A disagreement about within-group agreement: disentangling issues of consistency versus consensus
Article Abstract:
James, Demaree, and Wolf (1984) developed an index, Rwg, for assessing within-group agreement appropriate when only a single target is rated. The assessment of interperceiver agreement in such situations is of particular relevance to the composition model for climate. Schmidt and Hunter (1989) have criticized the conceptual foundation of Rwg because it is not consistent with the classical model of reliability. They proposed an alternative approach, the use of the rating standard deviation (SDx), the standard deviation error of the rating mean (SEm), and the associated confidence intervals for SEm to index interrater agreement. This comment argues that the critique of Rwg did not clearly distinguish the concepts of interrater consensus (i.e., agreement) and interrater consistency (i.e., reliability). When the distinction between agreement and reliability is carefully drawn, the critique of Rwg is shown to divert attention from more critical problems in the assessment of agreement. A comparison demonstrates that the approach for assessing within-group agreement proposed by Schmidt and Hunter (1989) suffers from several limitations. The comment concludes that Rwg should not be used as an index of interrater reliability but, within certain bounds, it is suitable as an index of within-group interrater agreement and that SDx and SEm are not suitable substitutes for extant indexes of interrater agreement. (Reprinted by permission of the publisher.)
Publication Name: Journal of Applied Psychology
Subject: Social sciences
ISSN: 0021-9010
Year: 1992
User Contributions:
Comment about this article or add new information about this topic:
A longitudinal investigation of newcomer expectations, early socialization outcomes, and the moderating effects of role development factors
Article Abstract:
This longitudinal study examined hypothesized moderating effects of role development on the link between unmet expectations and socialization outcomes. Data were collected from 248 new hires before organizational entry and at an average of 4 weeks after entry. Three role expectations - conflict, clarity, and acceptance - were measured at both data collections. Two role development constructs - leader-member exchange (LMX) and team-member exchange (TMX) - and three socialization outcomes - organizational commitment, turnover intention, and job satisfaction - were measured after entry. Results showed that met expectations, LMX and TMX were significant predictors of all outcomes. In addition, LMX and TMX were significantly moderated several relationships, such that favorable role development relationships with supervisors or work groups ameliorated the negative effects of unmet expectations. Research and applied implications are discussed. (Reprinted by permission of the publisher.)
Publication Name: Journal of Applied Psychology
Subject: Social sciences
ISSN: 0021-9010
Year: 1995
User Contributions:
Comment about this article or add new information about this topic:
Integration of climate and leadership: examination of a neglected issue
Article Abstract:
The research domains of climate and leadership are implicitly entwined, yet there has been little theoretical development or empirical research directly addressing the linkage between these constructs. In this study we developed a framework integrating interactionist-based climate theory (Schneider 1983b) and the vertical dyad linkage theory of leadership (Graen, 1976; Graen & Cashman, 1975). Three propositions derived from the integrative framework were supported. Subordinates with high-quality supervisor relations had more positive climate perceptions, exhibited greater consensus on climate, and had perceptions more similar to those of their supervisors than did subordinates with low-quality relations. The value of a synthesis of the two research domains is discussed. (Reprinted by permission of the publisher.)
Publication Name: Journal of Applied Psychology
Subject: Social sciences
ISSN: 0021-9010
Year: 1989
User Contributions:
Comment about this article or add new information about this topic:
- Abstracts: Context effects at encoding and judgment in consumption settings: the role of cognitive resources. Schema congruity as a basis for product evaluation
- Abstracts: When timing matters: the influence of temporal distance on consumers' affective and persuasive responses
- Abstracts: The role of prescribed and nonprescribed behaviors in estimating the dollar value of performance. On seeking moderator variables in the meta-analysis of correlational data: a Monte Carlo investigation of statistical power and resistance to Type I error
- Abstracts: Definitely not a breeze: extending an operant model of effective supervision to teams. Development of an operant-based taxonomy and observational index of supervisory behavior
- Abstracts: Housing quotas: pro and con. The rewards of racial prejudice. Housing: far from fair