Cited by 515Reliability and Agreement in MeasurementPsychometric Methodologies and TestingDelphi Technique in Research

The DOI matches its Crossref record; 32 of the 33 references it cites were found in a registry or an index.

A disagreement about within-group agreement: disentangling issues of consistency versus consensus

Kozlowski, Steve W., Hattrup, Keith·1992·Journal of Applied Psychology

Open this paper in CoChat — free account

Abstract

James, Demaree, and Wolf (1984) developed an indes, r WG , for assessing within-group agreement appropriate when only a single target is rated. The assessment of interperceiver agreement in such situations is of particular relevance to the composition model for climate. Schmidt and Hunter (1989) have criticized the conceptual foundation of r WG because it is not consistent with the classical model of reliability. They proposed an alternative approach, the use of the rating standard deviation (SD X ), the standard error of the rating mean (SE M ), and the associated confidence intervals for SE M to index interrater agreement. This comment argues that the critique of r WG dit not clearly distinguish the concepts of interrater consensus (i.e., agreement) and interrater consistency (i.e., reliability)

Integrity signals

Registry

Crossref · 10.1037/0021-9010.77.2.161

Cites

32 of 32 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
The Social Psychology of Organizations.
Hackman, J. R., Katz, D., & Kahn, R. L. (1979) · Administrative Science Quarterly · doi:10.2307/2989929 · Cited by 12,243
Weighted kappa: nominal scale agreement provision for scaled disagreement or partial credit
Cohen, J. (1968) · Psychological Bulletin · doi:10.1037/h0026256 · Cited by 8,736
Estimating within-group interrater reliability with and without response bias
James, L. R., Demaree, R. G., & Wolf, G. (1984) · Journal of Applied Psychology · doi:10.1037/0021-9010.69.1.85 · Cited by 4,774
TRANSFER OF TRAINING: A REVIEW AND DIRECTIONS FOR FUTURE RESEARCH
Baldwin, T. T., & Ford, J. K. (1988) · Personnel Psychology · doi:10.1111/j.1744-6570.1988.tb00632.x · Cited by 3,662
International Review of Industrial and Organizational Psychology
Cooper, C. L., & Robertson, I. T. (2003) · Wiley eBooks · doi:10.1002/0470013311.oth1 · Cited by 2,787
Aggregation bias in estimates of perceptual agreement.
James, L. R. (1982) · Journal of Applied Psychology · doi:10.1037/0021-9010.67.2.219 · Cited by 2,139
Personality, affect, and behavior in groups
George, J. M. (1990) · Journal of Applied Psychology · doi:10.1037/0021-9010.75.2.107 · Cited by 1,372
Employee and customer perceptions of service in banks: Replication and extension.
Schneider, B., & Bowen, D. E. (1985) · Journal of Applied Psychology · doi:10.1037/0021-9010.70.3.423 · Cited by 1,344

Flagged first, then by citations

Show all 33 references

1 of the 33 references couldn’t be matched to a known paper.

Sorted by citations

Items 201–300 of 515

Bridging the implementation gaps in the knowledge management system for enhancing corporate performance
LIN, C., & Tseng, S. (2005) · Expert Systems with Applications · doi:10.1016/j.eswa.2005.01.015 · Cited by 64
Do Individual Perceptions of Group Cohesion Reflect Shared Beliefs?
Carron, A. V., Brawley, L. R., Eys, M., Bray, S. R., Dorsch, K. D., Estabrooks, P. A., Hall, C. R., Hardy, J., Hausenblas, H. A., Madison, R., et al. (2003) · Small Group Research · doi:10.1177/1046496403254274 · Cited by 64
Situation-based measurement of the full range of leadership model — Development and validation of a situational judgment test
Peus, C. V., Braun, S. H., & Frey, D. (2013) · The Leadership Quarterly · doi:10.1016/j.leaqua.2013.07.006 · Cited by 71
Knowledge Management Enablers, Processes, and Organizational Performance: An Integration and Empirical Examination
Lee, H., & Choi, B. (2000) · Cited by 62
Perceived Combat Readiness as Collective Efficacy: Individual- and Group-Level Analysis
Shamir, B., Brainin, E., Zakay, E., & Popper, M. (2000) · Military Psychology · doi:10.1207/s15327876mp1202_2 · Cited by 61
Quality and strength of patient safety climate on medical-surgical units
Hughes, L., Chang, Y., & Mark, B. A. (2009) · Health Care Management Review · doi:10.1097/01.hmr.0000342976.07179.3a · Cited by 59
A Meta-Analysis of Cohesion and Performance
Gully, S. M., Devine, D. J., & Whitney, D. J. (2012) · Small Group Research · doi:10.1177/1046496412468069 · Cited by 58
A contingent approach to the role of human capital and competencies on firm strategy
Díaz-Fernández, M., Cabrales, Á. L., & Cabrera, R. V. (2014) · BRQ Business Research Quarterly · doi:10.1016/j.brq.2014.01.002 · Cited by 57
When Experts Disagree: Response Aggregation and its Consequences in Expert Surveys
Lindstädt, R., Proksch, S., & Slapin, J. B. (2018) · Political Science Research and Methods · doi:10.1017/psrm.2018.52 · Cited by 57
Identifying Group Task Satisfaction at Work
Mason, C., & Griffin, M. A. (2003) · Small Group Research · doi:10.1177/1046496403252153 · Cited by 57
R&D project team climate and team performance in Korea: A multidimensional approach
Kim, Y., & Lee, B.-H. (1995) · R and D Management · doi:10.1111/j.1467-9310.1995.tb00910.x · Cited by 57
Shared leadership and relationship conflict in teams: The moderating role of team power base diversity
Sinha, R., Chiu, C., & Srinivas, S. B. (2021) · Journal of Organizational Behavior · doi:10.1002/job.2515 · Cited by 55
Group Task Satisfaction
Mason, C., & Griffin, M. A. (2005) · Group & Organization Management · doi:10.1177/1059601104269522 · Cited by 55
Schools as Organizational Models: Implications for Examining School Effectiveness
Griffith, J. E. (2003) · The Elementary School Journal · doi:10.1086/499741 · Cited by 55
Differential Effects of Task and Reward Interdependence on Perceived Helping Behavior, Effort, and Group Performance
Allen, B. C., Sargent, L. D., & Bradley, L. M. (2003) · Small Group Research · doi:10.1177/1046496403257615 · Cited by 55
Coding ATC incident data using HFACS: Inter-coder consensus
Olsen, N. S. (2011) · Safety Science · doi:10.1016/j.ssci.2011.05.007 · Cited by 55
The dual influences of team cooperative and competitive orientations on the relationship between empowering leadership and team innovative behaviors
Lin, M., Zhang, X., Ng, B. C. S., & Zhong, L. (2022) · International Journal of Hospitality Management · doi:10.1016/j.ijhm.2022.103160 · Cited by 55
Predicting the performance and innovativeness of scientists and engineers.
Keller, R. T. (2011) · Journal of Applied Psychology · doi:10.1037/a0025332 · Cited by 54
A Multilevel Study of Abusive Supervision, Norms, and Personal Control on Counterproductive Work Behavior: A Theory of Planned Behavior Approach
Ju, D., Xu, M., Qin, X., & Spector, P. E. (2018) · Journal of Leadership & Organizational Studies · doi:10.1177/1548051818806289 · Cited by 58
Does 360‐degree feedback work in different industries?
Brutus, S., Fleenor, J. W., & London, M. (1998) · Journal of Management Development · doi:10.1108/eum0000000004487 · Cited by 54
Measuring core dimensions of organizational culture : A review of research and development of a new instrument
Delobbe, N., Haccoun, R. R., & Vandenberghe, C. (2002) · DIAL (Catholic University of Leuven) · Cited by 54
A LONGITUDINAL EXAMINATION OF CONCOMITANT CHANGES IN TEAM LEADERSHIP AND CUSTOMER SATISFACTION
Walker, A. G., Smither, J. W., & Waldman, D. A. (2008) · Personnel Psychology · doi:10.1111/j.1744-6570.2008.00122.x · Cited by 53
Good Effects of Bad Feelings: Negative Affectivity and Group Decision‐making
Bode, H. J. M. K., van Knippenberg, D., & van Ginkel, W. P. (2009) · British Journal of Management · doi:10.1111/j.1467-8551.2009.00675.x · Cited by 51
Worker word of mouth on the internet
González, S. M., & Bulchand‐Gidumal, J. (2016) · International Journal of Manpower · doi:10.1108/ijm-09-2014-0188 · Cited by 53
Academic Coping, Friendship Quality, and Student Engagement Associated with Student Quality of School Life: A Partial Least Square Analysis
Thien, L. M., & Razak, N. B. A. (2012) · Social Indicators Research · doi:10.1007/s11205-012-0077-x · Cited by 51
Humane Orientation as a New Cultural Dimension of the GLOBE Project
Schlösser, O., Fresé, M., Heintze, A.-M., Al-Najjar, M., Arciszewski, T., Besevegis, E., Bishop, G. D., Bonnes, M., Clegg, C., Drozda‐Senkowska, E., et al. (2012) · Journal of Cross-Cultural Psychology · doi:10.1177/0022022112465671 · Cited by 51
Improving Team Functioning and Performance in Age-Diverse Teams: Evaluation of a Leadership Training
Jungmann, F., Wegge, J., Liebermann, S. C., Ries, B. C., & Schmidt, K. (2020) · Work Aging and Retirement · doi:10.1093/workar/waaa003 · Cited by 60
Why and when proactive employees take charge at work: the role of servant leadership and prosocial motivation
Xu, A. J., Loi, R. C. H., & Chow, C. W. C. (2021) · European Journal of Work and Organizational Psychology · doi:10.1080/1359432x.2021.1934449 · Cited by 57
Transformational Leadership and Group Climate-Empirical Results from Symphony Orchestras
Boerner, S., & von Streit, C. F. (2005) · Journal of Leadership & Organizational Studies · doi:10.1177/107179190501200203 · Cited by 49
Do Satisfied Employees Satisfy Customers? Support-Services Staff Morale and Satisfaction Among Public School Administrators, Students, and Parents
Griffith, J. (2001) · Journal of Applied Social Psychology · doi:10.1111/j.1559-1816.2001.tb02744.x · Cited by 49
Evaluating implementation of the Transparency and Openness Promotion (TOP) guidelines: the TRUST process for rating journal policies, procedures, and practices
Mayo‐Wilson, E., Grant, S., Supplee, L. H., Kianersi, S., Amin, A., DeHaven, A., & Mellor, D. T. (2021) · Research Integrity and Peer Review · doi:10.1186/s41073-021-00112-8 · Cited by 50
Interrater reliability and agreement of performance ratings: A methodological comparison
Fleenor, J. W., Fleenor, J., & Grossnickle, W. F. (1996) · Journal of Business and Psychology · doi:10.1007/bf02249609 · Cited by 46
AGREEMENT AND RELIABILITY ASSESSMENTS FOR PERFORMANCE OF SENSORY DESCRIPTIVE PANEL
Bi, J. (2003) · Journal of Sensory Studies · doi:10.1111/j.1745-459x.2003.tb00373.x · Cited by 46
Data Aggregation in Multilevel Research: Best Practice Recommendations and Tools for Moving Forward
LeBreton, J. M., Moeller, A. N., & Wittmer, J. L. S. (2022) · Journal of Business and Psychology · doi:10.1007/s10869-022-09853-9 · Cited by 48
Statement validity assessment: Inter‐rater reliability of criteria‐based content analysis in the mock‐crime paradigm
Gödert, H. W., Gamer, M., Rill, H., & Vossel, G. (2005) · Legal and Criminological Psychology · doi:10.1348/135532505x52680 · Cited by 45
From errors to OCBs and creativity: A multilevel mediation mechanism of workplace gratitude
Chen, L., Guo, Y., Song, L. J., & Lyu, B. (2020) · Current Psychology · doi:10.1007/s12144-020-01120-5 · Cited by 48
A Framework for Analyzing Levels of AnalysisIssues in Studies of E-Collaboration
Gallivan, M. J., & Benunan-Fich, R. (2005) · IEEE Transactions on Professional Communication · doi:10.1109/tpc.2005.843301 · Cited by 41
How do Individual‐Level Factors Affect the Creative Solution Formation Process of Teams?
Zhang, W., Zhang, Q., & Song, M. (2015) · Creativity and Innovation Management · doi:10.1111/caim.12127 · Cited by 42
Both angel and devil: The suppressing effect of transformational leadership on proactive employee’s career satisfaction
Li, J., & Yuan, B. (2017) · International Journal of Hospitality Management · doi:10.1016/j.ijhm.2017.06.008 · Cited by 47
The influence of the structure of social networks on academic spin-offs’ entrepreneurial orientation
Diánez‐González, J. P., & Camelo‐Ordaz, C. (2017) · Industrial Marketing Management · doi:10.1016/j.indmarman.2017.12.009 · Cited by 46
Innovation adoption as facilitated by a change-oriented workplace
Becan, J. E., Knight, D. K., & Flynn, P. M. (2011) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2011.10.014 · Cited by 41
Consequences of Collective-Focused Leadership and Differentiated Individual-Focused Leadership
Kunze, F., de Jong, S. B., & Bruch, H. (2013) · Journal of Management · doi:10.1177/0149206313498903 · Cited by 51
Introducing a scalable peer feedback system for learning teams
O’Neill, T., Larson, N., Smith, J. L., Donia, M. B. L., Deng, C., Rosehart, W., & Brennan, R. W. (2018) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2018.1526256 · Cited by 41
Exploring the Processes Underlying Within-Group Homogeneity
Mason, C. (2006) · Small Group Research · doi:10.1177/1046496406288972 · Cited by 41
A PRACTITIONER‐BASED ANALYSIS OF INTERVIEWER JOB EXPERTISE AND SCALE FORMAT AS CONTEXTUAL FACTORS IN SITUATIONAL INTERVIEWS
Maurer, S. D. (2002) · Personnel Psychology · doi:10.1111/j.1744-6570.2002.tb00112.x · Cited by 40
An Empirical Examination of a Model of Social Climate in Elementary Schools
Griffith, J. E. (1995) · Basic and Applied Social Psychology · doi:10.1080/01973533.1995.9646134 · Cited by 39
Examination of the Discriminant, Convergent, and Criterion‐Related Validity of Self‐Ratings on the Emotional Competence Inventory
Byrne, J. C., Dominick, P. G., Smither, J. W., & Reilly, R. R. (2007) · International Journal of Selection and Assessment · doi:10.1111/j.1468-2389.2007.00393.x · Cited by 39
Shared leadership and group interaction styles in problem-solving virtual teams
Balthazard, P. A., Waldman, D. A., Howell, J. M., & ATWATER, L. E. (2004) · Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.2004.1265159 · Cited by 41
The Role of Organizational Emotional Memory on Declarative and Procedural Memory and Firm Innovativeness
Akgün, A., Keskin, H., & Byrne, J. (2012) · Journal of Product Innovation Management · doi:10.1111/j.1540-5885.2012.00916.x · Cited by 57
DO SITUATIONAL VARIABLES ACT AS SUBSTANTIVE CAUSES OF RELATIONSHIPS BETWEEN INDIVIDUAL DIFFERENCE VARIABLES? TWO LARGE‐SCALE TESTS OF “COMMON CAUSE” MODELS
Burke, M. J., Rupinski, M. T., Dunlap, W. P., & Davison, H. K. (1996) · Personnel Psychology · doi:10.1111/j.1744-6570.1996.tb01585.x · Cited by 38
THE EFFECT OF PERSONAL VALUES, ORGANIZATIONAL CULTURE, AND PERSON- ORGANIZATION FIT ON INDIVIDUAL OUTCOMES IN THE RESTAURANT INDUSTRY
Tepeci, M. (2001) · Cited by 36
Lack of consensus among competency ratings of the same occupation: Noise or substance?
Lievens, F., Sánchez, J. I., Bartram, D., & Brown, A. (2010) · Journal of Applied Psychology · doi:10.1037/a0018035 · Cited by 35
Both a curse and a blessing? A social cognitive approach to the paradoxical effects of leader narcissism
Liu, X., Zheng, X., Li, N., Yu, Y., Harms, P. D., & Yang, J. (2021) · Human Relations · doi:10.1177/00187267211015925 · Cited by 40
Reliability studies of incident coding systems in high hazard industries: A narrative review of study methodology
Olsen, N. S. (2012) · Applied Ergonomics · doi:10.1016/j.apergo.2012.06.009 · Cited by 35
Functional Diversity, Absorptive Capability and Product Success: The Moderating Role of Project Complexity in New Product Development Teams
Açıkgöz, A., Günsel, A., Kuzey, C., & Seçgin, G. (2015) · Creativity and Innovation Management · doi:10.1111/caim.12155 · Cited by 34
Development and reliability of a quantitative personal hygiene assessment tool
Delea, M. G., Snyder, J. S., Woreta, M., Zewudie, K., Solomon, A. W., & Freeman, M. C. (2020) · International Journal of Hygiene and Environmental Health · doi:10.1016/j.ijheh.2020.113521 · Cited by 35
A Test of the Impact of Collective Efficacy in Routine and Novel Performance Environments
Marks, M. A. (1999) · Human Performance · doi:10.1207/s15327043hup1203&4_5 · Cited by 34
An Empirical Investigation of Kaizen Event Effectiveness: Outcomes and Critical Success Factors
Farris, J. A. (2006) · VTechWorks (Virginia Tech) · Cited by 34
Grading as a Reform Effort: Do Standards‐Based Grades Converge With Test Scores?
Welsh, M. E., D’Agostino, J. V., & Kaniskan, B. (2013) · Educational Measurement Issues and Practice · doi:10.1111/emip.12009 · Cited by 33
Rethinking the role of team mindfulness in team relationship conflict: A conflict management perspective
Ni, D., Zheng, X., & Liang, L. H. (2021) · Journal of Organizational Behavior · doi:10.1002/job.2588 · Cited by 34
Student and Parent Perceptions of School Social Environment: Are They Group Based?
Griffith, J. E. (1997) · The Elementary School Journal · doi:10.1086/461888 · Cited by 32
Assessing Interrater Agreement via the Average Deviation Index Given a Variety of Theoretical and Methodological Problems
Smith‐Crowe, K., Burke, M. J., Kouchaki, M., & Signal, S. M. (2012) · Organizational Research Methods · doi:10.1177/1094428112465898 · Cited by 33
Can Union Voice Make a Difference? The Effect of Union Citizenship Behavior on Employee Absence
Deery, S. J., Iverson, R. D., Buttigieg, D. M., & Zatzick, C. D. (2013) · Human Resource Management · doi:10.1002/hrm.21549 · Cited by 34
MEASURING THE COMMUNITY IN ONLINE CLASSES
Rubin, B. (2013) · Online Learning · doi:10.24059/olj.v17i3.344 · Cited by 31
Fear Appeals, Message Processing Cues, and Credibility in the Websites of Violent, Ideological, and Nonideological Groups
Dunbar, N. E., Connelly, S., Jensen, M. L., Adame, B. J., Rozzell, B. L., Griffith, J. A., & O’Hair, H. D. (2014) · Journal of Computer-Mediated Communication · doi:10.1111/jcc4.12083 · Cited by 31
Disentangling Strategic Consensus: Strategic Consensus Types, Psychological Bonds, and Their Effects on Strategic Climate
Bragaw, N. A., & Misangyi, V. F. (2019) · Academy of Management Review · doi:10.5465/amr.2016.0228 · Cited by 37
Promoting orchestral performance: the interplay between musicians' mood and a conductor's leadership style
Boerner, S., & von Streit, C. F. (2006) · Psychology of Music · doi:10.1177/0305735607068891 · Cited by 31
Personality Composition, Affective Tie and Knowledge Sharing: A Team Level Analysis
Hsu, B., Wu, W.-L., & Yeh, R.-S. (2007) · Portland International Conference on Management of Engineering and Technology (PICMET) · doi:10.1109/picmet.2007.4349592 · Cited by 30
Multilevel Methods and Statistics: The Next Frontier
Eckardt, R., Yammarino, F. J., Dionne, S. D., & Spain, S. M. (2020) · Organizational Research Methods · doi:10.1177/1094428120959827 · Cited by 32
How and when team average individual mindfulness facilitates team mindfulness: The roles of team relational stress and team individual mindfulness diversity
Liu, X., Zheng, X., Yu, Y., Owens, B. P., & Ni, D. (2021) · Journal of Organizational Behavior · doi:10.1002/job.2564 · Cited by 34
Using Consensus as a Criterion for Groupness
Carron, A. V., Brawley, L. R., Bray, S. R., Eys, M., Dorsch, K. D., Estabrooks, P. A., Hall, C. R., Hardy, J., Hausenblas, H. A., Madison, R., et al. (2004) · Small Group Research · doi:10.1177/1046496404263923 · Cited by 30
Within-Group Agreement ( r WG ): Two Theoretical Parameters and their Estimators
Newman, D. A., & Sin, H. (2018) · Organizational Research Methods · doi:10.1177/1094428118809504 · Cited by 30
Assessing the reliability of student evaluations of teaching: choosing the right coefficient
Morley, D. D. (2013) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2013.796508 · Cited by 31
The mediating effect of psychological empowerment on the relationship between participative goal setting and team outcomes – a study in China
Lee, J., & Wei, F. (2011) · The International Journal of Human Resource Management · doi:10.1080/09585192.2011.540152 · Cited by 29
Social Categorization, Moral Disengagement, and Credibility of Ideological Group Websites
Connelly, S., Dunbar, N. E., Jensen, M. L., Griffith, J. A., Taylor, W. D., Johnson, G., Hughes, M., & Mumford, M. D. (2015) · Journal of Media Psychology Theories Methods and Applications · doi:10.1027/1864-1105/a000138 · Cited by 29
The Influence of Ownership on Performance: Stakeholder and Strategic Contingency Perspectives
Brouthers, K. D., Gelderman, M., & Arens, P. (2007) · Schmalenbach Business Review · doi:10.1007/bf03396749 · Cited by 28
Identifying Meaningful Subgroups of Adults With Severe Mental Illness
Rubin, W. V., & Panzano, P. C. (2002) · Psychiatric Services · doi:10.1176/appi.ps.53.4.452 · Cited by 27
Organizational climate and ineffectiveness: Evidence from 25 outdoor work crew divisions
Stetzer, A., Morgeson, F. P., & Anderson, E. L. (1997) · Journal of Quality Management · doi:10.1016/s1084-8568(97)90006-7 · Cited by 27
Using Multi-Informant Designs to Address Key Informant and Common Method Bias
Homburg, C., Klarmann, M., & Totzek, D. (2012) · Gabler Verlag eBooks · doi:10.1007/978-3-8349-3722-3_4 · Cited by 26
Methods for the measurement of consensual beliefs within groups.
Gideon, I. C. L., & Schaller, M. (1998) · Group Dynamics Theory Research and Practice · doi:10.1037//1089-2699.2.4.241 · Cited by 31
Group goal setting and group performance in a physical activity context
Burke, S. M., Shapcott, K. M., Carron, A. V., Bradshaw, M. H., & Estabrooks, P. A. (2010) · International Journal of Sport and Exercise Psychology · doi:10.1080/1612197x.2010.9671952 · Cited by 25
The roles of shared perceptions of individual job insecurity and job insecurity climate for work- and health-related outcomes: A multilevel approach
Låstad, L., Näswall, K., Berntson, E., Seddigh, A., & Sverke, M. (2016) · Economic and Industrial Democracy · doi:10.1177/0143831x16637129 · Cited by 25
Harnessing members' positive mood for team-directed learning behaviour and team innovation: The moderating role of perceived team feedback
Walter, F. H., & van der Vegt, G. S. (2012) · European Journal of Work and Organizational Psychology · doi:10.1080/1359432x.2012.660748 · Cited by 31
Customer mistreatment and unethical pro-organizational behavior: a daily diary study examining the roles of status threat
Ye, Y., Liu, P., & Zhang, L. (2023) · International Journal of Contemporary Hospitality Management · doi:10.1108/ijchm-01-2023-0021 · Cited by 24
How organizational stressors affect collective organizational citizenship behaviors in the French Police
Molines, M., Sanséau, P., & Adamovic, M. (2017) · International Journal of Public Sector Management · doi:10.1108/ijpsm-02-2016-0043 · Cited by 30
Videometric Measurement of Individual Characteristics in Difficult to Access Subject Pools: Demonstrating with Ceos
Hill, A., Petrenko, O. V., Ridge, J. W., & Aime, F. (2019) · Emerald Group Publishing Limited eBooks · doi:10.1108/s1479-838720190000011005 · Cited by 24
Differences Between Students’ and Teachers’ Fairness Perceptions: Exploring the Potential of a Self-Administered Questionnaire to Improve Teachers’ Assessment Practices
Sonnleitner, P., & Kovacs, C. (2020) · Frontiers in Education · doi:10.3389/feduc.2020.00017 · Cited by 27
Team zhongyong thinking and team incremental and radical creativity
Lang, Y., Zhang, F., & Jun, Y. (2022) · Journal of Innovation & Knowledge · doi:10.1016/j.jik.2022.100196 · Cited by 24
Increased Business Value for Positive Job Attitudes during Economic Recessions: A Meta-Analysis and SEM Analysis
Harter, J. K., Schmidt, F. L., Agrawal, S., Plowman, S. K., & Blue, A. T. (2020) · Human Performance · doi:10.1080/08959285.2020.1758702 · Cited by 27
Linkages of School Structural and Socioenvironmental Characteristics to Parental Satisfaction With Public Education and Student Academic Achievement
Griffith, J. E. (1997) · Journal of Applied Social Psychology · doi:10.1111/j.1559-1816.1997.tb00627.x · Cited by 23
Team Foresight in New Product Development Projects
Açıkgöz, A., Günsel, A., Kuzey, C., & Zaim, H. (2015) · Group Decision and Negotiation · doi:10.1007/s10726-015-9443-9 · Cited by 22
In search of demanded competencies: designing superior compensation systems
Díaz-Fernández, M., Cabrales, Á. L., & Cabrera, R. V. (2012) · The International Journal of Human Resource Management · doi:10.1080/09585192.2012.677461 · Cited by 22
Cohesion as Shared Beliefs in Exercise Classes
Burke, S. M., Carron, A. V., Patterson, M. M., Estabrooks, P. A., Hill, J. L., Loughead, T. M., Rosenkranz, S. R., & Spink, K. S. (2005) · Small Group Research · doi:10.1177/1046496404267942 · Cited by 22
Exploring the Role of Self-Confidence, Need-for-Cognition, and the Degree of IT Support on Individual Creativity: Multilevel Analysis Approach
Hahn, M. H., & Lee, K. C. (2016) · Current Psychology · doi:10.1007/s12144-016-9445-z · Cited by 23
Measuring and Monitoring the Dynamics of Team Cohesion: Methods, Emerging Tools, and Advanced Technologies
Santoro, J. M., Dixon, A. J., Chang, C.-H. D., & Kozlowski, S. W. J. (2015) · Emerald Group Publishing Limited eBooks · doi:10.1108/s1534-085620150000017006 · Cited by 23
Self-citation
Assessment of Data Quality for Evaluations of Manual Pavement Distress
Bogus, S. M., Migliaccio, G. C., & Cordova, A. A. (2010) · Transportation Research Record Journal of the Transportation Research Board · doi:10.3141/2170-01 · Cited by 21
The Relationship Between Unlearning and Innovation Ambidexterity with the Performance of New Product Development Teams
Açıkgöz, A., Demirkan, I., Latham, G. P., & Kuzey, C. (2021) · Group Decision and Negotiation · doi:10.1007/s10726-021-09743-0 · Cited by 20
Shared Leadership Regulates Operational Team Performance in the Presence of Extreme Decisional Consensus/Conflict: Evidences from Business Process Reengineering
Bruccoleri, M., Riccobono, F., & Größler, A. (2018) · Decision Sciences · doi:10.1111/deci.12325 · Cited by 25
Open-plan office, employees’ enactment, interpretations and reactions to territoriality
Monaghan, N., & Ayoko, O. B. (2019) · International Journal of Manpower · doi:10.1108/ijm-10-2017-0270 · Cited by 21
When change leadership impacts commitment to change and when it doesn't: a multi-level multi-dimensional investigation
Liu, Y. (2009) · SMARTech Repository (Georgia Institute of Technology) · Cited by 20

Authors: Kozlowski, S. W., & Hattrup, K.
Affiliations: Michigan State University (US)
ORCID: Kozlowski, Steve W.
Venue: Journal of Applied Psychology
Publisher: American Psychological Association (APA)
Published: 1992-04
Volume: 77
Issue: 2
Pages: 161-167
ISSN: 0021-9010 (ISSN-L)
1939-1854
DOI: 10.1037/0021-9010.77.2.161
OpenAlex: W2069294908
Cited by: 514
References: 33
Citations by year: 2026: 8 · 2025: 6 · 2024: 9 · 2023: 12 · 2022: 5 · 2021: 23 · 2020: 11 · 2019: 15 · 2018: 16 · 2017: 15 · 2016: 19 · 2015: 27 · 2014: 24 · 2013: 17 · 2012: 26
FWCI: 12.78
Type: journal article
Language: en
Open access: closed
Locations: Journal of Applied Psychology (publishedVersion)
Topics: Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
Social Sciences › Sociology and Political Science › Delphi Technique in Research
Keywords: interobserver agreement, confidence intervals, classical test theory, reliability statistics

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

A disagreement about within-group agreement: disentangling issues of consistency versus consensus

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks