Apples and Oranges: An Empirical Comparison of Commonly Used Indices of Interrater Agreement.
The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
Empirical comparison of common indices of interrater agreement indicated that the indices are not directly comparable in regard to the magnitude of the estimates produced or the information conveye...
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Weighted kappa: nominal scale agreement provision for scaled disagreement or partial credit
Cohen, J. (1968) · Psychological Bulletin · doi:10.1037/h0026256 · Cited by 8,736
Aggregation bias in estimates of perceptual agreement.
James, L. R. (1982) · Journal of Applied Psychology · doi:10.1037/0021-9010.67.2.219 · Cited by 2,139
Estimation of the reliability of ratings.
Ebel, R. L. (1951) · Psychometrika · doi:10.1007/bf02288803 · Cited by 976 · cited 1×
“For example, Ilgen and Fujii (1976) used behaviorally based ratings by four trained observers and by workgroup members to measure leader consideration and initiating structure.”
Method
Cited by
Development and validation of work–family conflict and family–work conflict scales
Netemeyer, R. G., Boles, J. S., & McMurrian, R. (1996) · Journal of Applied Psychology · doi:10.1037/0021-9010.81.4.400 · Cited by 3,864
Jansen, J. J. P., Van Den Bosch, F. A. J., & Volberda, H. W. (2006) · Management Science · doi:10.1287/mnsc.1060.0576 · Cited by 3,705
“001 levels (Jones et al. 1983).”
BackgroundValidation Guidelines for IS Positivist Research
Straub, D., & Gefen, D. (2004) · Communications of the Association for Information Systems · doi:10.17705/1cais.01324 · Cited by 2,797
CONDUCTING INTERORGANIZATIONAL RESEARCH USING KEY INFORMANTS.
KUMAR, N., STERN, L. W., & ANDERSON, J. C. (1993) · Academy of Management Journal · doi:10.2307/256824 · Cited by 2,467
Managing Potential and Realized Absorptive Capacity: How do Organizational Antecedents Matter?
Jansen, J. J. P., Van Den Bosch, F. A. J., & Volberda, H. W. (2005) · Academy of Management Journal · doi:10.5465/amj.2005.19573106 · Cited by 2,232
ZAHRA, S. A. (1996) · Academy of Management Journal · doi:10.2307/257076 · Cited by 1,050
Managing foreign subsidiaries: agents of headquarters, or an interdependent network?
O?Donnell, S. W. (2000) · Strategic Management Journal · doi:10.1002/(sici)1097-0266(200005)21:5<525::aid-smj104>3.0.co;2-q · Cited by 793
Chatman, J. A., & Jehn, K. A. (1994) · Academy of Management Journal · doi:10.2307/256699 · Cited by 785
WORK-FAMILY HUMAN RESOURCE BUNDLES AND PERCEIVED ORGANIZATIONAL PERFORMANCE.
Perry-Smith, J. E., & Blum, T. C. (2000) · Academy of Management Journal · doi:10.2307/1556339 · Cited by 748
Zhou, J. (1998) · Journal of Applied Psychology · doi:10.1037//0021-9010.83.2.261 · Cited by 645
PERSONAL AND STRUCTURAL DETERMINANTS OF THE PACE OF STRATEGIC DECISION MAKING.
WALLY, S., & BAUM, J. R. (1994) · Academy of Management Journal · doi:10.2307/256605 · Cited by 579
Construct validity of an objective (entropy) categorical measure of diversification strategy
Hoskisson, R. E., Hitt, M. A., Johnson, R. A., & Moesel, D. D. (1993) · Strategic Management Journal · doi:10.1002/smj.4250140305 · Cited by 569
Modeling the Multilevel Determinants of Top Management Team Behavioral Integration
Simsek, Z., Veiga, J. F., Lubatkin, M. H., & Dino, R. N. (2005) · Academy of Management Journal · doi:10.5465/amj.2005.15993139 · Cited by 540
A disagreement about within-group agreement: disentangling issues of consistency versus consensus
Kozlowski, S. W., & Hattrup, K. (1992) · Journal of Applied Psychology · doi:10.1037/0021-9010.77.2.161 · Cited by 514
INSTITUTIONALIZING IDENTITY: SYMBOLIC ISOMORPHISM AND ORGANIZATIONAL NAMES.
Glynn, M. A., & Abzug, R. (2002) · Academy of Management Journal · doi:10.2307/3069296 · Cited by 491
On Average Deviation Indices for Estimating Interrater Agreement
Burke, M. J., Finkelstein, L. M., & Dusig, M. S. (1999) · Organizational Research Methods · doi:10.1177/109442819921004 · Cited by 462
Goal setting: A meta-analytic examination of the empirical evidence.
Tubbs, M. E. (1986) · Journal of Applied Psychology · doi:10.1037//0021-9010.71.3.474 · Cited by 455
CASE SURVEY METHODOLOGY: QUANTITATIVE ANALYSIS OF PATTERNS ACROSS CASE STUDIES.
LARSSON, R. (1993) · Academy of Management Journal · doi:10.2307/256820 · Cited by 443
CONCEALMENT OF NEGATIVE ORGANIZATIONAL OUTCOMES: AN AGENCY THEORY PERSPECTIVE.
ABRAHAMSON, E., & PARK, C. (1994) · Academy of Management Journal · doi:10.2307/256674 · Cited by 408
EDWARDS, J. R. (1993) · Personnel Psychology · doi:10.1111/j.1744-6570.1993.tb00889.x · Cited by 369
Rating reliability and representation validity in scenic landscape assessments
Palmer, J. F., & Hoffman, R. E. (2001) · Landscape and Urban Planning · doi:10.1016/s0169-2046(01)00133-5 · Cited by 367
Alexiev, A. S., Jansen, J. J. P., Van den Bosch, F. A. J., & Volberda, H. W. (2010) · Journal of Management Studies · doi:10.1111/j.1467-6486.2010.00919.x · Cited by 349
Disentangling the antecedents of ambidexterity: Exploration and exploitation
Koryak, O., Lockett, A., Hayton, J., Nicolaou, N., & Mole, K. (2018) · Research Policy · doi:10.1016/j.respol.2017.12.003 · Cited by 335
DO CHAMELEONS GET AHEAD? THE EFFECTS OF SELF-MONITORING ON MANAGERIAL CAREERS.
KILDUFF, M., & DAY, D. V. (1994) · Academy of Management Journal · doi:10.2307/256612 · Cited by 325
Kotha, S., & Swamidass, P. M. (2000) · Journal of Operations Management · doi:10.1016/s0272-6963(99)00025-x · Cited by 312
PERFORMANCE OF ACQUISITIONS OF DISTRESSED FIRMS.
BRUTON, G. D., OVIATT, B. M., & WHITE, M. A. (1994) · Academy of Management Journal · doi:10.2307/256607 · Cited by 288
The commercialization of user innovations: the development of the rodeo kayak industry
Hienerth, C. (2006) · R and D Management · doi:10.1111/j.1467-9310.2006.00430.x · Cited by 283
Why Firms Engage in Corruption: A Top Management Perspective
Collins, J. D., Uhlenbruck, K., & Rodriguez, P. (2009) · Journal of Business Ethics · doi:10.1007/s10551-008-9872-3 · Cited by 271
DOWNSIZING IN PRIVATIZED FIRMS IN RUSSIA, UKRAINE, AND BELARUS.
Filatotchev, I., Buck, T., & Zhukov, V. (2000) · Academy of Management Journal · doi:10.2307/1556396 · Cited by 269
ORGANIZATION-LEVEL DETERMINANTS OF WOMEN IN MANAGEMENT.
BLUM, T. C., FIELDS, D. L., & GOODMAN, J. S. (1994) · Academy of Management Journal · doi:10.2307/256829 · Cited by 267
Fields, D., & Bocarnea, M. C. (2005) · Encyclopedia of Social Measurement · doi:10.1016/b0-12-369398-5/00528-4 · Cited by 262
Lechner, C., Frankenberger, K., & Floyd, S. W. (2010) · Academy of Management Journal · doi:10.5465/amj.2010.52814620 · Cited by 258
Volberda, H. W., van der Weerdt, N., Verwaal, E., Stienstra, M., & Verdu, A. J. (2012) · Organization Science · doi:10.1287/orsc.1110.0687 · Cited by 254
Interdisciplinary approaches to job design: A constructive replication with extensions.
Campion, M. A. (1988) · Journal of Applied Psychology · doi:10.1037/0021-9010.73.3.467 · Cited by 254
Metadata
- Authors
- Jones, A. P., Johnson, L. A., Butler, M. C., & Main, D. S.
- Venue
- Academy of Management Journal
- Publisher
- Academy of Management
- Published
- 1983-09-01
- Volume
- 26
- Issue
- 3
- Pages
- 507-519
- ISSN
- 0001-4273 (ISSN-L)
- 1948-0989
- OpenAlex
- W2087910543
- Cited by
- 122
- References
- 3
- FWCI
- 1.70
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.