The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
MEASUREMENT ERROR IN RESEARCH ON HUMAN RESOURCES and FIRM PERFORMANCE: HOW MUCH ERROR IS THERE AND HOW DOES IT INFLUENCE EFFECT SIZE ESTIMATES?
Abstract
Studies of the relationship between human resource (HR) practices and firm performance typically use a single respondent to assess firm level HR practices or HR effectiveness. However, previous research in other substantive areas suggests that rater differences are a potentially important source of measurement error. We demonstrate analytically the potential consequences of both random and systematic measurement error in research on HR and firm performance. However, our main focus is on random error and we show how generalizability theory can be applied to obtain better estimates of reliability by simultaneously recognizing multiple sources (e.g., items, raters) of random measurement error. These more inclusive reliability estimates, in turn, offer the possibility of more precisely quantifying substantive relationships in the HR and firm performance literature. In our sample, reliabilities (as estimated by generalizability coefficients) for single‐rater assessments of HR variables were generally below .50. This degree of measurement error, if present in substantive studies on HR and firm performance, could lead to considerable bias, given that an unstandardized regression coefficient is corrected for measurement error in the independent variable by dividing by its reliability coefficient (not its square root). We also found only limited convergent validity between HR and line managers ratings of a second type of HR measure, HR effectiveness. In general, our findings suggest that future researchers need to devote greater attention to measurement error and construct validity issues. Our study provides an example of how generalizability theory can be useful in this pursuit.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Firm Resources and Sustained Competitive Advantage
Barney, J. (1991) · Journal of Management · doi:10.1177/014920639101700108 · Cited by 48,334
Firm resources and sustained competitive advantage
Barney, J. B. (2004) · Advances in Strategic Management · doi:10.1016/s0742-3322(00)17018-4 · Cited by 38,152
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116
HUSELID, M. A. (1995) · Academy of Management Journal · doi:10.2307/256741 · Cited by 9,342
Estimating within-group interrater reliability with and without response bias
James, L. R., Demaree, R. G., & Wolf, G. (1984) · Journal of Applied Psychology · doi:10.1037/0021-9010.69.1.85 · Cited by 4,774
Cohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003
Dess, G. G., & Robinson, R. B. (1984) · Strategic Management Journal · doi:10.1002/smj.4250050306 · Cited by 3,337
EFFECTS OF HUMAN RESOURCE SYSTEMS ON MANUFACTURING PERFORMANCE AND TURNOVER.
Arthur, J. B. (1994) · Academy of Management Journal · doi:10.2307/256705 · Cited by 3,210
THE IMPACT OF HUMAN RESOURCE MANAGEMENT ON ORGANIZATIONAL PERFORMANCE: PROGRESS AND PROSPECTS.
BECKER, B., & GERHART, B. (1996) · Academy of Management Journal · doi:10.2307/256712 · Cited by 3,152
Self-citationTheoretical Perspectives for Strategic Human Resource Management
Wright, P. M., & McMahan, G. C. (1992) · Journal of Management · doi:10.1177/014920639201800205 · Cited by 2,742
Self-citationThe Effects of Human Resource Management Practices on Productivity: A Study of Steel Finishing Lines
Ichniowski, C., Shaw, K. L., & Prennushi, G. (1997) · American Economic Review · Cited by 2,512
HUMAN RESOURCE MANAGEMENT, MANUFACTURING STRATEGY, AND FIRM PERFORMANCE.
YOUNDT, M. A., SNELL, S. A., DEAN, Jr., & LEPAK, D. P. (1996) · Academy of Management Journal · doi:10.2307/256714 · Cited by 2,272
Self-citationrwg: an assessment of within-group interrater agreement
James, L. R., Demaree, R. G., & Wolf, G. (1993) · Journal of Applied Psychology · doi:10.1037/0021-9010.78.2.306 · Cited by 2,221
Human Resource Systems and Sustained Competitive Advantage: A Competency-Based Perspective
Lado, A. A., & Wilson, M. C. (1994) · The Academy of Management Review · doi:10.2307/258742 · Cited by 2,144
Aggregation bias in estimates of perceptual agreement.
James, L. R. (1982) · Journal of Applied Psychology · doi:10.1037/0021-9010.67.2.219 · Cited by 2,139
HUSELID, M. A., JACKSON, S. E., & SCHULER, R. S. (1997) · Academy of Management Journal · doi:10.2307/257025 · Cited by 1,824
The Dependability of Behavioral Measurements: Theory of Generalizability for Scores and Profiles
Merrifield, P. R., Cronbach, L. J., Gleser, G. C., Nanda, H., & Rajaratnam, N. (1974) · American Educational Research Journal · doi:10.2307/1162145 · Cited by 1,819
Macduffie, J. P. (1995) · ILR Review · doi:10.1177/001979399504800201 · Cited by 1,809
Generalizability theory: a primer
(1992) · Choice Reviews Online · doi:10.5860/choice.29-4192 · Cited by 1,298
Cohen, P. (1980) · Evaluation and Program Planning · doi:10.1016/0149-7189(80)90009-9 · Cited by 1,112
Issues of fit in strategic human resource management: Implications for research
Delery, J. E. (1998) · Human Resource Management Review · doi:10.1016/s1053-4822(98)90006-7 · Cited by 1,034
Delery, J. E., & Doty, D. H. (1996) · Academy of Management Journal · doi:10.5465/256713 · Cited by 843
Schmidt, F. L. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.2.115 · Cited by 830
APPLICANT PERSONALITY, ORGANIZATIONAL CULTURE, AND ORGANIZATION ATTRACTION
JUDGE, T. A., & CABLE, D. M. (1997) · Personnel Psychology · doi:10.1111/j.1744-6570.1997.tb00912.x · Cited by 830
Schmidt, F. L. (1996) · Psychological Methods · doi:10.1037//1082-989x.1.2.115 · Cited by 783
What Works at Work: Overview and Assessment
ICHNIOWSKI, C., KOCHAN, T. A., LEVINE, D., OLSON, C., & STRAUSS, G. (1996) · Industrial Relations: A Journal of Economy and Society · doi:10.1111/j.1468-232x.1996.tb00409.x · Cited by 778
Statistical procedures and the justification of knowledge in psychological science.
Rosnow, R. L., & Rosenthal, R. (1989) · American Psychologist · doi:10.1037/0003-066x.44.10.1276 · Cited by 777
ORGANIZATIONAL DIFFERENCES IN MANAGERIAL COMPENSATION AND FINANCIAL PERFORMANCE.
Gerhart, B., & Milkovich, G. T. (1990) · Academy of Management Journal · doi:10.2307/256286 · Cited by 716
Self-citationStatistical procedures and the justification of knowledge in psychological science.
Rosnow, R. L., & Rosenthal, R. (1992) · Methodological issues & strategies in clinical research. · doi:10.1037/10109-027 · Cited by 652
Elements of Generalizability Theory
Brennan, R. L. (1992) · Medical Entomology and Zoology · Cited by 599
THE RELATIONSHIP OF STAFFING PRACTICES TO ORGANIZATIONAL LEVEL MEASURES OF PERFORMANCE
TERPSTRA, D. E., & ROZELL, E. J. (1993) · Personnel Psychology · doi:10.1111/j.1744-6570.1993.tb00866.x · Cited by 587
Seidler, J. (1974) · American Sociological Review · doi:10.2307/2094155 · Cited by 587
Linear Models for Unbalanced Data
Turner, D. (1989) · Technometrics · doi:10.1080/00401706.1989.10488483 · Cited by 582
Measurement error in psychological research: Lessons from 26 research scenarios.
Schmidt, F. L., & Hunter, J. E. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.2.199 · Cited by 567
Recommendations for APA test standards regarding construct, trait, or discriminant validity.
Campbell, D. T. (1960) · American Psychologist · doi:10.1037/h0048255 · Cited by 560
REMOVING THE FINANCIAL PERFORMANCE HALO FROM FORTUNE'S "MOST ADMIRED" COMPANIES.
BROWN, B., & PERRY, S. (1994) · Academy of Management Journal · doi:10.2307/256676 · Cited by 554
HUSELID, M. A., & BECKER, B. E. (1996) · Industrial Relations: A Journal of Economy and Society · doi:10.1111/j.1468-232x.1996.tb00413.x · Cited by 533
A disagreement about within-group agreement: disentangling issues of consistency versus consensus
Kozlowski, S. W., & Hattrup, K. (1992) · Journal of Applied Psychology · doi:10.1037/0021-9010.77.2.161 · Cited by 514
Comparative analysis of the reliability of job performance ratings.
Viswesvaran, C., Ones, D. S., & Schmidt, F. L. (1996) · Journal of Applied Psychology · doi:10.1037/0021-9010.81.5.557 · Cited by 505
CONFIGURATIONS OF ORGANIZATIONAL EFFECTIVENESS AND EFFICIENCY.
OSTROFF, C., & SCHMITT, N. (1993) · Academy of Management Journal · doi:10.2307/256814 · Cited by 423
WHAT EXECUTIVES NOTICE: ACCURATE PERCEPTIONS IN TOP MANAGEMENT TEAMS.
SUTCLIFFE, K. M. (1994) · Academy of Management Journal · doi:10.2307/256677 · Cited by 403
Brozek, J., & McNemar, Q. (1949) · The American Journal of Psychology · doi:10.2307/1418299 · Cited by 331
Tsui, A. S. (1990) · Administrative Science Quarterly · doi:10.2307/2393313 · Cited by 296
Linear Models for Unbalanced Data.
Woodward, P., & Searle, S. R. (1988) · The Statistician · doi:10.2307/2348778 · Cited by 278
Structure and process of diversification, compensation strategy, and firm performance
Gomez‐Mejia, L. R. (1992) · Strategic Management Journal · doi:10.1002/smj.4250130506 · Cited by 276
George, J. M., & James, L. R. (1993) · Journal of Applied Psychology · doi:10.1037//0021-9010.78.5.798 · Cited by 268
Opening Pandora's box: studying the accuracy of managers' perceptions
Starbuck, W. H., & Mezias, J. M. (1996) · Journal of Organizational Behavior · Cited by 236
A cautionary note on measurement error corrections in structural equation models.
DeShon, R. P. (1998) · Psychological Methods · doi:10.1037//1082-989x.3.4.412 · Cited by 226
Critical analysis of the statistical and ethical implications of various definitions of test bias.
Hunter, J. E., & Schmidt, F. L. (1976) · Psychological Bulletin · doi:10.1037/0033-2909.83.6.1053 · Cited by 158
Interrater reliability coefficients cannot be computed when only one stimulus is rated.
Schmidt, F. L., & Hunter, J. E. (1989) · Journal of Applied Psychology · doi:10.1037/0021-9010.74.2.368 · Cited by 126
Direct estimates of SD-sub(y ) and the implications for utility analysis.
Becker, B. E., & Huselid, M. A. (1992) · Journal of Applied Psychology · doi:10.1037/0021-9010.77.3.227 · Cited by 70
Cited by
Human resources and the resource based view of the firm
Wright, P. M., Dunford, B. B., & Snell, S. A. (2001) · Journal of Management · doi:10.1016/s0149-2063(01)00120-9 · Cited by 2,581
Self-citationJiang, K., Lepak, D. P., Hu, J., & Baer, J. C. (2012) · Academy of Management Journal · doi:10.5465/amj.2011.0088 · Cited by 2,432
COMBS, J., LIU, Y., HALL, A., & KETCHEN, D. (2006) · Personnel Psychology · doi:10.1111/j.1744-6570.2006.00045.x · Cited by 2,092
Collins, C. J., & Smith, K. G. (2006) · Academy of Management Journal · doi:10.5465/amj.2006.21794671 · Cited by 2,025
Strategic talent management: A review and research agenda
Collings, D. G., & Mellahi, K. (2009) · Human Resource Management Review · doi:10.1016/j.hrmr.2009.04.001 · Cited by 1,837
Metadata
- Authors
- GERHART, B., WRIGHT, P. M., MC MAHAN, G. C., & SNELL, S. A.
- Venue
- Personnel Psychology
- Publisher
- Wiley
- Published
- 2000-12
- Volume
- 53
- Issue
- 4
- Pages
- 803-834
- ISSN
- 0031-5826 (ISSN-L)
- 1744-6570
- OpenAlex
- W2057075856
- Cited by
- 679
- References
- 52
- FWCI
- 21.08
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.