Cited by 568Psychometric Methodologies and TestingReliability and Agreement in MeasurementMeta-analysis and systematic reviews

The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.

Measurement error in psychological research: Lessons from 26 research scenarios.

Schmidt, Frank L., Hunter, John E.·1996·Psychological Methods

DOI 10.1037/1082-989x.1.2.199

Open this paper in CoChat — free account

Abstract

technical principles to concrete research problems that appear in a wide variety of forms and with a myriad of obscuring features, details, and idiosyncracies. This article is based on a different approach: examination of a series of concrete research scenarios that we have encountered in our work as researchers, advisors to researchers, or reviewers. This article examines 26 real-world case studies and explicates them on the basis of the principles of reliability theory found in Cronbach (1947, 1951) and Cronbach et al. (1972). Although we cite and rely on these sources, other sources (e.g., Thorndike, 1951) would yield identical resolutions; only the terminology would be sometimes (slightly) different. In classical measurement theory, the fundamental general formula for the observed correlation between any two measures, x and y, is yields the dissattenuation formula:

Integrity signals

Registry

Crossref · 10.1037/1082-989x.1.2.199

Cites

24 of 24 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Coefficient Alpha and the Internal Structure of Tests
Cronbach, L. J. (1951) · Psychometrika · doi:10.1007/bf02310555 · Cited by 43,931
Handbook of Industrial and Organizational Psychology.
Hammer, T. H., Anderson, J. F., Gurdon, M. A., Jick, T. D., Petit, A., Stern, R. N., Schwartz, H., Vardi, Y., & Dunnette, M. D. (1977) · Administrative Science Quarterly · doi:10.2307/2391755 · Cited by 11,947
Reviews: Lord, Frederic M., and Novick, Melvin R. (with contributions by Allan Birnbaum). Statistical Theories of Mental Test Scores. Reading, Mass.: Addison-Wesley, 1968. xii + 568 pp. $14.95.
Rozeboom, W. W., Lord, F. M., Novick, M. R., & Birnbaum, A. (1969) · American Educational Research Journal · doi:10.2307/1162101 · Cited by 8,012
Methods of Meta-Analysis: Correcting Error and Bias in Research Findings
Schmidt, F. L., & Hunter, J. E. (2015) · doi:10.4135/9781483398105 · Cited by 5,542
Self-citation
The American Voter. By A. Campbell, P. Converse, W. Miller, and D. Stokes. (New York: John Wiley & Sons, Inc. 1960. Pp. viii, 573. $8.50.)
Eulau, H. H. F. (1960) · American Political Science Review · doi:10.2307/1952653 · Cited by 4,744
Educational measurement, 3rd ed.
Linn, R. L. (1989) · Cited by 2,858
The efficacy of psychological, educational, and behavioral treatment: Confirmation from meta-analysis.
Lipsey, M. W., & Wilson, D. B. (1993) · American Psychologist · doi:10.1037/0003-066x.48.12.1181 · Cited by 2,033
The Dependability of Behavioral Measurements: Theory of Generalizability for Scores and Profiles
Merrifield, P. R., Cronbach, L. J., Gleser, G. C., Nanda, H., & Rajaratnam, N. (1974) · American Educational Research Journal · doi:10.2307/1162145 · Cited by 1,819
Personnel Selection in Organizations
Murphy, K. R., Schmitt, N., & Borman, W. C. (1993) · Academy of Management Review · doi:10.2307/258598 · Cited by 1,646
Modeling the performance prediction problem in industrial and organizational psychology.
Campbell, J. P. (1990) · Cited by 1,476

Show all 24 references

Sorted by citations

Items 501–568 of 568

The R ole of Valence in Construct Dimensionality Debates
Kam, C. S. (2012) · Scholarship@Western (Western University)
EXPLORING THE GAP BETWEEN A PRE- AND POST-INSTALLATION OF A CORPORATE E-LEARNING PROGRAM IN AN ACCOUNTING WORKPLACE
Cheng, K. (2013) · The Turkish Online Journal of Educational Technology
Development and test of a firefighter safety climate model
Smith, T. D. (2010)
The role of work-stress appraisals among female clerical workers
Morris, J. E. (2009) · cIRcle (University of British Columbia) · doi:10.14288/1.0089075
Investigating the Presence of Nonlinear Personality—Job Performance Relationships
Walmsley, P. T. (2013) · University of Minnesota Digital Conservancy (University of Minnesota)
Examination of Peer Contextual Performance Ratings in Co-located and Virtual Teams Using the Social Relations Model
Cullen, K. L. (2011)
Psychologist The Counseling
Creswell, J. W., Hanson, W. E., & Clark, V. L. P. (2007)
Jenseits von Usability: Website-Ästhetik
Thielsch, M. T. (2008) · Usability Professionals
Driven towards a middle-ground: Passion and work-life balance among Filipino professionals
Lajom, J. A. L. (2016) · ANU Open Research (Australian National University) · doi:10.25911/5d5146d77988f
Chapter 11 The Social Context of Well-Being: Policy Examples
Diener, E., Lucas, R. E., Schimmack, U., & Helliwell, J. F. (2009) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195334074.003.0011
Chapter 10 Work, the Economy, and Well-Being: Policy Examples
Diener, E., Lucas, R. E., Schimmack, U., & Helliwell, J. F. (2009) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195334074.003.0010
Chapter 4 Contributions of Well-Being Measures
Diener, E., Lucas, R. E., Schimmack, U., & Helliwell, J. F. (2009) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195334074.003.0004
Chapter 9 The Environment and Well-Being: Policy Examples
Diener, E., Lucas, R. E., Schimmack, U., & Helliwell, J. F. (2009) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195334074.003.0009
Chapter 7 The Desirability of Well-Being as a Guide for Policy
Diener, E., Lucas, R. E., Schimmack, U., & Helliwell, J. F. (2009) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195334074.003.0007
Exploring the structural relationships between personality and 360-degree feedback
Napper, C. N. (2013)
The Variance Architecture Approach to the Study of Constructs in Organizational Contexts
Putka, D. J. (2002) · OhioLink ETD Center (Ohio Library and Information Network)
Reliability and validity of the list learning paradigm and implications for clinical memory assessment
Fratti, S. (2017) · Minerva Access (University of Melbourne)
Introducing an Error Orientation Framework: Individual Differences in Coping with Errors in the Workplace
Huish, K. A. (2011) · Griffith Research Online · doi:10.25904/1912/3663
Meta‐Analysis
Schmidt, F. L. (2012) · Wiley eBooks · doi:10.1002/9781118133880.hop202020
Self-citation
The Longitudinal Mediating Effect of Young Children’ Self-Concept on the Relationship between Fathers’ Parenting Participation and Young Children’ Self-Esteem
jehuiseon, & Lee, K. (2018) · Journal of Educational Innovation Research · doi:10.21024/pnuedi.28.2.201806.399
Is 360 Feedback a Predictor or Criterion Measure?
Pulakos, E. D., & Rose, D. S. (2019) · Oxford University Press eBooks · doi:10.1093/oso/9780190879860.003.0017
A Longitudinal Study between Directors’ Leadership Perceived by Teachers, Teachers’ Efficacy and Young Children’ Happiness
Lee, K., & Won-Suk, S. (2018) · Journal of Educational Innovation Research · doi:10.21024/pnuedi.28.1.201803.147
Couch: A Mobile Application Designed to Investigate the Relationship Between Aesthetics and Persuasion
Aydin, M. (2017) · doi:10.22215/etd/2017-11894
Revenue Management at Jinja Sailing Club
Mulero, E. (2018)
Inter-rater Reliability of Participatory Evaluation Data - Brachiaria Grasses in NyandaruaPreprint
Mailu, S., & Maro, F. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3274582
UNPUBLISHED, REJECTED MANUSCRIPT NOT TO BE RESUBMITTED: Acting with Conviction: On the Roles of Moral and Religious Convictions in the Minnesota Same-Sex Marriage Constitutional Amendment VotePreprint
Vitriol, J. A. (2020) · doi:10.31234/osf.io/yhcq9
Affec tivity and job satisfaction: a meta-analysis
Connolly, J. J. (1998)
Detached Concern
Park, H. I., & Nam, J. S. (2021) · Korean Journal of Industrial and Organizational Psychology · doi:10.24230/kjiop.v34i4.629-662
Chapter 12 Existing Surveys
Diener, E., Lucas, R. E., Schimmack, U., & Helliwell, J. F. (2009) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195334074.003.0012
Peer Review #1 of "A surge of p-values between 0.041 and 0.049 in recent decades (but negative results are increasing rapidly too) (v0.1)"
(2015) · PeerJ · doi:10.7287/peerj.733v0.1/reviews/1
Peer Review #1 of "A surge of p-values between 0.041 and 0.049 in recent decades (but negative results are increasing rapidly too) (v0.2)"
(2015) · PeerJ · doi:10.7287/peerj.733v0.2/reviews/1
Peer Review #2 of "A surge of p-values between 0.041 and 0.049 in recent decades (but negative results are increasing rapidly too) (v0.1)"
(2015) · PeerJ · doi:10.7287/peerj.733v0.1/reviews/2
Bibliography
Altman, M., Gill, J., & McDonald, M. P. (2003) · Wiley series in probability and statistics · doi:10.1002/0471475769.biblio
Chapter 13 Conclusions
Diener, E., Lucas, R. E., Schimmack, U., & Helliwell, J. F. (2009) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195334074.003.0013
Psychometrics
Perron, B. E., Victor, B. G., & Vaughn, M. G. (2014) · doi:10.1093/obo/9780195389678-0156
ON THE INTEGRITY OF RELIABILITY ESTIMATION IN CLASSICAL TEST THEORY: THE CASE FOR AN ADDITIVE COEFFICIENT OF STABILITY
Becker, G. (2008) · Psychological Reports · doi:10.2466/pr0.103.6.545-565
Copyright Page
(2009) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195334074.002.0004
Zum Zusammenhang von Offenheit und Erfolg bei internationalen beruflichen Entsendungen
Deller, J., Albrecht, A., Dilchert, S., Öneş, D. S., & Paulus, F. M. (2023) · Springer eBooks · doi:10.1007/978-3-658-40764-3_9
Supplemental Material for Applying Multivariate Generalizability Theory to Psychological Assessments
(2023) · Psychological Methods · doi:10.1037/met0000606.supp
Perceptions of Justice in Clinical Learning Environments: Development and Validation of an Organizational Justice Measure for Medical Trainees
Cullen, M. J., Hane, J., Zhou, Y., Seltzer, B. K., Sackett, P. R., Culican, S. M., Thakker, K., Young, J. Q., Arbuckle, M., Whatley, K., et al. (2024) · Academic Medicine · doi:10.1097/acm.0000000000005669
Assessing the overlap of personality traits and internalizing psychopathology using multi-informant data: Two sides of the same coin?Preprint
Soodla, H. L., Lehto, K., Kõiv, K., Vainik, U., Akkermann, K., & Mõttus, R. (2024) · doi:10.31219/osf.io/ak6vx
Face recognition’s practical relevance: Social bonds, not social butterfliesPreprint
Engfors, L. M., Wilmer, J. B., Palermo, R., Gignac, G. E., Germine, L. T., & Jeffery, L. (2024) · doi:10.31219/osf.io/jh3te
Dynamic Visualization Analysis of English Teaching Research in China Based on Flow Theory (2005~2023)
程, 度. (2024) · Creative Education Studies · doi:10.12677/ces.2024.127459
The “Square of Deception”: How some borrowers boxed themselves in to access funds
Ivanaj, S., & Mesly, O. (2024) · Management & Prospective · doi:10.3917/g2000.406.0088
TAREFA DE CUBOS DE CORSI: O VIÉS DO APLICADOR
de Lima, V. L. T., & Ribeiro, S. D. (2024) · Revista Contemporânea · doi:10.56083/rcv4n11-101
Research hotspots and trends of social robot interaction design: a bibliometric analysis
Wang, J., Chen, Y., Huo, S., Mai, L., & Jia, F. (2024) · Elsevier eBooks · doi:10.1016/b978-0-443-23606-8.00006-3
An Innovative Framework for Enhancing Consumer Expectations Surveys through Market and Personal Indicators
Mesly, O. (2025) · Journal of Economic Issues · doi:10.1080/00213624.2025.2455301
Investigating the Influence of Dimensions of Martin's Humor Styles on Bereavement Outcomes, with Coping Humor Being Examined as a Potential Moderating Variable
Arora, K., & Singh, P. K. (2025) · INTERNATIONAL JOURNAL OF RESEARCH AND ANALYTICAL REVIEWS · doi:10.56975/ijrar.v12i2.313988
The Brief Version of the Need Inventory of Sensation Seeking (NISS-6)
Zenger, M., Brähler, E., & Roth, M. (2025) · European Journal of Psychological Assessment · doi:10.1027/1015-5759/a000930
Improving Survey of Consumers’ Expectations Based on Market and Personal Indicators
Mesly, O. (2025) · Journal of Economic Issues · doi:10.1080/00213624.2025.2575143
The Impact of Psychological Mindedness on Executive Coaching Effectiveness
Orban, J. (2026) · Springer eBooks · doi:10.1007/978-3-032-11842-4_8
Concepts of Psychometric Test Construction
Orban, J. (2026) · Springer eBooks · doi:10.1007/978-3-032-11842-4_5
Role of Mental Abilities and Conscientiousness in Explaining College Grades
Cucina, J. M., Byle, K. A., & Burtnick, S. K. (2026) · Intelligence & Cognitive Abilities · doi:10.65550/001c.154598
Loneliness and Personality: Noise‐ and Bias‐Free True Correlations Between Loneliness and the Big Five Personality Domains
Maher, P., Dragostinov, Y., Vainik, U., Cooper, A. J., Allïk, J., Realo, A., & Mõttus, R. (2026) · Journal of Personality · doi:10.1111/jopy.70048 · Cited by 5
Brighten-up-DPs: A Guide to Designing and Reporting Rigorous Experimental Dark Patterns ResearchPreprint
Schilling, T. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6441638
Preschool Self-Regulation Assessment (PSRA): A Reliability Generalization Meta-Analysis
Türk, E. D., & Yıldırım, Ö. (2026) · Measurement and Evaluation in Counseling and Development · doi:10.1080/07481756.2026.2648968
Measuring Belief in Conspiracy Theories: Validation of a French and English Single-Item ScalePreprint
Douglas, K., Lantian, A., Nurra, C., & Dominique Muller, B. (2015) · OSF Preprints (OSF Preprints)
Maximum likelihood estimation of perceptual differences in sorting tasks
Liu, Y., Li, H., Xiang, Y., Zhou, M., Li, Q., Yu, H., Ejima, Y., Takahashi, S., Yang, J., Bai, B., et al. (2026) · PLoS ONE · doi:10.1371/journal.pone.0349396
Preliminary examination of symptom validity in veterans using the Rivermead post-concussion symptoms questionnaire
Rolin, S. N., & Davis, J. J. (2026) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acag037
On the problems of construct proliferation and redundancy: A discussion of problems and various solutions
Manata, B., Boster, F. J., & Boynton, K. (2026) · Communication Monographs · doi:10.1080/03637751.2026.2685711
Knowledge Calibration in Pharmaceutical Training: Asymmetric Bias and the Influence of Adaptive E‐Learning, Expertise and Satisfaction
Langendorf, L. N., & Khalid, M. S. (2026) · International Journal of Training and Development · doi:10.1111/ijtd.70042
Quantifying Effects of Item Wording and Multiple Sources of Measurement Error Using Extended Bifactor Models
Vispoel, W. P., Lee, H., & Chen, T. (2026) · Behavioral Sciences · doi:10.3390/bs16091636
Affective language and transdiagnostic symptom burden in clinically referred adolescents: a multicenter Turkish sentence-completion study
Albayrak, Z. S., Genç, H. A., Ekici, E. E., Görgülü, T. T., Seçinti, D. D., KAHRAMAN, G., ÇAMLI, Ş. E., & Eser, H. Y. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1958650
Visible Greenery and Visual Composition in Urban Views: A Matched-Scene Experiment on Restorativeness and Preference
Lee, J., Hsu, T.-W., Yang, H. J., & Lee, J. (2026) · Buildings · doi:10.3390/buildings16193777
Does Goal Orientation Make a Difference for Innovation Implementation? Moderating Roles of Implementation Autonomy and Perceived Ease of Use
Choi, S. Y., Qian, X., Choi, J. N., & Chung, H. S. (2026) · Human Performance · doi:10.1080/08959285.2026.2739150
Scaling Police Perceptions About Gendered Roles and “Men” as Victims in Domestic Spaces: A Quantitative Study of NCT Delhi, India
Gautam, U., Tewari, D. B., Jaiswal, V., Das, P., Mishra, A., Randhawa, N. S., & Marjara, K. (2026) · Social Sciences · doi:10.3390/socsci15100713
A Meta-Analysis of the Role of Reliability in Inter-Construct Correlations in Second Language Research
Zhao, H., & Aryadoust, V. (2026) · Educational Assessment · doi:10.1080/10627197.2026.2749629
Ratios: A short guide to confidence limits and proper use
Franz, V. H. (2007) · arXiv · doi:10.48550/arxiv.0710.2024 · Cited by 48

Authors: Schmidt, F. L., & Hunter, J. E.
Affiliations: University of Iowa (US)
ORCID: Hunter, John E.
Venue: Psychological Methods
Publisher: American Psychological Association (APA)
Published: 1996-06
Volume: 1
Issue: 2
Pages: 199-223
ISSN: 1082-989X (ISSN-L)
1939-1463
DOI: 10.1037/1082-989x.1.2.199
OpenAlex: W2051130243
Cited by: 567
References: 24
Citations by year: 2026: 19 · 2025: 15 · 2024: 28 · 2023: 16 · 2022: 16 · 2021: 25 · 2020: 13 · 2019: 21 · 2018: 24 · 2017: 17 · 2016: 22 · 2015: 21 · 2014: 18 · 2013: 21 · 2012: 29
FWCI: 26.81
Type: journal article
Language: en
Open access: closed
Locations: Psychological Methods (publishedVersion)
Topics: Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Keywords: measurement error, reliability theory, classical test theory, research scenarios, case studies

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Measurement error in psychological research: Lessons from 26 research scenarios.

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks