The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Measurement error in psychological research: Lessons from 26 research scenarios.
Abstract
technical principles to concrete research problems that appear in a wide variety of forms and with a myriad of obscuring features, details, and idiosyncracies. This article is based on a different approach: examination of a series of concrete research scenarios that we have encountered in our work as researchers, advisors to researchers, or reviewers. This article examines 26 real-world case studies and explicates them on the basis of the principles of reliability theory found in Cronbach (1947, 1951) and Cronbach et al. (1972). Although we cite and rely on these sources, other sources (e.g., Thorndike, 1951) would yield identical resolutions; only the terminology would be sometimes (slightly) different. In classical measurement theory, the fundamental general formula for the observed correlation between any two measures, x and y, is yields the dissattenuation formula:
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This method aims to investigate relations on the level of constructs rather than measured values; therefore, it allows correction for the effects of several statistical artifacts, inter alia, concerning measuring accuracy (or more specifically for internal consistencies [78]).”
From Conceptualizations of cyberchondria and relations to the anxiety spectrum: Systematic review and meta-analysis (2021) · cites this paper as [78]
Citations
Cites
Coefficient Alpha and the Internal Structure of Tests
Cronbach, L. J. (1951) · Psychometrika · doi:10.1007/bf02310555 · Cited by 43,931
Handbook of Industrial and Organizational Psychology.
Hammer, T. H., Anderson, J. F., Gurdon, M. A., Jick, T. D., Petit, A., Stern, R. N., Schwartz, H., Vardi, Y., & Dunnette, M. D. (1977) · Administrative Science Quarterly · doi:10.2307/2391755 · Cited by 11,947
Rozeboom, W. W., Lord, F. M., Novick, M. R., & Birnbaum, A. (1969) · American Educational Research Journal · doi:10.2307/1162101 · Cited by 8,012
Methods of Meta-Analysis: Correcting Error and Bias in Research Findings
Schmidt, F. L., & Hunter, J. E. (2015) · doi:10.4135/9781483398105 · Cited by 5,542
Self-citationEulau, H. H. F. (1960) · American Political Science Review · doi:10.2307/1952653 · Cited by 4,744
Educational measurement, 3rd ed.
Linn, R. L. (1989) · Cited by 2,858
Lipsey, M. W., & Wilson, D. B. (1993) · American Psychologist · doi:10.1037/0003-066x.48.12.1181 · Cited by 2,033
The Dependability of Behavioral Measurements: Theory of Generalizability for Scores and Profiles
Merrifield, P. R., Cronbach, L. J., Gleser, G. C., Nanda, H., & Rajaratnam, N. (1974) · American Educational Research Journal · doi:10.2307/1162145 · Cited by 1,819
Personnel Selection in Organizations
Murphy, K. R., Schmitt, N., & Borman, W. C. (1993) · Academy of Management Review · doi:10.2307/258598 · Cited by 1,646
Modeling the performance prediction problem in industrial and organizational psychology.
Campbell, J. P. (1990) · Cited by 1,476
Cited by
Sorted by citations
Items 401–500 of 568
Jackson, D. J. R., Cooper-Thomas, H. D., van Gelderen, M., & Davis, J. (2010) · Human Resource Development Quarterly · doi:10.1002/hrdq.20042 · Cited by 4
Diener, E., Lucas, R. E., Schimmack, U., & Helliwell, J. F. (2009) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195334074.003.0002 · Cited by 4
Craig, B., Wang, X., Sandella, J. M., Tsai, T., Kuo, D., & Finch, C. (2021) · Journal of Osteopathic Medicine · doi:10.1515/jom-2021-0007 · Cited by 4
Equal Precision Measurement Structural Models
Wood, P. K., Wiedermann, W., & Steinley, D. (2022) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705511.2022.2082971 · Cited by 4
Parsons, S. D., Brandmaier, A. M., Lindenberger, U., & Kievit, R. (2024) · Imaging Neuroscience · doi:10.1162/imag_a_00086 · Cited by 8
Gignac, G. E., Jang, K. L., & Bates, T. C. (2009) · Psychology science quarterly · Cited by 4
Control Cognitions and Causal Attributions as Predictors of Fatigue Severity in a Community Sample
Wells, L., Thorsteinsson, E., & Brown, R. F. (2012) · The Journal of Social Psychology · doi:10.1080/00224545.2011.586655 · Cited by 4
Francisco, J. D. D. S., & Claro, J. A. C. D. S. (2014) · Revista Brasileira de Administração Científica · doi:10.6008/spc2179-684x.2014.003.0007 · Cited by 4
Psychological assessment in adult mental health settings.
Horn, S. L., Mihura, J. L., & Meyer, G. J. (2013) · American Psychological Association eBooks · doi:10.1037/14048-014 · Cited by 4
Bolton, C. J. H., & Herbert, J. D. (2005) · iDEA - Drexel University Institutional Repository · doi:10.17918/etd-511 · Cited by 4
Bouchard, T. J. (1996) · Springer eBooks · doi:10.1007/978-0-585-34289-4_7 · Cited by 4
Advances in meta‐analysis: A unifying modelling framework with measurement error correction
Becker, B. J., & Zhang, Q. (2024) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/bmsp.12345 · Cited by 3
Krammer, G., Schermer, J., Koschmieder, C., Goffin, R. D., Hendy, N., & Biderman, M. (2024) · International Journal of Selection and Assessment · doi:10.1111/ijsa.12500 · Cited by 4
Becker, G. (2001) · Psychological Reports · doi:10.2466/pr0.2001.89.2.291 · Cited by 3
Chapter 5 The Well-Being Measures Are Valid
Diener, E., Lucas, R. E., Schimmack, U., & Helliwell, J. F. (2009) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195334074.003.0005 · Cited by 3
Lutz, P. K., O’Connor, B. P., & Folk, D. P. (2021) · Journal of Personality Assessment · doi:10.1080/00223891.2021.1991359 · Cited by 3
The Type to Take Out a Loan? A Study of Developer Personality and Technical Debt
Graf‐Vlachy, L., & Wagner, S. (2023) · IEEE/ACM International Conference on Technical Debt (TechDebt) · doi:10.1109/techdebt59074.2023.00010 · Cited by 3
Exploring the impact of temperature perception and fear of missing out on distracted walking
Sinha, J., & Serin, N. (2024) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2023.12.014 · Cited by 3
Meta-Analysis as a Validity Summary Tool
Banks, G. C., & McDaniel, M. A. (2012) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199732579.013.0009 · Cited by 4
McGill, R. J., Kennedy, K. S., & Busse, R. T. (2016) · Chapman University Digital Commons (Chapman University) · Cited by 3
Imprese familiari e performance: una meta-analisi degli studi empirici
Gallucci, C., & Santulli, R. (2018) · Sinergie Italian Journal of Management · doi:10.7433/s99.2016.19 · Cited by 3
Recent proposals to estimate transient error within the classical test theory tradition
Huysamen, G. K. (2006) · SA Journal of Industrial Psychology · doi:10.4102/sajip.v32i4.248 · Cited by 3
Something more than g: Meaningful Memory uniquely predicts training performance
Cucina, J. M., Su, C., Busciglio, H. H., & Peyton, S. T. (2015) · Intelligence · doi:10.1016/j.intell.2015.01.007 · Cited by 5
Cox, S. J., & Oliver, A. (1999) · Lancaster EPrints (Lancaster University) · Cited by 3
Poropat, A. E. (2010) · Journal of Management & Organization · doi:10.1017/s1833367200002352 · Cited by 3
Construct Validity Evidence for Multisource Performance Ratings: Is Interrater Reliability Enough?
Ock, J. (2016) · Industrial and Organizational Psychology · doi:10.1017/iop.2016.19 · Cited by 3
Cheng, K. W. (2011) · New Horizons in Education · Cited by 3
Role Theory Approaches for Effectiveness of Marketing-Oriented Boundary Spanners
Singh, J., & Saatcioglu, A. (2008) · Emerald Group Publishing Limited eBooks · doi:10.1108/s1548-6435(2008)0000004010 · Cited by 4
Small, B. (2011) · Research Commons (University of Waikato) · Cited by 3
Marzi, E. (2018) · TSpace (University of Toronto) · Cited by 3
Streiner, D. L., Norman, G. R., & Cairney, J. (2024) · Oxford University Press eBooks · doi:10.1093/med/9780192869487.003.0010 · Cited by 2
Graf‐Vlachy, L., & Wagner, S. (2024) · IEEE/ACM International Conference on Technical Debt (TechDebt) · doi:10.1145/3644384.3644475 · Cited by 2
Moss, J. L., Liu, B., & Zhu, L. (2019) · Health Education & Behavior · doi:10.1177/1090198119839111 · Cited by 2
Smith, R. A., & Osoro, R. A. (2023) · AIDS Education and Prevention · doi:10.1521/aeap.2023.35.1.69 · Cited by 2
Development and Validation of the Parental Food Choice Guilt Scale
Yaremych, H. E., & Persky, S. (2023) · European Journal of Psychological Assessment · doi:10.1027/1015-5759/a000800 · Cited by 2
Waller, N. G. (2024) · The American Statistician · doi:10.1080/00031305.2024.2350449 · Cited by 2
Smith, R. A., Osoro, R. A., & Sterner, G. (2024) · Journal of Applied Communication Research · doi:10.1080/00909882.2024.2344780 · Cited by 4
Kruse, E. A., Saxena, A., Shovestul, B. J., Dudek, E. M., Reda, S., Dong, J., Venkataraman, A., Lamberti, J. S., & Dodell‐Feder, D. (2024) · Schizophrenia Research Cognition · doi:10.1016/j.scog.2024.100329 · Cited by 2
Evaluating Contextual Models for Intensive Longitudinal Data in the Presence of Noise
Ernst, A. F., Ceulemans, E., Bringmann, L. F., & Adolf, J. (2024) · Multivariate Behavioral Research · doi:10.1080/00273171.2024.2436420 · Cited by 2
Examining the Advantages and Disadvantages of Pilot Studies: Monte-Carlo Simulations
Nakazawa, M. (2012) · UNM’s Digital Repository (University of New Mexico) · Cited by 2
Big Five Validity and Publication Bias: Conscientiousness Worse than Assumed
Kepes, S., McDaniel, M. A., Banks, G. C., & Hurtz, G. M. (2011) · Cited by 2
Chapter 8 Health and Well-Being: Policy Examples
Diener, E., Lucas, R. E., Schimmack, U., & Helliwell, J. F. (2009) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195334074.003.0008 · Cited by 2
Models and Methods for Evaluating Reliability and Validity
Murphy, K. R. (2009) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199234738.003.0012 · Cited by 2
Kai-Wen, C. (2011) · WSEAS Transactions on Information Science and Applications archive · Cited by 2
Villagrán, M. A., Aragón, E., & Guzmán, J. I. N. (2019) · Universitas Psychologica · doi:10.11144/javeriana.upsy18-3.ccsa · Cited by 2
Refinement: Measuring informativeness of ratings in the absence of a gold standard
Grant, S., Meilă, M., Erosheva, E. A., & Lee, C. J. (2022) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/bmsp.12268 · Cited by 2
Dunkel, C. S., Hertler, S. C., Mathes, E. W., & de Baca, T. C. (2019) · Current Psychology · doi:10.1007/s12144-019-00443-2 · Cited by 2
Exploring Calling Work Orientation: Construct Clarity and Organizational Implications
Newness, K. A. (2013) · FIU - Digital Commons (Florida International University) · doi:10.25148/etd.fi13112203 · Cited by 3
Diferencias sexuales en el acceso léxico al color
Delgado, A. R., & Prieto, G. (2003) · Psicothema · Cited by 2
Pereira, M. E., Fagundes, A. L. M., da Silva, J. F., & Takei, R. (2017) · Psicologia Argumento · doi:10.7213/psicolargum.v23i41.20001 · Cited by 2
A Tale of Self-Monitoring, Social Capital, and Social Media
Beane, D. A. (2012) · University of North Florida Digital Commons (University of North Florida) · Cited by 2
A Method to Analyse Measurement Invariance under Uncertainty in Between-Subjects Design
García, J. A. M., Marín, M. R., & Molina, M. D. C. V. (2012) · The Spanish Journal of Psychology · doi:10.5209/rev_sjop.2012.v15.n3.39435 · Cited by 1
Streiner, D. L., Norman, G. R., & Cairney, J. (2014) · doi:10.1093/med/9780199685219.003.0010 · Cited by 1
Self-Care and Quality of Life: Associated Factors Among MSW Students
Nicotera, N., Park, I. Y., Call, J., & Steward, A. T. (2023) · Journal of Teaching in Social Work · doi:10.1080/08841233.2023.2263888 · Cited by 1
Moore, S., Naragon‐Gainey, K., Pestell, C., Becerra, R., Buelow, M. T., Fynn, D. M., & Weinborn, M. (2025) · Neuropsychology Review · doi:10.1007/s11065-025-09668-4 · Cited by 1
Development and Validation of the Faceted Dark Triad (FDT) Scale
Martindale, J., Hughes, D. J., Paul Irwing, B., & Rose, L. (2025) · Assessment · doi:10.1177/10731911251388351 · Cited by 2
Vispoel, W. P., Hong, H., Lee, H., & Chen, T. (2026) · Journal of Personality Assessment · doi:10.1080/00223891.2026.2628589 · Cited by 1
Verche, E., Correas, Á., Arranz-Paraíso, S., & Aguayo‐Estremera, R. (2026) · Neuropsychology Review · doi:10.1007/s11065-025-09690-6 · Cited by 1
Abroshan, H., van der Linde, I., Kirk, E., Oghaz, M. M., Muir, J., & Vallukappully, S. (2026) · Computers & Security · doi:10.1016/j.cose.2026.105030 · Cited by 1
Luor, T., Lu, H., Johanson, R. E., & Wu, L. (2009) · Advanced concurrent engineering · doi:10.1007/978-1-84882-762-2_82 · Cited by 1
FACTOR ANALYSIS TO EXAMINE PSYCHOMETRIC PROPERTIES OF FAMILY FUNCTIONING MEASURES
Bellamy, N. D., Matthew, R. F., & Wang, M. Q. (2006) · Psychological Reports · doi:10.2466/pr0.99.1.267-273 · Cited by 1
Stable unstable reliability theory
Thomas, H., Lohaus, A., & Domsch, H. (2011) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.2010.02011.x · Cited by 1
Effect of Brand Difference on Multichannel Apparel Shopping Behaviors in a Multichannel Environment
Noh, M., & Lee, E. (2011) · Cited by 1
Mindful but forgetful: The negative effect of trait mindfulness on memories of immoral behavior
Reynolds, S. J., Eliseo, M. S., Watkins, T., & Mariam, M. (2023) · Business and Society Review · doi:10.1111/basr.12328 · Cited by 1
Obi, U. S., Chukwuma, A., Agu, I. C., Eigbiremolen, G. O., & Mbachu, C. O. (2024) · BMC Medical Education · doi:10.1186/s12909-024-06298-x · Cited by 1
Wang, H., Chien, C.-F., & Chen, C.-Y. (2025) · Teaching and Teacher Education · doi:10.1016/j.tate.2025.105073 · Cited by 1
Assessing children’s spatial thinking: Insights, challenges, and implications
McKee, K., Atit, K., & Uttal, D. H. (2025) · Advances in child development and behavior · doi:10.1016/bs.acdb.2025.07.005 · Cited by 1
Minding the Gap Between First and Continued Usage of a Corporate E-Learning English-language Program
Luor, T., Lu, H., Johanson, R. E., & Yu, H. (2012) · International Journal of Technology and Human Interaction · doi:10.4018/jthi.2012010104 · Cited by 1
Becker, G. (2008) · Psychological Reports · doi:10.2466/pr0.103.2.545-565 · Cited by 1
Chapter 1 Using Well-Being to Inform Public Policy
Diener, E., Lucas, R. E., Schimmack, U., & Helliwell, J. F. (2009) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195334074.003.0001 · Cited by 1
The Construct Validity Of A Situational Judgment Test In A Maximum Performance Context
Stagl, K. C. (2006) · Journal of International Crisis and Risk Communication Research · Cited by 1
Decision Making Approach to Employee Selection
Kaliannan, M. (2017) · Advances in human resources management and organizational development book series · doi:10.4018/978-1-5225-4056-4.ch003 · Cited by 1
Fliege, H., & Wiernik, B. M. (2017) · Verlag Barbara Budrich eBooks · doi:10.2307/j.ctvdf0d15.10 · Cited by 1
Ekohariadi, Anistyasari, Y., & Putra, R. E. (2020) · Proceedings of the International Joint Conference on Arts and Humanities (IJCAH 2020) · doi:10.2991/assehr.k.201201.193 · Cited by 1
The Underappreciated Effects of Unreliability on Multiple Regression and Mediation
Trafimow, D. (2021) · Applied Finance and Accounting · doi:10.11114/afa.v7i2.5292 · Cited by 1
Is the open organisations profile a valid and reliable measure of openness in organisations?
Stubbs, L. (2007) · e-publications@bond (Bond University) · Cited by 1
Individual Differences in Expressing and Perceiving Nonverbal Cues: New Data on an Old QuestionPreprint
Elfenbein, H. A., Foo, M., Mandal, M. K., Biswal, R., Eisenkraft, N., Lim, A. C., & Sharma, S. (2009) · SSRN Electronic Journal · doi:10.2139/ssrn.1483388 · Cited by 1
(2003) · Personnel Psychology · doi:10.1111/j.1744-6570.2003.tb00150.x · Cited by 1
Media Markt und Saturn – Zwei Marken, eine Erfolgsstory
Creusen, U. (2008) · Gabler eBooks · doi:10.1007/978-3-8349-9437-0_22 · Cited by 1
Петров, Д. О. (2007) · Victoria University Research Repository (Victoria University) · Cited by 1
Affectivity and job satisfaction: a meta-analysis
Connolly, J. J. (1998) · doi:10.25148/etd.fi14060894 · Cited by 1
A Panel Study of the Relationship Between Corporate Social Inconsistency and RiskPreprint
Fu, L., Boehe, D., Orlitzky, M., & Swanson, D. (2016) · SSRN Electronic Journal · doi:10.2139/ssrn.2782749 · Cited by 1
Chapter 6 Issues Regarding the Use of Well-Being Measures for Policy
Diener, E., Lucas, R. E., Schimmack, U., & Helliwell, J. F. (2009) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195334074.003.0006 · Cited by 1
Schmitt, N. (2013) · Oxford University Press eBooks · doi:10.1093/obo/9780199846740-0029 · Cited by 1
(2005) · Personnel Psychology · doi:10.1111/j.1744-6570.2005.0020051109_17.x · Cited by 1
Becker, G. (2001) · Psychological Reports · doi:10.2466/pr0.89.6.291-307 · Cited by 1
Elder, J., Wilson, L., & Calanchini, J. (2022) · doi:10.31234/osf.io/sm2yt · Cited by 1
Assessing individual motivation for consuming diverse food groups over a two-week periodPreprint
Werner, J., Kloidt, J., & Barsalou, L. W. (2022) · doi:10.31234/osf.io/4d9xq · Cited by 1
Parsons, S. D., Brandmaier, A. M., Lindenberger, U., & Kievit, R. (2023) · doi:10.31234/osf.io/zpu6t · Cited by 1
Linking trust and performance evaluation style
Ward, E. A. (2011) · Enlighten: Theses (The University of Glasgow)
Complex and Collaborative Problem Solving: New, Unique, and Useful?
Oh, I. (2015) · Industrial and Organizational Psychology · doi:10.1017/iop.2015.38
Religious Participation Effects on Mental and Physical Health
Nolan, J. A. (2006) · eCommons (Cornell University)
Incidence and Attributions of Uncivil Events: Should they be Studied Separately?
Withrow, S. A. (2014) · ScholarWorks@BGSU (Bowling Green State University)
Practical Impact of Predictor Reliability for Personnel Selection Decisions
Ock, J., & Oswald, F. L. (2011) · PsycEXTRA Dataset · doi:10.1037/e518362013-284
Bayesian Analysis of Parental Drinking Motives and Children's Adjustment
Duke, A. A. (2013) · UKnowledge (University of Kentucky)
A BRIEF INTRODUCTION TO UNIFIED TEST THEORY
Becker, G. (2003) · Psychological Reports · doi:10.2466/pr0.2003.93.1.3
Developing content-valid selection procedures: What every HPT and HRD professional should know
Cerrito, J. C., & McLean, G. N. (2010) · Performance Improvement Journal · doi:10.1002/pfi.20122
The Reliability and Validity of the Children's Conscientiousness And Procrastination Scale
Osterman, N. M. (1999) · The Keep (Eastern Illinois University)
Metadata
- Authors
- Schmidt, F. L., & Hunter, J. E.
- Affiliations
- University of Iowa (US)
- ORCID
- Hunter, John E.
- Venue
- Psychological Methods
- Published
- 1996-06
- Volume
- 1
- Issue
- 2
- Pages
- 199-223
- ISSN
- 1082-989X (ISSN-L)
- 1939-1463
- OpenAlex
- W2051130243
- Cited by
- 567
- References
- 24
- Citations by year
- 2026: 19 · 2025: 15 · 2024: 28 · 2023: 16 · 2022: 16 · 2021: 25 · 2020: 13 · 2019: 21 · 2018: 24 · 2017: 17 · 2016: 22 · 2015: 21 · 2014: 18 · 2013: 21 · 2012: 29
- FWCI
- 26.81
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Methods (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- measurement error, reliability theory, classical test theory, research scenarios, case studies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review