RELIABILITY IS NOT VALIDITY AND VALIDITY IS NOT RELIABILITY
The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
Abstract
Interrater correlations do provide an index of reliability of job performance ratings. We show that the arguments presented by Murphy and DeShon (2000) lead to the radical conclusion that traditional measurement models–both classical theory and generalizability theory models–can be used neither with job performance ratings nor with other measures used in I‐O and other areas of psychology and the social sciences. We show that this untenable conclusion is based on confusion of validity issues and questions with reliability issues and questions. It is also based on the incorrect belief that classical measurement models are capable of addressing only random response measurement error and cannot address other forms of measurement error. We also show that the solution Murphy and DeShon offer to the problem of measurement error in ratings, as they define this problem, cannot work. Properly understood, the position taken by Murphy and DeShon leaves us with the nihilistic conclusion that no appropriate measurement models are possible in psychological research, thus making meaningful research impossible.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Measurement error in psychological research: Lessons from 26 research scenarios.
Schmidt, F. L., & Hunter, J. E. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.2.199 · Cited by 567
Self-citation
Cited by
The job satisfaction–job performance relationship: A qualitative and quantitative review.
Judge, T. A., Thoresen, C. J., Bono, J. E., & Patton, G. K. (2001) · Psychological Bulletin · doi:10.1037/0033-2909.127.3.376 · Cited by 4,760
Answers to 20 questions about interrater reliability and interrater agreement
LeBreton, J. M., & Senter, J. L. (2008) · Organizational Research Methods · doi:10.1177/1094428106296642 · Cited by 3,608
CHRISTIAN, M. S., GARZA, A. S., & SLAUGHTER, J. E. (2011) · Personnel Psychology · doi:10.1111/j.1744-6570.2010.01203.x · Cited by 2,903
Personality and Transformational and Transactional Leadership: A Meta-Analysis.
Bono, J. E., & Judge, T. A. (2004) · Journal of Applied Psychology · doi:10.1037/0021-9010.89.5.901 · Cited by 1,563
Berry, C. M., Ones, D. S., & Sackett, P. R. (2007) · Journal of Applied Psychology · doi:10.1037/0021-9010.92.2.410 · Cited by 1,333
Self-citation
Metadata
- Authors
- SCHMIDT, F. L., VISWESVARAN, C., & ONES, D. S.
- Venue
- Personnel Psychology
- Publisher
- Wiley
- Published
- 2000-12
- Volume
- 53
- Issue
- 4
- Pages
- 901-912
- ISSN
- 0031-5826 (ISSN-L)
- 1744-6570
- OpenAlex
- W2033753338
- Cited by
- 108
- References
- 1
- FWCI
- 7.61
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: RELIABILITY IS NOT VALIDITY AND VALIDITY IS NOT RELIABILITY. https://app.cochat.ai/papers/10.1111/j.1744-6570.2000.tb02422.x
- The paper
- SCHMIDT, F. L., VISWESVARAN, C., & ONES, D. S. (2000). RELIABILITY IS NOT VALIDITY AND VALIDITY IS NOT RELIABILITY. Personnel Psychology. https://doi.org/10.1111/j.1744-6570.2000.tb02422.x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.