The importance of measurement invariance in neurocognitive ability testing
Open accessThe DOI matches its Crossref record; 33 of the 34 references it cites were found in a registry or an index, and 1 are not checked yet.
Abstract
OBJECTIVE: Neurocognitive test batteries such as recent editions of the Wechsler's Adult Intelligence Scale (WAIS-III/WAIS-IV) typically use nation-level population-based norms. The question is whether these batteries function in the same manner across different subgroups based on gender, age, educational background, socioeconomic status, ethnicity, mother tongue, or race. Here, the author argues that measurement invariance is a core issue in determining whether population-based norms are valid for different subgroups. METHOD: The author introduces measurement invariance, argues why it is an important topic of study, discusses why invariance might fail in cognitive ability testing, and reviews a dozen studies of invariance of commonly used neurocognitive test batteries. RESULTS: In over half of the reviewed studies, IQ batteries were not found to be measurement invariant across groups based on ethnicity, gender, educational background, cohort, or age. Apart from age and cohort, test manuals do not take such lack of invariance into account in computing full-scale IQ scores or normed domain scores. CONCLUSIONS: Measurement invariance is crucial for valid use of neurocognitive tests in clinical, educational, and professional practice. The appropriateness of population-based norms to particular subgroups should depend also on whether measurement invariance holds with respect to important subgroups.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“In order to be able to compare test scores of individuals from different populations or groups in a meaningful and reliable way, it is essential for any diagnostic instrument used to provide measures that have the same meaning across those groups in question (e.g., Chen and Zhu 2012; Millsap and Kwok 2004; Wicherts 2016).”
From Measurement Invariance of the WISC-V across a Clinical Sample of Children and Adolescents with ADHD and a Matched Control Group (2024) · cites this paper as Wicherts 2016
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Measurement Invariance, Factor Analysis and Factorial Invariance
Meredith, W. (1993) · Psychometrika · doi:10.1007/bf02294825 · Cited by 4,536 · cited 1×
“Similarly, testing of measurement invariance in the confirmatory factor analyses, where the term strict factorial invariance (Meredith, 1993) is common, has become increasingly popular in recent decades as a means of studying the fairness of cognitive ability batteries like the Wechsler scales.”
MethodByrne, B. M., Shavelson, R. J., & Muthén, B. (1989) · Psychological Bulletin · doi:10.1037//0033-2909.105.3.456 · Cited by 4,115
Wechsler Adult Intelligence Scale--Third Edition
Wechsler, D. (2019) · PsycTESTS Dataset · doi:10.1037/t49755-000 · Cited by 2,327
Differential Item Functioning.
Gudgeon, A. C., Holland, P. W., & Wainer, H. (1994) · The Statistician · doi:10.2307/2348590 · Cited by 2,091
Massive IQ gains in 14 nations: What IQ tests really measure.
Flynn, J. R. (1987) · Psychological Bulletin · doi:10.1037/0033-2909.101.2.171 · Cited by 1,918
Borsboom, D., Mellenbergh, G. J., & van Heerden, J. (2004) · Psychological Review · doi:10.1037/0033-295x.111.4.1061 · Cited by 1,674
Statistical Approaches to Measurement Invariance
Millsap, R. E. (2012) · doi:10.4324/9780203821961 · Cited by 1,554
McGrew, K. S. (2009) · Intelligence · doi:10.1016/j.intell.2008.08.004 · Cited by 1,354 · cited 2×
“The trouble perhaps starts already with the fact that any given cognitive item is strongly dependent on a number of cognitive processes in a complex multivariate fashion, covering a great deal of cognitive ability factors in healthy populations (McGrew, 2009) and perhaps even more factors in unhealthy populations.”
BackgroundThe mean IQ of Americans: Massive gains 1932 to 1978.
Flynn, J. R. (1984) · Psychological Bulletin · doi:10.1037/0033-2909.95.1.29 · Cited by 1,206
The Clinical Neuropsychologist
(2013) · The Clinical Neuropsychologist · doi:10.1080/13854046.2013.852397 · Cited by 588
Research works printed but not linked: 3
- 10.1037/0033-2909.105.3.456 · doi:10.1037/0033-2909.105.3.456 · Paper page
- Taylor N., 2008, Uses and abuses of intelligence. Studies advancing Spearman and Raven’s quest for non-arbitrary metrics, 371
- Wechsler D., 2014, Wechsler adult intelligence scale-fourth SA edition
Cited by
Persistence and Fade-Out of Educational-Intervention Effects: Mechanisms and Potential Solutions
Bailey, D. H., Duncan, G. J., Cunha, F., Foorman, B. R., & Yeager, D. S. (2020) · Psychological Science in the Public Interest · doi:10.1177/1529100620915848 · Cited by 284
Robitzsch, A., & Lüdtke, O. (2023) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705511.2023.2191292 · Cited by 185
Risky business: Correlation and causation in longitudinal studies of skill development.
Bailey, D. H., Duncan, G. J., Watts, T. W., Clements, D. H., & Sarama, J. H. (2018) · American Psychologist · doi:10.1037/amp0000146 · Cited by 115
“Future assessments and research designs, including those that investigate measurement invariance across subgroups (Wicherts, 2016), are needed to investigate such possibilities.”
Wu, J., & Cheng, T. (2018) · Computers & Education · doi:10.1016/j.compedu.2018.08.016 · Cited by 120
Avila, J. F., Rentería, M. A., Witkiewitz, K. A., Verney, S. P., Vonk, J. M. J., & Manly, J. J. (2019) · Neuropsychology · doi:10.1037/neu0000584 · Cited by 80
“This relationship must be independent to make meaningful comparisons of latent mean differences (Wicherts, 2016).”
Background
Metadata
- Authors
- Wicherts, J. M.
- Affiliations
- Tilburg University (NL)
- Corresponding author
- Wicherts, Jelte M.
- ORCID
- Wicherts, Jelte M.
- Venue
- The Clinical Neuropsychologist
- Publisher
- Informa UK Limited
- Published
- 2016-06-30
- Volume
- 30
- Issue
- 7
- Pages
- 1006-1016
- ISSN
- 0920-1637 (ISSN-L)
- 1385-4046
- 1744-4144
- OpenAlex
- W2471250754
- Cited by
- 89
- References
- 33
- Citations by year
- 2026: 5 · 2025: 11 · 2024: 14 · 2023: 19 · 2022: 8 · 2021: 5 · 2020: 10 · 2019: 5 · 2018: 7 · 2017: 5
- FWCI
- 1.96
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- The Clinical Neuropsychologist (publishedVersion, cc-by-nc-nd)
- Research portal (Tilburg University) (publishedVersion, other-oa)
- PubMed (publishedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- Funders
- Nederlandse Organisatie voor Wetenschappelijk Onderzoek (452-11-004)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Cognitive Abilities and Testing
- Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
- Keywords
- measurement invariance, neurocognitive testing, WAIS-III, WAIS-IV, subgroup differences, gender differences, ethnicity, socioeconomic status, educational background, test validity, reference values
- MeSH terms
- Adult, Cognition, Ethnicity, Female, Humans, Intelligence Tests, Male, Neuropsychological Tests, Wechsler Scales, Reproducibility of Results
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The importance of measurement invariance in neurocognitive ability testing. https://app.cochat.ai/papers/10.1080/13854046.2016.1205136
- The paper
- Wicherts, J. M. (2016). The importance of measurement invariance in neurocognitive ability testing. The Clinical Neuropsychologist. https://doi.org/10.1080/13854046.2016.1205136
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.