Are intelligence tests measurement invariant over time? Investigating the nature of the Flynn effect
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Wicherts and colleagues (2004) found that measurement bias often affected subtests with a substantial weight of culture-based declarative knowledge; in their study with the WAIS, the two subtests with substantial measurement bias across cohorts were Similarities and Comprehension, both VCI subtests.
“Wicherts and colleagues (2004) found that this measurement bias often affected subtests with a substantial weight of culture-based declarative knowledge; in their study with the WAIS, the two subtests with substantial measurement bias across cohorts were Similarities and Comprehension, both subtests of the VCI.”
From No negative Flynn effect in France: Why variations of intelligence should not be assessed using tests based on cultural knowledge (2021) · cites this paper as Wicherts et al., 2004
Performance can be represented as a hierarchical model with four levels: latent general intelligence g; latent broad dimensions such as Gf, Gc, Gq, Gs, Gsm; observed performance on subtests; and observed performance on items.
“Performance can be represented as a hierarchical model with four levels: on the top is latent general intelligence, g; on the second level are latent broad dimensions of intelligence such as Gf, Gc, Gq, Gs and Gsm; on the third level is observed performance on the various subtests that serve to estimate latent dimensions; and on the fourth level is observed performance on the specific items that”
From No negative Flynn effect in France: Why variations of intelligence should not be assessed using tests based on cultural knowledge (2021) · cites this paper as Wicherts et al., 2004
Subtests primarily reflecting Gc intrinsically depend on culture-based declarative knowledge, and culture as assessed by these tests changes over time, making them especially likely to develop DIF.
“On the other hand, subtests primarily reflecting Gc intrinsically depend on culture-based declarative knowledge, and culture as assessed by these tests changes over time (e.g.Pietschnig et al., 2013), making them especially likely to develop DIF (see Beaujean & Osterlind, 2008;Pietschnig et al., 2013;Wicherts et al., 2004).”
From No negative Flynn effect in France: Why variations of intelligence should not be assessed using tests based on cultural knowledge (2021) · cites this paper as Wicherts et al., 2004
Intelligence tests, including the WAIS, do not demonstrate measurement invariance over time; the baseline difficulty of a given subtest can change over time, even when controlling for ability.
“In line with this idea, intelligence tests -including the WAIS -do not demonstrate measurement invariance over time: in particular, the baseline difficulty of a given subtest can change over time, even when controlling for ability (Wicherts et al., 2004).”
From No negative Flynn effect in France: Why variations of intelligence should not be assessed using tests based on cultural knowledge (2021) · cites this paper as Wicherts et al., 2004
Cites
Item bias and item response theory
Mellenbergh, G. J. (1989) · International Journal of Educational Research · doi:10.1016/0883-0355(89)90002-5 · Cited by 553 · see citing works
Investigating Spearman's Hypothesis by Means of Multi-Group Confirmatory Factor Analysis
Dolan, C. V. (2000) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3501_2 · Cited by 99 · see citing works
Self-citationSecular gains in fluid intelligence: Evidence from the culture-fair intelligence test
COLOM, R., & GARCÍA-LÓPEZ, O. (2003) · Journal of Biosocial Science · doi:10.1017/s0021932003000336 · Cited by 42 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
A dynamical model of general intelligence: The positive manifold of intelligence by mutualism.
Van Der Maas, H. L. J., Dolan, C. V., Grasman, R. P. P. P., Wicherts, J. M., Huizenga, H. M., & Raijmakers, M. E. J. (2006) · Psychological Review · doi:10.1037/0033-295x.113.4.842 · Cited by 1,006 · see citing works
Self-citationIntelligence: New findings and theoretical developments
Nisbett, R. E., Aronson, J., Blair, C., Dickens, W., Flynn, J., Halpern, D. F., & Turkheimer, E. (2012) · American Psychologist · doi:10.1037/a0026699 · Cited by 968 · see citing works
Developmental cognitive neuroscience using latent change score models: A tutorial and applications
Kievit, R. A., Brandmaier, A. M., Ziegler, G., van Harmelen, A.-L., de Mooij, S. M. M., Moutoussis, M., Goodyer, I. M., Bullmore, E., Jones, P. B., Fonagy, P., et al. (2018) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2017.11.007 · Cited by 516 · see citing works
Tracking executive function across the transition to school: A latent variable approach.
Hughes, C., Ensor, R., Wilson, A., & Graham, A. (2009) · Developmental Neuropsychology · doi:10.1080/87565640903325691 · Cited by 448 · see citing works
The Flynn effect: A meta-analysis.
Trahan, L. H., Stuebing, K. K., Fletcher, J. M., & Hiscock, M. (2014) · Psychological Bulletin · doi:10.1037/a0037173 · Cited by 364 · see citing works
“Wicherts et al. (2004) found that intelligence measures were not factorially invariant, such that the measures displayed differential patterns of gains and losses that were unexpected given each test’s common factor means.”
Secular declines in cognitive test scores: A reversal of the Flynn Effect
Teasdale, T. W., & Owen, D. R. (2008) · Intelligence · doi:10.1016/j.intell.2007.01.007 · Cited by 185 · see citing works
Score gains on g-loaded tests: No g
te Nijenhuis, J., van Vianen, A. E. M., & van der Flier, H. (2007) · Intelligence · doi:10.1016/j.intell.2006.07.006 · Cited by 129 · see citing works
Stereotype Threat and Group Differences in Test Performance: A Question of Measurement Invariance.
Wicherts, J. M., Dolan, C. V., & Hessen, D. J. (2005) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.89.5.696 · Cited by 126 · see citing works
Self-citationWicherts, J. M., Dolan, C. V., Carlson, J. S., & van der Maas, H. L. J. (2010) · Learning and Individual Differences · doi:10.1016/j.lindif.2009.12.001 · Cited by 102 · see citing works
Self-citationThe Importance of Measurement Invariance in Neurocognitive Ability Testing
Wicherts, J. M. (2016) · The Clinical Neuropsychologist · doi:10.1080/13854046.2016.1205136 · Cited by 89 · see citing works
Self-citationRushton, J. P., & Jensen, A. R. (2010) · The Open Psychology Journal · doi:10.2174/1874350101003010009 · Cited by 48 · see citing works
“In any case, several studies have corroborated the results on g and group differences using MGCFA with White-Black differences in the US [52], White-Black differences in South Africa [41], and White-Roma differences in Serbia [62] (the Roma, or Gypsies, are a people of South Asian origin).”
BackgroundResultRacial equality in intelligence: Predictions from a theory of intelligence as processing
Fagan, J. F., & Holland, C. R. (2007) · Intelligence · doi:10.1016/j.intell.2006.08.009 · Cited by 47 · see citing works
Wanted: More race realism, less moralistic fallacy.
Rushton, J. P., & Jensen, A. R. (2005) · Psychology, Public Policy, and Law · doi:10.1037/1076-8971.11.2.328 · Cited by 45 · see citing works
The Totality of Available Evidence Shows the Race IQ Gap Still Remains
Rushton, J. P., & Jensen, A. R. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01803.x · Cited by 42 · see citing works
Murray, C. (2007) · Intelligence · doi:10.1016/j.intell.2007.02.001 · Cited by 37 · see citing works
Gonthier, C., Grégoire, J., & Besançon, M. (2021) · Intelligence · doi:10.1016/j.intell.2020.101512 · Cited by 20 · see citing works
Warne, R. T. (2021) · The American Journal of Psychology · doi:10.5406/amerjpsyc.134.4.0479 · Cited by 12 · see citing works
- Authors
- Wicherts, J. M., Dolan, C. V., Hessen, D. J., Oosterveld, P., van Baal, G. C. M., Boomsma, D. I., & Span, M. M.
- Affiliations
- University of Amsterdam (NL)
- Vrije Universiteit Amsterdam (NL)
- Swets (Netherlands) (NL)
- Corresponding author
- Wicherts, Jelte M.
- Venue
- Intelligence
- Publisher
- Elsevier BV
- Published
- 2004-09
- Volume
- 32
- Issue
- 5
- Pages
- 509-537
- ISSN
- 0160-2896 (ISSN-L)
- OpenAlex
- W2102390408
- Cited by
- 211
- References
- 3
- Citations by year
- 2026: 7 · 2025: 5 · 2024: 6 · 2023: 9 · 2022: 6 · 2021: 4 · 2020: 6 · 2019: 6 · 2018: 8 · 2017: 8 · 2016: 10 · 2015: 15 · 2014: 14 · 2013: 16 · 2012: 13
- FWCI
- 14.04
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Intelligence (publishedVersion)
- UvA-DARE (University of Amsterdam) (publishedVersion)
- VU Research Portal (publishedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Cognitive Abilities and Testing
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
- Keywords
- Flynn effect, measurement invariance, cohort differences, Wechsler Adult Intelligence Scale, Differential Aptitude Tests
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
