A knowledge-based theory of rising scores on “culture-free” tests.
The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Abstract
Secular gains in intelligence test scores have perplexed researchers since they were documented by Flynn (1984, 1987). Gains are most pronounced on abstract, so-called culture-free tests, prompting Flynn (2007) to attribute them to problem-solving skills availed by scientifically advanced cultures. We propose that recent-born individuals have adopted an approach to analogy that enables them to infer higher level relations requiring roles that are not intrinsic to the objects that constitute initial representations of items. This proposal is translated into item-specific predictions about differences between cohorts in pass rates and item-response patterns on the Raven's Matrices (Flynn, 1987), a seemingly culture-free test that registers the largest Flynn effect. Consistent with predictions, archival data reveal that individuals born around 1940 are less able to map objects at higher levels of relational abstraction than individuals born around 1990. Polytomous Rasch models verify predicted violations of measurement invariance, as raw scores are found to underestimate the number of analogical rules inferred by members of the earlier cohort relative to members of the later cohort who achieve the same overall score. The work provides a plausible cognitive account of the Flynn effect, furthers understanding of the cognition of matrix reasoning, and underscores the need to consider how test-takers select item responses.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Rasch model for partial credit scoring
Masters, G. N. (1982) · Psychometrika · doi:10.1007/bf02296272 · Cited by 3,782
Protocol Analysis: Verbal Reports as Data
Ericsson, K. A., & Simon, H. A. (1993) · doi:10.7551/mitpress/5657.001.0001 · Cited by 3,537
Ericsson, K. A., & Kintsch, W. (1995) · Psychological Review · doi:10.1037/0033-295x.102.2.211 · Cited by 3,498 · cited 1×
“Secular gains in intelligence test scores have perplexed researchers since they were documented by Flynn (1984, 1987), but few have attempted to understand them as a cognitive phenomenon. Gains are most pronounced on seemingly ―culture-free‖ tests, which require analogical reasoning in the near-absence of familiar con…”
BackgroundIntelligence: Knowns and unknowns.
Neisser, U., Boodoo, G., Bouchard, T. J., Boykin, A. W., Brody, N., Ceci, S. J., Halpern, D. F., Loehlin, J. C., Perloff, R., Sternberg, R. J., et al. (1996) · American Psychologist · doi:10.1037/0003-066x.51.2.77 · Cited by 2,913
Massive IQ gains in 14 nations: What IQ tests really measure.
Flynn, J. R. (1987) · Psychological Bulletin · doi:10.1037/0033-2909.101.2.171 · Cited by 1,918 · cited 2×
“The test has one of the largest Flynn effects (Brouwers et al., 2009; Flynn, 1987), making it an ideal instrument for evaluating the present theory.”
BackgroundCarpenter, P. A., Just, M. A., & Shell, P. (1990) · Psychological Review · doi:10.1037/0033-295x.97.3.404 · Cited by 1,648
The theoretical status of latent variables.
Borsboom, D., Mellenbergh, G. J., & van Heerden, J. (2003) · Psychological Review · doi:10.1037/0033-295x.110.2.203 · Cited by 1,566
How Can the Human Mind Occur in the Physical Universe?
Anderson, J. R. (2007) · doi:10.1093/acprof:oso/9780195324259.001.0001 · Cited by 1,483
The influence of improvement in one mental function upon the efficiency of other functions. (I).
Woodworth, R. S., & Thorndike, E. L. (1901) · Psychological Review · doi:10.1037/h0074898 · Cited by 1,223
The mean IQ of Americans: Massive gains 1932 to 1978.
Flynn, J. R. (1984) · Psychological Bulletin · doi:10.1037/0033-2909.95.1.29 · Cited by 1,206 · cited 4×
“tests designed not to test knowledge that have seen the largest gains of all (Flynn, 1984; 1987).”
BackgroundInfluentialDarwin's mistake: Explaining the discontinuity between human and nonhuman minds
Penn, D. C., Holyoak, K. J., & Povinelli, D. J. (2008) · Behavioral and Brain Sciences · doi:10.1017/s0140525x08003543 · Cited by 1,174
Ceci, S. J. (1991) · Developmental Psychology · doi:10.1037/0012-1649.27.5.703 · Cited by 837 · cited 1×
“The search for prospective causes has focused on broad ecological changes, from improved education (Blair, Gamson, Thorne, Baker, 2005; Ceci, 1991), to better nutrition (Colom, LluisFont, & Andrés-Pueyo, 2005; Lynn, 1990; Martorell, 1998), to increasing availability of information (Barber, 2005), to shrinking sibship…”
BackgroundHeritability estimates versus large environmental effects: The IQ paradox resolved.
Dickens, W. T., & Flynn, J. R. (2001) · Psychological Review · doi:10.1037/0033-295x.108.2.346 · Cited by 663
Bunge, M. (1997) · Philosophy of the Social Sciences · doi:10.1177/004839319702700402 · Cited by 620
What Is Intelligence?: Beyond the Flynn Effect
Flynn, J. R. (2007) · doi:10.1017/cbo9780511605253 · Cited by 590
CHALMERS, D. J., FRENCH, R. M., & HOFSTADTER, D. R. (1992) · Journal of Experimental & Theoretical Artificial Intelligence · doi:10.1080/09528139208953747 · Cited by 333
Are intelligence tests measurement invariant over time? Investigating the nature of the Flynn effect
Wicherts, J. M., Dolan, C. V., Hessen, D. J., Oosterveld, P., van Baal, G. C. M., Boomsma, D. I., & Span, M. M. (2004) · Intelligence · doi:10.1016/j.intell.2004.07.002 · Cited by 211
The role of nutrition in secular increases in intelligence
Lynn, R. (1990) · Personality and Individual Differences · doi:10.1016/0191-8869(90)90241-i · Cited by 180
A long-term rise and recent decline in intelligence test performance: the Flynn effect in reverse
Teasdale, T. W., & Owen, D. R. (2005) · Personality and Individual Differences · doi:10.1016/j.paid.2005.01.029 · Cited by 156
COLOM, R., LLUISFONT, J., & ANDRESPUEYO, A. (2005) · Intelligence · doi:10.1016/j.intell.2004.07.010 · Cited by 106
Wicherts, J. M., Dolan, C. V., Carlson, J. S., & van der Maas, H. L. J. (2010) · Learning and Individual Differences · doi:10.1016/j.lindif.2009.12.001 · Cited by 102
Wiley, J., Jarosz, A. F., Cushen, P. J., & Colflesh, G. J. H. (2011) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0021613 · Cited by 99
Lynn, R., & Harvey, J. (2008) · Intelligence · doi:10.1016/j.intell.2007.03.004 · Cited by 73
Fox, M. C., & Charness, N. (2010) · Aging, Neuropsychology, and Cognition · doi:10.1080/13825580903042668 · Cited by 61 · cited 3×
“A methodological concern, given Fox and Charness’ (2010) finding of higher scores among”
BackgroundInfluentialSelf-citationBeaujean, A. A., & Osterlind, S. J. (2008) · Intelligence · doi:10.1016/j.intell.2007.10.004 · Cited by 56
Age-related IQ decline is reduced markedly after adjustment for the Flynn effect
Dickinson, M. D., & Hiscock, M. (2010) · Journal of Clinical and Experimental Neuropsychology · doi:10.1080/13803391003596413 · Cited by 29
Cited by
The Importance of Measurement Invariance in Neurocognitive Ability Testing
Wicherts, J. M. (2016) · The Clinical Neuropsychologist · doi:10.1080/13854046.2016.1205136 · Cited by 89
The “Flynn effect” and Flynn’s paradox
Flynn, J. R. (2013) · Intelligence · doi:10.1016/j.intell.2013.06.014 · Cited by 42
“Recently a brilliant article assessed what actually allows each generation to do better on it than the preceding generation (Fox & Mitchum, 2013).”
Wicherts, J. M. (2017) · Intelligence · doi:10.1016/j.intell.2016.11.002 · Cited by 17
Metadata
- Authors
- Fox, M. C., & Mitchum, A. L.
- Venue
- Journal of Experimental Psychology: General
- Published
- 2013-08
- Volume
- 142
- Issue
- 3
- Pages
- 979-1000
- ISSN
- 0096-3445 (ISSN-L)
- 1939-2222
- OpenAlex
- W2131571723
- Cited by
- 50
- References
- 26
- FWCI
- 7.44
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.