“In What Way Are Apples and Oranges Alike?” A Critique of Flynn’s Interpretation of the Flynn Effect
Abstract
Flynn wrote a book devoted to the Flynn effect, featuring his theoretical explanation of why the intelligence of worldwide populations has apparently increased from generation to generation. The essence of his theorizing is that because of the societal impact of scientific technology, people of today are much more guided by abstract, rather than concrete, approaches to problem solving. He bases his theory in large part on gains on specific tasks, most notably Raven’s matrices, Wechsler Intelligence Scale for Children (WISC) Performance subtests, and, most important, on WISC Similarities. The gains on these separate tasks over more than half a century (1947-2002) are striking. However, Flynn failed to take into account the sweeping changes in test content, administration procedures, and scoring guidelines when the 1974 WISC-R was developed from the 1949 WISC. These substantial changes challenge the meaningfulness of comparing children’s performance in 1947 with their performance in 2002 on Similarities and other WISC subtests— and therefore challenge Flynn’s explanation of the effect that bears his name.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The patterns of order effects are consistent with the hypothesis by Kaufman (2010).
“The patterns are consistent with hypothesis by Kaufman (2010).”
From The Flynn effect: A meta-analysis. (2014) · cites this paper as Kaufman (2010)
The earlier and later versions of the same test may differ significantly in format or content.
“the earlier and later versions of the same test may differ significantly in format or content (e.g., Kaufman, 2010)”
From The Flynn effect: A meta-analysis. (2014) · cites this paper as Kaufman, 2010
Our data do not address Kaufman's (2010) more specific concern about asymmetric order effects such that taking the newer test first increased subsequent performance on the older test more than taking the older test first increases subsequent performance on the newer test.
“Our data do not address Kaufman’s (2010) more specific concern about asymmetric order effects such that taking the newer test first increased subsequent performance on the older test more than taking the older test first increases subsequent performance on the newer test.”
From The Flynn effect: A meta-analysis. (2014) · cites this paper as Kaufman (2010)
The conclusion is in line with a tradition of studies attributing fluctuations of intelligence scores to methodological biases, especially as they relate to cultural item content.
“This conclusion is in line with a tradition of studies attributing fluctuations of intelligence scores to methodological biases, especially as they relate to [cultural] item content”
From No negative Flynn effect in France: Why variations of intelligence should not be assessed using tests based on cultural knowledge (2021) · cites this paper as Kaufman, 2010
Cites
Puberty-related influences on brain development
Giedd, J. N., Clasen, L. S., Lenroot, R., Greenstein, D., Wallace, G. L., Ordaz, S., Molloy, E. A., Blumenthal, J. D., Tossell, J. W., Stayer, C., et al. (2006) · Molecular and Cellular Endocrinology · doi:10.1016/j.mce.2006.04.016 · Cited by 300 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
The Flynn effect: A meta-analysis.
Trahan, L. H., Stuebing, K. K., Fletcher, J. M., & Hiscock, M. (2014) · Psychological Bulletin · doi:10.1037/a0037173 · Cited by 364 · see citing works
“…(Elliot, 1990, 2007), Kaufman Adolescent and Adult Intelligence Test (Kaufman & Kaufman, 1993), Kaufman Assessment Battery for Children (Kaufman & Kaufman, 1983, 2004a), Kaufman Brief Intelligence Test (Kaufman & Kaufman, 1990, 2004b), McCarthy Scales of Children’s Abilities (McCarthy, 1972),…”
Dworak, E. M., Revelle, W., & Condon, D. M. (2023) · Intelligence · doi:10.1016/j.intell.2023.101734 · Cited by 35 · see citing works
Gonthier, C., Grégoire, J., & Besançon, M. (2021) · Intelligence · doi:10.1016/j.intell.2020.101512 · Cited by 20 · see citing works
“Apples and Oranges Are Both Round”: Furthering the Discussion on the Flynn Effect
Ceci, S. J., & Kanaya, T. (2010) · Journal of Psychoeducational Assessment · doi:10.1177/0734282910373339 · Cited by 17 · see citing works
- Authors
- Kaufman, A. S.
- Affiliations
- Yale University (US)
- Corresponding author
- Kaufman, Alan S.
- Venue
- Journal of Psychoeducational Assessment
- Publisher
- SAGE Publications
- Published
- 2010-06-16
- Volume
- 28
- Issue
- 5
- Pages
- 382-398
- ISSN
- 0734-2829 (ISSN-L)
- 1557-5144
- OpenAlex
- W1971207991
- Cited by
- 45
- References
- 1
- Citations by year
- 2026: 1 · 2025: 2 · 2023: 1 · 2022: 3 · 2021: 2 · 2020: 1 · 2019: 1 · 2017: 1 · 2016: 1 · 2015: 6 · 2014: 5 · 2013: 7 · 2012: 1
- FWCI
- 8.10
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Psychoeducational Assessment (publishedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Cognitive Abilities and Testing
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
- Keywords
- Flynn effect, Raven's Progressive Matrices, WISC-R, test administration procedures
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
