Looking for Flynn effects in a recent online U.S. adult sample: Examining shifts within the SAPA Project
Open accessAbstract
Compared to European countries, research is limited regarding if the Flynn effect, or its reversal, is a current phenomenon in the United States. Though recent research on the United States suggests that a Flynn effect could still be present, or partially present, among child and adolescent samples, few studies have explored differences of cognitive ability scores among US adults. Thirteen years of cross-sectional data from a subsample of adults (n = 394,378) were obtained from the Synthetic Aperture Personality Assessment Project (SAPA Project) to examine if cognitive ability scores changed within the United States from 2006 to 2018. Responses to an overlapping set of 35 (collected 2006–2018) and 60 (collected 2011–2018) items from the open-source multiple choice intelligence assessment International Cognitive Ability Resource (ICAR) were used to examine the trends in standardized average composite cognitive ability scores and domain scores of matrix reasoning, letter and number series, verbal reasoning, and three-dimensional rotation. Composite ability scores from 35 items and domain scores (matrix reasoning; letter and number series) showed a pattern consistent with a reversed Flynn effect from 2006 to 2018 when stratified across age, education, or gender. Slopes for verbal reasoning scores, however, failed to meet or exceed an annual threshold of |0.02| SD. A reversed Flynn effect was also present from 2011 to 2018 for composite ability scores from 60 items across age, education, and gender. Despite declining scores across age and demographics in other domains of cognitive ability, three-dimensional rotation scores showed evidence of a Flynn effect with the largest slopes occurring across age stratified regressions.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Cites
The g factor: the science of mental ability
(1998) · Choice Reviews Online · doi:10.5860/choice.36-2443 · Cited by 2,760 · see citing works
Theory of fluid and crystallized intelligence: A critical experiment.
Cattell, R. B. (1963) · Journal of Educational Psychology · doi:10.1037/h0046743 · Cited by 2,556 · see citing works
Ziegel, E. R., & Lohr, S. L. (2000) · Technometrics · doi:10.2307/1271491 · Cited by 2,450 · see citing works
Massive IQ gains in 14 nations: What IQ tests really measure.
Flynn, J. R. (1987) · Psychological Bulletin · doi:10.1037/0033-2909.101.2.171 · Cited by 1,918 · see citing works
Refinement and test of the theory of fluid and crystallized general intelligences.
Horn, J. L., & Cattell, R. B. (1966) · Journal of Educational Psychology · doi:10.1037/h0023816 · Cited by 1,570 · see citing works
Human cognitive abilities: A survey of factor-analytic studies
Eysenck, H. J. (1994) · Personality and Individual Differences · doi:10.1016/0191-8869(94)90126-0 · Cited by 1,392 · see citing works
McGrew, K. S. (2009) · Intelligence · doi:10.1016/j.intell.2008.08.004 · Cited by 1,354 · see citing works
The bell curve: intelligence and class structure in American life
(1995) · Choice Reviews Online · doi:10.5860/choice.32-5357 · Cited by 1,261 · see citing works
The mean IQ of Americans: Massive gains 1932 to 1978.
Flynn, J. R. (1984) · Psychological Bulletin · doi:10.1037/0033-2909.95.1.29 · Cited by 1,206 · see citing works
Selective review of cognitive aging
SALTHOUSE, T. A. (2010) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617710000706 · Cited by 1,166 · see citing works
Consequences of Age-Related Cognitive Declines
Salthouse, T. (2012) · Annual Review of Psychology · doi:10.1146/annurev-psych-120710-100328 · Cited by 818 · see citing works
Trajectories of normal cognitive aging
Salthouse, T. A. (2019) · Psychology and Aging · doi:10.1037/pag0000288 · Cited by 730 · see citing works
The measurement of adult intelligence.
Cattell, R. B. (1943) · Psychological Bulletin · doi:10.1037/h0059973 · Cited by 669 · see citing works
Searching for justice: The discovery of IQ gains over time.
Flynn, J. R. (1999) · American Psychologist · doi:10.1037/0003-066x.54.1.5 · Cited by 499 · see citing works
Yang, Y., & Land, K. C. (2006) · Sociological Methodology · doi:10.1111/j.1467-9531.2006.00175.x · Cited by 440 · see citing works
The SAGE Handbook of Online Research Methods
Fielding, N., Lee, R. M., & Blank, G. (2016) · SAGE Publications Ltd eBooks · doi:10.4135/9781473957992 · Cited by 435 · see citing works
Johnson, W., & BOUCHARDJR, T. (2005) · Intelligence · doi:10.1016/j.intell.2004.12.002 · Cited by 433 · see citing works
Condon, D., & Revelle, W. (2014) · Intelligence · doi:10.1016/j.intell.2014.01.004 · Cited by 406 · see citing works
Self-citationThe Flynn effect: A meta-analysis.
Trahan, L. H., Stuebing, K. K., Fletcher, J. M., & Hiscock, M. (2014) · Psychological Bulletin · doi:10.1037/a0037173 · Cited by 364 · see citing works
One Century of Global IQ Gains: A Formal Meta-Analysis of the Flynn Effect (1909–2013)
Pietschnig, J., & Voracek, M. (2015) · Perspectives on Psychological Science · doi:10.1177/1745691615577701 · Cited by 316 · see citing works
Video game training does not enhance cognitive ability: A comprehensive meta-analytic investigation
Sala, G., Tatlidil, K. S., & Gobet, F. (2018) · Psychological Bulletin · doi:10.1037/bul0000139 · Cited by 257 · cited 1× · see citing works
“…in differences of three-dimensional scores are due to playing video games, as much as the relationship between playing video games and spatial ability (Sala, Tatlidil, and Gobet, 2018) may be acting as a greater protective factor for lower scores that could be observed in this domain of ability.”
BackgroundHandbook of Individual Differences in Cognition
Gruszka, A., Matthews, G., & Szymura, B. (2010) · Plenum series on human exceptionality · doi:10.1007/978-1-4419-1210-7 · Cited by 232 · see citing works
McGrew, K. S., & Wendling, B. J. (2010) · Psychology in the Schools · doi:10.1002/pits.20497 · Cited by 232 · see citing works
Sundet, J. M., Barlaug, D., & Torjussen, T. M. (2004) · Intelligence · doi:10.1016/s0160-2896(04)00052-2 · Cited by 228 · see citing works
Analyzing Age-Period-Cohort Data: A Review and Critique
Fosse, E., & Winship, C. (2019) · The Annual review of sociology · doi:10.1146/annurev-soc-073018-022616 · Cited by 220 · see citing works
What is intelligence?: beyond the Flynn effect
(2008) · Choice Reviews Online · doi:10.5860/choice.45-4077 · Cited by 213 · see citing works
Flynn effect and its reversal are both environmentally caused
Bratsberg, B., & Rogeberg, O. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1718793115 · Cited by 199 · see citing works
Secular declines in cognitive test scores: A reversal of the Flynn Effect
Teasdale, T. W., & Owen, D. R. (2008) · Intelligence · doi:10.1016/j.intell.2007.01.007 · Cited by 185 · see citing works
Ability factors and environmental influences.
Vernon, P. E. (1965) · American Psychologist · doi:10.1037/h0021472 · Cited by 181 · see citing works
The negative Flynn Effect: A systematic literature review
Dutton, E., van der Linden, D., & Lynn, R. (2016) · Intelligence · doi:10.1016/j.intell.2016.10.002 · Cited by 160 · see citing works
A long-term rise and recent decline in intelligence test performance: the Flynn effect in reverse
Teasdale, T. W., & Owen, D. R. (2005) · Personality and Individual Differences · doi:10.1016/j.paid.2005.01.029 · Cited by 156 · see citing works
RISING SCORES ON INTELLIGENCE TESTS
Neisser, U. (1997) · American Scientist · Cited by 148 · see citing works
Continuing secular increases in intellgence and a stable prevalence of high intelligence levels
Teasdale, T. W., & Owen, D. R. (1989) · Intelligence · doi:10.1016/0160-2896(89)90021-4 · Cited by 119 · see citing works
What has caused the Flynn effect? Secular increases in the development quotients of infants
Lynn, R. (2009) · Intelligence · doi:10.1016/j.intell.2008.07.008 · Cited by 111 · see citing works
A critique of the Flynn Effect: massive IQ gains, methodological artifacts, or both?
Rodgers, J. L. (1998) · Intelligence · doi:10.1016/s0160-2896(99)00004-5 · Cited by 110 · see citing works
COLOM, R., LLUISFONT, J., & ANDRESPUEYO, A. (2005) · Intelligence · doi:10.1016/j.intell.2004.07.010 · Cited by 106 · see citing works
Condon, D. M. (2018) · doi:10.31234/osf.io/sc4p9 · Cited by 102 · see citing works
Self-citationA negative Flynn effect in Finland, 1997–2009
Dutton, E., & Lynn, R. (2013) · Intelligence · doi:10.1016/j.intell.2013.05.008 · Cited by 100 · see citing works
The Flynn effect and population aging
Skirbekk, V., Stonawski, M., Bonsang, E., & Staudinger, U. M. (2013) · Intelligence · doi:10.1016/j.intell.2013.02.001 · Cited by 89 · see citing works
The WAIS-III and WAIS-IV: Daubert Motions Favor the Certainly False over the Approximately True
Flynn, J. (2009) · Applied Neuropsychology · doi:10.1080/09084280902864360 · Cited by 82 · see citing works
Dworak, E. M., Revelle, W., Doebler, P., & Condon, D. M. (2020) · Personality and Individual Differences · doi:10.1016/j.paid.2020.109906 · Cited by 78 · see citing works
Self-citationIndividual Differences in Cognition: New Methods for Examining the Personality-Cognition Link
Revelle, W., Wilt, J. A., & Rosenthal, A. M. (2010) · Plenum series on human exceptionality · doi:10.1007/978-1-4419-1210-7_2 · Cited by 69 · see citing works
Self-citationExploring the persome: The power of the item in understanding personality structure
Revelle, W., Dworak, E. M., & Condon, D. M. (2020) · Personality and Individual Differences · doi:10.1016/j.paid.2020.109905 · Cited by 68 · see citing works
Self-citationWeb- and Phone-based Data Collection using Planned Missing Designs
Revelle, W., Condon, D. M., Wilt, J. A., French, J. A., Brown, A., & Elleman, L. G. (2016) · SAGE Publications Ltd eBooks · doi:10.4135/9781473957992.n33 · Cited by 62 · see citing works
Self-citationThe rise and fall of the Flynn Effect as a reason to expect a narrowing of the Black–White IQ gap☆
Rushton, J. P., & Jensen, A. R. (2010) · Intelligence · doi:10.1016/j.intell.2009.12.002 · Cited by 61 · see citing works
A negative Flynn effect in France, 1999 to 2008–9
Dutton, E., & Lynn, R. (2015) · Intelligence · doi:10.1016/j.intell.2015.05.005 · Cited by 58 · see citing works
Ang, S., Rodgers, J. L., & Wänström, L. (2010) · Intelligence · doi:10.1016/j.intell.2010.05.004 · Cited by 53 · see citing works
Pietschnig, J., & Gittler, G. (2015) · Intelligence · doi:10.1016/j.intell.2015.10.004 · Cited by 51 · see citing works
In the Netherlands the anti-Flynn effect is a Jensen effect
Menie, M. A. W. O., & Meisenberg, G. (2013) · Personality and Individual Differences · doi:10.1016/j.paid.2012.12.022 · Cited by 50 · see citing works
Identification of a Flynn Effect in the NLSY: Moving from the center to the boundaries
Rodgers, J. L., & Wänström, L. (2006) · Intelligence · doi:10.1016/j.intell.2006.06.002 · Cited by 47 · see citing works
“In What Way Are Apples and Oranges Alike?” A Critique of Flynn’s Interpretation of the Flynn Effect
Kaufman, A. S. (2010) · Journal of Psychoeducational Assessment · doi:10.1177/0734282910373346 · Cited by 45 · see citing works
Secular trends in cognitive test performance: Swedish conscript data 1970–1993
Rönnlund, M., Carlstedt, B., Blomstedt, Y., Nilsson, L., & Weinehall, L. (2012) · Intelligence · doi:10.1016/j.intell.2012.10.001 · Cited by 41 · see citing works
Changes in test-taking patterns over time
Must, O., & Must, A. (2013) · Intelligence · doi:10.1016/j.intell.2013.04.005 · Cited by 40 · see citing works
An Examination of the Convergent Validity of the ICAR16 and WAIS-IV
Young, S. R., & Keith, T. Z. (2020) · Journal of Psychoeducational Assessment · doi:10.1177/0734282920943455 · Cited by 38 · see citing works
Pietschnig, J., Tran, U. S., & Voracek, M. (2013) · Intelligence · doi:10.1016/j.intell.2013.06.005 · Cited by 34 · see citing works
Platt, J. M., Keyes, K. M., McLaughlin, K. A., & Kaufman, A. S. (2019) · Intelligence · doi:10.1016/j.intell.2019.101385 · Cited by 32 · see citing works
Peeking Inside the “Black Box” of the Flynn Effect: Evidence From Three Wechsler Instruments
Zhou, X., Zhu, J., & Weiss, L. G. (2010) · Journal of Psychoeducational Assessment · doi:10.1177/0734282910373340 · Cited by 31 · see citing works
Selected Personality Data from the SAPA-Project: On the Structure of Phrased Self-Report Items
Condon, D. M., & Revelle, W. (2015) · Journal of Open Psychology Data · doi:10.5334/jopd.al · Cited by 31 · see citing works
Self-citationA SAPA Project Update: On the Structure of phrased Self-Report Personality Items
Condon, D. M., Roney, E., & Revelle, W. (2017) · Journal of Open Psychology Data · doi:10.5334/jopd.32 · Cited by 30 · see citing works
Self-citationShakeel, M. D., & Peterson, P. E. (2022) · Educational Psychology Review · doi:10.1007/s10648-021-09657-y · Cited by 26 · see citing works
The Flynn Effect: A Quantitative Commentary on Modernity and Human Intelligence
Clark, C. M., Lawlor‐Savage, L., & Goghari, V. M. (2016) · Measurement Interdisciplinary Research and Perspectives · doi:10.1080/15366367.2016.1156910 · Cited by 22 · see citing works
O’Keefe, P., & Rodgers, J. L. (2017) · Multivariate Behavioral Research · doi:10.1080/00273171.2017.1354758 · Cited by 20 · see citing works
Declines in vocabulary among American adults within levels of educational attainment, 1974–2016
Twenge, J. M., Campbell, W. K., & Sherman, R. A. (2019) · Intelligence · doi:10.1016/j.intell.2019.101377 · Cited by 20 · see citing works
Cognitive Ability in Everyday Life: The Utility of Open-Source Measures
Revelle, W., Dworak, E. M., & Condon, D. M. (2020) · Current Directions in Psychological Science · doi:10.1177/0963721420922178 · Cited by 20 · see citing works
Self-citationConsiderations on the Flynn Effect
Weiss, L. G. (2010) · Journal of Psychoeducational Assessment · doi:10.1177/0734282910373572 · Cited by 19 · see citing works
“Apples and Oranges Are Both Round”: Furthering the Discussion on the Flynn Effect
Ceci, S. J., & Kanaya, T. (2010) · Journal of Psychoeducational Assessment · doi:10.1177/0734282910373339 · Cited by 17 · see citing works
Benson, N. F., Beaujean, A. A., & Taub, G. E. (2015) · Multivariate Behavioral Research · doi:10.1080/00273171.2015.1022642 · Cited by 16 · see citing works
Condon, D. M., & Revelle, W. (2016) · Journal of Open Psychology Data · doi:10.5334/jopd.25 · Cited by 15 · see citing works
Self-citationGiangrande, E. J., Beam, C. R., Finkel, D., Davis, D. W., & Turkheimer, E. N. (2021) · Child Development · doi:10.1111/cdev.13675 · Cited by 15 · see citing works
Russell, E. W. (2007) · Applied Neuropsychology · doi:10.1080/09084280701719211 · Cited by 12 · see citing works
The Flynn Effect: Technology May Be Part of It, But Is Most Certainly Not All of It
Pietschnig, J. (2016) · Measurement Interdisciplinary Research and Perspectives · doi:10.1080/15366367.2016.1171612 · Cited by 9 · see citing works
Flagged first, then by citations
Research works printed but not linked: 6
- Gittler, 1998, Differential transfer of learning: Effects of instruction in descriptive geometry on spatial test performance, Journal for Geometry and Graphics, 2, 71
- Guarino, 2018, Scientists identify four personality types, Washington Post
- mistressredditor, 2013, Cutting edge personality test measures the Big Five, Small Six, and Great Three factors of personality. [Online forum post], Reddit
- Pietschnig, 2018, Is the Flynn effect related to migration?, Politische Psychologie, 267
- SAPAPsych, 2014, [Academic] Help me get more participants for my senior thesis and receive data on your personality profile in return! All welcome, ages 14 and up. should take around 20 minutes. [Online forum post], Reddit
- SAPAPsych, 2014, Cutting edge personality test (measures Big Five, Small Six, and Great Three factors of personality) with new and improved personality feedback. We took your comments and revised our test! [Online forum post], Reddit
Cited by
Sorted by citations
Wait, Where’s the Flynn Effect on the WAIS-5?
Winter, E. L., Trudel, S. M., & Kaufman, A. S. (2024) · Journal of Intelligence · doi:10.3390/jintelligence12110118 · Cited by 5 · see citing works
- Authors
- Dworak, E. M., Revelle, W., & Condon, D. M.
- Affiliations
- Northwestern University (US)
- University of Oregon (US)
- Corresponding author
- Dworak, Elizabeth M.
- Venue
- Intelligence
- Publisher
- Elsevier BV
- Published
- 2023-05
- Volume
- 98
- Pages
- 101734
- ISSN
- 0160-2896 (ISSN-L)
- OpenAlex
- W4322761152
- Semantic Scholar
- c6731ffe1670087d6663810244d6f1bf440936bf
- Cited by
- 35
- References
- 71
- Citations by year
- 2026: 8 · 2025: 11 · 2024: 9 · 2023: 7
- FWCI
- 8.46
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Intelligence (publishedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- Funders
- National Science Foundation (SMA-1419324)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Cognitive Abilities and Testing
- Social Sciences › Sociology and Political Science › Intergenerational and Educational Inequality Studies
- Social Sciences › Psychology › Neuropsychology and Physiological Psychology › Aging and Gerontology Research
- Keywords
- Flynn effect, matrix reasoning, verbal reasoning, 3D rotation, age differences in intelligence, United States
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
