The DOI matches its Crossref record.
Unpublished results hide the decline effect
Open accessAbstract
Some effects diminish when tests are repeated. Jonathan Schooler says being open about findings that don't make the scientific record could reveal why.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling
John, L. K., Loewenstein, G., & Prelec, D. (2012) · Psychological Science · doi:10.1177/0956797611430953 · Cited by 2,239
(2011) · Cited by 2,025
Nosek (2012) · doi:10.1177/1745691612459058 · Cited by 1,301
Determinants of Entrepreneurial Intent: A Meta–Analytic Test and Integration of Competing Models
Schlaegel, C., & Koenig, M. (2014) · Entrepreneurship Theory and Practice · doi:10.1111/etap.12087 · Cited by 1,233
The relationship between nature connectedness and happiness: a meta-analysis
Capaldi, C. A., Dopko, R. L., & Zelenski, J. M. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00976 · Cited by 1,183
“Year was analyzed as a moderator because of the recent attention given to the decline effect— the observation that many scientific findings diminish with time (Schooler, 2011).”
BackgroundYeager, D. S., Romero, C., Paunesku, D., Hulleman, C. S., Schneider, B., Hinojosa, C., Lee, H. Y., O'Brien, J., Flint, K., Roberts, A., et al. (2016) · Journal of Educational Psychology · doi:10.1037/edu0000098 · Cited by 691
Facts Are More Important Than Novelty: Replication in the Education Sciences
Makel, M. C., & Plucker, J. A. (2014) · Educational Researcher · doi:10.3102/0013189x14545513 · Cited by 609
“, Rosenthal, 1979; Rotton, Foos, Vanmeek, & Levitt, 1995; Spellman, 2012), the decline effect from large initial findings (e.g., Ioannidis, 2005a; Rhine, 1934/1997; Schooler, 2011), overreliance on null hypothesis testing (e.”
Cognitive Advantage in Bilingualism: An Example of Publication Bias?
de Bruin, A., Treccani, B., & Della Sala, S. (2015) · Psychological Science · doi:10.1177/0956797614557866 · Cited by 599
Why Science Is Not Necessarily Self-Correcting
Ioannidis, J. P. A. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612464056 · Cited by 563
Verhage, M. L., Schuengel, C., Madigan, S., Fearon, R. M. P., Oosterman, M., Cassibba, R., Bakermans-Kranenburg, M. J., & van IJzendoorn, M. H. (2016) · Psychological Bulletin · doi:10.1037/bul0000038 · Cited by 550
Small Effects: The Indispensable Foundation for a Cumulative Psychological Science
Götz, F. M., Gosling, S. D., & Rentfrow, P. J. (2022) · Perspectives on Psychological Science · doi:10.1177/1745691620984483 · Cited by 538
The ironic effect of significant results on the credibility of multiple-study articles.
Schimmack, U. (2012) · Psychological Methods · doi:10.1037/a0029487 · Cited by 455
Deep impact: unintended consequences of journal rank
Brembs, B., Button, K., & Munafò, M. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00291 · Cited by 441
Kühberger, A., Fritz, A., & Scherndl, T. (2014) · PLoS ONE · doi:10.1371/journal.pone.0105825 · Cited by 399
Conservation translocations: a review of common difficulties and promising directions.
Berger‐Tal, O., Blumstein, D. T., & Swaisgood, R. R. (2020) · Animal Conservation · doi:10.1111/acv.12534 · Cited by 415
Parameter tuning or default values? An empirical investigation in search-based software engineering
Arcuri, A., & Fraser, G. (2013) · Empirical Software Engineering · doi:10.1007/s10664-013-9249-9 · Cited by 384
Weingarten, E., Chen, Q., McAdams, M., Yi, J., Hepler, J., & Albarracín, D. (2016) · Psychological Bulletin · doi:10.1037/bul0000030 · Cited by 380
Support for major hypotheses in invasion biology is uneven and declining
Jeschke, J., Gómez Aparicio, L., Haider, S., Heger, T., Lortie, C., Pyšek, P., & Strayer, D. (2012) · NeoBiota · doi:10.3897/neobiota.14.3435 · Cited by 374
Scientific Utopia: I. Opening Scientific Communication
Nosek, B. A., & Bar-Anan, Y. (2012) · Psychological Inquiry · doi:10.1080/1047840x.2012.692215 · Cited by 368
Meta-assessment of bias in science
Fanelli, D., Costas, R., & Ioannidis, J. P. A. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1618569114 · Cited by 364
Risk factors for child sexual abuse victimization: A meta-analytic review.
Assink, M., van der Put, C. E., Meeuwsen, M. W. C. M., de Jong, N. M., Oort, F. J., Stams, G. J. J. M., & Hoeve, M. (2019) · Psychological bulletin · doi:10.1037/bul0000188 · Cited by 322
Social desirability is the same in offline, online, and paper surveys: A meta-analysis
Dodou, D., & de Winter, J. C. F. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2014.04.005 · Cited by 325
Pietschnig, J., Penke, L., Wicherts, J. M., Zeiler, M., & Voracek, M. (2015) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2015.09.017 · Cited by 316
The effects of psychological distance on abstraction: Two meta-analyses.
Soderberg, C. K., Callahan, S. P., Kochersberger, A. O., Amit, E., & Ledgerwood, A. (2015) · Psychological Bulletin · doi:10.1037/bul0000005 · Cited by 299
Smith, H. C., Vacek, P., Johnson, R. J., Slauterbeck, J. R., Hashemi, J., Shultz, S., & Beynnon, B. D. (2012) · Sports Health: A Multidisciplinary Approach · doi:10.1177/1941738111428281 · Cited by 298
Eirich, R., McArthur, B. A., Anhorn, C., McGuinness, C., Christakis, D. A., & Madigan, S. (2022) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2022.0155 · Cited by 293
Heyvaert, M., Saenen, L., Campbell, J. M., Maes, B., & Onghena, P. (2014) · Research in Developmental Disabilities · doi:10.1016/j.ridd.2014.06.017 · Cited by 284
Tackett, J. L., Lilienfeld, S. O., Patrick, C. J., Johnson, S. L., Krueger, R. F., Miller, J. D., Oltmanns, T. F., & Shrout, P. E. (2017) · Perspectives on Psychological Science · doi:10.1177/1745691617690042 · Cited by 251
Lying takes time: A meta-analysis on reaction time measures of deception.
Suchotzki, K., Verschuere, B., Van Bockstaele, B., Ben-Shakhar, G., & Crombez, G. (2017) · Psychological Bulletin · doi:10.1037/bul0000087 · Cited by 279
The intergenerational transmission of child maltreatment: A three-level meta-analysis
Assink, M., Spruit, A., Schuts, M., Lindauer, R., van der Put, C. E., & Stams, G.-J. J. M. (2018) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2018.07.037 · Cited by 275
“Excellence R Us”: university research and the fetishisation of excellence
Moore, S., Neylon, C., Paul Eve, M., Paul O’Donnell, D., & Pattinson, D. (2017) · Palgrave Communications · doi:10.1057/palcomms.2016.105 · Cited by 264
Registered Replication Report: Schooler and Engstler-Schooler (1990)
Alogna, V. K., Attaya, M. K., Aucoin, P., Bahník, Š., Birch, S., Birt, A. R., Bornstein, B. H., Bouwmeester, S., Brandimonte, M. A., Brown, C., et al. (2014) · Perspectives on Psychological Science · doi:10.1177/1745691614545653 · Cited by 223
“Schooler has noted that the measured effect size of the overshadowing effect reported in later studies is smaller than that in the original report (Schooler, 2011; see also Lehrer, 2010).”
Effect of cognitive-behavioral therapy for anxiety disorders on quality of life: A meta-analysis.
Hofmann, S. G., Wu, J. Q., & Boettcher, H. (2014) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0035491 · Cited by 191
Kaplan, R. M., & Stone, A. A. (2013) · Annual Review of Psychology · doi:10.1146/annurev-psych-113011-143736 · Cited by 144
Autonomic nervous system activity during positive emotions: a meta-analytic review
Behnke, M., Kreibig, S. D., Kaczmarek, L. D., Assink, M., & Gross, J. J. (2022) · Emotion Review · doi:10.1177/17540739211073084 · Cited by 60
Social responses to expressive suppression: the role of personality judgments
Tackman, A. M., & Srivastava, S. (2016) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000053 · Cited by 50
School-based oral health education increases caries inequalities
Qadri, G., Alkilzy, M., Franze, M., Hoffmann, W., & Splieth, C. (2018) · Community Dental Health · doi:10.1922/cdh_4145qadri07 · Cited by 34
Storm, L., Sherwood, S. J., Roe, C. A., Tressoldi, P. E., Rock, A. J., & Di Risio, L. (2017) · International Journal of Dream Research · doi:10.11588/ijodr.2017.2.34888 · Cited by 29
“Other researchers point out that effects in mainstream psychology and other disciplines, also go into decline (Ioannidis, 2005; Schooler, 2011).”
BackgroundA Meta-Analysis of Spearman’s Hypothesis in the United States
Woodley of Menie, M., Peñaherrera-Aguirre, M., & Sarraf, M. (2026) · Intelligence & Cognitive Abilities · doi:10.65550/001c.171909
Metadata
- Authors
- Schooler, J.
- Venue
- Nature
- Published
- 2011-02-23
- Volume
- 470
- Issue
- 7335
- Pages
- 437-437
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W2073143637
- Cited by
- 333
- References
- 0
- FWCI
- 68.29
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.