The DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index.
Why Science Is Not Necessarily Self-Correcting
Abstract
The ability to self-correct is considered a hallmark of science. However, self-correction does not always happen to scientific evidence by default. The trajectory of scientific credibility can fluctuate over time, both for defined scientific fields and for science at-large. History suggests that major catastrophes in scientific credibility are unfortunately possible and the argument that “it is obvious that progress is made” is weak. Careful evaluation of the current status of credibility of various scientific fields is important in order to understand any credibility deficits and how one could obtain and establish more trustworthy results. Efficient and unbiased replication mechanisms are essential for maintaining high levels of scientific credibility. Depending on the types of results obtained in the discovery and replication phases, there are different paradigms of research: optimal, self-correcting, false nonreplication, and perpetuated fallacy. In the absence of replication efforts, one is left with unconfirmed (genuine) discoveries and unchallenged fallacies. In several fields of investigation, including many areas of psychological science, perpetuated and unchallenged fallacies may comprise the majority of the circulating evidence. I catalogue a number of impediments to self-correction that have been empirically studied in psychological science. Finally, I discuss some proposed solutions to promote sound replication practices enhancing the credibility of scientific results as well as some potential disadvantages of each of them. Any deviation from the principle that seeking the truth has priority over any other goals may be seriously damaging to the self-correcting functions of science.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The credibility and efficiency of the scientific ecosystem is undermined if the research community does not have access to the data that underlie scientific claims [48,49].”
From Data availability, reusability, and analytic reproducibility: evaluating the impact of a mandatory open data policy at the journal Cognition (2018) · cites this paper as [48]
In the citing paper
“Fatal errors and retractions, especially of prominent publications, are increasing [16–18].”
From The natural selection of bad science (2016) · cites this paper as [17]
In the citing paper
“In the presence of impediments, such as unclear and inconspicuous retractions, this self-correcting process may become unnecessarily slow, inefficient and ineffective [27].”
From Media and social media attention to retracted articles according to Altmetric (2021) · cites this paper as [27]
Citations
Cites
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Self-citationThe file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068 · cited 2×
“Psychology was apparently the first scientific discipline to recognize the importance of publication bias (Rosenthal, 1979) and many of the methods that have been developed to try to probe for publication bias or adjust for its presence have also been developed in the psychological literature.”
BackgroundJournal of social behavior and personality
(1986) · Personality and Individual Differences · doi:10.1016/0191-8869(86)90025-5 · Cited by 6,706
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Journal of The American Statistical Association
Fienberg, S. E. (2005) · Encyclopedia of Statistical Sciences · doi:10.1002/0471667196.ess1317 · Cited by 6,125
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 6×
“Moreover, what is not appreciated is that underpowered studies not only have low chances of detecting effects that are nonnull; they also have a lower positive predictive value for the results to be correct when they identify a statistically significant effect (Ioannidis, 2005), and they are likely to identify estimat…”
BackgroundInfluentialSelf-citationThe Sociology of Science: Theoretical and Empirical Investigations
Kaplan, N., Merton, R. K., & Storer, N. W. (1974) · Technology and Culture · doi:10.2307/3102264 · Cited by 4,005
Raise standards for preclinical cancer research
Begley, C. G., & Ellis, L. M. (2012) · Nature · doi:10.1038/483531a · Cited by 2,979 · cited 1×
“…from diverse fields suggests that when efforts are made to repeat or reproduce published research, the repeatability and reproducibility is dismal (Begley & Ellis, 2012; Donoho, Maleki, Rahman, Shahram, & Stodden, 2009; Hothorn & Leisch, 2011; Ioannidis et al., 2009; Prinz, Schlange, & Asadullah,…”
BackgroundMeasuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling
John, L. K., Loewenstein, G., & Prelec, D. (2012) · Psychological Science · doi:10.1177/0956797611430953 · Cited by 2,239
Fanelli, D. (2009) · PLoS ONE · doi:10.1371/journal.pone.0005738 · Cited by 1,911 · cited 2×
“Several empirical studies in psychological science have highlighted some of the mechanisms that lead to such selective reporting without necessarily classic file-drawer type of publication bias (Bakker & Wicherts, 2011; Fiedler, 2011; Simmons, Nelson, & Simonsohn, 2011) and Wagenmakers et al. (2012) make a lively pres…”
BackgroundBelieve it or not: how much can we rely on published data on potential drug targets?
Prinz, F., Schlange, T., & Asadullah, K. (2011) · Nature Reviews Drug Discovery · doi:10.1038/nrd3439-c1 · Cited by 1,888
Why Most Discovered True Associations Are Inflated
Ioannidis, J. P. A. (2008) · Epidemiology · doi:10.1097/ede.0b013e31818131e7 · Cited by 1,495 · cited 4×
“…simply conceptual replications (Makel et al., 2012; Nosek et al., 2012), which probably suffer from confirmation bias (Wagenmakers et al., 2012) in which authors try to get the result they want (the “fine-tune factor,” or what I have previously described as “vibration of effects” (Ioannidis, 2008).”
BackgroundInfluentialSelf-citationTHE SOCIOLOGY OF SCIENCE:: Theoretical and Empirical Investigations
Merton, R. Κ., & Storer, N. W. (2017) · Cited by 1,462
Nosek (2012) · doi:10.1177/1745691612459058 · Cited by 1,301 · cited 2×
“Many of these replications are simply conceptual replications (Makel et al., 2012; Nosek et al., 2012), which probably suffer from confirmation bias (Wagenmakers et al., 2012) in which authors try to get the result they want (the “fine-tune factor,” or what I have previously described as “vibration…”
BackgroundNegative results are disappearing from most disciplines and countries
Fanelli, D. (2012) · Scientometrics · doi:10.1007/s11192-011-0494-7 · Cited by 1,248 · cited 1×
“Of note, this ubiquity of “positive” results has been well-documented in very diverse scientific fields, and it seems to be increasing in disciplines in lower positions in the hierarchy of evidence (Fanelli, 2010a, 2010b, 2012).”
BackgroundA catalogue of reporting guidelines for health research
Simera, I., Moher, D., Hoey, J., Schulz, K. F., & Altman, D. G. (2010) · European Journal of Clinical Investigation · doi:10.1111/j.1365-2362.2009.02234.x · Cited by 1,047
An Agenda for Purely Confirmatory Research
Wagenmakers, E.-J., Wetzels, R., Borsboom, D., van der Maas, H. L. J., & Kievit, R. A. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612463078 · Cited by 1,042 · cited 4×
“Many of these replications are simply conceptual replications (Makel et al., 2012; Nosek et al., 2012), which probably suffer from confirmation bias (Wagenmakers et al., 2012) in which authors try to get the result they want (the “fine-tune factor,” or what I have previously described as “vibration…”
BackgroundInfluentialSterling, T. D. (1959) · Journal of the American Statistical Association · doi:10.1080/01621459.1959.10501497 · Cited by 964 · cited 2×
“However, it is striking that the proportion of significant results in psychological science is approaching 100%, and this has been noticed even half a century ago (Sterling, 1959) with no change in the interim (Bakker et al., 2012; Sterling, Rosenbaum, & Weinkam, 1995).”
BackgroundDo Pressures to Publish Increase Scientists' Bias? An Empirical Support from US States Data
Fanelli, D. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010271 · Cited by 805 · cited 1×
“Of note, this ubiquity of “positive” results has been well-documented in very diverse scientific fields, and it seems to be increasing in disciplines in lower positions in the hierarchy of evidence (Fanelli, 2010a, 2010b, 2012).”
BackgroundThe rules of the game called psychological science
Bakker, M., van Dijk, A., & Wicherts, J. M. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612459060 · Cited by 800 · cited 3×
“Bakker et al. (2012) estimate that almost all the papers in psychological science claim “positive” findings anyhow.”
BackgroundAn exploratory test for an excess of significant findings
Ioannidis, J. P., & Trikalinos, T. A. (2007) · Clinical Trials · doi:10.1177/1740774507079441 · Cited by 751 · cited 1×
“Methods have been developed to test for excess of significance across sets of studies, meta-analyses, and entire fields (Ioannidis & Trikalinos, 2007).”
BackgroundSelf-citationReplications in Psychology Research: How Often Do They Really Occur?
Makel, M. C., Plucker, J. A., & Hegarty, B. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612460688 · Cited by 750
“Positive” results increase down the Hierarchy of the Sciences
Fanelli, D. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010068 · Cited by 734 · cited 1×
“Of note, this ubiquity of “positive” results has been well-documented in very diverse scientific fields, and it seems to be increasing in disciplines in lower positions in the hierarchy of evidence (Fanelli, 2010a, 2010b, 2012).”
BackgroundIs the Replicability Crisis Overblown? Three Arguments Examined
Pashler, H., & Harris, C. R. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612463401 · Cited by 697 · cited 3×
“…the replication crisis is serious and how science won’t necessarily correct itself unless direct (not just conceptual) replications are performed (Pashler & Harris, 2012, this issue); how one could change the focus of science from getting something novel and significant to getting to the truth…”
BackgroundInfluentialMaxwell, S. E. (2004) · Psychological Methods · doi:10.1037/1082-989x.9.2.147 · Cited by 654 · cited 1×
“This preponderance of nominally significant results is astonishing, given that psychological investigations remain largely underpowered (Maxwell, 2004).”
BackgroundRepeatability of published microarray gene expression analyses
Ioannidis, J. P. A., Allison, D. B., Ball, C. A., Coulibaly, I., Cui, X., Culhane, A. C., Falchi, M., Furlanello, C., Game, L., Jurman, G., et al. (2009) · Nature Genetics · doi:10.1038/ng.295 · Cited by 551 · cited 2×
“significance at all cost has eroded the credibility of science and credibility is decreasing over time? Empirical evidence from diverse fields suggests that when efforts are made to repeat or reproduce published research, the repeatability and reproducibility is dismal (Begley & Ellis, 2012; Donoho, Maleki, Rahman, Sh…”
BackgroundSelf-citationThe poor availability of psychological research data for reanalysis.
Wicherts, J. M., Borsboom, D., Kats, J., & Molenaar, D. (2006) · American Psychologist · doi:10.1037/0003-066x.61.7.726 · Cited by 543 · cited 1×
“Finally, the lack of routine open access to raw data, analysis codes, and protocols (Alsheikh-Ali, Qureshi, AlMallah, & Ioannidis, 2011; Wicherts et al., 2006) does not allow outside investigators to repeat, and thus verify, the published results.”
BackgroundWhy Current Publication Practices May Distort Science
Young, N. S., Ioannidis, J. P. A., & Al-Ubaydli, O. (2008) · PLoS Medicine · doi:10.1371/journal.pmed.0050201 · Cited by 502
Self-citationFerguson, C. J., & Brannick, M. T. (2012) · Psychological Methods · doi:10.1037/a0024445 · Cited by 493 · cited 2×
“(2012); Misreporting of results Bakker & Wicherts (2011) Voodoo correlations Fiedler (2011) Fabricated results Fanneli (2009) Other questionable research practices John et al.”
BackgroundWhy Most Published Research Findings Are False
Ioannidis, J. P. A. (2019) · CHANCE · doi:10.1080/09332480.2019.1579573 · Cited by 463
Self-citationSterling, T. D., Rosenbaum, W. L., & Weinkam, J. J. (1995) · The American Statistician · doi:10.1080/00031305.1995.10476125 · Cited by 453
Replications and extensions in marketing: Rarely published but quite contrary
Hubbard, R., & Armstrong, J. S. (1994) · International Journal of Research in Marketing · doi:10.1016/0167-8116(94)90003-5 · Cited by 416 · cited 1×
“…article, replications (at least published ones) in psychological science are extremely uncommon—in the same range as previously documented for economics, marketing, and communication (Evanschitzky, Baumgarth, Hubbard, & Armstrong, 2006; Hubbard & Armstrong, 1994; Kelly, Vhase, & Tucker, 1979).”
BackgroundPublic Availability of Published Research Data in High-Impact Journals
Alsheikh-Ali, A. A., Qureshi, W., Al-Mallah, M. H., & Ioannidis, J. P. A. (2011) · PLoS ONE · doi:10.1371/journal.pone.0024357 · Cited by 363
Self-citationThe (mis)reporting of statistical results in psychology journals
Bakker, M., & Wicherts, J. M. (2011) · Behavior Research Methods · doi:10.3758/s13428-011-0089-5 · Cited by 356 · cited 1×
“…have highlighted some of the mechanisms that lead to such selective reporting without necessarily classic file-drawer type of publication bias (Bakker & Wicherts, 2011; Fiedler, 2011; Simmons, Nelson, & Simonsohn, 2011) and Wagenmakers et al. (2012) make a lively presentation of how this fine…”
BackgroundUnpublished results hide the decline effect
Schooler, J. (2011) · Nature · doi:10.1038/470437a · Cited by 333 · cited 1×
“However, in the presence of publication and other selective reporting biases, this correction will not be seen necessarily (Schooler, 2011) and perpetuated fallacies may ensue.”
BackgroundIoannidis, J. P. A., & Trikalinos, T. A. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.10.019 · Cited by 325 · cited 4×
“On the basis of Makel et al.’s (2012) article, replications (at least published ones) in psychological science are extremely uncommon—in the same range as previously documented for economics, marketing, and communication (Evanschitzky, Baumgarth, Hubbard, & Armstrong, 2006; Hubbard & Armstrong, 1994; Kelly, Vhase, & T…”
BackgroundResultInfluentialSelf-citationJournal of Legal and Political Sociology
K., W. P. M. (1943) · The University of Toronto Law Journal · doi:10.2307/824517 · Cited by 298
Reproducible Research in Computational Harmonic Analysis
Donoho, D. L., Maleki, A., Rahman, I. U., Shahram, M., & Stodden, V. (2009) · Computing in Science & Engineering · doi:10.1109/mcse.2009.15 · Cited by 274
Giner-Sorolla, R. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612457576 · Cited by 274
Golden holocaust: origins of the cigarette catastrophe and the case for abolition
(2012) · Choice Reviews Online · doi:10.5860/choice.49-6860 · Cited by 272
Replication research's disturbing trend
Evanschitzky, H., Baumgarth, C., Hubbard, R., & Armstrong, J. S. (2007) · Journal of Business Research · doi:10.1016/j.jbusres.2006.12.003 · Cited by 267
Improving Validation Practices in “Omics” Research
Ioannidis, J. P. A., & Khoury, M. J. (2011) · Science · doi:10.1126/science.1211811 · Cited by 246 · cited 1×
“Many of these ideas require a change in the incentives pattern of current science, focusing on truth when we try to reward (or penalize) specific scientific results (Ioannidis & Khoury, 2011).”
BackgroundSelf-citationComparison of protocols and registry entries to published reports for randomised controlled trials
Dwan, K., Altman, D. G., Cresswell, L., Blundell, M., Gamble, C. L., & Williamson, P. R. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000031.pub2 · Cited by 243 · cited 1×
“It is possible that other types of selective reporting bias surrounding the analyses and presentation of outcomes of scientific investigations may be more common than classic publication bias (Dwan et al., 2011).”
BackgroundThe Psychology of Replication and Replication in Psychology
Francis, G. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612459520 · Cited by 238 · cited 4×
“premise of examining whether the results are too good to be true (Francis, 2012b). One should examine such empirical studies cautiously, as sometimes genuine heterogeneity when addressing different questions or different experiments, may masquerade as excess significance. However, it is striking that the proportion of…”
BackgroundInfluentialVoodoo Correlations Are Everywhere—Not Only in Neuroscience
Fiedler, K. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691611400237 · Cited by 235 · cited 2×
“Several empirical studies in psychological science have highlighted some of the mechanisms that lead to such selective reporting without necessarily classic file-drawer type of publication bias (Bakker & Wicherts, 2011; Fiedler, 2011; Simmons, Nelson, & Simonsohn, 2011) and Wagenmakers et al.”
BackgroundToo good to be true: Publication bias in two prominent studies from experimental psychology
Francis, G. (2012) · Psychonomic Bulletin & Review · doi:10.3758/s13423-012-0227-9 · Cited by 206 · cited 3×
“premise of examining whether the results are too good to be true (Francis, 2012b).”
BackgroundFrank, M. C., & Saxe, R. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612460686 · Cited by 175 · cited 3×
“Frank and Saxe (2012) and Grahe et al. (2012) suggest that students in training could populate the ranks of replicators. Finally, Wagenmakers et al. (2012) repeat the plea for separating exploratory and confirmatory research and demand rigorous a priori registration of the analysis plans for confirmatory research.”
BackgroundEditorial bias against replication research.
Neuliep, J. W., & Crandall, R. (1990) · Journal of social behavior and personality · Cited by 139
Aly, G. (1994) · Johns Hopkins University Press eBooks · doi:10.56021/9780801847752 · Cited by 115
Reviewer bias against replication research.
Neuliep, J. W., & Crandall, R. (1993) · Journal of social behavior and personality · Cited by 113
Golden holocaust: origins of the cigarette catastrophe and the case for abolition
Berridge, V. S. (2012) · Medical Humanities · doi:10.1136/medhum-2012-010202 · Cited by 96
Case studies in reproducibility
Hothorn, T., & Leisch, F. (2011) · Briefings in Bioinformatics · doi:10.1093/bib/bbq084 · Cited by 80 · cited 2×
“Some suggestions for potential amendments that can be tested have been made in previous articles (Ioannidis, 2005; Young, Ioannidis, & Al-Ubaydli, 2008) and additional suggestions are made also by authors in this issue of Perspectives. Nosek et al. (2012) provide the most explicit and extensive list of recommended cha…”
BackgroundCleansing the Fatherland: Nazi Medicine and Racial Hygiene
Aly, G., Chroust, P., Pross, C., Cooper, B., & Kater, M. H. (1994) · Cited by 77
Ioannidis, J. P. A. (2012) · JAMA · doi:10.1001/jama.2012.8144 · Cited by 77 · cited 2×
“Registration practices need careful consideration to decide what exactly needs to be registered: a study, a dataset, or an analysis (Ioannidis, 2012a).”
BackgroundSelf-citationHarnessing the Undiscovered Resource of Student Research Projects
Grahe, J. E., Reifman, A. S., Hermann, A. D., Walker, M., Oleson, K. C., Nario‐Redmond, M. R., & Wiebe, R. P. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612459057 · Cited by 65 · cited 2×
“Frank and Saxe (2012) and Grahe et al. (2012) suggest that students in training could populate the ranks of replicators.”
BackgroundThe Nine Circles of Scientific Hell
Neuroskeptic (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612459519 · Cited by 64
REPLICATION IN EXPERIMENTAL COMMUNICATION RESEARCH: AN ANALYSIS
Kelly, C. W., Chase, L. J., & Tucker, R. K. (1979) · Human Communication Research · doi:10.1111/j.1468-2958.1979.tb00646.x · Cited by 59
Psychologists Are Open to Change, yet Wary of Rules
Fuchs, H. M., Jenny, M. A., & Fiedler, S. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612459521 · Cited by 51
Shadish, W. R., Doherty, M., & Montgomery, L. M. (1989) · Clinical Psychology Review · doi:10.1016/0272-7358(89)90013-5 · Cited by 46
Osherovich, L. Z. (2011) · Science-Business eXchange · doi:10.1038/scibx.2011.416 · Cited by 43 · cited 1×
“Not surprisingly, even hedge funds don’t put much trust on published scientific results (Osherovich, 2011).”
BackgroundYou Could Have Just Asked: Reply to Francis (2012)
Galak, J., & Meyvis, T. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612463079 · Cited by 15
Scientific Communication Is Down at the Moment, Please Check Again Later
Ioannidis, J. P. A. (2012) · Psychological Inquiry · doi:10.1080/1047840x.2012.699427 · Cited by 7 · cited 2×
“Registration practices need careful consideration to decide what exactly needs to be registered: a study, a dataset, or an analysis (Ioannidis, 2012a).”
BackgroundSelf-citation
Research works printed but not linked: 1
- Neuliep J. W., 1993, Journal of Social Behavior and Personality, 8, 21
Cited by
Power failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641
Self-citationChoosing Prediction Over Explanation in Psychology: Lessons From Machine Learning
Yarkoni, T., & Westfall, J. (2017) · Perspectives on Psychological Science · doi:10.1177/1745691617693393 · Cited by 1,916
“…and journalists alike to favor analysis procedures that produce “good” results—where a good result is one that is deemed more hypothesis-congruent, publication-worthy, soci-etally interesting, etc. (Bakker, van Dijk, & Wicherts, 2012; Dwan et al., 2008; Ferguson & Heene, 2012; Ioannidis, 2012).”
BackgroundVan Dam, N. T., van Vugt, M. K., Vago, D. R., Schmalzl, L., Saron, C. D., Olendzki, A., Meissner, T., Lazar, S. W., Kerr, C. E., Gorchov, J., et al. (2018) · Perspectives on Psychological Science · doi:10.1177/1745691617709589 · Cited by 1,506
“…and wider swaths of other basic and applied sciences, receiving considerable attention in both the scientific literature (Button et al., 2013; Ioannidis, 2005, 2012; Miguel et al., 2014; Open Science Collaboration, 2012; Pashler & Wagenmakers, 2012) and public news media (Freedman, 2010;…”
Pashler, H., & Wagenmakers, E. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612465253 · Cited by 1,321
“…mathematical modeling that any scientific field that ignores replication can easily come to the miserable state wherein (as the title of his most famous article puts it) “most published research findings are false” (see also Ioannidis, 2012, this issue, and Pashler & Harris, 2012, this issue).”
Backgroundvon Bartheld, C. S., Bahney, J., & Herculano‐Houzel, S. (2016) · Journal of Comparative Neurology · doi:10.1002/cne.24040 · Cited by 1,063
“…for the notion of a 10:1 GNR over a 50-year period is an example of a major failure in the scientific process that is supposed to self-correct invalid claims or reports (Committee on the Conduct of Science, 1989; Neville, 2007; Firestein, 2012; Ioannidis, 2012), as explained in more detail below.”
Background
Metadata
- Authors
- Ioannidis, J. P. A.
- Affiliations
- Stanford Medicine (US)
- Corresponding author
- Ioannidis, John P. A.
- Venue
- Perspectives on Psychological Science
- Publisher
- SAGE Publications
- Published
- 2012-11
- Volume
- 7
- Issue
- 6
- Pages
- 645-654
- ISSN
- 1745-6916 (ISSN-L)
- 1745-6924
- OpenAlex
- W2169214811
- Cited by
- 563
- References
- 61
- Citations by year
- 2026: 16 · 2025: 49 · 2024: 23 · 2023: 29 · 2022: 36 · 2021: 57 · 2020: 48 · 2019: 58 · 2018: 46 · 2017: 52 · 2016: 46 · 2015: 36 · 2014: 39 · 2013: 25 · 2012: 2
- FWCI
- 43.79
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Perspectives on Psychological Science (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › General Psychology › Academic and Historical Perspectives in Psychology
- Keywords
- scientific credibility, replication, replication crisis, research paradigms, credibility deficit, scientific progress
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.