How scientists fool themselves – and how they can stop
The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Researchers often expect a particular outcome and can unintentionally influence the experiment or interpret the data in such a way as to support their preferred hypothesis [81].”
From Reporting animal research: Explanation and elaboration for the ARRIVE guidelines 2.0 (2020) · cites this paper as [81]
In the citing paper
“HARKing, or hypothesizing after results are known (37), or JARKing, justifying after results are known (38), are also inappropriate practices.”
From Misrepresentation and distortion of research in biomedical literature (2018) · cites this paper as [38]
Citations
Cites
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
Raise standards for preclinical cancer research
Begley, C. G., & Ellis, L. M. (2012) · Nature · doi:10.1038/483531a · Cited by 2,979
Platt, J. R. (1964) · Science · doi:10.1126/science.146.3642.347 · Cited by 2,907
Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling
John, L. K., Loewenstein, G., & Prelec, D. (2012) · Psychological Science · doi:10.1177/0956797611430953 · Cited by 2,239
Repeatability of published microarray gene expression analyses
Ioannidis, J. P. A., Allison, D. B., Ball, C. A., Coulibaly, I., Cui, X., Culhane, A. C., Falchi, M., Furlanello, C., Game, L., Jurman, G., et al. (2009) · Nature Genetics · doi:10.1038/ng.295 · Cited by 551
The (mis)reporting of statistical results in psychology journals
Bakker, M., & Wicherts, J. M. (2011) · Behavior Research Methods · doi:10.3758/s13428-011-0089-5 · Cited by 356
Does Incidental Disgust Amplify Moral Judgment? A Meta-Analytic Review of Experimental Evidence
Landy, J. F., & Goodwin, G. P. (2015) · Perspectives on Psychological Science · doi:10.1177/1745691615583128 · Cited by 288
Fugelsang, J. A., Stein, C. B., Green, A. E., & Dunbar, K. N. (2004) · Canadian Journal of Experimental Psychology / Revue canadienne de psychologie expérimentale · doi:10.1037/h0085799 · Cited by 115
The effect of horizontal eye movements on free recall: A preregistered adversarial collaboration.
Matzke, D., Nieuwenhuis, S., van Rijn, H., Slagter, H. A., van der Molen, M. W., & Wagenmakers, E.-J. (2015) · Journal of Experimental Psychology: General · doi:10.1037/xge0000038 · Cited by 114
Interactions of Multisensory Components Perceptually Rescue Túngara Frog Mating Signals
Taylor, R. C., & Ryan, M. J. (2013) · Science · doi:10.1126/science.1237113 · Cited by 102
Research works printed but not linked: 1
- MacCoun, R. & Perlmutter, S. in Psychological Science Under Scrutiny: Recent Challenges and Proposed Solutions (eds Lilienfeld, S. O. & Waldman, I.) (Wiley, in the press); Preprint available at http://ssrn.com/abstract=2563337
Cited by
Items 201–295 of 295
Replicability in Psychotherapy Research: Uncontrolled Risk Factors and Proposed Measures
Leichsenring, F., & Steinert, C. (2016) · Psychotherapy and Psychosomatics · doi:10.1159/000444858 · Cited by 4
OTSUKA, Y., Imanishi, J., Mamoru, N. A. S. U., Shimahara, S., & Iwasakai, Y. (2023) · Landscape and Ecological Engineering · doi:10.1007/s11355-023-00583-5 · Cited by 3
Chew, B., Lai, P. S. M., Sivaratnam, D., Basri, N. I., Appannah, G., Yusof, B. N. M., Thambiah, S. C., Hanipah, Z. N., Wong, P. F., & Chang, L.-C. (2025) · Health Systems & Reform · doi:10.1080/23288604.2024.2417788 · Cited by 5
Barry, A. E., Valdez, D., Goodson, P., Szucs, L. E., & Reyes, J. V. (2018) · Journal of American College Health · doi:10.1080/07448481.2018.1470091 · Cited by 3
SANTÉ PSYCHIQUE, MAL-ÊTRE, DÉPRESSION ET ANXIÉTÉ DES ÉTUDIANTS : DES CHIFFRES ET DES HUMAINS?
Morvan, Y., Frajerman, A., Kern, L., & Chaumette, B. (2019) · Revue québécoise de psychologie · doi:10.7202/1065901ar · Cited by 5
Estreder, Y., Martínez‐Tur, V., Tomás-Marco, I., Maniezki, A., Ramos, J., & Pătraș, L. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.617622 · Cited by 4
Must replication attempts be battlegrounds?
Hobson, H. (2018) · Cortex · doi:10.1016/j.cortex.2018.11.035 · Cited by 3
Patient safety with nighttime surgery—perhaps we should just assume that it is not as safe at night
McGiffin, D. C. (2020) · Journal of Cardiac Surgery · doi:10.1111/jocs.15018 · Cited by 3
Feinsinger, P., Rodríguez, I. V., Izquierdo, A. E., & Buzato, S. (2020) · BioScience · doi:10.1093/biosci/biaa108 · Cited by 6
Vellameeran, F. A., & Brindha, T. (2021) · Bio-Algorithms and Med-Systems · doi:10.1515/bams-2020-0069 · Cited by 3
Discussion Paper: Should statistics rescue mathematical modelling?Preprint
Saltelli, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.06457 · Cited by 9
No evidence for motor recovery-related cortical reorganization after stroke using resting-state fMRIPreprint
Branscheidt, M., Ejaz, N., Xu, J., Widmer, M., Harran, M. D., Cortés, J. C., Kitago, T., Celnik, P. A., Hernandez-Castillo, C. R., Diedrichsen, J., et al. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/681320 · Cited by 3
I am not biased. It is everyone else’s problem
Watkins, T. R., & Harvey, L. A. (2020) · Spinal Cord · doi:10.1038/s41393-020-0446-2 · Cited by 3
Silva, F. M., Adegboye, A. R. A., Curioni, C. C., Gomes, F. D. S., Collins, G. S., Kac, G., Cook, J. A., Ismail, L. C., Page, M. J., Khandpur, N., et al. (2023) · medRxiv · doi:10.1101/2023.06.08.23291109 · Cited by 3
A Practical Approach to Minimizing Risk from Multiplicity in Statistical Reporting
Franc, J. M. (2025) · Prehospital and Disaster Medicine · doi:10.1017/s1049023x25101611 · Cited by 3
Navigating Ambiguity and Uncertainty in End-of-Life Care Research Practice
van Drimmelen, T., Slagboom, M. N., Reis, R., Bouter, L. M., & van der Steen, J. T. (2025) · Journal of Empirical Research on Human Research Ethics · doi:10.1177/15562646251377121 · Cited by 2
Where There's Smoke, There's Fire: the Effect of Truncated Testimony on Juror Decision‐making
Anderson, L., Gross, J., Sonne, T., Zajac, R., & Hayne, H. (2016) · Behavioral Sciences & the Law · doi:10.1002/bsl.2212 · Cited by 4
Modelling Goals, Strategies, and Mistakes
Briggs, W. C. (2016) · Springer eBooks · doi:10.1007/978-3-319-39756-6_10 · Cited by 2
Positive steps with negative studies in the WASH sector
Colford, J. M. (2017) · The Lancet Global Health · doi:10.1016/s2214-109x(17)30221-8 · Cited by 3
The prevalence of improper solution‐making technique places molar solutions in crisis
Calvert, R. D., Crawford, C. R., & Running, C. A. (2020) · Journal of Food Science Education · doi:10.1111/1541-4329.12186 · Cited by 2
Practical Guidance for Crafting Original Research Manuscripts
Pollock, N. W. (2023) · Wilderness and Environmental Medicine · doi:10.1016/j.wem.2022.09.005 · Cited by 4
Biases and Feedbacks in the Knowledge System: from Academia to the Public and Back
Dubi, Y. (2023) · European Review · doi:10.1017/s1062798723000315 · Cited by 2
Haring, R., & Bell, R. J. (2018) · Climacteric · doi:10.1080/13697137.2018.1476968 · Cited by 3
Broken Beds, but better science; using multiple hypotheses to interpret geological data
Gallois, A., Burgess, P. M., Bosence, D. W. J., & Hollis, C. (2022) · Terra Nova · doi:10.1111/ter.12631 · Cited by 2
Research integrity and the law that never was
Mayer, M. G. (2018) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2018-110993 · Cited by 2
Methodological Advances in Motor Learning and Development
Lohse, K. R. (2020) · Journal of Motor Learning and Development · doi:10.1123/jmld.2019-0054 · Cited by 2
NetMix: A Network-Structured Mixture Model for Reduced-Bias Estimation of Altered Subnetworks
Reyna, M. A., Chitra, U., Elyanow, R., & Raphael, B. J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-45257-5_11 · Cited by 3
The Dark Matter of the Bibliome
Kennedy, D. N. (2015) · Neuroinformatics · doi:10.1007/s12021-015-9283-4 · Cited by 2
Misinterpretations, mistakes, or just misbehaving
Glick, M., & Carrasco‐Labra, A. (2019) · The Journal of the American Dental Association · doi:10.1016/j.adaj.2019.02.010 · Cited by 2
OTSUKA, Y., & IWASAKI, Y. (2025) · Cities · doi:10.1016/j.cities.2025.106342 · Cited by 3
Reproducibility of biomedical research: Quo vadis?
Dal‐Ré, R., Bernad, A., & Garesse, R. (2016) · Medicina Clínica (English Edition) · doi:10.1016/j.medcle.2016.06.029 · Cited by 1
Scientific honesty and publicly shared lab notebooks
van Steensel, B. (2018) · EMBO Reports · doi:10.15252/embr.201846866 · Cited by 3
Fields, D., & Asbury, K. (2023) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-023-05966-z · Cited by 3
Is the Persistence of the Amyloid Cascade Hypothesis a Result of Constant Confirmation Bias?
Behl, C. (2023) · Springer eBooks · doi:10.1007/978-3-031-31570-1_18 · Cited by 1
Shift to New Dimensions--Further Initiatives to Deepen Communication Science
Yamada, T. (2018) · NTT technical review · doi:10.53829/ntr201811fa1 · Cited by 1
Boosting reproducible research practices with the repeat it with me: Reproducibility team challenge
Bortolotti, L., Schauman, S., & Caligiuri, M. E. (2024) · Magnetic Resonance in Medicine · doi:10.1002/mrm.30041 · Cited by 1
Silva, F. M., Adegboye, A. R. A., Naude, C. E., Curioni, C. C., Gomes, F. D. S., Collins, G. S., Kac, G., de Beyer, J. A., Cook, J. A., Ismail, L. C., et al. (2025) · American Journal of Clinical Nutrition · doi:10.1016/j.ajcnut.2025.01.016 · Cited by 2
Data Reuse and the Social Capital of Open SciencePreprint
Alicea, B. (2016) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/093518 · Cited by 2
Franciotta, D. M., & Uccelli, A. (2017) · Neurological Sciences · doi:10.1007/s10072-017-3022-6 · Cited by 2
Scientists in silico?Preprint
McBride, C. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.00678 · Cited by 2
A computational knowledge engine for human neurosciencePreprint
Beam, E., Potts, C., Poldrack, R. A., & Etkin, A. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/701540 · Cited by 1
Rapid Evidence Review 1 on the Critical Appraisal of Third-Party Evidence
Thomas, S., Gregory, P., O’Brien, S. J., McCallion, C., Goodall, B., Chan, C., & Nunn, P. (2021) · doi:10.46756/sci.fsa.elm525 · Cited by 1
Brooker, R., & Allum, N. (2024) · doi:10.31222/osf.io/ur2sd · Cited by 1
Fields, D., & Asbury, K. (2024) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/sf37a · Cited by 2
Fibroblast Differentiation and Models of Human Skin
Rakar, J. (2016) · Linköping University medical dissertations · doi:10.3384/diss.diva-125925
Ruan, X., Bumgarner, G. W., & Kaye, A. D. (2016) · JAMA Oncology · doi:10.1001/jamaoncol.2016.0139
Ruan, X., Rubin, R. E., & Kaye, A. D. (2016) · Annals of Pharmacotherapy · doi:10.1177/1060028015627311
Castillo-Tarrillo, G. F., Yshpilco, L. B., Murillo-Padilla, J. C., da Silva, J. C., Zambrano, L. I., & de Souza, A. A. L. (2016) · Ciencia e Investigación Medico Estudiantil Latinoamericana · doi:10.23961/cimel.2016.212.647
Ruan, X., Luo, J. J., Kaye, A. M., & Kaye, A. D. (2016) · Annals of Pharmacotherapy · doi:10.1177/1060028016675353
Reproducibility and research misconduct: time for radical reform
Gandevia, S. C. (2016) · Internal Medicine Journal · doi:10.1111/imj.13206
Research on Chewing Gum: Questions of Ethics
Vieira, S. (2017) · Open Journal of Philosophy · doi:10.4236/ojpp.2017.73016
Philosophy and Physics : A Reconciliation
Oddan, J. (2017)
Veldkamp, C. L. S., Hartgerink, C. H. J., van Assen, M. A. L. M., & Wicherts, J. M. (2016) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/uk6ju
Research Integrity in Public Health
Gorman, D. M. (2018) · Oxford University Press eBooks · doi:10.1093/obo/9780199756797-0189
We may be Homo sapiens, but anaesthetists are merely apes when evaluating risk
Aranake-Chrisinger, A., Whitlock, E. L., & Avidan, M. S. (2018) · British Journal of Anaesthesia · doi:10.1016/j.bja.2018.07.022
PROPOSALS FOR SMALL STEPS TOWARD REPRODUCIBILITY OF SCIENCE EDUCATIONAL STUDIES
Šorgo, A. (2019) · Journal of Baltic Science Education · doi:10.33225/jbse/19.18.04
Miles, E. W. (2019) · Springer eBooks · doi:10.1007/978-3-030-15781-4_6
Zabriskie, C. (2019) · The Research Repository @ WVU (West Virginia University) · doi:10.33915/etd.4118
Probabilistic Reasoning in Stroke
Katsanos, A. H., Seitidis, G., Tsivgoulis, G. K., & Mavridis, D. (2020) · Stroke · doi:10.1161/strokeaha.120.030252
When Values Collide: Why Scientists Argue About Open Science and How to Move ForwardPreprint
Fife, D. A., Lung, M., Sullivan, N., & Young, C. (2020) · doi:10.31234/osf.io/q9d28
Ageing, Grey Matter Loss and Resting-State Effective Connectivity
Korbmacher, M. (2021) · NORA - Norwegian Open Research Archives
بحوث العلوم النفسية: الاستدلال الإحصائي والأزمة في قابلية التكرارPreprint
Unshur, A. M. H. (2021) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/47p8g
Kline, J. A. (2018) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.726772120.793551762
Riminucci, M., & Corsi, A. (2019) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.726772120.793558467
Chessler, S. D. (2019) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.726772120.793557759
Nelson, G. S. (2018) · Wiley eBooks · doi:10.1002/9781119425083.ch8
Golemis, E. A. (2019) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.726772120.793559699
Nelson, G. S. (2018) · doi:10.1002/9781119425083.ch6
Morling, B., & Calin-Jageman, R. J. (2019) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/qxwb7
Establishing a Reliability Program
Tulkoff, C., & Caswell, G. (2021) · Wiley eBooks · doi:10.1002/9781119109402.ch2
Tourish, D. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108616669.012
Tod, D. (2019) · Springer eBooks · doi:10.1007/978-3-030-12263-8_8
Must replication attempts be battlegrounds?Preprint
Hobson, H. (2018) · doi:10.31234/osf.io/82sr3
P-hacking, HARKing and confirmation bias in cyclostratigraphic spectral analysisPreprint
Smith, D. G. (2022) · doi:10.1002/essoar.10511908.1
Introducing the fragility index—A case study using the Term Breech Trial
Ho, A. K., Zamperoni, K. E., Ho, A. M. ‐., & Mizubuti, G. B. (2022) · Birth · doi:10.1111/birt.12698
Categories of Evidence and Methods in Surgical Decision-Making
Carmichael, S., & Kline, D. (2023) · Surgical Clinics of North America · doi:10.1016/j.suc.2022.11.001 · Cited by 1
Addressing bias in manual segmentation of spheroid sprouting assays with U-Net.
Rapp, J., Böhringer, D., Schlunck, G., Agostini, H. T., Reinhard, T., & Bucher, F. (2023) · PubMed Central
Ethical Principles in Plastic Surgery Research
Prescher, H., & Vercler, C. J. (2024) · Seminars in Plastic Surgery · doi:10.1055/s-0043-1778045
Best practices for user consultation in flow cytometry shared resource laboratories
Asosingh, K., Bayiyana, A., Black, M. C., Chakraborty, U., Clemente, M. J., Graham, A. C., Gregory, M. D., Hogg, K., Isterdael, G. V., Liu, C., et al. (2024) · Cytometry Part A · doi:10.1002/cyto.a.24891
Anatomy of Educational Innovations Based on Learning by Discovery in Higher Education
Ruisoto, P., Contador, I., Quintero-Ponce, E., López, J. C., Álvarez, B., Cacho, R., & Fernández‐Calvo, B. (2024) · Papeles del Psicólogo - Psychologist Papers · doi:10.23923/pap.psicol.3044 · Cited by 1
Stevens, C., Lacroix, C., Bouchet, M., Marsicano, G., & Marighetto, A. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.12.03.626648
Stimulus-Driven Leakage in Naturalistic Neuroimaging
Kim, S. (2026) · Imaging Neuroscience · doi:10.1101/2025.04.01.646146 · Cited by 1
Interessenkonflikte im Gesundheitswesen
Kuhn, H., Klemperer, D., Lieb, K., & Ludwig, W.-D. (2025) · Springer eBooks · doi:10.1007/978-3-658-42592-0_40-1
OTSUKA, Y., TAKAMORI, M., Zhangyan, Z. H. A. O., & AIZAWA, A. (2025) · Journal of the Japanese Society of Revegetation Technology · doi:10.7211/jjsrt.50.299
Gorman, D. M. (2024) · The Conversation · doi:10.64628/aai.hgywvmamf · Cited by 1
Why isn’t science better? Look at career incentives
Smaldino, P. E. (2016) · The Conversation · doi:10.64628/aai.wgmrhm6y4 · Cited by 3
Fields, D., & Asbury, K. (2025) · International Journal of Educational Research · doi:10.1016/j.ijer.2025.102856
Data visualization and causal reasoning are essential for causal effect estimation
Chen, D., Zhang, J. J., & Lynn, H. (2026) · Teaching Statistics · doi:10.1002/test.70031
Contaminating the evidence: the reproducibility crisis and fraud in infectious disease research
Watkins, R. R. (2026) · Infection · doi:10.1007/s15010-026-02730-0 · Cited by 1
Hachmann, H.-K. (2020) · doi:10.70675/3a07b69dzbd54z4f4bzae0czcce0e8c5fbff
Behl, C. (2026) · Springer eBooks · doi:10.1007/978-3-662-72210-7_18
Science is always unfinished: rethinking the demand for complete stories
Munita, R. (2026) · Trends in Biochemical Sciences · doi:10.1016/j.tibs.2026.04.010
Deschamps, L., Paillassa, J., Lévesque, E., & Maire, V. (2026) · Journal of Geophysical Research Biogeosciences · doi:10.1029/2025jg009082
Facts and values in (de)growth economics
Nagatsu, M., & MacLeod, M. (2026) · European Journal for Philosophy of Science · doi:10.1007/s13194-026-00780-7
Controversial to whom? A defense of the intra-scientific consensus view
Bellolio, C. (2026) · Contemporary Political Theory · doi:10.1057/s41296-026-00855-3
Metadata
- Authors
- Nuzzo, R.
- Corresponding author
- Nuzzo, Regina
- Venue
- Nature
- Published
- 2015-10-07
- Volume
- 526
- Issue
- 7572
- Pages
- 182-185
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W2211143780
- Cited by
- 296
- References
- 13
- Citations by year
- 2026: 8 · 2025: 10 · 2024: 20 · 2023: 21 · 2022: 17 · 2021: 30 · 2020: 27 · 2019: 44 · 2018: 33 · 2017: 35 · 2016: 48 · 2015: 3
- FWCI
- 77.93
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Social Sciences › Education › Academic integrity and plagiarism
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- self-deception, research reproducibility, researcher bias, confirmation bias, scientific integrity
- MeSH terms
- Competitive Behavior, Models, Theoretical, Motivation, Prejudice, Research Design, Research Personnel, Statistics as Topic, Reproducibility of Results, Bias, Single-Blind Method
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.