How scientists fool themselves – and how they can stop
The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Researchers often expect a particular outcome and can unintentionally influence the experiment or interpret the data in such a way as to support their preferred hypothesis [81].”
From Reporting animal research: Explanation and elaboration for the ARRIVE guidelines 2.0 (2020) · cites this paper as [81]
In the citing paper
“HARKing, or hypothesizing after results are known (37), or JARKing, justifying after results are known (38), are also inappropriate practices.”
From Misrepresentation and distortion of research in biomedical literature (2018) · cites this paper as [38]
Citations
Cites
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
Raise standards for preclinical cancer research
Begley, C. G., & Ellis, L. M. (2012) · Nature · doi:10.1038/483531a · Cited by 2,979
Platt, J. R. (1964) · Science · doi:10.1126/science.146.3642.347 · Cited by 2,907
Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling
John, L. K., Loewenstein, G., & Prelec, D. (2012) · Psychological Science · doi:10.1177/0956797611430953 · Cited by 2,239
Repeatability of published microarray gene expression analyses
Ioannidis, J. P. A., Allison, D. B., Ball, C. A., Coulibaly, I., Cui, X., Culhane, A. C., Falchi, M., Furlanello, C., Game, L., Jurman, G., et al. (2009) · Nature Genetics · doi:10.1038/ng.295 · Cited by 551
The (mis)reporting of statistical results in psychology journals
Bakker, M., & Wicherts, J. M. (2011) · Behavior Research Methods · doi:10.3758/s13428-011-0089-5 · Cited by 356
Does Incidental Disgust Amplify Moral Judgment? A Meta-Analytic Review of Experimental Evidence
Landy, J. F., & Goodwin, G. P. (2015) · Perspectives on Psychological Science · doi:10.1177/1745691615583128 · Cited by 288
Fugelsang, J. A., Stein, C. B., Green, A. E., & Dunbar, K. N. (2004) · Canadian Journal of Experimental Psychology / Revue canadienne de psychologie expérimentale · doi:10.1037/h0085799 · Cited by 115
The effect of horizontal eye movements on free recall: A preregistered adversarial collaboration.
Matzke, D., Nieuwenhuis, S., van Rijn, H., Slagter, H. A., van der Molen, M. W., & Wagenmakers, E.-J. (2015) · Journal of Experimental Psychology: General · doi:10.1037/xge0000038 · Cited by 114
Interactions of Multisensory Components Perceptually Rescue Túngara Frog Mating Signals
Taylor, R. C., & Ryan, M. J. (2013) · Science · doi:10.1126/science.1237113 · Cited by 102
Research works printed but not linked: 1
- MacCoun, R. & Perlmutter, S. in Psychological Science Under Scrutiny: Recent Challenges and Proposed Solutions (eds Lilienfeld, S. O. & Waldman, I.) (Wiley, in the press); Preprint available at http://ssrn.com/abstract=2563337
Cited by
A manifesto for reproducible science
Munafò, M. R., Nosek, B. A., Bishop, D. V. M., Button, K. S., Chambers, C. D., Percie du Sert, N., Simonsohn, U., Wagenmakers, E.-J., Ware, J. J., & Ioannidis, J. P. A. (2017) · Nature Human Behaviour · doi:10.1038/s41562-016-0021 · Cited by 3,397
Reporting animal research: Explanation and elaboration for the ARRIVE guidelines 2.0
Percie du Sert, N., Ahluwalia, A., Alam, S., Avey, M. T., Baker, M., Browne, W. J., Clark, A., Cuthill, I. C., Dirnagl, U., Emerson, M., et al. (2020) · PLOS Biology · doi:10.1371/journal.pbio.3000411 · Cited by 2,677
“Researchers often expect a particular outcome and can unintentionally influence the experiment or interpret the data in such a way as to support their preferred hypothesis [81].”
BackgroundSarstedt, M., Hair, J. F., Pick, M., Liengaard, B. D., Radomir, L., & Ringle, C. M. (2022) · Psychology & Marketing · doi:10.1002/mar.21640 · Cited by 1,264
von Bartheld, C. S., Bahney, J., & Herculano‐Houzel, S. (2016) · Journal of Comparative Neurology · doi:10.1002/cne.24040 · Cited by 1,063
“…parts of the human brain that were not representative; neglecting the role of the cerebellum; missing primary literature; copying information from previous reviews without scrutiny; inaccurate quoting of others’ work, and hesitation to challenge the prevailing dogma (Ioannidis, 2012; Nuzzo, 2015).”
BackgroundEdwards, M. A., & Roy, S. (2017) · Environmental Engineering Science · doi:10.1089/ees.2016.0223 · Cited by 688
“PLS-SEM: indeed a silver bullet” – retrospective observations and recent advances
Sarstedt, M., Hair, J. F., & Ringle, C. M. (2023) · Journal of Marketing Theory and Practice · doi:10.1080/10696679.2022.2056488 · Cited by 617
Open science challenges, benefits and tips in early career and beyond
Allen, C., & Mehler, D. M. A. (2019) · PLOS Biology · doi:10.1371/journal.pbio.3000246 · Cited by 608
Reporting animal research: Explanation and Elaboration for the ARRIVE guidelines 2019
Percie du Sert, N., Ahluwalia, A., Alam, S., Avey, M. T., Baker, M., Browne, W. J., Clark, A., Cuthill, I. C., Dirnagl, U., Emerson, M., et al. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/703355 · Cited by 559
On doing better science: From thrill of discovery to policy implications
Antonakis, J. (2017) · The Leadership Quarterly · doi:10.1016/j.leaqua.2017.01.006 · Cited by 475
Detecting and avoiding likely false‐positive findings – a practical guide
Forstmeier, W., Wagenmakers, E., & Parker, T. H. (2017) · Biological Reviews · doi:10.1111/brv.12315 · Cited by 436
The earth is flat ( p > 0.05): significance thresholds and the crisis of unreplicable research
Amrhein, V., Korner-Nievergelt, F., & Roth, T. (2017) · PeerJ · doi:10.7717/peerj.3544 · Cited by 308
Misrepresentation and distortion of research in biomedical literature
Boutron, I., & Ravaud, P. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1710755115 · Cited by 273
Statistical methods for linguistic research: Foundational Ideas—Part II
Nicenboim, B., & Vasishth, S. (2016) · Language and Linguistics Compass · doi:10.1111/lnc3.12207 · Cited by 263
Using confirmatory composite analysis to assess emergent variables in business research
Henseler, J., & Schuberth, F. (2020) · Journal of Business Research · doi:10.1016/j.jbusres.2020.07.026 · Cited by 235
Protecting against researcher bias in secondary data analysis: challenges and potential solutions
Baldwin, J. R., Pingault, J.-B., Schoeler, T., Sallis, H. M., & Munafò, M. R. (2022) · European Journal of Epidemiology · doi:10.1007/s10654-021-00839-0 · Cited by 178
A third option for climate policy within potential limits to growth
van den Bergh, J. C. J. M. (2017) · Nature Climate Change · doi:10.1038/nclimate3113 · Cited by 161
Assessing inter individual differences with task related functional neuroimaging
Lebreton, M., Bavard, S., Daunizeau, J., & Palminteri, S. (2019) · Nature Human Behaviour · doi:10.1038/s41562-019-0681-8 · Cited by 160
Replication in Criminology and the Social Sciences
Pridemore, W. A., Makel, M. C., & Plucker, J. A. (2017) · Annual Review of Criminology · doi:10.1146/annurev-criminol-032317-091849 · Cited by 169
Answers to 18 Questions About Open Science Practices
Banks, G. C., Field, J. G., Oswald, F. L., O’Boyle, E. H., Landis, R. S., Rupp, D. E., & Rogelberg, S. G. (2018) · Journal of Business and Psychology · doi:10.1007/s10869-018-9547-8 · Cited by 178
Philosophy of science and the replicability crisis
Romero, F. (2019) · Philosophy Compass · doi:10.1111/phc3.12633 · Cited by 184
Irreproducibility in hydrogen storage material research
Broom, D. P., & Hirscher, M. (2016) · Energy & Environmental Science · doi:10.1039/c6ee01435f · Cited by 130
ReproZip: Computational Reproducibility With Ease
Chirigati, F., Rampin, R., Shasha, D., & Freire, J. (2016) · Proceedings of the 2016 International Conference on Management of Data · doi:10.1145/2882903.2899401 · Cited by 128
System dynamics modelling and simulation for sociotechnical transitions research
Papachristos, G. (2018) · Environmental Innovation and Societal Transitions · doi:10.1016/j.eist.2018.10.001 · Cited by 140
Brain and psychological determinants of placebo pill response in chronic pain patients
Vachon‐Presseau, É., Berger, S., Abdullah, T. B., Huang, L., Cecchi, G., Griffith, J. W., Schnitzer, T. J., & Apkarian, A. V. (2018) · Nature Communications · doi:10.1038/s41467-018-05859-1 · Cited by 129
Jarantow, S. W., Pisors, E. D., & Chiu, M. L. (2023) · Current Protocols · doi:10.1002/cpz1.801 · Cited by 162
Tod, D., Booth, A., & Smith, B. M. (2021) · International Review of Sport and Exercise Psychology · doi:10.1080/1750984x.2021.1952471 · Cited by 169
Designing a rigorous microscopy experiment: Validating methods and avoiding bias
Jost, A. P.-T., & Waters, J. C. (2019) · The Journal of Cell Biology · doi:10.1083/jcb.201812109 · Cited by 116
Toward conciliation in the habitat fragmentation and biodiversity debate
Valente, J. J., Gannon, D. G., Hightower, J. N., Kim, H., Leimberger, K. G., Macedo, R., Rousseau, J. S., Weldy, M. J., Zitomer, R. A., Fahrig, L., et al. (2023) · Landscape Ecology · doi:10.1007/s10980-023-01708-9 · Cited by 117
Sarstedt, M., Adler, S. J., Ringle, C. M., Cho, G., Diamantopoulos, A., Hwang, H., & Liengaard, B. D. (2024) · Journal of Product Innovation Management · doi:10.1111/jpim.12738 · Cited by 147
PLS-Based Model Selection: The Role of Alternative Explanations in Information Systems Research
Sharma, P. N., Sarstedt, M., Galit Shmueli, A., Kim, K. H., & Thiele, K. O. (2019) · tub.dok (Hamburg University of Technology) · doi:10.17005/1.jais.00538 · Cited by 98
Heading for new shores! Overcoming pitfalls in BCI design
Chavarriaga, R., Fried-Oken, M., Kleih, S., Lotte, F., & Scherer, R. (2017) · Brain-Computer Interfaces · doi:10.1080/2326263x.2016.1263916 · Cited by 97
“Besides these issues, the BCI field also suffers from problems inherent to the scientific literature, as is the bias to publish only positive results that prevents the research community of learning from its errors [119].”
Robotic crowd biology with Maholo LabDroids
Yachie, N., & Natsume, T. (2017) · Nature Biotechnology · doi:10.1038/nbt.3758 · Cited by 107
Statistical Methods for Linguistic Research: Foundational Ideas – Part I
Vasishth, S., & Nicenboim, B. (2016) · Language and Linguistics Compass · doi:10.1111/lnc3.12201 · Cited by 119
Varangot‐Reille, C., Suso‐Martí, L., Romero-Palau, M., Suárez-Pastor, P., & Cuenca‐Martínez, F. (2021) · Journal of Pain · doi:10.1016/j.jpain.2021.12.003 · Cited by 109
Modeling the Risk of Team Sport Injuries: A Narrative Review of Different Statistical Approaches
Ruddy, J. D., Cormack, S. J., Whiteley, R. J., Williams, M. D., Timmins, R. G., & Opar, D. A. (2019) · Frontiers in Physiology · doi:10.3389/fphys.2019.00829 · Cited by 117
Biases in research: risk factors for non-replicability in psychotherapy and pharmacotherapy research
Leichsenring, F., Abbass, A., Hilsenroth, M. J., Leweke, F., Luyten, P., Keefe, J. R., Midgley, N., Rabung, S., Salzer, S., & Steinert, C. (2017) · Psychological Medicine · doi:10.1017/s003329171600324x · Cited by 78
Performing Contrast Analysis in Factorial Designs: From NHST to Confidence Intervals and Beyond
Wiens, S., & Nilsson, M. E. (2016) · Educational and Psychological Measurement · doi:10.1177/0013164416668950 · Cited by 90
Silverio, A., Cavallo, P., Rosa, R. D., & Galasso, G. (2019) · Frontiers in Medicine · doi:10.3389/fmed.2019.00036 · Cited by 80
Discounting: A practical guide to multilevel analysis of indifference data
Young, M. E. (2017) · Journal of the Experimental Analysis of Behavior · doi:10.1002/jeab.265 · Cited by 71
Bello, N. M., Kramer, M., Tempelman, R. J., Stroup, W. W., St-Pierre, N. R., Craig, B. Α., Young, L. J., & Gbur, E. E. (2016) · Journal of Dairy Science · doi:10.3168/jds.2016-11516 · Cited by 66
Must-have Qualities of Clinical Research on Artificial Intelligence and Machine Learning
Koçak, B., Cuocolo, R., Santos, D. P. D., Stanzione, A., & Ugga, L. (2023) · Balkan Medical Journal · doi:10.4274/balkanmedj.galenos.2022.2022-11-51 · Cited by 64
A mechanism based transition research methodology: Bridging analytical approaches
Papachristos, G. (2018) · Futures · doi:10.1016/j.futures.2018.02.006 · Cited by 72
Research Misconduct in Business and Management Studies: Causes, Consequences, and Possible Remedies
Tourish, D., & Craig, R. (2018) · Journal of Management Inquiry · doi:10.1177/1056492618792621 · Cited by 72
A data-driven framework for mapping domains of human neurobiology
Beam, E., Potts, C., Poldrack, R. A., & Etkin, A. (2021) · Nature Neuroscience · doi:10.1038/s41593-021-00948-9 · Cited by 69
Button, K. S., Bal, L., Clark, A., & Shipley, T. (2016) · BMC Psychology · doi:10.1186/s40359-016-0167-7 · Cited by 58
Hoffmann, S., Schönbrodt, F. D., Elsas, R., Wilson, R., Strasser, U., & Boulesteix, A. (2021) · Royal Society Open Science · doi:10.1098/rsos.201925 · Cited by 85
Genotypic variability enhances the reproducibility of an ecological study
Milcu, A., Freitas, R. P., Ellison, A. M., Blouin, M., Scheu, S., Freschet, G. T., Rose, L., Barot, S., Cesarz, S., Eisenhauer, N., et al. (2018) · Nature Ecology & Evolution · doi:10.1038/s41559-017-0434-x · Cited by 62
Drews, S., & van den Bergh, J. C. J. M. (2017) · Global Environmental Change · doi:10.1016/j.gloenvcha.2017.08.007 · Cited by 65
Olazabal, M., Neumann, M. B., Foudi, S., & Chiabai, A. (2018) · Systems Research and Behavioral Science · doi:10.1002/sres.2519 · Cited by 56
The Interplay between Subjectivity, Statistical Practice, and Psychological Science
Rouder, J. N., Morey, R. D., & Wagenmakers, E. (2016) · Collabra · doi:10.1525/collabra.28 · Cited by 70
Nonprobability Sampling and Causal Analysis
Köhler, U., Kreuter, F., & Stuart, E. A. (2018) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-030718-104951 · Cited by 81
Mebane, C. A., Sumpter, J. P., Fairbrother, A., Augspurger, T. P., Canfield, T. J., Goodfellow, W. L., Guiney, P. D., LeHuray, A. P., Maltby, L., Mayfield, D. B., et al. (2019) · Integrated Environmental Assessment and Management · doi:10.1002/ieam.4119 · Cited by 62
A Priori Justification for Effect Measures in Single-Case Experimental Designs
Manolov, R., Moeyaert, M., & Fingerhut, J. E. (2022) · Perspectives on Behavior Science · doi:10.1007/s40614-021-00282-2 · Cited by 53
“Preregistered protocols are a methodological safeguard against confirmation bias relevant for science in general (Nuzzo, 2015).”
BackgroundBello, N. M., & Renter, D. G. (2018) · Journal of Dairy Science · doi:10.3168/jds.2017-13978 · Cited by 68
Replicability and replication in the humanities
Peels, R. (2019) · Research Integrity and Peer Review · doi:10.1186/s41073-018-0060-4 · Cited by 80
Jones, K., Johnston, R. J., & Manley, D. (2016) · Methodological Innovations · doi:10.1177/2059799116672874 · Cited by 63
Why are we not evaluating multiple competing hypotheses in ecology and evolution?
Betini, G. S., Avgar, T., & Fryxell, J. M. (2017) · Royal Society Open Science · doi:10.1098/rsos.160756 · Cited by 59
Sharma, P. N., Sarstedt, M., Ringle, C. M., Cheah, J., Herfurth, A., & Hair, J. F. (2024) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2024.102805 · Cited by 63
Waltemath, D., & Wolkenhauer, O. (2016) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2016.2555481 · Cited by 49
Wyatt, T. D. (2020) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2019.0262 · Cited by 56
Open Science: What, Why, and HowPreprint
Spellman, B., Gilbert, E. A., & Corker, K. S. (2017) · doi:10.31234/osf.io/ak6jr · Cited by 50
Preregistration in experimental linguistics: applications, challenges, and limitations
Roettger, T. B. (2021) · Linguistics · doi:10.1515/ling-2019-0048 · Cited by 52
Who Believes in the Storybook Image of the Scientist?
Veldkamp, C. L. S., Hartgerink, C. H. J., van Assen, M. A. L. M., & Wicherts, J. M. (2016) · Accountability in Research · doi:10.1080/08989621.2016.1268922 · Cited by 47
Strong Inference in Mathematical Modeling: A Method for Robust Science in the Twenty-First Century
Ganusov, V. V. (2016) · Frontiers in Microbiology · doi:10.3389/fmicb.2016.01131 · Cited by 49
A Meta-Analysis of Odor Thresholds and Odor Identification in Autism Spectrum Disorders
Larsson, M. U., Tirado, C., & Wiens, S. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.00679 · Cited by 46
The climate of neurofeedback: scientific rigour and the perils of ideology
Thibault, R. T., Lifshitz, M., & Raz, A. (2018) · Brain · doi:10.1093/brain/awx330 · Cited by 44
Field, S. M., Wagenmakers, E.-J., Kiers, H. A. L., Hoekstra, R., Ernst, A. F., & van Ravenzwaaij, D. (2020) · Royal Society Open Science · doi:10.1098/rsos.181351 · Cited by 43
Berger, S., & Baria, A. T. (2022) · Frontiers in Pain Research · doi:10.3389/fpain.2022.896276 · Cited by 47
Crilly, N. (2019) · Design Studies · doi:10.1016/j.destud.2019.10.006 · Cited by 51
Behavioural lateralization in a detour test is not repeatable in fishes
Roche, D. G., Amcoff, M., Morgan, R., Sundin, J., Andreassen, A. H., Finnøen, M. H., Lawrence, M. J., Henderson, E., Norin, T., Speers‐Roesch, B., et al. (2020) · Animal Behaviour · doi:10.1016/j.anbehav.2020.06.025 · Cited by 44
Sharma, P. N., Morgeson, F. V., Mithas, S., & Aljazzaf, S. (2018) · Government Information Quarterly · doi:10.1016/j.giq.2018.07.003 · Cited by 54
Projecting the performance of conservation interventions
Law, E. A., Ferraro, P. J., Arcese, P., Bryan, B. A., Davis, K. J., Gordon, A., Holden, M. H., Iacona, G. D., Marcos-Martínez, R., McAlpine, C., et al. (2017) · Biological Conservation · doi:10.1016/j.biocon.2017.08.029 · Cited by 36
Genotype-Specific Measles Transmissibility: A Branching Process Analysis
Ackley, S. F., Hacker, J. K., Enanoria, W. T. A., Worden, L., Blumberg, S., Porco, T. C., & Zipprich, J. (2017) · Clinical Infectious Diseases · doi:10.1093/cid/cix974 · Cited by 39
Placebo Intervention Enhances Reward Learning in Healthy Individuals
Turi, Z., Mittner, M., Paulus, W., & Antal, A. (2017) · Scientific Reports · doi:10.1038/srep41028 · Cited by 37
Nießl, C., Herrmann, M., Wiedemann, C., Casalicchio, G., & Boulesteix, A. (2021) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.1441 · Cited by 58
Barsky, L. W., Black, M. C., Cochran, M. R., Daniel, B. J., Davies, D. C., DeLay, M. L., Gardner, R., Gregory, M. D., Kunkel, D., Lannigan, J. A., et al. (2016) · Cytometry Part A · doi:10.1002/cyto.a.23016 · Cited by 34
The influence of audio-visual interactions on the annoyance ratings for wind turbines
Szychowska, M., Hafke-Dys, H., Preis, A., Kociński, J., & Kleka, P. (2017) · Applied Acoustics · doi:10.1016/j.apacoust.2017.08.003 · Cited by 36
Are Leadership and Management Essential for Good Research? An Interview Study of Genetic Researchers
Antes, A. L., Mart, A., & DuBois, J. M. (2016) · Journal of Empirical Research on Human Research Ethics · doi:10.1177/1556264616668775 · Cited by 45
Boulesteix, A., & Hoffmann, S. (2024) · BMJ Medicine · doi:10.1136/bmjmed-2023-000783 · Cited by 44
Conceptual framework for investigating causal effects from observational data in livestock1
Bello, N. M., Ferreira, V. C. A., Gianola, D., & Rosa, G. J. M. (2018) · Journal of Animal Science · doi:10.1093/jas/sky277 · Cited by 41
Considerations when processing and interpreting genomics data of the placenta
Konwar, C., Gobbo, G. F. D., Yuan, V., & Robinson, W. P. (2019) · Placenta · doi:10.1016/j.placenta.2019.01.006 · Cited by 35
Physiological Plausibility Can Increase Reproducibility in Cognitive Neuroscience
van Ede, F., & Maris, E. (2016) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2016.05.006 · Cited by 32
Examining Data Repository Guidelines for Qualitative Data Sharing
Antes, A. L., Walsh, H. A., Strait, M., Hudson‐Vitale, C., & DuBois, J. M. (2017) · Journal of Empirical Research on Human Research Ethics · doi:10.1177/1556264617744121 · Cited by 46
Psychotherapy Versus Pharmacotherapy of Depression: What’s the Evidence?
Leichsenring, F., Steinert, C., & Hoyer, J. (2016) · Zeitschrift für Psychosomatische Medizin und Psychotherapie · doi:10.13109/zptm.2016.62.2.190 · Cited by 32
Qresp, a tool for curating, discovering and exploring reproducible scientific papers
Govoni, M., Munakami, M., Tanikanti, A., Skone, J. H., Runesha, H. B., Giberti, F., Pablo, J., & Galli, G. (2019) · Scientific Data · doi:10.1038/sdata.2019.2 · Cited by 34
A Computational Inflection for Scientific Discovery
Hope, T., Downey, D., Weld, D. S., Etzioni, O., & Horvitz, E. (2023) · Communications of the ACM · doi:10.1145/3576896 · Cited by 65
Huggins, J. E., Guger, C., Ziat, M., Zander, T. O., Taylor, D., Tangermann, M., Soria‐Frisch, A., Simeral, J. D., Scherer, R., Rupp, R., et al. (2017) · Brain-Computer Interfaces · doi:10.1080/2326263x.2016.1275488 · Cited by 34
On researcher bias in Software Engineering experiments
Romano, S., Fucci, D., Scanniello, G., Baldassarre, M. T., Turhan, B., & Juristo, N. (2021) · Journal of Systems and Software · doi:10.1016/j.jss.2021.111068 · Cited by 42
Centralized scientific communities are less likely to generate replicable results
Danchev, V., Rzhetsky, A., & Evans, J. A. (2019) · eLife · doi:10.7554/elife.43094 · Cited by 27
Improving research integrity: a framework for responsible science communication
Ciubotariu, I. I., & Bosch, G. (2022) · BMC Research Notes · doi:10.1186/s13104-022-06065-5 · Cited by 44
Who Should Do Replication Labor?
Romero, F. (2018) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245918803619 · Cited by 29
Team Logo Predicts Concussion Risk
Smoliga, J. M., & Zavorsky, G. S. (2017) · Epidemiology · doi:10.1097/ede.0000000000000694 · Cited by 28
Roy, S., & Edwards, M. A. (2019) · Citizen Science Theory and Practice · doi:10.5334/cstp.154 · Cited by 41
When we can trust computers (and when we can't)
Coveney, P. V., & Highfield, R. (2021) · Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences · doi:10.1098/rsta.2020.0067 · Cited by 31
The Making of an Expert Detective. Thinking and Deciding in Criminal Investigations
Fahsing, I. (2016) · BIBSYS Brage (BIBSYS (Norway)) · doi:10.13140/rg.2.2.29210.44482 · Cited by 69
Spellman, B. A., Gilbert, E. A., & Corker, K. S. (2018) · Wiley eBooks · doi:10.1002/9781119170174.epcn519 · Cited by 92
A role for meta‐analysis in hydrology
Evaristo, J., & McDonnell, J. J. (2017) · Hydrological Processes · doi:10.1002/hyp.11253 · Cited by 24
Arzika, A. M., Maliki, R., Goodhew, E. B., Rogier, E. W., Priest, J. W., Lebas, E., O’Brien, K. S., Le, V., Oldenburg, C. E., Doan, T. A., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-28565-5 · Cited by 26
Gene-tree misrooting drives conflicts in phylogenomic coalescent analyses of palaeognath birds
Simmons, M. P., Springer, M. S., & Gatesy, J. (2021) · Molecular Phylogenetics and Evolution · doi:10.1016/j.ympev.2021.107344 · Cited by 25
Arguments from Expert Opinion and Persistent Bias
Mizrahi, M. (2017) · Argumentation · doi:10.1007/s10503-017-9434-x · Cited by 31
Metadata
- Authors
- Nuzzo, R.
- Corresponding author
- Nuzzo, Regina
- Venue
- Nature
- Published
- 2015-10-07
- Volume
- 526
- Issue
- 7572
- Pages
- 182-185
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W2211143780
- Cited by
- 296
- References
- 13
- Citations by year
- 2026: 8 · 2025: 10 · 2024: 20 · 2023: 21 · 2022: 17 · 2021: 30 · 2020: 27 · 2019: 44 · 2018: 33 · 2017: 35 · 2016: 48 · 2015: 3
- FWCI
- 77.93
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Social Sciences › Education › Academic integrity and plagiarism
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- self-deception, research reproducibility, researcher bias, confirmation bias, scientific integrity
- MeSH terms
- Competitive Behavior, Models, Theoretical, Motivation, Prejudice, Research Design, Research Personnel, Statistics as Topic, Reproducibility of Results, Bias, Single-Blind Method
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.