How to Make More Published Research True
Open accessThe DOI matches its Crossref record; 75 of the 75 references it cites were found in a registry or an index.
Abstract
Currently, many published research findings are false or exaggerated, and an estimated 85% of research resources are wasted.N To make more published research true, practices that have improved credibility and efficiency in specific fields may be transplanted to others which would benefit from them-possibilities include the adoption of large-scale collaborative research; replication culture; registration; sharing; reproducibility practices; better statistical methods; standardization of definitions and analyses; more appropriate (usually more stringent) statistical thresholds; and improvement in study design standards, peer review, reporting and dissemination of research, and training of the scientific workforce. N Selection of interventions to improve research practices requires rigorous examination and experimental testing whenever feasible.N Optimal interventions need to understand and harness the motives of various stakeholders who operate in scientific research and who differ on the extent to which they are interested in promoting publishable, fundable, translatable, or profitable results.N Modifications need to be made in the reward system for science, affecting the exchange rates for currencies (e.g., publications and grants) and purchased academic goods (e.g., promotion and other academic or administrative power) and introducing currencies that are better aligned with translatable and reproducible research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Accordingly, there is growing recognition that data availability is a critical feature of an efficient, progressive, and ultimately self-correcting scientific ecosystem that generates credible findings [1–3].”
From Data availability, reusability, and analytic reproducibility: evaluating the impact of a mandatory open data policy at the journal Cognition (2018) · cites this paper as [1]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Some journals have heeded the growing calls for adoption of transparent and reproducible research practices and introduced new policies to implement change [1,2].”
From Data availability, reusability, and analytic reproducibility: evaluating the impact of a mandatory open data policy at the journal Cognition (2018) · cites this paper as [1]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, protocol registration is applicable to and recommended for all studies and is supported by various platforms, such as the Open Science Framework [3, 29, 35–37].”
From Assessing transparency practices in dental randomized controlled trials (2024) · cites this paper as [3]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Well-planned, well-executed, and well-reported RCTs, which embrace transparent and open science practices, enhance the likelihood that results are accurate, reliable, and applicable [2, 3].”
From Assessing transparency practices in dental randomized controlled trials (2024) · cites this paper as [3]
Experimental — accuracy not yet measuredIn the citing paper
“Consider that the stakeholders who fund and support science may have incentives that are not always aligned with those of active researchers [82].”
From The natural selection of bad science (2016) · cites this paper as [82]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Self-citationConfirmation Bias: A Ubiquitous Phenomenon in Many Guises
Nickerson, R. S. (1998) · Review of General Psychology · doi:10.1037/1089-2680.2.2.175 · Cited by 7,267 · cited 2×
“powerful in scientific processes [8,9].”
BackgroundSimmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 2×
“Many new proposed associations and/or effects are false or grossly exaggerated [2,3], and translation of knowledge into useful applications is often slow and potentially inefficient [4].”
BackgroundSelf-citationClinical Practice Guidelines We Can Trust
Committee on Standards for Developing Trustworthy Clinical Practice Guidelines, Board on Health Care Services, & Institute of Medicine (2011) · National Academies Press eBooks · doi:10.17226/13058 · Cited by 3,081
Raise standards for preclinical cancer research
Begley, C. G., & Ellis, L. M. (2012) · Nature · doi:10.1038/483531a · Cited by 2,979 · cited 1×
“Pharmaceutical industry teams have championed reproducibility in preclinical research [56,57] because they depend on pre-clinical academic investigations accurately pinpointing useful drug targets.”
BackgroundBelieve it or not: how much can we rely on published data on potential drug targets?
Prinz, F., Schlange, T., & Asadullah, K. (2011) · Nature Reviews Drug Discovery · doi:10.1038/nrd3439-c1 · Cited by 1,888 · cited 1×
“Pharmaceutical industry teams have championed reproducibility in preclinical research [56,57] because they depend on pre-clinical academic investigations accurately pinpointing useful drug targets.”
BackgroundEvidence based medicine: a movement in crisis?
Greenhalgh, T., Howick, J., Maskrey, N., & for the Evidence Based Medicine Renaissance Group (2014) · BMJ · doi:10.1136/bmj.g3725 · Cited by 1,766
Scientific method: Statistical errors
Nuzzo, R. (2014) · Nature · doi:10.1038/506150a · Cited by 1,536
Why Most Discovered True Associations Are Inflated
Ioannidis, J. P. A. (2008) · Epidemiology · doi:10.1097/ede.0b013e31818131e7 · Cited by 1,495 · cited 1×
“Many new proposed associations and/or effects are false or grossly exaggerated [2,3], and translation of knowledge into useful applications is often slow and potentially inefficient [4].”
BackgroundSelf-citation
Research works printed but not linked: 1
- R Al-Shahi Salman, 2014, Increasing value and reducing waste in biomedical research regulation and management, Lancet, 383, 176, 10.1016/s0140-6736(13)62297-7 · DOI · Paper page
Cited by
Items 401–500 of 802
Cordell, G. A. (2019) · Journal of Ethnopharmacology · doi:10.1016/j.jep.2019.112134 · Cited by 11
Suskens, J. J. M., Reurink, G., Tol, J. L., Kerkhoffs, G. M. M. J., Goedhart, E. A., Maas, H., & van Dieën, J. H. (2023) · Journal of Applied Biomechanics · doi:10.1123/jab.2022-0102 · Cited by 10
Building capacity to encourage research reproducibility and #MakeResearchTrue
Rethlefsen, M. L., Lackey, M. J., & Zhao, S. (2018) · Journal of the Medical Library Association JMLA · doi:10.5195/jmla.2018.273 · Cited by 10
Niezamierzone konsekwencje punktozy jako wartości kulturowej polskiej społeczności akademickiej
Kulikowski, K., & Antipow, E. (2020) · Studia Socjologiczne · doi:10.24425/sts.2020.132476 · Cited by 15
How to understand and teach P values: a diagnostic test framework
Baduashvili, A., Evans, A. T., & Cutler, T. S. (2020) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.03.003 · Cited by 9
Charting the Constellation of Science Reform
Field, S. M. (2022) · Liberate Science GmbH eBooks · doi:10.53962/meeb-2ktd · Cited by 11
Statistical Issues in Reproducibility
Stahel, W. A. (2016) · John Wiley & Sons, Inc. eBooks · doi:10.1002/9781118865064.ch5 · Cited by 12
Achieving Milestones as a Prerequisite for Proceeding With a Clinical Trial
Mickle, A. M., Maybrier, H. R., Winter, A. C., McKinnon, S., Torres, B. A., Lin, N., Lenze, E. J., Stark, S., Muench, M. R., Jacobsohn, E., et al. (2017) · Anesthesia & Analgesia · doi:10.1213/ane.0000000000002680 · Cited by 9
Gea-Caballero, V., de Viñaspre‐Hernández, R. R., Saus‐Ortega, C., Celda-Belinchón, L., Santolalla‐Arnedo, I., Marqués‐Sulé, E., & Juárez‐Vela, R. (2023) · Frontiers in Public Health · doi:10.3389/fpubh.2023.1119117 · Cited by 10
Sawyer-Morris, G., Ulukaya, M., Kushmerick-McCune, B., Clark, K. J., Bruce, J., Gatzke, S., Walters, S. T., & Taxman, F. S. (2025) · Journal of Clinical and Translational Science · doi:10.1017/cts.2025.68 · Cited by 11
“Portfolio analyses can also help improve public transparency by building trust between the scientific community and the public, potentially enhancing credibility and support for research initiatives [14].”
Die New Statistics in der Psychologie: Status quo und Zukunft der Datenanalyse
Schäfer, T. (2018) · Zeitschrift für Entwicklungspsychologie und Pädagogische Psychologie · doi:10.1026/0049-8637/a000184 · Cited by 8
The iatrogenic opioid crisis: An example of ‘institutional corruption of pharmaceuticals’?
Makhinson, M., Seshia, S. S., Young, G. B., Smith, P. A., Stobart, K., & Guha, I. N. (2021) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.13566 · Cited by 8
Hansford, H. J., Cashin, A. G., Wewege, M. A., Ferraro, M. C., McAuley, J. H., Jones, M. D., & Collaborators, T. A. O. P. (. S. S. (2021) · Arthroscopy The Journal of Arthroscopic and Related Surgery · doi:10.1016/j.arthro.2021.09.005 · Cited by 8
Hopkins, W. D., Westerhausen, R., Schapiro, S. J., & Sherwood, C. C. (2022) · Genes Brain & Behavior · doi:10.1111/gbb.12784 · Cited by 8
“The issue of reproducibility and replication of scientific findings is a topic of increasing interest in the social, biological and medical fields.(62,63) Specifically, the chimpanzee sample in this study consisted of two cohorts of animals that were housed at separate facilities with distinct founder animals.”
BackgroundNeonatal Jaundice and Autism: Precautionary Principle Invocation Overdue
Wilde, V. K. (2022) · Cureus · doi:10.7759/cureus.22512 · Cited by 10
Catalá-López, F., Alonso‐Arroyo, A., Page, M. J., Castelló‐Cogollos, L., Hutton, B., Ridao-López, M., Tabarés‐Seisdedos, R., Aleixandre‐Benavent, R., & Moher, D. (2023) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2023.02.001 · Cited by 8
Lapointe, L., Ouimet, M., Charbonneau, M., & Beorofei, É. T. (2015) · Canadian Public Administration · doi:10.1111/capa.12124 · Cited by 12
Collaboration in Giftedness and Talent Development Research
Makel, M. C., Smith, K. N., Miller, E. M., Peters, S. J., & McBee, M. T. (2020) · journal for the education of the gifted · doi:10.1177/0162353220912019 · Cited by 8
Hirt, J., Ewald, H., Lawson, D. O., Hemkens, L. G., Briel, M., & Schandelmaier, S. (2022) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2022.05.005 · Cited by 8
Reproducibility in Biomedical Research
Mullane, K., Curtis, M. J., & Williams, M. J. (2017) · Elsevier eBooks · doi:10.1016/b978-0-12-804725-5.00001-x · Cited by 11
Nudging transparent behavioural science and policy
Maynard, O., & Munafo, M. R. (2018) · Behavioural Public Policy · doi:10.1017/bpp.2018.10 · Cited by 9
“, 2015) is rapidly developing strategies to improve the transparency and robustness of research (Ioannidis, 2014; Munafò et al., 2017).”
BackgroundInvestigating the link between smoke-free legislation and stillbirths
Been, J. V., & Sheikh, A. (2015) · Expert Review of Respiratory Medicine · doi:10.1586/17476348.2016.1125784 · Cited by 8
“The importance of replication in research is increasingly recognized and emphasized.[23,24] When undertaking quasi-experimental studies, we would urge”
BackgroundHow to Read a Research CompendiumPreprint
Nüst, D., Boettiger, C., & Marwick, B. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.09525 · Cited by 10
“domains, yet the intentions and benefits are the same. Research compendia are practised Open Science culture and as such improve transparency (Nosek et al. 2015), “make more published research true” (Ioannidis 2014), and enable enhanced review and publication workflows (Nüst et al. 2017). They answer readers’ needs to u…”
BackgroundHoffmann, S., Schönbrodt, F. D., Elsas, R., Wilson, R., Strasser, U., & Boulesteix, A. (2020) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/afb9p · Cited by 8
STEM-based engineering design process models in physics learning: systematic literature review
Syukri, M., Haya, F., Maghfirah, S., Herliana, F., Rasul, M. S., & Pratama, H. (2026) · European Journal of STEM Education · doi:10.20897/ejsteme/17784 · Cited by 7
van den Bogert, C. A., Souverein, P. C., Brekelmans, C. T. M., Janssen, S. W. J., van Hunnik, M., Koëter, G. H., Leufkens, H. G. M., & Bouter, L. M. (2015) · BMJ Open · doi:10.1136/bmjopen-2015-007827 · Cited by 10
Choi, S. W., & Lam, D. M. H. (2015) · Anaesthesia · doi:10.1111/anae.13300 · Cited by 8
Ritto, A. P., de Araújo, A. L., de Carvalho, C. R. R., de Souza, H. P., Favaretto, P. M. E. S., Saboya, V. R. B., Garcia, M. L., Kulikowski, L. D., Kallas, E. G., Pereira, A. J. R., et al. (2024) · Frontiers in Public Health · doi:10.3389/fpubh.2024.1369129 · Cited by 8
“In recent years, collaboration among healthcare researchers with diverse expertise and access to large-scale patient data has emerged as a critical approach to enhancing research quality and efficiency (4–11).”
BackgroundProtocol publication rate and comparison between article, registry and protocol in RCTs
Mathieu, S., Bouillon‐Minois, J., Triché, L. R., Coudeyre, E., de Chazeron, I., Finotto, T., Laporte, C., Moisset, X., Samalin, L., Villatte, G., et al. (2025) · BMC Medical Research Methodology · doi:10.1186/s12874-025-02471-y · Cited by 10
Hartwig, F. P., Davies, N. M., Horta, B. L., Victora, C. G., & Smith, G. D. (2016) · BMJ Open · doi:10.1136/bmjopen-2015-010067 · Cited by 8
“INTRODUCTION Consortium-based efforts have been proposed as a practice that may contribute to generate more reliable scientific findings.(1) Such an approach has many desirable characteristics, including improved power by”
BackgroundKrause, M. S. (2016) · Psychotherapy Research · doi:10.1080/10503307.2016.1222459 · Cited by 7
“Doing so must be because these all are true replicates of the same RCTjk (see, e.g., Ioannidis, 2014; Schmidt, 2009; van der Veer, van Ijzendoorn, & Valsiner, 1994, on the concept and feasibility of such replication), which would mean that they all have the same statistically expected outcome…”
BackgroundData Heterogeneity: The Enzyme to Catalyze Translational Bioinformatics?
Cahan, E. M., & Khatri, P. (2020) · Journal of Medical Internet Research · doi:10.2196/18044 · Cited by 7
“This has been observed both in vitro and in vivo, where physiologic models poorly recapitulate real-world biology; up to 100% of findings based on observational data (such as vast catalogs of genetic signals) are not replicable [2,5,19].”
BackgroundThe rise of a mega‐journal in public health publishing
Gorman, D. (2023) · Learned Publishing · doi:10.1002/leap.1566 · Cited by 6
“There is also an extensive literature demonstrating that the current incentive system within academia, which encourages quantity over quality of publications, has resulted in the proliferation of false-positive published results that are frequently trivial and rarely replicated (Edwards & Roy, 2017; Ioannidis, 2014; S…”
BackgroundResultFusco, G., Scandola, M., Lin, H., Inzlicht, M., & Aglioti, S. M. (2023) · Cortex · doi:10.1016/j.cortex.2023.09.019 · Cited by 9
“…were conducted using a Bayesian approach (Kruschke, 2014, pp. 1 e 759), which is an alternative approach to Null Hypothesis Significance Testing (NHST) that has been recently at the centre of controversies (Cohen, 1990; Hubbard & Lindsay, 2008; Ioannidis, 2014; Open Science Collaboration, 2015).”
MethodSting operations in biomedical publishing violate truthfulness and undermine trust in research
da Silva, J. A. T., Türp, J. C., & Daly, T. P. (2024) · Current Medical Research and Opinion · doi:10.1080/03007995.2024.2441340 · Cited by 7
“Several authors have pointed out that the quality of some— others would say most 82,83 —of the biomedical literature leaves much to be desired 84 , leading to the widely lamented “replication crisis” not only in biomedicine, especially cancer 85 , but also across scientific disciplines 86 , such as…”
Wang, K., Guan, C., Yu, J., Jin, X., Sun, L. V., Zheng, L., Xia, L., & Zhang, Y. (2017) · Oncotarget · doi:10.18632/oncotarget.20657 · Cited by 7
“However, the interpretation of the results should be carried out with caution since publication bias is ubiquitous [66], and cannot be accurately determined by the use of statistical tests.”
BackgroundFeltrin, R. B., Guilam, M. C. R., Barral‐Netto, M., Lima, N. T., & Moraes, M. O. (2018) · PLoS ONE · doi:10.1371/journal.pone.0204232 · Cited by 7
Hicks, D. M., Melkers, M. J., Barna, J. A., Isett, K. R., & Gilbert, G. H. (2019) · PubMed · Cited by 7
An Open-Source Framework for Automated High-Throughput Cell Biology Experiments
Katunin, P., Zhou, J., Shehata, O. M., Peden, A. A., Cadby, A. J., & Nikolaev, A. (2021) · Frontiers in Cell and Developmental Biology · doi:10.3389/fcell.2021.697584 · Cited by 7
Intersections of Technological and Regulatory Zones in Regenerative Medicine
Hogle, L. F. (2017) · Springer eBooks · doi:10.1007/978-3-319-63787-7_3 · Cited by 11
Tendency Towards the Average? The Aesthetic Evaluation of a Quantitatively Average Music Performance
Wolf, A. D., Kopiez, R., Platz, F., Lin, H.-R., & Mütze, H. (2018) · Music Perception An Interdisciplinary Journal · doi:10.1525/mp.2018.36.1.98 · Cited by 8
“Both Ioannidis (2014) and Cumming (2014) reported extensive lists with mostly viable suggestions on how to improve current research practice to reduce this problem of low replicability.”
BackgroundKemper, J. M., Wang, H. T. Y., Ong, A. G. J., Mol, B. W., & Rolnik, D. L. (2019) · European Journal of Obstetrics & Gynecology and Reproductive Biology · doi:10.1016/j.ejogrb.2019.12.022 · Cited by 7
Noble, A. J., Nevitt, S. J., Holmes, E. A. F., Ridsdale, L., Morgan, M., Smith, C. T., Hughes, D. A., Goodacre, S. W., Marson, A. G., & Snape, D. (2020) · Health Services and Delivery Research · doi:10.3310/hsdr08390 · Cited by 7
Been, J. V., Mackay, D., Millett, C. J., Soyiri, I. N., van Schayck, O. C. P., Pell, J. P., & Sheikh, A. (2017) · Tobacco Control · doi:10.1136/tobaccocontrol-2017-053801 · Cited by 8
Estimating the Reproducibility of Experimental PhilosophyPreprint
Cova, F., & Abatista, A. (2024) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/hr4zs · Cited by 7
Assessing transparency practices in dental randomized controlled trials
Prado, M. C., Dotto, L., Agostini, B., & Sarkis-Onofre, R. (2024) · BMC Medical Research Methodology · doi:10.1186/s12874-024-02316-0 · Cited by 6
Schlögl, M., Waltersdorfer, L., Regner, P., Siposova, A., & Brenning, A. (2026) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2026.106962 · Cited by 6
Dhingra, K., Mitchell, S. M., Davies, B., & Taylor, P. J. (2021) · Psychiatry Research · doi:10.1016/j.psychres.2021.114085 · Cited by 6
Computational Reproducibility: A Practical Framework for Data Curators
Sawchuk, S., & Khair, S. (2021) · Journal of eScience Librarianship · doi:10.7191/jeslib.2021.1206 · Cited by 8
“…solutions for researchers, rather than curators (Akmon 2017; Fear 2015; Goodman et al 2014; Gray et al. 2005; Hatton and van Genuchten 2019; Ioannidis 2014; King 2011; Kitzes et al. 2017; Macneil 2018; McCoach et al. 2020; Peng 2011; Sandve et al. 2013; Stodden 2010; Stodden 2012; Stodden…”
BackgroundSanctions for Research Misconduct in Cardiothoracic Surgery Journals
Sade, R. M., Canver, C. C., D’Amico, T. A., Ellis, J., Fenton, K. N., Freeman, R., Fullerton, D. A., Harrison, L. W., Jaggers, J. J., Jones, J., et al. (2016) · The Annals of Thoracic Surgery · doi:10.1016/j.athoracsur.2016.02.003 · Cited by 6
Pro-Con Debate: Interdisciplinary Perspectives on Industry-Sponsored Research
Sessler, D. I., Alman, B. A., Treggiari, M. M., & Mont, M. A. (2023) · Anesthesia & Analgesia · doi:10.1213/ane.0000000000006386 · Cited by 6
Advancing Research through Replication
Lash, T. L. (2014) · Paediatric and Perinatal Epidemiology · doi:10.1111/ppe.12167 · Cited by 6
Novel concept on antiviral strategies to dengue
Lo, Y.-C., & Perng, G. (2016) · Current Opinion in Virology · doi:10.1016/j.coviro.2016.05.009 · Cited by 6
Examining the Reproducibility of 6 Published Studies in Public Health Services and Systems Research
Harris, J. K., Wondmeneh, S. B., Zhao, Y., & Leider, J. P. (2018) · Journal of Public Health Management and Practice · doi:10.1097/phh.0000000000000694 · Cited by 8
“Funders and employers of researchers could consider incentivizing or funding reproducible research, reproduction efforts, and strategies for increasing reproducibility such as sharing data and statistical code.(6,29)”
BackgroundARRIVE and CONSORT guidelines: do they have a place in Veterinary Anaesthesia and Analgesia?
Flammer, S. A., & Trim, C. Μ. (2015) · Veterinary Anaesthesia and Analgesia · doi:10.1111/vaa.12329 · Cited by 6
Why So Few Randomized Trials Are Useful*
Lanspa, M. J., & Morris, A. H. (2017) · Critical Care Medicine · doi:10.1097/ccm.0000000000002115 · Cited by 6
Veldkamp, C. L. S. (2017) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/g8cjq · Cited by 6
Calling differential DNA methylation at cell-type resolution: an objective status-quoPreprint
Han, J., Zheng, S., Breeze, C. E., Beck, S., & Teschendorff, A. E. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/822940 · Cited by 5
Kochunov, P., Ma, Y., Hatch, K. S., Schmaal, L., Jahanshad, N., Thompson, P. M., Adhikari, B. M., Bruce, H. A., Chiappelli, J., van der Vaart, A. D., et al. (2021) · medRxiv · doi:10.1101/2021.09.18.21263763 · Cited by 6
Guidelines on design, measurement and statistics for Appetite
Geary, N., & Higgs, S. (2021) · Appetite · doi:10.1016/j.appet.2021.105731 · Cited by 7
Pursuitworthiness in urgent research: Lessons on well-ordered science from sustainability science
Stojanovic, M. (2023) · Studies in History and Philosophy of Science Part A · doi:10.1016/j.shpsa.2023.01.004 · Cited by 5
Measuring the replicability of our own research
Brown, R. E. (2024) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2024.110111 · Cited by 5
“Ioannidis (2014) has presented 12 steps for improving the reliability and validity of published research.”
Interventions to promote medical research integrity: a scoping review
Liu, S., Yang, Y., & Li, M. (2025) · BMC Medical Ethics · doi:10.1186/s12910-025-01275-5 · Cited by 5
“In addition, given the global nature of scientific research, future research should promote international cooperation and coordination [62].”
Placebo and nocebo phenomena from the perspective of evidence based and person centered medicine
Jakovljević, M. (2017) · Hospital Pharmacology - International Multidisciplinary Journal · doi:10.5937/hpimj1702512j · Cited by 5
Kochunov, P., Ma, Y., Hatch, K. S., Schmaal, L., Jahanshad, N., Thompson, P. M., Adhikari, B. M., Bruce, H. A., Chiappelli, J., van der Vaart, A. D., et al. (2021) · Pacific Symposium on Biocomputing (PSB) · doi:10.1142/9789811250477_0013 · Cited by 9
“Moreover, clinical and neuroimaging findings in MDD have historically been affected by heterogeneity and poor reproducibility (1).”
BackgroundMethodSwan, K., Speyer, R., Scharitzer, M., Farneti, D., Brown, T., & Cordier, R. (2022) · Journal of Clinical Medicine · doi:10.3390/jcm11030724 · Cited by 7
Ninot, G., Descamps, É., Achalid, G., Poisbeau, P., & Falissard, B. (2024) · Kinésithérapie la Revue · doi:10.1016/j.kine.2024.03.010 · Cited by 5
Taking machine learning research online with OpenML
Vanschoren, J., van Rijn, J. N., & Bischl, B. (2015) · TU/e Research Portal · Cited by 8
Iris, F., Béopoulos, A., & Géa, M. (2018) · Current Opinion in Pharmacology · doi:10.1016/j.coph.2018.07.005 · Cited by 5
As diversas faces da dúvida – ceticismo, negacionismo e confiança nas ciências
Corrêa, M. F., & David, M. (2020) · Em Construção · doi:10.12957/emconstrucao.2020.54268 · Cited by 5
Le mésusage des citations et ses conséquences en médecine
Dumas-Mallet, E., Boraud, T., & Gonon, F. (2021) · médecine/sciences · doi:10.1051/medsci/2021142 · Cited by 9
The Unholy Grail of cancer screening: or is it just about the Benjamins?
Chatanaka, M. K., Yousef, G. M., & Diamandis, E. P. (2024) · Clinical Chemistry and Laboratory Medicine (CCLM) · doi:10.1515/cclm-2024-1013 · Cited by 5
“We and others explained some possible reasons of biomarker failures in the clinic and proposed measures on how we could partially overcome these di ffi culties [7 – 10, 12, 13].”
Good science depends on good peer review
Hochberg, M. (2014) · Ideas in Ecology and Evolution · doi:10.4033/iee.2014.7.16.f · Cited by 5
“…that science itself is subject to evolution (Hull 2001), and that peer review is one of the key processes maintaining and advancing scientific quality (Riisgård et al. 2001, Ware 2008, Ioannidis 2014); otherwise put, peer review extends well beyond the improvements made to individual manuscripts.”
BackgroundSystemic review and meta-analysis of diagnostic imaging technologies
Wáng, Y. X. J. (2016) · Quantitative Imaging in Medicine and Surgery · doi:10.21037/qims.2016.10.08 · Cited by 6
Surgical regenerative treatment of peri-implantitis
Howe, M.-S., & Richards, D. (2017) · Evidence-Based Dentistry · doi:10.1038/sj.ebd.6401256 · Cited by 5
Computational Reproducibility: The Elephant in the Room
Hatton, L., & van Genuchten, M. (2019) · IEEE Software · doi:10.1109/ms.2018.2883805 · Cited by 5
“An estimated cost of irreproducible biomedical research is $28 billion/year (Freedman, Cockburn and Simcoe, 2015) and “ Currently, many published research findings are false or exaggerated, and an estimated 85% of research resources are wasted ” (Ioannidis 2014).”
BackgroundSeehra, J., Liu, C., & Pandis, N. (2021) · Journal of Dentistry · doi:10.1016/j.jdent.2021.103658 · Cited by 5
Why multiple hypothesis test corrections provide poor control of false positives in the real world.
Lazic, S. E. (2024) · Psychological Methods · doi:10.1037/met0000678 · Cited by 5
Citation Misuses in the Biomedical Literature and Its Effects on Public Health
Dumas-Mallet, E., & Gonon, F. (2022) · Springer eBooks · doi:10.1007/978-3-030-99680-2_42 · Cited by 6
Post-LLM Academic Writing Considerations
Potter, L. N., & Palmer, X. (2023) · Lecture notes in networks and systems · doi:10.1007/978-3-031-47448-4_12 · Cited by 6
Foster, K. R., & Skufca, J. D. (2016) · IEEE Pulse · doi:10.1109/mpul.2015.2513726 · Cited by 7
“In 2014, Ioannidis published a follow-up paper, “How to Make More Published Research True,” with a list of suggestions that are largely aimed at researchers [9].”
BackgroundP-hacking in academic research
Ingre, M. (2016) · DiVA (Stockholm University) · doi:10.6084/m9.figshare.3393664 · Cited by 7
Is the HPCSA requirement for a research dissertation for specialist registration the best option?
Biccard, B. M., Dyer, R. A., Swanevelder, J. L., Coetzee, J. X., & Shafer, S. L. (2017) · Southern African Journal of Anaesthesia and Analgesia · doi:10.4102/sajaa.v23i4.1364 · Cited by 11
“John Ioannidis 2016 In November 2010 the Subcommittee for Postgraduate Education and Training (Medical) under the auspices of the Health Professions Council of South Africa (HPCSA) decreed that for registrars who commenced training on or after 1 January 2011, “Completion of a research component” is…”
BackgroundMurray, J. E., Barrett, S. T., Brock, R. L., & Bevins, R. A. (2017) · ACS Chemical Neuroscience · doi:10.1021/acschemneuro.7b00341 · Cited by 5
Correspondence Between Results and Aims of Funding Support in EPIDEMIOLOGY Articles
Lash, T. L., Kaufman, J. S., & Hernán, M. Á. (2017) · Epidemiology · doi:10.1097/ede.0000000000000767 · Cited by 6
Smaldino, P. E., Turner, M. A., & Kallens, P. C. (2019) · Royal Society Open Science · doi:10.1098/rsos.191249 · Cited by 6
Neuroadaptive electroencephalography: a proof-of-principle study in infantsPreprint
da Costa, P. F., Haartsen, R., Throm, E., Mason, L., Gui, A., Leech, R., & Jones, E. J. H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.06029 · Cited by 6
“Second, stimulus selection is often guided by theory or previous empirical study; but the replication crisis (Ioannidis 2014, Collaboration 2015) and the overwhelming focus on a narrow subset of the world’s population in the neuroimaging literature (Westfall et al. 2017) means that trying to select…”
BackgroundThe importance of rigor in pharmacy research: Challenges and solutions
Gionfriddo, M. R., McClendon, C., Nolfi, D., Kalarchian, M. A., & Covvey, J. R. (2025) · Research in Social and Administrative Pharmacy · doi:10.1016/j.sapharm.2025.02.005 · Cited by 4
DeScAI: the convergence of decentralized science and artificial intelligence
Shilina, S. (2025) · Frontiers in Blockchain · doi:10.3389/fbloc.2025.1657050 · Cited by 5
“…incentives, opaque peer review, and inequitable access to resources reveal that legacy models of knowledge production are increasingly un fi t for present needs (Baker, 2016; Begley and Ellis, 2012; Fang and Casadevall, 2016; Ioannidis, 2014; Kitcher, 1993; Prinz et al., 2011; Powell, 2016).”
Experimentación animal en Ecuador: cuando la ética precede a la ley. Nota técnica
Nirchio, M. (2025) · Revista Científica de la Facultad de Ciencias Veterinarias · doi:10.52973/rcfcv-e35682 · Cited by 6
Acute myocardial infarction treatment delay in South Asia: a systematic review and meta-analysis
Ramamurthy, D., Panda, M., Rangappa, M., Kannan, S., Kundapur, R., Rajeshwari, S., Subbiah, P., Aggarwal, P., & Aggarwal, S. S. (2025) · Future Cardiology · doi:10.1080/14796678.2025.2541525 · Cited by 4
Villeval, M., Carayol, M., Lamy, S., Lepage, B., & Lang, T. (2016) · Revue d Épidémiologie et de Santé Publique · doi:10.1016/j.respe.2016.06.331 · Cited by 4
O’Connor, M., Faucheux, S., Combe, C. G., & Petousi, V. G. (2018) · Revue française d administration publique · doi:10.3917/rfap.166.0333 · Cited by 4
Flipping the grant application review process
Dinov, I. D. (2019) · Studies in Higher Education · doi:10.1080/03075079.2019.1628201 · Cited by 4
“…Michigan Institute for Data Science, University of Michigan, 426 N. Ingalls Str., Ann Arbor, MI 48109, USA; http://www.SOCR.umich.edu quantifying research impact and scholarly wealth, which may need to be used in modifications of the research-funding incentive-and-reward system (Ioannidis 2014).”
BackgroundBest practices in bibliographic data science
Lahti, L., Vaara, V., Marjanen, J., & Tolonen, M. (2019) · Työväentutkimus Vuosikirja · Cited by 4
Hansford, H. J., Cashin, A. G., Wewege, M. A., Ferraro, M. C., McAuley, J. H., & Jones, M. D. (2021) · Journal of science and medicine in sport · doi:10.1016/j.jsams.2021.08.004 · Cited by 4
Xu, Y., & Mansmann, U. (2022) · Human Genetics · doi:10.1007/s00439-022-02455-8 · Cited by 5
“However, this study reaffirms the scientific value of sound reproducibility practices; even a single reproducibility study can add to the credibility of published results (Ioannidis 2014; Seibold et al.”
ResultRamdjee, B., Husson, M., Hajage, D., Tubach, F., Estellat, C., & Dechartres, A. (2023) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2023.03.015 · Cited by 4
Metadata
- Authors
- Ioannidis, J. P. A.
- Affiliations
- Stanford Medicine (US)
- Corresponding author
- Ioannidis, John P. A.
- Venue
- PLoS Medicine
- Publisher
- Public Library of Science (PLoS)
- Published
- 2014-10-21
- Volume
- 11
- Issue
- 10
- Pages
- e1001747
- ISSN
- 1549-1277 (ISSN-L)
- 1549-1676
- PMC
- PMC4204808
- OpenAlex
- W2077181076
- Cited by
- 760
- References
- 75
- Citations by year
- 2026: 26 · 2025: 31 · 2024: 37 · 2023: 50 · 2022: 51 · 2021: 44 · 2020: 51 · 2019: 68 · 2018: 93 · 2017: 108 · 2016: 111 · 2015: 80 · 2014: 10
- FWCI
- 192.35
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS Medicine (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Laura and John Arnold Foundation
- Topics
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Social Sciences › Education › Academic integrity and plagiarism
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- research integrity, reproducibility, research credibility, research registration, statistical thresholds, peer review, research reporting, research incentives, publication incentives, research waste
- MeSH terms
- Publications, Publishing, Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.