How to Make More Published Research True
Open accessThe DOI matches its Crossref record; 75 of the 75 references it cites were found in a registry or an index.
Abstract
Currently, many published research findings are false or exaggerated, and an estimated 85% of research resources are wasted.N To make more published research true, practices that have improved credibility and efficiency in specific fields may be transplanted to others which would benefit from them-possibilities include the adoption of large-scale collaborative research; replication culture; registration; sharing; reproducibility practices; better statistical methods; standardization of definitions and analyses; more appropriate (usually more stringent) statistical thresholds; and improvement in study design standards, peer review, reporting and dissemination of research, and training of the scientific workforce. N Selection of interventions to improve research practices requires rigorous examination and experimental testing whenever feasible.N Optimal interventions need to understand and harness the motives of various stakeholders who operate in scientific research and who differ on the extent to which they are interested in promoting publishable, fundable, translatable, or profitable results.N Modifications need to be made in the reward system for science, affecting the exchange rates for currencies (e.g., publications and grants) and purchased academic goods (e.g., promotion and other academic or administrative power) and introducing currencies that are better aligned with translatable and reproducible research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Accordingly, there is growing recognition that data availability is a critical feature of an efficient, progressive, and ultimately self-correcting scientific ecosystem that generates credible findings [1–3].”
From Data availability, reusability, and analytic reproducibility: evaluating the impact of a mandatory open data policy at the journal Cognition (2018) · cites this paper as [1]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Some journals have heeded the growing calls for adoption of transparent and reproducible research practices and introduced new policies to implement change [1,2].”
From Data availability, reusability, and analytic reproducibility: evaluating the impact of a mandatory open data policy at the journal Cognition (2018) · cites this paper as [1]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, protocol registration is applicable to and recommended for all studies and is supported by various platforms, such as the Open Science Framework [3, 29, 35–37].”
From Assessing transparency practices in dental randomized controlled trials (2024) · cites this paper as [3]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Well-planned, well-executed, and well-reported RCTs, which embrace transparent and open science practices, enhance the likelihood that results are accurate, reliable, and applicable [2, 3].”
From Assessing transparency practices in dental randomized controlled trials (2024) · cites this paper as [3]
Experimental — accuracy not yet measuredIn the citing paper
“Consider that the stakeholders who fund and support science may have incentives that are not always aligned with those of active researchers [82].”
From The natural selection of bad science (2016) · cites this paper as [82]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Self-citationConfirmation Bias: A Ubiquitous Phenomenon in Many Guises
Nickerson, R. S. (1998) · Review of General Psychology · doi:10.1037/1089-2680.2.2.175 · Cited by 7,267 · cited 2×
“powerful in scientific processes [8,9].”
BackgroundSimmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 2×
“Many new proposed associations and/or effects are false or grossly exaggerated [2,3], and translation of knowledge into useful applications is often slow and potentially inefficient [4].”
BackgroundSelf-citationClinical Practice Guidelines We Can Trust
Committee on Standards for Developing Trustworthy Clinical Practice Guidelines, Board on Health Care Services, & Institute of Medicine (2011) · National Academies Press eBooks · doi:10.17226/13058 · Cited by 3,081
Raise standards for preclinical cancer research
Begley, C. G., & Ellis, L. M. (2012) · Nature · doi:10.1038/483531a · Cited by 2,979 · cited 1×
“Pharmaceutical industry teams have championed reproducibility in preclinical research [56,57] because they depend on pre-clinical academic investigations accurately pinpointing useful drug targets.”
BackgroundBelieve it or not: how much can we rely on published data on potential drug targets?
Prinz, F., Schlange, T., & Asadullah, K. (2011) · Nature Reviews Drug Discovery · doi:10.1038/nrd3439-c1 · Cited by 1,888 · cited 1×
“Pharmaceutical industry teams have championed reproducibility in preclinical research [56,57] because they depend on pre-clinical academic investigations accurately pinpointing useful drug targets.”
BackgroundEvidence based medicine: a movement in crisis?
Greenhalgh, T., Howick, J., Maskrey, N., & for the Evidence Based Medicine Renaissance Group (2014) · BMJ · doi:10.1136/bmj.g3725 · Cited by 1,766
Scientific method: Statistical errors
Nuzzo, R. (2014) · Nature · doi:10.1038/506150a · Cited by 1,536
Why Most Discovered True Associations Are Inflated
Ioannidis, J. P. A. (2008) · Epidemiology · doi:10.1097/ede.0b013e31818131e7 · Cited by 1,495 · cited 1×
“Many new proposed associations and/or effects are false or grossly exaggerated [2,3], and translation of knowledge into useful applications is often slow and potentially inefficient [4].”
BackgroundSelf-citation
Research works printed but not linked: 1
- R Al-Shahi Salman, 2014, Increasing value and reducing waste in biomedical research regulation and management, Lancet, 383, 176, 10.1016/s0140-6736(13)62297-7 · DOI · Paper page
Cited by
Items 501–600 of 802
Research Integrity: Teil 2: Open Science
Kopkow, C., & Braun, T. (2023) · physioscience · doi:10.1055/a-2025-5225 · Cited by 4
Brock, G. (2023) · doi:10.1093/oso/9780198875642.001.0001 · Cited by 29
Reflections on the Unintended Consequences of the Science Reform Movement
Field, S. M., van Dongen, N. N. N., & Tiokhin, L. (2024) · Journal of Trial and Error · doi:10.36850/ed4 · Cited by 3
How to avoid haste and waste in occupational, environmental and public health research
Erren, T. C., Shaw, D., & Groß, J. V. (2015) · Journal of Epidemiology & Community Health · doi:10.1136/jech-2015-205543 · Cited by 4
Davies, P., Davies, N. M., & Qiu, T. (2017) · British Educational Research Journal · doi:10.1002/berj.3289 · Cited by 7
Bioinformatics and Precision Medicine
Manrai, A. K., & Kohane, I. S. (2017) · Elsevier eBooks · doi:10.1016/b978-0-12-809523-2.00011-x · Cited by 4
Challier, V., Henry, J. K., Liu, S., Ames, C. P., Kebaish, K. M., Obeid, I., Hostin, R. A., Gupta, M. C., Boachie-Adjei, O., Smith, J. S., et al. (2017) · Neurosurgery · doi:10.1093/neuros/nyx580 · Cited by 4
Hänscheid, T., Hardisty, D. W., & Henriques, S. O. (2018) · Acta Médica Portuguesa · doi:10.20344/amp.10762 · Cited by 4
Case Studies: Challenge Studies in Low- and Middle-Income Countries
Jamrozik, E., & Selgelid, M. J. (2020) · SpringerBriefs in ethics · doi:10.1007/978-3-030-41480-1_5 · Cited by 4
“…the chance that participants will be exposed to challenge infections unnecessarily) and (iv) increase standardisation and/or comparability across similar research programs (if research groups are able to co-ordinate) which may serve to increase the accuracy and impact of results (Ioannidis 2015).”
BackgroundInfluentialSanctions for research misconduct in cardiothoracic surgery journals
Sade, R. M., Canver, C. C., D’Amico, T. A., Ellis, J., Fenton, K. N., Freeman, R., Fullerton, D. A., Harrison, L. W., Jaggers, J. J., Jones, J., et al. (2016) · Journal of Thoracic and Cardiovascular Surgery · doi:10.1016/j.jtcvs.2016.06.044 · Cited by 4
Linked Data in Neuroscience: Applications, Benefits, and ChallengesPreprint
Nichols, B. N., Ghosh, S., Auer, T., Grabowski, T. J., Maumet, C., Keator, D. B., Martone, M. E., Pohl, K. M., & Poline, J. (2016) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/053934 · Cited by 4
Hardwicke, T. (2016) · Thesis Commons (OSF Preprints) · doi:10.31237/osf.io/r4c32 · Cited by 4
“Large-scale collaboration also fosters other open practices (open data, open analysis code, open materials, pre-registration) which naturally support e cient collaboration (Ioannidis, 2014; Simons et al., 2014).”
BackgroundInfluentialPinto, J. V., Moulin, T. C., & Amaral, O. B. (2016) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/086124 · Cited by 6
Vossen, A. Y. (2017) · Enlighten: Theses (The University of Glasgow) · Cited by 5
Discussion Paper: Should statistics rescue mathematical modelling?Preprint
Saltelli, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.06457 · Cited by 10
“In statistics abuse or misuse of the p-test [13]–[15], [22], [49] has been singled out by many observers as one of the causes of the reproducibility crisis currently affecting science [2], [3], [7], [9], [50].”
BackgroundLowering the P Value Threshold—Reply
Ioannidis, J. P. A. (2018) · JAMA · doi:10.1001/jama.2018.8743 · Cited by 4
Self-citationBrownstein, N. C. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.04721 · Cited by 6
“Clearly, changes to scientific and statistical standards will require coordination and buyin from multiple groups concurrently, ensure that changes improve scientific practice as a whole (Ioannidis 2014, Sørensen & Rothman 2010).”
BackgroundAllen, C. J., & Park, K. (2019) · Journal of Controlled Release · doi:10.1016/j.jconrel.2019.04.024 · Cited by 4
Research Portfolios in Science Policy: Moving from Financial Returns to Societal BenefitsPreprint
Wallace, M. L., & Ràfols, I. (2014) · SSRN Electronic Journal · doi:10.2139/ssrn.2500396 · Cited by 5
A Measure of Research TastePreprint
Koltun, V., & Hafner, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.08089 · Cited by 4
“Nevertheless, there are concerns that science is not self-correcting and the present reward system is suboptimal (Ioannidis, 2012; 2014; Sarewitz, 2016b; Smaldino & McElreath, 2016; Edwards & Roy, 2017; Lindner et al., 2018).”
BackgroundHodges, C. B., Lindsey, H. M., Stone, B. M., Johnson, P. K., & Carter, J. H. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/zem2w · Cited by 4
How to: improve peer review skills for CMI
Scudeller, L., & Friedman, J. (2021) · Clinical Microbiology and Infection · doi:10.1016/j.cmi.2021.06.028 · Cited by 4
Replication research in education: is the tide turning?
Banerjee, R. (2022) · Educational Research and Evaluation · doi:10.1080/13803611.2021.2022311 · Cited by 4
Looking for better science communication? Do it like the Harvard Business Review
Nassis, G. P., Verhagen, E. A. L. M., Busch, H., & Krustrup, P. (2023) · BMJ Open Sport & Exercise Medicine · doi:10.1136/bmjsem-2023-001611 · Cited by 4
Lefebvre, S., & Beaucousin, V. (2025) · Cognition & Emotion · doi:10.1080/02699931.2025.2487521 · Cited by 4
“These results should be replicated in future studies to strengthen their validity (Ioannidis, 2014).”
Medizinische Forschung – Qualität vor Quantität
Hostettler, S., Kraft, E., & Bosshard, C. (2015) · Bulletin des Médecins Suisses · doi:10.4414/saez.2015.04171 · Cited by 3
Tebes, J. K. (2016) · American Journal of Community Psychology · doi:10.1002/ajcp.12041 · Cited by 3
The role of theory in mitigating the ‘reproducibility crisis’
Marone, L. (2024) · Ecología Austral · doi:10.25260/ea.24.34.1.0.2291 · Cited by 4
“Then, the attention paid to data curation and sound analyses to increase data validation is widely justified (Ioannidis 2014).”
BackgroundRibeiro, M. D., & Vasconcelos, S. M. R. (2024) · Anais da Academia Brasileira de Ciências · doi:10.1590/0001-3765202420240038 · Cited by 3
Toward a roadmap for addressing today's health dilemma–The 101-statement consensus report
Wirnitzer, K., Motevalli, M. S., Tanous, D., Drenowatz, C. J., Moser, M., Cramer, H., Rosemann, T. J., Wagner, K., Michalsen, A., Knechtle, B., et al. (2025) · Frontiers in Nutrition · doi:10.3389/fnut.2025.1676080 · Cited by 4
“…collaborative research, standardization of definitions and analyses, pilot examination of interventions, and improvement in study design standards, peer review, reporting, and dissemination of research have been identified as crucial actions to enhance the validity of scientific works (302).”
Obrist, R. (2015) · Swiss Medical Weekly · doi:10.4414/smw.2015.14120 · Cited by 3
Beyond failure: the 2 nd LAK Failathon
Clow, D., Ferguson, R., Kitto, K., Cho, Y.-S., Sharkey, M., & Aguerrebere, C. (2017) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/3027385.3029429 · Cited by 4
Probandari, A. N., Mahendradhata, Y., Widjanarko, B., Alisjahbana, B., & On behalf of Tuberculosis Operational Research Group (TORG) (2017) · Global Health Action · doi:10.1080/16549716.2017.1381442 · Cited by 3
Metaepidemiologie und Qualitätssicherung klinischer Evidenzproduktion
Haring, R. (2017) · Springer eBooks · doi:10.1007/978-3-662-55377-0_4 · Cited by 3
The Pros of Publishing Standalone Clinical Trial Protocols in Anesthesiology Journals
Whittington, R. A. (2018) · Anesthesia & Analgesia · doi:10.1213/ane.0000000000002827 · Cited by 3
Faggion, C. M. (2021) · Journal of Evidence Based Dental Practice · doi:10.1016/j.jebdp.2021.101654 · Cited by 3
Outcomes in pediatric anesthesia: towards a universal language
Marchesini, V., & Disma, N. M. (2022) · Current Opinion in Anaesthesiology · doi:10.1097/aco.0000000000001232 · Cited by 3
Verykouki, E., & Nakas, C. T. (2023) · Stats · doi:10.3390/stats6020035 · Cited by 4
Trinkley, K. E., McNeal, D. M., Fort, M. P., Green, L. W., & Huebschmann, A. G. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197660690.003.0016 · Cited by 4
D’Angelo, L. (2024) · Cuadernos del CIMBAGE · doi:10.56503/cimbage/vol.1/nro.26(2024)/3022 · Cited by 3
Robledo, K. P., Rieger, I., Finlayson, S., Tarnow‐Mordi, W., & Martin, A. J. (2025) · Archives of Disease in Childhood Fetal & Neonatal · doi:10.1136/archdischild-2024-327762 · Cited by 3
Training the Mind, and the Food and Drug Administration, on Droperidol
Newman, D. H. (2015) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2015.05.030 · Cited by 3
The Central Importance of Laboratories for Reducing Waste in Biomedical Research
Stroth, N. (2015) · Science and Engineering Ethics · doi:10.1007/s11948-015-9738-x · Cited by 5
“Recent essays have expanded this topic by identifying the stakeholders involved (as well as their specific motivations and expectations) and providing thoughtful, tangible suggestions for improvement (Ioannidis 2014; Macleod et al. 2014).”
BackgroundInfluentialBhopal, R. S. (2017) · Annals of Epidemiology · doi:10.1016/j.annepidem.2017.01.001 · Cited by 3
Muir, W. W. (2017) · Equine Veterinary Journal · doi:10.1111/evj.12660 · Cited by 3
The probability of probability and research truths
Fatovich, D. M., & Phillips, M. R. (2017) · Emergency Medicine Australasia · doi:10.1111/1742-6723.12740 · Cited by 4
Stüber, J. C., & Plückthun, A. (2019) · PLoS ONE · doi:10.1371/journal.pone.0226579 · Cited by 3
The imperative to find the courage to redesign the biomedical research enterprise
Bielekova, B., & Brownlee, S. (2021) · F1000Research · doi:10.12688/f1000research.53654.1 · Cited by 3
“It would be based on established attributes of reproducible research, such as blinding, power calculation, randomization, use of controls, validation of results in an independent cohort, availability of raw data and analysis codes.(4,21,22) Though the quickest way forward is to assign an MR score to a paper based on a…”
MethodLes manques à l’intégrité scientifique et médicale
Sculier, J. (2015) · Cahiers de psychologie clinique · doi:10.3917/cpc.044.0013 · Cited by 4
Above a Swamp: A Theory of High-Quality Scientific Production
Kiri, B., Lacetera, N., & Zirulia, L. (2015) · National Bureau of Economic Research · doi:10.3386/w21143 · Cited by 6
Commentary: Legacy of the Commission on Research Integrity
Redman, B. K. (2016) · Science and Engineering Ethics · doi:10.1007/s11948-016-9753-6 · Cited by 3
“It is also important to note that in cases where whistleblowers have become known (Klintworth 2014), they are not infrequently students, postdoctoral fellows, or research technicians, who have the opportunity to closely observe what goes on in the lab.”
BackgroundTowards a Culture of Open Science and Data Sharing in Health and Medical Research
Rowhani-Farid, A. (2018) · Queensland University of Technology · doi:10.5204/thesis.eprints.119697 · Cited by 7
Opinions on the value of direct replication: A survey of 2,000 psychologistsPreprint
Buttliere, B., & Wicherts, J. M. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/z9kx6 · Cited by 3
Biomedical Research in the 21st Century: Multiple Challenges in Resolving Reproducibility Issues
Mullane, K., Curtis, M. J., & Williams, M. J. (2017) · Elsevier eBooks · doi:10.1016/b978-0-12-804725-5.00006-9 · Cited by 4
Mehta, N., Gupta, A. K., Das, D., Shrivastava, R., & Goyal, A. (2025) · Indian Journal of Dental Research · doi:10.4103/ijdr.ijdr_110_24 · Cited by 2
On the Computational Reproducibility of Human-Computer Interaction
Iarygina, O., Hornbæk, K. A. S., & Mottelson, A. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791129 · Cited by 3
de Ruijter, T. C., Smits, K. M., Aarts, M. J. B., van Hellemond, I. E. G., Neste, L. V., de Vries, B., Peer, P. G. M., Veeck, J., van Engeland, M., & Tjan‐Heijnen, V. C. G. (2019) · Diagnostic and Prognostic Research · doi:10.1186/s41512-019-0065-6 · Cited by 2
Flaws (and quality) in research today: can artificial intelligence intervene?
Siristatidis, C. S., & Pouliakis, A. (2020) · Systems Biology in Reproductive Medicine · doi:10.1080/19396368.2020.1749727 · Cited by 2
Reproducibility literature analysis - a federal information professional perspective
Antognoli, E., Avila, R. L., Sears, J., Christiansen, L. L., Tieman, J., & Hart, J. (2020) · IASSIST Quarterly · doi:10.29173/iq967 · Cited by 2
Making Space for Qualitative Evidence in Global Maternal and Child Health Policymaking
Colvin, C. J. (2022) · Global maternal and child health · doi:10.1007/978-3-030-84514-8_9 · Cited by 3
“Though the language and logic of EBM and the RCT are ubiquitous in biomedicine and health policy, there is growing recognition of the limits of standard EBM approaches (Ioannidis, 2014; Hutchison & Rogers, 2012) as well as the potential contribution of qualitative evidence (Gilson et al., 2011).”
BackgroundIslamic Ethics in Engagement with Life, Health, and Medicine
Setia, A. (2022) · Philosophy and medicine · doi:10.1007/978-3-030-53801-9_5 · Cited by 2
Indrayan, A., Vishwakarma, G., Malhotra, R., Gupta, P., Sachdev, H., Karande, S., Asthana, S., & Labani, S. (2022) · Journal of Postgraduate Medicine · doi:10.4103/jpgm.jpgm_460_22 · Cited by 1
“The quality of medical research has been in discussion for quite some time [1-4] but the concern has steeply increased in the past decade as the number of papers and journals has exponentially increased.”
Abusive Tax Avoidance and Tax Professionals’ Responsibilities
Brock, G. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780198875642.003.0006 · Cited by 2
Importance and use of guidelines to report main types of studies in medical research
López-Ortiz, G., Dávila-Mendoza, R., & Dávila-Mendoza, R. (2024) · Cirugía y Cirujanos (English Edition) · doi:10.24875/cirue.m22000518 · Cited by 2
Buja, L. M., & Fogg, S. E. (2025) · Minerva Medica · doi:10.23736/s0026-4806.25.09660-0 · Cited by 2
Lee, K. C. M., Peterson, W., Lisi, F., Ding, T., Nojima, K., Kanno, H., Zhou, Y., Matsumura, H., Kitahama, Y., Li, M., et al. (2025) · Electromagnetic waves · doi:10.2528/pier25100702 · Cited by 2
Replicated results are more trustworthy
Shepperd, M. (2016) · Elsevier eBooks · doi:10.1016/b978-0-12-804206-9.00052-0 · Cited by 3
Stewardship of Integrity in Scientific Communication
Albertine, K. H. (2018) · The Anatomical Record · doi:10.1002/ar.23858 · Cited by 2
“Readers are referred to an interesting consideration of this voluntary service (Ioannidis, 2014).”
BackgroundLike a bridge over troubled waters
Borofsky, R. (2015) · Journal of the Royal Anthropological Institute · doi:10.1111/1467-9655.12214 · Cited by 2
Gaynon, P. S. (2015) · Blood · doi:10.1182/blood-2015-08-665067 · Cited by 2
Nicolaisen, O. (2017) · Reviews in Aquaculture · doi:10.1111/raq.12204 · Cited by 2
Ge, X., Yang, Y.-Z., Li, S.-S., Hou, L., Ren, J., Yang, K., & Fa, X. (2017) · Journal of Huazhong University of Science and Technology [Medical Sciences] · doi:10.1007/s11596-017-1758-0 · Cited by 3
Haring, R., & Bell, R. J. (2018) · Climacteric · doi:10.1080/13697137.2018.1476968 · Cited by 3
Crisis en la calidad de la ciencia médica: el papel del arbitraje en el nuevo desorden editorial
Ayçaguer, L. C. S. (2018) · IRIS - Revista de Informação Memória e Tecnologia · doi:10.51359/2318-4183.2018.238908 · Cited by 5
Improving the Reliability and Generalizability of Scientific Research
Tiokhin, L. (2018) · Cited by 2
Fare Open Access: La libera diffusione del sapere scientifico nell’era digitale
Aliprandi, S. (2017) · Ledizioni eBooks · doi:10.4000/books.ledizioni.5161 · Cited by 10
Evaluation of Non-pharmacological Interventions
Ninot, G. (2020) · Springer eBooks · doi:10.1007/978-3-030-60971-9_8 · Cited by 2
Novel biomedical research must not be a work of fiction
Lazar, M. A. (2021) · Journal of Clinical Investigation · doi:10.1172/jci150827 · Cited by 2
Ninot, G., Amadori, F., Maitre, J., Rapior, S., Rivière, L., Trouillet, R., & Carbonnel, F. (2018) · HEGEL - HEpato-GastroEntérologie Libérale · doi:10.3917/heg.081.0013 · Cited by 2
(Epi)genetic profiling of cutaneous melanoma: diagnostic, prognostic, and biological relevance
van den Hurk, K. (2015) · Research Publications (Maastricht University) · doi:10.26481/dis.20150702kh · Cited by 2
Research integrity: we are all accountable
Otto, C. M., Bradley, S. M., & Newby, D. E. (2015) · Heart · doi:10.1136/heartjnl-2015-307458 · Cited by 2
Institutional research and biomedical journals: Poor quality articles and honest researchers!
Maisonneuve, H., & Slim, K. (2015) · Journal of Visceral Surgery · doi:10.1016/j.jviscsurg.2015.09.004 · Cited by 2
Supporting More Reliable Results
Webb, S. (2015) · BioTechniques · doi:10.2144/000114314 · Cited by 3
The Solution to Science's Replication CrisisPreprint
Knuteson, B. (2016) · SSRN Electronic Journal · doi:10.2139/ssrn.2835131 · Cited by 2
Disclosing negative trial results – procedure
Scavone, C., Rafaniello, C., Sportiello, L., Berrino, L., & Capuano, A. (2016) · Expert Review of Clinical Pharmacology · doi:10.1080/17512433.2016.1251838 · Cited by 2
Gang Warfare: What are the criteria for deriving assertions from facts in science?
Weiss, K. M. (2016) · Evolutionary Anthropology Issues News and Reviews · doi:10.1002/evan.21509 · Cited by 2
Stein, D. G., & Sayeed, I. (2018) · Neuropharmacology · doi:10.1016/j.neuropharm.2018.10.007 · Cited by 2
Smith, S. M., Fava, M., Jensen, M. P., Mbowe, O. B., McDermott, M., Turk, D. C., & Dworkin, R. H. (2019) · Journal of Pain · doi:10.1016/j.jpain.2019.09.008 · Cited by 2
RetractedCommentary on Vassar et al. (2020): Cautionary observations on the pre‐registration revolution
Gorman, D. M. (2020) · Addiction · doi:10.1111/add.14945 · Cited by 2
Realistic and Robust Reproducible Research for BiostatisticsPreprint
Hejblum, B. P., Kunzmann, K., Lavagnini, E., Hutchinson, A., Robertson, D. S., Jones, S., & Eckes-Shephard, A. H. (2020) · Preprints.org · doi:10.20944/preprints202006.0002.v1 · Cited by 4
Is adherence to the scientific method dying?
Magee, G. A., & Weaver, F. A. (2022) · Journal of Vascular Surgery · doi:10.1016/j.jvs.2022.08.031 · Cited by 2
Hybrid Cloud Architectures for Research Computing: Applications and Use CasesPreprint
Stiensmeier, X., Kanitz, A., Krüger, J., Insua, S., Rošinec, A., Spišaková, V., Hejtmánek, L., Yuan, D. Y., Farrell, G., Tedds, J. A., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2601.04349 · Cited by 2
“Consequently, an alarmingly high portion of results cannot be reproduced, verified, or confirmed in any way [27], [28].”
Kimbrough, C. W., & Pawlik, T. M. (2019) · Springer eBooks · doi:10.1007/978-3-030-05964-4_7 · Cited by 2
Data Mining and Other Informatics Approaches to Pharmacoepidemiology
Bate, A., Trifirò, G., Avillach, P., & Evans, S. J. W. (2019) · Pharmacoepidemiology · doi:10.1002/9781119413431.ch27 · Cited by 1
Publicación en la Revista Española de Anestesiología y Reanimación de protocolos de estudios
Errando, C. L., & Ferrando, C. (2020) · Revista Española de Anestesiología y Reanimación · doi:10.1016/j.redar.2020.04.004 · Cited by 2
The enhanced research impact of self‐archiving platforms: Evidence from bioRxiv
Liu, H., Hu, G., & Li, Y. (2024) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.24932 · Cited by 1
“Our research contributes to the ongoing debate in the science of science regarding whether quality or dissemination is the most important determinant of research impact (Bracken & Thomas, 2002; Ioannidis, 2014).”
Optimising registrar research supervision: Quality, conflict management and best practices
Obasa, A. E., Motsohi, T., Burger, M. C., Lübbe, J., van Wyk, L., & du Toit, J. (2025) · Journal of the Colleges of Medicine of South Africa · doi:10.4102/jcmsa.v3i1.167 · Cited by 1
The Evolution of Data Sharing Practices in the Psychological Literature
Neve, J., & Rousselet, G. A. (2025) · Meta-Psychology · doi:10.15626/mp.2021.2908 · Cited by 1
Toward Big Data–Derived Classification of Neuropsychiatric Disorders
Kochunov, P., Thompson, P. M., & Hong, L. E. (2025) · Biological Psychiatry Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2025.05.006 · Cited by 1
Metadata
- Authors
- Ioannidis, J. P. A.
- Affiliations
- Stanford Medicine (US)
- Corresponding author
- Ioannidis, John P. A.
- Venue
- PLoS Medicine
- Publisher
- Public Library of Science (PLoS)
- Published
- 2014-10-21
- Volume
- 11
- Issue
- 10
- Pages
- e1001747
- ISSN
- 1549-1277 (ISSN-L)
- 1549-1676
- PMC
- PMC4204808
- OpenAlex
- W2077181076
- Cited by
- 760
- References
- 75
- Citations by year
- 2026: 26 · 2025: 31 · 2024: 37 · 2023: 50 · 2022: 51 · 2021: 44 · 2020: 51 · 2019: 68 · 2018: 93 · 2017: 108 · 2016: 111 · 2015: 80 · 2014: 10
- FWCI
- 192.35
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS Medicine (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Laura and John Arnold Foundation
- Topics
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Social Sciences › Education › Academic integrity and plagiarism
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- research integrity, reproducibility, research credibility, research registration, statistical thresholds, peer review, research reporting, research incentives, publication incentives, research waste
- MeSH terms
- Publications, Publishing, Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.