Why Most Clinical Research Is Not Useful
Open accessThe DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
Abstract
John Ioannidis argues that problem base, context placement, information gain, pragmatism, patient centeredness, value for money, feasibility, and transparency define useful clinical research. He suggests most clinical research is not useful and reform is overdue.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Neglecting the actual development phase can be problematic, as a poor problem definition, insufficient attention to existing evidence and context needs, a missing model underlying the intervention, and an unsound selection of hypothesized change mechanisms can lead to inefficient treatments (30–32).”
From Developing a mechanism-based therapy for acute psychiatric inpatients with psychotic symptoms: an Intervention Mapping approach (2023) · cites this paper as [30]
Experimental — accuracy not yet measuredIn the citing paper
“Systematic review guidelines typically advocate that all relevant studies must be included for the conclusions of that review to be valid 22”
From Software support for environmental evidence synthesis (2018) · cites this paper as [22]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Self-citationWhy Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 1×
“I have previously written about why most published research is false [2] and how to make more of it true Summary Points”
BackgroundSelf-citationTunis (2003) · doi:10.1001/jama.290.12.1624 · Cited by 1,724 · cited 1×
“Pragmatism has long been advocated in clinical research [15], but it is rare.”
BackgroundSurrogate End Points in Clinical Trials: Are We Being Misled?
Fleming, T. R., & DeMets, D. L. (1996) · Annals of Internal Medicine · doi:10.7326/0003-4819-125-7-199610010-00011 · Cited by 1,651 · cited 1×
“Nonvalidated surrogate outcomes lacking clinical insight [13] and composite outcomes that combine outcomes of very different clinical portent [14] are often utilized so that authors can claim that clinical studies are well powered.”
BackgroundIncreasing value and reducing waste in research design, conduct, and analysis
Ioannidis, J. P. A., Greenland, S., Hlatky, M. A., Khoury, M. J., Macleod, M. R., Moher, D., Schulz, K. F., & Tibshirani, R. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62227-8 · Cited by 1,597
Self-citationReducing waste from incomplete or unusable reports of biomedical research
Glasziou, P., Altman, D. G., Bossuyt, P., Boutron, I., Clarke, M., Julious, S., Michie, S., Moher, D., & Wager, E. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62228-x · Cited by 1,319
Biomedical research: increasing value, reducing waste.
Macleod, M. R., Michie, S., Roberts, I., Dirnagl, U., Chalmers, I., Ioannidis, J. P. A., Salman, R. A.-S., Chan, A.-W., & Glasziou, P. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62329-6 · Cited by 1,003
Self-citationMoynihan, R., G⊘tzsche, P. C., Heath, I., & Henry, D. (2002) · BMJ · doi:10.1136/bmj.324.7342.886 · Cited by 900
Increasing value and reducing waste: addressing inaccessible research
Chan, A.-W., Song, F., Vickers, A., Jefferson, T., Dickersin, K., Gøtzsche, P. C., Krumholz, H. M., Ghersi, D., & van der Worp, H. B. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62296-5 · Cited by 887
How to Make More Published Research True
Ioannidis, J. P. A. (2014) · PLoS Medicine · doi:10.1371/journal.pmed.1001747 · Cited by 760 · cited 1×
“Joint efforts by multiple stakeholders may yield solutions that are more likely to be more widely adopted and thus successful [3].”
BackgroundSelf-citation
Cited by
Items 601–667 of 667
Evans, J. M., Gilbert, J. E., Bacola, J., Hagens, V. K., Simanovski, V., Holm, P., Harvey, R., Blake, P. G., & Matheson, G. (2021) · Figshare · doi:10.6084/m9.figshare.16786824
Evans, J. M., Gilbert, J. E., Bacola, J., Hagens, V. K., Simanovski, V., Holm, P., Harvey, R., Blake, P. G., & Matheson, G. (2021) · Figshare · doi:10.6084/m9.figshare.16786827
Bronkhorst, H., van Weerden, W. M., Bunnik, E. M., & Zwart, H. (2023) · Figshare · doi:10.6084/m9.figshare.24202524
Gleadhill, C., Williams, C. M., Kamper, S. J., Alderman, K. B., Delbridge, A., Mahon, B., Donald, B., Delore, C., Boettcher, C., Renfrew, D., et al. (2023) · Figshare · doi:10.6084/m9.figshare.23240080
Hill, J. R., Ganci, A., Campbell, N. L., Pickett, A. C., Chui, M. A., Abebe, E., & Holden, R. J. (2026) · JMIR Human Factors · doi:10.2196/82366
Harandi, M. F., Nasibi, S., Mohammadi, M. A., Mousavi, S., Shamsaddini, S., Derakhshani, A., Shafiei, M., & Lashkarizadeh, M. R. (2025) · BULLETIN OF SURGERY OF KAZAKHSTAN · doi:10.35805/bsk2025iv008
El-Mallah, J., & Ravnic, D. J. (2026) · Elsevier eBooks · doi:10.1016/b978-0-323-91168-9.00003-x
Bishop, E., Tikellis, G., Carmichael, C., Cox, N. S., Rushen, T., Steiner, A., Young, K., Tashkandi, J., Campagna, M. P., JONES, A. W., et al. (2026) · Research Involvement and Engagement · doi:10.1186/s40900-026-00843-2 · Cited by 1
“This lack of impact partly stems from insufficient engagement with end users - community members - during the research process [1, 2].”
Wahyudi, A., Pamuji, A., Martuti, R., & Hapradespa, A. (2026) · NuCSJo Nusantara Community Service Journal · doi:10.70437/nucsjo.v2i2.308
Neomania: How Our Obsession With Innovation is Failing Science, and How to Restore Trust
Vaesen, K. (2026) · Open Book Publishers · doi:10.11647/obp.0507
Kayhan, Z., & Kesimci, E. (2026) · Journal of Clinical Anesthesia · doi:10.1016/j.jclinane.2026.112141
Chen, Z., Chai, N., Wang, J., Wang, X., & Fan, Z. (2026) · Scientific Reports · doi:10.1038/s41598-026-39658-2
El mito de la evidencia clínica: sesgos, heurísticos, falsedades y errores metodológicos
Martín-Fernández, J. (2026) · Revista Clínica de Medicina de Familia · doi:10.55783/rcmf.190106
Scientific Articles: A Bridge to Societal Problem-Solving
Ansari, N. N. (2026) · Middle East Journal of Rehabilitation and Health Studies · doi:10.5812/mejrh-169971
Nomata, Y., Nakamura, S., Nakanishi, K., Kadomatsu, Y., UENO, H., Kato, T., Mizuno, T., & Chen-Yoshikawa, T. F. (2026) · Surgery Today · doi:10.1007/s00595-026-03259-3
Publishing in the Era of Artificial Intelligence: What Do Medical Research Journals Expect?
Afzal, I., & Radha, S. S. (2026) · Cureus · doi:10.7759/cureus.104955
“Instead, originality is judged by the intellectual contribution of the work, novel insights into disease mechanisms, meaningful changes to clinical pathways or improved understanding of health system performance [16].”
Bilimsel Makale ve Yayıncılık Akademisyen El Kitabı
Altay, S., Asan, A., Büyük, S., Bozkurt, M. F., Rexhepi, A., İsmaili, L., Akça, O., Gül, F., Saraçlı, S., Yavuz, Ş., et al. (2026) · Akademisyen Kitabevi eBooks · doi:10.37609/akya.4076
Jeayes, A., Babbage, C. M., Sprange, K., & Hall, C. L. (2026) · Trials · doi:10.1186/s13063-026-09610-w
“Informativeness refers to the extent to which an RCT is designed, conducted, and reported in a way that generates reliable and meaningful evidence to guide future clinical practice, research, and policy decisions [5, 6].”
Attitudes Towards Research among Homeopathy Interns in India: What Research are We Talking About?
Rutten, L., & Eizayaga, J. E. (2026) · Homeopathy · doi:10.1055/a-2773-0906
Digital Episodic Future Thinking Intervention (Luminaut): Co-Design and Iterative Development Study
Kakoschke, N., Howlett, C. A., Little, K., Gwilt, I., Rebuli, M. A., Brooker, P. G., & Davis, A. (2026) · JMIR Human Factors · doi:10.2196/74099
“Such trials could also serve the dual purpose of highlighting the cost-effectiveness of digital health interventions via an economic evaluation [95], which is critical for reducing the gap between research and end user needs and increasing clinical research utility [96].”
Le gaspillage évitable de la recherche dans les essais cliniques
Yordanov, Y. (2019) · theses.fr (ABES) · doi:10.70675/130e8831z862fz47f2z8000z2f04c8541788
Truchot, J. (2019) · theses.fr (ABES) · doi:10.70675/be9fab61z497fz4851za7caz1bb3d39e7616
Teodorescu, D., Torres, O. E., & Turner, J. F., Jr. (2026) · IGI Global eBooks · doi:10.4018/979-8-3373-3932-0.ch008
Nweke, M., & Pillay, J. D. (2026) · Healthcare · doi:10.3390/healthcare14080988
“These inequalities are further reinforced by rapid urbanisation, food-system transitions, harmful alcohol use, physical inactivity, and occupational exposures such as mining-related dust, all of which interact with poverty and limited educational attainment [21–23].”
Hoang, V. L., Nguyen, N. T., Bui, H. T., Hoang, T. H., & Liamputtong, P. (2025) · Springer eBooks · doi:10.1007/978-981-97-0821-5_133-1
When evidence meets artificial intelligence
Cruz-Suarez, G. A., Hincapie-Ayala, D., Osorio, F. O., Gómez-Ayala, M. C., Alzate‐Ricaurte, S., Ariza, F., Esteban, S., Jeon, S., & Celi, L. A. (2026) · The Lancet Regional Health - Americas · doi:10.1016/j.lana.2026.101472 · Cited by 8
Definitions, Principles, and Concepts of Pharmacoepidemiology and Pharmacovigilance
Chinzowu, T., & Nishtala, P. S. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-26472-6.00047-4
Innocent, D. C., Innocent, R. C., Anyakorah, P. E., Innocent, I. P., Chukwuemeka, P. S., Anuwe, J. C., Eugene, C., Udoh, O. U., Nwokeji, C. E., Emerole, C. O., et al. (2026) · BMC Medical Research Methodology · doi:10.1186/s12874-026-02872-7 · Cited by 2
“Methodological credibility increasingly depends on the explicit articulation of trade-offs between internal validity, feasibility, and applicability, rather than on uncritical adherence to design hierarchies [39, 40].”
Gavkare, A. M., Nanaware, N. L., Darade, R., Dhotre, S. V., Mumbre, S. S., & Nagoba, B. (2026) · World Journal of Clinical Cases · doi:10.12998/wjcc.v14.i16.119831
Adedeji, A. A., Adedeji, K. A., Adedeji, K. A., & Olaleye, O. N. (2026) · F1000Research · doi:10.12688/f1000research.179057.1
Guarnieri, L., Bosco, F., Corasaniti, M. T., Citraro, R., & Sarro, G. D. (2026) · Frontiers in Pharmacology · doi:10.3389/fphar.2026.1822176
“The scientific literature confirms that safety endpoints in registration trials are often insufficient for a comprehensive assessment (Ioannidis, 2016).”
Implementation Science: Buzzword or Game Changer? Ten Years Later
Douglas, N., & McGrath, S. (2026) · American Journal of Speech-Language Pathology · doi:10.1044/2026_ajslp-25-00415
Yan, M., Yang, H., Cui, D., & Zhang, Y.-S. (2026) · World Journal of Psychiatry · doi:10.5498/wjp.120241
Setiawan, M., Saraswati, M. R., & Darwinata, A. E. (2026) · Biofaal Journal · doi:10.30598/biofaal.v7i1pp32-48
Oliynyk, I. (2026) · Scientific Reports · doi:10.1038/s41598-026-56497-3
“Consequently, without deterministic normalization and rigorous metadata harmonization, registry-derived datasets may remain insufficiently robust for high-stakes clinical prediction, longitudinal modeling, and explainable AI applications in translational neuro-oncology 16 .”
Legood, I., Pagkaki, C., Thiyagalingam, S., roman, M. P., Falconi, G., Betschart, C., & Doumouchtsis, S. K. (2026) · International Urogynecology Journal · doi:10.1007/s00192-026-06782-6
Gajewski, F., Kurec, G., Litkowska, A., Pec, J., Kleinrok, J., Pająk, W., Burdan, O., Krawczyk, P. A., & Korolczuk, A. (2026) · Journal of Personalized Medicine · doi:10.3390/jpm16070342
Fragmented Data, Fragmented Decisions: Integrating Knowledge Systems in Modern PharmacotherapyPreprint
Ahmed, A. A., Fan, X., Imran, A., Li, C., Zhang, Y., & Wang, Q. (2026) · Research Square · doi:10.21203/rs.3.rs-9735159/v1
Braga, M. C. S., Guerreiro, N. D. A., Andreoni, S., & Tomita, L. Y. (2026) · Revista Brasileira em Promoção da saúde · doi:10.5020/18061230.2026.15877
Doggart, N. H., Spracklen, D. V., Reddington, C. L. S., Butt, E., Cuthbert, R., McEvoy, M., Meshack, C. K., Nawaz, M. A., & Pandey, M. (2026) · People and Nature · doi:10.1002/pan3.70375
“For example, implementation science highlighted that disconnects between clinician research needs and clinical research resulted in billions of dollars in research funding being spent on research unusable by clinicians (Ioannidis, 2016 ).”
Institutional Use of Meta-Research to Manage Conflict of Interest
Lozada-Martínez, I. D., Hernández-Páez, D. A., & Visconti-Lopez, F. J. (2026) · Springer eBooks · doi:10.1007/978-3-032-27479-3_7 · Cited by 1
Moore-Ramdin, L., van Eeghen, A. M., Stevens, J., Takhar, P., Meitzler, S., Fladrowski, C., Rozenberg, M., & Amin, S. (2026) · Patient · doi:10.1007/s40271-026-00830-5
Tellier, R. (2026) · Frontiers in Immunology · doi:10.3389/fimmu.2026.1865449 · Cited by 1
Are antidepressants held to a different standard?
Wadoo, O., Khan, Y. S., Latoo, J., Gania, A. M., & Alabdulla, M. (2026) · BJPsych Open · doi:10.1192/bjo.2026.12043
“4 Evidence-based frameworks do not eliminate uncertainty, but provide a structured approach for its management.”
Schnitker, L., Selby, Z., Dhir, M., Wagle, J., Feeley, Y., Myers, D., Singh, R., Sriram, D., Mcleod, K., O’Keefe, F., et al. (2026) · Journal of Clinical Nursing · doi:10.1111/jocn.70453
Hoang, V. L., Nguyen, N. T., Bui, H. T., Hoang, T. H., & Liamputtong, P. (2026) · Springer eBooks · doi:10.1007/978-981-92-1288-0_133
Braga, M. C. S., Guerreiro, N. D. A., Andreoni, S., & Tomita, L. Y. (2026) · Revista Brasileira em Promoção da saúde · doi:10.5020/18061230.2026.17176
Ferraz, L. S., & Linardi, A. (2026) · Pharmacological Research - Reports · doi:10.1016/j.prerep.2026.100102
Epistemic Asymmetry Between Abstracts and Discussion Sections in the Orthopaedic Literature
Parisien, R. C. (2026) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.26.00433
Goñi-Ruiz, N., & Furtado‐Eraso, S. (2026) · Anales del Sistema Sanitario de Navarra · doi:10.23938/assn.1177
The PYRAMID Framework: A Hierarchical Systems Architecture for Multidisciplinary Knowledge Synthesis
Chelliah, D. A., & Sheela, P. J. (2026) · Systems Research and Behavioral Science · doi:10.1002/sres.70143
Balachandran, P., Janakiram, C., Bhan, A., Thankappan, K. R., Kumar, N., & Menon, J. C. (2026) · BMJ Open · doi:10.1136/bmjopen-2026-117248
Quantifying the inclusion of cardiovascular research into clinical guidelines
Bundgaard, J. S., Raaschou-Pedersen, J. S., Iversen, K. K., Bundgaard, H., Khurana, M. P., & Raaschou‐Oddershede, D. (2026) · Clinical Research in Cardiology · doi:10.1007/s00392-026-03011-4
Baghdadı, Z. D. (2026) · Children · doi:10.3390/children13091161
“Research-waste and meta-research studies have documented preventable losses stemming from low-priority questions, avoidable design limitations, selective analysis, incomplete reporting, and weak placement of new studies within the existing evidence base [4–8].”
Jiang, Z., & Zhang, Q. (2026) · Acupuncture & Electro-Therapeutics Research · doi:10.1177/03601293261478134
Holas, P., & Piasecka, A. (2026) · Psychiatria i Psychologia Kliniczna · doi:10.15557/pipk.2026.0034
Artificial Intelligence in the Diagnosis of Superficial Mycoses: A Scoping Review
(Misăiloaie), D. M. L., Popescu, I. A., Vâță, D., Mocanu, M., & Solovăstru, L. G. (2026) · Journal of Fungi · doi:10.3390/jof12090684
“[1] Artificial intelligence (AI) is increasingly proposed for the diagnosis of superficial fungal infections.”
InfluentialHung, M., Jensen, A., Strickler, I., Vu, S., Arapovic, A. E., & El‐Othmani, M. M. (2026) · Journal of Clinical Medicine · doi:10.3390/jcm15187220
“Outcome reporting should employ clear, predefined definitions of dislocation, recurrent instability, revision, and reoperation, with standardized follow-up intervals and explicit distinction between hip-based and patient-based analyses [112,113].”
Introducción a la Medicina Basada en la Evidencia
Gómez-Triana, J. E., Gil, P. U., & Auza-Santiváñez, J. C. (2026) · doi:10.62486/978-9915-9928-3-9.ch03
Asaduzzaman, M., Nahar, L., Biswas, M. S., & Rahman, M. M. (2026) · Pharmacological Research - Natural Products · doi:10.1016/j.prenap.2026.100887
Development of a support tool for hepatitis C virus treatment decision making
Masterman, C., Barnett, T., Tryphonopoulos, P. D., Babenko‐Mould, Y., & Biondi, M. J. (2026) · Canadian Liver Journal · doi:10.3138/canlivj-2026-0024
Chen, S., Pan, S., Janitz, A. E., & Comiford, A. L. (2026) · Stats · doi:10.3390/stats9050115
Alonso, R., Araújo, P., Romão, P., & Delgado, P. (2026) · Education Policy Analysis Archives · doi:10.14507/epaa.34.10090
Katab, A., Arnott, B., Cheetham, T., Craw, O. A., & Kolehmainen, N. (2026) · Health Expectations · doi:10.1111/hex.70942
“Yet a large percentage of funding acquired for health‐related research is wasted due to poor quality research designs and discrepancies between re-searcher's goals and the public's needs [10].”
Top 50 most-cited articles on hypertension management in primary care: A bibliometric analysis
Alotaibi, R. F., Aldossari, N. G. A., Alwahabi, R. K., ALjerah, K. N., Alshammari, A. K., Alshehri, O. F., Bagais, B. K., Alhashim, M. J., Alhawsah, R. A., & Bamashmous, B. O. (2026) · Journal of Family Medicine and Primary Care · doi:10.4103/jfmpc.jfmpc_42_26
Metadata
- Authors
- Ioannidis, J. P. A.
- Affiliations
- Stanford Medicine (US)
- Corresponding author
- Ioannidis, John P. A.
- Venue
- PLOS Medicine
- Publisher
- Public Library of Science (PLoS)
- Published
- 2016-06-21
- Volume
- 13
- Issue
- 6
- Pages
- e1002049
- ISSN
- 1549-1277 (ISSN-L)
- 1549-1676
- PMC
- PMC4915619
- OpenAlex
- W2469474955
- Cited by
- 655
- References
- 56
- Citations by year
- 2026: 68 · 2025: 55 · 2024: 48 · 2023: 60 · 2022: 55 · 2021: 77 · 2020: 81 · 2019: 59 · 2018: 69 · 2017: 65 · 2016: 18
- FWCI
- 69.75
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS Medicine (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- Patient-Centered Outcomes Research Institute
- Laura and John Arnold Foundation
- National Institutes of Health
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Health and Medical Research Impacts
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Health Professions › General Health Professions › Healthcare cost, quality, practices
- Keywords
- research value, research reform, problem-based research, information gain, pragmatism, patient-oriented research, value for money, feasibility, research transparency
- MeSH terms
- Humans, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.