Why Most Clinical Research Is Not Useful
Open accessThe DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
Abstract
John Ioannidis argues that problem base, context placement, information gain, pragmatism, patient centeredness, value for money, feasibility, and transparency define useful clinical research. He suggests most clinical research is not useful and reform is overdue.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Neglecting the actual development phase can be problematic, as a poor problem definition, insufficient attention to existing evidence and context needs, a missing model underlying the intervention, and an unsound selection of hypothesized change mechanisms can lead to inefficient treatments (30–32).”
From Developing a mechanism-based therapy for acute psychiatric inpatients with psychotic symptoms: an Intervention Mapping approach (2023) · cites this paper as [30]
Experimental — accuracy not yet measuredIn the citing paper
“Systematic review guidelines typically advocate that all relevant studies must be included for the conclusions of that review to be valid 22”
From Software support for environmental evidence synthesis (2018) · cites this paper as [22]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Self-citationWhy Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 1×
“I have previously written about why most published research is false [2] and how to make more of it true Summary Points”
BackgroundSelf-citationTunis (2003) · doi:10.1001/jama.290.12.1624 · Cited by 1,724 · cited 1×
“Pragmatism has long been advocated in clinical research [15], but it is rare.”
BackgroundSurrogate End Points in Clinical Trials: Are We Being Misled?
Fleming, T. R., & DeMets, D. L. (1996) · Annals of Internal Medicine · doi:10.7326/0003-4819-125-7-199610010-00011 · Cited by 1,651 · cited 1×
“Nonvalidated surrogate outcomes lacking clinical insight [13] and composite outcomes that combine outcomes of very different clinical portent [14] are often utilized so that authors can claim that clinical studies are well powered.”
BackgroundIncreasing value and reducing waste in research design, conduct, and analysis
Ioannidis, J. P. A., Greenland, S., Hlatky, M. A., Khoury, M. J., Macleod, M. R., Moher, D., Schulz, K. F., & Tibshirani, R. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62227-8 · Cited by 1,597
Self-citationReducing waste from incomplete or unusable reports of biomedical research
Glasziou, P., Altman, D. G., Bossuyt, P., Boutron, I., Clarke, M., Julious, S., Michie, S., Moher, D., & Wager, E. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62228-x · Cited by 1,319
Biomedical research: increasing value, reducing waste.
Macleod, M. R., Michie, S., Roberts, I., Dirnagl, U., Chalmers, I., Ioannidis, J. P. A., Salman, R. A.-S., Chan, A.-W., & Glasziou, P. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62329-6 · Cited by 1,003
Self-citationMoynihan, R., G⊘tzsche, P. C., Heath, I., & Henry, D. (2002) · BMJ · doi:10.1136/bmj.324.7342.886 · Cited by 900
Increasing value and reducing waste: addressing inaccessible research
Chan, A.-W., Song, F., Vickers, A., Jefferson, T., Dickersin, K., Gøtzsche, P. C., Krumholz, H. M., Ghersi, D., & van der Worp, H. B. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62296-5 · Cited by 887
How to Make More Published Research True
Ioannidis, J. P. A. (2014) · PLoS Medicine · doi:10.1371/journal.pmed.1001747 · Cited by 760 · cited 1×
“Joint efforts by multiple stakeholders may yield solutions that are more likely to be more widely adopted and thus successful [3].”
BackgroundSelf-citation
Cited by
Items 301–400 of 667
Porta, M. S., & Bolúmar, F. (2016) · European Journal of Epidemiology · doi:10.1007/s10654-016-0181-3 · Cited by 7
Sepsis: find me, manage me, and stop me!
Timsit, J., & Perner, A. (2016) · Intensive Care Medicine · doi:10.1007/s00134-016-4603-1 · Cited by 6
RBM online: challenges ahead in scientific publishing
Fauser, B. C. J. M. (2017) · Reproductive BioMedicine Online · doi:10.1016/j.rbmo.2017.01.006 · Cited by 6
Ting, D. K., Bigham, B. L., Mehta, S., & Stiell, I. G. (2018) · Canadian Journal of Emergency Medicine · doi:10.1017/cem.2018.395 · Cited by 6
Jung, H., Won, C. W., & Lim, J. (2019) · Annals of Geriatric Medicine and Research · doi:10.4235/agmr.19.0044 · Cited by 6
Merlo, J. (2026) · Annals of Epidemiology · doi:10.1016/j.annepidem.2026.01.010 · Cited by 6
Jung, W., Ahn, A., Lee, G., Kong, S., Kang, D., Lee, D., Kim, T. E., Shim, Y. M., Kim, H. K., Cho, J. H., et al. (2024) · JMIR Research Protocols · doi:10.2196/54707 · Cited by 5
Saraff, V., Boot, A. M., Linglart, A., Semler, O., Harvengt, P., Williams, A., Bailey, K., Glen, F. C., Davies, E. H., Wood, S., et al. (2024) · PLoS ONE · doi:10.1371/journal.pone.0295080 · Cited by 5
Welsby, E., Hobbs, D., Hordacre, B. G., Ward, E., & Hillier, S. (2024) · Journal of Rehabilitation and Assistive Technologies Engineering · doi:10.1177/20556683241266780 · Cited by 7
Placebo and nocebo phenomena from the perspective of evidence based and person centered medicine
Jakovljević, M. (2017) · Hospital Pharmacology - International Multidisciplinary Journal · doi:10.5937/hpimj1702512j · Cited by 5
Proving non-conventional methods: A paradigmatic paradox
Rutten, L. L. B. (2019) · Indian Journal of Research in Homoeopathy · doi:10.4103/ijrh.ijrh_64_19 · Cited by 5
“The RCT as a method now enjoys lower credibility than was the case 25 years ago.[41] Credibility depends on statistical issues (such as power, false positives or negatives), methodological choices, reporting, financial and other interests and prior Figure 1: Funnel plots of 110 Homoeopathy trials (above) and 110”
BackgroundAbdel‐Hamid, I. A., Abo-Aly, M. A., & Mostafa, T. (2023) · Sexual Medicine Reviews · doi:10.1093/sxmrev/qeac003 · Cited by 5
The prototype of a frailty learning health system: The HARMONY Model
Parker, K. J., Hickman, L., McDonagh, J., Lindley, R. I., & Ferguson, C. (2023) · Learning Health Systems · doi:10.1002/lrh2.10401 · Cited by 6
The response of Canada’s clinical health research ecosystem to the COVID-19 pandemic
Lamontagne, F., Masse, M.-H., Yarnell, C. J., Lemyre, F. C., Lévesque, S., Domingue, M., O’Hearn, K., Watpool, I., Hoogenes, J., Sprague, S., et al. (2024) · Canadian Medical Association Journal · doi:10.1503/cmaj.230760 · Cited by 5
Tsirogianni, A. M., Bouzalmate-Hajjaj, A., Hooft, J. V. ’., Khan, K. S., Bueno‐Cavanillas, A., & Ibáñez, N. C. (2024) · Clinical Nutrition ESPEN · doi:10.1016/j.clnesp.2024.08.026 · Cited by 6
Is orthodontic research falling prey to obscure and predatory journals? A bibliometric study
Maroulakos, M. P., Al‐Moghrabi, D., Fleischmann, I., Pandis, N., & Fleming, P. S. (2024) · European Journal of Orthodontics · doi:10.1093/ejo/cjae039 · Cited by 5
O’Callaghan, G., Fahy, M. P., Hall, P., McCartan, D., Langhorne, P., Galvin, R., & Horgan, F. (2024) · Health Expectations · doi:10.1111/hex.70040 · Cited by 7
“By engaging end ‐ users in health-care research, co ‐ design potentially mitigates waste often seen in traditional health research, such as excluding relevant perspectives or including outcomes irrelevant to specific groups [16].”
BackgroundDuan, Y.-S., Wang, Y., Li, B.-Y., Fu, Z., Tu, J., Zhou, H., Wang, Y., Wang, Y., & Liu, C. (2024) · Journal of Pain Research · doi:10.2147/jpr.s477000 · Cited by 5
Keane, M. J., & Berg, C. (2017) · British Journal of Anaesthesia · doi:10.1093/bja/aex334 · Cited by 6
Why mind-body medicine is poised to set a new standard for clinical research
Penrod, N. M., & Moore, J. H. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.05.001 · Cited by 5
Ban, J.-W., Chan, M. S., Muthee, T. B., Páez, A., Stevens, R., & Perera, R. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.01.016 · Cited by 6
Abed, V., Koolmees, D. S., Elhage, K. G., Hessburg, L. T., & Makhni, E. C. (2022) · Arthroscopy Sports Medicine and Rehabilitation · doi:10.1016/j.asmr.2021.09.005 · Cited by 5
“(b) Noneuniversity-affiliated teaching hospitals (2) Public or semi-government research institutes (3) Nonprofit research institutes (4) Private sector institutions (5) Government Institutions (6) Other institutions Hottenrott and Lawson combined “1a” and “1b” into one classification of “Higher Education Sector,” but…”
BackgroundStrengthening Reporting of Neonatal Trials
Webbe, J., Baba, A., Butcher, N. J., Rodrigues, C., Stallwood, E., Goren, K., Monsour, A., Chang, A. S., Trivedi, A., Manley, B. J., et al. (2023) · PEDIATRICS · doi:10.1542/peds.2022-060765 · Cited by 5
Systemic review and meta-analysis of diagnostic imaging technologies
Wáng, Y. X. J. (2016) · Quantitative Imaging in Medicine and Surgery · doi:10.21037/qims.2016.10.08 · Cited by 6
Wrong guidelines: how to detect them and what to do in the case of flawed recommendations
Iannone, P., Costantino, G., Montano, N., Podda, G. M., Minardi, M., Doyle, J., & Cartabellotta, A. (2016) · BMJ Evidence-Based Medicine · doi:10.1136/ebmed-2016-110607 · Cited by 6
Revisiones rápidas para la síntesis de la evidencia
Catalá-López, F., Stevens, A., Garritty, C., & Hutton, B. (2017) · Medicina Clínica · doi:10.1016/j.medcli.2016.12.016 · Cited by 9
On Reproducible and Replicable Gerontology
Estabrook, R. (2020) · Gerontology · doi:10.1159/000504574 · Cited by 6
Precision medicine in follicular lymphoma: Focus on predictive biomarkers
Sorigué, M., Cañamero, E., & Sancho, J. (2020) · Hematological Oncology · doi:10.1002/hon.2781 · Cited by 7
Research, kindness and the antifragility of emergency medicine
Fatovich, D. M. (2021) · Emergency Medicine Australasia · doi:10.1111/1742-6723.13730 · Cited by 5
“Useful clinical research means that it can lead to a favourable change in decision making.(5) The human body, however, is so complex and our understanding of it so superficial, that what we believe should work – because it is physiologically plausible - often does not.”
BackgroundSpontaneously Generated Online Patient Experience of Modafinil: A Qualitative and NLP Analysis
Walsh, J., Cave, J. A. K., & Griffiths, F. E. (2021) · Frontiers in Digital Health · doi:10.3389/fdgth.2021.598431 · Cited by 7
“How SGOPE Can Complement RCTs in Generating Evidence Our results demonstrate how SGOPE can help address some of the identified issues with a research driven agenda (15)”
BackgroundRapid reviews for evidence synthesis
Catalá-López, F., Stevens, A., Garritty, C., & Hutton, B. (2017) · Medicina Clínica (English Edition) · doi:10.1016/j.medcle.2016.12.068 · Cited by 8
Is the HPCSA requirement for a research dissertation for specialist registration the best option?
Biccard, B. M., Dyer, R. A., Swanevelder, J. L., Coetzee, J. X., & Shafer, S. L. (2017) · Southern African Journal of Anaesthesia and Analgesia · doi:10.4102/sajaa.v23i4.1364 · Cited by 11
“John Ioannidis 2016 In November 2010 the Subcommittee for Postgraduate Education and Training (Medical) under the auspices of the Health Professions Council of South Africa (HPCSA) decreed that for registrars who commenced training on or after 1 January 2011, “Completion of a research component” is…”
BackgroundHemkens, L. G. (2020) · Clinical Trials · doi:10.1177/1740774520913845 · Cited by 5
Stewart, A. G. (2017) · Frontiers in Pharmacology · doi:10.3389/fphar.2017.00008 · Cited by 5
“8:8. doi: 10.3389/fphar.2017.00008”
BackgroundInfluentialEmmenegger, M., Zografou, C., Dai, Y., Hoyt, L. R., Gudneppanavar, R., Chincisan, A., Rehrauer, H., Noé, F., Zajac, N., Meisl, G., et al. (2024) · medRxiv · doi:10.1101/2024.06.17.24309019 · Cited by 5
Pursuitworthiness in urgent research: Lessons on well-ordered science from sustainability science
Stojanovic, M. (2023) · Studies in History and Philosophy of Science Part A · doi:10.1016/j.shpsa.2023.01.004 · Cited by 5
Komorowski, A. S., Lo, C. K. L., Kapoor, A. K., Smieja, M., Loeb, M. B., Mertz, D., & Bai, A. D. (2023) · Clinical Infectious Diseases · doi:10.1093/cid/ciad574 · Cited by 5
Co-designing a film showcasing the dental experiences of community returners (ex-offenders)
Booth, J., McMullen, H., Rodríguez, A., & Muirhead, V. (2025) · Frontiers in Oral Health · doi:10.3389/froh.2024.1391438 · Cited by 4
Li, L., Liu, J., Zheng, Y., Shi, C., & Bai, W. (2025) · Depression and Anxiety · doi:10.1155/da/7645625 · Cited by 4
Unveiling 30 years of research on speech biomarker of dementia using text mining
Oh, C., & Park, M. S. (2025) · Digital Health · doi:10.1177/20552076251360901 · Cited by 5
“9 A longitudinal analysis of the literature on speech biomarkers in dementia can offer valuable insights into how the fi eld has evolved over time and inform future directions.”
Babbage, C. M., Davies, E. B., Jones, D. P., Stevenson, P., Salvage, J., Anderson, S. M., McNally, E., & Groom, M. J. (2025) · BMJ Open · doi:10.1136/bmjopen-2024-098306 · Cited by 4
“Of those with a diagnosis, over 60% had not been offered any treatment for their tics.”
Parallel pressures: the common roots of doctor bullshit and large language model hallucinations
Soto, R. A. C., McCoy, L. G., Perdomo-Luna, C., Ziegler, J., Pino, L. E., Rico, A., Velasco-Muñoz, V., Uribe-Castaño, A., Rodman, A. M., & Celi, L. A. (2025) · BMJ · doi:10.1136/bmj.r2570 · Cited by 4
Implementation science in hybrid randomized controlled trials: a state-of-the-art systematic review
Liu, M., Comber, E. R., Martin, A. J., Roberts, N. A., Trott, M., Costa, N., Foster, N. E., & Hickman, I. J. (2026) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000568 · Cited by 5
Худолій, О. М., Іващенко, О. В., & Khudolii, M. (2026) · Physical Education Theory and Methodology · doi:10.17309/tmfv.2026.4.01 · Cited by 4
“Statistical methods should be anticipated during the design phase, while data structures should remain open to reanalysis and the application of more sophisticated multifactorial models (Box & Wilson, 1951; Collins et al., 2009; Ivashchenko et al., 2016; Ivashchenko et al., 2018; Ioannidis, 2016).”
InfluentialThe need for “gentle medicine” in a post Covid-19 world
Andrade, G. E., & Campo-Redondo, M. (2021) · Medicine Health Care and Philosophy · doi:10.1007/s11019-021-10046-z · Cited by 4
“Indeed, in Ioannidis’ (2016) estimation, such is the magnitude of the problem of conflicts of interests in medicine, that in his words, medical research does not “make a difference for health and disease outcomes.””
BackgroundInteligencja w codziennym życiu
(2021) · Wydawnictwo Liberi Libri eBooks · doi:10.47943/lib.9788363487515 · Cited by 12
La carne bovina como parte de una dieta saludable. Una revisión
Arias, R., Velásquez, A., Morales, R., & Alvarado-Gilis, C. (2022) · Agro Sur · doi:10.4206/agrosur.2021.v50n1-03 · Cited by 5
Optimizing drug discovery: An opportunity and application with reverse translational research
Musyuni, P., Sharma, R., & Aggarwal, G. (2022) · Health Sciences Review · doi:10.1016/j.hsr.2022.100074 · Cited by 5
Cole, R., Kearney, L. N., Jenkinson, B., Kettle, I., Ng, B., Callaway, L. K., & Nugent, R. (2024) · Australian Health Review · doi:10.1071/ah23222 · Cited by 4
Lorenzo, J. M. E., Martín-Arriscado, C., & Martín‐Fernández, J. (2024) · Revista Clínica de Medicina de Familia · doi:10.55783/rcmf.170405 · Cited by 4
Usefulness of Analytical Research: Rethinking Analytical R&D&T Strategies
Valcárcel, M. (2017) · Analytical Chemistry · doi:10.1021/acs.analchem.7b03935 · Cited by 4
Clinical Utility of Psychoeducational Interventions for Youth with Type 1 Diabetes: A Scoping Review
Bergmame, L., & Shaw, S. R. (2021) · Continuity in Education · doi:10.5334/cie.28 · Cited by 6
Mazzola, G. B., Baker, D. J., Vukovics, K., Davis, C. M., & Elliott, E. M. (2023) · Musicae Scientiae · doi:10.1177/10298649221149109 · Cited by 9
“As a subset of psychology, music psychology is not immune to what is referred to as the replication crisis (Hutson, 2018; Ioannidis, 2005, 2016; Open Science Collaboration, 2015; Peng, 2011), that is, that it is difficult or even impossible to reproduce many findings published in the scientific…”
BackgroundZeitoun, J., Ross, J. S., Atal, I., Vivot, A., Downing, N. S., Baron, G., & Ravaud, P. (2018) · Clinical Pharmacology & Therapeutics · doi:10.1002/cpt.1038 · Cited by 4
“15 (23.8) Degree of novelty (according to Lanthier et al.12), n (”
BackgroundInfluentialNetwork generation and evolution based on spatial and opinion dynamics components
Martins, A. C. R. (2019) · International Journal of Modern Physics C · doi:10.1142/s0129183119500773 · Cited by 5
“Models for network evolution, however, are usually built with simple probabilistic rules [21, 22, 23, 24, 25, 26, 27, 28].”
BackgroundHall, N. J., Rees, C. M., Rhodes, H. L., Williams, A., Vipond, M. N., Gordon, A., Evans, D. A., Wood, R. J., Bytheway, J., & Sutcliffe, J. R. (2021) · BJS Open · doi:10.1093/bjsopen/zraa062 · Cited by 4
CDC mask recommendations and guideline development: Missing pieces
Matthews, S. (2021) · Infection Control and Hospital Epidemiology · doi:10.1017/ice.2021.197 · Cited by 4
Teaching scientific research integrity: A case study
Saltelli, A. (2023) · Innovations in Education and Teaching International · doi:10.1080/14703297.2023.2237949 · Cited by 5
Evidence-based pharmacotherapy in cardiology. National guideline
Martsevich, S. Y., Кутишенко, Н. П., Lukina, Y. V., Yakusevich, V. V., Николаевна, Т. С., Samorodskaya, I. V., Lukyanov, М. М., Zagrebelny, A. V., Metelskaya, V. A., Александровна, П. Е., et al. (2024) · Rational Pharmacotherapy in Cardiology · doi:10.20996/1819-6446-2024-2992 · Cited by 5
Bergmame, L., & Shaw, S. R. (2017) · Health Psychology Report · doi:10.5114/hpr.2018.70357 · Cited by 4
Daffos, Q., Hansconrad, E., Plaisance, P. I., Pateron, D., Yordanov, Y., & Chauvin, A. (2018) · The American Journal of Emergency Medicine · doi:10.1016/j.ajem.2018.11.017 · Cited by 4
“Poor reporting does not necessarily mean poor methods [8], but adequate reporting allows readers to assess the strength and weakness of published studies and improve the replication of interventions in daily practice [9,10].”
BackgroundReforming Health Care: The Single System Solution
Fisher, E. S. (2020) · NEJM Catalyst · doi:10.1056/cat.20.0456 · Cited by 7
Troublesome Dependency Modeling: Causality, Inference, Statistical LearningPreprint
Mandel, I. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.2984045 · Cited by 5
How to: improve peer review skills for CMI
Scudeller, L., & Friedman, J. (2021) · Clinical Microbiology and Infection · doi:10.1016/j.cmi.2021.06.028 · Cited by 4
Tatsioni, A., Siountri, I., Tsamoulis, D., & Vafeidou, K. (2021) · European Journal of General Practice · doi:10.1080/13814788.2021.1986279 · Cited by 4
“One may argue that most studies, both RCTs and others, may have limited usefulness [36,37].”
BackgroundTSGMA: identification of macro associations from global data to build global MA networksPreprint
Ma, H. (2025) · medRxiv · doi:10.1101/2025.06.09.25329257 · Cited by 4
Establishing priorities in child health: Giving parents and youth a voice
Elliott, S. A., Scott, S. D., Wright, K. S., & Hartling, L. (2023) · Journal of Child Health Care · doi:10.1177/13674935231205041 · Cited by 4
“Areas of potentially important research may be neglected, causing a mismatch between research being carried out and research evidence needed by consumers (Ioannidis, 2016).”
Szeto, K., Davis, A., Arnold, J. B., Gwilt, I., Forrest, A., Heyne, I., Hewitt, A., Diestel-Feddersen, P., Edwards, D., Singh, B., et al. (2025) · Frontiers in Digital Health · doi:10.3389/fdgth.2025.1520991 · Cited by 3
“To move toward WAT integration in healthcare, addressing the needs of end-users and developing strategies that consider these barriers and the healthcare contexts that they exist within are necessary (25, 26).”
Thompson, G. A., El-Shewy, M., & Zaher, A. (2026) · Journal of Prosthodontics · doi:10.1111/jopr.70111 · Cited by 3
Papakostopoulou, M., Kučera, J., & Tycová, H. (2022) · American Journal of Orthodontics and Dentofacial Orthopedics · doi:10.1016/j.ajodo.2021.10.012 · Cited by 3
Chatio, S. T., Ganle, J. K., Adongo, P. B., Ansah, P. O., Nonterah, E. A., Mensah, N. K., Akazili, J., & Beisel, U. (2025) · PLOS Global Public Health · doi:10.1371/journal.pgph.0003201 · Cited by 4
Jelinek, T., O’Brien, C., Young, A., Hughes, G. K., Bratten, C., Paul, E., & Vassar, M. B. (2025) · JSES Reviews Reports and Techniques · doi:10.1016/j.xrrt.2025.04.015 · Cited by 5
Metaepidemiologie und Qualitätssicherung klinischer Evidenzproduktion
Haring, R. (2017) · Springer eBooks · doi:10.1007/978-3-662-55377-0_4 · Cited by 3
HTA in nuclear medicine: [68Ga]PSMA PET/CT for patients with prostate cancer
Pozzo, L., Monteiro, L. R., Cerci, J. J., Fanti, S., Negro, A., & Trindade, E. M. (2019) · Clinical and Translational Imaging · doi:10.1007/s40336-019-00313-8 · Cited by 3
Public Participation in Health Care: Exploring the Co-Production of Knowledge
Green, G., Boaz, A., & Stuttaford, M. C. (2020) · Frontiers research topics · doi:10.3389/978-2-88963-298-5 · Cited by 5
Beyond failure: the 2 nd LAK Failathon
Clow, D., Ferguson, R., Kitto, K., Cho, Y.-S., Sharkey, M., & Aguerrebere, C. (2017) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/3027385.3029429 · Cited by 4
Improving the Quality of Medical Research
Indrayan, A. (2020) · Annals of the National Academy of Medical Sciences (India) · doi:10.1055/s-0040-1710159 · Cited by 4
Understanding Bias in Diagnosing, Assessing, and Treating Female Offenders
Cunliffe, T. B., Gacono, C. B., & Smith, J. M. (2021) · Elsevier eBooks · doi:10.1016/b978-0-12-823372-6.00006-0 · Cited by 3
COVID-19: A Catalyst for Transforming Randomized Trials
Lee, J., Price, J. C., Jackson, W. M., Whittington, R. A., & Ioannidis, J. P. A. (2021) · Journal of Neurosurgical Anesthesiology · doi:10.1097/ana.0000000000000804 · Cited by 4
Self-citationAn urgent call for improved quality of trial design and reporting in postoperative pain research
Fabritius, M. L., Wetterslev, J., Dahl, J. B., & Mathiesen, O. (2016) · Acta Anaesthesiologica Scandinavica · doi:10.1111/aas.12820 · Cited by 3
Streamlining science with structured data archives: insights from stroke rehabilitation
Mohabbati-Kalejahi, N., Yazdi, M. A. A., Megahed, F. M., Schaefer, S. Y., Boyd, L. A., Lang, C. E., & Lohse, K. R. (2017) · Scientometrics · doi:10.1007/s11192-017-2482-z · Cited by 3
“Effective decision making, in either research or clinical practice, relies on putting these data in context (Ioannidis 2016) and yet the current tools/methods available to pool data across studies are laborious and time intensive (Higgins and Green 2011; Borenstein et al. 2009).”
BackgroundExperimental Planning and Execution
Mullane, K., Curtis, M. J., & Williams, M. J. (2017) · Elsevier eBooks · doi:10.1016/b978-0-12-804725-5.00002-1 · Cited by 3
Velden, D. L. V. D., Levit, L. A., Chang, G. J., Facktor, M. A., Goodman, K. A., Kaufman, J., Konecny, G. E., Kwan, S. W., Mooney, M., Smith, G. L., et al. (2019) · Journal of Cancer Policy · doi:10.1016/j.jcpo.2019.100188 · Cited by 3
Cooper, A. L., Kelly, S., & Brown, J. A. (2023) · Applied Nursing Research · doi:10.1016/j.apnr.2023.151730 · Cited by 4
A Clinical Perspective on Big Data in Mental Health
Torous, J. B., Namiri, N. K., & Keshavan, M. S. (2019) · Springer eBooks · doi:10.1007/978-3-030-03553-2_3 · Cited by 5
From probability to believability
Sturmberg, J. P. (2019) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.13186 · Cited by 4
Why Science Succeeds, and Sometimes Doesn’t
Baron, J. A. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108684354.004 · Cited by 4
Discussion Paper: Should statistics rescue mathematical modelling?Preprint
Saltelli, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.06457 · Cited by 10
“In statistics abuse or misuse of the p-test [13]–[15], [22], [49] has been singled out by many observers as one of the causes of the reproducibility crisis currently affecting science [2], [3], [7], [9], [50].”
BackgroundArguing Practical Significance in Software Engineering Using Bayesian Data Analysis.Preprint
Torkar, R., FELDT, R. H., & Furia, C. A. (2018) · arXiv (Cornell University) · Cited by 3
Conceptual, Structural, and Practical Challenges to Ethical Allocation of Research Funds
Dresser, R. S. (2018) · The American Journal of Bioethics · doi:10.1080/15265161.2018.1523502 · Cited by 3
Liu, S., Wei, S., & Lehmann, H. P. (2023) · medRxiv · doi:10.1101/2023.07.06.23292124 · Cited by 3
“This choice fits with the recurring recommendations that models need to be checked against local constraints 5,22-25 .”
BackgroundGussmann, E., Lucae, S., Falkai, P., Padberg, F., Egli, S., & Kopf-Beck, J. (2023) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1160075 · Cited by 2
Exploring the Clinical Usefulness of Undergraduate Medical Research: A Mixed-Methods Study
Burke, E., Savage, C., Begley, J., Sioufi, S., Smith, S. D., Slavi Stoyanov, A., & O’Tuathaigh, C. M. P. (2024) · Medical Science Educator · doi:10.1007/s40670-024-02035-7 · Cited by 2
Spencer, S. D., Borgogna, N. C., Owen, T., Rast, C. E., Johnson, D. A., Cheng, J. S.-C., Castillo, A. A., Storch, E. A., Cervin, M., & Hollon, S. D. (2025) · Personalized Medicine in Psychiatry · doi:10.1016/j.pmip.2025.100154 · Cited by 3
Neziraj, M., Striberger, R., & Samuelsson, M. (2025) · Geriatric Nursing · doi:10.1016/j.gerinurse.2025.103433 · Cited by 2
Choosing Alpha Post Hoc: The Danger of Multiple Standard Significance Thresholds
Hemerik, J., & Koning, N. W. (2026) · Statistical Science · doi:10.1214/25-sts983 · Cited by 5
“Recently, there has been an intense debate in many fields on whether the threshold should be changed from 0.05 to 0.005 [7, 20, 3, 37, 34, 26, 21, 43, 4, 22, 29, 14, 8, 25, 1, 41, 44, 9].”
InfluentialBuono, M., Schiavone, L., Rizzo, S., Musto, L. A., Gatta, G., Pilati, L., & Caumo, F. (2026) · Diagnostics · doi:10.3390/diagnostics16050776 · Cited by 2
“Detection rates are already high; the unresolved challenge lies in improving decision relevance through outcome-oriented validation and the adoption of clinically meaningful endpoints, rather than surrogate metrics of technical performance or lesion conspicuity [63–65].”
Precision Medicine Through Network Language: Integrating Clinical Insight and Data Expertise
Palumbo, M. C., Farina, L., & Petti, M. (2026) · Genes · doi:10.3390/genes17040467 · Cited by 2
“This is also due to the high biological heterogeneity and poor reproducibility of many preclinical results [4,5].”
Matano, F., & Patra, A. K. (2026) · Antioxidants · doi:10.3390/antiox15050579 · Cited by 3
Pozzi, J., D’Argenzio, J., Carriero, S., Cè, M., D’Arrigo, D., Lanza, C., Biondetti, P., Angileri, S. A., Pavan, M., Catona, R., et al. (2026) · Diagnostics · doi:10.3390/diagnostics16142266 · Cited by 2
“Where Ioannidis [17] distinguishes useful from merely publishable research, Huang et al. [9] specify the criteria for clinical translation, and RQS 2.0 [22] grades study-level readiness.”
Influential
Metadata
- Authors
- Ioannidis, J. P. A.
- Affiliations
- Stanford Medicine (US)
- Corresponding author
- Ioannidis, John P. A.
- Venue
- PLOS Medicine
- Publisher
- Public Library of Science (PLoS)
- Published
- 2016-06-21
- Volume
- 13
- Issue
- 6
- Pages
- e1002049
- ISSN
- 1549-1277 (ISSN-L)
- 1549-1676
- PMC
- PMC4915619
- OpenAlex
- W2469474955
- Cited by
- 655
- References
- 56
- Citations by year
- 2026: 68 · 2025: 55 · 2024: 48 · 2023: 60 · 2022: 55 · 2021: 77 · 2020: 81 · 2019: 59 · 2018: 69 · 2017: 65 · 2016: 18
- FWCI
- 69.75
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS Medicine (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- Patient-Centered Outcomes Research Institute
- Laura and John Arnold Foundation
- National Institutes of Health
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Health and Medical Research Impacts
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Health Professions › General Health Professions › Healthcare cost, quality, practices
- Keywords
- research value, research reform, problem-based research, information gain, pragmatism, patient-oriented research, value for money, feasibility, research transparency
- MeSH terms
- Humans, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.