Why Most Clinical Research Is Not Useful
Open accessThe DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
Abstract
John Ioannidis argues that problem base, context placement, information gain, pragmatism, patient centeredness, value for money, feasibility, and transparency define useful clinical research. He suggests most clinical research is not useful and reform is overdue.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Neglecting the actual development phase can be problematic, as a poor problem definition, insufficient attention to existing evidence and context needs, a missing model underlying the intervention, and an unsound selection of hypothesized change mechanisms can lead to inefficient treatments (30–32).”
From Developing a mechanism-based therapy for acute psychiatric inpatients with psychotic symptoms: an Intervention Mapping approach (2023) · cites this paper as [30]
Experimental — accuracy not yet measuredIn the citing paper
“Systematic review guidelines typically advocate that all relevant studies must be included for the conclusions of that review to be valid 22”
From Software support for environmental evidence synthesis (2018) · cites this paper as [22]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Self-citationWhy Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 1×
“I have previously written about why most published research is false [2] and how to make more of it true Summary Points”
BackgroundSelf-citationTunis (2003) · doi:10.1001/jama.290.12.1624 · Cited by 1,724 · cited 1×
“Pragmatism has long been advocated in clinical research [15], but it is rare.”
BackgroundSurrogate End Points in Clinical Trials: Are We Being Misled?
Fleming, T. R., & DeMets, D. L. (1996) · Annals of Internal Medicine · doi:10.7326/0003-4819-125-7-199610010-00011 · Cited by 1,651 · cited 1×
“Nonvalidated surrogate outcomes lacking clinical insight [13] and composite outcomes that combine outcomes of very different clinical portent [14] are often utilized so that authors can claim that clinical studies are well powered.”
BackgroundIncreasing value and reducing waste in research design, conduct, and analysis
Ioannidis, J. P. A., Greenland, S., Hlatky, M. A., Khoury, M. J., Macleod, M. R., Moher, D., Schulz, K. F., & Tibshirani, R. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62227-8 · Cited by 1,597
Self-citationReducing waste from incomplete or unusable reports of biomedical research
Glasziou, P., Altman, D. G., Bossuyt, P., Boutron, I., Clarke, M., Julious, S., Michie, S., Moher, D., & Wager, E. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62228-x · Cited by 1,319
Biomedical research: increasing value, reducing waste.
Macleod, M. R., Michie, S., Roberts, I., Dirnagl, U., Chalmers, I., Ioannidis, J. P. A., Salman, R. A.-S., Chan, A.-W., & Glasziou, P. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62329-6 · Cited by 1,003
Self-citationMoynihan, R., G⊘tzsche, P. C., Heath, I., & Henry, D. (2002) · BMJ · doi:10.1136/bmj.324.7342.886 · Cited by 900
Increasing value and reducing waste: addressing inaccessible research
Chan, A.-W., Song, F., Vickers, A., Jefferson, T., Dickersin, K., Gøtzsche, P. C., Krumholz, H. M., Ghersi, D., & van der Worp, H. B. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62296-5 · Cited by 887
How to Make More Published Research True
Ioannidis, J. P. A. (2014) · PLoS Medicine · doi:10.1371/journal.pmed.1001747 · Cited by 760 · cited 1×
“Joint efforts by multiple stakeholders may yield solutions that are more likely to be more widely adopted and thus successful [3].”
BackgroundSelf-citation
Cited by
Items 501–600 of 667
On the Value of Biomedical Research and Medical Care
Catillon, M. (2020) · Digital Access to Scholarship at Harvard (DASH) (Harvard University) · Cited by 1
Montés, A. F., Lago, N. M., Gómez, J. D. L. C., Vázquez, E. M. B., Folgar, S. C., Campos, M. C., Castiñeiras, A. C., Rúa, M. C., Martín, E. G., Villarroel, P. G., et al. (2021) · Healthcare · doi:10.3390/healthcare9060665
O aumento da má conduta científica nas pesquisas da área de saúde: impressão ou realidade?
Rabelo, D. R., Lopes, G. F., & Cumming, H. S. (2021) · Journal of Evidence-Based Healthcare · doi:10.17267/2675-021xevidence.2021.e3389
Houston, L. (2020) · Research Online (University of Wollongong)
Zajenkowski, M. (2021) · Wydawnictwo Liberi Libri eBooks · doi:10.47943/lib.9788363487515.rozdzial00b
Przekonania na temat inteligencji, czyli kto i dlaczego chce być (postrzegany jako) mądry
Zajenkowski, M., & Maciantowicz, O. (2021) · Wydawnictwo Liberi Libri eBooks · doi:10.47943/lib.9788363487515.rozdzial05
Jak inteligentnie kontrolować swoje zachowania? Siła woli w życiu codziennym
Jędrzejczyk, J. (2021) · Wydawnictwo Liberi Libri eBooks · doi:10.47943/lib.9788363487515.rozdzial02
Inteligencja: ogólna zdolność o praktycznym znaczeniu dla szkoły, pracy, zdrowia i długości życia
Zajenkowski, M. (2021) · Wydawnictwo Liberi Libri eBooks · doi:10.47943/lib.9788363487515.rozdzial01
Łowicki, P. (2021) · Wydawnictwo Liberi Libri eBooks · doi:10.47943/lib.9788363487515.rozdzial07
Harmonization of Data and Biobanks for Preeclampsia Research
Staff, A. C., Redman, C. W. G., & Roberts, J. M. (2022) · Elsevier eBooks · doi:10.1016/b978-0-12-818417-2.00016-6
Ellis, D. A. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108671408.008
Ellis, D. A. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108671408.001
Ellis, D. A. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108671408.004
Ellis, D. A. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108671408.002
Ellis, D. A. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108671408.009
Ellis, D. A. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108671408.007
Replication crisisPreprint
Quang-Loc, N. (2022) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/4wd5x
Balas, E. A. (2018) · Wiley eBooks · doi:10.1002/9781119225898.ch14
DTB Select: 9 | September 2016
(2016) · Drug and Therapeutics Bulletin · doi:10.1136/dtb.2016.9.0422
(2021) · Wydawnictwo Liberi Libri eBooks · doi:10.47943/lib.9788363487515.rozdzial00a
Mergny, J. (2020) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.737405003.793575646
Zhang (2019) · Research Publications (Maastricht University) · doi:10.26481/dis.20190701mz · Cited by 2
Kammerer, J. J. (2016) · Sage eBooks · doi:10.4135/9781483349985.n407
(2018) · Sociological Methodology · doi:10.1177/0081175018799359
“This suggests that there is something wrong with how we approach model uncertainty and model selection in science more generally (see also Gelman and Loken 2014; Ioannidis 2016).”
BackgroundEllis, D. A. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108671408.010
Introduction to Intervention Research
(2021) · Wiley eBooks · doi:10.1002/9781119610113.ch1
On the pasta theory of reproductive research
(2018) · Human Reproduction · doi:10.1093/humrep/dey223
Pieper, I. J. (2022) · Queensland University of Technology · doi:10.5204/thesis.eprints.231386 · Cited by 1
Principles and applications of metaresearch
Harpe, S. E. (2022) · Elsevier eBooks · doi:10.1016/b978-0-323-91888-6.00038-7
Clinical trial research agenda on COVID-19 – the first two years in Germany and beyond
Hirt, J., Janiaud, P., & Hemkens, L. G. (2022) · Zeitschrift für Evidenz Fortbildung und Qualität im Gesundheitswesen · doi:10.1016/j.zefq.2022.08.003 · Cited by 1
“Yet, clinical research is often not decisionoriented and patient-centered, and therefore not as useful as it should be [3].”
[Extensions of guidelines for reporting types of study in medicine].
Dávila-Mendoza, R., & López-Ortiz, G. (2022) · PubMed Central · Cited by 4
Birds of a Feather: Advancing US Active Duty, Reservist, and Veteran Medical Research, Together
Babyar, J. C. (2022) · Public Integrity · doi:10.1080/10999922.2022.2124606
“Clinician choice of medical journals may or may not affect the medicine (Ioannidis, 2016).”
BackgroundMental Health Services Research and Community Psychiatry
Goodsmith, N., & Cruz, M. (2022) · Springer eBooks · doi:10.1007/978-3-031-10239-4_30
Electronic Health Records to Detect Psychosis Risk
Oliver, D., & Fusar‐Poli, P. (2023) · Springer eBooks · doi:10.1007/978-3-031-10698-9_12
Metabolites in fish and humans as a response to different food ingredients : a metabolomics approach
Brunel, M. (2023) · Acta universitatis agriculturae Sueciae · doi:10.54612/a.524khafcck
Plessas, A., Ramos, J. I. E., Cowie, S., Landon, J., & Parry, D. (2023) · Research Square · doi:10.21203/rs.3.rs-2533427/v1
Embracing diversity during researcher evaluation in the academic scientific environment
Riera, R., Quesada-Cabrera, R., Martínez, A., & Dupont, S. T. (2023) · Frontiers in Education · doi:10.3389/feduc.2023.1098319
“Several issues are related to a hyper-specialization of researchers (Riera et al., 2018) and a lack of problem-solving (Ioannidis, 2016), mostly hidden away from society (“Academia bubble”).”
BackgroundKelley, K. C. (2023) · Elsevier eBooks · doi:10.1016/b978-0-323-90300-4.00073-2
From “Modern” to “Postmodern” Psychology: Is There a Way Past?
Hanfstingl, B., Gnambs, T., Edelsbrunner, P. A., Uher, J., & Dettweiler, U. (2023) · Frontiers research topics · doi:10.3389/978-2-83251-944-8
Kamp, C. B., Olsen, M. H., Nielsen, N., Lange, T., Mbuagbaw, L. C. E., Thabane, L., Billot, L., Binder, N., Garattini, S. K., Banzi, R., et al. (2023) · Health Services Insights · doi:10.1177/11786329231166519
(2023) · Elsevier eBooks · doi:10.1016/b978-0-443-10715-3.16001-9
Intelligence-based cardiovascular disease prevention
Al-Falahi, Z., & Tran, T. H. (2023) · Elsevier eBooks · doi:10.1016/b978-0-323-90534-3.00033-0 · Cited by 1
Ban, J.-W., Perera, R., & Williams, V. (2023) · BMC Family Practice · doi:10.1186/s12875-023-02155-w
“Background Health research is valuable when it creates knowledge that can improve the decisions of patients, clinicians, and policymakers; or when other researchers can use the results to synthesize such knowledge [1].”
BackgroundBronkhorst, H., van Weerden, W. M., Bunnik, E. M., & Zwart, H. A. E. (2023) · Research Involvement and Engagement · doi:10.1186/s40900-023-00498-3 · Cited by 1
Field, K. M., Rosenthal, M. A., Gillett, P., & IJzerman, M. J. (2023) · Journal of Clinical Neuroscience · doi:10.1016/j.jocn.2023.07.024
Chatio, S. T., Ansah, N. A., Nonterah, E. A., Bangre, O., Awuni, D., Kuwolamo, I., Asoala, V., & Ansah, P. B. (2024) · International Journal of Clinical Trials · doi:10.18203/2349-3259.ijct20240039
Rault, M., Banâtre, A., Lucas, G., Myhie, D., & Maury, A. (2024) · Pédagogie médicale · doi:10.1051/pmed/2024002
Kelter, R. (2024) · Statistics in Biosciences · doi:10.1007/s12561-024-09425-w · Cited by 2
Gastric Cancer associated with the use of Omeprazole in Adults
Joaquín, A. A. A., & Sabattini, A. C. (2024) · SCT Proceedings in Interdisciplinary Insights and Innovations. · doi:10.56294/piii2024332
Bargeri, S., Basso, G., Geraci, I., Castellini, G., Chiarotto, A., Gianola, S., Ostelo, R., Testa, M., & Innocenti, T. (2024) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2024.111465 · Cited by 1
Gao, J., Xiaoyuan, C., & Chenyan, G. (2024) · Health care science · doi:10.1002/hcs2.108
Chiva, L. M., & Ordás, P. (2024) · International Journal of Gynecological Cancer · doi:10.1136/ijgc-2024-006139
Hviid et al. 2019 Vaccine-Autism Study: Much Ado About Nothing?Preprint
Hammond, J., Varia, J. C., & Hooker, B. S. (2025) · Preprints.org · doi:10.20944/preprints202501.0796.v1
Hviid et al. 2019 Vaccine-Autism Study: Much Ado About Nothing?Preprint
Hammond, J., Varia, J. C., & Hooker, B. S. (2025) · Preprints.org · doi:10.20944/preprints202501.0796.v2
Optimizing the question: Balancing significance and feasibility
Ibrahim, M., & Alnajar, A. (2025) · Elsevier eBooks · doi:10.1016/b978-0-323-91790-2.00042-3
Didyk, C., Lewis, L. K., & Lange, B. S. (2025) · Disability and Rehabilitation · doi:10.1080/09638288.2025.2459895
Co-designing and Evaluating Oral Health Promotion Interventions for Vulnerable Groups
(2025) · Frontiers research topics · doi:10.3389/978-2-8325-6206-2
Vesga, S. E. A., González, M., Rojas, D. M., Ospina, J., Duque, S., & Castaño, A. Á. (2025) · Biomédica · doi:10.7705/biomedica.7239
Development and implementation of a novel metric score ( SciMet ) for scientific publications
Díaz, E. S., Viveros-Carreño, D. A., Levin, G., Ramirez, P. T., & Pareja, R. (2025) · International Journal of Gynecology & Obstetrics · doi:10.1002/ijgo.70147
“4 To the best of our knowledge, there has been no prior study focused on evaluating leading and outstanding publications within the field of gynecology oncology.”
Handling conflicts of interest concerns more than transparency
Bouter, L. M. (2025) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2025.111801
Chocó-Cedillos, A. (2025) · Revista Científica · doi:10.54495/rev.cientifica.v32i2.419
The IND Process: Innovation and challenges
Wasiullah, M., Yadav, D. P. Y. D. P., Yadav, S. Y. S., & Maurya, N. M. N. (2025) · International Journal of Pharmaceutical Research and Applications · doi:10.35629/4494-100223562362
Emotion Regulation and Childhood Obesity: Co-designing a Mobile App for School-Aged Children
Cipriano, A., Rosato, M. S., Veneziano, R., Napolano, R., Cotrufo, P., & Cella, S. (2025) · Smart innovation, systems and technologies · doi:10.1007/978-981-96-0994-9_31
Abordagens em Monitoramento de Dados: Estratégias aplicáveis a pesquisa clínica acadêmica
Cunegatto, F. R., Medolago, N. B., Horn, T. S., & Freitas, V. L. D. O. (2025) · Clinical & Biomedical Research · doi:10.22491/2357-9730.139974
Lapierre, N., Mortenson, W. B., Labrie, D., Huet‐Fiola, C., Morales, E., & Routhier, F. (2025) · Health & Social Care in the Community · doi:10.1155/hsc/7325259
“In research context, co-creation design can allow for research questions and outcomes more relevant to end-users [35].”
Tsocheva, I., Chavda, J., Scales, J., Dove, R. E., Kalsi, H. S., Wood, H. E., Colligan, G., Cross, L., Sartori, L., Moon, J., et al. (2025) · Environmental Health Insights · doi:10.1177/11786302251328831
Management of acute sinusitis in children: an umbrella review
Machado, J. A. L., Morales, D. I. E., & Cárdenas, A. Z. (2025) · Romanian Journal of Rhinology · doi:10.2478/rjr-2025-0016
Restoring Guidelines: EBM-X to Bring Critical Thinking and Humility Back to Evidence-Based Medicine
Martinez, L., Mena, L. A. P., Cubilhas, B., Monteiro, D., Canteri, A., & Fregni, F. (2025) · Principles and Practice of Clinical Research Journal · doi:10.21801/ppcrj.2025.112.9
Nekhlopochyn, O. S. (2025) · Ukrainian Neurosurgical Journal · doi:10.25305/unj.325812 · Cited by 1
“As a result, the total cost of treatment may increase, the efficiency of healthcare resource utilization may decline, and the socio-economic burden on both http://theunj.org patients and the healthcare system as a whole may rise [56,57].”
Kabić, T., Munitić, M. Š., Weerasekara, I., Bała, M. M., Zając, J., Briel, M., Pieper, D., & Puljak, L. (2025) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2025.112008
Devoy, C., Devoy, C., McLaughlin, R. A., Cronin, C., Clarke, R., Connolly, R. M., Crowley, E., Raigal‐Aran, L., Collins, D., Bird, B., et al. (2025) · Journal of Translational Medicine · doi:10.1186/s12967-025-07074-1 · Cited by 1
“However, many translational studies fall short of these standards, limiting their real-world impact and generalisability [1, 2].”
Terapia sistémica del conocimiento clínico
Jurado, A. J. N. (2025) · Revista Clínica de Medicina de Familia · doi:10.55783/rcmf.180306
Converting Data into Interpretation
Kaplan, D. (2025) · Springer eBooks · doi:10.1007/978-3-032-08228-2_8
Jayeoba, M., Sohn, R., Weiss, A. L., Stanič, A., Mazzetta, R., Pham, A., Scanlan, L., Garcia, M., Sidhu, A., Ho, E. E., et al. (2026) · Journal of Medical Internet Research · doi:10.2196/87514
Next Generation Hierarchy for Next Generation Medicine
Buazzi, M. M. (2025) · Journal of The Best Available Evidence in Medicine · doi:10.63720/v1i2006
Software Testing Education and Industry Needs - Report from the ENACTEST EU Project
Saadatmand, M., Abbas, M., Marín, B., Paiva, A. C. R., Asch, N. V., Moran, G., Cammaerts, F., Snoeck, M., & Mendes, A. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-12092-2_4
Herrera, R. M. A., Lazaro, A. C. D. P., Torres, I. J. V., Rodriguez, A. W. O., & Rivera, O. P. L. (2025) · doi:10.70165/cici.120
Samskapande av ett dialogverktyg för samverkan mellan forskare och hälso- och sjukvårdspersonal
Laustsen, C. E., Haak, M., Petersson, P., & Westergren, A. (2025) · Äldre i Centrum Vetenskapligt supplement · doi:10.52585/icvs.v6i1.25
Gleadhill, C., Alderman, K. B., Davidson, S. R. E., Kamper, S. J., Tutty, A., Robson, E., da Silva, P. V., Donald, B., Dooley, K., Manvell, J., et al. (2022) · Figshare · doi:10.6084/m9.figshare.21592574
Beets, M. W., Pfledderer, C. D., von Klinggraeff, L., Burkart, S. A., & Armstrong, B. (2022) · Figshare · doi:10.6084/m9.figshare.21228715
Gleadhill, C., Williams, C. M., Kamper, S. J., Alderman, K. B., Delbridge, A., Mahon, B., Donald, B., Delore, C., Boettcher, C., Renfrew, D., et al. (2023) · Figshare · doi:10.6084/m9.figshare.23240083
Gleadhill, C., Alderman, K. B., Davidson, S. R. E., Kamper, S. J., Tutty, A., Robson, E., da Silva, P. V., Donald, B., Dooley, K., Manvell, J., et al. (2022) · Figshare · doi:10.6084/m9.figshare.21592577
Gleadhill, C., Williams, C. M., Kamper, S. J., Alderman, K. B., Delbridge, A., Mahon, B., Donald, B., Delore, C., Boettcher, C., Renfrew, D., et al. (2023) · Figshare · doi:10.6084/m9.figshare.23240086
Ban, J. W., Perera, R., & Williams, V. (2023) · Figshare · doi:10.6084/m9.figshare.24172075
Peters, S., Guccione, L., Francis, J., Best, S., Tavender, E. J., Curran, J., Davies, K., Rowe, S., Palmer, V. J., & Klaic, M. (2024) · Figshare · doi:10.6084/m9.figshare.27000757
Anthony, N., Pellen, C., Ohmann, C., Moher, D., & Naudet, F. (2021) · Figshare · doi:10.6084/m9.figshare.14741249
Peters, S., Guccione, L., Francis, J., Best, S., Tavender, E. J., Curran, J., Davies, K., Rowe, S., Palmer, V. J., & Klaic, M. (2024) · Figshare · doi:10.6084/m9.figshare.27000760
Ban, J. W., Perera, R., & Williams, V. (2023) · Figshare · doi:10.6084/m9.figshare.24172078
Peters, S., Guccione, L., Francis, J., Best, S., Tavender, E. J., Curran, J., Davies, K., Rowe, S., Palmer, V. J., & Klaic, M. (2024) · Figshare · doi:10.6084/m9.figshare.27000754
Generating Evidence for COPD Clinical Guidelines Using EHRs
Johnson, A. M. (2019) · Purdue e-Pubs (Purdue University System) · doi:10.25394/pgs.8980349
Gleadhill, C., Alderman, K. B., Davidson, S. R. E., Kamper, S. J., Tutty, A., Robson, E., da Silva, P. V., Donald, B., Dooley, K., Manvell, J., et al. (2022) · Figshare · doi:10.6084/m9.figshare.21592571
Evans, J. M., Gilbert, J. E., Bacola, J., Hagens, V. K., Simanovski, V., Holm, P., Harvey, R., Blake, P. G., & Matheson, G. (2021) · Figshare · doi:10.6084/m9.figshare.16786821
Evans, J. M., Gilbert, J. E., Bacola, J., Hagens, V. K., Simanovski, V., Holm, P., Harvey, R., Blake, P. G., & Matheson, G. (2021) · Figshare · doi:10.6084/m9.figshare.16786815
Evans, J. M., Gilbert, J. E., Bacola, J., Hagens, V. K., Simanovski, V., Holm, P., Harvey, R., Blake, P. G., & Matheson, G. (2021) · Figshare · doi:10.6084/m9.figshare.16786818
Wong Shee, A., Donaldson, A., Clapham, R. P., Aitken, J. C., Ananthapavan, J., Ugalde, A., Versace, V. L., & Namara, K. M. (2024) · Figshare · doi:10.6084/m9.figshare.26549282
Additional file 1 of Implementation science in maternity care: a scoping review
Dadich, A., Piper, A., & Coates, D. (2021) · Figshare · doi:10.6084/m9.figshare.13719531
Peters, S., Guccione, L., Francis, J., Best, S., Tavender, E. J., Curran, J., Davies, K., Rowe, S., Palmer, V. J., & Klaic, M. (2024) · Figshare · doi:10.6084/m9.figshare.27000751
Metadata
- Authors
- Ioannidis, J. P. A.
- Affiliations
- Stanford Medicine (US)
- Corresponding author
- Ioannidis, John P. A.
- Venue
- PLOS Medicine
- Publisher
- Public Library of Science (PLoS)
- Published
- 2016-06-21
- Volume
- 13
- Issue
- 6
- Pages
- e1002049
- ISSN
- 1549-1277 (ISSN-L)
- 1549-1676
- PMC
- PMC4915619
- OpenAlex
- W2469474955
- Cited by
- 655
- References
- 56
- Citations by year
- 2026: 68 · 2025: 55 · 2024: 48 · 2023: 60 · 2022: 55 · 2021: 77 · 2020: 81 · 2019: 59 · 2018: 69 · 2017: 65 · 2016: 18
- FWCI
- 69.75
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS Medicine (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- Patient-Centered Outcomes Research Institute
- Laura and John Arnold Foundation
- National Institutes of Health
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Health and Medical Research Impacts
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Health Professions › General Health Professions › Healthcare cost, quality, practices
- Keywords
- research value, research reform, problem-based research, information gain, pragmatism, patient-oriented research, value for money, feasibility, research transparency
- MeSH terms
- Humans, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.