Medicine is plagued by untrustworthy clinical trials. How many studies are faked or flawed?
The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Shakur, H., Roberts, I., Fawole, B., Chaudhri, R., El-Sheikh, M., Akintan, A., Qureshi, Z., Kidanto, H., Vwalika, B., Abdulkadir, A., et al. (2017) · The Lancet · doi:10.1016/s0140-6736(17)30638-4 · Cited by 1,469
False individual patient data and zombie randomised controlled trials submitted to Anaesthesia
Carlisle, J. B. (2021) · Anaesthesia · doi:10.1111/anae.15263 · Cited by 173
Ivermectin for preventing and treating COVID-19
Popp, M., Reis, S., Schießer, S., Hausinger, R. I., Stegemann, M., Metzendorf, M.-I., Kranke, P., Meybohm, P., Skoetz, N., & Weibel, S. (2022) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd015017.pub3 · Cited by 169
The knowledge system underpinning healthcare is not fit for purpose and must change
Roberts, I., Ker, K., Edwards, P., Beecher, D., Manno, D., & Sydenham, E. (2015) · BMJ · doi:10.1136/bmj.h2463 · Cited by 126
Tranexamic Acid to Prevent Obstetrical Hemorrhage after Cesarean Delivery
Pacheco, L. D., Clifton, R. G., Saade, G. R., Weiner, S. J., Parry, S. I., Thorp, J. M., Longo, M., Salazar, A., Dalton, W., Tita, A., et al. (2023) · New England Journal of Medicine · doi:10.1056/nejmoa2207419 · Cited by 124
Tocolytics for delaying preterm birth: a network meta-analysis (0924)
Wilson, A., Morton, V. H., Marson, E. J., Markland, A. D., Larkai, E., Papadopoulou, A., Coomarasamy, A., Tobías, A., Chou, D., Oladapo, O. T., et al. (2022) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd014978.pub2 · Cited by 117
Sotiriadis, A., Makrydimas, G., Papatheodorou, S., & Ioannidis, J. P. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006614.pub2 · Cited by 114
Sotiriadis, A., Makrydimas, G., Papatheodorou, S., Ioannidis, J. P. A., & McGoldrick, E. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006614.pub3 · Cited by 83
Ker, K., Shakur, H., & Roberts, I. (2016) · BJOG: An International Journal of Obstetrics & Gynaecology · doi:10.1111/1471-0528.14267 · Cited by 66
Bellos, I., & Pergialiotis, V. (2021) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2021.09.025 · Cited by 65
Research works printed but not linked: 5
- Popp, M. et al. Cochrane Database Syst. Rev. 6, CD015017 (2022).
- Sotiriadis, A. et al. Cochrane Database Syst. Rev. 8, CD006614 (2018).
- Sotiriadis, A. et al. Cochrane Database Syst. Rev. 8, CD006614 (2021).
- Wilson, A. et al. Cochrane Database Syst. Rev. 8, CD014978 (2022).
- Boughton, S. L., Wilkinson, J. & Bero, L. Cochrane Database Syst. Rev. 6, ED000152 (2021).
Cited by
Leveraging generative AI for clinical evidence synthesis needs to ensure trustworthiness
Zhang, G., Jin, Q., Jered McInerney, D., Chen, Y., Wang, F., Cole, C. L., Yang, Q., Wang, Y., Malin, B. A., Peleg, M., et al. (2024) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2024.104640 · Cited by 40
Wright, D. E., Wright, A., Magee, L. A., von Dadelszen, P., & Nicolaides, K. H. (2024) · BJOG An International Journal of Obstetrics & Gynaecology · doi:10.1111/1471-0528.17769 · Cited by 30
“Other than publication bias, extreme effects could reflect a lack of trustworthiness 24 ; more likely to occur in smaller trials with limited oversight and scrutiny.”
Wittau, J., & Seifert, R. (2024) · Naunyn-Schmiedeberg s Archives of Pharmacology · doi:10.1007/s00210-024-03272-8 · Cited by 36
Inclusion of Retracted Studies in Systematic Reviews and Meta-Analyses of Interventions
Graña, C., Cabanac, G., Perrodeau, É., Ghosn, L., Ravaud, P., & Boutron, I. (2025) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2025.0256 · Cited by 29
How Can the Clinical Aptitude of AI Assistants Be Assayed?
Thirunavukarasu, A. J. (2023) · Journal of Medical Internet Research · doi:10.2196/51603 · Cited by 19
“Not all RCTs are created equal, with bias, fraud, and opaque reporting all reducing confidence in conclusions [16].”
Metadata
- Authors
- Van Noorden, R.
- Venue
- Nature
- Published
- 2023-07-18
- Volume
- 619
- Issue
- 7970
- Pages
- 454-458
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W4384664793
- Semantic Scholar
- 194118003f450acd96d43f98a4fa778bcc42206b
- Cited by
- 87
- References
- 14
- Citations by year
- 2026: 30 · 2025: 17 · 2024: 33 · 2023: 6
- FWCI
- 21.46
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Social Sciences › Education › Academic integrity and plagiarism
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Health Sciences › Nursing › Issues, ethics and legal aspects › Pharmaceutical industry and healthcare
- Keywords
- clinical trial integrity, research misconduct, fabricated data, publication bias
- MeSH terms
- Scientific Experimental Error, Clinical Trials as Topic, Fraud, Humans, Medicine, Scientific Misconduct
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Medicine is plagued by untrustworthy clinical trials. How many studies are faked or flawed? https://app.cochat.ai/papers/10.1038/d41586-023-02299-w
- The paper
- Van Noorden, R. (2023). Medicine is plagued by untrustworthy clinical trials. How many studies are faked or flawed? Nature. https://doi.org/10.1038/d41586-023-02299-w
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.