Reporting of artificial intelligence prediction models
Open accessThe DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
www.thelancet.com Vol 393 April 20, 2019 1577 shortcut, investing in magic bullets such as vaccines, antiretrovirals, and bednets that could be distributed without a well functioning healthcare system, and even in war zones. These programmes saved millions of lives, but failed to launch the anticipated virtuous cycle of development, poverty reduction, and improved health systems. Many African countries remain deeply impoverished, and although child mortality has plummeted, weak health systems remain ill equipped to address soaring numbers of deaths and disability from heart disease, cancer, and other non communicable diseases. Bollyky and colleagues’ findings suggest a possible reason for this dispiriting reality: many of the countries with the worst health systems are governed by corrupt autocrats who retain power by force and can ignore the welfare of their people without repercussions. To date, the global development community has skirted the complications of politics, instead emphasising medical programmes and the empower ment of women, the LGBT+ (lesbian, gay, bisexual, transgender, and all other identities) community, and people with disabilities—ie, people who do not directly challenge government power. This emphasis is sometimes justified by the longstanding assumption that in poor countries, especially, dictators are better at getting things done because they can ignore the demands of petty, competing constituencies. However, Bollyky’s findings support the theory…
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The welcome emergence of RCTs seeking to evaluate newer interventions based on, or including, an AI component (called ‘AI interventions’ here)23,26–31 has similarly been met with concerns about the design and reporting25,32–34.”
From Reporting guidelines for clinical trial reports for interventions involving artificial intelligence: the CONSORT-AI extension (2020) · cites this paper as [32]
In the citing paper
“of randomized controlled trials seeking to evaluate the clinical efficacy of newer interventions based on, or including, an AI component (called ‘AI interventions’ here)15,18–23 has similarly been met with concerns about design and reporting17,24–26.”
From Guidelines for clinical trial protocols for interventions involving artificial intelligence: the SPIRIT-AI extension (2020) · cites this paper as [24]
In the citing paper
“However, explainability methods will be essential in accurately interpreting the”
From Artificial intelligence and endo-histo-omics: new dimensions of precision endoscopy and histology in inflammatory bowel disease (2024) · cites this paper as [94]
In the citing paper
“but there is an important stage of research between these, namely studies focussing on the initial clinical use of AI systems, for which no such guidance currently exists”
From Reporting guideline for the early stage clinical evaluation of decision support systems driven by artificial intelligence: DECIDE-AI (2022) · cites this paper as [23]
In the citing paper
“the introduction of an ML-specific standard has been announced lately [46]”
From Moving from bytes to bedside: a systematic review on the use of artificial intelligence in the intensive care unit (2021) · cites this paper as [46]
Citations
Cites
Prediction of coronary heart disease using risk factor categories
Wilson, P. W. F., D’Agostino, R. B., Levy, D., Belanger, A. M., Silbershatz, H., & Kannel, W. B. (1998) · Circulation · doi:10.1161/01.cir.97.18.1837 · Cited by 9,581
Moons, K. G. M., Altman, D. G., Reitsma, J. B., Ioannidis, J. P. A., Macaskill, P., Steyerberg, E. W., Vickers, A. J., Ransohoff, D. F., & Collins, G. S. (2015) · Annals of Internal Medicine · doi:10.7326/m14-0698 · Cited by 5,147
Self-citationCollins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · Annals of Internal Medicine · doi:10.7326/m14-0697 · Cited by 3,267
Self-citationMalinchoc, M., Kamath, P. S., Gordon, F. D., Peine, C. J., Rank, J., & ter Borg, P. C. J. (2000) · Hepatology · doi:10.1053/he.2000.5852 · Cited by 2,893
Hippisley-Cox, J., Coupland, C., & Brindle, P. (2017) · BMJ · doi:10.1136/bmj.j2099 · Cited by 1,703
Johnston, S. C., Rothwell, P. M., Nguyen-Huynh, M. N., Giles, M. F., Elkins, J. S., Bernstein, A. L., & Sidney, S. (2007) · The Lancet · doi:10.1016/s0140-6736(07)60150-0 · Cited by 1,338
Machine Learning and Prediction in Medicine — Beyond the Peak of Inflated Expectations
Chen, J. H., & Asch, S. M. (2017) · New England Journal of Medicine · doi:10.1056/nejmp1702071 · Cited by 1,171
Prediction models for cardiovascular disease risk in the general population: systematic review
Damen, J. A. A. G., Hooft, L., Schuit, E., Debray, T. P. A., Collins, G. S., Tzoulaki, I., Lassale, C. M., Siontis, G. C. M., Chiocchia, V., Roberts, C., et al. (2016) · BMJ · doi:10.1136/bmj.i2416 · Cited by 935
Self-citationCollins, G. S., de Groot, J. A., Dutton, S., Omar, O., Shanyinde, M., Tajar, A., Voysey, M., Wharton, R., Yu, L.-M., Moons, K. G., et al. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-40 · Cited by 729
Self-citationReporting and Methods in Clinical Prediction Research: A Systematic Review
Bouwmeester, W., Zuithoff, N. P. A., Mallett, S., Geerlings, M. I., Vergouwe, Y., Steyerberg, E. W., Altman, D. G., & Moons, K. G. M. (2012) · PLoS Medicine · doi:10.1371/journal.pmed.1001221 · Cited by 600
Self-citation
Cited by
Collins, G. S., Moons, K. G. M., Dhiman, P., Riley, R. D., Beam, A. L., Van Calster, B., Ghassemi, M., Liu, X., Reitsma, J. B., van Smeden, M., et al. (2024) · BMJ · doi:10.1136/bmj-2023-078378 · Cited by 4,718
Self-citationKey challenges for delivering clinical impact with artificial intelligence
Kelly, C. J., Karthikesalingam, A., Suleyman, M., Corrado, G., & King, D. (2019) · BMC Medicine · doi:10.1186/s12916-019-1426-2 · Cited by 3,136
Liu, X., Faes, L., Kale, A. U., Wagner, S. K., Fu, D. J., Bruynseels, A., Mahendiran, T., Moraes, G., Shamdas, M., Kern, C., et al. (2019) · The Lancet Digital Health · doi:10.1016/s2589-7500(19)30123-2 · Cited by 1,883
Artificial intelligence and deep learning in ophthalmology
Ting, D. S. W., Pasquale, L. R., Peng, L., Campbell, J. P., Lee, A. Y., Raman, R., Tan, G. S. W., Schmetterer, L., Keane, P. A., & Wong, T. Y. (2019) · British Journal of Ophthalmology · doi:10.1136/bjophthalmol-2018-313173 · Cited by 1,554
Artificial Intelligence and Deep Learning in Ophthalmology
Wang, Z., Keane, P. A., Chiang, M., Cheung, C. Y., Wong, T. Y., & Ting, D. S. W. (2022) · Artificial Intelligence in Medicine · doi:10.1007/978-3-030-64573-1_200 · Cited by 1,524
Metadata
- Authors
- Collins, G. S., & Moons, K. G. M.
- Affiliations
- Utrecht University (NL)
- ORCID
- Moons, Karel G M
- Venue
- The Lancet
- Publisher
- Elsevier BV
- Published
- 2019-04
- Volume
- 393
- Issue
- 10181
- Pages
- 1577-1579
- ISSN
- 0099-5355 (ISSN-L)
- 0140-6736
- OpenAlex
- W2937186836
- Cited by
- 701
- References
- 13
- Citations by year
- 2026: 78 · 2025: 73 · 2024: 91 · 2023: 87 · 2022: 96 · 2021: 162 · 2020: 100 · 2019: 12
- FWCI
- 29.33
- Type
- journal article
- Language
- en
- Open access
- green
- dspace.library.uu.nl
- Licence
- other-oa
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
- Locations
- The Lancet (publishedVersion)
- PubMed (publishedVersion)
- Utrecht University Repository (Utrecht University) (submittedVersion, other-oa)
- Utrecht University Repository (Utrecht University) (submittedVersion)
- Funders
- Cancer Research UK (27294, 16895)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Keywords
- artificial intelligence, machine learning, prediction model, reporting guidelines, digital health, health apps, mobile health, e-health, intelligent monitoring, clinical research reporting
- MeSH terms
- Artificial Intelligence, Prognosis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Reporting of artificial intelligence prediction models. https://app.cochat.ai/papers/10.1016/s0140-6736(19)30037-6
- The paper
- Collins, G. S., & Moons, K. G. M. (2019). Reporting of artificial intelligence prediction models. The Lancet. https://doi.org/10.1016/s0140-6736(19)30037-6
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.