Time to reality check the promises of machine learning-powered precision medicine.
Open accessThe DOI matches its Crossref record; 32 of the 34 references it cites were found in a registry or an index.
Abstract
Machine learning methods, combined with large electronic health databases, could enable a personalised approach to medicine through improved diagnosis and prediction of individual responses to therapies. If successful, this strategy would represent a revolution in clinical research and practice. However, although the vision of individually tailored medicine is alluring, there is a need to distinguish genuine potential from hype. We argue that the goal of personalised medical care faces serious challenges, many of which cannot be addressed through algorithmic complexity, and call for collaboration between traditional methodologists and experts in medical machine learning to avoid extensive research waste.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Thereby, an attentive awareness of the differences between conventional and digitalized research methods in deriving knowledge from big data is of high relevance, as certain automated approaches lack testable hypotheses, conceptual frameworks or theoretical foundations (Kriston, 2020), as indispensable theoretical presuppositions for causal inferences (Wilkinson et al., 2020).”
From More Light? Opportunities and Pitfalls in Digitalized Psychotherapy Process Research (2021) · cites this paper as Wilkinson et al., 2020
In the citing paper
“As such, some methods relying on machine learning and artificial intelligence are not suitable to detect causal mechanisms in clinical settings, as they might impede transparency and replicability, which have to remain indispensable criteria for various decisions in healthcare.”
From More Light? Opportunities and Pitfalls in Digitalized Psychotherapy Process Research (2021) · cites this paper as Wilkinson et al., 2020
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Causal Diagrams for Epidemiologic Research
Greenland, S., Pearl, J., & Robins, J. M. (1999) · Epidemiology · doi:10.1097/00001648-199901000-00008 · Cited by 3,728 · cited 1×
“A suite of methodological approaches are available to aid estimation of causal effects in non experimental data, 23,24 such as electronic health records, which potentially offer more diverse and relevant sam ples than clinical trials (although representative samples might not be necessary to…”
MethodHannun, A. Y., Rajpurkar, P., Haghpanahi, M., Tison, G. H., Bourn, C., Turakhia, M. P., & Ng, A. Y. (2019) · Nature Medicine · doi:10.1038/s41591-018-0268-3 · Cited by 3,148
Air Pollution and Hospital Admissions for Heart Disease in Eight U.S. Counties
Schwartz, J. (1999) · Epidemiology · doi:10.1097/00001648-199901000-00005 · Cited by 3,038
Shmueli, G. (2010) · Statistical Science · doi:10.1214/10-sts330 · Cited by 2,517
Mostly Harmless Econometrics: An Empiricist's Companion
Kmenta, J. (2010) · Business Economics · doi:10.1057/be.2009.37 · Cited by 2,495
Liu, X., Faes, L., Kale, A. U., Wagner, S. K., Fu, D. J., Bruynseels, A., Mahendiran, T., Moraes, G., Shamdas, M., Kern, C., et al. (2019) · The Lancet Digital Health · doi:10.1016/s2589-7500(19)30123-2 · Cited by 1,883
Abràmoff, M. D., Lavin, P. T., Birch, M., Shah, N., & Folk, J. C. (2018) · npj Digital Medicine · doi:10.1038/s41746-018-0040-6 · Cited by 1,638
Rajpurkar, P., Irvin, J., Ball, R. L., Zhu, K., Yang, B., Mehta, H., Duan, T., Ding, D., Bagul, A., Langlotz, C. P., et al. (2018) · PLOS Medicine · doi:10.1371/journal.pmed.1002686 · Cited by 1,449 · cited 1×
“7 Given such innovation, it is hard to dispute the revolu tionary potential of machine learning for improving clinical diagnostics.”
BackgroundNagendran, M., Chen, Y., Lovejoy, C. A., Gordon, A. C., Komorowski, M., Harvey, H., Topol, E. J., Ioannidis, J. P. A., Collins, G. S., & Maruthappu, M. (2020) · BMJ · doi:10.1136/bmj.m689 · Cited by 1,152 · cited 1×
“15 Emphasis on predictive performance over clinical utility is not unusual.”
BackgroundSwitching from insulin to oral sulfonylureas in patients with diabetes due to Kir6.2 mutations
Pearson, E. R., Flechtner, I., Njølstad, P. R., Malecki, M. T., Flanagan, S. E., Larkin, B., Ashcroft, F. M., Klimes, I., Codner, E., Iotova, V., et al. (2006) · New England Journal of Medicine · doi:10.1056/nejmoa061759 · Cited by 988 · cited 1×
“30 However, in most cases, characterising and predicting treatment responses is undermined for the very reasons we seek to use precision medicine—health is complex—and under standing the determinants of variation in response is a formidable challenge.”
Background
Cited by
Machine learning for medical imaging: methodological failures and recommendations for the future
Varoquaux, G., & Cheplygina, V. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00592-y · Cited by 656
From promise to practice: towards the realisation of AI-informed mental health care
Koutsouleris, N., Hauser, T. U., Skvortsova, V., & De Choudhury, M. (2022) · The Lancet Digital Health · doi:10.1016/s2589-7500(22)00153-4 · Cited by 251
Causal machine learning for healthcare and precision medicine
Sanchez, P., Voisey, J. P., Xia, T., Watson, H. I., O’Neil, A. Q., & Tsaftaris, S. A. (2022) · Royal Society Open Science · doi:10.1098/rsos.220638 · Cited by 211
Modern views of machine learning for precision psychiatry
Chen, Z. S., Kulkarni, P. (., Galatzer-Levy, I. R., Bigio, B., Nasca, C., & Zhang, Y. (2022) · Patterns · doi:10.1016/j.patter.2022.100602 · Cited by 210
“However, the amount of precision that can be modeled us-ing ML is far beyond the first level [158, 159].”
BackgroundThe three ghosts of medical AI: Can the black-box present deliver?
Quinn, T. P., Jacobs, S., Senadeera, M., Le, V., & Coghlan, S. (2022) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2021.102158 · Cited by 215
Metadata
- Authors
- Wilkinson, J., Arnold, K. F., Murray, E. J., van Smeden, M., Carr, K., Sippy, R., de Kamps, M., Beam, A., Konigorski, S., Lippert, C., Gilthorpe, M. S., & Tennant, P. W. G.
- Affiliations
- Manchester Academic Health Science Centre (GB)
- University of Leeds (GB)
- Boston University (US)
- Harvard University (US)
- SUNY Upstate Medical University (US)
- Hasso Plattner Institute (DE)
- Corresponding author
- Wilkinson, Jack
- ORCID
- Venue
- The Lancet Digital Health
- Publisher
- Elsevier BV
- Published
- 2020-12
- Volume
- 2
- Issue
- 12
- Pages
- e677-e680
- ISSN
- 2589-7500 (ISSN-L)
- PMC
- PMC9060421
- OpenAlex
- W3086029573
- Cited by
- 233
- References
- 34
- Citations by year
- 2026: 18 · 2025: 34 · 2024: 41 · 2023: 46 · 2022: 55 · 2021: 35 · 2020: 4
- FWCI
- 13.76
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
- creativecommons.org/licenses/by/4.0/ (vor)
- Locations
- The Lancet Digital Health (publishedVersion, cc-by)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion, cc-by)
- White Rose Research Online (University of Leeds, The University of Sheffield, University of York) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Research Explorer (The University of Manchester) (submittedVersion, cc-by)
- St Andrews Research Repository (St Andrews Research Repository) (submittedVersion, cc-by)
- Apollo (University of Cambridge) (submittedVersion, cc-by)
- Funders
- Bundesministerium für Bildung und Forschung (01|S19066)
- Wellcome Trust (204796/Z/16/Z)
- Alan Turing Institute (EP/N510129/1)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Keywords
- machine learning, precision medicine, personalized medicine, electronic health records, clinical prediction, treatment response prediction, research waste, clinical research challenges
- MeSH terms
- Machine Learning, Delivery of Health Care, Humans, Precision Medicine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Time to reality check the promises of machine learning-powered precision medicine. https://app.cochat.ai/papers/10.1016/s2589-7500(20)30200-4
- The paper
- Wilkinson, J., Arnold, K. F., Murray, E. J., van Smeden, M., Carr, K., Sippy, R., de Kamps, M., Beam, A., Konigorski, S., Lippert, C., Gilthorpe, M. S., & Tennant, P. W. G. (2020). Time to reality check the promises of machine learning-powered precision medicine. The Lancet Digital Health. https://doi.org/10.1016/s2589-7500(20)30200-4
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.