The DOI matches its Crossref record; 67 of the 67 references it cites were found in a registry or an index.
Machine learning and artificial intelligence research for patient benefit: 20 critical questions on transparency, replicability, ethics, and effectiveness
Open accessAbstract
Machine learning, artificial intelligence, and other modern statistical methods are providing new opportunities to operationalise previously untapped and rapidly growing sources of data for patient benefit. Despite much promising research currently being undertaken, particularly in imaging, the literature as a whole lacks transparency, clear reporting to facilitate replicability, exploration for potential ethical concerns, and clear demonstrations of effectiveness. Among the many reasons why these problems exist, one of the most important (for which we provide a preliminary solution here) is the current lack of best practice guidance specific to machine learning and artificial intelligence. However, we believe that interdisciplinary groups pursuing research and impact projects involving machine learning and artificial intelligence for health would benefit from explicitly addressing a series of questions concerning transparency, reproducibility, ethics, and effectiveness (TREE). The 20 critical questions proposed here provide a framework for research groups to inform the design, conduct, and reporting; for editors and peer reviewers to evaluate contributions to the literature; and for patients, clinicians and policy makers to critically appraise where new findings may deliver patient benefit.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Advances in neural information processing systems 7
Cios, K., & Shields, M. (1997) · Neurocomputing · doi:10.1016/s0925-2312(97)90018-7 · Cited by 22,059
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
Improving neural networks by preventing co-adaptation of feature detectors
Hinton, G. E., Srivastava, N., Krizhevsky, A., Sutskever, I., & Salakhutdinov, R. R. (2012) · arXiv · doi:10.48550/arxiv.1207.0580 · Cited by 6,382
Benchimol, E. I., Smeeth, L., Guttmann, A., Harron, K., Moher, D., Petersen, I., Sørensen, H. T., von Elm, E., Langan, S. M., & RECORD Working Committee (2015) · PLOS Medicine · doi:10.1371/journal.pmed.1001885 · Cited by 5,749
Moons, K. G. M., Altman, D. G., Reitsma, J. B., Ioannidis, J. P. A., Macaskill, P., Steyerberg, E. W., Vickers, A. J., Ransohoff, D. F., & Collins, G. S. (2015) · Annals of Internal Medicine · doi:10.7326/m14-0698 · Cited by 5,147
Self-citationTowards A Rigorous Science of Interpretable Machine Learning
Doshi-Velez, F., & Kim, B. (2017) · arXiv · doi:10.48550/arxiv.1702.08608 · Cited by 3,121
Clinically applicable deep learning for diagnosis and referral in retinal disease
De Fauw, J., Ledsam, J. R., Romera-Paredes, B., Nikolov, S., Tomasev, N., Blackwell, S., Askham, H., Glorot, X., O’Donoghue, B., Visentin, D., et al. (2018) · Nature Medicine · doi:10.1038/s41591-018-0107-6 · Cited by 2,639
Scalable and accurate deep learning with electronic health records.
Rajkomar, A., Oren, E., Chen, K., Dai, A. M., Hajaj, N., Hardt, M., Liu, P. J., Liu, X., Marcus, J., Sun, M., et al. (2018) · eScholarship (California Digital Library) · Cited by 2,242
Christodoulou, E., Ma, J., Collins, G. S., Steyerberg, E. W., Verbakel, J. Y., & Van Calster, B. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.02.004 · Cited by 2,119 · cited 1×
“40 We would urge researchers to keep this in mind when carrying out such comparisons.”
BackgroundIncreasing value and reducing waste in research design, conduct, and analysis
Ioannidis, J. P. A., Greenland, S., Hlatky, M. A., Khoury, M. J., Macleod, M. R., Moher, D., Schulz, K. F., & Tibshirani, R. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62227-8 · Cited by 1,597
Self-citationPrognosis Research Strategy (PROGRESS) 3: Prognostic Model Research
Steyerberg, E. W., Moons, K. G. M., van der Windt, D. A., Hayden, J. A., Perel, P., Schroter, S., Riley, R. D., Hemingway, H., Altman, D. G., & for the PROGRESS Group (2013) · PLoS Medicine · doi:10.1371/journal.pmed.1001381 · Cited by 1,508
Self-citationHow to increase value and reduce waste when research priorities are set
Chalmers, I., Bracken, M. B., Djulbegovic, B., Garattini, S., Grant, J., Gülmezoglu, A. M., Howells, D. W., Ioannidis, J. P. A., & Oliver, S. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62229-1 · Cited by 1,436
Self-citationPrognosis and prognostic research: validating a prognostic model
Altman, D. G., Vergouwe, Y., Royston, P., & Moons, K. G. M. (2009) · BMJ · doi:10.1136/bmj.b605 · Cited by 1,436
Self-citationFord, I., & Norrie, J. (2016) · New England Journal of Medicine · doi:10.1056/nejmra1510059 · Cited by 1,405
Potential Biases in Machine Learning Algorithms Using Electronic Health Record Data
Gianfrancesco, M. A., Tamang, S., Yazdany, J., & Schmajuk, G. (2018) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2018.3763 · Cited by 1,395 · cited 1×
“67 Although many of the ML/AI algorithms developed will often have bias, it should be compared with the bias in the existing systems being used.”
Pashler, H., & Wagenmakers, E. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612465253 · Cited by 1,321
Reducing waste from incomplete or unusable reports of biomedical research
Glasziou, P., Altman, D. G., Bossuyt, P., Boutron, I., Clarke, M., Julious, S., Michie, S., Moher, D., & Wager, E. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62228-x · Cited by 1,319
(2019) · SGEM International Multidisciplinary Scientific Conferences on SOCIAL SCIENCES and ARTS Proceedings · doi:10.5593/sgemsocial2019v/1.1 · Cited by 1,298
What does research reproducibility mean?
Goodman, S. N., Fanelli, D., & Ioannidis, J. P. A. (2016) · Science Translational Medicine · doi:10.1126/scitranslmed.aaf5027 · Cited by 1,293 · cited 1×
“…is associated with results reproducibility (that is, the production of corroborating results in a new study, having followed the same experimental methods 65 ), whether it is a consequence of the inadequate reporting observed in the modelling literature, 59 or other related issues is unclear.”
ResultSelf-citationMorgan, R. L., Whaley, P., Thayer, K. A., & Schünemann, H. J. (2018) · Environment International · doi:10.1016/j.envint.2018.07.015 · Cited by 1,282
Prognosis and prognostic research: Developing a prognostic model
Royston, P., Moons, K. G. M., Altman, D. G., & Vergouwe, Y. (2009) · BMJ · doi:10.1136/bmj.b604 · Cited by 1,172
Self-citationAssessing the Generalizability of Prognostic Information
Justice, A. C., Covinsky, K. E., & Berlin, J. A. (1999) · Annals of Internal Medicine · doi:10.7326/0003-4819-130-6-199903160-00016 · Cited by 1,160
Unintended consequences of machine learning in medicine
Cabitza, F., Rasoini, R., & Gensini, G. F. (2017) · JAMA · doi:10.1001/jama.2017.7797 · Cited by 1,066
Kusner, M. J., Loftus, J. R., Russell, C., & Silva, R. (2017) · arXiv · doi:10.48550/arxiv.1703.06856 · Cited by 995
An Analysis of Deep Neural Network Models for Practical Applications
Canziani, A., Paszke, A., & Culurciello, E. (2016) · arXiv · doi:10.48550/arxiv.1605.07678 · Cited by 969
Prognosis and prognostic research: application and impact of prognostic models in clinical practice
Moons, K. G. M., Altman, D. G., Vergouwe, Y., & Royston, P. (2009) · BMJ · doi:10.1136/bmj.b606 · Cited by 934
Self-citationIncreasing value and reducing waste: addressing inaccessible research
Chan, A.-W., Song, F., Vickers, A., Jefferson, T., Dickersin, K., Gøtzsche, P. C., Krumholz, H. M., Ghersi, D., & van der Worp, H. B. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62296-5 · Cited by 887
Genomic Risk Prediction of Coronary Artery Disease in 480,000 Adults
Inouye, M., Abraham, G., Nelson, C. P., Wood, A. M., Sweeting, M. J., Dudbridge, F., Lai, F. Y., Kaptoge, S., Brozynska, M., Wang, T., et al. (2018) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2018.07.079 · Cited by 793
Self-citationHow to Make More Published Research True
Ioannidis, J. P. A. (2014) · PLoS Medicine · doi:10.1371/journal.pmed.1001747 · Cited by 760
Self-citationFreer, T. W., & Ulissey, M. J. (2001) · Radiology · doi:10.1148/radiol.2203001282 · Cited by 751
Collins, G. S., de Groot, J. A., Dutton, S., Omar, O., Shanyinde, M., Tajar, A., Voysey, M., Wharton, R., Yu, L.-M., Moons, K. G., et al. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-40 · Cited by 729
Self-citationDiagnostic Accuracy of Digital Screening Mammography With and Without Computer-Aided Detection
Lehman, C. D., Wellman, R. D., Buist, D. S. M., Kerlikowske, K., Tosteson, A. N. A., & Miglioretti, D. L. (2015) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2015.5231 · Cited by 678
Prognosis research strategy (PROGRESS) 1: A framework for researching clinical outcomes
Hemingway, H., Croft, P., Perel, P., Hayden, J. A., Abrams, K., Timmis, A., Briggs, A., Udumyan, R., Moons, K. G. M., Steyerberg, E. W., et al. (2013) · BMJ · doi:10.1136/bmj.e5595 · Cited by 663
Self-citationIncreasing value and reducing waste in biomedical research regulation and management
Salman, R. A.-S., Beller, E., Kagan, J., Hemminki, E., Phillips, R. S., Savulescu, J., Macleod, M., Wisely, J., & Chalmers, I. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62297-7 · Cited by 534
Aequitas: A Bias and Fairness Audit Toolkit
Saleiro, P., Kuester, B., Hinkson, L., London, J., Stevens, A., Anisfeld, A., Rodolfa, K. T., & Ghani, R. (2018) · arXiv · doi:10.48550/arxiv.1811.05577 · Cited by 496
Self-citationSiontis, G. C. M., Tzoulaki, I., Castaldi, P. J., & Ioannidis, J. P. A. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.09.007 · Cited by 459
Self-citationImproving palliative care with deep learning
Avati, A., Jung, K., Harman, S., Downing, L., Ng, A., & Shah, N. H. (2017) · 2017 IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm.2017.8217669 · Cited by 439
Can AI Help Reduce Disparities in General Medical and Mental Health Care?
(2019) · AMA Journal of Ethics · doi:10.1001/amajethics.2019.167 · Cited by 401
Single Reading with Computer-Aided Detection for Screening Mammography
Gilbert, F. J., Astley, S. M., Gillan, M. G. C., Agbaje, O. F., Wallis, M. G., James, J., Boggis, C. R. M., & Duffy, S. W. (2008) · New England Journal of Medicine · doi:10.1056/nejmoa0803545 · Cited by 296
Assessment of Claims of Improved Prediction Beyond the Framingham Risk Score
Tzoulaki, I. (2009) · JAMA · doi:10.1001/jama.2009.1757 · Cited by 276
Willetts, M., Hollowell, S., Aslett, L., Holmes, C., & Doherty, A. (2018) · Scientific Reports · doi:10.1038/s41598-018-26174-1 · Cited by 250
Self-citationPredictive analytics in health care: how can we know it works?
Van Calster, B., Wynants, L., Timmerman, D., Steyerberg, E. W., & Collins, G. S. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz130 · Cited by 223
On the Reuse of Scientific Data
Pasquetto, I. V., Randles, B. M., & Borgman, C. L. (2017) · Data Science Journal · doi:10.5334/dsj-2017-008 · Cited by 223
Morales, J., Welter, D., Bowler, E. H., Cerezo, M., Harris, L. W., McMahon, A. C., Hall, P., Junkins, H. A., Milano, A., Hastings, E., et al. (2018) · Genome Biology · doi:10.1186/s13059-018-1396-2 · Cited by 217
Electronic documents give reproducible research a new meaning
Claerbout, J. F., & Karrenbach, M. (1992) · SEG Technical Program Expanded Abstracts 1992 · doi:10.1190/1.1822162 · Cited by 205
Waste, Leaks, and Failures in the Biomarker Pipeline
Ioannidis, J. P. A., & Bossuyt, P. M. M. (2017) · Clinical Chemistry · doi:10.1373/clinchem.2016.254649 · Cited by 172
Self-citationArtificial intelligence in drug combination therapy
Tsigelny, I. F. (2018) · Briefings in Bioinformatics · doi:10.1093/bib/bby004 · Cited by 134
Stockdale, J., Cassell, J., & Ford, E. M. (2019) · Wellcome Open Research · doi:10.12688/wellcomeopenres.13531.2 · Cited by 133
Curtis, D. (2018) · Psychiatric Genetics · doi:10.1097/ypg.0000000000000206 · Cited by 132
Privacy preservation techniques in big data analytics: a survey
Rao, P. R. M., Krishna, S. M., & Kumar, A. P. S. (2018) · Journal Of Big Data · doi:10.1186/s40537-018-0141-8 · Cited by 128
Dagan, N., Cohen-Stavi, C. J., Leventer‐Roberts, M., & Balicer, R. D. (2017) · BMJ · doi:10.1136/bmj.i6755 · Cited by 121
Comparing risk prediction models
Collins, G. S., & Moons, K. G. M. (2012) · BMJ · doi:10.1136/bmj.e3186 · Cited by 110
Self-citationReproducibility in critical care: a mortality prediction case study
Johnson, A. E. W., Pollard, T., & Mark, R. G. (2017) · Machine Learning for Healthcare Conference · Cited by 103
An empirical assessment of validation practices for molecular classifiers
Castaldi, P. J., Dahabreh, I. J., & Ioannidis, J. P. A. (2011) · Briefings in Bioinformatics · doi:10.1093/bib/bbq073 · Cited by 102
Self-citationLimits on Learning Machine Accuracy Imposed by Data Quality
Cortes, C., Jackel, L. D., & Chiang, W.-P. (1994) · Cited by 89
A Quick Guide to Software Licensing for the Scientist-Programmer
Morin, A., Urban, J. M., & Piotr Sliz, A. (2012) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002598 · Cited by 86
Povyakalo, A. A., Alberdi, E., Strigini, L., & Ayton, P. (2013) · Medical Decision Making · doi:10.1177/0272989x12465490 · Cited by 79
Stockdale, J., Cassell, J., & Ford, E. M. (2018) · Wellcome Open Research · doi:10.12688/wellcomeopenres.13531.1 · Cited by 78
Diagnostic tests often fail to lead to changes in patient outcomes
Siontis, K. C., Siontis, G. C. M., Contopoulos‐Ioannidis, D. G., & Ioannidis, J. P. A. (2014) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.12.008 · Cited by 68
Self-citationSomashekhar, S., Kumarc, R., Rauthan, A., Arun, K., Patil, P., & Ramya, Y. (2017) · Cancer Research · doi:10.1158/1538-7445.sabcs16-s6-07 · Cited by 56
Ohnuma, T., & Uchino, S. (2017) · PLoS ONE · doi:10.1371/journal.pone.0169341 · Cited by 37
O’Brien, M. J., Lee, J. Y., Carnethon, M. R., Ackermann, R. T., Vargas, M. C., Hamilton, A., Mohanty, N., Rittner, S. S., Park, J. N., Hassan, A., et al. (2016) · PLoS Medicine · doi:10.1371/journal.pmed.1002074 · Cited by 36
Billington, J., Fahey, T. P., & Galvin, R. (2012) · BMC Family Practice · doi:10.1186/1471-2296-13-76 · Cited by 35
What’s holding up the big data revolution in healthcare?
Dhindsa, K., Bhandari, M., & Sonnadara, R. (2018) · BMJ · doi:10.1136/bmj.k5357 · Cited by 35
Snooks, H. A., Bailey, K., Burge-Jones, D., Dale, J. R., Davies, J., Evans, B. A., Farr, A., Fitzsimmons, D. F., Heaven, M. L., Howson, H., et al. (2018) · BMJ Quality & Safety · doi:10.1136/bmjqs-2018-007976 · Cited by 32
Király, F. J., Mateen, B. A., & Sonabend, R. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.07519 · Cited by 10
Self-citation
Cited by
Revolutionizing healthcare: the role of artificial intelligence in clinical practice
Alowais, S. A., Alghamdi, S. S., Alsuhebany, N., Alqahtani, T., Alshaya, A. I., Almohareb, S. N., Aldairem, A., Alrashed, M., Bin Saleh, K., Badreldin, H. A., et al. (2023) · BMC Medical Education · doi:10.1186/s12909-023-04698-z · Cited by 3,146
Nagendran, M., Chen, Y., Lovejoy, C. A., Gordon, A. C., Komorowski, M., Harvey, H., Topol, E. J., Ioannidis, J. P. A., Collins, G. S., & Maruthappu, M. (2020) · BMJ · doi:10.1136/bmj.m689 · Cited by 1,152
Self-citationDiagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis
Aggarwal, R., Sounderajah, V., Martin, G., Ting, D. S. W., Karthikesalingam, A., King, D., Ashrafian, H., & Darzi, A. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00438-z · Cited by 946
Artificial intelligence-enhanced electrocardiography in cardiovascular disease management
Siontis, K. C., Noseworthy, P. A., Attia, Z. I., & Friedman, P. A. (2021) · Nature Reviews Cardiology · doi:10.1038/s41569-020-00503-2 · Cited by 914
Vasey, B., Nagendran, M., Campbell, B., Clifton, D. A., Collins, G. S., Denaxas, S., Denniston, A. K., Faes, L., Geerts, B., Ibrahim, M., et al. (2022) · Nature Medicine · doi:10.1038/s41591-022-01772-9 · Cited by 1,039
Self-citation
Metadata
- Authors
- Vollmer, S., Mateen, B. A., Bohner, G., Király, F. J., Ghani, R., Jonsson, P., Cumbers, S., Jonas, A., McAllister, K. S. L., Myles, P., Grainger, D., Birse, M., Branson, R., Moons, K. G. M., Collins, G. S., Ioannidis, J. P. A., Holmes, C., & Hemingway, H.
- Venue
- BMJ
- Publisher
- BMJ
- Published
- 2020-03-20
- Volume
- 368
- Pages
- l6927
- ISSN
- 1756-1833 (ISSN-L)
- OpenAlex
- W3011403448
- Cited by
- 497
- References
- 67
- FWCI
- 15.91
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.