CoChat

Designing clinically translatable artificial intelligence systems for high-dimensional medical imaging

Open access
Shad, Rohan, Cunningham, John P., Ashley, Euan A., Langlotz, Curtis P., Hiesinger, William · 2021 · Nature Machine Intelligence
Cited by 55

The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.

Abstract

The National Institutes of Health in 2018 identified key focus areas for the future of artificial intelligence in medical imaging, creating a foundational roadmap for research in image acquisition, algorithms, data standardization and translatable clinical decision support systems. Among the key issues raised in the report, data availability, the need for novel computing architectures and explainable artificial intelligence algorithms are still relevant, despite the tremendous progress made over the past few years alone. Furthermore, translational goals of data sharing, validation of performance for regulatory approval, generalizability and mitigation of unintended bias must be accounted for early in the development process. In this Perspective, we explore challenges unique to high-dimensional clinical imaging data, in addition to highlighting some of the technical and ethical considerations involved in developing machine learning systems that better represent the high-dimensional nature of many imaging modalities. Furthermore, we argue that methods that attempt to address explainability, uncertainty and bias should be treated as core components of any clinical machine learning system. Substantial advances have been made in the past decade in developing high-performance machine learning models for medical applications, but translating them into practical clinical decision-making processes remains challenging. This Perspective provides insights into a range of challenges specific to high-dimensional, multimodal medical imaging.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1038/s42256-021-00399-8

Cites

37 of 37 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 37 references

Research works printed but not linked: 31

  1. Rajpurkar, P. et al. AppendiXNet: deep learning for diagnosis of appendicitis from a small dataset of CT exams using video pretraining. Sci. Rep. 10, 3958 (2020). · DOI · Paper page
  2. Huang, S.-C. et al. PENet—a scalable deep-learning model for automated diagnosis of pulmonary embolism using volumetric CT imaging. npj Digit. Med. 3, 61 (2020). · DOI · Paper page
  3. Allen, B. et al. A road map for translational research on artificial intelligence in medical imaging: from the 2018 National Institutes of Health/RSNA/ACR/The Academy Workshop. J. Am. Coll. Radiol. 16, 1179–1189 (2019). · DOI · Paper page
  4. Paszke, A. et al. PyTorch: an imperative style, high-performance deep learning library. Preprint at https://arxiv.org/abs/1912.01703 (2019). · arXiv
  5. Abadi, M. et al. TensorFlow: large-scale machine learning on heterogeneous distributed systems. Preprint at https://arxiv.org/abs/1603.04467v2 (2016). · arXiv
  6. Ulloa Cerna, A. E. et al. Deep-learning-assisted analysis of echocardiographic videos improves predictions of all-cause mortality. Nat. Biomed. Eng. https://doi.org/10.1038/s41551-020-00667-9 (2021). · DOI
  7. Oren, O., Gersh, B. J. & Bhatt, D. L. Artificial intelligence in medical imaging: switching from radiographic pathological data to clinically meaningful endpoints. Lancet Digit. Health 2, e486–e488 (2020). · DOI · Paper page
  8. Mildenberger, P., Eichelberg, M. & Martin, E. Introduction to the DICOM standard. Eur. Radiol. 12, 920–927 (2002). · DOI · Paper page
  9. Mesterhazy, J., Olson, G. & Datta, S. High performance on-demand de-identification of a petabyte-scale medical imaging data lake. Preprint at https://arxiv.org/abs/2008.01827 (2020). · arXiv
  10. Rubin, D. L. et al. Automated tracking of quantitative assessments of tumor burden in clinical trials. Transl. Oncol. 7, 23–35 (2014). · DOI
  11. Balachandar, N., Chang, K., Kalpathy-Cramer, J. & Rubin, D. L. Accounting for data variability in multi-institutional distributed deep learning for medical imaging. J. Am. Med. Inform. Assoc. 27, 700–708 (2020). · DOI · Paper page
  12. Xu, Y. et al. A collaborative online AI engine for CT-based COVID-19 diagnosis. Preprint at medRxiv https://doi.org/10.1101/2020.05.10.20096073 (2020). · DOI · Paper page
  13. Anwar, S., Barnes, N. & Petersson, L. A systematic evaluation: fine-grained CNN vs. traditional CNN classifiers. Preprint at https://arxiv.org/abs/2003.11154 (2020). · arXiv
  14. He, K., Zhang, X., Ren, S. & Sun, J. Identity mappings in deep residual networks. Preprint at https://arxiv.org/abs/1603.05027 (2016). · DOI · Paper page
  15. Tan, M. & Le, Q. V. EfficientNet: rethinking model scaling for convolutional neural networks. Preprint at https://arxiv.org/abs/1905.11946 (2019). · arXiv
  16. Carreira, J. & Zisserman, A. Quo vadis, action recognition? A new model and the kinetics dataset. Preprint at https://arxiv.org/abs/1705.07750 (2018). · DOI · Paper page
  17. Simonyan, K. & Zisserman, A. Very deep convolutional networks for large-scale image recognition. Preprint at http://arxiv.org/abs/1409.1556 (2014). · arXiv
  18. Marcel, S. & Rodriguez, Y. Torchvision the machine-vision package of torch. In Proc. International Conference on Multimedia - MM ’10 1485 (ACM, 2010); https://doi.org/10.1145/1873951.1874254 · DOI · Paper page
  19. Taleb, A. et al. 3D self-supervised methods for medical imaging. Preprint at https://arxiv.org/abs/2006.03829v3 (2020). · arXiv
  20. Shad, R. et al. Predicting post-operative right ventricular failure using video-based deep learning. Nat. Commun. 12, 5192 (2021). · DOI
  21. Raghu, M., Zhang, C., Kleinberg, J. & Bengio, S. Transfusion: understanding transfer learning for medical imaging. Preprint at https://arxiv.org/abs/1902.07208 (2019). · arXiv
  22. Zhang, Y., Jiang, H., Miura, Y., Manning, C. D. & Langlotz, C. P. Contrastive learning of medical visual representations from paired images and text. Preprint at https://arxiv.org/abs/2010.00747 (2020). · arXiv
  23. Piergiovanni, A., Angelova, A., Toshev, A. & Ryoo, M. Evolving space-time neural architectures for videos. In 2019 IEEE/CVF International Conf. Computer Vision (ICCV) 1793–1802 (IEEE, 2019); https://doi.org/10.1109/ICCV.2019.00188 · DOI
  24. Yamashita, R., Long, J., Saleem, A., Rubin, D. L. & Shen, J. Deep learning predicts postsurgical recurrence of hepatocellular carcinoma from digital histopathologic images. Sci. Rep. 11, 2047 (2021). · DOI
  25. Kvamme, H., Borgan, Ø. & Scheel, I. Time-to-event prediction with neural networks and Cox regression. Preprint at https://arxiv.org/abs/1907.00825 (2019). · arXiv
  26. Sensoy, M., Kaplan, L. & Kandemir, M. Evidential deep learning to quantify classification uncertainty. Preprint at https://arxiv.org/abs/1806.01768 (2018). · arXiv
  27. DeGrave, A. J., Janizek, J. D. & Lee, S.-I. AI for radiographic COVID-19 detection selects shortcuts over signal. Nat. Mach. Intell. https://doi.org/10.1038/s42256-021-00338-7 (2021). · DOI · Paper page
  28. Chen, I. Y. et al. Ethical machine learning in health care. Preprint at https://arxiv.org/abs/2009.10576 (2020). · arXiv
  29. Esteva, A. et al. Deep learning-enabled medical computer vision. npj Digit. Med. 4, 5 (2021). · DOI · Paper page
  30. Pfohl, S. R., Foryciarz, A. & Shah, N. H. An empirical characterization of fair machine learning for clinical risk prediction. J. Biomed. Inform. 113, 103621 (2021). · DOI · Paper page
  31. Shapley, L. S. A value for n-person games. Contrib. Theory Games 2, 307–317 (1953).

Cited by

See all 55

Metadata

Authors
Shad, R., Cunningham, J. P., Ashley, E. A., Langlotz, C. P., & Hiesinger, W.
Venue
Nature Machine Intelligence
Published
2021-11-16
Volume
3
Issue
11
Pages
929-935
ISSN
2522-5839 (ISSN-L)
OpenAlex
W3211724668
Cited by
55
References
37
FWCI
2.27
Type
journal article
Language
en
Open access
green
Licence
Funders
American Heart Association (834986)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Designing clinically translatable artificial intelligence systems for high-dimensional medical imaging. https://app.cochat.ai/papers/10.1038/s42256-021-00399-8
The paper
Shad, R., Cunningham, J. P., Ashley, E. A., Langlotz, C. P., & Hiesinger, W. (2021). Designing clinically translatable artificial intelligence systems for high-dimensional medical imaging. Nature Machine Intelligence. https://doi.org/10.1038/s42256-021-00399-8

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.