Implementing Machine Learning in Radiology Practice and Research
The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: The purposes of this article are to describe concepts that radiologists should understand to evaluate machine learning projects, including common algorithms, supervised as opposed to unsupervised techniques, statistical pitfalls, and data considerations for training and evaluation, and to briefly describe ethical dilemmas and legal risk. CONCLUSION: Machine learning includes a broad class of computer programs that improve with experience. The complexity of creating, training, and monitoring machine learning indicates that the success of the algorithms will require radiologist involvement for years to come, leading to engagement rather than replacement.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Advances in Neural Information Processing Systems 25
Zhang, Y., Sutton, C. A., Storkey, A., & Zoubin Ghahramani, A. (2012) · Cited by 12,653
Machine learning: Trends, perspectives, and prospects
Jordan, M. I., & Mitchell, T. M. (2015) · Science · doi:10.1126/science.aaa8415 · Cited by 9,955 · cited 1×
“computer program performance improves automatically with experience [5].”
BackgroundHow transferable are features in deep neural networks?
Yosinski, J., Clune, J., Bengio, Y., & Lipson, H. (2014) · arXiv · doi:10.48550/arxiv.1411.1792 · Cited by 6,061 · cited 1×
“Researchers in computer science have found that as deep CNNs are trained, the first layer of neurons begins to recognize characteristics such as shape and color, which has led researchers to evaluate whether these trained networks can be generalized to other tasks in a process called transfer learning [12].”
BackgroundCluster failure: why fMRI inferences for spatial extent have inflated false-positive rates
Eklund, A., Nichols, T. E., & Knutsson, H. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1602413113 · Cited by 3,487 · cited 1×
“The risks of inappropriate statistical methods are all too apparent in the work [7] that exposed software bugs and inappro-”
BackgroundCheng, J.-Z., Ni, D., Chou, Y.-H., Qin, J., Tiu, C.-M., Chang, Y.-C., Huang, C.-S., Shen, D., & Chen, C.-M. (2016) · Scientific Reports · doi:10.1038/srep24454 · Cited by 755
Discrimination of Breast Cancer with Microcalcifications on Mammography by Deep Learning
Wang, J., Yang, X., Cai, H., Tan, W., Jin, C., & Li, L. (2016) · Scientific Reports · doi:10.1038/srep27327 · Cited by 291
Three-dimensional solid texture analysis in biomedical imaging: Review and opportunities
Depeursinge, A., Foncubierta-Rodriguez, A., Van De Ville, D., & Müller, H. (2014) · Medical Image Analysis · doi:10.1016/j.media.2013.10.005 · Cited by 244
MRI texture features as biomarkers to predict MGMT methylation status in glioblastomas
Korfiatis, P., Kline, T. L., Coufalova, L., Lachance, D. H., Parney, I. F., Carter, R. E., Buckner, J. C., & Erickson, B. J. (2016) · Medical Physics · doi:10.1118/1.4948668 · Cited by 163
Cited by
Park, S. H., & Han, K. (2018) · Radiology · doi:10.1148/radiol.2017171920 · Cited by 894
Pesapane, F., Codari, M., & Sardanelli, F. (2018) · European Radiology Experimental · doi:10.1186/s41747-018-0061-6 · Cited by 833
Current Applications and Future Impact of Machine Learning in Radiology
Choy, G., Khalilzadeh, O., Michalski, M., Do, S., Samir, A. E., Pianykh, O. S., Geis, J. R., Pandharipande, P. V., Brink, J. A., & Dreyer, K. J. (2018) · Radiology · doi:10.1148/radiol.2018171820 · Cited by 800
“For example, an intelligent MR imager may recognize a lesion and suggest modifications in the sequence to achieve optimal characterization of the lesion (4).”
Self-citationMedical students' attitude towards artificial intelligence: a multicentre survey
Pinto dos Santos, D., Giese, D., Brodehl, S., Chon, S. H., Staab, W., Kleinert, R., Maintz, D., & Baeßler, B. (2019) · European Radiology · doi:10.1007/s00330-018-5601-1 · Cited by 754
Kim, D. H., & MacKinnon, T. (2018) · Clinical Radiology · doi:10.1016/j.crad.2017.11.015 · Cited by 495
Pesapane, F., Volonté, C., Codari, M., & Sardanelli, F. (2018) · Insights into Imaging · doi:10.1007/s13244-018-0645-y · Cited by 479
Larson, D. B., Chen, M. C., Lungren, M. P., Halabi, S. S., Stence, N. V., & Langlotz, C. P. (2018) · Radiology · doi:10.1148/radiol.2017170236 · Cited by 456
Artificial intelligence for good health: a scoping review of the ethics literature.
Murphy, K., Di Ruggiero, E., Upshur, R., Willison, D. J., Malhotra, N., Cai, J. C., Malhotra, N., Lui, V., & Gibson, J. (2021) · BMC Medical Ethics · doi:10.1186/s12910-021-00577-8 · Cited by 435
Identifying Ethical Considerations for Machine Learning Healthcare Applications
Char, D. S., Abràmoff, M. D., & Feudtner, C. (2020) · The American Journal of Bioethics · doi:10.1080/15265161.2020.1819469 · Cited by 415
Geis, J. R., Brady, A. P., Wu, C. C., Spencer, J., Ranschaert, E., Jaremko, J. L., Langer, S. G., Borondy Kitts, A., Birch, J., Shields, W. F., et al. (2019) · Radiology · doi:10.1148/radiol.2019191586 · Cited by 388
Self-citationHung, K., Montalvao, C., Tanaka, R., Kawai, T., & Bornstein, M. M. (2020) · Dentomaxillofacial Radiology · doi:10.1259/dmfr.20190107 · Cited by 387
Apostolopoulos, I. D., Aznaouridis, S. I., & Tzani, M. A. (2020) · Journal of Medical and Biological Engineering · doi:10.1007/s40846-020-00529-4 · Cited by 335
What the radiologist should know about artificial intelligence – an ESR white paper
European Society of Radiology (ESR) (2019) · Insights into Imaging · doi:10.1186/s13244-019-0738-2 · Cited by 320
Mammographic Breast Density Assessment Using Deep Learning: Clinical Implementation
Lehman, C. D., Yala, A., Schuster, T., Dontchos, B., Bahl, M., Swanson, K., & Barzilay, R. (2019) · Radiology · doi:10.1148/radiol.2018180694 · Cited by 294
Deep learning in medical image analysis: A third eye for doctors
Fourcade, A., & Khonsari, R. H. (2019) · Journal of Stomatology, Oral and Maxillofacial Surgery · doi:10.1016/j.jormas.2019.06.002 · Cited by 284
Artificial intelligence: Who is responsible for the diagnosis?
Neri, E., Coppola, F., Miele, V., Bibbolino, C., & Grassi, R. (2020) · La radiologia medica · doi:10.1007/s11547-020-01135-9 · Cited by 240
Artificial intelligence for precision education in radiology
Duong, M. T., Rauschecker, A. M., Rudie, J. D., Chen, P.-H., Cook, T. S., Bryan, R. N., & Mohan, S. (2019) · The British Journal of Radiology · doi:10.1259/bjr.20190389 · Cited by 205
Martín Noguerol, T., Paulano-Godino, F., Martín-Valdivia, M. T., Menias, C. O., & Luna, A. (2019) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2019.05.047 · Cited by 175
An introduction and overview of machine learning in neurosurgical care
Senders, J. T., Zaki, M. M., Karhade, A. V., Chang, B., Gormley, W. B., Broekman, M. L., Smith, T. R., & Arnaout, O. (2018) · Acta Neurochirurgica · doi:10.1007/s00701-017-3385-8 · Cited by 178
How far have we come? Artificial intelligence for chest radiograph interpretation
Kallianos, K., Mongan, J., Antani, S., Henry, T., Taylor, A., Abuya, J., & Kohli, M. (2019) · Clinical Radiology · doi:10.1016/j.crad.2018.12.015 · Cited by 173
Self-citationGeis, J. R., Brady, A. P., Wu, C. C., Spencer, J., Ranschaert, E., Jaremko, J. L., Langer, S. G., Kitts, A. B., Birch, J., Shields, W. F., et al. (2019) · Canadian Association of Radiologists Journal · doi:10.1016/j.carj.2019.08.010 · Cited by 140
Self-citationRomeo, V., Ricciardi, C., Cuocolo, R., Stanzione, A., Verde, F., Sarno, L., Improta, G., Mainenti, P. P., D'Armiento, M., Brunetti, A., et al. (2019) · Magnetic Resonance Imaging · doi:10.1016/j.mri.2019.05.017 · Cited by 113
Behzadi-khormouji, H., Rostami, H., Salehi, S., Derakhshande-Rishehri, T., Masoumi, M., Salemi, S., Keshavarz, A., Gholamrezanezhad, A., Assadi, M., & Batouli, A. (2020) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2019.105162 · Cited by 112
Artificial intelligence-based education assists medical students’ interpretation of hip fracture
Cheng, C.-T., Chen, C.-C., Fu, C.-Y., Chaou, C.-H., Wu, Y.-T., Hsu, C.-P., Chang, C.-C., Chung, I.-F., Hsieh, C.-H., Hsieh, M.-J., et al. (2020) · Insights into Imaging · doi:10.1186/s13244-020-00932-0 · Cited by 87
Yeo, M., Tahayori, B., Kok, H. K., Maingard, J., Kutaiba, N., Russell, J., Thijs, V., Jhamb, A., Chandra, R. V., Brooks, M., et al. (2021) · Journal of NeuroInterventional Surgery · doi:10.1136/neurintsurg-2020-017099 · Cited by 65
Simulation-Based Education in the Artificial Intelligence Era
Komasawa, N., & Yokohira, M. (2023) · Cureus · doi:10.7759/cureus.40940 · Cited by 64
Artificial intelligence in radiology: Are Saudi residents ready, prepared, and knowledgeable?
Khafaji, M. A., Safhi, M. A., Albadawi, R. H., Al-Amoudi, S. O., Shehata, S. S., & Toonsi, F. (2022) · Saudi Medical Journal · doi:10.15537/smj.2022.43.1.20210337 · Cited by 48
Weikert, T., Francone, M., Abbara, S., Baessler, B., Choi, B. W., Gutberlet, M., Hecht, E. M., Loewe, C., Mousseaux, E., Natale, L., et al. (2021) · European Radiology · doi:10.1007/s00330-020-07417-0 · Cited by 34
Shelmerdine, S. C., Togher, D., Rickaby, S., & Dean, G. (2024) · Clinical Radiology · doi:10.1016/j.crad.2024.05.018 · Cited by 17
Evaluation of knowledge and attitudes of radiology department workers about artificial intelligence
Yurdaisik, I., & Aksoy, S. H. (2021) · Annals of Clinical and Analytical Medicine · doi:10.4328/acam.20453 · Cited by 13
“187 Introduction Artificial intelligence (AI) is defined as computers that behave in the ways that previously thought to require human intelligence and have significant potential to considerably improve radiology, assist patients and reduce costs [1].”
Background
Metadata
- Authors
- Kohli, M., Prevedello, L. M., Filice, R. W., & Geis, J. R.
- Venue
- American Journal of Roentgenology
- Publisher
- American Roentgen Ray Society
- Published
- 2017-04
- Volume
- 208
- Issue
- 4
- Pages
- 754-760
- ISSN
- 0002-9580 (ISSN-L)
- 0361-803X
- 1546-3141
- OpenAlex
- W2582555581
- Cited by
- 301
- References
- 13
- FWCI
- 13.26
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.