The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Artificial Intelligence System Approaching Neuroradiologist-level Differential Diagnosis Accuracy at Brain MRI
Open accessAbstract
Background Although artificial intelligence (AI) shows promise across many aspects of radiology, the use of AI to create differential diagnoses for rare and common diseases at brain MRI has not been demonstrated. Purpose To evaluate an AI system for generation of differential diagnoses at brain MRI compared with radiologists. Materials and Methods This retrospective study tested performance of an AI system for probabilistic diagnosis in patients with 19 common and rare diagnoses at brain MRI acquired between January 2008 and January 2018. The AI system combines data-driven and domain-expertise methodologies, including deep learning and Bayesian networks. First, lesions were detected by using deep learning. Then, 18 quantitative imaging features were extracted by using atlas-based coregistration and segmentation. Third, these image features were combined with five clinical features by using Bayesian inference to develop probability-ranked differential diagnoses. Quantitative feature extraction algorithms and conditional probabilities were fine-tuned on a training set of 86 patients (mean age, 49 years ± 16 [standard deviation]; 53 women). Accuracy was compared with radiology residents, general radiologists, neuroradiology fellows, and academic neuroradiologists by using accuracy of top one, top two, and top three differential diagnoses in 92 independent test set patients (mean age, 47 years ± 18; 52 women). Results For accuracy of top three differential diagnoses, the AI system (91% correct) performed similarly to academic neuroradiologists (86% correct; P = .20), and better than radiology residents (56%; P < .001), general radiologists (57%; P < .001), and neuroradiology fellows (77%; P = .003). The performance of the AI system was not affected by disease prevalence (93% accuracy for common vs 85% for rare diseases; P = .26). Radiologists were more accurate at diagnosing common versus rare diagnoses (78% vs 47% across all radiologists; P < .001). Conclusion An artificial intelligence system for brain MRI approached overall top one, top two, and top three differential diagnoses accuracy of neuroradiologists and exceeded that of less-specialized radiologists. © RSNA, 2020 Online supplemental material is available for this article. See also the editorial by Zaharchuk in this issue.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“New multimodal AI models have made significant progress in describing video content, such as surgeries, making video data a promising method for AI decision support with further research.68”
From Review of Artificial Intelligence for Clinical Use in Alzheimer's Disease and Related Dementias (2026) · cites this paper as [68]
Citations
Cites
Yushkevich, P. A., Piven, J., Hazlett, H. C., Smith, R. G., Ho, S., Gee, J. C., & Gerig, G. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.01.015 · Cited by 8,868
Self-citationDeep learning in medical image analysis
Shen, D., Wu, G., & Suk, H.-I. (2017) · Annual Review of Biomedical Engineering · doi:10.1146/annurev-bioeng-071516-044442 · Cited by 4,968
Subjective probability: A judgment of representativeness
Kahneman, D., & Tversky, A. (1972) · Cognitive Psychology · doi:10.1016/0010-0285(72)90016-3 · Cited by 4,851
A reproducible evaluation of ANTs similarity metric performance in brain image registration
Avants, B. B., Tustison, N. J., Song, G., Cook, P. A., Klein, A., & Gee, J. C. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2010.09.025 · Cited by 4,796
Self-citationBest practices for convolutional neural networks applied to visual document analysis
Simard, P. Y., Steinkraus, D., & Platt, J. C. (2005) · Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings. · doi:10.1109/icdar.2003.1227801 · Cited by 2,741
Marcus, D. S., Wang, T. H., Parker, J., Csernansky, J. G., Morris, J. C., & Buckner, R. L. (2007) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2007.19.9.1498 · Cited by 2,163
Statistical Methods in Diagnostic Medicine
Zhou, X., Obuchowski, N. A., & McClish, D. K. (2011) · Wiley Series in Probability and Statistics · doi:10.1002/9780470906514 · Cited by 1,784
Zech, J. R., Badgeley, M. A., Liu, M., Costa, A. B., Titano, J. J., & Oermann, E. K. (2018) · PLOS Medicine · doi:10.1371/journal.pmed.1002683 · Cited by 1,719 · cited 1×
“Finally, the retrospective work described here was performed at a single health system, potentially limiting generalization (28).”
MethodDeep learning algorithms for detection of critical findings in head CT scans: a retrospective study
Chilamkurthy, S., Ghosh, R., Tanamala, S., Biviji, M., Campeau, N. G., Venugopal, V. K., Mahajan, V., Rao, P., & Warier, P. (2018) · The Lancet · doi:10.1016/s0140-6736(18)31645-3 · Cited by 1,020
Bruno, M. A., Walker, E. A., & Abujudeh, H. H. (2015) · RadioGraphics · doi:10.1148/rg.2015150023 · Cited by 573
Research works printed but not linked: 1
- Ronneberger O, Fischer P, Brox T. U-Net: Convolutional Networks for Biomedical Image Segmentation. Cham, Switzerland: Springer International, 2015; 234–241.
Cited by
Towards accurate differential diagnosis with large language models
McDuff, D., Schaekermann, M., Tu, T., Palepu, A., Wang, A., Garrison, J., Singhal, K., Sharma, Y., Azizi, S., Kulkarni, K., et al. (2025) · Nature · doi:10.1038/s41586-025-08869-4 · Cited by 311
“Deep learning has been applied to promising effect for generating DDx in a number of specialties including radiology 4 , ophthalmology 5 and dermatology 3 , but such systems lack the interactive capabilities to fluently assist a user through communication in natural language.”
Towards Accurate Differential Diagnosis with Large Language Models
McDuff, D., Schaekermann, M., Tu, T., Palepu, A., Wang, A., Garrison, J., Singhal, K., Sharma, Y., Azizi, S., Kulkarni, K., et al. (2023) · arXiv · doi:10.48550/arxiv.2312.00164 · Cited by 311
“Deep learning has been applied to promising effect for generating DDx in a number of specialties including radiology 4 , ophthalmology 5 and dermatology 3 , but such systems lack the interactive capabilities to fluently assist a user through communication in natural language.”
Artificial intelligence in clinical medicine: catalyzing a sustainable global healthcare paradigm
Krishnan, G., Singh, S., Pathania, M., Gosavi, S., Abhishek, S., Parchani, A., & Dhar, M. (2023) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2023.1227091 · Cited by 296
Eslam, M., Fan, J.-G., Yu, M.-L., Wong, V. W.-S., Cua, I. H., Liu, C.-J., Tanwandee, T., Gani, R., Seto, W.-K., Alam, S., et al. (2025) · Hepatology International · doi:10.1007/s12072-024-10774-3 · Cited by 170
Bedrikovetski, S., Dudi-Venkata, N. N., Kroon, H. M., Seow, W., Vather, R., Carneiro, G., Moore, J. W., & Sammour, T. (2021) · BMC Cancer · doi:10.1186/s12885-021-08773-w · Cited by 162
Metadata
- Authors
- Rauschecker, A. M., Rudie, J. D., Xie, L., Wang, J., Duong, M. T., Botzolakis, E. J., Kovalovich, A. M., Egan, J., Cook, T. C., Bryan, R. N., Nasrallah, I. M., Mohan, S., & Gee, J. C.
- Affiliations
- University of California, San Francisco (US)
- From the Department of Radiology & Biomedical Imaging, University of California, San Francisco, 513 Parnassus Ave, Room S-261, Box 0628, San Francisco, CA 94143-0628 (A.M.R.); Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, PA 19104 (A.M.R., J.D.R., L.X., J.W., M.T.D., A.M.K., J.E., T.C.C., I.M.N., S.M., J.C.G.); Mecklenburg Radiology Associates, Charlotte, NC (E.J.B.); and Department of Radiology, University of Texas at Austin, Austin, TX (R.N.B.).
- ORCID
- Venue
- Radiology
- Published
- 2020-06
- Volume
- 295
- Issue
- 3
- Pages
- 626-637
- ISSN
- 0033-8419 (ISSN-L)
- 1527-1315
- PMC
- PMC7263320
- OpenAlex
- W3014301887
- Cited by
- 148
- References
- 34
- Citations by year
- 2026: 14 · 2025: 28 · 2024: 22 · 2023: 20 · 2022: 26 · 2021: 26 · 2020: 12
- FWCI
- 6.18
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Radiology (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- eScholarship (California Digital Library) (submittedVersion)
- Funders
- National Institutes of Health (T32)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Brain Tumor Detection and Classification
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiomics and Machine Learning in Medical Imaging
- Keywords
- artificial intelligence, differential diagnosis, brain MRI, neuroradiology, Bayesian networks, quantitative imaging features, probabilistic diagnosis, radiologist comparison
- MeSH terms
- Adult, Aged, Artificial Intelligence, Brain, Brain Diseases, Diagnosis, Computer-Assisted, Diagnosis, Differential, Female, Humans, Magnetic Resonance Imaging, Male, Middle Aged, Retrospective Studies, Sensitivity and Specificity, Rare Diseases
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Artificial Intelligence System Approaching Neuroradiologist-level Differential Diagnosis Accuracy at Brain MRI. https://app.cochat.ai/papers/10.1148/radiol.2020190283
- The paper
- Rauschecker, A. M., Rudie, J. D., Xie, L., Wang, J., Duong, M. T., Botzolakis, E. J., Kovalovich, A. M., Egan, J., Cook, T. C., Bryan, R. N., Nasrallah, I. M., Mohan, S., & Gee, J. C. (2020). Artificial Intelligence System Approaching Neuroradiologist-level Differential Diagnosis Accuracy at Brain MRI. Radiology. https://doi.org/10.1148/radiol.2020190283
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.