Augmented Radiologist Workflow Improves Report Value and Saves Time: A Potential Model for Implementation of Artificial Intelligence
Open accessThe DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
Rationale and Objectives: Our primary aim was to improve radiology reports by increasing concordance of target lesion measurements with oncology records using radiology preprocessors (RP). Faster notification of incidental actionable findings to referring clinicians and clinical radiologist exam interpretation time savings with RPs quantifying tumor burden were also assessed. Materials and Methods: In this prospective quality improvement initiative, RPs annotated lesions before radiologist interpretation of CT exams. Clinical radiologists then hyperlinked approved measurements into interactive reports during interpretations. RPs evaluated concordance with our tumor measurement radiologist, the determinant of tumor burden. Actionable finding detection and notification times were also deduced. Clinical radiologist interpretation times were calculated from established average CT chest, abdomen, and pelvis interpretation times. Results: RPs assessed 1287 body CT exams with 812 follow-up CT chest, abdomen, and pelvis studies; 95 (11.7%) of which had 241 verified target lesions. There was improved concordance (67.8% vs.22.5%) of target lesion measurements. RPs detected 93.1% incidental actionable findings with faster clinician notification by a median time of 1 hour (range: 15 minutes–16 hours). Radiologist exam interpretation times decreased by 37%. Conclusions: This workflow resulted in three-fold improved target lesion measurement concordance with oncology records, earlier detection and faster notification of incidental actionable findings to referring clinicians, and decreased exam interpretation times for clinical radiologists. These findings demonstrate potential roles for automation (such as AI) to improve report value, worklist prioritization, and patient care.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Yan, K., Wang, X., Lu, L., & Summers, R. M. (2018) · Journal of medical imaging · doi:10.1117/1.jmi.5.3.036501 · Cited by 573 · cited 2×
“As an example of success, interactive reporting with hyperlinks allowed for the 32K Lesion dataset to be made publicly available in 2018 (8).”
BackgroundMethodLanglotz, C. P., Allen, B., Erickson, B. J., Kalpathy-Cramer, J., Bigelow, K., Cook, T. S., Flanders, A. E., Lungren, M. P., Mendelson, D. S., Rudie, J. D., et al. (2019) · Radiology · doi:10.1148/radiol.2019190613 · Cited by 368 · cited 1×
“…(such as RP and radiologist lesion measurements from this study) can be made more readily available for machine learning development using the concept of local training and interinstitutional distribution of algorithms without transferring sensitive patient data, known as federated learning (24).”
Distributed deep learning networks among institutions for medical imaging
Chang, K., Balachandar, N., Lam, C., Yi, D., Brown, J., Beers, A., Rosen, B., Rubin, D. L., & Kalpathy-Cramer, J. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy017 · Cited by 340
Cited by
Preparing Medical Imaging Data for Machine Learning
Willemink, M. J., Koszek, W. A., Hardell, C., Wu, J., Fleischmann, D., Harvey, H., Folio, L. R., Summers, R. M., Rubin, D. L., & Lungren, M. P. (2020) · Radiology · doi:10.1148/radiol.2020192224 · Cited by 1,020
“Measurements can be performed in advance of radiologists by radiology preprocessors that improve annotation quality while saving radiologists time (61).”
BackgroundSelf-citationPierre, K., Haneberg, A. G., Kwak, S., Peters, K. R., Hochhegger, B., Sananmuang, T., Tunlayadechanont, P., Tighe, P. J., Mancuso, A., & Forghani, R. (2023) · Seminars in Roentgenology · doi:10.1053/j.ro.2023.02.003 · Cited by 79
Catalina, Q. M., Fuster-Casanovas, A., Vidal-Alaball, J., Escalé-Besa, A., Marin-Gomez, F. X., Femenia, J., & Solé-Casals, J. (2023) · DIGITAL HEALTH · doi:10.1177/20552076231180511 · Cited by 71
Artificial Intelligence in Emergency Radiology: Where Are We Going?
Cellina, M., Cè, M., Irmici, G., Ascenti, V., Caloro, E., Bianchi, L., Pellegrino, G., D’Amico, N., Papa, S., & Carrafiello, G. (2022) · Diagnostics · doi:10.3390/diagnostics12123223 · Cited by 62
Metadata
- Authors
- Do, H. M., Spear, L. G., Nikpanah, M., Mirmomen, S. M., Machado, L. B., Toscano, A. P., Turkbey, B., Bagheri, M. H., Gulley, J. L., & Folio, L. R.
- Venue
- Academic Radiology
- Publisher
- Elsevier BV
- Published
- 2020-01
- Volume
- 27
- Issue
- 1
- Pages
- 96-105
- ISSN
- 1076-6332 (ISSN-L)
- OpenAlex
- W2994230815
- Cited by
- 70
- References
- 3
- FWCI
- 4.65
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Augmented Radiologist Workflow Improves Report Value and Saves Time: A Potential Model for Implementation of Artificial Intelligence. https://app.cochat.ai/papers/10.1016/j.acra.2019.09.014
- The paper
- Do, H. M., Spear, L. G., Nikpanah, M., Mirmomen, S. M., Machado, L. B., Toscano, A. P., Turkbey, B., Bagheri, M. H., Gulley, J. L., & Folio, L. R. (2020). Augmented Radiologist Workflow Improves Report Value and Saves Time: A Potential Model for Implementation of Artificial Intelligence. Academic Radiology. https://doi.org/10.1016/j.acra.2019.09.014
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.