The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Utility of a Deep-Learning Algorithm to Guide Novices to Acquire Echocardiograms for Limited Diagnostic Use
Open accessAbstract
Importance: Artificial intelligence (AI) has been applied to analysis of medical imaging in recent years, but AI to guide the acquisition of ultrasonography images is a novel area of investigation. A novel deep-learning (DL) algorithm, trained on more than 5 million examples of the outcome of ultrasonographic probe movement on image quality, can provide real-time prescriptive guidance for novice operators to obtain limited diagnostic transthoracic echocardiographic images. Objective: To test whether novice users could obtain 10-view transthoracic echocardiographic studies of diagnostic quality using this DL-based software. Design, Setting, and Participants: This prospective, multicenter diagnostic study was conducted in 2 academic hospitals. A cohort of 8 nurses who had not previously conducted echocardiograms was recruited and trained with AI. Each nurse scanned 30 patients aged at least 18 years who were scheduled to undergo a clinically indicated echocardiogram at Northwestern Memorial Hospital or Minneapolis Heart Institute between March and May 2019. These scans were compared with those of sonographers using the same echocardiographic hardware but without AI guidance. Interventions: Each patient underwent paired limited echocardiograms: one from a nurse without prior echocardiography experience using the DL algorithm and the other from a sonographer without the DL algorithm. Five level 3-trained echocardiographers independently and blindly evaluated each acquisition. Main Outcomes and Measures: Four primary end points were sequentially assessed: qualitative judgement about left ventricular size and function, right ventricular size, and the presence of a pericardial effusion. Secondary end points included 6 other clinical parameters and comparison of scans by nurses vs sonographers. Results: A total of 240 patients (mean [SD] age, 61 [16] years old; 139 men [57.9%]; 79 [32.9%] with body mass indexes >30) completed the study. Eight nurses each scanned 30 patients using the DL algorithm, producing studies judged to be of diagnostic quality for left ventricular size, function, and pericardial effusion in 237 of 240 cases (98.8%) and right ventricular size in 222 of 240 cases (92.5%). For the secondary end points, nurse and sonographer scans were not significantly different for most parameters. Conclusions and Relevance: This DL algorithm allows novices without experience in ultrasonography to obtain diagnostic transthoracic echocardiographic studies for evaluation of left ventricular size and function, right ventricular size, and presence of a nontrivial pericardial effusion, expanding the reach of echocardiography to clinical settings in which immediate interrogation of anatomy and cardiac function is needed and settings with limited resources.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Video-based AI for beat-to-beat assessment of cardiac function
Ouyang, D., He, B., Ghorbani, A., Yuan, N., Ebinger, J., Langlotz, C. P., Heidenreich, P. A., Harrington, R. A., Liang, D. H., Ashley, E. A., et al. (2020) · Nature · doi:10.1038/s41586-020-2145-8 · Cited by 1,153
Zhang, J., Gajjala, S., Agrawal, P., Tison, G. H., Hallock, L. A., Beussink-Nelson, L., Lassen, M. H., Fan, E., Aras, M. A., Jordan, C., et al. (2018) · Circulation · doi:10.1161/circulationaha.118.034338 · Cited by 1,006
Fast and accurate view classification of echocardiograms using deep learning
Madani, A., Arnaout, R., Mofrad, M., & Arnaout, R. (2018) · npj Digital Medicine · doi:10.1038/s41746-017-0013-1 · Cited by 585
Deep learning interpretation of echocardiograms
Ghorbani, A., Ouyang, D., Abid, A., He, B., Chen, J. H., Harrington, R. A., Liang, D. H., Ashley, E. A., & Zou, J. Y. (2020) · npj Digital Medicine · doi:10.1038/s41746-019-0216-8 · Cited by 518
Mobile and pervasive computing technologies and the future of Alzheimer’s clinical trials
Doraiswamy, P. M., Narayan, V. A., & Manji, H. K. (2018) · npj Digital Medicine · doi:10.1038/s41746-017-0008-y · Cited by 97
Research works printed but not linked: 18
- Knackstedt, 2015, Fully automated versus standard tracking of left ventricular ejection fraction and longitudinal strain: the FAST-EFS multicenter study., J Am Coll Cardiol, 66, 1456, 10.1016/j.jacc.2015.07.052 · DOI · Paper page
- Kusunose, 2020, A deep learning approach for assessment of regional wall motion abnormality from echocardiographic images., JACC Cardiovasc Imaging, 13, 374, 10.1016/j.jcmg.2019.02.024 · DOI · Paper page
- Kusunose, 2019, Utilization of artificial intelligence in echocardiography., Circ J, 83, 1623, 10.1253/circj.CJ-19-0420 · DOI
- Medvedofsky, 2018, Three-dimensional echocardiographic quantification of the left-heart chambers using an automated adaptive analytics algorithm: multicentre validation study., Eur Heart J Cardiovasc Imaging, 19, 47, 10.1093/ehjci/jew328 · DOI
- Narang, 2019, Machine learning based automated dynamic quantification of left heart chamber volumes., Eur Heart J Cardiovasc Imaging, 20, 541, 10.1093/ehjci/jey137 · DOI
- Narula, 2016, Machine-learning algorithms to automate morphological and functional assessments in 2D echocardiography., J Am Coll Cardiol, 68, 2287, 10.1016/j.jacc.2016.08.062 · DOI · Paper page
- Raghavendra, 2017, Fusion of spatial gray level dependency and fractal texture features for the characterization of thyroid lesions., Ultrasonics, 77, 110, 10.1016/j.ultras.2017.02.003 · DOI
- Sengupta, 2016, Cognitive machine-learning algorithm for cardiac imaging: a pilot study for differentiating constrictive pericarditis from restrictive cardiomyopathy., Circ Cardiovasc Imaging, 9, 10.1161/CIRCIMAGING.115.004330 · DOI · Paper page
- Mitchell, 2019, Guidelines for performing a comprehensive transthoracic echocardiographic examination in adults: recommendations from the American Society of Echocardiography., J Am Soc Echocardiogr, 32, 1, 10.1016/j.echo.2018.06.004 · DOI · Paper page
- Gallas, 2007, Multireader multicase variance analysis for binary data., J Opt Soc Am A Opt Image Sci Vis, 24, B70, 10.1364/JOSAA.24.000B70 · DOI
- Wiegers, 2019, 2019 ACC/AHA/ASE Advanced Training Statement on Echocardiography (revision of the 2003 ACC/AHA Clinical Competence Statement on Echocardiography): a report of the ACC Competency Management Committee., J Am Soc Echocardiogr, 32, 919, 10.1016/j.echo.2019.04.002 · DOI
- Genovese, 2019, Machine learning-based three-dimensional echocardiographic quantification of right ventricular size and function: validation against cardiac magnetic resonance., J Am Soc Echocardiogr, 32, 969, 10.1016/j.echo.2019.04.001 · DOI
- Volpato, 2019, Automated, machine learning-based, 3D echocardiographic quantification of left ventricular mass., Echocardiography, 36, 312, 10.1111/echo.2019.36.issue-2 · doi:10.1111/echo.2019.36.issue-2
- Asch, 2019, Automated echocardiographic quantification of left ventricular ejection fraction without volume measurements using a machine learning algorithm mimicking a human expert., Circ Cardiovasc Imaging, 12, 10.1161/CIRCIMAGING.119.009303 · DOI · Paper page
- Sanchez-Martinez, 2018, Machine learning analysis of left ventricular function to characterize heart failure with preserved ejection fraction., Circ Cardiovasc Imaging, 11, 10.1161/CIRCIMAGING.117.007138 · DOI
- Tabassian, 2018, Diagnosis of heart failure with preserved ejection fraction: machine learning of spatiotemporal variations in left ventricular deformation., J Am Soc Echocardiogr, 31, 1272, 10.1016/j.echo.2018.07.013 · DOI
- Ryan, 2015, COCATS 4 task force 5: training in echocardiography., J Am Coll Cardiol, 65, 1786, 10.1016/j.jacc.2015.03.035 · DOI
- American College of Cardiology. COVID-19 clinical guidance for the cardiovascular care team. Published 2020. Accessed March 23, 2020. https://www.acc.org/~/media/Non-Clinical/Files-PDFs-Excel-MS-Word-etc/2020/02/S20028-ACC-Clinical-Bulletin-Coronavirus.pdf
Cited by
Díaz-Gómez, J. L., Mayo, P. H., & Koenig, S. J. (2021) · New England Journal of Medicine · doi:10.1056/nejmra1916062 · Cited by 499
The current and future state of AI interpretation of medical images
Rajpurkar, P., & Lungren, M. P. (2023) · New England Journal of Medicine · doi:10.1056/nejmra2301725 · Cited by 443
Artificial Intelligence -based technologies in nursing: A scoping literature review of the evidence
von Gerich, H., Moen, H., Block, L. J., Chu, C. H., DeForest, H., Hobensack, M., Michalowski, M., Mitchell, J., Nibber, R., Olalia, M. A., et al. (2022) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2021.104153 · Cited by 360
Data drift in medical machine learning: implications and potential remedies
Sahiner, B., Chen, W., Samala, R. K., & Petrick, N. (2023) · The British Journal of Radiology · doi:10.1259/bjr.20220878 · Cited by 279
Vision–language foundation model for echocardiogram interpretation
Christensen, M., Vukadinovic, M., Yuan, N., & Ouyang, D. (2024) · Nature Medicine · doi:10.1038/s41591-024-02959-y · Cited by 231
Metadata
- Authors
- Narang, A., Bae, R., Hong, H., Thomas, Y., Surette, S., Cadieu, C., Chaudhry, A., Martin, R. P., McCarthy, P. M., Rubenson, D. S., Goldstein, S., Little, S. H., Lang, R. M., Weissman, N. J., & Thomas, J. D.
- Venue
- JAMA Cardiology
- Publisher
- American Medical Association (AMA)
- Published
- 2021-06-01
- Volume
- 6
- Issue
- 6
- Pages
- 624
- ISSN
- 2380-6583 (ISSN-L)
- OpenAlex
- W3132346797
- Cited by
- 442
- References
- 5
- FWCI
- 13.61
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Utility of a Deep-Learning Algorithm to Guide Novices to Acquire Echocardiograms for Limited Diagnostic Use. https://app.cochat.ai/papers/10.1001/jamacardio.2021.0185
- The paper
- Narang, A., Bae, R., Hong, H., Thomas, Y., Surette, S., Cadieu, C., Chaudhry, A., Martin, R. P., McCarthy, P. M., Rubenson, D. S., Goldstein, S., Little, S. H., Lang, R. M., Weissman, N. J., & Thomas, J. D. (2021). Utility of a Deep-Learning Algorithm to Guide Novices to Acquire Echocardiograms for Limited Diagnostic Use. JAMA Cardiology. https://doi.org/10.1001/jamacardio.2021.0185
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.