Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 442

The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.

Utility of a Deep-Learning Algorithm to Guide Novices to Acquire Echocardiograms for Limited Diagnostic Use

Open access
Narang, Akhil, Bae, Richard, Hong, Ha, Thomas, Yngvil, Surette, Samuel, Cadieu, Charles, Chaudhry, Ali, Martin, Randolph P., McCarthy, Patrick M., Rubenson, David S., Goldstein, Steven, Little, Stephen H., Lang, Roberto M., Weissman, Neil J., Thomas, James D.·2021·JAMA Cardiology

Abstract

Importance: Artificial intelligence (AI) has been applied to analysis of medical imaging in recent years, but AI to guide the acquisition of ultrasonography images is a novel area of investigation. A novel deep-learning (DL) algorithm, trained on more than 5 million examples of the outcome of ultrasonographic probe movement on image quality, can provide real-time prescriptive guidance for novice operators to obtain limited diagnostic transthoracic echocardiographic images. Objective: To test whether novice users could obtain 10-view transthoracic echocardiographic studies of diagnostic quality using this DL-based software. Design, Setting, and Participants: This prospective, multicenter diagnostic study was conducted in 2 academic hospitals. A cohort of 8 nurses who had not previously conducted echocardiograms was recruited and trained with AI. Each nurse scanned 30 patients aged at least 18 years who were scheduled to undergo a clinically indicated echocardiogram at Northwestern Memorial Hospital or Minneapolis Heart Institute between March and May 2019. These scans were compared with those of sonographers using the same echocardiographic hardware but without AI guidance. Interventions: Each patient underwent paired limited echocardiograms: one from a nurse without prior echocardiography experience using the DL algorithm and the other from a sonographer without the DL algorithm. Five level 3-trained echocardiographers independently and blindly evaluated each acquisition. Main Outcomes and Measures: Four primary end points were sequentially assessed: qualitative judgement about left ventricular size and function, right ventricular size, and the presence of a pericardial effusion. Secondary end points included 6 other clinical parameters and comparison of scans by nurses vs sonographers. Results: A total of 240 patients (mean [SD] age, 61 [16] years old; 139 men [57.9%]; 79 [32.9%] with body mass indexes >30) completed the study. Eight nurses each scanned 30 patients using the DL algorithm, producing studies judged to be of diagnostic quality for left ventricular size, function, and pericardial effusion in 237 of 240 cases (98.8%) and right ventricular size in 222 of 240 cases (92.5%). For the secondary end points, nurse and sonographer scans were not significantly different for most parameters. Conclusions and Relevance: This DL algorithm allows novices without experience in ultrasonography to obtain diagnostic transthoracic echocardiographic studies for evaluation of left ventricular size and function, right ventricular size, and presence of a nontrivial pericardial effusion, expanding the reach of echocardiography to clinical settings in which immediate interrogation of anatomy and cardiac function is needed and settings with limited resources.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1001/jamacardio.2021.0185

Cites

5 of 5 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 5 references

Research works printed but not linked: 18

  1. Knackstedt, 2015, Fully automated versus standard tracking of left ventricular ejection fraction and longitudinal strain: the FAST-EFS multicenter study., J Am Coll Cardiol, 66, 1456, 10.1016/j.jacc.2015.07.052 · DOI · Paper page
  2. Kusunose, 2020, A deep learning approach for assessment of regional wall motion abnormality from echocardiographic images., JACC Cardiovasc Imaging, 13, 374, 10.1016/j.jcmg.2019.02.024 · DOI · Paper page
  3. Kusunose, 2019, Utilization of artificial intelligence in echocardiography., Circ J, 83, 1623, 10.1253/circj.CJ-19-0420 · DOI
  4. Medvedofsky, 2018, Three-dimensional echocardiographic quantification of the left-heart chambers using an automated adaptive analytics algorithm: multicentre validation study., Eur Heart J Cardiovasc Imaging, 19, 47, 10.1093/ehjci/jew328 · DOI
  5. Narang, 2019, Machine learning based automated dynamic quantification of left heart chamber volumes., Eur Heart J Cardiovasc Imaging, 20, 541, 10.1093/ehjci/jey137 · DOI
  6. Narula, 2016, Machine-learning algorithms to automate morphological and functional assessments in 2D echocardiography., J Am Coll Cardiol, 68, 2287, 10.1016/j.jacc.2016.08.062 · DOI · Paper page
  7. Raghavendra, 2017, Fusion of spatial gray level dependency and fractal texture features for the characterization of thyroid lesions., Ultrasonics, 77, 110, 10.1016/j.ultras.2017.02.003 · DOI
  8. Sengupta, 2016, Cognitive machine-learning algorithm for cardiac imaging: a pilot study for differentiating constrictive pericarditis from restrictive cardiomyopathy., Circ Cardiovasc Imaging, 9, 10.1161/CIRCIMAGING.115.004330 · DOI · Paper page
  9. Mitchell, 2019, Guidelines for performing a comprehensive transthoracic echocardiographic examination in adults: recommendations from the American Society of Echocardiography., J Am Soc Echocardiogr, 32, 1, 10.1016/j.echo.2018.06.004 · DOI · Paper page
  10. Gallas, 2007, Multireader multicase variance analysis for binary data., J Opt Soc Am A Opt Image Sci Vis, 24, B70, 10.1364/JOSAA.24.000B70 · DOI
  11. Wiegers, 2019, 2019 ACC/AHA/ASE Advanced Training Statement on Echocardiography (revision of the 2003 ACC/AHA Clinical Competence Statement on Echocardiography): a report of the ACC Competency Management Committee., J Am Soc Echocardiogr, 32, 919, 10.1016/j.echo.2019.04.002 · DOI
  12. Genovese, 2019, Machine learning-based three-dimensional echocardiographic quantification of right ventricular size and function: validation against cardiac magnetic resonance., J Am Soc Echocardiogr, 32, 969, 10.1016/j.echo.2019.04.001 · DOI
  13. Volpato, 2019, Automated, machine learning-based, 3D echocardiographic quantification of left ventricular mass., Echocardiography, 36, 312, 10.1111/echo.2019.36.issue-2 · doi:10.1111/echo.2019.36.issue-2
  14. Asch, 2019, Automated echocardiographic quantification of left ventricular ejection fraction without volume measurements using a machine learning algorithm mimicking a human expert., Circ Cardiovasc Imaging, 12, 10.1161/CIRCIMAGING.119.009303 · DOI · Paper page
  15. Sanchez-Martinez, 2018, Machine learning analysis of left ventricular function to characterize heart failure with preserved ejection fraction., Circ Cardiovasc Imaging, 11, 10.1161/CIRCIMAGING.117.007138 · DOI
  16. Tabassian, 2018, Diagnosis of heart failure with preserved ejection fraction: machine learning of spatiotemporal variations in left ventricular deformation., J Am Soc Echocardiogr, 31, 1272, 10.1016/j.echo.2018.07.013 · DOI
  17. Ryan, 2015, COCATS 4 task force 5: training in echocardiography., J Am Coll Cardiol, 65, 1786, 10.1016/j.jacc.2015.03.035 · DOI
  18. American College of Cardiology. COVID-19 clinical guidance for the cardiovascular care team. Published 2020. Accessed March 23, 2020. https://www.acc.org/~/media/Non-Clinical/Files-PDFs-Excel-MS-Word-etc/2020/02/S20028-ACC-Clinical-Bulletin-Coronavirus.pdf

Cited by

See all 442

Metadata

Authors
Narang, A., Bae, R., Hong, H., Thomas, Y., Surette, S., Cadieu, C., Chaudhry, A., Martin, R. P., McCarthy, P. M., Rubenson, D. S., Goldstein, S., Little, S. H., Lang, R. M., Weissman, N. J., & Thomas, J. D.
Venue
JAMA Cardiology
Published
2021-06-01
Volume
6
Issue
6
Pages
624
ISSN
2380-6583 (ISSN-L)
OpenAlex
W3132346797
Cited by
442
References
5
FWCI
13.61
Type
journal article
Language
en
Open access
hybrid

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Utility of a Deep-Learning Algorithm to Guide Novices to Acquire Echocardiograms for Limited Diagnostic Use. https://app.cochat.ai/papers/10.1001/jamacardio.2021.0185
The paper
Narang, A., Bae, R., Hong, H., Thomas, Y., Surette, S., Cadieu, C., Chaudhry, A., Martin, R. P., McCarthy, P. M., Rubenson, D. S., Goldstein, S., Little, S. H., Lang, R. M., Weissman, N. J., & Thomas, J. D. (2021). Utility of a Deep-Learning Algorithm to Guide Novices to Acquire Echocardiograms for Limited Diagnostic Use. JAMA Cardiology. https://doi.org/10.1001/jamacardio.2021.0185

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.