The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Video-based AI for beat-to-beat assessment of cardiac function
Open accessPublished version of a preprint
Abstract
Accurate assessment of cardiac function is crucial for the diagnosis of cardiovascular disease 1, screening for cardiotoxicity 2 and decisions regarding the clinical management of patients with a critical illness 3. However, human assessment of cardiac function focuses on a limited sampling of cardiac cycles and has considerable inter-observer variability despite years of training 4,5. Here, to overcome this challenge, we present a video-based deep learning algorithm-EchoNet-Dynamic-that surpasses the performance of human experts in the critical tasks of segmenting the left ventricle, estimating ejection fraction and assessing cardiomyopathy. Trained on echocardiogram videos, our model accurately segments the left ventricle with a Dice similarity coefficient of 0.92, predicts ejection fraction with a mean absolute error of 4.1% and reliably classifies heart failure with reduced ejection fraction (area under the curve of 0.97). In an external dataset from another healthcare system, EchoNet-Dynamic predicts the ejection fraction with a mean absolute error of 6.0% and classifies heart failure with reduced ejection fraction with an area under the curve of 0.96. Prospective evaluation with repeated human measurements confirms that the model has variance that is comparable to or less than that of human experts. By leveraging information across multiple cardiac cycles, our model can rapidly identify subtle changes in ejection fraction, is more reproducible than human evaluation and lays the foundation for precise diagnosis of cardiovascular disease in real time. As a resource to promote further innovation, we also make publicly available a large dataset of 10,030 annotated echocardiogram videos.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Accurate segmentation is essential for many clinical applications, including disease diagnosis, treatment planning, and monitoring of disease progression2,3.”
From Segment anything in medical images (2024) · cites this paper as [3]
In the citing paper
“To account for the fact that most studies utilize privately held medical imaging datasets, 10,000 annotated echocardiogram videos were recently open-sourced 36 .”
From Deep learning-enabled medical computer vision (2021) · cites this paper as [36]
In the citing paper
“Alongside this release, a video-based model, EchoNet-Dynamic 36 , was developed.It can estimate ejection fraction and assess cardiomyopathy, alongside a comprehensive evaluation criterion based on results from an external dataset and human experts.”
From Deep learning-enabled medical computer vision (2021) · cites this paper as [36]
In the citing paper
“Foundation models are uniquely powerful in their ability to integrate multimodal patient data ranging from the EHR [Rajkomar et al. 2018] to medical imaging [Bera et al. 2019; Ouyang et al. 2020] to drug and molecular measurements [Gottlieb et al. 2011; Ruiz et al. 2020] to make an optimal prediction.”
From On the Opportunities and Risks of Foundation Models (2021) · cites this paper as Ouyang et al. 2020
Citations
Cites
Dermatologist-level classification of skin cancer with deep neural networks
Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., & Thrun, S. (2017) · Nature · doi:10.1038/nature21056 · Cited by 14,362
2013 ACCF/AHA Guideline for the Management of Heart Failure
Yancy, C. W., Jessup, M., Bozkurt, B., Butler, J., Casey, D. E., Drazner, M. H., Fonarow, G. C., Geraci, S. A., Horwich, T., Januzzi, J. L., et al. (2013) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2013.05.019 · Cited by 12,536
Lang, R. M., Badano, L. P., Mor-Avi, V., Afilalo, J., Armstrong, A., Ernande, L., Flachskampf, F. A., Foster, E., Goldstein, S. A., Kuznetsova, T., et al. (2015) · Journal of the American Society of Echocardiography · doi:10.1016/j.echo.2014.10.003 · Cited by 12,362
Surviving Sepsis Campaign: International Guidelines for Management of Severe Sepsis and Septic Shock
Dellinger, R. P., Levy, M. M., Rhodes, A., Annane, D., Gerlach, H., Opal, S. M., Sevransky, J. E., Sprung, C. L., Douglas, I. S., Jaeschke, R., et al. (2013) · Critical Care Medicine · doi:10.1097/ccm.0b013e31827e83af · Cited by 9,694
Learning Spatiotemporal Features with 3D Convolutional Networks
Tran, D., Bourdev, L., Fergus, R., Torresani, L., & Paluri, M. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.510 · Cited by 9,593 · cited 5×
“We tested three model architectures with variable integration of temporal convolutions (R3D, MC3 and R2+1D) and ultimately chose decomposed R2+1D spatiotemporal convolutions as the architecture with the best performance to use for EchoNet-Dynamic 29,30 (Extended Data Fig.”
MethodResultInfluentialLang, R. M., Badano, L. P., Mor-Avi, V., Afilalo, J., Armstrong, A., Ernande, L., Flachskampf, F. A., Foster, E., Goldstein, S. A., Kuznetsova, T., et al. (2015) · European Heart Journal – Cardiovascular Imaging · doi:10.1093/ehjci/jev014 · Cited by 8,361 · cited 10×
“Impairment of Human assessment of the ejection fraction has variance in part due to the common finding of irregularity in the heart rate and the laborious nature of a calculation that requires manual tracing of the size of the ventricle to quantify every beat 4,5 .”
BackgroundMethodInfluentialGulshan, V., Peng, L., Coram, M., Stumpe, M. C., Wu, D., Narayanaswamy, A., Venugopalan, S., Widner, K., Madams, T., Cuadros, J., et al. (2016) · JAMA · doi:10.1001/jama.2016.17216 · Cited by 7,697
The Surviving Sepsis Campaign Guidelines Committee including The Pediatric Subgroup*, Dellinger, R. P., Levy, M. M., Rhodes, A., Annane, D., Gerlach, H., Opal, S. M., Sevransky, J. E., Sprung, C. L., Douglas, I. S., et al. (2013) · Intensive Care Medicine · doi:10.1007/s00134-012-2769-8 · Cited by 7,290
ESC Guidelines for the diagnosis and treatment of acute and chronic heart failure 2012
Authors/Task Force Members, McMurray, J. J. V., Adamopoulos, S., Anker, S. D., Auricchio, A., Böhm, M., Dickstein, K., Falk, V., Filippatos, G., Fonseca, C., et al. (2012) · European Heart Journal · doi:10.1093/eurheartj/ehs104 · Cited by 6,879
A Closer Look at Spatiotemporal Convolutions for Action Recognition
Tran, D., Wang, H., Torresani, L., Ray, J., LeCun, Y., & Paluri, M. (2017) · arXiv · doi:10.48550/arxiv.1711.11248 · Cited by 3,664
Research works printed but not linked: 1
- Chen, L.-C., Papandreou, G., Schroff, F. & Adam, H. Rethinking atrous convolution for semantic image segmentation. Preprint at https://arxiv.org/abs/1706.05587 (2017). · arXiv
Cited by
Rajpurkar, P., Chen, E., Banerjee, O., & Topol, E. J. (2022) · Nature Medicine · doi:10.1038/s41591-021-01614-0 · Cited by 3,212
“AI systems have achieved considerable improvements in accuracy for radiology tasks, including mammography interpretation 21,22 , cardiac function assessment 23,24 and lung cancer screening 25 , tackling not only diagnosis but also risk prediction and treatment 26 .”
BackgroundSegment anything in medical images
Ma, J., He, Y., Li, F., Han, L., You, C., & Wang, B. (2024) · Nature Communications · doi:10.1038/s41467-024-44824-z · Cited by 2,913
“Accurate segmentation is essential for many clinical applications, including disease diagnosis, treatment planning, and monitoring of disease progression [1], [2].”
On the Opportunities and Risks of Foundation Models
Bommasani, R., Hudson, D. A., Adeli, E., Altman, R., Arora, S., von Arx, S., Bernstein, M. S., Bohg, J., Bosselut, A., Brunskill, E., et al. (2021) · arXiv · doi:10.48550/arxiv.2108.07258 · Cited by 2,676
Deep learning-enabled medical computer vision
Esteva, A., Chou, K., Yeung, S., Naik, N., Madani, A., Mottaghi, A., Liu, Y., Topol, E., Dean, J., & Socher, R. (2021) · npj Digital Medicine · doi:10.1038/s41746-020-00376-2 · Cited by 1,406
Transformers in medical imaging: A survey
Shamshad, F., Khan, S., Zamir, S. W., Khan, M. H., Hayat, M., Khan, F. S., & Fu, H. (2023) · Medical Image Analysis · doi:10.1016/j.media.2023.102802 · Cited by 1,296
Metadata
- Authors
- Ouyang, D., He, B., Ghorbani, A., Yuan, N., Ebinger, J., Langlotz, C. P., Heidenreich, P. A., Harrington, R. A., Liang, D. H., Ashley, E. A., & Zou, J. Y.
- Affiliations
- Stanford Medicine (US)
- Stanford University (US)
- Cedars-Sinai Medical Center (US)
- Corresponding author
- Ouyang, David
- Zou, James Y.
- ORCID
- Venue
- Nature
- Published
- 2020-03-25
- Volume
- 580
- Issue
- 7802
- Pages
- 252-256
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- PMC
- PMC8979576
- OpenAlex
- W3013692475
- Cited by
- 1,153
- References
- 41
- Citations by year
- 2026: 263 · 2025: 276 · 2024: 212 · 2023: 172 · 2022: 122 · 2021: 85 · 2020: 22
- FWCI
- 62.03
- Type
- journal article
- Language
- en
- Open access
- green
- doi.org
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Nature (publishedVersion)
- medRxiv (acceptedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Funders
- National Science Foundation (1763191)
- American College of Cardiology Foundation
- National Institutes of Health (1r21md012867-01, R21 MD012867-01)
- National Institute on Aging (P30AG059307)
- National Heart, Lung, and Blood Institute (F32 HL149298)
- National Institute on Minority Health and Health Disparities (R21 MD012867)
- Stanford Cardiovascular Institute, School of Medicine, Stanford University
- Topics
- Health Sciences › Medicine › Cardiology and Cardiovascular Medicine › Cardiovascular Function and Risk Factors
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Keywords
- EchoNet-Dynamic, echocardiography, left ventricle segmentation, ejection fraction estimation, heart failure with reduced ejection fraction, cardiomyopathy classification, interobserver variability, cardiovascular disease diagnosis
- MeSH terms
- Deep Learning, Atrial Fibrillation, Echocardiography, Heart, Heart Diseases, Heart Failure, Hospitals, Humans, Models, Cardiovascular, Prospective Studies, Video Recording, Reproducibility of Results, Ventricular Function, Left, Datasets as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Video-based AI for beat-to-beat assessment of cardiac function. https://app.cochat.ai/papers/10.1038/s41586-020-2145-8
- The paper
- Ouyang, D., He, B., Ghorbani, A., Yuan, N., Ebinger, J., Langlotz, C. P., Heidenreich, P. A., Harrington, R. A., Liang, D. H., Ashley, E. A., & Zou, J. Y. (2020). Video-based AI for beat-to-beat assessment of cardiac function. Nature. https://doi.org/10.1038/s41586-020-2145-8
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.