The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Prospective validation of a deep learning electrocardiogram algorithm for the detection of left ventricular systolic dysfunction
Abstract
Objectives: We sought to validate a deep learning algorithm designed to predict an ejection fraction (EF) less than or equal to 35% based on the 12‐lead electrocardiogram (ECG) in a large prospective cohort. Background: Patients undergoing routine ECG may have undetected left ventricular (LV) dysfunction that warrants further echocardiographic assessment. However, identification of these patients can be challenging. Methods: We applied the algorithm to all ECGs interpreted by the Mayo Clinic ECG laboratory in September 2018. The performance of the algorithm was tested among patients with recent echocardiographic assessments of LV function. We also applied the algorithm in patients with no recent echocardiographic assessments of LV function to determine the rate of new “positive screens.” Results: Among 16 056 adult patients who underwent routine ECG, 8600 (age 67.1 ± 15.2 years, 45.6% male), had a transthoracic echocardiogram (TTE) and 3874 patients had a TTE and ECG less than 1 month apart. Among these patients, the algorithm was able to detect an EF less than or equal to 35% with 86.8% specificity, 82.5% sensitivity, and 86.5% accuracy, (area under the curve, 0.918). Among 474 “false‐positives screens,” 189 (39.8%) had an EF of 36% to 50%. Among patients with no prior TTE, the algorithm identified 3.5% of the patients with suspected EF less than or equal to 35%. Exploratory analysis suggests false positives could be reduced by assessing NT‐pro‐BNP after the initial “positive screen.” Conclusions: A deep learning algorithm detected depressed LV function with good accuracy in routine practice. Further studies are needed to validate the algorithm in patients with no prior echocardiogram and to assess the impact on echocardiography utilization, cost, and clinical outcomes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An Introduction to Support Vector Machines and Other Kernel-based Learning Methods
Cristianini, N., & Shawe-Taylor, J. (2000) · doi:10.1017/cbo9780511801389 · Cited by 13,855
2013 ACCF/AHA Guideline for the Management of Heart Failure
Yancy, C. W., Jessup, M., Bozkurt, B., Butler, J., Casey, D. E., Drazner, M. H., Fonarow, G. C., Geraci, S. A., Horwich, T., Januzzi, J. L., et al. (2013) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2013.05.019 · Cited by 12,536
Pfeffer, M. A., Braunwald, E., Moyé, L. A., Basta, L., Brown, E. J., Cuddy, T. E., Davis, B. R., Geltman, E. M., Goldman, S., Flaker, G. C., et al. (1992) · New England Journal of Medicine · doi:10.1056/nejm199209033271001 · Cited by 5,911
Attia, Z. I., Kapa, S., Lopez-Jimenez, F., McKie, P. M., Ladewig, D. J., Satam, G., Pellikka, P. A., Enriquez-Sarano, M., Noseworthy, P. A., Munger, T. M., et al. (2019) · Nature Medicine · doi:10.1038/s41591-018-0240-2 · Cited by 1,389 · cited 3×
“We previously reported on the development of this algorithm in a large population of patients with paired ECGs and echocardiograms.(5) However, the current study extends this evaluation to the patient not otherwise undergoing echocardiography and is the first to report the rate of “new positive screens.”
MethodResultInfluentialSelf-citationScreening for Asymptomatic Left Ventricular Dysfunction Using B‐Type Natriuretic Peptide
McDonagh, T. A., McDonald, K., & Maisel, A. S. (2008) · Congestive Heart Failure · doi:10.1111/j.1751-7133.2008.tb00002.x · Cited by 35
Cited by
Artificial intelligence-enhanced electrocardiography in cardiovascular disease management
Siontis, K. C., Noseworthy, P. A., Attia, Z. I., & Friedman, P. A. (2021) · Nature Reviews Cardiology · doi:10.1038/s41569-020-00503-2 · Cited by 914
Self-citationCardiac Troponin for Assessment of Myocardial Injury in COVID-19
Sandoval, Y., Januzzi, J. L., & Jaffe, A. S. (2020) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2020.06.068 · Cited by 438
Yao, X., Rushlow, D. R., Inselman, J. W., McCoy, R. G., Thacher, T. D., Behnken, E. M., Bernard, M. E., Rosas, S. L., Akfaly, A., Misra, A., et al. (2021) · Nature Medicine · doi:10.1038/s41591-021-01335-4 · Cited by 424
Self-citationApplication of artificial intelligence to the electrocardiogram
Attia, Z. I., Harmon, D. M., Behr, E. R., & Friedman, P. A. (2021) · European Heart Journal · doi:10.1093/eurheartj/ehab649 · Cited by 312
Self-citationPrediction of mortality from 12-lead electrocardiogram voltage data using a deep neural network
Raghunath, S., Ulloa Cerna, A. E., Jing, L., vanMaanen, D. P., Stough, J., Hartzel, D. N., Leader, J. B., Kirchner, H. L., Stumpe, M. C., Hafez, A., et al. (2020) · Nature Medicine · doi:10.1038/s41591-020-0870-z · Cited by 314
Artificial Intelligence in Cardiology: Present and Future
Lopez-Jimenez, F., Attia, Z., Arruda-Olson, A. M., Carter, R., Chareonthaitawee, P., Jouni, H., Kapa, S., Lerman, A., Luong, C., Medina-Inojosa, J. R., et al. (2020) · Mayo Clinic Proceedings · doi:10.1016/j.mayocp.2020.01.038 · Cited by 280
Self-citationDeep learning and the electrocardiogram: review of the current state-of-the-art
Somani, S., Russak, A. J., Richter, F., Zhao, S., Vaid, A., Chaudhry, F., De Freitas, J. K., Naik, N., Miotto, R., Nadkarni, G. N., et al. (2021) · EP Europace · doi:10.1093/europace/euaa377 · Cited by 264
Noseworthy, P. A., Attia, Z. I., Brewer, L. C., Hayes, S. N., Yao, X., Kapa, S., Friedman, P. A., & Lopez-Jimenez, F. (2020) · Circulation: Arrhythmia and Electrophysiology · doi:10.1161/circep.119.007988 · Cited by 220
Self-citationAdedinsewo, D., Carter, R. E., Attia, Z., Johnson, P., Kashou, A. H., Dugan, J. L., Albus, M., Sheele, J. M., Bellolio, F., Friedman, P. A., et al. (2020) · Circulation: Arrhythmia and Electrophysiology · doi:10.1161/circep.120.008437 · Cited by 169
Self-citationBachtiger, P., Petri, C. F., Scott, F. E., Ri Park, S., Kelshiker, M. A., Sahemey, H. K., Dumea, B., Alquero, R., Padam, P. S., Hatrick, I. R., et al. (2022) · The Lancet Digital Health · doi:10.1016/s2589-7500(21)00256-9 · Cited by 167
Prospective evaluation of smartwatch-enabled detection of left ventricular dysfunction
Attia, Z. I., Harmon, D. M., Dugan, J., Manka, L., Lopez-Jimenez, F., Lerman, A., Siontis, K. C., Noseworthy, P. A., Yao, X., Klavetter, E. W., et al. (2022) · Nature Medicine · doi:10.1038/s41591-022-02053-1 · Cited by 154
Self-citationPediatric ECG-Based Deep Learning to Predict Left Ventricular Dysfunction and Remodeling
Mayourian, J., La Cava, W. G., Vaid, A., Nadkarni, G. N., Ghelani, S. J., Mannix, R., Geva, T., Dionne, A., Alexander, M. E., Duong, S. Q., et al. (2024) · Circulation · doi:10.1161/circulationaha.123.067750 · Cited by 59
Bjerkén, L. V., Rønborg, S. N., Jensen, M. T., Ørting, S. N., & Nielsen, O. W. (2022) · Heart Failure Reviews · doi:10.1007/s10741-022-10283-1 · Cited by 50
“1 3 A retrospective design was used in eleven studies [12–14, 17–24], one was a case series [15] and three were prospective cohort studies [16, 25, 26].”
BackgroundMethodResultArtificial intelligence and the electrocardiogram: A modern renaissance
Palermi, S., Vecchiato, M., Ng, F. S., Attia, Z., Cho, Y., Anselmino, M., De Ferrari, G. M., Saglietto, A., Sau, A., Chiu, I.-M., et al. (2025) · European Journal of Internal Medicine · doi:10.1016/j.ejim.2025.04.036 · Cited by 42
Self-citationHarmon, D. M., Carter, R. E., Cohen-Shelly, M., Svatikova, A., Adedinsewo, D. A., Noseworthy, P. A., Kapa, S., Lopez-Jimenez, F., Friedman, P. A., & Attia, Z. I. (2022) · European Heart Journal - Digital Health · doi:10.1093/ehjdh/ztac028 · Cited by 35
Self-citationDigital tools in heart failure: addressing unmet needs
Myhre, P. L., Tromp, J., Ouwerkerk, W., Ting, D. S. W., Docherty, K. F., Gibson, C. M., & Lam, C. S. P. (2024) · The Lancet Digital Health · doi:10.1016/s2589-7500(24)00158-4 · Cited by 31
König, S., Hohenstein, S., Nitsche, A., Pellissier, V., Leiner, J., Stellmacher, L., Hindricks, G., & Bollmann, A. (2024) · European Heart Journal - Digital Health · doi:10.1093/ehjdh/ztad081 · Cited by 21
Diagnosis of Atrial Fibrillation Based on AI-Detected Anomalies of ECG Segments
Choi, S., Choi, K., Yun, H. K., Kim, S. H., Choi, H.-H., Park, Y.-S., & Joo, S. (2024) · Heliyon · doi:10.1016/j.heliyon.2023.e23597 · Cited by 15
Artificial intelligence-enabled electrocardiography from scientific research to clinical application
Lin, C.-S., Liu, W.-T., Chen, Y.-H., Lin, S.-H., & Lin, C. (2025) · EMBO Molecular Medicine · doi:10.1038/s44321-025-00351-y · Cited by 15
Liu, W.-T., Hsieh, P.-H., Lin, C.-S., Fang, W.-H., Wang, C.-H., Tsai, C.-S., Hung, Y.-J., Hsieh, C.-B., Lin, C., & Tsai, D.-J. (2024) · Canadian Journal of Cardiology · doi:10.1016/j.cjca.2023.11.044 · Cited by 15
Lopez-Jimenez, F., Alger, H. M., Attia, Z. I., Barry, B., Chatterjee, R., Dolor, R., Friedman, P. A., Greene, S. J., Greenwood, J., Gundurao, V., et al. (2025) · American Heart Journal Plus: Cardiology Research and Practice · doi:10.1016/j.ahjo.2025.100528 · Cited by 6
Self-citationArends, B. K. O., van Amsterdam, W. A. C., van der Harst, P., van Smeden, M., van Es, R., & van de Leur, R. R. (2026) · European Heart Journal - Digital Health · doi:10.1093/ehjdh/ztag038 · Cited by 6
Arends, B. K. O., McCormick, J. M., van der Harst, P., Heus, P., & van Es, R. (2025) · European Journal of Clinical Investigation · doi:10.1111/eci.14387 · Cited by 5
Metadata
- Authors
- Attia, Z. I., Kapa, S., Yao, X., Lopez‐Jimenez, F., Mohan, T. L., Pellikka, P. A., Carter, R. E., Shah, N. D., Friedman, P. A., & Noseworthy, P. A.
- Venue
- Journal of Cardiovascular Electrophysiology
- Publisher
- Wiley
- Published
- 2019-03-10
- Volume
- 30
- Issue
- 5
- Pages
- 668-674
- ISSN
- 1045-3873 (ISSN-L)
- 1540-8167
- OpenAlex
- W2919098904
- Cited by
- 196
- References
- 5
- FWCI
- 11.57
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.