A comprehensive artificial intelligence–enabled electrocardiogram interpretation program
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
Background: Automated computerized electrocardiogram (ECG) interpretation algorithms are designed to enhance physician ECG interpretation, minimize medical error, and expedite clinical workflow. However, the performance of current computer algorithms is notoriously inconsistent. We aimed to develop and validate an artificial intelligence-enabled ECG (AI-ECG) algorithm capable of comprehensive 12-lead ECG interpretation with accuracy comparable to practicing cardiologists. Methods: We developed an AI-ECG algorithm using a convolutional neural network as a multilabel classifier capable of assessing 66 discrete, structured diagnostic ECG codes using the cardiologist's final annotation as the gold-standard interpretation. We included 2,499,522 ECGs from 720,978 patients ≥18 years of age with a standard 12-lead ECG obtained at the Mayo Clinic ECG laboratory between 1993 and 2017. The total sample was randomly divided into training (n = 1,749,654), validation (n = 249,951), and testing (n = 499,917) datasets with a similar distribution of codes. We compared the AI-ECG algorithm's performance to the cardiologist's interpretation in the testing dataset using receiver operating characteristic (ROC) and precision recall (PR) curves. Results: The model performed well for various rhythm, conduction, ischemia, waveform morphology, and secondary diagnoses codes with an area under the ROC curve of ≥0.98 for 62 of the 66 codes. PR metrics were used to assess model performance accounting for category imbalance and demonstrated a sensitivity ≥95% for all codes. Conclusions: An AI-ECG algorithm demonstrates high diagnostic performance in comparison to reference cardiologist interpretation of a standard 12-lead ECG. The use of AI-ECG reading tools may permit scalability as ECG acquisition becomes more ubiquitous.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Hannun, A. Y., Rajpurkar, P., Haghpanahi, M., Tison, G. H., Bourn, C., Turakhia, M. P., & Ng, A. Y. (2019) · Nature Medicine · doi:10.1038/s41591-018-0268-3 · Cited by 3,148
Attia, Z. I., Noseworthy, P. A., Lopez-Jimenez, F., Asirvatham, S. J., Deshmukh, A. J., Gersh, B. J., Carter, R. E., Yao, X., Rabinstein, A. A., Erickson, B. J., et al. (2019) · The Lancet · doi:10.1016/s0140-6736(19)31721-0 · Cited by 1,613 · cited 1×
“A deep learning approach has been shown to identify a host of distinct arrhythmias from single-lead ECGs,(18) detect ventricular dysfunction,(19) and predict the likelihood of developing of atrial fibrillation in sinus rhythm.(20) Given the advances in deep learning in electrocardiography, we hypothesized that a CNN w…”
ResultSelf-citationAttia, Z. I., Kapa, S., Lopez-Jimenez, F., McKie, P. M., Ladewig, D. J., Satam, G., Pellikka, P. A., Enriquez-Sarano, M., Noseworthy, P. A., Munger, T. M., et al. (2019) · Nature Medicine · doi:10.1038/s41591-018-0240-2 · Cited by 1,389 · cited 1×
“A deep learning approach has been shown to identify a host of distinct arrhythmias from single-lead ECGs, 18 detect ventricular dysfunction, 19 and predict the likelihood of developing of atrial fi brillation in sinus rhythm.”
BackgroundSelf-citation
Cited by
Artificial intelligence-enhanced electrocardiography in cardiovascular disease management
Siontis, K. C., Noseworthy, P. A., Attia, Z. I., & Friedman, P. A. (2021) · Nature Reviews Cardiology · doi:10.1038/s41569-020-00503-2 · Cited by 914
Self-citationExplaining Deep Learning for ECG Analysis: Building Blocks for Auditing and Knowledge Discovery
Wagner, P., Mehari, T., Haverkamp, W., & Strodthoff, N. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.108525 · Cited by 48
“Most remarkably, this does not only apply to the prediction of diagnostic statements as routinely assessed also by cardiologists, from myocardial infarctions [4] over comprehensive prediction of ECG statements [5, 6], and rhythm abnormalities [7] to challenging conditions such as hypertrophic cardiomyopathy [8], but i…”
BackgroundMehari, T., & Strodthoff, N. (2023) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2023.3310989 · Cited by 29
“As a consequence, we deliberately focus on comprehensive ECG classification tasks rather than specific clinical prediction tasks, even though we also envision that data-driven methods will eventually supplement current rule-based decision support systems in ECG devices, see also [15].”
BackgroundStrodthoff, N., Lopez Alcaraz, J. M., & Haverkamp, W. (2024) · European Heart Journal - Digital Health · doi:10.1093/ehjdh/ztae039 · Cited by 22
Palantzas, A., & Anagnostouli, M. (2025) · International Journal of Molecular Sciences · doi:10.3390/ijms26178217 · Cited by 11
“AI ECG analysis detects AF, AV block, VT, silent AF [189–194], LV dysfunction, hypertrophic cardiomyopathy, valvular disease, amyloidosis (AUC 0.95–0.98), conduction, and ischemic abnormalities with near 100% sensitivity [192,195].”
Influential
Metadata
- Authors
- Kashou, A. H., Ko, W.-Y., Attia, Z. I., Cohen, M. S., Friedman, P. A., & Noseworthy, P. A.
- Venue
- Cardiovascular Digital Health Journal
- Publisher
- Elsevier BV
- Published
- 2020-09
- Volume
- 1
- Issue
- 2
- Pages
- 62-70
- ISSN
- 2666-6936 (ISSN-L)
- OpenAlex
- W3012063106
- Cited by
- 76
- References
- 5
- FWCI
- 4.61
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A comprehensive artificial intelligence–enabled electrocardiogram interpretation program. https://app.cochat.ai/papers/10.1016/j.cvdhj.2020.08.005
- The paper
- Kashou, A. H., Ko, W.-Y., Attia, Z. I., Cohen, M. S., Friedman, P. A., & Noseworthy, P. A. (2020). A comprehensive artificial intelligence–enabled electrocardiogram interpretation program. Cardiovascular Digital Health Journal. https://doi.org/10.1016/j.cvdhj.2020.08.005
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.