A deep neural network learning algorithm outperforms a conventional algorithm for emergency department electrocardiogram interpretation
The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
Abstract
BACKGROUND Cardiologs® has developed the first electrocardiogram (ECG) algorithm that uses a deep neural network (DNN) for full 12‑lead ECG analysis, including rhythm, QRS and ST-T-U waves. We compared the accuracy of the first version of Cardiologs® DNN algorithm to the Mortara/Veritas® conventional algorithm in emergency department (ED) ECGs. METHODS Individual ECG diagnoses were prospectively mapped to one of 16 pre-specified groups of ECG diagnoses, which were further classified as "major" ECG abnormality or not. Automated interpretations were compared to blinded experts'. The primary outcome was the performance of the algorithms in finding at least one "major" abnormality. The secondary outcome was the proportion of all ECGs for which all groups were identified, with no false negative or false positive groups ("accurate ECG interpretation"). Additionally, we measured sensitivity and positive predictive value (PPV) for any abnormal group. RESULTS Cardiologs® vs. Veritas® accuracy for finding a major abnormality was 92.2% vs. 87.2% (p < 0.0001), with comparable sensitivity (88.7% vs. 92.0%, p = 0.086), improved specificity (94.0% vs. 84.7%, p < 0.0001) and improved positive predictive value (PPV 88.2% vs. 75.4%, p < 0.0001). Cardiologs® had accurate ECG interpretation for 72.0% (95% CI: 69.6-74.2) of ECGs vs. 59.8% (57.3-62.3) for Veritas® (P < 0.0001). Sensitivity for any abnormal group for Cardiologs® and Veritas®, respectively, was 69.6% (95CI 66.7-72.3) vs. 68.3% (95CI 65.3-71.1) (NS). Positive Predictive Value was 74.0% (71.1-76.7) for Cardiologs® vs. 56.5% (53.7-59.3) for Veritas® (P < 0.0001). CONCLUSION Cardiologs' DNN was more accurate and specific in identifying ECGs with at least one major abnormal group. It had a significantly higher rate of accurate ECG interpretation, with similar sensitivity and higher PPV.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Variation of a test’s sensitivity and specificity with disease prevalence
Leeflang, M. M. G., Rutjes, A. W. S., Reitsma, J. B., Hooft, L., & Bossuyt, P. M. M. (2013) · Canadian Medical Association Journal · doi:10.1503/cmaj.121286 · Cited by 530
Cited by
Artificial intelligence-enhanced electrocardiography in cardiovascular disease management
Siontis, K. C., Noseworthy, P. A., Attia, Z. I., & Friedman, P. A. (2021) · Nature Reviews Cardiology · doi:10.1038/s41569-020-00503-2 · Cited by 914
Automatic diagnosis of the 12-lead ECG using a deep neural network
Ribeiro, A. H., Ribeiro, M. H., Paixão, G. M. M., Oliveira, D. M., Gomes, P. R., Canazart, J. A., Ferreira, M. P. S., Andersson, C. R., Macfarlane, P. W., Meira, W., et al. (2020) · Nature Communications · doi:10.1038/s41467-020-15432-4 · Cited by 894
Ribeiro, A. H., Ribeiro, M. H., Paixao, G. M., Oliveira, D. M., Gomes, P. R., Canazart, J. A., Ferreira, M. P. S., Andersson, C. R., Macfarlane, P. W., Meira, W., et al. (2020) · RePEc: Research Papers in Economics · doi:10.5281/zenodo.3625006 · Cited by 715
Artificial Intelligence Transforms the Future of Health Care
Noorbakhsh-Sabet, N., Zand, R., Zhang, Y., & Abedi, V. (2019) · The American Journal of Medicine · doi:10.1016/j.amjmed.2019.01.017 · Cited by 626
“In terms of algorithm improvement Stephen W. Smith et al. 35 developed a deep neural network model for 12-lead ECG analysis compared to the conventional algorithm in emergency department ECGs, their result showed an accuracy of 92% for finding a major abnormality.”
MethodDeep Learning for ECG Analysis: Benchmarks and Insights from PTB-XL
Strodthoff, N., Wagner, P., Schaeffter, T., & Samek, W. (2021) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2020.3022989 · Cited by 491
Metadata
- Authors
- Smith, S. W., Walsh, B., Grauer, K., Wang, K., Rapin, J., Li, J., Fennell, W., & Taboulet, P.
- Venue
- Journal of Electrocardiology
- Publisher
- Elsevier BV
- Published
- 2019-01
- Volume
- 52
- Pages
- 88-95
- ISSN
- 0022-0736 (ISSN-L)
- OpenAlex
- W2900614987
- Cited by
- 106
- References
- 1
- FWCI
- 7.57
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A deep neural network learning algorithm outperforms a conventional algorithm for emergency department electrocardiogram interpretation. https://app.cochat.ai/papers/10.1016/j.jelectrocard.2018.11.013
- The paper
- Smith, S. W., Walsh, B., Grauer, K., Wang, K., Rapin, J., Li, J., Fennell, W., & Taboulet, P. (2019). A deep neural network learning algorithm outperforms a conventional algorithm for emergency department electrocardiogram interpretation. Journal of Electrocardiology. https://doi.org/10.1016/j.jelectrocard.2018.11.013
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.