Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 436

The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.

Classification of 12-lead ECGs: the PhysioNet/Computing in Cardiology Challenge 2020

Open access
Perez Alday, Erick A, Gu, Annie, J Shah, Amit, Robichaux, Chad, Ian Wong, An-Kwok, Liu, Chengyu, Liu, Feifei, Bahrami Rad, Ali, Elola, Andoni, Seyedi, Salman, Li, Qiao, Sharma, Ashish, Clifford, Gari D, Reyna, Matthew A·2020·Physiological Measurement

Abstract

Objective : Vast 12-lead ECGs repositories provide opportunities to develop new machine learning approaches for creating accurate and automatic diagnostic systems for cardiac abnormalities. However, most 12-lead ECG classification studies are trained, tested, or developed in single, small, or relatively homogeneous datasets. In addition, most algorithms focus on identifying small numbers of cardiac arrhythmias that do not represent the complexity and difficulty of ECG interpretation. This work addresses these issues by providing a standard, multi-institutional database and a novel scoring metric through a public competition: the PhysioNet/Computing in Cardiology Challenge 2020. Approach : A total of 66 361 12-lead ECG recordings were sourced from six hospital systems from four countries across three continents; 43 101 recordings were posted publicly with a focus on 27 diagnoses. For the first time in a public competition, we required teams to publish open-source code for both training and testing their algorithms, ensuring full scientific reproducibility. Main results : A total of 217 teams submitted 1395 algorithms during the Challenge, representing a diversity of approaches for identifying cardiac abnormalities from both academia and industry. As with previous Challenges, high-performing algorithms exhibited significant drops ( ≲ 10%) in performance on the hidden test data. Significance : Data from diverse institutions allowed us to assess algorithmic generalizability. A novel evaluation metric considered different misclassification errors for different cardiac abnormalities, capturing the outcomes and risks of different diagnoses. Requiring both trained models and code for training models improved the generalizability of submissions, setting a new bar in reproducibility for public data science competitions.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1088/1361-6579/abc960

Cites

22 of 22 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 22 references

Cited by

See all 436

Metadata

Authors
Perez Alday, E. A., Gu, A., J Shah, A., Robichaux, C., Ian Wong, A.-K., Liu, C., Liu, F., Bahrami Rad, A., Elola, A., Seyedi, S., Li, Q., Sharma, A., Clifford, G. D., & Reyna, M. A.
Venue
Physiological Measurement
Published
2020-12-01
Volume
41
Issue
12
Pages
124003
ISSN
  • 0967-3334 (ISSN-L)
  • 1361-6579
OpenAlex
W3098699929
Cited by
436
References
22
FWCI
39.66
Type
journal article
Language
en
Open access
green

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Classification of 12-lead ECGs: the PhysioNet/Computing in Cardiology Challenge 2020. https://app.cochat.ai/papers/10.1088/1361-6579/abc960
The paper
Perez Alday, E. A., Gu, A., J Shah, A., Robichaux, C., Ian Wong, A.-K., Liu, C., Liu, F., Bahrami Rad, A., Elola, A., Seyedi, S., Li, Q., Sharma, A., Clifford, G. D., & Reyna, M. A. (2020). Classification of 12-lead ECGs: the PhysioNet/Computing in Cardiology Challenge 2020. Physiological Measurement. https://doi.org/10.1088/1361-6579/abc960

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.