Cited by 29ECG Monitoring and AnalysisMachine Learning in HealthcareCardiac electrophysiology and arrhythmias

Towards Quantitative Precision for ECG Analysis: Leveraging State Space Models, Self-Supervision and Patient Metadata

Open access
Mehari, Temesgen, Strodthoff, Nils·2023·IEEE Journal of Biomedical and Health Informatics

Abstract

Deep learning has emerged as the preferred modeling approach for automatic ECG analysis. In this study, we investigate three elements aimed at improving the quantitative accuracy of such systems. These components consistently enhance performance beyond the existing state-of-the-art, which is predominantly based on convolutional models. Firstly, we explore more expressive architectures by exploiting structured state space models (SSMs). These models have shown promise in capturing long-term dependencies in time series data. By incorporating SSMs into our approach, we not only achieve better performance, but also gain insights into long-standing questions in the field. Specifically, for standard diagnostic tasks, we find no advantage in using higher sampling rates such as 500 Hz compared to 100 Hz. Similarly, extending the input size of the model beyond 3 seconds does not lead to significant improvements. Secondly, we demonstrate that self-supervised learning using contrastive predictive coding can further improve the performance of SSMs. By leveraging self-supervision, we enable the model to learn more robust and representative features, leading to improved analysis accuracy. Lastly, we depart from synthetic benchmarking scenarios and incorporate basic demographic metadata alongside the ECG signal as input. This inclusion of patient metadata departs from the conventional practice of relying solely on the signal itself. Remarkably, this addition consistently yields positive effects on predictive performance. We firmly believe that all three components should be considered when developing next-generation ECG analysis algorithms.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/jbhi.2023.3310989

Cites

3 of 3 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 39

  1. A. Y. Hannun, P. Rajpurkar, M. Haghpanahi, G. H. Tison, C. Bourn, M. P. Turakhia et al., "Cardiologist-level arrhythmia detection and classification in ambulatory electrocardiograms using a deep neural network," Nature Medicine, vol. 25, no. 1, pp. 65-69, Jan. 2019.
  2. Z. I. Attia, S. Kapa, F. Lopez-Jimenez, P. M. McKie, D. J. Ladewig, G. Satam et al., "Screening for cardiac contractile dysfunction using an artificial intelligence-enabled electrocardiogram," Nature Medicine, vol. 25, no. 1, pp. 70-74, Jan. 2019.
  3. E. M. Lima, A. H. Ribeiro, G. M. M. Paixão, M. H. Ribeiro, M. M. Pinto-Filho, P. R. Gomes et al., "Deep neural network-estimated elec- trocardiographic age as a mortality predictor," Nature Communications, vol. 12, no. 1, Aug. 2021.
  4. F. H. Verbrugge, Y. N. Reddy, Z. I. Attia, P. A. Friedman, P. A. Noseworthy, F. Lopez-Jimenez et al., "Detection of left atrial myopathy using artificial intelligence-enabled electrocardiography," Circulation: Heart Failure, vol. 15, no. 1, Jan. 2022.
  5. N. Strodthoff, P. Wagner, T. Schaeffter, and W. Samek, "Deep learning for ecg analysis: Benchmarks and insights from ptb-xl," IEEE Journal of Biomedical and Health Informatics, vol. 25, no. 5, pp. 1519-1528, 2020.
  6. A. Y. Hannun, P. Rajpurkar, M. Haghpanahi, G. H. Tison, C. Bourn, M. P. Turakhia et al., "Cardiologist-level arrhythmia detection and classification in ambulatory electrocardiograms using a deep neural network," Nature Medicine, vol. 25, no. 1, pp. 65-69, 2019.
  7. A. H. Ribeiro, M. H. Ribeiro, G. M. M. Paixão, D. M. Oliveira, P. R. Gomes, J. A. Canazart et al., "Automatic diagnosis of the 12-lead ECG using a deep neural network," Nature Communications, vol. 11, no. 1, Apr. 2020.
  8. A. Natarajan, Y. Chang, S. Mariani, A. Rahman, G. Boverman, S. Vij et al., "A wide and deep transformer neural network for 12-lead ecg classification," in 2020 Computing in Cardiology (CinC). IEEE, 2020.
  9. P. Nejedly, A. Ivora, R. Smisek, I. Viscor, Z. Koscova, P. Jurak et al., "Classification of ECG using ensemble of residual CNNs with attention mechanism," in 2021 Computing in Cardiology (CinC). IEEE, Sep. 2021.
  10. A. Gu, K. Goel, and C. Ré, "Efficiently modeling long sequences with structured state spaces," in International Conference on Learning Representations, 2022.
  11. P. Wagner, N. Strodthoff, R.-D. Bousseljot, D. Kreiseler, F. I. Lunze, W. Samek et al., "PTB-XL, a large publicly available electrocardiogra- phy dataset," Scientific Data, vol. 7, no. 1, p. 154, 2020.
  12. A. L. Goldberger, L. A. N. Amaral, L. Glass, J. M. Hausdorff, P. C. Ivanov, R. G. Mark et al., "PhysioBank, PhysioToolkit, and PhysioNet," Circulation, vol. 101, no. 23, pp. e215-e220, 2000.
  13. J. Zheng, J. Zhang, S. Danioko, H. Yao, H. Guo, and C. Rakovski, "A 12-lead electrocardiogram database for arrhythmia research covering more than 10, 000 patients," Scientific Data, vol. 7, no. 1, Feb. 2020.
  14. A. H. Kashou, W.-Y. Ko, Z. I. Attia, M. S. Cohen, P. A. Friedman, and P. A. Noseworthy, "A comprehensive artificial intelligence-enabled elec- trocardiogram interpretation program," Cardiovascular Digital Health Journal, vol. 1, no. 2, pp. 62-70, Sep. 2020.
  15. T. Mehari and N. Strodthoff, "Self-supervised representation learning from 12-lead ECG data," Computers in Biology and Medicine, vol. 141, p. 105114, Feb. 2022.
  16. --, "Advancing the State-of-the-Art for ECG Analysis through Struc- tured State Space Models," in Machine Learning for Health (ML4H) symposium, 2022, extended abstract.
  17. S. Hong, Y. Zhou, J. Shang, C. Xiao, and J. Sun, "Opportunities and challenges of deep learning methods for electrocardiogram data: A systematic review," Computers in Biology and Medicine, vol. 122, p. 103801, Jul. 2020.
  18. G. Petmezas, L. Stefanopoulos, V. Kilintzis, A. Tzavelis, J. A. Rogers, A. K. Katsaggelos et al., "State-of-the-art deep learning methods on electrocardiogram data: Systematic review," JMIR medical informatics, vol. 10, no. 8, p. e38454, 2022.
  19. A. Gu, I. Johnson, K. Goel, K. Saab, T. Dao, A. Rudra et al., "Combining recurrent, convolutional, and continuous-time models with linear state space layers," in Advances in Neural Information Processing Systems, M. Ranzato, A. Beygelzimer, Y. Dauphin, P. Liang, and J. W. Vaughan, Eds., vol. 34. Curran Associates, Inc., 2021, pp. 572-585.
  20. A. Gu, A. Gupta, K. Goel, and C. Ré, "On the parameterization and initialization of diagonal state space models," arXiv preprint 2206.11893, 2022. · arXiv
  21. J. M. L. Alcaraz and N. Strodthoff, "Diffusion-based time series impu- tation and forecasting with structured state space models," Transactions on Machine Learning Research, 2022.
  22. J. Devlin, M.-W. Chang, K. Lee, and K. Toutanova, "BERT: Pre- training of deep bidirectional transformers for language understanding," in Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers). Minneapolis, Minnesota: Association for Computational Linguistics, Jun. 2019, pp. 4171-4186.
  23. A. Baevski, H. Zhou, A. Mohamed, and M. Auli, "wav2vec 2.0: A framework for self-supervised learning of speech representations," in Advances in Neural Information Processing Systems, 2020.
  24. T. Chen, S. Kornblith, M. Norouzi, and G. Hinton, "A simple framework for contrastive learning of visual representations," in International Conference on Machine Learning, 2020.
  25. Y. Yuan, G. Xun, Q. Suo, K. Jia, and A. Zhang, "Wave2vec: Deep representation learning for clinical temporal data," Neurocomputing, vol. 324, pp. 31-42, Jan. 2019.
  26. P. Sarkar and A. Etemad, "Self-supervised ECG representation learning for emotion recognition," IEEE Transactions on Affective Computing, pp. 1-1, 2020.
  27. D. Kiyasseh, T. Zhu, and D. A. Clifton, "Clocs: Contrastive learning of cardiac signals across space, time, and patients," in Proceedings of the 38th International Conference on Machine Learning, ser. Proceedings of Machine Learning Research, M. Meila and T. Zhang, Eds., vol. 139, 18-24 Jul 2021, pp. 5606-5615.
  28. B. Gopal, R. Han, G. Raghupathi, A. Ng, G. Tison, and P. Ra- jpurkar, "3kg: Contrastive learning of 12-lead electrocardiograms using physiologically-inspired augmentations," in Proceedings of Machine Learning for Health, ser. Proceedings of Machine Learning Research, S. Roy, S. Pfohl, E. Rocheteau, G. A. Tadesse, L. Oala, F. Falck et al., Eds., vol. 158, 04 Dec 2021, pp. 156-167.
  29. X. Lan, D. Ng, S. Hong, and M. Feng, "Intra-inter subject self- supervised learning for multivariate cardiac signals," in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 36, no. 4, 2022, pp. 4532-4540.
  30. A. van den Oord, Y. Li, and O. Vinyals, "Representation learning with contrastive predictive coding," arXiv preprint 1807.03748, 2018. · arXiv
  31. S. Hochreiter and J. Schmidhuber, "Long short-term memory," Neural computation, vol. 9, no. 8, pp. 1735-1780, 1997.
  32. A. Gu, T. Dao, S. Ermon, A. Rudra, and C. Ré, "Hippo: Recurrent memory with optimal polynomial projections," in Advances in Neural Information Processing Systems, H. Larochelle, M. Ranzato, R. Hadsell, M. Balcan, and H. Lin, Eds., vol. 33. Curran Associates, Inc., 2020, pp. 1474-1487.
  33. E. A. P. Alday, A. Gu, A. J. Shah, C. Robichaux, A.-K. I. Wong, C. Liu et al., "Classification of 12-lead ECGs: the PhysioNet/computing in cardiology challenge 2020," Physiological Measurement, vol. 41, no. 12, p. 124003, Dec. 2020.
  34. M. A. Reyna, N. Sadr, E. A. P. Alday, A. Gu, A. J. Shah, C. Robichaux et al., "Will two do? varying dimensions in electrocardiography: the physionet/computing in cardiology challenge 2021," in 2021 Computing in Cardiology (CinC), vol. 48. IEEE, 2021, pp. 1-4.
  35. I. Loshchilov and F. Hutter, "Decoupled weight decay regularization," in International Conference on Learning Representations, 2017.
  36. X. Zhang and K. Zhou, "Multi-period attention for automatic ecg classification," in ICMLCA 2021; 2nd International Conference on Machine Learning and Computer Application. VDE, 2021, pp. 1-4.
  37. Y. Li, G. Wang, Z. Xia, W. Yang, and L. Sun, "A dual-scale lead-seperated transformer with lead-orthogonal attention and meta- information for ecg classification," arXiv preprint arXiv:2211.12777, 2022. · arXiv
  38. X. Li, C. Li, Y. Wei, Y. Sun, J. Wei, X. Li et al., "Bat: Beat- aligned transformer for electrocardiogram classification," in 2021 IEEE International Conference on Data Mining (ICDM). IEEE, 2021, pp. 320-329.
  39. M. Dehghani, A. Arnab, L. Beyer, A. Vaswani, and Y. Tay, "The efficiency misnomer," arXiv preprint 2110.12894, 2021. · arXiv

Cited by

Sorted by citations

Authors
Mehari, T., & Strodthoff, N.
Affiliations
  • Physikalisch-Technische Bundesanstalt (DE)
  • Carl von Ossietzky Universität Oldenburg (DE)
Venue
IEEE Journal of Biomedical and Health Informatics
Published
2023-11
Volume
27
Issue
11
Pages
5326-5334
ISSN
  • 2168-2194 (ISSN-L)
  • 2168-2208
OpenAlex
W4386362877
Cited by
29
References
3
Citations by year
2026: 12 · 2025: 9 · 2024: 8
FWCI
5.76
Type
journal article
Language
en
Open access
Locations
  • IEEE Journal of Biomedical and Health Informatics (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • Carl von Ossiezky University of Oldenburg (submittedVersion)
  • Fraunhofer-Publica (Fraunhofer-Gesellschaft) (submittedVersion)
  • arXiv (Cornell University) (cc-by)
Topics
  • Health Sciences › Medicine › Cardiology and Cardiovascular Medicine › ECG Monitoring and Analysis
  • Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
  • Health Sciences › Medicine › Cardiology and Cardiovascular Medicine › Cardiac electrophysiology and arrhythmias
Keywords
ECG signal analysis, state-space model, self-supervised learning, contrastive predictive coding, patient metadata, sampling frequency, quantitative accuracy, long-range dependencies, ECG classification
MeSH terms
Metadata, Algorithms, Electrocardiography, Humans, Time Factors, Benchmarking

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review