Towards Quantitative Precision for ECG Analysis: Leveraging State Space Models, Self-Supervision and Patient Metadata
Open accessAbstract
Deep learning has emerged as the preferred modeling approach for automatic ECG analysis. In this study, we investigate three elements aimed at improving the quantitative accuracy of such systems. These components consistently enhance performance beyond the existing state-of-the-art, which is predominantly based on convolutional models. Firstly, we explore more expressive architectures by exploiting structured state space models (SSMs). These models have shown promise in capturing long-term dependencies in time series data. By incorporating SSMs into our approach, we not only achieve better performance, but also gain insights into long-standing questions in the field. Specifically, for standard diagnostic tasks, we find no advantage in using higher sampling rates such as 500 Hz compared to 100 Hz. Similarly, extending the input size of the model beyond 3 seconds does not lead to significant improvements. Secondly, we demonstrate that self-supervised learning using contrastive predictive coding can further improve the performance of SSMs. By leveraging self-supervision, we enable the model to learn more robust and representative features, leading to improved analysis accuracy. Lastly, we depart from synthetic benchmarking scenarios and incorporate basic demographic metadata alongside the ECG signal as input. This inclusion of patient metadata departs from the conventional practice of relying solely on the signal itself. Remarkably, this addition consistently yields positive effects on predictive performance. We firmly believe that all three components should be considered when developing next-generation ECG analysis algorithms.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
S4-based encoder has demonstrated superior performance over conventional deep learning architectures such as CNNs, RNNs, and transformers in physiological time-series modeling [29, 34].
“ECG waveforms are processed using an S4-based encoder built on structured state space models [33], which has demonstrated superior performance over conventional deep learning architectures such as CNNs, RNNs, and transformers in physiological time-series modeling [29, 34].”
From A Multimodal Deep Learning Framework for Predicting ICU Deterioration: Integrating ECG Waveforms with Clinical Data and Clinician Benchmarking (2026) · cites this paper as [34]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Inceptiontime: finding alexnet for time series classification
Ismail Fawaz, H., Lucas, B., Forestier, G., Pelletier, C., Schmidt, D. F., Weber, J., Webb, G. I., Idoumghar, L., Muller, P.-A., & Petitjean, F. (2020) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-020-00710-y · Cited by 1,788 · see citing works
Deep multimodal learning: a survey on recent advances and trends
Ramachandram, D., & Taylor, G. W. (2017) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2738401 · Cited by 1,139 · cited 1× · see citing works
“approach in the multimodal learning literature [37].”
Subject-Aware Contrastive Learning for Biosignals
Cheng, J. Y., Goh, H., Dogrusoz, K., Tuzel, O., & Azemi, E. (2020) · arXiv · doi:10.48550/arxiv.2007.04871 · Cited by 74 · see citing works
Flagged first, then by citations
Research works printed but not linked: 39
- A. Y. Hannun, P. Rajpurkar, M. Haghpanahi, G. H. Tison, C. Bourn, M. P. Turakhia et al., "Cardiologist-level arrhythmia detection and classification in ambulatory electrocardiograms using a deep neural network," Nature Medicine, vol. 25, no. 1, pp. 65-69, Jan. 2019.
- Z. I. Attia, S. Kapa, F. Lopez-Jimenez, P. M. McKie, D. J. Ladewig, G. Satam et al., "Screening for cardiac contractile dysfunction using an artificial intelligence-enabled electrocardiogram," Nature Medicine, vol. 25, no. 1, pp. 70-74, Jan. 2019.
- E. M. Lima, A. H. Ribeiro, G. M. M. Paixão, M. H. Ribeiro, M. M. Pinto-Filho, P. R. Gomes et al., "Deep neural network-estimated elec- trocardiographic age as a mortality predictor," Nature Communications, vol. 12, no. 1, Aug. 2021.
- F. H. Verbrugge, Y. N. Reddy, Z. I. Attia, P. A. Friedman, P. A. Noseworthy, F. Lopez-Jimenez et al., "Detection of left atrial myopathy using artificial intelligence-enabled electrocardiography," Circulation: Heart Failure, vol. 15, no. 1, Jan. 2022.
- N. Strodthoff, P. Wagner, T. Schaeffter, and W. Samek, "Deep learning for ecg analysis: Benchmarks and insights from ptb-xl," IEEE Journal of Biomedical and Health Informatics, vol. 25, no. 5, pp. 1519-1528, 2020.
- A. Y. Hannun, P. Rajpurkar, M. Haghpanahi, G. H. Tison, C. Bourn, M. P. Turakhia et al., "Cardiologist-level arrhythmia detection and classification in ambulatory electrocardiograms using a deep neural network," Nature Medicine, vol. 25, no. 1, pp. 65-69, 2019.
- A. H. Ribeiro, M. H. Ribeiro, G. M. M. Paixão, D. M. Oliveira, P. R. Gomes, J. A. Canazart et al., "Automatic diagnosis of the 12-lead ECG using a deep neural network," Nature Communications, vol. 11, no. 1, Apr. 2020.
- A. Natarajan, Y. Chang, S. Mariani, A. Rahman, G. Boverman, S. Vij et al., "A wide and deep transformer neural network for 12-lead ecg classification," in 2020 Computing in Cardiology (CinC). IEEE, 2020.
- P. Nejedly, A. Ivora, R. Smisek, I. Viscor, Z. Koscova, P. Jurak et al., "Classification of ECG using ensemble of residual CNNs with attention mechanism," in 2021 Computing in Cardiology (CinC). IEEE, Sep. 2021.
- A. Gu, K. Goel, and C. Ré, "Efficiently modeling long sequences with structured state spaces," in International Conference on Learning Representations, 2022.
- P. Wagner, N. Strodthoff, R.-D. Bousseljot, D. Kreiseler, F. I. Lunze, W. Samek et al., "PTB-XL, a large publicly available electrocardiogra- phy dataset," Scientific Data, vol. 7, no. 1, p. 154, 2020.
- A. L. Goldberger, L. A. N. Amaral, L. Glass, J. M. Hausdorff, P. C. Ivanov, R. G. Mark et al., "PhysioBank, PhysioToolkit, and PhysioNet," Circulation, vol. 101, no. 23, pp. e215-e220, 2000.
- J. Zheng, J. Zhang, S. Danioko, H. Yao, H. Guo, and C. Rakovski, "A 12-lead electrocardiogram database for arrhythmia research covering more than 10, 000 patients," Scientific Data, vol. 7, no. 1, Feb. 2020.
- A. H. Kashou, W.-Y. Ko, Z. I. Attia, M. S. Cohen, P. A. Friedman, and P. A. Noseworthy, "A comprehensive artificial intelligence-enabled elec- trocardiogram interpretation program," Cardiovascular Digital Health Journal, vol. 1, no. 2, pp. 62-70, Sep. 2020.
- T. Mehari and N. Strodthoff, "Self-supervised representation learning from 12-lead ECG data," Computers in Biology and Medicine, vol. 141, p. 105114, Feb. 2022.
- --, "Advancing the State-of-the-Art for ECG Analysis through Struc- tured State Space Models," in Machine Learning for Health (ML4H) symposium, 2022, extended abstract.
- S. Hong, Y. Zhou, J. Shang, C. Xiao, and J. Sun, "Opportunities and challenges of deep learning methods for electrocardiogram data: A systematic review," Computers in Biology and Medicine, vol. 122, p. 103801, Jul. 2020.
- G. Petmezas, L. Stefanopoulos, V. Kilintzis, A. Tzavelis, J. A. Rogers, A. K. Katsaggelos et al., "State-of-the-art deep learning methods on electrocardiogram data: Systematic review," JMIR medical informatics, vol. 10, no. 8, p. e38454, 2022.
- A. Gu, I. Johnson, K. Goel, K. Saab, T. Dao, A. Rudra et al., "Combining recurrent, convolutional, and continuous-time models with linear state space layers," in Advances in Neural Information Processing Systems, M. Ranzato, A. Beygelzimer, Y. Dauphin, P. Liang, and J. W. Vaughan, Eds., vol. 34. Curran Associates, Inc., 2021, pp. 572-585.
- A. Gu, A. Gupta, K. Goel, and C. Ré, "On the parameterization and initialization of diagonal state space models," arXiv preprint 2206.11893, 2022. · arXiv
- J. M. L. Alcaraz and N. Strodthoff, "Diffusion-based time series impu- tation and forecasting with structured state space models," Transactions on Machine Learning Research, 2022.
- J. Devlin, M.-W. Chang, K. Lee, and K. Toutanova, "BERT: Pre- training of deep bidirectional transformers for language understanding," in Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers). Minneapolis, Minnesota: Association for Computational Linguistics, Jun. 2019, pp. 4171-4186.
- A. Baevski, H. Zhou, A. Mohamed, and M. Auli, "wav2vec 2.0: A framework for self-supervised learning of speech representations," in Advances in Neural Information Processing Systems, 2020.
- T. Chen, S. Kornblith, M. Norouzi, and G. Hinton, "A simple framework for contrastive learning of visual representations," in International Conference on Machine Learning, 2020.
- Y. Yuan, G. Xun, Q. Suo, K. Jia, and A. Zhang, "Wave2vec: Deep representation learning for clinical temporal data," Neurocomputing, vol. 324, pp. 31-42, Jan. 2019.
- P. Sarkar and A. Etemad, "Self-supervised ECG representation learning for emotion recognition," IEEE Transactions on Affective Computing, pp. 1-1, 2020.
- D. Kiyasseh, T. Zhu, and D. A. Clifton, "Clocs: Contrastive learning of cardiac signals across space, time, and patients," in Proceedings of the 38th International Conference on Machine Learning, ser. Proceedings of Machine Learning Research, M. Meila and T. Zhang, Eds., vol. 139, 18-24 Jul 2021, pp. 5606-5615.
- B. Gopal, R. Han, G. Raghupathi, A. Ng, G. Tison, and P. Ra- jpurkar, "3kg: Contrastive learning of 12-lead electrocardiograms using physiologically-inspired augmentations," in Proceedings of Machine Learning for Health, ser. Proceedings of Machine Learning Research, S. Roy, S. Pfohl, E. Rocheteau, G. A. Tadesse, L. Oala, F. Falck et al., Eds., vol. 158, 04 Dec 2021, pp. 156-167.
- X. Lan, D. Ng, S. Hong, and M. Feng, "Intra-inter subject self- supervised learning for multivariate cardiac signals," in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 36, no. 4, 2022, pp. 4532-4540.
- A. van den Oord, Y. Li, and O. Vinyals, "Representation learning with contrastive predictive coding," arXiv preprint 1807.03748, 2018. · arXiv
- S. Hochreiter and J. Schmidhuber, "Long short-term memory," Neural computation, vol. 9, no. 8, pp. 1735-1780, 1997.
- A. Gu, T. Dao, S. Ermon, A. Rudra, and C. Ré, "Hippo: Recurrent memory with optimal polynomial projections," in Advances in Neural Information Processing Systems, H. Larochelle, M. Ranzato, R. Hadsell, M. Balcan, and H. Lin, Eds., vol. 33. Curran Associates, Inc., 2020, pp. 1474-1487.
- E. A. P. Alday, A. Gu, A. J. Shah, C. Robichaux, A.-K. I. Wong, C. Liu et al., "Classification of 12-lead ECGs: the PhysioNet/computing in cardiology challenge 2020," Physiological Measurement, vol. 41, no. 12, p. 124003, Dec. 2020.
- M. A. Reyna, N. Sadr, E. A. P. Alday, A. Gu, A. J. Shah, C. Robichaux et al., "Will two do? varying dimensions in electrocardiography: the physionet/computing in cardiology challenge 2021," in 2021 Computing in Cardiology (CinC), vol. 48. IEEE, 2021, pp. 1-4.
- I. Loshchilov and F. Hutter, "Decoupled weight decay regularization," in International Conference on Learning Representations, 2017.
- X. Zhang and K. Zhou, "Multi-period attention for automatic ecg classification," in ICMLCA 2021; 2nd International Conference on Machine Learning and Computer Application. VDE, 2021, pp. 1-4.
- Y. Li, G. Wang, Z. Xia, W. Yang, and L. Sun, "A dual-scale lead-seperated transformer with lead-orthogonal attention and meta- information for ecg classification," arXiv preprint arXiv:2211.12777, 2022. · arXiv
- X. Li, C. Li, Y. Wei, Y. Sun, J. Wei, X. Li et al., "Bat: Beat- aligned transformer for electrocardiogram classification," in 2021 IEEE International Conference on Data Mining (ICDM). IEEE, 2021, pp. 320-329.
- M. Dehghani, A. Arnab, L. Beyer, A. Vaswani, and Y. Tay, "The efficiency misnomer," arXiv preprint 2110.12894, 2021. · arXiv
Cited by
Sorted by citations
Explaining Deep Learning for ECG Analysis: Building Blocks for Auditing and Knowledge Discovery
Wagner, P., Mehari, T., Haverkamp, W., & Strodthoff, N. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.108525 · Cited by 48 · see citing works
Self-citationAlcaraz, J. M. L., Bouma, H., & Strodthoff, N. (2025) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2025.110196 · Cited by 13 · see citing works
Self-citationAlcaraz, J. M. L., Moran, X. L., Zaragoza, E. D., Händel, C., Koebe, R., Haverkamp, W., & Strodthoff, N. (2026) · arXiv · doi:10.48550/arxiv.2601.06645
“ECG waveforms are processed using an S4-based encoder built on structured state space models [33], which has demonstrated superior performance over conventional deep learning architectures such as CNNs, RNNs, and transformers in physiological time-series modeling [29, 34].”
Self-citation
- Authors
- Mehari, T., & Strodthoff, N.
- Affiliations
- Physikalisch-Technische Bundesanstalt (DE)
- Carl von Ossietzky Universität Oldenburg (DE)
- Venue
- IEEE Journal of Biomedical and Health Informatics
- Published
- 2023-11
- Volume
- 27
- Issue
- 11
- Pages
- 5326-5334
- ISSN
- 2168-2194 (ISSN-L)
- 2168-2208
- OpenAlex
- W4386362877
- Cited by
- 29
- References
- 3
- Citations by year
- 2026: 12 · 2025: 9 · 2024: 8
- FWCI
- 5.76
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- IEEE Journal of Biomedical and Health Informatics (publishedVersion, cc-by)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- Carl von Ossiezky University of Oldenburg (submittedVersion)
- Fraunhofer-Publica (Fraunhofer-Gesellschaft) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Topics
- Health Sciences › Medicine › Cardiology and Cardiovascular Medicine › ECG Monitoring and Analysis
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Health Sciences › Medicine › Cardiology and Cardiovascular Medicine › Cardiac electrophysiology and arrhythmias
- Keywords
- ECG signal analysis, state-space model, self-supervised learning, contrastive predictive coding, patient metadata, sampling frequency, quantitative accuracy, long-range dependencies, ECG classification
- MeSH terms
- Metadata, Algorithms, Electrocardiography, Humans, Time Factors, Benchmarking
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review