Self-Supervised Contrastive Learning for Medical Time Series: A Systematic Review
Open accessThe DOI matches its Crossref record; 128 of the 131 references it cites were found in a registry or an index, and 3 are not checked yet.
Abstract
Medical time series are sequential data collected over time that measures health-related signals, such as electroencephalography (EEG), electrocardiography (ECG), and intensive care unit (ICU) readings. Analyzing medical time series and identifying the latent patterns and trends that lead to uncovering highly valuable insights for enhancing diagnosis, treatment, risk assessment, and disease progression. However, data mining in medical time series is heavily limited by the sample annotation which is time-consuming and labor-intensive, and expert-depending. To mitigate this challenge, the emerging self-supervised contrastive learning, which has shown great success since 2020, is a promising solution. Contrastive learning aims to learn representative embeddings by contrasting positive and negative samples without the requirement for explicit labels. Here, we conducted a systematic review of how contrastive learning alleviates the label scarcity in medical time series based on PRISMA standards. We searched the studies in five scientific databases (IEEE, ACM, Scopus, Google Scholar, and PubMed) and retrieved 1908 papers based on the inclusion criteria. After applying excluding criteria, and screening at title, abstract, and full text levels, we carefully reviewed 43 papers in this area. Specifically, this paper outlines the pipeline of contrastive learning, including pre-training, fine-tuning, and testing. We provide a comprehensive summary of the various augmentations applied to medical time series data, the architectures of pre-training encoders, the types of fine-tuning classifiers and clusters, and the popular contrastive loss functions. Moreover, we present an overview of the different data types used in medical time series, highlight the medical applications of interest, and provide a comprehensive table of 51 public datasets that have been utilized in this field. In addition, this paper will provide a discussion on the promising future scopes such as providing guidance for effective augmentation design, developing a unified framework for analyzing hierarchical time series, and investigating methods for processing multimodal data. Despite being in its early stages, self-supervised contrastive learning has shown great potential in overcoming the need for expert-created annotations in the research of medical time series.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures





Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Liu et al. [33] provide a comprehensive summary of the various augmentations applied to medical time series data, the architectures of pre-training encoders, the types of fine-tuning classifiers and clusters, and the popular contrastive loss functions.”
From Self-Supervised Learning for Time Series Analysis: Taxonomy, Progress, and Prospects (2024) · cites this paper as [33]
The cited source says what the claim attributes to it.
In the citing paper
“The taxonomies proposed by Eldele et al. [19], Deldari et al. [20] and Liu et al. [33] are somewhat similar to our proposed taxonomy, i.e., three taxonomies involve time series self-supervised contrastive learning methods.”
From Self-Supervised Learning for Time Series Analysis: Taxonomy, Progress, and Prospects (2024) · cites this paper as [33]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The PRISMA 2020 statement: An updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · BMJ · doi:10.1136/bmj.n71 · Cited by 108,283
Goldberger, A. L., Amaral, L. A. N., Glass, L., Hausdorff, J. M., Ivanov, P. C., Mark, R. G., Mietus, J. E., Moody, G. B., Peng, C.-K., & Stanley, H. E. (2000) · Circulation · doi:10.1161/01.cir.101.23.e215 · Cited by 14,809
Momentum Contrast for Unsupervised Visual Representation Learning
He, K., Fan, H., Wu, Y., Xie, S., & Girshick, R. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00975 · Cited by 13,347
A simple framework for contrastive learning of visual representations
Chen, T., Kornblith, S., Norouzi, M., & Hinton, G. (2020) · arXiv · doi:10.48550/arxiv.2002.05709 · Cited by 10,857 · cited 6×
“Self-supervised contrastive learning drawn much attention since the development of SimCLR [16] in 2020.”
BackgroundInfluentialMIMIC-III, a freely accessible critical care database
Johnson, A. E. W., Pollard, T. J., Shen, L., Lehman, L.-W. H., Feng, M., Ghassemi, M., Moody, B., Szolovits, P., Anthony Celi, L., & Mark, R. G. (2016) · Scientific Data · doi:10.1038/sdata.2016.35 · Cited by 8,141 · cited 1×
“) [78] for surgical adverse events forecasting.”
The PRISMA 2020 statement: an updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J., Bossuyt, P., Boutron, I., Hoffmann, T., mulrow, C., Shamseer, L., Tetzlaff, J., Akl, E., Brennan, S. E., et al. (2020) · doi:10.31222/osf.io/v7gm2_v1 · Cited by 8,090
“Librispeech: an ASR corpus based on public domain audio books,”
Panayotov, V., Chen, G., Povey, D., & Khudanpur, S. (2015) · 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2015.7178964 · Cited by 6,072
The PRISMA 2020 statement: An updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · PLoS Medicine · doi:10.1371/journal.pmed.1003583 · Cited by 5,148
The impact of the MIT-BIH Arrhythmia Database
Moody, G. B., & Mark, R. G. (2001) · IEEE Engineering in Medicine and Biology Magazine · doi:10.1109/51.932724 · Cited by 4,812
Hannun, A. Y., Rajpurkar, P., Haghpanahi, M., Tison, G. H., Bourn, C., Turakhia, M. P., & Ng, A. Y. (2019) · Nature Medicine · doi:10.1038/s41591-018-0268-3 · Cited by 3,148
BCI2000: A General-Purpose Brain-Computer Interface (BCI) System
Schalk, G., McFarland, D. J., Hinterberger, T., Birbaumer, N., & Wolpaw, J. R. (2004) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2004.827072 · Cited by 3,024
Noise-contrastive estimation: A new estimation principle for unnormalized statistical models
Gutmann, M. U., & Hyvärinen, A. (2010) · Edinburgh Research Explorer (University of Edinburgh) · Cited by 2,992
Deep learning and its applications to machine health monitoring
Zhao, R., Yan, R., Chen, Z., Mao, K., Wang, P., & Gao, R. X. (2019) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2018.05.050 · Cited by 2,894
Artificial intelligence in healthcare
Yu, K.-H., Beam, A. L., & Kohane, I. S. (2018) · Nature Biomedical Engineering · doi:10.1038/s41551-018-0305-z · Cited by 2,817
Zheng, W.-L., & Lu, B.-L. (2015) · IEEE Transactions on Autonomous Mental Development · doi:10.1109/tamd.2015.2431497 · Cited by 2,595
Detecting Stress During Real-World Driving Tasks Using Physiological Sensors
Healey, J. A., & Picard, R. W. (2005) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2005.848368 · Cited by 2,207 · cited 2×
“MIT DriverDb [68] ECG, EMG, EDA, PR 17 ECG: 496 EMG: 15.”
MethodPollard, T. J., Johnson, A. E. W., Raffa, J. D., Celi, L. A., Mark, R. G., & Badawi, O. (2018) · Scientific Data · doi:10.1038/sdata.2018.178 · Cited by 1,993 · cited 2×
“HiRID [79,131] ICU 33,000+ eICU [80] ICU 160 variables -”
BackgroundMethod(2013) · RECERCAT (Consorci de Serveis Universitaris de Catalunya) · Cited by 1,959
Deep learning for electroencephalogram (EEG) classification tasks: a review
Craik, A., He, Y., & Contreras-Vidal, J. L. (2019) · Journal of Neural Engineering · doi:10.1088/1741-2552/ab0ab5 · Cited by 1,758 · cited 1×
“These electrodes link to a computer that will be able to record the sampled electrical impulse as one’s brain activities during a medical test or pre-defined task [45].”
BackgroundShickel, B., Tighe, P. J., Bihorac, A., & Rashidi, P. (2018) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2017.2767063 · Cited by 1,688 · cited 1×
“For example, previous studies show individuals only visit the hospitals five times each year [10], making the EHR contain very limited time points for sequential analysis (a patient only has 50 events in 10 years of EHR).”
The Sleep Heart Health Study: Design, Rationale, and Methods
(1997) · Sleep · doi:10.1093/sleep/20.12.1077 · Cited by 1,331
PTB-XL, a large publicly available electrocardiography dataset
Wagner, P., Strodthoff, N., Bousseljot, R.-D., Kreiseler, D., Lunze, F. I., Samek, W., & Schaeffter, T. (2020) · Scientific Data · doi:10.1038/s41597-020-0495-6 · Cited by 1,315
Introducing WESAD, a Multimodal Dataset for Wearable Stress and Affect Detection
Schmidt, P., Reiss, A., Duerichen, R., Marberger, C., & Van Laerhoven, K. (2018) · Proceedings of the 20th ACM International Conference on Multimodal Interaction · doi:10.1145/3242969.3242985 · Cited by 1,277
Katsigiannis, S., & Ramzan, N. (2018) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2017.2688239 · Cited by 1,135
Differential entropy feature for EEG-based emotion classification
Duan, R.-N., Zhu, J.-Y., & Lu, B.-L. (2013) · 2013 6th International IEEE/EMBS Conference on Neural Engineering (NER) · doi:10.1109/ner.2013.6695876 · Cited by 1,100
Self-supervised Learning: Generative or Contrastive
Liu, X., Zhang, F., Hou, Z., Mian, L., Wang, Z., Zhang, J., & Tang, J. (2021) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3090866 · Cited by 1,087 · cited 3×
“In this systematic review, we mainly focus on contrastive learning which is more effective if the downstream task is classification [17].”
BackgroundDeep learning for healthcare applications based on physiological signals: A review
Faust, O., Hagiwara, Y., Hong, T. J., Lih, O. S., & Acharya, U. R. (2018) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2018.04.005 · Cited by 1,026 · cited 1×
“In contrast, we pay more attention to dense medical time series such as vital signs where each recording contains hundreds of time points [11].”
BackgroundMultitask learning and benchmarking with clinical time series data
Harutyunyan, H., Khachatrian, H., Kale, D. C., Ver Steeg, G., & Galstyan, A. (2019) · Scientific Data · doi:10.1038/s41597-019-0103-9 · Cited by 958
Analysis of a sleep-dependent neuronal feedback loop: the slow-wave microcontinuity of the EEG
Kemp, B., Zwinderman, A. H., Tuk, B., Kamphuisen, H. A. C., & Oberye, J. J. L. (2000) · IEEE Transactions on Biomedical Engineering · doi:10.1109/10.867928 · Cited by 953
The National Sleep Research Resource: towards a sleep data commons
Zhang, G.-Q., Cui, L., Mueller, R., Tao, S., Kim, M., Rueschman, M., Mariani, S., Mobley, D., & Redline, S. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy064 · Cited by 917
Automatic diagnosis of the 12-lead ECG using a deep neural network
Ribeiro, A. H., Ribeiro, M. H., Paixão, G. M. M., Oliveira, D. M., Gomes, P. R., Canazart, J. A., Ferreira, M. P. S., Andersson, C. R., Macfarlane, P. W., Meira, W., et al. (2020) · Nature Communications · doi:10.1038/s41467-020-15432-4 · Cited by 894 · cited 1×
“Ribeiro [100] ECG 827 12 Automatic diagnosis of ECG”
MethodClifford, G., Liu, C., Moody, B., Lehman, L.-W., Silva, I., Li, Q., Johnson, A., & Mark, R. (2017) · Computing in Cardiology Conference (CinC) · doi:10.22489/cinc.2017.065-469 · Cited by 838
Graph Contrastive Learning with Augmentations
You, Y., Chen, T., Sui, Y., Chen, T., Wang, Z., & Shen, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.13902 · Cited by 824
Information Retrieval for Music and Motion
Müller, M. (2007) · doi:10.1007/978-3-540-74048-3 · Cited by 818
An empirical survey of data augmentation for time series classification with neural networks
Iwana, B. K., & Uchida, S. (2021) · PLOS ONE · doi:10.1371/journal.pone.0254841 · Cited by 725 · cited 1×
“Given the different data modalities, some of the common image augmentations, such as color changes or rotation, may not be as relevant to time series data [23].”
BackgroundRibeiro, A. H., Ribeiro, M. H., Paixao, G. M., Oliveira, D. M., Gomes, P. R., Canazart, J. A., Ferreira, M. P. S., Andersson, C. R., Macfarlane, P. W., Meira, W., et al. (2020) · RePEc: Research Papers in Economics · doi:10.5281/zenodo.3625006 · Cited by 715
Stisen, A., Blunck, H., Bhattacharya, S., Prentow, T. S., Kjærgaard, M. B., Dey, A., Sonne, T., & Jensen, M. M. (2015) · Proceedings of the 13th ACM Conference on Embedded Networked Sensor Systems · doi:10.1145/2809695.2809718 · Cited by 714
AMIGOS: A Dataset for Affect, Personality and Mood Research on Individuals and Groups
Miranda-Correa, J. A., Abadi, M. K., Sebe, N., & Patras, I. (2021) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2884461 · Cited by 709
Machine Learning for Survival Analysis: A Survey
Wang, P., Li, Y., & Reddy, C. K. (2019) · ACM Computing Surveys · doi:10.1145/3214306 · Cited by 691 · cited 1×
“device and then analyzed by a physician or specialist to assess the patient’s current status [9].”
BackgroundTriplet Loss in Siamese Network for Object Tracking
Dong, X., & Shen, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01261-8_28 · Cited by 648
The mPower study, Parkinson disease mobile data collected using ResearchKit
Bot, B. M., Suver, C., Neto, E. C., Kellen, M., Klein, A., Bare, C., Doerr, M., Pratap, A., Wilbanks, J., Dorsey, E. R., et al. (2016) · Scientific Data · doi:10.1038/sdata.2016.11 · Cited by 630 · cited 2×
“, memory, tapping, voice, and walking) [77], which is different from other reported papers that involved neurological disorder diagnosis.”
BackgroundResultNutzung der EKG-Signaldatenbank CARDIODAT der PTB über das Internet
Bousseljot, R., Kreiseler, D., & Schnabel, A. (2009) · Biomedizinische Technik/Biomedical Engineering · doi:10.1515/bmte.1995.40.s1.317 · Cited by 623
Liu, F., Liu, C., Zhao, L., Zhang, X., Wu, X., Xu, X., Liu, Y., Ma, C., Wei, S., He, Z., et al. (2018) · Journal of Medical Imaging and Health Informatics · doi:10.1166/jmihi.2018.2442 · Cited by 620
Self-citationThe temple university hospital EEG data corpus
Obeid, I., & Picone, J. (2016) · Frontiers in Neuroscience · doi:10.3389/fnins.2016.00196 · Cited by 528
Silva, I., Moody, G. B., Scott, D., Celi, L. A., & Mark, R. G. (2012) · PubMed · Cited by 518
A 12-lead electrocardiogram database for arrhythmia research covering more than 10,000 patients
Zheng, J., Zhang, J., Danioko, S., Yao, H., Guo, H., & Rakovski, C. (2020) · Scientific Data · doi:10.1038/s41597-020-0386-x · Cited by 487
Early prediction of circulatory failure in the intensive care unit using machine learning
Hyland, S. L., Faltys, M., Hüser, M., Lyu, X., Gumbsch, T., Esteban, C., Bock, C., Horn, M., Moor, M., Rieck, B., et al. (2020) · Nature Medicine · doi:10.1038/s41591-020-0789-4 · Cited by 477
Classification of 12-lead ECGs: the PhysioNet/Computing in Cardiology Challenge 2020
Perez Alday, E. A., Gu, A., J Shah, A., Robichaux, C., Ian Wong, A.-K., Liu, C., Liu, F., Bahrami Rad, A., Elola, A., Seyedi, S., et al. (2020) · Physiological Measurement · doi:10.1088/1361-6579/abc960 · Cited by 436
Systematic review of smartphone-based passive sensing for health and wellbeing
Cornet, V. P., & Holden, R. J. (2018) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2017.12.008 · Cited by 406
ISRUC-Sleep: A comprehensive public dataset for sleep researchers
Khalighi, S., Sousa, T., Santos, J. M., & Nunes, U. (2016) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2015.10.013 · Cited by 367 · cited 3×
“Dataset Data Type Subjects Frequency (Hz) Channels Task Physiological Synchrony Selective Attention [110] ECG, EEG, EDA 26 1024 EEG:32 EDA: 2 ECG:2 Attention focus study SHHS [111,112] ECG, EEG, EOG, EMG, SpO2, RR 9736 EEG: 125 EOG: 50 EMG: 125 ECG: 125/250 SpO2: 1 RR: 10 EEG: 2 EOG: 2 EMG: 1 ECG: 1 SpO2: 1 RR: 1 Slee…”
InfluentialBabayan, A., Erbey, M., Kumral, D., Reinelt, J. D., Reiter, A. M. F., Röbbig, J., Schaare, H. L., Uhlig, M., Anwander, A., Bazin, P.-L., et al. (2019) · Scientific Data · doi:10.1038/sdata.2018.308 · Cited by 364
O'Reilly, C., Gosselin, N., Carrier, J., & Nielsen, T. (2014) · Journal of Sleep Research · doi:10.1111/jsr.12169 · Cited by 356
CLOCS: Contrastive Learning of Cardiac Signals Across Space, Time, and Patients
Kiyasseh, D., Zhu, T., & Clifton, D. A. (2020) · Oxford University Research Archive (ORA) (University of Oxford) · doi:10.48550/arxiv.2005.13249 · Cited by 319 · cited 8×
“The underlying assumption is two channels that measure the same medical event will have similar embedding [18].”
BackgroundInfluentialThe MobiAct Dataset: Recognition of Activities of Daily Living using Smartphones
Vavoulas, G., Chatzaki, C., Malliotakis, T., Pediaditis, M., & Tsiknakis, M. (2016) · Proceedings of the International Conference on Information and Communication Technologies for Ageing Well and e-Health · doi:10.5220/0005792401430151 · Cited by 301 · cited 1×
“MobiAct [94] Acceleration, Angular velocity 57 20 6 Activity Recognition”
BackgroundMobile sensor data anonymization
Malekzadeh, M., Clegg, R. G., Cavallaro, A., & Haddadi, H. (2019) · Proceedings of the International Conference on Internet of Things Design and Implementation · doi:10.1145/3302505.3310068 · Cited by 298 · cited 1×
“MotionSense [92] Acceleration, Angular velocity 24 50 12 Activity Recognition”
BackgroundThe SWELL Knowledge Work Dataset for Stress and User Modeling Research
Koldijk, S., Sappelli, M., Verberne, S., Neerincx, M. A., & Kraaij, W. (2014) · Proceedings of the 16th International Conference on Multimodal Interaction · doi:10.1145/2663204.2663257 · Cited by 281
BCI Competition 2008–Graz data set A
Brunner, C., Leeb, R., & Müller-Putz, G. (2024) · IEEE DataPort · doi:10.21227/katb-zv89 · Cited by 271
The Temple University Hospital Seizure Detection Corpus
Shah, V., von Weltin, E., Lopez, S., McHugh, J. R., Veloso, L., Golmohammadi, M., Obeid, I., & Picone, J. (2018) · Frontiers in Neuroinformatics · doi:10.3389/fninf.2018.00083 · Cited by 266
The neurophysiological bases of EEG and EEG measurement: A review for the rest of us
Jackson, A. F., & Bolger, D. J. (2014) · Psychophysiology · doi:10.1111/psyp.12283 · Cited by 264 · cited 1×
“EEG detects the electrical impulse in the brain through numbers of electrodes set at certain spots on the scalp [44].”
BackgroundSelf-supervised learning methods and applications in medical imaging analysis: a survey
Shurrab, S., & Duwairi, R. (2022) · PeerJ Computer Science · doi:10.7717/peerj-cs.1045 · Cited by 254 · cited 1×
“tion, while some surveys have explored self-supervised methods in medical imaging [6,7], this paper uniquely focuses on medical time series, an area that has received limited attention despite its crucial role in health informatics.”
BackgroundEPILEPSIAE – A European epilepsy database
Ihle, M., Feldwisch-Drentrup, H., Teixeira, C. A., Witon, A., Schelter, B., Timmer, J., & Schulze-Bonhage, A. (2012) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2010.08.011 · Cited by 239
Time Series Prediction Using Deep Learning Methods in Healthcare
Morid, M. A., Sheng, O. R. L., & Dunbar, J. (2023) · ACM Transactions on Management Information Systems · doi:10.1145/3531326 · Cited by 231 · cited 1×
“In this category, we include the tasks as long as it exploits one or multi-modal signals from ICU data [4], which comprise a number of tasks: mortality prediction, readmission after ICU discharge, length of stay in ICU, sepsis shock forecasting, etc.”
MethodA deep learning framework for identifying children with ADHD using an EEG-based brain network
Chen, H., Song, Y., & Li, X. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.04.058 · Cited by 189
Self-supervised representation learning from 12-lead ECG data
Mehari, T., & Strodthoff, N. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2021.105114 · Cited by 188 · cited 4×
“The fine-tuning classifiers in the reviewed publications contains a variety of architectures including logistic regression [36], linear layer [46,56], CNN [21,71], LSTM [28], and MLP [35], etc.”
BackgroundInfluentialYou Snooze, You Win: The PhysioNet/Computing in Cardiology Challenge 2018
Ghassemi, M., Moody, B., Lehman, L.-W., Song, C., Li, Q., Sun, H., Westover, B., & Clifford, G. (2018) · Computing in Cardiology Conference (CinC) · doi:10.22489/cinc.2018.049 · Cited by 187
Hasan, N. I., & Bhattacharjee, A. (2019) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2019.04.005 · Cited by 186 · cited 1×
“, cardiovascular disease detection [12], neurological disorder [13]) and forecasting (e.”
BackgroundDreem Open Datasets: Multi-Scored Sleep Datasets to Compare Human and Automated Sleep Staging
Guillot, A., Sauvet, F., During, E., & Thorey, V. (2020) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2020.3011181 · Cited by 176
Unsupervised representation learning for time series with temporal neighborhood coding
Tonekaboni, S., Eytan, D., & Goldenberg, A. (2021) · arXiv · doi:10.48550/arxiv.2106.00750 · Cited by 170 · cited 1×
“It regards the two samples that are temporally near to each other as a positive sample [85].”
BackgroundYang, C., Xiao, C., Westover, M. B., & Sun, J. (2023) · JMIR AI · doi:10.2196/46769 · Cited by 163 · cited 2×
“(2021) [32] EEG Sleep stage classification Bandpass filtering; Jittering; Channel flipping Contrastive mapping STFT + CNN Logistic regression Triplet loss SHHS, Sleep-EDF, MGH Sleep X”
BackgroundHeart murmur detection from phonocardiogram recordings: The George B. Moody PhysioNet Challenge 2022
Reyna, M. A., Kiarashi, Y., Elola, A., Oliveira, J., Renna, F., Gu, A., Alday, E. A. P., Sadr, N., Sharma, A., Kpodonu, J., et al. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000324 · Cited by 163
Che, Z., Cheng, Y., Zhai, S., Sun, Z., & Liu, Y. (2017) · 2017 IEEE International Conference on Data Mining (ICDM) · doi:10.1109/icdm.2017.93 · Cited by 162
Albelwi, S. (2022) · Entropy · doi:10.3390/e24040551 · Cited by 150 · cited 2×
“For instance, a popular augmentation technique in computer vision is to identify the rotation angle of an image [25].”
Background(2020) · Cited by 147
Westerhuis, M. E. M. H., Visser, G. H. A., Moons, K. G. M., van Beek, E., Benders, M. J., Bijvoet, S. M., van Dessel, H. J. H. M., Drogtrop, A. P., van Geijn, H. P., Graziosi, G. C., et al. (2010) · Obstetrics & Gynecology · doi:10.1097/aog.0b013e3181dfffd6 · Cited by 126 · cited 1×
“Dutch STAN trial [97] CTG 5681 Fetal monitoring”
BackgroundThe TUH EEG CORPUS: A big data resource for automated EEG interpretation
Harati, A., Lopez, S., Obeid, I., Picone, J., Jacobson, M. P., & Tobochnik, S. (2014) · 2014 IEEE Signal Processing in Medicine and Biology Symposium (SPMB) · doi:10.1109/spmb.2014.7002953 · Cited by 126 · cited 2×
“There are well-constructed infrastructures for epilepsy seizure (e.g., the TUH EEG Corpus [76]) but very limited public datasets on biomedical time series-based AD or ASD.”
BackgroundO’Connor, L., Brage, S., Griffin, S. J., Wareham, N. J., & Forouhi, N. G. (2015) · British Journal of Nutrition · doi:10.1017/s000711451500269x · Cited by 125
Greenwald, S. D., Patil, R. S., & Mark, R. G. (2002) · [1990] Proceedings Computers in Cardiology · doi:10.1109/cic.1990.144257 · Cited by 124
Lai, J., Tan, H., Wang, J., Ji, L., Guo, J., Han, B., Shi, Y., Feng, Q., & Yang, W. (2023) · Nature Communications · doi:10.1038/s41467-023-39472-8 · Cited by 123
Acute physiology and chronic health evaluation (APACHE II) and Medicare reimbursement.
Wagner, D. P., & Draper, E. A. (1984) · PubMed · Cited by 112
DiCOVA Challenge: Dataset, Task, and Baseline System for COVID-19 Diagnosis Using Acoustics
Muguli, A., Pinto, L., R, N., Sharma, N., Krishnan, P., Ghosh, P. K., Kumar, R., Bhat, S., Chetupalli, S. R., Ganapathy, S., et al. (2021) · Interspeech 2021 · doi:10.21437/interspeech.2021-74 · Cited by 101
Tan, C., Zhang, L., & Wu, H. (2018) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2018.2817192 · Cited by 97
Contrastive Self-supervised Learning for Sensor-based Human Activity Recognition
Khaertdinov, B., Ghaleb, E., & Asteriadis, S. (2021) · 2021 IEEE International Joint Conference on Biometrics (IJCB) · doi:10.1109/ijcb52358.2021.9484410 · Cited by 95 · cited 1×
“Similarly, bringing the idea to time series data, an intuitive pretext task is to predict whether the input sequence is permuted or not [87].”
BackgroundSelf-Supervised Representation Learning from Electroencephalography Signals
Banville, H. J., Albuquerque, I., Hyvärinen, A., Moffat, G., Engemann, D. A., & Gramfort, A. (2019) · Machine learning for signal processing ... · doi:10.1109/mlsp.2019.8918693 · Cited by 90 · cited 18×
“(2019) [21] EEG Sleep scoring Neighboring; Temporal shuffling Contrastive mapping CNN Linear layer Absolute distance Sleep-EDF; MASS session3 -”
BackgroundInfluentialRibeiro, A. L. P., Paixão, G. M. M., Gomes, P. R., Ribeiro, M. H., Ribeiro, A. H., Canazart, J. A., Oliveira, D. M., Ferreira, M. P., Lima, E. M., Moraes, J. L. D., et al. (2019) · Journal of Electrocardiology · doi:10.1016/j.jelectrocard.2019.09.008 · Cited by 84
Self-supervised Contrastive Learning for EEG-based Sleep Staging
Jiang, X., Zhao, J., Du, B., & Yuan, Z. (2021) · 2021 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9533305 · Cited by 84 · cited 9×
“Permutation contains two steps: segmenting which splits the time series into several subsequences and permuting which randomly reorders the subsequences [35].”
BackgroundInfluentialChowdhury, A., Rosenthal, J., Waring, J., & Umeton, R. (2021) · Informatics · doi:10.3390/informatics8030059 · Cited by 82 · cited 1×
“tion, while some surveys have explored self-supervised methods in medical imaging [6,7], this paper uniquely focuses on medical time series, an area that has received limited attention despite its crucial role in health informatics.”
BackgroundHeart murmur detection from phonocardiogram recordings: The George B. Moody PhysioNet Challenge 2022Preprint
Reyna, M. A., Kiarashi, Y., Elola, A., et al. (2022) · medRxiv · doi:10.1101/2022.08.11.22278688 · Cited by 72
Self-supervised representation learning from electroencephalography signals
Banville, H. J., Albuquerque, I., Hyvärinen, A., Moffat, G., Engemann, D. A., & Gramfort, A. (2019) · HAL · Cited by 71
Multi-channel EEG recording during motor imagery of different joints from the same limb
Ma, X., Qiu, S., & He, H. (2020) · Scientific Data · doi:10.1038/s41597-020-0535-2 · Cited by 69
Ye, J., Xiao, Q., Wang, J., Zhang, H., Deng, J., & Lin, Y. (2022) · IEEE Signal Processing Letters · doi:10.1109/lsp.2021.3130826 · Cited by 61 · cited 1×
“(2022) [34] EEG Sleep stage classification Predictive coding ResNet + GRU Linear layer InfoNEC loss Sleep-EDF; ISRUC X”
BackgroundBaker, S., Xiang, W., & Atkinson, I. (2020) · Scientific Reports · doi:10.1038/s41598-020-78184-7 · Cited by 60
Stuldreher, I. V., Thammasan, N., van Erp, J. B. F., & Brouwer, A.-M. (2020) · Journal of Neural Engineering · doi:10.1088/1741-2552/aba87d · Cited by 58
Self-Supervised Graph Neural Networks for Improved Electroencephalographic Seizure Analysis
Tang, S., Dunnmon, J., Saab, K. K., Zhang, X., Huang, Q., Dubost, F., Rubin, D. L., & Lee‐Messer, C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.08336 · Cited by 55 · cited 1×
“(2022) [41] EEG Seizure detection DCGRUs MLP TUSZ, In-house dataset X Forecast the future sequence”
Self-citationChen, H., Lundberg, S. M., Erion, G., Kim, J. H., & Lee, S.-I. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00536-y · Cited by 48
Semi-Supervised Contrastive Learning for Generalizable Motor Imagery EEG Classification
Han, J., Gu, X., & Lo, B. P. L. (2021) · Wearable and Implantable Body Sensor Networks · doi:10.1109/bsn51625.2021.9507038 · Cited by 48 · cited 22×
“Han et al. (2021) [71] EEG Motor-Imagery classification Jittering; DC shift; Temporal roll, Amplitude scale, Temporal cutout, Crop and upsample Contrastive mapping CNN CNN NT-Xent BCIC IV 2a - - Wagh et al. (2021) [30] ECG EEG grade; Eye state; Demographics classification Randomly flipping;…”
BackgroundInfluentialContrastive Embeddind Learning Method for Respiratory Sound Classification
Song, W., Han, J., & Song, H. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414385 · Cited by 46 · cited 4×
“Time shifting means horizontally (along with the time axis) shifting the sample to generate the augmented sample [63].”
BackgroundInfluentialSarkar, P., Lobmaier, S., Fabre, B., González, D., Mueller, A., Frasch, M. G., Antonelli, M. C., & Etemad, A. (2021) · Scientific Reports · doi:10.1038/s41598-021-03376-8 · Cited by 42 · cited 8×
“Jittering, also known as adding random noise, is one of the most popular, simple yet effective augmentation methods [56].”
BackgroundMethodInfluentialDetection of seizures in intracranial EEG: UPenn and Mayo Clinic's Seizure Detection Challenge
Temko, A., Sarkar, A. K., & Lightbody, G. (2015) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2015.7319901 · Cited by 40
Self-supervised transfer learning of physiological representations from free-living wearable data
Spathis, D., Perez-Pozuelo, I., Brage, S., Wareham, N. J., & Mascolo, C. (2021) · Proceedings of the Conference on Health, Inference, and Learning · doi:10.1145/3450439.3451863 · Cited by 40 · cited 3×
“Three works (5%) [39,64,65] adopted the heart rate data.”
BackgroundMethodBreaking away from labels: The promise of self-supervised machine learning in intelligent health
Spathis, D., Perez-Pozuelo, I., Marques-Fernandez, L., & Mascolo, C. (2022) · Patterns · doi:10.1016/j.patter.2021.100410 · Cited by 39 · cited 2×
“Compared to end-to-end models, contrastive learning needs to augment samples to provide measurable loss, however, the augmentation inevitably increased the number of samples which requires more computational resources [22,137].”
BackgroundAnomaly Detection on Electroencephalography with Self-supervised Learning
Xu, J., Zheng, Y., Mao, Y., Wang, R., & Zheng, W. (2020) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm49941.2020.9313163 · Cited by 39 · cited 2×
“X Xu et al. (2020) [20] EEG Seizure detection Scaling transformations Predicting transformation types CNN CNN Cross-entropy UPenn and Mayo Clinic’s seizure detection challenge - - Ho et al. (2022) [31] EEG Seizure detection Graph-based pair sampling Contrastive mapping GNN Thresholding NCE+MSE TUSZ…”
MethodXiao, Q., Wang, J., Ye, J., Zhang, H., Bu, Y., Zhang, Y., & Wu, H. (2021) · ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp39728.2021.9414752 · Cited by 38 · cited 2×
“(2021) [33] EEG Sleep stage classification Predictive coding CNN + LSTM Linear layer InfoNEC loss + Cross-entropy Sleep-EDF; ISRUC X”
BackgroundGreenwald, S. D., Patil, R. S., & Mark, R. G. (1992) · PubMed · Cited by 37
Self-Supervised Learning From Multi-Sensor Data for Sleep Recognition
Zhao, A., Dong, J., & Zhou, H. (2020) · IEEE Access · doi:10.1109/access.2020.2994593 · Cited by 36 · cited 4×
“[65] conducted insomnia detection based on bioradar data (continuous waves) from a non-contact sleep monitoring dataset [75].”
BackgroundMethodInfluentialA Self-Supervised Learning Based Channel Attention MLP-Mixer Network for Motor Imagery Decoding
He, Y., Lu, Z., Wang, J., Ying, S., & Shi, J. (2022) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2022.3199363 · Cited by 36 · cited 2×
“(2022) [29] EEG Motor-Imagery classification Predictive coding CNN + LSTM Linear layer MSE MI-2; BCIC IV 2a -”
BackgroundCLECG: A Novel Contrastive Learning Framework for Electrocardiogram Arrhythmia Classification
Chen, H., Wang, G., Zhang, G., Zhang, P., & Yang, H. (2021) · IEEE Signal Processing Letters · doi:10.1109/lsp.2021.3114119 · Cited by 35 · cited 2×
“(2021) [49] ECG Cardiac arrhythmia classification Daubechies wavelet transform; Random crop Contrastive mapping ResNet + MLP NT-Xent PTB-XL; ICBEB 2018; PhysioNet 2017 X -”
BackgroundContrastive Heartbeats: Contrastive Learning for Self-Supervised ECG Representation and Phenotyping
Wei, C. T., Hsieh, M.-E., Liu, C., & Tseng, V. S. M. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746887 · Cited by 35 · cited 2×
“…arrhythmia classification Daubechies wavelet transform; Random crop Contrastive mapping ResNet + MLP - NT-Xent PTB-XL; ICBEB 2018; PhysioNet 2017 X - Wei et al. (2022) [50] ECG Cardiac arrhythmia classification Trials discrimination Contrastive mapping Causal CNN Logistic…”
BackgroundSense and Learn: Self-supervision for omnipresent sensors
Saeed, A., Ungureanu, V., & Gfeller, B. (2021) · Machine Learning with Applications · doi:10.1016/j.mlwa.2021.100152 · Cited by 34
Listen2YourHeart: A Self-Supervised Approach for Detecting Murmur in Heart-Beat Sounds
Ballas, A., Papapanagiotou, V., Delopoulos, A. N., & Diou", C. (2022) · Computing in cardiology · doi:10.22489/cinc.2022.298 · Cited by 34 · cited 5×
“Nearly all of the studies in this scope are based on ECG data, except one work [57] used PCG signals that record heart sounds and murmurs [73].”
BackgroundMethodInfluentialBioradiolocation-based sleep stage classification
Tataraidze, A., Korostovtseva, L., Anishchenko, L., Bochkarev, M., Sviryaev, Y., & Ivashov, S. (2016) · 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2016.7591321 · Cited by 30 · cited 1×
“[65] conducted insomnia detection based on bioradar data (continuous waves) from a non-contact sleep monitoring dataset [75].”
MethodBi-Directional Gated Recurrent Unit Based Ensemble Model for the Early Detection of Sepsis
Wickramaratne, S., & Mahmud, M. S. (2020) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc44109.2020.9175223 · Cited by 26
Weak self-supervised learning for seizure forecasting: a feasibility study
Yang, Y., Truong, N. D., Eshraghian, J. K., Nikpour, A., & Kavehei, O. (2022) · Royal Society Open Science · doi:10.1098/rsos.220374 · Cited by 26 · cited 1×
“(2022) [42] EEG Seizure detection and forecasting Conv-LSTM MLP Cross entropy TUH seizure, EPILEPSIAE dataset, RPAH dataset (private) X -”
BackgroundT-DPSOM: an interpretable clustering method for unsupervised learning of patient health states
Manduchi, L., Hüser, M., Faltys, M., Vogt, J. E., Rätsch, G., & Fortuin, V. (2021) · ACM Conference on Health, Inference, and Learning (CHIL) · doi:10.1145/3450439.3451872 · Cited by 23 · cited 1×
“Manduchi et al. (2021) [59] ICU Patient health state tracking - Predictive coding VAE-LSTM - KL-divergence; Cross-entropy MNIST; Fashion-MNIST; eICU dataset -”
Wang, H., Lin, G., Li, Y., Zhang, X., Xu, W. H., Wang, X., & Han, D. (2021) · Nature and Science of Sleep · doi:10.2147/nss.s336344 · Cited by 21
Self-citationSelf-Supervised Learning with Electrocardiogram Delineation for Arrhythmia Detection
Lee, B. T., Kong, S. T., Song, Y., & Lee, Y. (2021) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc46164.2021.9630364 · Cited by 21 · cited 1×
“(2021) [55] ECG Cardiac arrhythmia classification ResNet MLP CPSC, PT-BXL, Chapman-Shaoxing X - -”
BackgroundChen, X., Zhu, Q., Zhang, J., & Dai, L.-R. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746205 · Cited by 19 · cited 4×
“Affected by the outbreak of the pandemic, there are two publications aimed at detecting COVID-19 symptoms based on the sound of cough [62,83].”
BackgroundInfluentialOrlandic, L., Teijeiro, T., & Atienza, D. (2023) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2023.107743 · Cited by 18 · cited 1×
“Affected by the outbreak of the pandemic, there are two publications aimed at detecting COVID-19 symptoms based on the sound of cough [62,83].”
BackgroundEdinburgh, T., Smielewski, P., Czosnyka, M., Cabeleira, M. T., Eglen, S. J., & Ercole, A. (2021) · Acta neurochirurgica. Supplementum · doi:10.1007/978-3-030-59436-7_45 · Cited by 17
First Steps Towards Self-Supervised Pretraining of the 12-Lead ECG
Gedon, D., Ribeiro, A. H., Wahlström, N., & Schön, T. B. (2021) · Computing in cardiology · doi:10.23919/cinc53138.2021.9662748 · Cited by 16 · cited 2×
“(2022) [54] ECG Cardiac abnormality detection ResNet Linear layer MSE Train: CODE; Test: CPSC 2018, PTB-XL X - Reconstruct the masked signal”
BackgroundTowards Parkinson’s Disease Prognosis Using Self-Supervised Learning and Anomaly Detection
Jiang, H., Lim, W. Y. B., Ng, J. S., Wang, Y., Chi, Y., & Miao, C. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414840 · Cited by 13 · cited 7×
“In [67], the main indicator is not EEG but human behavior data from accelerometers and gyroscopes that measures acceleration and angular velocity, respectively.”
BackgroundMethodInfluentialCUDAMicroBench: Microbenchmarks to Assist CUDA Performance Programming
Yi, X., Stokes, D., Yan, Y., & Liao, C. (2021) · IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum · doi:10.1109/ipdpsw52791.2021.00068 · Cited by 13
A Contrastive Learning Framework for ECG Anomaly Detection
Li, F., Chang, H., Jiang, M., & Su, Y. (2022) · International Conference on Intelligent Computing and Signal Processing (ICSP) · doi:10.1109/icsp54964.2022.9778634 · Cited by 12 · cited 4×
“Sarkar et al. (2021) [56] Abdominal ECG Maternal and fetal stress detection Jittering; Scaling; Flipping; Temporal inversion; Permutation; Time-warping Augmentation type recognition CNN MLP Cross entropy AMIGOS; DREAMER; WESAD; SWELL; FELICITy X X Jiang et al. (2021) [67] Acceleration, Angular velocity Parkinson’s Dis…”
BackgroundInfluentialA Contrastive Predictive Coding-Based Classification Framework for Healthcare Sensor Data
Ren, C., Sun, L., & Peng, D. (2022) · Journal of Healthcare Engineering · doi:10.1155/2022/5649253 · Cited by 11 · cited 2×
“…Cardiac arrhythmia classification Block masking with noise Contrastive mapping ResNet Logistic regression InfoNCE Physionet Motor Imagery; MIT-BIH - - Ren et al. (2022) [37] EEG, ECG Sleep stage classification; Cardiac arrhythmia classification - Predictive coding MLP CNN Cross entropy Sleep-EDF;…”
BackgroundMethodStuldreher, I. V., Merasli, A., Thammasan, N., van Erp, J. B. F., & Brouwer, A.-M. (2022) · Frontiers in Neuroergonomics · doi:10.3389/fnrgo.2021.750248 · Cited by 9 · cited 4×
“[43] adopt Kmeans for the downstream clustering.”
BackgroundMethodInfluentialLuo, C., Wang, G., Ding, Z., Chen, H., & Yang, F. (2021) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc46164.2021.9630616 · Cited by 8 · cited 2×
“Luo et al. (2021) [48] ECG Cardiac arrhythmia classification Reorganization Detect organization operation CNN - Cross-entropy PhysioNet 2017; CPSC 2018 X - Chen et al. (2021) [49] ECG Cardiac arrhythmia classification Daubechies wavelet transform; Random crop Contrastive mapping ResNet + MLP -…”
CROCS: Clustering and Retrieval of Cardiac Signals Based on Patient Disease Class, Sex, and AgePreprint
Kiyasseh, D., Zhu, T., & Clifton, D. A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.14230 · Cited by 7 · cited 4×
“Most of the downstream tasks of these studies are based on binary or multi-class classification, and only one work [51] employed clustering and retrieves setting which creates clusters of similar patient attributes and enables the retrieve of associate information from it.”
BackgroundInfluentialContrastive Predictive Coding for Anomaly Detection of Fetal Health from the Cardiotocogram
de Vries, I. R., Huijben, I. A. M., Kok, R. D., van Sloun, R. J. G., & Vullings, R. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747178 · Cited by 6 · cited 5×
“Similarly, one study [66] used Cardiotocography (CTG) which is a temporal recording of both the fetal heart rate and uterine contractions.”
BackgroundMethodResultInfluentialMotion and heart rate from a wrist-worn wearable and labeled sleep from polysomnography
Walch, O. (2020) · PhysioNet · doi:10.13026/50yh-tt09 · Cited by 5
Unsupervised Anomaly Detection on Temporal Multiway Data
Nguyen, D. T., Nguyen, P., Do, K., Rana, S., Gupta, S., & Tran, T. (2020) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci47803.2020.9308219 · Cited by 4 · cited 5×
“Luo et al. (2021) [48] ECG Cardiac arrhythmia classification Reorganization Detect organization operation CNN - Cross-entropy PhysioNet 2017; CPSC 2018 X - Chen et al. (2021) [49] ECG Cardiac arrhythmia classification Daubechies wavelet transform; Random crop Contrastive mapping ResNet + MLP - NT-Xent PTB-XL; ICBEB 20…”
BackgroundInfluentialYang, W., Feng, Q., Lai, J., et al. (2022) · Research Square · doi:10.21203/rs.3.rs-1796360/v1 · Cited by 1
Research works printed but not linked: 14
- Spathis, D., Perez-Pozuelo, I., Brage, S., Wareham, N.J., and Mascolo, C. (2020). Learning generalizable physiological representations from large-scale wearable data. arXiv.
- Pan, L., Feng, Z., and Peng, S. (2022). A review of machine learning approaches, challenges and prospects for computational tumor pathology. arXiv.
- Kingma, D.P., and Welling, M. (2013). Auto-encoding variational bayes. arXiv.
- Wagh, N., Wei, J., Rawal, S., Berry, B., Barnard, L., Brinkmann, B., Worrell, G., Jones, D., and Varatharajah, Y. (2021, January 6–7). Domain-guided Self-supervision of EEG Data Improves Downstream Classification Performance and Generalizability. Proceedings of the Machine Learning for Health, PMLR, Virtual.
- Ho, T.K.K., and Armanfard, N. (2022). Self-Supervised Learning for Anomalous Channel Detection in EEG Graphs: Application to Seizure Analysis. arXiv.
- Yang, C., Xiao, D., Westover, M.B., and Sun, J. (2021). Self-supervised eeg representation learning for automatic sleep staging. arXiv.
- Cheng, J.Y., Goh, H., Dogrusoz, K., Tuzel, O., and Azemi, E. (2020). Subject-aware contrastive learning for biosignals. arXiv.
- Huijben, I.A., Nijdam, A.A., Overeem, S., van Gilst, M.M., and van Sloun, R.J. (2022). SOM-CPC: Unsupervised Contrastive Learning with Self-Organizing Maps for Structured Representations of High-Rate Time Series. arXiv.
- Zhang, X., Zhao, Z., Tsiligkaridis, T., and Zitnik, M. (2022). Self-supervised contrastive pre-training for time series via time-frequency consistency. arXiv.
- Weatherhead, A., Greer, R., Moga, M.A., Mazwi, M., Eytan, D., Goldenberg, A., and Tonekaboni, S. (2022, January 7–8). Learning Unsupervised Representations for ICU Timeseries. Proceedings of the Conference on Health, Inference, and Learning, PMLR, Virtual.
- Edinburgh, T., Smielewski, P., Czosnyka, M., Cabeleira, M., Eglen, S.J., and Ercole, A. (2021). Intracranial Pressure and Neuromonitoring XVII, Springer.
- Wever, F., Keller, T.A., Symul, L., and Garcia, V. (2021). As easy as APC: Overcoming missing data and class imbalance in time series with self-supervised learning. arXiv.
- van den Oord, A., Li, Y., and Vinyals, O. (2018). Representation learning with contrastive predictive coding. arXiv.
- Rocha, B., Filos, D., Mendes, L., Vogiatzis, I., Perantoni, E., Kaimakamis, E., Natsiavas, P., Oliveira, A., Jácome, C., and Marques, A. A respiratory sound database for the development of automated classification. Proceedings of the International Conference on Biomedical and Health Informatics.
Cited by
Self-Supervised Learning for Time Series Analysis: Taxonomy, Progress, and Prospects
Zhang, K., Wen, Q., Zhang, C., Cai, R., Jin, M., Liu, Y., Zhang, J. Y., Liang, Y., Pang, G., Song, D., et al. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3387317 · Cited by 295
“The second category focuses on the key components of time series modeling based on deep neural networks, such as data augmentation [33], [45], [46], [47], model structure [33], [48], [49].”
BackgroundMethodInfluentialTahir, M. A. A., Norouzi, M., Khan, S. S., Davie, J., Yamanaka, S., & Ashraf, A. B. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.109302 · Cited by 56
Applications of Self-Supervised Learning to Biomedical Signals: A Survey
Pup, F. D., & Atzori, M. (2023) · IEEE Access · doi:10.1109/access.2023.3344531 · Cited by 43
“In fact, previously cited works focus on different types of data (medical imaging) [19], [20], specific biomedical signals (EEG) [21], or specific self-supervised learning paradigms (contrastive learning) [15].”
BackgroundLarge language models for bioinformatics
Ruan, W., Lyu, Y., Zhang, J., Cai, J., Shu, P., Yang, G., Lu, Y., Gao, S., Wang, Y., Wang, P., et al. (2025) · Quantitative Biology · doi:10.1002/qub2.70014 · Cited by 48
“Language models are trained using self ‐ supervised learning methods [85].”
Self-citationTS-MAE: A masked autoencoder for time series representation learning
Liu, Q., Ye, J., Liang, H., Sun, L., & Du, B. (2024) · Information Sciences · doi:10.1016/j.ins.2024.121576 · Cited by 20
Metadata
- Authors
- Liu, Z., Alavi, A., Li, M., & Zhang, X.
- Affiliations
- RMIT University (AU)
- Coles, Melbourne, VIC 3123, Australia
- University of North Carolina at Charlotte (US)
- Corresponding author
- Alavi, Azadeh
- Zhang, Xiang
- Venue
- Sensors
- Publisher
- MDPI AG
- Published
- 2023-04-23
- Volume
- 23
- Issue
- 9
- Pages
- 4221
- ISSN
- 1424-8220 (ISSN-L)
- PMC
- PMC10181273
- OpenAlex
- W4366829097
- Cited by
- 90
- References
- 128
- Citations by year
- 2026: 35 · 2025: 26 · 2024: 25 · 2023: 4
- FWCI
- 1.88
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Sensors (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Funders
- National Science Foundation (2245894)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Physical Sciences › Computer Science › Signal Processing › Time Series Analysis and Forecasting
- Health Sciences › Medicine › Cardiology and Cardiovascular Medicine › ECG Monitoring and Analysis
- Keywords
- self-supervised contrastive learning, medical time series, limited labeled data, data augmentation, contrastive loss, EEG, ECG, intensive care monitoring, hierarchical time series, multimodal data, medical datasets
- MeSH terms
- Learning, Time Factors, Databases, Factual, Data Mining
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.