Towards robust and label-efficient time series representation learning
Open accessThe DOI matches its Crossref record; 209 of the 210 references it cites were found in a registry or an index, and 1 are not checked yet.
Abstract
Time series data is sequential measurements collected over time from various sources in different applications, e.g., healthcare and manufacturing. With the increased generation of time series data from these applications, their analysis is becoming more important to get insights. Deep learning has shown a potential and proven capability in automatic learning from massive data, by identifying complex patterns and representations directly from data. However, the current deep learning-based models suffer significant limitations. First, they lack the ability to efficiently learn time series temporal relations while utilizing parallel processing. Second, these models require large amounts of labeled data for training, which can be difficult to obtain, especially with complex time series data. Third, the generalization capability of these models is limited, where they suffer performance deterioration when transferring knowledge from a labeled source domain to an out-of-distribution unlabeled target domain. In this thesis, we address these problems and provide solutions for the real-world deployment of deep learning models for time series data. We first propose a novel attention-based deep learning architecture called AttnSleep to classify EEG-based sleep stages, being one of the common time series healthcare data types. Specifically, we propose a powerful feature extractor that learns from different frequency bands in EEG signals. We also propose a temporal context encoder module to learn the temporal dependencies among extracted features using a causal multi-head attention mechanism. Last, we develop a class-aware loss function to address the class-imbalance problem in sleep data without incurring any additional computational costs. Next, we propose two frameworks to address the label scarcity problem in different settings. The first framework, TS-TCC, is a self-supervised learning approach that learns useful representations from unlabeled data. TS-TCC utilizes time series-specific augmentations to generate two views for each sample. We then learn the temporal representations via a novel cross-view temporal prediction task. Furthermore, we propose a contextual contrasting module that further learns discriminative representations. The second framework, CA-TCC, improves the learned representations from TS-TCC in semi-supervised settings, by training the model in four phases. First, we perform self-supervised training with TS-TCC. Then, we fine-tune the pretrained model with the available few labeled samples. Following that, we use the fine-tuned model to assign pseudo labels to the unlabeled set. Finally, we leverage these pseudo labels to realize a class-aware contrastive loss for semi-supervised training. These two frameworks showed significant performance improvement with having few labeled samples compared to traditional supervised training. Last, we tackle the domain shift problem and propose two novel frameworks to address this issue. In the first framework, we introduce an adversarial domain adaptation technique named ADAST, that addresses two challenges, namely the loss of domain-specific information during feature extraction and the ignorance of class information in the target domain during domain alignment. To overcome these challenges, we incorporate an unshared attention mechanism and an iterative self-training strategy with dual distinct classifiers. In the second framework, we attempt to overcome the complexity of adversarial training and present a novel approach called CoTMix to address the domain shift with a simple yet effective contrastive learning strategy. In specific, we propose a cross-domain temporal mixup strategy to create source-dominant and target-dominant domains. These domains serve as augmented views for the source and target domains in contrastive learning. Unlike prior works, CoTMix maps the source and target domains to an intermediate domain. These frameworks showed improved robustness of deep learning models on time series data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“The taxonomies proposed by Eldele et al. [19], Deldari et al. [20] and Liu et al. [33] are somewhat similar to our proposed taxonomy, i.e., three taxonomies involve time series self-supervised contrastive learning methods.”
From Self-Supervised Learning for Time Series Analysis: Taxonomy, Progress, and Prospects (2024) · cites this paper as [19]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“However, these two reviews only discuss a small part of self-supervised contrastive learning (SSCL), which requires a more comprehensive literature review.”
From Self-Supervised Learning for Time Series Analysis: Taxonomy, Progress, and Prospects (2024) · cites this paper as [19]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398
Squeeze-and-Excitation Networks
Hu, J., Shen, L., & Sun, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00745 · Cited by 35,667
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Labaca-Castro, R. (2023) · Machine Learning under Malware Attack · doi:10.1007/978-3-658-40442-0_9 · Cited by 19,272
Momentum Contrast for Unsupervised Visual Representation Learning
He, K., Fan, H., Wu, Y., Xie, S., & Girshick, R. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00975 · Cited by 13,347
Squeeze-and-Excitation Networks
Hu, J., Shen, L., Albanie, S., Sun, G., & Wu, E. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2913372 · Cited by 12,157
A simple framework for contrastive learning of visual representations
Chen, T., Kornblith, S., Norouzi, M., & Hinton, G. (2020) · arXiv · doi:10.48550/arxiv.2002.05709 · Cited by 10,857
Domain-Adversarial Training of Neural Networks
Ganin, Y., Ustinova, E., Ajakan, H., Germain, P., Larochelle, H., Laviolette, F., Marchand, M., & Lempitsky, V. (2017) · Advances in Computer Vision and Pattern Recognition · doi:10.1007/978-3-319-58347-1_10 · Cited by 8,318
UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction
McInnes, L., Healy, J., & Melville, J. (2018) · arXiv · doi:10.48550/arxiv.1802.03426 · Cited by 7,101
Representation Learning with Contrastive Predictive Coding
Oord, A. V. D., Li, Y., & Vinyals, O. (2018) · arXiv · doi:10.48550/arxiv.1807.03748 · Cited by 6,242
How transferable are features in deep neural networks?
Yosinski, J., Clune, J., Bengio, Y., & Lipson, H. (2014) · arXiv · doi:10.48550/arxiv.1411.1792 · Cited by 6,061
mixup: Beyond Empirical Risk Minimization
Zhang, H., Cisse, M., Dauphin, Y. N., & Lopez-Paz, D. (2017) · arXiv · doi:10.48550/arxiv.1710.09412 · Cited by 5,831
Adversarial Discriminative Domain Adaptation
Tzeng, E., Hoffman, J., Saenko, K., & Darrell, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.316 · Cited by 5,154
An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling
Bai, S., Kolter, J. Z., & Koltun, V. (2018) · arXiv · doi:10.48550/arxiv.1803.01271 · Cited by 4,655
Tarvainen, A., & Valpola, H. (2017) · arXiv · doi:10.48550/arxiv.1703.01780 · Cited by 4,275
Bootstrap Your Own Latent: A New Approach to Self-Supervised Learning
Grill, J.-B., Strub, F., Altché, F., Tallec, C., Richemond, P. H., Buchatskaya, E., Doersch, C., Pires, B. A., Guo, Z. D., Azar, M. G., et al. (2020) · arXiv · doi:10.48550/arxiv.2006.07733 · Cited by 3,846
Deep CORAL: Correlation Alignment for Deep Domain Adaptation
Sun, B., & Saenko, K. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-49409-8_35 · Cited by 3,757
Exploring Simple Siamese Representation Learning
Chen, X., & He, K. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01549 · Cited by 3,725
Supervised Contrastive Learning
Khosla, P., Teterwak, P., Wang, C., Sarna, A., Tian, Y., Isola, P., Maschinot, A., Liu, C., & Krishnan, D. (2020) · arXiv · doi:10.48550/arxiv.2004.11362 · Cited by 3,569
Self-Attention Generative Adversarial Networks
Zhang, H., Goodfellow, I., Metaxas, D., & Odena, A. (2018) · arXiv · doi:10.48550/arxiv.1805.08318 · Cited by 3,353
Deep learning for time series classification: a review
Ismail Fawaz, H., Forestier, G., Weber, J., Idoumghar, L., & Muller, P.-A. (2019) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-019-00619-1 · Cited by 3,342
Zhang, R., Isola, P., & Efros, A. A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46487-9_40 · Cited by 3,178
Andrzejak, R. G., Lehnertz, K., Mormann, F., Rieke, C., David, P., & Elger, C. E. (2001) · Physical Review E · doi:10.1103/physreve.64.061907 · Cited by 3,032
Activity recognition using cell phone accelerometers
Kwapisz, J. R., Weiss, G. M., & Moore, S. A. (2011) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1964897.1964918 · Cited by 2,912
FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidence
Sohn, K., Berthelot, D., Li, C.-L., Zhang, Z., Carlini, N., Cubuk, E. D., Kurakin, A., Zhang, H., & Raffel, C. (2020) · arXiv · doi:10.48550/arxiv.2001.07685 · Cited by 2,892
Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzles
Noroozi, M., & Favaro, P. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46466-4_5 · Cited by 2,775
CyCADA: Cycle-Consistent Adversarial Domain Adaptation
Hoffman, J., Tzeng, E., Park, T., Zhu, J.-Y., Isola, P., Saenko, K., Efros, A. A., & Darrell, T. (2017) · arXiv · doi:10.48550/arxiv.1711.03213 · Cited by 2,656
Model Selection and Multimodel Inference
(2004) · Springer eBooks · doi:10.1007/b97636 · Cited by 2,582
Opportunities and obstacles for deep learning in biology and medicine
Ching, T., Himmelstein, D. S., Beaulieu-Jones, B. K., Kalinin, A. A., Do, B. T., Way, G. P., Ferrero, E., Agapow, P.-M., Zietz, M., Hoffman, M. M., et al. (2018) · Journal of The Royal Society Interface · doi:10.1098/rsif.2017.0387 · Cited by 2,310
Time series classification from scratch with deep neural networks: A strong baseline
Wang, Z., Yan, W., & Oates, T. (2017) · 2017 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2017.7966039 · Cited by 2,299
Deep domain confusion Maximizing for domain invariance
Tzeng, E., Hoffman, J., Zhang, N., Saenko, K., & Darrell, T. (2014) · arXiv · doi:10.48550/arxiv.1412.3474 · Cited by 2,285
Empirical Evaluation of Rectified Activations in Convolutional Network
Xu, B., Wang, N., Chen, T., & Li, M. (2015) · arXiv · doi:10.48550/arxiv.1505.00853 · Cited by 2,264
Return of Frustratingly Easy Domain Adaptation
Sun, B., Feng, J., & Saenko, K. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10306 · Cited by 2,004
(2013) · RECERCAT (Consorci de Serveis Universitaris de Catalunya) · Cited by 1,959
Squeeze-and-Excitation Networks
Hu, J., Shen, L., Albanie, S., Sun, G. Z., & Wu, E. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.01507 · Cited by 1,908
Unsupervised Learning of Video Representations using LSTMs
Srivastava, N., Mansimov, E., & Salakhutdinov, R. (2015) · arXiv · doi:10.48550/arxiv.1502.04681 · Cited by 1,861
Inceptiontime: finding alexnet for time series classification
Ismail Fawaz, H., Lucas, B., Forestier, G., Pelletier, C., Schmidt, D. F., Weber, J., Webb, G. I., Idoumghar, L., Muller, P.-A., & Petitjean, F. (2020) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-020-00710-y · Cited by 1,788
A Continual Learning Survey: Defying Forgetting in Classification Tasks
Delange, M., Aljundi, R., Masana, M., Parisot, S., Jia, X., Leonardis, A., Slabaugh, G., & Tuytelaars, T. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3057446 · Cited by 1,647
Unsupervised Domain Adaptation for Semantic Segmentation via Class-Balanced Self-training
Zou, Y., Yu, Z., Vijaya Kumar, B. V. K., & Wang, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01219-9_18 · Cited by 1,464
Self-Supervised Learning of Pretext-Invariant Representations
Misra, I., & van der Maaten, L. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00674 · Cited by 1,435
Application of machine learning to epileptic seizure onset detection and treatment
Shoeb, A. H. (2009) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 1,426
DeepSleepNet: a model for automatic sleep stage scoring based on raw single-channel EEG
Supratak, A., Dong, H., Wu, C., & Guo, Y. (2017) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2017.2721116 · Cited by 1,376
The Sleep Heart Health Study: Design, Rationale, and Methods
(1997) · Sleep · doi:10.1093/sleep/20.12.1077 · Cited by 1,331
Morgan, M. C. (2025) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.17575540 · Cited by 1,283
Conditional Adversarial Domain Adaptation
Long, M., Cao, Z., Wang, J., & Jordan, M. I. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.10667 · Cited by 1,281
A Transformer-based Framework for Multivariate Time Series Representation Learning
Zerveas, G., Jayaraman, S., Patel, D., Bhamidipaty, A., & Eickhoff, C. (2021) · Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining · doi:10.1145/3447548.3467401 · Cited by 1,278
Lessmeier, C., Kimotho, J. K., Zimmer, D., & Sextro, W. (2016) · PHM Society European Conference · doi:10.36001/phme.2016.v3i1.1577 · Cited by 1,268
Deep Subdomain Adaptation Network for Image Classification
Zhu, Y., Zhuang, F., Wang, J., Ke, G., Chen, J., Bian, J., Xiong, H., & He, Q. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2988928 · Cited by 1,245
A review of unsupervised feature learning and deep learning for time-series modeling
Längkvist, M., Karlsson, L., & Loutfi, A. (2014) · Pattern Recognition Letters · doi:10.1016/j.patrec.2014.01.008 · Cited by 1,243
Liang, J., Hu, D., & Feng, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.08546 · Cited by 1,239
A Survey of Deep Active Learning
Ren, P., Xiao, Y., Chang, X., Huang, P.-Y., Li, Z., Gupta, B. B., Chen, X., & Wang, X. (2022) · ACM Computing Surveys · doi:10.1145/3472291 · Cited by 1,169
Deep State Space Models for Time Series Forecasting
Rangapuram, S. S., Seeger, M., Gasthaus, J. A., Stella, L., Wang, Y., & Januschowski, T. (2018) · neural information processing systems · Cited by 1,097
Generalizing to unseen domains: A survey on domain generalization
Wang, J., Lan, C., Liu, C., Ouyang, Y., Qin, T., Lu, W., Chen, Y., Zeng, W., & Yu, P. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2022.3178128 · Cited by 1,046
A survey of unsupervised deep domain adaptation
Wilson, G., & Cook, D. J. (2020) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3400066 · Cited by 987
SVMs Modeling for Highly Imbalanced Classification
Tang, Y., Zhang, Y.-Q., Chawla, N. V., & Krasser, S. (2009) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2008.2002909 · Cited by 966
Contrastive Adaptation Network for Unsupervised Domain Adaptation
Kang, G., Jiang, L., Yang, Y., & Hauptmann, A. G. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00503 · Cited by 941
Nweke, H. F., Teh, Y. W., Al-garadi, M. A., & Alo, U. R. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.03.056 · Cited by 930
10 CHALLENGING PROBLEMS IN DATA MINING RESEARCH
YANG, Q., & WU, X. (2006) · International Journal of Information Technology & Decision Making · doi:10.1142/s0219622006002258 · Cited by 930
The National Sleep Research Resource: towards a sleep data commons
Zhang, G.-Q., Cui, L., Mueller, R., Tao, S., Kim, M., Rueschman, M., Mariani, S., Mobley, D., & Redline, S. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy064 · Cited by 917
Luyster, F. S., Strollo, P. J., Zee, P. C., & Walsh, J. K. (2012) · Sleep · doi:10.5665/sleep.1846 · Cited by 853
TS2Vec: Towards Universal Representation of Time Series
Yue, Z., Wang, Y., Duan, J., Yang, T., Huang, C., Tong, Y., & Xu, B. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i8.20881 · Cited by 850
Domain Adaptation under Target and Conditional Shift
Zhang, K., Schölkopf, B., Muandet, K., & Wang, Z. (2013) · Max Planck Digital Library · Cited by 753
Time Series Data Augmentation for Deep Learning: A Survey
Wen, Q., Sun, L., Yang, F., Song, X., Gao, J., Wang, X., & Xu, H. (2021) · Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/631 · Cited by 727
Time Series Data Augmentation for Deep Learning: A Survey
Wen, Q., Sun, L., Yang, F., Song, X., Gao, J., Wang, X., & Xu, H. (2020) · arXiv · doi:10.48550/arxiv.2002.12478 · Cited by 727
Stisen, A., Blunck, H., Bhattacharya, S., Prentow, T. S., Kjærgaard, M. B., Dey, A., Sonne, T., & Jensen, M. M. (2015) · Proceedings of the 13th ACM Conference on Embedded Networked Sensor Systems · doi:10.1145/2809695.2809718 · Cited by 714
Time-Series Representation Learning via Temporal and Contextual Contrasting
Eldele, E., Ragab, M., Chen, Z., Wu, M., Kwoh, C. K., Li, X., & Guan, C. (2021) · Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/324 · Cited by 696
An Attention-Based Deep Learning Approach for Sleep Stage Classification With Single-Channel EEG
Eldele, E., Chen, Z., Liu, C., Wu, M., Kwoh, C.-K., Li, X., & Guan, C. (2021) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2021.3076234 · Cited by 693
Transferability vs. Discriminability: Batch Spectral Penalization for Adversarial Domain Adaptation
Chen, X., Wang, S., Long, M., & Wang, J. (2019) · International Conference on Machine Learning · Cited by 691
Time Series Data Analysis and Theory
Wegman, E. J., & Brillinger, D. R. (1976) · Technometrics · doi:10.2307/1267927 · Cited by 689
Learning Deep Transformer Models for Machine Translation
Wang, Q., Li, B., Xiao, T., Zhu, J., Li, C., Wong, D. F., & Chao, L. S. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1176 · Cited by 673
A Decade Survey of Transfer Learning (2010–2020)
Niu, S., Liu, Y., Wang, J., & Song, H. (2020) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2021.3054609 · Cited by 645
Phan, H., Andreotti, F., Cooray, N., Chen, O. Y., & De Vos, M. (2019) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2019.2896659 · Cited by 623
SleepEEGNet: Automated sleep stage scoring with sequence to sequence deep learning approach
Mousavi, S., Afghah, F., & Acharya, U. R. (2019) · PLOS ONE · doi:10.1371/journal.pone.0216456 · Cited by 531
DivideMix: Learning with Noisy Labels as Semi-supervised Learning
Li, J., Socher, R., & Hoi, S. C. H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.07394 · Cited by 500
EA-LSTM: Evolutionary attention-based LSTM for time series prediction
Li, Y., Zhu, Z., Kong, D., Han, H., & Zhao, Y. (2019) · Knowledge-Based Systems · doi:10.1016/j.knosys.2019.05.028 · Cited by 489
Joint Classification and Prediction CNN Framework for Automatic Sleep Stage Classification
Phan, H., Andreotti, F., Cooray, N., Chen, O. Y., & De Vos, M. (2019) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2018.2872652 · Cited by 464
Ba, J. L., Kiros, J., & Hinton, G. E. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1607.06450 · Cited by 440
A convolutional neural network for sleep stage scoring from raw single-channel EEG
Sors, A., Bonnet, S., Mirek, S., Vercueil, L., & Payen, J.-F. (2018) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2017.12.001 · Cited by 424
Non-linear analysis of EEG signals at various sleep stages
Acharya U., R., Faust, O., Kannathal, N., Chua, T., & Laxminarayan, S. (2005) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2005.06.011 · Cited by 413
Sensor-Based Abnormal Human-Activity Detection
Yin, J., Yang, Q., & Pan, J. J. (2008) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2007.1042 · Cited by 391
Zhu, G., Li, Y., & Wen, P. (2014) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2014.2303991 · Cited by 384
Asymmetric Tri-training for Unsupervised Domain Adaptation
Saito, K., Ushiku, Y., & Harada, T. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.08400 · Cited by 383
Michielli, N., Acharya, U. R., & Molinari, F. (2019) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2019.01.013 · Cited by 383
Self-Supervised ECG Representation Learning for Emotion Recognition
Sarkar, P., & Etemad, A. (2022) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2020.3014842 · Cited by 383
Adversarial Domain Adaptation with Domain Mixup
Xu, M., Zhang, J., Ni, B., Li, T., Wang, C., Tian, Q., & Zhang, W. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.6123 · Cited by 381
Exploring Simple Siamese Representation Learning
Chen, X., & He, K. (2020) · arXiv · doi:10.48550/arxiv.2011.10566 · Cited by 381
A DIRT-T Approach to Unsupervised Domain Adaptation
Shu, R., Bui, H., Narui, H., & Ermon, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.08735 · Cited by 377
A Semisupervised Recurrent Convolutional Attention Model for Human Activity Recognition
Chen, K., Yao, L., Zhang, D., Wang, X., Chang, X., & Nie, F. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2927224 · Cited by 368
Very deep convolutional neural networks for raw waveforms
Dai, W., Dai, C., Qu, S., Li, J., & Das, S. (2017) · 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2017.7952190 · Cited by 357
A Review of Single-Source Deep Unsupervised Visual Domain Adaptation
Zhao, S., Yue, X., Zhang, S., Li, B., Zhao, H., Wu, B., Krishna, R., Gonzalez, J. E., Sangiovanni-Vincentelli, A. L., Seshia, S. A., et al. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3028503 · Cited by 352
Multi-task Self-Supervised Learning for Human Activity Detection
Saeed, A., Ozcelebi, T., & Lukkien, J. (2019) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3328932 · Cited by 346
Huang, W., Cheng, J., Yang, Y., & Guo, G. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.05.052 · Cited by 339
A Novel Multi-Class EEG-Based Sleep Stage Classification System
Memar, P., & Faradji, F. (2018) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2017.2776149 · Cited by 318
Learning and Using the Arrow of Time
Wei, D., Lim, J., Zisserman, A., & Freeman, W. T. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00840 · Cited by 315
Qi, G.-J., & Luo, J. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3031898 · Cited by 315
Bai, X., Wang, X., Liu, X., Liu, Q., Song, J., Sebe, N., & Kim, B. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2021.108102 · Cited by 313
Omni-Scale CNNs: a simple and effective kernel size configuration for time series classificationPreprint
Tang, W., Long, G., Liu, L., Zhou, T., Blumenstein, M., & Jiang, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.10061 · Cited by 280
Adversarial Feature Augmentation for Unsupervised Domain Adaptation
Volpi, R., Morerio, P., Savarese, S., & Murino, V. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00576 · Cited by 277
Hassan, A. R., & Bhuiyan, M. I. H. (2016) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2015.09.002 · Cited by 273
A hybrid classification autoencoder for semi-supervised fault diagnosis in rotating machinery
Wu, X., Zhang, Y., Cheng, C., & Peng, Z. (2021) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2020.107327 · Cited by 266
DSANet: Dual Self-Attention Network for Multivariate Time Series Forecasting
Huang, S., Wang, D., Wu, X., & Tang, A. (2019) · Proceedings of the 28th ACM International Conference on Information and Knowledge Management · doi:10.1145/3357384.3358132 · Cited by 250
Automatic Sleep Stage Scoring with Single-Channel EEG Using Convolutional Neural Networks
Tsinalis, O., Matthews, P. M., Guo, Y., & Zafeiriou, S. P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.01683 · Cited by 249
Self-Ensembling With GAN-Based Data Augmentation for Domain Adaptation in Semantic Segmentation
Choi, J., Kim, T., & Kim, C. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00693 · Cited by 248
Uncovering the structure of clinical EEG signals with self-supervised learning
Banville, H., Chehab, O., Hyvärinen, A., Engemann, D.-A., & Gramfort, A. (2021) · Journal of Neural Engineering · doi:10.1088/1741-2552/abca18 · Cited by 245
Model Selection and Multimodel Inference
Korner-Nievergelt, F., Roth, T., von Felten, S., Guélat, J., Almasi, B., & Korner-Nievergelt, P. (2015) · Bayesian Data Analysis in Ecology Using Linear Models with R, BUGS, and STAN · doi:10.1016/b978-0-12-801370-0.00011-3 · Cited by 232
FixBi: Bridging Domain Spaces for Unsupervised Domain Adaptation
Na, J., Jung, H., Chang, H. J., & Hwang, W. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00115 · Cited by 229
HoMM: Higher-Order Moment Matching for Unsupervised Domain Adaptation
Chen, C., Fu, Z., Chen, Z., Jin, S., Cheng, Z., Jin, X., & Hua, X.-S. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.5745 · Cited by 214
Self-Supervised Contrastive Pre-Training for Time Series Via Time-Frequency Consistency
Zhang, X., Zhao, Z., Tsiligkaridis, T., & Žitnik, M. (2022) · neural information processing systems · doi:10.52202/068431-0288 · Cited by 203
An optimal frequency domain filter for edge detection in digital pictures
(1979) · NCHU Institutional Repository CRIS · doi:10.1109/tpami · Cited by 198
Exploiting Unlabeled Data in CNNs by Self-Supervised Learning to Rank
Liu, X., Weijer, J. V. D., & Bagdanov, A. D. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2899857 · Cited by 192
Unsupervised representation learning for time series with temporal neighborhood coding
Tonekaboni, S., Eytan, D., & Goldenberg, A. (2021) · arXiv · doi:10.48550/arxiv.2106.00750 · Cited by 170
Yu, W., Kim, I. Y., & Mechefske, C. (2021) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2020.107322 · Cited by 158
A Survey on Contrastive Self-Supervised Learning
Jaiswal, A., Babu, A. R., Zadeh, M. Z., Banerjee, D., & Makedon, F. (2020) · Technologies · doi:10.3390/technologies9010002 · Cited by 154
Automatic Human Sleep Stage Scoring Using Deep Neural Networks
Malafeev, A., Laptev, D., Bauer, S., Omlin, X., Wierzbicka, A., Wichniak, A., Jernajczyk, W., Riener, R., Buhmann, J., & Achermann, P. (2018) · Frontiers in Neuroscience · doi:10.3389/fnins.2018.00781 · Cited by 151
(2020) · Cited by 147
Adversarial Spectral Kernel Matching for Unsupervised Time Series Domain Adaptation
Liu, Q., & Xue, H. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/378 · Cited by 145
Multi-Source Deep Domain Adaptation with Weak Supervision for Time-Series Sensor Data
Wilson, G., Doppa, J. R., & Cook, D. J. (2020) · Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3394486.3403228 · Cited by 141
Convolution- and Attention-Based Neural Network for Automated Sleep Stage Classification
Zhu, T., Luo, W., & Yu, F. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17114152 · Cited by 137
Exploiting Domain-Specific Features to Enhance Domain GeneralizationPreprint
Bui, M.-H., Tran, T. B., Tran, A. T., & Phung, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.09410 · Cited by 136
Contrastive learning based self-supervised time-series analysis
Pöppelbaum, J., Chadha, G. S., & Schwung, A. (2022) · Applied Soft Computing · doi:10.1016/j.asoc.2021.108397 · Cited by 131
Self-Supervised Transformer for Sparse and Irregularly Sampled Multivariate Clinical Time-Series
Tipirneni, S., & Reddy, C. K. (2022) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3516367 · Cited by 130
HyCLASSS: A Hybrid Classifier for Automatic Sleep Stage Scoring
Li, X., Cui, L., Tao, S., Chen, J., Zhang, X., & Zhang, G. (2017) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2017.2668993 · Cited by 129
Time series feature learning with labeled and unlabeled data
Wang, H., Zhang, Q., Wu, J., Pan, S., & Chen, Y. (2019) · Pattern Recognition · doi:10.1016/j.patcog.2018.12.026 · Cited by 128
Deep Learning for Automated Feature Discovery and Classification of Sleep Stages
Sokolovsky, M., Guerrero, F., Paisarnsrisomsuk, S., Ruiz, C., & Álvarez, S. A. (2019) · IEEE Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2019.2912955 · Cited by 128
A Prototype-Oriented Framework for Unsupervised Domain AdaptationPreprint
Tanwisuth, K., Fan, X., Zheng, H., Zhang, S., Zhang, H., Chen, B., & Zhou, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.12024 · Cited by 125
ADATIME: A Benchmarking Suite for Domain Adaptation on Time Series Data
Ragab, M., Eldele, E., Tan, W. L., Foo, C.-S., Chen, Z., Wu, M., Kwoh, C. K., & Li, X. (2023) · CRC Press eBooks · doi:10.1145/3587937 · Cited by 124
Manifold Criterion Guided Transfer Learning via Intermediate Domain Generation
Zhang, L., Wang, S., Huang, G.-B., Zuo, W., Yang, J. J., & Zhang, D. D. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2899037 · Cited by 122
On the vanishing and exploding gradient problem in Gated Recurrent Units
Rehmer, A., & Kroll, A. (2020) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2020.12.1342 · Cited by 122
Mixing up contrastive learning: Self-supervised representation learning for time series
Wickstrøm, K., Kampffmeyer, M., Mikalsen, K. Ø., & Jenssen, R. (2022) · Pattern Recognition Letters · doi:10.1016/j.patrec.2022.02.007 · Cited by 113
Seifpour, S., Niknazar, H., Mikaeili, M., & Nasrabadi, A. M. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.03.020 · Cited by 113
SelfMatch: Robust semisupervised time‐series classification with self‐distillation
Xing, H., Xiao, Z., Zhan, D., Luo, S., Dai, P., & Li, K. (2022) · International Journal of Intelligent Systems · doi:10.1002/int.22957 · Cited by 113
Self-Supervised Autoregressive Domain Adaptation for Time Series Data
Ragab, M., Eldele, E., Chen, Z., Wu, M., Kwoh, C. K., & Li, X. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3183252 · Cited by 111
Khan, M., Wang, H., Riaz, A., El-Fatyany, A., & Karim, S. (2021) · The Journal of Supercomputing · doi:10.1007/s11227-020-03560-z · Cited by 109
On Minimum Discrepancy Estimation for Deep Domain Adaptation
Rahman, M. M., Fookes, C., Baktashmotlagh, M., & Sridharan, S. (2020) · Springer eBooks · doi:10.1007/978-3-030-30671-7_6 · Cited by 105
Gharehbaghi, A., & Lindén, M. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2754294 · Cited by 101
Attention-based sequence to sequence model for machine remaining useful life prediction
Ragab, M., Chen, Z., Wu, M., Kwoh, C. K., Yan, R., & Li, X. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.09.022 · Cited by 101
Unsupervised Time-Series Representation Learning with Iterative Bilinear Temporal-Spectral FusionPreprint
Yang, L. Q., & Hong, S. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2202.04770 · Cited by 99
Dimitriadis, S. I., Salis, C. I., & Linden, D. E. J. (2018) · Clinical Neurophysiology · doi:10.1016/j.clinph.2017.12.039 · Cited by 98
A semi-supervised GAN method for RUL prediction using failure and suspension histories
He, R., Tian, Z., & Zuo, M. J. (2021) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2021.108657 · Cited by 91
Adversarial Multiple-Target Domain Adaptation for Fault Classification
Ragab, M., Chen, Z., Wu, M., Li, H., Kwoh, C.-K., Yan, R., & Li, X. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2020.3009341 · Cited by 90
Transfer Learning for Human Activity Recognition Using Representational Analysis of Neural Networks
An, S., Bhat, G., Gümüşsoy, S., & Ogras, U. Y. (2023) · ACM Transactions on Computing for Healthcare · doi:10.1145/3563948 · Cited by 87
Time Series Domain Adaptation via Sparse Associative Structure Alignment
Cai, R., Chen, J., Li, Z., Chen, W., Zhang, K., Ye, J., Li, Z., Yang, X., & Zhang, Z. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i8.16846 · Cited by 86
Sun, Y., Wang, B., Jin, J., & Wang, X. (2018) · International Congress on Image and Signal Processing (CISP) · doi:10.1109/cisp-bmei.2018.8633058 · Cited by 81
Self-supervised Learning for Semi-supervised Time Series Classification
Jawed, S., Grabocka, J., & Schmidt-Thieme, L. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-47426-3_39 · Cited by 81
PARSE: Pairwise Alignment of Representations in Semi-Supervised EEG Learning for Emotion Recognition
Zhang, G., Davoodnia, V., & Etemad, A. (2022) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2022.3210441 · Cited by 80
Generalizing to Unseen Domains: A Survey on Domain GeneralizationPreprint
Wang, J., Lan, C., Liu, C., Ouyang, Y., Qin, T., Lu, W., Chen, Y., Zeng, W., & Yu, P. S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.03097 · Cited by 80
Consensus Adversarial Domain Adaptation
Zou, H., Zhou, Y., Yang, J., Liu, H., Das, H. P., & Spanos, C. J. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33015997 · Cited by 75
A deep learning approach for real-time detection of sleep spindles
Kulkarni, P. M., Xiao, Z., Robinson, E. J., Jami, A. S., Zhang, J., Zhou, H., Henin, S. E., Liu, A. A., Osorio, R. S., Wang, J., et al. (2019) · Journal of Neural Engineering · doi:10.1088/1741-2552/ab0933 · Cited by 75
ADAST: Attentive Cross-Domain EEG-Based Sleep Staging Framework With Iterative Self-Training
Eldele, E., Ragab, M., Chen, Z., Wu, M., Kwoh, C. K., Li, X., & Guan, C. (2022) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2022.3189695 · Cited by 75
Cardiorespiratory Sleep Stage Detection Using Conditional Random Fields
Fonseca, P., den Teuling, N., Long, X., & Aarts, R. M. (2017) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2016.2550104 · Cited by 74
Deep Transfer Learning for Time Series Data Based on Sensor Modality Classification
Li, F., Shirahama, K., Nisar, M. A., Huang, X., & Grzegorzek, M. (2020) · Sensors · doi:10.3390/s20154271 · Cited by 74
Semi-Supervised Time Series Classification by Temporal Relation Prediction
Fan, H., Zhang, F., Wang, R., Huang, X., & Li, Z. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9413883 · Cited by 74
Liu, X., Shi, R., Hui, Q., Xu, S., Wang, S., Na, R., Sun, Y. Z., Ding, W., Zheng, D., & Chen, X. (2022) · Information Processing & Management · doi:10.1016/j.ipm.2022.103001 · Cited by 74
Contrast and Mix: Temporal Contrastive Video Domain Adaptation with Background MixingPreprint
Sahoo, A., Shah, R., Panda, R., Saenko, K., & Das, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.15128 · Cited by 73
Towards Accurate Model Selection in Deep Unsupervised Domain AdaptationPreprint
You, K., Wang, X., Long, M., & Jordan, M. I. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.04665 · Cited by 72
Chapter 3 An overview of polysomnography
Keenan, S. A. (2005) · Handbook of clinical neurophysiology · doi:10.1016/s1567-4231(09)70028-0 · Cited by 71
Support and Invertibility in Domain-Invariant Representations
Johansson, F. D., Sontag, D., & Ranganath, R. (2019) · arXiv · doi:10.48550/arxiv.1903.03448 · Cited by 70
Stisen, A., Blunck, H., Bhattacharya, S., Prentow, T. S., Kjærgaard, M. B., Dey, A. K., Sonne, T., & Jensen, M. M. (2015) · Cited by 70
End-to-end sleep staging using convolutional neural network in raw single-channel EEG
Li, F., Yan, R., Mahini, R., Wei, L., Wang, Z., Mathiak, K., Liu, R., & Cong, F. (2020) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2020.102203 · Cited by 69
Label-Efficient Time Series Representation Learning: A Review
Eldele, E., Ragab, M., Chen, Z., Wu, M., Kwoh, C. K., & Li, X. (2024) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2024.3430236 · Cited by 69
Tank, J., Diedrich, A., Hale, N., Niaz, F. E., Furlan, R., Robertson, R. M., & Mosqueda-Garcia, R. (2003) · American Journal of Physiology-Regulatory, Integrative and Comparative Physiology · doi:10.1152/ajpregu.00013.2003 · Cited by 68
An Attention Based CNN-LSTM Approach for Sleep-Wake Detection With Heterogeneous Sensors
Chen, Z., Wu, M., Cui, W., Liu, C., & Li, X. (2020) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2020.3006145 · Cited by 66
You, S., Cho, B. H., Shon, Y., Seo, D., & Kim, I. Y. (2021) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2021.106542 · Cited by 65
Lifelong learning with non-i.i.d. tasks
Pentina, A., & Lampert, C. H. (2015) · Cited by 64
Reg-Gan: Semi-Supervised Learning Based on Generative Adversarial Networks for Regression
Rezagholiradeh, M., & Haidar, M. A. (2018) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2018.8462534 · Cited by 62
Contrastive Domain Adaptation for Time-Series Via Temporal Mixup
Eldele, E., Ragab, M., Chen, Z., Wu, M., Kwoh, C., & Li, X.-L. (2022) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2023.3293473 · Cited by 62
Ye, J., Xiao, Q., Wang, J., Zhang, H., Deng, J., & Lin, Y. (2022) · IEEE Signal Processing Letters · doi:10.1109/lsp.2021.3130826 · Cited by 61
Chambon, S., Galtier, M. N., Arnal, P. J., Wainrib, G., & Gramfort, A. (2018) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2018.2813138 · Cited by 59
Domain Adaptation for Time-Series Classification to Mitigate Covariate Shift
Ott, F., Rügamer, D., Heublein, L., Bischl, B., & Mutschler, C. (2022) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3503161.3548167 · Cited by 55
SUCCESS: A New Approach for Semi-supervised Classification of Time-Series
Marussy, K., & Búza, K. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-38658-9_39 · Cited by 53
Self-adaptive Re-weighted Adversarial Domain Adaptation
Wang, S., & Zhang, L. (2020) · Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/440 · Cited by 53
Hsu, E.-Y., Liu, C., & Tseng, V. S. M. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-16142-2_42 · Cited by 49
A Semi-Automatic Annotation Approach for Human Activity Recognition
Bota, P. J., da Silva, J. K. A., Folgado, D., & Gamboa, H. F. S. (2019) · Sensors · doi:10.3390/s19030501 · Cited by 48
Dual Alignment for Partial Domain Adaptation
Li, L., Wan, Z., & He, H. (2020) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2020.2983337 · Cited by 48
Semi-Supervised Contrastive Learning for Generalizable Motor Imagery EEG Classification
Han, J., Gu, X., & Lo, B. P. L. (2021) · Wearable and Implantable Body Sensor Networks · doi:10.1109/bsn51625.2021.9507038 · Cited by 48
Attentive Adversarial Network for Large-Scale Sleep Staging.
Nasiri, S., & Clifford, G. D. (2020) · Machine Learning for Healthcare Conference · Cited by 47
Domain Adaptation for Time Series Forecasting via Attention SharingPreprint
Jin, X., Park, Y., Maddix, D. C., Wang, H., & Wang, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.06828 · Cited by 44
Transferring Structured Knowledge in Unsupervised Domain Adaptation of a Sleep Staging Network
Yoo, C., Lee, H. W., & Kang, J. (2021) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2021.3103614 · Cited by 44
Liu, D., Wang, T., Liu, S., Wang, R., Yao, S., & Abdelzaher, T. (2021) · 2021 International Conference on Computer Communications and Networks (ICCCN) · doi:10.1109/icccn52240.2021.9522151 · Cited by 44
Sanabria, A. R., Zambonelli, F., Dobson, S., & Ye, J. (2021) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2021.101477 · Cited by 43
Attention-based LSTM-CNNs For Time-series Classification
Du, Q., Gu, W., Zhang, L., & Huang, S. (2018) · ACM Conference on Embedded Networked Sensor Systems (SenSys) · doi:10.1145/3274783.3275208 · Cited by 43
Learning Saliency Maps to Explain Deep Time Series Classifiers
Parvatharaju, P. S., Doddaiah, R., Hartvigsen, T., & Rundensteiner, E. A. (2021) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3459637.3482446 · Cited by 43
Efficient Attention using a Fixed-Size Memory Representation
Britz, D., Guan, M. Y., & Luong, M.-T. (2017) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d17-1040 · Cited by 41
Pair-based Uncertainty and Diversity Promoting Early Active Learning for Person Re-identification
Liu, W., Chang, X., Chen, L., Phung, D., Zhang, X., Yang, Y., & Hauptmann, A. G. (2020) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3372121 · Cited by 41
MtCLSS: Multi-Task Contrastive Learning for Semi-Supervised Pediatric Sleep Staging
Li, Y., Luo, S., Zhang, H., Zhang, Y., Zhang, Y., & Lo, B. P. L. (2022) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2022.3213171 · Cited by 37
Unsupervised sleep staging system based on domain adaptation
Zhao, R., Xia, Y., & Zhang, Y. (2021) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2021.102937 · Cited by 36
Sense and Learn: Self-supervision for omnipresent sensors
Saeed, A., Ungureanu, V., & Gfeller, B. (2021) · Machine Learning with Applications · doi:10.1016/j.mlwa.2021.100152 · Cited by 34
Sense and Learn: Self-Supervision for Omnipresent Sensors
Saeed, A., Ungureanu, V., & Gfeller, B. (2020) · arXiv · doi:10.48550/arxiv.2009.13233 · Cited by 34
Multivariate Time Series Classification Using Spiking Neural Networks
Fang, H., Shrestha, A., & Qiu, Q. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9206751 · Cited by 32
SMATE: Semi-Supervised Spatio-Temporal Representation Learning on Multivariate Time Series
Zuo, J., Zeitouni, K., & Taher, Y. (2021) · Proceedings · doi:10.1109/icdm51629.2021.00206 · Cited by 31
Evaluating Subjective Accuracy in Time Series Pattern-Matching Using Human-Annotated Rankings
Eichmann, P., & Zgraggen, E. (2015) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/2678025.2701379 · Cited by 28
The Analysis of Time Series: Theory and Practice
Loynes, R. M., & Chatfield, C. (1977) · International Statistical Review · doi:10.2307/1403012 · Cited by 27
Rodríguez‐Labrada, R., Galicia-Polo, L., Canales‐Ochoa, N., Voss, U., Tuin, I., Peña-Acosta, A., Estupiñán‐Rodríguez, A., Medrano‐Montero, J., Vázquez‐Mojena, Y., González-Zaldívar, Y., et al. (2019) · Sleep Medicine · doi:10.1016/j.sleep.2019.04.005 · Cited by 24
Chen, Z., Wu, M., Gao, K., Wu, J., Ding, J., Zeng, Z., & Li, X. (2020) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2020.2996943 · Cited by 23
Local Minimax Complexity of Stochastic Convex OptimizationPreprint
Zhu, Y., Chatterjee, S., Duchi, J. C., & Lafferty, J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.07596 · Cited by 18
Research works printed but not linked: 24
- Ary L. Goldberger, Luis A. N. Amaral, Leon Glass, Jeffrey M. Hausdorff, Plamen Ch. Ivanov, Roger G. Mark, Joseph E. Mietus, George B. Moody, Chung-Kang Peng, and H. Eugene Stanley. Physiobank, physiotoolkit, and physionet components of a new research resource for complex physiologic signals. Circulation, 101(23):215-220, 2000. xxi, 47, 48
- Bendong Zhao, Huanzhang Lu, Shangfeng Chen, Junliang Liu, and Dongya Wu. Convolutional neural networks for time series classification. Journal of Systems Engineering and Electronics, 28(1):162-169, 2017. doi: 10.21629/ JSEE.2017.01.18. 4 · doi:10.21629/jsee.2017.01.18.4
- Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. Deep residual learning for image recognition. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 770-778, 2016. doi: 10.1109/CVPR. 2016.90. 12 · doi:10.1109/cvpr.2016.90.12
- Chien-Liang Liu, Wen-Hoar Hsaio, and Yao-Chung Tu. Time series classi- fication with multivariate convolutional neural network. IEEE Transactions on Industrial Electronics, 66(6):4788-4797, 2019. doi: 10.1109/TIE.2018. 2864702. 13 · doi:10.1109/tie.2018.2864702.13
- Curran Associates, Inc., 2018. URL https://proceedings.neurips.cc/paper/2018/file/ 5cf68969fb67aa6082363a6d4e6468e2-Paper.pdf. 14
- Curran Associates, Inc., 2017. URL https://proceedings.neurips.cc/paper/2017/file/ 3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf. 14, 44, 65, 141
- Richard Zhang, Phillip Isola, and Alexei A. Efros. Colorful image coloriza- tion. In Bastian Leibe, Jiri Matas, Nicu Sebe, and Max Welling, editors, Computer Vision -ECCV 2016, pages 649-666, Cham, 2016. Springer In- ternational Publishing. ISBN 978-3-319-46487-9. 19
- Jean-Bastien Grill, Florian Strub, Florent Altché, Corentin Tallec, Pierre H. Richemond, Elena Buchatskaya, Carl Doersch, Bernardo Avila Pires, Zhaohan Daniel Guo, Mohammad Gheshlaghi Azar, Bilal Piot, Koray Kavukcuoglu, Rémi Munos, and Michal Valko. Bootstrap your own latent a new approach to self-supervised learning. In Proceedings of the 34th Interna- tional Conference on Neural Information Processing Systems, NIPS'20, Red Hook, NY, USA, 2020.
- Aaqib Saeed, Tanir Ozcelebi, and Johan Lukkien. Multi-task self-supervised learning for human activity detection. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., 3(2), jun 2019. doi: 10.1145/3328932. URL https: //doi.org/10.1145/3328932. 20 · DOI · Paper page
- Xue Jiang, Jianhui Zhao, Bo Du, and Zhiyong Yuan. Self-supervised con- trastive learning for eeg-based sleep staging. In 2021 International Joint Conference on Neural Networks (IJCNN), pages 1-8, 2021. doi: 10.1109/ IJCNN52387.2021.9533305. 21, 33 · doi:10.1109/ijcnn52387.2021.9533305.21
- Curran Associates, Inc., 2020. URL https://proceedings.neurips.cc/paper/2020/file/ 06964dce9addb1c5cb5d6e3d9838f733-Paper.pdf. 23, 88
- Xuxin Liu, Fengbin Zhang, Han Liu, and Haoyi Fan. itimes: Investigating semi-supervised time series classification via irregular time sampling. IEEE Transactions on Industrial Informatics, pages 1-9, 2022. doi: 10.1109/TII. 2022.3199374. 24 · doi:10.1109/tii.2022.3199374.24
- Qingchang Zhu, Zhenghua Chen, and Yeng Chai Soh. A novel semisupervised deep learning method for human activity recognition. IEEE Transactions on Industrial Informatics, 15(7):3821-3830, 2019. doi: 10.1109/TII.2018. 2889315. 25 · doi:10.1109/tii.2018.2889315.25
- Curran As- sociates, Inc., 2014. URL https://proceedings.neurips.cc/paper/2014/ file/375c71349b295fbe2dcdca9206f20a06-Paper.pdf. 26
- Arthur Gretton, Karsten M. Borgwardt, Malte J. Rasch, Bernhard Schölkopf, and Alexander Smola. A kernel two-sample test. Journal of Machine Learning Research, 13(1):723-773, 2012. 27
- Mingsheng Long, Zhangjie Cao, Jianmin Wang, and Michael I. Jordan. Con- ditional adversarial domain adaptation. In Advances in Neural Information Processing Systems, volume 31, pages 1640-1650, 2018. 29, 108, 109, 125
- Emadeldeen Eldele, Mohamed Ragab, Zhenghua Chen, Min Wu, Chee Keong Kwoh, and Xiaoli Li. Self-supervised learning for label-efficient sleep stage classification: A comprehensive evaluation. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 31:1333-1342, 2023. doi: 10.1109/ TNSRE.2023.3245285. 37, 61 · doi:10.1109/tnsre.2023.3245285.37
- Mostafa Neo Mohsenvand, Mohammad Rasool Izadi, and Pattie Maes. Con- trastive representation learning for electroencephalogram classification. In Proceedings of the Machine Learning for Health NeurIPS Workshop, volume 136 of Proceedings of Machine Learning Research, pages 238-253, 2020. URL https://proceedings.mlr.press/v136/mohsenvand20a.html. 63
- Alejandro Newell and Jia Deng. How useful is self-supervised pretraining for visual tasks? In 2020 IEEE/CVF Conference on Computer Vision and Pat- tern Recognition (CVPR), pages 7343-7352, 2020. doi: 10.1109/CVPR42600. 2020.00737. 78 · doi:10.1109/cvpr42600.2020.00737.78
- Emadeldeen Eldele, Mohamed Ragab, Zhenghua Chen, Min Wu, Chee-Keong Kwoh, Xiaoli Li, and Cuntai Guan. Self-supervised contrastive representation learning for semi-supervised time-series classification. IEEE Transactions on Pattern Analysis and Machine Intelligence, pages 1-15, 2023. doi: 10.1109/ TPAMI.2023.3308189. 81 · doi:10.1109/tpami.2023.3308189.81
- Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde- Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. Generative ad- versarial nets. In Advances in Neural Information Processing Systems 27, pages 2672-2680, 2014. 101, 102
- Prannay Khosla, Piotr Teterwak, Chen Wang, Aaron Sarna, Yonglong Tian, Phillip Isola, Aaron Maschinot, Ce Liu, and Dilip Krishnan. Supervised contrastive learning. In NeurIPS, 2020. 121
- Curran Asso- ciates, Inc., 2021. URL https://proceedings.neurips.cc/paper/2021/ file/8edd72158ccd2a879f79cb2538568fdc-Paper.pdf. 137
- Tsung-Yu Hsieh, Suhang Wang, Yiwei Sun, and Vasant Honavar. Explainable multivariate time series classification: A deep neural network which learns to attend to important variables as well as time intervals. In Proceedings of the 14th ACM International Conference on Web Search and Data Mining, WSDM '21, page 607-615, 2021. ISBN 9781450382977. 141
Cited by
Self-Supervised Learning for Time Series Analysis: Taxonomy, Progress, and Prospects
Zhang, K., Wen, Q., Zhang, C., Cai, R., Jin, M., Liu, Y., Zhang, J. Y., Liang, Y., Pang, G., Song, D., et al. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3387317 · Cited by 295
Metadata
- Authors
- Emadeldeen, A. I. A. E.
- Publisher
- Nanyang Technological University
- Published
- 2023-01-01
- OpenAlex
- W4387309943
- Cited by
- 1
- References
- 206
- Citations by year
- 2024: 1
- Type
- dissertation
- Language
- en
- Open access
- gold
- dx.doi.org
- Licence
- cc-by-nc
- Locations
- DR-NTU (Nanyang Technological University) (submittedVersion, cc-by-nc)
- Topics
- Physical Sciences › Computer Science › Signal Processing › Time Series Analysis and Forecasting
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Keywords
- time series representation learning, attention-based deep learning, multi-head attention, class imbalance, self-supervised learning, semi-supervised learning, limited labeled data, pseudo-labeling, contrastive learning, domain adaptation, adversarial domain adaptation, temporal prediction, temporal relations, few-shot learning, out-of-distribution generalization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.