The DOI matches its Crossref record; 38 of the 39 references it cites were found in a registry or an index.
Temporal Contrastive Learning for Sensor-Based Human Activity Recognition: A Self-Supervised Approach
Open accessAbstract
Deep learning techniques can make use of a large amount of time-series data from wearable devices and greatly benefit the development of sensor-based human activity recognition (HAR). However, representation learning in a supervised manner requires massive labeled sensory data that are time-consuming to obtain and hindered by privacy concerns. To address these issues, we utilize the plentiful unlabeled sensory data and propose a novel self-supervised learning framework, namely temporal contrastive learning in HAR (TCLHAR), which learns the meaningful feature representations for time-series data without labels. Our TCLHAR framework utilizes the temporal co-occurrence relationship among time windows as the supervisory signals to construct positive pairs in the encoder pretraining stage. The encoder is designed for cross-modality fusion, which leverages the local interactions of each sensor modality and the global fusion of features from different sensors. The proposed framework is extensively evaluated on public HAR datasets in supervised, self-supervised, and semi-supervised settings. Our method outperforms several self-supervised learning benchmark models, achieving comparable results with fully labeled data training. When labeled data are scarce, our method can boost the${F}1$score by up to 65% over traditional supervised training, which demonstrates the effectiveness of our feature representations.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533 · cited 2×
“Recently, self-supervised learning, a branch of the unsupervised learning technique, has raised a lot of interest and shown great success in multiple fields such as CV [24], [25], [26] and NLP [27], [28], [29].”
Momentum Contrast for Unsupervised Visual Representation Learning
He, K., Fan, H., Wu, Y., Xie, S., & Girshick, R. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00975 · Cited by 13,347
Representation Learning with Contrastive Predictive Coding
Oord, A. V. D., Li, Y., & Vinyals, O. (2018) · arXiv · doi:10.48550/arxiv.1807.03748 · Cited by 6,242 · cited 3×
“We select InfoNCE loss [31] as our objective function in the pretraining stage, which has shown success in other self-supervised learning frameworks [5], [6].”
Context Encoders: Feature Learning by Inpainting
Pathak, D., Krahenbuhl, P., Donahue, J., Darrell, T., & Efros, A. A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.278 · Cited by 5,691
Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition
Ordóñez, F., & Roggen, D. (2016) · Sensors · doi:10.3390/s16010115 · Cited by 2,761 · cited 3×
“Supervised learning models for HAR have been widely developed and achieve promising performance [1], [3], [20], [21].”
Unsupervised Visual Representation Learning by Context Prediction
Doersch, C., Gupta, A., & Efros, A. A. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.167 · Cited by 2,629
Unsupervised Representation Learning by Predicting Image Rotations
Gidaris, S., Singh, P., & Komodakis, N. (2018) · arXiv · doi:10.48550/arxiv.1803.07728 · Cited by 2,477 · cited 2×
“Recently, self-supervised learning, a branch of the unsupervised learning technique, has raised a lot of interest and shown great success in multiple fields such as CV [24], [25], [26] and NLP [27], [28], [29].”
Tian, Y., Krishnan, D., & Isola, P. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58621-8_45 · Cited by 1,997
(2013) · RECERCAT (Consorci de Serveis Universitaris de Catalunya) · Cited by 1,959
What makes for good views for contrastive learning
Tian, Y., Sun, C., Poole, B., Krishnan, D., Schmid, C., & Isola, P. (2020) · arXiv · doi:10.48550/arxiv.2005.10243 · Cited by 773
DeepSense: A Unified Deep Learning Framework for Time-Series Mobile Sensing Data Processing
Yao, S., Hu, S., Zhao, Y., Zhang, A., & Abdelzaher, T. (2017) · Proceedings of the 26th International Conference on World Wide Web · doi:10.1145/3038912.3052577 · Cited by 667 · cited 3×
“Supervised learning models for HAR have been widely developed and achieve promising performance [1], [3], [20], [21].”
USC-HAD: a daily activity dataset for ubiquitous activity recognition using wearable sensors
Zhang, M., & Sawchuk, A. A. (2012) · Proceedings of the 2012 ACM Conference on Ubiquitous Computing · doi:10.1145/2370216.2370438 · Cited by 554
Ensembles of Deep LSTM Learners for Activity Recognition using Wearables
Guan, Y., & Plötz, T. (2017) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3090076 · Cited by 511 · cited 1×
“With the rapid development of deep learning techniques, many supervised deep learning models have been successfully applied to HAR [1], [2], [3].”
Dataset Augmentation in Feature SpacePreprint
DeVries, T., & Taylor, G. W. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.05538 · Cited by 461
Multi-Scale Convolutional Neural Networks for Time Series Classification
Cui, Z., Chen, W., & Chen, Y. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.06995 · Cited by 455
Spatiotemporal Contrastive Video Representation Learning
Qian, R., Meng, T., Gong, B., Yang, M.-H., Wang, H., Belongie, S., & Cui, Y. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00689 · Cited by 443
Self-citationMulti-task Self-Supervised Learning for Human Activity Detection
Saeed, A., Ozcelebi, T., & Lukkien, J. (2019) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3328932 · Cited by 346
Feature Learning for Activity Recognition in Ubiquitous Computing
Plötz, T., Hammerla, N., & Olivier, P. (2011) · Newcastle University · doi:10.25405/ncl.34175319 · Cited by 337
Activity recognition from acceleration data based on discrete consine transform and SVM
He, Z., & Jin, L. (2009) · 2009 IEEE International Conference on Systems, Man and Cybernetics · doi:10.1109/icsmc.2009.5346042 · Cited by 266
RobustTAD: Robust Time Series Anomaly Detection via Decomposition and Convolutional Neural NetworksPreprint
Gao, J., Song, X., Wen, Q., Wang, P., Sun, L., & Xu, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.09545 · Cited by 187
Contrastive Predictive Coding for Human Activity Recognition
Haresamudram, H., Essa, I., & Plötz, T. (2021) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3463506 · Cited by 150 · cited 5×
“Comparing supervised TCLHAR with TCLHAR and supervised CSSHAR with CSSHAR, we can see that self-supervised models always perform worse than the supervised learning models, which can also be seen in existing studies [8], [9], [10].”
InfluentialMasked reconstruction based self-supervision for human activity recognition
Haresamudram, H., Beedu, A., Agrawal, V., Grady, P. L., Essa, I., Hoffman, J., & Plötz, T. (2020) · Proceedings of the 2020 International Symposium on Wearable Computers · doi:10.1145/3410531.3414306 · Cited by 146
Contrastive Self-supervised Learning for Sensor-based Human Activity Recognition
Khaertdinov, B., Ghaleb, E., & Asteriadis, S. (2021) · 2021 IEEE International Joint Conference on Biometrics (IJCB) · doi:10.1109/ijcb52358.2021.9484410 · Cited by 95 · cited 10×
“Comparing supervised TCLHAR with TCLHAR and supervised CSSHAR with CSSHAR, we can see that self-supervised models always perform worse than the supervised learning models, which can also be seen in existing studies [8], [9], [10].”
InfluentialCosmo: contrastive fusion learning with small data for multimodal human activity recognition
Ouyang, X., Shuai, X., Zhou, J., Shi, I. W., Xie, Z., Xing, G., & Huang, J. (2022) · Proceedings of the 28th Annual International Conference on Mobile Computing And Networking · doi:10.1145/3495243.3560519 · Cited by 94
Human Daily Activity and Fall Recognition Using a Smartphone’s Acceleration Sensor
Chatzaki, C., Pediaditis, M., Vavoulas, G., & Tsiknakis, M. (2017) · Communications in Computer and Information Science · doi:10.1007/978-3-319-62704-5_7 · Cited by 91 · cited 3×
“3) We conduct extensive experiments on three public HAR datasets, including MobiAct [16], UCI-HAR [17], and USC-HAD [18], to compare our framework with several self-supervised learning benchmarks models on HAR.”
On the role of features in human activity recognition
Haresamudram, H., Anderson, D. V., & Plötz, T. (2019) · Proceedings of the 23rd International Symposium on Wearable Computers · doi:10.1145/3341163.3347727 · Cited by 90
Sensor Data Augmentation by Resampling in Contrastive Learning for Human Activity Recognition
Wang, J., Zhu, T., Gan, J., Chen, L., Ning, H., & Wan, Y. (2022) · IEEE Sensors Journal · doi:10.1109/jsen.2022.3214198 · Cited by 83
Negative Selection by Clustering for Contrastive Learning in Human Activity Recognition
Wang, J., Zhu, T., Chen, L. L., Ning, H., & Wan, Y. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3239945 · Cited by 52
An optimized deep learning model for human activity recognition using inertial measurement units
Challa, S. K., Kumar, A. A., Semwal, V. B., & Dua, N. (2023) · Expert Systems · doi:10.1111/exsy.13457 · Cited by 45
Khaertdinov, B., Asteriadis, S., & Ghaleb, E. (2022) · IEEE Transactions on Biometrics Behavior and Identity Science · doi:10.1109/tbiom.2022.3180591 · Cited by 40
Deep ensemble learning approach for lower limb movement recognition from multichannel sEMG signals
Tokas, P., Semwal, V. B., & Jain, S. (2024) · Neural Computing and Applications · doi:10.1007/s00521-024-09465-9 · Cited by 34
Investigating Enhancements to Contrastive Predictive Coding for Human Activity Recognition
Haresamudram, H., Essa, I., & Plötz, T. (2023) · 2023 IEEE International Conference on Pervasive Computing and Communications (PerCom) · doi:10.1109/percom56429.2023.10099197 · Cited by 27 · cited 1×
“Recently, a few studies have introduced self-supervised learning to HAR and demonstrated its promising performance [10], [12], [23], [30].”
Human motion activity recognition and pattern analysis using compressed deep neural networks
Kumari, N. V., Yadagani, A., Behera, B., Semwal, V. B., & Mohanty, S. (2024) · Computer Methods in Biomechanics and Biomedical Engineering Imaging & Visualization · doi:10.1080/21681163.2024.2331052 · Cited by 27
Investigating Enhancements to Contrastive Predictive Coding for Human Activity Recognition
Haresamudram, H., Essa, I., & Ploetz, T. (2022) · arXiv · Cited by 27 · cited 1×
“Recently, a few studies have introduced self-supervised learning to HAR and demonstrated its promising performance [10], [12], [23], [30].”
Research works printed but not linked: 4
- 10.5555/3524938.3525087 · doi:10.5555/3524938.3525087
- 10.5555/3495724.3497510 · doi:10.5555/3495724.3497510
- Goodfellow, 2016, Deep Learning
- Van der Maaten, 2008, Visualizing data using t-SNE, J. Mach. Learn. Res., 9, 1
Cited by
Kobir, M. I., Machado, P., Lotfi, A., Haider, D., & Ihianle, I. K. (2025) · Sensors · doi:10.3390/s25133955 · Cited by 15
“Recent approaches have also explored contrastive learning frameworks and diffusion-based methods for HAR, which learn robust representations by maximising inter-class separability and modelling temporal dynamics in latent space [19,20].”
Time-Series Contrastive Learning Against False Negatives and Class Imbalance
Jin, X., Wang, J., Ou, X., Liu, L., & Lin, Y. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2025.3568387 · Cited by 14
“In contrast, TCLHAR [34] constructs positive pairs by utilizing the temporal co-occurrence relationship between adjacent time windows.”
Guo, P., & Nakayama, M. (2025) · Sensors · doi:10.3390/s25226988 · Cited by 6
“For the self-supervised contrastive learning settings, we followed dataset-specific hyperparameter configurations as reported in previous studies [34,45].”
Li, Z., Fu, M., Fu, B., & Liu, Y. (2025) · Signal Image and Video Processing · doi:10.1007/s11760-025-04888-w · Cited by 4
Lim, G., & Yi, M.-K. (2025) · IEEE Sensors Journal · doi:10.1109/jsen.2025.3613260 · Cited by 2
“Chen et al. [17] proposed TCLHAR, a temporal contrastive learning framework that constructs positive pairs from adjacent time windows.”
Metadata
- Authors
- Chen, X., Zhou, X., Sun, M., & Wang, H.
- Affiliations
- Louisiana State University (US)
- Stevens Institute of Technology (US)
- Venue
- IEEE Sensors Journal
- Published
- 2025-01-01
- Volume
- 25
- Issue
- 1
- Pages
- 1839-1850
- ISSN
- 1530-437X (ISSN-L)
- 1558-1748
- 2379-9153
- OpenAlex
- W4404410831
- Semantic Scholar
- 4a0df00a51ae79083514a5f36498a0e2826c3647
- Cited by
- 13
- References
- 39
- Citations by year
- 2026: 6 · 2025: 7
- FWCI
- 1.82
- Type
- journal article
- Language
- en
- Open access
- green
- repository.lsu.edu
- Licence
- Locations
- IEEE Sensors Journal (publishedVersion)
- Civil War Book Review (submittedVersion)
- Funders
- National Science Foundation (1943486, 2246757, 2315612, 2332011, 2403247, 2431595)
- Office of Research and Economic Development at Louisiana State University
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Physical Sciences › Computer Science › Signal Processing › Time Series Analysis and Forecasting
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- temporal contrastive learning, self-supervised learning, wearable sensors, time series representation learning, cross-modal fusion, unlabeled data, semi-supervised learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.