ColloSSL: Collaborative Self-Supervised Learning for Human Activity Recognition
The DOI matches its Crossref record; 58 of the 58 references it cites were found in a registry or an index.
Abstract
A major bottleneck in training robust Human-Activity Recognition models (HAR) is the need for large-scale labeled sensor datasets. Because labeling large amounts of sensor data is an expensive task, unsupervised and semi-supervised learning techniques have emerged that can learn good features from the data without requiring any labels. In this paper, we extend this line of research and present a novel technique called Collaborative Self-Supervised Learning (ColloSSL) which leverages unlabeled data collected from multiple devices worn by a user to learn high-quality features of the data. A key insight that underpins the design of ColloSSL is that unlabeled sensor datasets simultaneously captured by multiple devices can be viewed as natural transformations of each other, and leveraged to generate a supervisory signal for representation learning. We present three technical innovations to extend conventional self-supervised learning algorithms to a multi-device setting: a Device Selection approach which selects positive and negative devices to enable contrastive learning, a Contrastive Sampling algorithm which samples positive and negative examples in a multi-device setting, and a loss function called Multi-view Contrastive Loss which extends standard contrastive loss to a multi-device setting. Our experimental results on three multi-device datasets show that ColloSSL outperforms both fully-supervised and semi-supervised learning techniques in majority of the experiment settings, resulting in an absolute increase of upto 7.9% in F1 score compared to the best performing baselines. We also show that ColloSSL outperforms the fully-supervised methods in a low-data regime, by just using one-tenth of the available labeled data in the best case.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“ColloSSL employs a combination of device selection and contrastive sampling algorithms to form training batches from multiple devices, enabling contrastive learning without labeled data.”
From Past, Present, and Future of Sensor-based Human Activity Recognition Using Wearables: A Surveying Tutorial on a Still Challenging Task (2025) · cites this paper as [93]
In the citing paper
“ColloSSL (Collaborative Self-Supervised Learning) [93] tackles the scarcity of labeled data in HAR by leveraging time-synchronized data collected from multiple inertial sensors worn by users.”
From Past, Present, and Future of Sensor-based Human Activity Recognition Using Wearables: A Surveying Tutorial on a Still Challenging Task (2025) · cites this paper as [93]
In the citing paper
“Leave-one-group-out cross-validation approach is used for performance evaluation follows the previous works [26,34] .”
From Spatial-Temporal Masked Autoencoder for Multi-Device Wearable Human Activity Recognition (2023) · cites this paper as [34]
In the citing paper
“The authors propose ColloSSL, which demonstrates that learning the correlations across multiple devices benefits contrastive learning.”
From Spatial-Temporal Masked Autoencoder for Multi-Device Wearable Human Activity Recognition (2023) · cites this paper as [34]
In the citing paper
“The majority of these works have focused on contrastive approaches [23, 24, 25, 26, 27].”
From Comparing self-supervised learning techniques for wearable human activity recognition (2025) · cites this paper as [27]
Citations
Cites
(2008) · Journal of Machine Learning Research · Cited by 33,051
Momentum Contrast for Unsupervised Visual Representation Learning
He, K., Fan, H., Wu, Y., Xie, S., & Girshick, R. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00975 · Cited by 13,347
A Survey on Bias and Fairness in Machine Learning
Mehrabi, N., Morstatter, F., Saxena, N., Lerman, K., & Galstyan, A. (2019) · arXiv · doi:10.48550/arxiv.1908.09635 · Cited by 5,812
A Survey on Bias and Fairness in Machine Learning
Mehrabi, N., Morstatter, F., Saxena, N., Lerman, K., & Galstyan, A. (2022) · ACM Computing Surveys · doi:10.1145/3457607 · Cited by 5,812
Emerging Properties in Self-Supervised Vision Transformers
Caron, M., Touvron, H., Misra, I., Jegou, H., Mairal, J., Bojanowski, P., & Joulin, A. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00951 · Cited by 5,638 · cited 1×
“Self-supervised learning (SSL) has become an increasingly popular area of research in the machine learning community to minimize the reliance on labeled data for training deep learning models [6, 8, 23, 25, 29].”
BackgroundDeep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps
Simonyan, K., Vedaldi, A., & Zisserman, A. (2013) · arXiv · doi:10.48550/arxiv.1312.6034 · Cited by 5,370 · cited 1×
“For a better interpretability of our findings, we visualize saliency maps [46, 53] for two randomly selected data samples from the RealWorld dataset.”
MethodBootstrap Your Own Latent: A New Approach to Self-Supervised Learning
Grill, J.-B., Strub, F., Altché, F., Tallec, C., Richemond, P. H., Buchatskaya, E., Doersch, C., Pires, B. A., Guo, Z. D., Azar, M. G., et al. (2020) · arXiv · doi:10.48550/arxiv.2006.07733 · Cited by 3,846 · cited 2×
“However, recently novel SSL methods have been proposed which do not require negative samples [10, 17] and outperform contrastive learning methods such as SimCLR.”
BackgroundMethodExploring Simple Siamese Representation Learning
Chen, X., & He, K. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01549 · Cited by 3,725
Supervised Contrastive Learning
Khosla, P., Teterwak, P., Wang, C., Sarna, A., Tian, Y., Isola, P., Maschinot, A., Liu, C., & Krishnan, D. (2020) · arXiv · doi:10.48550/arxiv.2004.11362 · Cited by 3,569 · cited 1×
“Self-supervised learning (SSL) has become an increasingly popular area of research in the machine learning community to minimize the reliance on labeled data for training deep learning models [6, 8, 23, 25, 29].”
BackgroundDeep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition
Ordóñez, F., & Roggen, D. (2016) · Sensors · doi:10.3390/s16010115 · Cited by 2,761 · cited 1×
“For this purpose, a number of deep learning based sensor fusion techniques [37, 39, 61, 65, 66] have been proposed, which train a fusion model by concatenating multiple sensor streams.”
Research works printed but not linked: 13
- Philip Bachman, R Devon Hjelm, and William Buchwalter. 2019. Learning representations by maximizing mutual information across views. arXiv preprint arXiv:1906.00910 (2019). · arXiv
- Pierre Baldi. 2012. Autoencoders, Unsupervised Learning, and Deep Architectures. In Proceedings of ICML Workshop on Unsupervised and Transfer Learning (Proceedings of Machine Learning Research, Vol. 27), Isabelle Guyon, Gideon Dror, Vincent Lemaire, Graham Taylor, and Daniel Silver (Eds.). PMLR, Bellevue, Washington, USA, 37--49. http://proceedings.mlr.press/v27/baldi12a.html
- Ting Chen, Simon Kornblith, Mohammad Norouzi, and Geoffrey Hinton. 2020. A simple framework for contrastive learning of visual representations. In International conference on machine learning. PMLR, 1597--1607.
- Sanorita Dey, Nirupam Roy, Wenyuan Xu, Romit Roy Choudhury, and Srihari Nelakuditi. 2014. AccelPrint: Imperfections of Accelerometers Make Smartphones Trackable.. In NDSS. Citeseer.
- Adam W. Harley, Shrinidhi K. Lakshmikanth, Fangyu Li, Xian Zhou, Hsiao-Yu Fish Tung, and Katerina Fragkiadaki. 2020. Learning from Unlabelled Videos Using Contrastive Predictive Neural 3D Mapping. arXiv:1906.03764 [cs.CV] · arXiv
- Song-Mi Lee, Sang Min Yoon, and Heeryon Cho. 2017. Human activity recognition from accelerometer data using Convolutional Neural Network. In 2017 ieee international conference on big data and smart computing (bigcomp). IEEE, 131--134.
- Daniel S Park, William Chan, Yu Zhang, Chung-Cheng Chiu, Barret Zoph, Ekin D Cubuk, and Quoc V Le. 2019. Specaugment: A simple data augmentation method for automatic speech recognition. arXiv preprint arXiv:1904.08779 (2019). · arXiv
- Thomas Plötz Nils Y Hammerla and Patrick L Olivier. 2011. Feature learning for activity recognition in ubiquitous computing. In Twenty-second international joint conference on artificial intelligence.
- Charissa Ann Ronao and Sung-Bae Cho. 2016. Human activity recognition with smartphone sensors using deep learning neural networks. Expert systems with applications 59 (2016), 235--244.
- Aaqib Saeed, Victor Ungureanu, and Beat Gfeller. 2020. Sense and Learn: Self-Supervision for Omnipresent Sensors. arXiv preprint arXiv:2009.13233 (2020). · arXiv
- Pritam Sarkar and Ali Etemad. 2020. Self-supervised ecg representation learning for emotion recognition. arXiv preprint arXiv:2002.03898 (2020). · arXiv
- Haizhou Shi, Youcai Zhang, Zijin Shen, Siliang Tang, Yaqian Li, Yandong Guo, and Yueting Zhuang. 2021. Federated Self-Supervised Contrastive Learning via Ensemble Similarity Distillation. arXiv preprint arXiv:2109.14611 (2021). · arXiv
- 10.5555/2832747.2832806 · doi:10.5555/2832747.2832806
Cited by
Items 101–152 of 152
Esmaeili, A., Ghorrati, Z., & Matson, E. T. (2023) · IEEE International Conference on Robotic Computing (IRC) · doi:10.1109/irc59093.2023.00068 · Cited by 3
S2C‐HAR: A Semi‐Supervised Human Activity Recognition Framework Based on Contrastive Learning
Li, X., Nie, L., Liu, M., Cheng, W., Zhu, H., Wu, X., & Zhan, D. (2025) · Concurrency and Computation Practice and Experience · doi:10.1002/cpe.70027 · Cited by 3
Liu, X., Yuan, G., Zhang, Y., Liu, S., & Yan, Q. (2025) · Proceedings of the Thirty-Fourth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2025/952 · Cited by 2
BioQ: Towards Context-Aware Multi-Device Collaboration with Bio-cues
Orzikulova, A., Vasile, D. A., Tang, C. I., Kawsar, F., Lee, S.-J., & Min, C. (2025) · ACM Conference on Embedded Networked Sensor Systems (SenSys) · doi:10.1145/3715014.3722079 · Cited by 2
Self-citationGuo, K., Tang, H., Xu, T., Zhou, H., Lyu, M., Liu, Z., Wang, X., & Li, X. (2025) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2025.3569841 · Cited by 2
Calatrava-Nicolás, F. M., Ray, L. S. S., Rey, V. F., Lukowicz, P., & Mozos, Ó. M. (2025) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/3714394.3756194 · Cited by 2
GenHAR: Generalizing Cross-domain Human Activity Recognition for Last-mile Delivery
Hong, Z., Li, Z., Fan, X., Yang, G., Guo, B., Wang, H., He, T., & Zhang, D. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770854.3783921 · Cited by 2
Multi-Frequency Federated Learning for Human Activity Recognition Using Head-Worn Sensors
Fenoglio, D., Li, M., Casnici, D., Laporte, M., Gashi, S., Silvia Santini, B., Gjoreski, M., & Langheinrich, M. (2024) · International Conference on Intelligent Environments (IE) · doi:10.1109/ie61493.2024.10599924 · Cited by 2
AcouDL: Context-Aware Daily Activity Recognition from Natural Acoustic Signals
Chakma, A., Das, A., Faridee, A. Z. M., Chakraborty, S., Chakraborty, S., & Roy, N. (2024) · IEEE International Conference on Smart Computing · doi:10.1109/smartcomp61445.2024.00077 · Cited by 2
Self-supervised learning for data-efficient human activity recognition
Tang, C. I. (2023) · Apollo (University of Cambridge) · doi:10.17863/cam.107522 · Cited by 2
Self-citationCOMODO: Cross-Modal Video-to-IMU Distillation for Efficient Egocentric Human Activity Recognition
Chen, B., Wongso, W., Li, Z., Khaokaew, Y., Xue, H., & Salim, F. D. (2026) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3810218 · Cited by 1
Oishi, N., Birch, P., Lago, P., & Roggen, D. (2026) · Knowledge-Based Systems · doi:10.1016/j.knosys.2026.116367 · Cited by 1
Contrastive Learning Based Human Activity Recognition Using Body Sensors
Xie, C., Zhou, Y., Yu, D., Sun, S., & Zhang, X. (2023) · International Conference on Big Data Computing and Communications (BigCom) · doi:10.1109/bigcom61073.2023.00043 · Cited by 1
Wu, K., Liu, B., Chen, Z., Li, S., & Li, W. (2025) · Lecture notes in electrical engineering · doi:10.1007/978-981-96-2216-0_37 · Cited by 1
Unseen-aware semi-supervised model for robust human activity recognition
Li, Y., Ouyang, Z., & Li, G. (2025) · Multimedia Systems · doi:10.1007/s00530-025-01939-7 · Cited by 1
Integrative analysis and imputation of multiple data streams via deep Gaussian processes
Septiandri, A. A., Ming, D., DiazDelaO, F. A., Jendoubi, T., & Ray, S. (2025) · Bioinformatics Advances · doi:10.1093/bioadv/vbaf305 · Cited by 1
Zhang, Z., Zhao, D. Y., Zhu, G., Li, X. Q., Li, C., Liu, B., Li, Y., & Ma, H. (2026) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2026.3672513 · Cited by 1
Ye, Z., Huang, Y., Yu, C., Wang, Y., Luo, Y., & Shi, Y. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791014 · Cited by 1
TransfHAR: Self-Supervised Wrist Representations for On-Demand Activity Recognition
Bradshaw, A., Arakawa, R., Liu, X., & Ahuja, K. (2026) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3830398.3830553 · Cited by 1
FM-FoG: A Real-Time Foundation Model-based Wearable System for Freezing-of-Gait Mitigation
Chi, C., Clapham, J., Cloud, L. J., Pretzer‐Aboff, I., Blackwell, G. G., Shao, H., & Zhou, G. (2026) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3831651 · Cited by 1
Feature representation learning for human activity recognition
Khaertdinov, B. (2024) · Research Publications (Maastricht University) · doi:10.26481/dis.20240618bk · Cited by 1
Nshimyimana, D., Rey, V. F., Suh, S., Zhou, B., & Lukowicz, P. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2503.17978 · Cited by 1
UniMotion: Self-Supervised Learning for Cross-Domain IMU Motion RecognitionPreprint
Khanna, P., Srivastava, T., Jain, S., & Balasubramanian, A. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2603.12218 · Cited by 1
Ek, S. (2024) · theses.fr (ABES) · doi:10.70675/a47253c1zf05az480aza992zc137c06fbc2f · Cited by 1
Haresamudram, H., Tang, C. I., Suh, S., Lukowicz, P., & Ploetz, T. (2024) · arXiv · Cited by 31
Self-citationInvestigating Enhancements to Contrastive Predictive Coding for Human Activity Recognition
Haresamudram, H., Essa, I., & Ploetz, T. (2022) · arXiv · Cited by 27
Yang, L., Yang, P., Peng, X., Wang, X., & Qi, J. (2025) · 2025 IEEE 23rd International Conference on Industrial Informatics (INDIN) · doi:10.1109/indin64977.2025.11278998
PLUM: Improving Inference Efficiency By Leveraging Repetition-Sparsity Trade-OffPreprint
Kuhar, S., Jain, Y. M., & Tumanov, A. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2312.01581
Self-citationContrastive Sensor Excitation for Generalizable Cross-Person Activity Recognition
Tan, Z., Fang, S., Zhu, H., & Yang, C. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10650018
CAUDA: Cloud-assisted Active Unsupervised Domain Adaptation for On-device Learning
Wang, Z., Zheng, Z., & Wu, F. (2024) · IEEE International Performance, Computing, and Communications Conference · doi:10.1109/ipccc59868.2024.10850366
Efficient Deep Learning for Correlated Time Series Analytics
Lai, Z. (2025) · VBN Forskningsportal (Aalborg Universitet) · doi:10.54337/aau772637354
lukss, A. (2025) · International Journal of Science and Research Archive · doi:10.30574/ijsra.2025.17.2.3076
Personalized Self-Supervised Learning for Real-World Human Activity Recognition
Huetter, S. (2023) · reposiTUm (TU Wien) · doi:10.34726/hss.2023.109782
Cross-modal learning from visual information for activity recognition on inertial sensors
Tong, C. (2023) · Oxford University Research Archive (ORA) (University of Oxford) · doi:10.5287/ora-4jqroa50k
Using machine learning for wearables to understand the association of sleep with future morbidity
Yuan, H. (2024) · Oxford University Research Archive (ORA) (University of Oxford) · doi:10.5287/ora-e9m8dob29
Adaptive Edge Systems for Smart IoT Applications
Liu, M. (2023) · eScholarship (California Digital Library)
Prototype-based Self-Supervised Multimodal Learning for PPG and Accelerometry SignalsPreprint
Mao, W., Xu, M. A., Haresamudram, H., Saha, M., Kumar, S., & Rehg, J. M. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2510.09764
Advancing Human Activity Recognition: Innovations in Signal Representations and Machine Learning
Wieland, C. (2025) · Repository KITopen (Karlsruhe Institute of Technology) · doi:10.5445/ir/1000186423
Align and Adapt: Multimodal Multiview Human Activity Recognition Under Arbitrary View Combinations
Nguyen, D., & Le‐Khac, N. (2026) · IEEE Sensors Journal · doi:10.1109/jsen.2026.3718255
Nguyen, D., & Le‐Khac, N. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6216286
Li, T., Li, Z., Li, D., Wu, J., Chen, Y., Feng, X. T., Ma, Y., Liu, D., & Guo, C. (2025) · IEEE International Joint Conference on Biometrics (IJCB) · doi:10.1109/ijcb65343.2025.11410654
Efficient federated self-supervised human activity recognition via delta-loss client clustering
Bukit, T. A., Yahya, B. N., & Lee, S. (2026) · Digital Signal Processing · doi:10.1016/j.dsp.2026.106251
PoHAR: Understanding Hyperlocal Human Activities with Pollution Sensor Networks
Karmakar, P., Reddy, K., & Chakraborty, S. (2026) · International Conference on Distributed Computing in Smart Systems and the Internet of Things (DCOSS-IoT) · doi:10.1109/dcoss-iot69657.2026.00025
Choudhury, N. A., & Soni, B. (2026) · Transactions on computer systems and networks · doi:10.1007/978-981-95-7206-9_2
Biomechanics-Informed Masked Autoencoder With Anchor Alignment for Robust Human Activity Recognition
Guo, T., Hou, F., Pang, Y., & Wang, Z. (2026) · IEEE Access · doi:10.1109/access.2026.3713236
Multimodal Federated Learning under Dual-Axis Modality MissingnessPreprint
Orzikulova, A., Kwak, J., Shin, J., Guo, Y., Ouyang, X., Xing, G., Whang, S. E., & Lee, S.-J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.09240
UniMoRe : Uni fied Mo tion Re presentation via Gait IMU Pretraining
Chakraborty, S., Kumar, A., & Nigam, A. (2026) · IEEE Sensors Journal · doi:10.1109/jsen.2026.3718949
Chen, Y., Chen, Q., Tian, Y., Xing, W., Pi, Y., & Cao, Z. (2026) · Pattern Recognition · doi:10.1016/j.patcog.2026.114645
SenseAgent: An LLM Agent for Adaptive Cross-Domain IMU SensingPreprint
Zhao, T., Liu, C., & Wang, X. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.32000
Next Token Prediction for Generalizable Human Activity Recognition
Cai, Y., Yu, A., Guo, B., Liu, Y., & Hong, Z. (2026) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3799682.3840756
Real-time Recognition of Contextual Composite Activities from Asynchronous Multi-IMU Sensor Streams
Mondal, A., Khan, A., Chugh, G., & Chakraborty, S. (2026) · ACM Transactions on Sensor Networks · doi:10.1145/3860888
WearableBridge: Task-Guided Latent Transport for Free-Living Activity RecognitionPreprint
Zou, J., & Wang, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.09067
Metadata
- Authors
- Jain, Y., Tang, C. I., Min, C., Kawsar, F., & Mathur, A.
- Affiliations
- Georgia Institute of Technology (US)
- University of Cambridge (GB)
- Nokia (United Kingdom) (GB)
- Venue
- Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Published
- 2022-03-29
- Volume
- 6
- Issue
- 1
- Pages
- 1-28
- ISSN
- 2474-9567 (ISSN-L)
- OpenAlex
- W4220693285
- Cited by
- 113
- References
- 46
- Citations by year
- 2026: 16 · 2025: 31 · 2024: 32 · 2023: 29 · 2022: 5
- FWCI
- 7.94
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies (publishedVersion, public-domain)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
- Keywords
- human activity recognition, unsupervised learning, semi-supervised learning, contrastive learning, device selection, representation learning, wearable sensors, limited labeled data
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.