CrossHAR: Generalizing Cross-dataset Human Activity Recognition via Hierarchical Self-Supervised Pretraining
The DOI matches its Crossref record; 72 of the 72 references it cites were found in a registry or an index.
Abstract
The increasing availability of low-cost wearable devices and smartphones has significantly advanced the field of sensor-based human activity recognition (HAR), attracting considerable research interest. One of the major challenges in HAR is the domain shift problem in cross-dataset activity recognition, which occurs due to variations in users, device types, and sensor placements between the source dataset and the target dataset. Although domain adaptation methods have shown promise, they typically require access to the target dataset during the training process, which might not be practical in some scenarios. To address these issues, we introduce CrossHAR, a new HAR model designed to improve model performance on unseen target datasets. CrossHAR involves three main steps: (i) CrossHAR explores the sensor data generation principle to diversify the data distribution and augment the raw sensor data. (ii) CrossHAR then employs a hierarchical self-supervised pretraining approach with the augmented data to develop a generalizable representation. (iii) Finally, CrossHAR fine-tunes the pretrained model with a small set of labeled data in the source dataset, enhancing its performance in cross-dataset HAR. Our extensive experiments across multiple real-world HAR datasets demonstrate that CrossHAR outperforms current state-of-the-art methods by 10.83% in accuracy, demonstrating its effectiveness in generalizing to unseen target datasets.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“While effective, these methods suffer from two major limitations: (1) collecting data from each new user increases deployment costs, and (2) the two-stage training pipeline adds complexity and computational overhead.”
From Towards User-Generalizable Wearable-Sensor-Based Human Activity Recognition: A Multi-Task Contrastive Learning Approach (2025) · cites this paper as [11]
In the citing paper
“Prior works have explored personalized HAR frameworks [11,12,13,14,15,16], typically adopting a two-stage approach: pre-training on a general dataset followed by fine-tuning on data from the target user.”
From Towards User-Generalizable Wearable-Sensor-Based Human Activity Recognition: A Multi-Task Contrastive Learning Approach (2025) · cites this paper as [11]
In the citing paper
“While effective, these methods suffer from two major limitations: (1) collecting data from each new user increases deployment costs, and (2) the two-stage training pipeline adds complexity and computational overhead.”
From Towards User-Generalizable Wearable-Sensor-Based Human Activity Recognition: A Multi-Task Contrastive Learning Approach (2025) · cites this paper as [11]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · cited 1×
“• ResNet [24] (Residual Neural Network) is a popular deep learning model and has been applied in time series analysis.”
MethodKirillov, A., Mintun, E., Ravi, N., Mao, H., Rolland, C., Gustafson, L., Xiao, T., Whitehead, S., Berg, A. C., Lo, W.-Y., et al. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00371 · Cited by 11,953
Transformers in Vision: A Survey
Khan, S., Naseer, M., Hayat, M., Zamir, S. W., Khan, F. S., & Shah, M. (2022) · ACM Computing Surveys · doi:10.1145/3505244 · Cited by 3,595 · cited 1×
“Recently, self-supervised pretraining has received increasing attention from the research community due to its great success in natural language processing [32] and computer vision [14, 19, 33].”
BackgroundTransformers in Vision: A Survey
Khan, S., Naseer, M., Hayat, M., Zamir, S. W., Khan, F. S., & Shah, M. (2021) · arXiv · doi:10.48550/arxiv.2101.01169 · Cited by 3,594 · cited 1×
“Recently, self-supervised pretraining has received increasing attention from the research community due to its great success in natural language processing [32] and computer vision [14, 19, 33].”
BackgroundThe Performance of LSTM and BiLSTM in Forecasting Time Series
Siami-Namini, S., Tavakoli, N., & Namin, A. S. (2019) · 2019 IEEE International Conference on Big Data (Big Data) · doi:10.1109/bigdata47090.2019.9005997 · Cited by 1,574 · cited 1×
“• LSTM [64] (Long Short-Term Memory) is a type of recurrent neural network architecture that is commonly used for time series classification tasks.”
BackgroundProceedings of the 2nd International Conference on Neural Information Processing Systems
Touretzky, D. S. (1989) · Cited by 1,439
Generalizing to unseen domains: A survey on domain generalization
Wang, J., Lan, C., Liu, C., Ouyang, Y., Qin, T., Lu, W., Chen, Y., Zeng, W., & Yu, P. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2022.3178128 · Cited by 1,046 · cited 4×
“Given these practical constraints, domain generalization [8, 35, 76, 84, 89], focuses on training models exclusively with source domain data to achieve robust performance on unseen target domains, becomes a more promising approach.”
BackgroundMethodInfluentialA survey of unsupervised deep domain adaptation
Wilson, G., & Cook, D. J. (2020) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3400066 · Cited by 987 · cited 1×
“Domain adaptation , a widely studied technique to address the domain shift issue [25, 34, 80, 80], aims to bridge the gap between source and target domains by incorporating data from both during the training phase.”
BackgroundImageBind One Embedding Space to Bind Them All
Girdhar, R., El-Nouby, A., Liu, Z., Singh, M., Alwala, K. V., Joulin, A., & Misra, I. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01457 · Cited by 863 · cited 2×
“(ii) Furthermore, recent advancements in pretraining methodologies in the computer vision [11, 19] and natural language processing (NLP) [32] communities have shown remarkable effectiveness in improving generalization [31, 76].”
BackgroundLaMDA: Language Models for Dialog Applications
Thoppilan, R., De Freitas, D., Hall, J., Shazeer, N., Kulshreshtha, A., Cheng, H.-T., Jin, A., Bos, T., Baker, L., Du, Y., et al. (2022) · arXiv · doi:10.48550/arxiv.2201.08239 · Cited by 778 · cited 1×
“Motivated by the success of the foundation model in NLP [69] and computer vision communities [38], we will explore developing foundation models for sensor-based human activity recognition [40].”
MethodTransition-Aware Human Activity Recognition Using Smartphones
Reyes-Ortiz, J.-L., Oneto, L., Samà, A., Parra, X., & Anguita, D. (2016) · Neurocomputing · doi:10.1016/j.neucom.2015.07.085 · Cited by 740 · cited 7×
“In this case study, we aim to evaluate the performance of CrossHAR against new sensors (some public datasets were collected a decade ago [56]), under diverse conditions such as various motion amplitudes, and in limited hardware resources.”
BackgroundMethodInfluentialUm, T. T., Pfister, F. M. J., Pichler, D., Endo, S., Lang, M., Hirche, S., Fietzek, U., & Kulić, D. (2017) · Proceedings of the 19th ACM International Conference on Multimodal Interaction · doi:10.1145/3136755.3136817 · Cited by 729 · cited 2×
“Note that, the number of generated IMU samples can be infinite due to the infinite space of device orientations [74].”
BackgroundMethodTime Series Data Augmentation for Deep Learning: A Survey
Wen, Q., Sun, L., Yang, F., Song, X., Gao, J., Wang, X., & Xu, H. (2021) · Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/631 · Cited by 727
Time Series Data Augmentation for Deep Learning: A Survey
Wen, Q., Sun, L., Yang, F., Song, X., Gao, J., Wang, X., & Xu, H. (2020) · arXiv · doi:10.48550/arxiv.2002.12478 · Cited by 727
Stisen, A., Blunck, H., Bhattacharya, S., Prentow, T. S., Kjærgaard, M. B., Dey, A., Sonne, T., & Jensen, M. M. (2015) · Proceedings of the 13th ACM Conference on Embedded Networked Sensor Systems · doi:10.1145/2809695.2809718 · Cited by 714
Deep Learning for Sensor-based Human Activity Recognition
Chen, K., Zhang, D., Yao, L., Guo, B., Yu, Z., & Liu, Y. (2022) · ACM Computing Surveys · doi:10.1145/3447744 · Cited by 690 · cited 5×
“Training with data from the source dataset ( 𝐷 ) and fine-tuning with a subset data from the target dataset ( 𝐷 ) [8, 57, 59].”
BackgroundMethodInfluentialSelf-citationDeepSense: A Unified Deep Learning Framework for Time-Series Mobile Sensing Data Processing
Yao, S., Hu, S., Zhao, Y., Zhang, A., & Abdelzaher, T. (2017) · Proceedings of the 26th International Conference on World Wide Web · doi:10.1145/3038912.3052577 · Cited by 667 · cited 1×
“We utilize UCI [56], Shoaib [63], Motion [46], and HHAR [65], to evaluate different methods, as they are widely used in previous HAR studies [7, 50, 58, 82, 83, 85].”
MethodUm, T. T. (n.d.) · mediaTUM – the media and publications repository of the Technical University Munich (Technical University Munich) · Cited by 602
Fusion of Smartphone Motion Sensors for Physical Activity Recognition
Shoaib, M., Bosch, S., Incel, O., Scholten, H., & Havinga, P. (2014) · Sensors · doi:10.3390/s140610146 · Cited by 552 · cited 1×
“We utilize UCI [56], Shoaib [63], Motion [46], and HHAR [65], to evaluate different methods, as they are widely used in previous HAR studies [7, 50, 58, 82, 83, 85].”
MethodMulti-task Self-Supervised Learning for Human Activity Detection
Saeed, A., Ozcelebi, T., & Lukkien, J. (2019) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3328932 · Cited by 346 · cited 2×
“We utilize UCI [56], Shoaib [63], Motion [46], and HHAR [65], to evaluate different methods, as they are widely used in previous HAR studies [7, 50, 58, 82, 83, 85].”
BackgroundMethodGenerative Adversarial Networks in Time Series: A Systematic Literature Review
Brophy, E., Wang, Z., She, Q., & Ward, T. (2023) · ACM Computing Surveys · doi:10.1145/3559540 · Cited by 337
Deep Learning for Sensor-based Human Activity Recognition: Overview, Challenges and Opportunities
Chen, K., Zhang, D., Yao, L., Guo, B., Yu, Z., & Liu, Y. (2020) · arXiv · doi:10.48550/arxiv.2001.07416 · Cited by 314 · cited 5×
“Training with data from the source dataset ( 𝐷 ) and fine-tuning with a subset data from the target dataset ( 𝐷 ) [8, 57, 59].”
BackgroundMethodInfluentialSelf-citationMobile sensor data anonymization
Malekzadeh, M., Clegg, R. G., Cavallaro, A., & Haddadi, H. (2019) · Proceedings of the International Conference on Internet of Things Design and Implementation · doi:10.1145/3302505.3310068 · Cited by 298 · cited 2×
“We utilize UCI [56], Shoaib [63], Motion [46], and HHAR [65], to evaluate different methods, as they are widely used in previous HAR studies [7, 50, 58, 82, 83, 85].”
BackgroundMethodSelfReg: Self-supervised Contrastive Regularization for Domain Generalization
Kim, D., Yoo, Y., Park, S., Kim, J., & Lee, J. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00948 · Cited by 262 · cited 3×
“Given these practical constraints, domain generalization [8, 35, 76, 84, 89], focuses on training models exclusively with source domain data to achieve robust performance on unseen target domains, becomes a more promising approach.”
BackgroundMethodSelf-Supervised Contrastive Representation Learning for Semi-Supervised Time-Series Classification
Eldele, E., Ragab, M., Chen, Z., Wu, M., Kwoh, C.-K., Li, X., & Guan, C. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3308189 · Cited by 224
Self-Supervised Contrastive Pre-Training for Time Series Via Time-Frequency Consistency
Zhang, X., Zhao, Z., Tsiligkaridis, T., & Žitnik, M. (2022) · neural information processing systems · doi:10.52202/068431-0288 · Cited by 203
Kwon, H., Tong, C., Haresamudram, H., Gao, Y., Abowd, G. D., Lane, N. D., & Plötz, T. (2020) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3411841 · Cited by 152
Contrastive Predictive Coding for Human Activity Recognition
Haresamudram, H., Essa, I., & Plötz, T. (2021) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3463506 · Cited by 150 · cited 1×
“Recently, with the increase of large-scale unlabeled data, weak-supervised, self-supervised, and unsupervised methods are receiving more attention [22, 23, 29, 58, 62, 68, 83, 86].”
BackgroundXu, H., Zhou, P., Tan, R., Li, M., & Shen, G. (2021) · Proceedings of the 19th ACM Conference on Embedded Networked Sensor Systems · doi:10.1145/3485730.3485937 · Cited by 150 · cited 9×
“Even with good performance, most pretraining methods are not designed for IMU sensor data or not designed for the generalization setting [83].”
BackgroundMethodInfluentialDeep Transfer Learning for Cross-domain Activity Recognition
Wang, J., Zheng, V. W., Chen, Y., & Huang, M. (2018) · Proceedings of the 3rd International Conference on Crowd Science and Engineering · doi:10.1145/3265689.3265705 · Cited by 142 · cited 2×
“We summarize the domain shift problems into cross domain and cross dataset according to existing studies [8, 51, 77].”
MethodSelfHAR: Improving Human Activity Recognition through Self-training with Unlabeled Data
Tang, C. I., Perez-Pozuelo, I., Spathis, D., Brage, S., Wareham, N., & Mascolo, C. (2021) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3448112 · Cited by 140
A Systematic Study of Unsupervised Domain Adaptation for Robust Human-Activity Recognition
Chang, Y., Mathur, A., Isopoussu, A., Song, J., & Kawsar, F. (2020) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3380985 · Cited by 138 · cited 2×
“We utilize UCI [56], Shoaib [63], Motion [46], and HHAR [65], to evaluate different methods, as they are widely used in previous HAR studies [7, 50, 58, 82, 83, 85].”
BackgroundMethodColloSSL: Collaborative Self-Supervised Learning for Human Activity Recognition
Jain, Y., Tang, C. I., Min, C., Kawsar, F., & Mathur, A. (2022) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3517246 · Cited by 113
A Broad Study of Pre-training for Domain Generalization and Adaptation
Kim, D., Wang, K., Sclaroff, S., & Saenko, K. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19827-4_36 · Cited by 108
Assessing the State of Self-Supervised Human Activity Recognition Using Wearables
Haresamudram, H., Essa, I., & Plötz, T. (2022) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3550299 · Cited by 107 · cited 1×
“Recently, with the increase of large-scale unlabeled data, weak-supervised, self-supervised, and unsupervised methods are receiving more attention [22, 23, 29, 58, 62, 68, 83, 86].”
BackgroundAbedin, A., Ehsanpour, M., Shi, Q., Rezatofighi, H., & Ranasinghe, D. C. (2021) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3448083 · Cited by 107
GLOBEM: Cross-Dataset Generalization of Longitudinal Human Behavior Modeling
Xu, X., Liu, X., Zhang, H., Wang, W., Nepal, S., Sefidgar, Y., Seo, W., Kuehn, K. S., Huckins, J. F., Morris, M. E., et al. (2022) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3569485 · Cited by 96
Cross-Dataset Activity Recognition via Adaptive Spatial-Temporal Transfer Learning
Qin, X., Chen, Y., Wang, J., & Yu, C. (2019) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3369818 · Cited by 87 · cited 6×
“Due to the heterogeneity of sensor readings, models trained on one domain might not achieve comparable performance on other domains [49, 51, 83].”
BackgroundMethodResultInfluentialLatent Independent Excitation for Generalizable Sensor-based Cross-Person Activity Recognition
Qian, H., Pan, S. J., & Miao, C. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i13.17416 · Cited by 85 · cited 5×
“Unlike most existing cross-domain studies that focus on domain shift caused by one domain [25, 50, 52], we aim to generalize from 𝐷 𝑠𝑜𝑢𝑟𝑐𝑒 to 𝐷 𝑡𝑎𝑟𝑔𝑒𝑡 , addressing the shift brought by the combination of multiple domains.”
BackgroundMethodInfluentialLi, Y., Wang, X., & An, L. (2023) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3580795 · Cited by 82
Personalized Human Activity Recognition Using Convolutional Neural Networks
Rokni, S. A., Nourollahi, M., & Ghasemzadeh, H. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12185 · Cited by 77
PrimeNet: Pre-training for Irregular Multivariate Time Series
Chowdhury, R. R., Li, J., Zhang, X., Hong, D., Gupta, R. K., & Shang, J. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i6.25876 · Cited by 72
Ling, C. (2020) · doi:10.1145/3381012 · Cited by 72
Inoue, S., Lago, P., Hossain, T., Mairittha, T., & Mairittha, N. (2019) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3351244 · Cited by 67 · cited 2×
“Recent advancements in human activity recognition (HAR) have significantly enhanced practical applications in diverse fields such as healthcare [26] and manufacturing [54, 81].”
BackgroundkNN Sampling for Personalised Human Activity Recognition
Sani, S., Wiratunga, N., Massie, S., & Cooper, K. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-61030-6_23 · Cited by 65 · cited 1×
“Training with data from the source dataset ( 𝐷 ) and fine-tuning with a subset data from the target dataset ( 𝐷 ) [8, 57, 59].”
MethodWePos: Weak-supervised Indoor Positioning with Unlabeled WiFi for On-demand Delivery
Guo, B., Zuo, W., Wang, S., Lyu, W., Hong, Z., Ding, Y. C., He, T., & Zhang, D. (2022) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3534574 · Cited by 63
Self-citationSemantic-Discriminative Mixup for Generalizable Sensor-based Cross-domain Activity Recognition
Lu, W., Wang, J., Chen, Y., Pan, S. J., Hu, C., & Qin, X. (2022) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3534589 · Cited by 60 · cited 4×
“However, this method often assumes the availability of target domain data during training, which may not be practical in many real-world scenarios [42].”
BackgroundMethodInfluentialX-CHAR: A Concept-based Explainable Complex Human Activity Recognition Model
Jeyakumar, J. V., Sarker, A., Garcia, L. A., & Srivastava, M. B. (2023) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3580804 · Cited by 58 · cited 1×
“To increase the safety and robustness of HAR models, Jeyakumar et al. [30] design an explainable complex human activity recognition model for critical applications such as healthcare.”
BackgroundDomain Generalization for Activity Recognition via Adaptive Feature Fusion
Qin, X., Wang, J., Chen, Y., Lu, W., & Jiang, X. (2023) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3552434 · Cited by 55 · cited 6×
“Unlike most existing cross-domain studies that focus on domain shift caused by one domain [25, 50, 52], we aim to generalize from 𝐷 𝑠𝑜𝑢𝑟𝑐𝑒 to 𝐷 𝑡𝑎𝑟𝑔𝑒𝑡 , addressing the shift brought by the combination of multiple domains.”
BackgroundMethodInfluentialPractically Adopting Human Activity Recognition
Xu, H., Zhou, P., Tan, R., & Li, M. (2023) · Proceedings of the 29th Annual International Conference on Mobile Computing and Networking · doi:10.1145/3570361.3613299 · Cited by 55
Qingxin, X., Wada, A., Korpela, J., Maekawa, T., & Namioka, Y. (2019) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3328931 · Cited by 47 · cited 2×
“Recent advancements in human activity recognition (HAR) have significantly enhanced practical applications in diverse fields such as healthcare [26] and manufacturing [54, 81].”
BackgroundXia, Q., Korpela, J., Namioka, Y., & Maekawa, T. (2020) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3411836 · Cited by 47 · cited 2×
“Recent advancements in human activity recognition (HAR) have significantly enhanced practical applications in diverse fields such as healthcare [26] and manufacturing [54, 81].”
BackgroundDomain-Specific Risk Minimization for Domain Generalization
Zhang, Y., Wang, J., Liang, J., Zhang, Z., Yu, B., Wang, L., Tao, D., & Xie, X. (2023) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3580305.3599313 · Cited by 46 · cited 2×
“Given these practical constraints, domain generalization [8, 35, 76, 84, 89], focuses on training models exclusively with source domain data to achieve robust performance on unseen target domains, becomes a more promising approach.”
BackgroundMethodHu, R., Chen, L., Miao, S., & Tang, X. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i5.25743 · Cited by 44
Learning Disentangled Behaviour Patterns for Wearable-based Human Activity Recognition
Su, J., Wen, Z., Lin, T., & Guan, Y. (2022) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3517252 · Cited by 43
IMU2Doppler: Cross-Modal Domain Adaptation for Doppler-based Activity Recognition Using IMU Data
Bhalla, S., Goel, M., & Khurana, R. (2021) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3494994 · Cited by 41
"What is Your Envisioned Future?": Toward Human-AI Enrichment in Data Work of Asthma Care
Su, Z., He, L., Jariwala, S. P., Zheng, K., & Chen, Y. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555157 · Cited by 41
Zero-Shot Learning for IMU-Based Activity Recognition Using Video Embeddings
Tong, C., Ge, J., & Lane, N. D. (2021) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3494995 · Cited by 40 · cited 1×
“Given the intrinsic similarity of wearable sensor data and other data such as video, some studies focus on HAR by utilizing knowledge learned from other modalities [4, 39, 55, 72].”
BackgroundMazankiewicz, A., Böhm, K., & Berges, M. (2020) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3432230 · Cited by 35 · cited 3×
“Few studies have shed light on the important problem of whether and how unlabeled data benefit the generalization capability of sensor-based HAR models [25, 48].”
BackgroundMethodVision2Sensor: Knowledge Transfer Across Sensing Modalities for Human Activity Recognition
Radu, V., & Henne, M. (2019) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3351242 · Cited by 33
ConvBoost: Boosting ConvNets for Sensor-based Activity Recognition
Shao, S., Guan, Y., Zhai, B., Missier, P., & Plötz, T. (2023) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3596234 · Cited by 30
Qin, X., Wang, J., Ma, S., Lu, W., Zhu, Y., Xie, X., & Chen, Y. (2023) · Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining · doi:10.1145/3580305.3599360 · Cited by 29 · cited 3×
“To address the shortage of training data, Qin et al. [53] design a diverse and discriminative representation learning model to generalize HAR to unseen domains.”
BackgroundSynthetic Smartwatch IMU Data Generation from In-the-wild ASL Videos
Santhalingam, P. S., Pathak, P., Rangwala, H., & Kosecka, J. (2023) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3596261 · Cited by 28 · cited 1×
“Kwon et al. [39] and Santhalingam et al. [60] extract IMU data from recorded videos to improve HAR performances.”
BackgroundWeakly Supervised Multi-Task Representation Learning for Human Activity Analysis Using Wearables
Sheng, T., & Huber, M. (2020) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3397330 · Cited by 28 · cited 1×
“Recently, with the increase of large-scale unlabeled data, weak-supervised, self-supervised, and unsupervised methods are receiving more attention [22, 23, 29, 58, 62, 68, 83, 86].”
BackgroundCrowdAct: Achieving High-Quality Crowdsourced Datasets in Mobile Activity Recognition
Mairittha, N., Mairittha, T., Lago, P., & Inoue, S. (2021) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3432222 · Cited by 20
Haladjian, J. (2019) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3369813 · Cited by 19
Caramaschi, S., Papini, G. B., & Caiani, E. G. (2023) · Applied Sciences · doi:10.3390/app13074175 · Cited by 11 · cited 1×
“Motivated by rotation-based augmentation on the accelerometer sensor [6, 74], we design coordinate transformations to obtain sensor readings from various orientations.”
MethodUnsupervised domain adaptation for robust sensory systems
Mathur, A., Isopoussu, A., Bianchi‐Berthouze, N., Lane, N. D., & Kawsar, F. (2019) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/3341162.3345609 · Cited by 9 · cited 1×
“Paradigm I : Paradigm II: Training with data from source dataset ( 𝐷 ) and unlabeled data from target dataset ( 𝐷 ) [25, 47, 48].”
MethodUnsupervised Diffusion Model for Sensor-based Human Activity Recognition
Zuo, S., Rey, V. F., Suh, S., Sigg, S., & Lukowicz, P. (2023) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/3594739.3610797 · Cited by 8
MMTSA: Multimodal Temporal Segment Attention Network for Efficient Human Activity Recognition
Gao, Z., Wang, Y., Chen, J., Xing, J., Patel, S., Liu, X., & Shi, Y. (2022) · arXiv · doi:10.48550/arxiv.2210.09222 · Cited by 6
KATN: Key Activity Detection via Inexact Supervised Learning
You, X., Zhang, L., Yu, H., Yuan, M., & Li, X. (2021) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3494957 · Cited by 5
Research works printed but not linked: 22
- Si-An Chen, Chun-Liang Li, Nate Yoder, Sercan O Arik, and Tomas Pfister. 2023. Tsmixer: An all-mlp architecture for time series forecasting. arXiv preprint arXiv:2303.06053 (2023). · arXiv
- Ting Chen, Simon Kornblith, Mohammad Norouzi, and Geoffrey Hinton. 2020. A simple framework for contrastive learning of visual representations. In International conference on machine learning. PMLR, 1597--1607.
- Jiaxiang Dong, Haixu Wu, Haoran Zhang, Li Zhang, Jianmin Wang, and Mingsheng Long. 2023. SimMTM: A Simple Pre-Training Framework for Masked Time-Series Modeling. arXiv preprint arXiv:2302.00861 (2023). · arXiv
- Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai Thomas Unterthiner Mostafa Dehghani Matthias Minderer Georg Heigold Sylvain Gelly et al. 2020. An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929 (2020). · arXiv
- Emadeldeen Eldele, Mohamed Ragab, Zhenghua Chen, Min Wu, Chee Keong Kwoh, Xiaoli Li, and Cuntai Guan. 2021. Time-series representation learning via temporal and contextual contrasting. arXiv preprint arXiv:2106.14112 (2021). · arXiv
- John Cristian Borges Gamboa. 2017. Deep learning for time-series analysis. arXiv preprint arXiv:1701.01887 (2017). · arXiv
- Hassan Ismail Fawaz, Germain Forestier, Jonathan Weber, Lhassane Idoumghar, and Pierre-Alain Muller. 2019. Deep learning for time series classification: a review. Data mining and knowledge discovery 33, 4 (2019), 917--963.
- Aryan Jadon, Avinash Patil, and Shruti Jadon. 2022. A Comprehensive Survey of Regression Based Loss Functions for Time Series Forecasting. arXiv preprint arXiv:2211.02989 (2022). · arXiv
- Junguang Jiang, Yang Shu, Jianmin Wang, and Mingsheng Long. 2022. Transferability in deep learning: A survey. arXiv preprint arXiv:2201.05867 (2022). · arXiv
- Jacob Devlin Ming-Wei Chang Kenton and Lee Kristina Toutanova. 2019. Bert: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of naacL-HLT, Vol. 1. 2.
- Taesung Kim, Jinhee Kim, Yunwon Tae, Cheonbok Park, Jang-Ho Choi, and Jaegul Choo. 2021. Reversible instance normalization for accurate time-series forecasting against distribution shift. In International Conference on Learning Representations.
- Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014). · arXiv
- Zikang Leng, Hyeokhyen Kwon, and Thomas Plötz. 2023. On the Benefit of Generative Foundation Models for Human Activity Recognition. arXiv preprint arXiv:2310.12085 (2023). · arXiv
- Wang Lu, Jindong Wang, Xinwei Sun, Yiqiang Chen, and Xing Xie. 2023. Out-of-distribution Representation Learning for Time Series Classification. In The Eleventh International Conference on Learning Representations. https://openreview.net/forum?id=gUZWOE42l6Q
- Qianli Ma, Zhen Liu, Zhenjing Zheng, Ziyang Huang, Siying Zhu, Zhongzhong Yu, and James T Kwok. 2023. A Survey on Time-Series Pre-Trained Models. arXiv preprint arXiv:2305.10716 (2023). · arXiv
- Riccardo Presotto, Sannara Ek, Gabriele Civitarese, François Portet, Philippe Lalanda, and Claudio Bettini. 2023. Combining Public Human Activity Recognition Datasets to Mitigate Labeled Data Scarcity. arXiv preprint arXiv:2306.13735 (2023). · arXiv
- Xue Wang Liang Sun Rong Jin Tian Zhou Peisong Niu. 2023. One Fits All: Power General Time Series Analysis by Pretrained LM. In NeurIPS.
- Ilya O Tolstikhin, Neil Houlsby, Alexander Kolesnikov, Lucas Beyer, Xiaohua Zhai, Thomas Unterthiner, Jessica Yung, Andreas Steiner, Daniel Keysers, Jakob Uszkoreit, et al. 2021. Mlp-mixer: An all-mlp architecture for vision. Advances in neural information processing systems 34 (2021), 24261--24272.
- Dmitry Ulyanov, Andrea Vedaldi, and Victor Lempitsky. 2017. Instance Normalization: The Missing Ingredient for Fast Stylization. arXiv:1607.08022 [cs.CV] · arXiv
- Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. Advances in neural information processing systems 30 (2017).
- Zhiguang Wang, Weizhong Yan, and Tim Oates. 2017. Time series classification from scratch with deep neural networks: A strong baseline. In 2017 International joint conference on neural networks (IJCNN). IEEE, 1578--1585.
- Hongyi Zhang, Moustapha Cisse, Yann N Dauphin, and David Lopez-Paz. 2017. mixup: Beyond empirical risk minimization. arXiv preprint arXiv:1710.09412 (2017). · arXiv
Cited by
Qureshi, T. S., Shahid, M. H., Farhan, A. A., & Alamri, S. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11275-x · Cited by 69
GOAT: A Generalized Cross-Dataset Activity Recognition Framework with Natural Language Supervision
Miao, S., & Chen, L. (2024) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3699736 · Cited by 27
LLM4HAR: Generalizable On-device Human Activity Recognition with Pretrained LLMs
Hong, Z., Song, Y., Li, Z., Yu, A., Zhong, S., Ding, Y. C., He, T., & Zhang, D. (2025) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3711896.3737226 · Cited by 34
Self-citationBian, S., Liu, M., Rey, V. F., Geißler, D., & Lukowicz, P. (2025) · ACM International Symposium on Wearable Computers (ISWC) · doi:10.1145/3715071.3750410 · Cited by 24
PhyMask: An Adaptive Masking Paradigm for Efficient Self-Supervised Learning in IoT
Kara, D., Kimura, T., Chen, Y., Li, J., Wang, R., Chen, Y., Wang, T., Liu, S., & Abdelzaher, T. (2024) · ACM Conference on Embedded Networked Sensor Systems (SenSys) · doi:10.1145/3666025.3699325 · Cited by 20
Metadata
- Authors
- Hong, Z., Li, Z., Zhong, S., Lyu, W., Wang, H., Ding, Y., He, T., & Zhang, D.
- Affiliations
- Rutgers, The State University of New Jersey (US)
- Jingdong (China) (CN)
- The University of Texas at Dallas (US)
- Venue
- Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Published
- 2024-05-13
- Volume
- 8
- Issue
- 2
- Pages
- 1-26
- ISSN
- 2474-9567 (ISSN-L)
- OpenAlex
- W4396919944
- Cited by
- 67
- References
- 66
- Citations by year
- 2026: 26 · 2025: 35 · 2024: 6
- FWCI
- 9.38
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies (publishedVersion)
- Funders
- National Science and Technology Major Project (2021ZD0114200)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Signal Processing › Time Series Analysis and Forecasting
- Keywords
- human activity recognition, cross-dataset generalization, domain shift, wearable sensors, smartphone sensors, domain adaptation, representation learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.