Reducing Label Dependency in Human Activity Recognition with Wearables: From Supervised Learning to Novel Weakly Self-Supervised Approaches
Open accessThe DOI matches its Crossref record; 67 of the 67 references it cites were found in a registry or an index; 8 of the 44 sources its claims cite were checked for support.
Abstract
Human activity recognition (HAR) using wearable sensors has advanced through various machine learning paradigms, each with inherent trade-offs between performance and labeling requirements. While fully supervised techniques achieve high accuracy, they demand extensive labeled datasets that are costly to obtain. Conversely, unsupervised methods eliminate labeling needs but often deliver suboptimal performance. This paper presents a comprehensive investigation across the supervision spectrum for wearable-based HAR, with particular focus on novel approaches that minimize labeling requirements while maintaining competitive accuracy. We develop and empirically compare: (1) traditional fully supervised learning, (2) basic unsupervised learning, (3) a weakly supervised learning approach with constraints, (4) a multi-task learning approach with knowledge sharing, (5) a self-supervised approach based on domain expertise, and (6) a novel weakly self-supervised learning framework that leverages domain knowledge and minimal labeled data. Experiments across benchmark datasets demonstrate that: (i) our weakly supervised methods achieve performance comparable to fully supervised approaches while significantly reducing supervision requirements; (ii) the proposed multi-task framework enhances performance through knowledge sharing between related tasks; (iii) our weakly self-supervised approach demonstrates remarkable efficiency with just 10% of labeled data. These results not only highlight the complementary strengths of different learning paradigms, offering insights into tailoring HAR solutions based on the availability of labeled data, but also establish that our novel weakly self-supervised framework offers a promising solution for practical HAR applications where labeled data are limited.
Overview
CoChat Summary
TL;DR
The paper compares supervised, unsupervised, weakly supervised, self-supervised, and hybrid weakly self-supervised methods for wearable-sensor human activity recognition (HAR) to reduce label dependence. Across three benchmark datasets, the weakly supervised and hybrid methods are reported to approach or exceed fully supervised performance while using far fewer labels.
Key findings
- The weakly supervised single-task method achieved 94.36% accuracy on UCI-Smartphone, 98.56% on PAMAP2, and 97.96% on REALDISP, substantially outperforming the unsupervised baseline (63.69%, 77.06%, 64.01%).
- The weakly supervised multi-task method achieved 98.85%, 98.93%, and 98.22% accuracy on the three datasets, and on UCI-Smartphone it exceeded the supervised TCN baseline (98.85% vs. 98.66%).
- The self-supervised method outperformed the standard autoencoder on all datasets: 74.01% vs. 63.69% on UCI-Smartphone, 85.43% vs. 77.06% on PAMAP2, and 68.12% vs. 64.01% on REALDISP.
- The weakly self-supervised method improved further with more labels: with 1% labeled data it reached 80.15%, 91.28%, and 75.15%, and with 10% labeled data it reached 93.52%, 99.04%, and 92.23%; on PAMAP2, 99.04% exceeded the fully supervised TCN baseline of 95.27%.
Methods
- The study systematically compares six paradigms: fully supervised learning, unsupervised autoencoders on handcrafted statistical features, weakly supervised Siamese/contrastive learning with pairwise similarity constraints, weakly supervised multi-task learning with an added person-identification task, self-supervised learning with temporal and feature consistency losses, and a two-stage weakly self-supervised framework combining self-supervised pretraining with weak supervision.
- Evaluation was conducted on three benchmark HAR datasets: UCI-Smartphone (30 participants, 12 activities), PAMAP2 (9 participants, 12 activities), and REALDISP (17 participants, 33 activities).
- The paper reports using accuracy and F1-score as metrics, with stratified splits and k-means clustering on learned latent representations for the non-classification approaches.
Limitations
- The paper notes that fully supervised methods require extensive labeled data, while unsupervised methods often perform worse due to lack of guidance; this is stated as a general trade-off in the paper.
- The authors state that temporal-consistency self-supervision can struggle on activity transitions such as sit-to-stand or stand-to-walk, where signal patterns are ambiguous; this may limit effectiveness.
- Evident from the text: the evaluation is restricted to three benchmark datasets and to ideal-placement settings for REALDISP, so the reported results may not fully cover broader real-world deployment variability.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures









Verification
Claims the paper makes
5 Valid · 0 Not valid · 18 Not checked · 94 Own results and interpretations
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“HAR and person identification exhibit a strong connection”
§ Reducing Label Dependency in Human Activity Recognition with Wearables: From Supervised Learning to Novel Weakly Self-Supervised Approaches > 1. Introduction
What the sources say
- Not checked yetcites [3] Ruder, S. (2017). An Overview of Multi-Task Learning in Deep Neural Networks. arXiv.
- Supportedcites [4] Sheng, 2020, Weakly supervised multi-task representation learning for human activity analysis using wearables, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. source
The Introduction states that human activity recognition (HAR) and person identification are closely related. The Ablation Studies section says the results confirm that relationship, directly supporting the paraphrase. (LLM, conf=0.94)
- Could not verifycites [5] Saeed, 2019, Multi-task Self-Supervised Learning for Human Activity Detection, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. sourceExperimental — accuracy not yet measured
The paper’s Introduction (p. 1) and Evaluation (p. 8) discuss human activity recognition and learned sensor representations, but do not address a connection to person identification. Searches for person identification, user identification, and subject identity found no passage making that connection. (LLM, conf=0.73)
boostedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“the proposed multi-task framework enhances performance through knowledge sharing between related tasks”
§ Reducing Label Dependency in Human Activity Recognition with Wearables: From Supervised Learning to Novel Weakly Self-Supervised Approaches > Abstract Human activity recognition (HAR) using wearable sensors has advanced through various machine learning paradigms, each with inherent trade-offs between performance and labeling requirements. While fully supervised techniques achieve high accuracy, they demand extensive labeled datasets that are costly to obtain. Conversely, unsupervised methods eliminate labeling needs but often deliver suboptimal performance. This paper presents a comprehensive investigation across the supervision spectrum for wearable-based HAR, with particular focus on novel approaches that minimize labeling requirements while maintaining competitive accuracy. We develop and empirically compare: (1) traditional fully supervised learning, (2) basic unsupervised learning, (3) a weakly supervised learning approach with constraints, (4) a multi-task learning approach with knowledge sharing, (5) a self-supervised approach based on domain expertise, and (6) a novel weakly self-supervised learning framework that leverages domain knowledge and minimal labeled data. Experiments across benchmark datasets demonstrate that: (i) our weakly supervised methods achieve performance comparable to fully supervised approaches while significantly reducing supervision requirements; (ii) the proposed multi-task framework enhances performance through knowledge sharing between related tasks; (iii) our weakly self-supervised approach demonstrates remarkable efficiency with just 10% of labeled data. These results not only highlight the complementary strengths of different learning paradigms, offering insights into tailoring HAR solutions based on the availability of labeled data, but also establish that our novel weakly self-supervised framework offers a promising solution for practical HAR applications where labeled data are limited.
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“our weakly self-supervised approach demonstrates remarkable efficiency with just 10% of labeled data”
§ Reducing Label Dependency in Human Activity Recognition with Wearables: From Supervised Learning to Novel Weakly Self-Supervised Approaches > Abstract Human activity recognition (HAR) using wearable sensors has advanced through various machine learning paradigms, each with inherent trade-offs between performance and labeling requirements. While fully supervised techniques achieve high accuracy, they demand extensive labeled datasets that are costly to obtain. Conversely, unsupervised methods eliminate labeling needs but often deliver suboptimal performance. This paper presents a comprehensive investigation across the supervision spectrum for wearable-based HAR, with particular focus on novel approaches that minimize labeling requirements while maintaining competitive accuracy. We develop and empirically compare: (1) traditional fully supervised learning, (2) basic unsupervised learning, (3) a weakly supervised learning approach with constraints, (4) a multi-task learning approach with knowledge sharing, (5) a self-supervised approach based on domain expertise, and (6) a novel weakly self-supervised learning framework that leverages domain knowledge and minimal labeled data. Experiments across benchmark datasets demonstrate that: (i) our weakly supervised methods achieve performance comparable to fully supervised approaches while significantly reducing supervision requirements; (ii) the proposed multi-task framework enhances performance through knowledge sharing between related tasks; (iii) our weakly self-supervised approach demonstrates remarkable efficiency with just 10% of labeled data. These results not only highlight the complementary strengths of different learning paradigms, offering insights into tailoring HAR solutions based on the availability of labeled data, but also establish that our novel weakly self-supervised framework offers a promising solution for practical HAR applications where labeled data are limited.
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“we conducted experiments with extremely limited label availability (1%, 5%, and 10% of labeled data), showing how our combined framework progressively improves performance as more labels become available”
§ Reducing Label Dependency in Human Activity Recognition with Wearables: From Supervised Learning to Novel Weakly Self-Supervised Approaches > 1. Introduction
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Its performance demonstrates a clear trend: as the amount of labeled data increases, so does the model’s effectiveness.”
§ Reducing Label Dependency in Human Activity Recognition with Wearables: From Supervised Learning to Novel Weakly Self-Supervised Approaches > 4. Evaluation and Experiments > 4.2. Results and Analysis
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
46 more claims
Create a free account to see all 117 claims and to verify the 36 references still open.
- Probably not a substantial claim. 34
- It may state two separate claims as one. 41
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Reducing Label Dependency in Human Activity Recognition with Wearables: From Supervised Learning to Novel Weakly Self-Supervised Approaches > 4. Evaluation and Experiments > 4.2. Results and Analysis
“While it does not consistently outperform all supervised methods, it achieves results comparable to or better than several fully supervised techniques despite not requiring explicitly labeled data during training.”
§ Reducing Label Dependency in Human Activity Recognition with Wearables: From Supervised Learning to Novel Weakly Self-Supervised Approaches > 4. Evaluation and Experiments > 4.3. Visualization
“As shown in Figure 8a,b, the weakly supervised single-task and multi-task approaches produce the most distinct clusters, benefiting from the use of all labeled data.”
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · cited 2×
“Each selected technique addresses specific challenges in HAR: autoencoders [36] for unsupervised representation learning, ResNet [37] for handling deep architectures without degradation, Siamese networks [38] for similarity-based learning in weakly supervised settings, temporal convolutional…”
(2008) · Journal of Machine Learning Research · Cited by 33,051
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818 · cited 1×
“Each convolutional layer is followed by batch normalization (BN) [49], which stabilizes optimization by reparameterizing the problem into a more tractable form.”
(2010) · International Conference on Machine Learning · Cited by 13,995
Scaling Laws for Neural Language Models
Kaplan, J., McCandlish, S., Henighan, T., Brown, T. B., Chess, B., Child, R., Gray, S., Radford, A., Wu, J., & Amodei, D. (2020) · arXiv · doi:10.48550/arxiv.2001.08361 · Cited by 9,550 · cited 1×
“This characteristic holds significant value, given that the magnitude of the dataset plays a pivotal role in enhancing the real-world performance of models in downstream tasks, as highlighted by studies such as [27].”
Extracting and composing robust features with denoising autoencoders
Vincent, P., Larochelle, H., Bengio, Y., & Manzagol, P.-A. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390294 · Cited by 7,436 · cited 1×
“For instance, Vincent et al. [41] used denoising autoencoders for robust feature learning, Kingma and Welling [42] introduced variational autoencoders for generative modeling, and Sakurada and Yairi [43] employed autoencoders for anomaly detection in time-series data.”
Dimensionality Reduction by Learning an Invariant Mapping
Hadsell, R., Chopra, S., & LeCun, Y. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.100 · Cited by 5,336 · cited 1×
“…deep architectures without degradation, Siamese networks [38] for similarity-based learning in weakly supervised settings, temporal convolutional networks (TCNs) [39] for effective temporal pattern extraction, and contrastive loss functions [40] for implementing pairwise constraint-based learning.”
Learning a Similarity Metric Discriminatively, with Application to Face Verification
Chopra, S., Hadsell, R., & LeCun, Y. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.202 · Cited by 4,036 · cited 2×
“We first developed a weakly supervised approach inspired by previous research in computer vision [1,2].”
InfluentialSiamese Neural Networks for One-shot Image Recognition
Koch, G. E., Zemel, R. S., & Salakhutdinov, R. (2015) · Cited by 3,740
Character-level Convolutional Networks for Text Classification
Zhang, X., Zhao, J., & LeCun, Y. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1509.01626 · Cited by 3,205 · cited 1×
“For example, Lea et al. [51] utilized a TCN for action segmentation and detection, Zhang et al. [52] applied it for text classification, and Bednarski et al. [53] employed it in health informatics for predicting clinical length of stay and mortality.”
Nonlinear principal component analysis using autoassociative neural networks
Kramer, M. A. (1991) · AIChE Journal · doi:10.1002/aic.690370209 · Cited by 3,037 · cited 1×
“Each selected technique addresses specific challenges in HAR: autoencoders [36] for unsupervised representation learning, ResNet [37] for handling deep architectures without degradation, Siamese networks [38] for similarity-based learning in weakly supervised settings, temporal convolutional…”
Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition
Ordóñez, F., & Roggen, D. (2016) · Sensors · doi:10.3390/s16010115 · Cited by 2,761 · cited 9×
“Then, the feature extraction can be defined as Equation (8): Finally, x i is used as the input to the model.”
InfluentialRevisiting Unreasonable Effectiveness of Data in Deep Learning Era
Sun, C., Shrivastava, A., Singh, S., & Gupta, A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.97 · Cited by 2,484 · cited 1×
“A larger dataset in supervised representation learning has been shown to positively impact downstream performance [23].”
Unsupervised Representation Learning by Predicting Image Rotations
Gidaris, S., Singh, P., & Komodakis, N. (2018) · arXiv · doi:10.48550/arxiv.1803.07728 · Cited by 2,477 · cited 2×
“As a concrete example, in the image rotation prediction task [33], the authors define a collection of K discrete geometric transformations, denoted as T = { t ( ·| r ) } = 0 .”
SIGNATURE VERIFICATION USING A “SIAMESE” TIME DELAY NEURAL NETWORK
BROMLEY, J., BENTZ, J. W., BOTTOU, L., GUYON, I., LECUN, Y., MOORE, C., SÄCKINGER, E., & SHAH, R. (1994) · Series in Machine Perception and Artificial Intelligence · doi:10.1142/9789812797926_0003 · Cited by 2,350
Temporal Convolutional Networks for Action Segmentation and Detection
Lea, C., Flynn, M. D., Vidal, R., Reiter, A., & Hager, G. D. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.113 · Cited by 2,238 · cited 1×
“For example, Lea et al. [51] utilized a TCN for action segmentation and detection, Zhang et al. [52] applied it for text classification, and Bednarski et al. [53] employed it in health informatics for predicting clinical length of stay and mortality.”
Deep learning for sensor-based activity recognition: A survey
Wang, J., Chen, Y., Hao, S., Peng, X., & Hu, L. (2019) · Pattern Recognition Letters · doi:10.1016/j.patrec.2018.02.010 · Cited by 2,014 · cited 2×
“For a comprehensive understanding of various aspects and methodologies in HAR, we refer readers to survey papers by Minh Dang et al. [17], Wang et al. [18], and Zhang et al. [19], which offer in-depth discussions on different techniques in HAR research.”
(2013) · RECERCAT (Consorci de Serveis Universitaris de Catalunya) · Cited by 1,959
Inceptiontime: finding alexnet for time series classification
Ismail Fawaz, H., Lucas, B., Forestier, G., Pelletier, C., Schmidt, D. F., Weber, J., Webb, G. I., Idoumghar, L., Muller, P.-A., & Petitjean, F. (2020) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-020-00710-y · Cited by 1,788
Introducing a New Benchmarked Dataset for Activity Monitoring
Reiss, A., & Stricker, D. (2012) · 2012 16th International Symposium on Wearable Computers · doi:10.1109/iswc.2012.13 · Cited by 1,456 · cited 2×
“We evaluated the effectiveness of our proposed approaches on three benchmark datasets: UCI-Smartphone [6], PAMAP2 [66], and REALDISP [68], focusing on their performance in the HAR task with an emphasis on label efficiency.”
Anomaly Detection Using Autoencoders with Nonlinear Dimensionality Reduction
Sakurada, M., & Yairi, T. (2014) · Proceedings of the MLSDA 2014 2nd Workshop on Machine Learning for Sensory Data Analysis · doi:10.1145/2689746.2689747 · Cited by 1,438 · cited 1×
“For instance, Vincent et al. [41] used denoising autoencoders for robust feature learning, Kingma and Welling [42] introduced variational autoencoders for generative modeling, and Sakurada and Yairi [43] employed autoencoders for anomaly detection in time-series data.”
Siamese Recurrent Architectures for Learning Sentence Similarity
Mueller, J., & Thyagarajan, A. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10350 · Cited by 935
Temporal Convolutional Networks: A Unified Approach to Action Segmentation
Lea, C., Vidal, R., Reiter, A., & Hager, G. D. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-49409-8_7 · Cited by 924 · cited 1×
“…deep architectures without degradation, Siamese networks [38] for similarity-based learning in weakly supervised settings, temporal convolutional networks (TCNs) [39] for effective temporal pattern extraction, and contrastive loss functions [40] for implementing pairwise constraint-based learning.”
Convolutional Neural Networks for Human Activity Recognition using Mobile Sensors
Zeng, M., Nguyen, L. T., Yu, B., Mengshoel, O. J., Zhu, J., Wu, P., & Zhang, J. (2014) · Proceedings of the 6th International Conference on Mobile Computing, Applications and Services · doi:10.4108/icst.mobicase.2014.257786 · Cited by 876 · cited 1×
“Supervised deep learning techniques have seen development and utilization within HAR systems [13,63,64].”
Contrastive Representation Learning: A Framework and Review
Le-Khac, P. H., Healy, G., & Smeaton, A. F. (2020) · IEEE Access · doi:10.1109/access.2020.3031549 · Cited by 862 · cited 1×
“Common weakly supervised strategies include multiple instance learning using group-level labels [28], label propagation from a small labeled subset [29], and contrastive methods with pairwise constraints [30,31] (e.g., must-link, cannot-link).”
Transition-Aware Human Activity Recognition Using Smartphones
Reyes-Ortiz, J.-L., Oneto, L., Samà, A., Parra, X., & Anguita, D. (2016) · Neurocomputing · doi:10.1016/j.neucom.2015.07.085 · Cited by 740 · cited 2×
“For this study, postural transitions were grouped into a combined transition class, and sensor streams were segmented into 2.56 s windows with a 1.28 s overlap, following established practices [7].”
InfluentialMultiple instance learning: A survey of problem characteristics and applications
Carbonneau, M.-A., Cheplygina, V., Granger, E., & Gagnon, G. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2017.10.009 · Cited by 740 · cited 1×
“Common weakly supervised strategies include multiple instance learning using group-level labels [28], label propagation from a small labeled subset [29], and contrastive methods with pairwise constraints [30,31] (e.g., must-link, cannot-link).”
Sensor-based and vision-based human activity recognition: A comprehensive survey
Minh Dang, L., Min, K., Wang, H., Jalil Piran, M., Hee Lee, C., & Moon, H. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2020.107561 · Cited by 730 · cited 1×
“For a comprehensive understanding of various aspects and methodologies in HAR, we refer readers to survey papers by Minh Dang et al. [17], Wang et al. [18], and Zhang et al. [19], which offer in-depth discussions on different techniques in HAR research.”
Label Propagation for Deep Semi-Supervised Learning
Iscen, A., Tolias, G., Avrithis, Y., & Chum, O. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00521 · Cited by 686 · cited 1×
“Common weakly supervised strategies include multiple instance learning using group-level labels [28], label propagation from a small labeled subset [29], and contrastive methods with pairwise constraints [30,31] (e.g., must-link, cannot-link).”
Revisiting Self-Supervised Visual Representation Learning
Kolesnikov, A., Zhai, X., & Beyer, L. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00202 · Cited by 675 · cited 1×
“He et al. [37] showed their superior performance in image recognition tasks, Kolesnikov et al. [44] adapted ResNets for self-supervised visual representation learning, and Maweu et al. [45] applied them to time-series data to improve diagnostic accuracy in healthcare.”
Deep Learning in Human Activity Recognition with Wearable Sensors: A Review on Advances
Zhang, S., Li, Y., Zhang, S., Shahabi, F., Xia, S., Deng, Y., & Alshurafa, N. (2022) · Sensors · doi:10.3390/s22041476 · Cited by 625 · cited 1×
“For a comprehensive understanding of various aspects and methodologies in HAR, we refer readers to survey papers by Minh Dang et al. [17], Wang et al. [18], and Zhang et al. [19], which offer in-depth discussions on different techniques in HAR research.”
Deep, Convolutional, and Recurrent Models for Human Activity Recognition Using Wearables
Hammerla, N. Y., Halloran, S., & Ploetz, T. (2016) · arXiv · doi:10.48550/arxiv.1604.08880 · Cited by 606 · cited 2×
“Following prior work [64,73], sensor streams were downsampled from 100 Hz to 33.3 Hz and segmented into 5.12 s windows with a 1 s step size.”
InfluentialA Time Series is Worth 64 Words: Long-term Forecasting with Transformers
Nie, Y., Nguyen, N. H., Sinthong, P., & Kalagnanam, J. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2211.14730 · Cited by 548 · cited 1×
“Transformer-based approaches such as PatchTST [57] have shown strong performance in capturing long-range temporal dependencies and are increasingly applied in HAR tasks.”
Unsupervised Representation Learning by Sorting Sequences
Lee, H.-Y., Huang, J.-B., Singh, M., & Yang, M.-H. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.79 · Cited by 534 · cited 1×
“For sequential data, common tasks include predicting future steps, sorting scrambled sequences [34], or determining sequence ordering [35].”
TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysis
Wu, H., Hu, T., Liu, Y., Zhou, H., Wang, J., & Long, M. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2210.02186 · Cited by 431 · cited 1×
“Likewise, InceptionTime [58] and TimesNet [59] represent powerful architectures that extract multi-scale temporal features through hierarchical design.”
Multi-task Self-Supervised Learning for Human Activity Detection
Saeed, A., Ozcelebi, T., & Lukkien, J. (2019) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3328932 · Cited by 346
Learning Text Similarity with Siamese Recurrent Networks
Neculoiu, P., Versteegh, M., & Rotaru, M. (2016) · Proceedings of the 1st Workshop on Representation Learning for NLP · doi:10.18653/v1/w16-1617 · Cited by 341 · cited 1×
“In natural language processing, Mueller and Thyagarajan [46] introduced a Siamese RNN to evaluate semantic similarity between sentences, while Neculoiu et al. [47] employed one for job title normalization in recruitment analysis.”
Imaging and fusing time series for wearable sensor-based human activity recognition
Qin, Z., Zhang, Y., Meng, S., Qin, Z., & Choo, K.-K. R. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.06.014 · Cited by 309 · cited 1×
“Qin et al. [16], for instance, incorporated engineered wavelet features organized as an image input.”
Activity recognition from acceleration data based on discrete consine transform and SVM
He, Z., & Jin, L. (2009) · 2009 IEEE International Conference on Systems, Man and Cybernetics · doi:10.1109/icsmc.2009.5346042 · Cited by 266 · cited 1×
“Additionally, researchers have employed wavelet transform-based features [9], while He and Jin [10] proposed features derived from the discrete cosine transform.”
Contrastive Learning for Many-to-many Multilingual Neural Machine Translation
Pan, X., Wang, M., Wu, L., & Li, L. (2021) · doi:10.18653/v1/2021.acl-long.21 · Cited by 243 · cited 1×
“Chen et al. [54] employed contrastive learning for visual representations, Xu et al. [55] used similar techniques for learning sentence representations, and Pan et al. [56] applied contrastive loss for multilingual neural machine translation.”
Deep Activity Recognition Models with Triaxial Accelerometers
Alsheikh, M. A., Selim, A., Niyato, D. T., Doyle, L., Lin, S., & Tan, H.-P. (2015) · DR-NTU (Nanyang Technological University) · Cited by 204
Zeng, M., Gao, H., Yu, T., Mengshoel, O. J., Langseth, H., Lane, I., & Liu, X. (2018) · Proceedings of the 2018 ACM International Symposium on Wearable Computers · doi:10.1145/3267242.3267286 · Cited by 185 · cited 1×
“Following prior work [64,73], sensor streams were downsampled from 100 Hz to 33.3 Hz and segmented into 5.12 s windows with a 1 s step size.”
InfluentialSelf-supervised learning for human activity recognition using 700,000 person-days of wearable data
Yuan, H., Chan, S., Creagh, A. P., Tong, C., Acquah, A., Clifton, D. A., & Doherty, A. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01062-3 · Cited by 166 · cited 1×
“Yuan et al. [60] leverage large-scale wearable data to train generalizable representations using self-supervision.”
A benchmark dataset to evaluate sensor displacement in activity recognition
Baños, O., Damas, M., Pomares, H., Rojas, I., Tóth, M. A., & Amft, O. (2012) · Proceedings of the 2012 ACM Conference on Ubiquitous Computing · doi:10.1145/2370216.2370437 · Cited by 163 · cited 2×
“We evaluated the effectiveness of our proposed approaches on three benchmark datasets: UCI-Smartphone [6], PAMAP2 [66], and REALDISP [68], focusing on their performance in the HAR task with an emphasis on label efficiency.”
Assessing the State of Self-Supervised Human Activity Recognition Using Wearables
Haresamudram, H., Essa, I., & Plötz, T. (2022) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3550299 · Cited by 107 · cited 2×
“Haresamudram et al. [12] conduct an extensive evaluation of self-supervised methods across multiple HAR settings.”
Human Activity Recognition from Wearable Sensor Data Using Self-Attention
Saif, M., Tanjid Hasan Tonmoy, M., Kishor, K. B., Mahbubur Rahman, A. K. M., Ashraful Amin, M., Mohammad, S., Muhammad, A. H. K., & Amin, A. A. (2020) · Frontiers in Artificial Intelligence and Applications · doi:10.3233/faia200236 · Cited by 93
What Makes Good Contrastive Learning on Small-Scale Wearable-based Tasks?
Qian, H., Tian, T., & Miao, C. (2022) · Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining · doi:10.1145/3534678.3539134 · Cited by 67 · cited 1×
“Cheng et al. [61] propose contrastive learning techniques that emphasize invariance to augmentation, and Qian et al. [62] examine how contrastive learning can be adapted to small-scale HAR datasets.”
Cheng, D., Zhang, L., Bu, C., Wu, H., & Song, A. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.110789 · Cited by 55 · cited 1×
“Cheng et al. [61] propose contrastive learning techniques that emphasize invariance to augmentation, and Qian et al. [62] examine how contrastive learning can be adapted to small-scale HAR datasets.”
Self-Supervised Visual Representations Learning by Contrastive Mask Prediction
Zhao, Y., Wang, G., Luo, C., Zeng, W., & Zha, Z.-J. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01000 · Cited by 54 · cited 1×
“In computer vision, these include predicting missing image parts [32], determining relative patch positions, colorizing grayscale images, and predicting image rotations [33].”
Classification of Acceleration Waveforms during Walking by Wavelet Transform
Sekine, M., Ogawa, M., Togawa, T., Fukui, Y., & Tamura, T. (1997) · Methods of Information in Medicine · doi:10.1055/s-0038-1636855 · Cited by 50
Contrastive Learning Models for Sentence Representations
Xu, L., Xie, H., Li, Z., Wang, F. L., Wang, W., & Li, Q. (2023) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3593590 · Cited by 50 · cited 1×
“Chen et al. [54] employed contrastive learning for visual representations, Xu et al. [55] used similar techniques for learning sentence representations, and Pan et al. [56] applied contrastive loss for multilingual neural machine translation.”
Predicting What You Already Know Helps: Provable Self-Supervised Learning
Lee, J. D., Lei, Q., Saunshi, N., & Zhuo, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.01064 · Cited by 45 · cited 1×
“For sequential data, common tasks include predicting future steps, sorting scrambled sequences [34], or determining sequence ordering [35].”
Joint Learning of Speaker and Phonetic Similarities with Siamese Networks
Zeghidour, N., Synnaeve, G., Usunier, N., & Dupoux, E. (2016) · Interspeech 2016 · doi:10.21437/interspeech.2016-811 · Cited by 41 · cited 1×
“Zeghidour et al. [48] leveraged a multi-output Siamese network for speaker and phonetic similarity detection, demonstrating the versatility of this architecture.”
Bednarski, B. P., Singh, A. D., Zhang, W., Jones, W. M., Naeim, A., & Ramezani, R. (2022) · Scientific Reports · doi:10.1038/s41598-022-25472-z · Cited by 41 · cited 1×
“For example, Lea et al. [51] utilized a TCN for action segmentation and detection, Zhang et al. [52] applied it for text classification, and Bednarski et al. [53] employed it in health informatics for predicting clinical length of stay and mortality.”
Deep Transfer Learning with Graph Neural Network for Sensor-Based Human Activity Recognition
Liao, T., Zhao, J., Liu, Y., Ivanov, K., Xiong, J., & Yan, Y. (2022) · 2022 IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm55620.2022.9995660 · Cited by 36 · cited 2×
“…[69], which employs attention mechanisms to learn the importance of different sensor modalities and better capture spatio-temporal context; ResGCNN [70], which leverages residual graph convolutional neural networks to model relationships between sensor data and enable transfer learning…”
InfluentialGenerating Healthcare Time Series Data for Improving Diagnostic Accuracy of Deep Neural Networks
Maweu, B. M., Shamsuddin, R., Dakshit, S., & Prabhakaran, B. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3077049 · Cited by 35 · cited 1×
“He et al. [37] showed their superior performance in image recognition tasks, Kolesnikov et al. [44] adapted ResNets for self-supervised visual representation learning, and Maweu et al. [45] applied them to time-series data to improve diagnostic accuracy in healthcare.”
Weakly Supervised Multi-Task Representation Learning for Human Activity Analysis Using Wearables
Sheng, T., & Huber, M. (2020) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3397330 · Cited by 28
Self-citationSiamese Networks for Weakly Supervised Human Activity Recognition
Sheng, T., & Huber, M. (2019) · 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC) · doi:10.1109/smc.2019.8914045 · Cited by 21 · cited 1×
“Common weakly supervised strategies include multiple instance learning using group-level labels [28], label propagation from a small labeled subset [29], and contrastive methods with pairwise constraints [30,31] (e.g., must-link, cannot-link).”
Self-citationEvaluation Methods for Representation Learning: A Survey
Nozawa, K., & Sato, I. (2022) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/776 · Cited by 20 · cited 1×
“In supervised representation learning [20], the training process leverages labeled data, where each input sample x is associated with a corresponding target label y .”
Unsupervised Embedding Learning for Human Activity Recognition Using Wearable Sensor DataPreprint
Sheng, T., & Huber, M. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2307.11796 · Cited by 10
Self-citationConsistency Based Weakly Self-Supervised Learning for Human Activity Recognition with WearablesPreprint
Sheng, T., & Huber, M. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2408.07282 · Cited by 7 · cited 1×
“Various statistical features, such as mean, variance, and entropy, have been successfully integrated into models [6–8].”
Self-citationEfficient Deep Clustering of Human Activities and How to Improve EvaluationPreprint
Mahon, L., & Lukasiewicz, T. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2209.08335 · Cited by 6 · cited 2×
“…0.8942 0.8782 - Self-Attention [69] 0.8500 0.8500 - ResGCNN [70] 0.8313 0.8333 - Contrastive GNN [71] 0.9143 0.9182 - Efficient Deep Clustering [72] 0 The performance of each method is influenced by dataset-specific characteristics that also mirror challenges encountered in real-world…”
InfluentialContrastive Learning for Many-to-many Multilingual Neural Machine TranslationPreprint
Pan, X., Wang, M., Wu, L., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.09501 · Cited by 5 · cited 1×
“Chen et al. [54] employed contrastive learning for visual representations, Xu et al. [55] used similar techniques for learning sentence representations, and Pan et al. [56] applied contrastive loss for multilingual neural machine translation.”
(2022) · Communications in Computer and Information Science · doi:10.1007/978-3-031-24352-3 · Cited by 5
Tello, A., & Degeler, V. (2025) · ACM Symposium on Applied Computing · doi:10.1145/3672608.3707743 · Cited by 5
Self-supervised Learning for Human Activity Recognition Using 700,000 Person-days of Wearable Data
Yuan, H., Chan, S., Creagh, A. P., Tong, C., Acquah, A., Clifton, D. A., & Doherty, A. (2022) · arXiv · doi:10.48550/arxiv.2206.02909 · cited 1×
“Yuan et al. [60] leverage large-scale wearable data to train generalizable representations using self-supervision.”
Research works printed but not linked: 8
- Ruder, S. (2017). An Overview of Multi-Task Learning in Deep Neural Networks. arXiv.
- Chen, R., Luo, H., Zhao, F., Meng, X., Xie, Z., and Zhu, Y. (2021). Modeling Accurate Human Activity Recognition for Embedded Devices Using Multi-level Distillation. arXiv.
- Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv.
- McInnes, L., Healy, J., and Melville, J. (2020). UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction. arXiv.
- Mikolov, T., Grave, E., Bojanowski, P., Puhrsch, C., and Joulin, A. (2017). Advances in pre-training distributed word representations. arXiv.
- Kingma, D.P., and Welling, M. (2022). Auto-Encoding Variational Bayes. arXiv.
- Chen, T., Kornblith, S., Norouzi, M., and Hinton, G.E. (2020). A Simple Framework for Contrastive Learning of Visual Representations. arXiv.
- Aljalbout, E., Golkov, V., Siddiqui, Y., and Cremers, D. (2018). Clustering with Deep Learning: Taxonomy and New Methods. arXiv.
Cited by
Self-Supervised Gait Event Detection from Smartphone IMUs for Human Performance and Sports Medicine
TUDOR, A. C., Mănescu, D. C., & Mănescu, D. C. (2025) · Applied Sciences · doi:10.3390/app152211974 · Cited by 18
Kong, M., Zhao, X., Li, Q., Yu, Y., & Zhang, C. (2025) · Advanced Intelligent Systems · doi:10.1002/aisy.202501136 · Cited by 6
Liu, X., & Wang, G. (2026) · Mathematics · doi:10.3390/math14111932
Biomechanics-Informed Masked Autoencoder With Anchor Alignment for Robust Human Activity Recognition
Guo, T., Hou, F., Pang, Y., & Wang, Z. (2026) · IEEE Access · doi:10.1109/access.2026.3713236
“The present convergence of advanced wearable sensor capabilities, sophisticated self-supervised learning (SSL) paradigms, and a deepened understanding of human biomechanics presents a timely and unique opportunity to address these long-standing challenges [6], [7].”
Reducing Labeled Data Dependency with Self-Supervised Learning: Advances and applications
Tyagi, H., Bhardwaj, M. K., Bipin, Tyagi, S., Singh, P., & Himanshu (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-30005-8_20
Metadata
- Authors
- Sheng, T., & Huber, M.
- Affiliations
- The University of Texas at Arlington (US)
- Corresponding author
- Sheng, Taoran
- Venue
- Sensors
- Publisher
- MDPI AG
- Published
- 2025-06-28
- Volume
- 25
- Issue
- 13
- Pages
- 4032
- ISSN
- 1424-8220 (ISSN-L)
- PMC
- PMC12252065
- OpenAlex
- W4411802278
- Cited by
- 5
- References
- 63
- Citations by year
- 2026: 4 · 2025: 1
- FWCI
- 1.76
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Sensors (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Signal Processing › Time Series Analysis and Forecasting
- Keywords
- human activity recognition, wearable sensors, weakly supervised learning, multi-task learning, knowledge sharing, domain knowledge, limited labeled data, unsupervised learning, supervised learning
- MeSH terms
- Machine Learning, Supervised Machine Learning, Unsupervised Machine Learning, Wearable Electronic Devices, Algorithms, Humans, Human Activities
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.