CoChat
Sign Up
PreprintCited by 67Context-Aware Activity Recognition SystemsDomain Adaptation and Few-Shot LearningTime Series Analysis and Forecasting

Exploring Contrastive Learning in Human Activity Recognition for Healthcare

Open access
Tang, Chi Ian, Perez-Pozuelo, Ignacio, Spathis, Dimitris, Mascolo, Cecilia·2020·arXiv
DOI 10.48550/arxiv.2011.11542arXiv 2011.11542
Open this paper in CoChat — free accountOpen PDF

Abstract

Human Activity Recognition (HAR) constitutes one of the most important tasks for wearable and mobile sensing given its implications in human well-being and health monitoring. Motivated by the limitations of labeled datasets in HAR, particularly when employed in healthcare-related applications, this work explores the adoption and adaptation of SimCLR, a contrastive learning technique for visual representations, to HAR. The use of contrastive learning objectives causes the representations of corresponding views to be more similar, and those of non-corresponding views to be more different. After an extensive evaluation exploring 64 combinations of different signal transformations for augmenting the data, we observed significant performance differences owing to the order and the function thereof. In particular, preliminary results indicated an improvement over supervised and unsupervised learning methods when using fine-tuning and random rotation for augmentation, however, future work should explore under which conditions SimCLR is beneficial for HAR systems and other healthcare-related applications.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2011.11542

Cites

2 of 2 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Haresamudram et al. show that the SimCLR framework and multi-task self-supervised learning outperform other approaches, including BYOL, SimSiam, masked reconstruction, CPC and autoencoders for human activity recognition.

    “Haresamudram et al. [81] show that the SimCLR framework [184] and multi-task self-supervised learning [166], outperform other approaches, including BYOL, SimSiam, masked reconstruction, CPC and autoencoders for HAR.”

    From Past, Present, and Future of Sensor-based Human Activity Recognition Using Wearables: A Surveying Tutorial on a Still Challenging Task (2025) · cites this paper as [184]

    The Evaluation Results (p. 4) report that the paper’s SimCLR adaptation outperformed supervised training and a reproduced self-supervised HAR method. They do not compare SimCLR and multi-task self-supervised learning against BYOL, SimSiam, masked reconstruction, CPC, or autoencoders. The cited paper is by Tang et al., not Haresamudram et al. (LLM, conf=0.88)

    Experimental — accuracy not yet measured

  • When some labeled training data are available for new classes, self-supervised methods such as SimCLR can be leveraged to fine-tune learned models to effectively recognize new activities as well.

    “When some labeled training data are available for the new classes, selfsupervised methods such as SimCLR [184] can be leveraged to fine-tune learned models to effectively recognize new activities as well [81].”

    From Past, Present, and Future of Sensor-based Human Activity Recognition Using Wearables: A Surveying Tutorial on a Still Challenging Task (2025) · cites this paper as [184]

    The Introduction (p. 2) and Evaluation Results (p. 4) report that SimCLR representations performed well for activity recognition when fine-tuned with labels. But the Evaluation protocol (p. 4) tests on unseen subjects, not new activity classes, so the claim about recognizing new activities goes beyond what this paper shows. (LLM, conf=0.88)

    Experimental — accuracy not yet measured

  • In limited label scenarios, self-supervised learning has shown strong performance relative to end-to-end training.

    “In these scenarios, self-supervised learning has shown strong performance relative to end-to-end training, as encoder weights are learned from large-scale data, and only the classifier layers are updated with annotation information (multi-task self-supervision [166], SimCLR [184], CPC [80], or ColloSSL [93]).”

    From Past, Present, and Future of Sensor-based Human Activity Recognition Using Wearables: A Surveying Tutorial on a Still Challenging Task (2025) · cites this paper as [184]

    The Introduction (p. 2) says that SimCLR representations performed better than fully supervised training for sensor-based human activity recognition, and the Results (p. 4) report a gain of up to 0.020. This supports the performance comparison in a setting motivated by limited labels, but not as a general result for self-supervised methods. The Evaluation protocol (p. 4) also says the last encoder layer was fine-tuned, contrary to the citing sentence’s explanation that only classifier layers were updated. (LLM, conf=0.83)

    Experimental — accuracy not yet measured

  • Training first on large amounts of unlabeled data followed by fine-tuning on smaller quantities of labeled data has shown great promise for activity recognition applications.

    “This practice of training first on large amounts of unlabeled data, followed by the fine-tuning on smaller quantities of labeled data has shown great promise for activity recognition applications [26, 27, 62-64, 71, 72].”

    From Assessing the State of Self-Supervised Human Activity Recognition Using Wearables (2022) · cites this paper as [72]

    The Introduction (p. 2) says contrastive representations improved activity-recognition performance when fine-tuned with labels, and the Evaluation Results (p. 4) report a gain over fully supervised models. The paper supports the promise of unlabeled pre-training followed by labeled fine-tuning, but it does not establish the claimed comparison between large amounts of unlabeled data and smaller quantities of labeled data. (LLM, conf=0.83)

    Experimental — accuracy not yet measured

  • Tang et al. modified the SimCLR framework for sensor time series.

    “One such adaptation effort is the modification of the SimCLR framework for sensor time series by Tang et al. [184].”

    From Past, Present, and Future of Sensor-based Human Activity Recognition Using Wearables: A Surveying Tutorial on a Still Challenging Task (2025) · cites this paper as [184]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 18

  1. [1][1] Akin Avci, Stephan Bosch, Mihai Marin-Perianu, Raluca Marin-Perianu, and Paul Havinga. Activity recognition using inertial sensing for healthcare, wellbeing and sports applications: A survey. In 23th International conference on architecture of computing systems 2010 , pages 1-10. VDE, 2010. -
  2. [2][2] Song-Mi Lee, Sang Min Yoon, and Heeryon Cho. Human activity recognition from accelerometer data using convolutional neural network. In 2017 ieee international conference on big data and smart computing (bigcomp) , pages 131-134. IEEE, 2017. -
  3. [4][4] Aaqib Saeed, Tanir Ozcelebi, and Johan Lukkien. Multi-task self-supervised learning for human activity detection. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies , 3(2):1-30, 2019. -
  4. [5][5] Nils Y Hammerla, Shane Halloran, and Thomas Plötz. Deep, convolutional, and recurrent models for human activity recognition using wearables. arXiv preprint arXiv:1604.08880 , 2016. - · arXiv
  5. [7][7] Allan Stisen, Henrik Blunck, Sourav Bhattacharya, Thor Siiger Prentow, Mikkel Baun Kjærgaard, Anind Dey, Tobias Sonne, and Mads Møller Jensen. Smart devices are different: Assessing and mitigating mobile sensing heterogeneities for activity recognition. In Proceedings of the 13th ACM conference on embedded networked sensor systems , pages 127-140, 2015. -
  6. [11][11] Jennifer R Kwapisz, Gary M Weiss, and Samuel A Moore. Activity recognition using cell phone accelerometers. ACM SigKDD Explorations Newsletter , 12(2):74-82, 2011. -
  7. [12][12] Jesper E Van Engelen and Holger H Hoos. A survey on semi-supervised learning. Machine Learning , 109(2):373-440, 2020. -
  8. [13][13] Xiaojin Zhu and Andrew B Goldberg. Introduction to semi-supervised learning. Synthesis lectures on artificial intelligence and machine learning , 3(1):1-130, 2009. -
  9. [14][14] Ting Chen, Simon Kornblith, Mohammad Norouzi, and Geoffrey Hinton. A simple framework for contrastive learning of visual representations. arXiv preprint arXiv:2002.05709 , 2020. - · arXiv
  10. [15][15] Kaiming He, Haoqi Fan, Yuxin Wu, Saining Xie, and Ross Girshick. Momentum contrast for unsupervised visual representation learning. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 9729-9738, 2020. -
  11. [16][16] Aaron van den Oord, Yazhe Li, and Oriol Vinyals. Representation learning with contrastive predictive coding. arXiv preprint arXiv:1807.03748 , 2018. - · arXiv
  12. [17][17] Olivier J Hénaff, Aravind Srinivas, Jeffrey De Fauw, Ali Razavi, Carl Doersch, SM Eslami, and Aaron van den Oord. Data-efficient image recognition with contrastive predictive coding. arXiv preprint arXiv:1905.09272 , 2019. - · arXiv
  13. [19][19] Maja Stikic, Kristof Van Laerhoven, and Bernt Schiele. Exploring semi-supervised and active learning for activity recognition. In 2008 12th IEEE International Symposium on Wearable Computers , pages 81-88. IEEE, 2008. -
  14. [20][20] Godwin Ogbuabor and Robert La. Human activity recognition for healthcare using smartphones. In Proceedings of the 2018 10th International Conference on Machine Learning and Computing , pages 41-46, 2018. -
  15. [21][21] Abdulhamit Subasi, Mariam Radhwan, Rabea Kurdi, and Kholoud Khateeb. Iot based mobile healthcare system for human activity recognition. In 2018 15th Learning and Technology Conference (L&T) , pages 29-34. IEEE, 2018. -
  16. [22][22] Kihyuk Sohn. Improved deep metric learning with multi-class n-pair loss objective. In Advances in neural information processing systems , pages 1857-1865, 2016. -
  17. [23][23] Zhirong Wu, Yuanjun Xiong, Stella X Yu, and Dahua Lin. Unsupervised feature learning via non-parametric instance discrimination. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , pages 3733-3742, 2018. -
  18. [24][24] Terry T Um, Franz MJ Pfister, Daniel Pichler, Satoshi Endo, Muriel Lang, Sandra Hirche, Urban Fietzek, and Dana Kuli´ c. Data augmentation of wearable sensor data for parkinson's disease monitoring using convolutional neural networks. In Proceedings of the 19th ACM International Conference on Multimodal Interaction , pages 216-220, 2017.

Cited by

Sorted by citations

Authors
Tang, C. I., Perez-Pozuelo, I., Spathis, D., & Mascolo, C.
ORCID
Venue
arXiv
Publisher
arXiv
Published
2020
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2011.11542
arXiv
2011.11542
OpenAlex
W7028426426
Cited by
67
References
2
Citations by year
2025: 13 · 2024: 23 · 2023: 15 · 2022: 9 · 2021: 7
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • Cambridge University Engineering Department Publications Database (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
  • Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
  • Physical Sciences › Computer Science › Signal Processing › Time Series Analysis and Forecasting
Keywords
human activity recognition, contrastive learning, SimCLR, healthcare monitoring, wearable sensing, data augmentation, signal transformation, fine-tuning, random rotation, unsupervised learning, visual representation learning

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review