CoChat

Self-supervised Human Activity Recognition by Learning to Predict Cross-Dimensional Motion

Open access
Rahimi Taghanaki, Setareh, Rainbow, Michael J, Etemad, Ali · 2021 · 2021 International Symposium on Wearable Computers

The DOI matches its Crossref record; 35 of the 36 references it cites were found in a registry or an index; 12 of the 25 sources its claims cite were checked for support.

Abstract

We propose the use of self-supervised learning for human activity recognition with smartphone accelerometer data. Our proposed solution consists of two steps. First, the representations of unlabeled input signals are learned by training a deep convolutional neural network to predict a segment of accelerometer values. Our model exploits a novel scheme to leverage past and present motion in x and y dimensions, as well as past values of the z axis to predict values in the z dimension. This cross-dimensional prediction approach results in effective pretext training with which our model learns to extract strong representations. Next, we freeze the convolution blocks and transfer the weights to our downstream network aimed at human activity recognition. For this task, we add a number of fully connected layers to the end of the frozen network and train the added layers with labeled accelerometer signals to learn to classify human activities. We evaluate the performance of our method on three publicly available human activity datasets: UCI HAR, MotionSense, and HAPT. The results show that our approach outperforms the existing methods and sets new state-of-the-art results.

Overview

CoChat Summary

TL;DR

The paper proposes a self-supervised human activity recognition framework that learns accelerometer representations by predicting future z-axis motion from past/present x and y and past z, then freezes the convolutional blocks and transfers them to a downstream HAR classifier. It reports state-of-the-art results on UCI HAR, MotionSense, and HAPT.

Key findings

  • The pretext motion-prediction task achieved \(R^2 = 0.682 \pm 0.062\), which the authors interpret as strongly learned representations.
  • On UCI HAR, the self-supervised model reached accuracy \(0.908 \pm 0.036\) and weighted F1 \(0.908 \pm 0.036\); fine-tuning gave accuracy \(0.906 \pm 0.038\) and weighted F1 \(0.906 \pm 0.038\).
  • On MotionSense, the self-supervised model reached accuracy \(0.920 \pm 0.022\) and weighted F1 \(0.921 \pm 0.022\); fine-tuning improved accuracy to \(0.933 \pm 0.024\) and weighted F1 to \(0.934 \pm 0.023\).
  • On HAPT, the self-supervised model reached accuracy \(0.899 \pm 0.034\) and weighted F1 \(0.898 \pm 0.034\); fine-tuning gave accuracy \(0.901 \pm 0.038\) and weighted F1 \(0.900 \pm 0.038\). With only 1% labeled data, the self-supervised model clearly outperformed a fully supervised model of the same architecture, while at 100% labeled data the two were relatively similar.

Methods

  • Two-stage design: a deep CNN \(H_{predict}\) is trained with MSE loss to predict a 0.48-second future segment of the z axis from 2.56 seconds of x and y and 2.08 seconds of past z, with 50% overlap between input segments. The convolution blocks are then frozen and transferred to \(H_{HAR}\), which adds fully connected layers and is trained with entropy loss and 20% dropout.
  • Data: three public smartphone accelerometer datasets — UCI HAR (30 participants, 6 activities, 50 Hz), MotionSense (24 participants, 6 activities, 50 Hz), and HAPT (30 participants, 12 activities, 50 Hz).
  • Evaluation: user-split holdout validation, randomly selecting 20% of participants per dataset for testing and 10% of training data for validation, repeated 5 times so all users appear once in the test set and 4 times in training; results are averaged. Metrics are \(R^2\) for pretext prediction and accuracy plus mean/weighted F1 for HAR.

Limitations

  • The paper states future work could use additional datasets for the pretext self-supervised task to improve generalized motion representations, and that CNN-RNN-based methods may better learn temporal dependencies. No explicit limitations section is provided.
  • Evident from the text: all downstream evaluations are within individual datasets, and no cross-dataset transfer results are reported despite the claim that the learned features can be used across different datasets.
  • Evident from the text: the method uses accelerometer signals only, although the described datasets also contain gyroscope data.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1145/3460421.3480417

Cites

35 of 35 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Figure 1 The proposed self-supervised architecture is presented.
Figure 1 The proposed self-supervised architecture is presented.From the PDF
Image 2
From the PDF

Verification

Claims the paper makes

9 Valid · 1 Not valid · 5 Not checked · 24 Own results and interpretations

25 more claims · 2 with their cited sources checked

Create a free account to see all 39 claims and every source verdict.

See all claims — free account
  • It may state two separate claims as one. 5
  • The quote only partly states this claim. 2
  • Probably not a substantial claim. 6

Create a free account to see these claims.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

1 of 1

Citations

Cites

Show all 35 references

Cited by

See all 22

Metadata

Authors
Rahimi Taghanaki, S., Rainbow, M. J., & Etemad, A.
Affiliations
  • Queen's University, Canada
  • Queen's University (CA)
Venue
2021 International Symposium on Wearable Computers
Publisher
ACM
Published
2021-09-21
Pages
23-27
OpenAlex
W3196399896
Cited by
22
References
36
Citations by year
2026: 3 · 2025: 3 · 2024: 7 · 2023: 5 · 2022: 4
FWCI
1.31
Type
conference paper
Language
en
Open access
Locations
  • International Symposium on Wearable Computers (publishedVersion, public-domain)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
  • Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
Keywords
human activity recognition, self-supervised learning, smartphone accelerometer, transfer learning, unlabeled data, UCI-HAR

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Self-supervised Human Activity Recognition by Learning to Predict Cross-Dimensional Motion. https://app.cochat.ai/papers/10.1145/3460421.3480417
The paper
Rahimi Taghanaki, S., Rainbow, M. J., & Etemad, A. (2021). Self-supervised Human Activity Recognition by Learning to Predict Cross-Dimensional Motion. 2021 International Symposium on Wearable Computers. https://doi.org/10.1145/3460421.3480417

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.