Cited by 11Context-Aware Activity Recognition SystemsDomain Adaptation and Few-Shot LearningHuman Pose and Action Recognition

Continual Egocentric Activity Recognition With Foreseeable-Generalized Visual–IMU Representations

Open access
He, Chiyuan, Cheng, Shaoxu, Qiu, Zihuan, Xu, Linfeng, Meng, Fanman, Wu, Qingbo, Li, Hongliang·2024·IEEE Sensors Journal

Published version of a preprint

Abstract

The rapid advancement of wearable sensors has significantly facilitated data collection in our daily lives. Human activity recognition (HAR), a prominent research area in wearable technology, has made substantial progress in recent years. However, the existing efforts often overlook the issue of functional scalability in models, making it challenging for deep models to adapt to application scenarios that require continuous evolution. Furthermore, when employing conventional continual learning techniques, we have observed an imbalance between visual-based and inertial-measurement-unit (IMU) sensing modalities during joint optimization, which hampers model generalization and poses a significant challenge. To obtain a generalized representation more adapted to continual tasks, we propose a motivational optimization scheme to address the limited generalization caused by the modal imbalance, enabling foreseeable generalization in a visual–IMU multimodal network. To prevent the forgetting of previously learned activities, we introduce a robust representation estimation technique and a pseudo representation (PR) generation strategy for continual learning. Experimental results on the egocentric activity dataset UESTC-MMEA-CL demonstrate the effectiveness of our proposed method. Furthermore, our method effectively leverages the generalization capabilities of IMU-based modal representations, outperforming state-of-the-art methods in various task settings.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/jsen.2024.3371975

Cites

69 of 69 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
He, C., Cheng, S., Qiu, Z., Xu, L., Meng, F., Wu, Q., & Li, H.
Affiliations
University of Electronic Science and Technology of China (CN)
Venue
IEEE Sensors Journal
Published
2024-04-15
Volume
24
Issue
8
Pages
12934-12945
ISSN
  • 1530-437X (ISSN-L)
  • 1558-1748
  • 2379-9153
OpenAlex
W4392567293
Cited by
11
References
68
Citations by year
2026: 4 · 2025: 5 · 2024: 2
FWCI
1.54
Type
journal article
Language
en
Open access
Locations
  • IEEE Sensors Journal (publishedVersion)
  • Figshare (submittedVersion, cc-by-nc-sa)
Funders
  • National Science and Technology Major Project (2021ZD0112001)
  • National Natural Science Foundation of China (62071086, 62271119)
  • Independent Research Project of Civil Aviation Flight Technology and Flight Safety Key Laboratory (FZ2022ZZ06)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
  • Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
Keywords
continual learning, human activity recognition, wearable sensors

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review