Cited by 55Context-Aware Activity Recognition SystemsHuman Mobility and Location-Based AnalysisGait Recognition and Analysis

Practically Adopting Human Activity Recognition

Open access
Xu, Huatao, Zhou, Pengfei, Tan, Rui, Li, Mo·2023·Proceedings of the 29th Annual International Conference on Mobile Computing and Networking

Abstract

Existing inertial measurement unit (IMU) based human activity recognition (HAR) approaches still face a major challenge when adopted across users in practice. The severe heterogeneity in IMU data significantly undermines model generalizability in wild adoption. This paper presents UniHAR, a universal HAR framework for mobile devices. To address the challenge of data heterogeneity, we thoroughly study augmenting data with the physics of the IMU sensing process and present a novel adoption of data augmentations for exploiting both unlabeled and labeled data. We consider two application scenarios of UniHAR, which can further integrate federated learning and adversarial training for improved generalization. UniHAR is fully prototyped on the mobile platform and introduces low overhead to mobile devices. Extensive experiments demonstrate its superior performance in adapting HAR models across four open datasets.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3570361.3613299

Cites

56 of 56 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • LIMU-BERT is a foundation model training framework that proposes to make use of unlabeled data with masked language modeling solution.

    “LIMU-BERT is a foundation model training framework that proposes to make use of the ever common unlabeled data with masked language modeling solution.”

    From Towards Customizable Foundation Models for Human Activity Recognition with Wearable Devices (2025) · cites this paper as [57]

    Section 8 (Related Work) describes LIMU-BERT as an early foundation model for extracting features from unlabeled IMU data. Section 5.1.1 says the authors embed LIMU-BERT in their design, which reconstructs randomly masked IMU readings. The paper does not call this a masked language modeling solution or clearly attribute that specific training method to LIMU-BERT itself. (LLM, conf=0.82)

    Experimental — accuracy not yet measured
  • A 3-dimensional rotation deterministically maps accelerometer and gyroscope signals across axes via a rotation matrix.

    “Physically, a 3-dimensional rotation deterministically maps accelerometer and gyroscope signals across axes via a rotation matrix29.”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 19

  1. [1]1. Martín Abadi, Paul Barham, Jianmin Chen, Zhifeng Chen, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Geoffrey Irving, Michael Isard, et al. 2016. {TensorFlow}: a system for {Large-Scale} machine learning. In 12th USENIX symposium on operating systems design and implementation (OSDI 16). 265-283.
  2. [9]9. Taesik Gong, Yeonsu Kim, Jinwoo Shin, and Sung-Ju Lee. 2019. Metasense: few-shot adaptation to untrained conditions in deep mobile sensing. In Proceedings of the 17th Conference on Embedded Networked Sensor Systems. 110-123.
  3. [13]13. Jeya Vikranth Jeyakumar, Liangzhen Lai, Naveen Suda, and Mani Srivastava. 2019. SenseHAR: a robust virtual activity sensor for smart- phones and wearables. In Proceedings of the 17th Conference on Embed- ded Networked Sensor Systems. 15-28.
  4. [14]14. Sijie Ji, Yaxiong Xie, and Mo Li. 2022. SiFall: Practical Online Fall Detection with RF Sensing. In Proceedings of the 20th ACM Conference on Embedded Networked Sensor Systems. 563-577.
  5. [21]21. Ang Li, Jingwei Sun, Pengcheng Li, Yu Pu, Hai Li, and Yiran Chen. 2021. Hermes: an efficient federated learning framework for heteroge- neous mobile clients. In Proceedings of the 27th Annual International Conference on Mobile Computing and Networking. 420-437.
  6. [23]23. Chenning Li, Xiao Zeng, Mi Zhang, and Zhichao Cao. 2022. PyramidFL: A fine-grained client selection framework for efficient federated learn- ing. In Proceedings of the 28th Annual International Conference on Mobile Computing And Networking. 158-171.
  7. [27]27. Shengzhong Liu, Shuochao Yao, Jinyang Li, Dongxin Liu, Tianshi Wang, Huajie Shao, and Tarek Abdelzaher. 2020. GIobalFusion: A Global Attentional Deep Learning Framework for Multisensor Infor- mation Fusion. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 1 (2020), 1-27.
  8. [28]28. Xiao Liu, Fanjin Zhang, Zhenyu Hou, Li Mian, Zhaoyu Wang, Jing Zhang, and Jie Tang. 2021. Self-supervised learning: Generative or contrastive. IEEE Transactions on Knowledge and Data Engineering (2021).
  9. [34]34. Xiaomin Ouyang, Zhiyuan Xie, Jiayu Zhou, Jianwei Huang, and Guo- liang Xing. 2021. ClusterFL: a similarity-aware federated learning system for human activity recognition. In Proceedings of the 19th An- nual International Conference on Mobile Systems, Applications, and Services. 54-66.
  10. [43]43. Zhiyao Sheng, Huatao Xu, Qian Zhang, and Dong Wang. 2022. Facilitat- ing Radar-Based Gesture Recognition With Self-Supervised Learning. In 2022 19th Annual IEEE International Conference on Sensing, Commu- nication, and Networking (SECON). IEEE, 154-162.
  11. [46]46. Connor Shorten, Taghi M Khoshgoftaar, and Borko Furht. 2021. Text data augmentation for deep learning. Journal of big Data 8 (2021), 1-34.
  12. [52]52. Chi Ian Tang, Ignacio Perez-Pozuelo, Dimitris Spathis, Soren Brage, Nick Wareham, and Cecilia Mascolo. 2021. SelfHAR: Improving Hu- man Activity Recognition through Self-training with Unlabeled Data. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 5, 1 (2021), 1-30.
  13. [53]53. Linlin Tu, Xiaomin Ouyang, Jiayu Zhou, Yuze He, and Guoliang Xing. 2021. FedDL: Federated Learning via Dynamic Layer Sharing for Hu- man Activity Recognition. In Proceedings of the 19th ACM Conference on Embedded Networked Sensor Systems. 15-28.
  14. [59]59. Qingsong Wen, Liang Sun, Fan Yang, Xiaomin Song, Jingkun Gao, Xue Wang, and Huan Xu. 2020. Time series data augmentation for deep learning: A survey. arXiv preprint arXiv:2002.12478 (2020). · arXiv
  15. [60]60. Qizhe Xie, Zihang Dai, Eduard Hovy, Thang Luong, and Quoc Le. 2020. Unsupervised data augmentation for consistency training. Advances in neural information processing systems 33 (2020), 6256-6268.
  16. [61]61. Haifeng Xing, Jinglong Li, Bo Hou, Yongjian Zhang, and Meifeng Guo. 2017. Pedestrian stride length estimation from IMU measurements and ANN based algorithm. Journal of Sensors 2017 (2017).
  17. [62]62. Huatao Xu, Pengfei Zhou, Rui Tan, Mo Li, and Guobin Shen. 2021. LIMU-BERT: Unleashing the Potential of Unlabeled Data for IMU Sensing Applications. In Proceedings of the 19th ACM Conference on Embedded Networked Sensor Systems. 220-233.
  18. [63]63. Jianbo Yang, Minh Nhut Nguyen, Phyo Phyo San, Xiaoli Li, and Shonali Krishnaswamy. 2015. Deep convolutional neural networks on multi- channel time series for human activity recognition.. In Ijcai, Vol. 15. Buenos Aires, Argentina, 3995-4001.
  19. [65]65. Zhijun Zhou, Yingtian Zhang, Xiaojing Yu, Panlong Yang, Xiang-Yang Li, Jing Zhao, and Hao Zhou. 2020. XHAR: Deep Domain Adaptation for Human Activity Recognition with Smart Devices. In 2020 17th Annual IEEE International Conference on Sensing, Communication, and Networking (SECON). IEEE, 1-9.

Cited by

Sorted by citations

Authors
Xu, H., Zhou, P., Tan, R., & Li, M.
Affiliations
  • Nanyang Technological University (SG)
  • University of Pittsburgh (US)
Venue
Proceedings of the 29th Annual International Conference on Mobile Computing and Networking
Publisher
ACM
Published
2023-10-02
Pages
1-15
ISSN
1543-5679 (ISSN-L)
OpenAlex
W4387227531
Cited by
55
References
56
Citations by year
2026: 14 · 2025: 26 · 2024: 14 · 2023: 1
FWCI
5.89
Type
conference paper
Language
en
Open access
Locations
  • ACM Annual International Conference on Mobile Computing and Networking (MobiCom) (publishedVersion)
  • DR-NTU (Nanyang Technological University) (publishedVersion)
  • Rare & Special e-Zone (The Hong Kong University of Science and Technology) (submittedVersion)
Funders
  • National Research Foundation, Singapore under its Industry Alignment Fund ? Pre-positioning (IAF-PP) Funding Initiative
  • National Research Foundation, Singapore under its NRF Investigatorship (NRFI) NRF-NRFI08-2022-0010
  • Ministry of Education, Singapore, under its Academic Research Fund Tier 1 (RG88/22)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
  • Social Sciences › Transportation › Human Mobility and Location-Based Analysis
  • Physical Sciences › Engineering › Biomedical Engineering › Gait Recognition and Analysis
Keywords
human activity recognition, inertial measurement unit, cross-user generalization, data heterogeneity, unlabeled data, federated learning, adversarial training, mobile devices

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review