CoChat

Deep Learning for Sensor-based Human Activity Recognition

Chen, Kaixuan, Zhang, Dalin, Yao, Lina, Guo, Bin, Yu, Zhiwen, Liu, Yunhao · 2022 · ACM Computing Surveys

The DOI matches its Crossref record; 151 of the 151 references it cites were found in a registry or an index.

Abstract

The vast proliferation of sensor devices and Internet of Things enables the applications of sensor-based activity recognition. However, there exist substantial challenges that could influence the performance of the recognition system in practical scenarios. Recently, as deep learning has demonstrated its effectiveness in many areas, plenty of deep methods have been investigated to address the challenges in activity recognition. In this study, we present a survey of the state-of-the-art deep learning methods for sensor-based human activity recognition. We first introduce the multi-modality of the sensory data and provide information for public datasets that can be used for evaluation in different challenge tasks. We then propose a new taxonomy to structure the deep methods by challenges. Challenges and challenge-related deep methods are summarized and analyzed to form an overview of the current research progress. At the end of this work, we discuss the open issues and provide some insights for future directions.

Overview

Integrity signals

Registry

Crossref · 10.1145/3447744

Cites

151 of 151 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Research works printed but not linked: 37

  1. Alsheikh Mohammad Abu, 2016, Proceedings of the Workshops at the 30th AAAI Conference on Artificial Intelligence.
  2. Bengio Yoshua, 2012, Proceedings of ICML Workshop on Unsupervised and Transfer Learning. 17–36
  3. Brophy Eoin, 2018, Zhengwei Wang, Alan F. Smeaton, and Tomas E. Ward.
  4. 10.5555/3367032.3367223 · doi:10.5555/3367032.3367223
  5. Chen Ling, 2020, METIER: A deep multi-task learning based activity and user recognition model using wearable sensors. Proc. ACM Interact., Mob, Wear. Ubiq. Technol., 4, 1
  6. Dong Mingtao, 2018, Proceedings of the International Conference on Signal and Information Processing, Networking and Computers. Springer, 32–40
  7. Goodfellow Ian, 2014, Proceedings of the International Conference on Advances in Neural Information Processing Systems. 2672–2680
  8. Hammerla Nils Yannick, 2015, Proceedings of the 29th AAAI Conference on Artificial Intelligence.
  9. Hammerla Nils Y., 2016, Proceedings of the 25th International Joint Conference on Artificial Intelligence. 1533–1540
  10. Karpathy Andrej, 2016, Proceedings of the 4th International Conference on Learning Representations Workshop.
  11. Al Hafiz Khan Md Abdullah, 2018, Proceedings of the International Conference on Pervasive Computing and Communications. IEEE, 1–9.
  12. 10.5555/3164150.3164213 · doi:10.5555/3164150.3164213
  13. Krizhevsky Alex, Proceedings of the International Conference on Advances in Neural Information Processing Systems. 1097–1105
  14. Nicholas, Proceedings of the 16th International Workshop on Mobile Computing Systems and Applications. ACM, 117–122
  15. Lee Song-Mi, 2017, Proceedings of the IEEE International Conference on Big Data and Smart Computing (BigComp’17)
  16. Li Fei, 2011, Proceedings of the Workshops at the 25th AAAI Conference on Artificial Intelligence.
  17. Li Xinyu, Proceedings of the 8th Wireless of the Students, by the Students, and for the Students Workshop (S3@MobiCom’16)
  18. Li Xinyu, Proceedings of the 14th ACM Conference on Embedded Network Sensor Systems CD-ROM. ACM, 164–175
  19. Li Xinyu, 2017, Burd
  20. Ordóñez Morales Francisco Javier, 2016, Proceedings of the ACM International Symposium on Wearable Computers. ACM, 92–99
  21. Vishvak, Proceedings of the ACM International Symposium on Wearable Computers. ACM, 100–103
  22. Phan NhatHai, 2016, Proceedings of the 30th AAAI Conference on Artificial Intelligence.
  23. Pouyanfar Samira, 2018, A survey on deep learning: Algorithms, techniques, and applications, Comput. Surv., 51, 92
  24. Press Ofir, 2017, Language generation with recurrent generative adversarial networks without pre-training. arXiv preprint arXiv:1706.01399 · arXiv
  25. Qian Hangwei, 2018, Proceedings of the AAAI Conference on Artificial Intelligence.
  26. Saeedi Ramyar, Proceedings of the IEEE International Conference on Big Data. IEEE, 473–479
  27. Serrano Sofia, Proceedings of the 57th Conference of the Association for Computational Linguistics (ACL’19)
  28. van Kasteren Tim L. M., 2011, Kröse
  29. Xue Li, 2018, Understanding and improving deep neural network for activity recognition. arXiv preprint arXiv:1805.07020 · arXiv
  30. 10.5555/2832747.2832806 · doi:10.5555/2832747.2832806
  31. Zebin Tahmina, Proceedings of the IEEE Conference on Sensors (SENSORS’16)
  32. Zhang Dalin, 2018, Proceedings of the AAAI Conference on Artificial Intelligence, 32
  33. Zhang Mi, Proceedings of the ACM Conference on Ubiquitous Computing. ACM, 1036–1043
  34. 10.5555/3304889.3305093 · doi:10.5555/3304889.3305093
  35. Zhang Yanyi, Proceedings of the 16th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN’17)
  36. Zhang Yong, 2018, Human activity recognition based on time series analysis using U-Net. arXiv preprint arXiv:1809.08113 · arXiv
  37. Zheng Yi, Proceedings of the International Conference on Web-age Information Management. Springer, 298–310

Cited by

See all 690

Metadata

Authors
Chen, K., Zhang, D., Yao, L., Guo, B., Yu, Z., & Liu, Y.
Affiliations
  • Aalborg University (DK)
  • UNSW Sydney (AU)
  • Northwestern Polytechnical University (CN)
  • Michigan State University (US)
Venue
ACM Computing Surveys
Published
2021-05-24
Volume
54
Issue
4
Pages
1-40
ISSN
  • 0360-0300 (ISSN-L)
  • 1557-7341
OpenAlex
W3164845984
Cited by
690
References
144
Citations by year
2026: 83 · 2025: 137 · 2024: 172 · 2023: 149 · 2022: 101 · 2021: 45
FWCI
41.94
Type
journal article
Language
en
Open access
closed
Locations
  • ACM Computing Surveys (publishedVersion, public-domain)
  • VBN Forskningsportal (Aalborg Universitet) (submittedVersion)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
  • Physical Sciences › Engineering › Biomedical Engineering › Gait Recognition and Analysis
Keywords
human activity recognition, sensor-based activity recognition, deep learning, Internet of Things, sensor fusion, activity recognition dataset, wearable sensors

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.