A perspective on human activity recognition from inertial motion data
Open accessThe DOI matches its Crossref record; 60 of the 60 references it cites were found in a registry or an index.
Abstract
Human activity recognition (HAR) using inertial motion data has gained a lot of momentum in recent years both in research and industrial applications. From the abstract perspective, this has been driven by the rapid dynamics for building intelligent, smart environments, and ubiquitous systems that cover all aspects of human life including healthcare, sports, manufacturing, commerce, etc., which necessitate and subsume activity recognition aiming at recognizing the actions, characteristics, and goals of one or more agent(s) from a temporal series of observations streamed from one or more sensors. From a more concrete and seemingly orthogonal perspective, such momentum has been driven by the ubiquity of inertial motion sensors on-board mobile and wearable devices including smartphones, smartwatches, etc. In this paper we give an introductory and a comprehensive survey to the subject from a given perspective. We focus on a subset of topics, that we think are major, that will have significant and influential impacts on the future research and industrial-scale deployment of HAR systems. These include: (1) a comprehensive and detailed description of the inertial motion benchmark datasets that are publicly available and/or accessible, (2) feature selection and extraction techniques and the corresponding learning methods used to build workable HAR systems; we survey classical handcrafted datasets as well as data-oriented automatic representation learning approach to the subject, (3) transfer learning as a way to overcome many hurdles in actual deployments of HAR systems on a large scale, (4) embedded implementations of HAR systems on mobile and/or wearable devices, and finally (5) we touch on adversarial attacks, a topic that is essentially related to the security and privacy of HAR systems. As the field is very huge and diverse, this article is by no means comprehensive; it is though meant to provide a logically and conceptually rather complete picture to advanced practitioners, as well as to present a readable guided introduction to newcomers. Our logical and conceptual perspectives mimic the typical data science pipeline for state-of-the-art AI-based systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Howard, A., Sandler, M., Chen, B., Wang, W., Chen, L.-C., Tan, M., Chu, G., Vasudevan, V., Zhu, Y., Pang, R., et al. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00140 · Cited by 9,708
Activity Recognition from User-Annotated Acceleration Data
Bao, L., & Intille, S. S. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24646-6_1 · Cited by 3,147
Activity recognition using cell phone accelerometers
Kwapisz, J. R., Weiss, G. M., & Moore, S. A. (2011) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1964897.1964918 · Cited by 2,912
A Survey on Human Activity Recognition using Wearable Sensors
Lara, O. D., & Labrador, M. A. (2013) · IEEE Communications Surveys & Tutorials · doi:10.1109/surv.2012.110112.00192 · Cited by 2,662
A review of wearable sensors and systems with application in rehabilitation
Patel, S., Park, H., Bonato, P., Chan, L., & Rodgers, M. (2012) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/1743-0003-9-21 · Cited by 2,396
Transfer Feature Learning with Joint Distribution Adaptation
Long, M., Wang, J., Ding, G., Sun, J., & Yu, P. S. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.274 · Cited by 2,071
A tutorial on human activity recognition using body-worn inertial sensors
Bulling, A., Blanke, U., & Schiele, B. (2014) · ACM Computing Surveys · doi:10.1145/2499621 · Cited by 1,668
Introducing a New Benchmarked Dataset for Activity Monitoring
Reiss, A., & Stricker, D. (2012) · 2012 16th International Symposium on Wearable Computers · doi:10.1109/iswc.2012.13 · Cited by 1,456
Collecting complex activity datasets in highly rich networked sensor environments
Roggen, D., Calatroni, A., Rossi, M., Holleczek, T., Forster, K., Troster, G., Lukowicz, P., Bannach, D., Pirkl, G., Ferscha, A., et al. (2010) · 2010 Seventh International Conference on Networked Sensing Systems (INSS) · doi:10.1109/inss.2010.5573462 · Cited by 788
The Opportunity challenge: A benchmark database for on-body sensor-based activity recognition
Chavarriaga, R., Sagha, H., Calatroni, A., Digumarti, S. T., Tröster, G., Millán, J. D. R., & Roggen, D. (2013) · Pattern Recognition Letters · doi:10.1016/j.patrec.2012.12.014 · Cited by 742
Transition-Aware Human Activity Recognition Using Smartphones
Reyes-Ortiz, J.-L., Oneto, L., Samà, A., Parra, X., & Anguita, D. (2016) · Neurocomputing · doi:10.1016/j.neucom.2015.07.085 · Cited by 740
Stisen, A., Blunck, H., Bhattacharya, S., Prentow, T. S., Kjærgaard, M. B., Dey, A., Sonne, T., & Jensen, M. M. (2015) · Proceedings of the 13th ACM Conference on Embedded Networked Sensor Systems · doi:10.1145/2809695.2809718 · Cited by 714
Wearable Assistant for Parkinson’s Disease Patients With the Freezing of Gait Symptom
Bachlin, M., Plotnik, M., Roggen, D., Maidan, I., Hausdorff, J. M., Giladi, N., & Troster, G. (2010) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2009.2036165 · Cited by 693
Human fall detection on embedded platform using depth maps and wireless accelerometer
Kwolek, B., & Kepski, M. (2014) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2014.09.005 · Cited by 650
UniMiB SHAR: A Dataset for Human Activity Recognition Using Acceleration Data from Smartphones
Micucci, D., Mobilio, M., & Napoletano, P. (2017) · doi:10.20944/preprints201706.0033.v1 · Cited by 596
UniMiB SHAR: A Dataset for Human Activity Recognition Using Acceleration Data from Smartphones
Micucci, D., Mobilio, M., & Napoletano, P. (2017) · Applied Sciences · doi:10.3390/app7101101 · Cited by 596
UniMiB SHAR: A Dataset for Human Activity Recognition Using Acceleration Data from Smartphones
Micucci, D., Mobilio, M., & Napoletano, P. (2017) · doi:10.20944/preprints201706.0033.v2 · Cited by 596
USC-HAD: a daily activity dataset for ubiquitous activity recognition using wearable sensors
Zhang, M., & Sawchuk, A. A. (2012) · Proceedings of the 2012 ACM Conference on Ubiquitous Computing · doi:10.1145/2370216.2370438 · Cited by 554
Fusion of Smartphone Motion Sensors for Physical Activity Recognition
Shoaib, M., Bosch, S., Incel, O., Scholten, H., & Havinga, P. (2014) · Sensors · doi:10.3390/s140610146 · Cited by 552
Preece, S. J., Goulermas, J. Y., Kenney, L. P. J., & Howard, D. (2009) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2008.2006190 · Cited by 551
A Study on Human Activity Recognition Using Accelerometer Data from Smartphones
Bayat, A., Pomplun, M., & Tran, D. A. (2014) · Procedia Computer Science · doi:10.1016/j.procs.2014.07.009 · Cited by 531
SisFall: A Fall and Movement Dataset
Sucerquia, A., López, J., & Vargas-Bonilla, J. (2017) · Sensors · doi:10.3390/s17010198 · Cited by 530
Deep Recurrent Neural Networks for Human Activity Recognition
Murad, A., & Pyun, J.-Y. (2017) · Sensors · doi:10.3390/s17112556 · Cited by 524
Harari, G. M., Lane, N. D., Wang, R., Crosier, B. S., Campbell, A. T., & Gosling, S. D. (2016) · Perspectives on Psychological Science · doi:10.1177/1745691616650285 · Cited by 515
Activity recognition on streaming sensor data
Krishnan, N. C., & Cook, D. J. (2014) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2012.07.003 · Cited by 488
Tapia, E. M., Intille, S. S., Haskell, W., Larson, K., Wright, J., King, A., & Friedman, R. (2007) · 2007 11th IEEE International Symposium on Wearable Computers · doi:10.1109/iswc.2007.4373774 · Cited by 458
A CNN-LSTM Approach to Human Activity Recognition
Mutegeki, R., & Han, D. S. (2020) · 2020 International Conference on Artificial Intelligence in Information and Communication (ICAIIC) · doi:10.1109/icaiic48513.2020.9065078 · Cited by 452
Complex Human Activity Recognition Using Smartphone and Wrist-Worn Motion Sensors
Shoaib, M., Bosch, S., Incel, O., Scholten, H., & Havinga, P. (2016) · Sensors · doi:10.3390/s16040426 · Cited by 423
Sensor Positioning for Activity Recognition Using Wearable Accelerometers
Atallah, L., Lo, B., King, R., & Yang, G.-Z. (2011) · IEEE Transactions on Biomedical Circuits and Systems · doi:10.1109/tbcas.2011.2160540 · Cited by 346
Barometric Pressure and Triaxial Accelerometry-Based Falls Event Detection
Bianchi, F., Redmond, S. J., Narayanan, M. R., Cerutti, S., & Lovell, N. H. (2010) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2010.2070807 · Cited by 296
Wearable Sensor-Based Human Activity Recognition with Transformer Model
Dirgová Luptáková, I., Kubovčík, M., & Pospíchal, J. (2022) · Sensors · doi:10.3390/s22051911 · Cited by 270
Ravi, D., Wong, C., Lo, B., & Yang, G.-Z. (2016) · 2016 IEEE 13th International Conference on Wearable and Implantable Body Sensor Networks (BSN) · doi:10.1109/bsn.2016.7516235 · Cited by 269
Activity Recognition and Monitoring Using Multiple Sensors on Different Body Positions
Maurer, U., Smailagic, A., Siewiorek, D. P., & Deisher, M. (2006) · doi:10.21236/ada534437 · Cited by 266
Steven Eyobu, O., & Han, D. S. (2018) · Sensors · doi:10.3390/s18092892 · Cited by 259
A wearable system for pre-impact fall detection
Nyan, M. N., Tay, F. E. H., & Murugasu, E. (2008) · Journal of Biomechanics · doi:10.1016/j.jbiomech.2008.08.009 · Cited by 241
Feature Selection and Activity Recognition from Wearable Sensors
Pirttikangas, S., Fujinami, K., & Nakajima, T. (2006) · Lecture Notes in Computer Science · doi:10.1007/11890348_39 · Cited by 229
Portable preimpact fall detector with inertial sensors
Wu, G., & Xue, S. (2008) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2007.916282 · Cited by 227
A Comprehensive Analysis on Wearable Acceleration Sensors in Human Activity Recognition
Janidarmian, M., Roshan Fekr, A., Radecka, K., & Zilic, Z. (2017) · Sensors · doi:10.3390/s17030529 · Cited by 217
Human Activity Recognition Using Federated Learning
Sozinov, K., Vlassov, V., & Girdzijauskas, S. (2018) · 2018 IEEE Intl Conf on Parallel & Distributed Processing with Applications, Ubiquitous Computing & Communications, Big Data & Cloud Computing, Social Computing & Networking, Sustainable Computing & Communications (ISPA/IUCC/BDCloud/SocialCom/SustainCom) · doi:10.1109/bdcloud.2018.00164 · Cited by 167
A benchmark dataset to evaluate sensor displacement in activity recognition
Baños, O., Damas, M., Pomares, H., Rojas, I., Tóth, M. A., & Amft, O. (2012) · Proceedings of the 2012 ACM Conference on Ubiquitous Computing · doi:10.1145/2370216.2370437 · Cited by 163
Dealing with the Effects of Sensor Displacement in Wearable Activity Recognition
Banos, O., Toth, M., Damas, M., Pomares, H., & Rojas, I. (2014) · Sensors · doi:10.3390/s140609995 · Cited by 159
Human Activity Recognition Based on Residual Network and BiLSTM
Li, Y., & Wang, L. (2022) · Sensors · doi:10.3390/s22020635 · Cited by 156
Protecting Sensory Data against Sensitive Inferences
Malekzadeh, M., Clegg, R. G., Cavallaro, A., & Haddadi, H. (2018) · Proceedings of the 1st Workshop on Privacy by Design in Distributed Systems · doi:10.1145/3195258.3195260 · Cited by 154
Kwon, H., Tong, C., Haresamudram, H., Gao, Y., Abowd, G. D., Lane, N. D., & Plötz, T. (2020) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3411841 · Cited by 152
Deep Learning for RFID-Based Activity Recognition
Li, X., Zhang, Y., Marsic, I., Sarcevic, A., & Burd, R. S. (2016) · Proceedings of the 14th ACM Conference on Embedded Networked Sensor Systems CD-ROM · doi:10.1145/2994551.2994569 · Cited by 150
Activity recognition using semi-Markov models on real world smart home datasets
van Kasteren, T. L. M., Englebienne, G., & Kröse, B. J. A. (2010) · Journal of Ambient Intelligence and Smart Environments · doi:10.3233/ais-2010-0070 · Cited by 131
A mobile platform for real-time human activity recognition
Lara, S. D., & Labrador, M. A. (2012) · 2012 IEEE Consumer Communications and Networking Conference (CCNC) · doi:10.1109/ccnc.2012.6181018 · Cited by 128
Kangas, M., Vikman, I., Nyberg, L., Korpelainen, R., Lindblom, J., & Jämsä, T. (2012) · Gait & Posture · doi:10.1016/j.gaitpost.2011.11.016 · Cited by 126
Adversarial Attacks on Time Series
Karim, F., Majumdar, S., & Darabi, H. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2986319 · Cited by 118
Margarito, J., Helaoui, R., Bianchi, A., Sartor, F., & Bonomi, A. (2015) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2015.2471094 · Cited by 118
Sun, W., Guo, Z., Yang, Z., Wu, Y., Lan, W., Liao, Y., Wu, X., & Liu, Y. (2022) · Sensors · doi:10.3390/s22207784 · Cited by 112
FingerPing: Recognizing Fine-grained Hand Poses using Active Acoustic On-body Sensing
Zhang, C., Xue, Q., Waghmare, A., Meng, R., Jain, S., Han, Y., Li, X., Cunefare, K., Ploetz, T., Starner, T., et al. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174011 · Cited by 82
Online human activity recognition using low-power wearable devices
Bhat, G., Deb, R., Chaurasia, V. V., Shill, H., & Ogras, U. Y. (2018) · Proceedings of the International Conference on Computer-Aided Design · doi:10.1145/3240765.3240833 · Cited by 82
CrossCount: A Deep Learning System for Device-Free Human Counting Using WiFi
Ibrahim, O. T., Gomaa, W., & Youssef, M. (2019) · IEEE Sensors Journal · doi:10.1109/jsen.2019.2928502 · Cited by 61
Self-citationDynamic hand gesture recognition for wearable devices with low complexity recurrent neural networks
Shin, S., & Sung, W. (2016) · 2016 IEEE International Symposium on Circuits and Systems (ISCAS) · doi:10.1109/iscas.2016.7539037 · Cited by 59
MyoGym: introducing an open gym data set for activity recognition collected using myo armband
Koskimäki, H., Siirtola, P., & Röning, J. (2017) · Proceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2017 ACM International Symposium on Wearable Computers · doi:10.1145/3123024.3124400 · Cited by 46
Gait Neural Network for Human-Exoskeleton Interaction
Fang, B., Zhou, Q., Sun, F., Shan, J., Wang, M., Xiang, C., & Zhang, Q. (2020) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2020.00058 · Cited by 39
OpenHealth: Open-Source Platform for Wearable Health Monitoring
Bhat, G., Deb, R., & Ogras, U. Y. (2019) · IEEE Design & Test · doi:10.1109/mdat.2019.2906110 · Cited by 36
MobiGesture: Mobility-aware hand gesture recognition for healthcare
Zhao, H., Ma, Y., Wang, S., Watson, A., & Zhou, G. (2018) · Smart Health · doi:10.1016/j.smhl.2018.07.010 · Cited by 18
Cited by
Ahmed, M. E., Yu, H., Vassallo, M., & Koufaki, P. (2025) · Smart Health · doi:10.1016/j.smhl.2025.100555 · Cited by 10
A framework to automatically detect near-falls using a wearable inertial measurement cluster
Gießler, M., Werth, J., Waltersberger, B., & Karamanidis, K. (2024) · Communications Engineering · doi:10.1038/s44172-024-00325-x · Cited by 6
“Furthermore,recent ,particularlyinthe fi eld of automated fall detection, with improvements in the accuracy of wearable sensor-based detection systems 13 – 15 .”
Oishi, N., Birch, P., Lago, P., & Roggen, D. (2026) · Knowledge-Based Systems · doi:10.1016/j.knosys.2026.116367 · Cited by 1
Metadata
- Authors
- Gomaa, W., & Khamis, M. A.
- Venue
- Neural Computing and Applications
- Published
- 2023-07-31
- Volume
- 35
- Issue
- 28
- Pages
- 20463-20568
- ISSN
- 0941-0643 (ISSN-L)
- 1433-3058
- OpenAlex
- W4385428483
- Cited by
- 54
- References
- 60
- FWCI
- 4.91
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.