A tutorial on human activity recognition using body-worn inertial sensors
The DOI matches its Crossref record; 131 of the 132 references it cites were found in a registry or an index.
Abstract
The last 20 years have seen ever-increasing research activity in the field of human activity recognition. With activity recognition having considerably matured, so has the number of challenges in designing, implementing, and evaluating activity recognition systems. This tutorial aims to provide a comprehensive hands-on introduction for newcomers to the field of human activity recognition. It specifically focuses on activity recognition using on-body inertial sensors. We first discuss the key research challenges that human activity recognition shares with general pattern recognition and identify those challenges that are specific to human activity recognition. We then describe the concept of an Activity Recognition Chain (ARC) as a general-purpose framework for designing and evaluating activity recognition systems. We detail each component of the framework, provide references to related research, and introduce the best practice methods developed by the activity recognition research community. We conclude with the educational example problem of recognizing different hand gestures from inertial sensors attached to the upper and lower arm. We illustrate how each component of this framework can be implemented for this specific activity recognition problem and demonstrate how different implementations compare and how they impact overall recognition performance.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The promising results delivered in these works without the use of labels have resulted in a general direction of integrating unsupervised learning as-is into conventional activity recognition chains (ARC) [8] in the feature extraction step.”
From Contrastive Predictive Coding for Human Activity Recognition (2021) · cites this paper as [8]
In the citing paper
“The comparative studies using our evaluation framework are novel, because such an analysis has in particular been missing in most survey papers of sensor-based HAR [1,2,3].”
From Comparison of Feature Learning Methods for Human Activity Recognition Using Wearable Sensors (2018) · cites this paper as [3]
In the citing paper
“In [3], the authors carried out extensive experiments to assess the effectiveness of several approaches, but only considered simple hand-crafted features and classifiers using a small self-produced dataset.”
From Comparison of Feature Learning Methods for Human Activity Recognition Using Wearable Sensors (2018) · cites this paper as [3]
In the citing paper
“While the HAR problem seeks to find a perfect segmentation of activities, this task is difficult to achieve since humans perform activities in a fluent way and the segmentation of time series into intervals that represent single activities is not straightforward (Bulling et al. 2014).”
From Advanced Sensing and Human Activity Recognition in Early Intervention and Rehabilitation of Elderly People (2020) · cites this paper as Bulling et al. 2014
In the citing paper
“The second aspect that goes along with this is that human activity is highly diverse and the recognition of specific activities therefore requires an accurate selection of sensors and their placement (Bulling et al. 2014).”
From Advanced Sensing and Human Activity Recognition in Early Intervention and Rehabilitation of Elderly People (2020) · cites this paper as Bulling et al. 2014
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
A tutorial on hidden Markov models and selected applications in speech recognition
Rabiner, L. R. (1989) · Proceedings of the IEEE · doi:10.1109/5.18626 · Cited by 22,743 · cited 2×
“Given the training data T and an initial guess of the parameters ., a separate model is trained for each class using expectation maximization [Rabiner 1989; Fink 2008].”
MethodAn introduction to ROC analysis
Fawcett, T. (2006) · Pattern Recognition Letters · doi:10.1016/j.patrec.2005.10.010 · Cited by 21,879 · cited 1×
“Therefore, a common strategy is to sweep the threshold on the score for each individual class (one vs. all) and analyze the behavior in so-called Receiver Operating Characteristic (ROC) or Precision-Recall (PR) curves [Fawcett 2006].”
MethodPeng, H., Long, F., & Ding, C. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.159 · Cited by 10,544 · cited 2×
“These can be categorized into wrapper [Kohavi and John 1997], filter [Peng et al. 2005], or hybrid [Somol et al.”
BackgroundMethodWrappers for feature subset selection
Kohavi, R., & John, G. H. (1997) · Artificial Intelligence · doi:10.1016/s0004-3702(97)00043-x · Cited by 8,947 · cited 2×
“A large number of researchers investigated machine recognition of gestures and activities from still images and video in constrained environments or stationary settings (see Mitra and Acharya [2007], Turaga et al.”
BackgroundAn introduction to variable and feature selection
GuyonIsabelle, & ElisseeffAndré (2003) · Journal of Machine Learning Research · doi:10.5555/944919.944968 · Cited by 7,715
The Pascal Visual Object Classes Challenge: A Retrospective
Everingham, M., Eslami, S. M. A., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-014-0733-5 · Cited by 7,139
Friedman, J., Hastie, T., & Tibshirani, R. (2000) · The Annals of Statistics · doi:10.1214/aos/1016218223 · Cited by 6,884 · cited 2×
“Introduced in machine learning and computer vision [Friedman et al. 2000; Torralba et al. 2007], boosting as a variant of decision fusion has been successfully applied to activity recognition as well [Lester et al. 2005; Blanke and Schiele 2009; Zinnen et al. 2009b].”
Method2011 Compendium of Physical Activities: A Second Update of Codes and MET Values
AINSWORTH, B. E., HASKELL, W. L., HERRMANN, S. D., MECKES, N., BASSETT, D. R., TUDOR-LOCKE, C., GREER, J. L., VEZINA, J., WHITT-GLOVER, M. C., & LEON, A. S. (2011) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0b013e31821ece12 · Cited by 6,317 · cited 2×
“Other resources include the comprehensive compendium of physical activity [Ainsworth et al. 2011].”
BackgroundProceedings of the 19th International Joint Conference on Artificial Intelligence
Pujol, J. M., Delgado, J., Ramon Sangüesa, A., & Flache, A. (2005) · International Joint Conference on Artificial Intelligence · Cited by 5,771
Kittler, J., Hatef, M., Duin, R. P. W., & Matas, J. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.667881 · Cited by 5,290 · cited 3×
“J. Kittler et al. 1998.”
Background
Research works printed but not linked: 7
- 10.5555/2015035.2015320 · doi:10.5555/2015035.2015320
- 10.5555/1642293.1642416 · doi:10.5555/1642293.1642416
- 10.5555/1642293.1642417 · doi:10.5555/1642293.1642417
- 10.5555/2283516.2283683 · doi:10.5555/2283516.2283683
- 10.5555/1460232.1460248 · doi:10.5555/1460232.1460248
- 10.5555/2021975.2022004 · doi:10.5555/2021975.2022004
- 10.5555/862896.881089 · doi:10.5555/862896.881089
Cited by
Items 501–600 of 1,007
Sensor Data Required for Automatic Recognition of Athletic Tasks Using Deep Neural Networks
Clouthier, A. L., Ross, G. B., & Graham, R. B. (2020) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2019.00473 · Cited by 29
“Previously, activity recognition methods employed techniques that required hand-selected features as input (Bulling et al., 2014).”
MethodQin, X., Wang, J., Ma, S., Lu, W., Zhu, Y., Xie, X., & Chen, Y. (2023) · Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining · doi:10.1145/3580305.3599360 · Cited by 29
“With the development of machine learning and deep learning techniques, wearable sensor-based HAR has been applied to many real-life scenarios such as fatigue detection during the driving procedure [4], fall detection of the elders [30], healthcare in daily life, and diagnosis of the Parkinson’s disease [7, 13], etc.”
MethodTemporal Action Localization for Inertial-based Human Activity Recognition
Bock, M., Moeller, M., & Laerhoven, K. V. (2024) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3699770 · Cited by 29
“Being one of the key challenges in HAR [7], the TAL architectures further show to be less affected by the unbalanced nature of HAR datasets due to a large NULL-class.”
InfluentialEsfahani, M. I. M., Nussbaum, M. A., & Kong, Z. (2019) · Ergonomics · doi:10.1080/00140139.2019.1578419 · Cited by 29
“Specifically, useful features identify variabilities in a dataset and can improve classification performance (Bulling, Blanke, and Schiele 2014).”
BackgroundMethodInfluentialHigh-Level Features for Human Activity Recognition and Modeling
Hartmann, Y., Liu, H., & Schultz, T. (2023) · Communications in computer and information science · doi:10.1007/978-3-031-38854-5_8 · Cited by 29
“Human activity recognition (HAR), an important research topic for today’s modern life, involves proven machine learning (ML) algorithms for related tasks, including biosignal (pre-)processing, feature extraction and selection, unsupervised data segmentation, and activity modeling approaches, as the classic and the sta…”
BackgroundEfficient human activity recognition with spatio-temporal spiking neural networks
Li, Y., Yin, R., Kim, Y., & Panda, P. (2023) · Frontiers in Neuroscience · doi:10.3389/fnins.2023.1233037 · Cited by 30
Robust Automated Human Activity Recognition and Its Application to Sleep Research
Sathyanarayana, A., Ofli, F., Fernández-Luque, L., Srivastava, J., Elmagarmid, A. K., Arora, T., & Taheri, S. (2016) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw.2016.0077 · Cited by 29
“Even though we evaluate the performance of the proposed HAR algorithm on sleep analysis, RAHAR can be employed in other research areas such as obesity, diabetes, and cardiac diseases.”
MethodExploring Symmetric and Asymmetric Bimanual Eating Detection with Inertial Sensors on the Wrist
Thomaz, E., Bedri, A., Prioleau, T., Essa, I. A., & Abowd, G. D. (2017) · doi:10.1145/3089341.3089345 · Cited by 29
Burtscher, M. J., Meyer, B. M., Jonas, K. W., Feese, S., & Tröster, G. (2018) · Journal of Organizational Behavior · doi:10.1002/job.2271 · Cited by 29
Activity-Aware Wearable System for Power-Efficient Prediction of Physiological Responses
Starliper, N., Mohammadzadeh, F., Songkakul, T., Hernandez, M. L., Bozkurt, A. Y., & Lobaton, E. J. (2019) · Sensors · doi:10.3390/s19030441 · Cited by 29
Monitoring Student Activities with Smartwatches: On the Academic Performance Enhancement
Herrera-Alcántara, O., Barrera-Animas, A. Y., González-Mendoza, M., & Castro-Espinoza, F. A. (2019) · Sensors · doi:10.3390/s19071605 · Cited by 29
“The wrist-worn data were acquired with MSBand sensors and transmitted to the App, and from the App to the data server for offline processing.”
MethodAbedin, A., Rezatofighi, S. H., Shi, Q., & Ranasinghe, D. C. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/801 · Cited by 29
Weakly-supervised sensor-based activity segmentation and recognition via learning from distributions
Qian, H., Pan, S. J., & Miao, C. (2020) · Artificial Intelligence · doi:10.1016/j.artint.2020.103429 · Cited by 29
“Activity recognition, as an important application of artificial intelligence [52], has been used in a wide spectrum of real-world applications, such as health care, smart homes, security and assisted living [8,19,5,23,11,39].”
BackgroundLee, K., & Han, S. (2021) · Automation in Construction · doi:10.1016/j.autcon.2021.103857 · Cited by 30
A new scheme for the development of IMU-based activity recognition systems for telerehabilitation
Nasrabadi, A. M., Eslaminia, A., Bakhshayesh, P. R., Ejtehadi, M., Alibiglou, L., & Behzadipour, S. (2022) · Medical Engineering & Physics · doi:10.1016/j.medengphy.2022.103876 · Cited by 29
Analysis of Multi-Sensor Fusion for Mobile and Wearable Sensor Based Human Activity Recognition
Nweke, H. F., Teh, Y. W., Alo, U. R., & Mujtaba, G. (2018) · Proceedings of the International Conference on Data Processing and Applications · doi:10.1145/3224207.3224212 · Cited by 28
“At the same time, machine learning approach provide better mechanism to accurately detect activity by implementing effective data preprocessing and segmentation, feature extraction and dimensionality reduction, classification with learning models and finally evaluation of learning algorithms[7].”
MethodTime to Think the Security of WiFi-Based Behavior Recognition Systems
Liu, J., He, Y., Xiao, C., Han, J., & Ren, K. (2023) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2023.3261328 · Cited by 28
One is Enough: Enabling One-shot Device-free Gesture Recognition with COTS WiFi
Zhao, L., Xiao, R., Liu, J., & Han, J. (2024) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom52122.2024.10621091 · Cited by 28
“Traditional gesture recognition approaches often capture the gesture information using cameras [19]–[21], wearable devices [22]–[24], or sonars [25]– [27].”
BackgroundSong, Y., Li, Y., Wang, Y., Ye, C., Zhu, C., & Yang, R. (2026) · Advanced Functional Materials · doi:10.1002/adfm.202532014 · Cited by 28
“Gesture recognition with IMUs on the upper and lower arms merges heterogeneous node outputs at the decision layer to form a unified prediction [171].”
Barshan, B., & Yurtman, A. (2015) · The Computer Journal · doi:10.1093/comjnl/bxv093 · Cited by 28
“Although numerous studies on activity recognition with wearable sensors exist (see [11, 12] for recent surveys), only a small number of them have looked into the minimal number and configuration of sensors to recognize activities.”
Machine Learning Algorithms for Activity-Intensity Recognition Using Accelerometer Data
Gomes, E. R., Bertini, L., Campos, W. R., Sobral, A. P. B., Mocaiber, I., & Copetti, A. (2021) · Sensors · doi:10.3390/s21041214 · Cited by 28
“To our knowledge, this approach has not been explored so far, as can be contrasted with other studies in this area, such as [1,7], as well as specific works differently interpreting the intensity parameter [4,6,19,20].”
ResultGashi, S., Saeed, A., Vicini, A., Lascio, E. D., & Santini, S. (2021) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3462244.3479921 · Cited by 28
“This technique is used to estimate how well the recognition system generalizes to a new user [16].”
MethodInfluentialSaha, S. S., Sandha, S. S., Pei, S., Jain, V., Wang, Z., Li, Y., Sarker, A., & Srivastava, M. B. (2022) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3534586 · Cited by 28
“The bulk of emerging innovations builds upon recent advances in machine learning (ML) for sensor-based activity detection and gesture recognition [2, 11, 52, 68] because classical signal processing techniques do not yield high enough accuracy for complex activity recognition.”
BackgroundZhou, B., Suh, S., Rey, V. F., Altamirano, C. A. V., & Lukowicz, P. (2022) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3534610 · Cited by 28
“Event-based recognition is common in human activity recognition [11] after the prediction results on individual windows to smooth out the results in adjacent time windows, or majority voting within a longer event to improve the accuracy, with the assumption that people usually do not switch…”
BackgroundDeep learning for Flight Maneuver Recognition: A survey
Lu, J., Pan, L., Deng, J., Chai, H., Ren, Z., & Shi, Y. (2022) · Electronic Research Archive · doi:10.3934/era.2023005 · Cited by 28
Ramos, F., Lorayne, A., Costa, A., de Sousa, R. R., de Almeida, H. O., & Perkusich, Â. (2016) · Proceedings/Proceedings of the ... International Conference on Software Engineering and Knowledge Engineering · doi:10.18293/seke2016-040 · Cited by 28
“In the last years, AR has became a topic of interest for mobile and ubiquitous computing researchers [10], [5], especially due to the significant growth in the number of mobile devices available to users, which incorporate several types of sensors, such as gyroscope and accelerometer [8].”
BackgroundMethodZebin, T., Scully, P., & Ozanyan, K. B. (2016) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-319-49655-9_38 · Cited by 28
“Components of the human activity recognition chain[1])”
BackgroundMethodWernimont, S. M., Thompson, R. J., Mickelsen, S., Smith, S., Alvarenga, I., & Gross, K. L. (2018) · Sensors · doi:10.3390/s18010249 · Cited by 28
Discovering Underlying Plans Based on Shallow Models
Zhuo, H. H., Zha, Y., Subbarao Kambhampati, B., & Tian, X. (2020) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3368270 · Cited by 28
“discussed the key research challenges [13] that human activity recognition shared with general pattern recognition.”
BackgroundAutomatic Smile and Frown Recognition with Kinetic Earables
Lee, S., Min, C., Montanari, A., Mathur, A., Chang, Y., Song, J., & Kawsar, F. (2019) · Augmented Human International Conference · doi:10.1145/3311823.3311869 · Cited by 28
“The typical pipeline consists of two key components; extracting statistical features from raw IMU signals and using a machine learning classifier for the final classification [1].”
MethodSensor-based activity recognition: One picture is worth a thousand words
Riboni, D., & Murtas, M. (2019) · Future Generation Computer Systems · doi:10.1016/j.future.2019.07.020 · Cited by 28
“Activity recognition (AR) systems can be broadly divided into vision-based [17] and sensor-based [5] ones.”
BackgroundMethodRank Pooling Approach for Wearable Sensor-Based ADLs Recognition
Nisar, M. A., Shirahama, K., Li, F., Huang, X., & Grzegorzek, M. (2020) · Sensors · doi:10.3390/s20123463 · Cited by 28
“The research has shown that hierarchical models are necessary for accurate activity recognition [13,14].”
Feature Space Reduction for Human Activity Recognition based on Multi-channel Biosignals
Hartmann, Y., Liu, H., & Schultz, T. (2021) · International Joint Conference on Biomedical Engineering Systems and Technologies (BIOSTEC) · doi:10.5220/0010260800002865 · Cited by 28
Time Analysis in Human Activity Recognition
Gil-Martín, M., San-Segundo, R., Fernández-Martínez, F., & Ferreiros, J. (2021) · Neural Processing Letters · doi:10.1007/s11063-021-10611-w · Cited by 28
GOAT: A Generalized Cross-Dataset Activity Recognition Framework with Natural Language Supervision
Miao, S., & Chen, L. (2024) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3699736 · Cited by 27
Qualitative Methods for Computing Education
Tenenberg, J. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.008 · Cited by 27
Personalized human activity recognition using deep learning and edge-cloud architecture
Alawneh, L. M., Al‐Ayyoub, M., Al-Sharif, Z. A., & Shatnawi, A. S. (2022) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-022-03752-w · Cited by 27
“Successful applications of HAR can range from providing prompt care (Ogbuabor and La 2018) for patients and elderly, including fall detection, to studying and enhancing athletes’ body movements (Bulling et al. 2014).”
BackgroundA review of thermal array sensor-based activity detection in smart spaces using AI
Nwakanma, C. I., Anyanwu, G. O., Ahakonye, L. A. C., Lee, J., & Kim, D. (2023) · ICT Express · doi:10.1016/j.icte.2023.11.007 · Cited by 27
Hendry, D., Rohl, A. L., Rasmussen, C. L., Zabatiero, J. G., Cliff, D. P., Smith, S. S., MacKenzie, J. E., Pattinson, C. L., Straker, L. M., & Campbell, A. (2023) · Sensors · doi:10.3390/s23249661 · Cited by 27
“Machine learning is the overarching term used to define a branch of artificial intelligence and is a rapidly advancing field [13].”
BackgroundMethodPersonalized Active Learning for Activity Classification Using Wireless Wearable Sensors
Xu, J., Song, L., Xu, J. Y., Pottie, G. J., & van der Schaar, M. (2016) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2016.2553648 · Cited by 27
“The second partitioning is performed on the subspace [10, 50) and the third partitioning is performed on the subspace [50, 90), creating two level-2 context subspaces.”
BackgroundMethodCoupeté, E., Moutarde, F., & Manitsaris, S. (2018) · Autonomous Robots · doi:10.1007/s10514-018-9704-y · Cited by 27
“Bulling et al. (2014) proposed an “ Activity Recognition Chain ” to recognize gestures with inertial sensors.”
BackgroundMethodCooperative starting intention detection of cyclists based on smart devices and infrastructure
Bieshaar, M., Zernetsch, S., Depping, M., Sick, B., & Doll, K. (2017) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2017.8317691 · Cited by 27
“The first method is realized by human activity recognition techniques [11] based on the gyroscope and accelerometer sensory data, which is nowadays available on nearly every smartphone.”
MethodUnTran: Recognizing Unseen Activities with Unlabeled Data Using Transfer Learning
Khan, M. A. A. H., & Roy, N. (2018) · IEEE/ACM International Conference on Internet-of-Things Design and Implementation (IoTDI) · doi:10.1109/iotdi.2018.00014 · Cited by 27
“These traditional supervised machine learning algorithms are tuned to specific settings and do not perform well if deployed in a new environment where variations in users activity patterns, diversity of devices, and sensing biasness are omnipresent [12][2][3].”
BackgroundDeep Learning for Multimodal Fall Detection
Martínez-Villaseñor, L., Ponce-Espinosa, H., & Daniel, K. R. P. (2019) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2019.8914429 · Cited by 27
“Additionally, we include a baseline classifier using random forest (RF) and applying the development cycle of a conventional fall detection system [30].”
MethodDANA: Dimension-Adaptive Neural Architecture for Multivariate Sensor Data
Malekzadeh, M., Clegg, R. G., Cavallaro, A., & Haddadi, H. (2021) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3478074 · Cited by 27
“Health and wellness applications [42, 43, 64] exploit motion sensors embedded in mobile and wearable devices to infer body movements and temporal changes in the physiological state of the wearer [8, 9, 20, 51].”
BackgroundImproving human action recognition by jointly exploiting video and WiFi clues
Guo, J., Shi, M., Zhu, X., Huang, W., He, Y., Zhang, W., & Tang, Z. (2021) · Neurocomputing · doi:10.1016/j.neucom.2020.11.074 · Cited by 27
Zero-shot human activity recognition via nonlinear compatibility based method
Wang, W., Miao, C., & Hao, S. (2017) · IEEE/WIC/ACM International Conference on Web Intelligence · doi:10.1145/3106426.3106526 · Cited by 27
“In past years, extensive researches have been conducted in this area [5, 8, 15] and a lot of recognizing methods have been proposed.”
BackgroundMethodInfluentialHigh-Performance Real-Time Human Activity Recognition Using Machine Learning
Pardhu, T., Acharya, B., & Moreira, F. (2024) · Mathematics · doi:10.3390/math12223622 · Cited by 26
Recognition of Physiotherapeutic Exercises Through DTW and Low-Cost Vision-Based Motion Capture
Rybarczyk, Y. P., Deters, J. K., Aladro-Gonzalvo, A. R., Esparza, W. D., González, M., Villarreal-Narvaez, S., & Nunes, I. L. (2017) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-60366-7_33 · Cited by 26
Deep Learning for Human Activity Recognition Based on Causality Feature Extraction
Hwang, Y. M., Park, S., Lee, H. O., Ko, S., & Lee, B. (2021) · IEEE Access · doi:10.1109/access.2021.3103211 · Cited by 26
Detecting Smartwatch-Based Behavior Change in Response to a Multi-Domain Brain Health Intervention
Cook, D. J., Strickland, M., & Schmitter‐Edgecombe, M. (2022) · ACM Transactions on Computing for Healthcare · doi:10.1145/3508020 · Cited by 26
“Performing human activity recognition from wearable sensors has become a popular topic for researchers to investigate [6, 7].”
BackgroundHan, C., Zhang, L., Tang, Y., Xu, S., Min, F., Wu, H., & Song, A. (2022) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2022.3191653 · Cited by 26
Liang, J., Zhang, L., Han, C., Bu, C., Wu, H., & Song, A. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2023.3271306 · Cited by 26
Robust Feature Representation Using Multi-Task Learning for Human Activity Recognition
Azadi, B., Haslgrübler, M., Anzengruber-Tánase, B., Sopidis, G., & Ferscha, A. (2024) · Sensors · doi:10.3390/s24020681 · Cited by 26
“Without regard to the learning approach, HAR consists of four main stages: data acquisition, data preparation, feature learning, and recognition task [14].”
BackgroundZhang, Y., Wu, D., Wang, Y., Zhang, Y., Ji, G., & Ai, J. (2024) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2024.3374312 · Cited by 26
“In comparison to other sensing modalities like cameras [8], [9], [10], wearable devices [11], [12], [13], smartphones [14], [15], and sonar [16], [17], [18], Wi-Fi-based HAR offers advantages such as cost-effectiveness, absence of wearable devices, privacy nonintrusion [19], and ease of deployment.”
BackgroundAn analytical approach for head gesture recognition with motion sensors
Rudigkeit, N., Gebhard, M., & Gräser, A. (2015) · International Conference on Sensing Technology · doi:10.1109/icsenst.2015.7933064 · Cited by 26
“In [3] the authors give an extensive introduction into this topic.”
BackgroundAutomated Quality Control for Sensor Based Symptom Measurement Performed Outside the Lab
Badawy, R., Raykov, Y. P., Evers, L. J. W., Bloem, B. R., Faber, M. J., Zhan, A., Claes, K., & Little, M. A. (2018) · Sensors · doi:10.3390/s18041215 · Cited by 26
“Typically, in activity recognition in “ubiquitous computing” applications, the sensor data are segmented into windows of fixed alignment and equal duration, and then, a hand-crafted set of features is extracted from each window [16].”
BackgroundCollection of a Diverse, Realistic and Annotated Dataset for Wearable Activity Recognition
Cleland, I., Donnelly, M. P., Nugent, C., Hallberg, J., Espinilla, M., & García-Constantino, M. (2018) · IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops) · doi:10.1109/percomw.2018.8480322 · Cited by 26
“A set of common features, defined in previous work [16, 18] were extracted from the x, y, z axis and SMV, as presented in Table IV.”
BackgroundMethodInfluentialComputing for Other Disciplines
Guzdial, M. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.020 · Cited by 26
Capacitor-based Activity Sensing for Kinetic-powered Wearable IoTs
Lan, G., Ma, D., Xu, W., Hassan, M., & Hu, W. S. (2020) · ACM Transactions on Internet of Things · doi:10.1145/3362124 · Cited by 26
“, the 3-axial accelerations, 25–100 times per second [7, 30], depending on the performance”
BackgroundInfluentialPatel, A. D., & Shah, J. H. (2019) · IEEE India Conference · doi:10.1109/indicon47234.2019.9030353 · Cited by 26
“(i) Sensor-based HAR (Environmental, object, wearable): These types of sensors are non-intrusive, so they provide maximum flexibility to the users [16].”
BackgroundA Novel Gesture Recognition System Based on CSI Extracted from a Smartphone with Nexmon Firmware
Li, T., Shi, C., Li, P., & Chen, P. (2020) · Sensors · doi:10.3390/s21010222 · Cited by 26
“Traditionally, gesture recognition is usually implemented using technologies such as depth and infrared cameras [1–3] or wearable devices [4–6].”
BackgroundTran, T. Q., Becker, A., & Grzechca, D. E. (2021) · Sensors · doi:10.3390/s21093184 · Cited by 26
“Data in—data out [17,31] Data level fusion Feature in—feature out [17,21–23] Feature level fusion Decision in—decision out [17,23,32,33] Decision level fusion Data in—feature out The inputs are the raw sensor data and the output are the features of the surroundings.”
BackgroundToward Privacy-Preserving Healthcare Monitoring Based on Time-Series Activities Over Cloud
Zheng, Y., Lu, R., Zhang, S., Guan, Y., Shao, J., & Zhu, H. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3079106 · Cited by 26
Data Augmentation Strategies for Human Activity Data Using Generative Adversarial Neural Networks
Hoelzemann, A., Sorathiya, N., & Laerhoven, K. V. (2021) · IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops) · doi:10.1109/percomworkshops51409.2021.9431046 · Cited by 26
“Regardless of the previously defined experiment protocol selection, its use defines the manner and scope of the individual activities in detail [6].”
MethodExploring System Performance of Continual Learning for Mobile and Embedded Sensing Applications
Kwon, Y. D., Chauhan, J., Kumar, A., Hui, P., & Mascolo, C. (2021) · ePrints Soton (University of Southampton) · doi:10.17863/cam.81436 · Cited by 26
Hardegger, M., Roggen, D., Calatroni, A., & Tröster, G. (2016) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/2824286 · Cited by 26
“Depending on the type and duration of the activities to be recognized, the raw signals are preprocessed into descriptive features [Bulling et al. 2014], or the system compares the input data to prerecorded templates with similarity metrics such as Dynamic Time Warping (DTW, Berndt and Clifford…”
MethodMazurek, P., Wagner, J., & Morawski, R. Z. (2017) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2017.09.006 · Cited by 26
Detecting Intentions of Vulnerable Road Users Based on Collective IntelligencePreprint
Bieshaar, M., Reitberger, G., Zernetsch, S., Sick, B., Fuchs, E., & Doll, K. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.03916 · Cited by 26
BAR: Bayesian Activity Recognition using variational inferencePreprint
Krishnan, R., Subedar, M. M., & Tickoo, O. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.03305 · Cited by 26
“Activity recognition is an active area of research with multiple approaches depending on the application domain and the types of sensors [1, 2, 3].”
BackgroundTowards Generalizable Human Activity Recognition: A SurveyPreprint
Cai, Y., Guo, B., Salim, F., & Hong, Z. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2508.12213 · Cited by 26
“Table 1 shows the comparison between our survey and existing representative IMU-sensing-based surveys [25, 48, 50, 84, 96, 124, 140, 163, 174, 209].”
Seeing and Hearing Egocentric Actions: How Much Can We Learn?
Cartas, A., Luque, J., Radeva, P. I., Segura, C., & Dimiccoli, M. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00548 · Cited by 25
“Indeed, most existing approaches for the latter aimed at combining different inertial sensors such as accelerometers, gyroscopes and magnetic field sensors [34] or inertial cues with audio or depth cues [7, 10].”
BackgroundHuman action recognition based on low- and high-level data from wearable inertial sensors
López-Nava, I. H., & Muñoz-Meléndez, A. (2019) · International Journal of Distributed Sensor Networks · doi:10.1177/1550147719894532 · Cited by 25
Sensor-based Human Activity Recognition Using Graph LSTM and Multi-task Classification Model
Cao, J., Wang, Y., Tao, H., & Guo, X. (2022) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3561387 · Cited by 25
Evaluation of at-home physiotherapy: machine-learning prediction with smart watch inertial sensors
Boyer, P., Burns, D., & Whyne, C. M. (2023) · Bone and Joint Research · doi:10.1302/2046-3758.123.bjr-2022-0126.r1 · Cited by 25
IoT Motion Tracking System for Workout Performance Evaluation: A Case Study on Dumbbell
Sun, S., Peng, T., Huang, H., Wang, Y., Zhang, X., & Zhou, Y. (2023) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2023.3320183 · Cited by 25
“In 2014, Bulling et al. [18] provided a tutorial on traditional machine-learning methods for human motion recognition based on wearable inertial sensors.”
BackgroundApplication of Smart Insoles for Recognition of Activities of Daily Living: A Systematic Review
D’Arco, L., McCalmont, G., Wang, H., & Zheng, H. (2023) · ACM Transactions on Computing for Healthcare · doi:10.1145/3633785 · Cited by 25
“Concerning Time Windowing, there are no precise rules that allow establishing the optimal size of a window, this is because an activity is performed differently even by the same person over time [10].”
BackgroundMulti-modal lifelog data fusion for improved human activity recognition: A hybrid approach
Oh, Y., & Kim, S. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102464 · Cited by 25
Energy efficient human activity recognition using wearable sensors
Ding, G., Tian, J., Wu, J., Zhao, Q., & Xie, L. (2018) · IEEE Wireless Communications and Networking Conference Workshops (WCNCW) · doi:10.1109/wcncw.2018.8368980 · Cited by 25
“[12, 13].”
Nematallah, H., & Rajan, S. (2020) · IEEE International Instrumentation and Measurement Technology Conference · doi:10.1109/i2mtc43012.2020.9128582 · Cited by 25
“The activity recognition using handcrafted features has been well researched in the literature [10], [11].”
MethodA Personalized Classifier for Human Motion Activities With Semi-Supervised Learning
Singh, G., Chowdhary, M., Kumar, A., & Bahl, R. (2020) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2020.3036277 · Cited by 25
“Earlier work, Bulling et al. [10] have provided a comprehensive overview on recognizing human motion activities using on-body inertial sensors.”
BackgroundInertial Sensor-Based Smoother for Gait Analysis
Suh, Y. S. (2014) · Sensors · doi:10.3390/s141224338 · Cited by 25
“These angle-based systems are extended to estimate whole human body motion [12–14].”
BackgroundTime-Elastic Generative Model for Acceleration Time Series in Human Activity Recognition
Muñoz-Organero, M., & Blázquez, R. R. (2017) · Sensors · doi:10.3390/s17020319 · Cited by 25
“Each Inertial Measurement Unit comprised a three-axial accelerometer and a two-axis gyroscope recording timestamped motion data at a joint sampling rate of 32 Hz [20].”
BackgroundMethodInfluentialMBOSS: A Symbolic Representation of Human Activity Recognition Using Mobile Sensors
Montero Quispe, K. G., Sousa Lima, W., Macêdo Batista, D., & Souto, E. (2018) · Sensors · doi:10.3390/s18124354 · Cited by 24
“Inertial sensors data is typically processed through the following steps: data collection, data segmentation, feature extraction, feature selection, and classification model training [11].”
MethodInfluentialEspinilla, M., Medina-Quero, J., Salguero, A., Irvine, N., Donnelly, M. P., Cleland, I., & Nugent, C. (2018) · International Conference on Ubiquitous Computing and Ambient Intelligence (UCAmI) · doi:10.3390/proceedings2191242 · Cited by 24
“The set of common features, defined in previous work [8,9] were extracted from the x , y , z axis and SMV, as is presented in Table 2.”
BackgroundMethodPrediction of freezing of gait based on self-supervised pretraining via contrastive learning
Xia, Y., Sun, H. D., Zhang, B., Xu, Y., & Ye, Q. (2023) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2023.105765 · Cited by 24
Multiwindow Fusion for Wearable Activity Recognition
Baños, O., Gálvez, J. M., Damas, M., Guillén, A., Herrera, L. J., Pomares, H., Rojas, I., Villalonga, C., Hong, C. S., & Lee, S. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-19222-2_24 · Cited by 24
“All these steps, commonly referred as to activity recognition chain, are extensively reviewed in [10].”
Creating collar-sensed motion gestures for dog-human communication in service applications
Valentin, G., Alcaidinho, J., Howard, A., Jackson, M. M., & Starner, T. E. (2016) · ACM International Symposium on Wearable Computers (ISWC) · doi:10.1145/2971763.2971788 · Cited by 24
“This last approach is often described as a two-step process consisting of segmentation and classification [7].”
Methodi 2 tag: RFID Mobility and Activity Identification Through Intelligent Profiling
Fan, X., Gong, W., & Liu, J. (2017) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3035968 · Cited by 24
“Traditional solutions mainly use radars (Xiao et al. 2016), cameras (Chaquet et al. 2013), and various inertial sensors (Bulling et al. 2014).”
BackgroundVirtual Tai-Chi System: A smart-connected modality for rehabilitation
Liang, Y., Wu, D., Ledesma, D., Davis, C., Slaughter, R., & Guo, Z. (2018) · Smart Health · doi:10.1016/j.smhl.2018.07.021 · Cited by 24
Attributes’ Importance for Zero-Shot Pose-Classification Based on Wearable Sensors
Ohashi, H., Al-Naser, M., Ahmed, S., Nakamura, K., Sato, T., & Dengel, A. R. (2018) · Sensors · doi:10.3390/s18082485 · Cited by 24
Ponce-Espinosa, H., Souza, P. V. D. C., Guimarães, A. J., & González-Mora, G. (2019) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2019.103427 · Cited by 24
GAN-based Style Transformation to Improve Gesture-recognition Accuracy
Suzuki, N., Watanabe, Y., & Nakazawa, A. (2020) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3432199 · Cited by 24
“features and SVMs and/or hidden Markov models (HMMs) [2].”
BackgroundIMU-based Deep Neural Networks for Locomotor Intention Prediction
Lu, H., Schomaker, L., & Carloni, R. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341649 · Cited by 24
“Inertial measurement units (IMUs) have been used for the prediction of locomotion modes and as the control input for lower limb powered prostheses [2].”
MethodInattentive Driving Detection Using Body-Worn Sensors: Feasibility Study
Akiduki, T., Nagasawa, J., Zhang, Z., Omae, Y., Arakawa, T., & Takahashi, H. (2022) · Sensors · doi:10.3390/s22010352 · Cited by 23
“Features of wrist movements such as the mean and variance of acceleration, which are widely used in Human Activity Recognition (HAR) [29–31], are computed from accelerometer data and used as input to the model.”
MethodMicro-activity recognition in industrial assembly process with IMU data and deep learning
Sopidis, G., Haslgrübler, M., Azadi, B., Anzengruber-Tánase, B., Ahmad, A., Ferscha, A., & Baresch, M. (2022) · International Conference on PErvasive Technologies Related to Assistive Environments (PETRA) · doi:10.1145/3529190.3529204 · Cited by 23
FusedAR: Energy-Positive Human Activity Recognition Using Kinetic and Solar Signal Fusion
Sandhu, M. M., Khalifa, S., Geissdoerfer, K., Jurdak, R., Portmann, M., & Kusý, B. (2023) · IEEE Sensors Journal · doi:10.1109/jsen.2023.3268687 · Cited by 23
“…transducer varies in line with the underlying human movements and, thus, encodes distinct context information about the corresponding activity, demonstrating the potential of KEH-based activity recognition (KEHAR) as a proxy for conventional accelerometer-based activity recognition (AccAR) [16].”
BackgroundBSDGAN: Balancing Sensor Data Generative Adversarial Networks for Human Activity Recognition
Hu, Y. (2023) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn54540.2023.10191928 · Cited by 23
“The abundance of sensor data leads to Human Activity Recognition (HAR) based on sensor data widely employed in various fields of our daily life, such as health care [2], sleep quality analysis [3], patient rehabilitation [4], interactive entertainment [5] and sports fitness [6].”
BackgroundAli, A. M., & Abdelhafeez, A. (2022) · Sustainable Machine Intelligence Journal · doi:10.61185/smij.2022.8463 · Cited by 23
Ferguson, E. F., Spackman, E. K., Cai, R. Y., Hardan, A. Y., & Uljarević, M. (2024) · Autism Research · doi:10.1002/aur.3269 · Cited by 23
“…measurement units, to provide greater flexibility and accuracy in characterizing the dynamic interplay between specific SIB subdomains and patterns of arousal in autistic youth (Barrera et al., 2007; Bulling et al., 2014; Cantin-Garside et al., 2020; Freeman et al., 1999; Jennett et al., 2011).”
Metadata
- Authors
- Bulling, A., Blanke, U., & Schiele, B.
- Affiliations
- Max Planck Institute for Informatics (DE)
- ETH Zurich (CH)
- Venue
- ACM Computing Surveys
- Published
- 2014-01
- Volume
- 46
- Issue
- 3
- Pages
- 1-33
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W2023302299
- Cited by
- 1,668
- References
- 132
- Citations by year
- 2026: 114 · 2025: 105 · 2024: 104 · 2023: 125 · 2022: 158 · 2021: 153 · 2020: 201 · 2019: 213 · 2018: 164 · 2017: 118 · 2016: 115 · 2015: 75 · 2014: 22
- FWCI
- 98.29
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM Computing Surveys (publishedVersion)
- Max Planck Digital Library (submittedVersion)
- MPG.PuRe (Max Planck Society) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Physical Sciences › Engineering › Biomedical Engineering › Gait Recognition and Analysis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Keywords
- human activity recognition, wearable sensors, hand gesture recognition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.