A tutorial on human activity recognition using body-worn inertial sensors
The DOI matches its Crossref record; 131 of the 132 references it cites were found in a registry or an index.
Abstract
The last 20 years have seen ever-increasing research activity in the field of human activity recognition. With activity recognition having considerably matured, so has the number of challenges in designing, implementing, and evaluating activity recognition systems. This tutorial aims to provide a comprehensive hands-on introduction for newcomers to the field of human activity recognition. It specifically focuses on activity recognition using on-body inertial sensors. We first discuss the key research challenges that human activity recognition shares with general pattern recognition and identify those challenges that are specific to human activity recognition. We then describe the concept of an Activity Recognition Chain (ARC) as a general-purpose framework for designing and evaluating activity recognition systems. We detail each component of the framework, provide references to related research, and introduce the best practice methods developed by the activity recognition research community. We conclude with the educational example problem of recognizing different hand gestures from inertial sensors attached to the upper and lower arm. We illustrate how each component of this framework can be implemented for this specific activity recognition problem and demonstrate how different implementations compare and how they impact overall recognition performance.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The promising results delivered in these works without the use of labels have resulted in a general direction of integrating unsupervised learning as-is into conventional activity recognition chains (ARC) [8] in the feature extraction step.”
From Contrastive Predictive Coding for Human Activity Recognition (2021) · cites this paper as [8]
In the citing paper
“The comparative studies using our evaluation framework are novel, because such an analysis has in particular been missing in most survey papers of sensor-based HAR [1,2,3].”
From Comparison of Feature Learning Methods for Human Activity Recognition Using Wearable Sensors (2018) · cites this paper as [3]
In the citing paper
“In [3], the authors carried out extensive experiments to assess the effectiveness of several approaches, but only considered simple hand-crafted features and classifiers using a small self-produced dataset.”
From Comparison of Feature Learning Methods for Human Activity Recognition Using Wearable Sensors (2018) · cites this paper as [3]
In the citing paper
“While the HAR problem seeks to find a perfect segmentation of activities, this task is difficult to achieve since humans perform activities in a fluent way and the segmentation of time series into intervals that represent single activities is not straightforward (Bulling et al. 2014).”
From Advanced Sensing and Human Activity Recognition in Early Intervention and Rehabilitation of Elderly People (2020) · cites this paper as Bulling et al. 2014
In the citing paper
“The second aspect that goes along with this is that human activity is highly diverse and the recognition of specific activities therefore requires an accurate selection of sensors and their placement (Bulling et al. 2014).”
From Advanced Sensing and Human Activity Recognition in Early Intervention and Rehabilitation of Elderly People (2020) · cites this paper as Bulling et al. 2014
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
A tutorial on hidden Markov models and selected applications in speech recognition
Rabiner, L. R. (1989) · Proceedings of the IEEE · doi:10.1109/5.18626 · Cited by 22,743 · cited 2×
“Given the training data T and an initial guess of the parameters ., a separate model is trained for each class using expectation maximization [Rabiner 1989; Fink 2008].”
MethodAn introduction to ROC analysis
Fawcett, T. (2006) · Pattern Recognition Letters · doi:10.1016/j.patrec.2005.10.010 · Cited by 21,879 · cited 1×
“Therefore, a common strategy is to sweep the threshold on the score for each individual class (one vs. all) and analyze the behavior in so-called Receiver Operating Characteristic (ROC) or Precision-Recall (PR) curves [Fawcett 2006].”
MethodPeng, H., Long, F., & Ding, C. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.159 · Cited by 10,544 · cited 2×
“These can be categorized into wrapper [Kohavi and John 1997], filter [Peng et al. 2005], or hybrid [Somol et al.”
BackgroundMethodWrappers for feature subset selection
Kohavi, R., & John, G. H. (1997) · Artificial Intelligence · doi:10.1016/s0004-3702(97)00043-x · Cited by 8,947 · cited 2×
“A large number of researchers investigated machine recognition of gestures and activities from still images and video in constrained environments or stationary settings (see Mitra and Acharya [2007], Turaga et al.”
BackgroundAn introduction to variable and feature selection
GuyonIsabelle, & ElisseeffAndré (2003) · Journal of Machine Learning Research · doi:10.5555/944919.944968 · Cited by 7,715
The Pascal Visual Object Classes Challenge: A Retrospective
Everingham, M., Eslami, S. M. A., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-014-0733-5 · Cited by 7,139
Friedman, J., Hastie, T., & Tibshirani, R. (2000) · The Annals of Statistics · doi:10.1214/aos/1016218223 · Cited by 6,884 · cited 2×
“Introduced in machine learning and computer vision [Friedman et al. 2000; Torralba et al. 2007], boosting as a variant of decision fusion has been successfully applied to activity recognition as well [Lester et al. 2005; Blanke and Schiele 2009; Zinnen et al. 2009b].”
Method2011 Compendium of Physical Activities: A Second Update of Codes and MET Values
AINSWORTH, B. E., HASKELL, W. L., HERRMANN, S. D., MECKES, N., BASSETT, D. R., TUDOR-LOCKE, C., GREER, J. L., VEZINA, J., WHITT-GLOVER, M. C., & LEON, A. S. (2011) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0b013e31821ece12 · Cited by 6,317 · cited 2×
“Other resources include the comprehensive compendium of physical activity [Ainsworth et al. 2011].”
BackgroundProceedings of the 19th International Joint Conference on Artificial Intelligence
Pujol, J. M., Delgado, J., Ramon Sangüesa, A., & Flache, A. (2005) · International Joint Conference on Artificial Intelligence · Cited by 5,771
Kittler, J., Hatef, M., Duin, R. P. W., & Matas, J. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.667881 · Cited by 5,290 · cited 3×
“J. Kittler et al. 1998.”
Background
Research works printed but not linked: 7
- 10.5555/2015035.2015320 · doi:10.5555/2015035.2015320
- 10.5555/1642293.1642416 · doi:10.5555/1642293.1642416
- 10.5555/1642293.1642417 · doi:10.5555/1642293.1642417
- 10.5555/2283516.2283683 · doi:10.5555/2283516.2283683
- 10.5555/1460232.1460248 · doi:10.5555/1460232.1460248
- 10.5555/2021975.2022004 · doi:10.5555/2021975.2022004
- 10.5555/862896.881089 · doi:10.5555/862896.881089
Cited by
Items 401–500 of 1,007
A Comprehensive Review of Automated Data Annotation Techniques in Human Activity RecognitionPreprint
Demrozi, F., Turetta, C., Machot, F. A., Pravadelli, G., & Kindt, P. H. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2307.05988 · Cited by 39
“Automated annotation systems are commonly used in large-scale HAR applications, where manual annotation is not feasible due to a large amount of data [9].”
BackgroundMethodInfluentialDetecting Urban Transport Modes Using a Hybrid Knowledge Driven Framework from GPS Trajectory
Das, R. D., & Winter, S. (2016) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi5110207 · Cited by 38
“Detecting transport modes in near-real time resembles to activity recognition on a second-by-second basis in pervasive and mobile computing [21,22].”
BackgroundHuman activity recognition for emergency first responders via body-worn inertial sensors
Scheurer, S., Tedesco, S. A., Brown, K. N., & O’Flynn, B. (2017) · Wearable and Implantable Body Sensor Networks · doi:10.1109/bsn.2017.7935994 · Cited by 39
“Human activity recognition based on inertial data has been a fruitful line of enquiry for more than a decade [3], [4].”
BackgroundEasing Power Consumption of Wearable Activity Monitoring with Change Point Detection
Culman, C., Aminikhanghahi, S., & Cook, D. J. (2020) · Sensors · doi:10.3390/s20010310 · Cited by 38
Integrated Wound Recognition in Bandages for Intelligent Treatment
He, X., Yang, S., Liu, C., Xu, T., & Zhang, X. (2020) · Advanced Healthcare Materials · doi:10.1002/adhm.202000941 · Cited by 38
Biosensors toward behavior detection in diagnosis of alzheimer’s disease
Sun, X., Sun, X., Wang, Q., Wang, X., Feng, L., Yang, Y., Jing, Y., Yang, C., & Zhang, S. (2022) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2022.1031833 · Cited by 38
“Especially, biosensors oriented to motion behavior monitoring, physiological signal capturing, and environment information detecting have drawn particular attention among AD diagnosis and other behavior detection applications (Lara and Labrador, 2013; Bulling et al., 2014; Liu et al., 2021).”
BackgroundGaze-enabled activity recognition for augmented reality feedback
Bektaş, K., Strecker, J., Mayer, S., & García, K. (2024) · Computers & Graphics · doi:10.1016/j.cag.2024.103909 · Cited by 40
RAM: Radar-based activity monitor
Khan, M. A. A. H., Kukkapalli, R., Waradpande, P., Kulandaivel, S., Banerjee, N., Roy, N., & Robucci, R. (2016) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom.2016.7524361 · Cited by 38
“Researchers have also proposed the use of wearable sensors for activity recognition [15].”
Backgrounde-Shoes: Smart shoes for unobtrusive human activity recognition
Pham, C., Điệp, N. N., & Phuong, T. M. (2017) · International Conference on Knowledge and Systems Engineering/Proceedings · doi:10.1109/kse.2017.8119470 · Cited by 38
“Networks Feature extraction for activity recognition using wearable sensors is challenging because human activity is very complicated [26].”
BackgroundWearable Internet-of-Things platform for human activity recognition and health care
Iqbal, A., Ullah, F., Anwar, H., Rehman, A. U., Shah, K., Baig, A., Ali, S., Yoo, S., & Kwak, K. S. (2020) · International Journal of Distributed Sensor Networks · doi:10.1177/1550147720911561 · Cited by 38
“15 First, either one sensor or a combination of body-worn, wrist-worn, and smartphone motion sensors collect activity time-series data.”
BackgroundProbabilistic modeling for sensor fusion with inertial measurements
Kok, M. (2016) · Linköping studies in science and technology. Dissertations · doi:10.3384/diss.diva-133083 · Cited by 37
“Bulling et al. (2014); Hardegger et al. (2016); Reiss et al. (2010). This field focuses on recognizing the activities that the subject performs.”
BackgroundClassifying Diverse Physical Activities Using “Smart Garments”
Esfahani, M. I. M., & Nussbaum, M. A. (2019) · Sensors · doi:10.3390/s19143133 · Cited by 37
“It is unrealistic to presume (at least initially) that a single, optimal classification method can be derived for all conditions of interest [54,55].”
BackgroundWiGAN: A WiFi Based Gesture Recognition System with GANs
Jiang, D., Li, M., & Xu, C. (2020) · Sensors · doi:10.3390/s20174757 · Cited by 37
“Traditional gesture recognition methods are mainly based on cameras [1], wearable sensors [2], RFID [3], radar [4], and other special equipment [5].”
BackgroundAdversary Models for Mobile Device Authentication
Mayrhofer, R., & Sigg, S. (2021) · ACM Computing Surveys · doi:10.1145/3477601 · Cited by 37
“Common measures such as accuracy, precision, recall, true/false positive/negative rates, or F-measure are all based on this same principle [30, 41].”
BackgroundA Radar-Based Human Activity Recognition Using a Novel 3-D Point Cloud Classifier
Yu, Z., Taha, A., Taylor, W., Zahid, A., Rajab, K. Z., Heidari, H., Imran, M. A., & Abbasi, Q. H. (2022) · IEEE Sensors Journal · doi:10.1109/jsen.2022.3198395 · Cited by 37
“For daily activities of humans, the complexity of the actions 132 may be different, and human movements are classified accord-133 ing to various situations, including the number of activi-134 ties [13], the types of activities [14], data collection energy 135 consumption [15], and significance [16].”
BackgroundRecognition of Human Hand Activities Based on a Single Wrist IMU Using Recurrent Neural Networks
Rivera, P., Añazco, E. V., Choi, M., & Kim, T. (2017) · International Journal of Pharma Medicine and Biological Sciences · doi:10.18178/ijpmbs.6.4.114-118 · Cited by 37
“Even for time sequential data, Conditional Random Forest or Hidden Markov Model were used [2], [3].”
MethodRehman, S. U., Ali, A., Khan, A., & Okpala, C. (2024) · Algorithms · doi:10.3390/a17120556 · Cited by 36
Karim, M. F. A., Khalid, S., Lee, S., Almutairi, S. S., Namoun, A., & Abohashrh, M. (2025) · IEEE Access · doi:10.1109/access.2025.3590073 · Cited by 36
“Human Action Recognition (HAR) systems have undergone transformative advancements driven by innovations in signal processing and the proliferation of Internet of Things (IoT) technologies [41], [59], [93].”
Deep Dilation on Multimodality Time Series for Human Activity Recognition
Xi, R., Li, M., Hou, M., Fu, M., Qu, H., Liu, D., & Haruna, C. R. (2018) · IEEE Access · doi:10.1109/access.2018.2870841 · Cited by 35
“Besides, they also ignore intra-class variability and similarity that are implicit features required to recognize complex activities [15].”
BackgroundSmartWheels: Detecting urban features for wheelchair users’ navigation
Mascetti, S., Civitarese, G., Malak, O. E., & Bettini, C. (2020) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2020.101115 · Cited by 37
“A common technique for data cleaning is data smoothing, which aims at reducing the intrinsic noise of inertial sensor measurements [6].”
MethodHuman activity recognition adapted to the type of movement
Gil-Martín, M., San-Segundo, R., Fernández-Martínez, F., & de Córdoba, R. (2020) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2020.106822 · Cited by 36
Haden, P. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.006 · Cited by 36
Emotion recognition from embedded bodily expressions and speech during dyadic interactions
Müller, P., Amin, S., Verma, P., Andriluka, M., & Bulling, A. (2015) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2015.7344640 · Cited by 36
“…body movements has since sparked a large body of work in social signal processing and affective computing, focusing on both encoding body movements in a similar fashion as facial expressions [10, 11] as well as inferring emotions from body movements [12, 13, 14] (see [15, 16, 17, 18] for reviews).”
BackgroundSelf-citationCiliberto, M., Fortes Rey, V., Calatroni, A., Lukowicz, P., & Roggen, D. (2021) · Frontiers in Computer Science · doi:10.3389/fcomp.2021.792065 · Cited by 35
“This is an important area of research in wearable, mobile and ubiquitous computing Kim et al. (2010); Bulling et al. (2014); San-Segundo et al. (2018); Plotz and Guan (2018) systems able to model human behaviour and automatically recognise speci fi c activities and situations enable new forms of…”
BackgroundBieshaar, M., Zernetsch, S., Hubert, A., Sick, B., & Doll, K. (2018) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2018.2873900 · Cited by 35
“The detection is realized by means of human activity recognition techniques [32] based on the gyroscope and accelerometer sensory data, which is nowadays available on nearly every smartphone.”
MethodInfluentialComparing CNN and Human Crafted Features for Human Activity Recognition
Cruciani, F., Vafeiadis, A., Nugent, C., Cleland, I., McCullagh, P. J., Votis, K., Giakoumis, D., Tzovaras, D. K., Chen, L., & Hamzaoui, R. (2019) · IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI) · doi:10.1109/smartworld-uic-atc-scalcom-iop-sci.2019.00190 · Cited by 35
“The process of activity recognition usually includes a spe-cific sequence of steps, also known as Activity Recognition Chain (ARC) [10].”
BackgroundHuman activity detection using machine learning methods from wearable sensors
Randhawa, P., Shanthagiri, V., Kumar, A., & Yadav, V. (2020) · Sensor Review · doi:10.1108/sr-02-2020-0027 · Cited by 35
Classification of Human Activities Based on Radar Signals using 1D-CNN and LSTM
Zhu, J., Chen, H., & Ye, W. (2020) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas45731.2020.9181233 · Cited by 35
Machine and Deep Learning Algorithms for Wearable Health Monitoring
Fei, C., Liu, R., Li, Z., Wang, T., & Baig, F. N. (2021) · Health information science · doi:10.1007/978-3-030-68723-6_6 · Cited by 35
Synthetic Smartwatch IMU Data Generation from In-the-wild ASL Videos
Santhalingam, P. S., Pathak, P., Rangwala, H., & Kosecka, J. (2023) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3596261 · Cited by 28
Liang, J., Zhang, L., Bu, C., Cheng, D., Wu, H., & Song, A. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122180 · Cited by 35
Wearable Inertial Sensor for Jump Performance Analysis
Milosevic, B., & Farella, E. (2015) · Workshop on Wearable Systems and Applications (WearSys) · doi:10.1145/2753509.2753512 · Cited by 35
“Applications include activity recognition [4], energy expenditure estimation [1], rehabilitation [18], gait analysis [5].”
BackgroundUsing an End-to-End Convolutional Network on Radar Signal for Human Activity Classification
Ye, W., Chen, H., & Li, B. (2019) · IEEE Sensors Journal · doi:10.1109/jsen.2019.2938997 · Cited by 35
“HUMAN activity classification can be used in many areas such as sleep monitoring, elderly care, and anti-terrorism monitoring [1]–[5].”
MethodPrabhu, G., O'Connor, N. E., & Moran, K. (2020) · Sensors · doi:10.3390/s20174791 · Cited by 35
“Studies [8,15,17,19] on the usage of 45 wearable sensors, either phone-based or using inertial measurement units, have shown that CVD 46 patients (67% ~ 68%) have an interest in single sensor-based cardiac rehabilitation [8].”
BackgroundPlÖtz, T. (2022) · ACM Computing Surveys · doi:10.1145/3459666 · Cited by 34
“The typical reflex is to employ some form of the standard activity recognition pipeline (summarized, for example, in Reference [10]): Record and annotate example data, extract analysis frames through a sliding window procedure, extract (heuristic) features, and train a classifier.”
BackgroundMethodInfluentialAnalysing Cooking Behaviour in Home Settings: Towards Health Monitoring
Yordanova, K., Lüdtke, S., Whitehouse, S., Krüger, F., Paiement, A., Mirmehdi, M., Craddock, I. J., & Kirste, T. (2019) · Sensors · doi:10.3390/s19030646 · Cited by 34
“[19] provided a detailed overview of methods for activity recognition.”
MethodA Survey on Energy Expenditure Estimation Using Wearable Devices
Álvarez-García, J. A., Cvetković, B., & Luštrek, M. (2020) · ACM Computing Surveys · doi:10.1145/3404482 · Cited by 34
“We can observe that the field most closely related to EEE is probably AR (addressed in ACM Computing Surveys in 2013 [60] and 2014 [26]).”
BackgroundMorshed, M. B., Kulkarni, S. S., Li, R. C., Saha, K., Roper, L. G., Nachman, L., Lu, H., Mirabella, L., Srivastava, S., Choudhury, M. D., et al. (2020) · JMIR mhealth and uhealth · doi:10.2196/20625 · Cited by 34
“After annotating the data, the authors employed an eating moment recognition pipeline, which is similar to the conventional activity recognition chain [44].”
MethodSelf-Attention Networks for Human Activity Recognition Using Wearable Devices
Betancourt, C., Chen, W., & Kuan, C.-W. (2020) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc42975.2020.9283381 · Cited by 34
“Sliding window is a popular technique used to standardize this type of data producing equal-sized samples [7].”
BackgroundMethodInfluentialMuangprathub, J., Sriwichian, A., Wanichsombat, A., Kajornkasirat, S., Nillaor, P., & Boonjing, V. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph182312652 · Cited by 34
Meyer, J., Frank, A., Schlebusch, T., & Kasneci, E. (2021) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3494998 · Cited by 34
“This leads to intra class heterogeneity [7] and a general model, which shows high recognition accuracy over all participants, is hard to build.”
BackgroundInfluentialAssessing Impact of Sensors and Feature Selection in Smart-Insole-Based Human Activity Recognition
D’Arco, L., Wang, H., & Zheng, H. (2022) · Methods and Protocols · doi:10.3390/mps5030045 · Cited by 34
“…and wearable sensors, can be integrated into HAR systems; however, the evolution of Micro-Electro-Mechanical Systems (MEMS) has favoured the diffusion of wearable devices, which are cost-effective and require slight space to deploy, and seamlessly integrate with the user’s daily life [9].”
BackgroundCost-sensitive feature selection for on-body sensor localization
Saeedi, R., Schimert, B., & Ghasemzadeh, H. G. (2014) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/2638728.2641313 · Cited by 34
“Statistical features have shown effectiveness in human activity recognition based on previous studies [4].”
BackgroundDetecting unseen anomalies in weight training exercises
Kowsar, Y., Moshtaghi, M., Velloso, E., Kulik, L., & Leckie, C. A. (2016) · Australian Conference on Computer-Human Interaction (OzCHI) · doi:10.1145/3010915.3010941 · Cited by 34
“For a survey of activity recognition, see (Bulling et al. 2014; Lara and Labrador 2013).”
BackgroundRecognition and prediction of manipulation actions using Enriched Semantic Event Chains
Ziaeetabar, F., Kulvičius, T., Tamošiūnaitė, M., & Wörgötter, F. (2018) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2018.10.005 · Cited by 34
Altuve, M., Lizarazo, P., & Villamizar, J. (2020) · Journal of Applied Biomedicine · doi:10.1016/j.bbe.2020.04.007 · Cited by 34
Haresamudram, H., Tang, C. I., Suh, S., Lukowicz, P., & Plötz, T. (2025) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3729467 · Cited by 33
“The Activity Recognition Chain as summarized in [19].”
InfluentialPatchHAR: A MLP-Like Architecture for Efficient Activity Recognition Using Wearables
Wang, S., Zhang, L., Wang, X., Huang, W., Wu, H., & Song, A. (2024) · IEEE Transactions on Biometrics Behavior and Identity Science · doi:10.1109/tbiom.2024.3354261 · Cited by 33
“…accuracy, and smaller size, HAR has a wide range of applications in Ambient Assisted Living (AAL), motion tracking, elderly health assessment, and Human–Machine Interaction (HMI) [2], [3], which have greatly improved the quality of life and the healthcare of the elderly or other dependent people.”
BackgroundTransfer learning across human activities using a cascade neural network architecture
Du, X., Farrahi, K., & Niranjan, M. (2019) · International Symposium on Wearable Computers · doi:10.1145/3341163.3347730 · Cited by 33
“As with a number of other problems, extracting relevant features by automatical training is seen as an advantage over the use of hand-crafted features as used in [3, 18, 24].”
BackgroundHurtado, S., García-Nieto, J., Popov, A., & Navas‐Delgado, I. (2023) · International Journal of Interactive Multimedia and Artificial Intelligence · doi:10.9781/ijimai.2022.05.004 · Cited by 33
Scalable regular pattern mining in evolving body sensor data
Tanbeer, S. K., Hassan, M. M., Almogren, A., Zuair, M., & Jeong, B.-S. (2016) · Future Generation Computer Systems · doi:10.1016/j.future.2016.04.008 · Cited by 33
Gesture Recognition Using Dynamic Time Warping and Kinect: A Practical Approach
Riofrio, S., Pozo, D., Rosero, J. L., & Vásquez-Peralvo, J. A. (2017) · International Conference on Information Systems and Computer Science (INCISCOS) · doi:10.1109/inciscos.2017.36 · Cited by 33
“Some of them can be Inertial Measurements Units (IMU) [3], [4], Electromyography (EMG) sensors [5], stereo cameras [6], sensor fusion techniques [7] or depth sensors technologies like Kinect [8] or leap motion [9].”
BackgroundIterative Design of Visual Analytics for a Clinician-in-the-Loop Smart Home
Ghods, A., Caffrey, K., Lin, B., Fraga, K. J., Fritz, R., Schmitter‐Edgecombe, M., Hundhausen, C. D., & Cook, D. J. (2018) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2018.2864287 · Cited by 35
“While many diverse approaches have been explored for activity recognition that draw from machine learning techniques such as support vector machines, Gaussian mixture models, decision trees, and probabilistic graphs [21]–[29], many of these approaches also perform activity recognition on pre-segmented data in scripted…”
BackgroundPOLARIS: Probabilistic and Ontological Activity Recognition in Smart-Homes
Civitarese, G., Sztyler, T., Riboni, D., Bettini, C., & Stuckenschmidt, H. (2019) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2019.2930050 · Cited by 33
“Physical activity recognition systems are mainly based on data acquired from body-worn accelerometers [2], [15].”
BackgroundHDL: Hierarchical Deep Learning Model based Human Activity Recognition using Smartphone Sensors
Su, T., Sun, H., Ma, C., Jiang, L., & Xu, T. (2019) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2019.8851889 · Cited by 33
“recognition with various wearable sensors [19] [20] [21] [22].”
BackgroundVita, A. D., Russo, A., Pau, D. P., Benedetto, L. D., Rubino, A., & Licciardo, G. D. (2020) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2020.3011984 · Cited by 33
“Both image and inertial sensors are used to build HAR systems [2], [3], but the evolution of MEMS has largely contributed to make inertial-based HAR systems more cost-efficient than the image-based counterpart [4].”
BackgroundActivity recognition for medical teamwork based on passive RFID
Li, X., Yao, D., Pan, X., Johannaman, J., Yang, J., Webman, R. B., Sarcevic, A., Marsic, I., & Burd, R. S. (2016) · IEEE International Conference on RFID · doi:10.1109/rfid.2016.7488002 · Cited by 33
“Approaches for human-object interaction detection in complex and crowded environments rely on wearable sensors, which may be limiting in a clinical setting [4][5][6].”
Learning multi-level features for sensor-based human action recognition
Xu, Y. L., Shen, Z., Zhang, X., Gao, Y., Deng, S., Wang, Y., Fan, Y., & Chang, E. (2017) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2017.07.001 · Cited by 32
“Researches in the area of sensor-based HAR have been ever increasing in the past few years [8,16,18,41].”
BackgroundMethodGuerra, J., Uddin, J., Nilsen, D. M., Mclnerney, J., Fadoo, A., Omofuma, I., Hughes, S., Agrawal, S. K., Allen, P., & Schambra, H. M. (2017) · International Conference on Rehabilitation Robotics · doi:10.1109/icorr.2017.8009305 · Cited by 32
“The HMM calculates the likelihood of each state s ∈ [1, 25] per time frame.”
Jeyaraj, P. R., & Nadar, E. R. S. (2018) · Technology and Health Care · doi:10.3233/thc-171173 · Cited by 33
Martínez-Villaseñor, L., & Ponce-Espinosa, H. (2019) · International Journal of Distributed Sensor Networks · doi:10.1177/1550147719853987 · Cited by 32
“In particular, human-oriented perception, natural HRI, and real-time performance are design issues closely related to the domain of HAR.”
InfluentialLascio, E. D., Gashi, S., Hidalgo, J. S., Nale, B., Debus, M. E., & Santini, S. (2020) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3411821 · Cited by 32
“We plan to experiment with different segmentation strategies, including adaptive sliding windows [6], in future work.”
BackgroundMethodInfluentialSmartphone Sensor-Based Human Activity Recognition Robust to Different Sampling Rates
Hasegawa, T. (2020) · IEEE Sensors Journal · doi:10.1109/jsen.2020.3038281 · Cited by 32
“There are many other benchmark datasets for ADL recognition, such as WISDM [1] (sampling rate is 20 Hz), Skoda [17] (100 Hz), PAMAP [18] (100 Hz), Smartphone Dataset [19] (50 Hz), UniMiB SHAR [20] (50 Hz), mHealth [21], [22] (50 Hz), and Hand Gesture [23] (32 Hz).”
BackgroundTowards a Safe Human–Robot Collaboration Using Information on Human Worker Activity
Orsag, L., Stipanĉić, T., & Koren, L. (2023) · Sensors · doi:10.3390/s23031283 · Cited by 32
“HAR aims to understand human behaviors, which enable the computing systems to proactively assist users, based on their requirements [45].”
BackgroundA Real-Time Cross-Domain Wi-Fi-Based Gesture Recognition System for Digital Twins
Su, J. D., Mao, Q., Liao, Z., Sheng, Z., Huang, C., & Zhang, X. (2023) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2023.3310073 · Cited by 32
“Building a DT requires sensors to collect data and further process the data into usable information for the DT. Traditional gesture recognition systems are mainly based on visual sensors [9], [10], [11] or wearable sensors [12], [13], [14].”
MethodA Compressed Sensing-Based Wearable Sensor Network for Quantitative Assessment of Stroke Patients
Yu, L., Xiong, D., Guo, L., & Wang, J. (2016) · Sensors · doi:10.3390/s16020202 · Cited by 32
“Based on the application scenarios, the following four categories can be distinguished: fall detection [10,11], physical activity monitoring [12–14], movement recognition [15–17] and quantitative assessment [18–20].”
BackgroundMining intricate temporal rules for recognizing complex activities of daily living under uncertainty
Liu, L., Wang, S., Peng, Y., Huang, Z., Liu, M., & Hu, B. (2016) · Pattern Recognition · doi:10.1016/j.patcog.2016.07.024 · Cited by 32
A Smart Glove to Track Fitness Exercises by Reading Hand Palm
Hippocrate, A. A. E., Fujiwara, M., Suwa, H., Arakawa, Y., & Yasumoto, K. (2019) · Journal of Sensors · doi:10.1155/2019/9320145 · Cited by 32
“The DTW algorithm has been proven to be e ff ective for speech recognition [36] and has been intensively used in previous studies related to activity recognition [32], human motion [37], and bioinformatics [38].”
BackgroundMethodKnowledge-driven Egocentric Multimodal Activity Recognition
Huang, Y., Yang, X., Gao, J., Sang, J., & Xu, C. (2020) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3409332 · Cited by 32
“Bulling et al. [4] has shown that statistical features (e.g., time-domain and frequency-domain features) of sensor signals can achieve advanced performance in recognizing activities.”
BackgroundSmartphone-based human activity recognition
Ortiz, J. (2014) · UPCommons institutional repository (Universitat Politècnica de Catalunya) · doi:10.5821/dissertation-2117-95551 · Cited by 32
Inertial-Measurement-Unit-Based Novel Human Activity Recognition Algorithm Using Conformer
Kim, Y.-W., Cho, W.-H., Kim, K.-S., & Lee, S. (2022) · Sensors · doi:10.3390/s22103932 · Cited by 31
“IMU-based HAR technologies are expected to be utilized in digital healthcare; consequently, related studies have been steadily conducted over the past decades [1,2].”
BackgroundMatrix and Tensor Completion on a Human Activity Recognition Framework
Savvaki, S., Tsagkatakis, G., Πανουσοπούλου, Α., & Tsakalides, P. (2017) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2017.2716112 · Cited by 31
“Wearable computing and machine learning, which are typically combined for extracting context from raw streams of inertial data [3], are therefore expected to pioneer the provision of daily activities analytics while in motion within pervasive environments [4], [5].”
BackgroundUnsupervised online activity discovery using temporal behaviour assumption
Gjoreski, H., & Roggen, D. (2017) · ACM International Symposium on Wearable Computers (ISWC) · doi:10.1145/3123021.3123044 · Cited by 31
“INTRODUCTION Human Activity Recognition (HAR) relies on supervised learning [1], which limits it to recognizing pre-defined "closed" set of activities for which training data is available.”
BackgroundFalco, I. D., Pietro, G. D., & Sannino, G. (2019) · Neural Computing and Applications · doi:10.1007/s00521-018-03973-1 · Cited by 31
RetractedPhysical-World Attack towards WiFi-based Behavior Recognition
Liu, J., He, Y., Xiao, C., Han, J., Cheng, L., & Ren, K. (2022) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom48880.2022.9796920 · Cited by 31
Periodic Physical Activity Information Segmentation, Counting and Recognition From Video
Cheng, S.-H., Sarwar, M. A., Daraghmi, Y., İk, T.-U., & Li, Y.-L. (2023) · IEEE Access · doi:10.1109/access.2023.3247583 · Cited by 31
“Nowadays, HAR is based upon many different modalities, such as internal motion units (IMU) [33], [34], [35], [36], electromagnetic waves [37], [38], sound [39] and video [40], [41].”
BackgroundImproving classification of sit, stand, and lie in a smartphone human activity recognition system
Capela, N. A., Lemaire, E. D., & Baddour, N. (2015) · IEEE International Symposium on Medical Measurements and Applications (MeMeA) · doi:10.1109/memea.2015.7145250 · Cited by 31
“Newly added features should be mutually uncorrelated to existing features in order to provide beneficial gains in classifier accuracy [8], which is difficult when features are derived from a single sensor or sensor location.”
Improving activity recognition via automatic decision tree pruning
Phan, T. (2014) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/2638728.2641310 · Cited by 31
“Some approaches to treating naturalisitic activities include: labelling videotaped user behavior [3]; labelling users performing real-time multiple activities [5]; having users report their own activities [8]; and defining a “null” class [2].”
BackgroundMišić, D., Zdravković, M. M., Mitković, M., Vitković, N., & Mitković, M. (2018) · IEEE Internet of Things Journal · doi:10.1109/jiot.2018.2819623 · Cited by 31
“With a single sensor, common location choices are the hip, thigh, upper arm, wrist, or ankle [25].”
BackgroundCapSense: Capacitor-based Activity Sensing for Kinetic Energy Harvesting Powered Wearable Devices
Lan, G., Ma, D., Xu, W., Hassan, M., & Hu, W. S. (2017) · EAI International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services (MobiQuitous) · doi:10.1145/3144457.3144459 · Cited by 31
“It is noteworthy that, unlike conventional accelerometer-based [5] or KEH transducer-based activity sensing system [18] that require complex signal processing and feature extractions, CapSense relies only on the voltage dierence of the capacitor for activity recognition.”
BackgroundInfluentialComprehensive evaluation of skeleton features-based fall detection from Microsoft Kinect v2
Alzahrani, M. S., Jarraya, S. K., Ben‐Abdallah, H., & Ali, M. S. (2019) · Signal Image and Video Processing · doi:10.1007/s11760-019-01490-9 · Cited by 31
Ram, S. S., Apduhan, B. O., & Shiratori, N. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-24302-9_30 · Cited by 31
EnTrans: Leveraging Kinetic Energy Harvesting Signal for Transportation Mode Detection
Lan, G., Xu, W., Ma, D., Khalifa, S., Hassan, M., & Hu, W. S. (2019) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2918642 · Cited by 31
“We suggest interested readers refer [39], [40] for details of feature calculation.”
BackgroundNweke, H. F., Al-Garadi, M. A., Mujtaba, G., Alo, U. R., & Waqas, A. (2018) · International Conference on Computing, Mathematics and Engineering Technologies (iCoMET) · doi:10.1109/icomet.2018.8346364 · Cited by 31
“human activity recognition start with data collection, data segmentation, feature extraction and recognition of class label [1].”
BackgroundPersonalized Dynamics Models for Adaptive Assistive Navigation SystemsPreprint
Ohn-Bar, E., Kitani, K., & Asakawa, C. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.04118 · Cited by 31
“, surveillance or social settings [13, 28, 62, 54, 5, 42, 36, 19, 65, 34, 32, 23]).”
BackgroundMethodKwon, H., Abowd, G. D., & Plötz, T. (2021) · Sensors · doi:10.3390/s21248337 · Cited by 30
Energy-Efficient Context Aware Power Management with Asynchronous Protocol for Body Sensor Network
Magno, M., Polonelli, T., Casamassima, F., Gomez, A., Farella, E., & Benini, L. (2016) · Mobile Networks and Applications · doi:10.1007/s11036-016-0755-z · Cited by 30
GraphConvLSTM: Spatiotemporal Learning for Activity Recognition with Wearable Sensors
Han, J., He, Y., Liu, J., Zhang, Q., & Jing, X. (2019) · Globecom · doi:10.1109/globecom38437.2019.9013934 · Cited by 30
“machine learning technique [28], [29], [30].”
Low-Power HWAccelerator for AI Edge-Computing in Human Activity Recognition Systems
Vita, A. D., Pau, D. P., Parrella, C., Benedetto, L. D., Rubino, A., & Licciardo, G. D. (2020) · IEEE International Conference on Artificial Intelligence Circuits and Systems (AICAS) · doi:10.1109/aicas48895.2020.9073913 · Cited by 30
“Human Activity Recognition (HAR) is the ability to recognize different human activities based on data collected from sensors [1].”
BackgroundSensor Location Analysis and Minimal Deployment for Fall Detection System
Ponce-Espinosa, H., Martínez-Villaseñor, L., & Núñez-Martínez, J. (2020) · IEEE Access · doi:10.1109/access.2020.3022971 · Cited by 30
“This procedure is typically implemented in fall detection systems for temporal abstraction [29].”
MethodLow Power Tiny Binary Neural Network with improved accuracy in Human Recognition Systems
Vita, A. D., Pau, D. P., Benedetto, L. D., Rubino, A., Pétrot, F., & Licciardo, G. D. (2020) · Euromicro Conference on Digital System Design (DSD) · doi:10.1109/dsd51259.2020.00057 · Cited by 30
“In addition, in HAR systems, inertial sensors can have an arbitrary and changeable orientation in space, with the gravity acceleration providing a variable contribution to each sample, which is related to the reference frame integral to the sensor.”
BackgroundInfluentialReal-time wearable-device based activity recognition using machine learning methods
Thư, N. T., Dao, T.-H., Bao, B. Q., Tran, D.-N., Thanh, P. V., & Tran, D. (2022) · International Journal of Computing and Digital Systems · doi:10.12785/ijcds/120126 · Cited by 30
“Different from the above two approaches, the bodymounted sensor-based approach has opened up many potential applications in activity classification [16]–[20], [22]– [30].”
BackgroundClassification of Human Motion Data Based on Inertial Measurement Units in Sports: A Scoping Review
Kranzinger, C., Bernhart, S., Kremser, W., Venek, V., Rieser, H., Mayr, S., & Kranzinger, S. (2023) · Applied Sciences · doi:10.3390/app13158684 · Cited by 30
Lalapura, V. S., Bhimavarapu, V. R., Amudha, J., & Satheesh, H. S. (2024) · Algorithms · doi:10.3390/a17030104 · Cited by 30
Spinsante, S., Angelici, A., Lundström, J., Espinilla, M., Cleland, I., & Nugent, C. (2016) · Mobile Information Systems · doi:10.1155/2016/5126816 · Cited by 31
“An IR sensor could detect a user moving or being still, whereas a home assisting robot could understand when the person is sleeping, taking pills, or doing cleaning [4, 33, 34].”
BackgroundAssessing Motion Style Errors in Ski Jumping Using Inertial Sensor Devices
Brock, H., & Ohgi, Y. (2017) · IEEE Sensors Journal · doi:10.1109/jsen.2017.2699162 · Cited by 30
“Research in activity recognition from wearable sensor data has resulted in a wide variety of possible feature representations [31].”
BackgroundSwallowNet: Recurrent neural network detects and characterizes eating patterns
Nguyen, D. T., Cohen, E., Pourhomayoun, M., & Alshurafa, N. (2017) · 2017 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops) · doi:10.1109/percomw.2017.7917596 · Cited by 25
“3) Features: Table I summarizes the statistical features extracted from the signals, which have been shown to be useful in representing time-series signals [8] [9].”
BackgroundMethodInfluentialTeacher Learning and Professional Development
Fincher, S. A., Kolikant, Y. B., & Falkner, K. E. K. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.026 · Cited by 31
Energy-efficiency in wireless sensor networks
Rault, T. (2015) · theses.fr (ABES) · doi:10.70675/e1b49a3dzd54az4e25z9f7az7e5e4ddf36f8 · Cited by 30
“falsely detect events that did not occur [199].”
BackgroundOn the Generality of Codebook Approach for Sensor-Based Human Activity Recognition
Shirahama, K., & Grzegorzek, M. (2017) · Electronics · doi:10.3390/electronics6020044 · Cited by 29
“Recent survey papers on sensor-based human activity recognition [1,3] present that the mean and variance (standard deviation) of values in a sequence are the most popular features.”
BackgroundMethod
Metadata
- Authors
- Bulling, A., Blanke, U., & Schiele, B.
- Affiliations
- Max Planck Institute for Informatics (DE)
- ETH Zurich (CH)
- Venue
- ACM Computing Surveys
- Published
- 2014-01
- Volume
- 46
- Issue
- 3
- Pages
- 1-33
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W2023302299
- Cited by
- 1,668
- References
- 132
- Citations by year
- 2026: 114 · 2025: 105 · 2024: 104 · 2023: 125 · 2022: 158 · 2021: 153 · 2020: 201 · 2019: 213 · 2018: 164 · 2017: 118 · 2016: 115 · 2015: 75 · 2014: 22
- FWCI
- 98.29
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM Computing Surveys (publishedVersion)
- Max Planck Digital Library (submittedVersion)
- MPG.PuRe (Max Planck Society) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Physical Sciences › Engineering › Biomedical Engineering › Gait Recognition and Analysis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Keywords
- human activity recognition, wearable sensors, hand gesture recognition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.