A tutorial on human activity recognition using body-worn inertial sensors
The DOI matches its Crossref record; 131 of the 132 references it cites were found in a registry or an index.
Abstract
The last 20 years have seen ever-increasing research activity in the field of human activity recognition. With activity recognition having considerably matured, so has the number of challenges in designing, implementing, and evaluating activity recognition systems. This tutorial aims to provide a comprehensive hands-on introduction for newcomers to the field of human activity recognition. It specifically focuses on activity recognition using on-body inertial sensors. We first discuss the key research challenges that human activity recognition shares with general pattern recognition and identify those challenges that are specific to human activity recognition. We then describe the concept of an Activity Recognition Chain (ARC) as a general-purpose framework for designing and evaluating activity recognition systems. We detail each component of the framework, provide references to related research, and introduce the best practice methods developed by the activity recognition research community. We conclude with the educational example problem of recognizing different hand gestures from inertial sensors attached to the upper and lower arm. We illustrate how each component of this framework can be implemented for this specific activity recognition problem and demonstrate how different implementations compare and how they impact overall recognition performance.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The promising results delivered in these works without the use of labels have resulted in a general direction of integrating unsupervised learning as-is into conventional activity recognition chains (ARC) [8] in the feature extraction step.”
From Contrastive Predictive Coding for Human Activity Recognition (2021) · cites this paper as [8]
In the citing paper
“The comparative studies using our evaluation framework are novel, because such an analysis has in particular been missing in most survey papers of sensor-based HAR [1,2,3].”
From Comparison of Feature Learning Methods for Human Activity Recognition Using Wearable Sensors (2018) · cites this paper as [3]
In the citing paper
“In [3], the authors carried out extensive experiments to assess the effectiveness of several approaches, but only considered simple hand-crafted features and classifiers using a small self-produced dataset.”
From Comparison of Feature Learning Methods for Human Activity Recognition Using Wearable Sensors (2018) · cites this paper as [3]
In the citing paper
“While the HAR problem seeks to find a perfect segmentation of activities, this task is difficult to achieve since humans perform activities in a fluent way and the segmentation of time series into intervals that represent single activities is not straightforward (Bulling et al. 2014).”
From Advanced Sensing and Human Activity Recognition in Early Intervention and Rehabilitation of Elderly People (2020) · cites this paper as Bulling et al. 2014
In the citing paper
“The second aspect that goes along with this is that human activity is highly diverse and the recognition of specific activities therefore requires an accurate selection of sensors and their placement (Bulling et al. 2014).”
From Advanced Sensing and Human Activity Recognition in Early Intervention and Rehabilitation of Elderly People (2020) · cites this paper as Bulling et al. 2014
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
A tutorial on hidden Markov models and selected applications in speech recognition
Rabiner, L. R. (1989) · Proceedings of the IEEE · doi:10.1109/5.18626 · Cited by 22,743 · cited 2×
“Given the training data T and an initial guess of the parameters ., a separate model is trained for each class using expectation maximization [Rabiner 1989; Fink 2008].”
MethodAn introduction to ROC analysis
Fawcett, T. (2006) · Pattern Recognition Letters · doi:10.1016/j.patrec.2005.10.010 · Cited by 21,879 · cited 1×
“Therefore, a common strategy is to sweep the threshold on the score for each individual class (one vs. all) and analyze the behavior in so-called Receiver Operating Characteristic (ROC) or Precision-Recall (PR) curves [Fawcett 2006].”
MethodPeng, H., Long, F., & Ding, C. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.159 · Cited by 10,544 · cited 2×
“These can be categorized into wrapper [Kohavi and John 1997], filter [Peng et al. 2005], or hybrid [Somol et al.”
BackgroundMethodWrappers for feature subset selection
Kohavi, R., & John, G. H. (1997) · Artificial Intelligence · doi:10.1016/s0004-3702(97)00043-x · Cited by 8,947 · cited 2×
“A large number of researchers investigated machine recognition of gestures and activities from still images and video in constrained environments or stationary settings (see Mitra and Acharya [2007], Turaga et al.”
BackgroundAn introduction to variable and feature selection
GuyonIsabelle, & ElisseeffAndré (2003) · Journal of Machine Learning Research · doi:10.5555/944919.944968 · Cited by 7,715
The Pascal Visual Object Classes Challenge: A Retrospective
Everingham, M., Eslami, S. M. A., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-014-0733-5 · Cited by 7,139
Friedman, J., Hastie, T., & Tibshirani, R. (2000) · The Annals of Statistics · doi:10.1214/aos/1016218223 · Cited by 6,884 · cited 2×
“Introduced in machine learning and computer vision [Friedman et al. 2000; Torralba et al. 2007], boosting as a variant of decision fusion has been successfully applied to activity recognition as well [Lester et al. 2005; Blanke and Schiele 2009; Zinnen et al. 2009b].”
Method2011 Compendium of Physical Activities: A Second Update of Codes and MET Values
AINSWORTH, B. E., HASKELL, W. L., HERRMANN, S. D., MECKES, N., BASSETT, D. R., TUDOR-LOCKE, C., GREER, J. L., VEZINA, J., WHITT-GLOVER, M. C., & LEON, A. S. (2011) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0b013e31821ece12 · Cited by 6,317 · cited 2×
“Other resources include the comprehensive compendium of physical activity [Ainsworth et al. 2011].”
BackgroundProceedings of the 19th International Joint Conference on Artificial Intelligence
Pujol, J. M., Delgado, J., Ramon Sangüesa, A., & Flache, A. (2005) · International Joint Conference on Artificial Intelligence · Cited by 5,771
Kittler, J., Hatef, M., Duin, R. P. W., & Matas, J. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.667881 · Cited by 5,290 · cited 3×
“J. Kittler et al. 1998.”
Background
Research works printed but not linked: 7
- 10.5555/2015035.2015320 · doi:10.5555/2015035.2015320
- 10.5555/1642293.1642416 · doi:10.5555/1642293.1642416
- 10.5555/1642293.1642417 · doi:10.5555/1642293.1642417
- 10.5555/2283516.2283683 · doi:10.5555/2283516.2283683
- 10.5555/1460232.1460248 · doi:10.5555/1460232.1460248
- 10.5555/2021975.2022004 · doi:10.5555/2021975.2022004
- 10.5555/862896.881089 · doi:10.5555/862896.881089
Cited by
Items 101–200 of 1,007
Human Activity Recognition with Convolutional Neural Networks
Bevilacqua, A., MacDonald, K., Rangarej, A., Widjaya, V., Caulfield, B., & Kechadi, T. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-10997-4_33 · Cited by 86
“[6] give a broad introduction to the problem, highlighting the capabilities and limitations of the classification models based on static and shallow features.”
BackgroundYu, L., Xiong, D., Guo, L., & Wang, J. (2016) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2016.02.012 · Cited by 134
A Random Forest-based ensemble method for activity recognition
Feng, Z., Mo, L., & Li, M. (2015) · 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2015.7319532 · Cited by 111
“The purpose of HAR is to offer useful information on a user’s behavior so that computing systems can proactively help their users [1] (Abowd.”
BackgroundBinarized-BLSTM-RNN based Human Activity Recognition
Edel, M., & Koppe, E. (2016) · 2016 International Conference on Indoor Positioning and Indoor Navigation (IPIN) · doi:10.1109/ipin.2016.7743581 · Cited by 114
“with body-worn sensors, manually designed feature extraction procedures, and a wide variety of supervised classification methods [7].”
MethodMulti-Sensor Fusion for Activity Recognition—A Survey
Aguileta, A. A., Brena, R., Mayora, O., Minero, E. M., & Trejo, L. A. (2019) · Sensors · doi:10.3390/s19173808 · Cited by 133
“The final classification can be done in many ways, such as choosing the highest score and letting the application choose how to use the scores [76].”
BackgroundMethodInfluentialKulin, M., Kazaz, T., Poorter, E. D., & Moerman, I. (2021) · Electronics · doi:10.3390/electronics10030318 · Cited by 132
An effective deep autoencoder approach for online smartphone-based human activity recognition
Almaslukh, B., Artoli, A. M., & Al-Muhtadi, J. F. (2017) · Cited by 132
Human activity recognition using wearable sensors by heterogeneous convolutional neural networks
Han, C., Zhang, L., Tang, Y., Huang, W., Min, F., & He, J. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.116764 · Cited by 130
Human Activity Recognition With Accelerometer and Gyroscope: A Data Fusion Approach
Webber, M., & Rojas, R. F. (2021) · IEEE Sensors Journal · doi:10.1109/jsen.2021.3079883 · Cited by 130
Shallow Convolutional Neural Networks for Human Activity Recognition Using Wearable Sensors
Huang, W., Zhang, L., Gao, W., Min, F., & He, J. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3091990 · Cited by 129
“…and sensor technology, human activity recognition (HAR) using wearable inertial sensors has become a new research hotspot due to its extensive use in a large variety of application domains such as health-care [1], sports tracking [2] [3], fitness, game console design [4] and smart homes [5].”
BackgroundSmartwatch Wearing Behavior Analysis: A Longitudinal Study
Jeong, H., Kim, H., Kim, R., Lee, U., & Jeong, Y. (2017) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3131892 · Cited by 129
“The mean and variance feature types were selected because these features were typically used in existing activity recognition models [7].”
MethodRault, T., Bouabdallah, A., Challal, Y., & Marin, F. (2016) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2016.08.003 · Cited by 128
“Besides correct classification, context recognition systems can miss, confuse or falsely detect events that did not occur [31].”
BackgroundHuman Activity Recognition from Body Sensor Data using Deep Learning
Hassan, M. M., Huda, S., Uddin, M. Z., Almogren, A., & Alrubaian, M. (2018) · Journal of Medical Systems · doi:10.1007/s10916-018-0948-z · Cited by 113
Yao, R., Lin, G., Shi, Q., & Ranasinghe, D. C. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2017.12.024 · Cited by 105
Mukherjee, D., Mondal, R., Singh, P. K., Sarkar, R., & Bhattacharjee, D. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-020-09537-7 · Cited by 124
“In the last 20 years, many notable research works have been performed on HAR [1, 7].”
BackgroundA Multichannel CNN-GRU Model for Human Activity Recognition
Lu, L., Zhang, C., Cao, K., Deng, T., & Yang, Q. (2022) · IEEE Access · doi:10.1109/access.2022.3185112 · Cited by 124
“Manual feature extraction, such as statistical and frequency domain features, always depends on elaborate features selection of human experience and domain knowledge [15].”
BackgroundAnalyzing Activity Behavior and Movement in a Naturalistic Environment Using Smart Home Techniques
Cook, D. J., Schmitter-Edgecombe, M., & Dawadi, P. (2015) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2015.2461659 · Cited by 123
Authentication of Smartphone Users Based on Activity Recognition and Mobile Sensing
Ehatisham-ul-Haq, M., Azam, M. A., Loo, J., Shuang, K., Islam, S., Naeem, U., & Amin, Y. (2017) · Sensors · doi:10.3390/s17092043 · Cited by 123
“In [29] and [30], data pre-processing and feature extraction algorithms were applied for activity recognition using an accelerometer.”
MethodWEAR: An Outdoor Sports Dataset for Wearable and Egocentric Activity Recognition
Bock, M., Kuehne, H., Laerhoven, K. V., & Moeller, M. (2024) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3699776 · Cited by 124
“Inertial-based HAR Compared to video-based modalities body-worn sensor systems bare a great potential in analyzing our daily activities with minimal intrusion, yielding various applications from the provision of medical support to supporting complex work processes [5].”
InfluentialJaved, A. R., Sarwar, M. U., Khan, S., Iwendi, C., Mittal, M., & Kumar, N. (2020) · Sensors · doi:10.3390/s20082216 · Cited by 109
“Authors in [4], used “eWatch” for data collection of six activities.”
BackgroundMethodUsing unlabeled data in a sparse-coding framework for human activity recognition
Bhattacharya, S., Nurmi, P., Hammerla, N., & Plötz, T. (2014) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2014.05.006 · Cited by 121
LARa: Creating a Dataset for Human Activity Recognition in Logistics Using Semantic Attributes
Niemann, F., Reining, C., Rueda, F. M., Nair, N. R., Steffens, J. A., Fink, G. A., & ten Hompel, M. (2020) · Sensors · doi:10.3390/s20154083 · Cited by 120
“The definition of activities and their semantic attributes is derived from the researchers’ experience [13,33], and from HAR methods [1,16].”
BackgroundMethodInfluentialDetecting heat events in dairy cows using accelerometers and unsupervised learning
Shahriar, M. S., Smith, D., Rahman, A., Freeman, M., Hills, J. L., Rawnsley, R., Henry, D., & Bishop-Hurley, G. J. (2016) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2016.08.009 · Cited by 120
“These features are the maximum, minimum, standard deviation, amplitude, energy and top 5 magnitudes of the fast Fourier transform (FFT) as shown by Zhang and Sawchuk (2011) and Bulling et al. (2014).”
MethodZebin, T., Scully, P., Peek, N. B., Casson, A. J., & Ozanyan, K. B. (2019) · IEEE Access · doi:10.1109/access.2019.2941836 · Cited by 119
“In traditional machine learning models based on static and shallow features, several authors [7], [8] provided a broad summary of HAR, highlighting the capabilities and limitations of a number of statistical machine learning models such as Support Vector Machines (SVMs), Gaussian Mixture”
BackgroundRobust Human Activity Recognition using smartwatches and smartphones
San-Segundo, R., Blunck, H., Moreno-Pimentel, J., Stisen, A., & Gil-Martín, M. (2018) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2018.04.002 · Cited by 105
Azimi, I., Pahikkala, T., Rahmani, A. M., Niela‐Vilén, H., Axelin, A., & Liljeberg, P. (2019) · Future Generation Computer Systems · doi:10.1016/j.future.2019.02.015 · Cited by 118
“Most of the data analysis was performed in the cloud servers, amalgamating sensor data to extract new information such as health status and physical activity [77].”
MethodBig Healthcare Data Analytics: Challenges and Applications
Lee, C., Luo, Z., Ngiam, K. Y., Zhang, M., Zheng, K., Chen, G., Ooi, B. C., & Yip, W. L. J. (2017) · Scalable computing and communications · doi:10.1007/978-3-319-58280-1_2 · Cited by 118
“Sliding window methods are typically used for static or periodic activities while sporadic activities can be recognized using template matching approaches [71] or Hidden Markov Modelling (HMM) [84, 12].”
BackgroundMilosevic, B., Leardini, A., & Farella, E. (2020) · BioMedical Engineering OnLine · doi:10.1186/s12938-020-00762-7 · Cited by 116
Servati, A., Zou, L., Wang, Z., Ko, F., & Servati, P. (2017) · Sensors · doi:10.3390/s17071622 · Cited by 106
“Decision-level fusion is the process of combining the decisions generated from multiple sensors individually [92].”
BackgroundAnagnostis, A., Benos, L. T., Tsaopoulos, D. E., Tagarakis, A. C., Tsolakis, N., & Bochtis, D. (2021) · Applied Sciences · doi:10.3390/app11052188 · Cited by 115
“Afterwards, important feature vectors are extracted to minimize the classification errors and computation time [28].”
Deep learning and model personalization in sensor-based human activity recognition
Ferrari, A., Micucci, D., Mobilio, M., & Napoletano, P. (2022) · Journal of Reliable Intelligent Environments · doi:10.1007/s40860-021-00167-w · Cited by 115
“Initially, traditional machine-learning techniques were used for sensor-based HAR [4].”
MethodColloSSL: Collaborative Self-Supervised Learning for Human Activity Recognition
Jain, Y., Tang, C. I., Min, C., Kawsar, F., & Mathur, A. (2022) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3517246 · Cited by 113
“Compared to other data modalities such as images, videos and audio clips, where post-hoc annotations are often feasible, obtaining labels for sensor time-series, especially those collected in free-living environments is very difficult [5].”
BackgroundHuMAn: Complex Activity Recognition with Multi-Modal Multi-Positional Body Sensing
Bharti, P., De, D., Chellappan, S., & Das, S. K. (2019) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2018.2841905 · Cited by 95
“…contexts (ranging from simple activities to more complex ones) are important for applications like smart healthcare [7], [41], quantified self [48], monitoring elderly people in assisted living [10], designing smart homes and appliances [33], activity-aware media content delivery [34], and so on.”
BackgroundKumaran Santhosh, K., Dogra, D. P., Roy, P. P., & Mitra, A. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3108504 · Cited by 80
Curzon, P., Bell, T., Waite, J., & Dorling, M. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.018 · Cited by 115
Thakur, D., Biswas, S., Ho, E. S. L., & Chattopadhyay, S. (2022) · IEEE Access · doi:10.1109/access.2022.3140373 · Cited by 112
“Hence, several methodological challenges are involved in HAR (except for handcrafted feature extraction), such as imbalanced datasets, intraclass variability, interclass similarity, the empty class problem [15] and the multiclass window problem [16].”
Schrader, L., Vargas Toro, A., Konietzny, S., Rüping, S., Schäpers, B., Steinböck, M., Krewer, C., Müller, F., Güttler, J., & Bock, T. (2020) · Journal of Population Ageing · doi:10.1007/s12062-020-09260-z · Cited by 110
“While the HAR problem seeks to find a perfect segmentation of activities, this task is difficult to achieve since humans perform activities in a fluent way and the segmentation of time series into intervals that represent single activities is not straightforward (Bulling et al. 2014).”
BackgroundMethodInfluentialRecognition and Repetition Counting for Complex Physical Exercises with Deep Learning
Soro, A., Brunner, G., Tanner, S., & Wattenhofer, R. P. (2019) · Sensors · doi:10.3390/s19030714 · Cited by 110
“HAR can be based upon many different modalities, such as video [13,14], sound [15], electromagnetic waves [16,17], and, probably most prevalent nowadays, body-worn inertial sensors [18,19], which we employ in this work.”
A Novel Semisupervised Deep Learning Method for Human Activity Recognition
Zhu, Q., Chen, Z., & Soh, Y. C. (2019) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2018.2889315 · Cited by 97
“In some informatics applications, HAR is studied extensively according to a survey on body-worn sensors [1].”
BackgroundRiboni, D., Sztyler, T., Civitarese, G., & Stuckenschmidt, H. (2016) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/2971648.2971691 · Cited by 108
“Physical activity recognition systems are mainly based on data acquired from body-worn accelerometers [2, 3, 32].”
BackgroundHuman Activity Recognition on Smartphones Using a Bidirectional LSTM Network
Hernandez, F., Suarez, L. F., Villamizar, J., & Altuve, M. (2019) · 2019 XXII Symposium on Image, Signal Processing and Artificial Vision (STSIVA) · doi:10.1109/stsiva.2019.8730249 · Cited by 86
“were recorded from 12 subjects using a multiple wireless and wired sensor systems integrated in the environment, in objects, and on the body [12]; the hand gesture dataset2 in which 11 human’s hand movements (eight gestures in daily living and three gestures in playing tennis) were collected from two subjects using bo…”
MethodYin, Y., Xie, L., Jiang, Z., Xiao, F., Cao, J., & Lu, S. (2024) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2024.3357591 · Cited by 108
“(3) Interference from null-class activities: The mobile devices are often worn/carried or close to the user, even the user performs interference activities or keeps stationary, the device may continuously record the sensor data of unexpected activities, i.e., null-class activities [6].”
Abedin, A., Ehsanpour, M., Shi, Q., Rezatofighi, H., & Ranasinghe, D. C. (2021) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3448083 · Cited by 107
“Traditionally, the standard activity recognition pipeline for time-series sensory data involved sliding window segmentation, manual hand-crafted feature design, and subsequent activity classification with classical machine learning algorithms [16].”
BackgroundSuh, S., Rey, V. F., & Lukowicz, P. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.110143 · Cited by 107
Sensor-based human activity recognition system with a multilayered model using time series shapelets
Liu, L., Peng, Y., Liu, M., & Huang, Z. (2015) · Knowledge-Based Systems · doi:10.1016/j.knosys.2015.09.024 · Cited by 107
Sun, J., Fu, Y., Li, S., He, J., Xu, C., & Tan, L. (2018) · Journal of Sensors · doi:10.1155/2018/8580959 · Cited by 88
“The de facto standard work fl ow for activity recognition in ubiquitous and wearable computing [26] treats individual frames of sensor data as statistically independent, that is, isolated portions of data are converted into feature vectors that are then presented to a classi fi er without further…”
BackgroundHuman Activity Recognition Using an Ensemble Learning Algorithm with Smartphone Sensor Data
Tan, T.-H., Wu, J., Liu, S.-H., & Gochoo, M. (2022) · Electronics · doi:10.3390/electronics11030322 · Cited by 106
Recognition of human activity using GRU deep learning algorithm
Mohsen, S. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-15571-y · Cited by 104
“However, the low precision of these accelerometers is a challenging issue yet to be fully overcome [11, 44].”
BackgroundRonao, C. A., & Cho, S.-B. (2017) · International Journal of Distributed Sensor Networks · doi:10.1177/1550147716683687 · Cited by 96
“On top of various applications using smartphone sensors such as Bluetooth-aided mobile phone localization and distributed range-free localization of wireless sensor networks, the use of sensors to recognize human activities has sparked a lot of research interest due to its promising applications in the areas of pervas…”
BackgroundClassification of team sport activities using a single wearable tracking device
Wundersitz, D. W. T., Josman, C., Gupta, R., Netto, K., Gastin, P. B., & Robertson, S. J. (2015) · Journal of Biomechanics · doi:10.1016/j.jbiomech.2015.09.015 · Cited by 104
Wearable sensor-based pattern mining for human activity recognition: deep learning approach
Bijalwan, V., Semwal, V. B., & Gupta, V. (2021) · Industrial Robot the international journal of robotics research and application · doi:10.1108/ir-09-2020-0187 · Cited by 102
MM-Fit: Multimodal Deep Learning for Automatic Exercise Logging across Sensing Devices
Strömbäck, D., Huang, S., & Radu, V. (2020) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3432701 · Cited by 73
“Human activity recognition approaches can be divided into two main categories, sensor-based methods [6, 9, 28, 51], relying on data from inertial measurement units (IMUs), such as accelerometers and gyroscopes, and video-based methods [1, 21, 39], operating on visual input data, such as colour and depth.”
BackgroundLightweight Deep Learning Model in Mobile-Edge Computing for Radar-Based Human Activity Recognition
Zhu, J., Lou, X., & Ye, W. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3063504 · Cited by 100
Deep Learning for Human Activity Recognition in Mobile Computing
Plotz, T., & Guan, Y. (2018) · Computer · doi:10.1109/mc.2018.2381112 · Cited by 99
Carter, A. S., Hundhausen, C. D., & Adesope, O. (2017) · ACM Transactions on Computing Education · doi:10.1145/3120259 · Cited by 99
“Thus far, researchers have used either statistical analysis (see [20]) or machine learning (see [12]) to gain insights into the data collected.”
Cheng, X., Zhang, L., Tang, Y., Liu, Y., Wu, H., & He, J. (2022) · IEEE Sensors Journal · doi:10.1109/jsen.2022.3149337 · Cited by 82
Human Activity Recognition Using K-Nearest Neighbor Machine Learning Algorithm
Mohsen, S., Elkaseer, A., & Scholz, S. G. (2021) · Smart innovation, systems and technologies · doi:10.1007/978-981-16-6128-0_29 · Cited by 99
Complex activity recognition using time series pattern dictionary learned from ubiquitous sensors
Liu, L., Peng, Y., Wang, S., Liu, M., & Huang, Z. (2016) · Information Sciences · doi:10.1016/j.ins.2016.01.020 · Cited by 98
“[6] for extracting these feature from nsors.”
MethodPhysical Activity Recognition Using Posterior-Adapted Class-Based Fusion of Multiaccelerometer Data
Chowdhury, A. K., Tjondronegoro, D., Chandran, V., & Trost, S. G. (2017) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2017.2705036 · Cited by 98
“In activity recognition, the commonly used decision fusion rules include majority voting, summation, hierarchical fusion and Bayesian fusion [23].”
MethodZhao, J., & Obonyo, E. (2020) · Advanced Engineering Informatics · doi:10.1016/j.aei.2020.101177 · Cited by 98
A survey on unsupervised learning for wearable sensor-based activity recognition
Ige, A. O., & Noor, M. H. M. (2022) · Applied Soft Computing · doi:10.1016/j.asoc.2022.109363 · Cited by 99
Enhanced Hand-Oriented Activity Recognition Based on Smartwatch Sensor Data Using LSTMs
Mekruksavanich, S., Jitpattanakul, A., Youplao, P., & Yupapin, P. (2020) · Symmetry · doi:10.3390/sym12091570 · Cited by 85
Cross-position activity recognition with stratified transfer learning
Chen, Y., Wang, J., Huang, M., & Yu, H. (2019) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2019.04.004 · Cited by 79
“Human Activity recognition has been a popular research topic in pervasive computing [21] for its competence in learning profound high-level knowledge”
BackgroundSurvey on Human Activity Recognition based on Acceleration Data
Slim, S. O., Atia, A., Marwa, M. A., & Mostafa, M.-S. M. (2019) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2019.0100311 · Cited by 97
“In the first, the training data are used for training the classifiers [25].”
BackgroundMethodMachine learning-based offline signature verification systems: A systematic review
Hameed, M. M., Ahmad, R. B., Kiah, L. M., & Murtaza, G. (2021) · Signal Processing Image Communication · doi:10.1016/j.image.2021.116139 · Cited by 96
Transfer Learning in Natural Language Processing
Yang, Q., Zhang, Y., Dai, W., & Pan, S. J. (2020) · Cambridge University Press eBooks · doi:10.1017/9781139061773.020 · Cited by 95
Deep Neural Network based Human Activity Recognition for the Order Picking Process
Grzeszick, R., Lenk, J. M., Rueda, F. M., Fink, G. A., Feldhorst, S., & ten Hompel, M. (2017) · Proceedings of the 4th International Workshop on Sensor-based Activity Recognition and Interaction · doi:10.1145/3134230.3134231 · Cited by 93
“The contribution of this paper is two-fold: 1) The application of a deep neural network to the task of HAR in an order picking scenario is shown.”
BackgroundMethodInfluentialJanarthanan, R., Doss, S., & Baskar, S. (2020) · Measurement · doi:10.1016/j.measurement.2020.108050 · Cited by 93
Trends in human activity recognition with focus on machine learning and power requirements
Nguyen, B., Coelho, Y., Bastos-Filho, T., & Krishnan, S. (2021) · Machine Learning with Applications · doi:10.1016/j.mlwa.2021.100072 · Cited by 93
Industry 4.0-Oriented Deep Learning Models for Human Activity Recognition
Mohsen, S., Elkaseer, A., & Scholz, S. G. (2021) · IEEE Access · doi:10.1109/access.2021.3125733 · Cited by 93
“racy of these accelerometers is a challenging problem yet to be fully overcome [13], [14].”
BackgroundA general framework for sensor-based human activity recognition
Köping, L., Shirahama, K., & Grzegorzek, M. (2018) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2017.12.025 · Cited by 93
ProtoHAR: Prototype Guided Personalized Federated Learning for Human Activity Recognition
Cheng, D., Zhang, L., Bu, C., Wang, X., Wu, H., & Song, A. (2023) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2023.3275438 · Cited by 92
“T ODAY, the popularity of cell phones and smart bracelets has made them easier to collect sensor data, which has greatly stimulated researches for sensor-based Human Activity Recognition (HAR) [1].”
BackgroundWang, J., Chen, Y., Gu, Y., Xiao, Y., & Pan, H. (2018) · 2018 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2018.8489106 · Cited by 92
“ubiquitous computing more than one decades[1] and has been grabbing considerable research attentions from a pretty wide range of researchers[2][3][4][5][6].”
BackgroundLet's (not) stick together: pairwise similarity biases cross-validation in activity recognition
Hammerla, N. Y., & Plötz, T. (2015) · Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing · doi:10.1145/2750858.2807551 · Cited by 91
“The sensor data in ubiquitous computing is usually analysed using a pipeline-based approach [7].”
BackgroundMethodInfluentialPresotto, R., Civitarese, G., & Bettini, C. (2022) · Personal and Ubiquitous Computing · doi:10.1007/s00779-022-01688-8 · Cited by 91
Few-shot learning-based human activity recognition
Feng, S., & Duarte, M. F. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.06.070 · Cited by 91
On the role of features in human activity recognition
Haresamudram, H., Anderson, D. V., & Plötz, T. (2019) · Proceedings of the 23rd International Symposium on Wearable Computers · doi:10.1145/3341163.3347727 · Cited by 90
“The standard activity recognition chain (ARC, [6]) defines a series of processing steps, where each step has a clearly defined goal.”
BackgroundMethodInfluentialMusic Recommendation System Using Human Activity Recognition From Accelerometer Data
Kim, H., Kim, G. Y., & Kim, J. Y. (2019) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2019.2924177 · Cited by 90
“PIHAR is performed without knowing the phone position, whereas PSHAR is performed while knowing the position or placement of the phone.”
InfluentialBasketball Activity Recognition using Wearable Inertial Measurement Units
Nguyen, L. N., Rodríguez-Martín, D., Catalá, A., Pérez‐López, C., Samà, A., & Cavallaro, A. (2015) · International Conference on Human Computer Interaction (Interacción) · doi:10.1145/2829875.2829930 · Cited by 90
Impact of Physical Activity on Sleep:A Deep Learning Based Exploration
Sathyanarayana, A., Joty, S., Fernández-Luque, L., Ofli, F., Srivastava, J., Elmagarmid, A. K., Taheri, S., & Arora, T. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1607.07034 · Cited by 74
“In this sub-section, we limit our deep learning review to studies that employ techniques to analyses of physical activity data, and refer the reader to Chen et al. [27] and Bulling et al. [28] for more comprehensive reviews of sensor-based human activity recognition literature.”
MethodA Survey on Anomalous Behavior Detection for Elderly Care Using Dense-Sensing Networks
Deep, S., Zheng, X., Karmakar, C. K., Yu, D., Hamey, L., & Jin, J. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2948204 · Cited by 88
“Window techniques can be further categorized as Fixed-size Non-overlapping Sliding Window (FNSW) or Fixed-size Overlapping Sliding Window (FOSW).”
BackgroundMethodInfluentialEnhancing activity recognition using CPD-based activity segmentation
Aminikhanghahi, S., & Cook, D. J. (2019) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2019.01.004 · Cited by 86
“[13] surveyed algorithms for supervised and unsupervised activity recognition from wearable sensors.”
BackgroundNeural Network Ensembles for Sensor-Based Human Activity Recognition Within Smart Environments
Irvine, N., Nugent, C., Zhang, S., Wang, H., & Ng, W. W. Y. (2019) · Sensors · doi:10.3390/s20010216 · Cited by 87
“The materials and methods implemented are described within this section. of the activity recognition process [80].”
BackgroundMethodA Survey on Approaches of Motion Mode Recognition Using Sensors
Elhoushi, M., Georgy, J., Noureldin, A. M., & Korenberg, M. J. (2016) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2016.2617200 · Cited by 86
Baldominos, A., Cervantes, A., Sáez, Y., & Isasi, P. (2019) · Sensors · doi:10.3390/s19030521 · Cited by 86
“[1] studied this problem and proposed the activity recognition chain (ARC), a sequence of steps in order to build human activity recognition systems (see Figure 1), to which we will adhere in this paper.”
BackgroundLatent Independent Excitation for Generalizable Sensor-based Cross-Person Activity Recognition
Qian, H., Pan, S. J., & Miao, C. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i13.17416 · Cited by 85
“…has become one of the most crucial techniques in a wide range of real-world applications, such as healthcare, gait analysis, assisted living, security and smart homes (Chen et al. 2020; Wang et al. 2019; Janidarmian et al. 2017; Bulling, Blanke, and Schiele 2014; Lara and Labrador 2013).”
BackgroundMethodSemi-supervised convolutional neural networks for human activity recognition
Zeng, M., Yu, T., Wang, X., Nguyen, L. T., Mengshoel, O. J., & Lane, I. (2017) · 2017 IEEE International Conference on Big Data (Big Data) · doi:10.1109/bigdata.2017.8257967 · Cited by 85
“Designing handcrafted features requires domain knowledge [8].”
The History of Computing Education Research
Guzdial, M., & du Boulay, B. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.002 · Cited by 85
Automated sensing of daily activity: A new lens into development
de Barbaro, K. (2019) · Developmental Psychobiology · doi:10.1002/dev.21831 · Cited by 85
“High‐quality tutorials for activity recognition are available (Bulling et al., 2014).”
BackgroundSmart insoles review (2008-2021): Applications, potentials, and future
Almuteb, I., Hua, R., & Wang, Y. (2022) · Smart Health · doi:10.1016/j.smhl.2022.100301 · Cited by 84
Classification of broiler behaviours using triaxial accelerometer and machine learning
Yang, X., Zhao, Y., Street, G. M., Huang, Y., To, S. D. F., & PURSWELL, J. L. (2021) · animal · doi:10.1016/j.animal.2021.100269 · Cited by 82
Kim, W.-Y., & Seo, D.-H. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3162833 · Cited by 82
“Current methods for this are classified into three types: camera [7], wearable sensor [9], and radar [10].”
MethodDetermining the Single Best Axis for Exercise Repetition Recognition and Counting on SmartWatches
Mortazavi, B. J., Pourhomayoun, M., Alsheikh, G., Alshurafa, N., Lee, S. I., & Sarrafzadeh, M. (2014) · 2014 11th International Conference on Wearable and Implantable Body Sensor Networks · doi:10.1109/bsn.2014.21 · Cited by 63
“A review of such wearable accelerometers and activity energy expenditures shows popularity of such systems in promoting physical activity [16]–[18].”
BackgroundLiu, L., Wang, S., Hu, B., Qiong, Q., Wen, J., & Rosenblum, D. S. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2018.04.022 · Cited by 81
Human Activity Recognition for Production and Logistics—A Systematic Literature Review
Reining, C., Niemann, F., Rueda, F. M., Fink, G. A., & ten Hompel, M. (2019) · Information · doi:10.3390/info10080245 · Cited by 82
“In the approach, a window is moved over the time-series data by a certain step to extract a segment [29].”
BackgroundMethodInfluentialSensor-Based Human Activity Recognition Using Deep Stacked Multilayered Perceptron Model
Rustam, F., Reshi, A. A., Ashraf, I., Mehmood, A., Ullah, S., Khan, D. M., & Choi, G. S. (2020) · IEEE Access · doi:10.1109/access.2020.3041822 · Cited by 81
“of the classification models in HAR based on static and shallow features using body-worn sensors is given in [12].”
BackgroundCarslake, C., Vázquez-Diosdado, J. A., & Kaler, J. (2020) · Sensors · doi:10.3390/s21010088 · Cited by 81
“In this study windows sizes of 1 s–10 s with a 50% overlap [28], were explored.”
MethodHuAc: Human Activity Recognition Using Crowdsourced WiFi Signals and Skeleton Data
Guo, L., Wang, L., Liu, J., Zhou, W., & Lu, B. (2018) · Wireless Communications and Mobile Computing · doi:10.1155/2018/6163475 · Cited by 81
Human Activity Recognition with Smartphone Inertial Sensors Using Bidir-LSTM Networks
Yu, S., & Qin, L. (2018) · International Conference on Mechanical, Control and Computer Engineering (ICMCCE) · doi:10.1109/icmcce.2018.00052 · Cited by 80
Semantic-Discriminative Mixup for Generalizable Sensor-based Cross-domain Activity Recognition
Lu, W., Wang, J., Chen, Y., Pan, S. J., Hu, C., & Qin, X. (2022) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3534589 · Cited by 60
“In all three settings, we adopt the sliding window technique [4] with 50% overlap to construct training samples following common practice in HAR [31].”
Method
Metadata
- Authors
- Bulling, A., Blanke, U., & Schiele, B.
- Affiliations
- Max Planck Institute for Informatics (DE)
- ETH Zurich (CH)
- Venue
- ACM Computing Surveys
- Published
- 2014-01
- Volume
- 46
- Issue
- 3
- Pages
- 1-33
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W2023302299
- Cited by
- 1,668
- References
- 132
- Citations by year
- 2026: 114 · 2025: 105 · 2024: 104 · 2023: 125 · 2022: 158 · 2021: 153 · 2020: 201 · 2019: 213 · 2018: 164 · 2017: 118 · 2016: 115 · 2015: 75 · 2014: 22
- FWCI
- 98.29
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM Computing Surveys (publishedVersion)
- Max Planck Digital Library (submittedVersion)
- MPG.PuRe (Max Planck Society) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Physical Sciences › Engineering › Biomedical Engineering › Gait Recognition and Analysis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Keywords
- human activity recognition, wearable sensors, hand gesture recognition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.