Complex Human Activity Recognition Using Smartphone and Wrist-Worn Motion Sensors
Open accessThe DOI matches its Crossref record; 40 of the 41 references it cites were found in a registry or an index.
Abstract
The position of on-body motion sensors plays an important role in human activity recognition. Most often, mobile phone sensors at the trouser pocket or an equivalent position are used for this purpose. However, this position is not suitable for recognizing activities that involve hand gestures, such as smoking, eating, drinking coffee and giving a talk. To recognize such activities, wrist-worn motion sensors are used. However, these two positions are mainly used in isolation. To use richer context information, we evaluate three motion sensors (accelerometer, gyroscope and linear acceleration sensor) at both wrist and pocket positions. Using three classifiers, we show that the combination of these two positions outperforms the wrist position alone, mainly at smaller segmentation windows. Another problem is that less-repetitive activities, such as smoking, eating, giving a talk and drinking coffee, cannot be recognized easily at smaller segmentation windows unlike repetitive activities, like walking, jogging and biking. For this purpose, we evaluate the effect of seven window sizes (2-30 s) on thirteen activities and show how increasing window size affects these various activities in different ways. We also propose various optimizations to further improve the recognition of these activities. For reproducibility, we make our dataset publicly available.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures












Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Basic activities demonstrate consistent and repeated patterns, facilitating their detection, whereas complex activities entail non-repetitive and context-sensitive motions that depend on extended temporal sequences, presenting considerable challenges for detection [7, 8].”
From Adaptive temporal attention mechanism and hybrid deep CNN model for wearable sensor-based human activity recognition (2025) · cites this paper as [8]
Experimental — accuracy not yet measuredIn the citing paper
“The UTwente dataset consists of 13 activities gathered from 10 people utilizing two smartphones (one in the right trouser pocket and the other on the wrist), equipped with accelerometer, gyroscope, linear acceleration, and magnetometer sensors at a frequency of 50 Hz.”
From Adaptive temporal attention mechanism and hybrid deep CNN model for wearable sensor-based human activity recognition (2025) · cites this paper as [8]
In the citing paper
“The UTwente dataset was chosen as a suitable benchmark for evaluation because of its diverse range of activities (13 in total, comprising 7 simple and 6 complicated activities), superior data quality, and the application of wearable sensors in real-world contexts (trouser pockets and wrists) [8].”
From Adaptive temporal attention mechanism and hybrid deep CNN model for wearable sensor-based human activity recognition (2025) · cites this paper as [8]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016
The WEKA data mining software: an update
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., & Witten, I. H. (2009) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1656274.1656278 · Cited by 17,750 · cited 1×
“As data are randomized before stratified cross-validation in the WEKA (Waikato Environment for Knowledge Analysis) tool [25], overlap in the data can cause using some data in both training and testing, which can lead to higher recognition performance.”
MethodA survey of mobile phone sensing
Lane, N., Miluzzo, E., Lu, H., Peebles, D., Choudhury, T., & Campbell, A. (2010) · IEEE Communications Magazine · doi:10.1109/mcom.2010.5560598 · Cited by 2,292
A tutorial on human activity recognition using body-worn inertial sensors
Bulling, A., Blanke, U., & Schiele, B. (2014) · ACM Computing Surveys · doi:10.1145/2499621 · Cited by 1,668 · cited 1×
“Activity recognition using body-worn motion sensors in general [19] and especially using smartphone sensors has been studied in recent years [1,2], and it is still being studied extensively [1,2,19–21].”
BackgroundMiluzzo, E., Lane, N. D., Fodor, K., Peterson, R., Lu, H., Musolesi, M., Eisenman, S. B., Zheng, X., & Campbell, A. T. (2008) · Proceedings of the 6th ACM conference on Embedded network sensor systems · doi:10.1145/1460412.1460445 · Cited by 1,032 · cited 1×
“They are implemented on mobile phones in various studies; i.e. , Naive Bayes in [37–39], decision tree in [40–42] and KNN in [31,32,39,43].”
MethodPreprocessing techniques for context recognition from accelerometer data
Figo, D., Diniz, P. C., Ferreira, D. R., & Cardoso, J. M. P. (2010) · Personal and Ubiquitous Computing · doi:10.1007/s00779-010-0293-9 · Cited by 578
The Jigsaw continuous sensing engine for mobile phone applications
Lu, H., Yang, J., Liu, Z., Lane, N. D., Choudhury, T., & Campbell, A. T. (2010) · Proceedings of the 8th ACM Conference on Embedded Networked Sensor Systems · doi:10.1145/1869983.1869992 · Cited by 560
Mobile Phone Sensing Systems: A Survey
Khan, W. Z., Xiang, Y., Aalsalem, M. Y., & Arshad, Q. (2013) · IEEE Communications Surveys & Tutorials · doi:10.1109/surv.2012.031412.00077 · Cited by 557 · cited 2×
“Activity recognition using body-worn motion sensors in general [19] and especially using smartphone sensors has been studied in recent years [1,2], and it is still being studied extensively [1,2,19–21].”
BackgroundFusion of Smartphone Motion Sensors for Physical Activity Recognition
Shoaib, M., Bosch, S., Incel, O., Scholten, H., & Havinga, P. (2014) · Sensors · doi:10.3390/s140610146 · Cited by 552 · cited 6×
“We had shown previously that the accelerometer performs poorly at recognizing walking upstairs and downstairs and needs additional gyroscope data for better recognition of these two activities [12].”
BackgroundMethodInfluentialSelf-citationA Survey of Online Activity Recognition Using Mobile Phones
Shoaib, M., Bosch, S., Incel, O., Scholten, H., & Havinga, P. (2015) · Sensors · doi:10.3390/s150102059 · Cited by 489 · cited 2×
“We selected three classifiers, which are commonly used for practical activity recognition: Naive Bayes, k-nearest neighbor (KNN) and decision tree [35,36].”
BackgroundMethodSelf-citation
Research works printed but not linked: 1
- Kose Mustafa. Incel O.D. Ersoy C. Online human activity recognition on smart phones Proceedings of the Workshop on Mobile Sensing: From Smartphones and Wearables to Big Data Beijing, China 16 April 2012 11 15
Cited by
Items 101–200 of 424
Cybersecurity Attack-Resilience Authentication Mechanism for Intelligent Healthcare System
Soni, P., Pradhan, J., Pal, A. K., & Islam, S. H. (2022) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2022.3179429 · Cited by 42
“Many researchers[17]–[19] o) Peak-to-peak time; p) Peak-to-peak slope; and q) Absolute latency to amplitude ratio.”
BackgroundMethodActivity Recognition and Semantic Description for Indoor Mobile Localization
Guo, S., Xiong, H., Zheng, X., & Zhou, Y. (2017) · Sensors · doi:10.3390/s17030649 · Cited by 39
“In order to evaluate the performance of the HAR classification, 10-fold cross-validation [39] was used.”
MethodReal-world smartphone-based gait recognition
Alobaidi, H., Clarke, N., Li, F., & Alruban, A. (2021) · Computers & Security · doi:10.1016/j.cose.2021.102557 · Cited by 37
A Framework for Maternal Physical Activities and Health Monitoring Using Wearable Sensors
Ullah, F., Iqbal, A., Iqbal, S., Kwak, D., Anwar, H., Khan, A., Ullah, R., Siddique, H., & Kwak, K. S. (2021) · Sensors · doi:10.3390/s21154949 · Cited by 32
Contrastive Accelerometer–Gyroscope Embedding Model for Human Activity Recognition
Koo, I., Park, Y., Jeong, M., & Kim, C. (2022) · IEEE Sensors Journal · doi:10.1109/jsen.2022.3222825 · Cited by 40
“Previous works in body-worn sensor-based HAR literature explore the pattern recognition methods [15] such as support vector machines [16], Hidden Markov Model [17], and other classifiers like Naive Bayes, K -Nearest Neighbor, and Decision Tree [18].”
MethodZhuo, S., Sherlock, L., Dobbie, G., Koh, Y. S., Russello, G., & Lottridge, D. M. (2020) · Sensors · doi:10.3390/s20030655 · Cited by 38
Research on Non-Contact Monitoring System for Human Physiological Signal and Body Movement
Liang, Q., Xu, L., Bao, N., Qi, L., Shi, J., Yang, Y., & Yao, Y. (2019) · Biosensors · doi:10.3390/bios9020058 · Cited by 34
Smartwatches Can Detect Walker and Cane Use in Older Adults
Antos, S. A., Danilovich, M., Eisenstein, A., Gordon, K. E., & Kording, K. P. (2019) · Innovation in Aging · doi:10.1093/geroni/igz008 · Cited by 36
Alo, U. R., Nweke, H. F., Teh, Y. W., & Murtaza, G. (2020) · Sensors · doi:10.3390/s20216300 · Cited by 40
“Conversely, complex activities are composed of a sequence of activities performed at a longer duration of time and include smoking, eating, taking medication, cooking, writing, etc. [7,12].”
BackgroundMethodInfluentialkNN Prototyping Schemes for Embedded Human Activity Recognition with Online Learning
Ferreira, P., Cardoso, J. M. P., & Mendes‐Moreira, J. (2020) · Computers · doi:10.3390/computers9040096 · Cited by 35
Review of Machine Learning and Deep Learning Based Recommender Systems for Health Informatics
Saha, J., Chowdhury, C., & Biswas, S. (2019) · Studies in big data · doi:10.1007/978-3-030-33966-1_6 · Cited by 39
Ehatisham-ul-Haq, M., & Azam, M. A. (2020) · Future Generation Computer Systems · doi:10.1016/j.future.2020.01.003 · Cited by 37
Wearable Internet-of-Things platform for human activity recognition and health care
Iqbal, A., Ullah, F., Anwar, H., Rehman, A. U., Shah, K., Baig, A., Ali, S., Yoo, S., & Kwak, K. S. (2020) · International Journal of Distributed Sensor Networks · doi:10.1177/1550147720911561 · Cited by 38
“14,16,17 The segmented data are used to extract various time-domain features, such as the mean, variance, and root mean square values, as well as the frequency domain, such as the magnitude of the highest frequency.”
MethodA Novel Multichannel Dilated Convolution Neural Network for Human Activity Recognition
Lin, Y., & Wu, J. (2020) · Mathematical Problems in Engineering · doi:10.1155/2020/5426532 · Cited by 34
Out-of-Distribution Detection of Human Activity Recognition with Smartwatch Inertial Sensors
Boyer, P., Burns, D., & Whyne, C. M. (2021) · Sensors · doi:10.3390/s21051669 · Cited by 40
“HAR classification research involving IMU sensors embedded in wearables is fairly common given the ubiquity of these devices, including those using smartphones [2,10,22,69,70] and smartwatches [5,6,12,71].”
BackgroundAwais, M., Palmerini, L., Bourke, A. K., Ihlen, E. A. F., Helbostad, J. L., & Chiari, L. (2016) · Sensors · doi:10.3390/s16122105 · Cited by 38
“[22] proposed a system for complex human activity recognition by varying window sizes from 1 s to 30 s and found that increasing window size improves the recognition rate of complex activities.”
BackgroundA New Approach to Human Activity Recognition Using Machine Learning Techniques
Marinho, L. B., Junior, A. H. D. S., & Filho, P. P. R. (2017) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-53480-0_52 · Cited by 40
Lima, W. S., Bragança, H. L. D. S., & Souto, E. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.114093 · Cited by 32
Ehatisham-ul-Haq, M., Azam, M. A., Amin, Y., & Naeem, U. (2020) · IEEE Access · doi:10.1109/access.2020.2964237 · Cited by 34
“Shoaib et al. [50], [51] utilized the mixture of smartphone and smartwatch sensors for recognizing complex human activities and achieved effective recognition performance.”
BackgroundSmartphone Sensor-Based Human Activity Recognition Robust to Different Sampling Rates
Hasegawa, T. (2020) · IEEE Sensors Journal · doi:10.1109/jsen.2020.3038281 · Cited by 32
“Although one study [11] did not specify a sampling rate, most studies adopted a uniform sampling rate within the study ( [12] 10Hz, [13] 76Hz, [14] 50Hz, [3] 50Hz, [4] 20Hz and [2] 128Hz).”
BackgroundResultLu, S., Zhang, X., Wang, J., Wang, Y., Fan, M., & Zhou, Y. (2021) · Journal of Healthcare Engineering · doi:10.1155/2021/9958256 · Cited by 33
“Shoaib et al. [18] used inertial sensors to detect the activities that involve hand gestures (smoking, eating, drinking, giving a chat, etc.).”
BackgroundStudent’s Health Exercise Recognition Tool for E-Learning Education
Shloul, T. A., Javeed, M., Gochoo, M., Alsuhibany, S. A., Ghadi, Y. Y., Jalal, A., & Park, J. (2022) · Intelligent Automation & Soft Computing · doi:10.32604/iasc.2023.026051 · Cited by 33
A Smartphone Lightweight Method for Human Activity Recognition Based on Information Theory
Bragança, H. L. D. S., Colonna, J. G., Lima, W. S., & Souto, E. (2020) · Sensors · doi:10.3390/s20071856 · Cited by 32
Real-World Gait Bout Detection Using a Wrist Sensor: An Unsupervised Real-Life Validation
Soltani, A., Paraschiv-Ionescu, A., Dejnabadi, H., Marques-Vidal, P. M., & Aminian, K. (2020) · IEEE Access · doi:10.1109/access.2020.2998842 · Cited by 32
“Note that the reference reported a median [interquartile range] of 73.6 [45.1 – 153.0] (min) for total duration of GB of each subject.”
BackgroundInfluentialReal-Time Drink Trigger Detection in Free-living Conditions Using Inertial Sensors
Gomes, D., & Sousa, I. (2019) · Sensors · doi:10.3390/s19092145 · Cited by 32
“The authors of [4] also conducted remarkable work in complex activity recognition from a range of activities in which drinking was included, using inertial sensing and taking activities as a whole instead of splitting them into gestures.”
BackgroundAnalysis of Multi-Sensor Fusion for Mobile and Wearable Sensor Based Human Activity Recognition
Nweke, H. F., Teh, Y. W., Alo, U. R., & Mujtaba, G. (2018) · Proceedings of the International Conference on Data Processing and Applications · doi:10.1145/3224207.3224212 · Cited by 28
“According to [15], fusion of multiple motion sensors can affect activity recognition in three ways: increase performance, decrease performance or provide no effect on the performance.”
BackgroundMethodInfluentialIntelligent system for human activity recognition in IoT environment
Khaled, H., Abu-Elnasr, O., Elmougy, S., & Tolba, A. S. (2021) · Complex & Intelligent Systems · doi:10.1007/s40747-021-00508-5 · Cited by 31
“Shoaib et al. [23] collected data from 13 human activities performed indoors.”
BackgroundSmart Devices Based Multisensory Approach for Complex Human Activity Recognition
Hanif, M. A., Akram, T., Shahzad, A., Khan, M. A., Tariq, U., Choi, J.-I., Nam, Y., & Zulfiqar, Z. (2021) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2022.019815 · Cited by 32
“In [25] the authors detect the same as in [24] eating activity using wrist worn accelerometer and gyro scope.”
BackgroundDeep learning models for real-life human activity recognition from smartphone sensor data
Garcia-Gonzalez, D., Rivero, D., Fernández-Blanco, E., & Luaces, M. R. (2023) · Internet of Things · doi:10.1016/j.iot.2023.100925 · Cited by 41
Machine and Deep Learning Algorithms for Wearable Health Monitoring
Fei, C., Liu, R., Li, Z., Wang, T., & Baig, F. N. (2021) · Health information science · doi:10.1007/978-3-030-68723-6_6 · Cited by 35
SARM: Salah Activities Recognition Model Based on Smartphone
Ahmad, N., Han, L., Iqbal, K., Ahmad, R., Abid, M. A., & Iqbal, N. (2019) · Electronics · doi:10.3390/electronics8080881 · Cited by 30
“In practice, our activities were somewhat close to standing and sitting activities, yet the accelerometer sensor recognition accuracy was better to detect these compared to the other sensors [18,37].”
BackgroundMethodInfluentialPeriodic Physical Activity Information Segmentation, Counting and Recognition From Video
Cheng, S.-H., Sarwar, M. A., Daraghmi, Y., İk, T.-U., & Li, Y.-L. (2023) · IEEE Access · doi:10.1109/access.2023.3247583 · Cited by 31
“HAR covers an extensive range of tasks including activity recognition [24], repetition counter [25], [26], [27] and distinguishing activity from non-activity [28], [29].”
BackgroundSağbaş, E. A., & Ballı, S. (2024) · Neural Computing and Applications · doi:10.1007/s00521-023-09360-9 · Cited by 26
“In studies carried out with sensor data obtained from mobile devices, standard deviation, and average values are generally used when creating feature sets due to their low complexity and reasonable results [39].”
Automated Urban Travel Interpretation: A Bottom-up Approach for Trajectory Segmentation
Das, R. D., & Winter, S. (2016) · Sensors · doi:10.3390/s16111962 · Cited by 26
“With the emergence of IMUs on smartphones now such micro-level activities are easily detected almost everywhere in offline as well online mode [60,61].”
BackgroundEfficient human activity recognition with spatio-temporal spiking neural networks
Li, Y., Yin, R., Kim, Y., & Panda, P. (2023) · Frontiers in Neuroscience · doi:10.3389/fnins.2023.1233037 · Cited by 30
“Employing machine learning-based classifiers (Kim and Ling, 2009; Aggarwal and Xia, 2014; Shoaib et al., 2016) in conjunction with hand-crafted features has resulted in reasonably satisfactory performance.”
Human Complex Activity Recognition With Sensor Data Using Multiple Features
Huan, R., Jiang, C., Ge, L., Shu, J., Zhan, Z., Chen, P., Chi, K., & Liang, R. (2021) · IEEE Sensors Journal · doi:10.1109/jsen.2021.3130913 · Cited by 28
Human Movement Recognition Based on the Stochastic Characterisation of Acceleration Data
Muñoz-Organero, M., & Lotfi, A. (2016) · Sensors · doi:10.3390/s16091464 · Cited by 26
LP-SBA-XACML: Lightweight Semantics Based Scheme Enabling Intelligent Behavior-Aware Privacy for IoT
Chehab, M., & Mourad, A. (2020) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2020.2999866 · Cited by 26
ADAM-sense: Anxiety-displaying activities recognition by motion sensors
Khan, N. S., Ghani, M. S., & Anjum, G. (2021) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2021.101485 · Cited by 25
Kuncan, F., Kaya, Y., Yiner, Z., & Kaya, M. (2022) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2022.103963 · Cited by 29
PAMS: A new position-aware multi-sensor dataset for human activity recognition using smartphones
Esfahani, P., & Malazi, H. T. (2017) · CSI International Symposium on Computer Architecture and Digital Systems (CADS) · doi:10.1109/cads.2017.8310680 · Cited by 28
“[18] published a dataset of ten participants aged 25 to 35 years old.”
BackgroundFan, C., & Gao, F. (2020) · IEEE Access · doi:10.1109/access.2020.3006163 · Cited by 24
“Regarding the learning techniques, previous works mostly use traditional classification methods such as the naïve Bayes classifier [12], [13], support vector machine [4], [12], [14], and random forest [12], [14]–[18].”
MethodKeefe, R. F., Zimbelman, E. G., & Wempe, A. M. (2019) · International Journal of Forest Engineering · doi:10.1080/14942119.2019.1572489 · Cited by 27
“…a variety of sensors, including accelerometers, gyroscopes, barometers, thermometers, decibel meters (microphones), magnetometers, lux meters, optical heart rate sensors, and GNSS chips (Anjum and Ilyas 2013; Trost et al. 2014; del Rosario et al. 2015; Shoaib et al. 2015, 2016; Weiss et al. 2016).”
BackgroundActivity recognition of FMCW radar human signatures using tower convolutional neural networks
Victoria, A. H., & Maragatham, G. (2021) · Wireless Networks · doi:10.1007/s11276-021-02670-7 · Cited by 22
A Machine Learning Approach for Walking Classification in Elderly People with Gait Disorders
Peimankar, A., Winther, T. S., Ebrahimi, A., & Wiil, U. K. (2023) · Sensors · doi:10.3390/s23020679 · Cited by 29
Energy efficient human activity recognition using wearable sensors
Ding, G., Tian, J., Wu, J., Zhao, Q., & Xie, L. (2018) · IEEE Wireless Communications and Networking Conference Workshops (WCNCW) · doi:10.1109/wcncw.2018.8368980 · Cited by 25
“complex activities can be more easily detected with more sensor units than one unit [3, 4].”
BackgroundTwistIn: Tangible Authentication of Smart Devices via Motion Co-analysis with a Smartwatch
Leung, H.-M. C., Fu, C., & Heng, P. (2018) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3214275 · Cited by 27
Wearable Motion-Based Heart Rate at Rest: A Workplace Evaluation
Hernandez, J., McDuff, D., Quigley, K. S., Maes, P., & Picard, R. W. (2018) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2018.2877484 · Cited by 24
Human action recognition based on low- and high-level data from wearable inertial sensors
López-Nava, I. H., & Muñoz-Meléndez, A. (2019) · International Journal of Distributed Sensor Networks · doi:10.1177/1550147719894532 · Cited by 25
Posture and Physical Activity Detection: Impact of Number of Sensors and Feature Type
Tang, Q., John, D., Thapa-Chhetry, B., ARGUELLO, D. J., & Intille, S. S. (2020) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0000000000002306 · Cited by 26
“(27) used a relatively weak 10-fold cross-validation rather than the recommended leave-one-subject-out validation (32).”
MethodSiamese Networks for Weakly Supervised Human Activity Recognition
Sheng, T., & Huber, M. (2019) · 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC) · doi:10.1109/smc.2019.8914045 · Cited by 21
Umbricht, D., Cheng, W., Lipsmeier, F., Bamdadian, A., & Lindemann, M. (2020) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2020.574375 · Cited by 27
Identifying Smartphone Users based on their Activity Patterns via Mobile Sensing
Ehatisham-ul-Haq, M., Azam, M. A., Naeem, U., Rѐhman, S. U., & Khalid, A. (2017) · Procedia Computer Science · doi:10.1016/j.procs.2017.08.349 · Cited by 23
UnTran: Recognizing Unseen Activities with Unlabeled Data Using Transfer Learning
Khan, M. A. A. H., & Roy, N. (2018) · IEEE/ACM International Conference on Internet-of-Things Design and Implementation (IoTDI) · doi:10.1109/iotdi.2018.00014 · Cited by 27
Human Activity Recognition Based on Symbolic Representation Algorithms for Inertial Sensors
Lima, W. S., Bragança, H. L. D. S., Quispe, K. G. M., & Souto, E. (2018) · Sensors · doi:10.3390/s18114045 · Cited by 24
“This advancement has benefited applications such as health care [1,2], monitoring physical activities [3,4], domestic activities [5], and safety [6,7].”
BackgroundMethodYu, H., Pan, G., Pan, M., Li, C., Jia, W., Zhang, L., & Sun, M. (2019) · Sensors · doi:10.3390/s19030546 · Cited by 24
Physical Activity Recognition by Utilising Smartphone Sensor Signals
Alruban, A., Alobaidi, H., Clarke, N., & Li, F. (2019) · International Conference on Pattern Recognition Applications and Methods · doi:10.5220/0007271903420351 · Cited by 25
“Therefore, much of the research has employed smartphones to record various types of individual activities in a user-friendly, unobtrusive, and periodic manner (Kwon, Kang and Bae, 2014; Capela et al., 2016; Shoaib et al., 2016).”
A context‐awareness model for activity recognition in robot‐assisted scenarios
Rodríguez-Lera, F. J., Martín, F., Guerrero‐Higueras, Á. M., & Olivera, V. M. (2019) · Expert Systems · doi:10.1111/exsy.12481 · Cited by 21
Lateef, R. A. R., & Abbas, A. R. (2022) · Iraqi Journal of Science · doi:10.24996/ijs.2022.63.1.34 · Cited by 23
“The position of the smartphone or smart watch and the location of a subject play a vital role on the result of recognition of activity Havinga [44] studied the effect of placing the smartphone on the two body positions, in the pocket and in wrist on the performance of activity recognition.”
BackgroundInfluentialZimbelman, E. G., & Keefe, R. F. (2021) · PLoS ONE · doi:10.1371/journal.pone.0250624 · Cited by 23
“Additionally, previous studies have shown that hip-mounted accelerometers may recognize activities like running better than wrist-mounted accelerometers [27] and that using sensors in multiple positions, such as the wrist and pocket, can improve model performance [34].”
BackgroundResultInfluentialJamil, H., Qayyum, F., Iqbal, N., Jamil, F., & Kim, D. H. (2022) · IEEE Sensors Journal · doi:10.1109/jsen.2022.3228120 · Cited by 22
Huh, J., Cerrada, C. J., Dzubur, E., Dunton, G. F., Spruijt‐Metz, D., & Leventhal, A. M. (2020) · Translational Behavioral Medicine · doi:10.1093/tbm/ibz183 · Cited by 23
D-SORM: A digital solution for remote monitoring based on the attitude of wearable devices
Abbas, M., Somme, D., & Jeannès, R. L. B. (2021) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2021.106247 · Cited by 24
CNN‐LSTM‐Based Late Sensor Fusion for Human Activity Recognition in Big Data Networks
Baloch, Z., Shaikh, F. K., & Unar, M. A. (2022) · Wireless Communications and Mobile Computing · doi:10.1155/2022/3434100 · Cited by 24
DANA: Dimension-Adaptive Neural Architecture for Multivariate Sensor Data
Malekzadeh, M., Clegg, R. G., Cavallaro, A., & Haddadi, H. (2021) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3478074 · Cited by 27
“UTwente [57] Accelerometer Gyroscope Magnetometer {Sit, Stand, Walk, Jog, Bike, Smoke, Drink, Eat, Talk, Type, Write, Stairs-Down, Stairs-Up} 10 Right Wrist”
BackgroundMethodInfluentialMicro-activity recognition in industrial assembly process with IMU data and deep learning
Sopidis, G., Haslgrübler, M., Azadi, B., Anzengruber-Tánase, B., Ahmad, A., Ferscha, A., & Baresch, M. (2022) · International Conference on PErvasive Technologies Related to Assistive Environments (PETRA) · doi:10.1145/3529190.3529204 · Cited by 23
“The data acquisition, is followed by the preprocessing, later the learning and the classification of the activities occurs similar to the approach in [Stiefmeier et al. 2008] and finally the notification through the feedback modality Fig.1.”
BackgroundMethodZhao, C., Gao, F., & Shen, Z. (2024) · Computers & Security · doi:10.1016/j.cose.2023.103698 · Cited by 20
SmokeSense: Online Activity Recognition Framework on Smartwatches
Shoaib, M. A., İncel, Ö. D., Scholten, H., & Havinga, P. (2018) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-319-90740-6_7 · Cited by 24
“Our aim is to address the mentioned issues, validate the offline analysis results from our previous studies [15,16] and to compare various aspects of an activity recognition system in a similar environment and similar experimental setup.”
ResultSelf-citationSyed, S., Morseth, B., Hopstock, L. A., & Horsch, A. (2021) · Scientific Reports · doi:10.1038/s41598-021-87757-z · Cited by 22
Towards Inferring Mechanical Lock Combinations using Wrist-Wearables as a Side-Channel
Maiti, A., Heard, R., Sabra, M., & Jadliwala, M. S. (2018) · ACM Conference on Security and Privacy in Wireless and Mobile Networks (WiSec) · doi:10.1145/3212480.3212498 · Cited by 19
Ray, S. J., Cherian, J., Liberty, A. M., Hammond, T. A., & Shireman, P. K. (2024) · doi:10.2196/preprints.67373 · Cited by 18
Ray, S. J., Cherian, J., Liberty, A. M., Hammond, T. A., & Shireman, P. K. (2025) · Journal of Medical Internet Research · doi:10.2196/67373 · Cited by 18
“More recent work has predominantly used commercially available devices [9,10,14,15].”
A Review of Physical Human Activity Recognition Chain Using Sensors
AlShorman, O., Alshorman, B., & Masadeh, M. (2020) · Indonesian Journal of Electrical Engineering and Informatics (IJEEI) · doi:10.11591/ijeei.v8i3.2312 · Cited by 20
Mekruksavanich, S., & Jitpattanakul, A. (2024) · Symmetry · doi:10.3390/sym16050554 · Cited by 19
An online feature selection architecture for Human Activity Recognition
Karagiannaki, K., Πανουσοπούλου, Α., & Tsakalides, P. (2017) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2017.7952611 · Cited by 20
“Signal processing [3, 4] and wearable computing [5, 6] have been empowering these efforts, providing the necessary means for monitoring the physiological performance of individuals and extracting contextual information from raw observations in an offline, centralized fashion.”
BackgroundDaily wrist activity classification using a smart band
Nguyen, N. D., Truong, P. H., & Jeong, G. (2017) · Physiological Measurement · doi:10.1088/1361-6579/aa7c10 · Cited by 18
“…systems (Banos et al 2012), gait analysis (Iosa et al 2016, L ó pez-Nava and Muoz-Melndez 2016), long-term health and fitness monitoring (Zhang et al 2012, Nguyen et al 2015), giving context-aware feedback (Shoaib et al 2016), surveillance (Kanna et al 2016), and robotics (Kanna et al 2016).”
BackgroundA framework for the recognition of horse gaits through wearable devices
Casella, E., Khamesi, A. R., & Silvestri, S. (2020) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2020.101213 · Cited by 20
Daily Living Activity Recognition In-The-Wild: Modeling and Inferring Activity-Aware Human Contexts
Ehatisham-ul-Haq, M., Murtaza, F., Azam, M. A., & Amin, Y. (2022) · Electronics · doi:10.3390/electronics11020226 · Cited by 17
StresSense: Real-Time detection of stress-displaying behaviors
Khan, N. S., Qadir, S., Anjum, G., & Uddin, N. (2024) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2024.105401 · Cited by 20
Li, T., Wang, Q., An, Y., Guo, L. J., Ren, L., Lei, L., & Chen, X. (2025) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2025.107750 · Cited by 22
Online Change Point Detection in Application With Transition-Aware Activity Recognition
Thakur, D., & Biswas, S. (2022) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2022.3185533 · Cited by 20
“On the other hand, frequency domain features are helpful to validate the distribution of signal energy and are effective for the identification of repetitive activities [39], [40].”
BackgroundTwo-Domain Joint Attention Mechanism Based on Sensor Data for Group Activity Recognition
Huan, R., Bo, A., Shu, J., Chen, P., & Liang, R. (2023) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2023.3246469 · Cited by 16
Prigent, G., Aminian, K., Cereatti, A., Salis, F., Bonci, T., Scott, K., Mazzà, C., Alcock, L., Din, S. D., Gazit, E., et al. (2023) · Medical & Biological Engineering & Computing · doi:10.1007/s11517-023-02826-x · Cited by 19
Kundu, S., Mallik, M., Saha, J., & Chowdhury, C. (2024) · International Journal of Information Technology · doi:10.1007/s41870-024-02305-y · Cited by 24
“Hand-gesture activities can also be recognized with higher accuracy, when smartphone is used along with wrist-worn sensors, as shown in [23].”
ProxiTalk: Activate Speech Input by Bringing Smartphone to the Mouth
Yang, Z., Yu, C., Zheng, F., & Shi, Y. (2019) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3351276 · Cited by 19
“Many researchers have studied and compared various data-driven methods to classify user actions and activities using smartphone sensor-based data [29, 30, 35, 48, 55, 56, 63].”
BackgroundReal-time human behaviour monitoring using hybrid ambient assisted living framework
Patel, A. D., & Shah, J. H. (2020) · Journal of Reliable Intelligent Environments · doi:10.1007/s40860-020-00100-7 · Cited by 17
Recommendation system for human physical activities using smartphones
Kadri, N., Ellouze, A., & Ksantini, M. (2020) · doi:10.1109/iccis49240.2020.9257671 · Cited by 16
“In the case of machine learning, we can talk about the most used methods with this kind of data, like Support Vector Machine (SVM) [1], Decision Tree algorithm [2] and K-Nearest Neighbors (KNN) [3].”
BackgroundMethodA hybrid CNN and BLSTM network for human complex activity recognition with multi-feature fusion
Huan, R., Zhan, Z., Ge, L., Chi, K., Chen, P., & Liang, R. (2021) · Multimedia Tools and Applications · doi:10.1007/s11042-021-11363-4 · Cited by 18
A Multiserver Authentication Protocol With Integrated Monitoring for IoMT-Based Healthcare System
Xie, Q., Zhao, Y., Xie, Q., Li, X., He, D., & Chen, K. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3469629 · Cited by 17
“1) Data Acquisition: Shoaib et al. [17], [18], [19] utilized an existing physical recognition data set to verify the performance of their continuous authentication.”
Eating and Drinking Recognition in Free-Living Conditions for Triggering Smart Reminders
Gomes, D., Mendes‐Moreira, J., Sousa, I., & da Silva, J. K. A. (2019) · Sensors · doi:10.3390/s19122803 · Cited by 19
Activity Recognition from Mobile Phone using Deep CNN
Wu, W., & Zhang, Y. (2019) · Chinese Control Conference (CCC) · doi:10.23919/chicc.2019.8865142 · Cited by 16
“In most sensor-based HAR methods, users had to attach multiple dedicated motion sensors [5, 6] to various parts of the body such as legs, arms, and waist.”
MethodComparing Cross-Subject Performance on Human Activities Recognition Using Learning Models
Yang, Z., Qu, M., Pan, Y., & Huan, R. (2022) · IEEE Access · doi:10.1109/access.2022.3204739 · Cited by 18
“Experiments on PAMAP2 and UT-data [10] 188 obtained F1-scores at 92.23% and 98.07%, respectively.”
BackgroundInfluentialInertial Sensor-Based Instrumented Cane for Real-Time Walking Cane Kinematics Estimation
Fernandez, I. G., Ahmad, S. A., & Wada, C. (2020) · Sensors · doi:10.3390/s20174675 · Cited by 17
Robust human activity recognition using lesser number of wearable sensors
Wang, D., Candinegara, E., Hou, J., Tan, A., & Miao, C. (2017) · International Conference on Security, Pattern Analysis, and Cybernetics (SPAC) · doi:10.1109/spac.2017.8304292 · Cited by 16
Alpine Skiing Activity Recognition Using Smartphone’s IMUs
Azadi, B., Haslgrübler, M., Anzengruber-Tánase, B., Grünberger, S., & Ferscha, A. (2022) · Sensors · doi:10.3390/s22155922 · Cited by 17
“Scholars concluded a window size between [2, 3, 4, 5] seconds is ideal for HAR applications [30,31] which are mainly low-speed activities.”
Towards Self-Improving Activity Recognition Systems Based on Probabilistic, Generative Models
Janicke, M., Tomforde, S., & Sick, B. (2016) · IEEE International Conference on Autonomic Computing (ICAC) · doi:10.1109/icac.2016.22 · Cited by 16
“is actively pursued at the moment [20], [21].”
BackgroundMarcello, F., Pilloni, V., & Giusto, D. (2019) · Energies · doi:10.3390/en12132631 · Cited by 13
Li, Y., Wang, L., & Liu, F. (2022) · Electronics · doi:10.3390/electronics11162526 · Cited by 14
IMU-based Human Activity Recognition using Machine Learning and Deep Learning models
AlKharji, S., Alteneiji, A., & Poon, K. (2023) · International Conference on Signal Processing and Information Security (ICSPIS) · doi:10.1109/icspis60075.2023.10343567 · Cited by 16
“Complex activities that involve hand gestures require longer window sizes compared to simpler activities that contain repetitive movements which require window sizes between 2 and 5 seconds [13].”
BackgroundTian, Y., Hettiarachchi, D., Yu, H. S., & Kamijo, S. (2024) · IEEE Sensors Journal · doi:10.1109/jsen.2024.3404777 · Cited by 15
“Shoaib et al. [40] proposed using traditional machine learning methods, such as KNN, DT, and NB, to recognize complex activities.”
Method
Metadata
- Authors
- Shoaib, M., Bosch, S., Incel, O., Scholten, H., & Havinga, P.
- Affiliations
- University of Twente (NL)
- Department of Computer Engineering, Galatasaray University, Ortakoy, 34349 Istanbul, Turkey
- Corresponding author
- Shoaib, Muhammad
- Venue
- Sensors
- Publisher
- MDPI AG
- Published
- 2016-03-24
- Volume
- 16
- Issue
- 4
- Pages
- 426
- ISSN
- 1424-8220 (ISSN-L)
- PMC
- PMC4850940
- OpenAlex
- W2304267454
- Cited by
- 423
- References
- 41
- Citations by year
- 2026: 28 · 2025: 24 · 2024: 34 · 2023: 42 · 2022: 48 · 2021: 62 · 2020: 58 · 2019: 52 · 2018: 37 · 2017: 29 · 2016: 9
- FWCI
- 28.79
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Sensors (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- University of Twente Research Information (publishedVersion, cc-by)
- University of Twente Research Information (submittedVersion, cc-by)
- Funders
- Galatasaray Üniversitesi (13.401.002)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Social Sciences › Transportation › Human Mobility and Location-Based Analysis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Keywords
- human activity recognition, smartphone sensors, accelerometer, gyroscope, sensor placement, hand gestures, smoking detection, multimodal sensor fusion, activity recognition dataset
- MeSH terms
- Smartphone, Activities of Daily Living, Humans, Movement, Pattern Recognition, Automated, Smoking, Wrist, Walking, Accelerometry
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.