Complex Human Activity Recognition Using Smartphone and Wrist-Worn Motion Sensors
Open accessThe DOI matches its Crossref record; 40 of the 41 references it cites were found in a registry or an index.
Abstract
The position of on-body motion sensors plays an important role in human activity recognition. Most often, mobile phone sensors at the trouser pocket or an equivalent position are used for this purpose. However, this position is not suitable for recognizing activities that involve hand gestures, such as smoking, eating, drinking coffee and giving a talk. To recognize such activities, wrist-worn motion sensors are used. However, these two positions are mainly used in isolation. To use richer context information, we evaluate three motion sensors (accelerometer, gyroscope and linear acceleration sensor) at both wrist and pocket positions. Using three classifiers, we show that the combination of these two positions outperforms the wrist position alone, mainly at smaller segmentation windows. Another problem is that less-repetitive activities, such as smoking, eating, giving a talk and drinking coffee, cannot be recognized easily at smaller segmentation windows unlike repetitive activities, like walking, jogging and biking. For this purpose, we evaluate the effect of seven window sizes (2-30 s) on thirteen activities and show how increasing window size affects these various activities in different ways. We also propose various optimizations to further improve the recognition of these activities. For reproducibility, we make our dataset publicly available.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures












Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Basic activities demonstrate consistent and repeated patterns, facilitating their detection, whereas complex activities entail non-repetitive and context-sensitive motions that depend on extended temporal sequences, presenting considerable challenges for detection [7, 8].”
From Adaptive temporal attention mechanism and hybrid deep CNN model for wearable sensor-based human activity recognition (2025) · cites this paper as [8]
Experimental — accuracy not yet measuredIn the citing paper
“The UTwente dataset consists of 13 activities gathered from 10 people utilizing two smartphones (one in the right trouser pocket and the other on the wrist), equipped with accelerometer, gyroscope, linear acceleration, and magnetometer sensors at a frequency of 50 Hz.”
From Adaptive temporal attention mechanism and hybrid deep CNN model for wearable sensor-based human activity recognition (2025) · cites this paper as [8]
In the citing paper
“The UTwente dataset was chosen as a suitable benchmark for evaluation because of its diverse range of activities (13 in total, comprising 7 simple and 6 complicated activities), superior data quality, and the application of wearable sensors in real-world contexts (trouser pockets and wrists) [8].”
From Adaptive temporal attention mechanism and hybrid deep CNN model for wearable sensor-based human activity recognition (2025) · cites this paper as [8]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016
The WEKA data mining software: an update
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., & Witten, I. H. (2009) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1656274.1656278 · Cited by 17,750 · cited 1×
“As data are randomized before stratified cross-validation in the WEKA (Waikato Environment for Knowledge Analysis) tool [25], overlap in the data can cause using some data in both training and testing, which can lead to higher recognition performance.”
MethodA survey of mobile phone sensing
Lane, N., Miluzzo, E., Lu, H., Peebles, D., Choudhury, T., & Campbell, A. (2010) · IEEE Communications Magazine · doi:10.1109/mcom.2010.5560598 · Cited by 2,292
A tutorial on human activity recognition using body-worn inertial sensors
Bulling, A., Blanke, U., & Schiele, B. (2014) · ACM Computing Surveys · doi:10.1145/2499621 · Cited by 1,668 · cited 1×
“Activity recognition using body-worn motion sensors in general [19] and especially using smartphone sensors has been studied in recent years [1,2], and it is still being studied extensively [1,2,19–21].”
BackgroundMiluzzo, E., Lane, N. D., Fodor, K., Peterson, R., Lu, H., Musolesi, M., Eisenman, S. B., Zheng, X., & Campbell, A. T. (2008) · Proceedings of the 6th ACM conference on Embedded network sensor systems · doi:10.1145/1460412.1460445 · Cited by 1,032 · cited 1×
“They are implemented on mobile phones in various studies; i.e. , Naive Bayes in [37–39], decision tree in [40–42] and KNN in [31,32,39,43].”
MethodPreprocessing techniques for context recognition from accelerometer data
Figo, D., Diniz, P. C., Ferreira, D. R., & Cardoso, J. M. P. (2010) · Personal and Ubiquitous Computing · doi:10.1007/s00779-010-0293-9 · Cited by 578
The Jigsaw continuous sensing engine for mobile phone applications
Lu, H., Yang, J., Liu, Z., Lane, N. D., Choudhury, T., & Campbell, A. T. (2010) · Proceedings of the 8th ACM Conference on Embedded Networked Sensor Systems · doi:10.1145/1869983.1869992 · Cited by 560
Mobile Phone Sensing Systems: A Survey
Khan, W. Z., Xiang, Y., Aalsalem, M. Y., & Arshad, Q. (2013) · IEEE Communications Surveys & Tutorials · doi:10.1109/surv.2012.031412.00077 · Cited by 557 · cited 2×
“Activity recognition using body-worn motion sensors in general [19] and especially using smartphone sensors has been studied in recent years [1,2], and it is still being studied extensively [1,2,19–21].”
BackgroundFusion of Smartphone Motion Sensors for Physical Activity Recognition
Shoaib, M., Bosch, S., Incel, O., Scholten, H., & Havinga, P. (2014) · Sensors · doi:10.3390/s140610146 · Cited by 552 · cited 6×
“We had shown previously that the accelerometer performs poorly at recognizing walking upstairs and downstairs and needs additional gyroscope data for better recognition of these two activities [12].”
BackgroundMethodInfluentialSelf-citationA Survey of Online Activity Recognition Using Mobile Phones
Shoaib, M., Bosch, S., Incel, O., Scholten, H., & Havinga, P. (2015) · Sensors · doi:10.3390/s150102059 · Cited by 489 · cited 2×
“We selected three classifiers, which are commonly used for practical activity recognition: Naive Bayes, k-nearest neighbor (KNN) and decision tree [35,36].”
BackgroundMethodSelf-citationBeWell: A Smartphone Application to Monitor, Model and Promote Wellbeing
Lane, N., Mohammod, M., Lin, M., Yang, X., Lu, H., Ali, S., Doryab, A., Berke, E., Choudhury, T., & Campbell, A. (2011) · Proceedings of the 5th International ICST Conference on Pervasive Computing Technologies for Healthcare · doi:10.4108/icst.pervasivehealth.2011.246161 · Cited by 409 · cited 1×
“, Naive Bayes in [37–39], decision tree in [40–42] and KNN in [31,32,39,43].”
BackgroundAnalyzing features for activity recognition
Huynh, T., & Schiele, B. (2005) · Proceedings of the 2005 joint conference on Smart objects and ambient intelligence: innovative context-aware services: usages and technologies · doi:10.1145/1107548.1107591 · Cited by 339
RisQ: recognizing smoking gestures with inertial sensors on a wristband
Parate, A., Chiu, M.-C., Chadowitz, C., Ganesan, D., & Kalogerakis, E. (2014) · Proceedings of the 12th annual international conference on Mobile systems, applications, and services · doi:10.1145/2594368.2594379 · Cited by 282
A Review and Taxonomy of Activity Recognition on Mobile Phones
Incel, O. D., Kose, M., & Ersoy, C. (2013) · BioNanoScience · doi:10.1007/s12668-013-0088-3 · Cited by 234 · cited 2×
“Activity recognition using body-worn motion sensors in general [19] and especially using smartphone sensors has been studied in recent years [1,2], and it is still being studied extensively [1,2,19–21].”
BackgroundTowards Physical Activity Recognition Using Smartphone Sensors
Shoaib, M., Scholten, H., & Havinga, P. J. M. (2013) · 2013 IEEE 10th International Conference on Ubiquitous Intelligence and Computing and 2013 IEEE 10th International Conference on Autonomic and Trusted Computing · doi:10.1109/uic-atc.2013.43 · Cited by 228 · cited 4×
“For data collection, we used our Android application [10,12].”
BackgroundMethodInfluentialSelf-citationDetecting Periods of Eating During Free-Living by Tracking Wrist Motion
Dong, Y., Scisco, J., Wilson, M., Muth, E., & Hoover, A. (2014) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2013.2282471 · Cited by 227
Recognizing Human Activities User-independently on Smartphones Based on Accelerometer Data
Siirtola, P., & Röning, J. (2012) · International Journal of Interactive Multimedia and Artificial Intelligence · doi:10.9781/ijimai.2012.155 · Cited by 206 · cited 1×
“They are implemented on mobile phones in various studies; i.e. , Naive Bayes in [37–39], decision tree in [40–42] and KNN in [31,32,39,43].”
MethodMachine learning for activity recognition: hip versus wrist data
Trost, S. G., Zheng, Y., & Wong, W.-K. (2014) · Physiological Measurement · doi:10.1088/0967-3334/35/11/2183 · Cited by 181
Human motion recognition using a wireless sensor-based wearable system
Varkey, J. P., Pompili, D., & Walls, T. A. (2011) · Personal and Ubiquitous Computing · doi:10.1007/s00779-011-0455-4 · Cited by 149
Activity classification using a single wrist-worn accelerometer
Chernbumroong, S., Atkins, A. S., & Yu, H. (2011) · International Conference on Software, Knowledge, Information Management and Applications (SKIMA) · doi:10.1109/skima.2011.6089975 · Cited by 130
User, device and orientation independent human activity recognition on mobile phones
Ustev, Y. E., İncel, Ö. D., & Ersoy, C. (2013) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/2494091.2496039 · Cited by 125
Towards detection of bad habits by fusing smartphone and smartwatch sensors
Shoaib, M. A., Bosch, S., Scholten, H., Havinga, P., & İncel, Ö. D. (2015) · IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops) · doi:10.1109/percomw.2015.7134104 · Cited by 119 · cited 3×
“Extending our previous work [24], we evaluated the effect of combining motion sensors at the wrist and pocket positions, such as an accelerometer, a gyroscope and a linear acceleration sensor.”
BackgroundMethodSelf-citationMoncada‐Torres, A., Leuenberger, K., Gonzenbach, R. R., Luft, A. R., & Gassert, R. (2014) · Physiological Measurement · doi:10.1088/0967-3334/35/7/1245 · Cited by 117 · cited 1×
“Usually, additional sensors, such as a gyroscope [10] and a barometer [11], are combined with the accelerometer to reliably recognize using stairs: walking upstairs and downstairs.”
MethodThe case for smartwatch-based diet monitoring
Sen, S., Subbaraju, V., Misra, A., Balan, R. K., & Lee, Y. (2015) · IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops) · doi:10.1109/percomw.2015.7134103 · Cited by 96 · cited 1×
“In [22], the authors use the accelerometer and gyroscope data from a smartwatch to recognize eating episodes from similar non-eating activities.”
BackgroundMulti-Sensor Fusion for Enhanced Contextual Awareness of Everyday Activities with Ubiquitous Devices
Guiry, J. J., van de Ven, P. W. J., & Nelson, J. (2014) · Sensors · doi:10.3390/s140305687 · Cited by 93
Determining the Single Best Axis for Exercise Repetition Recognition and Counting on SmartWatches
Mortazavi, B. J., Pourhomayoun, M., Alsheikh, G., Alshurafa, N. I., Lee, S. I., & Sarrafzadeh, M. (2014) · Wearable and Implantable Body Sensor Networks · doi:10.1109/bsn.2014.21 · Cited by 82
Ready-to-use activity recognition for smartphones
Siirtola, P., & Röning, J. (2013) · IEEE Symposium on Computational Intelligence and Data Mining (CIDM) · doi:10.1109/cidm.2013.6597218 · Cited by 71 · cited 1×
“This method has shown to be effective in other studies [31–33].”
Energy-Efficient Integration of Continuous Context Sensing and Prediction into Smartwatches
Rawassizadeh, R., Tomitsch, M., Nourizadeh, M., Momeni, E., Peery, A., Ulanova, L., & Pazzani, M. J. (2015) · Sensors · doi:10.3390/s150922616 · Cited by 60 · cited 2×
“This needs further exploration, though initial work towards energy-efficient context sensing has been done in [44], which also highlights some of the other challenges in using smartwatches for activity recognition.”
BackgroundDetecting User Activities using the Accelerometer on Android Smartphones
Perez, B., Murphy, M. J., & Olin, F. W. (2010) · Cited by 53
A Feasibility Study of Wrist-Worn Accelerometer Based Detection of Smoking Habits
Scholl, P., & Laerhoven, K. V. (2012) · International Conference on Innovative Mobile and Internet Services in Ubiquitous Computing (IMIS) · doi:10.1109/imis.2012.96 · Cited by 50 · cited 3×
“Earlier studies [5,7,9,16–18] have shown that such activities can be recognized using on-body motion sensors, which we discuss further in the Related Work Section 2.”
BackgroundUsing smart phones for context-aware prompting in smart environments
Das, B., Seelye, A. M., Thomas, B. L., Cook, D. J., Holder, L. B., & Schmitter‐Edgecombe, M. (2012) · IEEE Consumer Communications and Networking Conference · doi:10.1109/ccnc.2012.6181023 · Cited by 41 · cited 1×
“, Naive Bayes in [37–39], decision tree in [40–42] and KNN in [31,32,39,43].”
BackgroundAccelerometer based intelligent system for human movement recognition
da Silva, F. G., & Galeazzo, E. (2013) · International Workshop on Advances in Sensors and Interfaces (IWASI) · doi:10.1109/iwasi.2013.6576063 · Cited by 38 · cited 1×
“Similarly, a wrist-worn accelerometer was used in [17] to recognize eight activities, including the activity of working on a computer.”
MethodA Study of Temporal Action Sequencing During Consumption of a Meal
Ramos-Garcia, R. I., & Hoover, A. W. (2013) · ACM International Conference on Bioinformatics, Computational Biology, and Health Informatics (ACM-BCB) · doi:10.1145/2506583.2506596 · Cited by 36 · cited 3×
“Earlier studies [5,7,9,16–18] have shown that such activities can be recognized using on-body motion sensors, which we discuss further in the Related Work Section 2.”
BackgroundMethodActivity Recognition with Mobile Phones
Frank, J., Mannor, S., & Precup, D. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-23808-6_44 · Cited by 35
Thiemjarus, S., Henpraserttae, A., & Marukatat, S. (2013) · Wearable and Implantable Body Sensor Networks · doi:10.1109/bsn.2013.6575462 · Cited by 32 · cited 1×
“They are implemented on mobile phones in various studies; i.e. , Naive Bayes in [37–39], decision tree in [40–42] and KNN in [31,32,39,43].”
MethodHuman activity recognition using inertial sensors with invariance to sensor orientation
Florentino-Liaño, B., O’Mahony, N., & Artés-Rodríguez, A. (2012) · International Workshop on Cognitive Information Processing (CIP) · doi:10.1109/cip.2012.6232914 · Cited by 22 · cited 2×
“However, it is also less generic in terms of classification, because it is more sensitive to changes in sensor orientation and body position [27,28].”
BackgroundHuman Activity Recognition Using Heterogeneous Sensors
Shoaib, M. A. (2013) · University of Twente Research Information · Cited by 19
Self-citationChanging health behaviors through social and physical context awareness
Chen, G., Ding, X., Huang, K. W., Xu, Y., & Zhang, C. (2015) · 2012 International Conference on Computing, Networking and Communications (ICNC) · doi:10.1109/iccnc.2015.7069424 · Cited by 10 · cited 2×
“Moreover, the recognition of such activities can be used in giving context-aware feedback [14].”
BackgroundSmart Watches for Home Interaction Services
Bieber, G., Fernholz, N., & Gaerber, M. (2013) · Communications in computer and information science · doi:10.1007/978-3-642-39473-7_59 · Cited by 7 · cited 1×
“Recently, wrist-worn motion sensors are also being used for human activity recognition [3–5].”
BackgroundDefining a Roadmap Towards Comparative Research in Online Activity Recognition on Mobile Phones
Shoaib, M. A., Bosch, S., İncel, Ö. D., Scholten, H., & Havinga, P. (2015) · International Conference on Pervasive and Embedded Computing and Communication Systems · doi:10.5220/0005324401540159 · Cited by 6 · cited 2×
“We selected three classifiers, which are commonly used for practical activity recognition: Naive Bayes, k-nearest neighbor (KNN) and decision tree [35,36].”
BackgroundMethodSelf-citation
Research works printed but not linked: 2
- Bieber, G., Fernholz, N., and Gaerber, M. (2013). HCI International 2013-Posters’ Extended Abstracts, Springer.
- Frank, J., Mannor, S., and Precup, D. (2011). Machine Learning and Knowledge Discovery in Databases, Springer.
Cited by
Nweke, H. F., Teh, Y. W., Al-garadi, M. A., & Alo, U. R. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.03.056 · Cited by 930
Qiu, S., Zhao, H., Jiang, N., Wang, Z., Liu, L., An, Y., Zhao, H., Miao, X., Liu, R., & Fortino, G. (2022) · Information Fusion · doi:10.1016/j.inffus.2021.11.006 · Cited by 671
A survey on wearable sensor modality centred human activity recognition in health care
Wang, Y., Cang, S., & Yu, H. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.04.057 · Cited by 409
Nweke, H. F., Teh, Y. W., Mujtaba, G., & Al-garadi, M. A. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.06.002 · Cited by 394
Demrozi, F., Pravadelli, G., Bihorac, A., & Rashidi, P. (2020) · IEEE Access · doi:10.1109/access.2020.3037715 · Cited by 368
Metadata
- Authors
- Shoaib, M., Bosch, S., Incel, O., Scholten, H., & Havinga, P.
- Affiliations
- University of Twente (NL)
- Department of Computer Engineering, Galatasaray University, Ortakoy, 34349 Istanbul, Turkey
- Corresponding author
- Shoaib, Muhammad
- Venue
- Sensors
- Publisher
- MDPI AG
- Published
- 2016-03-24
- Volume
- 16
- Issue
- 4
- Pages
- 426
- ISSN
- 1424-8220 (ISSN-L)
- PMC
- PMC4850940
- OpenAlex
- W2304267454
- Cited by
- 423
- References
- 41
- Citations by year
- 2026: 28 · 2025: 24 · 2024: 34 · 2023: 42 · 2022: 48 · 2021: 62 · 2020: 58 · 2019: 52 · 2018: 37 · 2017: 29 · 2016: 9
- FWCI
- 28.79
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Sensors (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- University of Twente Research Information (publishedVersion, cc-by)
- University of Twente Research Information (submittedVersion, cc-by)
- Funders
- Galatasaray Üniversitesi (13.401.002)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Social Sciences › Transportation › Human Mobility and Location-Based Analysis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Keywords
- human activity recognition, smartphone sensors, accelerometer, gyroscope, sensor placement, hand gestures, smoking detection, multimodal sensor fusion, activity recognition dataset
- MeSH terms
- Smartphone, Activities of Daily Living, Humans, Movement, Pattern Recognition, Automated, Smoking, Wrist, Walking, Accelerometry
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.