Fusion of Smartphone Motion Sensors for Physical Activity Recognition
Open accessThe DOI matches its Crossref record; 43 of the 45 references it cites were found in a registry or an index.
Abstract
For physical activity recognition, smartphone sensors, such as an accelerometer and a gyroscope, are being utilized in many research studies. So far, particularly, the accelerometer has been extensively studied. In a few recent studies, a combination of a gyroscope, a magnetometer (in a supporting role) and an accelerometer (in a lead role) has been used with the aim to improve the recognition performance. How and when are various motion sensors, which are available on a smartphone, best used for better recognition performance, either individually or in combination? This is yet to be explored. In order to investigate this question, in this paper, we explore how these various motion sensors behave in different situations in the activity recognition process. For this purpose, we designed a data collection experiment where ten participants performed seven different activities carrying smart phones at different positions. Based on the analysis of this data set, we show that these sensors, except the magnetometer, are each capable of taking the lead roles individually, depending on the type of activity being recognized, the body position, the used data features and the classification method employed (personalized or generalized). We also show that their combination only improves the overall recognition performance when their individual performances are not very high, so that there is room for performance improvement. We have made our data set and our data collection application publicly available, thereby making our experiments reproducible.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
















Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This fragmentation stems from varying sensor characteristics across devices (e.g., watches, phones, wristbands), placement-dependent data variations, diverse sensing specifications [38,41,43], and inconsistent activity taxonomies [43].”
From Towards Customizable Foundation Models for Human Activity Recognition with Wearable Devices (2025) · cites this paper as [41]
Experimental — accuracy not yet measuredIn the citing paper
“In previous studies, features extracted from Micro-Electro-Mechanical Systems (MEMS) signals revealed that the gyroscope and accelerometer signals contain the most information about human motion because they measure kinematic motion indirectly [19].”
From Deep CNN-LSTM With Self-Attention Model for Human Activity Recognition Using Wearable Sensor (2022) · cites this paper as [19]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The WEKA data mining software: an update
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., & Witten, I. H. (2009) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1656274.1656278 · Cited by 17,750 · cited 3×
“In order to analyze the preprocessed data, we used the WEKA machine learning tool (Waikato Environment for Knowledge Analysis) [37,38].”
MethodActivity Recognition from User-Annotated Acceleration Data
Bao, L., & Intille, S. S. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24646-6_1 · Cited by 3,147
Anguita, D., Ghio, A., Oneto, L., Parra, X., & Reyes-Ortiz, J. L. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35395-6_30 · Cited by 971
Healthcare in the pocket: Mapping the space of mobile-phone health interventions
Klasnja, P., & Pratt, W. (2012) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2011.08.017 · Cited by 970
Driving style recognition using a smartphone as a sensor platform
Johnson, D. A., & Trivedi, M. M. (2011) · 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2011.6083078 · Cited by 727
Accurate, Fast Fall Detection Using Gyroscopes and Accelerometer-Derived Posture Information
Li, Q., Stankovic, J. A., Hanson, M. A., Barth, A. T., Lach, J., & Zhou, G. (2009) · 2009 Sixth International Workshop on Wearable and Implantable Body Sensor Networks · doi:10.1109/bsn.2009.46 · Cited by 584
Preprocessing techniques for context recognition from accelerometer data
Figo, D., Diniz, P. C., Ferreira, D. R., & Cardoso, J. M. P. (2010) · Personal and Ubiquitous Computing · doi:10.1007/s00779-010-0293-9 · Cited by 578 · cited 10×
“Though time domain features are computationally cheap compared to frequency domain features, due to the expensive Fourier transformation [4,8], we still chose one feature set from the frequency domain to validate our results in a generic way.”
InfluentialPreece, S. J., Goulermas, J. Y., Kenney, L. P. J., & Howard, D. (2009) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2008.2006190 · Cited by 551 · cited 4×
“We used the sliding window approach with an overlap of 50% (1 s overlap here), based on the reporting of previous studies [3,34,35].”
InfluentialWEKA: The Waikato Environment for Knowledge Analysis
Garner, S. (1996) · Cited by 508
BeWell: A Smartphone Application to Monitor, Model and Promote Wellbeing
Lane, N., Mohammod, M., Lin, M., Yang, X., Lu, H., Ali, S., Doryab, A., Berke, E., Choudhury, T., & Campbell, A. (2011) · Proceedings of the 5th International ICST Conference on Pervasive Computing Technologies for Healthcare · doi:10.4108/icst.pervasivehealth.2011.246161 · Cited by 409
Classification Accuracies of Physical Activities Using Smartphone Motion Sensors
Wu, W., Dasgupta, S., Ramirez, E. E., Peterson, C., & Norman, G. J. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.2208 · Cited by 316
Human Activity Recognition Using Inertial/Magnetic Sensor Units
Altun, K., & Barshan, B. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-14715-9_5 · Cited by 279
Mercury: a wearable sensor network platform for high-fidelity motion analysis
Lorincz, K., Chen, B.-R., Challen, G. W., Chowdhury, A. R., Patel, S., Bonato, P., & Welsh, M. (2009) · Proceedings of the 7th ACM Conference on Embedded Networked Sensor Systems · doi:10.1145/1644038.1644057 · Cited by 265
Sun, L., Zhang, D., Li, B., Guo, B., & Li, S. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-16355-5_42 · Cited by 251
A Review and Taxonomy of Activity Recognition on Mobile Phones
Incel, O. D., Kose, M., & Ersoy, C. (2013) · BioNanoScience · doi:10.1007/s12668-013-0088-3 · Cited by 234
Activity recognition using smartphone sensors
Anjum, A., & Ilyas, M. U. (2013) · 2013 IEEE 10th Consumer Communications and Networking Conference (CCNC) · doi:10.1109/ccnc.2013.6488584 · Cited by 233
Motion Mode Recognition and Step Detection Algorithms for Mobile Phone Users
Susi, M., Renaudin, V., & Lachapelle, G. (2013) · Sensors · doi:10.3390/s130201539 · Cited by 231
Towards Physical Activity Recognition Using Smartphone Sensors
Shoaib, M., Scholten, H., & Havinga, P. J. M. (2013) · 2013 IEEE 10th International Conference on Ubiquitous Intelligence and Computing and 2013 IEEE 10th International Conference on Autonomic and Trusted Computing · doi:10.1109/uic-atc.2013.43 · Cited by 228
Self-citationFall Detection and Activity Recognition with Machine Learning
Luštrek, M., & Kaluža, B. (2009) · Informatica · Cited by 188
Activity logging using lightweight classification techniques in mobile devices
Martín, H., Bernardos, A. M., Iglesias, J., & Casar, J. R. (2013) · Personal and Ubiquitous Computing · doi:10.1007/s00779-012-0515-4 · Cited by 180
Dealing with sensor displacement in motion-based onbody activity recognition systems
Kunze, K., & Lukowicz, P. (2008) · Proceedings of the 10th international conference on Ubiquitous computing · doi:10.1145/1409635.1409639 · Cited by 161
Classification of Sporting Activities Using Smartphone Accelerometers
Mitchell, E., Monaghan, D. S., & O'Connor, N. E. (2013) · Sensors · doi:10.3390/s130405317 · Cited by 159
Stair climbing detection during daily physical activity using a miniature gyroscope
Coley, B., Najafi, B., Paraschiv-Ionescu, A., & Aminian, K. (2004) · Gait & Posture · doi:10.1016/j.gaitpost.2004.08.008 · Cited by 131
User, device and orientation independent human activity recognition on mobile phones
Ustev, Y. E., İncel, Ö. D., & Ersoy, C. (2013) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/2494091.2496039 · Cited by 125
By train or by car? Detecting the user's motion type through smartphone sensors data
Bedogni, L., Felice, M. D., & Bononi, L. (2012) · IFIP Wireless Days · doi:10.1109/wd.2012.6402818 · Cited by 102
A Study of Mobile Sensing Using Smartphones
Liu, M. (2013) · International Journal of Distributed Sensor Networks · doi:10.1155/2013/272916 · Cited by 85
Pärkkä, J., Ermes, M., Antila, K., van Gils, M., Mänttäri, A., & Nieminen, H. (2007) · Conference proceedings · doi:10.1109/iembs.2007.4352588 · Cited by 74
Ready-to-use activity recognition for smartphones
Siirtola, P., & Röning, J. (2013) · IEEE Symposium on Computational Intelligence and Data Mining (CIDM) · doi:10.1109/cidm.2013.6597218 · Cited by 71
MobiCon: a mobile context-monitoring platform
Lee, Y., Iyengar, S. S., Min, C., Ju, Y., Kang, S., Park, T., Lee, J., Rhee, Y., & Song, J. (2012) · Communications of the ACM · doi:10.1145/2093548.2093567 · Cited by 71
Ambient Assisted Living and Home Care
Bravo, J., RodrÃguez, M., & Hervás, R. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-35395-6 · Cited by 55
Continuous Functional Activity Monitoring Based on Wearable Tri-axial Accelerometer and Gyroscope
Zhang, Y., Sapir, I., Markovic, S., WAGENAAR, R. C., & Little, T. D. C. (2011) · International Conference on Pervasive Computing Technologies for Healthcare · doi:10.4108/icst.pervasivehealth.2011.245966 · Cited by 53
Towards Recognizing Tai Chi - An Initial Experiment Using Wearable Sensors
Kunze, K. S., Barry, M. P., Heinz, E. A., Lukowicz, P., Majoe, D., & Gutknecht, J. (2006) · Cited by 53
(2010) · Lecture notes in computer science · doi:10.1007/978-3-642-14715-9 · Cited by 51
Can magnetic field sensors replace gyroscopes in wearable sensing applications?
Kunze, K. S., Bahle, G., Lukowicz, P., & Partridge, K. (2010) · International Symposium on Wearable Computers · doi:10.1109/iswc.2010.5665859 · Cited by 43
Energy consumption of the sensors of Smartphones
Koenig, I., Memon, A. Q., & David, K. (2013) · International Symposium on Wireless Communication Systems · Cited by 33
OpenSesame: Unlocking smart phone through handshaking biometrics
Guo, Y., Yang, L., Ding, X., Han, J., & Liu, Y. (2013) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infcom.2013.6566796 · Cited by 32
Practical automated activity recognition using standard smartphones
Stewart, V., Ferguson, S., Peng, J.-X., & Rafferty, K. (2012) · IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops) · doi:10.1109/percomw.2012.6197485 · Cited by 14
Ubiquitous Computing and Ambient Intelligence. Context-Awareness and Context-Driven Interaction
Urzaiz, G., Ochoa, S. F., Bravo, J., Chen, L., & Oliveira, J. (2013) · Lecture notes in computer science · doi:10.1007/978-3-319-03176-7 · Cited by 13
Continuous Functional Activity Monitoring Based on Wearable Tri-axial Accelerometer and Gyroscope
Zhang, Y., Sapir, I., Markovic, S., WAGENAAR, R. C., & Little, T. D. C. (2012) · Cited by 10
Human movement activity classification approaches that use wearable sensors and mobile devices
Kaghyan, S., Sarukhanyan, H. G., & Akopian, D. (2013) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.2007868 · Cited by 8
Measuring Walking and Running Cadence Using Magnetometers
Abdulla, U. A., Taylor, K., Barlow, M., & Naqshbandi, K. Z. (2013) · IEEE International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom) · doi:10.1109/trustcom.2013.176 · Cited by 8
HARF: A Hierarchical Activity Recognition Framework Using Smartphone Sensors
Han, M., Bang, J., Nugent, C., McClean, S. I., & Lee, S. (2013) · Lecture notes in computer science · doi:10.1007/978-3-319-03176-7_21 · Cited by 5
Human Hand Movement Analysis Using Principle Component Analysis Classifier
Yong, C. Y., Sudirman, R., Mahmood, N. H., & Chew, K. M. (2013) · Applied Mechanics and Materials · doi:10.4028/www.scientific.net/amm.284-287.3126 · Cited by 5
Research works printed but not linked: 1
- Bao, L., and Intille, S.S. (2004). Pervasive Computing, Springer.
Cited by
Deep learning for cyber security intrusion detection: Approaches, datasets, and comparative study
Ferrag, M. A., Maglaras, L., Moschoyiannis, S., & Janicke, H. (2020) · Journal of Information Security and Applications · doi:10.1016/j.jisa.2019.102419 · Cited by 1,130
Human activity recognition with smartphone sensors using deep learning neural networks
Ronao, C. A., & Cho, S.-B. (2016) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.04.032 · Cited by 1,215
Nweke, H. F., Teh, Y. W., Al-garadi, M. A., & Alo, U. R. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.03.056 · Cited by 930
Deep Learning for Sensor-based Human Activity Recognition
Chen, K., Zhang, D., Yao, L., Guo, B., Yu, Z., & Liu, Y. (2022) · ACM Computing Surveys · doi:10.1145/3447744 · Cited by 690
Human Activity Recognition Using Wearable Sensors by Deep Convolutional Neural Networks
Jiang, W., & Yin, Z. (2015) · Proceedings of the 23rd ACM international conference on Multimedia · doi:10.1145/2733373.2806333 · Cited by 676
“Especially, activity recognition based on wearable sensors is directly related to our daily lives such as healthcare and workout monitoring [3][4].”
Background
Metadata
- Authors
- Shoaib, M., Bosch, S., Incel, O., Scholten, H., & Havinga, P.
- Affiliations
- University of Twente (NL)
- Department of Computer Engineering, Galatasaray University, Ortakoy, Istanbul 34349, Turkey
- Corresponding author
- Shoaib, Muhammad
- Venue
- Sensors
- Publisher
- MDPI AG
- Published
- 2014-06-10
- Volume
- 14
- Issue
- 6
- Pages
- 10146-10176
- ISSN
- 1424-8220 (ISSN-L)
- PMC
- PMC4118351
- OpenAlex
- W2129793335
- Cited by
- 552
- References
- 45
- Citations by year
- 2026: 25 · 2025: 34 · 2024: 57 · 2023: 53 · 2022: 53 · 2021: 66 · 2020: 54 · 2019: 58 · 2018: 50 · 2017: 44 · 2016: 34 · 2015: 21 · 2014: 2
- FWCI
- 29.97
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Sensors (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- University of Twente Research Information (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- University of Twente Research Information (submittedVersion, other-oa)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Physical Activity and Health
- Social Sciences › Transportation › Human Mobility and Location-Based Analysis
- Keywords
- physical activity recognition, smartphone motion sensors, accelerometer, gyroscope, magnetometer, sensor fusion, sensor combination, posture, personalized classification
- MeSH terms
- Activities of Daily Living, Adult, Algorithms, Humans, Male, Monitoring, Physiologic, Movement, Pattern Recognition, Automated, Models, Statistical, Walking, Cell Phone, Accelerometry
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.