Sensor-Based Activity Recognition
The DOI matches its Crossref record; 146 of the 146 references it cites were found in a registry or an index.
Abstract
Research on sensor-based activity recognition has, recently, made significant progress and is attracting growing attention in a number of disciplines and application domains. However, there is a lack of high-level overview on this topic that can inform related communities of the research state of the art. In this paper, we present a comprehensive survey to examine the development and current status of various aspects of sensor-based activity recognition. We first discuss the general rationale and distinctions of vision-based and sensor-based activity recognition. Then, we review the major approaches and methods associated with sensor-based activity monitoring, modeling, and recognition from which strengths and weaknesses of those approaches are highlighted. We make a primary distinction in this paper between data-driven and knowledge-driven approaches, and use this distinction to structure our survey. We also discuss some promising directions for future research.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The comparative studies using our evaluation framework are novel, because such an analysis has in particular been missing in most survey papers of sensor-based HAR [1,2,3].”
From Comparison of Feature Learning Methods for Human Activity Recognition Using Wearable Sensors (2018) · cites this paper as [1]
In the citing paper
“Both of the aforementioned surveys however only make a list of different methods, without any comparative study being carried out in a reference evaluation framework.”
From Comparison of Feature Learning Methods for Human Activity Recognition Using Wearable Sensors (2018) · cites this paper as [1]
In the citing paper
“By reconstructing the original input with only a partial view, MAE effectively learns to capture and encode crucial information.”
From Comparing self-supervised learning techniques for wearable human activity recognition (2025) · cites this paper as [9]
In the citing paper
“Moreover, more recent approaches proposed in the other domains, like the Masked AutoEncoder (MAE) [9] and data2vec [10], represent promising directions beyond contrastive learning and, at the same time, allows higher recognition rates.”
From Comparing self-supervised learning techniques for wearable human activity recognition (2025) · cites this paper as [9]
In the citing paper
“However, this survey does not take into account the latest advancements in the field of vision and NLP, such as MAE [9] and data2vec [10], which are presented later in this article.”
From Comparing self-supervised learning techniques for wearable human activity recognition (2025) · cites this paper as [9]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The Computer for the 21st Century
Weiser, M. (1991) · Scientific American · doi:10.1038/scientificamerican0991-94 · Cited by 10,017
Yilmaz, A., Javed, O., & Shah, M. (2006) · ACM Computing Surveys · doi:10.1145/1177352.1177355 · Cited by 4,792
Activity Recognition from User-Annotated Acceleration Data
Bao, L., & Intille, S. S. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24646-6_1 · Cited by 3,147
A survey of advances in vision-based human motion capture and analysis
Moeslund, T. B., Hilton, A., & Krüger, V. (2006) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2006.08.002 · Cited by 2,541
A Survey on Wearable Sensor-Based Systems for Health Monitoring and Prognosis
Pantelopoulos, A., & Bourbakis, N. G. (2010) · IEEE Transactions on Systems Man and Cybernetics Part C (Applications and Reviews) · doi:10.1109/tsmcc.2009.2032660 · Cited by 2,296
A survey on vision-based human action recognition
Poppe, R. (2010) · Image and Vision Computing · doi:10.1016/j.imavis.2009.11.014 · Cited by 2,242
The Computer for the Twenty-First Century
Weiser, M. (1991) · Scientific American · Cited by 2,113
Human activity analysis: A review
Aggarwal, J. K., & Ryoo, M. S. (2011) · ACM Computing Surveys · doi:10.1145/1922649.1922653 · Cited by 2,056
Advances in Neural Information Processing Systems 18
Murray, I., Mackay, D., Zoubin Ghahramani, A., & Skilling, J. (2006) · Cited by 1,927
The Visual Analysis of Human Movement: A Survey
Gavrila, D. M. (1999) · Computer Vision and Image Understanding · doi:10.1006/cviu.1998.0716 · Cited by 1,782
Research works printed but not linked: 15
- International symposium on wearable computers
- 2011, International workshop on frontiers in activity recognition using pervasive sensing
- 2011, International workshop on human activity understanding from 3D data
- 2011, International workshop on situation, activity and goal awareness
- 2011, Goal, activity and plan recognition
- 2011, Activity context representation: techniques and languages
- Workshop on human behavior understanding: inducing behavioral change
- 2011, Workshop on robust machine learning techniques for human activity recognition
- 10.1109/TSMCC.2009.2032660 · DOI · Paper page
- Madan, Towards socially-intelligent wearable networks
- Michael, 2007, Ontology-centred design of an ambient middleware for assisted living: The case of SOPRANO
- Wu, 2007, Joint recognition of multiple concurrent activities using factorial conditional random fields
- Choudhury, 2005, Modeling conversational dynamics as a mixed memory Markov process, 281
- Sutton, 2007, Dynamic conditional random fields, J. Mach. Learning Res., 8, 693
- Chen, 2011, Situation, activity and goal awareness (SAGAware2011), Proc. SAGAware Workshop
Cited by
Human activity recognition with smartphone sensors using deep learning neural networks
Ronao, C. A., & Cho, S.-B. (2016) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.04.032 · Cited by 1,215
LSTM-CNN Architecture for Human Activity Recognition
Xia, K., Huang, J., & Wang, H. (2020) · IEEE Access · doi:10.1109/access.2020.2982225 · Cited by 851
Transition-Aware Human Activity Recognition Using Smartphones
Reyes-Ortiz, J.-L., Oneto, L., Samà, A., Parra, X., & Anguita, D. (2016) · Neurocomputing · doi:10.1016/j.neucom.2015.07.085 · Cited by 740
Window Size Impact in Human Activity Recognition
Banos, O., Galvez, J.-M., Damas, M., Pomares, H., & Rojas, I. (2014) · Sensors · doi:10.3390/s140406474 · Cited by 648
A Survey on Ambient Intelligence in Healthcare
Acampora, G., Cook, D. J., Rashidi, P., & Vasilakos, A. V. (2013) · Proceedings of the IEEE · doi:10.1109/jproc.2013.2262913 · Cited by 630
Self-citationSmart Cities: A Survey on Data Management, Security, and Enabling Technologies
Gharaibeh, A., Salahuddin, M. A., Hussini, S. J., Khreishah, A., Khalil, I., Guizani, M., & Al-Fuqaha, A. (2017) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2017.2736886 · Cited by 628
Ensembles of Deep LSTM Learners for Activity Recognition using Wearables
Guan, Y., & Plötz, T. (2017) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3090076 · Cited by 511
“We argue that HAR can now safely be considered common knowledge and thus refer to seminal papers and tutorials such as [Bulling et al. 2014; Chen et al. 2012; Avci et al. 2010].”
BackgroundFrom action to activity: Sensor-based activity recognition
Liu, Y., Nie, L., Liu, L., & Rosenblum, D. S. (2016) · Neurocomputing · doi:10.1016/j.neucom.2015.08.096 · Cited by 486
A Survey of Online Activity Recognition Using Mobile Phones
Shoaib, M., Bosch, S., Incel, O., Scholten, H., & Havinga, P. (2015) · Sensors · doi:10.3390/s150102059 · Cited by 489
A survey on wearable sensor modality centred human activity recognition in health care
Wang, Y., Cang, S., & Yu, H. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.04.057 · Cited by 409
A survey of depth and inertial sensor fusion for human action recognition
Chen, C., Jafari, R., & Kehtarnavaz, N. (2017) · Multimedia Tools and Applications · doi:10.1007/s11042-015-3177-1 · Cited by 356
“…there exist several survey papers for human action recognition using depth sensors alone (e.g., [2, 19, 31, 76]) or inertial sensors alone (e.g., [5, 11, 30, 40]), there exists no survey article on the simultaneous utilization of these two differing modality sensors for human action recognition.”
BackgroundWearable IoT enabled real-time health monitoring system
Wan, J., A. A. H. Al-awlaqi, M., Li, M., O’Grady, M., Gu, X., Wang, J., & Cao, N. (2018) · EURASIP Journal on Wireless Communications and Networking · doi:10.1186/s13638-018-1308-x · Cited by 333
Smart cities survey: Technologies, application domains and challenges for the cities of the future
Sánchez-Corcuera, R., Nuñez-Marcos, A., Sesma-Solance, J., Bilbao-Jayo, A., Mulero, R., Zulaika, U., Azkune, G., & Almeida, A. (2019) · International Journal of Distributed Sensor Networks · doi:10.1177/1550147719853984 · Cited by 331
A Comparative Study on Human Activity Recognition Using Inertial Sensors in a Smartphone
Wang, A., Chen, G., Yang, J., Zhao, S., & Chang, C.-Y. (2016) · IEEE Sensors Journal · doi:10.1109/jsen.2016.2545708 · Cited by 324
Banos, O., Villalonga, C., Garcia, R., Saez, A., Damas, M., Holgado-Terriza, J. A., Lee, S., Pomares, H., & Rojas, I. (2015) · BioMedical Engineering OnLine · doi:10.1186/1475-925x-14-s2-s6 · Cited by 321
Comparison of Feature Learning Methods for Human Activity Recognition Using Wearable Sensors
Li, F., Shirahama, K., Nisar, M., Köping, L., & Grzegorzek, M. (2018) · Sensors · doi:10.3390/s18020679 · Cited by 302
Vision-Based Fall Detection with Convolutional Neural Networks
Núñez-Marcos, A., Azkune, G., & Arganda-Carreras, I. (2017) · Wireless Communications and Mobile Computing · doi:10.1155/2017/9474806 · Cited by 282
Smartphone-based construction workers' activity recognition and classification
Akhavian, R., & Behzadan, A. H. (2016) · Automation in Construction · doi:10.1016/j.autcon.2016.08.015 · Cited by 272
A Survey on Deep Learning for Human Activity Recognition
Gu, F., Chung, M.-H., Chignell, M., Valaee, S., Zhou, B., & Liu, X. (2022) · ACM Computing Surveys · doi:10.1145/3472290 · Cited by 272
Human Activity Recognition Using Inertial Sensors in a Smartphone: An Overview
Sousa Lima, W., Souto, E., El-Khatib, K., Jalali, R., & Gama, J. (2019) · Sensors · doi:10.3390/s19143213 · Cited by 256
The Internet of Things: A Review of Enabled Technologies and Future Challenges
Ud Din, I., Guizani, M., Hassan, S., Kim, B.-S., Khurram Khan, M., Atiquzzaman, M., & Ahmed, S. H. (2019) · IEEE Access · doi:10.1109/access.2018.2886601 · Cited by 254
A federated learning system with enhanced feature extraction for human activity recognition
Xiao, Z., Xu, X., Xing, H., Song, F., Wang, X., & Zhao, B. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.107338 · Cited by 251
A Comprehensive Analysis on Wearable Acceleration Sensors in Human Activity Recognition
Janidarmian, M., Roshan Fekr, A., Radecka, K., & Zilic, Z. (2017) · Sensors · doi:10.3390/s17030529 · Cited by 217
Uddin, M. Z., Hassan, M. M., Alsanad, A., & Savaglio, C. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.08.004 · Cited by 194
Panwar, M., Biswas, D., Bajaj, H., Jobges, M., Turk, R., Maharatna, K., & Acharyya, A. (2019) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2019.2899927 · Cited by 158
A Hybrid Deep Learning Model for Human Activity Recognition Using Multimodal Body Sensing Data
Gumaei, A., Hassan, M. M., Alelaiwi, A., & Alsalman, H. (2019) · IEEE Access · doi:10.1109/access.2019.2927134 · Cited by 157
Marcroft, C., Khan, A., Embleton, N. D., Trenell, M., & Plötz, T. (2015) · Frontiers in Neurology · doi:10.3389/fneur.2014.00284 · Cited by 146
Analyzing Activity Behavior and Movement in a Naturalistic Environment Using Smart Home Techniques
Cook, D. J., Schmitter-Edgecombe, M., & Dawadi, P. (2015) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2015.2461659 · Cited by 123
Self-citationHuman Activity Recognition Based on Motion Sensor Using U-Net
Zhang, Y., Zhang, Z., Zhang, Y., Bao, J., Zhang, Y., & Deng, H. (2019) · IEEE Access · doi:10.1109/access.2019.2920969 · Cited by 121
Federated Contrastive Learning With Feature-Based Distillation for Human Activity Recognition
Xiao, Z., & Tong, H. (2025) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2024.3510428 · Cited by 86
Gao, Y., Long, Y., Guan, Y., Basu, A., Baggaley, J., & Ploetz, T. (2019) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3314399 · Cited by 49
Domain Generalization for Activity Recognition via Adaptive Feature Fusion
Qin, X., Wang, J., Chen, Y., Lu, W., & Jiang, X. (2023) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3552434 · Cited by 55
Forecasting occurrences of activities
Minor, B., & Cook, D. J. (2017) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2016.09.010 · Cited by 45
“Our group and others have explored a large number of approaches to supervised activity recognition [17-31].”
BackgroundSelf-citationAccelerometer-Based Human Activity Recognition in Smartphones for Healthcare Services
Torres-Huitzil, C., & Alvarez-Landero, A. (2015) · Springer Series in Bio-/Neuroinformatics · doi:10.1007/978-3-319-12817-7_7 · Cited by 45
Activity-Aware Energy-Efficient Automation of Smart Buildings
Thomas, B., & Cook, D. (2016) · Energies · doi:10.3390/en9080624 · Cited by 42
Self-citationZhou, F., Wen, G., Ma, Y., Geng, H., Huang, R., Pei, L., Yu, W., Chu, L., & Qiu, R. (2022) · Applied Sciences · doi:10.3390/app12115336 · Cited by 41
“It has been widely used in various applications, such as natural language processing [26], visual image classification [32], object detection [107], and activity recognition [108–112].”
MethodPlÖtz, T. (2022) · ACM Computing Surveys · doi:10.1145/3459666 · Cited by 34
Longitudinal Effects of Teacher Use of a Computer Data System on Student Achievement
Wayman, J. C., Shaw, S., & Cho, V. (2017) · AERA Open · doi:10.1177/2332858416685534 · Cited by 30
On the Generality of Codebook Approach for Sensor-Based Human Activity Recognition
Shirahama, K., & Grzegorzek, M. (2017) · Electronics · doi:10.3390/electronics6020044 · Cited by 29
Nakamura, Y., Matsuda, Y., Arakawa, Y., & Yasumoto, K. (2019) · Sensors · doi:10.3390/s19204600 · Cited by 24
Automated activity-aware prompting for activity initiation
Holder, L. B., & Cook, D. J. (2013) · Gerontechnology · doi:10.4017/gt.2013.11.4.005.00 · Cited by 24
Self-citationIntelligent Decision Support System for Dementia Care Through Smart Home
Gayathri, K. S., & Easwarakumar, K. S. (2016) · Procedia Computer Science · doi:10.1016/j.procs.2016.07.281 · Cited by 22
If only we had more data!: Sensor-Based Human Activity Recognition in Challenging Scenarios
Plötz, T. (2023) · 2023 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events (PerCom Workshops) · doi:10.1109/percomworkshops56833.2023.10150267 · Cited by 16
“Traditionally, a pipeline-based approach has been the method of choice for ML-based activity recognition [8], [9] consisting of dedicated preprocessing, segmentation, feature extraction, and classification steps.”
BackgroundMethodKumar, P., & Chauhan, S. (2021) · CCF Transactions on Pervasive Computing and Interaction · doi:10.1007/s42486-021-00063-5 · Cited by 13
RetractedComparing self-supervised learning techniques for wearable human activity recognition
Ek, S., Presotto, R., Civitarese, G., Portet, F., Lalanda, P., & Bettini, C. (2025) · CCF Transactions on Pervasive Computing and Interaction · doi:10.1007/s42486-024-00182-9 · Cited by 15
“Human activity recognition (HAR) aims to recognize human actions automatically using sensor data (Chen et al. 2012).”
Towards skill recognition using eye-hand coordination in industrial production
Haslgrübler, M., Gollan, B., Thomay, C., Ferscha, A., & Heftberger, J. (2019) · Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments · doi:10.1145/3316782.3316784 · Cited by 9
Guo, P., & Nakayama, M. (2025) · Sensors · doi:10.3390/s25226988 · Cited by 6
ContextGPT: Infusing LLMs Knowledge into Neuro-Symbolic Activity Recognition Models
Arrotta, L., Bettini, C., Civitarese, G., & Fiori, M. (2024) · arXiv · doi:10.48550/arxiv.2403.06586 · Cited by 3
“Sensor-based Human Activity Recognition (HAR) is a widely studied research area, and it involves using unobtrusive sensors to identify the activities performed by humans in their daily life [5].”
Metadata
- Authors
- Chen, L., Hoey, J., Nugent, C. D., Cook, D. J., & Yu, Z.
- Affiliations
- University of Ulster (GB)
- University of Waterloo (CA)
- Washington State University (US)
- Northwestern Polytechnical University (CN)
- Venue
- IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews)
- Published
- 2012-11
- Volume
- 42
- Issue
- 6
- Pages
- 790-808
- ISSN
- 1094-6977 (ISSN-L)
- 1558-2442
- OpenAlex
- W2059732136
- Cited by
- 1,074
- References
- 146
- Citations by year
- 2026: 28 · 2025: 42 · 2024: 58 · 2023: 64 · 2022: 85 · 2021: 105 · 2020: 100 · 2019: 125 · 2018: 123 · 2017: 105 · 2016: 90 · 2015: 80 · 2014: 45 · 2013: 21 · 2012: 2
- FWCI
- 48.57
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Systems Man and Cybernetics Part C (Applications and Reviews) (publishedVersion)
- DMU Open Research Archive (De Montfort University) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Physical Activity and Health
- Keywords
- sensor-based activity recognition, activity monitoring, activity modeling, data-driven methods, wearable sensors, human activity recognition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.