Deriving Effective Human Activity Recognition Systems through Objective Task Complexity Assessment
The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Abstract
Research in sensor based human activity recognition (HAR) has been a core concern of the mobile and ubiquitous computing community. Sophisticated systems have been developed with the main view on applications of HAR methods in research settings. This work addresses a related yet practically different problem that mainly focuses on users of HAR technology. We acknowledge that practitioners from outside the core HAR research community are motivated to employ HAR methods for practical deployments. Even though standard processing approaches exist, arguably, often times substantial modifications are necessary to derive effective analysis systems. It is not always clear a-priori how challenging a HAR task actually is and what dimensions of an analysis pipeline are crucial for successful automated assessments. In practice this can lead to disappointing results or disproportionate efforts that have to be invested into the optimization of data analysis pipelines, that were supposed to work "out of the box". We present a framework for the objective complexity assessment of HAR tasks that directly supports practitioners' decision making of whether and how to employ HAR for their deployments. We map a HAR task onto a vectorial representation that allows us to analyse the inherent challenges of the task and to draw conclusions through similarity analysis with regards to existing tasks. We validate our complexity assessment framework on 23 HAR datasets and derive a data-driven categorization of human activity recognition. We demonstrate how our objective analysis can be used to inform the deployment of HAR systems in practical scenarios.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For example, in healthcare, collecting large amounts of data may be difficult, due to challenges with participant recruitment.This is compounded by the necessity to enlist healthcare professionals for annotation, which may incur high costs [31].”
From Assessing the State of Self-Supervised Human Activity Recognition Using Wearables (2022) · cites this paper as [31]
Citations
Cites
UCI Machine Learning Repository
Asuncion, A. (2007) · Medical Entomology and Zoology · Cited by 25,410
Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition
Ordóñez, F., & Roggen, D. (2016) · Sensors · doi:10.3390/s16010115 · Cited by 2,761
A tutorial on human activity recognition using body-worn inertial sensors
Bulling, A., Blanke, U., & Schiele, B. (2014) · ACM Computing Surveys · doi:10.1145/2499621 · Cited by 1,668 · cited 8×
“The core of our automated guidance is–indirectly–based on the state-of-the-art in human activity recognition, the standard activity recognition chain (ARC) [6], which is used for pre-processing the pilot data.”
BackgroundMethodInfluentialIntroducing a New Benchmarked Dataset for Activity Monitoring
Reiss, A., & Stricker, D. (2012) · 2012 16th International Symposium on Wearable Computers · doi:10.1109/iswc.2012.13 · Cited by 1,456 · cited 17×
“In fact, the reference analysis systems for SimADL differ substantially from the ARC paradigm.”
BackgroundInfluentialConvolutional Neural Networks for Human Activity Recognition using Mobile Sensors
Zeng, M., Nguyen, L. T., Yu, B., Mengshoel, O. J., Zhu, J., Wu, P., & Zhang, J. (2014) · Proceedings of the 6th International Conference on Mobile Computing, Applications and Services · doi:10.4108/icst.mobicase.2014.257786 · Cited by 876
Collecting complex activity datasets in highly rich networked sensor environments
Roggen, D., Calatroni, A., Rossi, M., Holleczek, T., Forster, K., Troster, G., Lukowicz, P., Bannach, D., Pirkl, G., Ferscha, A., et al. (2010) · 2010 Seventh International Conference on Networked Sensing Systems (INSS) · doi:10.1109/inss.2010.5573462 · Cited by 788
Complexity measures of supervised classification problems
Ho, T. K., & Basu, M. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.990132 · Cited by 734 · cited 3×
“The inherent challenges of a HAR task are determined through three main categories of complexity measures [17]:”
BackgroundMethodInfluentialStisen, A., Blunck, H., Bhattacharya, S., Prentow, T. S., Kjærgaard, M. B., Dey, A., Sonne, T., & Jensen, M. M. (2015) · Proceedings of the 13th ACM Conference on Embedded Networked Sensor Systems · doi:10.1145/2809695.2809718 · Cited by 714 · cited 1×
“1 Skoda car manufacturing related movements body-worn IMU; gestures [35] 2 PAMAP2 physical activity monitoring body-worn IMU; ADL [31] 3 MHealth body-motion (and vitals) monitoring body-worn IMU; ADL [4] 4 USC-HAD low-level activities in health-care phone-based IMU; ADL [44] 5 Opportunity cleanup and breakfast activit…”
Wearable Assistant for Parkinson’s Disease Patients With the Freezing of Gait Symptom
Bachlin, M., Plotnik, M., Roggen, D., Maidan, I., Hausdorff, J. M., Giladi, N., & Troster, G. (2010) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2009.2036165 · Cited by 693 · cited 1×
“1 Skoda car manufacturing related movements body-worn IMU; gestures [35] 2 PAMAP2 physical activity monitoring body-worn IMU; ADL [31] 3 MHealth body-motion (and vitals) monitoring body-worn IMU; ADL [4] 4 USC-HAD low-level activities in health-care phone-based IMU; ADL [44] 5 Opportunity cleanup and breakfast activit…”
USC-HAD: a daily activity dataset for ubiquitous activity recognition using wearable sensors
Zhang, M., & Sawchuk, A. A. (2012) · Proceedings of the 2012 ACM Conference on Ubiquitous Computing · doi:10.1145/2370216.2370438 · Cited by 554
Research works printed but not linked: 8
- Bulling Andreas, 2014, January
- Fisher James M., 2016, Body-worn sensors in parkinson's disease: Evaluating their acceptability to patients. Telemedicine and e-Health, 22(1):63--69
- Godfrey Alan, 2011, P Van De Ven, and J Nelson. Activity classification using a single chest mounted tri-axial accelerometer. Medical engineering & physics, 33(9):1127--1135
- 10.5555/3060832.3060835 · doi:10.5555/3060832.3060835
- 10.5555/2886521.2886562 · doi:10.5555/2886521.2886562
- Saponas T Scott, 2011, Pervasive 2011 Workshop: Frontiers in Activity Recognition using Pervasive Sensing (IWFAR)
- Wijekoon Anjana, 2019, Mex: Multi-modal exercises dataset for human activity recognition. arXiv preprint [Web Link]
- Wold Svante, 1987, Principal component analysis. Chemometrics and intelligent laboratory systems, 2(1-3):37--52
Cited by
Assessing the State of Self-Supervised Human Activity Recognition Using Wearables
Haresamudram, H., Essa, I., & Plötz, T. (2022) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3550299 · Cited by 107
“This is compounded by the necessity to enlist healthcare professionals for annotation, which may incur high costs [31].”
BackgroundSelf-citationBootstrapping Human Activity Recognition Systems for Smart Homes from Scratch
Hiremath, S. K., Nishimura, Y., Chernova, S., & Plötz, T. (2022) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3550294 · Cited by 48
“This procedure helps in reducing the burden on obtaining annotations for all data points and yet reaches acceptable performance scores [26].”
BackgroundSelf-citationThukral, M., Dhekane, S. G., Hiremath, S. K., Haresamudram, H., & Plötz, T. (2025) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3712278 · Cited by 52
Self-citationThukral, M., Dhekane, S. G., Hiremath, S. K., Haresamudram, H., & Ploetz, T. (2024) · arXiv · doi:10.48550/arxiv.2405.12368 · Cited by 21
Self-citationThe Lifespan of Human Activity Recognition Systems for Smart Homes
Hiremath, S. K., & Plötz, T. (2023) · Sensors · doi:10.3390/s23187729 · Cited by 27
“A significant challenge in obtaining a large number of such annotations is that it is cumbersome and requires time and effort [95].”
BackgroundSelf-citationIf only we had more data!: Sensor-Based Human Activity Recognition in Challenging Scenarios
Plötz, T. (2023) · 2023 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events (PerCom Workshops) · doi:10.1109/percomworkshops56833.2023.10150267 · Cited by 16
“…the feature extraction and the classification blocks have to undergo careful optimization for each application case, which requires close collaboration between machine learning and domain experts, and substantial efforts and resources – an approach that often does not scale nor generalize well [22].”
BackgroundSelf-citationEnhancing human activity recognition using features reduction in IoT edge and Azure cloud
Wazwaz, A. A., Amin, K., Semary, N. A., & Ghanem, T. F. (2023) · Decision Analytics Journal · doi:10.1016/j.dajour.2023.100282 · Cited by 12
Predicting Performance Improvement of Human Activity Recognition Model by Additional Data Collection
Tanigaki, K., Teoh, T. C., Yoshimura, N., Maekawa, T., & Hara, T. (2022) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3550319 · Cited by 12
“For example, a method that estimates the ML setting (handcrafted features and an ML model to use) suitable for a given HAR task was studied [11].”
MethodAnwendung von Human Activity Recognition im Unternehmenskontext – Ein Konzept für die Zukunft?
Rimbeck, M., Wähling, J., & Stumpf-Wollersheim, J. (2022) · Forum Dienstleistungsmanagement · doi:10.1007/978-3-658-37344-3_15 · Cited by 2
Hiremath, S. K., & Plötz, T. (2024) · International Conference on Activity and Behavior Computing (ABC) · doi:10.1109/abc61795.2024.10651685 · Cited by 7
“To reduce such a reliance on annotation as a resource [39], a semi-supervised learning paradigm–Active Learning–uses a human in the loop to obtain annotations [40].”
MethodSelf-citationStepping Into the Next Decade of Ubiquitous and Pervasive Computing: UbiComp and ISWC 2021
Majethia, R., Ghosh, S., Nolasco, H. R., Shahid, F., Viswanath, V., Shehu, I. S., & Zhao, Y. (2022) · IEEE Pervasive Computing · doi:10.1109/mprv.2022.3160063 · Cited by 1
Video and Image Complexity in Human Action Recognition
Burgos-Madrigal, A., & Altamirano-Robles, L. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-89691-1_34
Metadata
- Authors
- Hiremath, S. K., & Plötz, T.
- Affiliations
- Georgia Institute of Technology (US)
- ORCID
- Hiremath, Shruthi K.
- Venue
- Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Published
- 2020-12-17
- Volume
- 4
- Issue
- 4
- Pages
- 1-24
- ISSN
- 2474-9567 (ISSN-L)
- OpenAlex
- W3118018543
- Cited by
- 11
- References
- 37
- Citations by year
- 2025: 1 · 2024: 1 · 2023: 3 · 2022: 5 · 2021: 1
- FWCI
- 0.88
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Social Sciences › Transportation › Human Mobility and Location-Based Analysis
- Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
- Keywords
- human activity recognition, sensor-based activity recognition, similarity analysis, wearable sensors, ubiquitous computing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.