Deriving Effective Human Activity Recognition Systems through Objective Task Complexity Assessment
The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Abstract
Research in sensor based human activity recognition (HAR) has been a core concern of the mobile and ubiquitous computing community. Sophisticated systems have been developed with the main view on applications of HAR methods in research settings. This work addresses a related yet practically different problem that mainly focuses on users of HAR technology. We acknowledge that practitioners from outside the core HAR research community are motivated to employ HAR methods for practical deployments. Even though standard processing approaches exist, arguably, often times substantial modifications are necessary to derive effective analysis systems. It is not always clear a-priori how challenging a HAR task actually is and what dimensions of an analysis pipeline are crucial for successful automated assessments. In practice this can lead to disappointing results or disproportionate efforts that have to be invested into the optimization of data analysis pipelines, that were supposed to work "out of the box". We present a framework for the objective complexity assessment of HAR tasks that directly supports practitioners' decision making of whether and how to employ HAR for their deployments. We map a HAR task onto a vectorial representation that allows us to analyse the inherent challenges of the task and to draw conclusions through similarity analysis with regards to existing tasks. We validate our complexity assessment framework on 23 HAR datasets and derive a data-driven categorization of human activity recognition. We demonstrate how our objective analysis can be used to inform the deployment of HAR systems in practical scenarios.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For example, in healthcare, collecting large amounts of data may be difficult, due to challenges with participant recruitment.This is compounded by the necessity to enlist healthcare professionals for annotation, which may incur high costs [31].”
From Assessing the State of Self-Supervised Human Activity Recognition Using Wearables (2022) · cites this paper as [31]
Citations
Cites
UCI Machine Learning Repository
Asuncion, A. (2007) · Medical Entomology and Zoology · Cited by 25,410
Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition
Ordóñez, F., & Roggen, D. (2016) · Sensors · doi:10.3390/s16010115 · Cited by 2,761
A tutorial on human activity recognition using body-worn inertial sensors
Bulling, A., Blanke, U., & Schiele, B. (2014) · ACM Computing Surveys · doi:10.1145/2499621 · Cited by 1,668 · cited 8×
“The core of our automated guidance is–indirectly–based on the state-of-the-art in human activity recognition, the standard activity recognition chain (ARC) [6], which is used for pre-processing the pilot data.”
BackgroundMethodInfluentialIntroducing a New Benchmarked Dataset for Activity Monitoring
Reiss, A., & Stricker, D. (2012) · 2012 16th International Symposium on Wearable Computers · doi:10.1109/iswc.2012.13 · Cited by 1,456 · cited 17×
“In fact, the reference analysis systems for SimADL differ substantially from the ARC paradigm.”
BackgroundInfluentialConvolutional Neural Networks for Human Activity Recognition using Mobile Sensors
Zeng, M., Nguyen, L. T., Yu, B., Mengshoel, O. J., Zhu, J., Wu, P., & Zhang, J. (2014) · Proceedings of the 6th International Conference on Mobile Computing, Applications and Services · doi:10.4108/icst.mobicase.2014.257786 · Cited by 876
Collecting complex activity datasets in highly rich networked sensor environments
Roggen, D., Calatroni, A., Rossi, M., Holleczek, T., Forster, K., Troster, G., Lukowicz, P., Bannach, D., Pirkl, G., Ferscha, A., et al. (2010) · 2010 Seventh International Conference on Networked Sensing Systems (INSS) · doi:10.1109/inss.2010.5573462 · Cited by 788
Complexity measures of supervised classification problems
Ho, T. K., & Basu, M. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.990132 · Cited by 734 · cited 3×
“The inherent challenges of a HAR task are determined through three main categories of complexity measures [17]:”
BackgroundMethodInfluentialStisen, A., Blunck, H., Bhattacharya, S., Prentow, T. S., Kjærgaard, M. B., Dey, A., Sonne, T., & Jensen, M. M. (2015) · Proceedings of the 13th ACM Conference on Embedded Networked Sensor Systems · doi:10.1145/2809695.2809718 · Cited by 714 · cited 1×
“1 Skoda car manufacturing related movements body-worn IMU; gestures [35] 2 PAMAP2 physical activity monitoring body-worn IMU; ADL [31] 3 MHealth body-motion (and vitals) monitoring body-worn IMU; ADL [4] 4 USC-HAD low-level activities in health-care phone-based IMU; ADL [44] 5 Opportunity cleanup and breakfast activit…”
Wearable Assistant for Parkinson’s Disease Patients With the Freezing of Gait Symptom
Bachlin, M., Plotnik, M., Roggen, D., Maidan, I., Hausdorff, J. M., Giladi, N., & Troster, G. (2010) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2009.2036165 · Cited by 693 · cited 1×
“1 Skoda car manufacturing related movements body-worn IMU; gestures [35] 2 PAMAP2 physical activity monitoring body-worn IMU; ADL [31] 3 MHealth body-motion (and vitals) monitoring body-worn IMU; ADL [4] 4 USC-HAD low-level activities in health-care phone-based IMU; ADL [44] 5 Opportunity cleanup and breakfast activit…”
USC-HAD: a daily activity dataset for ubiquitous activity recognition using wearable sensors
Zhang, M., & Sawchuk, A. A. (2012) · Proceedings of the 2012 ACM Conference on Ubiquitous Computing · doi:10.1145/2370216.2370438 · Cited by 554
Ensembles of Deep LSTM Learners for Activity Recognition using Wearables
Guan, Y., & Plötz, T. (2017) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3090076 · Cited by 511 · cited 1×
“, by leveraging ensembles of deep learners [12].”
BackgroundSelf-citationMeasuring the VC-Dimension of a Learning Machine
Vapnik, V., Levin, E., & Cun, Y. L. (1994) · Neural Computation · doi:10.1162/neco.1994.6.5.851 · Cited by 388 · cited 1×
“In the core machine learning literature the capacity of a classifier can be expressed through its Vapnik-Chervonenkis dimension [38], a measure that approximates the capabilities of a classifier as the number of points that it can shatter, which essentially links to the classifier’s ability to do well on unknown test…”
BackgroundWearable Activity Tracking in Car Manufacturing
Stiefmeier, T., Roggen, D., Ogris, G., Lukowicz, P., & Tr, G. (2008) · IEEE Pervasive Computing · doi:10.1109/mprv.2008.40 · Cited by 367 · cited 2×
“1 Skoda car manufacturing related movements body-worn IMU; gestures [35] 2 PAMAP2 physical activity monitoring body-worn IMU; ADL [31] 3 MHealth body-motion (and vitals) monitoring body-worn IMU; ADL [4] 4 USC-HAD low-level activities in health-care phone-based IMU; ADL [44] 5 Opportunity cleanup and breakfast activit…”
MethodHuman activity recognition: A review
Ann, O. C., & Theng, L. B. (2014) · 2014 IEEE International Conference on Control System, Computing and Engineering (ICCSCE 2014) · doi:10.1109/iccsce.2014.7072750 · Cited by 169 · cited 1×
“the wider human computer interaction field using more intuitive interfaces such as gestures [2; 6; 23; 27].”
BackgroundHammerla, N. Y., Kirkham, R., Andras, P., & Ploetz, T. (2013) · Proceedings of the 2013 International Symposium on Wearable Computers · doi:10.1145/2493988.2494353 · Cited by 138 · cited 5×
“This similarity suggests that the classification configuration should be changed to: i) 2 second sliding windows, with a 50% overlap; ii) ECDF [14] features with 30 bins; and iii) Random Forest classification backend.”
BackgroundMethodInfluentialSensor enabled wearable RFID technology for mitigating the risk of falls near beds
Shinmoto Torres, R. L., Ranasinghe, D. C., Shi, Q., & Sample, A. P. (2013) · 2013 IEEE International Conference on RFID (RFID) · doi:10.1109/rfid.2013.6548154 · Cited by 134 · cited 1×
“1 Skoda car manufacturing related movements body-worn IMU; gestures [35] 2 PAMAP2 physical activity monitoring body-worn IMU; ADL [31] 3 MHealth body-motion (and vitals) monitoring body-worn IMU; ADL [4] 4 USC-HAD low-level activities in health-care phone-based IMU; ADL [44] 5 Opportunity cleanup and breakfast activit…”
Automatic assessment of problem behavior in individuals with developmental disabilities
Plötz, T., Hammerla, N. Y., Rozga, A., Reavis, A., Call, N., & Abowd, G. D. (2012) · Proceedings of the 2012 ACM Conference on Ubiquitous Computing · doi:10.1145/2370216.2370276 · Cited by 128 · cited 3×
“6 RELATED WORK Human Activity Recognition (HAR) is at the core of mobile and ubiquitous computing research, utilized in a range of scenarios including but not limited to health assessments [15; 29], sports monitoring [25], monitoring activities of daily living [31], and as core component of innovative human-computer i…”
BackgroundSelf-citationRapid specification and automated generation of prompting systems to assist people with dementia
Hoey, J., Plötz, T., Jackson, D., Monk, A. F., Pham, C., & Olivier, P. L. (2010) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2010.11.007 · Cited by 116 · cited 1×
“As such, we have seen explorations of HAR in a range of research domains, including health assessments [10; 15; 19; 26; 29; 42], and”
BackgroundSelf-citationDeep Learning for Human Activity Recognition in Mobile Computing
Plotz, T., & Guan, Y. (2018) · Computer · doi:10.1109/mc.2018.2381112 · Cited by 99 · cited 2×
“However, these methods, albeit very promising with regard to recognition performance, come with substantially higher demands and requirements [28].”
BackgroundMethodUnsupervised home monitoring of Parkinson's disease motor symptoms using body-worn accelerometers
Fisher, J. M., Hammerla, N. Y., Ploetz, T., Andras, P., Rochester, L., & Walker, R. W. (2016) · Parkinsonism & Related Disorders · doi:10.1016/j.parkreldis.2016.09.009 · Cited by 94
Self-citationHand gesture recognition of a mobile device user
Mantyla, V.-M., Mantyjarvi, J., Seppanen, T., & Tuulari, E. (2002) · 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532) · doi:10.1109/icme.2000.869596 · Cited by 92 · cited 2×
“As such, we have seen explorations of HAR in a range of research domains, including health assessments [10; 15; 19; 26; 29; 42], and the wider human computer interaction field using more intuitive interfaces such as gestures [2; 6; 23; 27].”
BackgroundBasketball Activity Recognition using Wearable Inertial Measurement Units
Nguyen, L. N., Rodríguez-Martín, D., Catalá, A., Pérez‐López, C., Samà, A., & Cavallaro, A. (2015) · International Conference on Human Computer Interaction (Interacción) · doi:10.1145/2829875.2829930 · Cited by 90 · cited 1×
“6 RELATED WORK Human Activity Recognition (HAR) is at the core of mobile and ubiquitous computing research, utilized in a range of scenarios including but not limited to health assessments [15; 29], sports monitoring [25], monitoring activities of daily living [31], and as core component of innovative human-computer i…”
BackgroundOn the role of features in human activity recognition
Haresamudram, H., Anderson, D. V., & Plötz, T. (2019) · Proceedings of the 23rd International Symposium on Wearable Computers · doi:10.1145/3341163.3347727 · Cited by 90 · cited 1×
“As shown in [16], feature engineering is an important aspect of learning representations that can be used to separate data belonging to different activity classes.”
BackgroundSelf-citationO'Brien, J. T., Gallagher, P., Stow, D., Hammerla, N., Ploetz, T., Firbank, M., Ladha, C., Ladha, K., Jackson, D., McNaney, R., et al. (2017) · Psychological Medicine · doi:10.1017/s0033291716002166 · Cited by 76 · cited 1×
“As such, we have seen explorations of HAR in a range of research domains, including health assessments [10; 15; 19; 26; 29; 42], and”
BackgroundMeasuring the complexity of classification problems
Ho, T. K., & Basu, M. (2002) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2000.906015 · Cited by 53
Handling annotation uncertainty in human activity recognition
Kwon, H., Abowd, G. D., & Plötz, T. (2019) · Proceedings of the 23rd International Symposium on Wearable Computers · doi:10.1145/3341163.3347744 · Cited by 52 · cited 1×
“For this current work, we assume that pilot datasets are representative and correctly annotated (even though recent work has demonstrated how the latter can be relaxed by incorporating label uncertainties into the modeling process [21; 39].”
BackgroundSelf-citationGao, Y., Long, Y., Guan, Y., Basu, A., Baggaley, J., & Ploetz, T. (2019) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3314399 · Cited by 49 · cited 1×
“As such, we have seen explorations of HAR in a range of research domains, including health assessments [10; 15; 19; 26; 29; 42], and”
BackgroundSIMADL: Simulated Activities of Daily Living Dataset
Alshammari, T. A., Alshammari, N. O., Sedky, M., & Howard, C. (2018) · Data · doi:10.3390/data3020011 · Cited by 44 · cited 1×
“1 Skoda car manufacturing related movements body-worn IMU; gestures [35] 2 PAMAP2 physical activity monitoring body-worn IMU; ADL [31] 3 MHealth body-motion (and vitals) monitoring body-worn IMU; ADL [4] 4 USC-HAD low-level activities in health-care phone-based IMU; ADL [44] 5 Opportunity cleanup and breakfast activit…”
Can classification performance be predicted by complexity measures? A study using microarray data
Morán‐Fernández, L., Bolón‐Canedo, V., & Alonso‐Betanzos, A. (2016) · Knowledge and Information Systems · doi:10.1007/s10115-016-1003-3 · Cited by 43 · cited 1×
“Related work on task complexity assessment exists in (few) other fields, such as for the analysis of micro-array data where the relation between different classification approaches and the complexity of various datasets has been explored [5; 24].”
BackgroundYao, X., Plötz, T., Johnson, M., & de Barbaro, K. (2019) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3328935 · Cited by 43 · cited 1×
“As such, we have seen explorations of HAR in a range of research domains, including health assessments [10; 15; 19; 26; 29; 42], and”
BackgroundSelf-citationmDurance: A Novel Mobile Health System to Support Trunk Endurance Assessment
Banos, O., Moral-Munoz, J., Diaz-Reyes, I., Arroyo-Morales, M., Damas, M., Herrera-Viedma, E., Hong, C., Lee, S., Pomares, H., Rojas, I., et al. (2015) · Sensors · doi:10.3390/s150613159 · Cited by 41 · cited 18×
“In fact, the reference analysis systems for SimADL differ substantially from the ARC paradigm.”
BackgroundInfluentialKwon, H., Abowd, G. D., & Plötz, T. (2018) · Proceedings of the 2018 ACM International Symposium on Wearable Computers · doi:10.1145/3267242.3267258 · Cited by 35 · cited 1×
“Utilizing artefacts from sensor data, in [20] slightly better performance scores were achieved over the base ECDF features.”
MethodSelf-citationPolat, K. (2019) · doi:10.1109/ebbt.2019.8742042 · Cited by 35 · cited 1×
“However, the freeze movements have distinct frequency coefficients, which is in line with what HAR systems with good recognition results on Daphnet seem to focus on [30].”
ResultHuman Activity Recognition Using Heterogeneous Sensors
Shoaib, M. A. (2013) · University of Twente Research Information · Cited by 19
On specialized window lengths and detector based human activity recognition
Li, H., Abowd, G. D., & Plötz, T. (2018) · Proceedings of the 2018 ACM International Symposium on Wearable Computers · doi:10.1145/3267242.3267246 · Cited by 19 · cited 2×
“Fine-tuning of these parameters can go beyond simplistic changes that are made for such analysis pipelines as seen in [22], where the window length is fine-tuned to match the lengths of the different activities under study in order to model them effectively.”
BackgroundSelf-citationAn insight on complexity measures and classification in microarray data
Bolón‐Canedo, V., Morán‐Fernández, L., & Alonso‐Betanzos, A. (2015) · doi:10.1109/ijcnn.2015.7280302 · Cited by 12 · cited 1×
“Related work on task complexity assessment exists in (few) other fields, such as for the analysis of micro-array data where the relation between different classification approaches and the complexity of various datasets has been explored [5; 24].”
BackgroundWang, K., He, J., & Zhang, L. (2020) · arXiv (Cornell University) · Cited by 2
Research works printed but not linked: 8
- Bulling Andreas, 2014, January
- Fisher James M., 2016, Body-worn sensors in parkinson's disease: Evaluating their acceptability to patients. Telemedicine and e-Health, 22(1):63--69
- Godfrey Alan, 2011, P Van De Ven, and J Nelson. Activity classification using a single chest mounted tri-axial accelerometer. Medical engineering & physics, 33(9):1127--1135
- 10.5555/3060832.3060835 · doi:10.5555/3060832.3060835
- 10.5555/2886521.2886562 · doi:10.5555/2886521.2886562
- Saponas T Scott, 2011, Pervasive 2011 Workshop: Frontiers in Activity Recognition using Pervasive Sensing (IWFAR)
- Wijekoon Anjana, 2019, Mex: Multi-modal exercises dataset for human activity recognition. arXiv preprint [Web Link]
- Wold Svante, 1987, Principal component analysis. Chemometrics and intelligent laboratory systems, 2(1-3):37--52
Cited by
Assessing the State of Self-Supervised Human Activity Recognition Using Wearables
Haresamudram, H., Essa, I., & Plötz, T. (2022) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3550299 · Cited by 107
“This is compounded by the necessity to enlist healthcare professionals for annotation, which may incur high costs [31].”
BackgroundSelf-citationBootstrapping Human Activity Recognition Systems for Smart Homes from Scratch
Hiremath, S. K., Nishimura, Y., Chernova, S., & Plötz, T. (2022) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3550294 · Cited by 48
“This procedure helps in reducing the burden on obtaining annotations for all data points and yet reaches acceptable performance scores [26].”
BackgroundSelf-citationThukral, M., Dhekane, S. G., Hiremath, S. K., Haresamudram, H., & Plötz, T. (2025) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3712278 · Cited by 52
Self-citationThukral, M., Dhekane, S. G., Hiremath, S. K., Haresamudram, H., & Ploetz, T. (2024) · arXiv · doi:10.48550/arxiv.2405.12368 · Cited by 21
Self-citationThe Lifespan of Human Activity Recognition Systems for Smart Homes
Hiremath, S. K., & Plötz, T. (2023) · Sensors · doi:10.3390/s23187729 · Cited by 27
“A significant challenge in obtaining a large number of such annotations is that it is cumbersome and requires time and effort [95].”
BackgroundSelf-citation
Metadata
- Authors
- Hiremath, S. K., & Plötz, T.
- Affiliations
- Georgia Institute of Technology (US)
- ORCID
- Hiremath, Shruthi K.
- Venue
- Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Published
- 2020-12-17
- Volume
- 4
- Issue
- 4
- Pages
- 1-24
- ISSN
- 2474-9567 (ISSN-L)
- OpenAlex
- W3118018543
- Cited by
- 11
- References
- 37
- Citations by year
- 2025: 1 · 2024: 1 · 2023: 3 · 2022: 5 · 2021: 1
- FWCI
- 0.88
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Social Sciences › Transportation › Human Mobility and Location-Based Analysis
- Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
- Keywords
- human activity recognition, sensor-based activity recognition, similarity analysis, wearable sensors, ubiquitous computing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.