Handling annotation uncertainty in human activity recognition
The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Abstract
Developing systems for Human Activity Recognition (HAR) using wearables typically relies on datasets that were manually annotated by human experts with regards to precise timings of instances of relevant activities. However, obtaining such data annotations is often very challenging in the predominantly mobile scenarios of Human Activity Recognition. As a result, labels often carry a degree of uncertainty-label jitter-with regards to: i) correct temporal alignments of activity boundaries; and ii) correctness of the actual label provided by the human annotator. In this work, we present a scheme that explicitly incorporates label jitter into the model training process. We demonstrate the effectiveness of the proposed method through a systematic experimental evaluation on standard recognition tasks for which our method leads to significant increases of mean F1 scores.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Previous work showed that handling outlier samples in HAR datasets is important and, if successful, can significantly improve the performance of the resulting HAR model [91,92,93].”
From Complex Deep Neural Networks from Large Scale Virtual IMU Data for Effective Human Activity Recognition Using Wearables (2021) · cites this paper as [92]
Citations
Cites
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138
Introduction to Statistical Pattern Recognition
(1990) · Elsevier eBooks · doi:10.1016/c2009-0-27872-x · Cited by 11,031
Adversarial examples in the physical world
Kurakin, A., Goodfellow, I. J., & Bengio, S. (2018) · Artificial Intelligence Safety and Security · doi:10.1201/9781351251389-8 · Cited by 5,375
Probable Inference, the Law of Succession, and Statistical Inference
Wilson, E. B. (1927) · Journal of the American Statistical Association · doi:10.1080/01621459.1927.10502953 · Cited by 4,476
Deep neural networks are easily fooled: High confidence predictions for unrecognizable images
Nguyen, A., Yosinski, J., & Clune, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298640 · Cited by 3,258
Deep Neural Networks are Easily Fooled: High Confidence Predictions for Unrecognizable Images
Nguyen, A., Yosinski, J., & Clune, J. (2014) · arXiv · doi:10.48550/arxiv.1412.1897 · Cited by 3,258
Zadeh, L. A. (1997) · Fuzzy Sets and Systems · doi:10.1016/s0165-0114(97)00077-8 · Cited by 2,897
Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition
Ordóñez, F., & Roggen, D. (2016) · Sensors · doi:10.3390/s16010115 · Cited by 2,761 · cited 4×
“For this evaluation, we used the Opportunity dataset [6], and a state-of-the-art Con-vLSTM classifier [24], which not only automatically learns the feature representation but also models long-term temporal contexts.”
MethodInfluentialA tutorial on human activity recognition using body-worn inertial sensors
Bulling, A., Blanke, U., & Schiele, B. (2014) · ACM Computing Surveys · doi:10.1145/2499621 · Cited by 1,668
When does label smoothing help?
Müller, R., Kornblith, S., & Hinton, G. (2019) · arXiv · doi:10.48550/arxiv.1906.02629 · Cited by 859
Research works printed but not linked: 1
- Xie L., 2016, Disturblabel: Regularizing cnn on the loss layer.. In CVPR. 4753--4762.
Cited by
Human Activity Recognition: Review, Taxonomy and Open Challenges
Arshad, M. H., Bilal, M., & Gani, A. (2022) · Sensors · doi:10.3390/s22176463 · Cited by 206
Quantifying Parkinson’s disease motor severity under uncertainty using MDS-UPDRS videos
Lu, M., Zhao, Q., Poston, K. L., Sullivan, E. V., Pfefferbaum, A., Shahid, M., Katz, M., Montaser‐Kouhsari, L., Schulman, K. A., Milstein, A. S., et al. (2021) · Medical Image Analysis · doi:10.1016/j.media.2021.102179 · Cited by 108
Gjoreski, M., Gams, M., Luštrek, M., Genc, P., Garbas, J.-U., & Hassan, T. (2020) · IEEE Access · doi:10.1109/access.2020.2986810 · Cited by 106
IMUGPT 2.0: Language-Based Cross Modality Transfer for Sensor-Based Human Activity Recognition
Leng, Z., Bhattacharjee, A., Rajasekhar, H., Zhang, L., Bruda, E., Kwon, H., & Plötz, T. (2024) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3678545 · Cited by 61
“This hinders the development of robust and generalizable models.”
Self-citationX-CHAR: A Concept-based Explainable Complex Human Activity Recognition Model
Jeyakumar, J. V., Sarker, A., Garcia, L. A., & Srivastava, M. B. (2023) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3580804 · Cited by 58
Metadata
- Authors
- Kwon, H., Abowd, G. D., & Plötz, T.
- Affiliations
- Georgia Institute of Technology (US)
- Venue
- Proceedings of the 23rd International Symposium on Wearable Computers
- Publisher
- ACM
- Published
- 2019-09-09
- Pages
- 109-117
- OpenAlex
- W2971670291
- Cited by
- 52
- References
- 36
- Citations by year
- 2026: 3 · 2025: 9 · 2024: 6 · 2023: 6 · 2022: 14 · 2021: 11 · 2020: 3
- FWCI
- 2.28
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International Symposium on Wearable Computers (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Keywords
- human activity recognition, annotation uncertainty, wearable sensors, temporal alignment, label noise
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Handling annotation uncertainty in human activity recognition. https://app.cochat.ai/papers/10.1145/3341163.3347744
- The paper
- Kwon, H., Abowd, G. D., & Plötz, T. (2019). Handling annotation uncertainty in human activity recognition. Proceedings of the 23rd International Symposium on Wearable Computers. https://doi.org/10.1145/3341163.3347744
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.