Active Deep Learning for Activity Recognition with Context Aware Annotator Selection
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
Machine learning models are bounded by the credibility of ground truth data used for both training and testing. Regardless of the problem domain, this ground truth annotation is objectively manual and tedious as it needs considerable amount of human intervention. With the advent of Active Learning with multiple annotators, the burden can be somewhat mitigated by actively acquiring labels of most informative data instances. However, multiple annotators with varying degrees of expertise poses new set of challenges in terms of quality of the label received and availability of the annotator. Due to limited amount of ground truth information addressing the variabilities of Activity of Daily Living (ADLs), activity recognition models using wearable and mobile devices are still not robust enough for real-world deployment. In this paper, we first propose an active learning combined deep model which updates its network parameters based on the optimization of a joint loss function. We then propose a novel annotator selection model by exploiting the relationships among the users while considering their heterogeneity with respect to their expertise, physical and spatial context. Our proposed model leverages model-free deep reinforcement learning in a partially observable environment setting to capture the action-reward interaction among multiple annotators. Our experiments in real-world settings exhibit that our active deep model converges to optimal accuracy with fewer labeled instances and achieves ~8% improvement in accuracy in fewer iterations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition
Ordóñez, F., & Roggen, D. (2016) · Sensors · doi:10.3390/s16010115 · Cited by 2,761
Nweke, H. F., Teh, Y. W., Al-garadi, M. A., & Alo, U. R. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.03.056 · Cited by 930
Convolutional Neural Networks for Human Activity Recognition using Mobile Sensors
Zeng, M., Nguyen, L. T., Yu, B., Mengshoel, O. J., Zhu, J., Wu, P., & Zhang, J. (2014) · Proceedings of the 6th International Conference on Mobile Computing, Applications and Services · doi:10.4108/icst.mobicase.2014.257786 · Cited by 876 · cited 1×
“Themodelproposedin[35]exhibitshighestincrementinaccuracy( ≈ 9”
Ensembles of Deep LSTM Learners for Activity Recognition using Wearables
Guan, Y., & Plötz, T. (2017) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3090076 · Cited by 511 · cited 1×
“Guan et al. proposed an ensemble model based on LSTM to address the problem of imbalanced dataset and data quality [8].”
BackgroundMultimodal Deep Learning for Activity and Context Recognition
Radu, V., Tong, C., Bhattacharya, S., Lane, N. D., Mascolo, C., Marina, M. K., & Kawsar, F. (2018) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3161174 · Cited by 281 · cited 2×
“Various researchers [20][23][17][23] have also addressed the problem of sensor fusion and heterogeneity in presence of multimodal sensors using deep learning methods.”
BackgroundPeng (2018) · doi:10.1145/3214277 · Cited by 134
Deep Activity Recognition Models with Triaxial Accelerometers
Alsheikh, M. A., Selim, A., Niyato, D., Doyle, L., Lin, S., & Tan, H.-P. (2015) · arXiv · doi:10.48550/arxiv.1511.04664 · Cited by 126
Active learning enabled activity recognition
Hossain, H. M. S., Khan, M. A. A. H., & Roy, N. (2017) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2016.08.017 · Cited by 92
Self-citationMathur, A., Zhang, T., Bhattacharya, S., Velickovic, P., Joffe, L., Lane, N. D., Kawsar, F., & Lio, P. (2018) · 2018 17th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN) · doi:10.1109/ipsn.2018.00048 · Cited by 70 · cited 1×
“Various researchers [20][23][17][23] have also addressed the problem of sensor fusion and heterogeneity in presence of multimodal sensors using deep learning methods.”
Background
Research works printed but not linked: 27
- Mohammad Arif Ul Alam and Nirmalya Roy . 2017 . Unseen Activity Recognitions: A Hierarchical Active Transfer Learning Approach. In 37th IEEE International Conference on Distributed Computing Systems, ICDCS 2017 , Atlanta, GA, USA, June 5--8 , 2017. 436--446. Mohammad Arif Ul Alam and Nirmalya Roy. 2017. Unseen Activity Recognitions: A Hierarchical Active Transfer Learning Approach. In 37th IEEE International Conference on Distributed Computing Systems, ICDCS 2017, Atlanta, GA, USA, June 5--8, 2017. 436--446.
- Hande Ö zgü r Alemdar , T. L. M. van Kasteren , and Cem Ersoy . 2017 . Active learning with uncertainty sampling for large scale activity recognition in smart homes . JAISE , Vol. 9 , 2 (2017), 209 -- 223 . Hande Ö zgü r Alemdar, T. L. M. van Kasteren, and Cem Ersoy. 2017. Active learning with uncertainty sampling for large scale activity recognition in smart homes. JAISE , Vol. 9, 2 (2017), 209--223.
- 10.1109/TSMCC.2012.2198883 · DOI · Paper page
- Gabriele Civitarese , Claudio Bettini , Timo Sztyler , Daniele Riboni , and Heiner Stuckenschmidt . 2018 . NECTAR: Knowledge-based Collaborative Active Learning for Activity Recognition. In 2018 IEEE International Conference on Pervasive Computing and Communications, PerCom 2018 , Athens, Greece, March 19--23 , 2018. 1--10. Gabriele Civitarese, Claudio Bettini, Timo Sztyler, Daniele Riboni, and Heiner Stuckenschmidt. 2018. NECTAR: Knowledge-based Collaborative Active Learning for Activity Recognition. In 2018 IEEE International Conference on Pervasive Computing and Communications, PerCom 2018, Athens, Greece, March 19--23, 2018. 1--10.
- 10.1145/1458082.1458165 · DOI · Paper page
- 10.1137/1.9781611972801.72 · DOI · Paper page
- 10.1109/ICCV.2015.516 · DOI · Paper page
- 10.1145/3214269 · DOI · Paper page
- H. M. Sajjad Hossain and Nirmalya Roy . 2018 . SocialAnnotator: Annotator Selection Using Activity and Social Context . In Proceedings of the AAAI Fall Symposium on Reasoning and Learning in Real-World Systems for Long-Term Autonomy. 30--37 . H. M. Sajjad Hossain and Nirmalya Roy. 2018. SocialAnnotator: Annotator Selection Using Activity and Social Context. In Proceedings of the AAAI Fall Symposium on Reasoning and Learning in Real-World Systems for Long-Term Autonomy. 30--37.
- 10.1109/PERCOMW.2017.7917621 · DOI · Paper page
- 10.1109/PERCOM.2018.8444585 · DOI · Paper page
- 10.1145/3161201 · DOI · Paper page
- Timothy P. Lillicrap , Jonathan J. Hunt , Alexander Pritzel , Nicolas Heess , Tom Erez , Yuval Tassa , David Silver , and Daan Wierstra . 2015. Continuous control with deep reinforcement learning. CoRR ( 2015 ). Timothy P. Lillicrap, Jonathan J. Hunt, Alexander Pritzel, Nicolas Heess, Tom Erez, Yuval Tassa, David Silver, and Daan Wierstra. 2015. Continuous control with deep reinforcement learning. CoRR (2015).
- Volodymyr Mnih , Koray Kavukcuoglu , David Silver , Alex Graves , Ioannis Antonoglou , Daan Wierstra , and Martin A . Riedmiller . 2013 . Playing Atari with Deep Reinforcement Learning. CoRR , Vol. abs/ 1312 .5602 (2013). Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Alex Graves, Ioannis Antonoglou, Daan Wierstra, and Martin A. Riedmiller. 2013. Playing Atari with Deep Reinforcement Learning. CoRR , Vol. abs/1312.5602 (2013). · arXiv
- 10.3390/s16081182 · DOI
- 10.1145/3123021.3123046 · DOI · Paper page
- 10.1002/widm.1254 · DOI · Paper page
- 10.1145/2971648.2971691 · DOI
- Seyed Ali Rokni , Marjan Nourollahi , and Hassan Ghasemzadeh . 2018 . Personalized Human Activity Recognition Using Convolutional Neural Networks . In Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence , New Orleans, Louisiana, USA, February 2--7 , 2018 . Seyed Ali Rokni, Marjan Nourollahi, and Hassan Ghasemzadeh. 2018. Personalized Human Activity Recognition Using Convolutional Neural Networks. In Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, New Orleans, Louisiana, USA, February 2--7, 2018 .
- 10.1007/978-3-030-01081-2_23 · DOI
- Burr Settles . 2012. Active Learning . Morgan & Claypool Publishers . Burr Settles. 2012. Active Learning .Morgan & Claypool Publishers.
- 10.1109/CHASE.2017.115 · DOI · Paper page
- David Silver , Guy Lever , Nicolas Heess , Thomas Degris , Daan Wierstra , and Martin Riedmiller . 2014 . Deterministic Policy Gradient Algorithms . In Proceedings of the 31st International Conference on International Conference on Machine Learning - Volume 32 (ICML'14). David Silver, Guy Lever, Nicolas Heess, Thomas Degris, Daan Wierstra, and Martin Riedmiller. 2014. Deterministic Policy Gradient Algorithms. In Proceedings of the 31st International Conference on International Conference on Machine Learning - Volume 32 (ICML'14).
- Richard S. Sutton and Andrew G . Barto . 1998 . Reinforcement learning - an introduction .MIT Press . Richard S. Sutton and Andrew G. Barto. 1998. Reinforcement learning - an introduction .MIT Press.
- Jindong Wang , Yiqiang Chen , Lisha Hu , Xiaohui Peng , and Philip S. Yu . 2018 . Stratified Transfer Learning for Cross-domain Activity Recognition. In 2018 IEEE International Conference on Pervasive Computing and Communications, PerCom 2018 , Athens, Greece, March 19--23 , 2018 . 1--10. Jindong Wang, Yiqiang Chen, Lisha Hu, Xiaohui Peng, and Philip S. Yu. 2018. Stratified Transfer Learning for Cross-domain Activity Recognition. In 2018 IEEE International Conference on Pervasive Computing and Communications, PerCom 2018, Athens, Greece, March 19--23, 2018. 1--10.
- 10.1109/ICDMW.2012.48 · DOI
- Ou Wu , Weiming Hu , and Jun Gao . 2011 . Learning to Rank under Multiple Annotators . In IJCAI 2011, Proceedings of the 22nd International Joint Conference on Artificial Intelligence , Barcelona, Catalonia, Spain, July 16--22 , 2011. 1571--1576. Ou Wu, Weiming Hu, and Jun Gao. 2011. Learning to Rank under Multiple Annotators. In IJCAI 2011, Proceedings of the 22nd International Joint Conference on Artificial Intelligence, Barcelona, Catalonia, Spain, July 16--22, 2011. 1571--1576.
Cited by
A Survey of Deep Active Learning
Ren, P., Xiao, Y., Chang, X., Huang, P.-Y., Li, Z., Gupta, B. B., Chen, X., & Wang, X. (2022) · ACM Computing Surveys · doi:10.1145/3472291 · Cited by 1,169
Deep Learning for Sensor-based Human Activity Recognition
Chen, K., Zhang, D., Yao, L., Guo, B., Yu, Z., & Liu, Y. (2022) · ACM Computing Surveys · doi:10.1145/3447744 · Cited by 690
“ids of the clusters, in this work, the neighboring samples are also queried. The experiments show that the proposed method can achieve the optimal results by labeling 10% of the data. Hossain and Roy [60] further investigated two problems of deep active learning and human activity recognition. The first problem is tha…”
BackgroundMethodInfluentialDeep Learning for Sensor-based Human Activity Recognition: Overview, Challenges and Opportunities
Chen, K., Zhang, D., Yao, L., Guo, B., Yu, Z., & Liu, Y. (2020) · arXiv · doi:10.48550/arxiv.2001.07416 · Cited by 314
“ids of the clusters, in this work, the neighboring samples are also queried. The experiments show that the proposed method can achieve the optimal results by labeling 10% of the data. Hossain and Roy [60] further investigated two problems of deep active learning and human activity recognition. The first problem is tha…”
BackgroundMethodInfluentialHuman Activity Recognition Data Analysis: History, Evolutions, and New Trends
Ariza-Colpas, P. P., Vicario, E., Oviedo-Carrascal, A. I., Butt Aziz, S., Piñeres-Melo, M. A., Quintero-Linero, A., & Patara, F. (2022) · Sensors · doi:10.3390/s22093401 · Cited by 52
“Lu [162] uses the DoMSEV Dataset using the Deep-shallow algorithm with an accuracy of 72.9% and Hossain [163], Pop used a new Dataset to which they implemented the Deep Q-Network algorithm with an accuracy of 83.26%.”
InfluentialKumar, P., & Chauhan, S. (2021) · CCF Transactions on Pervasive Computing and Interaction · doi:10.1007/s42486-021-00063-5 · Cited by 13
Retracted
Metadata
- Authors
- Hossain, H. M. S., & Roy, N.
- Venue
- Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining
- Publisher
- ACM
- Published
- 2019-07-25
- Pages
- 1862-1870
- OpenAlex
- W2951768055
- Cited by
- 34
- References
- 9
- FWCI
- 1.69
- Type
- conference paper
- Language
- en
- Open access
- bronze
- Funders
- Office of Naval Research (N00014-15-1-2229)
- Alzheimer's Association (AARG-17-533039)
- National Science Foundation (1750936)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Active Deep Learning for Activity Recognition with Context Aware Annotator Selection. https://app.cochat.ai/papers/10.1145/3292500.3330688
- The paper
- Hossain, H. M. S., & Roy, N. (2019). Active Deep Learning for Activity Recognition with Context Aware Annotator Selection. Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. https://doi.org/10.1145/3292500.3330688
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.