Personalizing Activity Recognition Models Through Quantifying Different Types of Uncertainty Using Wearable Sensors
The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
Recognizing activities of daily living (ADL) provides vital contextual information that enhances the effectiveness of various mobile health and wellness applications. Development of wearable motion sensors along with machine learning algorithms offer a great opportunity for ADL recognition. However, the performance of the ADL recognition systems may significantly degrade when they are used by a new user due to inter-subject variability. This issue limits the usability of these systems. In this paper, we propose a deep learning assisted personalization framework for ADL recognition with the aim to maximize the personalization performance while minimizing solicitation of inputs or labels from the user to reduce user's burden. The proposed framework consists of unsupervised retraining of automatic feature extraction layers and supervised fine-tuning of classification layers through a novel active learning model based on a given model's uncertainty. We design a Bayesian deep convolutional neural network with stochastic latent variables that allows us to estimate both aleatoric (data-dependent) and epistemic (model-dependent) uncertainties in recognition task. In this study, for the first time, we show how distinguishing between the two aforementioned sources of uncertainty leads to more effective active learning. The experimental results show that our proposed method improves the accuracy of ADL recognition on a new user by 25% on average compared to the case of using a model for a new user with no personalization with an average final accuracy of 89.2%. Moreover, our method achieves higher personalization accuracy while significantly reducing user's burden in terms of soliciting inputs and labels compared to other methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Dropout as a bayesian approximation: Representing model uncertainty in deep learning
Gal, Y., & Ghahramani, Z. (2015) · arXiv · doi:10.48550/arxiv.1506.02142 · Cited by 6,471
What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?
Kendall, A., & Gal, Y. (2017) · arXiv · doi:10.48550/arxiv.1703.04977 · Cited by 3,088 · cited 1×
“This confirms the initial hypothesis about the type of uncertainties and it is in line with prior reports [53].”
ResultDeep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition
Ordóñez, F., & Roggen, D. (2016) · Sensors · doi:10.3390/s16010115 · Cited by 2,761 · cited 1×
“Several prior investigations have used data from inertial measurement units (IMU) or motion sensors to automatically extract features by leveraging convolutional neural networks (CNN) for detecting human gestures and activities [34]–[37].”
BackgroundA Survey on Human Activity Recognition using Wearable Sensors
Lara, O. D., & Labrador, M. A. (2013) · IEEE Communications Surveys & Tutorials · doi:10.1109/surv.2012.110112.00192 · Cited by 2,662
A Survey on Wearable Sensor-Based Systems for Health Monitoring and Prognosis
Pantelopoulos, A., & Bourbakis, N. G. (2010) · IEEE Transactions on Systems Man and Cybernetics Part C (Applications and Reviews) · doi:10.1109/tsmcc.2009.2032660 · Cited by 2,296 · cited 1×
“R ECOGNIZING activities of daily living (ADL) is gaining bold traction as it provides vital information about people, their activities, and important contextual insight that enhances the effectiveness of mobile health and wellness delivery paradigms [1]–[4].”
BackgroundIntroducing a New Benchmarked Dataset for Activity Monitoring
Reiss, A., & Stricker, D. (2012) · 2012 16th International Symposium on Wearable Computers · doi:10.1109/iswc.2012.13 · Cited by 1,456 · cited 1×
“To demonstrate the effectiveness of our proposed framework, weusedtwopubliclyavailabledatasetsincludingPAMAP2[51], andMoST[52].”
MethodWang, R., Chen, F., Chen, Z., Li, T., Harari, G., Tignor, S., Zhou, X., Ben-Zeev, D., & Campbell, A. T. (2014) · Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing · doi:10.1145/2632048.2632054 · Cited by 1,116 · cited 1×
“In fact, it is shown that user compliance to the wearable devices decay over time, particularly, when the collection system requires constant interaction [15].”
BackgroundConvolutional Neural Networks for Human Activity Recognition using Mobile Sensors
Zeng, M., Nguyen, L. T., Yu, B., Mengshoel, O. J., Zhu, J., Wu, P., & Zhang, J. (2014) · Proceedings of the 6th International Conference on Mobile Computing, Applications and Services · doi:10.4108/icst.mobicase.2014.257786 · Cited by 876
Deep, Convolutional, and Recurrent Models for Human Activity Recognition Using Wearables
Hammerla, N. Y., Halloran, S., & Ploetz, T. (2016) · arXiv · doi:10.48550/arxiv.1604.08880 · Cited by 606
Morales, F. J. O., & Roggen, D. (2016) · Proceedings of the 2016 ACM International Symposium on Wearable Computers · doi:10.1145/2971763.2971764 · Cited by 136 · cited 1×
“Moreover,itisshownthatusuallythefirstlayers,whichare responsibleforfeatureextraction,aremoregeneralizableand transferable,whilethelastlayersaremoretaskspecificandless transferablebetweendifferentusers[50].”
Research works printed but not linked: 36
- weiss, 0, The impact of personalization on smartphone-based activity recognition, Proc Workshops at 26th AAAI Conf Artificial Intell
- 10.1145/3267305.3267528 · DOI · Paper page
- 10.1145/3302506.3310391 · DOI · Paper page
- 10.1109/JIOT.2018.2856119 · DOI
- 10.1109/ICSENS.2016.7808590 · DOI · Paper page
- yang, 0, Deep convolutional neural networks on multichannel time series for human activity recognition, Proc 24th Int Joint Conf Artif Intell, 3995
- zhao, 0, Cross-people mobile-phone based activity recognition, Proc 22nd Int Joint Conf Artif Intell, 2545
- zhao, 2011, Human action recognition based on non-linear svm decision tree, J Comput Inform Syst, 7, 2461
- 10.1145/3267305.3267525 · DOI
- 10.1145/2638728.2641674 · DOI
- avci, 0, Activity recognition using inertial sensing for healthcare, wellbeing and sports applications: A survey, Proc 23th Int Conf Architecture Comput Syst, 1
- 10.1007/978-3-540-70994-7_36 · DOI
- 10.1109/ISWCS.2010.5624490 · DOI
- 10.1109/JSEN.2016.2562599 · DOI
- 10.1109/ASPDAC.2008.4483992 · DOI
- 10.1145/3055004.3055015 · DOI
- 10.4108/icst.pervasivehealth.2012.248600 · DOI
- 10.1145/2971648.2971691 · DOI
- 10.1145/2971648.2971701 · DOI · Paper page
- 10.1109/MNET.2016.7474340 · DOI · Paper page
- 10.1109/JBHI.2018.2869779 · DOI
- 10.1145/3214269 · DOI · Paper page
- añazco, 0, Smoking activity recognition using a single wrist IMU and deep learning light, Proc 2nd Int Conf Digit Signal Process, 48
- 10.1109/ICHI.2016.100 · DOI
- 10.1145/3302505.3310087 · DOI
- 10.1109/SAS.2017.7894068 · DOI
- 10.3414/ME0592 · DOI · Paper page
- 10.1016/j.eswa.2012.09.004 · DOI · Paper page
- erhan, 2010, Why does unsupervised pre-training help deep learning?, J Mach Learn Res, 11, 625
- 10.1007/978-3-642-02085-8_11 · DOI
- 10.1109/BHI.2019.8834505 · DOI
- 10.1007/978-3-319-46493-0_36 · DOI · Paper page
- vincent, 2010, Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion, J Mach Learn Res, 11, 3371
- diethe, 0, Active transfer learning for activity recognition, Proc Eur Symp Artif Neural Netw Comput Intell Mach Learn, 429
- sabato, 2016, Interactive algorithms: From pool to stream, 29th Annual Conference on Learning Theory, 49, 23
- 10.1109/PERCOM.2017.7917864 · DOI · Paper page
Cited by
A review of uncertainty quantification in deep learning: Techniques, applications and challenges
Abdar, M., Pourpanah, F., Hussain, S., Rezazadegan, D., Liu, L., Ghavamzadeh, M., Fieguth, P., Cao, X., Khosravi, A., Acharya, U. R., et al. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.05.008 · Cited by 3,111
“[117] proposed a unified BDL framework to quantify both aleatoric and epistemic uncertainties for activity recognition.”
BackgroundTrust in AI: progress, challenges, and future directions
Afroogh, S., Akbari, A., Malone, E., Kargar, M., & Alambeigi, H. (2024) · Humanities and Social Sciences Communications · doi:10.1057/s41599-024-04044-8 · Cited by 507
Self-citationHuman Activity Recognition Based on Dynamic Active Learning
Bi, H., Perello-Nieto, M., Santos-Rodriguez, R., & Flach, P. (2021) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2020.3013403 · Cited by 81
“[61] designed an active learning based activity recognition method which employs Bayesian deep CNN with stochastic latent variables to estimate the uncertainties of samples.”
MethodTransfer Learning in Sensor-Based Human Activity Recognition: A Survey
Dhekane, S. G., & Ploetz, T. (2025) · ACM Computing Surveys · doi:10.1145/3717608 · Cited by 42
Impact of Wearable Measurement Properties and Data Quality on ADLs Classification Accuracy
Poli, A., Cosoli, G., Scalise, L., & Spinsante, S. (2021) · IEEE Sensors Journal · doi:10.1109/jsen.2020.3009368 · Cited by 33
Toward User-Driven Sound Recognizer Personalization with People Who Are d/Deaf or Hard of Hearing
Goodman, S. M., Liu, P., Jain, D., McDonnell, E. J., Froehlich, J. E., & Findlater, L. (2021) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3463501 · Cited by 33
Wojtusiak, J., Asadzadehzanjani, N., Levy, C., Alemi, F., & Williams, A. E. (2021) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-020-01368-8 · Cited by 26
Metadata
- Authors
- Akbari, A., & Jafari, R.
- Venue
- IEEE Transactions on Biomedical Engineering
- Published
- 2020-09
- Volume
- 67
- Issue
- 9
- Pages
- 2530-2541
- ISSN
- 0018-9294 (ISSN-L)
- 1558-2531
- OpenAlex
- W2997626223
- Cited by
- 50
- References
- 12
- FWCI
- 3.41
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Funders
- National Science Foundation (CNS-1734039, ECCS-1509063)
- National Institutes of Health (1R01EB028106-01)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.