A Systematic Study of Unsupervised Domain Adaptation for Robust Human-Activity Recognition
The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
Wearable sensors are increasingly becoming the primary interface for monitoring human activities. However, in order to scale human activity recognition (HAR) using wearable sensors to million of users and devices, it is imperative that HAR computational models are robust against real-world heterogeneity in inertial sensor data. In this paper, we study the problem of wearing diversity which pertains to the placement of the wearable sensor on the human body, and demonstrate that even state-of-the-art deep learning models are not robust against these factors. The core contribution of the paper lies in presenting a first-of-its-kind in-depth study of unsupervised domain adaptation (UDA) algorithms in the context of wearing diversity -- we develop and evaluate three adaptation techniques on four HAR datasets to evaluate their relative performance towards addressing the issue of wearing diversity. More importantly, we also do a careful analysis to learn the downsides of each UDA algorithm and uncover several implicit data-related assumptions without which these algorithms suffer a major degradation in accuracy. Taken together, our experimental findings caution against using UDA as a silver bullet for adapting HAR models to new domains, and serve as practical guidelines for HAR practitioners as well as pave the way for future research on domain adaptation in HAR.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Striving for Simplicity: The All Convolutional Net
Springenberg, J. T., Dosovitskiy, A., Brox, T., & Riedmiller, M. (2014) · arXiv · doi:10.48550/arxiv.1412.6806 · Cited by 3,447
Deep domain confusion Maximizing for domain invariance
Tzeng, E., Hoffman, J., Zhang, N., Saenko, K., & Darrell, T. (2014) · arXiv · doi:10.48550/arxiv.1412.3474 · Cited by 2,285
A tutorial on human activity recognition using body-worn inertial sensors
Bulling, A., Blanke, U., & Schiele, B. (2014) · ACM Computing Surveys · doi:10.1145/2499621 · Cited by 1,668
Introducing a New Benchmarked Dataset for Activity Monitoring
Reiss, A., & Stricker, D. (2012) · 2012 16th International Symposium on Wearable Computers · doi:10.1109/iswc.2012.13 · Cited by 1,456 · cited 2×
“RealWorld [40] 8 7 118616 29652 50Hz Opportunity [37] 5 8 90490 22616 30Hz HHAR [4] 6 2 30280 5342 50∼200Hz PAMAP2 [36] 12 3 30726 7680 100Hz”
MethodCollecting complex activity datasets in highly rich networked sensor environments
Roggen, D., Calatroni, A., Rossi, M., Holleczek, T., Forster, K., Troster, G., Lukowicz, P., Bannach, D., Pirkl, G., Ferscha, A., et al. (2010) · 2010 Seventh International Conference on Networked Sensing Systems (INSS) · doi:10.1109/inss.2010.5573462 · Cited by 788
Um, T. T., Pfister, F. M. J., Pichler, D., Endo, S., Lang, M., Hirche, S., Fietzek, U., & Kulić, D. (2017) · Proceedings of the 19th ACM International Conference on Multimodal Interaction · doi:10.1145/3136755.3136817 · Cited by 729 · cited 1×
“[44], which have shown a good performance.”
Stisen, A., Blunck, H., Bhattacharya, S., Prentow, T. S., Kjærgaard, M. B., Dey, A., Sonne, T., & Jensen, M. M. (2015) · Proceedings of the 13th ACM Conference on Embedded Networked Sensor Systems · doi:10.1145/2809695.2809718 · Cited by 714
Deep, Convolutional, and Recurrent Models for Human Activity Recognition Using Wearables
Hammerla, N. Y., Halloran, S., & Ploetz, T. (2016) · arXiv · doi:10.48550/arxiv.1604.08880 · Cited by 606
Preprocessing techniques for context recognition from accelerometer data
Figo, D., Diniz, P. C., Ferreira, D. R., & Cardoso, J. M. P. (2010) · Personal and Ubiquitous Computing · doi:10.1007/s00779-010-0293-9 · Cited by 578 · cited 1×
“5 to 3Hz, which may be related to whole-body movement [12].”
BackgroundLane, N. D., Xu, Y., Lu, H., Hu, S., Choudhury, T., Campbell, A. T., & Zhao, F. (2011) · Proceedings of the 13th international conference on Ubiquitous computing · doi:10.1145/2030112.2030160 · Cited by 171
Research works printed but not linked: 35
- 2017. New technology tracks food intake by monitoring wrist movements. http://gadgetsandwearables.com/2017/03/29/food-tracking/ . Accessed : February 10, 2020 . 2017. New technology tracks food intake by monitoring wrist movements. http://gadgetsandwearables.com/2017/03/29/food-tracking/. Accessed: February 10, 2020.
- 10.1017/S0373463307004560 · DOI · Paper page
- Ali Akbari and Roozbeh Jafari. 2019. Transferring activity recognition models for new wearable sensors with deep generative domain adaptation. In IPSN. Ali Akbari and Roozbeh Jafari. 2019. Transferring activity recognition models for new wearable sensors with deep generative domain adaptation. In IPSN. · DOI · Paper page
- 10.3390/s18113726 · DOI
- 10.1016/j.jneumeth.2013.09.015 · DOI
- 10.1007/978-3-030-01237-3_9 · DOI · Paper page
- 10.1145/2582051.2582075 · doi:10.1145/2582051.2582075
- 10.1145/2494091.2499576 · DOI · Paper page
- Jérémy Frey , May Grabli , Ronit Slyper , and Jessica R. Cauchard . 2018. Breeze: Sharing Biofeedback Through Wearable Technologies . In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI '18) . ACM, New York, NY, USA, Article 645, 12 pages. https://doi.org/10.1145/3173574.3174219 Jérémy Frey, May Grabli, Ronit Slyper, and Jessica R. Cauchard. 2018. Breeze: Sharing Biofeedback Through Wearable Technologies. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI '18). ACM, New York, NY, USA, Article 645, 12 pages. https://doi.org/10.1145/3173574.3174219 · DOI
- 10.5555/2946645.2946704 · doi:10.5555/2946645.2946704
- 10.1145/3191743 · DOI
- Arthur Gretton , Karsten M Borgwardt , Malte J Rasch , Bernhard Schölkopf , and Alexander Smola . 2012 . A kernel two-sample test . Journal of Machine Learning Research 13, Mar (2012), 723--773. Arthur Gretton, Karsten M Borgwardt, Malte J Rasch, Bernhard Schölkopf, and Alexander Smola. 2012. A kernel two-sample test. Journal of Machine Learning Research 13, Mar (2012), 723--773.
- 10.1109/ACCESS.2019.2939288 · DOI
- 10.1109/MPRV.2018.03367740 · DOI
- 10.3390/s131013099 · DOI
- Diederik P Kingma and Jimmy Ba . 2014 . Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014). Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014). · arXiv
- Diederik P. Kingma and Max Welling . 2013 . Auto-Encoding Variational Bayes. CoRR abs/1312.6114 (2013). Diederik P. Kingma and Max Welling. 2013. Auto-Encoding Variational Bayes. CoRR abs/1312.6114 (2013). · arXiv
- 10.1109/MCOM.2010.5560598 · DOI · Paper page
- Da Li , Jianshu Zhang , Yongxin Yang , Cong Liu , Yi-Zhe Song , and Timothy M . Hospedales . 2019 . Episodic Training for Domain Generalization . arXiv:cs.CV/1902.00113 Da Li, Jianshu Zhang, Yongxin Yang, Cong Liu, Yi-Zhe Song, and Timothy M. Hospedales. 2019. Episodic Training for Domain Generalization. arXiv:cs.CV/1902.00113
- Andrew L Maas , Awni Y Hannun , and Andrew Y Ng . 2013 . Rectifier nonlinearities improve neural network acoustic models . In Proc. icml , Vol. 30 . 3. Andrew L Maas, Awni Y Hannun, and Andrew Y Ng. 2013. Rectifier nonlinearities improve neural network acoustic models. In Proc. icml, Vol. 30. 3.
- 10.1109/ICMLA.2019.00155 · DOI
- 10.1145/3341163.3347716 · DOI
- 10.1145/1460412.1460444 · DOI · Paper page
- 10.1145/2750858.2804256 · DOI
- 10.1155/2018/9762098 · DOI
- Avital Oliver , Augustus Odena , Colin A Raffel , Ekin Dogus Cubuk, and Ian Goodfellow . 2018 . Realistic Evaluation of Deep Semi-Supervised Learning Algorithms. In Advances in Neural Information Processing Systems 31, S. Bengio, H. Wallach, H. Larochelle, K. Grauman, N. Cesa-Bianchi, and R. Garnett (Eds.). Curran Associates, Inc ., 3235--3246. http://papers.nips.cc/paper/7585-realistic-evaluation-of-deep-semi-supervised-learning-algorithms.pdf Avital Oliver, Augustus Odena, Colin A Raffel, Ekin Dogus Cubuk, and Ian Goodfellow. 2018. Realistic Evaluation of Deep Semi-Supervised Learning Algorithms. In Advances in Neural Information Processing Systems 31, S. Bengio, H. Wallach, H. Larochelle, K. Grauman, N. Cesa-Bianchi, and R. Garnett (Eds.). Curran Associates, Inc., 3235--3246. http://papers.nips.cc/paper/7585-realistic-evaluation-of-deep-semi-supervised-learning-algorithms.pdf
- Vern I Paulsen and Mrinal Raghupathi . 2016. An introduction to the theory of reproducing kernel Hilbert spaces . Vol. 152 . Cambridge University Press . Vern I Paulsen and Mrinal Raghupathi. 2016. An introduction to the theory of reproducing kernel Hilbert spaces. Vol. 152. Cambridge University Press.
- Liangying Peng , Ling Chen , Zhenan Ye , and Yi Zhang . 2018 . AROMA: A Deep Multi-Task Learning Based Simple and Complex Human Activity Recognition Method Using Wearable Sensors. IMWUT 2 (2018), 74:1--74:16. Liangying Peng, Ling Chen, Zhenan Ye, and Yi Zhang. 2018. AROMA: A Deep Multi-Task Learning Based Simple and Complex Human Activity Recognition Method Using Wearable Sensors. IMWUT 2 (2018), 74:1--74:16.
- 10.1109/CIDM.2013.6597218 · DOI
- Timo Sztyler and Heiner Stuckenschmidt . 2016. On-body Localization of Wearable Devices: An Investigation of Position-Aware Activity Recognition. In 2016 IEEE International Conference on Pervasive Computing and Communications (PerCom) . IEEE Computer Society , 1--9. https://doi.org/10.1109/PERCOM. 2016 .7456521 http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=7456521. Timo Sztyler and Heiner Stuckenschmidt. 2016. On-body Localization of Wearable Devices: An Investigation of Position-Aware Activity Recognition. In 2016 IEEE International Conference on Pervasive Computing and Communications (PerCom). IEEE Computer Society, 1--9. https://doi.org/10.1109/PERCOM.2016.7456521 http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=7456521. · doi:10.1109/percom
- Timo Sztyler , Heiner Stuckenschmidt , and Wolfgang Petrich . 2017. Position-aware activity recognition with wearable devices. Pervasive and mobile computing 38 ( 2017 ), 281--295. Timo Sztyler, Heiner Stuckenschmidt, and Wolfgang Petrich. 2017. Position-aware activity recognition with wearable devices. Pervasive and mobile computing 38 (2017), 281--295.
- Dmitry Ulyanov , Andrea Vedaldi , and Victor S Lempitsky . 2017 . Improved Texture Networks: Maximizing Quality and Diversity in Feed-forward Stylization and Texture Synthesis .. In CVPR , Vol. 1. 3 . Dmitry Ulyanov, Andrea Vedaldi, and Victor S Lempitsky. 2017. Improved Texture Networks: Maximizing Quality and Diversity in Feed-forward Stylization and Texture Synthesis.. In CVPR, Vol. 1. 3.
- 10.5555/3327345.3327439 · doi:10.5555/3327345.3327439
- 10.1007/s00779-017-1007-3 · DOI
- 10.1145/2699343.2699350 · DOI · Paper page
Cited by
Kwon, H., Tong, C., Haresamudram, H., Gao, Y., Abowd, G. D., Lane, N. D., & Plötz, T. (2020) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3411841 · Cited by 152
ColloSSL: Collaborative Self-Supervised Learning for Human Activity Recognition
Jain, Y., Tang, C. I., Min, C., Kawsar, F., & Mathur, A. (2022) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3517246 · Cited by 113
Self-citationWhat Makes Good Contrastive Learning on Small-Scale Wearable-based Tasks?
Qian, H., Tian, T., & Miao, C. (2022) · Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining · doi:10.1145/3534678.3539134 · Cited by 67
Hong, Z., Li, Z., Zhong, S., Lyu, W., Wang, H., Ding, Y., He, T., & Zhang, D. (2024) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3659597 · Cited by 67
“We utilize UCI [56], Shoaib [63], Motion [46], and HHAR [65], to evaluate different methods, as they are widely used in previous HAR studies [7, 50, 58, 82, 83, 85].”
BackgroundMethodPractically Adopting Human Activity Recognition
Xu, H., Zhou, P., Tan, R., & Li, M. (2023) · Proceedings of the 29th Annual International Conference on Mobile Computing and Networking · doi:10.1145/3570361.3613299 · Cited by 55
Domain Generalization for Activity Recognition via Adaptive Feature Fusion
Qin, X., Wang, J., Chen, Y., Lu, W., & Jiang, X. (2023) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3552434 · Cited by 55
Cross-Domain HAR: Few Shot Transfer Learning for Human Activity Recognition
Thukral, M., Haresamudram, H., & Ploetz, T. (2023) · arXiv · doi:10.48550/arxiv.2310.14390 · Cited by 45
Hu, R., Chen, L., Miao, S., & Tang, X. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i5.25743 · Cited by 44
Sanabria, A. R., Zambonelli, F., Dobson, S., & Ye, J. (2021) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2021.101477 · Cited by 43
“Chang et al. [10] have developed unsupervised domain adaptation algorithms on feature matching and confusion maximisation and performed in-depth analysis of these algorithms in wearing diversity.”
BackgroundTransfer Learning in Sensor-Based Human Activity Recognition: A Survey
Dhekane, S. G., & Ploetz, T. (2025) · ACM Computing Surveys · doi:10.1145/3717608 · Cited by 42
Liu, Y., Zhang, S., & Gowda, M. (2021) · Proceedings of the International Conference on Internet-of-Things Design and Implementation · doi:10.1145/3450268.3453537 · Cited by 39
“Furthermore, each user’s finger motion pattern as well as natural variations in sensor wearing positions could lead to different distributions in the sensor data [15, 20] thus entailing”
BackgroundCiliberto, M., Fortes Rey, V., Calatroni, A., Lukowicz, P., & Roggen, D. (2021) · Frontiers in Computer Science · doi:10.3389/fcomp.2021.792065 · Cited by 35
“…al. (2021), transfer learning research Kalabakov et al. (2021), ontology-based activity recognition Noor et al. (2018), unsupervised domain adaptation Chang et al. (2020), zero-shot learning Wu et al. (2020), convolutional feature optimisation Hiremath and Ploetz (2021) and deep network…”
BackgroundHaresamudram, H., Tang, C. I., Suh, S., Lukowicz, P., & Plötz, T. (2025) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3729467 · Cited by 33
“…data from the stream of readings; (iv) feature extraction: where compact, meaningful representations–features–are extracted from aforementioned windows of (preprocessed) sensor data; and (v) classification: where features are classified into activities, typically employing machine learning methods.”
Thukral, M., Dhekane, S. G., Hiremath, S. K., Haresamudram, H., & Ploetz, T. (2024) · arXiv · doi:10.48550/arxiv.2405.12368 · Cited by 21
Augmented Adversarial Learning for Human Activity Recognition with Partial Sensor Sets
Kang, H., Huang, Q., & Zhang, Q. (2022) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3550285 · Cited by 16
Kwon, H., Tong, C., Haresamudram, H., Gao, Y., Abowd, G. D., Lane, N. D., & Ploetz, T. (2020) · arXiv · doi:10.48550/arxiv.2006.05675 · Cited by 14
Haresamudram, H., Tang, C. I., Suh, S., Lukowicz, P., & Ploetz, T. (2024) · arXiv · Cited by 31
“…data from the stream of readings; (iv) feature extraction: where compact, meaningful representations–features–are extracted from aforementioned windows of (preprocessed) sensor data; and (v) classification: where features are classified into activities, typically employing machine learning methods.”
Metadata
- Authors
- Chang, Y., Mathur, A., Isopoussu, A., Song, J., & Kawsar, F.
- Venue
- Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Published
- 2020-03-18
- Volume
- 4
- Issue
- 1
- Pages
- 1-30
- ISSN
- 2474-9567 (ISSN-L)
- OpenAlex
- W3011074022
- Cited by
- 138
- References
- 10
- FWCI
- 6.72
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.