CoChat

A Systematic Study of Unsupervised Domain Adaptation for Robust Human-Activity Recognition

Chang, Youngjae, Mathur, Akhil, Isopoussu, Anton, Song, Junehwa, Kawsar, Fahim · 2020 · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Cited by 138

The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.

Abstract

Wearable sensors are increasingly becoming the primary interface for monitoring human activities. However, in order to scale human activity recognition (HAR) using wearable sensors to million of users and devices, it is imperative that HAR computational models are robust against real-world heterogeneity in inertial sensor data. In this paper, we study the problem of wearing diversity which pertains to the placement of the wearable sensor on the human body, and demonstrate that even state-of-the-art deep learning models are not robust against these factors. The core contribution of the paper lies in presenting a first-of-its-kind in-depth study of unsupervised domain adaptation (UDA) algorithms in the context of wearing diversity -- we develop and evaluate three adaptation techniques on four HAR datasets to evaluate their relative performance towards addressing the issue of wearing diversity. More importantly, we also do a careful analysis to learn the downsides of each UDA algorithm and uncover several implicit data-related assumptions without which these algorithms suffer a major degradation in accuracy. Taken together, our experimental findings caution against using UDA as a silver bullet for adapting HAR models to new domains, and serve as practical guidelines for HAR practitioners as well as pave the way for future research on domain adaptation in HAR.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3380985

Cites

10 of 10 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 10 references

Research works printed but not linked: 35

  1. 2017. New technology tracks food intake by monitoring wrist movements. http://gadgetsandwearables.com/2017/03/29/food-tracking/ . Accessed : February 10, 2020 . 2017. New technology tracks food intake by monitoring wrist movements. http://gadgetsandwearables.com/2017/03/29/food-tracking/. Accessed: February 10, 2020.
  2. 10.1017/S0373463307004560 · DOI · Paper page
  3. Ali Akbari and Roozbeh Jafari. 2019. Transferring activity recognition models for new wearable sensors with deep generative domain adaptation. In IPSN. Ali Akbari and Roozbeh Jafari. 2019. Transferring activity recognition models for new wearable sensors with deep generative domain adaptation. In IPSN. · DOI · Paper page
  4. 10.3390/s18113726 · DOI
  5. 10.1016/j.jneumeth.2013.09.015 · DOI
  6. 10.1007/978-3-030-01237-3_9 · DOI · Paper page
  7. 10.1145/2582051.2582075 · doi:10.1145/2582051.2582075
  8. 10.1145/2494091.2499576 · DOI · Paper page
  9. Jérémy Frey , May Grabli , Ronit Slyper , and Jessica R. Cauchard . 2018. Breeze: Sharing Biofeedback Through Wearable Technologies . In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI '18) . ACM, New York, NY, USA, Article 645, 12 pages. https://doi.org/10.1145/3173574.3174219 Jérémy Frey, May Grabli, Ronit Slyper, and Jessica R. Cauchard. 2018. Breeze: Sharing Biofeedback Through Wearable Technologies. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI '18). ACM, New York, NY, USA, Article 645, 12 pages. https://doi.org/10.1145/3173574.3174219 · DOI
  10. 10.5555/2946645.2946704 · doi:10.5555/2946645.2946704
  11. 10.1145/3191743 · DOI
  12. Arthur Gretton , Karsten M Borgwardt , Malte J Rasch , Bernhard Schölkopf , and Alexander Smola . 2012 . A kernel two-sample test . Journal of Machine Learning Research 13, Mar (2012), 723--773. Arthur Gretton, Karsten M Borgwardt, Malte J Rasch, Bernhard Schölkopf, and Alexander Smola. 2012. A kernel two-sample test. Journal of Machine Learning Research 13, Mar (2012), 723--773.
  13. 10.1109/ACCESS.2019.2939288 · DOI
  14. 10.1109/MPRV.2018.03367740 · DOI
  15. 10.3390/s131013099 · DOI
  16. Diederik P Kingma and Jimmy Ba . 2014 . Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014). Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014). · arXiv
  17. Diederik P. Kingma and Max Welling . 2013 . Auto-Encoding Variational Bayes. CoRR abs/1312.6114 (2013). Diederik P. Kingma and Max Welling. 2013. Auto-Encoding Variational Bayes. CoRR abs/1312.6114 (2013). · arXiv
  18. 10.1109/MCOM.2010.5560598 · DOI · Paper page
  19. Da Li , Jianshu Zhang , Yongxin Yang , Cong Liu , Yi-Zhe Song , and Timothy M . Hospedales . 2019 . Episodic Training for Domain Generalization . arXiv:cs.CV/1902.00113 Da Li, Jianshu Zhang, Yongxin Yang, Cong Liu, Yi-Zhe Song, and Timothy M. Hospedales. 2019. Episodic Training for Domain Generalization. arXiv:cs.CV/1902.00113
  20. Andrew L Maas , Awni Y Hannun , and Andrew Y Ng . 2013 . Rectifier nonlinearities improve neural network acoustic models . In Proc. icml , Vol. 30 . 3. Andrew L Maas, Awni Y Hannun, and Andrew Y Ng. 2013. Rectifier nonlinearities improve neural network acoustic models. In Proc. icml, Vol. 30. 3.
  21. 10.1109/ICMLA.2019.00155 · DOI
  22. 10.1145/3341163.3347716 · DOI
  23. 10.1145/1460412.1460444 · DOI · Paper page
  24. 10.1145/2750858.2804256 · DOI
  25. 10.1155/2018/9762098 · DOI
  26. Avital Oliver , Augustus Odena , Colin A Raffel , Ekin Dogus Cubuk, and Ian Goodfellow . 2018 . Realistic Evaluation of Deep Semi-Supervised Learning Algorithms. In Advances in Neural Information Processing Systems 31, S. Bengio, H. Wallach, H. Larochelle, K. Grauman, N. Cesa-Bianchi, and R. Garnett (Eds.). Curran Associates, Inc ., 3235--3246. http://papers.nips.cc/paper/7585-realistic-evaluation-of-deep-semi-supervised-learning-algorithms.pdf Avital Oliver, Augustus Odena, Colin A Raffel, Ekin Dogus Cubuk, and Ian Goodfellow. 2018. Realistic Evaluation of Deep Semi-Supervised Learning Algorithms. In Advances in Neural Information Processing Systems 31, S. Bengio, H. Wallach, H. Larochelle, K. Grauman, N. Cesa-Bianchi, and R. Garnett (Eds.). Curran Associates, Inc., 3235--3246. http://papers.nips.cc/paper/7585-realistic-evaluation-of-deep-semi-supervised-learning-algorithms.pdf
  27. Vern I Paulsen and Mrinal Raghupathi . 2016. An introduction to the theory of reproducing kernel Hilbert spaces . Vol. 152 . Cambridge University Press . Vern I Paulsen and Mrinal Raghupathi. 2016. An introduction to the theory of reproducing kernel Hilbert spaces. Vol. 152. Cambridge University Press.
  28. Liangying Peng , Ling Chen , Zhenan Ye , and Yi Zhang . 2018 . AROMA: A Deep Multi-Task Learning Based Simple and Complex Human Activity Recognition Method Using Wearable Sensors. IMWUT 2 (2018), 74:1--74:16. Liangying Peng, Ling Chen, Zhenan Ye, and Yi Zhang. 2018. AROMA: A Deep Multi-Task Learning Based Simple and Complex Human Activity Recognition Method Using Wearable Sensors. IMWUT 2 (2018), 74:1--74:16.
  29. 10.1109/CIDM.2013.6597218 · DOI
  30. Timo Sztyler and Heiner Stuckenschmidt . 2016. On-body Localization of Wearable Devices: An Investigation of Position-Aware Activity Recognition. In 2016 IEEE International Conference on Pervasive Computing and Communications (PerCom) . IEEE Computer Society , 1--9. https://doi.org/10.1109/PERCOM. 2016 .7456521 http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=7456521. Timo Sztyler and Heiner Stuckenschmidt. 2016. On-body Localization of Wearable Devices: An Investigation of Position-Aware Activity Recognition. In 2016 IEEE International Conference on Pervasive Computing and Communications (PerCom). IEEE Computer Society, 1--9. https://doi.org/10.1109/PERCOM.2016.7456521 http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=7456521. · doi:10.1109/percom
  31. Timo Sztyler , Heiner Stuckenschmidt , and Wolfgang Petrich . 2017. Position-aware activity recognition with wearable devices. Pervasive and mobile computing 38 ( 2017 ), 281--295. Timo Sztyler, Heiner Stuckenschmidt, and Wolfgang Petrich. 2017. Position-aware activity recognition with wearable devices. Pervasive and mobile computing 38 (2017), 281--295.
  32. Dmitry Ulyanov , Andrea Vedaldi , and Victor S Lempitsky . 2017 . Improved Texture Networks: Maximizing Quality and Diversity in Feed-forward Stylization and Texture Synthesis .. In CVPR , Vol. 1. 3 . Dmitry Ulyanov, Andrea Vedaldi, and Victor S Lempitsky. 2017. Improved Texture Networks: Maximizing Quality and Diversity in Feed-forward Stylization and Texture Synthesis.. In CVPR, Vol. 1. 3.
  33. 10.5555/3327345.3327439 · doi:10.5555/3327345.3327439
  34. 10.1007/s00779-017-1007-3 · DOI
  35. 10.1145/2699343.2699350 · DOI · Paper page

Cited by

Metadata

Authors
Chang, Y., Mathur, A., Isopoussu, A., Song, J., & Kawsar, F.
Venue
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Published
2020-03-18
Volume
4
Issue
1
Pages
1-30
ISSN
2474-9567 (ISSN-L)
OpenAlex
W3011074022
Cited by
138
References
10
FWCI
6.72
Type
journal article
Language
en
Open access
closed

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.