CoChat

Unsupervised Human Activity Representation Learning with Multi-task Deep Clustering

Ma, Haojie, Zhang, Zhijie, Li, Wenzhong, Lu, Sanglu · 2021 · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies

The DOI matches its Crossref record; 58 of the 58 references it cites were found in a registry or an index.

Abstract

Human activity recognition (HAR) based on sensing data from wearable and mobile devices has become an active research area in ubiquitous computing, and it envisions a wide range of application scenarios in mobile social networking, environmental context sensing, health and well-being monitoring, etc. However, activity recognition based on manually annotated sensing data is manpower-expensive, time-consuming, and privacy-sensitive, which prevents HAR systems from being really deployed in scale. In this paper, we address the problem of unsupervised human activity recognition, which infers activities from unlabeled datasets without the need of domain knowledge. We propose an end-to-end multi-task deep clustering framework to solve the problem. Taking the unlabeled multi-dimensional sensing signals as input, we firstly apply a CNN-BiLSTM autoencoder to form a compressed latent feature representation. Then we apply a K-means clustering algorithm based on the extracted features to partition the dataset into different groups, which produces pseudo labels for the instances. We further train a deep neural network (DNN) with the latent features and pseudo labels for activity recognition. The tasks of feature representation, clustering, and classification are integrated into a uniform multi-task learning framework and optimized jointly to achieve unsupervised activity classification. We conduct extensive experiments based on three public datasets. It is shown that the proposed approach…

Overview

Integrity signals

Registry

Crossref · 10.1145/3448074

Cites

58 of 58 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 58 references

Research works printed but not linked: 17

  1. Margareta Ackerman and Sanjoy Dasgupta. 2014. Incremental clustering: The case for extra clusters. In Advances in Neural Information Processing Systems. 307--315. Margareta Ackerman and Sanjoy Dasgupta. 2014. Incremental clustering: The case for extra clusters. In Advances in Neural Information Processing Systems. 307--315.
  2. Mohammad Abu Alsheikh , Ahmed Selim , Dusit Niyato , Linda Doyle , Shaowei Lin , and Hwee-Pink Tan . 2016 . Deep activity recognition models with triaxial accelerometers . In Workshops at the Thirtieth AAAI Conference on Artificial Intelligence. Mohammad Abu Alsheikh, Ahmed Selim, Dusit Niyato, Linda Doyle, Shaowei Lin, and Hwee-Pink Tan. 2016. Deep activity recognition models with triaxial accelerometers. In Workshops at the Thirtieth AAAI Conference on Artificial Intelligence.
  3. Rich Caruana . 1997. Multitask learning. Machine learning 28, 1 ( 1997 ), 41--75. Rich Caruana. 1997. Multitask learning. Machine learning 28, 1 (1997), 41--75.
  4. Sojeong Ha , Jeong-Min Yun , and Seungjin Choi . 2015 . Multi-modal Convolutional Neural Networks for Activity Recognition. 2015 IEEE International Conference on Systems, Man, and Cybernetics, 3017--3022 . Sojeong Ha, Jeong-Min Yun, and Seungjin Choi. 2015. Multi-modal Convolutional Neural Networks for Activity Recognition. 2015 IEEE International Conference on Systems, Man, and Cybernetics, 3017--3022.
  5. 10.5555/2886521.2886562 · doi:10.5555/2886521.2886562
  6. 10.5555/3060832.3060835 · doi:10.5555/3060832.3060835
  7. Md Rezaul Karim , Oya Beyan , Achille Zappa , Ivan G Costa , Dietrich Rebholz-Schuhmann , Michael Cochez , and Stefan Decker . 2020. Deep learning-based clustering approaches for bioinformatics. Briefings in Bioinformatics ( 2020 ). Md Rezaul Karim, Oya Beyan, Achille Zappa, Ivan G Costa, Dietrich Rebholz-Schuhmann, Michael Cochez, and Stefan Decker. 2020. Deep learning-based clustering approaches for bioinformatics. Briefings in Bioinformatics (2020).
  8. Yongmou Li , Dianxi Shi , Bo Ding , and Dongbo Liu . 2014. Unsupervised feature learning for human activity recognition using smartphone sensors . In Mining intelligence and knowledge exploration . Springer , 99--107. Yongmou Li, Dianxi Shi, Bo Ding, and Dongbo Liu. 2014. Unsupervised feature learning for human activity recognition using smartphone sensors. In Mining intelligence and knowledge exploration. Springer, 99--107.
  9. Haojie Ma , Wenzhong Li , X. Zhang , S. Gao , and S. Lu . 2019 . AttnSense: Multi-level Attention Mechanism For Multimodal Human Activity Recognition. In the 28th International Joint Conference on Artificial Intelligence (IJCAI'19) . Haojie Ma, Wenzhong Li, X. Zhang, S. Gao, and S. Lu. 2019. AttnSense: Multi-level Attention Mechanism For Multimodal Human Activity Recognition. In the 28th International Joint Conference on Artificial Intelligence (IJCAI'19).
  10. Naveen Sai Madiraju , Seid M Sadat , Dimitry Fisher , and Homa Karimabadi . 2018. Deep temporal clustering: Fully unsupervised learning of time-domain features. arXiv preprint arXiv:1802.01059 ( 2018 ). Naveen Sai Madiraju, Seid M Sadat, Dimitry Fisher, and Homa Karimabadi. 2018. Deep temporal clustering: Fully unsupervised learning of time-domain features. arXiv preprint arXiv:1802.01059 (2018). · arXiv
  11. D. Minnen , T. Starner , I. Essa , and C. Isbell . 2006. Discovering Characteristic Actions from On-Body Sensor Data . In IEEE 10th International Symposium on Wearable Computers. 11--18 . https://doi.org/10.1109/ISWC. 2006 .286337 D. Minnen, T. Starner, I. Essa, and C. Isbell. 2006. Discovering Characteristic Actions from On-Body Sensor Data. In IEEE 10th International Symposium on Wearable Computers. 11--18. https://doi.org/10.1109/ISWC.2006.286337 · doi:10.1109/iswc
  12. Hangwei Qian , Sinno Jialin Pan , and C. Miao . 2018. Sensor-Based Activity Recognition via Learning From Distributions . In Thirty-Second AAAI Conference on Artificial Intelligence. Hangwei Qian, Sinno Jialin Pan, and C. Miao. 2018. Sensor-Based Activity Recognition via Learning From Distributions. In Thirty-Second AAAI Conference on Artificial Intelligence.
  13. Neda Tavakoli , Sima Siami-Namini , Mahdi Adl Khanghah , Fahimeh Mirza Soltani, and Akbar Siami Namin. 2020 . Clustering Time Series Data through Autoencoder-based Deep Learning Models . arXiv preprint arXiv:2004.07296 (2020). Neda Tavakoli, Sima Siami-Namini, Mahdi Adl Khanghah, Fahimeh Mirza Soltani, and Akbar Siami Namin. 2020. Clustering Time Series Data through Autoencoder-based Deep Learning Models. arXiv preprint arXiv:2004.07296 (2020). · arXiv
  14. Jindong Wang , Yiqiang Chen , Shuji Hao , Xiaohui Peng , and Lisha Hu. 2018. Deep learning for sensor-based activity recognition: A survey. Pattern Recognition Letters ( 2018 ). Jindong Wang, Yiqiang Chen, Shuji Hao, Xiaohui Peng, and Lisha Hu. 2018. Deep learning for sensor-based activity recognition: A survey. Pattern Recognition Letters (2018).
  15. Bo Yang , Xiao Fu , Nicholas D Sidiropoulos , and Mingyi Hong . 2017 . Towards k-means-friendly spaces: Simultaneous deep learning and clustering . In international conference on machine learning (ICML'17) . PMLR, 3861--3870. Bo Yang, Xiao Fu, Nicholas D Sidiropoulos, and Mingyi Hong. 2017. Towards k-means-friendly spaces: Simultaneous deep learning and clustering. In international conference on machine learning (ICML'17). PMLR, 3861--3870.
  16. Jianbo Yang , Minh Nhut Nguyen , Phyo Phyo San, Xiaoli Li, and Shonali Krishnaswamy. 2015 . Deep Convolutional Neural Networks on Multichannel Time Series for Human Activity Recognition. In IJCAI. Jianbo Yang, Minh Nhut Nguyen, Phyo Phyo San, Xiaoli Li, and Shonali Krishnaswamy. 2015. Deep Convolutional Neural Networks on Multichannel Time Series for Human Activity Recognition. In IJCAI.
  17. Hongyuan Zha Xiaofeng He Chris Ding Ming Gu and Horst D Simon. 2002. Spectral relaxation for k-means clustering. In Advances in neural information processing systems. 1057--1064. Hongyuan Zha Xiaofeng He Chris Ding Ming Gu and Horst D Simon. 2002. Spectral relaxation for k-means clustering. In Advances in neural information processing systems. 1057--1064.

Cited by

Metadata

Authors
Ma, H., Zhang, Z., Li, W., & Lu, S.
Affiliations
Nanjing University (CN)
Venue
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Published
2021-03-19
Volume
5
Issue
1
Pages
1-25
ISSN
2474-9567 (ISSN-L)
OpenAlex
W3152187098
Cited by
48
References
56
Citations by year
2026: 5 · 2025: 7 · 2024: 18 · 2023: 9 · 2022: 8 · 2021: 1
FWCI
3.24
Type
journal article
Language
en
Open access
closed
Locations
Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies (publishedVersion)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
  • Social Sciences › Transportation › Human Mobility and Location-Based Analysis
  • Physical Sciences › Computer Science › Signal Processing › Time Series Analysis and Forecasting
Keywords
pseudo-labeling, K-means clustering, latent representations, activity classification, annotation cost reduction, mobile health monitoring

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.