CoChat

Attend and Discriminate: Beyond the State-of-the-Art for Human Activity Recognition Using Wearable Sensors

Abedin, Alireza, Ehsanpour, Mahsa, Shi, Qinfeng, Rezatofighi, Hamid, Ranasinghe, Damith C. · 2021 · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies

The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.

Abstract

Wearables are fundamental to improving our understanding of human activities, especially for an increasing number of healthcare applications from rehabilitation to fine-grained gait analysis. Although our collective know-how to solve Human Activity Recognition (HAR) problems with wearables has progressed immensely with end-to-end deep learning paradigms, several fundamental opportunities remain overlooked. We rigorously explore these new opportunities to learn enriched and highly discriminating activity representations. We propose: i) learning to exploit the latent relationships between multi-channel sensor modalities and specific activities; ii) investigating the effectiveness of data-agnostic augmentation for multi-modal sensor data streams to regularize deep HAR models; and iii) incorporating a classification loss criterion to encourage minimal intra-class representation differences whilst maximising inter-class differences to achieve more discriminative features. Our contributions achieves new state-of-the-art performance on four diverse activity recognition problem benchmarks with large margins---with up to 6% relative margin improvement. We extensively validate the contributions from our design concepts through extensive experiments, including activity misalignment measures, ablation studies and insights shared through both quantitative and qualitative studies. The code base and trained network parameters are open-sourced on GitHub https://github.com/AdelaideAuto-IDLab/Attend-And-Discriminate to support further research.

Overview

Integrity signals

Registry

Crossref · 10.1145/3448083

Cites

44 of 44 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 44 references

Research works printed but not linked: 13

  1. Akin Avci , Stephan Bosch , Mihai Marin-Perianu , Raluca Marin-Perianu , and Paul Havinga . 2010 . Activity recognition using inertial sensing for healthcare, wellbeing and sports applications: A survey . In 23th International conference on architecture of computing systems 2010. VDE, 1--10. Akin Avci, Stephan Bosch, Mihai Marin-Perianu, Raluca Marin-Perianu, and Paul Havinga. 2010. Activity recognition using inertial sensing for healthcare, wellbeing and sports applications: A survey. In 23th International conference on architecture of computing systems 2010. VDE, 1--10.
  2. Nils Y. Hammerla , Shane Halloran , and Thomas Plötz . 2016 . Deep, Convolutional, and Recurrent Models for Human Activity Recognition Using Wearables . In Proceedings of International Joint Conference on Artificial Intelligence. 1533--1540 . Nils Y. Hammerla, Shane Halloran, and Thomas Plötz. 2016. Deep, Convolutional, and Recurrent Models for Human Activity Recognition Using Wearables. In Proceedings of International Joint Conference on Artificial Intelligence. 1533--1540.
  3. Artur Jordao , Antonio C Nazare Jr , Jessica Sena, and William Robson Schwartz. 2018 . Human activity recognition based on wearable sensor data: A standardization of the state-of-the-art. arXiv preprint arXiv:1806.05226 (2018). Artur Jordao, Antonio C Nazare Jr, Jessica Sena, and William Robson Schwartz. 2018. Human activity recognition based on wearable sensor data: A standardization of the state-of-the-art. arXiv preprint arXiv:1806.05226 (2018). · arXiv
  4. Diederik P Kingma and Jimmy Ba . 2015 . Adam: A method for stochastic optimization . In The International Conference on Learning Representations. Diederik P Kingma and Jimmy Ba. 2015. Adam: A method for stochastic optimization. In The International Conference on Learning Representations.
  5. Yann LeCun , Yoshua Bengio , and Geoffrey Hinton . 2015. Deep learning. Nature 521, 7553 ( 2015 ), 436--444. Yann LeCun, Yoshua Bengio, and Geoffrey Hinton. 2015. Deep learning. Nature 521, 7553 (2015), 436--444.
  6. Andrea Mannini , Mary Rosenberger , William L Haskell , Angelo M Sabatini , and Stephen S Intille . 2017. Activity recognition in youth using single accelerometer placed at wrist or ankle. Medicine and science in sports and exercise 49, 4 ( 2017 ), 801. Andrea Mannini, Mary Rosenberger, William L Haskell, Angelo M Sabatini, and Stephen S Intille. 2017. Activity recognition in youth using single accelerometer placed at wrist or ankle. Medicine and science in sports and exercise 49, 4 (2017), 801.
  7. Vishvak S. Murahari and Thomas Plötz. 2018. On Attention Models for Human Activity Recognition . In Proceedings of International Symposium on Wearable Computers. 100--103 . Vishvak S. Murahari and Thomas Plötz. 2018. On Attention Models for Human Activity Recognition. In Proceedings of International Symposium on Wearable Computers. 100--103.
  8. Adam Paszke , Sam Gross , Soumith Chintala , Gregory Chanan , Edward Yang , Zachary DeVito , Zeming Lin , Alban Desmaison , Luca Antiga , and Adam Lerer . 2017 . Automatic differentiation in Pytorch . In NIPS Autodiff Workshop. Adam Paszke, Sam Gross, Soumith Chintala, Gregory Chanan, Edward Yang, Zachary DeVito, Zeming Lin, Alban Desmaison, Luca Antiga, and Adam Lerer. 2017. Automatic differentiation in Pytorch. In NIPS Autodiff Workshop.
  9. Nishkam Ravi , Nikhil Dandekar , Preetham Mysore , and Michael L. Littman . 2005. Activity recognition from accelerometer data . In Proceedings of the 17th Conference on Innovative Applications of Artificial Intelligence. 1541--1546 . Nishkam Ravi, Nikhil Dandekar, Preetham Mysore, and Michael L. Littman. 2005. Activity recognition from accelerometer data. In Proceedings of the 17th Conference on Innovative Applications of Artificial Intelligence. 1541--1546.
  10. Roberto Luis Shinmoto Torres , Qinfeng Shi , Anton van den Hengel , and Damith C . Ranasinghe . 2017 . A hierarchical model for recognizing alarming states in a batteryless sensor alarm intervention for preventing falls in older people. Pervasive Mob. Comput. 40, C ( 2017), 1--16. Roberto Luis Shinmoto Torres, Qinfeng Shi, Anton van den Hengel, and Damith C. Ranasinghe. 2017. A hierarchical model for recognizing alarming states in a batteryless sensor alarm intervention for preventing falls in older people. Pervasive Mob. Comput. 40, C (2017), 1--16.
  11. Ashish Vaswani Noam Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan N Gomez &Lstroke;ukasz Kaiser and Illia Polosukhin. 2017. Attention is all you need. In Advances in neural information processing systems. 5998--6008. Ashish Vaswani Noam Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan N Gomez &Lstroke;ukasz Kaiser and Illia Polosukhin. 2017. Attention is all you need. In Advances in neural information processing systems. 5998--6008.
  12. 10.5555/2832747.2832806 · doi:10.5555/2832747.2832806
  13. Nenggan Zheng , Jun Wen , Risheng Liu , Liangqu Long , Jianhua Dai , and Zhefeng Gong . 2018 . Unsupervised representation learning with long-term dynamics for skeleton based action recognition . In Thirty-Second AAAI conference on artificial intelligence. Nenggan Zheng, Jun Wen, Risheng Liu, Liangqu Long, Jianhua Dai, and Zhefeng Gong. 2018. Unsupervised representation learning with long-term dynamics for skeleton based action recognition. In Thirty-Second AAAI conference on artificial intelligence.

Cited by

Items 101–163 of 163

Metadata

Authors
Abedin, A., Ehsanpour, M., Shi, Q., Rezatofighi, H., & Ranasinghe, D. C.
Affiliations
  • The University of Adelaide (AU)
  • Monash University (AU)
Venue
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Published
2021-03-19
Volume
5
Issue
1
Pages
1-22
ISSN
2474-9567 (ISSN-L)
OpenAlex
W3144294392
Cited by
107
References
39
Citations by year
2026: 22 · 2025: 21 · 2024: 30 · 2023: 17 · 2022: 16 · 2021: 1
FWCI
5.76
Type
journal article
Language
en
Open access
closed
Locations
Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies (publishedVersion)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
  • Physical Sciences › Engineering › Biomedical Engineering › Gait Recognition and Analysis
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
Keywords
human activity recognition, wearable sensors, multimodal sensor fusion, discriminative feature learning, margin-based loss, gait analysis

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.