Understanding and improving recurrent networks for human activity recognition by continuous attention
The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
Deep neural networks, including recurrent networks, have been successfully applied to human activity recognition. Unfortunately, the final representation learned by recurrent networks might encode some noise (irrelevant signal components, unimportant sensor modalities, etc.). Besides, it is difficult to interpret the recurrent networks to gain insight into the models' behavior. To address these issues, we propose two attention models for human activity recognition: temporal attention and sensor attention. These two mechanisms adaptively focus on important signals and sensor modalities. To further improve the understandability and mean Fl score, we add continuity constraints, considering that continuous sensor signals are more robust than discrete ones. We evaluate the approaches on three datasets and obtain state-of-the-art results. Furthermore, qualitative analysis shows that the attention learned by the models agree well with human intuition.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Temporal attention was applied by Murahari et al. [138] whereas continuous sensor and temporal attention were evaluated by Zeng et al. [214], both leading to increased performance.”
From Past, Present, and Future of Sensor-based Human Activity Recognition Using Wearables: A Surveying Tutorial on a Still Challenging Task (2025) · cites this paper as [214]
The cited source says what the claim attributes to it.
In the citing paper
“[226] applies temporal attention and sensor attention into LSTM to improve the overall activity recognition accuracy by adaptively focusing on important time windows and sensor modalities.”
From Deep Learning in Human Activity Recognition with Wearable Sensors: A Review on Advances (2022) · cites this paper as [226]
In the citing paper
“The squeeze-and-excitation network (SENet) [15] is one of the representative methods, which brings clear performance gain across various deep CNN architectures via learning channel attention for each convolution block.”
From DanHAR: Dual Attention Network for multimodal human activity recognition using wearable sensors (2021) · cites this paper as [15]
In the citing paper
“SENet [15] for the first time proposes an effective mechanism to learn channel attention and achieves promising performance.”
From DanHAR: Dual Attention Network for multimodal human activity recognition using wearable sensors (2021) · cites this paper as [15]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · cited 8×
“Models PAMAP2 DG Skoda4 LSTM baseline ([12]) (LSTM without Attention) 0.”
BackgroundMethodResultInfluentialNeural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213 · cited 4×
“The attention approach is proposed to mitigate this problem for speech and natural language processing (NLP) [3, 14], and it offers means to explicate the inner workings of neural networks.”
BackgroundInfluentialApproximation by superpositions of a sigmoidal function
Cybenko, G. (1989) · Mathematics of Control, Signals, and Systems · doi:10.1007/bf02551274 · Cited by 13,883
Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
Xu, K., Ba, J., Kiros, R., Cho, K., Courville, A., Salakhutdinov, R., Zemel, R., & Bengio, Y. (2015) · arXiv · doi:10.48550/arxiv.1502.03044 · Cited by 8,248
Activity Recognition from User-Annotated Acceleration Data
Bao, L., & Intille, S. S. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24646-6_1 · Cited by 3,147 · cited 4×
“RECOGNITION We frame HAR as a sequence classification problem [4].”
BackgroundMethodInfluentialDeep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition
Ordóñez, F., & Roggen, D. (2016) · Sensors · doi:10.3390/s16010115 · Cited by 2,761 · cited 4×
“The baseline methods include standard LSTM [12], DeepConvLSTM [19], and LSTM-S (LSTM + sample-by-sample analysis) [11].”
BackgroundMethodInfluentialAttention-Based Models for Speech Recognition
Chorowski, J., Bahdanau, D., Serdyuk, D., Cho, K., & Bengio, Y. (2015) · arXiv · doi:10.48550/arxiv.1506.07503 · Cited by 2,021 · cited 1×
“Deep neural networks (DNNs) has had revolutionary impact in speech recognition [7], image classification [24], and machine translation [3].”
BackgroundA tutorial on human activity recognition using body-worn inertial sensors
Bulling, A., Blanke, U., & Schiele, B. (2014) · ACM Computing Surveys · doi:10.1145/2499621 · Cited by 1,668 · cited 2×
“INTRODUCTION Wearable-based human activity recognition (HAR) systems are an indispensable component in mobile ubiquitous computing and human-computer interaction [5].”
BackgroundIntroducing a New Benchmarked Dataset for Activity Monitoring
Reiss, A., & Stricker, D. (2012) · 2012 16th International Symposium on Wearable Computers · doi:10.1109/iswc.2012.13 · Cited by 1,456 · cited 1×
“The first is the PAMAP2 dataset (Physical Activity Monitoring for Aging People 2) [21].”
Background(2015) · Cited by 989
Research works printed but not linked: 1
- Nils Y Hammerla , Shane Halloran , and Thomas Ploetz . 2016. Deep , convolutional, and recurrent models for human activity recognition using wearables. IJCAI ( 2016 ). Nils Y Hammerla, Shane Halloran, and Thomas Ploetz. 2016. Deep, convolutional, and recurrent models for human activity recognition using wearables. IJCAI (2016).
Cited by
Deep Learning in Human Activity Recognition with Wearable Sensors: A Review on Advances
Zhang, S., Li, Y., Zhang, S., Shahabi, F., Xia, S., Deng, Y., & Alshurafa, N. (2022) · Sensors · doi:10.3390/s22041476 · Cited by 625
“Their method has outperformed regular CNN considerably on a number of public datasets such as PAMAP2 [228], WISDM [155], UNIMIB SHAR [188], and Opportunity [59].”
BackgroundMethodInfluentialDeep Learning for Sensor-based Human Activity Recognition
Chen, K., Zhang, D., Yao, L., Guo, B., Yu, Z., & Liu, Y. (2022) · ACM Computing Surveys · doi:10.1145/3447744 · Cited by 690
Multi-input CNN-GRU based human activity recognition using wearable sensors
Dua, N., Singh, S. N., & Semwal, V. B. (2021) · Computing · doi:10.1007/s00607-021-00928-8 · Cited by 432
“The proposed model is compared with the models presented in [17, 20–22, 36, 37, 49–52].”
MethodDeep PPG: Large-Scale Heart Rate Estimation with Convolutional Neural Networks
Reiss, A., Indlekofer, I., Schmidt, P., & Van Laerhoven, K. (2019) · Sensors · doi:10.3390/s19143079 · Cited by 377
“Deep learning has already been applied to various time-series signals, such as for human activity recognition [20–22] or gait parameter extraction [23].”
MethodDeep Learning for Sensor-based Human Activity Recognition: Overview, Challenges and Opportunities
Chen, K., Zhang, D., Yao, L., Guo, B., Yu, Z., & Liu, Y. (2020) · arXiv · doi:10.48550/arxiv.2001.07416 · Cited by 314
Metadata
- Authors
- Zeng, M., Gao, H., Yu, T., Mengshoel, O. J., Langseth, H., Lane, I., & Liu, X.
- Affiliations
- Carnegie Mellon University (US)
- The Norwegian University of Science and Technology
- Google (United States) (US)
- Venue
- Proceedings of the 2018 ACM International Symposium on Wearable Computers
- Publisher
- ACM
- Published
- 2018-10-08
- Pages
- 56-63
- OpenAlex
- W2894702700
- Cited by
- 185
- References
- 30
- Citations by year
- 2026: 6 · 2025: 18 · 2024: 32 · 2023: 25 · 2022: 35 · 2021: 37 · 2020: 19 · 2019: 13
- FWCI
- 5.20
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM International Symposium on Wearable Computers (ISWC) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Physical Sciences › Engineering › Biomedical Engineering › Gait Recognition and Analysis
- Keywords
- human activity recognition, recurrent neural networks, attention mechanism, temporal attention, interpretability, noise robustness, continuity constraints
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Understanding and improving recurrent networks for human activity recognition by continuous attention. https://app.cochat.ai/papers/10.1145/3267242.3267286
- The paper
- Zeng, M., Gao, H., Yu, T., Mengshoel, O. J., Langseth, H., Lane, I., & Liu, X. (2018). Understanding and improving recurrent networks for human activity recognition by continuous attention. Proceedings of the 2018 ACM International Symposium on Wearable Computers. https://doi.org/10.1145/3267242.3267286
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.