A Recurrent Neural Network Optimization Method for Anticipation of Hierarchical Human Activity
The DOI matches its Crossref record; 59 of the 66 references it cites were found in a registry or an index.
Abstract
Human activity anticipation is a pillar of new interactive multimedia technologies. It enables better human-computer interaction and creative sensory experience in all types of virtual reality-based multimedia applications. Human behaviors are hierarchically constituted in terms of low-level and high-level activities. Fine-grained activities play a substantial role in the early recognition of simple and complex human movements in real-time with low latency, allowing longer predictions in the future. In this paper, a new objective function is proposed to anticipate fine-grained human activities using IMU data, which still suffers from an imbalance problem. Four customized objective surrogate functions are applied in unidirectional and bidirectional recurrent neural networks and compared to efficiently optimize the model considering the loss of individual classes. The experiments on five datasets across proposed loss functions show that the proposed model significantly outperforms the counterpart methods and advances the state-of-the-art. The proposed model shows accuracy scores of up to 98% and 96% for high-level and low-level activities, respectively.Note to Practitioners—There are a large number of methods that can be used for the recognition of human activity in assisted living, smart home technologies, and pervasive healthcare applications. However, studies on these methods tend to focus on recognition rather than anticipation of human activity. Furthermore, they use eithe…
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Boyd, S., & Vandenberghe, L. (2004) · doi:10.1017/cbo9780511804441 · Cited by 56,601
Activity recognition using cell phone accelerometers
Kwapisz, J. R., Weiss, G. M., & Moore, S. A. (2011) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1964897.1964918 · Cited by 2,912 · cited 2×
“WISDM Dataset: the Wireless Sensor Data Mining dataset [43] consists of smartphone data of 36 subjects with a sampling frequency of 20Hz including 1098209 samples.”
MethodDeep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition
Ordóñez, F., & Roggen, D. (2016) · Sensors · doi:10.3390/s16010115 · Cited by 2,761 · cited 1×
“Following [48], 113 features and all 5 activities are selected.”
Background(2013) · RECERCAT (Consorci de Serveis Universitaris de Catalunya) · Cited by 1,959
Human activity recognition with smartphone sensors using deep learning neural networks
Ronao, C. A., & Cho, S.-B. (2016) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.04.032 · Cited by 1,215
The Opportunity challenge: A benchmark database for on-body sensor-based activity recognition
Chavarriaga, R., Sagha, H., Calatroni, A., Digumarti, S. T., Tröster, G., Millán, J. D. R., & Roggen, D. (2013) · Pattern Recognition Letters · doi:10.1016/j.patrec.2012.12.014 · Cited by 742 · cited 2×
“…to show the generalization ability of the proposed method: Opportunity-Locomotion Dataset: The Opportunity dataset is a large-scale multimodal dataset of human activities [42] simulating the daily life environment inside a studio flat and is annotated for both high-level and low-level activities.”
MethodTransition-Aware Human Activity Recognition Using Smartphones
Reyes-Ortiz, J.-L., Oneto, L., Samà, A., Parra, X., & Anguita, D. (2016) · Neurocomputing · doi:10.1016/j.neucom.2015.07.085 · Cited by 740 · cited 2×
“…were carried out on five datasets, including four publicly available HAR datasets: Opportunity-locomotion [42], WISDM [43], UCI HAPT dataset [44], UCI HAR dataset [45], and one dataset collected by the Laboratory of Images, Signals and Intelligent Systems (LISSI) at the University of…”
MethodKitani, K. M., Ziebart, B. D., Bagnell, J. A., & Hebert, M. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33765-9_15 · Cited by 701
Deep, Convolutional, and Recurrent Models for Human Activity Recognition Using Wearables
Hammerla, N. Y., Halloran, S., & Ploetz, T. (2016) · arXiv · doi:10.48550/arxiv.1604.08880 · Cited by 606
Anticipating Human Activities Using Object Affordances for Reactive Robotic Response
Koppula, H. S., & Saxena, A. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2430335 · Cited by 596
Research works printed but not linked: 2
- Li, ARMA-HMM: A new approach for early recognition of human activity, 1779
- Goodfellow, 2016, Deep Learning
Cited by
Dia, M., Khodabandelou, G., Anwar, S. M., & Othmani, A. (2025) · Scientific Reports · doi:10.1038/s41598-025-98264-w · Cited by 11
Self-citationWang, Y., Zhao, P., & Sun, J. (2026) · IEEE Transactions on NanoBioscience · doi:10.1109/tnb.2026.3673367
“In RNN, the state of each recurrent layer at the current moment is determined by both the current input and the state of the previous moment, which makes it highly flexible when processing sequential data [27], [28].”
Wang, Q., Ma, J., Fu, M., Wang, J., Bai, Y. B., Jiang, Z., & Li, H. (2026) · iScience · doi:10.1016/j.isci.2026.115252
Activity recognition via Riemannian optimization and multimodal Transformers
Soleimani, F., Khodabandelou, G., Chibani, A., & Amirat, Y. (2026) · Machine Learning with Applications · doi:10.1016/j.mlwa.2026.101021
Self-citation
Metadata
- Authors
- Khodabandelou, G., Chibani, A., Amirat, Y., & Tanimoto, S.
- Affiliations
- Université Paris-Est Créteil (FR)
- University of Washington (US)
- Venue
- IEEE Transactions on Automation Science and Engineering
- Published
- 2024-07
- Volume
- 21
- Issue
- 3
- Pages
- 4657-4673
- ISSN
- 1545-5955 (ISSN-L)
- 1558-3783
- OpenAlex
- W4385732061
- Cited by
- 4
- References
- 66
- Citations by year
- 2026: 3 · 2025: 1
- FWCI
- 0.36
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Automation Science and Engineering (publishedVersion)
- HAL (submittedVersion)
- Funders
- E-Corridor Project
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Physical Sciences › Computer Science › Human-Computer Interaction › Hand Gesture Recognition Systems
- Keywords
- recurrent neural networks, bidirectional LSTM, class imbalance, IMU data, virtual reality interaction, human movement prediction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A Recurrent Neural Network Optimization Method for Anticipation of Hierarchical Human Activity. https://app.cochat.ai/papers/10.1109/tase.2023.3300821
- The paper
- Khodabandelou, G., Chibani, A., Amirat, Y., & Tanimoto, S. (2024). A Recurrent Neural Network Optimization Method for Anticipation of Hierarchical Human Activity. IEEE Transactions on Automation Science and Engineering. https://doi.org/10.1109/tase.2023.3300821
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.