Asymmetric Residual Neural Network for Accurate Human Activity Recognition
Open accessThe DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
Human activity recognition (HAR) using deep neural networks has become a hot topic in human–computer interaction. Machines can effectively identify human naturalistic activities by learning from a large collection of sensor data. Activity recognition is not only an interesting research problem but also has many real-world practical applications. Based on the success of residual networks in achieving a high level of aesthetic representation of automatic learning, we propose a novel asymmetric residual network, named ARN. ARN is implemented using two identical path frameworks consisting of (1) a short time window, which is used to capture spatial features, and (2) a long time window, which is used to capture fine temporal features. The long time window path can be made very lightweight by reducing its channel capacity, while still being able to learn useful temporal representations for activity recognition. In this paper, we mainly focus on proposing a new model to improve the accuracy of HAR. In order to demonstrate the effectiveness of the ARN model, we carried out extensive experiments on benchmark datasets (i.e., OPPORTUNITY, UniMiB-SHAR) and compared the results with some conventional and state-of-the-art learning-based methods. We discuss the influence of networks parameters on performance to provide insights about its optimization. Results from our experiments show that ARN is effective in recognizing human activities via wearable datasets.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Wang, X., Girshick, R., Gupta, A., & He, K. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00813 · Cited by 11,596
SlowFast Networks for Video Recognition
Feichtenhofer, C., Fan, H., Malik, J., & He, K. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00630 · Cited by 4,007
Activity Recognition from User-Annotated Acceleration Data
Bao, L., & Intille, S. S. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24646-6_1 · Cited by 3,147
Activity recognition using cell phone accelerometers
Kwapisz, J. R., Weiss, G. M., & Moore, S. A. (2011) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1964897.1964918 · Cited by 2,912
Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition
Ordóñez, F., & Roggen, D. (2016) · Sensors · doi:10.3390/s16010115 · Cited by 2,761
Collecting complex activity datasets in highly rich networked sensor environments
Roggen, D., Calatroni, A., Rossi, M., Holleczek, T., Forster, K., Troster, G., Lukowicz, P., Bannach, D., Pirkl, G., Ferscha, A., et al. (2010) · 2010 Seventh International Conference on Networked Sensing Systems (INSS) · doi:10.1109/inss.2010.5573462 · Cited by 788
Deep, Convolutional, and Recurrent Models for Human Activity Recognition Using Wearables
Hammerla, N. Y., Halloran, S., & Ploetz, T. (2016) · arXiv · doi:10.48550/arxiv.1604.08880 · Cited by 606
UniMiB SHAR: A Dataset for Human Activity Recognition Using Acceleration Data from Smartphones
Micucci, D., Mobilio, M., & Napoletano, P. (2017) · doi:10.20944/preprints201706.0033.v1 · Cited by 596
UniMiB SHAR: A Dataset for Human Activity Recognition Using Acceleration Data from Smartphones
Micucci, D., Mobilio, M., & Napoletano, P. (2017) · Applied Sciences · doi:10.3390/app7101101 · Cited by 596
Research works printed but not linked: 30
- Sukor, 2019, A hybrid approach of knowledge-driven and data-driven reasoning for activity recognition in smart homes, J. Intell. Fuzzy Syst., 36, 4177, 10.3233/JIFS-169976 · DOI
- Xiao, 2017, Participatory Sensing for Smart Cities: A Case Study on Transport Trip Quality Measurement, IEEE Trans. Ind. Inform., 13, 759, 10.1109/TII.2017.2678522 · doi:10.1109/tii.2017.2678522
- Fortino, 2019, Advances in multi-sensor fusion for body sensor networks: Algorithms, architectures, and applications, Inf. Fusion, 45, 150, 10.1016/j.inffus.2018.01.012 · DOI
- Qiu, 2018, Deep Learning for Automated Extraction of Primary Sites From Cancer Pathology Reports, IEEE J. Biomed. Health Inform., 22, 244, 10.1109/JBHI.2017.2700722 · DOI · Paper page
- Oh, 2017, Playing real-time strategy games by imitating human players’ micromanagement skills based on spatial analysis, Expert Syst. Appl., 71, 192, 10.1016/j.eswa.2016.11.026 · DOI
- Lisowska, A., O’Neil, A., and Poole, I. (2018, January 19–21). Cross-cohort Evaluation of Machine Learning Approaches to Fall Detection from Accelerometer Data. Proceedings of the 11th International Joint Conference on Biomedical Engineering Systems and Technologies (BIOSTEC 2018)—Volume 5: HEALTHINF, Funchal, Madeira, Portugal. · doi:10.5220/0006554400770082
- Attal, 2015, Physical Human Activity Recognition Using Wearable Sensors, Sensors, 15, 31314, 10.3390/s151229858 · DOI · Paper page
- Englebienne, 2014, In-Home Activity Recognition: Bayesian Inference for Hidden Markov Models, IEEE Pervasive Comput., 13, 67, 10.1109/MPRV.2014.52 · DOI · Paper page
- Ramamurthy, S.R., and Roy, N. (2018). Recent trends in machine learning for human activity recognition—A survey. Wiley Interdiscip. Rev. Data Min. Knowl. Discov., 8. · DOI · Paper page
- Gu, 2018, Locomotion Activity Recognition Using Stacked Denoising Autoencoders, IEEE Internet Things J., 5, 2085, 10.1109/JIOT.2018.2823084 · DOI · Paper page
- Ioffe, S., and Szegedy, C. (2015, January 6–11). Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift. Proceedings of the 32nd International Conference on Machine Learning, Lille, France.
- Veenman, 2010, Visual Word Ambiguity, IEEE Trans. Pattern Anal. Mach. Intell., 32, 1271, 10.1109/TPAMI.2009.132 · DOI · Paper page
- Yang, 2019, Deep Attention-Guided Hashing, IEEE Access, 7, 11209, 10.1109/ACCESS.2019.2891894 · DOI
- Sarkar, A., Dasgupta, S., Naskar, S.K., and Bandyopadhyay, S. (2018, January 15–20). Says Who? Deep Learning Models for Joint Speech Recognition, Segmentation and Diarization. Proceedings of the 2018 IEEE International Conference on Acoustics, Speech and Signal Processing, Calgary, AB, Canada. · DOI
- Kumar, A., Irsoy, O., Ondruska, P., Iyyer, M., Bradbury, J., Gulrajani, I., Zhong, V., Paulus, R., and Socher, R. (2016, January 19–24). Ask Me Anything: Dynamic Memory Networks for Natural Language Processing. Proceedings of the 33nd International Conference on Machine Learning, New York City, NY, USA.
- Xu, W., Pang, Y., Yang, Y., and Liu, Y. (2018, January 20–24). Human Activity Recognition Based On Convolutional Neural Network. Proceedings of the 24th International Conference on Pattern Recognition, Beijing, China. · DOI
- Neverova, 2016, Learning Human Identity From Motion Patterns, IEEE Access, 4, 1810, 10.1109/ACCESS.2016.2557846 · DOI · Paper page
- Yang, J., Nguyen, M.N., San, P.P., Li, X., and Krishnaswamy, S. (2015, January 25–31). Deep Convolutional Neural Networks on Multichannel Time Series for Human Activity Recognition. Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence, Buenos Aires, Argentina.
- Yang, 2018, DFTerNet: Towards 2-bit Dynamic Fusion Networks for Accurate Human Activity Recognition, IEEE Access, 6, 56750, 10.1109/ACCESS.2018.2873315 · DOI · Paper page
- Milenkoski, M., Trivodaliev, K., Kalajdziski, S., Jovanov, M., and Stojkoska, B.R. (2018, January 21–25). Real time human activity recognition on smartphones using LSTM networks. Proceedings of the 41st International Convention on Information and Communication Technology, Electronics and Microelectronics, Opatija, Croatia. · DOI
- Meng, 2018, Human action recognition based on quaternion spatial-temporal convolutional neural network and LSTM in RGB videos, Multimed. Tools Appl., 77, 26901, 10.1007/s11042-018-5893-9 · DOI
- Han, J., Kamber, M., and Pei, J. (2011). Data Mining: Concepts and Techniques, Morgan Kaufmann. [3rd ed.].
- Baldi, 2016, A theory of local learning, the learning channel, and the optimality of backpropagation, Neural Netw., 83, 51, 10.1016/j.neunet.2016.07.006 · DOI · Paper page
- Nair, V., and Hinton, G.E. (2010, January 21–24). Rectified Linear Units Improve Restricted Boltzmann Machines. Proceedings of the 27th International Conference on Machine Learning, Haifa, Israel.
- Glorot, X., Bordes, A., and Bengio, Y. (2011, January 11–13). Deep Sparse Rectifier Neural Networks. Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics, Fort Lauderdale, FL, USA.
- Pascanu, R., Mikolov, T., and Bengio, Y. (2013, January 16–21). On the difficulty of training recurrent neural networks. Proceedings of the 30th International Conference on Machine Learning, Atlanta, GA, USA.
- Carreira, J., and Zisserman, A. (2017, January 21–26). Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA. · DOI · Paper page
- Feichtenhofer, C., Pinz, A., and Wildes, R.P. (2016, January 5–10). Spatiotemporal Residual Networks for Video Action Recognition. Proceedings of the Advances in Neural Information Processing Systems 29: Annual Conference on Neural Information Processing Systems 2016, Barcelona, Spain.
- Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G.S., Davis, A., Dean, J., and Devin, M. (2016). TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems. arXiv.
- Yang, Z., He, X., Gao, J., Deng, L., and Smola, A.J. (2016, January 27–30). Stacked Attention Networks for Image Question Answering. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA. · DOI · Paper page
Cited by
Multiscale Deep Feature Learning for Human Activity Recognition Using Wearable Sensors
Tang, Y., Zhang, L., Min, F., & He, J. (2023) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2022.3161812 · Cited by 224
Mekruksavanich, S., & Jitpattanakul, A. (2023) · Scientific Reports · doi:10.1038/s41598-023-39080-y · Cited by 75
Cheng, D., Zhang, L., Bu, C., Wu, H., & Song, A. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.110789 · Cited by 55
Human Activity Recognition Data Analysis: History, Evolutions, and New Trends
Ariza-Colpas, P. P., Vicario, E., Oviedo-Carrascal, A. I., Butt Aziz, S., Piñeres-Melo, M. A., Quintero-Linero, A., & Patara, F. (2022) · Sensors · doi:10.3390/s22093401 · Cited by 52
“Long [156] in turn uses the Opportunity and Uni-MiB-SAHR Dataset with the algorithms HC, CBH, CBS, AE, MLP, CNN, LSTM, Hybrid, ResNet, and ARN were the results of RNA of 90.29% and 76.39%.”
InfluentialFilterNet: A Many-to-Many Deep Learning Architecture for Time Series Classification
(2020) · doi:10.3390/s20092498 · Cited by 17
Metadata
- Authors
- Long, J., Sun, W., Yang, Z., & Raymond, O. I.
- Venue
- Information
- Publisher
- MDPI AG
- Published
- 2019-06-06
- Volume
- 10
- Issue
- 6
- Pages
- 203
- ISSN
- 2078-2489 (ISSN-L)
- OpenAlex
- W2947403743
- Cited by
- 54
- References
- 16
- FWCI
- 2.23
- Type
- journal article
- Language
- en
- Open access
- gold
- Funders
- Key Technology R&D Program of Hunan Province (2018GK2052)
- Science and Technology Plan of Hunan (2016TP1003)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.