CoChat

Asymmetric Residual Neural Network for Accurate Human Activity Recognition

Open access
Long, Jun, Sun, Wuqing, Yang, Zhan, Raymond, Osolo Ian · 2019 · Information
Cited by 54

The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.

Abstract

Human activity recognition (HAR) using deep neural networks has become a hot topic in human–computer interaction. Machines can effectively identify human naturalistic activities by learning from a large collection of sensor data. Activity recognition is not only an interesting research problem but also has many real-world practical applications. Based on the success of residual networks in achieving a high level of aesthetic representation of automatic learning, we propose a novel asymmetric residual network, named ARN. ARN is implemented using two identical path frameworks consisting of (1) a short time window, which is used to capture spatial features, and (2) a long time window, which is used to capture fine temporal features. The long time window path can be made very lightweight by reducing its channel capacity, while still being able to learn useful temporal representations for activity recognition. In this paper, we mainly focus on proposing a new model to improve the accuracy of HAR. In order to demonstrate the effectiveness of the ARN model, we carried out extensive experiments on benchmark datasets (i.e., OPPORTUNITY, UniMiB-SHAR) and compared the results with some conventional and state-of-the-art learning-based methods. We discuss the influence of networks parameters on performance to provide insights about its optimization. Results from our experiments show that ARN is effective in recognizing human activities via wearable datasets.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3390/info10060203

Cites

16 of 16 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 16 references

Research works printed but not linked: 30

  1. Sukor, 2019, A hybrid approach of knowledge-driven and data-driven reasoning for activity recognition in smart homes, J. Intell. Fuzzy Syst., 36, 4177, 10.3233/JIFS-169976 · DOI
  2. Xiao, 2017, Participatory Sensing for Smart Cities: A Case Study on Transport Trip Quality Measurement, IEEE Trans. Ind. Inform., 13, 759, 10.1109/TII.2017.2678522 · doi:10.1109/tii.2017.2678522
  3. Fortino, 2019, Advances in multi-sensor fusion for body sensor networks: Algorithms, architectures, and applications, Inf. Fusion, 45, 150, 10.1016/j.inffus.2018.01.012 · DOI
  4. Qiu, 2018, Deep Learning for Automated Extraction of Primary Sites From Cancer Pathology Reports, IEEE J. Biomed. Health Inform., 22, 244, 10.1109/JBHI.2017.2700722 · DOI · Paper page
  5. Oh, 2017, Playing real-time strategy games by imitating human players’ micromanagement skills based on spatial analysis, Expert Syst. Appl., 71, 192, 10.1016/j.eswa.2016.11.026 · DOI
  6. Lisowska, A., O’Neil, A., and Poole, I. (2018, January 19–21). Cross-cohort Evaluation of Machine Learning Approaches to Fall Detection from Accelerometer Data. Proceedings of the 11th International Joint Conference on Biomedical Engineering Systems and Technologies (BIOSTEC 2018)—Volume 5: HEALTHINF, Funchal, Madeira, Portugal. · doi:10.5220/0006554400770082
  7. Attal, 2015, Physical Human Activity Recognition Using Wearable Sensors, Sensors, 15, 31314, 10.3390/s151229858 · DOI · Paper page
  8. Englebienne, 2014, In-Home Activity Recognition: Bayesian Inference for Hidden Markov Models, IEEE Pervasive Comput., 13, 67, 10.1109/MPRV.2014.52 · DOI · Paper page
  9. Ramamurthy, S.R., and Roy, N. (2018). Recent trends in machine learning for human activity recognition—A survey. Wiley Interdiscip. Rev. Data Min. Knowl. Discov., 8. · DOI · Paper page
  10. Gu, 2018, Locomotion Activity Recognition Using Stacked Denoising Autoencoders, IEEE Internet Things J., 5, 2085, 10.1109/JIOT.2018.2823084 · DOI · Paper page
  11. Ioffe, S., and Szegedy, C. (2015, January 6–11). Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift. Proceedings of the 32nd International Conference on Machine Learning, Lille, France.
  12. Veenman, 2010, Visual Word Ambiguity, IEEE Trans. Pattern Anal. Mach. Intell., 32, 1271, 10.1109/TPAMI.2009.132 · DOI · Paper page
  13. Yang, 2019, Deep Attention-Guided Hashing, IEEE Access, 7, 11209, 10.1109/ACCESS.2019.2891894 · DOI
  14. Sarkar, A., Dasgupta, S., Naskar, S.K., and Bandyopadhyay, S. (2018, January 15–20). Says Who? Deep Learning Models for Joint Speech Recognition, Segmentation and Diarization. Proceedings of the 2018 IEEE International Conference on Acoustics, Speech and Signal Processing, Calgary, AB, Canada. · DOI
  15. Kumar, A., Irsoy, O., Ondruska, P., Iyyer, M., Bradbury, J., Gulrajani, I., Zhong, V., Paulus, R., and Socher, R. (2016, January 19–24). Ask Me Anything: Dynamic Memory Networks for Natural Language Processing. Proceedings of the 33nd International Conference on Machine Learning, New York City, NY, USA.
  16. Xu, W., Pang, Y., Yang, Y., and Liu, Y. (2018, January 20–24). Human Activity Recognition Based On Convolutional Neural Network. Proceedings of the 24th International Conference on Pattern Recognition, Beijing, China. · DOI
  17. Neverova, 2016, Learning Human Identity From Motion Patterns, IEEE Access, 4, 1810, 10.1109/ACCESS.2016.2557846 · DOI · Paper page
  18. Yang, J., Nguyen, M.N., San, P.P., Li, X., and Krishnaswamy, S. (2015, January 25–31). Deep Convolutional Neural Networks on Multichannel Time Series for Human Activity Recognition. Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence, Buenos Aires, Argentina.
  19. Yang, 2018, DFTerNet: Towards 2-bit Dynamic Fusion Networks for Accurate Human Activity Recognition, IEEE Access, 6, 56750, 10.1109/ACCESS.2018.2873315 · DOI · Paper page
  20. Milenkoski, M., Trivodaliev, K., Kalajdziski, S., Jovanov, M., and Stojkoska, B.R. (2018, January 21–25). Real time human activity recognition on smartphones using LSTM networks. Proceedings of the 41st International Convention on Information and Communication Technology, Electronics and Microelectronics, Opatija, Croatia. · DOI
  21. Meng, 2018, Human action recognition based on quaternion spatial-temporal convolutional neural network and LSTM in RGB videos, Multimed. Tools Appl., 77, 26901, 10.1007/s11042-018-5893-9 · DOI
  22. Han, J., Kamber, M., and Pei, J. (2011). Data Mining: Concepts and Techniques, Morgan Kaufmann. [3rd ed.].
  23. Baldi, 2016, A theory of local learning, the learning channel, and the optimality of backpropagation, Neural Netw., 83, 51, 10.1016/j.neunet.2016.07.006 · DOI · Paper page
  24. Nair, V., and Hinton, G.E. (2010, January 21–24). Rectified Linear Units Improve Restricted Boltzmann Machines. Proceedings of the 27th International Conference on Machine Learning, Haifa, Israel.
  25. Glorot, X., Bordes, A., and Bengio, Y. (2011, January 11–13). Deep Sparse Rectifier Neural Networks. Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics, Fort Lauderdale, FL, USA.
  26. Pascanu, R., Mikolov, T., and Bengio, Y. (2013, January 16–21). On the difficulty of training recurrent neural networks. Proceedings of the 30th International Conference on Machine Learning, Atlanta, GA, USA.
  27. Carreira, J., and Zisserman, A. (2017, January 21–26). Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA. · DOI · Paper page
  28. Feichtenhofer, C., Pinz, A., and Wildes, R.P. (2016, January 5–10). Spatiotemporal Residual Networks for Video Action Recognition. Proceedings of the Advances in Neural Information Processing Systems 29: Annual Conference on Neural Information Processing Systems 2016, Barcelona, Spain.
  29. Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G.S., Davis, A., Dean, J., and Devin, M. (2016). TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems. arXiv.
  30. Yang, Z., He, X., Gao, J., Deng, L., and Smola, A.J. (2016, January 27–30). Stacked Attention Networks for Image Question Answering. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA. · DOI · Paper page

Cited by

Metadata

Authors
Long, J., Sun, W., Yang, Z., & Raymond, O. I.
Venue
Information
Publisher
MDPI AG
Published
2019-06-06
Volume
10
Issue
6
Pages
203
ISSN
2078-2489 (ISSN-L)
OpenAlex
W2947403743
Cited by
54
References
16
FWCI
2.23
Type
journal article
Language
en
Open access
gold
Funders
  • Key Technology R&D Program of Hunan Province (2018GK2052)
  • Science and Technology Plan of Hunan (2016TP1003)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.