CoChat

Coarse-Fine Convolutional Deep-Learning Strategy for Human Activity Recognition

Open access
Avilés-Cruz, Carlos, Ferreyra-Ramírez, Andrés, Zúñiga-López, Arturo, Villegas-Cortéz, Juan · 2019 · Sensors
Cited by 73

The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.

Abstract

In the last decade, deep learning techniques have further improved human activity recognition (HAR) performance on several benchmark datasets. This paper presents a novel framework to classify and analyze human activities. A new convolutional neural network (CNN) strategy is applied to a single user movement recognition using a smartphone. Three parallel CNNs are used for local feature extraction, and latter they are fused in the classification task stage. The whole CNN scheme is based on a feature fusion of a fine-CNN, a medium-CNN, and a coarse-CNN. A tri-axial accelerometer and a tri-axial gyroscope sensor embedded in a smartphone are used to record the acceleration and angle signals. Six human activities successfully classified are walking, walking-upstairs, walking-downstairs, sitting, standing and laying. Performance evaluation is presented for the proposed CNN.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3390/s19071556

Cites

13 of 13 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 33

  1. Chen, 2012, Sensor-based activity recognition, IEEE Trans. Syst. Man Cybern. Part C Appl. Rev., 42, 790, 10.1109/TSMCC.2012.2198883 · DOI · Paper page
  2. Anguita, D., Ghio, A., Oneto, L., Parra, X., and Reyes-Ortiz, J.L. (2013, January 24–26). A Public Domain Dataset for Human Activity Recognition Using Smartphones. Proceedings of the European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning (ESANN 2013), Bruges, Belgium.
  3. Le, T.D., and Nguyen, C.V. (2015, January 16–18). Human Activity Recognition by smartphone. Proceedings of the 2nd National Foundation for Science and Technology Development Conference on Information and Computer Science, Ho Chi Minh City, Vietnam.
  4. Liang, 2014, Energy-Efficient Motion Related Activity Recognition on Mobile Devices for Pervasive Healthcare, Mob. Netw. Appl., 19, 303, 10.1007/s11036-013-0448-9 · DOI
  5. Zhang, M., and Sawchuk, A.A. (2012, January 28–30). Motion Primitive-based Human Activity Recognition Using a Bag-of-features Approach. Proceedings of the 2nd ACM SIGHIT International Health Informatics Symposium, Miami, Florida, USA. · DOI · Paper page
  6. Liu, J., Wang, Z., Zhong, L., Wickramasuriya, J., and Vasudevan, V. (2009, January 9–13). Wave: Accelerometer-Based Personalized Gesture Recognition and Its Applications. Proceedings of the Seventh Annual IEEE International Conference on Pervasive Computing and Communications (PerCom 2009), Galveston, TX, USA. · DOI · Paper page
  7. Lockhart, J.W., Weiss, G.M., Xue, J.C., Gallagher, S.T., Grosner, A.B., and Pulickal, T.T. (2011, January 21). Design Considerations for the WISDM Smart Phone-based Sensor Mining Architecture. Proceedings of the Fifth International Workshop on Knowledge Discovery from Sensor Data (SensorKDD ’11), San Diego, CA, USA. · DOI · Paper page
  8. Zhang, C., Yang, X., Lin, W., and Zhu, J. (2012). Recognizing Human Group Behaviors with Multi-group Causalities. Proceedings of the The 2012 IEEE/WIC/ACM International Joint Conferences on Web Intelligence and Intelligent Agent Technology—Volume 03, IEEE Computer Society. · DOI
  9. Fan, 2013, Video Sensor-Based Complex Scene Analysis with Granger Causality, Sensor, 13, 13685, 10.3390/s131013685 · doi:10.3390/s131013685
  10. Zhou, Z., Li, K., and He, X. (2015, January 26–30). Recognizing Human Activity in Still Images by Integrating Group-Based Contextual Cues. Proceedings of the 23rd ACM International Conference on Multimedia (MM’15), Brisbane, Australia. · doi:10.1145/2733373.2806300
  11. Onofri, 2016, A Survey on Using Domain and Contextual Knowledge for Human Activity Recognition in Video Streams, Expert Syst. Appl., 63, 97, 10.1016/j.eswa.2016.06.011 · DOI
  12. Zheng, 2018, Distinctive action sketch for human action recognition, Signal Process., 144, 323, 10.1016/j.sigpro.2017.10.022 · DOI
  13. Ji, 2018, Skeleton embedded motion body partition for human action recognition using depth sequences, Signal Process., 143, 56, 10.1016/j.sigpro.2017.08.016 · DOI
  14. Ghosh, A., and Riccardi, G. (2014, January 3–7). Recognizing Human Activities from Smartphone Sensor Signals. Proceedings of the 22Nd ACM International Conference on Multimedia (MM’14), Multimedia Orlando, Fl, USA. · DOI
  15. Dao, 2017, Daily Human Activities Recognition Using Heterogeneous Sensors from Smartphones, Procedia Comput. Sci., 111, 323, 10.1016/j.procs.2017.06.030 · DOI
  16. Hui, 2017, Compressed sensing method for human activity recognition using tri-axis accelerometer on mobile phone, J. China Univ. Posts Telecommun., 24, 31, 10.1016/S1005-8885(17)60196-1 · DOI
  17. Harjanto, 2016, Investigating the impact of frame rate towards robust human action recognition, Signal Process., 124, 220, 10.1016/j.sigpro.2015.08.006 · DOI
  18. Kose, M., Incel, O., and Ersoy, C. (2012, January 16–20). Online Human Activity Recognition on Smart Phones. Proceedings of the Workshop on Mobile Sensing: From Smartphones and Wearables to Big Data, Beijing, China.
  19. Thiemjarus, S., Henpraserttae, A., and Marukatat, S. (2013, January 6–9). A study on instance-based learning with reduced training prototypes for device-context-independent activity recognition on a mobile phone. Proceedings of the 2013 IEEE International Conference on Body Sensor Networks (BSN), Cambridge, MA, USA. · DOI
  20. Kim, 2013, Mobile Motion Sensor-Based Human Activity Recognition and Energy Expenditure Estimation in Building Environments, Smart Innov. Syst. Technol., 22, 987, 10.1007/978-3-642-36645-1_87 · DOI
  21. Siirtola, 2012, Recognizing Human Activities User-independently on Smartphones Based on Accelerometer Data, Int. J. Interact. Multimed. Artif. Intell., 1, 38
  22. Zhao, K., Du, J., Li, C., Zhang, C., Liu, H., and Xu, C. (2013, January 14–16). Healthy: A Diary System Based on Activity Recognition Using Smartphone. Proceedings of the 2013 IEEE 10th International Conference on Mobile Ad-Hoc and Sensor Systems (MASS), Hangzhou, China. · DOI
  23. Khan, 2013, Exploratory Data Analysis of Acceleration Signals to Select Light-Weight and Accurate Features for Real-Time Activity Recognition on Smartphones, Sensor, 13, 13099, 10.3390/s131013099 · DOI
  24. Guiry, J., van de Ven, P., and Nelson, J. (2012, January 15–17). Orientation independent human mobility monitoring with an android smartphone. Proceedings of the IASTED International Conference on Assistive Technologies, Innsbruck, Austria. · DOI
  25. Pardo, 2016, Segmenting human activities based on HMMs using smartphone inertial sensors, Pervasive Mob. Comput., 30, 84, 10.1016/j.pmcj.2016.01.004 · DOI
  26. Montero, 2016, Feature extraction from smartphone inertial signals for human activity segmentation, Signal Process., 120, 359, 10.1016/j.sigpro.2015.09.029 · DOI
  27. Cho, 2018, Divide and Conquer-Based 1D CNN Human Activity Recognition Using Test Data Sharpening, Sensors, 18, 1055, 10.3390/s18041055 · DOI · Paper page
  28. Ignatov, 2018, Real-time human activity recognition from accelerometer data using Convolutional Neural Networks, Appl. Soft Comput., 62, 915, 10.1016/j.asoc.2017.09.027 · DOI · Paper page
  29. Yang, J.B., Nguyen, M.N., San, P.P., Li, X.L., and Krishnaswamy, S. (August, January 25). Deep Convolutional Neural Networks on Multichannel Time Series for Human Activity Recognition. Proceedings of the 24th International Conference on Artificial Intelligence (IJCAI’15), Buenos Aires, Argentina.
  30. Inoue, 2018, Deep Recurrent Neural Network for Mobile Human Activity Recognition with High Throughput, Artif. Life Robot., 23, 173, 10.1007/s10015-017-0422-x · DOI · Paper page
  31. Edel, M., and Köppe, E. (2016, January 4–7). Binarized-BLSTM-RNN based Human Activity Recognition. Proceedings of the 2016 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Madrid, Spain. · DOI · Paper page
  32. Kingma, D.P., and Ba, J. (arXiv, 2014). Adam: A Method for Stochastic Optimization, arXiv.
  33. Shakya, 2018, Comparative Study of Machine Learning and Deep Learning Architecture for Human Activity Recognition Using Accelerometer Data, Int. J. Mach. Learn. Comput., 8, 577

Cited by

See all 73

Metadata

Authors
Avilés-Cruz, C., Ferreyra-Ramírez, A., Zúñiga-López, A., & Villegas-Cortéz, J.
Venue
Sensors
Publisher
MDPI AG
Published
2019-03-31
Volume
19
Issue
7
Pages
1556
ISSN
1424-8220 (ISSN-L)
OpenAlex
W2927123024
Cited by
73
References
13
FWCI
4.92
Type
journal article
Language
en
Open access
gold

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.