Coarse-Fine Convolutional Deep-Learning Strategy for Human Activity Recognition
Open accessThe DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
In the last decade, deep learning techniques have further improved human activity recognition (HAR) performance on several benchmark datasets. This paper presents a novel framework to classify and analyze human activities. A new convolutional neural network (CNN) strategy is applied to a single user movement recognition using a smartphone. Three parallel CNNs are used for local feature extraction, and latter they are fused in the classification task stage. The whole CNN scheme is based on a feature fusion of a fine-CNN, a medium-CNN, and a coarse-CNN. A tri-axial accelerometer and a tri-axial gyroscope sensor embedded in a smartphone are used to record the acceleration and angle signals. Six human activities successfully classified are walking, walking-upstairs, walking-downstairs, sitting, standing and laying. Performance evaluation is presented for the proposed CNN.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Activity recognition using cell phone accelerometers
Kwapisz, J. R., Weiss, G. M., & Moore, S. A. (2011) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1964897.1964918 · Cited by 2,912 · cited 3×
“To test our proposal, this paper, uses a second standard HAR dataset which is publicly available from the WISDM group [13].”
MethodDeep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition
Ordóñez, F., & Roggen, D. (2016) · Sensors · doi:10.3390/s16010115 · Cited by 2,761
A Survey on Human Activity Recognition using Wearable Sensors
Lara, O. D., & Labrador, M. A. (2013) · IEEE Communications Surveys & Tutorials · doi:10.1109/surv.2012.110112.00192 · Cited by 2,662
A survey of mobile phone sensing
Lane, N., Miluzzo, E., Lu, H., Peebles, D., Choudhury, T., & Campbell, A. (2010) · IEEE Communications Magazine · doi:10.1109/mcom.2010.5560598 · Cited by 2,292
Human activity recognition with smartphone sensors using deep learning neural networks
Ronao, C. A., & Cho, S.-B. (2016) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.04.032 · Cited by 1,215
Convolutional Neural Networks for Human Activity Recognition using Mobile Sensors
Zeng, M., Nguyen, L. T., Yu, B., Mengshoel, O. J., Zhu, J., Wu, P., & Zhang, J. (2014) · Proceedings of the 6th International Conference on Mobile Computing, Applications and Services · doi:10.4108/icst.mobicase.2014.257786 · Cited by 876
Collecting complex activity datasets in highly rich networked sensor environments
Roggen, D., Calatroni, A., Rossi, M., Holleczek, T., Forster, K., Troster, G., Lukowicz, P., Bannach, D., Pirkl, G., Ferscha, A., et al. (2010) · 2010 Seventh International Conference on Networked Sensing Systems (INSS) · doi:10.1109/inss.2010.5573462 · Cited by 788
Human Activity Recognition Using Wearable Sensors by Deep Convolutional Neural Networks
Jiang, W., & Yin, Z. (2015) · Proceedings of the 23rd ACM international conference on Multimedia · doi:10.1145/2733373.2806333 · Cited by 676
UniMiB SHAR: A Dataset for Human Activity Recognition Using Acceleration Data from Smartphones
Micucci, D., Mobilio, M., & Napoletano, P. (2017) · doi:10.20944/preprints201706.0033.v1 · Cited by 596
UniMiB SHAR: A Dataset for Human Activity Recognition Using Acceleration Data from Smartphones
Micucci, D., Mobilio, M., & Napoletano, P. (2017) · Applied Sciences · doi:10.3390/app7101101 · Cited by 596
Research works printed but not linked: 33
- Chen, 2012, Sensor-based activity recognition, IEEE Trans. Syst. Man Cybern. Part C Appl. Rev., 42, 790, 10.1109/TSMCC.2012.2198883 · DOI · Paper page
- Anguita, D., Ghio, A., Oneto, L., Parra, X., and Reyes-Ortiz, J.L. (2013, January 24–26). A Public Domain Dataset for Human Activity Recognition Using Smartphones. Proceedings of the European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning (ESANN 2013), Bruges, Belgium.
- Le, T.D., and Nguyen, C.V. (2015, January 16–18). Human Activity Recognition by smartphone. Proceedings of the 2nd National Foundation for Science and Technology Development Conference on Information and Computer Science, Ho Chi Minh City, Vietnam.
- Liang, 2014, Energy-Efficient Motion Related Activity Recognition on Mobile Devices for Pervasive Healthcare, Mob. Netw. Appl., 19, 303, 10.1007/s11036-013-0448-9 · DOI
- Zhang, M., and Sawchuk, A.A. (2012, January 28–30). Motion Primitive-based Human Activity Recognition Using a Bag-of-features Approach. Proceedings of the 2nd ACM SIGHIT International Health Informatics Symposium, Miami, Florida, USA. · DOI · Paper page
- Liu, J., Wang, Z., Zhong, L., Wickramasuriya, J., and Vasudevan, V. (2009, January 9–13). Wave: Accelerometer-Based Personalized Gesture Recognition and Its Applications. Proceedings of the Seventh Annual IEEE International Conference on Pervasive Computing and Communications (PerCom 2009), Galveston, TX, USA. · DOI · Paper page
- Lockhart, J.W., Weiss, G.M., Xue, J.C., Gallagher, S.T., Grosner, A.B., and Pulickal, T.T. (2011, January 21). Design Considerations for the WISDM Smart Phone-based Sensor Mining Architecture. Proceedings of the Fifth International Workshop on Knowledge Discovery from Sensor Data (SensorKDD ’11), San Diego, CA, USA. · DOI · Paper page
- Zhang, C., Yang, X., Lin, W., and Zhu, J. (2012). Recognizing Human Group Behaviors with Multi-group Causalities. Proceedings of the The 2012 IEEE/WIC/ACM International Joint Conferences on Web Intelligence and Intelligent Agent Technology—Volume 03, IEEE Computer Society. · DOI
- Fan, 2013, Video Sensor-Based Complex Scene Analysis with Granger Causality, Sensor, 13, 13685, 10.3390/s131013685 · doi:10.3390/s131013685
- Zhou, Z., Li, K., and He, X. (2015, January 26–30). Recognizing Human Activity in Still Images by Integrating Group-Based Contextual Cues. Proceedings of the 23rd ACM International Conference on Multimedia (MM’15), Brisbane, Australia. · doi:10.1145/2733373.2806300
- Onofri, 2016, A Survey on Using Domain and Contextual Knowledge for Human Activity Recognition in Video Streams, Expert Syst. Appl., 63, 97, 10.1016/j.eswa.2016.06.011 · DOI
- Zheng, 2018, Distinctive action sketch for human action recognition, Signal Process., 144, 323, 10.1016/j.sigpro.2017.10.022 · DOI
- Ji, 2018, Skeleton embedded motion body partition for human action recognition using depth sequences, Signal Process., 143, 56, 10.1016/j.sigpro.2017.08.016 · DOI
- Ghosh, A., and Riccardi, G. (2014, January 3–7). Recognizing Human Activities from Smartphone Sensor Signals. Proceedings of the 22Nd ACM International Conference on Multimedia (MM’14), Multimedia Orlando, Fl, USA. · DOI
- Dao, 2017, Daily Human Activities Recognition Using Heterogeneous Sensors from Smartphones, Procedia Comput. Sci., 111, 323, 10.1016/j.procs.2017.06.030 · DOI
- Hui, 2017, Compressed sensing method for human activity recognition using tri-axis accelerometer on mobile phone, J. China Univ. Posts Telecommun., 24, 31, 10.1016/S1005-8885(17)60196-1 · DOI
- Harjanto, 2016, Investigating the impact of frame rate towards robust human action recognition, Signal Process., 124, 220, 10.1016/j.sigpro.2015.08.006 · DOI
- Kose, M., Incel, O., and Ersoy, C. (2012, January 16–20). Online Human Activity Recognition on Smart Phones. Proceedings of the Workshop on Mobile Sensing: From Smartphones and Wearables to Big Data, Beijing, China.
- Thiemjarus, S., Henpraserttae, A., and Marukatat, S. (2013, January 6–9). A study on instance-based learning with reduced training prototypes for device-context-independent activity recognition on a mobile phone. Proceedings of the 2013 IEEE International Conference on Body Sensor Networks (BSN), Cambridge, MA, USA. · DOI
- Kim, 2013, Mobile Motion Sensor-Based Human Activity Recognition and Energy Expenditure Estimation in Building Environments, Smart Innov. Syst. Technol., 22, 987, 10.1007/978-3-642-36645-1_87 · DOI
- Siirtola, 2012, Recognizing Human Activities User-independently on Smartphones Based on Accelerometer Data, Int. J. Interact. Multimed. Artif. Intell., 1, 38
- Zhao, K., Du, J., Li, C., Zhang, C., Liu, H., and Xu, C. (2013, January 14–16). Healthy: A Diary System Based on Activity Recognition Using Smartphone. Proceedings of the 2013 IEEE 10th International Conference on Mobile Ad-Hoc and Sensor Systems (MASS), Hangzhou, China. · DOI
- Khan, 2013, Exploratory Data Analysis of Acceleration Signals to Select Light-Weight and Accurate Features for Real-Time Activity Recognition on Smartphones, Sensor, 13, 13099, 10.3390/s131013099 · DOI
- Guiry, J., van de Ven, P., and Nelson, J. (2012, January 15–17). Orientation independent human mobility monitoring with an android smartphone. Proceedings of the IASTED International Conference on Assistive Technologies, Innsbruck, Austria. · DOI
- Pardo, 2016, Segmenting human activities based on HMMs using smartphone inertial sensors, Pervasive Mob. Comput., 30, 84, 10.1016/j.pmcj.2016.01.004 · DOI
- Montero, 2016, Feature extraction from smartphone inertial signals for human activity segmentation, Signal Process., 120, 359, 10.1016/j.sigpro.2015.09.029 · DOI
- Cho, 2018, Divide and Conquer-Based 1D CNN Human Activity Recognition Using Test Data Sharpening, Sensors, 18, 1055, 10.3390/s18041055 · DOI · Paper page
- Ignatov, 2018, Real-time human activity recognition from accelerometer data using Convolutional Neural Networks, Appl. Soft Comput., 62, 915, 10.1016/j.asoc.2017.09.027 · DOI · Paper page
- Yang, J.B., Nguyen, M.N., San, P.P., Li, X.L., and Krishnaswamy, S. (August, January 25). Deep Convolutional Neural Networks on Multichannel Time Series for Human Activity Recognition. Proceedings of the 24th International Conference on Artificial Intelligence (IJCAI’15), Buenos Aires, Argentina.
- Inoue, 2018, Deep Recurrent Neural Network for Mobile Human Activity Recognition with High Throughput, Artif. Life Robot., 23, 173, 10.1007/s10015-017-0422-x · DOI · Paper page
- Edel, M., and Köppe, E. (2016, January 4–7). Binarized-BLSTM-RNN based Human Activity Recognition. Proceedings of the 2016 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Madrid, Spain. · DOI · Paper page
- Kingma, D.P., and Ba, J. (arXiv, 2014). Adam: A Method for Stochastic Optimization, arXiv.
- Shakya, 2018, Comparative Study of Machine Learning and Deep Learning Architecture for Human Activity Recognition Using Accelerometer Data, Int. J. Mach. Learn. Comput., 8, 577
Cited by
Ramanujam, E., Perumal, T., & Padmavathi, S. (2021) · IEEE Sensors Journal · doi:10.1109/jsen.2021.3069927 · Cited by 455
Sensor-data augmentation for human activity recognition with time-warping and data masking
Jeong, C. Y., Shin, H. C., & Kim, M. (2021) · Multimedia Tools and Applications · doi:10.1007/s11042-021-10600-0 · Cited by 38
Trujillo-Guerrero, M. F., Román-Niemes, S., Jaén-Vargas, M., Cadiz, A., Fonseca, R., & Serrano-Olmedo, J. J. (2023) · IEEE Access · doi:10.1109/access.2023.3318563 · Cited by 28
“Most HAR studies [7], [10], [16], [17], [18], [19], [20], and [21], perform exercises that involve the entire human body and differ one from each other such as walking, climbing stairs, sitting, jumping, or running.”
BackgroundMethod
Metadata
- Authors
- Avilés-Cruz, C., Ferreyra-Ramírez, A., Zúñiga-López, A., & Villegas-Cortéz, J.
- Venue
- Sensors
- Publisher
- MDPI AG
- Published
- 2019-03-31
- Volume
- 19
- Issue
- 7
- Pages
- 1556
- ISSN
- 1424-8220 (ISSN-L)
- OpenAlex
- W2927123024
- Cited by
- 73
- References
- 13
- FWCI
- 4.92
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Coarse-Fine Convolutional Deep-Learning Strategy for Human Activity Recognition. https://app.cochat.ai/papers/10.3390/s19071556
- The paper
- Avilés-Cruz, C., Ferreyra-Ramírez, A., Zúñiga-López, A., & Villegas-Cortéz, J. (2019). Coarse-Fine Convolutional Deep-Learning Strategy for Human Activity Recognition. Sensors. https://doi.org/10.3390/s19071556
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.