CoChat

A Fast and Robust Deep Convolutional Neural Networks for Complex Human Activity Recognition Using Smartphone

Open access
Qi, Wen, Su, Hang, Yang, Chenguang, Ferrigno, Giancarlo, De Momi, Elena, Aliverti, Andrea · 2019 · Sensors
Cited by 111

The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.

Abstract

As a significant role in healthcare and sports applications, human activity recognition (HAR) techniques are capable of monitoring humans’ daily behavior. It has spurred the demand for intelligent sensors and has been giving rise to the explosive growth of wearable and mobile devices. They provide the most availability of human activity data (big data). Powerful algorithms are required to analyze these heterogeneous and high-dimension streaming data efficiently. This paper proposes a novel fast and robust deep convolutional neural network structure (FR-DCNN) for human activity recognition (HAR) using a smartphone. It enhances the effectiveness and extends the information of the collected raw data from the inertial measurement unit (IMU) sensors by integrating a series of signal processing algorithms and a signal selection module. It enables a fast computational method for building the DCNN classifier by adding a data compression module. Experimental results on the sampled 12 complex activities dataset show that the proposed FR-DCNN model is the best method for fast computation and high accuracy recognition. The FR-DCNN model only needs 0.0029 s to predict activity in an online way with 95.27% accuracy. Meanwhile, it only takes 88 s (average) to establish the DCNN classifier on the compressed dataset with less precision loss 94.18%.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3390/s19173731

Cites

18 of 18 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 18 references

Research works printed but not linked: 54

  1. Lee, S.M., Yoon, S.M., and Cho, H. (2017, January 13–16). Human activity recognition from accelerometer data using Convolutional Neural Network. Proceedings of the 2017 IEEE International Conference on Big Data and Smart Computing (BigComp), Jeju, Korea.
  2. Capela, 2016, Evaluation of a smartphone human activity recognition application with able-bodied and stroke participants, J. Neuroeng. Rehabil., 13, 5, 10.1186/s12984-016-0114-0 · DOI · Paper page
  3. Saeedi, R., Norgaard, S., and Gebremedhin, A.H. (2017, January 11–14). A closed-loop deep learning architecture for robust activity recognition using wearable sensors. Proceedings of the 2017 IEEE International Conference on Big Data, Boston, MA, USA. · DOI · Paper page
  4. Fang, S.H., Liao, H.H., Fei, Y.X., Chen, K.H., Huang, J.W., Lu, Y.D., and Tsao, Y. (2016). Transportation modes classification using sensors on smartphones. Sensors, 16. · DOI
  5. Khemchandani, 2016, Robust least squares twin support vector machine for human activity recognition, Appl. Soft Comput., 47, 33, 10.1016/j.asoc.2016.05.025 · DOI
  6. Tran, D.N., and Phan, D.D. (2016, January 25–27). Human activities recognition in android smartphone using support vector machine. Proceedings of the 2016 7th International Conference on Intelligent Systems, Modelling and Simulation (ISMS), Bangkok, Thailand. · DOI · Paper page
  7. Vermeulen, 2017, A comparative study of k-nearest neighbour techniques in crowd simulation, Comput. Animat. Virtual Worlds, 28, e1775, 10.1002/cav.1775 · DOI
  8. Ignatov, 2016, Human activity recognition using quasiperiodic time series collected from a single triaxial accelerometer, Multimed. Tools Appl., 75, 7257, 10.1007/s11042-015-2643-0 · DOI
  9. Su, H., Yang, C., Mdeihly, H., Rizzo, A., Ferrigno, G., and De Momi, E. (2019, August 19). Neural Network Enhanced Robot Tool Identification and Calibration for Bilateral Teleoperation. Available online: https://ieeexplore.ieee.org/abstract/document/8805341. · doi:10.1109/access.2019.2936334
  10. Li, Z., Yang, C., and Fan, L. (2012). Advanced Control of Wheeled Inverted Pendulum Systems, Springer Science & Business Media. · doi:10.1007/978-1-4471-2963-9
  11. Mekruksavanich, S., Hnoohom, N., and Jitpattanakul, A. (2018, January 25–28). Smartwatch-based sitting detection with human activity recognition for office workers syndrome. Proceedings of the 2018 International ECTI Northern Section Conference on Electrical, Electronics, Computer and Telecommunications Engineering (ECTI-NCON), Muang Chiang Rai, Thailand. · DOI · Paper page
  12. Ke, G., Meng, Q., Finley, T., Wang, T., Chen, W., Ma, W., Ye, Q., and Liu, T.Y. (2017, January 4–9). Lightgbm: A highly efficient gradient boosting decision tree. Proceedings of the Advances in Neural Information Processing Systems, Long Beach, CA, USA.
  13. Tharwat, 2018, Recognizing human activity in mobile crowdsensing environment using optimized k-NN algorithm, Expert Syst. Appl., 107, 32, 10.1016/j.eswa.2018.04.017 · DOI
  14. Hu, 2016, Development of sensory-motor fusion-based manipulation and grasping control for a robotic hand-eye system, IEEE Trans. Syst. Ma, Cybern. Syst., 47, 1169
  15. Paul, P., and George, T. (2015, January 20). An effective approach for human activity recognition on smartphone. Proceedings of the 2015 IEEE International Conference on Engineering and Technology (Icetech), Coimbatore, India. · DOI
  16. Scheurer, S., Tedesco, S., Brown, K.N., and O’Flynn, B. (2017, January 9–12). Human activity recognition for emergency first responders via body-worn inertial sensors. Proceedings of the 2017 IEEE 14th International Conference on Wearable and Implantable Body Sensor Networks (BSN), Eindhoven, The Netherlands. · DOI
  17. Su, H., Li, Z., Li, G., and Yang, C. (2013). EMG-Based neural network control of an upper-limb power-assist exoskeleton robot. International Symposium on Neural Networks, Springer. · doi:10.1007/978-3-642-39068-5_25
  18. Mehr, H.D., Polat, H., and Cetin, A. (2016, January 20–21). Resident activity recognition in smart homes by using artificial neural networks. Proceedings of the 2016 4th International Istanbul Smart Grid Congress and Fair (ICSG), Istanbul, Turkey. · DOI · Paper page
  19. Su, H., Enayati, N., Vantadori, L., Spinoglio, A., Ferrigno, G., and De Momi, E. (2018). Online human-like redundancy optimization for tele-operated anthropomorphic manipulators. Int. J. Adv. Robot. Syst., 15. · doi:10.1177/1729881418814695
  20. Hasan, M., and Roy-Chowdhury, A.K. (2014). Continuous learning of human activity models using deep nets. European Conference on Computer Vision, Springer. · DOI
  21. Wang, 2017, Device-to-Device based mobile social networking in proximity (MSNP) on smartphones: Framework, challenges and prototype, Future Gener. Comput. Syst., 74, 241, 10.1016/j.future.2015.10.020 · DOI
  22. Wang, 2016, QuaCentive: A quality-aware incentive mechanism in mobile crowdsourced sensing (MCS), J. Supercomput., 72, 2924, 10.1007/s11227-015-1395-y · DOI
  23. Cao, 2018, GCHAR: An efficient Group-based Context—Aware human activity recognition on smartphone, J. Parallel Distrib. Comput., 118, 67, 10.1016/j.jpdc.2017.05.007 · DOI · Paper page
  24. Hu, Y., Su, H., Zhang, L., Miao, S., Chen, G., and Knoll, A. (2019). Nonlinear Model Predictive Control for Mobile Robot Using Varying-Parameter Convergent Differential Neural Network. Robotics, 8. · DOI
  25. Su, H., Li, S., Manivannan, J., Bascetta, L., Ferrigno, G., and Momi, E.D. (2019, January 20–24). Manipulability Optimization Control of a Serial Redundant Robot for Robot-assisted Minimally Invasive Surgery. Proceedings of the 2019 International Conference on Robotics and Automation (ICRA), Montreal, QC, Canada. · doi:10.1109/icra.2019.8793676
  26. Li, 2014, Fuzzy approximation-based adaptive backstepping control of an exoskeleton for human upper limbs, IEEE Trans. Fuzzy Syst., 23, 555, 10.1109/TFUZZ.2014.2317511 · doi:10.1109/tfuzz.2014.2317511
  27. Yu, S., and Qin, L. (2018, January 14–16). Human activity recognition with smartphone inertial sensors using bidir-lstm networks. Proceedings of the 2018 3rd International Conference on Mechanical, Control and Computer Engineering (ICMCCE), Huhhot, China. · DOI
  28. Yang, J., Nguyen, M.N., San, P.P., Li, X.L., and Krishnaswamy, S. (2015, January 25–31). Deep convolutional neural networks on multichannel time series for human activity recognition. Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence, Buenos Aires, Argentina.
  29. Inoue, 2018, Deep recurrent neural network for mobile human activity recognition with high throughput, Artif. Life Robot., 23, 173, 10.1007/s10015-017-0422-x · DOI · Paper page
  30. Su, H., Qi, W., Hu, Y., Sandoval, J., Zhang, L., Schmirander, Y., Chen, G., Aliverti, A., Knoll, A., and Ferrigno, G. (2019). Towards Model-Free Tool Dynamic Identification and Calibration Using Multi-Layer Neural Network. Sensors, 19. · doi:10.3390/s19173636
  31. Khan, M.A.A.H., Roy, N., and Misra, A. (2018, January 19). Scaling human activity recognition via deep learning-based domain adaptation. Proceedings of the 2018 IEEE International Conference on Pervasive Computing and Communications (PerCom), Athens, Greece. · DOI · Paper page
  32. Lu, 2017, Towards unsupervised physical activity recognition using smartphone accelerometers, Multimed. Tools Appl., 76, 10701, 10.1007/s11042-015-3188-y · DOI · Paper page
  33. Reynolds, D. (2015). Gaussian mixture models. Encyclopedia of Biometrics, Springer. · DOI · Paper page
  34. Bouguettaya, 2015, Efficient agglomerative hierarchical clustering, Expert Syst. Appl., 42, 2785, 10.1016/j.eswa.2014.09.054 · DOI · Paper page
  35. Dhanachandra, 2015, Image segmentation using K-means clustering algorithm and subtractive clustering algorithm, Procedia Comput. Sci., 54, 764, 10.1016/j.procs.2015.06.090 · DOI · Paper page
  36. Jin, X., and Han, J. (2017). K-medoids clustering. Encyclopedia of Machine Learning and Data Mining, Springer US. · doi:10.1007/978-1-4899-7687-1_432
  37. Nie, F., Wang, X., Jordan, M.I., and Huang, H. (2016, January 12–17). The constrained laplacian rank algorithm for graph-based clustering. Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence, Phoenix, AZ, USA. · DOI · Paper page
  38. Li, Z., Xia, Y., and Su, C.Y. (2015). Intelligent Networked Teleoperation Control, Springer. · doi:10.1007/978-3-662-46898-2
  39. Su, 2018, Safety-enhanced collaborative framework for tele-operated minimally invasive surgery using a 7-DoF torque-controlled robot, Int. J. Control Autom. Syst., 16, 2915, 10.1007/s12555-017-0486-3 · doi:10.1007/s12555-017-0486-3
  40. Su, H., Sandoval, J., Makhdoomi, M., Ferrigno, G., and De Momi, E. (2018, January 21–25). Safety-enhanced human-robot interaction control of redundant robot for teleoperated minimally invasive surgery. Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, Australia. · doi:10.1109/icra.2018.8463148
  41. Su, 2019, Improved Human–Robot Collaborative Control of Redundant Robot for Teleoperated Minimally Invasive Surgery, IEEE Robot. Autom. Lett., 4, 1447, 10.1109/LRA.2019.2897145 · doi:10.1109/lra.2019.2897145
  42. Sandhu, 2016, A study on design and implementation of Butterworth, Chebyshev and elliptic filter with Matlab, Int. J. Emerg. Technol. Eng. Res., 4, 111
  43. Lutovac, M.D., Tošić, D.V., and Evans, B.L. (2001). Filter Design for Signal Processing Using MATLAB and Mathematica, Prentice Hall.
  44. Roetenberg, 2005, Compensation of magnetic disturbances improves inertial and magnetic sensing of human body segment orientation, IEEE Trans. Neural Syst. Rehabil. Eng., 13, 395, 10.1109/TNSRE.2005.847353 · DOI · Paper page
  45. Yuan, L., Wang, M., and Cheng, H. (2018). Research of adaptive index based on slide window for spatial-textual query. Multimed. Tools Appl. · doi:10.1007/s11042-018-6921-5
  46. Biagetti, G., Crippa, P., Falaschetti, L., Orcioni, S., and Turchetti, C. (2017). Human activity recognition using accelerometer and photoplethysmographic signals. International Conference on Intelligent Decision Technologies, Springer. · DOI
  47. Dernbach, S., Das, B., Krishnan, N.C., Thomas, B.L., and Cook, D.J. (2012, January 26–29). Simple and complex activity recognition through smart phones. Proceedings of the 2012 Eighth International Conference on Intelligent Environments, Guanajuato, Mexico. · DOI · Paper page
  48. Anguita, 2013, Energy Efficient Smartphone-Based Activity Recognition using Fixed-Point Arithmetic, J. UCS, 19, 1295
  49. Biagetti, G., Crippa, P., Falaschetti, L., Orcioni, S., and Turchetti, C. (2016). An efficient technique for real-time human activity classification using accelerometer data. International Conference on Intelligent Decision Technologies, Springer. · DOI
  50. Ye, 2011, Cosine similarity measures for intuitionistic fuzzy sets and their applications, Math. Comput. Model., 53, 91, 10.1016/j.mcm.2010.07.022 · DOI · Paper page
  51. Achille, 2018, Information dropout: Learning optimal representations through noisy computation, IEEE Trans. Pattern Anal. Mach. Intell., 40, 2897, 10.1109/TPAMI.2017.2784440 · DOI · Paper page
  52. Ioffe, S., and Szegedy, C. (2015). Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv.
  53. Shang, W., Sohn, K., Almeida, D., and Lee, H. (2016, January 19–24). Understanding and improving convolutional neural networks via concatenated rectified linear units. Proceedings of the 33rd International Conference on International Conference on Machine Learning, New York, NY, USA.
  54. Pedamonti, D. (2018). Comparison of non-linear activation functions for deep neural networks on MNIST classification task. arXiv.

Cited by

See all 111

Metadata

Authors
Qi, W., Su, H., Yang, C., Ferrigno, G., De Momi, E., & Aliverti, A.
Venue
Sensors
Publisher
MDPI AG
Published
2019-08-29
Volume
19
Issue
17
Pages
3731
ISSN
1424-8220 (ISSN-L)
OpenAlex
W2970993639
Cited by
111
References
18
FWCI
7.71
Type
journal article
Language
en
Open access
gold

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: A Fast and Robust Deep Convolutional Neural Networks for Complex Human Activity Recognition Using Smartphone. https://app.cochat.ai/papers/10.3390/s19173731
The paper
Qi, W., Su, H., Yang, C., Ferrigno, G., De Momi, E., & Aliverti, A. (2019). A Fast and Robust Deep Convolutional Neural Networks for Complex Human Activity Recognition Using Smartphone. Sensors. https://doi.org/10.3390/s19173731

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.