A Fast and Robust Deep Convolutional Neural Networks for Complex Human Activity Recognition Using Smartphone
Open accessThe DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Abstract
As a significant role in healthcare and sports applications, human activity recognition (HAR) techniques are capable of monitoring humans’ daily behavior. It has spurred the demand for intelligent sensors and has been giving rise to the explosive growth of wearable and mobile devices. They provide the most availability of human activity data (big data). Powerful algorithms are required to analyze these heterogeneous and high-dimension streaming data efficiently. This paper proposes a novel fast and robust deep convolutional neural network structure (FR-DCNN) for human activity recognition (HAR) using a smartphone. It enhances the effectiveness and extends the information of the collected raw data from the inertial measurement unit (IMU) sensors by integrating a series of signal processing algorithms and a signal selection module. It enables a fast computational method for building the DCNN classifier by adding a data compression module. Experimental results on the sampled 12 complex activities dataset show that the proposed FR-DCNN model is the best method for fast computation and high accuracy recognition. The FR-DCNN model only needs 0.0029 s to predict activity in an online way with 95.27% accuracy. Meanwhile, it only takes 88 s (average) to establish the DCNN classifier on the compressed dataset with less precision loss 94.18%.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition
Ordóñez, F., & Roggen, D. (2016) · Sensors · doi:10.3390/s16010115 · Cited by 2,761 · cited 1×
“A deep generic framework based on CNN and RNN (LSTM) units were implemented on multimodal wearable sensors [45].”
MethodConvolutional 2D Knowledge Graph Embeddings
Dettmers, T., Minervini, P., Stenetorp, P., & Riedel, S. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11573 · Cited by 2,486
Human activity recognition with smartphone sensors using deep learning neural networks
Ronao, C. A., & Cho, S.-B. (2016) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.04.032 · Cited by 1,215
Structural-RNN: Deep Learning on Spatio-Temporal Graphs
Jain, A., Zamir, A. R., Savarese, S., & Saxena, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.573 · Cited by 1,133
Nweke, H. F., Teh, Y. W., Al-garadi, M. A., & Alo, U. R. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.03.056 · Cited by 930
Particular object retrieval with integral max-pooling of CNN activations
Tolias, G., Sicre, R., & Jégou, H. (2015) · arXiv · doi:10.48550/arxiv.1511.05879 · Cited by 744 · cited 1×
“The last deep convolutional module add a max-pooling layer [72].”
BackgroundTransition-Aware Human Activity Recognition Using Smartphones
Reyes-Ortiz, J.-L., Oneto, L., Samà, A., Parra, X., & Anguita, D. (2016) · Neurocomputing · doi:10.1016/j.neucom.2015.07.085 · Cited by 740
Human Activity Recognition Using Wearable Sensors by Deep Convolutional Neural Networks
Jiang, W., & Yin, Z. (2015) · Proceedings of the 23rd ACM international conference on Multimedia · doi:10.1145/2733373.2806333 · Cited by 676 · cited 1×
“The transformed frequency spectrum was implemented on three public datasets based on a designed DCNN model [37] with four CNN modules.”
MethodDeep, Convolutional, and Recurrent Models for Human Activity Recognition Using Wearables
Hammerla, N. Y., Halloran, S., & Ploetz, T. (2016) · arXiv · doi:10.48550/arxiv.1604.08880 · Cited by 606
Complex Human Activity Recognition Using Smartphone and Wrist-Worn Motion Sensors
Shoaib, M., Bosch, S., Incel, O., Scholten, H., & Havinga, P. (2016) · Sensors · doi:10.3390/s16040426 · Cited by 423 · cited 1×
“Some complex activities were considered to be detected, such as writing, typing, talking, and drinking coffee, by wearing a wrist-worn motion sensor and carrying smartphone together [18].”
BackgroundA Deep Learning Approach to Human Activity Recognition Based on Single Accelerometer
Chen, Y., & Xue, Y. (2015) · 2015 IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2015.263 · Cited by 378 · cited 1×
“A DCNN model with three CNN layers and two maximum pooling layers [38] was successfully identified eight activities.”
MethodA Comparative Study on Human Activity Recognition Using Inertial Sensors in a Smartphone
Wang, A., Chen, G., Yang, J., Zhao, S., & Chang, C.-Y. (2016) · IEEE Sensors Journal · doi:10.1109/jsen.2016.2545708 · Cited by 324
Can Deep Learning Revolutionize Mobile Sensing?
Lane, N. D., & Georgiev, P. (2015) · Proceedings of the 16th International Workshop on Mobile Computing Systems and Applications · doi:10.1145/2699343.2699349 · Cited by 282 · cited 1×
“However, with the growing of the influx of multimodal and high dimensional sensor data, the current HAR system based on the above mentioned ML algorithms were incapable of handling complex activities [28].”
BackgroundRavi, D., Wong, C., Lo, B., & Yang, G.-Z. (2016) · 2016 IEEE 13th International Conference on Wearable and Implantable Body Sensor Networks (BSN) · doi:10.1109/bsn.2016.7516235 · Cited by 269 · cited 2×
“In other words, the performance of the designed FE algorithms decided the recognition rate and computational speed of the classifier [24], for example, k-NN, SVM, DT, and ANN methods [25] only worked well under the premise of extracting perfect features from the collected signals.”
MethodDeep Activity Recognition Models with Triaxial Accelerometers
Alsheikh, M. A., Selim, A., Niyato, D., Doyle, L., Lin, S., & Tan, H.-P. (2015) · arXiv · doi:10.48550/arxiv.1511.04664 · Cited by 126
Deep Learning for Human Activity Recognition in Mobile Computing
Plotz, T., & Guan, Y. (2018) · Computer · doi:10.1109/mc.2018.2381112 · Cited by 99
Recognizing Human Activity in Free-Living Using Multiple Body-Worn Accelerometers
Fullerton, E., Heller, B., & Munoz-Organero, M. (2017) · IEEE Sensors Journal · doi:10.1109/jsen.2017.2722105 · Cited by 81
Gyroscope vs. accelerometer measurements of motion from wrist PPG during physical exercise
Casson, A. J., Vazquez Galvez, A., & Jarchi, D. (2016) · ICT Express · doi:10.1016/j.icte.2016.11.003 · Cited by 57
Research works printed but not linked: 54
- Lee, S.M., Yoon, S.M., and Cho, H. (2017, January 13–16). Human activity recognition from accelerometer data using Convolutional Neural Network. Proceedings of the 2017 IEEE International Conference on Big Data and Smart Computing (BigComp), Jeju, Korea.
- Capela, 2016, Evaluation of a smartphone human activity recognition application with able-bodied and stroke participants, J. Neuroeng. Rehabil., 13, 5, 10.1186/s12984-016-0114-0 · DOI · Paper page
- Saeedi, R., Norgaard, S., and Gebremedhin, A.H. (2017, January 11–14). A closed-loop deep learning architecture for robust activity recognition using wearable sensors. Proceedings of the 2017 IEEE International Conference on Big Data, Boston, MA, USA. · DOI · Paper page
- Fang, S.H., Liao, H.H., Fei, Y.X., Chen, K.H., Huang, J.W., Lu, Y.D., and Tsao, Y. (2016). Transportation modes classification using sensors on smartphones. Sensors, 16. · DOI
- Khemchandani, 2016, Robust least squares twin support vector machine for human activity recognition, Appl. Soft Comput., 47, 33, 10.1016/j.asoc.2016.05.025 · DOI
- Tran, D.N., and Phan, D.D. (2016, January 25–27). Human activities recognition in android smartphone using support vector machine. Proceedings of the 2016 7th International Conference on Intelligent Systems, Modelling and Simulation (ISMS), Bangkok, Thailand. · DOI · Paper page
- Vermeulen, 2017, A comparative study of k-nearest neighbour techniques in crowd simulation, Comput. Animat. Virtual Worlds, 28, e1775, 10.1002/cav.1775 · DOI
- Ignatov, 2016, Human activity recognition using quasiperiodic time series collected from a single triaxial accelerometer, Multimed. Tools Appl., 75, 7257, 10.1007/s11042-015-2643-0 · DOI
- Su, H., Yang, C., Mdeihly, H., Rizzo, A., Ferrigno, G., and De Momi, E. (2019, August 19). Neural Network Enhanced Robot Tool Identification and Calibration for Bilateral Teleoperation. Available online: https://ieeexplore.ieee.org/abstract/document/8805341. · doi:10.1109/access.2019.2936334
- Li, Z., Yang, C., and Fan, L. (2012). Advanced Control of Wheeled Inverted Pendulum Systems, Springer Science & Business Media. · doi:10.1007/978-1-4471-2963-9
- Mekruksavanich, S., Hnoohom, N., and Jitpattanakul, A. (2018, January 25–28). Smartwatch-based sitting detection with human activity recognition for office workers syndrome. Proceedings of the 2018 International ECTI Northern Section Conference on Electrical, Electronics, Computer and Telecommunications Engineering (ECTI-NCON), Muang Chiang Rai, Thailand. · DOI · Paper page
- Ke, G., Meng, Q., Finley, T., Wang, T., Chen, W., Ma, W., Ye, Q., and Liu, T.Y. (2017, January 4–9). Lightgbm: A highly efficient gradient boosting decision tree. Proceedings of the Advances in Neural Information Processing Systems, Long Beach, CA, USA.
- Tharwat, 2018, Recognizing human activity in mobile crowdsensing environment using optimized k-NN algorithm, Expert Syst. Appl., 107, 32, 10.1016/j.eswa.2018.04.017 · DOI
- Hu, 2016, Development of sensory-motor fusion-based manipulation and grasping control for a robotic hand-eye system, IEEE Trans. Syst. Ma, Cybern. Syst., 47, 1169
- Paul, P., and George, T. (2015, January 20). An effective approach for human activity recognition on smartphone. Proceedings of the 2015 IEEE International Conference on Engineering and Technology (Icetech), Coimbatore, India. · DOI
- Scheurer, S., Tedesco, S., Brown, K.N., and O’Flynn, B. (2017, January 9–12). Human activity recognition for emergency first responders via body-worn inertial sensors. Proceedings of the 2017 IEEE 14th International Conference on Wearable and Implantable Body Sensor Networks (BSN), Eindhoven, The Netherlands. · DOI
- Su, H., Li, Z., Li, G., and Yang, C. (2013). EMG-Based neural network control of an upper-limb power-assist exoskeleton robot. International Symposium on Neural Networks, Springer. · doi:10.1007/978-3-642-39068-5_25
- Mehr, H.D., Polat, H., and Cetin, A. (2016, January 20–21). Resident activity recognition in smart homes by using artificial neural networks. Proceedings of the 2016 4th International Istanbul Smart Grid Congress and Fair (ICSG), Istanbul, Turkey. · DOI · Paper page
- Su, H., Enayati, N., Vantadori, L., Spinoglio, A., Ferrigno, G., and De Momi, E. (2018). Online human-like redundancy optimization for tele-operated anthropomorphic manipulators. Int. J. Adv. Robot. Syst., 15. · doi:10.1177/1729881418814695
- Hasan, M., and Roy-Chowdhury, A.K. (2014). Continuous learning of human activity models using deep nets. European Conference on Computer Vision, Springer. · DOI
- Wang, 2017, Device-to-Device based mobile social networking in proximity (MSNP) on smartphones: Framework, challenges and prototype, Future Gener. Comput. Syst., 74, 241, 10.1016/j.future.2015.10.020 · DOI
- Wang, 2016, QuaCentive: A quality-aware incentive mechanism in mobile crowdsourced sensing (MCS), J. Supercomput., 72, 2924, 10.1007/s11227-015-1395-y · DOI
- Cao, 2018, GCHAR: An efficient Group-based Context—Aware human activity recognition on smartphone, J. Parallel Distrib. Comput., 118, 67, 10.1016/j.jpdc.2017.05.007 · DOI · Paper page
- Hu, Y., Su, H., Zhang, L., Miao, S., Chen, G., and Knoll, A. (2019). Nonlinear Model Predictive Control for Mobile Robot Using Varying-Parameter Convergent Differential Neural Network. Robotics, 8. · DOI
- Su, H., Li, S., Manivannan, J., Bascetta, L., Ferrigno, G., and Momi, E.D. (2019, January 20–24). Manipulability Optimization Control of a Serial Redundant Robot for Robot-assisted Minimally Invasive Surgery. Proceedings of the 2019 International Conference on Robotics and Automation (ICRA), Montreal, QC, Canada. · doi:10.1109/icra.2019.8793676
- Li, 2014, Fuzzy approximation-based adaptive backstepping control of an exoskeleton for human upper limbs, IEEE Trans. Fuzzy Syst., 23, 555, 10.1109/TFUZZ.2014.2317511 · doi:10.1109/tfuzz.2014.2317511
- Yu, S., and Qin, L. (2018, January 14–16). Human activity recognition with smartphone inertial sensors using bidir-lstm networks. Proceedings of the 2018 3rd International Conference on Mechanical, Control and Computer Engineering (ICMCCE), Huhhot, China. · DOI
- Yang, J., Nguyen, M.N., San, P.P., Li, X.L., and Krishnaswamy, S. (2015, January 25–31). Deep convolutional neural networks on multichannel time series for human activity recognition. Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence, Buenos Aires, Argentina.
- Inoue, 2018, Deep recurrent neural network for mobile human activity recognition with high throughput, Artif. Life Robot., 23, 173, 10.1007/s10015-017-0422-x · DOI · Paper page
- Su, H., Qi, W., Hu, Y., Sandoval, J., Zhang, L., Schmirander, Y., Chen, G., Aliverti, A., Knoll, A., and Ferrigno, G. (2019). Towards Model-Free Tool Dynamic Identification and Calibration Using Multi-Layer Neural Network. Sensors, 19. · doi:10.3390/s19173636
- Khan, M.A.A.H., Roy, N., and Misra, A. (2018, January 19). Scaling human activity recognition via deep learning-based domain adaptation. Proceedings of the 2018 IEEE International Conference on Pervasive Computing and Communications (PerCom), Athens, Greece. · DOI · Paper page
- Lu, 2017, Towards unsupervised physical activity recognition using smartphone accelerometers, Multimed. Tools Appl., 76, 10701, 10.1007/s11042-015-3188-y · DOI · Paper page
- Reynolds, D. (2015). Gaussian mixture models. Encyclopedia of Biometrics, Springer. · DOI · Paper page
- Bouguettaya, 2015, Efficient agglomerative hierarchical clustering, Expert Syst. Appl., 42, 2785, 10.1016/j.eswa.2014.09.054 · DOI · Paper page
- Dhanachandra, 2015, Image segmentation using K-means clustering algorithm and subtractive clustering algorithm, Procedia Comput. Sci., 54, 764, 10.1016/j.procs.2015.06.090 · DOI · Paper page
- Jin, X., and Han, J. (2017). K-medoids clustering. Encyclopedia of Machine Learning and Data Mining, Springer US. · doi:10.1007/978-1-4899-7687-1_432
- Nie, F., Wang, X., Jordan, M.I., and Huang, H. (2016, January 12–17). The constrained laplacian rank algorithm for graph-based clustering. Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence, Phoenix, AZ, USA. · DOI · Paper page
- Li, Z., Xia, Y., and Su, C.Y. (2015). Intelligent Networked Teleoperation Control, Springer. · doi:10.1007/978-3-662-46898-2
- Su, 2018, Safety-enhanced collaborative framework for tele-operated minimally invasive surgery using a 7-DoF torque-controlled robot, Int. J. Control Autom. Syst., 16, 2915, 10.1007/s12555-017-0486-3 · doi:10.1007/s12555-017-0486-3
- Su, H., Sandoval, J., Makhdoomi, M., Ferrigno, G., and De Momi, E. (2018, January 21–25). Safety-enhanced human-robot interaction control of redundant robot for teleoperated minimally invasive surgery. Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, Australia. · doi:10.1109/icra.2018.8463148
- Su, 2019, Improved Human–Robot Collaborative Control of Redundant Robot for Teleoperated Minimally Invasive Surgery, IEEE Robot. Autom. Lett., 4, 1447, 10.1109/LRA.2019.2897145 · doi:10.1109/lra.2019.2897145
- Sandhu, 2016, A study on design and implementation of Butterworth, Chebyshev and elliptic filter with Matlab, Int. J. Emerg. Technol. Eng. Res., 4, 111
- Lutovac, M.D., Tošić, D.V., and Evans, B.L. (2001). Filter Design for Signal Processing Using MATLAB and Mathematica, Prentice Hall.
- Roetenberg, 2005, Compensation of magnetic disturbances improves inertial and magnetic sensing of human body segment orientation, IEEE Trans. Neural Syst. Rehabil. Eng., 13, 395, 10.1109/TNSRE.2005.847353 · DOI · Paper page
- Yuan, L., Wang, M., and Cheng, H. (2018). Research of adaptive index based on slide window for spatial-textual query. Multimed. Tools Appl. · doi:10.1007/s11042-018-6921-5
- Biagetti, G., Crippa, P., Falaschetti, L., Orcioni, S., and Turchetti, C. (2017). Human activity recognition using accelerometer and photoplethysmographic signals. International Conference on Intelligent Decision Technologies, Springer. · DOI
- Dernbach, S., Das, B., Krishnan, N.C., Thomas, B.L., and Cook, D.J. (2012, January 26–29). Simple and complex activity recognition through smart phones. Proceedings of the 2012 Eighth International Conference on Intelligent Environments, Guanajuato, Mexico. · DOI · Paper page
- Anguita, 2013, Energy Efficient Smartphone-Based Activity Recognition using Fixed-Point Arithmetic, J. UCS, 19, 1295
- Biagetti, G., Crippa, P., Falaschetti, L., Orcioni, S., and Turchetti, C. (2016). An efficient technique for real-time human activity classification using accelerometer data. International Conference on Intelligent Decision Technologies, Springer. · DOI
- Ye, 2011, Cosine similarity measures for intuitionistic fuzzy sets and their applications, Math. Comput. Model., 53, 91, 10.1016/j.mcm.2010.07.022 · DOI · Paper page
- Achille, 2018, Information dropout: Learning optimal representations through noisy computation, IEEE Trans. Pattern Anal. Mach. Intell., 40, 2897, 10.1109/TPAMI.2017.2784440 · DOI · Paper page
- Ioffe, S., and Szegedy, C. (2015). Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv.
- Shang, W., Sohn, K., Almeida, D., and Lee, H. (2016, January 19–24). Understanding and improving convolutional neural networks via concatenated rectified linear units. Proceedings of the 33rd International Conference on International Conference on Machine Learning, New York, NY, USA.
- Pedamonti, D. (2018). Comparison of non-linear activation functions for deep neural networks on MNIST classification task. arXiv.
Cited by
Human Activity Recognition Based on Residual Network and BiLSTM
Li, Y., & Wang, L. (2022) · Sensors · doi:10.3390/s22020635 · Cited by 156
Wearable Sensor-Based Human Activity Recognition with Hybrid Deep Learning Model
Luwe, Y. J., Lee, C. P., & Lim, K. M. (2022) · Informatics · doi:10.3390/informatics9030056 · Cited by 92
Human Activity Recognition Data Analysis: History, Evolutions, and New Trends
Ariza-Colpas, P. P., Vicario, E., Oviedo-Carrascal, A. I., Butt Aziz, S., Piñeres-Melo, M. A., Quintero-Linero, A., & Patara, F. (2022) · Sensors · doi:10.3390/s22093401 · Cited by 52
“Recognizing human activities consists of interpreting human gestures or movements through sensors to determine human action or activity [98]. more personal device, and, especially, great For example, a HAR system can report activities performed by patients outside of hospital facilities, which…”
Ahmed, M. E., Yu, H., Vassallo, M., & Koufaki, P. (2025) · Smart Health · doi:10.1016/j.smhl.2025.100555 · Cited by 10
Metadata
- Authors
- Qi, W., Su, H., Yang, C., Ferrigno, G., De Momi, E., & Aliverti, A.
- Venue
- Sensors
- Publisher
- MDPI AG
- Published
- 2019-08-29
- Volume
- 19
- Issue
- 17
- Pages
- 3731
- ISSN
- 1424-8220 (ISSN-L)
- OpenAlex
- W2970993639
- Cited by
- 111
- References
- 18
- FWCI
- 7.71
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.