CoChat

Iss2Image: A Novel Signal-Encoding Technique for CNN-Based Human Activity Recognition

Open access
Hur, Taeho, Bang, Jaehun, Huynh-The, Thien, Lee, Jongwon, Kim, Jee-In, Lee, Sungyoung · 2018 · Sensors
Cited by 74

The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.

Abstract

The most significant barrier to success in human activity recognition is extracting and selecting the right features. In traditional methods, the features are chosen by humans, which requires the user to have expert knowledge or to do a large amount of empirical study. Newly developed deep learning technology can automatically extract and select features. Among the various deep learning methods, convolutional neural networks (CNNs) have the advantages of local dependency and scale invariance and are suitable for temporal data such as accelerometer (ACC) signals. In this paper, we propose an efficient human activity recognition method, namely Iss2Image (Inertial sensor signal to Image), a novel encoding technique for transforming an inertial sensor signal into an image with minimum distortion and a CNN model for image-based activity classification. Iss2Image converts real number values from the X, Y, and Z axes into three color channels to precisely infer correlations among successive sensor signal values in three different dimensions. We experimentally evaluated our method using several well-known datasets and our own dataset collected from a smartphone and smartwatch. The proposed method shows higher accuracy than other state-of-the-art approaches on the tested datasets.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3390/s18113910

Cites

22 of 22 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 22 references

Research works printed but not linked: 30

  1. Atasoy, 2016, Integrating features for accelerometer-based activity recognition, Procedia Comput. Sci., 98, 522, 10.1016/j.procs.2016.09.070 · DOI
  2. Zebin, T., Scully, P.J., and Ozanyan, K.B. (November, January 30). Human activity recognition with inertial sensors using a deep learning approach. Proceedings of the 2016 IEEE SENSORS, Orlando, FL, USA. · DOI · Paper page
  3. Xu, 2017, Learning multi-level features for sensor-based human action recognition, Pervasive Mob. Comput., 40, 324, 10.1016/j.pmcj.2017.07.001 · DOI
  4. Zhang, C., and Chen, T. (2003). From low level features to high level semantics. Handbook of Video Databases: Design and Applications, CRC Press.
  5. Ha, S., and Choi, S. (2016, January 24–29). Convolutional neural networks for human activity recognition using multiple accelerometer and gyroscope sensors. Proceedings of the 2016 International Joint Conference on Neural Networks, Vancouver, BC, Canada. · DOI · Paper page
  6. Almaslukh, 2017, An effective deep autoencoder approach for online smartphone-based human activity recognition, Int. J. Comput. Sci. Netw. Secur., 17, 160
  7. Inoue, 2018, Deep recurrent neural network for mobile human activity recognition with high throughput, Artif. Life Rob., 23, 173, 10.1007/s10015-017-0422-x · DOI · Paper page
  8. Bhattacharya, S., and Lane, N.D. (2016, January 14–18). From smart to deep: Robust activity recognition on smartwatches using deep learning. Proceedings of the 2016 IEEE International Conference on Pervasive Computing and Communication Workshops, Sydney, Australia. · DOI · Paper page
  9. Uddin, 2018, Classification of Recurrence Plots’ Distance Matrices with a Convolutional Neural Network for Activity Recognition, Procedia Comput. Sci., 130, 157, 10.1016/j.procs.2018.04.025 · DOI
  10. Zhang, R., and Li, C. (2015). Motion sequence recognition with multi-sensors using deep convolutional neural network. Intelligent Data Analysis and Applications, Springer. · DOI
  11. Dehzangi, O., Taherisadr, M., and ChangalVala, R. (2017). IMU-Based Gait Recognition Using Convolutional Neural Networks and Multi-Sensor Fusion. Sensors, 17. · DOI · Paper page
  12. Alsheikh, M.A., Selim, A., Niyato, D., Doyle, L., Lin, S., and Tan, H.P. (2016, January 12). Deep Activity Recognition Models with Triaxial Accelerometers. Proceedings of the Artificial Intelligence Applied to Assistive Technologies and Smart Environments, Phoenix, AZ, USA.
  13. Lu, 2019, Deconvolutive short-time Fourier transform spectrogram, IEEE Signal Process Lett., 16, 576
  14. Ha, S., Yun, J.M., and Choi, S. (2015, January 9–12). Multi-modal convolutional neural networks for activity recognition. Proceedings of the 2015 IEEE International Conference on Systems, Man, and Cybernetics, Hong Kong, China. · DOI · Paper page
  15. Yang, J., Nguyen, M.N., San, P.P., Li, X., and Krishnaswamy, S. (August, January 28). Deep Convolutional Neural Networks on Multichannel Time Series for Human Activity Recognition. Proceedings of the 24th International Joint Conference on Artificial Intelligence, Buenos Aires, Argentina.
  16. Baldominos, A., Saez, Y., and Isasi, P. (2018). Evolutionary Design of Convolutional Neural Networks for Human Activity Recognition in Sensor-Rich Environments. Sensors, 18. · DOI
  17. Cho, H., and Yoon, S.M. (2018). Divide and Conquer-Based 1D CNN Human Activity Recognition Using Test Data Sharpening. Sensors, 18. · DOI · Paper page
  18. Saez, Y., Baldominos, A., and Isasi, P. (2017). A comparison study of classifier algorithms for cross-person physical activity recognition. Sensors, 17. · DOI
  19. Vavoulas, G., Chatzaki, C., Malliotakis, T., Pediaditis, M., and Tsiknakis, M. (2016, January 21–22). The MobiAct Dataset: Recognition of Activities of Daily Living using Smartphones. Proceedings of the 2nd International Conference on Information and Communication Technologies for Ageing Well and e-Health, Rome, Italy. · DOI · Paper page
  20. Leutheuser, H., Schuldhaus, D., and Eskofier, B.M. (2013). Hierarchical, multi-sensor based classification of daily life activities: Comparison with state-of-the-art algorithms using a benchmark dataset. PLoS ONE, 8. · DOI · Paper page
  21. Anguita, D., Ghio, A., Oneto, L., Parra, X., and Reyes-Ortiz, J.L. (2013, January 24–26). A Public Domain Dataset for Human Activity Recognition Using Smartphones. Proceedings of the 21th European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning, Bruges, Belgium.
  22. Penatti, O.A., and Santos, M.F. (arXiv, 2017). Human activity recognition from mobile inertial sensors using recurrence plots, arXiv.
  23. Zheng, X., Wang, M., and Ordieres-Meré, J. (2018). Comparison of Data Preprocessing Approaches for Applying Deep Learning to Human Activity Recognition in the Context of Industry 4.0. Sensors, 18. · DOI · Paper page
  24. Russakovsky, 2015, Imagenet large scale visual recognition challenge, Int. J. Comput. Vis., 115, 211, 10.1007/s11263-015-0816-y · DOI · Paper page
  25. Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7–12). Going deeper with convolutions. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA. · DOI · Paper page
  26. Lin, M., Chen, Q., and Yan, S. (arXiv, 2013). Network in network, arXiv.
  27. Ahmer, M., Shah, M.Z.A., Shah, S.M.Z.S., Shah, S.M.S., Chowdhry, B.S., Shah, A., and Bhatti, K.H. (2017). Using Non-Linear Support Vector Machines for Detection of Activities of Daily Living. Indian J. Sci. Technol., 10. · DOI
  28. Zdravevski, 2017, Improving activity recognition accuracy in ambient-assisted living systems by automated feature engineering, IEEE Access, 5, 5262, 10.1109/ACCESS.2017.2684913 · DOI · Paper page
  29. Anguita, 2013, Energy Efficient Smartphone-Based Activity Recognition using Fixed-Point Arithmetic, J. Univ. Comput. Sci., 19, 1295
  30. Cao, 2018, GCHAR: An efficient Group-based Context—Aware human activity recognition on smartphone, J. Parallel Distrib. Comput., 118, 67, 10.1016/j.jpdc.2017.05.007 · DOI · Paper page

Cited by

See all 74

Metadata

Authors
Hur, T., Bang, J., Huynh-The, T., Lee, J., Kim, J.-I., & Lee, S.
Venue
Sensors
Publisher
MDPI AG
Published
2018-11-13
Volume
18
Issue
11
Pages
3910
ISSN
1424-8220 (ISSN-L)
OpenAlex
W2901438495
Cited by
74
References
22
FWCI
3.61
Type
journal article
Language
en
Open access
gold
Funders
  • Institute for Information and communications Technology Promotion (2017-0-00655)
  • Ministry of Science and ICT (IITP-2017-0-01629)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Iss2Image: A Novel Signal-Encoding Technique for CNN-Based Human Activity Recognition. https://app.cochat.ai/papers/10.3390/s18113910
The paper
Hur, T., Bang, J., Huynh-The, T., Lee, J., Kim, J.-I., & Lee, S. (2018). Iss2Image: A Novel Signal-Encoding Technique for CNN-Based Human Activity Recognition. Sensors. https://doi.org/10.3390/s18113910

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.