Transforming sensor data to the image domain for deep learning — An application to footstep detection
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
Convolutional Neural Networks (CNNs) have become the state-of-the-art in various computer vision tasks, but they are still premature for most sensor data, especially in pervasive and wearable computing. A major reason for this is the limited amount of annotated training data. In this paper, we propose the idea of leveraging the discriminative power of pre-trained deep CNNs on 2-dimensional sensor data by transforming the sensor modality to the visual domain. By three proposed strategies, 2D sensor output is converted into pressure distribution imageries. Then we utilize a pre-trained CNN for transfer learning on the converted imagery data. We evaluate our method on a gait dataset of floor surface pressure mapping. We obtain a classification accuracy of 87.66%, which outperforms the conventional machine learning methods by over 10%.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
Fukushima, K. (1980) · Biological Cybernetics · doi:10.1007/bf00344251 · Cited by 5,759
Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning
Szegedy, C., Ioffe, S., Vanhoucke, V., & Alemi, A. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11231 · Cited by 4,636 · cited 1×
“[10], they have recently risen in popularity after achieving superhuman accuracy on image classification tasks [11], [12], [13], [14].”
BackgroundCaruana, R. (1998) · Learning to Learn · doi:10.1007/978-1-4615-5529-2_5 · Cited by 577
Visualizing and Understanding Convolutional Networks
Zeiler, M. D., & Fergus, R. (2013) · arXiv · doi:10.48550/arxiv.1311.2901 · Cited by 522
Banaee, H., Ahmed, M., & Loutfi, A. (2013) · Sensors · doi:10.3390/s131217472 · Cited by 452 · cited 1×
“The task of extracting useful information from the raw sensor data has been performed using various machine learning and data mining techniques [6].”
MethodBreathing Detection: Towards a Miniaturized, Wearable, Battery-Operated Monitoring System
Corbishley, P., & Rodriguez-Villegas, E. (2008) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2007.910679 · Cited by 221
Cited by
Deep learning for sensor-based activity recognition: A survey
Wang, J., Chen, Y., Hao, S., Peng, X., & Hu, L. (2019) · Pattern Recognition Letters · doi:10.1016/j.patrec.2018.02.010 · Cited by 2,014
“Similar results are also shown in (Singh et al., 2017).”
MethodInfluentialDeep Learning for Monitoring of Human Gait: A Review
Alharthi, A. S., Yunas, S. U., & Ozanyan, K. B. (2019) · IEEE Sensors Journal · doi:10.1109/jsen.2019.2928777 · Cited by 175
“[94] proposed a pre-trained 17 layers CNN and gated recurrent units to extract gait features automatically from images of footstep GRF.”
MethodFedHAR: Semi-Supervised Online Learning for Personalized Federated Human Activity Recognition
Yu, H., Chen, Z., Zhang, X., Chen, X., Zhuang, F., Xiong, H., & Cheng, X. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2021.3136853 · Cited by 113
Deep learning of smartphone sensor data for personal health assistance
Li, H., & Trocan, M. (2019) · Microelectronics Journal · doi:10.1016/j.mejo.2018.01.015 · Cited by 30
Adversarial Deep Feature Extraction Network for User Independent Human Activity Recognition
Suh, S., Rey, V. F., & Lukowicz, P. (2022) · 2022 IEEE International Conference on Pervasive Computing and Communications (PerCom) · doi:10.1109/percom53586.2022.9762387 · Cited by 25
Self-citation
Metadata
- Authors
- Singh, M. S., Pondenkandath, V., Zhou, B., Lukowicz, P., & Liwickit, M.
- Venue
- 2017 International Joint Conference on Neural Networks (IJCNN)
- Publisher
- IEEE
- Published
- 2017-05
- Pages
- 2665-2672
- OpenAlex
- W2585245686
- Cited by
- 76
- References
- 9
- FWCI
- 18.27
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Transforming sensor data to the image domain for deep learning — An application to footstep detection. https://app.cochat.ai/papers/10.1109/ijcnn.2017.7966182
- The paper
- Singh, M. S., Pondenkandath, V., Zhou, B., Lukowicz, P., & Liwickit, M. (2017). Transforming sensor data to the image domain for deep learning — An application to footstep detection. 2017 International Joint Conference on Neural Networks (IJCNN). https://doi.org/10.1109/ijcnn.2017.7966182
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.