Deep Dilated Convolution on Multimodality Time Series for Human Activity Recognition
The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
Convolutional Neural Networks (CNNs) is capable of automatically learning feature representations, CNN-based recognition algorithm has been an alternative method for human activity recognition. Even though general convolution operation followed by pooling could expand the receptive fields for extracting features, it will bring about information loss in feature representation. Due to that dilated convolutions not only could expand receptive field exponentially without changing the size of field map or pooling, but it also will not cause information loss, hence, we propose D2CL, a novel deep learning framework for human activity recognition using multi-model wearable sensors. This framework consists of dilated convolutional neural networks and recurrent neural networks. At first, learning from previous works, we add a general convolutional layer to map inputs into a hidden space for improving the capability of nonlinear representations. Subsequently, a stacked dilated convolutional networks automatically learn feature representations for inter-sensors and intra-sensors from hidden space. Then, given these learned features, two RNNs are applied to model their latent temporal dependencies. Finally, a softmax classifier at the topmost layer is utilized to recognize activities. To evaluate the performance of D2CL on activity recognition, we select two open datasets OPPORTUNITY and PAMAP2 for training and testing. Results show that our proposed model achieves a higher classification performance than the state-of-the-art DeepConvLSTM.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition
Ordóñez, F., & Roggen, D. (2016) · Sensors · doi:10.3390/s16010115 · Cited by 2,761 · cited 2×
“As [19] presents, the architecture of DeepConvLSTM can be described as C(64)−C(64)−C(64)−C(64)−R(128)−R(128)−Sm.”
BackgroundDeep learning for sensor-based activity recognition: A survey
Wang, J., Chen, Y., Hao, S., Peng, X., & Hu, L. (2019) · Pattern Recognition Letters · doi:10.1016/j.patrec.2018.02.010 · Cited by 2,014
A tutorial on human activity recognition using body-worn inertial sensors
Bulling, A., Blanke, U., & Schiele, B. (2014) · ACM Computing Surveys · doi:10.1145/2499621 · Cited by 1,668 · cited 1×
“Besides, they ignore the characteristics of HAR task: intra-class variability and similarity, and complexness of physical activities [9].”
BackgroundIntroducing a New Benchmarked Dataset for Activity Monitoring
Reiss, A., & Stricker, D. (2012) · 2012 16th International Symposium on Wearable Computers · doi:10.1109/iswc.2012.13 · Cited by 1,456
Convolutional Neural Networks for Human Activity Recognition using Mobile Sensors
Zeng, M., Nguyen, L. T., Yu, B., Mengshoel, O. J., Zhu, J., Wu, P., & Zhang, J. (2014) · Proceedings of the 6th International Conference on Mobile Computing, Applications and Services · doi:10.4108/icst.mobicase.2014.257786 · Cited by 876 · cited 2×
“Due to the powerful ability of learning feature representation, Convolutional Neural Network(CNN) has been employed for sensor-based activity recognition [10] [11] to extract latent features.”
BackgroundMethodVisualizing and Understanding Recurrent Networks
Karpathy, A., Johnson, J., & Fei-Fei, L. (2015) · arXiv · doi:10.48550/arxiv.1506.02078 · Cited by 845 · cited 1×
“For the second block, on the basis of previous experience [24] that a depth of at least two recurrent layers is beneficial to process sequential data, in this paper, we employ a two-layer stacked LSTM.”
MethodCollecting complex activity datasets in highly rich networked sensor environments
Roggen, D., Calatroni, A., Rossi, M., Holleczek, T., Forster, K., Troster, G., Lukowicz, P., Bannach, D., Pirkl, G., Ferscha, A., et al. (2010) · 2010 Seventh International Conference on Networked Sensing Systems (INSS) · doi:10.1109/inss.2010.5573462 · Cited by 788
Human Activity Recognition Using Wearable Sensors by Deep Convolutional Neural Networks
Jiang, W., & Yin, Z. (2015) · Proceedings of the 23rd ACM international conference on Multimedia · doi:10.1145/2733373.2806333 · Cited by 676 · cited 1×
“Due to the powerful ability of learning feature representation, Convolutional Neural Network(CNN) has been employed for sensor-based activity recognition [10] [11] to extract latent features.”
MethodDeep, Convolutional, and Recurrent Models for Human Activity Recognition Using Wearables
Hammerla, N. Y., Halloran, S., & Ploetz, T. (2016) · arXiv · doi:10.48550/arxiv.1604.08880 · Cited by 606
USC-HAD: a daily activity dataset for ubiquitous activity recognition using wearable sensors
Zhang, M., & Sawchuk, A. A. (2012) · Proceedings of the 2012 ACM Conference on Ubiquitous Computing · doi:10.1145/2370216.2370438 · Cited by 554 · cited 1×
“Human activity recognition (HAR) plays an important role in peoples daily life and has become a key problem in humancomputer interaction (HCI) [1], human behavior analysis [2], mobile and ubiquitous computing [3] [4].”
BackgroundDealing with sensor displacement in motion-based onbody activity recognition systems
Kunze, K., & Lukowicz, P. (2008) · Proceedings of the 10th international conference on Ubiquitous computing · doi:10.1145/1409635.1409639 · Cited by 161
A-Wristocracy: Deep learning on wrist-worn sensing for recognition of user complex activities
Vepakomma, P., De, D., Das, S. K., & Bhansali, S. (2015) · 2015 IEEE 12th International Conference on Wearable and Implantable Body Sensor Networks (BSN) · doi:10.1109/bsn.2015.7299406 · Cited by 136 · cited 1×
“For example, [16] feeds hand-engineered features from the sensors into a DFN model to recognize activities.”
Background
Research works printed but not linked: 13
- lin, 2014, Network In Network, Proceedings of International Conference on Learning Representations
- hasan, 2016, Human Activity Recognition using Smartphone Sensors with Context Filtering, Proceedings of the Ninth International Conference on Advances in Computer-Human Interactions
- anguita, 2013, A Public Domain Dataset for Human Activity Recognition using Smartphones, Proceedings of the 21th annual European Symposium on Artificial Neural Networks
- almaslukh, 2017, An effective deep autoencoder approach for online smartphone-based human activity recognition, International Journal of Computer Science and Network Security
- lecun, 1998, Efficient backprop, Neural Networks Tricks of the Trade, 10.1007/3-540-49430-8_2 · DOI · Paper page
- anguita, 2013, A public domain dataset for human activity recognition using smartphones, European Symposium on Artificial Neural Networks Computational Intelligence and Machine Learning
- yang, 2015, Deep Convolutional Neural Networks On Multichannel Time Series For Human Activity Recognition, 24th International Joint conference on Artificial Intelligence
- 10.1145/1409635.1409637 · DOI · Paper page
- bulling, 2011, Recognition of visualmemory recall processes using eyemovement analysis, Proceedings of the 13th International Conference on Ubiquitous Computing, 10.1145/2030112.2030172 · DOI
- 10.1007/978-3-540-72348-6_3 · DOI · Paper page
- jaimes, 2007, Multimodal humancomputer interaction: A survey, Computer Vision and Image Understanding, 108, 10.1016/j.cviu.2006.10.019 · DOI · Paper page
- holschneider, 1987, A Real-Time Algorithm for Signal Analysis with the Help of the Wavelet Transform, Proc Wavelets Time-Frequency Methods Phase Space
- 10.1109/78.157290 · DOI · Paper page
Cited by
Deep Learning for Sensor-based Human Activity Recognition
Chen, K., Zhang, D., Yao, L., Guo, B., Yu, Z., & Liu, Y. (2022) · ACM Computing Surveys · doi:10.1145/3447744 · Cited by 690
“could explore is inadequate as well. Furthermore, if a large time scale is desirable, a pooling operation would be commonly used between two CNN layers, which would cause information loss. Xi et al. [160] applied a deep dilated CNN to time series for solving the issues. The dilated CNN uses dilated convolution kernels…”
MethodDeep Learning for Sensor-based Human Activity Recognition: Overview, Challenges and Opportunities
Chen, K., Zhang, D., Yao, L., Guo, B., Yu, Z., & Liu, Y. (2020) · arXiv · doi:10.48550/arxiv.2001.07416 · Cited by 314
“could explore is inadequate as well. Furthermore, if a large time scale is desirable, a pooling operation would be commonly used between two CNN layers, which would cause information loss. Xi et al. [160] applied a deep dilated CNN to time series for solving the issues. The dilated CNN uses dilated convolution kernels…”
MethodUnsupervised pre-trained filter learning approach for efficient convolution neural network
Rehman, S. U., Tu, S., Waqas, M., Huang, Y., Rehman, O. U., Ahmad, B., & Ahmad, S. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.06.084 · Cited by 270
Human activity recognition using wearable sensors by heterogeneous convolutional neural networks
Han, C., Zhang, L., Tang, Y., Huang, W., Min, F., & He, J. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.116764 · Cited by 130
Deep Neural Network Ensembles for Time Series Classification
Ismail Fawaz, H., Forestier, G., Weber, J., Idoumghar, L., & Muller, P.-A. (2019) · 2019 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2019.8852316 · Cited by 103
Metadata
- Authors
- Xi, R., Hou, M., Fu, M., Qu, H., & Liu, D.
- Venue
- 2018 International Joint Conference on Neural Networks (IJCNN)
- Publisher
- IEEE
- Published
- 2018-07
- Pages
- 1-8
- OpenAlex
- W2897077592
- Cited by
- 51
- References
- 12
- FWCI
- 1.54
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.