Deep Neural Networks for Sensor-Based Human Activity Recognition Using Selective Kernel Convolution
The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Abstract
Recently, the state-of-the-art performance in various sensor-based human activity recognition (HAR) tasks has been acquired by deep learning, which can extract automatically features from raw data. In standard convolutional neural networks (CNNs), there is usually the same receptive field (RF) size of artificial neurons within each feature layer. It is well known that the RF size of neurons is able to change adaptively according to the stimulus, which has rarely been exploited in HAR. In this article, a new multibranch CNN is introduced, which utilizes a selective kernel mechanism for HAR. To the best of our knowledge, it is for the first time to adopt an attention idea to perform kernel selection among multiple branches with different RFs in the HAR scenario. We perform extensive experiments on several benchmark HAR datasets, namely, UCI-HAR, UNIMIB SHAR, WISDM, PAMAP2, and OPPORTUNITY, as well as weakly labeled datasets. Ablation experiments show that the selective kernel convolution can adaptively choose an appropriate RF size among multiple branches for classifying numerous human activities. As a result, it can achieve a higher recognition accuracy under a similar computing budget.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
CBAM: Convolutional Block Attention Module
Woo, S., Park, J., Lee, J.-Y., & Kweon, I. S. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_1 · Cited by 25,853
Activity recognition using cell phone accelerometers
Kwapisz, J. R., Weiss, G. M., & Moore, S. A. (2011) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1964897.1964918 · Cited by 2,912 · cited 5×
“First, in order to verify the efficiency of the SK method, extensive experiments are performed on five benchmark datasets, consisting of UCI-HAR [12], UNIMIB SHAR [13], WISDM [14], PAMAP2 [15], and OPPORTUNITY [16] in the supervised HAR scenario.”
BackgroundMethodInfluentialDeep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition
Ordóñez, F., & Roggen, D. (2016) · Sensors · doi:10.3390/s16010115 · Cited by 2,761 · cited 4×
“In the multimodal HAR scenario, Ordóñez and Roggen [22] presented a DeepConvLSTM network, which combines convolutional and LSTM units for fusing multimodal sensor information to improve recognition performance.”
BackgroundMethodResultInfluentialDeep learning for sensor-based activity recognition: A survey
Wang, J., Chen, Y., Hao, S., Peng, X., & Hu, L. (2019) · Pattern Recognition Letters · doi:10.1016/j.patrec.2018.02.010 · Cited by 2,014
Introducing a New Benchmarked Dataset for Activity Monitoring
Reiss, A., & Stricker, D. (2012) · 2012 16th International Symposium on Wearable Computers · doi:10.1109/iswc.2012.13 · Cited by 1,456 · cited 3×
“First, in order to verify the efficiency of the SK method, extensive experiments are performed on five benchmark datasets, consisting of UCI-HAR [12], UNIMIB SHAR [13], WISDM [14], PAMAP2 [15], and OPPORTUNITY [16] in the supervised HAR scenario.”
BackgroundMethodHuman activity recognition with smartphone sensors using deep learning neural networks
Ronao, C. A., & Cho, S.-B. (2016) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.04.032 · Cited by 1,215
Srivastava, R. K., Greff, K., & Schmidhuber, J. (2015) · arXiv · doi:10.48550/arxiv.1505.00387 · Cited by 912
Convolutional Neural Networks for Human Activity Recognition using Mobile Sensors
Zeng, M., Nguyen, L. T., Yu, B., Mengshoel, O. J., Zhu, J., Wu, P., & Zhang, J. (2014) · Proceedings of the 6th International Conference on Mobile Computing, Applications and Services · doi:10.4108/icst.mobicase.2014.257786 · Cited by 876 · cited 1×
“For example, in order to maintain scale invariance character within an acceleration signal, Zeng et al. [17] first used CNNs to learn discriminative features for recognizing various human activities.”
BackgroundThe Opportunity challenge: A benchmark database for on-body sensor-based activity recognition
Chavarriaga, R., Sagha, H., Calatroni, A., Digumarti, S. T., Tröster, G., Millán, J. D. R., & Roggen, D. (2013) · Pattern Recognition Letters · doi:10.1016/j.patrec.2012.12.014 · Cited by 742 · cited 6×
“First, in order to verify the efficiency of the SK method, extensive experiments are performed on five benchmark datasets, consisting of UCI-HAR [12], UNIMIB SHAR [13], WISDM [14], PAMAP2 [15], and OPPORTUNITY [16] in the supervised HAR scenario.”
BackgroundMethodInfluentialHuman Activity Recognition Using Wearable Sensors by Deep Convolutional Neural Networks
Jiang, W., & Yin, Z. (2015) · Proceedings of the 23rd ACM international conference on Multimedia · doi:10.1145/2733373.2806333 · Cited by 676 · cited 1×
“D activity image, Jiang and Yin [21] proposed a novel CNN that is able to extract optimal features from the image for the use of HAR.”
BackgroundDeep, Convolutional, and Recurrent Models for Human Activity Recognition Using Wearables
Hammerla, N. Y., Halloran, S., & Ploetz, T. (2016) · arXiv · doi:10.48550/arxiv.1604.08880 · Cited by 606
UniMiB SHAR: A Dataset for Human Activity Recognition Using Acceleration Data from Smartphones
Micucci, D., Mobilio, M., & Napoletano, P. (2017) · doi:10.20944/preprints201706.0033.v1 · Cited by 596 · cited 3×
“First, in order to verify the efficiency of the SK method, extensive experiments are performed on five benchmark datasets, consisting of UCI-HAR [12], UNIMIB SHAR [13], WISDM [14], PAMAP2 [15], and OPPORTUNITY [16] in the supervised HAR scenario.”
BackgroundMethodUniMiB SHAR: A Dataset for Human Activity Recognition Using Acceleration Data from Smartphones
Micucci, D., Mobilio, M., & Napoletano, P. (2017) · Applied Sciences · doi:10.3390/app7101101 · Cited by 596
BlockDrop: Dynamic Inference Paths in Residual Networks
Wu, Z., Nagarajan, T., Kumar, A., Rennie, S., Davis, L. S., Grauman, K., & Feris, R. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00919 · Cited by 465
Comparison of Feature Learning Methods for Human Activity Recognition Using Wearable Sensors
Li, F., Shirahama, K., Nisar, M., Köping, L., & Grzegorzek, M. (2018) · Sensors · doi:10.3390/s18020679 · Cited by 302
Zeng, M., Gao, H., Yu, T., Mengshoel, O. J., Langseth, H., Lane, I., & Liu, X. (2018) · Proceedings of the 2018 ACM International Symposium on Wearable Computers · doi:10.1145/3267242.3267286 · Cited by 185 · cited 1×
“Zeng et al. [31] embedded two continuous attention modules into recurrent networks along temporal and sensor axes, respectively, to improve the understandability of HAR.”
BackgroundOptimising sampling rates for accelerometer-based human activity recognition
Khan, A., Hammerla, N., Mellor, S., & Plötz, T. (2016) · Pattern Recognition Letters · doi:10.1016/j.patrec.2016.01.001 · Cited by 171 · cited 1×
“Khan et al. [33] proposed a useful approach to optimize sampling frequencies of acceleration signals, which can effectively tailor activity inference systems according to particular scenarios.”
BackgroundDeep Activity Recognition Models with Triaxial Accelerometers
Alsheikh, M. A., Selim, A., Niyato, D., Doyle, L., Lin, S., & Tan, H.-P. (2015) · arXiv · doi:10.48550/arxiv.1511.04664 · Cited by 126
Cited by
Deep Learning in Human Activity Recognition with Wearable Sensors: A Review on Advances
Zhang, S., Li, Y., Zhang, S., Shahabi, F., Xia, S., Deng, Y., & Alshurafa, N. (2022) · Sensors · doi:10.3390/s22041476 · Cited by 625
“A majority of the CNNs consist of 5 to 9 layers [67, 91, 193, 232, 272, 300, 313], [130], [96], usually including 2 to 3 convolutional layers, 2 to 3 max pooling layers, followed by 1 to 2 fully connected layers before feeding the feature representation into the output layer (softmax layer in most cases).”
BackgroundWearable Sensor-Based Human Activity Recognition with Transformer Model
Dirgová Luptáková, I., Kubovčík, M., & Pospíchal, J. (2022) · Sensors · doi:10.3390/s22051911 · Cited by 270
“The paper [4] introduced a new approach - attention for learning multiscale features among multiple kernels of 1D convolution layers in HAR issues.”
BackgroundHuman activity recognition using wearable sensors by heterogeneous convolutional neural networks
Han, C., Zhang, L., Tang, Y., Huang, W., Min, F., & He, J. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.116764 · Cited by 130
Self-citationFederated Contrastive Learning With Feature-Based Distillation for Human Activity Recognition
Xiao, Z., & Tong, H. (2025) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2024.3510428 · Cited by 86
Metadata
- Authors
- Gao, W., Zhang, L., Huang, W., Min, F., He, J., & Song, A.
- Venue
- IEEE Transactions on Instrumentation and Measurement
- Published
- 2021
- Volume
- 70
- Pages
- 1-13
- ISSN
- 0018-9456 (ISSN-L)
- 1557-9662
- OpenAlex
- W3188277880
- Cited by
- 105
- References
- 20
- FWCI
- 7.14
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.