The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
The Layer-Wise Training Convolutional Neural Networks Using Local Loss for Sensor-Based Human Activity Recognition
Abstract
Recently, deep learning, which are able to extract automatically features from data, has achieved state-of-the-art performance across a variety of sensor based human activity recognition (HAR) tasks. However, the existing deep neural networks are usually trained with a global loss, and all hidden layer weights have to be always kept in memory before the forward and backward pass has completed. The backward locking phenomenon prevents the reuse of memory, which is a crucial limitation for wearable activity recognition. In the paper, we proposed a layer-wise convolutional neural networks (CNN) with local loss for the use of HAR task. To our knowledge, this paper is the first that uses local loss based CNN for HAR in ubiquitous and wearable computing arena. We performed experiments on five public HAR datasets including UCI HAR dataset, OPPOTUNITY dataset, UniMib-SHAR dataset, PAMAP dataset, and WISDM dataset. The results show that local loss works better than global loss for tested baseline architectures. At no extra cost, the local loss can approach the state-of-the-arts on a variety of HAR datasets, even though the number of parameters was smaller. We believe that the layer-wise CNN with local loss can be used to update the existing deep HAR methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Activity Recognition from User-Annotated Acceleration Data
Bao, L., & Intille, S. S. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24646-6_1 · Cited by 3,147
Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition
Ordóñez, F., & Roggen, D. (2016) · Sensors · doi:10.3390/s16010115 · Cited by 2,761 · cited 3×
“Ordóñez and Roggen [11] presented a generic deep framework composed of CNN and long-term short memory (LSTM) for activity recognition, which could fuse multimodal sensors to further improve the CNN on classification accuracy.”
BackgroundMethodDeep learning for sensor-based activity recognition: A survey
Wang, J., Chen, Y., Hao, S., Peng, X., & Hu, L. (2019) · Pattern Recognition Letters · doi:10.1016/j.patrec.2018.02.010 · Cited by 2,014 · cited 2×
“signals and it has achieved promising results on HAR tasks [1].”
BackgroundIntroducing a New Benchmarked Dataset for Activity Monitoring
Reiss, A., & Stricker, D. (2012) · 2012 16th International Symposium on Wearable Computers · doi:10.1109/iswc.2012.13 · Cited by 1,456 · cited 2×
“We evaluate our method on five public benchmark datasets, namely UCI HAR dataset [7], Opportunity dataset [17], UniMib-SHAR dataset [18], PAMAP2 dataset [19] and WISDM dataset [20].”
MethodHuman activity recognition with smartphone sensors using deep learning neural networks
Ronao, C. A., & Cho, S.-B. (2016) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.04.032 · Cited by 1,215
Convolutional Neural Networks for Human Activity Recognition using Mobile Sensors
Zeng, M., Nguyen, L. T., Yu, B., Mengshoel, O. J., Zhu, J., Wu, P., & Zhang, J. (2014) · Proceedings of the 6th International Conference on Mobile Computing, Applications and Services · doi:10.4108/icst.mobicase.2014.257786 · Cited by 876 · cited 2×
“For example, Zeng et al. [25] treated each dimension of the accelerometer as one channel like RGB of an image, then the convolution and pooling operation were performed separately.”
MethodResultInfluentialCollecting complex activity datasets in highly rich networked sensor environments
Roggen, D., Calatroni, A., Rossi, M., Holleczek, T., Forster, K., Troster, G., Lukowicz, P., Bannach, D., Pirkl, G., Ferscha, A., et al. (2010) · 2010 Seventh International Conference on Networked Sensing Systems (INSS) · doi:10.1109/inss.2010.5573462 · Cited by 788
Transition-Aware Human Activity Recognition Using Smartphones
Reyes-Ortiz, J.-L., Oneto, L., Samà, A., Parra, X., & Anguita, D. (2016) · Neurocomputing · doi:10.1016/j.neucom.2015.07.085 · Cited by 740
Human Activity Recognition Using Wearable Sensors by Deep Convolutional Neural Networks
Jiang, W., & Yin, Z. (2015) · Proceedings of the 23rd ACM international conference on Multimedia · doi:10.1145/2733373.2806333 · Cited by 676 · cited 3×
“For HAR, the state-of-the-art methods such as CNN [10] or DeepConvLSTM [11] tend to utilize global loss and gradient backpropagation to train neural networks, whereas it blocks the update of hidden layer weights before the forward and backward pass has completed.”
MethodInfluentialDeep, Convolutional, and Recurrent Models for Human Activity Recognition Using Wearables
Hammerla, N. Y., Halloran, S., & Ploetz, T. (2016) · arXiv · doi:10.48550/arxiv.1604.08880 · Cited by 606
UniMiB SHAR: A Dataset for Human Activity Recognition Using Acceleration Data from Smartphones
Micucci, D., Mobilio, M., & Napoletano, P. (2017) · doi:10.20944/preprints201706.0033.v1 · Cited by 596 · cited 2×
“We evaluate our method on five public benchmark datasets, namely UCI HAR dataset [7], Opportunity dataset [17], UniMib-SHAR dataset [18], PAMAP2 dataset [19] and WISDM dataset [20].”
MethodUniMiB SHAR: A Dataset for Human Activity Recognition Using Acceleration Data from Smartphones
Micucci, D., Mobilio, M., & Napoletano, P. (2017) · Applied Sciences · doi:10.3390/app7101101 · Cited by 596
Keeping the Resident in the Loop: Adapting the Smart Home to the User
Rashidi, P., & Cook, D. J. (2009) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/tsmca.2009.2025137 · Cited by 443 · cited 1×
“Human activity recognition (HAR) [1] based on wearable sensors has become a new research area with a wide range of real-world applications such as smart homes [2], health monitoring [3], sports tracking [4], and game console designing [5] to name but a few.”
BackgroundFeature Learning for Activity Recognition in Ubiquitous Computing
Plötz, T., Hammerla, N., & Olivier, P. (2011) · Newcastle University · doi:10.25405/ncl.34175319 · Cited by 337
Comparison of Feature Learning Methods for Human Activity Recognition Using Wearable Sensors
Li, F., Shirahama, K., Nisar, M., Köping, L., & Grzegorzek, M. (2018) · Sensors · doi:10.3390/s18020679 · Cited by 302
Ravi, D., Wong, C., Lo, B., & Yang, G.-Z. (2016) · 2016 IEEE 13th International Conference on Wearable and Implantable Body Sensor Networks (BSN) · doi:10.1109/bsn.2016.7516235 · Cited by 269 · cited 3×
“We evaluate our method on five public benchmark datasets, namely UCI HAR dataset [7], Opportunity dataset [17], UniMib-SHAR dataset [18], PAMAP2 dataset [19] and WISDM dataset [20].”
BackgroundMethodInfluentialA Comprehensive Analysis on Wearable Acceleration Sensors in Human Activity Recognition
Janidarmian, M., Roshan Fekr, A., Radecka, K., & Zilic, Z. (2017) · Sensors · doi:10.3390/s17030529 · Cited by 217
Zeng, M., Gao, H., Yu, T., Mengshoel, O. J., Langseth, H., Lane, I., & Liu, X. (2018) · Proceedings of the 2018 ACM International Symposium on Wearable Computers · doi:10.1145/3267242.3267286 · Cited by 185 · cited 1×
“For comparisons, we subsampled the sensor signals in order to match the frequency used in other related literatures [33], [34], [36], [37] on the dataset, which is still sufficient for sensing body motion.”
MethodOptimising sampling rates for accelerometer-based human activity recognition
Khan, A., Hammerla, N., Mellor, S., & Plötz, T. (2016) · Pattern Recognition Letters · doi:10.1016/j.patrec.2016.01.001 · Cited by 171 · cited 2×
“Khan et al. [36] shows that activity recognition with wearable sensing typically uses non-optimal sampling rates.”
BackgroundMethodDeep Activity Recognition Models with Triaxial Accelerometers
Alsheikh, M. A., Selim, A., Niyato, D., Doyle, L., Lin, S., & Tan, H.-P. (2015) · arXiv · doi:10.48550/arxiv.1511.04664 · Cited by 126
Recognizing Human Activities from Raw Accelerometer Data Using Deep Neural Networks
Zhang, L., Wu, X., & Luo, D. (2015) · 2015 IEEE 14th International Conference on Machine Learning and Applications (ICMLA) · doi:10.1109/icmla.2015.48 · Cited by 59 · cited 1×
“Even though our result is lower than the previously published result 82.3%(Zhang et al. [32], 2015) using deep belief networks, which needs larger computation, predsim loss is able to achieve the same 4.1% improvement on Zeng et al’s method [25] using CNN alone.”
ResultInfluentialSelf-citation
Research works printed but not linked: 20
- 10.1016/j.asoc.2017.09.027 · DOI · Paper page
- 10.1109/ACCESS.2018.2873315 · DOI
- 2020, Human Activity Recognition Using Recurrent Neural Nets RNN LSTM and Tensorflow on Smartphones
- jaderberg, 2017, Decoupled neural interfaces using synthetic gradients, Proc Int Conf Mach Learn (JMLR), 17, 1627
- gomez, 2017, The reversible residual network: Backpropagation without storing activations, Proc Adv Neural Inf Process Syst, 2214
- bengio, 2015, Towards biologically plausible deep learning, arXiv 1502 04156
- glorot, 2011, Deep sparse rectifier neural networks, Proc 14th Int Conf Artif Intell Statist, 315
- nøkland, 2019, Training neural networks with local error signals, arXiv 1901 06656
- 10.3390/s140406474 · DOI · Paper page
- 10.3390/computers2020088 · DOI · Paper page
- 10.1137/1.9781611972825.10 · DOI · Paper page
- 10.1016/j.simpat.2009.09.002 · DOI
- 10.1109/TSMCC.2012.2198883 · DOI · Paper page
- paszke, 2017, Automatic differentiation in PyTorch, Proc NIPS Autodiff Workshop
- 10.1109/SURV.2012.110112.00192 · DOI · Paper page
- casale, 2011, Human activity recognition from accelerometer data using a wearable device, Proc Iberian Conf Pattern Recognit Image Anal, 289, 10.1007/978-3-642-21257-4_36 · DOI · Paper page
- 10.1007/978-3-642-35395-6_30 · DOI · Paper page
- 10.1109/ISWC.2010.5665868 · DOI · Paper page
- 10.1145/1107548.1107591 · DOI · Paper page
- 10.1109/JSEN.2019.2917225 · DOI · Paper page
Cited by
A multibranch CNN-BiLSTM model for human activity recognition using wearable sensor data
Challa, S. K., Kumar, A., & Semwal, V. B. (2022) · The Visual Computer · doi:10.1007/s00371-021-02283-3 · Cited by 338
Multiscale Deep Feature Learning for Human Activity Recognition Using Wearable Sensors
Tang, Y., Zhang, L., Min, F., & He, J. (2023) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2022.3161812 · Cited by 224
“Finally, a competitive performance can be obtained via implementing the proposed method on UNIMIB-SHAR dataset, which exceeds all previous top results [10], [31], [33].”
BackgroundMethodInfluentialSelf-citationDanHAR: Dual Attention Network for multimodal human activity recognition using wearable sensors
Gao, W., Zhang, L., Teng, Q., He, J., & Wu, H. (2021) · Applied Soft Computing · doi:10.1016/j.asoc.2021.107728 · Cited by 214
Self-citationShallow Convolutional Neural Networks for Human Activity Recognition Using Wearable Sensors
Huang, W., Zhang, L., Gao, W., Min, F., & He, J. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3091990 · Cited by 129
Self-citationFederated Contrastive Learning With Feature-Based Distillation for Human Activity Recognition
Xiao, Z., & Tong, H. (2025) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2024.3510428 · Cited by 86
Metadata
- Authors
- Teng, Q., Wang, K., Zhang, L., & He, J.
- Venue
- IEEE Sensors Journal
- Published
- 2020-07-01
- Volume
- 20
- Issue
- 13
- Pages
- 7265-7274
- ISSN
- 1530-437X (ISSN-L)
- 1558-1748
- 2379-9153
- OpenAlex
- W3009411039
- Cited by
- 183
- References
- 21
- FWCI
- 9.83
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Funders
- National Science Foundation of China (61203237)
- Industry–Academia Cooperation Innovation Fund Projection of Jiangsu Province (BY2016001-02)
- Natural Science Foundation of Jiangsu Province (BK20191371)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.