The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Convolutional Neural Networks for Human Activity Recognition Using Body-Worn Sensors
Open accessAbstract
Human activity recognition (HAR) is a classification task for recognizing human movements. Methods of HAR are of great interest as they have become tools for measuring occurrences and durations of human actions, which are the basis of smart assistive technologies and manual processes analysis. Recently, deep neural networks have been deployed for HAR in the context of activities of daily living using multichannel time-series. These time-series are acquired from body-worn devices, which are composed of different types of sensors. The deep architectures process these measurements for finding basic and complex features in human corporal movements, and for classifying them into a set of human actions. As the devices are worn at different parts of the human body, we propose a novel deep neural network for HAR. This network handles sequence measurements from different body-worn devices separately. An evaluation of the architecture is performed on three datasets, the Oportunity, Pamap2, and an industrial dataset, outperforming the state-of-the-art. In addition, different network configurations will also be evaluated. We find that applying convolutions per sensor channel and per body-worn device improves the capabilities of convolutional neural network (CNNs).
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“A majority of the CNNs consist of five to nine layers [23,63,64,113,114,165,166,167,168], usually including two to three convolutional layers, two to three max-pooling layers, followed by one to two fully connected layers before feeding the feature representation into the output layer (softmax layer in most cases).”
From Deep Learning in Human Activity Recognition with Wearable Sensors: A Review on Advances (2022) · cites this paper as [114]
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Convolutional Two-Stream Network Fusion for Video Action Recognition
Feichtenhofer, C., Pinz, A. J., & Zisserman, A. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.213 · Cited by 2,842
Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition
Ordóñez, F., & Roggen, D. (2016) · Sensors · doi:10.3390/s16010115 · Cited by 2,761 · cited 10×
“This architecture was introduced in a previous work [11] based on the CNN and deepConvLSTM presented in [4,5,9].”
BackgroundMethodInfluentialA Survey on Human Activity Recognition using Wearable Sensors
Lara, O. D., & Labrador, M. A. (2013) · IEEE Communications Surveys & Tutorials · doi:10.1109/surv.2012.110112.00192 · Cited by 2,662
Convolutional networks and applications in vision
LeCun, Y., Kavukcuoglu, K., & Farabet, C. (2010) · Proceedings of 2010 IEEE International Symposium on Circuits and Systems · doi:10.1109/iscas.2010.5537907 · Cited by 2,213
A tutorial on human activity recognition using body-worn inertial sensors
Bulling, A., Blanke, U., & Schiele, B. (2014) · ACM Computing Surveys · doi:10.1145/2499621 · Cited by 1,668
Introducing a New Benchmarked Dataset for Activity Monitoring
Reiss, A., & Stricker, D. (2012) · 2012 16th International Symposium on Wearable Computers · doi:10.1109/iswc.2012.13 · Cited by 1,456 · cited 2×
“The step size allows a 78% overlapping as in [9,31].”
BackgroundProceedings of the 24th International Conference on Neural Information Processing Systems
Shawe-Taylor, J. S., Zemel, R. S., Bartlett, P. L., Pereira, F. B., & Weinberger, K. Q. (2011) · Cited by 1,184
(2015) · Cited by 989
Convolutional Neural Networks for Human Activity Recognition using Mobile Sensors
Zeng, M., Nguyen, L. T., Yu, B., Mengshoel, O. J., Zhu, J., Wu, P., & Zhang, J. (2014) · Proceedings of the 6th International Conference on Mobile Computing, Applications and Services · doi:10.4108/icst.mobicase.2014.257786 · Cited by 876
Collecting complex activity datasets in highly rich networked sensor environments
Roggen, D., Calatroni, A., Rossi, M., Holleczek, T., Forster, K., Troster, G., Lukowicz, P., Bannach, D., Pirkl, G., Ferscha, A., et al. (2010) · 2010 Seventh International Conference on Networked Sensing Systems (INSS) · doi:10.1109/inss.2010.5573462 · Cited by 788
Fukushima, K., & Miyake, S. (1982) · Pattern Recognition · doi:10.1016/0031-3203(82)90024-3 · Cited by 768
The Opportunity challenge: A benchmark database for on-body sensor-based activity recognition
Chavarriaga, R., Sagha, H., Calatroni, A., Digumarti, S. T., Tröster, G., Millán, J. D. R., & Roggen, D. (2013) · Pattern Recognition Letters · doi:10.1016/j.patrec.2012.12.014 · Cited by 742 · cited 2×
“Sessions ADL3 of participants 2 and 3 are used as validation set, and sessions ADL4 and ADL5 of participants 2 and 3 as testing set, following [3,5,30].”
BackgroundMethodPermutation Tests for Studying Classifier Performance
Ojala, M., & Garriga, G. C. (2009) · Proceedings · doi:10.1109/icdm.2009.108 · Cited by 578
Word Spotting and Recognition with Embedded Attributes
Almazán, J., Gordo, A., Fornés, A., & Valveny, E. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2339814 · Cited by 514
A deep learning approach to on-node sensor data analytics for mobile or wearable devices
Ravi, D., Wong, C., Lo, B., & Yang, G.-Z. (2017) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2016.2633287 · Cited by 439
Analyzing features for activity recognition
Huỳnh, T., & Schiele, B. (2005) · Proceedings of the 2005 joint conference on Smart objects and ambient intelligence: innovative context-aware services: usages and technologies · doi:10.1145/1107548.1107591 · Cited by 336
Permutation Tests for Studying Classifier Performance
Ojala, M., & Garriga, G. C. (2010) · Journal of Machine Learning Research · doi:10.5555/1756006.1859913 · Cited by 330
Spectral Representations for Convolutional Neural NetworksPreprint
Rippel, O., Snoek, J., & Adams, R. P. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.03767 · Cited by 276
Ravi, D., Wong, C., Lo, B., & Yang, G.-Z. (2016) · 2016 IEEE 13th International Conference on Wearable and Implantable Body Sensor Networks (BSN) · doi:10.1109/bsn.2016.7516235 · Cited by 269
PHOCNet: A Deep Convolutional Neural Network for Word Spotting in Handwritten Documents
Sudholt, S., & Fink, G. A. (2016) · International Conference on Frontiers in Handwriting Recognition · doi:10.1109/icfhr.2016.0060 · Cited by 243
Self-citationDeep Convolutional Neural Networks for Human Activity Recognition with Smartphone Sensors
Ronao, C. A., & Cho, S.-B. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-26561-2_6 · Cited by 176
Yao, R., Lin, G., Shi, Q., & Ranasinghe, D. C. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2017.12.024 · Cited by 115
Deep Neural Network based Human Activity Recognition for the Order Picking Process
Grzeszick, R., Lenk, J. M., Rueda, F. M., Fink, G. A., Feldhorst, S., & ten Hompel, M. (2017) · Proceedings of the 4th International Workshop on Sensor-based Activity Recognition and Interaction · doi:10.1145/3134230.3134231 · Cited by 93
Self-citationIn-Home Activity Recognition: Bayesian Inference for Hidden Markov Models
Ordóñez, F. J., Englebienne, G., de Toledo, P., van Kasteren, T. L. M., Sanchis, A., & Kröse, B. (2014) · IEEE Pervasive Computing · doi:10.1109/mprv.2014.52 · Cited by 48
Feldhorst, S., Masoudenijad, M., ten Hompel, M., & Fink, G. A. (2016) · International Conference on Pattern Recognition Applications and Methods · doi:10.5220/0005828407060713 · Cited by 22
Self-citationLimited-Memory Warping LCSS for Real-Time Low-Power Pattern Recognition in Wireless Nodes
Roggen, D., Cuspinera, L. P., Pombo, G., Ali, F. H., & Nguyen-Dinh, L.-V. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-15582-1_10 · Cited by 20
Analysing acoustic model changes for active learning in automatic speech recognition
Wu, C., Ng, R. W. M., Saz, Ó., & Hain, T. (2017) · International Conference on Systems, Signals and Image Processing · doi:10.1109/iwssip.2017.7965609 · Cited by 3
Research works printed but not linked: 4
- Hammerla, N.Y., Halloran, S., and Ploetz, T. (arXiv, 2016). Deep, convolutional, and recurrent models for human activity recognition using wearables, arXiv.
- Badrinarayanan, V., Handa, A., and Cipolla, R. (arXiv, 2015). Segnet: A deep convolutional encoder-decoder architecture for robust semantic pixel-wise labelling, arXiv.
- Graves, A. (arXiv, 2013). Generating sequences with recurrent neural networks, arXiv.
- Saxe, A.M., McClelland, J.L., and Ganguli, S. (arXiv, 2013). Exact solutions to the nonlinear dynamics of learning in deep linear neural networks, arXiv.
Cited by
Sorted by citations
Deep Learning in Human Activity Recognition with Wearable Sensors: A Review on Advances
Zhang, S., Li, Y., Zhang, S., Shahabi, F., Xia, S., Deng, Y., & Alshurafa, N. (2022) · Sensors · doi:10.3390/s22041476 · Cited by 625
“A majority of the CNNs consist of 5 to 9 layers [67, 91, 193, 232, 272, 300, 313], [130], [96], usually including 2 to 3 convolutional layers, 2 to 3 max pooling layers, followed by 1 to 2 fully connected layers before feeding the feature representation into the output layer (softmax layer in most cases).”
BackgroundMethodInfluentialPareek, P., & Thakkar, A. (2020) · Artificial Intelligence Review · doi:10.1007/s10462-020-09904-8 · Cited by 475
A CNN-LSTM Approach to Human Activity Recognition
Mutegeki, R., & Han, D. S. (2020) · 2020 International Conference on Artificial Intelligence in Information and Communication (ICAIIC) · doi:10.1109/icaiic48513.2020.9065078 · Cited by 452
Deep Learning for Time Series Classification and Extrinsic Regression: A Current Survey
Foumani, N. M., Miller, L., Tan, C. W., Webb, G. I., Forestier, G., & Salehi, M. (2024) · ACM Computing Surveys · doi:10.1145/3649448 · Cited by 328
Wearable Sensor-Based Human Activity Recognition in the Smart Healthcare System
Serpush, F., Menhaj, M. B., Masoumi, B., & Karasfi, B. (2022) · Computational Intelligence and Neuroscience · doi:10.1155/2022/1391906 · Cited by 174
Metadata
- Authors
- Moya Rueda, F., Grzeszick, R., Fink, G. A., Feldhorst, S., & Ten Hompel, M.
- Affiliations
- Department of Computer Science, TU Dortmund University, 44227 Dortmund, Germany
- TU Dortmund University (DE)
- Fraunhofer Institute for Material Flow and Logistics (DE)
- Fraunhofer IML, 44227 Dortmund, Germany
- Venue
- Informatics
- Publisher
- MDPI AG
- Published
- 2018-05-25
- Volume
- 5
- Issue
- 2
- Pages
- 26
- ISSN
- 2227-9709 (ISSN-L)
- OpenAlex
- W2803675191
- Cited by
- 196
- References
- 30
- Citations by year
- 2026: 12 · 2025: 16 · 2024: 27 · 2023: 30 · 2022: 35 · 2021: 31 · 2020: 29 · 2019: 14 · 2018: 2
- FWCI
- 9.51
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Informatics (publishedVersion, cc-by)
- Technische Universität Dortmund Eldorado (Technische Universität Dortmund) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Publikationsdatenbank der Fraunhofer-Gesellschaft (Fraunhofer-Gesellschaft) (submittedVersion, other-oa)
- Fraunhofer-Publica (Fraunhofer-Gesellschaft) (submittedVersion)
- Technische Universität Dortmund Eldorado (Technische Universität Dortmund) (cc-by)
- Funders
- Deutsche Forschungsgemeinschaft (Fi799/10-1)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Physical Sciences › Computer Science › Signal Processing › Time Series Analysis and Forecasting
- Keywords
- human activity recognition, wearable sensors, convolutional neural networks, activities of daily living, multichannel time series, wearable devices
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
