Deep recurrent neural network for mobile human activity recognition with high throughput
Open accessThe DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Abstract
In this paper, we propose a method of human activity recognition with high throughput from raw accelerometer data applying a deep recurrent neural network (DRNN), and investigate various architectures and its combination to find the best parameter values. The “high throughput” refers to short time at a time of recognition. We investigated various parameters and architectures of the DRNN by using the training dataset of 432 trials with 6 activity classes from 7 people. The maximum recognition rate was 95.42% and 83.43% against the test data of 108 segmented trials each of which has single activity class and 18 multiple sequential trials, respectively. Here, the maximum recognition rates by traditional methods were 71.65% and 54.97% for each. In addition, the efficiency of the found parameters was evaluated using additional dataset. Further, as for throughput of the recognition per unit time, the constructed DRNN was requiring only 1.347 ms, while the best traditional method required 11.031 ms which includes 11.027 ms for feature calculation. These advantages are caused by the compact and small architecture of the constructed real time oriented DRNN.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Neural Networks: A Comprehensive Foundation
Haykin, S. (1998) · Cited by 30,070
Improving neural networks by preventing co-adaptation of feature detectors
Hinton, G. E., Srivastava, N., Krizhevsky, A., Sutskever, I., & Salakhutdinov, R. R. (2012) · arXiv · doi:10.48550/arxiv.1207.0580 · Cited by 6,382
Graves, A., Fernández, S., Gomez, F., & Schmidhuber, J. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143891 · Cited by 5,370
On the difficulty of training recurrent neural networks
Pascanu, R., Mikolov, T., & Bengio, Y. (2012) · arXiv · doi:10.48550/arxiv.1211.5063 · Cited by 4,310
Activity Recognition from User-Annotated Acceleration Data
Bao, L., & Intille, S. S. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24646-6_1 · Cited by 3,147
Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition
Ordóñez, F., & Roggen, D. (2016) · Sensors · doi:10.3390/s16010115 · Cited by 2,761 · cited 4×
“In concrete, the total size of the inner variables and architecture from the input layer to the output layer of the DRNN is 74166 pcs, and this is the size of less than 10% of the conventional CNN + LSTM model [24].”
BackgroundMethodInfluentialA survey of mobile phone sensing
Lane, N., Miluzzo, E., Lu, H., Peebles, D., Choudhury, T., & Campbell, A. (2010) · IEEE Communications Magazine · doi:10.1109/mcom.2010.5560598 · Cited by 2,292
(2013) · RECERCAT (Consorci de Serveis Universitaris de Catalunya) · Cited by 1,959
A tutorial on human activity recognition using body-worn inertial sensors
Bulling, A., Blanke, U., & Schiele, B. (2014) · ACM Computing Surveys · doi:10.1145/2499621 · Cited by 1,668
(2015) · Cited by 989
Nurses' Recognition of Delirium and Its Symptoms: Comparison of Nurse and Researcher Ratings
Inouye, S. K. (2001) · Archives of Internal Medicine · doi:10.1001/archinte.161.20.2467 · Cited by 778
Human Activity Recognition and Pattern Discovery
Kim, E., Helal, S., & Cook, D. (2010) · IEEE Pervasive Computing · doi:10.1109/mprv.2010.7 · Cited by 704
Deep, Convolutional, and Recurrent Models for Human Activity Recognition Using Wearables
Hammerla, N. Y., Halloran, S., & Ploetz, T. (2016) · arXiv · doi:10.48550/arxiv.1604.08880 · Cited by 606
Activity recognition on streaming sensor data
Krishnan, N. C., & Cook, D. J. (2014) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2012.07.003 · Cited by 488
Training recurrent neural networks
Hinton, G. E., & Sutskever, I. (2013) · Cited by 383
A Feature Selection-Based Framework for Human Activity Recognition Using Wearable Multimodal Sensors
Zhang, M., & Sawchuk, A. (2011) · Proceedings of the 6th International ICST Conference on Body Area Networks · doi:10.4108/icst.bodynets.2011.247018 · Cited by 170
A feature selection-based framework for human activity recognition using wearable multimodal sensors
Zhang, M., & Sawchuk, A. A. (2011) · doi:10.5555/2318776.2318798 · Cited by 159
Kawaguchi, N., Ogawa, N., Iwasaki, Y., Kaji, K., Terada, T., Murao, K., Inoue, S., Kawahara, Y., Sumi, Y., & Nishio, N. (2011) · Augmented Human International Conference · doi:10.1145/1959826.1959853 · Cited by 144
Self-citationMotion primitive-based human activity recognition using a bag-of-features approach
Zhang, M., & Sawchuk, A. A. (2012) · Proceedings of the 2nd ACM SIGHIT International Health Informatics Symposium · doi:10.1145/2110363.2110433 · Cited by 125
ClimbAX: skill assessment for climbing enthusiasts
Ladha, C., Hammerla, N., Olivier, P. L., & Plötz, T. (2013) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/2493432.2493492 · Cited by 122
Using unlabeled data in a sparse-coding framework for human activity recognition
Bhattacharya, S., Nurmi, P., Hammerla, N., & Plötz, T. (2014) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2014.05.006 · Cited by 121
Mazilu, S., Blanke, U., Dorfman, M., Gazit, E., Mirelman, A., Hausdorff, J. M., & Tröster, G. (2015) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/2701431 · Cited by 70
Mobile activity recognition for a whole day: recognizing real nursing activities with big dataset
Inoue, S., Ueda, N., Nohara, Y., & Nakashima, N. (2015) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/2750858.2807533 · Cited by 59
Self-citationMulti-scale Conditional Random Fields for first-person activity recognition
Zhan, K., Faux, S. G., & Ramos, F. T. (2014) · IEEE International Conference on Pervasive Computing and Communications · doi:10.1109/percom.2014.6813944 · Cited by 54
Pre-training of Recurrent Neural Networks via Linear Autoencoders
Pasa, L., & Sperduti, A. (2014) · Padua Research Archive (University of Padova) · Cited by 38
Cost-sensitive feature selection for on-body sensor localization
Saeedi, R., Schimert, B., & Ghasemzadeh, H. G. (2014) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/2638728.2641313 · Cited by 34
Research works printed but not linked: 7
- Amodei D, Ananthanarayanan S, Anubhai R, Bai J, Battenberg E, Case C, Casper J, Catanzaro B, Cheng Q, Chen G, Chen J, Chen J, Chen Z, Chrzanowski M, Coates A, Diamos G, Ding K, Du N, Elsen E, Engel J, Fang W, Fan L, Fougner C, Gao L, Gong C, Hannun A, Han T, Johannes L, Jiang B, Ju C, Jun B, LeGresley P, Lin L, Liu J, Liu Y, Li W, Li X, Ma D, Narang S, Ng A, Ozair S, Peng Y, Prenger R, Qian S, Quan Z, Raiman J, Rao V, Satheesh S, Seetapun D, Sengupta S, Srinet K, Sriram A, Tang H, Tang L, Wang C, Wang J, Wang K, Wang Y, Wang Z, Wang Z, Wu S, Wei L, Xiao B, Xie W, Xie Y, Yogatama D, Yuan B, Zhan J, Zhu Z (Jun 2016) Deep speech 2: end-to-end speech recognition in English and mandarin. In: Balcan MF, Weinberger KQ (eds) Proceedings of The 33rd international conference on machine learning, Proceedings of machine learning research, PMLR, New York, New York, USA, vol 48, 20–22, pp 173–182
- Avci A, Bosch S, Marin-Perianu M, Marin-Perianu R, Havinga P (2010) Activity, recognition using inertial sensing for healthcare, wellbeing and sports applications: a survey. In: 23rd international conference on Architecture of computing systems (ARCS), VDE 2010, pp 1–10
- Guyon I, Elisseeff A (2003) An introduction to variable and feature selection. J Mach Learn Res 3:1157–1182
- Le QV, Jaitly N, Hinton GE (2015) A simple way to initialize recurrent networks of rectified linear units. arXiv preprint arXiv:1504.00941 · arXiv
- Strohrmann C, Harms H, Tröster G (2011) What do sensors know about your running performance? In: Proceedings—international symposium on wearable computers, ISWC, pp 101–104 · doi:10.1109/iswc.2011.21
- Tokui S, Oono K, Hido S, Clayton J (2015) Chainer: a next-generation open source framework for deep learning. In: Proceedings of workshop on machine learning systems (LearningSys) in the twenty-ninth annual conference on neural information processing systems (NIPS)
- Wu J, Yildirim I, Lim J, Freeman W, Tenenbaum J (2015) Galileo: perceiving physical object properties by integrating a physics engine with deep learning. In: Advances in neural information processing systems (NIPS 2015), vol 28, pp 1–9
Cited by
Deep learning for sensor-based activity recognition: A survey
Wang, J., Chen, Y., Hao, S., Peng, X., & Hu, L. (2019) · Pattern Recognition Letters · doi:10.1016/j.patrec.2018.02.010 · Cited by 2,014
“Few works has proposed RNN for the HAR tasks (Hammerla et al., 2016; Inoue et al., 2016; Edel and Köppe, 2016; Guan and Ploetz, 2017), where the learning speed and resource consumption are the main concerns for HAR.”
BackgroundMethodReal-time human activity recognition from accelerometer data using Convolutional Neural Networks
Ignatov, A. (2018) · Applied Soft Computing · doi:10.1016/j.asoc.2017.09.027 · Cited by 814
Sensor-based and vision-based human activity recognition: A comprehensive survey
Minh Dang, L., Min, K., Wang, H., Jalil Piran, M., Hee Lee, C., & Moon, H. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2020.107561 · Cited by 730
Qiu, S., Zhao, H., Jiang, N., Wang, Z., Liu, L., An, Y., Zhao, H., Miao, X., Liu, R., & Fortino, G. (2022) · Information Fusion · doi:10.1016/j.inffus.2021.11.006 · Cited by 671
Deep Learning in Human Activity Recognition with Wearable Sensors: A Review on Advances
Zhang, S., Li, Y., Zhang, S., Shahabi, F., Xia, S., Deng, Y., & Alshurafa, N. (2022) · Sensors · doi:10.3390/s22041476 · Cited by 625
“Since then, the recurrent neural network (RNN) with time series as input has been widely applied to classify human activities or estimate hand gestures [52, 65, 132, 175, 268, 269, 275], [12].”
Background
Metadata
- Authors
- Inoue, M., Inoue, S., & Nishida, T.
- Venue
- Artificial Life and Robotics
- Published
- 2017-12-30
- Volume
- 23
- Issue
- 2
- Pages
- 173-185
- ISSN
- 1433-5298 (ISSN-L)
- 1614-7456
- OpenAlex
- W2550797816
- Cited by
- 275
- References
- 28
- FWCI
- 10.00
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.