The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Convolutional neural networks for human activity recognition using multiple accelerometer and gyroscope sensors
Abstract
Human activity recognition involves classifying times series data, measured at inertial sensors such as accelerometers or gyroscopes, into one of pre-defined actions. Recently, convolutional neural network (CNN) has established itself as a powerful technique for human activity recognition, where convolution and pooling operations are applied along the temporal dimension of sensor signals. In most of existing work, 1D convolution operation is applied to individual univariate time series, while multi-sensors or multi-modality yield multivariate time series. 2D convolution and pooling operations are applied to multivariate time series, in order to capture local dependency along both temporal and spatial domains for uni-modal data, so that it achieves high performance with less number of parameters compared to 1D operation. However for multi-modal data existing CNNs with 2D operation handle different modalities in the same way, which cause interferences between characteristics from different modalities. In this paper, we present CNNs (CNN-pf and CNN-pff), especially CNN-pff, for multi-modal data. We employ both partial weight sharing and full weight sharing for our CNN models in such a way that modality-specific characteristics as well as common characteristics across modalities are learned from multi-modal (or multi-sensor) data and are eventually aggregated in upper layers. Experiments on benchmark datasets demonstrate the high performance of our CNN models, compared to state of the arts methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
(2010) · International Conference on Machine Learning · Cited by 13,995
Activity Recognition from User-Annotated Acceleration Data
Bao, L., & Intille, S. S. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24646-6_1 · Cited by 3,147
Improving deep neural networks for LVCSR using rectified linear units and dropout
Dahl, G. E., Sainath, T. N., & Hinton, G. E. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6639346 · Cited by 1,310
Recognizing human action in time-sequential images using hidden Markov model
Yamato, J., Ohya, J., & Ishii, K. (2003) · Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1992.223161 · Cited by 1,273 · cited 1×
“Data-driven methods, where features are learned from data without prior knowledge on signals, such as hidden Markov model (HMM) [8], support vector machine (SVM) [9], hidden conditional random fields (HCRF) [10], and convolutional neural network (CNN) [11], [12], [13], [14] are recently considered.”
Method(2015) · Cited by 989
Convolutional Neural Networks for Human Activity Recognition using Mobile Sensors
Zeng, M., Nguyen, L. T., Yu, B., Mengshoel, O. J., Zhu, J., Wu, P., & Zhang, J. (2014) · Proceedings of the 6th International Conference on Mobile Computing, Applications and Services · doi:10.4108/icst.mobicase.2014.257786 · Cited by 876 · cited 2×
“Data-driven methods, where features are learned from data without prior knowledge on signals, such as hidden Markov model (HMM) [8], support vector machine (SVM) [9], hidden conditional random fields (HCRF) [10], and convolutional neural network (CNN) [11], [12], [13], [14] are recently considered.”
BackgroundMethodApplying Convolutional Neural Networks concepts to hybrid NN-HMM model for speech recognition
Abdel-Hamid, O., Mohamed, A.-R., Jiang, H., & Penn, G. (2012) · 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2012.6288864 · Cited by 876
The Mobile Sensing Platform: An Embedded Activity Recognition System
Choudhury, T., Borriello, G., Consolvo, S., Haehnel, D., Harrison, B., Hemingway, B., Hightower, J., Klasnja, P. "., Koscher, K., LaMarca, A., et al. (2008) · IEEE Pervasive Computing · doi:10.1109/mprv.2008.39 · Cited by 598
mHealthDroid: A Novel Framework for Agile Development of Mobile Health Applications
Banos, O., Garcia, R., Holgado-Terriza, J. A., Damas, M., Pomares, H., Rojas, I., Saez, A., & Villalonga, C. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-13105-4_14 · Cited by 583
The Jigsaw continuous sensing engine for mobile phone applications
Lu, H., Yang, J., Liu, Z., Lane, N. D., Choudhury, T., & Campbell, A. T. (2010) · Proceedings of the 8th ACM Conference on Embedded Networked Sensor Systems · doi:10.1145/1869983.1869992 · Cited by 560
Hidden Conditional Random Fields for Gesture Recognition
Wang, S. B., Quattoni, A., Morency, L.-P., Demirdjian, D., & Darrell, T. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.132 · Cited by 451
LIBLINEAR: A Library for Large Linear Classification
FanRong-En, ChangKai-Wei, HsiehCho-Jui, WangXiang-Rui, & LinChih-Jen (2008) · Journal of Machine Learning Research · doi:10.5555/1390681.1442794 · Cited by 328
Multi-modal Convolutional Neural Networks for Activity Recognition
Ha, S., Yun, J.-M., & Choi, S. (2015) · 2015 IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2015.525 · Cited by 180
Self-citationUnsupervised, dynamic identification of physiological and activity context in wearable computing
Krause, A., Siewiorek, D. P., Smailagic, A., & Farringdon, J. (2004) · Proceedings · doi:10.1109/iswc.2003.1241398 · Cited by 171
Toward Scalable Activity Recognition for Sensor Networks
Wren, C. R., & Tapia, E. M. (2006) · Lecture notes in computer science · doi:10.1007/11752967_12 · Cited by 118
Factorized Orthogonal Latent Spaces
Salzmann, M., Ek, C. H., Urtasun, R., & Darrell, T. (2010) · Cited by 100
Activity Recognition from Sparsely Labeled Data Using Multi-Instance Learning
Stikic, M., & Schiele, B. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-01721-6_10 · Cited by 94
3D gesture classification with convolutional neural networks
Duffner, S., Berlemont, S., Lefebvre, G., & García, C. (2014) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2014.6854641 · Cited by 79
Group Nonnegative Matrix Factorization for EEG Classification
Lee, H., & Choi, S. (2009) · Cited by 59
Self-citationTeaching Context to Applications
Laerhoven, K. V., & Aidoo, K. A. (2001) · Personal and Ubiquitous Computing · doi:10.1007/s007790170029 · Cited by 38
Restricted Deep Belief Networks for Multi-view Learning
Kang, Y., & Choi, S. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-23783-6_9 · Cited by 24
Self-citation
Cited by
Deep learning for sensor-based activity recognition: A survey
Wang, J., Chen, Y., Hao, S., Peng, X., & Hu, L. (2019) · Pattern Recognition Letters · doi:10.1016/j.patrec.2018.02.010 · Cited by 2,014
“(Ha and Choi, 2016) adopted a CNN-pf and CNN-pff structure to investigate the performance of different weight-sharing techniques.”
MethodDeep Learning in Mobile and Wireless Networking: A Survey
Zhang, C., Patras, P., & Haddadi, H. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2904897 · Cited by 1,768
Deep Learning in Human Activity Recognition with Wearable Sensors: A Review on Advances
Zhang, S., Li, Y., Zhang, S., Shahabi, F., Xia, S., Deng, Y., & Alshurafa, N. (2022) · Sensors · doi:10.3390/s22041476 · Cited by 625
“[116] C-P-C-P-FC-FC-S daily activities, locomotion activities 12 S1, S2, S3 ECG mHealth”
BackgroundDeep Learning for Sensor-based Human Activity Recognition
Chen, K., Zhang, D., Yao, L., Guo, B., Yu, Z., & Liu, Y. (2022) · ACM Computing Surveys · doi:10.1145/3447744 · Cited by 690
“nt sensing modalities (e.g., different sensors, axes, or channels) is also a critical concern since commonly used CNN treats different modalities in the same way. To resolve this concern, Ha and Choi [54] presented a new CNN structure that had specific 1D CNNs for different modalities for learning modality-specific te…”
BackgroundMethodDemrozi, F., Pravadelli, G., Bihorac, A., & Rashidi, P. (2020) · IEEE Access · doi:10.1109/access.2020.3037715 · Cited by 368
Metadata
- Authors
- Ha, S., & Choi, S.
- Venue
- 2016 International Joint Conference on Neural Networks (IJCNN)
- Publisher
- IEEE
- Published
- 2016-07
- Pages
- 381-388
- OpenAlex
- W2551239383
- Cited by
- 307
- References
- 22
- FWCI
- 8.11
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.