The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
A multi-stream convolutional neural network for sEMG-based gesture recognition in muscle-computer interface
Abstract
In muscle-computer interface (MCI), deep learning is a promising technology to build-up classifiers for recognizing gestures from surface electromyography (sEMG) signals. Motivated by the observation that a small group of muscles play significant roles in specific hand movements, we propose a multi-stream convolutional neural network (CNN) framework to improve the recognition accuracy of gestures by learning the correlation between individual muscles and specific gestures with a “divide-and-conquer” strategy. Its pipeline consists of two stages, namely the multi-stream decomposition stage and the fusion stage. During the multi-stream decomposition stage, it first decomposes the original sEMG image into equal-sized patches (streams) by the layout of electrodes on muscles, and for each stream, it independently learns representative features by a CNN. Then during the fusion stage, it fuses the features learned from all streams into a unified feature map, which is subsequently fed into a fusion network to recognize gestures. Evaluations on three benchmark sEMG databases showed that our proposed multi-stream CNN framework outperformed the state-of-the-arts on sEMG-based gesture recognition.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
Proceedings of IEEE Conference on Computer Vision and Pattern Recognition
(1993) · doi:10.1109/cvpr.1993 · Cited by 17,667
Proceedings of IEEE International Conference on Computer Vision
(1995) · Proceedings of IEEE International Conference on Computer Vision · doi:10.1109/iccv.1995.466933 · Cited by 12,860
Large-Scale Video Classification with Convolutional Neural Networks
Karpathy, A., Toderici, G., Shetty, S., Leung, T., Sukthankar, R., & Fei-Fei, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.223 · Cited by 6,354
Proceedings of the International Joint Conference on Artificial Intelligence 2007
Bundy, A. (2007) · International Joint Conference on Artificial Intelligence · Cited by 2,761
Convolutional Neural Networks for Speech Recognition
Abdel-Hamid, O., Mohamed, A.-R., Jiang, H., Deng, L., Penn, G., & Yu, D. (2014) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2014.2339736 · Cited by 2,262
A new strategy for multifunction myoelectric control
Hudgins, B., Parker, P., & Scott, R. N. (1993) · IEEE Transactions on Biomedical Engineering · doi:10.1109/10.204774 · Cited by 2,149
MXNet: A Flexible and Efficient Machine Learning Library for Heterogeneous Distributed Systems
Chen, T., Li, M., Li, Y., Lin, M., Wang, N., Wang, M., Xiao, T., Xu, B., Zhang, C., & Zhang, Z. (2015) · arXiv · doi:10.48550/arxiv.1512.01274 · Cited by 1,819
A robust, real-time control scheme for multifunction myoelectric control
Englehart, K., & Hudgins, B. (2003) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2003.813539 · Cited by 1,743
Feature reduction and selection for EMG signal classification
Phinyomark, A., Phukpattaranont, P., & Limsakul, C. (2012) · Expert Systems with Applications · doi:10.1016/j.eswa.2012.01.102 · Cited by 1,542
Whole-home gesture recognition using wireless signals
Pu, Q., Gupta, S., Gollakota, S., & Patel, S. (2013) · Proceedings of the 19th annual international conference on Mobile computing & networking - MobiCom '13 · doi:10.1145/2500423.2500436 · Cited by 1,109
(2015) · Cited by 989
Electromyography data for non-invasive naturally-controlled robotic hand prostheses
Atzori, M., Gijsberts, A., Castellini, C., Caputo, B., Hager, A.-G. M., Elsig, S., Giatsidis, G., Bassetto, F., & Müller, H. (2014) · Scientific Data · doi:10.1038/sdata.2014.53 · Cited by 969
Support Vector Machine-Based Classification Scheme for Myoelectric Control Applied to Upper Limb
Oskoei, M. A., & Hu, H. (2008) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2008.919734 · Cited by 829
ImageNet classification with deep convolutional neural networks
Krizhevsky (2012) · Medical Entomology and Zoology · Cited by 799
Atzori, M., Cognolato, M., & Müller, H. (2016) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2016.00009 · Cited by 684
A Framework for Hand Gesture Recognition Based on Accelerometer and EMG Sensors
Zhang, X., Chen, X., Li, Y., Lantz, V., Wang, K., & Yang, J. (2011) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/tsmca.2011.2116004 · Cited by 618
A review of hand gesture and sign language recognition techniques
Cheok, M. J., Omar, Z., & Jaward, M. H. (2019) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-017-0705-5 · Cited by 600
Gesture recognition by instantaneous surface EMG images
Geng, W., Du, Y., Jin, W., Wei, W., Hu, Y., & Li, J. (2016) · Scientific Reports · doi:10.1038/srep36571 · Cited by 595
Self-citationWiGest: A ubiquitous WiFi-based gesture recognition system
Abdelnasser, H., Youssef, M., & Harras, K. A. (2015) · 2015 IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom.2015.7218525 · Cited by 552
Hand gesture recognition with 3D convolutional neural networks
Molchanov, P., Gupta, S., Kim, K., & Kautz, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2015.7301342 · Cited by 543
Sign Language Recognition Using Convolutional Neural Networks
Pigou, L., Dieleman, S., Kindermans, P.-J., & Schrauwen, B. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-16178-5_40 · Cited by 499
On the Shared Control of an EMG-Controlled Prosthetic Hand: Analysis of User–Prosthesis Interaction
Cipriani, C., Zaccone, F., Micera, S., & Carrozza, M. C. (2008) · IEEE Transactions on Robotics · doi:10.1109/tro.2007.910708 · Cited by 453
Deep Dynamic Neural Networks for Multimodal Gesture Segmentation and Recognition
Wu, D., Pigou, L., Kindermans, P.-J., Le, N. D.-H., Shao, L., Dambre, J., & Odobez, J.-M. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2537340 · Cited by 453
Surface EMG-Based Inter-Session Gesture Recognition Enhanced by Deep Domain Adaptation
Du, Y., Jin, W., Wei, W., Hu, Y., & Geng, W. (2017) · Sensors · doi:10.3390/s17030458 · Cited by 363
Self-citationZhai, X., Jelfs, B., Chan, R. H. M., & Tin, C. (2017) · Frontiers in Neuroscience · doi:10.3389/fnins.2017.00379 · Cited by 357
Al-Timemy, A. H., Bugmann, G., Escudero, J., & Outram, N. (2013) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2013.2249590 · Cited by 326
Proceedings of 1995 IEEE International Conference on Fuzzy Systems.
(1995) · doi:10.1109/fuzzy.1995 · Cited by 293
A dynamic gesture recognition system for the Korean sign language (KSL)
Kim, J.-S., Jang, W., & Bien, Z. (1996) · IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) · doi:10.1109/3477.485888 · Cited by 188
Multi-view Deep Network for Cross-View Classification
Kan, M., Shan, S., & Chen, X. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.524 · Cited by 182
Advancing Muscle-Computer Interfaces with High-Density Electromyography
Amma, C., Krings, T., Böer, J., & Schultz, T. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702501 · Cited by 168
A novel finger and hand pose estimation technique for real-time hand gesture recognition
Zhou, Y., Jiang, G., & Lin, Y. (2015) · Pattern Recognition · doi:10.1016/j.patcog.2015.07.014 · Cited by 156
Khushaba, R. N., Al-Timemy, A. H., Al-Ani, A., & Al-Jumaily, A. A. (2017) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2017.2687520 · Cited by 155
A Divide-and-Conquer Solver for Kernel Support Vector MachinesPreprint
Hsieh, C., Si, S., & Dhillon, I. S. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1311.0914 · Cited by 136
Real-time robust vision-based hand gesture recognition using stereo images
Liu, K., & Kehtarnavaz, N. (2013) · Journal of Real-Time Image Processing · doi:10.1007/s11554-013-0333-6 · Cited by 67
Divide-and-conquer learning and modular perceptron networks
Fu, H.-C., Lee, Y.-P., Chiang, C., & Pao, H.-T. (2001) · IEEE Transactions on Neural Networks · doi:10.1109/72.914522 · Cited by 58
Continuous hand gesture recognition based on trajectory shape information
Yang, C., Han, D. K., & Ko, H. (2017) · Pattern Recognition Letters · doi:10.1016/j.patrec.2017.05.016 · Cited by 50
Human-machine interfaces based on EMG and Kinect applied to teleoperation of a mobile humanoid robot
Wang, B., Yang, C., & Xie, Q. (2012) · World Congress on Intelligent Control and Automation · doi:10.1109/wcica.2012.6359124 · Cited by 33
Naik, G. R., Kumar, D., Weghorn, H., & Palaniswami, M. S. (2007) · International Conference on Digital Image Computing: Techniques and Applications (DICTA) · doi:10.1109/dicta.2007.4426772 · Cited by 25
Bayesian Co-Boosting for Multi-modal Gesture Recognition
Wu, J., & Cheng, J. (2017) · The Springer series on challenges in machine learning · doi:10.1007/978-3-319-57021-1_14 · Cited by 24
Virtual reality upper limb model controlled by EMG signals
Muri, F., Carbajal, C., Echenique, A. M., Fernández, H., & López, N. M. (2013) · Journal of Physics Conference Series · doi:10.1088/1742-6596/477/1/012041 · Cited by 22
Sequentially Supervised Long Short-Term Memory for Gesture Recognition
Wang, P., Song, Q., Han, H., & Cheng, J. (2016) · Cognitive Computation · doi:10.1007/s12559-016-9388-6 · Cited by 21
Bayesian co-boosting for multi-modal gesture recognition
WuJiaxiang, & ChengJian (2014) · Journal of Machine Learning Research · doi:10.5555/2627435.2697061 · Cited by 20
Iyer, D., Mohammad, F., Guo, Y., Safadi, E. A., Smiley, B. J., Liang, Z., & Jain, N. K. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-41920-6_26 · Cited by 14
Key-press gestures recognition and interaction based on SEMG signals
Cheng, J., Chen, X. '., Lu, Z., Wang, K., & Shen, M. (2010) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/1891903.1891950 · Cited by 12
Heterogeneous representation learning with separable structured sparsity regularization
Yang, P., Tan, Q., Zhu, Y., & He, J. (2017) · Knowledge and Information Systems · doi:10.1007/s10115-017-1094-5 · Cited by 2
Cited by
Deep Learning for EMG-based Human-Machine Interaction: A Review
Xiong, D., Zhang, D., Zhao, X., & Zhao, Y. (2021) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2021.1003865 · Cited by 395
A Multi-Stream Feature Fusion Approach for Traffic Prediction
Li, Z., Xiong, G., Tian, Y., Lv, Y., Chen, Y., Hui, P., & Su, X. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3026836 · Cited by 336
Emerging Wearable Interfaces and Algorithms for Hand Gesture Recognition: A Survey
Jiang, S., Kang, P., Song, X., Lo, B., & Shull, P. (2022) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2021.3078190 · Cited by 270
Surface-Electromyography-Based Gesture Recognition by Multi-View Deep Learning
Wei, W., Dai, Q., Wong, Y., Hu, Y., Kankanhalli, M., & Geng, W. (2019) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2019.2899222 · Cited by 261
Self-citationDeep Learning on 1-D Biosignals: a Taxonomy-based Survey
Ganapathy, N., Swaminathan, R., & Deserno, T. (2018) · Yearbook of Medical Informatics · doi:10.1055/s-0038-1667083 · Cited by 83
“All the papers used supervised learning to train a CNN and the applications are detection [57, 88, 93, 107], classification [91, 98–100], and diagnostics [95, 97].”
Metadata
- Authors
- Wei, W., Wong, Y., Du, Y., Hu, Y., Kankanhalli, M., & Geng, W.
- Venue
- Pattern Recognition Letters
- Publisher
- Elsevier BV
- Published
- 2019-03
- Volume
- 119
- Pages
- 131-138
- ISSN
- 0167-8655 (ISSN-L)
- OpenAlex
- W2775447708
- Cited by
- 274
- References
- 48
- FWCI
- 5.82
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.