The DOI matches its Crossref record; 47 of the 50 references it cites were found in a registry or an index.
Multimodal Gesture Recognition Based on the ResC3D Network
Abstract
Gesture recognition is an important issue in computer vision. Recognizing gestures with videos remains a challenging task due to the barriers of gesture-irrelevant factors. In this paper, we propose a multimodal gesture recognition method based on a ResC3D network. One key idea is to find a compact and effective representation of video sequences. Therefore, the video enhancement techniques, such as Retinex and median filter are applied to eliminate the illumination variation and noise in the input video, and a weighted frame unification strategy is utilized to sample key frames. Upon these representations, a ResC3D network, which leverages the advantages of both residual and C3D model, is developed to extract features, together with a canonical correlation analysis based fusion scheme for blending features. The performance of our method is evaluated in the Chalearn LAP isolated gesture recognition challenge. It reaches 67.71% accuracy and ranks the 1st place in this challenge.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In [98], the authors developed a multimodal gesture recognition system using the 3D Residual CNN (ResC3D) model [99] trained on an RGB-D dataset.”
From A survey on deep multimodal learning for computer vision: advances, trends, applications, and datasets (2022) · cites this paper as [98]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Learning Spatiotemporal Features with 3D Convolutional Networks
Tran, D., Bourdev, L., Fergus, R., Torresani, L., & Paluri, M. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.510 · Cited by 9,593
Two-Stream Convolutional Networks for Action Recognition in Videos
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1406.2199 · Cited by 6,756
Large-Scale Video Classification with Convolutional Neural Networks
Karpathy, A., Toderici, G., Shetty, S., Leung, T., Sukthankar, R., & Fei-Fei, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.223 · Cited by 6,354
3D Convolutional Neural Networks for Human Action Recognition
Ji, S., Xu, W., Yang, M., & Yu, K. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.59 · Cited by 6,313
Long-term recurrent convolutional networks for visual recognition and description
Donahue, J., Hendricks, L. A., Guadarrama, S., Rohrbach, M., Venugopalan, S., Darrell, T., & Saenko, K. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298878 · Cited by 5,228
Temporal Segment Networks: Towards Good Practices for Deep Action Recognition
Wang, L., Xiong, Y., Wang, Z., Qiao, Y., Lin, D., Tang, X., & Gool, L. V. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46484-8_2 · Cited by 4,232
Land, E. H., & McCann, J. J. (1971) · Journal of the Optical Society of America · doi:10.1364/josa.61.000001 · Cited by 4,135
Flagged first, then by citations
3 of the 50 references couldn’t be matched to a known paper.
Research works printed but not linked: 2
- konecný, 2014, One-shot-learning gesture recognition using hog-hof, Journal of Machine Learning Research, 15, 2513
- zhu, 2017, Multimodal gesture recognition using 3d convolution and convolutional lst-m, IEEE Access
Cited by
Sorted by citations
Items 101–168 of 168
Dynamic Gesture Recognition Based on 3D Separable Convolutional LSTM Networks
Zhang, X., Tie, Y., & Qi, L. (2020) · IEEE International Conference on Software Engineering and Service Science (ICSESS) · doi:10.1109/icsess49938.2020.9237672 · Cited by 6
Sign, Attend and Tell: Spatial Attention for Sign Language Recognition
Sarhan, N., & Frintrop, S. (2021) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg52635.2021.9666939 · Cited by 6
GL-PAM RGB-D Gesture Recognition
Li, B., Li, W., Tang, Y., Hu, J., & Zheng, W. (2018) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2018.8451157 · Cited by 6
Multiple depth-levels features fusion enhanced network for action recognition
Wang, S., Kong, J., Jiang, M., & Liu, T. (2020) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2020.102929 · Cited by 6
A Review of Vision Based Dynamic Hand Gestures Recognition
沙, 洁. (2020) · Computer Science and Application · doi:10.12677/csa.2020.105102 · Cited by 6
Global and Local Spatial-Attention Network for Isolated Gesture Recognition
Yuan, Q., Wan, J., Lin, C., Li, Y., Miao, Q., Li, S. Z., Wang, L., & Lu, Y. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-31456-9_10 · Cited by 5
Self-citationAnalyzing Multi-Channel Networks for Gesture Recognition
Narayana, P., Beveridge, J. R., & Draper, B. A. (2019) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2019.8851991 · Cited by 4
Rabbi, A. B. K., & Jeelani, I. (2024) · ASCE International Conference on Computing in Civil Engineering (i3CE) · doi:10.1061/9780784485248.056 · Cited by 4
Fusing Skeleton-Based Scene Flow for Gesture Recognition on Point Clouds
Liu, Y., & Jiao, J. (2025) · Electronics · doi:10.3390/electronics14030567 · Cited by 4
Body Pose and Deep Hand-shape Feature Based American Sign Language Recognition
Hosain, A. A., Santhalingam, P. S., Pathak, P. H., Košecká, J., & Rangwala, H. (2020) · IEEE International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa49011.2020.00033 · Cited by 4
Research on Gesture Recognition and Classification Based on Attention Mechanism
Wang, L., Chen, X., Xiong, W., & Li, Z. (2022) · IEEE Advanced Information Management, Communicates, Electronic and Automation Control Conference (IMCEC) · doi:10.1109/imcec55388.2022.10019998 · Cited by 4
A Lightweight Dynamic Gesture Recognition Network with Spatio-Temporal Attention
Li, X., Yang, L., & Liu, Y. (2023) · International Conference on Advanced Robotics and Mechatronics (ICARM) · doi:10.1109/icarm58088.2023.10218817 · Cited by 4
Hands in Focus: Sign Language Recognition Via Top-Down Attention
Sarhan, N., Wilms, C., Closius, V., Brefeld, U., & Frintrop, S. (2023) · Proceedings - International Conference on Image Processing · doi:10.1109/icip49359.2023.10222729 · Cited by 4
Hussain, M. A., Chun, C., & Kim, S. (2025) · Virtual Worlds · doi:10.3390/virtualworlds4040058 · Cited by 3
Dynamic Gesture Recognition Based On Multimodal Fusion Model
Fang, J., Xu, C., Wang, C., & Li, H. (2021) · International Conference on Ubiquitous Computing and Communications (IUCC) · doi:10.1109/iucc-cit-dsci-smartcns55181.2021.00038 · Cited by 3
Guo, S., Zhang, G., Han, B., & Fang, W. (2025) · Journal of Computing in Civil Engineering · doi:10.1061/jccee5.cpeng-6244 · Cited by 3
Kang, J., Kim, T., Kim, H. O., & Lee, S. (2025) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2025.3577156 · Cited by 4
Feature Fusion Based Hand Gesture Recognition Method for Automotive Interfaces
Xu, Q., Qin, G., Sun, M., Yan, J., Jiang, H., & Zhang, Z. (2020) · Chinese Journal of Electronics · doi:10.1049/cje.2020.06.008 · Cited by 3
SlowFast Convolution LSTM Networks for Dynamic Gesture Recognition
Zhang, X., Tie, Y., & Qi, L. (2021) · Asia Pacific Information Technology Conference (APIT) · doi:10.1145/3449365.3449375 · Cited by 3
Attentive 3D‐Ghost Module for Dynamic Hand Gesture Recognition with Positive Knowledge Transfer
Li, J., Liu, R., Kong, D., Wang, S., Wang, L., Yin, B., & Gao, R. (2021) · Computational Intelligence and Neuroscience · doi:10.1155/2021/5044916 · Cited by 3
A review of sign language recognition research
Yu, M., Jia, J., Xue, C., Yan, G., Guo, Y., & Liu, Y. (2022) · Journal of Intelligent & Fuzzy Systems · doi:10.3233/jifs-210050 · Cited by 3
Dynamic Sign Language Recognition Based on Improved R(2+1)D Algorithm
Gao, Y., Hu, R., Ma, T., Guo, S., Yang, Y., & Zhou, X. (2022) · International Conference on Image, Vision and Computing (ICIVC) · doi:10.1109/icivc55077.2022.9886615 · Cited by 3
PseudoDepth-SLR: Generating Depth Data for Sign Language Recognition
Sarhan, N., Willruth, J. M., & Fritnrop, S. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-44137-0_5 · Cited by 3
Integrated multi-local and global dynamic perception structure for sign language recognition
Liang, S., Li, Y., Shi, Y., Chen, H., & Miao, Q. (2025) · Pattern Analysis and Applications · doi:10.1007/s10044-024-01403-8 · Cited by 3
Self-citationGesture Recognition with Focuses Using Hierarchical Body Part Combination
Zhang, C., Hou, Y., He, J., & Xie, X. (2025) · Tsinghua Science & Technology · doi:10.26599/tst.2024.9010059 · Cited by 3
Feng, Z., Xu, T., Yang, X., Tian, J., Yi, J., & Zhao, K. (2019) · Communications in computer and information science · doi:10.1007/978-981-13-7986-4_10 · Cited by 3
Benchmarking deep neural networks for gesture recognition on embedded devices
Bini, S., Greco, A., Saggese, A., & Vento, M. (2022) · IEEE RO-MAN · doi:10.1109/ro-man53752.2022.9900705 · Cited by 3
Short-Term Temporal Convolutional Networks for Dynamic Hand Gesture RecognitionPreprint
Zhang, Y., Wang, C., Zheng, Y., Zhao, J., Li, Y., & Xie, X. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.05833 · Cited by 3
Self-citationGesture Recognition Algorithm Based on Lightweight 3DCNN Network
Zhang, G., Ma, N., Li, J., Jiang, B., & Wu, Z. (2021) · International Conference on Computational Intelligence and Security (CIS) · doi:10.1109/cis54983.2021.00053 · Cited by 2
Eye Gaze and Hand Gesture-Driven Human-Robot Interaction in Construction
Wang, X., Veeramani, D., Dai, F., & Zhu, Z. (2024) · ASCE Construction Research Congress (CRC) · doi:10.1061/9780784485262.101 · Cited by 2
CM-ASAP: Cross-Modality Adaptive Sensing and Perception for Efficient Hand Gesture Recognition
Hor, S., El‐Khamy, M., Zhou, Y., Arbabian, A., & Lim, S. (2024) · IEEE International Conference on Multimedia Information Processing and Retrieval (MIPR) · doi:10.1109/mipr62202.2024.00039 · Cited by 2
MGR-Dark: A Large Multimodal Video Dataset and RGB-IR Benchmark for Gesture Recognition in Darkness
Shi, Y., Li, Y., Liang, S., Chen, H., & Miao, Q. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3681267 · Cited by 2
Self-citationDynamic Gesture Recognition with Pose-based CNN Features derived from videos using LSTM
Roy, K., & Sahay, R. R. (2018) · Indian Conference on Computer Vision, Graphics and Image Processing · doi:10.1145/3293353.3293398 · Cited by 2
CNNs and Fisher Vectors for No-Audio Multimodal Speech Detection.
Quiros, J. V., & Hung, H. (2019) · MediaEval · Cited by 2
Multi-Modal Multi-Channel American Sign Language RecognitionPreprint
Tian, Y., Vahdani, E., Jing, L., & Huenerfauth, M. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4182158 · Cited by 2
Bridging the Gap: AI and Sign Language Recognition — A Path Toward Inclusive Communication
Tian, Y., Su, J., Ni, L., & Fang, Y. (2024) · International Journal of Artificial Intelligence and Robotics Research · doi:10.1142/s2972335324010038 · Cited by 1
Li, Y., Geng, X., Ma, Z., Miao, Q., & Pun, C. (2025) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2025.3572520 · Cited by 1
Self-citationModality Fusion Adaptor-Enhanced Vision Transformer for Multimodal Action Recognition
Hu, X., Li, Y., Xu, Y., Chen, W., Zhang, Y., Li, S., & Miao, Q. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-88217-3_24 · Cited by 1
Self-citationNayan, N., Ghosh, D., & Pradhan, P. M. (2025) · IEEE Region 10 Conference (TENCON) · doi:10.1109/tencon66050.2025.11375073 · Cited by 1
Two-stream siamese network with contrastive-center losses for RGB-D action recognition
Fan, C., Zhai, Z., Ming, Y., & Tian, L. F. (2019) · Journal of Electronic Imaging · doi:10.1117/1.jei.28.2.023004 · Cited by 1
A Deep Learning Framework for Recognizing Both Static and Dynamic Gestures
Mazhar, O., Ramdani, S., & Cherubini, A. (2021) · Sensors · doi:10.3390/s21062227 · Cited by 4
Temporal-Spatial Deformable Pose Network For Skeleton-Based Gesture Recognition
Lin, H., Cheng, J., Li, Y., & Zhang, X. (2021) · Proceedings - International Conference on Image Processing · doi:10.1109/icip42928.2021.9506253 · Cited by 1
Self-citationA Novel Social Interaction Assistive Device for Arab Deaf People
Otoom, M., Alzubaidi, M. A., & Al-Raziq, L. N. A. (2022) · ACM Transactions on Asian and Low-Resource Language Information Processing · doi:10.1145/3508374 · Cited by 1
A Review on Multimodal Fusion Method for Gesture Recognition
Lee, D. J., & Choi, S. (2023) · International Conference on Ubiquitous and Future Networks · doi:10.1109/icufn57995.2023.10199787 · Cited by 1
Hu, Y. (2024) · Lecture notes in computer science · doi:10.1007/978-981-97-8511-7_33 · Cited by 1
CISampler: Correlated Information Guided Frame Sampling for Gesture Recognition in Video
Shi, Y., Li, Y., Chen, H., Liang, S., & Miao, Q. (2024) · ACM International Conference on Multimedia in Asia (MMAsia) · doi:10.1145/3696409.3700224 · Cited by 1
Self-citationAttribute-based Gesture Recognition: Generalization to Unseen Classes
Retsinas, G., Filntisis, P. P., Kardaris, N., & Maragos, P. A. (2022) · Multidimensional Signal Processing Workshop · doi:10.1109/ivmsp54334.2022.9816275 · Cited by 1
A ConvNet Structure Learning Spatiotemporal Features for Gesture Recognition
Fan, G., Jin, S., Wang, F., & Yan, D. (2023) · International Conference on Intelligent Perception and Computer Vision (CIPCV) · doi:10.1109/cipcv58883.2023.00017 · Cited by 1
Dynamic Gesture Recognition Based on the Multimodality Fusion Temporal Segment Networks
Zheng, M., Tie, Y., Qi, L., & Jiang, S. (2019) · International Symposium on Next-Generation Electronics · doi:10.1109/isne.2019.8896438
Zhou, J., & Komuro, T. (2020) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg47880.2020.00006
Effective Fusion of 3DCNN and Convolutional GRU for Gesture Recognition
Yangbiao, L., Wu, M., & Xu, W. (2020) · IEEE International Conference on Computer and Communications (ICCC) · doi:10.1109/iccc51575.2020.9345075
Space-time event clouds-based event processing
Wang, Q. (2021) · doi:10.32657/10356/151982
Efficient Modelling Across Time of Human Actions and Interactions
Stergiou, A. (2021) · doi:10.33540/789
Research on gesture recognition algorithm based on MME-P3D
Jin, H., He, N., Liu, B., & Li, Z. (2024) · Mathematical Biosciences & Engineering · doi:10.3934/mbe.2024158
Chen, J., Tie, Y., Qi, L., & Liang, C. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10650267
Multimodal Disentanglement and Distillation Representation for Gesture RecognitionPreprint
Shi, Y., Li, Y., Chen, H., Liang, S., & Miao, Q. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4963605
Self-citationGesture recognition method based on multimodal data fusion
Miao, Q., Li, Y., Liu, X., & Liu, R. (2024) · Elsevier eBooks · doi:10.1016/b978-0-443-28959-0.00005-4
Self-citationBasic concepts and development of gesture recognition
Miao, Q., Li, Y., Liu, X., & Liu, R. (2024) · Elsevier eBooks · doi:10.1016/b978-0-443-28959-0.00004-2
Self-citationGesture recognition and attention mechanisms
Miao, Q., Li, Y., Liu, X., & Liu, R. (2024) · Elsevier eBooks · doi:10.1016/b978-0-443-28959-0.00001-7
Self-citationZhang, X., Lu, P., Zeng, X., & Sun, W. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.5073623
Dynamic Gesture Recognition Using R3D Network with Adaptive Temporal Feature Resolutions
Sun, Y., He, H., Tang, C., Huang, S., Wang, B., & Jiang, T. (2025) · Lecture notes in electrical engineering · doi:10.1007/978-981-96-2224-5_31
Vision-based human gestures recognition for human-robot interaction
Mazhar, O. (2019) · theses.fr (ABES) · doi:10.70675/3d2ca177zb310z4cddz828fz42baea348aef
A Dynamic Gated Cross-Attention Framework for Audio-Text Apparent Personality Analysis
Li, Y., Lu, Z., Ma, Y., Bu, H., Ma, Z., & Miao, Q. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11461985
Self-citationAmit, M. L. (2026) · IEEE International Colloquium on Signal Processing & Its Applications (CSPA) · doi:10.1109/cspa68262.2026.11517878
Wang, S., Laforet, J., Rida, I., Druart, B., Becheler, A., Istrate, D., & Boudaoud, S. (2026) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2026.104840 · Cited by 1
DUAL-Net: Joint Domain-Invariant and User-Adaptive Feature Learning for Gesture Recognition
Zhai, S., Yang, B., Dai, Z., Guo, Y. P., Jing, B., Qin, J., & Qin, P. (2026) · Sensors · doi:10.3390/s26134182
Tzadok, A., Lukashov, S., & Valdes‐Garcia, A. (2026) · doi:10.1109/imsrfsa70221.2026.11624284
Ibrahim, D. M., & El-Ghaish, H. (2026) · Journal of King Saud University - Computer and Information Sciences · doi:10.1007/s44443-026-01310-4
Metadata
- Authors
- Miao, Q., Li, Y., Ouyang, W., Ma, Z., Xu, X., Shi, W., & Cao, X.
- Affiliations
- Xidian University (CN)
- Chinese University of Hong Kong (HK)
- Chinese Academy of Sciences (CN)
- Venue
- 2017 IEEE International Conference on Computer Vision Workshops (ICCVW)
- Publisher
- IEEE
- Published
- 2017-10
- Pages
- 3047-3055
- ISSN
- 2473-9936 (ISSN-L)
- OpenAlex
- W2770472008
- Cited by
- 168
- References
- 50
- Citations by year
- 2026: 6 · 2025: 12 · 2024: 22 · 2023: 17 · 2022: 23 · 2021: 27 · 2020: 23 · 2019: 28 · 2018: 10
- FWCI
- 12.61
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE International Conference on Computer Vision Workshops (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Hand Gesture Recognition Systems
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Physical Sciences › Engineering › Biomedical Engineering › Gait Recognition and Analysis
- Keywords
- gesture recognition, multimodal fusion, Retinex, median filter, canonical correlation analysis, feature fusion, illumination variation, noise reduction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
