Multimodal Gesture Recognition Based on the ResC3D Network

Deep Residual Learning for Image Recognition

He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474

Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift

Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818

Caffe: Convolutional Architecture for Fast Feature Embedding

Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077

Learning Spatiotemporal Features with 3D Convolutional Networks

Tran, D., Bourdev, L., Fergus, R., Torresani, L., & Paluri, M. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.510 · Cited by 9,593

Two-Stream Convolutional Networks for Action Recognition in Videos

Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1406.2199 · Cited by 6,756

Large-Scale Video Classification with Convolutional Neural Networks

Karpathy, A., Toderici, G., Shetty, S., Leung, T., Sukthankar, R., & Fei-Fei, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.223 · Cited by 6,354

3D Convolutional Neural Networks for Human Action Recognition

Ji, S., Xu, W., Yang, M., & Yu, K. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.59 · Cited by 6,313

Long-term recurrent convolutional networks for visual recognition and description

Donahue, J., Hendricks, L. A., Guadarrama, S., Rohrbach, M., Venugopalan, S., Darrell, T., & Saenko, K. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298878 · Cited by 5,228

Temporal Segment Networks: Towards Good Practices for Deep Action Recognition

Wang, L., Xiong, Y., Wang, Z., Qiao, Y., Lin, D., Tang, X., & Gool, L. V. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46484-8_2 · Cited by 4,232

Lightness and Retinex Theory

Land, E. H., & McCann, J. J. (1971) · Journal of the Optical Society of America · doi:10.1364/josa.61.000001 · Cited by 4,135

The recognition of human movement using temporal templates

Bobick, A., & Davis, J. W. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.910878 · Cited by 2,837

High Accuracy Optical Flow Estimation Based on a Theory for Warping

Brox, T., Bruhn, A., Papenberg, N., & Weickert, J. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-24673-2_3 · Cited by 2,634

Real-time human pose recognition in parts from single depth images

Shotton, J., Sharp, T., Kipman, A., Fitzgibbon, A. W., Finocchio, M., Blake, A., Cook, M., & Moore, R. (2013) · Communications of the ACM · doi:10.1145/2398356.2398381 · Cited by 2,050

A Spatio-Temporal Descriptor Based on 3D-Gradients

Klaeser, A., Marszałek, M., & Schmid, C. (2008) · British Machine Vision Conference (BMVC) · doi:10.5244/c.22.99 · Cited by 1,842

Vision based hand gesture recognition for human computer interaction: a survey

Rautaray, S. S., & Agrawal, A. (2012) · Artificial Intelligence Review · doi:10.1007/s10462-012-9356-9 · Cited by 1,588

Recognizing human action in time-sequential images using hidden Markov model

Yamato, J., Ohya, J., & Ishii, K. (2003) · Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1992.223161 · Cited by 1,273

Large-scale Video Classification with Convolutional Neural Networks

Karpathy, A., Toderici, G. D., Shetty, S., Leung, T., Sukthankar, R., & Fei-Fei, L. (2014) · Cited by 1,266

Free viewpoint action recognition using motion history volumes

Weinland, D., Ronfard, R., & Boyer, E. (2006) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2006.07.013 · Cited by 906

Online Detection and Classification of Dynamic Hand Gestures with Recurrent 3D Convolutional Neural Networks

Molchanov, P. A., Yang, X., Gupta, S., Kim, K., Tyree, S., & Kautz, J. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.456 · Cited by 698

Max-pooling convolutional neural networks for vision-based hand gesture recognition

Nagi, J., Ducatelle, F., Di, G. A., Ciresan, D. C., Meier, U., Giusti, A., Nagi, F., Schmidhuber, J., & Gambardella, L. M. (2011) · IEEE International Conference on Signal and Image Processing Applications (ICSIPA) · doi:10.1109/icsipa.2011.6144164 · Cited by 690

A new method of feature fusion and its application in image recognition

Sun, Q., Zeng, S.-G., Liu, Y., Heng, P., & De-shen, X. (2005) · Pattern Recognition · doi:10.1016/j.patcog.2004.12.013 · Cited by 517

Hidden Conditional Random Fields for Gesture Recognition

Wang, S. B., Quattoni, A., Morency, L., Demirdjian, D., & Darrell, T. (2006) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2006.132 · Cited by 456

ConvNet Architecture Search for Spatiotemporal Feature LearningPreprint

Tran, D., Ray, J., Zheng, S.-F., Chang, S.-F., & Paluri, M. (2017) · arXiv.org · doi:10.48550/arxiv.1708.05038 · Cited by 421

Discriminant Correlation Analysis: Real-Time Feature Level Fusion for Multimodal Biometric Recognition

Haghighat, M., Abdel-Mottaleb, M. S., & Alhalabi, W. (2016) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2016.2569061 · Cited by 380

ChaLearn Looking at People RGB-D Isolated and Continuous Datasets for Gesture Recognition

Wan, J., Li, S. Z., Zhao, Y., Zhou, S., Guyon, I., & Escalera, S. (2016) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2016.100 · Cited by 281

Multimodal Gesture Recognition Using 3-D Convolution and Convolutional LSTM

Zhu, G., Zhang, L., Shen, P., & Song, J. (2017) · IEEE Access · doi:10.1109/access.2017.2684186 · Cited by 271

Real-time fingertip tracking and gesture recognition

Oka, K., Sato, Y., & Koike, H. (2002) · IEEE Computer Graphics and Applications · doi:10.1109/mcg.2002.1046630 · Cited by 263

A shape- and texture-based enhanced Fisher classifier for face recognition

Liu, C., & Wechsler, H. (2001) · IEEE Transactions on Image Processing · doi:10.1109/83.913594 · Cited by 261

Gesture modeling and recognition using finite state machines

Hong, P., Turk, M., & Huang, T. S. (2002) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.2000.840667 · Cited by 215

Unsupervised Extraction of Video Highlights via Robust Recurrent Auto-Encoders

Yang, H., Wang, B., Lin, S. C.-F., Wipf, D., Guo, M., & Guo, B. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.526 · Cited by 176

Dynamic time warping for off-line recognition of a small gesture vocabulary

Corradini, A. (2002) · Analysis and Modeling of Faces and Gestures · doi:10.1109/ratfg.2001.938914 · Cited by 174

Spatio-temporal covariance descriptors for action and gesture recognition

Sanin, A., Sanderson, C., Harandi, M. T., & Lovell, B. C. (2013) · Proceedings · doi:10.1109/wacv.2013.6475006 · Cited by 154

Scene Flow to Action Map: A New Representation for RGB-D Based Action Recognition with Convolutional Neural Networks

Wang, P., Li, W., Gao, Z., Zhang, Y., Tang, C., & Ogunbona, P. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.52 · Cited by 151

Spatio-temporal covariance descriptors for action and gesture recognition

Sanin, A., Sanderson, C., Harandi, M. T., & Lovell, B. C. (2013) · Cited by 123

The ChaLearn gesture dataset (CGD 2011)

Guyon, I., Athitsos, V., Jangyodsuk, P., & Escalante, H. J. (2014) · Machine Vision and Applications · doi:10.1007/s00138-014-0596-3 · Cited by 105

Explore Efficient Local Features from RGB-D Data for One-Shot Learning Gesture Recognition

Wan, J., Guo, G., & Li, S. Z. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2513479 · Cited by 104

Large-scale Isolated Gesture Recognition using Convolutional Neural Networks

Wang, P., Li, W., Liu, S., Gao, Z., Tang, C., & Ogunbona, P. (2016) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2016.7899599 · Cited by 100

Large-scale gesture recognition with a fusion of RGB-D data based on the C3D model

Li, Y., Miao, Q., Tian, K., Fan, Y., Xu, X., Li, R., & Song, J. (2016) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2016.7899602 · Cited by 89

Visual understanding of dynamic hand gestures

Yeasin, M., & Chaudhuri, S. (2000) · Pattern Recognition · doi:10.1016/s0031-3203(99)00175-2 · Cited by 88

A Unified Framework for Multi-Modal Isolated Gesture Recognition

Duan, J., Wan, J., Zhou, S., Guo, X., & Li, S. Z. (2018) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3131343 · Cited by 85

Generalized K–L transform based combined feature extraction

Yang, J. J., & Yang, J.-Y. (2002) · Pattern Recognition · doi:10.1016/s0031-3203(01)00152-2 · Cited by 84

Results and Analysis of ChaLearn LAP Multi-modal Isolated and Continuous Gesture Recognition, and Real Versus Fake Expressed Emotions Challenges

Wan, J., Escalera, S., Anbarjafari, G., Escalante, H. J., Baró, X., Guyon, I., Madadi, M., Allïk, J., Gorbova, J., Lin, C., et al. (2017) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2017.377 · Cited by 77

Large-scale Isolated Gesture Recognition using pyramidal 3D convolutional networks

Zhu, G., Zhang, L., Mei, L., Shao, J., Song, J., & Shen, P. (2016) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2016.7899601 · Cited by 71

A temporal Bayesian model for classifying, detecting and localizing activities in video sequences

Malgireddy, M. R., Nwogu, I., & Govindaraju, V. (2012) · 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2012.6239185 · Cited by 51

3D SMoSIFT: three-dimensional sparse motion scale invariant feature transform for activity recognition from RGB-D videos

Wan, J., Ruan, Q.-Q., Li, W., An, G., & Zhao, R. (2014) · J. Electronic Imaging · doi:10.1117/1.jei.23.2.023017 · Cited by 49

Language-Motivated Approaches to Action Recognition

Malgireddy, M. R., Nwogu, I., & Govindaraju, V. (2017) · The Springer series on challenges in machine learning · doi:10.1007/978-3-319-57021-1_5 · Cited by 36

Enhancement of Ultrasonic Image Based on the Multi-Scale Retinex Theory

Huang, Y., Gao, Y., Wang, H., Hao, D., Zhao, J., & Zhen, Z. (2012) · Lecture notes in electrical engineering · doi:10.1007/978-3-642-25792-6_18 · Cited by 1

A survey on deep multimodal learning for computer vision: advances, trends, applications, and datasets

Bayoudh, K., Knani, R., Hamdaoui, F., & Mtibaa, A. (2022) · The Visual Computer · doi:10.1007/s00371-021-02166-7 · Cited by 456

MMTM: Multimodal Transfer Module for CNN Fusion

Joze, H. R. V., Shaban, A., Iuzzolino, M. L., & Koishida, K. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01330 · Cited by 337

Improving the Performance of Unimodal Dynamic Hand-Gesture Recognition With Multimodal Training

Abavisani, M., Joze, H. R. V., & Patel, V. M. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00126 · Cited by 190

Gesture Recognition: Focus on the Hands

Narayana, P., Beveridge, J. R., & Draper, B. A. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00549 · Cited by 155

Motion Fused Frames: Data Level Fusion Strategy for Hand Gesture Recognition

Köpüklü, O., Köse, N., & Rigoll, G. (2018) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00284 · Cited by 141

A spatiotemporal attention-based ResC3D model for large-scale gesture recognition

Li, Y., Miao, Q., Qi, X., Ma, Z., & Ouyang, W. (2018) · Machine Vision and Applications · doi:10.1007/s00138-018-0996-x · Cited by 20

Large-scale gesture recognition with a fusion of RGB-D data based on the C3D model

Li, Y., Miao, Q., Tian, K., Fan, Y., Xu, X., Li, R., & Song, J. (2016) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2016.7899602 · Cited by 89

Large-scale gesture recognition with a fusion of RGB-D data based on optical flow and the C3D model

Li, Y., Miao, Q., Tian, K., Fan, Y., Xu, X., Ma, Z., & Song, J. (2017) · Pattern Recognition Letters · doi:10.1016/j.patrec.2017.12.003 · Cited by 46

A Unified Framework for Multi-Modal Isolated Gesture Recognition

Duan, J., Wan, J., Zhou, S., Guo, X., & Li, S. Z. (2018) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3131343 · Cited by 85

Dynamic Gesture Recognition Based On Multimodal Fusion Model

Fang, J., Xu, C., Wang, C., & Li, H. (2021) · International Conference on Ubiquitous Computing and Communications (IUCC) · doi:10.1109/iucc-cit-dsci-smartcns55181.2021.00038 · Cited by 3