Hand Gesture Recognition for Sign Language Using 3DCNN
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
Recently, automatic hand gesture recognition has gained increasing importance for two principal reasons: the growth of the deaf and hearing-impaired population, and the development of vision-based applications and touchless control on ubiquitous devices. As hand gesture recognition is at the core of sign language analysis a robust hand gesture recognition system should consider both spatial and temporal features. Unfortunately, finding discriminative spatiotemporal descriptors for a hand gesture sequence is not a trivial task. In this study, we proposed an efficient deep convolutional neural networks approach for hand gesture recognition. The proposed approach employed transfer learning to beat the scarcity of a large labeled hand gesture dataset. We evaluated it using three gesture datasets from color videos: 40, 23, and 10 classes were used from these datasets. The approach obtained recognition rates of 98.12%, 100%, and 76.67% on the three datasets, respectively for the signer-dependent mode. For the signer-independent mode, it obtained recognition rates of 84.38%, 34.9%, and 70% on the three datasets, respectively.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Learning Spatiotemporal Features with 3D Convolutional Networks
Tran, D., Bourdev, L., Fergus, R., Torresani, L., & Paluri, M. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.510 · Cited by 9,593
Large-Scale Video Classification with Convolutional Neural Networks
Karpathy, A., Toderici, G., Shetty, S., Leung, T., Sukthankar, R., & Fei-Fei, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.223 · Cited by 6,354 · cited 1×
“This had already been trained using millions of samples of human action recognition [6].”
BackgroundDeep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition
Ordóñez, F., & Roggen, D. (2016) · Sensors · doi:10.3390/s16010115 · Cited by 2,761 · cited 2×
“The memory state and output of an LSTM unit are updated at each time step [34].”
BackgroundImproving deep neural networks for LVCSR using rectified linear units and dropout
Dahl, G. E., Sainath, T. N., & Hinton, G. E. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6639346 · Cited by 1,310 · cited 1×
“This function was preferred as it has a simple derivative to speed up large-network training [32].”
BackgroundSpeech emotion recognition using deep 1D & 2D CNN LSTM networks
Zhao, J., Mao, X., & Chen, L. (2019) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2018.08.035 · Cited by 1,044 · cited 2×
“CNNs have shown excellent performance in fields such as object and speech recognition, image classification, and edge distribution [2]–[4], and human activity recognition [5]–[7].”
Background
Research works printed but not linked: 35
- van der maaten, 2008, Visualizing data using t-SNE, J Mach Learn Res, 9, 2579
- 10.1016/0169-7439(87)80084-9 · DOI · Paper page
- 10.1109/ICDM.2016.0121 · DOI · Paper page
- 10.1016/S0379-0738(02)00425-5 · doi:10.1016/s0379-0738(02)00425-5
- 10.1109/MCE.2019.2941464 · DOI
- goodfellow, 2016, Autoencoders, Deep Learning, 502
- 10.1016/j.patcog.2018.12.015 · DOI
- 10.1109/JSEN.2007.894132 · doi:10.1109/jsen.2007.894132
- 10.1109/MCOM.2018.1700790 · DOI · Paper page
- 10.1109/TSMCA.2006.886347 · DOI · Paper page
- 10.1109/TNSRE.2019.2896269 · DOI · Paper page
- 10.1145/108844.108900 · DOI · Paper page
- 10.1109/TPAMI.2002.1023803 · DOI · Paper page
- 10.1016/j.jvcir.2016.07.020 · DOI
- 10.1007/11550518_50 · DOI
- 10.1109/CVPRW.2008.4563181 · DOI
- 10.1109/TSMCB.2006.889630 · DOI
- 10.1155/ASP.2005.2136 · DOI
- 10.1109/TSMC.2014.2298214 · DOI
- 10.1109/TII.2019.2950326 · DOI · Paper page
- 10.1109/CVPR.2001.990517 · DOI · Paper page
- 10.1016/j.patcog.2016.01.012 · DOI · Paper page
- 10.1109/TSMCA.2011.2116004 · DOI · Paper page
- hou, 2017, An end-to-end 3D convolutional neural network for action detection and segmentation in videos, arXiv 1712 01111
- 10.1109/MNET.001.1900045 · DOI · Paper page
- 10.1109/TBME.2009.2013200 · DOI
- 10.1109/FIT.2011.25 · doi:10.1109/fit.2011.25
- 10.4236/jilsa.2010.21003 · DOI
- 10.1109/TIM.2014.2351331 · DOI
- 10.1007/978-3-319-13461-1_5 · doi:10.1007/978-3-319-13461-1_5
- 10.1109/CVPRW.2015.7301342 · DOI · Paper page
- 10.1109/ACCESS.2017.2680467 · DOI · Paper page
- 10.1109/CVPRW.2018.00284 · DOI
- chen, 2018, DenseImage network: Video spatial-temporal evolution encoding and understanding, arXiv 1805 07550
- 10.1007/s11042-019-7660-y · doi:10.1007/s11042-019-7660-y
Cited by
Computer vision-based hand gesture recognition for human-robot interaction: a review
Qi, J., Ma, L., Cui, Z., & Yu, Y. (2024) · Complex & Intelligent Systems · doi:10.1007/s40747-023-01173-6 · Cited by 267
Metadata
- Authors
- Al-Hammadi, M., Muhammad, G., Abdul, W., Alsulaiman, M., Bencherif, M. A., & Mekhtiche, M. A.
- Venue
- IEEE Access
- Published
- 2020
- Volume
- 8
- Pages
- 79491-79509
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W3022200071
- Cited by
- 232
- References
- 5
- FWCI
- 18.26
- Type
- journal article
- Language
- en
- Open access
- gold
- Funders
- Deanship of Scientific Research (DSR) with King Saud University, Riyadh, Saudi Arabia, through a research group program (RG-1437-018)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.