The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Sign Language Recognition using 3D convolutional neural networks
Abstract
Sign Language Recognition (SLR) targets on interpreting the sign language into text or speech, so as to facilitate the communication between deaf-mute people and ordinary people. This task has broad social impact, but is still very challenging due to the complexity and large variations in hand actions. Existing methods for SLR use hand-crafted features to describe sign language motion and build classification models based on those features. However, it is difficult to design reliable features to adapt to the large variations of hand gestures. To approach this problem, we propose a novel 3D convolutional neural network (CNN) which extracts discriminative spatial-temporal features from raw video stream automatically without any prior knowledge, avoiding designing features. To boost the performance, multi-channels of video streams, including color information, depth clue, and body joint positions, are used as input to the 3D CNN in order to integrate color, depth and trajectory information. We validate the proposed model on a real dataset collected with Microsoft Kinect and demonstrate its effectiveness over the traditional approaches based on hand-crafted features.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Large-Scale Video Classification with Convolutional Neural Networks
Karpathy, A., Toderici, G., Shetty, S., Leung, T., Sukthankar, R., & Fei-Fei, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.223 · Cited by 6,354
3D Convolutional Neural Networks for Human Action Recognition
Ji, S., Xu, W., Yang, M., & Yu, K. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.59 · Cited by 6,235
A unified architecture for natural language processing: deep neural networks with multitask learning
Collobert, R., & Weston, J. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390177 · Cited by 5,058
Learning Hierarchical Features for Scene Labeling
Farabet, C., Couprie, C., Najman, L., & LeCun, Y. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.231 · Cited by 2,620
Real-time American sign language recognition using desk and wearable computer based video
Starner, T., Weaver, J., & Pentland, A. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.735811 · Cited by 1,335
Sequential Deep Learning for Human Action Recognition
Baccouche, M., Mamalet, F., Wolf, C., Garcia, C., & Baskurt, A. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-25446-8_4 · Cited by 782
A Biologically Inspired System for Action Recognition
Jhuang, H., Serre, T., Wolf, L., & Poggio, T. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4408988 · Cited by 723
Convolutional Networks Can Learn to Generate Affinity Graphs for Image Segmentation
Turaga, S. C., Murray, J. F., Jain, V., Roth, F., Helmstaedter, M., Briggman, K., Denk, W., & Seung, H. S. (2010) · Neural Computation · doi:10.1162/neco.2009.10-08-881 · Cited by 376
Gesture recognition using recurrent neural networks
Murakami, K., & Taguchi, H. (1991) · Proceedings of the SIGCHI conference on Human factors in computing systems Reaching through technology - CHI '91 · doi:10.1145/108844.108900 · Cited by 359
Parallel hidden Markov models for American sign language recognition
Vogler, C., & Metaxas, D. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.791206 · Cited by 258
Video-based sign language recognition using Hidden Markov Models
Assan, M., & Grobel, K. (1998) · Lecture Notes in Computer Science · doi:10.1007/bfb0052992 · Cited by 205
A dynamic gesture recognition system for the Korean sign language (KSL)
Kim, J.-S., Jang, W., & Bien, Z. (1996) · IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) · doi:10.1109/3477.485888 · Cited by 188
A Real-Time Hand Posture Recognition System Using Deep Neural Networks
Tang, A., Lü, K., Wang, Y., Huang, J., & Li, H. (2015) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/2735952 · Cited by 165
Self-citationIsolated sign language recognition using hidden Markov models
Grobel, K., & Assan, M. (2002) · 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation · doi:10.1109/icsmc.1997.625742 · Cited by 160
Sign language recognition using model-based tracking and a 3D Hopfield neural network
Huang, C., & Huang, W. (1998) · Machine Vision and Applications · doi:10.1007/s001380050080 · Cited by 88
Cited by
Li, D., Opazo, C. R., Yu, X., & Li, H. (2020) · 2020 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv45572.2020.9093512 · Cited by 641
Self-citationSign Language Recognition: A Deep Survey
Rastgoo, R., Kiani, K., & Escalera, S. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.113794 · Cited by 575
Video-Based Sign Language Recognition Without Temporal Segmentation
Huang, J., Zhou, W., Zhang, Q., Li, H., & Li, W. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11903 · Cited by 451
Self-citationSignFi: Sign Language Recognition Using WiFi
Ma, Y., Zhou, G., Wang, S., Zhao, H., & Jung, W. (2018) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3191755 · Cited by 380
A survey on artificial intelligence in Chinese sign language recognition
Jiang, X., Satapathy, S. C., Yang, L., Wang, S.-H., & Zhang, Y.-D. (2020) · Arabian Journal for Science and Engineering · doi:10.1007/s13369-020-04758-2 · Cited by 71
Metadata
- Authors
- Huang, J., Zhou, W., Li, H., & Li, W.
- Venue
- 2015 IEEE International Conference on Multimedia and Expo (ICME)
- Publisher
- IEEE
- Published
- 2015-06
- Pages
- 1-6
- OpenAlex
- W1506441995
- Cited by
- 317
- References
- 18
- FWCI
- 10.89
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.