The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Visual interpretation of hand gestures for human-computer interaction: a review
Abstract
The use of hand gestures provides an attractive alternative to cumbersome interface devices for human-computer interaction (HCI). In particular, visual interpretation of hand gestures can help in achieving the ease and naturalness desired for HCI. This has motivated a very active research area concerned with computer vision-based analysis and interpretation of hand gestures. We survey the literature on visual interpretation of hand gestures in the context of its role in HCI. This discussion is organized on the basis of the method used for modeling, analyzing, and recognizing gestures. Important differences in the gesture interpretation approaches arise depending on whether a 3D model of the human hand or an image appearance model of the human hand is used. 3D hand models offer a way of more elaborate modeling of hand gestures but lead to computational hurdles that have not been overcome given the real-time requirements of HCI. Appearance-based models lead to computationally efficient "purposive" approaches that work well under constrained situations but seem to lack the generality desirable for HCI. We also discuss implemented gestural systems as well as other potential applications of vision-based gesture recognition. Although the current progress is encouraging, further theoretical as well as computational advances are needed before gestures can be widely used for HCI. We discuss directions of future research in gesture recognition, including its integration with other natural modes of human-computer interaction.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A tutorial on hidden Markov models and selected applications in speech recognition
Rabiner, L. R. (1989) · Proceedings of the IEEE · doi:10.1109/5.18626 · Cited by 22,743 · cited 22×
“In such cases, the HMM parameters can be efficiently computed using the Baum-Welch algorithm .”
MethodInfluentialFundamentals of speech recognition
Rabiner, L. R., & Juang, B.-H. F. (1993) · Cited by 7,680
Active Shape Models-Their Training and Application
Cootes, T. F., Taylor, C. J., Cooper, D. H., & Graham, J. (1995) · Computer Vision and Image Understanding · doi:10.1006/cviu.1995.1004 · Cited by 7,190
Ballard, D. H., & Brown, C. M. (1982) · Cited by 5,303
Rheingold, H. (1991) · Cited by 1,867
Using discriminant eigenfeatures for image retrieval
Swets, D. L., & Weng, J. J. (1996) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.531802 · Cited by 1,620
Blake, A., & Yuille, A. (1993) · Cited by 1,383
Aloimonos, J., Weiss, I., & Bandyopadhyay, A. (1988) · International Journal of Computer Vision · doi:10.1007/bf00133571 · Cited by 931
Sturman, D. J., & Zeltzer, L. K. (1994) · IEEE Computer Graphics and Applications · doi:10.1109/38.250916 · Cited by 727
Krueger, M. W. (1991) · Cumulative Index of Computer Aided Architectural Design · Cited by 604
Cited by
A survey of socially interactive robots
Fong, T., Nourbakhsh, I., & Dautenhahn, K. (2003) · Robotics and Autonomous Systems · doi:10.1016/s0921-8890(02)00372-x · Cited by 3,162
Mitra, S., & Acharya, T. (2007) · IEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2007.893280 · Cited by 1,981
The Visual Analysis of Human Movement: A Survey
Gavrila, D. M. (1999) · Computer Vision and Image Understanding · doi:10.1006/cviu.1998.0716 · Cited by 1,782
Automatic analysis of facial expressions: the state of the art
Pantie, M., & Rothkrantz, L. J. M. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.895976 · Cited by 1,778
A Survey of Computer Vision-Based Human Motion Capture
Moeslund, T. B., & Granum, E. (2001) · Computer Vision and Image Understanding · doi:10.1006/cviu.2000.0897 · Cited by 1,768
Vision based hand gesture recognition for human computer interaction: a survey
Rautaray, S. S., & Agrawal, A. (2015) · Artificial Intelligence Review · doi:10.1007/s10462-012-9356-9 · Cited by 1,526
A survey of vision-based methods for action representation, segmentation and recognition
Weinland, D., Ronfard, R., & Boyer, E. (2011) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2010.10.002 · Cited by 997
Multimodal human–computer interaction: A survey
Jaimes, A., & Sebe, N. (2007) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2006.10.019 · Cited by 965
Vision-based hand pose estimation: A review
Erol, A., Bebis, G., Nicolescu, M., Boyle, R. D., & Twombly, X. (2007) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2006.10.012 · Cited by 866
Vision-based human motion analysis: An overview
Poppe, R. (2007) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2006.10.016 · Cited by 835
A survey of appearance models in visual object tracking
Li, X., Hu, W., Shen, C., Zhang, Z., Dick, A., & Hengel, A. V. D. (2013) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/2508037.2508039 · Cited by 705
McKenna, S. J., Jabri, S., Duric, Z., Rosenfeld, A., & Wechsler, H. (2000) · Computer Vision and Image Understanding · doi:10.1006/cviu.2000.0870 · Cited by 660
Symbiotic human-robot collaborative assembly
Wang, L., Gao, R., Váncza, J., Krüger, J., Wang, X. V., Makris, S., & Chryssolouris, G. (2019) · CIRP Annals · doi:10.1016/j.cirp.2019.05.002 · Cited by 565
Automatic Sign Language Analysis: A Survey and the Future beyond Lexical Meaning
Ong, S. C. W., & Ranganath, S. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.112 · Cited by 562
Hand gesture recognition with 3D convolutional neural networks
Molchanov, P., Gupta, S., Kim, K., & Kautz, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2015.7301342 · Cited by 543
Vision-Based Gesture Recognition: A Review
Wu, Y., & Huang, T. S. (1999) · Lecture Notes in Computer Science · doi:10.1007/3-540-46616-9_10 · Cited by 528
Self-citationHand gesture recognition using a real-time tracking method and hidden Markov models
Chen, F.-S., Fu, C.-M., & Huang, C.-L. (2003) · Image and Vision Computing · doi:10.1016/s0262-8856(03)00070-2 · Cited by 507
Video-Based Abnormal Human Behavior Recognition—A Review
Popoola, O. P., & Wang, K. (2012) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2011.2178594 · Cited by 505
Tao, J., & Tan, T. (2005) · Lecture Notes in Computer Science · doi:10.1007/11573548_125 · Cited by 494
HUMAN–ROBOT COLLABORATION: A SURVEY
BAUER, A., WOLLHERR, D., & BUSS, M. (2008) · International Journal of Humanoid Robotics · doi:10.1142/s0219843608001303 · Cited by 493
Hidden Conditional Random Fields
Quattoni, A., Wang, S., Morency, L.-P., Collins, M., & Darrell, T. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1124 · Cited by 488
Oviatt, S. (2007) · Human Factors and Ergonomics · doi:10.1201/9781410615862.ch21 · Cited by 485
A survey of video datasets for human action and activity recognition
Chaquet, J. M., Carmona, E. J., & Fernández-Caballero, A. (2013) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2013.01.013 · Cited by 455
Hidden Conditional Random Fields for Gesture Recognition
Wang, S. B., Quattoni, A., Morency, L.-P., Demirdjian, D., & Darrell, T. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.132 · Cited by 451
Model-based hand tracking using a hierarchical Bayesian filter
Stenger, B., Thayananthan, A., Torr, P. H. S., & Cipolla, R. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.189 · Cited by 415
Looking at people: sensing for ubiquitous and wearable computing
Pentland, A. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.824823 · Cited by 403
EgoGesture: A New Dataset and Benchmark for Egocentric Hand Gesture Recognition
Zhang, Y., Cao, C., Cheng, J., & Lu, H. (2018) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2018.2808769 · Cited by 372
A Unified Framework for Gesture Recognition and Spatiotemporal Gesture Segmentation
Alon, J., Athitsos, V., Yuan, Q., & Sclaroff, S. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.203 · Cited by 363
A survey of depth and inertial sensor fusion for human action recognition
Chen, C., Jafari, R., & Kehtarnavaz, N. (2017) · Multimedia Tools and Applications · doi:10.1007/s11042-015-3177-1 · Cited by 356
“In [52] and [49], each gesture was considered to consist of three phases: pre-stroke, nucleus, and post-stroke.”
BackgroundExtraction of 2D motion trajectories and its application to hand gesture recognition
Yang, M.-H., Ahuja, N., & Tabb, M. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1023803 · Cited by 353
Real-time Hand Gesture Detection and Classification Using Convolutional Neural Networks
Kopuklu, O., Gunduz, A., Kose, N., & Rigoll, G. (2019) · 2019 14th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2019) · doi:10.1109/fg.2019.8756576 · Cited by 319
A Framework for Recognizing the Simultaneous Aspects of American Sign Language
Vogler, C., & Metaxas, D. (2001) · Computer Vision and Image Understanding · doi:10.1006/cviu.2000.0895 · Cited by 309
Toward multimodal human-computer interface
Sharma, R., Pavlovic, V. I., & Huang, T. S. (1998) · Proceedings of the IEEE · doi:10.1109/5.664275 · Cited by 302
Self-citationUnderstanding Transit Scenes: A Survey on Human Behavior-Recognition Algorithms
Candamo, J., Shreve, M., Goldgof, D. B., Sapper, D. B., & Kasturi, R. (2010) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2009.2030963 · Cited by 298
Multimodal human discourse: gesture and speech
Quek, F., McNeill, D., Bryll, R., Duncan, S., Ma, X.-F., Kirbas, C., McCullough, K. E., & Ansari, R. (2002) · ACM Transactions on Computer-Human Interaction · doi:10.1145/568513.568514 · Cited by 291
Motion history image: its variants and applications
Ahad, M. A. R., Tan, J. K., Kim, H., & Ishikawa, S. (2012) · Machine Vision and Applications · doi:10.1007/s00138-010-0298-4 · Cited by 284
Conditional models for contextual human motion recognition
Sminchisescu, C., Kanaujia, A., Li, Z., & Metaxas, D. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.59 · Cited by 282
Gesture interaction in virtual reality
LI, Y., HUANG, J., TIAN, F., WANG, H.-A., & DAI, G.-Z. (2019) · Virtual Reality & Intelligent Hardware · doi:10.3724/sp.j.2096-5796.2018.0006 · Cited by 278
Modeling the constraints of human hand motion
Lin, J., Wu, Y., & Huang, T. S. (2002) · Proceedings Workshop on Human Motion · doi:10.1109/humo.2000.897381 · Cited by 270
Self-citationReal-time fingertip tracking and gesture recognition
Oka, K., Sato, Y., & Koike, H. (2002) · IEEE Computer Graphics and Applications · doi:10.1109/mcg.2002.1046630 · Cited by 263
Duric, Z., Gray, W. D., Heishman, R., Li, F., Rosenfeld, A., Schoelles, M. J., Schunn, C., & Wechsler, H. (2002) · Proceedings of the IEEE · doi:10.1109/jproc.2002.801449 · Cited by 185
(2005) · ePrints Soton (University of Southampton) · Cited by 170
Multimodal interfaces: Challenges and perspectives
Sebe, N. (2009) · Journal of Ambient Intelligence and Smart Environments · doi:10.3233/ais-2009-0003 · Cited by 57
Metadata
- Authors
- Pavlovic, V. I., Sharma, R., & Huang, T. S.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 1997-07
- Volume
- 19
- Issue
- 7
- Pages
- 677-695
- ISSN
- 0162-8828 (ISSN-L)
- OpenAlex
- W2126698653
- Cited by
- 1,791
- References
- 50
- FWCI
- 36.00
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.