The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Parametric hidden Markov models for gesture recognition
Abstract
A method for the representation, recognition, and interpretation of parameterized gesture is presented. By parameterized gesture we mean gestures that exhibit a systematic spatial variation; one example is a point gesture where the relevant parameter is the two-dimensional direction. Our approach is to extend the standard hidden Markov model method of gesture recognition by including a global parametric variation in the output probabilities of the HMM states. Using a linear model of dependence, we formulate an expectation-maximization (EM) method for training the parametric HMM. During testing, a similar EM algorithm simultaneously maximizes the output likelihood of the PHMM for the given sequence and estimates the quantifying parameters. Using visually derived and directly measured three-dimensional hand position measurements as input, we present results that demonstrate the recognition superiority of the PHMM over standard HMM techniques, as well as greater robustness in parameter estimation with respect to noise in the input features. Finally, we extend the PHMM to handle arbitrary smooth (nonlinear) dependencies. The nonlinear formulation requires the use of a generalized expectation-maximization (GEM) algorithm for both training and the simultaneous recognition of the gesture and estimation of the value of the parameter. We present results on a pointing gesture, where the nonlinear approach permits the natural spherical coordinate parameterization of pointing direction.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Neural networks for pattern recognition
(1994) · Choice Reviews Online · doi:10.5860/choice.31-5500 · Cited by 18,538
Press, W. H., Teukolsky, S. A., Vetterling, W. T., & Flannery, B. P. (1994) · Cited by 15,411
Neural Networks for Pattern Recognition
Bishop, C. M. (1995) · doi:10.1093/oso/9780198538493.001.0001 · Cited by 12,287
Adaptive Mixtures of Local Experts
Jacobs, R. A., Jordan, M. I., Nowlan, S. J., & Hinton, G. E. (1991) · Neural Computation · doi:10.1162/neco.1991.3.1.79 · Cited by 5,384
Hand and mind: what gestures reveal about thought
(1993) · Choice Reviews Online · doi:10.5860/choice.30-2492 · Cited by 5,094
An introduction to hidden Markov models
Rabiner, L., & Juang, B. (1986) · IEEE ASSP Magazine · doi:10.1109/massp.1986.1165342 · Cited by 4,775
Introduction to Bayesian Networks
(2019) · Operational Risk Modelling in Financial Services · doi:10.1002/9781119508557.ch12 · Cited by 2,569
Visual learning and recognition of 3-d objects from appearance
Murase, H., & Nayar, S. K. (1995) · International Journal of Computer Vision · doi:10.1007/bf01421486 · Cited by 1,881
Maximum likelihood linear transformations for HMM-based speech recognition
Gales, M. J. F. (1998) · Computer Speech & Language · doi:10.1006/csla.1998.0043 · Cited by 1,482
Recognizing human action in time-sequential images using hidden Markov model
Yamato, J., Ohya, J., & Ishii, K. (2003) · Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1992.223161 · Cited by 1,273
Cited by
Automatic analysis of facial expressions: the state of the art
Pantie, M., & Rothkrantz, L. J. M. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.895976 · Cited by 1,778
A survey of vision-based methods for action representation, segmentation and recognition
Weinland, D., Ronfard, R., & Boyer, E. (2011) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2010.10.002 · Cited by 997
Separating Style and Content with Bilinear Models
Tenenbaum, J. B., & Freeman, W. T. (2000) · Neural Computation · doi:10.1162/089976600300015349 · Cited by 840
Robust Part-Based Hand Gesture Recognition Using Kinect Sensor
Ren, Z., Yuan, J., Meng, J., & Zhang, Z. (2013) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2013.2246148 · Cited by 746
Brand, M., & Hertzmann, A. (2000) · Proceedings of the 27th annual conference on Computer graphics and interactive techniques - SIGGRAPH '00 · doi:10.1145/344779.344865 · Cited by 705
Recognizing 50 human action categories of web videos
Reddy, K. K., & Shah, M. (2013) · Machine Vision and Applications · doi:10.1007/s00138-012-0450-4 · Cited by 655
Style-based inverse kinematics
Grochow, K., Martin, S. L., Hertzmann, A., & Popović, Z. (2004) · ACM Transactions on Graphics · doi:10.1145/1015706.1015755 · Cited by 642
A review of hand gesture and sign language recognition techniques
Cheok, M. J., Omar, Z., & Jaward, M. H. (2019) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-017-0705-5 · Cited by 600
Automatic Sign Language Analysis: A Survey and the Future beyond Lexical Meaning
Ong, S. C. W., & Ranganath, S. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.112 · Cited by 562
Unstructured human activity detection from RGBD images
Sung, J., Ponce, C., Selman, B., & Saxena, A. (2012) · 2012 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2012.6224591 · Cited by 511
Observing Human-Object Interactions: Using Spatial and Functional Compatibility for Recognition
Gupta, A., Kembhavi, A., & Davis, L. S. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.83 · Cited by 502
Survey on Emotional Body Gesture Recognition
Noroozi, F., Corneanu, C. A., Kaminska, D., Sapinski, T., Escalera, S., & Anbarjafari, G. (2021) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2874986 · Cited by 455
A tutorial on task-parameterized movement learning and retrieval
Calinon, S. (2016) · Intelligent Service Robotics · doi:10.1007/s11370-015-0187-9 · Cited by 422
A Unified Framework for Gesture Recognition and Spatiotemporal Gesture Segmentation
Alon, J., Athitsos, V., Yuan, Q., & Sclaroff, S. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.203 · Cited by 363
Extraction of 2D motion trajectories and its application to hand gesture recognition
Yang, M.-H., Ahuja, N., & Tabb, M. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1023803 · Cited by 353
Saisan, P., Doretto, G., Wu, Y. N., & Soatto, S. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990925 · Cited by 328
Motion segmentation and pose recognition with motion history gradients
Bradski, G. R., & Davis, J. W. (2002) · Machine Vision and Applications · doi:10.1007/s001380100064 · Cited by 320
Modeling Actions through State Changes
Fathi, A., & Rehg, J. M. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.333 · Cited by 145
Gait phase analysis based on a Hidden Markov Model
Bae, J., & Tomizuka, M. (2011) · Mechatronics · doi:10.1016/j.mechatronics.2011.03.003 · Cited by 106
Learning Robot Manipulation Tasks With Task-Parameterized Semitied Hidden Semi-Markov Model
Tanwani, A. K., & Calinon, S. (2016) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2016.2517825 · Cited by 84
Learning and inference in parametric switching linear dynamic systems
Oh, S. M., Rehg, J. M., Balch, T., & Dellaert, F. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.135 · Cited by 40
Predicting Speaker Head Nods and the Effects of Affective Information
Lee, J., & Marsella, S. C. (2010) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2010.2051874 · Cited by 37
“Some of the applications where HMMs have been successfully used are gesture recognition, speech recognition, and part-of-speech tagging [37]–[39].”
BackgroundModeling multimodal behaviors from speech prosody,
Ding, Y., Pelachaud, C., & Artières, T. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-40415-3_19 · Cited by 32
Metadata
- Authors
- Wilson, A. D., & Bobick, A. F.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 1999
- Volume
- 21
- Issue
- 9
- Pages
- 884-900
- ISSN
- 0162-8828 (ISSN-L)
- OpenAlex
- W2116494851
- Cited by
- 574
- References
- 28
- FWCI
- 13.33
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.