Expectation grammars: leveraging high-level expectations for activity recognition
The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Abstract
Video-based recognition and prediction of a temporally extended activity can benefit from a detailed description of high-level expectations about the activity. Stochastic grammars allow for an efficient representation of such expectations and are well-suited for the specification of temporally well-ordered activities. In this paper, we extend stochastic grammars by adding event parameters, state checks, and sensitivity to an internal scene model. We present an implemented system that uses human-specified grammars to recognize a person performing the Towers of Hanoi task from a video sequence by analyzing object interaction events. Experimental results from several videos show robust recognition of the full task and its constituent sub-tasks even though no appearance models of the objects in the video are provided. These experiments include videos of the task performed with different shaped objects and with distracting and extraneous interactions.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The notion of using background knowledge to compensate for the ambivalence of sensor-based information has been around since the early days of HAR research [15], initially in vision-based approaches [134], with later adoption in sensor-based work (e.g.[148]).”
From Past, Present, and Future of Sensor-based Human Activity Recognition Using Wearables: A Surveying Tutorial on a Still Challenging Task (2025) · cites this paper as [134]
Citations
Cites
Real-time American sign language recognition using desk and wearable computer based video
Starner, T., Weaver, J., & Pentland, A. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.735811 · Cited by 1,335
Self-citationHidden Markov Models for Speech Recognition
Juang, B. H., & Rabiner, L. R. (1991) · Technometrics · doi:10.1080/00401706.1991.10484833 · Cited by 1,068
Coupled hidden Markov models for complex action recognition
Brand, M., Oliver, N., & Pentland, A. (2002) · Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1997.609450 · Cited by 1,052
A Statistical Approach for Real-time Robust Background Subtraction and Shadow Detection
Horprasert, T. (1999) · IEEE/CVF International Conference on Computer Vision (ICCV) · Cited by 944
Hidden Markov Models for Speech Recognition
Huang, X., Ariki, Y., & Jack, M. A. (1991) · Medical Entomology and Zoology · Cited by 744
Recognition of visual activities and interactions by stochastic parsing
Ivanov, Y. A., & Bobick, A. F. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.868686 · Cited by 659
An Efficient Probabilistic Context-Free Parsing Algorithm that Computes Prefix Probabilities
Stolcke, A. (1994) · arXiv (Cornell University) · doi:10.48550/arxiv.cmp-lg/9411029 · Cited by 336
A Framework for Recognizing the Simultaneous Aspects of American Sign Language
Vogler, C., & Metaxas, D. (2001) · Computer Vision and Image Understanding · doi:10.1006/cviu.2000.0895 · Cited by 309
Exploiting human actions and object context for recognition tasks
Moore, D. J., Essa, I. A., & Hayes, M. H. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.791201 · Cited by 281
Self-citationA state-based approach to the representation and recognition of gesture
Bobick, A. F., & Wilson, A. D. (1997) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.643892 · Cited by 281
Cited by
Human activity analysis: A review
Aggarwal, J. K., & Ryoo, M. S. (2011) · ACM Computing Surveys · doi:10.1145/1922649.1922653 · Cited by 2,056
A system for learning statistical motion patterns
Hu, W., Xiao, X., Fu, Z., Xie, D., Tan, T., & Maybank, S. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.176 · Cited by 544
Trajectory-Based Anomalous Event Detection
Piciarelli, C., Micheloni, C., & Foresti, G. L. (2008) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2008.2005599 · Cited by 532
HUMAN–ROBOT COLLABORATION: A SURVEY
BAUER, A., WOLLHERR, D., & BUSS, M. (2008) · International Journal of Humanoid Robotics · doi:10.1142/s0219843608001303 · Cited by 493
Activity Recognition of Assembly Tasks Using Body-Worn Microphones and Accelerometers
Ward, J. A., Lukowicz, P., Troster, G., & Starner, T. E. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.197 · Cited by 431
Self-citation
Metadata
- Authors
- Minnen, D., Essa, I., & Starner, T.
- Affiliations
- Georgia Institute of Technology (US)
- Venue
- 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings.
- Publisher
- IEEE Comput. Soc
- Published
- 2003-11-21
- Volume
- 2
- Pages
- II-626-II-632
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2140877366
- Cited by
- 110
- References
- 19
- Citations by year
- 2025: 1 · 2024: 1 · 2023: 2 · 2022: 1 · 2021: 1 · 2020: 2 · 2018: 3 · 2017: 7 · 2016: 1 · 2015: 7 · 2014: 8 · 2013: 11 · 2012: 9
- FWCI
- 4.43
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
- Keywords
- stochastic grammars, activity recognition, Tower of Hanoi, scene model, distractor robustness
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Expectation grammars: leveraging high-level expectations for activity recognition. https://app.cochat.ai/papers/10.1109/cvpr.2003.1211525
- The paper
- Minnen, D., Essa, I., & Starner, T. (2003). Expectation grammars: leveraging high-level expectations for activity recognition. 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings. https://doi.org/10.1109/cvpr.2003.1211525
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.