The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Contextual recognition of head gestures,
Abstract
Head pose and gesture offer several key conversational grounding cues and are used extensively in face-to-face interaction among people. We investigate how dialog context from an embodied conversational agent (ECA) can improve visual recognition of user gestures. We present a recognition framework which (1) extracts contextual features from an ECA's dialog manager, (2) computes a prediction of head nod and head shakes, and (3) integrates the contextual predictions with the visual observation of a vision-based head gesture recognizer. We found a subset of lexical, punctuation and timing features that are easily available in most ECA architectures and can be used to learn how to predict user feedback. Using a discriminative approach to contextual prediction and multi-modal integration, we were able to improve the performance of head gesture detection even when the topic of the test set was significantly different than the training set.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In their study, they found that classification of nods and shakes was possible to do with high accuracy when the visual data from a camera sensor was combined with a prediction from dialogue context.”
From Modeling Feedback in Interaction With Conversational Agents—A Review (2022) · cites this paper as Morency et al., 2005
Citations
Cites
Context-based vision system for place and object recognition
Torralba, Murphy, M., Freeman, & Рубин (2003) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2003.1238354 · Cited by 875
Explorations in engagement for humans and robots
Sidner, C. L., Lee, C. W., Kidd, C. D., Lesh, N. B., & Rich, C. (2005) · Artificial Intelligence · doi:10.1016/j.artint.2005.03.005 · Cited by 559
Self-citationThe power of a nod and a glance: envelope vs. emotional feedback in animated conversational agents
Cassell, J., & Thorisson, K. R. (1999) · Applied Artificial Intelligence · doi:10.1080/088395199117360 · Cited by 383
Collagen: applying collaborative discourse theory to human-computer interaction
Rich, C., Sidner, C. L., & Lesh, N. B. (2001) · doi:10.1609/aimag.v22i4.1589 · Cited by 289
Self-citationEmbodied agents for multi-party dialogue in immersive virtual worlds
Traum, D. R., & Rickel, J. W. (2002) · Adaptive Agents and Multi-Agents Systems · doi:10.1145/544862.544922 · Cited by 236
Towards a model of face-to-face grounding
Nakano, Y., Reinstein, G., Stocky, T., & Cassell, J. (2003) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/1075096.1075166 · Cited by 202
A real-time head nod and shake detector
Kapoor, A., & Picard, R. W. (2001) · Workshop on Perceptive User Interfaces · doi:10.1145/971478.971509 · Cited by 156
Tracking focus of attention in meetings
Stiefelhagen, R. (2003) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1109/icmi.2002.1167006 · Cited by 152
Teaching and Working with Robots as a Collaboration
Breazeal, C., Hoffman, G., & Thomaz, A. L. (2004) · doi:10.1109/aamas.2004.258 · Cited by 136
Adaptive view-based appearance models
Morency, L.-P., Rahimi, A., & Darrell, T. J. (2003) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2003.1211435 · Cited by 107
Self-citation
Research works printed but not linked: 6
- Tim Bickmore and Justine Cassell . J. van Kuppevelt , L. Dybkjaer , and N. Bernsen (eds.), Natural, Intelligent and Effective Interaction with Multimodal Dialogue Systems , chapter Social Dialogue with Embodied Conversational Agents. Kluwer Academic , 2004 . Tim Bickmore and Justine Cassell. J. van Kuppevelt, L. Dybkjaer, and N. Bernsen (eds.), Natural, Intelligent and Effective Interaction with Multimodal Dialogue Systems, chapter Social Dialogue with Embodied Conversational Agents. Kluwer Academic, 2004.
- 10.5555/1018411.1018871 · DOI
- Dillman, Ehrenmann, Steinhaus, Rogalla, and R. Zoellner . Human friendly programming of humanoid robots--the German Collaborative Research Center . In The Third IARP Intenational Workshop on Humanoid and Human-Friendly Robotics, Tsukuba Research Centre , Japan , December 2002 . Dillman, Ehrenmann, Steinhaus, Rogalla, and R. Zoellner. Human friendly programming of humanoid robots--the German Collaborative Research Center. In The Third IARP Intenational Workshop on Humanoid and Human-Friendly Robotics, Tsukuba Research Centre, Japan, December 2002.
- Lemon, Gruenstein, and Stanley Peters . Collaborative activities and multi-tasking in dialogue systems. Traitement Automatique des Langues (TAL), special issue on dialogue, 43(2):131--154 , 2002 . Lemon, Gruenstein, and Stanley Peters. Collaborative activities and multi-tasking in dialogue systems. Traitement Automatique des Langues (TAL), special issue on dialogue, 43(2):131--154, 2002.
- 10.5555/874061.875409 · DOI
- 10.5555/946247.946665 · DOI
Cited by
Sorted by citations
Hidden Conditional Random Fields
Quattoni, A., Wang, S., Morency, L., Collins, M., & Darrell, T. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1124 · Cited by 489
Self-citationGesture and speech in interaction: An overview
Wagner, P., Malisz, Z., & Kopp, S. (2013) · Speech Communication · doi:10.1016/j.specom.2013.09.008 · Cited by 459
Hidden Conditional Random Fields for Gesture Recognition
Wang, S. B., Quattoni, A., Morency, L., Demirdjian, D., & Darrell, T. (2006) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2006.132 · Cited by 456
Self-citationCreating Rapport with Virtual Agents
Gratch, J., Wang, N., Gerten, J., Fast, E., & Duffy, R. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-74997-4_12 · Cited by 419
Gratch, J., Okhmatovskaia, A., Lamothe, F., Marsella, S., Morales, M., van der Werf, R. J., & Morency, L.-P. (2006) · Lecture Notes in Computer Science · doi:10.1007/11821830_2 · Cited by 247
Self-citation
Metadata
- Authors
- Morency, L.-P., Sidner, C., Lee, C., & Darrell, T.
- Affiliations
- Massachusetts Institute of Technology (US)
- Mitsubishi Electric Research Laboratories (United States) (US)
- Venue
- Proceedings of the 7th international conference on Multimodal interfaces
- Publisher
- ACM
- Published
- 2005-10-04
- Pages
- 18-24
- OpenAlex
- W2112618815
- Cited by
- 130
- References
- 18
- Citations by year
- 2026: 2 · 2024: 2 · 2023: 3 · 2022: 4 · 2021: 2 · 2020: 4 · 2019: 1 · 2018: 3 · 2017: 5 · 2016: 4 · 2015: 5 · 2014: 4 · 2013: 12 · 2012: 7
- FWCI
- 7.61
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Physical Sciences › Computer Science › Human-Computer Interaction › Hand Gesture Recognition Systems
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Keywords
- head gesture recognition, head orientation, head nodding, head shake, embodied conversational agents, contextual features, multimodal integration, lexical features, timing features, conversational grounding
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
