Contextual recognition of head gestures,
Abstract
Head pose and gesture offer several key conversational grounding cues and are used extensively in face-to-face interaction among people. We investigate how dialog context from an embodied conversational agent (ECA) can improve visual recognition of user gestures. We present a recognition framework which (1) extracts contextual features from an ECA's dialog manager, (2) computes a prediction of head nod and head shakes, and (3) integrates the contextual predictions with the visual observation of a vision-based head gesture recognizer. We found a subset of lexical, punctuation and timing features that are easily available in most ECA architectures and can be used to learn how to predict user feedback. Using a discriminative approach to contextual prediction and multi-modal integration, we were able to improve the performance of head gesture detection even when the topic of the test set was significantly different than the training set.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Morency et al. (2005) found that classification of nods and shakes was possible to do with high accuracy when the visual data from a camera sensor was combined with a prediction from dialogue context.
“In their study, they found that classification of nods and shakes was possible to do with high accuracy when the visual data from a camera sensor was combined with a prediction from dialogue context.”
From Modeling Feedback in Interaction With Conversational Agents—A Review (2022) · cites this paper as Morency et al., 2005
Cites
Context-based vision system for place and object recognition
Torralba, Murphy, M., Freeman, & Рубин (2003) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2003.1238354 · Cited by 867 · see citing works
Explorations in engagement for humans and robots
Sidner, C. L., Lee, C. W., Kidd, C. D., Lesh, N. B., & Rich, C. (2005) · Artificial Intelligence · doi:10.1016/j.artint.2005.03.005 · Cited by 559 · see citing works
Self-citationThe power of a nod and a glance: envelope vs. emotional feedback in animated conversational agents
Cassell, J., & Thorisson, K. R. (1999) · Applied Artificial Intelligence · doi:10.1080/088395199117360 · Cited by 383 · see citing works
Collagen: applying collaborative discourse theory to human-computer interaction
Rich, C., Sidner, C. L., & Lesh, N. B. (2001) · doi:10.1609/aimag.v22i4.1589 · Cited by 289 · see citing works
Self-citationEmbodied agents for multi-party dialogue in immersive virtual worlds
Traum, D. R., & Rickel, J. W. (2002) · Adaptive Agents and Multi-Agents Systems · doi:10.1145/544862.544922 · Cited by 229 · see citing works
Towards a model of face-to-face grounding
Nakano, Y., Reinstein, G., Stocky, T., & Cassell, J. (2003) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/1075096.1075166 · Cited by 202 · see citing works
A real-time head nod and shake detector
Kapoor, A., & Picard, R. W. (2001) · Workshop on Perceptive User Interfaces · doi:10.1145/971478.971509 · Cited by 156 · see citing works
Tracking focus of attention in meetings
Stiefelhagen, R. (2003) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1109/icmi.2002.1167006 · Cited by 152 · see citing works
Teaching and Working with Robots as a Collaboration
Breazeal, C., Hoffman, G., & Thomaz, A. L. (2004) · doi:10.1109/aamas.2004.258 · Cited by 136 · see citing works
Adaptive view-based appearance models
Morency, L.-P., Rahimi, A., & Darrell, T. J. (2003) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2003.1211435 · Cited by 107 · see citing works
Self-citationApplied Artificial Intelligence
Shinde, S. V., Bendre, V., Hemanth, D. J., & Balafar, M. A. (2023) · CRC Press eBooks · doi:10.1201/9781003324430 · Cited by 104 · see citing works
Fast stereo-based head tracking for interactive environments
Morency, L., Rahimi, A., Checka, N., & Darrell, T. (2003) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.2002.1004185 · Cited by 65 · see citing works
Self-citationA conversation robot using head gesture recognition as para-linguistic information
Fujie, S., Ejiri, Y., Nakajima, K., Matsusaka, Y., & Kobayashi, T. (2005) · IEEE RO-MAN · doi:10.1109/roman.2004.1374748 · Cited by 61 · see citing works
Behavior planning for a reflexive agent
Carolis, B. N. D., Pélachaud, C., Poggi, I., & de Rosis, F. (2001) · CINECA IRIS Institutional Research Information System (University of Bari Aldo Moro) · Cited by 61 · see citing works
Collaborative Activities and Multi-tasking in Dialogue Systems Towards natural dialogue with robots
Lemon, O., Gruenstein, A., & Peters, S. (2002) · TAL. Traitement automatique des langues · Cited by 51 · see citing works
ARMAR II — A LEARNING AND COOPERATIVE MULTIMODAL HUMANOID ROBOT SYSTEM
Dillmann, R., Becher, R., & Steinhaus, P. (2004) · International Journal of Humanoid Robotics · doi:10.1142/s0219843604000046 · Cited by 45 · see citing works
A multi-modal approach for determining speaker location and focus
Siracusa, M. R., Morency, L., Wilson, K., Fisher, J. S., & Darrell, T. (2003) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/958432.958449 · Cited by 31 · see citing works
Self-citationImpact of video editing based on participants' gaze in multiparty conversation
Takemae, Y., Otsuka, K., & Mukawa, N. (2004) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/985921.986057 · Cited by 19 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Hidden Conditional Random Fields
Quattoni, A., Wang, S., Morency, L., Collins, M., & Darrell, T. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1124 · Cited by 489 · see citing works
Self-citationGesture and speech in interaction: An overview
Wagner, P., Malisz, Z., & Kopp, S. (2013) · Speech Communication · doi:10.1016/j.specom.2013.09.008 · Cited by 459 · see citing works
Hidden Conditional Random Fields for Gesture Recognition
Wang, S. B., Quattoni, A., Morency, L., Demirdjian, D., & Darrell, T. (2006) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2006.132 · Cited by 456 · see citing works
Self-citationCreating Rapport with Virtual Agents
Gratch, J., Wang, N., Gerten, J., Fast, E., & Duffy, R. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-74997-4_12 · Cited by 419 · see citing works
Gratch, J., Okhmatovskaia, A., Lamothe, F., Marsella, S., Morales, M., van der Werf, R. J., & Morency, L.-P. (2006) · Lecture Notes in Computer Science · doi:10.1007/11821830_2 · Cited by 247 · see citing works
Self-citationHCI Beyond the GUI: Design for Haptic, Speech, Olfactory, and Other Nontraditional Interfaces
Kortum, P. T. (2008) · Cited by 185 · see citing works
A probabilistic multimodal approach for predicting listener backchannels
Morency, L.-P., de Kok, I., & Gratch, J. (2010) · Autonomous Agents and Multi-Agent Systems · doi:10.1007/s10458-009-9092-y · Cited by 162 · see citing works
Self-citationHuang, L., Morency, L., & Gratch, J. S. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-23974-8_8 · Cited by 154 · see citing works
Self-citationCan Virtual Humans Be More Engaging Than Real Ones?
Gratch, J. S., Wang, N., Okhmatovskaia, A., Lamothe, F., Morales, M., van der Werf, R. J., & Morency, L. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-73110-8_30 · Cited by 110 · see citing works
Self-citationPredicting Listener Backchannels: A Probabilistic Multimodal Approach
Morency, L., de Kok, I., & Gratch, J. S. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-85483-8_18 · Cited by 109 · see citing works
Self-citationThe effect of head-nod recognition in human-robot conversation,
Sidner, C. L., Lee, C., Morency, L.-P., & Forlines, C. (2006) · Proceedings of the 1st ACM SIGCHI/SIGART conference on Human-robot interaction · doi:10.1145/1121241.1121291 · Cited by 107 · see citing works
Self-citationGüneş, H., & Pantić, M. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15892-6_39 · Cited by 86 · see citing works
Recognizing gaze aversion gestures in embodied conversational discourse
Morency, L., Christoudias, C. M., & Darrell, T. (2006) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/1180995.1181051 · Cited by 82 · see citing works
Self-citationAutomatic inference of cross-modal nonverbal interactions in multiparty conversations
Otsuka, K., Sawada, H., & Yamato, J. (2007) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/1322192.1322237 · Cited by 81 · see citing works
Bousmalis, K., Méhu, M., & Pantić, M. (2012) · Image and Vision Computing · doi:10.1016/j.imavis.2012.07.003 · Cited by 78 · see citing works
Spotting agreement and disagreement: A survey of nonverbal audiovisual cues and tools
Bousmalis, K., Méhu, M., & Pantić, M. (2009) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2009.5349477 · Cited by 77 · see citing works
Head gesture recognition in intelligent interfaces
Morency, L., & Darrell, T. (2006) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/1111449.1111464 · Cited by 72 · see citing works
Self-citationSheikhi, S., & Odobez, J. (2014) · Pattern Recognition Letters · doi:10.1016/j.patrec.2014.10.002 · Cited by 67 · see citing works
A psycho-ethological approach to social signal processing
Méhu, M., & Scherer, K. R. (2012) · Cognitive Processing · doi:10.1007/s10339-012-0435-2 · Cited by 56 · see citing works
A framework for research and design of gesture-based human-computer interactions
Karam, M. (2006) · ePrints Soton (University of Southampton) · Cited by 52 · see citing works
Wang, N., & Gratch, J. S. (2010) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753513 · Cited by 51 · see citing works
Machine-Learning-Based Muscle Control of a 3D-Printed Bionic Arm
Said, S., Boulkaibet, I., Sheikh, M., Karar, A. S., Kork, S. A., & Naït-Ali, A. (2020) · Sensors · doi:10.3390/s20113144 · Cited by 54 · see citing works
Agreeable People Like Agreeable Virtual Humans
Kang, S., Gratch, J. S., Wang, N., & Watt, J. H. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-85483-8_26 · Cited by 47 · see citing works
Recognition of Hearing Needs from Body and Eye Movements to Improve Hearing Instruments
Tessendorf, B., Bulling, A., Roggen, D., Stiefmeier, T., Feilner, M., Derleth, P., & Tröster, G. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-21726-5_20 · Cited by 45 · see citing works
Automatic interface of cross-modal nonverbal interactions in multiparty conversation
Otsuka, K. (2007) · Cited by 45 · see citing works
The Paradigm Shift to Multimodality in Contemporary Computer Interfaces
Oviatt, S. L., & Cohen, P. R. (2015) · Synthesis lectures on human-centered informatics · doi:10.2200/s00636ed1v01y201503hci030 · Cited by 58 · see citing works
A Meta-Analytic Review on Embodied Pedagogical Agent Design and Testing Formats
Davis, R. O., Park, T., & Vincent, J. (2022) · Journal of Educational Computing Research · doi:10.1177/07356331221100556 · Cited by 41 · see citing works
Otsuka, K., & Tsumori, M. (2020) · IEEE Access · doi:10.1109/access.2020.3041672 · Cited by 38 · see citing works
Does the contingency of agents' nonverbal feedback affect users' social anxiety?
Kang, S., Gratch, J. S., Wang, N., & Watt, J. H. (2008) · doi:10.5555/1402383.1402405 · Cited by 38 · see citing works
Rapport Between Humans and Socially Interactive Agents
Gratch, J., & Lucas, G. (2021) · The Handbook on Socially Interactive Agents · doi:10.1145/3477322.3477335 · Cited by 36 · see citing works
Robust classification of face and head gestures in video
Akakın, H. Ç., & Sankur, B. (2011) · Image and Vision Computing · doi:10.1016/j.imavis.2011.03.001 · Cited by 34 · see citing works
Proxemic Feature Recognition for Interactive Robots: Automating Metrics from the Social Sciences
Mead, R., Atrash, A., & Matarić, M. J. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-25504-5_6 · Cited by 35 · see citing works
Lessons Learned from Virtual Humans
Swartout, W. (2010) · AI Magazine · doi:10.1609/aimag.v31i1.2284 · Cited by 34 · see citing works
Modeling Feedback in Interaction With Conversational Agents—A Review
Axelsson, A., Buschmeier, H., & Skantze, G. (2022) · Frontiers in Computer Science · doi:10.3389/fcomp.2022.744574 · Cited by 33 · see citing works
“Body pose can overlap with gaze direction and facial expressions when a system wants to sense head gestures like nodding (Sidner et al., 2006) or head-shakes (Morency et al., 2005, 2007).”
BackgroundGenerating Listening Behaviour
Heylen, D., Bevacqua, E., Pélachaud, C., Poggi, I., Gratch, J. S., & Schröder, M. (2010) · Cognitive technologies · doi:10.1007/978-3-642-15184-2_17 · Cited by 33 · see citing works
It’s in Their Eyes: A Study on Female and Male Virtual Humans’ Gaze
Kulms, P., Krämer, N. C., Gratch, J. S., & Kang, S. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-23974-8_9 · Cited by 33 · see citing works
Learning Backchannel Prediction Model from Parasocial Consensus Sampling: A Subjective Evaluation
Huang, L., Morency, L., & Gratch, J. S. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15892-6_17 · Cited by 32 · see citing works
Self-citationUsing self-context for multimodal detection of head nods in face-to-face interactions
Nguyen, L. S., Odobez, J., & Gática-Pérez, D. (2012) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/2388676.2388734 · Cited by 32 · see citing works
Investigating Communicative Feedback Phenomena across Languages and Modalities
Cerrato, L. (2007) · Cited by 34 · see citing works
Bevacqua, E., Prépin, K., Niewiadomski, R., de Sevin, É., & Pélachaud, C. (2010) · Natural language processing · doi:10.1075/nlp.8.20bev · Cited by 31 · see citing works
Automatic Acquisition of Context Models and its Application to Video Surveillance
Brdiczka, O., Yuen, P. C., Zaidenberg, S., Reignier, P., & Crowley, J. L. (2006) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2006.292 · Cited by 30 · see citing works
Fluid Semantic Back-Channel Feedback in Dialogue: Challenges and Progress
Jonsdottir, G. R., Gratch, J., Fast, E., & Thórisson, K. R. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-74997-4_15 · Cited by 29 · see citing works
Zhou, Y., Ramanarayanan, V., Lange, P. L., & Suendermann‐Oeft, D. (2018) · Lecture notes in electrical engineering · doi:10.1007/978-3-319-92108-2_21 · Cited by 27 · see citing works
Who Is there? Can a Virtual Agent Really Elicit Social Presence?
von der Pütten, A. M., Krämer, N., & Gratch, J. S. (2009) · Cited by 27 · see citing works
Xu, M., Xijian, P., Li, T., & Mantian, X. (2007) · International Conference on Image and Graphics · doi:10.1109/icig.2007.154 · Cited by 26 · see citing works
Yang, X., Wang, X., Dong, G., Yan, Z., Srivastava, M. B., Hayashi, E., & Zhang, Y. (2023) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3610900 · Cited by 22 · see citing works
Engagement detection based on mutli-party cues for human robot interaction
Salam, H., & Chétouani, M. (2015) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2015.7344593 · Cited by 22 · see citing works
A Context Model and Reasoning System to improve object trackingin complex scenarios
Sánchez, A. M., Patricio, M. A., Garcı́a, J., & Molina, J. M. (2009) · Expert Systems with Applications · doi:10.1016/j.eswa.2009.02.096 · Cited by 22 · see citing works
Can Virtual Human Build Rapport and Promote Learning?
Ning, W., & Gratch, J. S. (2009) · Frontiers in artificial intelligence and applications · doi:10.3233/978-1-60750-028-5-737 · Cited by 21 · see citing works
Paggio, P., & Navarretta, C. (2012) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-012-0105-9 · Cited by 20 · see citing works
Enabling Voice-Accompanying Hand-to-Face Gesture Recognition with Cross-Device Sensing
Li, Z., Liang, C., Wang, Y., Qin, Y., Yu, C., Yan, Y., Fan, M., & Shi, Y. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581008 · Cited by 19 · see citing works
Enhancement of Conversational Agents By Means of Multimodal Interaction
López-Cózar, R., Callejas, Z., Espejo, G., & Griol, D. (2011) · Conversational Agents and Natural Language Interaction · doi:10.4018/978-1-60960-617-6.ch010 · Cited by 18 · see citing works
Classification of Feedback Expressions in Multimodal Data
Navarretta, C., & Paggio, P. (2010) · Research at the University of Copenhagen (University of Copenhagen) · Cited by 17 · see citing works
Recognizing Visual Signatures of Spontaneous Head Gestures
Sharma, M., Ahmetovic, D., Jeni, L. A., & Kitani, K. (2018) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2018.00050 · Cited by 17 · see citing works
Attentional Gestures in Dialogues Between People and Robots
Sidner, C. L., & Lee, C. W. (2007) · doi:10.1002/9780470512470.ch6 · Cited by 16 · see citing works
Self-citationExploring annotation of head gesture forms in spontaneous human interaction.
Kousidis, S., Malisz, Z., Wagner, P., & Schlangen, D. (2013) · Publikationen an der Universität Bielefeld (Universität Bielefeld) · Cited by 15 · see citing works
Ruiz, N., Chen, F., & Oviatt, S. L. (2010) · Elsevier eBooks · doi:10.1016/b978-0-12-374825-6.00010-1 · Cited by 15 · see citing works
Detection of social signals for recognizing engagement in human-robot interactionPreprint
Lala, D., Inoue, K., Milhorat, P., & Kawahara, T. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.10257 · Cited by 15 · see citing works
The effect of avatar realism of virtual humans on self-disclosure in anonymous social interactions
Kang, S., & Gratch, J. S. (2010) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/1753846.1754056 · Cited by 14 · see citing works
Recognition of Multi-Pose Head Gestures in Human Conversations
Dong, L., Jin, Y., Tao, L., & Xu, G. (2007) · International Conference on Image and Graphics · doi:10.1109/icig.2007.176 · Cited by 13 · see citing works
Keyboard before Head Tracking Depresses User Success in Remote Camera Control
Zhu, D., Gedeon, T., & Taylor, K. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-03658-3_37 · Cited by 13 · see citing works
Transfer learning in multimodal corpora
Navarretta, C. (2013) · IEEE International Conference on Cognitive Infocommunications · doi:10.1109/coginfocom.2013.6719240 · Cited by 12 · see citing works
The Boosting Effect of Exploratory Behaviors
Sinapov, J., & Stoytchev, A. (2010) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v24i1.7725 · Cited by 12 · see citing works
Context aware addressee estimation for human robot interaction
Sheikhi, S., Jayagopi, D. B., Khalidov, V., & Odobez, J. (2013) · doi:10.1145/2535948.2535958 · Cited by 11 · see citing works
Barthelmess, P., & Oviatt, S. L. (2008) · Elsevier eBooks · doi:10.1016/b978-0-12-374017-5.00012-2 · Cited by 11 · see citing works
Navarretta, C. (2014) · Knowledge-Based Systems · doi:10.1016/j.knosys.2014.04.034 · Cited by 11 · see citing works
Archer-Boyd, A. W., Holman, J. A., & Brimijoin, W. O. (2017) · Hearing Research · doi:10.1016/j.heares.2017.11.011 · Cited by 11 · see citing works
Multimodal Sensing, Interpretation and Copying of Movements by a Virtual Agent
Bevacqua, E., Raouzaiou, A. T., Peters, C., Caridakis, G., Karpouzis, K. C., Pélachaud, C., & Mancini, M. (2006) · Lecture notes in computer science · doi:10.1007/11768029_16 · Cited by 12 · see citing works
Effect of Robot Head Movement and its Timing on Human-Robot Interaction
Lee, H. C., & Hahn, S. (2024) · International Journal of Social Robotics · doi:10.1007/s12369-024-01196-0 · Cited by 10 · see citing works
Computational modeling of face-to-face social interaction using nonverbal behavioral cues
Jayagopi, D. B. (2011) · Journal of Ambient Intelligence and Smart Environments · doi:10.3233/ais-2011-0115 · Cited by 10 · see citing works
Multimodal HALEF: An Open-Source Modular Web-Based Multimodal Dialog Framework
Zhou, Y., Ramanarayanan, V., Mundkowsky, R., Lange, P. L., Ivanov, A., Black, A. W., & Suendermann‐Oeft, D. (2016) · Lecture notes in electrical engineering · doi:10.1007/978-981-10-2585-3_18 · Cited by 10 · see citing works
A user's feedback ontology for context-aware interaction
Mezhoudi, N., & Vanderdonckt, J. M. (2015) · World Symposium on Web Applications and Networking (WSWAN) · doi:10.1109/wswan.2015.7210331 · Cited by 10 · see citing works
User intent perception by gesture and eye tracking
Yang, X., He, H., Yueming, W., Tang, C., Chen, H., & Liang, J. (2016) · Cogent Engineering · doi:10.1080/23311916.2016.1221570 · Cited by 10 · see citing works
Classifying Multimodal Turn Management in Danish Dyadic First Encounters
Navarretta, C., & Paggio, P. (2013) · OAR@UM (University of Malta) · Cited by 9 · see citing works
Annotating Non-verbal Behaviours in Informal Interactions
Navarretta, C. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-25775-9_29 · Cited by 9 · see citing works
Applying machine learning to head gesture recognition using wearables
Wu, C., Yang, H.-Z., Chen, Y.-A., Bajo, E., Ren, Y. C., & Tseng, Y. (2017) · International Conference on Awareness Science and Technology (iCAST) · doi:10.1109/icawst.2017.8256495 · Cited by 9 · see citing works
Conditional Sequence Model for Context-Based Recognition of Gaze Aversion
Morency, L., & Darrell, T. (2008) · Springer eBooks · doi:10.1007/978-3-540-78155-4_2 · Cited by 9 · see citing works
Self-citationEmbodied Head Gesture and Distance Education
Khan, M. S. L., & Réhman, S. U. (2015) · Procedia Manufacturing · doi:10.1016/j.promfg.2015.07.251 · Cited by 9 · see citing works
Understanding the Nonverbal Behavior of Socially Anxious People during Intimate Self-disclosure
Kang, S., Rizzo, A., & Gratch, J. S. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33197-8_22 · Cited by 9 · see citing works
The effect of affective iconic realism on anonymous interactants' self-disclosure
Kang, S., Gratch, J. S., & Watt, J. H. (2009) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/1520340.1520611 · Cited by 9 · see citing works
A real-time attitude recognition by eye-tracking
Lv, Y., Wang, S., & Shen, P. (2011) · International Conference on Internet Multimedia Computing and Service · doi:10.1145/2043674.2043723 · Cited by 9 · see citing works
Greta, une plateforme d'agent conversationnel expressif et interactif
de Sevin, É., Niewiadomski, R., Bevacqua, E., Pez, A.-M., Mancini, M., & Pélachaud, C. (2010) · Techniques et sciences informatiques · doi:10.3166/tsi.29.751-776 · Cited by 10 · see citing works
Traum, D. R., & Morency, L. (2010) · Cited by 8 · see citing works
Self-citationLow complexity head tracking on portable android devices for real time message composition
Montanini, L., Cippitelli, E., Gambi, E., & Spinsante, S. (2015) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-015-0174-7 · Cited by 8 · see citing works
Automatic Detection and Classification of Head Movements in Face-to-Face Conversations
Paggio, P., Agirrezabal, M., Jongejan, B., & Navarretta, C. (2020) · OAR@UM (University of Malta) · Cited by 8 · see citing works
Effect of time delays on agents' interaction dynamics
Prépin, K., & Pélachaud, C. (2011) · doi:10.5555/2034396.2034419 · Cited by 7 · see citing works
Kang, S., Watt, J. H., Gratch, J. S., & Wang, N. (2009) · Cited by 7 · see citing works
Lis, M., & Navarretta, C. (2014) · Cited by 6 · see citing works
Swartout, W. (2006) · National Conference on Artificial Intelligence · Cited by 6 · see citing works
Spatiotemporal-Boosted DCT Features for Head and Face Gesture Analysis
Akakın, H. Ç., & Sankur, B. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-14715-9_7 · Cited by 6 · see citing works
Platforms and Tools for SIA Research and Development
Hartholt, A., & Mozgai, S. (2022) · ACM eBooks · doi:10.1145/3563659.3563668 · Cited by 5 · see citing works
Automated Analysis of Proxemic Behavior: Leveraging Metrics from the Social Sciences
Mead, R., Atrash, A., & Matarić, M. J. (2011) · Cited by 5 · see citing works
A real time decision support system using head nod and shake
Suni, S. S., & Gopakumar, K. (2016) · International Conference on Circuit, Power and Computing Technologies · doi:10.1109/iccpct.2016.7530336 · Cited by 5 · see citing works
Gratch, J. S. (2008) · Springer eBooks · doi:10.1007/978-3-540-79037-2_10 · Cited by 5 · see citing works
Morency, L. (2009) · doi:10.1145/1722156.1722160 · Cited by 5 · see citing works
Self-citationDetecting head movements in video-recorded dyadic conversations
Paggio, P., Jongejan, B., Agirrezabal, M., & Navarretta, C. (2018) · doi:10.1145/3281151.3281152 · Cited by 4 · see citing works
Automatic identification of head movements in video-recorded conversations: can words help?
Paggio, P., Navarretta, C., & Jongejan, B. (2017) · Proceedings of the Sixth Workshop on Vision and Language · doi:10.18653/v1/w17-2006 · Cited by 4 · see citing works
Kjellström, H. (2011) · Springer eBooks · doi:10.1007/978-0-85729-997-0_18 · Cited by 3 · see citing works
Contextualization in Mobile Robots
Calisi, D., Farinelli, A., Grisetti, G., Iocchi, L., Nardi, D., Pellegrini, S., Tipaldi, D., & Ziparo, V. A. (2007) · Cited by 3 · see citing works
Uses of Contextual Knowledge in Mobile Robots
Calisi, D., Farinelli, A., Grisetti, G., Iocchi, L., Nardi, D., Pellegrini, S., Tipaldi, D., & Ziparo, V. A. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-74782-6_47 · Cited by 3 · see citing works
- Authors
- Morency, L.-P., Sidner, C., Lee, C., & Darrell, T.
- Affiliations
- Massachusetts Institute of Technology (US)
- Mitsubishi Electric Research Laboratories (United States) (US)
- Venue
- Proceedings of the 7th international conference on Multimodal interfaces
- Publisher
- ACM
- Published
- 2005-10-04
- Pages
- 18-24
- OpenAlex
- W2112618815
- Cited by
- 130
- References
- 18
- Citations by year
- 2026: 2 · 2024: 2 · 2023: 3 · 2022: 4 · 2021: 2 · 2020: 4 · 2019: 1 · 2018: 3 · 2017: 5 · 2016: 4 · 2015: 5 · 2014: 4 · 2013: 12 · 2012: 7
- FWCI
- 7.61
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Physical Sciences › Computer Science › Human-Computer Interaction › Hand Gesture Recognition Systems
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Emotion and Mood Recognition
- Keywords
- head gesture recognition, head orientation, head nodding, head shake, embodied conversational agents, contextual features, multimodal integration, lexical features, timing features, conversational grounding
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
