The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Animated conversation: rule-based generation of facial expression, gesture & spoken intonation for multiple conversational agents
Abstract
We describe an implemented system which automatically generates and animates conversations between multiple human-like agents with appropriate and synchronized speech, intonation, facial expressions, and hand gestures. Conversation is created by a dialogue planner that produces the text as well as the intonation of the utterances. The speaker/listener relationship, the text, and the intonation in turn drive facial expressions, lip motions, eye gaze, head motion, and arm gestures generators. Coordinated arm, wrist, and hand motions are invoked to create semantically meaningful gestures. Throughout we will use examples from an actual synthesized, fully animated conversation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Ekman, P., & Friesen, W. V. (2019) · PsycTESTS Dataset · doi:10.1037/t27734-000 · Cited by 6,019
Hand and mind: what gestures reveal about thought
(1993) · Choice Reviews Online · doi:10.5860/choice.30-2492 · Cited by 5,094
Some signals and rules for taking speaking turns in conversations.
Duncan, S. (1972) · Journal of Personality and Social Psychology · doi:10.1037/h0033031 · Cited by 1,385
Argyle, M., Cook, M., & Cramer, D. (1994) · British Journal of Psychiatry · doi:10.1017/s0007125000073980 · Cited by 1,304
Gesticulation and Speech: Two Aspects of the Process of Utterance
KENDON, A. (1980) · The Relationship of Verbal and Nonverbal Communication · doi:10.1515/9783110813098.207 · Cited by 1,205
The ZPG Letter: Subjects, Definiteness, and Information-status
Prince, E. F. (1992) · Pragmatics & Beyond New Series · doi:10.1075/pbns.16.12pri · Cited by 820
Simulating Humans: Computer Graphics, Animation, and Control
Badler, N. I., Phillips, C. B., & Webber, B. L. (1993) · Oxford University Press eBooks · doi:10.1093/oso/9780195073591.001.0001 · Cited by 751
Self-citationMovement coordination in social interaction: Some examples described
Kendon, A. (1970) · Acta Psychologica · doi:10.1016/0001-6918(70)90094-6 · Cited by 467
Modeling Coarticulation in Synthetic Visual Speech
Cohen, M. M., & Massaro, D. W. (1993) · Models and Techniques in Computer Animation · doi:10.1007/978-4-431-66911-1_13 · Cited by 445
Steedman, M. J. (1991) · Language · doi:10.1353/lan.1991.0098 · Cited by 386
Self-citation
Cited by
BEAT: the Behavior Expression Animation Toolkit
Cassell, J., Vilhjálmsson, H. H., & Bickmore, T. (2001) · Proceedings of the 28th annual conference on Computer graphics and interactive techniques · doi:10.1145/383259.383315 · Cited by 739
“Synthesis of animated communicative behavior has started from an underlying computation-heavy “intention to communicate” [10], a set of natural language instructions [2], or a state machine specifying whether or not the avatar or human participant was speaking, and the direction of the human participant’s gaze [15].”
BackgroundSelf-citationTen myths of multimodal interaction
Oviatt, S. (1999) · Communications of the ACM · doi:10.1145/319382.319398 · Cited by 689
Bruderlin, A., & Williams, L. (1995) · Proceedings of the 22nd annual conference on Computer graphics and interactive techniques - SIGGRAPH '95 · doi:10.1145/218380.218421 · Cited by 666
The impact of animated interface agents: a review of empirical research
DEHN, D. M., & VAN MULKEN, S. (2000) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.1999.0325 · Cited by 567
A Taxonomy of Social Cues for Conversational Agents
Feine, J., Gnewuch, U., Morana, S., & Maedche, A. (2019) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2019.07.009 · Cited by 567
Embodiment in conversational interfaces: Rea
Cassell, J., Bickmore, T., Billinghurst, M., Campbell, L., Chang, K., Vilhjálmsson, H., & Yan, H. (1999) · Proceedings of the SIGCHI conference on Human factors in computing systems the CHI is the limit - CHI '99 · doi:10.1145/302979.303150 · Cited by 566
Self-citationTowards a common framework for multimodal generation: the behavior markup language,
Kopp, S., Krenn, B., Marsella, S., Marshall, A. N., Pelachaud, C., Pirker, H., Thórisson, K. R., & Vilhjálmsson, H. (2006) · Lecture Notes in Computer Science · doi:10.1007/11821830_17 · Cited by 417
ALMA: a layered model of affect
Gebhard, P. (2005) · Proceedings of the fourth international joint conference on Autonomous agents and multiagent systems · doi:10.1145/1082473.1082478 · Cited by 395
The EMOTE model for effort and shape
Chi, D., Costa, M., Zhao, L., & Badler, N. (2000) · Proceedings of the 27th annual conference on Computer graphics and interactive techniques - SIGGRAPH '00 · doi:10.1145/344779.352172 · Cited by 393
Self-citationFooting in human-robot conversations: how robots might shape participant roles using gaze cues
Mutlu, B., Shiwa, T., Kanda, T., Ishiguro, H., & Hagita, N. (2009) · Proceedings of the 4th ACM/IEEE international conference on Human robot interaction · doi:10.1145/1514095.1514109 · Cited by 392
Guenter, B., Grimm, C., Wood, D., Malvar, H., & Pighin, F. (2006) · ACM SIGGRAPH 2006 Courses on - SIGGRAPH '06 · doi:10.1145/1185657.1185858 · Cited by 387
Bridging the Gap between Social Animal and Unsocial Machine: A Survey of Social Signal Processing
Vinciarelli, A., Pantic, M., Heylen, D., Pelachaud, C., Poggi, I., D'Errico, F., & Schroeder, M. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.27 · Cited by 381
A Storytelling Robot: Modeling and Evaluation of Human-like Gaze Behavior
Mutlu, B., Forlizzi, J., & Hodgins, J. (2006) · 2006 6th IEEE-RAS International Conference on Humanoid Robots · doi:10.1109/ichr.2006.321322 · Cited by 348
Human Conversation as a System Framework: Designing Embodied Conversational Agents
Cassell, J., Bickmore, T., Campbell, L., Vilhjálmsson, H., & Yan, H. (2000) · Embodied Conversational Agents · doi:10.7551/mitpress/2697.003.0004 · Cited by 342
Self-citationLearning Individual Styles of Conversational Gesture
Ginosar, S., Bar, A., Kohavi, G., Chan, C., Owens, A., & Malik, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00361 · Cited by 335
Infant-like Social Interactions between a Robot and a Human Caregiver
Breazeal, C., & Scassellati, B. (2000) · Adaptive Behavior · doi:10.1177/105971230000800104 · Cited by 327
Automatic determination of facial muscle activations from sparse motion capture marker data
Sifakis, E., Neverov, I., & Fedkiw, R. (2005) · ACM Transactions on Graphics · doi:10.1145/1073204.1073208 · Cited by 312
Applying artificial intelligence to virtual reality: Intelligent virtual environments
Luck, M., & Aylett, R. (2000) · Applied Artificial Intelligence · doi:10.1080/088395100117142 · Cited by 287
Generating facial expressions for speech
Pelachaud, C. (1996) · Cognitive Science · doi:10.1016/s0364-0213(99)80001-9 · Cited by 285
Self-citationLee, S. P., Badler, J. B., & Badler, N. I. (2002) · Proceedings of the 29th annual conference on Computer graphics and interactive techniques · doi:10.1145/566570.566629 · Cited by 257
Self-citationSynthesizing multimodal utterances for conversational agents
Kopp, S., & Wachsmuth, I. (2004) · Computer Animation and Virtual Worlds · doi:10.1002/cav.6 · Cited by 243
Virtual character performance from speech
Marsella, S., Xu, Y., Lhommet, M., Feng, A., Scherer, S., & Shapiro, A. (2013) · Proceedings of the 12th ACM SIGGRAPH/Eurographics Symposium on Computer Animation · doi:10.1145/2485895.2485900 · Cited by 168
Philip, P., Micoulaud-Franchi, J.-A., Sagaspe, P., Sevin, E. D., Olive, J., Bioulac, S., & Sauteraud, A. (2017) · Scientific Reports · doi:10.1038/srep42656 · Cited by 128
Schöbel, S., Schmitt, A., Benner, D., Saqr, M., Janson, A., & Leimeister, J. M. (2024) · Information Systems Frontiers · doi:10.1007/s10796-023-10375-9 · Cited by 127
Design of a virtual human presenter
Noma, T., Zhao, L., & Badler, N. I. (2000) · IEEE Computer Graphics and Applications · doi:10.1109/38.851755 · Cited by 115
“Our virtual human presenter is controlled by PaT-Nets (Parallel Transition Networks)[1]: simultaneously executing nite state automata.”
BackgroundMethodInfluentialSelf-citation(1997) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 72
Modeling multimodal behaviors from speech prosody,
Ding, Y., Pelachaud, C., & Artières, T. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-40415-3_19 · Cited by 32
Qu, C., Brinkman, W.-P., Ling, Y., Wiggers, P., & Heynderickx, I. (2013) · Virtual Reality · doi:10.1007/s10055-013-0231-z · Cited by 16
EMO2: End-Effector Guided Audio-Driven Avatar Video Generation
Tian, L., Hu, S., Wang, Q., Zhang, B., & Bo, L. (2025) · arXiv · doi:10.48550/arxiv.2501.10687
(1995) · DSpace@MIT (Massachusetts Institute of Technology)
Metadata
- Authors
- Cassell, J., Pelachaud, C., Badler, N., Steedman, M., Achorn, B., Becket, T., Douville, B., Prevost, S., & Stone, M.
- Venue
- Proceedings of the 21st annual conference on Computer graphics and interactive techniques - SIGGRAPH '94
- Publisher
- ACM Press
- Published
- 1994
- Pages
- 413-420
- OpenAlex
- W2008208299
- Cited by
- 665
- References
- 22
- FWCI
- 17.48
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.