The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Embodiment in conversational interfaces: Rea
Abstract
In this paper, we argue for embodied corrversational characters as the logical extension of the metaphor of human - computer interaction as a conversation. We argue that the only way to fully model the richness of human I&+ to-face communication is to rely on conversational analysis that describes sets of conversational behaviors as fi~lfilling conversational functions, both interactional and propositional. We demonstrate how to implement this approach in Rea, an embodied conversational agent that is capable of both multimodal input understanding and output generation in a limited application domain. Rea supports both social and task-oriented dialogue. We discuss issues that need to be addressed in creating embodied conversational agents, and describe the architecture of the Rea interface.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1997) · Choice Reviews Online · doi:10.5860/choice.34-3702 · Cited by 4,887
Clark, H. H., & Brennan, S. E. (1991) · Perspectives on socially shared cognition. · doi:10.1037/10096-006 · Cited by 4,555
ELIZA — a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1983) · Communications of the ACM · doi:10.1145/357980.357991 · Cited by 2,738
KQML as an agent communication language
Finin, T., Fritzson, R., McKay, D., & McEntire, R. (1994) · Proceedings of the third international conference on Information and knowledge management - CIKM '94 · doi:10.1145/191246.191322 · Cited by 1,482
“Put-that-there”: Voice and gesture at the graphics interface
Bolt, R. A. (1980) · Proceedings of the 7th annual conference on Computer graphics and interactive techniques - SIGGRAPH '80 · doi:10.1145/800250.807503 · Cited by 1,445
“Put-that-there”: Voice and gesture at the graphics interface
Bolt, R. A. (1980) · ACM SIGGRAPH Computer Graphics · doi:10.1145/965105.807503 · Cited by 921
KQML as an agent communication language
Finin, T., Fritzson, R., McKay, D., & McEntire, R. (1994) · doi:10.13016/m2bvis-7jvt · Cited by 875
Cassell, J., Pelachaud, C., Badler, N., Steedman, M., Achorn, B., Becket, T., Douville, B., Prevost, S., & Stone, M. (1994) · Proceedings of the 21st annual conference on Computer graphics and interactive techniques - SIGGRAPH '94 · doi:10.1145/192161.192272 · Cited by 665
Self-citationSteedman, M. J. (1991) · Language · doi:10.1353/lan.1991.0098 · Cited by 386
The power of a nod and a glance: envelope vs. emotional feedback in animated conversational agents
Cassell, J., & Thorisson, K. R. (1999) · Applied Artificial Intelligence · doi:10.1080/088395199117360 · Cited by 383
Self-citation
Cited by
IEMOCAP: Interactive emotional dyadic motion capture database
Busso, C., Bulut, M., Lee, C.-C., Kazemzadeh, A., Mower, E., Kim, S., Chang, J. N., Lee, S., & Narayanan, S. S. (2008) · Language Resources and Evaluation · doi:10.1007/s10579-008-9076-6 · Cited by 3,869
Establishing and maintaining long-term human-computer relationships
Bickmore, T. W., & Picard, R. W. (2005) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1067860.1067867 · Cited by 1,333
Self-citationInteractive Robots as Social Partners and Peer Tutors for Children: A Field Trial
Kanda, T., Hirano, T., Eaton, D., & Ishiguro, H. (2004) · Human-Computer Interaction · doi:10.1207/s15327051hci1901&2_4 · Cited by 1,003
Rapp, A., Curti, L., & Boldi, A. (2021) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2021.102630 · Cited by 643
A Taxonomy of Social Cues for Conversational Agents
Feine, J., Gnewuch, U., Morana, S., & Maedche, A. (2019) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2019.07.009 · Cited by 567
Relational agents: a model and implementation of building user trust
Bickmore, T., & Cassell, J. (2001) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/365024.365304 · Cited by 479
Self-citationThe Benefits of Interactions with Physically Present Robots over Video-Displayed Agents
Bainbridge, W. A., Hart, J. W., Kim, E. S., & Scassellati, B. (2011) · International Journal of Social Robotics · doi:10.1007/s12369-010-0082-7 · Cited by 478
A review of verbal and non-verbal human–robot interactive communication
Mavridis, N. (2015) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2014.09.031 · Cited by 453
Eye gaze patterns in conversations: there is more to conversational agents than meets the eyes
Vertegaal, R., Slagter, R., van der Veer, G., & Nijholt, A. (2001) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/365024.365119 · Cited by 415
Footing in human-robot conversations: how robots might shape participant roles using gaze cues
Mutlu, B., Shiwa, T., Kanda, T., Ishiguro, H., & Hagita, N. (2009) · Proceedings of the 4th ACM/IEEE international conference on Human robot interaction · doi:10.1145/1514095.1514109 · Cited by 392
Bridging the Gap between Social Animal and Unsocial Machine: A Survey of Social Signal Processing
Vinciarelli, A., Pantic, M., Heylen, D., Pelachaud, C., Poggi, I., D'Errico, F., & Schroeder, M. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.27 · Cited by 381
"Hey Alexa, What's Up?": A Mixed-Methods Studies of In-Home Conversational Agent Usage
Sciuto, A., Saini, A., Forlizzi, J., & Hong, J. I. (2018) · Proceedings of the 2018 Designing Interactive Systems Conference · doi:10.1145/3196709.3196772 · Cited by 327
Social Dialongue with Embodied Conversational Agents
Bickmore, T., & Cassell, J. (2005) · Text, Speech and Language Technology · doi:10.1007/1-4020-3933-6_2 · Cited by 324
“In our earlier study on the effects of social dialogue on trust in ECA interactions, we found that social dialogue significantly increased trust for extraverts, while it made no significant difference for introverts [ Cassell and Bickmore, 2003 ].”
BackgroundMethodResultSelf-citationHuman-Robot Collaboration: A Literature Review and Augmented Reality Approach in Design
Green, S. A., Billinghurst, M., Chen, X., & Chase, J. G. (2008) · International Journal of Advanced Robotic Systems · doi:10.5772/5664 · Cited by 306
Self-citationBehavioral Signal Processing: Deriving Human Behavioral Informatics From Speech and Language
Narayanan, S., & Georgiou, P. G. (2013) · Proceedings of the IEEE · doi:10.1109/jproc.2012.2236291 · Cited by 294
Negotiated Collusion: Modeling Social Language and its Relationship Effects in Intelligent Agents
Cassell, J., & Bickmore, T. (2003) · User Modeling and User-Adapted Interaction · doi:10.1023/a:1024026532471 · Cited by 253
Self-citationGratch, J., Okhmatovskaia, A., Lamothe, F., Marsella, S., Morales, M., van der Werf, R. J., & Morency, L.-P. (2006) · Lecture Notes in Computer Science · doi:10.1007/11821830_2 · Cited by 247
Future directions for chatbot research: An interdisciplinary research agenda
Følstad, A., Araujo, T., Law, E. L.-C., Brandtzaeg, P. B., Papadopoulos, S., Reis, L., Baez, M., Laban, G., McAllister, P., Ischen, C., et al. (2021) · Computing · doi:10.1007/s00607-021-01016-7 · Cited by 247
Texting with Humanlike Conversational Agents: Designing for Anthropomorphism
Seeger, A.-M., University of Mannheim, G., Pfeiffer, J., Justus Liebig University Giessen, G., Heinzl, A., & University of Mannheim, G. (2021) · Journal of the Association for Information Systems · doi:10.17705/1jais.00685 · Cited by 200
I'm Sorry, Dave, I'm Afraid I Can't Do That: Chatbot Perception and Expectations
Zamora, J. (2017) · Proceedings of the 5th International Conference on Human Agent Interaction · doi:10.1145/3125739.3125766 · Cited by 164
Krämer, N. C., von der Pütten, A., & Eimler, S. (2012) · Studies in Computational Intelligence · doi:10.1007/978-3-642-25691-2_9 · Cited by 135
Towards human-like spoken dialogue systems
Edlund, J., Gustafson, J., Heldner, M., & Hjalmarsson, A. (2008) · Speech Communication · doi:10.1016/j.specom.2008.04.002 · Cited by 135
First Impressions in Human--Agent Virtual Encounters
Cafaro, A., Vilhjálmsson, H. H., & Bickmore, T. (2016) · ACM Transactions on Computer-Human Interaction · doi:10.1145/2940325 · Cited by 120
“Cassell et al. [1999] created a virtual real-estate agent called REA that was capable of greeting her clients, finding out what sort of housing they were looking for, and finally, demonstrating a few matching properties.”
BackgroundSelf-citationLoveys, K., Sebaratnam, G., Sagar, M., & Broadbent, E. (2020) · International Journal of Social Robotics · doi:10.1007/s12369-020-00680-7 · Cited by 110
Seymour, W., & Van Kleek, M. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3479515 · Cited by 94
Modeling embodied feedback with virtual humans,
Kopp, S., Allwood, J., Grammer, K., Ahlsen, E., & Stocksmeier, T. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-79037-2_2 · Cited by 71
“The REA system [7] also used a pause duration model and employed different modalities for feedback (head nods, short feedback utterances): when the dialog partner has finished a turn, she nodded; if she did not understand what was said to her, she raised the eyebrows and asked a repair question.”
Bellur, S., & Sundar, S. S. (2017) · Human Communication Research · doi:10.1111/hcre.12094 · Cited by 69
A Listening Agent Exhibiting Variable Behaviour
Bevacqua, E., Mancini, M., & Pelachaud, C. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-85483-8_27 · Cited by 50
Generating Robot/Agent backchannels during a storytelling experiment
Al Moubayed, S., Baklouti, M., Chetouani, M., Dutoit, T., Mahdhaoui, A., Martin, J.-C., Ondas, S., Pelachaud, C., Urbain, J., & Yilmaz, M. (2009) · 2009 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2009.5152572 · Cited by 33
“Examples are REA [12], an early system that realizes the full action-reaction cycle of communication by interpreting multimodal user input and generating multimodal agent behavior.”
BackgroundOertel, C., Lopes, J., Yu, Y., Mora, K. A. F., Gustafson, J., Black, A. W., & Odobez, J.-M. (2016) · Proceedings of the 18th ACM International Conference on Multimodal Interaction · doi:10.1145/2993148.2993188 · Cited by 21
Incremental multimodal feedback for conversational agents,
Kopp, S., Stocksmeier, T., & Gibbon, D. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-74997-4_13 · Cited by 21
“Among explicit modeling attempts, the Gandalf system [15] employs pause duration models to generate agent feedback and simulated turn-taking behavior by looking away from the listener while speaking, returning his gaze when finishing the turn.”
MethodInfluentialRodriguez-Gil, L., Garcia-Zubia, J., Orduna, P., Villar-Martinez, A., & Lopez-De-Ipina, D. (2019) · IEEE Access · doi:10.1109/access.2018.2883500 · Cited by 20
“INTRODUCTION Conversational agents (CAs) and intelligent tutoring systems (ITSs) have existed for decades [1], [2].”
BackgroundRepresenting communicative functions in saiba with a unified function markup language,
Cafaro, A., Vilhjálmsson, H. H., Bickmore, T., Heylen, D., & Pelachaud, C. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-09767-1_11 · Cited by 17
“This included the REA system [1] and the systems that followed it: BEAT [3] and Spark [4].”
BackgroundMethodSelf-citationGrounding behaviours with conversational interfaces: effects of embodiment and failures
Kontogiorgos, D., Pereira, A., & Gustafson, J. (2021) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-021-00366-y · Cited by 14
Mining a multimodal corpus of doctor's training for virtual patient's feedbacks,
Porhet, C., Ochs, M., Saubesty, J., de Montcheuil, G., & Bertrand, R. (2017) · Proceedings of the 19th ACM International Conference on Multimodal Interaction · doi:10.1145/3136755.3136816 · Cited by 10
Supporting presentation techniques based on virtual humans in educational virtual worlds
Chittaro, L., Ieronutti, L., & Rigutti, S. (2005) · 2005 International Conference on Cyberworlds (CW'05) · doi:10.1109/cw.2005.86 · Cited by 10
Metadata
- Authors
- Cassell, J., Bickmore, T., Billinghurst, M., Campbell, L., Chang, K., Vilhjálmsson, H., & Yan, H.
- Venue
- Proceedings of the SIGCHI conference on Human factors in computing systems the CHI is the limit - CHI '99
- Publisher
- ACM Press
- Published
- 1999
- Pages
- 520-527
- OpenAlex
- W2111754733
- Cited by
- 566
- References
- 23
- FWCI
- 16.98
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.