Architecture for Building Conversational Agents That Support Collaborative Learning
Abstract
Tutorial Dialog Systems that employ Conversational Agents (CAs) to deliver instructional content to learners in one-on-one tutoring settings have been shown to be effective in multiple learning domains by multiple research groups. Our work focuses on extending this successful learning technology to collaborative learning settings involving two or more learners interacting with one or more agents. Experience from extending existing techniques for developing conversational agents into multiple-learner settings highlights two underlying assumptions from the one-learner setting that do not generalize well to the multiuser setting, and thus cause difficulties. These assumptions include what we refer to as the near-even participation assumption and the known addressee assumption. A new software architecture called Basilica that allows us to address and overcome these limitations is a major contribution of this article. The Basilica architecture adopts an object-oriented approach to represent agents as a network composed of what we refer to as behavioral components because they enable the agents to engage in rich conversational behaviors. Additionally, we describe three specific conversational agents built using Basilica in order to illustrate the desirable properties of this new architecture.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Cites
Interaction Process Analysis: A Method for the Study of Small Groups.
Greenwood, E. C. V., & Bales, R. F. (1950) · American Sociological Review · doi:10.2307/2086941 · Cited by 1,673 · see citing works
Kreijns, K., Kirschner, P. A., & Jochems, W. M. G. (2003) · Computers in Human Behavior · doi:10.1016/s0747-5632(02)00057-2 · Cited by 1,633 · see citing works
Interaction Process Analysis; A Method for the Study of Small Groups
Schnepp, B. G. J., Nuesse, C. J., & Bales, R. F. (1950) · The American Catholic Sociological Review · doi:10.2307/3707344 · Cited by 1,306 · see citing works
Cognitive Perspectives on Peer Learning
O’Donnell, A. M., & King, A. (2014) · Routledge eBooks · doi:10.4324/9781410603715 · Cited by 871 · see citing works
AutoTutor: an intelligent tutoring system with mixed-initiative dialogue.
Graesser, A. C., Chipman, P., Haynes, B. C., & Olney, A. (2005) · IEEE Transactions on Education · doi:10.1109/te.2005.856149 · Cited by 750 · see citing works
Collaboration Scripts – A Conceptual Analysis
Kollar, I., Fischer, F., & Hesse, F. W. (2006) · Educational Psychology Review · doi:10.1007/s10648-006-9007-2 · Cited by 534 · see citing works
Learning from Worked-Out Examples: The Effects of Example Variability and Elicited Self-Explanations
Renkl, A., Stark, R., Gruber, H., & Mandl, H. (1998) · Contemporary Educational Psychology · doi:10.1006/ceps.1997.0959 · Cited by 374 · see citing works
Promoting reflective interactions in a CSCL environment
Baker, M. J., & Lund, K. (1997) · Journal of Computer Assisted Learning · doi:10.1046/j.1365-2729.1997.00019.x · Cited by 359 · see citing works
Rosé, C., Wang, Y.-C., Cui, Y., Arguello, J., Stegmann, K., Weinberger, A., & Fischer, F. (2008) · International Journal of Computer-Supported Collaborative Learning · doi:10.1007/s11412-007-9034-0 · Cited by 351 · see citing works
Redefining the learning companion: the past, present, and future of educational agents
Chou, C., Chan, T.-W., & Lin, C.-J. (2003) · Computers & Education · doi:10.1016/s0360-1315(02)00130-6 · Cited by 270 · see citing works
The RavenClaw dialog management framework: Architecture and systems
Bohus, D., & Rudnicky, A. I. (2008) · Computer Speech & Language · doi:10.1016/j.csl.2008.10.001 · Cited by 264 · see citing works
Tutorial Dialogue as Adaptive Collaborative Learning Support
Kumar, R., Rosé, C. P., Wang, Y., Joshi, M., & Robinson, A. L. (2007) · Cited by 134 · see citing works
Self-citationAgent Technologies Designed to Facilitate Interactive Knowledge Construction
Graesser, A. C., Jeon, M., & Dufty, D. F. (2008) · Discourse Processes · doi:10.1080/01638530802145395 · Cited by 126 · see citing works
Using Intelligent Tutor Technology to Implement Adaptive Support for Student Collaboration
Diziol, D., Walker, E., Rummel, N., & Koedinger, K. R. (2009) · Educational Psychology Review · doi:10.1007/s10648-009-9116-9 · Cited by 112 · see citing works
Explicit referencing in chat supports collaborative learning
Mühlpfordt, M., & Wessner, M. (2005) · doi:10.3115/1149293.1149353 · Cited by 101 · see citing works
CyclePad: An articulate virtual laboratory for engineering thermodynamics
Forbus, K. D., Whalley, P. B., Everett, J. O., et al. (1999) · Artificial Intelligence · doi:10.1016/s0004-3702(99)00080-6 · Cited by 99 · see citing works
Tools for Authoring a Dialogue Agent that Participates in Learning Studies
Jordan, P., Hall, B. S., Ringenberg, M. A., Cue, Y., & Rosé, C. P. (2007) · Cited by 73 · see citing works
Socially Capable Conversational Tutors Can Be Effective in Collaborative Learning Situations
Kumar, R. V., Ai, H., Beuth, J., & Rosé, C. P. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-13388-6_20 · Cited by 59 · see citing works
Self-citationEngaging Collaborative Learners with Helping Agents
Chaudhuri, S., Rohit, K., Howley, I. K., & Rosé, C. P. (2009) · Frontiers in artificial intelligence and applications · doi:10.3233/978-1-60750-028-5-365 · Cited by 47 · see citing works
Ai, H., Kumar, R., Nguyen, D., Nagasunder, A., & Rosé, C. P. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-13437-1_14 · Cited by 46 · see citing works
Self-citationPlan-based dialogue management in a physics tutor
Freedman, R. (2000) · Conference on Applied Natural Language Processing · doi:10.3115/974147.974155 · Cited by 43 · see citing works
Research Methods Tutor: Evaluation of a dialogue-based tutoring system in the classroom
Arnott, E., Hastings, P., & Allbritton, D. W. (2008) · Behavior Research Methods · doi:10.3758/brm.40.3.694 · Cited by 42 · see citing works
The Need for Tutorial Dialog to Support Self-Explanation
Aleven, V., & Koedinger, K. R. (2000) · Cited by 38 · see citing works
Error awareness and recovery in conversational spoken language interfaces
Rudnicky, A. I., Rosenfeld, R., & Bohus, D. (2007) · Cited by 31 · see citing works
Supporting students working together on math with social dialogue
Kumar, R., Gweon, G., Joshi, M., Cui, Y. J., & Rosé, C. P. (2007) · ISCA Workshop on Speech and Language Technology in Education (SLaTE) · doi:10.21437/slate.2007-18 · Cited by 27 · see citing works
Self-citationThe queen's communicator: an object-oriented dialogue manager
O'Neill, I. M., Hanna, P., Liu, X., et al. (2003) · European Conference on Speech Communication and Technology (Eurospeech) · doi:10.21437/eurospeech.2003-254 · Cited by 25 · see citing works
A Framework for Assessment of Student Project Groups On-Line and Off-Line
Gweon, G., Jun, S., Lee, J., Finger, S., & Rosé, C. P. (2010) · Springer eBooks · doi:10.1007/978-1-4419-7710-6_14 · Cited by 23 · see citing works
Are we `in sync': turn-taking in collaborative dialogues
Beňuš, Š. (2009) · Interspeech (USB) · doi:10.21437/interspeech.2009-618 · Cited by 21 · see citing works
It’s Not Easy Being Green: Supporting Collaborative “Green Design” Learning
Chaudhuri, S., Kumar, R., Joshi, M., Terrell, E. J., Higgs, F., Aleven, V., & Rosé, C. P. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-69132-7_114 · Cited by 19 · see citing works
Self-citationThe RavenClaw dialog management framework
BohusDan, & RudnickyAlexander, I. (2009) · Computer Speech & Language · doi:10.5555/1518321.1518367 · Cited by 16 · see citing works
Towards a Flexible Intelligent Tutoring System for Argumentation
Loll, F., Pinkwart, N., Scheuer, O., et al. (2009) · IEEE International Conference on Advanced Learning Technologies (ICALT) · doi:10.1109/icalt.2009.138 · Cited by 8 · see citing works
Supporting Collaborative Knowledge Building with Intelligent Agents
Chen, W., Dolonen, J. A., & Wasson, B. (2003) · Lecture notes in computer science · doi:10.1007/978-3-540-45226-3_33 · Cited by 4 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Interacting with educational chatbots: A systematic review
Kuhail, M. A., Alturki, N., Alramlawi, S., & Alhejori, K. (2023) · Education and Information Technologies · doi:10.1007/s10639-022-11177-3 · Cited by 841 · see citing works
Towards an Agile Approach to Adapting Dynamic Collaboration Support to Student Needs
Adamson, D., Dyke, G., Jang, H., & Rosé, C. P. (2014) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-013-0012-6 · Cited by 156 · see citing works
Self-citationBittner, E., & Shoury, O. (2019) · Proceedings of the Annual Hawaii International Conference on System Sciences · doi:10.24251/hicss.2019.029 · Cited by 37 · see citing works
Xie, T., Liu, R., Chen, Y., & Liu, G. (2021) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2021.3129800 · Cited by 32 · see citing works
Towards Academically Productive Talk Supported by Conversational Agents
Dyke, G., Howley, I., Adamson, D., Kumar, R., & Rosé, C. P. (2013) · Productive Multivocality in the Analysis of Group Interactions · doi:10.1007/978-1-4614-8960-3_25 · Cited by 21 · see citing works
Self-citationRodriguez-Gil, L., Garcia-Zubia, J., Orduna, P., Villar-Martinez, A., & Lopez-De-Ipina, D. (2019) · IEEE Access · doi:10.1109/access.2018.2883500 · Cited by 20 · see citing works
Breideband, T., Bush, J. B., Reitman, J. G., Rose, S., Weatherley, J., Penuel, W. R., & D’Mello, S. K. (2025) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-025-00509-2 · Cited by 5 · see citing works
“Rosé and colleagues (Adamson, Ashe, et al. 2014; Adamson, Dyke, et al., 2014a, 2014b; Dyke et al., 2013; Kumar & Rose, 2010) and others (Tegos & Demetriadis, 2017; Tegos et al., 2015) have illustrated the viability of using computer agents to engage students in collaborative discourse (Michaels &…”
- Authors
- Kumar, R., & Rosé, C. P.
- Affiliations
- Carnegie Mellon University (US)
- ORCID
- Kumar, R
- Venue
- IEEE Transactions on Learning Technologies
- Published
- 2011-01
- Volume
- 4
- Issue
- 1
- Pages
- 21-34
- ISSN
- 1939-1382 (ISSN-L)
- OpenAlex
- W2100970477
- Cited by
- 160
- References
- 32
- Citations by year
- 2026: 1 · 2025: 18 · 2024: 13 · 2023: 11 · 2022: 5 · 2021: 14 · 2020: 12 · 2019: 9 · 2018: 12 · 2017: 3 · 2016: 9 · 2015: 10 · 2014: 13 · 2013: 19 · 2012: 8
- FWCI
- 10.16
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Learning Technologies (publishedVersion)
- Funders
- CA Technologies
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Keywords
- chatbots, cooperative learning, basilica architecture, software architecture, behavioral component, one-on-one tutoring
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
