CoChat

Towards Mutual Theory of Mind in Human-AI Interaction: How Language Reflects What Students Perceive About a Virtual Teaching Assistant

Wang, Qiaosi, Saha, Koustuv, Gregori, Eric, Joyner, David, Goel, Ashok · 2021 · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

The DOI matches its Crossref record; 98 of the 98 references it cites were found in a registry or an index.

Abstract

Building conversational agents that can conduct natural and prolonged conversations has been a major technical and design challenge, especially for community-facing conversational agents. We posit Mutual Theory of Mind as a theoretical framework to design for natural long-term human-AI interactions. From this perspective, we explore a community’s perception of a question-answering conversational agent through self-reported surveys and computational linguistic approach in the context of online education. We first examine long-term temporal changes in students’ perception of Jill Watson (JW), a virtual teaching assistant deployed in an online class discussion forum. We then explore the feasibility of inferring students’ perceptions of JW through linguistic features extracted from student-JW dialogues. We find that students’ perception of JW’s anthropomorphism and intelligence changed significantly over time. Regression analyses reveal that linguistic verbosity, readability, sentiment, diversity, and adaptability reflect student perception of JW. We discuss implications for building adaptive community-facing conversational agents as long-term companions and designing towards Mutual Theory of Mind in human-AI interaction.

Overview

Integrity signals

Registry

Crossref · 10.1145/3411764.3445645

Cites

98 of 98 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 98 references

Research works printed but not linked: 14

  1. Simon Baron-cohen. 1999. Evolution of a Theory of Mind?In The Descent of Mind: Psychological Perspectives on Hominid Evolution. Oxford University Press, 1–31.
  2. Cristian Danescu-Niculescu-Mizil Moritz Sudhof Dan Jurafsky Jure Leskovec and Christopher Potts. 2013. A computational approach to politeness with application to social factors. arXiv preprint arXiv:1306.6078(2013). · arXiv
  3. Bobbie Eicher, Kathryn Cunningham, Sydni Peterson Marissa Gonzales, and Ashok Goel. 2017. Toward mutual theory of mind as a foundation for co-creation. In International Conference on Computational Creativity, Co-Creation Workshop.
  4. Ashok K Goel and Lalith Polepeddi. 2016. Jill Watson: A virtual teaching assistant for online education. Technical Report. Georgia Institute of Technology.
  5. 10.4324/9781003320609-59 · DOI · Paper page
  6. Alvin I Goldman 2012. Theory of mind. The Oxford handbook of philosophy of cognitive science 1 (2012).
  7. Kokil Jaidka, Sharath Chandra Guntuku, Anneke Buffone, H Andrew Schwartz, and Lyle H Ungar. 2018. Facebook vs. Twitter: Cross-platform differences in self-disclosure and trait prediction. In Proceedings of the Twelfth International AAAI Conference on Web and Social Media. 141–150.
  8. 10.5555/1622637.1622649 · doi:10.5555/1622637.1622649
  9. Tomas Mikolov Ilya Sustskever Kai Chen Greg Corrado and Jeffrey Dean. 2013. Distributed Representations ofWords and Phrases and their Compositionality. In Neural Information Processing Systems (NIPS). 3111–3119.
  10. Clifford Nass and Youngme Moon. 2000. Machines and mindlessness: Social responses to computers.Journal of Social Issues 1, 56 (2000), 81–103.
  11. Christopher Peters. 2005. Foundations of an agent theory of mind model for conversation initiation in virtual environments. Virtual Social Agents(2005) 163. · DOI
  12. David Premack and Guy Woodruff. 1978. Does the chimpanzee have a theory of mind?Behavioral and brain sciences 1, 4 (1978), 515–526.
  13. Tina L Robbins and Angelo S DeNisi. 1994. A closer look at interpersonal affect as a distinct influence on cognitive processing in performance evaluations.Journal of Applied Psychology 79, 3 (1994), 341.
  14. Henry M Wellman. 1992. The child’s theory of mind.The MIT Press.

Cited by

See all 125

Metadata

Authors
Wang, Q., Saha, K., Gregori, E., Joyner, D., & Goel, A.
Affiliations
Georgia Institute of Technology (US)
Venue
Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems
Publisher
ACM
Published
2021-05-06
Pages
1-14
OpenAlex
W3160674997
Cited by
120
References
96
Citations by year
2026: 20 · 2025: 26 · 2024: 33 · 2023: 26 · 2022: 12 · 2021: 3
FWCI
31.56
Type
conference paper
Language
en
Open access
closed
Locations
CHI Conference on Human Factors in Computing Systems (publishedVersion)
Funders
Georgia Institute of Technology
Topics
  • Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
  • Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
  • Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
Keywords
human-AI interaction, virtual teaching assistants, chatbots, student perceptions, anthropomorphism, perceived intelligence, online learning, forum, linguistic features, sentiment analysis, readability, long-term interaction, adaptive agents

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Towards Mutual Theory of Mind in Human-AI Interaction: How Language Reflects What Students Perceive About a Virtual Teaching Assistant. https://app.cochat.ai/papers/10.1145/3411764.3445645
The paper
Wang, Q., Saha, K., Gregori, E., Joyner, D., & Goel, A. (2021). Towards Mutual Theory of Mind in Human-AI Interaction: How Language Reflects What Students Perceive About a Virtual Teaching Assistant. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3411764.3445645

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.