Cited by 40Social Robot Interaction and HRIIntelligent Tutoring Systems and Adaptive LearningChild Development and Digital Technology

“Elinor’s Talking to Me!”:Integrating Conversational AI into Children’s Narrative Science Programming

Open access
Xu, Ying, Vigil, Valery, Bustamante, Andres S., Warschauer, Mark·2022·CHI Conference on Human Factors in Computing Systems

Abstract

Video programs are important, accessible educational resources for young children, especially those from an under-resourced backgrounds. These programs’ potential can be amplified if children are allowed to socially interact with media characters during their video watching. This paper presents the design and empirical investigation of interactive science-focused videos in which the main character, powered by a conversational agent, engaged in contingent conversation with children by asking children questions and providing responsive feedback. We found that children actively interacted with the media character in the conversational videos and their parents spontaneously provided support in the process. We also found that the children who watched the conversational video performed better in the immediate, episode-specific science assessment compared to their peers who watched the broadcast, non-interactive version of the same episode. Several design implications are discussed for using conversational technologies to better support child active learning and parent involvement in video watching.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3491102.3502050

Cites

62 of 62 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 25

  1. Cynthia Breazeal, Paul L Harris, David DeSteno, Jacqueline M Kory Westlund, Leah Dickens, and Sooyeon Jeong. 2016. Young children treat robots as informants. Topics in cognitive science 8, 2 (2016), 481-491.
  2. Sandra L Calvert, Marisa M Putnam, Naomi R Aguiar, Rebecca M Ryan, Char- lotte A Wright, Yi Hui Angella Liu, and Evan Barba. 2020. Young children's mathematical learning from intelligent characters. Child development 91, 5 (2020), 1491-1508.
  3. Katja F Cantone. 2007. Code-switching in bilingual children. Vol. 296. Springer.
  4. Justine Cassell and Kimiko Ryokai. 2001. Making space for voice: Technologies to support children's fantasy and storytelling. Personal and ubiquitous computing 5, 3 (2001), 169-190.
  5. Kiran Egan. 1993. Narrative and learning: A voyage of implications. Linguistics and education 5, 2 (1993), 119-126.
  6. Stacy B Ehrlich, Susan C Levine, and Susan Goldin-Meadow. 2006. The importance of gesture in children's spatial reasoning. Developmental psychology 42, 6 (2006), 1259.
  7. Sílvia Fernandes, Jorge Abreu, Pedro Almeida, and Rita Santos. 2018. A Re- view of Voice User Interfaces for Interactive TV. In Iberoamerican Conference on Applications and Usability of Interactive TV. Springer, 115-128.
  8. Natalie Anne Freed. 2012. " This is the fufy robot that only speaks french": language use between preschoolers, their families, and a social robot while sharing virtual toys. Ph.D. Dissertation. Massachusetts Institute of Technology.
  9. Arthur C Graesser, Kurt VanLehn, Carolyn P Rosé, Pamela W Jordan, and Derek Harter. 2001. Intelligent tutoring systems with conversational dialogue. AI magazine 22, 4 (2001), 39-39.
  10. Sebastian Hobert and Raphael Meyer von Wolf. 2019. Say hello to your new automated tutor-a structured literature review on pedagogical conversational agents. (2019).
  11. Pirita Ihamäki and Katriina Heljakka. 2018. The internet of toys, connected- ness and character-based play in early education. In Proceedings of the Future Technologies Conference. Springer, 1079-1096.
  12. Connie A Korpan, Gay L Bisanz, Jefrey Bisanz, Conrad Boehme, and Mervyn A Lynch. 1997. What did you learn outside of school today? Using structured interviews to document home and community activities related to science and technology. Science Education 81, 6 (1997), 651-662.
  13. Marina Krcmar and Drew P Cingel. 2019. Do young children really learn best from the use of direct address in children's television? Media Psychology 22, 1 (2019), 152-171.
  14. Rachel E Meirson. 2020. Choose Your Own Adventure: The Future of Interactive Media. Ph.D. Dissertation. Drexel University.
  15. Roxana Moreno and Richard Mayer. 2007. Interactive multimodal learning envi- ronments. Educational psychology review 19, 3 (2007), 309-326.
  16. Sarah Roseberry, Kathy Hirsh-Pasek, and Roberta M Golinkof. 2014. Skype me! Socially contingent interactions help toddlers learn language. Child development 85, 3 (2014), 956-970.
  17. Preeti G Samudra, Rachel M Flynn, and Kevin M Wong. 2019. Coviewing Ed- ucational Media: Does Coviewing Help Low-Income Preschoolers Learn Au- ditory and Audiovisual Vocabulary Associations? AERA Open 5, 2 (2019), 2332858419853238.
  18. Masahiro Shiomi, Takayuki Kanda, Iris Howley, Kotaro Hayashi, and Norihiro Hagita. 2015. Can a social robot stimulate science curiosity in classrooms? International Journal of Social Robotics 7, 5 (2015), 641-652.
  19. Ian Smith, Fiona Stewart, and Phil Turner. 2004. Winky Dink and you: Deter- mining patterns of narrative for interactive television design. In Proceedings of the second European interactive television conference: Enhancing the experience, Brighton. Citeseer, 1-10.
  20. Catherine Snow. 1983. Literacy and language: Relationships during the preschool years. Harvard educational review 53, 2 (1983), 165-189.
  21. Gabrielle A Strouse. 2011. Dialogic video: infuence of dialogic reading techniques on preschoolers' learning from video stories. Ph.D. Dissertation.
  22. Gabrielle A Strouse, Katherine O'Doherty, and Georgene L Troseth. 2013. Efec- tive coviewing: Preschoolers' learning from video after a dialogic questioning intervention. Developmental psychology 49, 12 (2013), 2368.
  23. Georgene L Troseth, Megan M Saylor, and Allison H Archer. 2006. Young chil- dren's use of video as a source of socially relevant information. Child development 77, 3 (2006), 786-799.
  24. Sarah Vaala, Anna Ly, and Michael H Levine. 2015. Getting a Read on the App Stores: A Market Scan and Analysis of Children's Literacy Apps. Full Report.. In Joan Ganz Cooney Center at Sesame Workshop. ERIC.
  25. Radu-Daniel Vatavu, Pejman Saeghe, Teresa Chambel, Vinoba Vinayagamoorthy, and Marian F Ursu. 2020. Conceptualizing Augmented Reality Television for the Living Room. In ACM International Conference on Interactive Media Experiences. 1-12.

Cited by

Sorted by citations

Authors
Xu, Y., Vigil, V., Bustamante, A. S., & Warschauer, M.
Affiliations
University of California, Irvine (US)
Venue
CHI Conference on Human Factors in Computing Systems
Publisher
ACM
Published
2022-04-29
Pages
1-16
OpenAlex
W4225006040
Cited by
40
References
62
Citations by year
2026: 8 · 2025: 12 · 2024: 11 · 2023: 7 · 2022: 2
FWCI
15.41
Type
conference paper
Language
en
Open access
Locations
CHI Conference on Human Factors in Computing Systems (publishedVersion)
Funders
NSF (National Science Foundation) (#1906321 and #2115382)
Topics
  • Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
  • Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
  • Social Sciences › Education › Child Development and Digital Technology
Keywords
chatbots, children's science learning, interactive educational videos, media characters, parental involvement, active learning, science assessment

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review