Why doesn't it work?: voice-driven interfaces and young children's communication repair strategies
The DOI matches its Crossref record; 32 of the 33 references it cites were found in a registry or an index.
Abstract
In this study, we examine the conversational repair strategies that preschoolers use to correct communication breakdowns with a voice-driven interface. We conducted a two-week deployment in the homes of 14 preschoolers of a tablet game that included a broken voice-driven mini-game. We collected 107 audio samples of these children's (unsuccessful) attempts to communicate with the mini-game. We found that children tried a common set of repair strategies, including repeating themselves and experimenting with the tone and pronunciation of their words. Children were persistent, rarely giving up on the interaction, asking for help, or showing frustration. When parents participated in the interaction, they moved through four phases of engagement: first making suggestions, then intervening, then making statements of resignation, and finally pronouncing that the interaction could not be repaired. Designers should anticipate that in this context, children will borrow behaviors from person-to-person communication, such as pivoting strategies to probe the source of failed communication and structuring communication into turn-taking attempts.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Most studies focused on single-individual interactions with SDS (N=32), while four studies explored interactions involving multiple people with SDSs [6, 14, 46, 60].”
From System and User Strategies to Repair Conversational Breakdowns of Spoken Dialogue Systems: A Scoping Review (2024) · cites this paper as [14]
In the citing paper
“A smaller number (N=5) explored multi-session interactions ranging from 1-5 weeks, predominantly in real-world environments with families, (e.g. [14, 46]).”
From System and User Strategies to Repair Conversational Breakdowns of Spoken Dialogue Systems: A Scoping Review (2024) · cites this paper as [14]
In the citing paper
“A few studies used embodied SDSs, employing animated systems [14, 78], avatars [35, 57, 72], and robots [22], mainly in the gaming domain, with one study each in the personal assistant and customer service domains.”
From System and User Strategies to Repair Conversational Breakdowns of Spoken Dialogue Systems: A Scoping Review (2024) · cites this paper as [14]
In the citing paper
“In the gaming domain, studies employed either computer speakers [35, 78], mobile devices [14]or robots [22] in their SDS designs.”
From System and User Strategies to Repair Conversational Breakdowns of Spoken Dialogue Systems: A Scoping Review (2024) · cites this paper as [14]
In the citing paper
“Finally, participants' ages varied considerably, from as young as three years old [14] to as old as 92 years old [57].”
From System and User Strategies to Repair Conversational Breakdowns of Spoken Dialogue Systems: A Scoping Review (2024) · cites this paper as [14]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
A simplest systematics for the organization of turn-taking for conversation
Sacks, H., Schegloff, E. A., & Jefferson, G. (1974) · Language · doi:10.2307/412243 · Cited by 11,350
Plans and Situated Actions: The Problem of Human-Machine Communication
Kantowitz, B., & Suchman, L. A. (1990) · The American Journal of Psychology · doi:10.2307/1423221 · Cited by 5,299
Machines and Mindlessness: Social Responses to Computers
Nass, C., & Moon, Y. (2000) · Journal of Social Issues · doi:10.1111/0022-4537.00153 · Cited by 4,022 · cited 1×
“Or future work might explore whether these are mindless social scripts [16]; we saw that children consistently responded to prompts from the interface, even after repeated failures.”
BackgroundPlans and Situated Actions: The Problem of Human Machine Communication.
Woolgar, S., & Suchman, L. A. (1989) · Contemporary Sociology · doi:10.2307/2073874 · Cited by 1,604
Technology probes: inspiring design for and with families
Hutchinson, H., Mackay, W., Westerlund, B., Bederson, B. B., Druin, A., Plaisant, C., Beaudouin-Lafon, M., Conversy, S., Evans, H., Hansen, H., et al. (2003) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/642611.642616 · Cited by 1,471
User-defined gestures for surface computing
Wobbrock, J. O., Morris, M. R., & Wilson, A. D. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518866 · Cited by 1,317 · cited 1×
“Future work might explore asking children to de-sign feedback and scaffolding that will help them repair conversations together with an interface (much like existing work in user-defined and child-defined gestures [22,31]).”
Background(2011) · Encyclopedia of Child Behavior and Development · doi:10.1007/978-0-387-79061-9_5269 · Cited by 602
"Alexa is my new BFF": Social Roles, User Satisfaction, and Personification of the Amazon Echo
Purington, A., Taft, J. G., Sannon, S., Bazarova, N. N., & Taylor, S. H. (2017) · Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/3027063.3053246 · Cited by 476 · cited 2×
“Though this remains an underexplored space, early work examining adoption habits has shown that these interfaces are used regularly by children [20].”
BackgroundClark, E. V. (2009) · Cambridge University Press eBooks · doi:10.1017/cbo9780511806698 · Cited by 460 · cited 3×
“…among people of all ages, they are particularly common in conversations involving children age 5 and under, who are still acquiring the motor planning skills they need for clear pronunciation, learning the linguistic irregularities of their first language, and expanding their early vocabulary [4].”
Kahn, P. H., Kanda, T., Ishiguro, H., Freier, N. G., Severson, R. L., Gill, B. T., Ruckert, J. H., & Shen, S. (2012) · Developmental Psychology · doi:10.1037/a0027033 · Cited by 425
The prosody of maternal speech: infant age and context related changes
Stern, D. N., Spieker, S., Barnett, R. K., & MacKain, K. (1983) · Journal of Child Language · doi:10.1017/s0305000900005092 · Cited by 393 · cited 1×
“Adults intuitively adjust their speech to accommodate children’s current level of language acquisition, meeting them where they are, regardless of whether they are just starting to babble, beginning to form two-word combinations, or speaking in full sentences [24].”
Background‘I beg your pardon?’: the preverbal negotiation of failed messages
Golinkoff, R. M. (1986) · Journal of Child Language · doi:10.1017/s0305000900006826 · Cited by 258 · cited 3×
“…978-1-4503-5152-2/18/06…$15.00 https://doi.org/10.1145/3202185.3202749 attempts are often initially unsuccessful, prior research has shown that children are creative and persistent in using a variety of repair strategies to ensure their listener ultimately un-derstands their intended meaning [8].”
BackgroundInfluentialFridin, M. (2014) · Computers & Education · doi:10.1016/j.compedu.2013.07.043 · Cited by 247 · cited 1×
“For example, Fridin showed that KindSAR, an interactive, social robot, was able to engage preschoolers in interactive story-telling and game-play experiences and could correctly respond to their suggestions [6].”
BackgroundThe New Coviewing: Designing for Learning through Joint Media Engagement
Stevens, R., & Takeuchi, L. M. (2011) · Cited by 207
Revision Behaviors in the Speech of Normal Children Developing Language
Gallagher, T. M. (1977) · Journal of Speech and Hearing Research · doi:10.1044/jshr.2002.303 · Cited by 150 · cited 2×
“Prior research has shown that children are persistent in their communicative attempts with people; in a lab study of children’s follow-up requests, children tried to repair the conversation more than 99% of the time when a re-searcher showed evidence of misunderstanding [7].”
BackgroundRasmussen, E. E., Shafer, A., Colwell, M. J., White, S., Punyanunt-Carter, N., Densley, R. L., & Wright, H. (2016) · Journal of Children and Media · doi:10.1080/17482798.2016.1203806 · Cited by 150 · cited 1×
“Past research suggests that preschoolers and school-age children enjoy engaging in joint experiences with parents more than solitary or parallel play [3], and pre-schoolers learn more from content when they discuss it with parents [21].”
Background"Siri, is this you?": Understanding young children's interactions with voice input systems
Lovato, S., & Piper, A. M. (2015) · Proceedings of the 14th International Conference on Interaction Design and Children · doi:10.1145/2771839.2771910 · Cited by 118 · cited 1×
“An analysis of YouTube videos depicting children us-ing commercially available voice assistants found that children age 7 and under often struggled to be understood or to make use of the list of search results that they received in response to their speech input [14].”
BackgroundWiemann, J. M., & Knapp, M. L. (1975) · Journal of Communication · doi:10.1111/j.1460-2466.1975.tb00582.x · Cited by 114 · cited 1×
“Communication researchers consider turn-taking to be the most salient feature of human conversation [30], and parents intuitively begin scaffolding this behavior in infants even before they can speak [4].”
BackgroundSteps toward graceful interaction in spoken and written man-machine communication
Hayes, P. J., & Reddy, D. R. (1983) · International Journal of Man-Machine Studies · doi:10.1016/s0020-7373(83)80049-2 · Cited by 105 · cited 2×
“A central goal of research in natural language processing is to allow for conversational repair on the part of both the human and system [9].”
BackgroundDevelopment of Conversational Repair Strategies in Response to Requests for Clarification
Brinton, B., Fujiki, M., Loeb, D. F., & Winkler, E. (1986) · Journal of Speech, Language, and Hearing Research · doi:10.1044/jshr.2901.75 · Cited by 97 · cited 1×
“As children grow, their repair strategies mature [2]; for example, an infant gesturing for milk who receives a cracker might cry or throw the offered cracker to indicate the failed communication, a toddler might correct the misunder-standing by saying “No!”
BackgroundReview of Semantic-Free Utterances in Social Human–Robot Interaction
Yilmazyildiz, S., Read, R., Belpeame, T., & Verhelst, W. (2016) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2015.1093856 · Cited by 91 · cited 1×
“And work with adults has shown that detecting and recovering from breakdowns in communication remains a key challenge for human-robot interaction and other voice-based scenarios in HCI [32].”
BackgroundChildren's Speech Revisions for a Familiar and an Unfamiliar Adult
Tomasello, M., Farrar, M. J., & Dines, J. (1984) · Journal of Speech Language and Hearing Research · doi:10.1044/jshr.2703.359 · Cited by 86 · cited 1×
“For example, Tomasello and colleagues showed that toddlers are more likely to use repetition to correct repairs in conversations with familiar adults but more likely to reformulate their statements in conversations with unfamiliar adults [28].”
BackgroundPlowman, L., Stevenson, O., McPake, J., Stephen, C., & Adey, C. (2011) · Journal of Computer Assisted Learning · doi:10.1111/j.1365-2729.2011.00432.x · Cited by 84 · cited 1×
“Parents model routine interactions with technology for preschoolers and support them in troubleshooting [19].”
BackgroundForrester, M. A., & Cherington, S. M. (2009) · First Language · doi:10.1177/0142723708094452 · Cited by 63
CSBS DP manual : communication and symbolic behavior scales : developmental profile
Wetherby, A. M., & Prizant, B. M. (2002) · Paul H. Brookes Pub. eBooks · Cited by 60
Plan & Play: Supporting Intentional Media Use in Early Childhood
Hiniker, A., Lee, B., Sobel, K., & Choe, E. K. (2017) · Proceedings of the 2017 Conference on Interaction Design and Children · doi:10.1145/3078072.3079752 · Cited by 52
Self-citationPrinciples of Interaction in Language Learning.
Moerk, E. L. (1972) · Merrill-palmer Quarterly · Cited by 46
Rust, K., Malu, M., Anthony, L., & Findlater, L. (2014) · ACM International Conference on Interaction Design and Children (IDC) · doi:10.1145/2593968.2610452 · Cited by 36 · cited 1×
“Future work might explore asking children to de-sign feedback and scaffolding that will help them repair conversations together with an interface (much like existing work in user-defined and child-defined gestures [22,31]).”
BackgroundEffects of a Listener Robot with Children in Storytelling
Tamura, Y., Kimoto, M., Shiomi, M., Iio, T., Shimohara, K., & Hagita, N. (2017) · International Conference on Human-Agent Interaction (HAI) · doi:10.1145/3125739.3125750 · Cited by 27 · cited 1×
“Tamura and colleagues found that children preferred storytelling activities when they shared them with a listening robot that could respond to their statements and ask questions [27].”
Background“Try something else!” — When users change their discursive behavior in human-robot interaction
Lohse, M., Rohlfing, K. J., Wrede, B., & Sagerer, G. (2008) · 2008 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2008.4543743 · Cited by 24 · cited 3×
“Though prior work has examined adults’ reactions to miscommunications with voice-driven interfaces (e.g., [13]), our probe gave us access to the naturalistic re-pairs that much younger users employ.”
BackgroundAndrist, S., Leite, I., & Lehman, J. F. (2013) · ACM International Conference on Interaction Design and Children (IDC) · doi:10.1145/2485760.2485800 · Cited by 18 · cited 1×
“Andrist and colleagues demonstrated the potential for voice-driven interfaces to structure turn-taking in conversations among groups of children [1], which other work has shown is one of the most difficult conversational skills for children under five to master [23].”
BackgroundStorytelling by a kindergarten social assistive robot
FridinMarina (2014) · Computers in Education · doi:10.5555/2753872.2753893 · Cited by 9
Research works printed but not linked: 4
- Karen Petty . Developmental milestones of Young Children , Revised Edition. Retrieved April 2, 2018 from https://www.redleafpress.org/Developmental-Milestones-of-Young-Children-Revised-Edition-P1411.aspx Karen Petty. Developmental milestones of Young Children, Revised Edition. Retrieved April 2, 2018 from https://www.redleafpress.org/Developmental-Milestones-of-Young-Children-Revised-Edition-P1411.aspx
- 10.1353/lan.1974.0010 · DOI · Paper page
- Amy M Wetherby and Barry M Prizant . 1993. Communication and symbolic behavior scales: Manual . Riverside Publishing . Amy M Wetherby and Barry M Prizant. 1993. Communication and symbolic behavior scales: Manual. Riverside Publishing.
- Amazon.com : The Magic Door: Alexa Skills . Retrieved January 16, 2018 from https://www.amazon.com/The-Magic-Door-LLC/dp/B01BMUU6JQ Amazon.com: The Magic Door: Alexa Skills. Retrieved January 16, 2018 from https://www.amazon.com/The-Magic-Door-LLC/dp/B01BMUU6JQ
Cited by
Music, Search, and IoT: How People (Really) Use Voice Assistants
Ammari, T., Kaye, J., Tsai, J. Y., & Bentley, F. (2019) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3311956 · Cited by 356
Communication Breakdowns Between Families and Alexa
Beneteau, E., Richards, O. K., Zhang, M., Kientz, J. A., Yip, J., & Hiniker, A. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300473 · Cited by 313
“Yarosh and colleagues found that children struggled to formulate queries to a voice interface [43] and Cheng and colleagues define a taxonomy of communication repair strategies that preschoolers use when talking to a voice - driven game [9].”
BackgroundSelf-citationXu, Y., Wang, D., Collins, P., Lee, H., & Warschauer, M. (2021) · Computers & Education · doi:10.1016/j.compedu.2020.104059 · Cited by 175
“This pattern was also identified in children ’ s communication with CAs: Young children adjusted their speech style if they perceived CAs as encountering difficulties in understanding them (Beneteau et al., 2019; Cheng, Yen, Chen, Chen, & Hiniker, 2018).”
BackgroundHe Is Just Like Me: A Study of the Long-Term Use of Smart Speakers by Parents and Children
Garg, R., & Sengupta, S. (2020) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3381002 · Cited by 138
Parenting with Alexa: Exploring the Introduction of Smart Speakers on Family Dynamics
Beneteau, E., Boone, A., Wu, Y., Kientz, J. A., Yip, J., & Hiniker, A. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376344 · Cited by 140
“studies which explore children’s interactions with a variety of voice interfaces [11,16,29,41,48], we are interested in the parent-child dynamics involved with voice-interfaces, and the impacts on child behaviors in the home.”
BackgroundSelf-citation
Metadata
- Authors
- Cheng, Y., Yen, K., Chen, Y., Chen, S., & Hiniker, A.
- Affiliations
- University of Washington (US)
- Venue
- Proceedings of the 17th ACM Conference on Interaction Design and Children
- Publisher
- ACM
- Published
- 2018-06-19
- Pages
- 337-348
- OpenAlex
- W2808639209
- Cited by
- 69
- References
- 33
- Citations by year
- 2026: 6 · 2025: 4 · 2024: 12 · 2023: 6 · 2022: 8 · 2021: 13 · 2020: 13 · 2019: 7
- FWCI
- 3.35
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM International Conference on Interaction Design and Children (IDC) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Keywords
- conversational repair, preschool children, communication breakdown, parent-child interaction, turn-taking, persistence, tablet games, human-computer interaction with children
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.