How do children’s perceptions of machine intelligence change when training and coding smart programs?
The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Abstract
Children are increasingly surrounded by AI technologies but can overestimate smart devices’ abilities due to their lack of transparency. Drawing on the sense-making theory, this study explores how children come to see machine intelligence after training custom machine learning models and creating smart programs that use them. Through a 4-week observational study in after-school programs with 52 children (7 to 12 years old), we found that children engage in the scientific method while training, coding and testing their smart programs. We also found that children became more skeptical of certain abilities of smart devices as they shifted their attribution of agency from the devices to the people who program them. These changes in perception happened both through individual interactions with agents and prompted debates with peers. Based on these results, we conclude with discussions on strategies for promoting children’s sense-making practices and sense of agency in the age of machine learning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Qualitative evaluation and research methods
Ellis, D. (1990) · International Journal of Information Management · doi:10.1016/0268-4012(90)90041-p · Cited by 17,943
Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)
Adadi, A., & Berrada, M. (2018) · IEEE Access · doi:10.1109/access.2018.2870052 · Cited by 6,294
Machines and Mindlessness: Social Responses to Computers
Nass, C., & Moon, Y. (2000) · Journal of Social Issues · doi:10.1111/0022-4537.00153 · Cited by 4,022
What is AI Literacy? Competencies and Design Considerations
Long, D., & Magerko, B. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376727 · Cited by 3,241 · cited 2×
“Only recently have these modern efforts at CS literacy begun to explore AI literacy [41].”
BackgroundBartneck, C., Kulić, D., Croft, E., & Zoghbi, S. (2009) · International Journal of Social Robotics · doi:10.1007/s12369-008-0001-3 · Cited by 3,193 · cited 1×
“To answer RQ2 about children’s shift in perceptions, we used an AI Perception questionnaire adapted from Bartneck et al. [6].”
MethodPersuasive technology: using computers to change what we think and do
Fogg, B. J. (2002) · Ubiquity · doi:10.1145/764008.763957 · Cited by 1,554 · cited 1×
“…agents and tend to overestimate their abilities, either because children do not understand how these agents work, or because artifacts like toys and phones can talk, express emotions, and engage with youth in ways other humans would: with persuasive and charismatic modes of engagement [24, 55, 83].”
BackgroundCounterfactual explanations without opening the black box: automated decisions and the GDPR
Wachter, S., Mittelstadt, B., & Russell, C. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.3063289 · Cited by 1,061
Envisioning AI for K-12: What Should Every Child Know about AI?
Touretzky, D., Gardner-McCune, C., Martin, F., & Seehorn, D. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33019795 · Cited by 918
Voice Interfaces in Everyday Life
Porcheron, M., Fischer, J. E., Reeves, S., & Sharples, S. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174214 · Cited by 717 · cited 1×
“Other studies have shown that children often misunderstand agents and tend to overestimate their abilities, either because children do not understand how these agents work, or because artifacts like toys and phones can talk, express emotions, and engage with youth in ways other humans would: with persuasive and charis…”
BackgroundThe state of the art in end-user software engineering
Ko, A. J., Abraham, R., Beckwith, L., Blackwell, A., Burnett, M., Erwig, M., Scaffidi, C., Lawrance, J., Lieberman, H., Myers, B., et al. (2011) · ACM Computing Surveys · doi:10.1145/1922649.1922658 · Cited by 633
Self-citation"Hey Google is it OK if I eat you?": Initial Explorations in Child-Agent Interaction
Druga, S., Williams, R., Breazeal, C., & Resnick, M. (2017) · Proceedings of the 2017 Conference on Interaction Design and Children · doi:10.1145/3078072.3084330 · Cited by 330 · cited 4×
“Some studies have even shown that embodied agents can exert peer pressure over children [76] and that children can overestimate the intelligence of embodied agents [21].”
BackgroundInfluentialSelf-citation"Hey Alexa, What's Up?": A Mixed-Methods Studies of In-Home Conversational Agent Usage
Sciuto, A., Saini, A., Forlizzi, J., & Hong, J. I. (2018) · Proceedings of the 2018 Designing Interactive Systems Conference · doi:10.1145/3196709.3196772 · Cited by 327 · cited 1×
“This approach has strong precedence in recent work on computing education with children, such as children’s computer programming in low-vision populations [70], supporting children as data scientists through Scratch programming [15], children’s development of spatial reasoning through programming [27], and the family…”
BackgroundInclusive AI literacy for kids around the world
Druga, S., Vu, S. T., Likhith, E., & Qiu, T. (2019) · Proceedings of FabLearn 2019 · doi:10.1145/3311890.3311904 · Cited by 318
Self-citationThe effect of presence on human-robot interaction
Bainbridge, W. A., Hart, J., Kim, E. S., & Scassellati, B. (2008) · RO-MAN 2008 - The 17th IEEE International Symposium on Robot and Human Interactive Communication · doi:10.1109/roman.2008.4600749 · Cited by 300 · cited 1×
“The more life-like an agent is in terms of embodiment (the physical form of the AI), physical presence, social presence, and appearance, the more persuasive it can become [4, 59, 65].”
BackgroundUpdates in Human-AI Teams: Understanding and Addressing the Performance/Compatibility Tradeoff
Bansal, G., Nushi, B., Kamar, E., Weld, D. S., Lasecki, W. S., & Horvitz, E. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33012429 · Cited by 284 · cited 2×
“Other studies with adults has explored methods of bridging these comprehension gaps by helping people develop more robust mental models about AI (e.g., [5, 38, 61]).”
BackgroundResultTell me more?: the effects of mental model soundness on personalizing an intelligent agent
Kulesza, T., Stumpf, S., Burnett, M., & Kwan, I. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2207678 · Cited by 225 · cited 2×
“Other studies with adults has explored methods of bridging these comprehension gaps by helping people develop more robust mental models about AI (e.g., [5, 38, 61]).”
BackgroundResultParenting with Alexa: Exploring the Introduction of Smart Speakers on Family Dynamics
Beneteau, E., Boone, A., Wu, Y., Kientz, J. A., Yip, J., & Hiniker, A. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376344 · Cited by 140 · cited 1×
“Parents are likely equally uninformed; some parents are explicitly using smart devices as parenting tools for setting limits or managing kids’ schedules [8, 14, 82].”
BackgroundPersonifying programming tool feedback improves novice programmers' learning
Lee, M. J., & Ko, A. J. (2011) · Proceedings of the seventh international workshop on Computing education research · doi:10.1145/2016911.2016934 · Cited by 125
Self-citationPersuasive computing: Feeling peer pressure from multiple computer agents
Xu, K., & Lombard, M. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2017.04.043 · Cited by 76 · cited 1×
“Other studies have shown that children often misunderstand agents and tend to overestimate their abilities, either because children do not understand how these agents work, or because artifacts like toys and phones can talk, express emotions, and engage with youth in ways other humans would: with persuasive and charis…”
BackgroundRegister, Y., & Ko, A. J. (2020) · Proceedings of the 2020 ACM Conference on International Computing Education Research · doi:10.1145/3372782.3406252 · Cited by 49 · cited 1×
“…prior research on data literacy for children shows the importance of linking statistical inference to personal data [16, 43], and is based on the idea that children may have an easier time understanding how data is used in AI when they are familiar with its origins and meaning [13, 30, 37, 57].”
BackgroundSelf-citationChi, Y., Jeng, W., Acker, A., & Bowler, L. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-78105-1_49 · Cited by 24
Cited by
Artificial Intelligence (AI) Literacy in Early Childhood Education: The Challenges and Opportunities
Su, J., Ng, D. T. K., & Chu, S. K. W. (2023) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2023.100124 · Cited by 489
Pinski, M., & Benlian, A. (2024) · Computers in Human Behavior: Artificial Humans · doi:10.1016/j.chbah.2024.100062 · Cited by 243
Pedagogical Design of K-12 Artificial Intelligence Education: A Systematic Review
Yue, M., Jong, M. S.-Y., & Dai, Y. (2022) · Sustainability · doi:10.3390/su142315620 · Cited by 176
Family as a Third Space for AI Literacies: How do children and parents learn about AI together?
Druga, S., Christoph, F. L., & Ko, A. J. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3502031 · Cited by 130
“However, more recent studies have shown that children change their perception of AI abilities after engaging in AI programming and training activities [35].”
BackgroundResultInfluentialSelf-citationAI Literacy in K-12 and Higher Education in the Wake of Generative AI: An Integrative Review
Gu, X., & Ericson, B. J. (2025) · arXiv · doi:10.48550/arxiv.2503.00079 · Cited by 73
Metadata
- Authors
- Druga, S., & Ko, A. J.
- Venue
- Interaction Design and Children
- Publisher
- ACM
- Published
- 2021-06-24
- Pages
- 49-61
- OpenAlex
- W3176062377
- Cited by
- 108
- References
- 21
- FWCI
- 18.77
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.