Using Explainability to Help Children UnderstandGender Bias in AI
Open accessThe DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Abstract
Machine learning systems have become ubiquitous into our society. This has raised concerns about the potential discrimination that these systems might exert due to unconscious bias present in the data, for example regarding gender and race. Whilst this issue has been proposed as an essential subject to be included in the new AI curricula for schools, research has shown that it is a difficult topic to grasp by students. We propose an educational platform tailored to raise the awareness of gender bias in supervised learning, with the novelty of using Grad-CAM as an explainability technique that enables the classifier to visually explain its own predictions. Our study demonstrates that preadolescents (N=78, age 10-14) significantly improve their understanding of the concept of bias in terms of gender discrimination, increasing their ability to recognize biased predictions when they interact with the interpretable model, highlighting its suitability for educational programs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333 · cited 1×
“ageNet [13] and Microsoft COCO [29], contain biases regarding”
BackgroundGrad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-019-01228-7 · Cited by 6,909
“Why Should I Trust You?”: Explaining the Predictions of Any Classifier
Ribeiro, M., Singh, S., & Guestrin, C. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Demonstrations · doi:10.18653/v1/n16-3020 · Cited by 6,682
What is AI Literacy? Competencies and Design Considerations
Long, D., & Magerko, B. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376727 · Cited by 3,241 · cited 5×
“Starting from the claim in [30] that explainability techniques can have a positive impact in the education of AI to the general public, we present the first study evaluating its effectiveness among preadolescents.”
BackgroundInfluentialThe role of trust in automation reliance
Dzindolet, M. T., Peterson, S. A., Pomranky, R. A., Pierce, L. G., & Beck, H. P. (2003) · International Journal of Human-Computer Studies · doi:10.1016/s1071-5819(03)00038-7 · Cited by 1,276 · cited 1×
“As a result, many recent HCI studies have included an interpretable model, for example focusing on the perception of trust, fairness and intelligibility of intelligent systems that are able to present an explanation of their own predictions [14, 17, 25, 28, 34].”
BackgroundEnvisioning AI for K-12: What Should Every Child Know about AI?
Touretzky, D., Gardner-McCune, C., Martin, F., & Seehorn, D. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33019795 · Cited by 918
Men Also Like Shopping: Reducing Gender Bias Amplification using Corpus-level Constraints
Zhao, J., Wang, T., Yatskar, M., Ordonez, V., & Chang, K.-W. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1323 · Cited by 829
AI can be sexist and racist — it’s time to make it fair
Zou, J., & Schiebinger, L. (2018) · Nature · doi:10.1038/d41586-018-05707-8 · Cited by 765 · cited 2×
“Unconscious bias in machine learning systems is commonly derived from the use of a biased dataset to train the models [50].”
BackgroundPrinciples of Explanatory Debugging to Personalize Interactive Machine Learning
Kulesza, T., Burnett, M., Wong, W.-K., & Stumpf, S. (2015) · Proceedings of the 20th International Conference on Intelligent User Interfaces · doi:10.1145/2678025.2701399 · Cited by 576
Why and why not explanations improve the intelligibility of context-aware intelligent systems
Lim, B. Y., Dey, A. K., & Avrahami, D. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1519023 · Cited by 552 · cited 1×
“As a result, many recent HCI studies have included an interpretable model, for example focusing on the perception of trust, fairness and intelligibility of intelligent systems that are able to present an explanation of their own predictions [14, 17, 25, 28, 34].”
Background
Cited by
Artificial intelligence (AI) learning tools in K-12 education: A scoping review
Yim, I. H. Y., & Su, J. (2024) · Journal of Computers in Education · doi:10.1007/s40692-023-00304-9 · Cited by 249
Pedagogical Design of K-12 Artificial Intelligence Education: A Systematic Review
Yue, M., Jong, M. S.-Y., & Dai, Y. (2022) · Sustainability · doi:10.3390/su142315620 · Cited by 176
Su, J., & Yang, W. (2024) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12867 · Cited by 116
Winkle, K., McMillan, D., Arnelid, M., Harrison, K., Balaam, M., Johnson, E., & Leite, I. (2023) · Proceedings of the 2023 ACM/IEEE International Conference on Human-Robot Interaction · doi:10.1145/3568162.3576973 · Cited by 111
“…of robotics means that works concerning e.g. biases in artificial intelligence (AI) [11, 15, 59] and educating the general public about these biases [67, 92] also provide insightful examples of (what we would call) feminist approaches to technology that HRI researchers might look to draw upon.”
BackgroundSelf-citationBertrand, A., Viard, T., Belloum, R., Eagan, J. R., & Maxwell, W. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581314 · Cited by 71
Metadata
- Authors
- Melsión, G. I., Torre, I., Vidal, E., & Leite, I.
- Venue
- Interaction Design and Children
- Publisher
- ACM
- Published
- 2021-06-24
- Pages
- 87-99
- OpenAlex
- W3173188376
- Cited by
- 65
- References
- 20
- FWCI
- 4.20
- Type
- conference paper
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Using Explainability to Help Children UnderstandGender Bias in AI. https://app.cochat.ai/papers/10.1145/3459990.3460719
- The paper
- Melsión, G. I., Torre, I., Vidal, E., & Leite, I. (2021). Using Explainability to Help Children UnderstandGender Bias in AI. Interaction Design and Children. https://doi.org/10.1145/3459990.3460719
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.