What is AI Literacy? Competencies and Design Considerations
The DOI matches its Crossref record; 116 of the 117 references it cites were found in a registry or an index.
Abstract
Artificial intelligence (AI) is becoming increasingly integrated in user-facing technology, but public understanding of these technologies is often limited. There is a need for additional HCI research investigating a) what competencies users need in order to effectively interact with and critically evaluate AI and b) how to design learner-centered AI technologies that foster increased user understanding of AI. This paper takes a step towards realizing both of these goals by providing a concrete definition of AI literacy based on existing research. We synthesize a variety of interdisciplinary literature into a set of core competencies of AI literacy and suggest several design considerations to support AI developers and educators in creating learner-centered AI. These competencies and design considerations are organized in a conceptual framework thematically derived from the literature. This paper's contributions can be used to start a conversation about and guide future research on AI literacy within the HCI community.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Programming skills or computer science knowledge are not usually considered learning objectives of AI literacy, nor required qualifications (Long & Magerko, 2020).”
From Artificial intelligence literacy in higher and adult education: A scoping literature review (2022) · cites this paper as Long & Magerko, 2020
In the citing paper
“Accordingly, basic AI literacy education focuses on understanding AI and critically reflecting on AI outcomes.”
From Artificial intelligence literacy in higher and adult education: A scoping literature review (2022) · cites this paper as Long & Magerko, 2020
In the citing paper
“Seven studies (23%) also conducted (literature) reviews, either to define AI literacy and its core concepts (Long & Magerko, 2020;Ng et al., 2021a) or to compare existing AI literacy teaching programs in specific fields (e.g., health care) that have been published as research articles (Charow et al., 2021;Cetindamar et al., 2022).”
From Artificial intelligence literacy in higher and adult education: A scoping literature review (2022) · cites this paper as Long & Magerko, 2020
In the citing paper
“A preliminary attempt to structure the heterogeneous research landscape described above has revealed that there are two main types of publications.The first describes courses that are intended to teach AI to non-experts in different ways (Lin et al., 2021;Shih et al., 2021).Here, the focus is often on course design and evaluation.The second stream of publications is more theoretical and provides”
From Artificial intelligence literacy in higher and adult education: A scoping literature review (2022) · cites this paper as Long & Magerko, 2020
In the citing paper
“The definition developed by the two authors was cited and adopted in most of the studies listed in the review, and most authors used the definition or agreed with it at least in part.”
From Artificial intelligence literacy in higher and adult education: A scoping literature review (2022) · cites this paper as Long and Magerko (2020)
48 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Scoping studies: towards a methodological framework
Arksey, H., & O'Malley, L. (2005) · International Journal of Social Research Methodology · doi:10.1080/1364557032000119616 · Cited by 36,742 · cited 3×
“The goal of a scoping study is typically to identify all relevant literature “regardless of study design” as well as to identify gaps in the literature [9].”
BackgroundInfluentialArtificial intelligence: a modern approach
(1995) · Choice Reviews Online · doi:10.5860/choice.33-1577 · Cited by 21,974
(1980) · Medical Entomology and Zoology · Cited by 7,534
Social Media and Fake News in the 2016 Election
Allcott, H., & Gentzkow, M. (2017) · Journal of Economic Perspectives · doi:10.1257/jep.31.2.211 · Cited by 6,767 · cited 1×
“How Should AI Be Used? There are many ethical questions surrounding how AI should be used, and there has been growing concern surrounding issues such as AI’s effect on the job market [57], bias and discrimination in AI [7,24,99], and AI-related data privacy scandals [119].”
BackgroundIntelligence without representation
Brooks, R. A. (1991) · Artificial Intelligence · doi:10.1016/0004-3702(91)90053-m · Cited by 4,853
Meta-Analysis of Theory-of-Mind Development: The Truth about False Belief
Wellman, H. M., Cross, D., & Watson, J. (2001) · Child Development · doi:10.1111/1467-8624.00304 · Cited by 4,476 · cited 1×
“Most children do not develop theory of mind until they are 3-5 years old [139], which leads to additional complexities in understanding how children make sense of AI.”
Background(2018) · Cited by 3,510
The Singularity Is near: When Humans Transcend Biology
Mead, W. R., & Kurzweil, R. (2006) · Foreign Affairs · doi:10.2307/20031996 · Cited by 3,429
Resnick, M., Maloney, J., Monroy-Hernández, A., Rusk, N., Eastmond, E., Brennan, K., Millner, A., Rosenbaum, E., Silver, J., Silverman, B., et al. (2009) · Communications of the ACM · doi:10.1145/1592761.1592779 · Cited by 3,333
How the machine “thinks”: Understanding opacity in machine learning algorithms
Burrell, J. (2016) · Big Data & Society · doi:10.1177/2053951715622512 · Cited by 3,196 · cited 1×
“On the other hand—even with more transparent technologies—a lack of technical knowledge on the part of the user can lead to misconceptions [25].”
Background
Research works printed but not linked: 22
- ACM. 2017. Statement on Algorithmic Transparency and Accountability. Retrieved from https://www.acm.org/binaries/content/assets/publicpolicy/2017_usacm_statement_algorithms.pdf
- Safinah Ali, Blakeley H Payne, Randi Williams, Hae Won Park, and Cynthia Breazeal. 2019. Constructionism, Ethics, and Creativity: Developing Primary and Middle School Artificial Intelligence Education. In Proceedings of IJCAI 2019.
- Laura Beals and Marina Bers. 2006. Robotic technologies: when parents put their learning ahead of their child's. Journal of Interactive Learning Research 17, 4: 341--366.
- 10.5555/102753 · doi:10.5555/102753
- John D Bransford, A Brown, and R Cocking. 1999. How people learn: Mind, brain, experience, and school. Washington, DC: National Research Council.
- Daniel Smilkov and Shan Carter. Tensorflow - Neural Network Playground. Retrieved January 7, 2020 from http://playground.tensorflow.org
- 10.5555/335023 · doi:10.5555/335023
- Executive Office of the President. 2014. Big data: Seizing opportunities, preserving values. The White House Washington, DC.
- 10.5555/3298239.3298381 · doi:10.5555/3298239.3298381
- Robert B Fisher. 2001. AI and Cinema-Does artificial insanity rule? In Twelfth Irish Conference on Artificial Intelligence and Cognitive Science.
- Paulo Freire. 1972. Pedagogy of the oppressed. Herder and Herder, New York.
- Clint Heinze, Janet Haase, and Helen Higgins. 2010. An Action Research Report from a MultiYear Approach to Teaching Artificial Intelligence at the K6 Level. In 1st Symposium on Educational Advances in Artificial Intelligence.
- Ipsos. 2017. Revolution@Work: Fears and Expectations. Ipsos. Retrieved September 6, 2019 from https://www.ipsos.com/en/revolutionworkfears-and-expectations
- 10.5555/1214678 · doi:10.5555/1214678
- Arthur B Markman. 1999. Knowledge Representation. Lawrence Erlbaum Associates, Inc., Mahwah, NJ, USA.
- Maja J Mataric. 2004. Robotics education for all ages. In Proc. AAAI Spring Symposium on Accessible, Hands-on AI and Robotics Education.
- 10.5555/2361740 · doi:10.5555/2361740
- Simon Parsons and Elizabeth Sklar. 2004. Teaching AI using LEGO mindstorms. In AAAI Spring Symposium.
- Pega. 2018. What Consumers Really Think About AI: A Global Study. Pega. Retrieved September 6, 2019 from https://www.pega.com/ai-survey
- Weber Shandwick, Inc. 2016. AI-Ready or Not: Artificial Intelligence Here We Come! Weber Shandwick, Inc. Retrieved September 6, 2019 from https://www.webershandwick.com/news/ai-ready-ornot-artificial-intelligence-here-we-come/
- Mike Zyda and Sven Koenig. 2008. Teaching artificial intelligence playfully. In Proceedings of the AAAI-08 Education Colloquium, 90--95.
- eCraft2Learn - Digital Fabrication and Maker Movement in Education Making Computer supported Artefacts from Scratch. eCraft2Learn. Retrieved January 7, 2020 from https://project.ecraft2learn.eu/
Cited by
Conceptualizing AI literacy: An exploratory review
Ng, D. T. K., Leung, J. K. L., Chu, S. K. W., & Qiao, M. S. (2021) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2021.100041 · Cited by 2,205
Generative AI and ChatGPT: applications, challenges, and AI-human collaboration
Fui-Hoon Nah, F., Zheng, R., Cai, J., Siau, K., & Chen, L. (2023) · Journal of Information Technology Case and Application Research · doi:10.1080/15228053.2023.2233814 · Cited by 1,363
Wang, B., Rau, P.-L. P., & Yuan, T. (2023) · Behaviour & Information Technology · doi:10.1080/0144929x.2022.2072768 · Cited by 1,036
“Although Long and Magerko (2020) has summarised a set of core competencies in using AI technology, there neither exists a mature framework nor a practical tool for measuring it.”
BackgroundExplainable Artificial Intelligence in education
Khosravi, H., Shum, S. B., Chen, G., Conati, C., Tsai, Y.-S., Kay, J., Knight, S., Martinez-Maldonado, R., Sadiq, S., & Gašević, D. (2022) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2022.100074 · Cited by 863
Chiu, T. K. F. (2024) · Interactive Learning Environments · doi:10.1080/10494820.2023.2253861 · Cited by 852
Metadata
- Authors
- Long, D., & Magerko, B.
- Affiliations
- Georgia Institute of Technology (US)
- Venue
- Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2020-04-21
- Pages
- 1-16
- OpenAlex
- W3029022390
- Semantic Scholar
- 89ab36ae8630f6e4058c926816fe8d9a676c54e3
- Cited by
- 3,241
- References
- 117
- Citations by year
- 2026: 1428 · 2025: 867 · 2024: 499 · 2023: 215 · 2022: 146 · 2021: 76 · 2020: 9
- FWCI
- 84.56
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- Topics
- Social Sciences › Education › Digital literacy in education
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Keywords
- AI literacy, AI competencies, public understanding of AI, critical evaluation of AI, conceptual framework, artificial intelligence in education
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: What is AI Literacy? Competencies and Design Considerations. https://app.cochat.ai/papers/10.1145/3313831.3376727
- The paper
- Long, D., & Magerko, B. (2020). What is AI Literacy? Competencies and Design Considerations. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3313831.3376727
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.