What is AI Literacy? Competencies and Design Considerations
The DOI matches its Crossref record; 116 of the 117 references it cites were found in a registry or an index.
Abstract
Artificial intelligence (AI) is becoming increasingly integrated in user-facing technology, but public understanding of these technologies is often limited. There is a need for additional HCI research investigating a) what competencies users need in order to effectively interact with and critically evaluate AI and b) how to design learner-centered AI technologies that foster increased user understanding of AI. This paper takes a step towards realizing both of these goals by providing a concrete definition of AI literacy based on existing research. We synthesize a variety of interdisciplinary literature into a set of core competencies of AI literacy and suggest several design considerations to support AI developers and educators in creating learner-centered AI. These competencies and design considerations are organized in a conceptual framework thematically derived from the literature. This paper's contributions can be used to start a conversation about and guide future research on AI literacy within the HCI community.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Programming skills or computer science knowledge are not usually considered learning objectives of AI literacy, nor required qualifications (Long & Magerko, 2020).”
From Artificial intelligence literacy in higher and adult education: A scoping literature review (2022) · cites this paper as Long & Magerko, 2020
In the citing paper
“Accordingly, basic AI literacy education focuses on understanding AI and critically reflecting on AI outcomes.”
From Artificial intelligence literacy in higher and adult education: A scoping literature review (2022) · cites this paper as Long & Magerko, 2020
In the citing paper
“Seven studies (23%) also conducted (literature) reviews, either to define AI literacy and its core concepts (Long & Magerko, 2020;Ng et al., 2021a) or to compare existing AI literacy teaching programs in specific fields (e.g., health care) that have been published as research articles (Charow et al., 2021;Cetindamar et al., 2022).”
From Artificial intelligence literacy in higher and adult education: A scoping literature review (2022) · cites this paper as Long & Magerko, 2020
In the citing paper
“A preliminary attempt to structure the heterogeneous research landscape described above has revealed that there are two main types of publications.The first describes courses that are intended to teach AI to non-experts in different ways (Lin et al., 2021;Shih et al., 2021).Here, the focus is often on course design and evaluation.The second stream of publications is more theoretical and provides”
From Artificial intelligence literacy in higher and adult education: A scoping literature review (2022) · cites this paper as Long & Magerko, 2020
In the citing paper
“The definition developed by the two authors was cited and adopted in most of the studies listed in the review, and most authors used the definition or agreed with it at least in part.”
From Artificial intelligence literacy in higher and adult education: A scoping literature review (2022) · cites this paper as Long and Magerko (2020)
49 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Scoping studies: towards a methodological framework
Arksey, H., & O'Malley, L. (2005) · International Journal of Social Research Methodology · doi:10.1080/1364557032000119616 · Cited by 36,742 · cited 3×
“The goal of a scoping study is typically to identify all relevant literature “regardless of study design” as well as to identify gaps in the literature [9].”
BackgroundInfluentialArtificial intelligence: a modern approach
(1995) · Choice Reviews Online · doi:10.5860/choice.33-1577 · Cited by 21,974
(1980) · Medical Entomology and Zoology · Cited by 7,534
Social Media and Fake News in the 2016 Election
Allcott, H., & Gentzkow, M. (2017) · Journal of Economic Perspectives · doi:10.1257/jep.31.2.211 · Cited by 6,767 · cited 1×
“How Should AI Be Used? There are many ethical questions surrounding how AI should be used, and there has been growing concern surrounding issues such as AI’s effect on the job market [57], bias and discrimination in AI [7,24,99], and AI-related data privacy scandals [119].”
BackgroundIntelligence without representation
Brooks, R. A. (1991) · Artificial Intelligence · doi:10.1016/0004-3702(91)90053-m · Cited by 4,853 · cited 3×
“He suggests instead developing “completely autonomous mobile agents” that are capable of perceiving, acting, and pursuing a set of goals in a dynamic environment [21].”
BackgroundInfluentialMeta-Analysis of Theory-of-Mind Development: The Truth about False Belief
Wellman, H. M., Cross, D., & Watson, J. (2001) · Child Development · doi:10.1111/1467-8624.00304 · Cited by 4,476 · cited 1×
“Most children do not develop theory of mind until they are 3-5 years old [139], which leads to additional complexities in understanding how children make sense of AI.”
Background(2018) · Cited by 3,510
The Singularity Is near: When Humans Transcend Biology
Mead, W. R., & Kurzweil, R. (2006) · Foreign Affairs · doi:10.2307/20031996 · Cited by 3,429
Resnick, M., Maloney, J., Monroy-Hernández, A., Rusk, N., Eastmond, E., Brennan, K., Millner, A., Rosenbaum, E., Silver, J., Silverman, B., et al. (2009) · Communications of the ACM · doi:10.1145/1592761.1592779 · Cited by 3,333
How the machine “thinks”: Understanding opacity in machine learning algorithms
Burrell, J. (2016) · Big Data & Society · doi:10.1177/2053951715622512 · Cited by 3,196 · cited 1×
“On the other hand—even with more transparent technologies—a lack of technical knowledge on the part of the user can lead to misconceptions [25].”
Background
Research works printed but not linked: 22
- ACM. 2017. Statement on Algorithmic Transparency and Accountability. Retrieved from https://www.acm.org/binaries/content/assets/publicpolicy/2017_usacm_statement_algorithms.pdf
- Safinah Ali, Blakeley H Payne, Randi Williams, Hae Won Park, and Cynthia Breazeal. 2019. Constructionism, Ethics, and Creativity: Developing Primary and Middle School Artificial Intelligence Education. In Proceedings of IJCAI 2019.
- Laura Beals and Marina Bers. 2006. Robotic technologies: when parents put their learning ahead of their child's. Journal of Interactive Learning Research 17, 4: 341--366.
- 10.5555/102753 · doi:10.5555/102753
- John D Bransford, A Brown, and R Cocking. 1999. How people learn: Mind, brain, experience, and school. Washington, DC: National Research Council.
- Daniel Smilkov and Shan Carter. Tensorflow - Neural Network Playground. Retrieved January 7, 2020 from http://playground.tensorflow.org
- 10.5555/335023 · doi:10.5555/335023
- Executive Office of the President. 2014. Big data: Seizing opportunities, preserving values. The White House Washington, DC.
- 10.5555/3298239.3298381 · doi:10.5555/3298239.3298381
- Robert B Fisher. 2001. AI and Cinema-Does artificial insanity rule? In Twelfth Irish Conference on Artificial Intelligence and Cognitive Science.
- Paulo Freire. 1972. Pedagogy of the oppressed. Herder and Herder, New York.
- Clint Heinze, Janet Haase, and Helen Higgins. 2010. An Action Research Report from a MultiYear Approach to Teaching Artificial Intelligence at the K6 Level. In 1st Symposium on Educational Advances in Artificial Intelligence.
- Ipsos. 2017. Revolution@Work: Fears and Expectations. Ipsos. Retrieved September 6, 2019 from https://www.ipsos.com/en/revolutionworkfears-and-expectations
- 10.5555/1214678 · doi:10.5555/1214678
- Arthur B Markman. 1999. Knowledge Representation. Lawrence Erlbaum Associates, Inc., Mahwah, NJ, USA.
- Maja J Mataric. 2004. Robotics education for all ages. In Proc. AAAI Spring Symposium on Accessible, Hands-on AI and Robotics Education.
- 10.5555/2361740 · doi:10.5555/2361740
- Simon Parsons and Elizabeth Sklar. 2004. Teaching AI using LEGO mindstorms. In AAAI Spring Symposium.
- Pega. 2018. What Consumers Really Think About AI: A Global Study. Pega. Retrieved September 6, 2019 from https://www.pega.com/ai-survey
- Weber Shandwick, Inc. 2016. AI-Ready or Not: Artificial Intelligence Here We Come! Weber Shandwick, Inc. Retrieved September 6, 2019 from https://www.webershandwick.com/news/ai-ready-ornot-artificial-intelligence-here-we-come/
- Mike Zyda and Sven Koenig. 2008. Teaching artificial intelligence playfully. In Proceedings of the AAAI-08 Education Colloquium, 90--95.
- eCraft2Learn - Digital Fabrication and Maker Movement in Education Making Computer supported Artefacts from Scratch. eCraft2Learn. Retrieved January 7, 2020 from https://project.ecraft2learn.eu/
Cited by
Items 201–300 of 3,051
How Experienced Designers of Enterprise Applications Engage AI as a Design Material
Yildirim, N., Kass, A., Tung, T., Upton, C., Costello, D., Giusti, R., Lacin, S., Lovic, S., O'Neill, J. M., Meehan, R. O., et al. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517491 · Cited by 71
“However, there is no consensus on what constitutes a “good enough” understanding of AI [55, 68].”
BackgroundAustralian public understandings of artificial intelligence
Selwyn, N., & Cordoba, B. G. (2021) · AI & Society · doi:10.1007/s00146-021-01268-z · Cited by 91
“The nature of this public education might build upon the AI literacy efforts else-where—from formal additions to school and college curricula, the provision of community courses in libraries, employee training, as well as the provision of online AI literacy resources for public consumption (such as Coursera’s ‘AI for…”
BackgroundCharting the Future of AI in Project-Based Learning: A Co-Design Exploration with Students
Zheng, C., Yuan, K., Guo, B., Hadi Mogavi, R., Peng, Z., Ma, S., & Ma, X. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642807 · Cited by 70
“Many foresee a near future where AI usage in student learning becomes a norm [37, 61, 69], leading to a transformation in educational assessments, such as emphasizing the learning process rather than just the outcomes [57, 58] and evaluating students’ AI literacy [43, 57, 69].”
Van Brummelen, J., Tabunshchyk, V., & Heng, T. (2021) · Interaction Design and Children · doi:10.1145/3459990.3460730 · Cited by 78
Alamäki, A., Nyberg, C., Kimberley, A., & Salonen, A. O. (2024) · Frontiers in Education · doi:10.3389/feduc.2024.1343406 · Cited by 80
Charting the Future of AI in Project-Based Learning: A Co-Design Exploration with Students
Zheng, C., Yuan, K., Guo, B., Mogavi, R. H., Peng, Z., Ma, S., & Ma, X. (2024) · arXiv · doi:10.48550/arxiv.2401.14915 · Cited by 70
Dai, Y., Lin, Z., Liu, A., & Wang, W. (2023) · British Journal of Educational Technology · doi:10.1111/bjet.13371 · Cited by 101
Araújo, J. L., & Saúde, I. (2024) · Journal of Chemical Education · doi:10.1021/acs.jchemed.3c00745 · Cited by 109
Artificial Intelligence Literacy Competencies for Teachers Through Self-Assessment Tools
Tenberga, I., & Daniela, L. (2024) · Sustainability · doi:10.3390/su162310386 · Cited by 210
GLAT: The generative AI literacy assessment test
Jin, Y., Martinez-Maldonado, R., Gašević, D., & Yan, L. (2025) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2025.100436 · Cited by 76
O’Dea, X., Tsz Kit Ng, D., O’Dea, M., & Shkuratskyy, V. (2026) · Policy Futures in Education · doi:10.1177/14782103241287401 · Cited by 69
“During the pre-GenAI era, there has been research on AI literacy (Long and Magerko, 2020; Ng et al., 2021).”
InfluentialChai, C. S., Yu, D., King, R. B., & Zhou, Y. (2024) · Sage Open · doi:10.1177/21582440241242188 · Cited by 69
“In other words, AI education equips students with AI literacy (Long & Magerko, 2020; Ng et al., 2021).”
Artificial Intelligence (AI) Literacy Questionnaire with Confirmatory Factor Analysis
Kit Ng, D. T., Wu, W., Lok Leung, J. K., & Wah Chu, S. K. (2023) · 2023 IEEE International Conference on Advanced Learning Technologies (ICALT) · doi:10.1109/icalt58122.2023.00074 · Cited by 68
The use of generative AI by students with disabilities in higher education
Zhao, X., Cox, A., & Chen, X. (2025) · The Internet and Higher Education · doi:10.1016/j.iheduc.2025.101014 · Cited by 134
Shi, J., Liu, W., & Hu, K. (2025) · Behavioral Sciences · doi:10.3390/bs15050705 · Cited by 77
“For instance, Long and Magerko (2020) defined AI literacy as a set of competencies that enables individuals to critically evaluate AI technologies, communicate and collaborate effectively with AI, and use AI as a tool online, at home, and in the workplace.”
Park, H., Ahn, D., Hosanagar, K., & Lee, J. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517672 · Cited by 67
“However, since AI has emerged as a new social actor at the center of wicked problems, the stakeholders involved in the issues surrounding AI in HRM are not experts; most of them have low AI literacy [50] because they have not seen or used AI in HRM.”
BackgroundAlgorithmic Literacy, AI Literacy and Responsible Generative AI Literacy
Cox, A. (2024) · Journal of Web Librarianship · doi:10.1080/19322909.2024.2395341 · Cited by 67
“At the time of writing the most widely cited model of AI literacy is that proposed by Long and Magerko (2020) (Table 1).”
InfluentialHeinrichs, H., Kies, A., Nagel, S. K., & Kiessling, F. (2025) · Journal of Medical Internet Research · doi:10.2196/74187 · Cited by 66
“However, they expressed concern that increased patient access to generative AI tools (eg, ChatGPT and chatbots) might introduce misinformation into consultations [66].”
Using Explainability to Help Children UnderstandGender Bias in AI
Melsión, G. I., Torre, I., Vidal, E., & Leite, I. (2021) · Interaction Design and Children · doi:10.1145/3459990.3460719 · Cited by 65
“Starting from the claim in [30] that explainability techniques can have a positive impact in the education of AI to the general public, we present the first study evaluating its effectiveness among preadolescents.”
BackgroundInfluentialMedical and Dental Professionals Readiness for Artificial Intelligence for Saudi Arabia Vision 2030
Aboalshamat, K., Alhuzali, R., Alalyani, A., Alsharif, S., Qadhi, H., Almatrafi, R., Ammash, D., & Alotaibi, S. (2022) · International Journal of Pharmaceutical Research And Allied Sciences · doi:10.51847/nu8y6y6q1m · Cited by 66
“This can help the next generation of medical professionals cope with the data science era and fit into an upcoming AI ecosystem [50-52].”
BackgroundSubaşı, D. Ö., Sümengen, A. A., Semerci, R., Şimşek, E., Çakır, G. N., & Temizsoy, E. (2024) · Journal of Advanced Nursing · doi:10.1111/jan.16335 · Cited by 97
AI Literacy in K-12 and Higher Education in the Wake of Generative AI: An Integrative Review
Gu, X., & Ericson, B. J. (2025) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/3702652.3744217 · Cited by 167
“AI literacy and recognition of its potential significance are well-established [75, 127].”
InfluentialHsu, T.-C., Abelson, H., & Van Brummelen, J. (2022) · The International Review of Research in Open and Distributed Learning · doi:10.19173/irrodl.v22i4.5474 · Cited by 65
Zhou, X., Li, Y., Chai, C. S., & Chiu, T. K. F. (2025) · Interactive Learning Environments · doi:10.1080/10494820.2025.2487538 · Cited by 132
“Among the five instructional designs identified in the reviewed articles, design thinking may be the only learning approach that can effectively foster all five confidences and abilities throughout the iterative project cycle (Chiu et al., 2021; Long & Magerko, 2020).”
InfluentialArtificial intelligence literacy education in primary schools: a review
Yim, I. H. Y., & Su, J. (2025) · International Journal of Technology and Design Education · doi:10.1007/s10798-025-09979-w · Cited by 187
“Long and Magerko (2020) and Ng et al. (2021) comprehensively defined AI literacy across educational levels.”
Artificial Intelligence for Academic Purposes (AIAP): Integrating AI literacy into an EAP module
Ngo, T. N., & Hastie, D. (2025) · English for Specific Purposes · doi:10.1016/j.esp.2024.09.001 · Cited by 72
Integrating AI and machine learning in STEM education: Challenges and opportunities
Joseph, O. B., & Uzondu, N. C. (2024) · Computer Science & IT Research Journal · doi:10.51594/csitrj.v5i8.1379 · Cited by 64
Laupichler, M. C., Hadizadeh, D. R., Wintergerst, M. W. M., von der Emde, L., Paech, D., Dick, E. A., & Raupach, T. (2022) · BMC Medical Education · doi:10.1186/s12909-022-03866-x · Cited by 62
“The MAIRS-MS instrument asks very generally about AI readiness and to some extent also contains techno-mathematical aspects (see item on statistics skills), which is not considered to be a central aspect of AI literacy by all research groups (e.g., [21]).”
BackgroundResponsible AI literacy: A stakeholder-first approach
Domínguez Figaredo, D., & Stoyanovich, J. (2023) · Big Data & Society · doi:10.1177/20539517231219958 · Cited by 64
“Third, AI literacy is considered to be primarily about understanding AI and not about learning to design AI systems, which in turn points to the need to overcome reliance on programming exercises as the primary means of instruction (Laupichler et al., 2022; Long and Magerko, 2020; Ng et al., 2021).”
BackgroundResultUnderstanding Older Adults’ Perceptions and Challenges in Using AI-enabled Everyday Technologies
Shandilya, E., & Fan, M. (2022) · International Symposium of Chinese CHI (Chinese CHI) · doi:10.1145/3565698.3565774 · Cited by 121
“Many times, users are not aware that they interact with products that use AI, which affects their perception and may create false expectations from AI systems [34, 45].”
BackgroundInfluentialKim, J., Yu, S., Lee, S.-S., & Detrick, R. (2025) · Journal of Research on Technology in Education · doi:10.1080/15391523.2025.2456043 · Cited by 133
“As the use of AI in language education spreads, differences in AI literacy may help or hinder students in sifting out relevant information through their ability to critically assess, collaborate, and communicate with AI, resulting in varied task outcomes (Long & Magerko, 2020).”
InfluentialExploring intention of undergraduate students to embrace chatbots: from the vantage point of Lesotho
Ayanwale, M. A., & Molefi, R. R. (2024) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-024-00451-8 · Cited by 106
Evaluating AI literacy of secondary students: Framework and scale development
Zhong, B., & Liu, X. (2024) · Computers & Education · doi:10.1016/j.compedu.2024.105230 · Cited by 102
Critical GenAI Literacy: Postdigital Configurations
Rapanta, C., Bhatt, I., Bozkurt, A., Chubb, L. A., Erb, C., Forsler, I., Gravett, K., Koole, M., Lintner, T., Örtegren, A., et al. (2025) · Postdigital Science and Education · doi:10.1007/s42438-025-00573-w · Cited by 77
“Frameworks by Long and Magerko (2020), Ng et al. (2021), and Almatrafi et al. (2024) emphasize competencies like recognizing, using, evaluating, and ethically engaging with AI systems.”
Choi, J.-I., Yang, E., & Goo, E.-H. (2024) · Applied Sciences · doi:10.3390/app14041588 · Cited by 62
“This is in line with Long and Magerko’s discussion [6] on AI literacy competencies, reinforcing the importance of critical thinking and problem-solving abilities in navigating AI ethics.”
BackgroundAI Knowledge: Improving AI Delegation through Human Enablement
Pinski, M., Adam, M., & Benlian, A. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580794 · Cited by 62
“HCI research centered on human attributes, such as knowledge, skills, and abilities regarding AI, formed under the term “AI literacy” [5, 24, 42, 60, 72, 99].”
BackgroundMethodInfluentialLearning About AI: A Systematic Review of Reviews on AI Literacy
Zhang, S., Ganapathy Prasad, P., & Schroeder, N. L. (2025) · Journal of Educational Computing Research · doi:10.1177/07356331251342081 · Cited by 62
“This fi nding aligns well with Long and Magerko ’ s argument (2020) that, while understanding programming can aid in comprehension and would be needed in developing AI, most individuals interacting with AI in their daily lives do not need to know how to program.”
InfluentialIn the Black Mirror: Youth Investigations into Artificial Intelligence
Lee, C. H., Gobir, N., Gurn, A., & Soep, E. (2022) · ACM Transactions on Computing Education · doi:10.1145/3484495 · Cited by 82
(2023) · KSII Transactions on Internet and Information Systems · doi:10.3837/tiis.2023.08.016 · Cited by 60
“…competencies of AI literacy, recently, Long and Magerko (2020) defined AI literacy as “a set of competencies that enables individuals to critically evaluate AI technologies; communicate and collaborate effectively with AI; and use AI as a tool online, at home, and in the workplace” (p. 598) [25].”
BackgroundStudents-generative AI interaction patterns and its impact on academic writing
Kim, J., Lee, S.-S., Detrick, R., Wang, J., & Li, N. (2026) · Journal of Computing in Higher Education · doi:10.1007/s12528-025-09444-6 · Cited by 74
“Before the experiment, all participants were asked to answer AI literacy level questionnaires (7-point Likert-scale) adapted from Long and Magerko ( 2020) that include, for instance, ‘I can distinguish between devices utilizing AI and devices that are not.’”
Addressing AI and Data Literacy in Teacher Education: A Review of Existing Educational Frameworks
Olari, V., & Romeike, R. (2021) · The 16th Workshop in Primary and Secondary Computing Education · doi:10.1145/3481312.3481351 · Cited by 60
“This trend has led to political commitments to promote AI and data literacy in school education [4], reflected in the increasing development of K-12 educational frameworks focused on AI and data literacy [1, 2, 9, 15, 16].”
BackgroundMethodInfluentialNewman, M., Sun, K., Dalla Gasperina, I. B., Shin, G. Y., Pedraja, M. K., Kanchi, R., Song, M. B., Li, R., Lee, J. H., & Yip, J. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642492 · Cited by 59
“After agreements had been made and all AMs were completed, the first author compared the codebook to work on AI literacy [32, 59, 70], constructionism [42, 75], and creativity [3, 4, 52].”
MethodWhat Students Can Learn About Artificial Intelligence – Recommendations for K-12 Computing Education
Michaeli, T., Romeike, R., & Seegerer, S. (2023) · IFIP advances in information and communication technology · doi:10.1007/978-3-031-43393-1_19 · Cited by 73
Jatileni, C. N., Sanusi, I. T., Olaleye, S. A., Ayanwale, M. A., Agbo, F. J., & Oyelere, P. B. (2024) · Education and Information Technologies · doi:10.1007/s10639-023-12341-z · Cited by 59
“The agreement among researchers and relevant stakeholders about the importance of Artificial Intelligence (AI) lessons within the compulsory level of education (Long & Magerko, 2020; Touretzky et al., 2019) has heightened the need for several initiatives to further popularize the subject in schools.”
Establishing and evaluating trustworthy AI: overview and research challenges
Kowald, D., Scher, S., Pammer-Schindler, V., Müllner, P., Waxnegger, K., Demelius, L., Fessl, A., Toller, M., Mendoza Estrada, I. G., Šimić, I., et al. (2024) · Frontiers in Big Data · doi:10.3389/fdata.2024.1467222 · Cited by 59
“Overall, systems need to be designed to be understandable for humans (Long and Magerko, 2020; Ng et al., 2021).”
InfluentialMachine Learning for All!—Introducing Machine Learning in Middle and High School
Martins, R. M., von Wangenheim, C. G., Rauber, M. F., & Hauck, J. C. R. (2023) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-022-00325-y · Cited by 74
“…in alignment with the BNCC for K-12 in Brazil (MEC, 2017) focusing especially on the Big Idea 3 – Learning of the AI with the K-12 Guidelines for Artificial Intelligence (Touretzky et al., 2019), AI literacy (Long & Magerko, 2020) and a human-centered ML process (Amershi et al., 2019) (Table 2).”
Kim, S. S. Y., Vaughan, J. W., Liao, Q. V., Lombrozo, T., & Russakovsky, O. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714020 · Cited by 58
“We suggest future research to explore strategies for improving people’s understanding of LLMs [3, 83] and study how they are connected to reliance behaviors.”
Competency Model Approach to AI Literacy: Research-Based Path From Initial Framework to Model
Faruqe, F., Watkins, R., & Medsker, L. (2022) · Advances in Artificial Intelligence and Machine Learning · doi:10.54364/aaiml.2022.1140 · Cited by 58
“They also achieve this through conceptual and logical connections that are often recognizable and applicable to users of the framework [5].”
BackgroundInfluentialVisser, R., Peters, T. M., Scharlau, I., & Hammer, B. (2025) · Cognitive Systems Research · doi:10.1016/j.cogsys.2025.101357 · Cited by 58
“For example, understanding AI and its strength and weakness is central for AI literacy, which also can be influenced by cultural upbringing (Long & Magerko, 2020).”
Inteligencia artificial generativa y educación: Un análisis desde múltiples perspectivas
García‐Peñalvo, F. J. (2024) · Education in the Knowledge Society (EKS) · doi:10.14201/eks.31942 · Cited by 213
Effect of an Analogy-Based Approach of Artificial Intelligence Pedagogy in Upper Primary Schools
Dai, Y., Lin, Z., Liu, A., Dai, D., & Wang, W. (2023) · Journal of Educational Computing Research · doi:10.1177/07356331231201342 · Cited by 90
“In this regard, comparing AI and humans can help students better understand the ideas, attributes, and processes of intelligence and AI (Long & Magerko, 2020).”
BackgroundPotential and pitfalls of romantic Artificial Intelligence (AI) companions: A systematic review
Ho, J. Q. H., Hu, M., Chen, T. X., & Hartanto, A. (2025) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2025.100715 · Cited by 64
Leading the AI transformation in schools: it starts with a digital mindset
Pietsch, M., & Mah, D.-K. (2024) · Educational Technology Research and Development · doi:10.1007/s11423-024-10439-w · Cited by 136
“…and computer vision (Russell & Norvig, 2016), and without in-depth knowledge, the field can be correspondingly confusing (Bewersdorff et al., 2023; Long & Magerko, 2020); (2) generative AI is currently developing rapidly (Fengchun & Homes, 2023; Kasneci et al., 2023; Yusuf et al., 2024), and…”
Ma, S., & Chen, Z. (2024) · IEEE Access · doi:10.1109/access.2024.3468378 · Cited by 55
“…evaluate AI-generated content and assess the limitations of the tools themselves; and the ‘‘Ethics’’ dimension (comprising items 19, 21, 22, and 23) assesses adherence to ethical standards and the ability to safeguard against security risks (such as privacy breaches) when using AI products.”
BackgroundMethodPoseBlocks: A Toolkit for Creating (and Dancing) with AI
Jordan, B., Devasia, N., Hong, J., Williams, R., & Breazeal, C. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i17.17831 · Cited by 54
“1971), but researchers have only just begun to systematically study and develop standards for AI education more broadly (AAAI 2018; Long and Magerko 2020).”
BackgroundYou’d Better Stop! Understanding Human Reliance on Machine Learning Models under Covariate Shift
Chiang, C.-W., & Yin, M. (2021) · 13th ACM Web Science Conference 2021 · doi:10.1145/3447535.3462487 · Cited by 53
“On the high level, this is related to increase the general public’s AI literacy [9, 14], especially on enabling people to recognize that ML models learn from data, and the data used to train the models largely influences the results of the model.”
BackgroundFamily Learning Talk in AI Literacy Learning Activities
Long, D., Teachey, A., & Magerko, B. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3502091 · Cited by 53
“Several papers have expanded on the design considerations in [47] or suggested some additional design considerations for AI literacy activities.”
BackgroundMethodInfluentialSelf-citationA study on the knowledge and perception of artificial intelligence
Subaveerapandiyan, A., Sunanthini, C., & Amees, M. (2023) · IFLA Journal · doi:10.1177/03400352231180230 · Cited by 83
“anybody with or without such a background can use AI in their work (Long and Magerko, 2020).”
BackgroundArtificial Intelligence Across Europe: A Study on Awareness, Attitude and Trust
Scantamburlo, T., Cortés, À., Foffano, F., Barruè, C., Distefano, V., Pham, L., & Fabris, A. (2024) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2024.3461633 · Cited by 121
“This problem regards the type of knowledge and skills that we will value in the future (see [79] for a systematic review of key competencies of AI literacy).”
Developing Machine Learning Algorithm Literacy with Novel Plugged and Unplugged Approaches
Ma, R., Sanusi, I. T., Mahipal, V., Gonzales, J. E., & Martin, F. G. (2023) · Proceedings of the 54th ACM Technical Symposium on Computer Science Education V. 1 · doi:10.1145/3545945.3569772 · Cited by 52
“This suggests the need to disseminate AI literacy and educate students on the inner workings of technology [17, 34].”
BackgroundPedagogical framework for cultivating children's data agency and creative abilities in the age of AI
Kahila, J., Vartiainen, H., Tedre, M., Arkko, E., Lin, A., Pope, N., Jormanainen, I., & Valtonen, T. (2024) · Informatics in Education · doi:10.15388/infedu.2024.15 · Cited by 73
“…critically, responsibly and safely with practices of data driven society, researchers have called for new kinds of digital competences (Vuorikari et al., 2016), AI literacies (Long and Magerko, 2020), data awareness (Höper, 2021), or data literacies (Pangrazio and Selwyn, 2019; Cu et al., 2023).”
BackgroundTripathi, T., Sharma, S. R., Singh, V., Bhargava, P., & Raj, C. (2025) · Frontiers in Education · doi:10.3389/feduc.2025.1651217 · Cited by 51
Designing a novel teaching platform for AI: A case study in a Thai school context
Aung, Z. H., Sanium, S., Songsaksuppachok, C., Kusakunniran, W., Precharattana, M., Chuechote, S., Pongsanon, K., & Ritthipravat, P. (2022) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12706 · Cited by 50
The Role of Collaboration, Creativity, and Embodiment in AI Learning Experiences
Long, D., Padiyath, A., Teachey, A., & Magerko, B. S. (2021) · Creativity and Cognition · doi:10.1145/3450741.3465264 · Cited by 75
“These exhibits incorporate embodied interaction, collaboration, and/or creativity as key design features, and they also draw on design considerations outlined in [34].”
BackgroundMethodInfluentialSelf-citationSidra, S., & Mason, C. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2543997 · Cited by 95
“…a Collaborative AI Literacy measure was to develop a scale that remained consistent with existing definitions of the construct (specifically, Long and Magerko (2020) ’ s original definition of AI Literacy) but assesses the skills and knowledge required to exploit the collaborative…”
A systematic literature review of generative artificial intelligence (GenAI) literacy in schools
Park, J. (2025) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2025.100487 · Cited by 150
Enhancing artificial intelligence literacy through cross-cultural online workshops
Korte, S.-M., Cheung, W. M.-Y., Maasilta, M., Kong, S.-C., Keskitalo, P., Wang, L., Lau, C. M., Lee, J. C. K., & Gu, M. M. (2024) · Computers and Education Open · doi:10.1016/j.caeo.2024.100164 · Cited by 49
“It is defined as an individual ’ s competence in using, critically evaluating and communicating with AI as a subjective and independent human [29,48].”
BackgroundWu, D., Chen, M., Chen, X., & Liu, X. (2024) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2024.100295 · Cited by 111
Álvarez Ariza, J., Benitez Restrepo, M., & Hernández Hernández, C. (2025) · IEEE Access · doi:10.1109/access.2025.3541424 · Cited by 51
Prilop, C. N., Mah, D.-K., Jacobsen, L. J., Hansen, R. R., Weber, K. E., & Hoya, F. (2025) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2025.100471 · Cited by 146
PlushPal: Storytelling with Interactive Plush Toys and Machine Learning
Tseng, T., Murai, Y., Freed, N., Gelosi, D., Ta, T. D., & Kawahara, Y. (2021) · Interaction Design and Children · doi:10.1145/3459990.3460694 · Cited by 49
“A proposed list of AI competencies include understanding how computers “recognize and make decisions” and the role humans play in programming and tuning AI systems [23].”
BackgroundRegister, Y., & Ko, A. J. (2020) · Proceedings of the 2020 ACM Conference on International Computing Education Research · doi:10.1145/3372782.3406252 · Cited by 49
“Core features of this literacy include model transparency, understanding the mechanisms, contextualizing data, critical thinking, and leveraging learners’ interests and backgrounds [31].”
BackgroundThe GenAI divide among university students: A call for action
Beckman, K., Apps, T., Howard, S. K., Rogerson, C., Rogerson, A., & Tondeur, J. (2025) · The Internet and Higher Education · doi:10.1016/j.iheduc.2025.101036 · Cited by 49
Chubb, J., Missaoui, S., Concannon, S. J., Maloney, L., & Walker, J. A. (2021) · International Journal of Child-Computer Interaction · doi:10.1016/j.ijcci.2021.100403 · Cited by 74
“This kind of user-involvement should keep participants as fully informed as possible about the objectives and procedures of the research to improve AI literacy Long and Magerko [2020].”
BackgroundInfluentialAssessing the assessments: toward a multidimensional approach to AI literacy
Biagini, G. (2024) · Media Education · doi:10.36253/me-15831 · Cited by 48
“…– (Laupichler et al., 2023; Southworth et al., 2023) understanding the fundamentals of AI is crucial not only for those working in tech-centric roles but also for the general population to make informed decisions (Kandl-hofer et al., 2016; Ng et al., 2021; Long & Magerko, 2020; UNESCO, 2022).”
BackgroundĐerić, E., Frank, D., & Milković, M. (2025) · Information · doi:10.3390/info16070622 · Cited by 60
Zheng, C., Wu, Y., Shi, C., Ma, S., Luo, J., & Ma, X. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581131 · Cited by 48
“Data or AI literacy might be the factor for this difference [57].”
BackgroundLaupichler, M. C., Aster, A., Perschewski, J.-O., & Schleiss, J. (2023) · Education Sciences · doi:10.3390/educsci13100978 · Cited by 48
“They described AI literacy as “a set of competencies that enables individuals to critically evaluate AI technologies; communicate and collaborate effectively with AI; and use AI as a tool online, at home, and in the workplace” [8], (p. 2).”
BackgroundLin, X., Zhou, Y., Shen, W., Luo, G., Xian, X., & Pang, B. (2023) · Education and Information Technologies · doi:10.1007/s10639-023-12029-4 · Cited by 60
“Second, some studies hold another perspective which sees AI literacy as a set of basic abilities that enable individuals to critically evaluate AI technologies, communicate, and collaborate effectively with AI (Long & Magerko, 2020).”
Heil, J., Ifenthaler, D., Cooper, M., Mascia, M. L., Conti, R., & Penna, M. P. (2025) · Smart Learning Environments · doi:10.1186/s40561-025-00395-0 · Cited by 47
“For instance, AI competence involves a basic understanding of the functionality of AI (Attwell et al., 2020), including identifying whether or not an application uses AI (Long & Magerko, 2020).”
Milana, M., Brandi, U., Hodge, S., & Hoggan-Kloubert, T. (2024) · International Journal of Lifelong Education · doi:10.1080/02601370.2024.2310448 · Cited by 46
“…several researchers concur that adults need training in AI literacy – ‘a set of competencies that enables individuals to critically evaluate AI technologies, communicate and collaborate effectively with AI, and use AI as a tool online, at home, and in the workplace’ (Long & Magerko, 2020, p.2).”
BackgroundLessons Learnt from a Multimodal Learning Analytics Deployment In-the-Wild
Martínez‐Maldonado, R., Echeverría, V., Fernandez-Nieto, G. M., Yan, L., Zhao, L., Alfredo, R., Li, X., Dix, S., Jaggard, H., Wotherspoon, R., et al. (2023) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3622784 · Cited by 82
“Professional development programs can be created to increase teachers’ AI literacy [52] and visualisation literacy [80] for them to understand, to some extent, how they can integrate the MMLA interfaces into their existing practices or how they can adapt their current practices to the new…”
BackgroundKim, K., & Kwon, K. (2024) · Education and Information Technologies · doi:10.1007/s10639-024-12497-2 · Cited by 57
“To achieve this goal, our research aimed to explore students’ foundational understanding of AI, ML, and AI ethics, which form AI knowledge (Long & Magerko, 2020; Touretzky et al., 2019).”
Charting Competence: A Holistic Scale for Measuring Proficiency in Artificial Intelligence Literacy
Yuan, C. W., Tsai, H.-Y. S., & Chen, Y.-T. (2024) · Journal of Educational Computing Research · doi:10.1177/07356331241261206 · Cited by 73
“…be de fi ned as a multi-level capacity to comprehend the derivation of AI technologies from data processing to algorithm training, critically assess their applications and consequences, and pro fi ciently interact with AI systems (Hancock et al., 2020; Long & Magerko, 2020; Ng et al., 2021, 2021b).”
InfluentialPreparing Educators to Teach and Create With Generative Artificial Intelligence
MacDowell, P., Moskalyk, K., Korchinski, K., & Morrison, D. (2024) · Canadian Journal of Learning and Technology · doi:10.21432/cjlt28606 · Cited by 92
“Long and Magerko (2020) defined AI literacy as “a set of competencies that enables individuals to critically evaluate AI technologies; communicate and collaborate effectively with AI; and use AI as a tool online, at home, and in the workplace” (p. 2).”
BackgroundExploring students’ experience of ChatGPT in STEM education
Valeri, F., Nilsson, P., & Cederqvist, A. (2024) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2024.100360 · Cited by 97
Pei, B., Lu, J., & Jing, X. (2025) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2025.100406 · Cited by 93
Introducing Artificial Intelligence Fundamentals with LearningML: Artificial Intelligence made easy
Rodríguez-García, J. D., Moreno-León, J., Román-González, M., & Robles, G. (2020) · Eighth International Conference on Technological Ecosystems for Enhancing Multiculturality · doi:10.1145/3434780.3436705 · Cited by 46
“It is a must, therefore, that citizens know its fundamentals in order to understand what can be made with AI, and how it can affect our lives [7].”
BackgroundMeng, X., & Liu, J. (2025) · Online Information Review · doi:10.1108/oir-06-2024-0375 · Cited by 46
AI-deploying organizations are key to addressing ‘perfect storm’ of AI risks
Curtis, C., Gillespie, N., & Lockey, S. (2023) · AI and Ethics · doi:10.1007/s43681-022-00163-7 · Cited by 43
“The gap in the integration of the trustworthy AI principle of transparency contributes to this low literacy and awareness of AI throughout the general population and has led to calls for the promotion of greater transparency in all aspects of AI design, extending to the intentions of the system creators and disclosure…”
BackgroundAn empirical analysis of high school students' practices of modelling with unstructured data
Jiang, S., Nocera, A., Tatar, C., Yoder, M. M., Chao, J., Wiedemann, K., Finzer, W., & Rosé, C. P. (2022) · British Journal of Educational Technology · doi:10.1111/bjet.13253 · Cited by 59
Enhancing children’s understanding of algorithmic biases in and with text-to-image generative AI
Vartiainen, H., Kahila, J., Tedre, M., López‐Pernas, S., & Pope, N. (2024) · New Media & Society · doi:10.1177/14614448241252820 · Cited by 75
“To ensure that people can engage constructively, critically, responsibly and safely with practices of data-driven society, researchers have called for new kinds of AI literacies (Long and Magerko, 2020; Ng et al., 2021) or data literacies (Pangrazio and Selwyn, 2019).”
AI in the Public Eye: Investigating Public AI Literacy Through AI Art
Hemment, D., Currie, M., Bennett, S., Elwes, J., Ridler, A., Sinders, C., Vidmar, M., Hill, R., & Warner, H. (2023) · 2023 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3593013.3594052 · Cited by 44
“Long and Magerko [39] think of AI literacy as “a set of competencies that enables individuals to critically evaluate AI technologies” as well as use it (p. 1).”
BackgroundA systematic review on how educators teach AI in K-12 education
Liu, X., & Zhong, B. (2024) · Educational Research Review · doi:10.1016/j.edurev.2024.100642 · Cited by 113
Visualizing the knowledge mapping of artificial intelligence in education: A systematic review
Qin, Q., & Zhang, S. (2024) · Education and Information Technologies · doi:10.1007/s10639-024-13076-1 · Cited by 68
“Some of the most co-cited articles include Zawacki-Richter et al. (2019), Popenici and Kerr (2017), Hwang et al. (2020); Chen et al., 2020a); Long and Magerko (2020); Luckin and Cukurova (2019).”
Enam, M. A., Murmu, C., & Dixon, E. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2476710 · Cited by 79
“Long and Magerko (2020) defined AI literacy as: The sixteen competencies defined by Long and Magerko (2020) emerged from a conceptual framework encompassing five stages: defining AI, understanding the tasks AI can perform, grasping the mechanisms of AI, knowing how to use AI, and perceiving the…”
Fostering responsible AI literacy: A systematic review of K-12 AI ethics education
Ma, M., Ng, D. T. K., Liu, Z., & Wong, G. K. W. (2025) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2025.100422 · Cited by 133
Engaging Teachers to Co-Design Integrated AI Curriculum for K-12 ClassroomsPreprint
Brummelen, J. V., & Lin, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.11100 · Cited by 44
“This may be through teaching data-related AI competencies, like Data Literacy, Learning from Data, and Critically Interpreting Data [22], or through using data to train ML models, which can teach other AI competencies.”
BackgroundMethodInfluentialMeta AI literacy scale: Further validation and development of a short version
Koch, M. J., Carolus, A., Wienrich, C., & Latoschik, M. E. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e39686 · Cited by 44
“AIL is “ a set of competencies that enables individuals to critically evaluate AI technologies, communicate and collaborate effectively with AI; and use AI as a tool online, at home, and in the workplace ” [1].”
BackgroundInfluences on User Trust in Healthcare Artificial Intelligence: A Systematic Review
Jermutus, E., Kneale, D., Thomas, J., & Michie, S. (2022) · Wellcome Open Research · doi:10.12688/wellcomeopenres.17550.1 · Cited by 44
“Given the suggested influence of knowledge on trust, we need to educate people on the capabilities and limitations of AI (among other aspects) to increase AI literacy 48 .”
Background
Metadata
- Authors
- Long, D., & Magerko, B.
- Affiliations
- Georgia Institute of Technology (US)
- Venue
- Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2020-04-21
- Pages
- 1-16
- OpenAlex
- W3029022390
- Semantic Scholar
- 89ab36ae8630f6e4058c926816fe8d9a676c54e3
- Cited by
- 3,241
- References
- 117
- Citations by year
- 2026: 1428 · 2025: 867 · 2024: 499 · 2023: 215 · 2022: 146 · 2021: 76 · 2020: 9
- FWCI
- 84.56
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- Topics
- Social Sciences › Education › Digital literacy in education
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Keywords
- AI literacy, AI competencies, public understanding of AI, critical evaluation of AI, conceptual framework, artificial intelligence in education
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.