Cited by 391Digital literacy in educationArtificial Intelligence in EducationLibrary Science and Information Literacy

Design and validation of the AI literacy questionnaire: The affective, behavioural, cognitive and ethical approach

Open access
Ng, Davy Tsz Kit, Wu, Wenjie, Leung, Jac Ka Lok, Chiu, Thomas Kin Fung, Chu, Samuel Kai Wah·2024·British Journal of Educational Technology

Abstract

Artificial intelligence (AI) literacy is at the top of the agenda for education today in developing learners' AI knowledge, skills, attitudes and values in the 21st century. However, there are few validated research instruments for educators to examine how secondary students develop and perceive their learning outcomes. After reviewing the literature on AI literacy questionnaires, we categorized the identified competencies in four dimensions: (1) affective learning (intrinsic motivation and self‐efficacy/confidence), (2) behavioural learning (behavioural commitment and collaboration), (3) cognitive learning (know and understand; apply, evaluate and create) and (4) ethical learning. Then, a 32‐item self‐reported questionnaire on AI literacy (AILQ) was developed and validated to measure students' literacy development in the four dimensions. The design and validation of AILQ were examined through theoretical review, expert judgement, interview, pilot study and first‐ and second‐order confirmatory factor analysis. This article reports the findings of a pilot study using a preliminary version of the AILQ among 363 secondary school students in Hong Kong to analyse the psychometric properties of the instrument. Results indicated a four‐factor structure of the AILQ and revealed good reliability and validity. The AILQ is recommended as a reliable measurement scale for assessing how secondary students foster their AI literacy and inform better instructional design based on the proposed affective, behavioural, cognitive and ethical (ABCE) learning framework. Practitioner notes: What is already known about this topic AI literacy has drawn increasing attention in recent years and has been identified as an important digital literacy. Schools and universities around the world started to incorporate AI into their curriculum to foster young learners' AI literacy. Some studies have worked to design suitable measurement tools, especially questionnaires, to examine students' learning outcomes in AI learning programmes. What this paper adds Develops an AI literacy questionnaire (AILQ) to evaluate students' literacy development in terms of affective, behavioural, cognitive and ethical (ABCE) dimensions. Proposes a parsimonious model based on the ABCE framework and addresses a skill set of AI literacy. Implications for practice and/or policy Researchers are able to use the AILQ as a guide to measure students' AI literacy. Practitioners are able to use the AILQ to assess students' AI literacy development.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1111/bjet.13411

Cites

93 of 94 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • The study extends conceptual frameworks of AI literacy by specifying the structural components through which AI literacy can be cultivated beyond classroom instruction.

    “it extends conceptual frameworks of AI literacy by specifying the structural components through which AI literacy can be cultivated beyond classroom instruction.”

    From Toward Sustainable AI Literacy in Higher Education: A Delphi–AHP Approach to Identifying Key Components of AI/Data Extracurricular Programs (2026) · cites this paper as [25]

    The 'Definition and significance of AI literacy' section says the study establishes affective, behavioural, cognitive and ethical dimensions of AI literacy development, supporting the claim that it extends a conceptual framework. The passages do not establish that these components cultivate AI literacy beyond classroom instruction; the study’s instructional-design passage describes a series of lessons and workshops. (LLM, conf=0.83)

    Experimental — accuracy not yet measured
  • Most existing research on AI education in higher education has focused on conceptual frameworks for AI literacy, measurement instrument development, or pedagogical strategies for AI in classroom contexts.

    “Most existing research on AI education in higher education has focused on conceptual frameworks for AI literacy [1,9,10], measurement instrument development [25], or pedagogical strategies for AI in classroom contexts [30].”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 5

  1. Ali S., 2019, International Workshop on Education in Artificial Intelligence k‐12 (eduai’19), 1
  2. Covello S., 2010, A review of digital literacy assessment instruments, Syracuse University, 1, 31
  3. 10.1207/s15328007sem1103_2 · DOI · Paper page
  4. Microsoft, 2023, Responsible and trusted AI
  5. Proulx V. K., 1994, Computer science vs computer literacy. Which to teach

Cited by

Sorted by citations

Authors
Ng, D. T. K., Wu, W., Leung, J. K. L., Chiu, T. K. F., & Chu, S. K. W.
Affiliations
  • University of Hong Kong (HK)
  • Chinese University of Hong Kong (HK)
  • Hong Kong University of Science and Technology (HK)
  • Hong Kong Metropolitan University (HK)
Corresponding author
Ng, Davy Tsz Kit
Venue
British Journal of Educational Technology
Publisher
Wiley
Published
2023-12-13
Volume
55
Issue
3
Pages
1082-1104
ISSN
  • 0007-1013 (ISSN-L)
  • 1467-8535
OpenAlex
W4389681621
Cited by
390
References
93
Citations by year
2026: 230 · 2025: 134 · 2024: 26
FWCI
91.53
Type
journal article
Language
en
Open access
Locations
  • British Journal of Educational Technology (publishedVersion, cc-by-nc)
  • Rare & Special e-Zone (The Hong Kong University of Science and Technology) (submittedVersion)
Topics
  • Physical Sciences › Computer Science › Information Systems › Digital literacy in education
  • Physical Sciences › Computer Science › Information Systems › Artificial Intelligence in Education
  • Social Sciences › Library and Information Sciences › Library Science and Information Literacy
Keywords
AI literacy, high school students, affective learning, behavioural learning, cognitive learning, ethical learning, psychometric validation, self-efficacy, intrinsic motivation, collaboration, artificial intelligence in education, digital literacy

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review