Cited by 1,036Digital literacy in educationEthics and Social Impacts of AIGender and Technology in Education

The DOI matches its Crossref record; 69 of the 69 references it cites were found in a registry or an index.

Measuring user competence in using artificial intelligence: validity and reliability of artificial intelligence literacy scale

Wang, Bingcheng, Rau, Pei-Luen Patrick, Yuan, Tianyi·2023·Behaviour & Information Technology

Abstract

As artificial intelligence (AI) became a part of daily life, it has become important to determine user competence in using AI technology. Here, we propose the concept of AI literacy and develop a quantitative scale for obtaining accurate data regarding the AI literacy of ordinary users. We first identified the primary core constructs of AI literacy, including awareness, use, evaluation, and ethics. Next, we generated 65 items to capture these four constructs; only 31 items were retained after a three-step content validation process. Then, we conducted a survey, and collected two samples of data. By reducing the number of items using the first sample and performing reliability and validity tests on the second sample, we obtained a 12-item instrument for the quantitative measurement of AI literacy. The results confirmed that the proposed four-construct model is an adequate representation of AI literacy. Further, AI literacy is significantly related to digital literacy, attitude towards robots, and users’ daily usage of AI. This study will not only aid researchers in understanding how user competence in using AI technology affects human–AI interactions but will also help designers develop AI applications that are aligned with the AI literacy levels of the target users.

Overview

Integrity signals

Registry

Crossref · 10.1080/0144929x.2022.2072768

Cites

69 of 69 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 69 references

Research works printed but not linked: 15

  1. Buckingham D., 1989, Radical Philosophy, 51, 12
  2. Buckingham D., 2007, Journal of Educational Multimedia and Hypermedia, 16, 323
  3. Calvani A., 2008, Journal of E-Learning and Knowledge Society, 4, 183
  4. 10.1177/002224378001700401 · DOI
  5. Eshet Y., 2004, Journal of Educational Multimedia and Hypermedia, 13, 93
  6. Finstad K., 2010, Journal of Usability Studies, 5, 104
  7. Gapski, H. 2007. “Some Reflections on Digital Literacy.” Paper Presented at the Proceedings of the 3rd International Workshop on Digital Literacy.
  8. Gilster P., 1997, Digital Literacy
  9. 10.7551/mitpress/8975.001.0001 · DOI · Paper page
  10. 10.17265/2159-5313/2016.09.003 · DOI · Paper page
  11. Kim Y., 2013, Journal of Digital Convergence, 11, 9
  12. Likert R., 1932, Archives of Psychology
  13. Mayerl J., 2016, Green European, 210
  14. Tarafdar M., 2019, MIT Sloan Management Review, 60, 37
  15. Wilson, H. J., and P. R. Daugherty. 2018. “Collaborative Intelligence: Humans and AI Are Joining Forces.” Harvard Business Review .

Cited by

Sorted by citations

Items 201–300 of 1,003

Metadata

Authors
Wang, B., Rau, P.-L. P., & Yuan, T.
Affiliations
Tsinghua University (CN)
Corresponding author
Rau, Pei-Luen Patrick
Venue
Behaviour & Information Technology
Published
2022-05-10
Volume
42
Issue
9
Pages
1324-1337
ISSN
  • 0144-929X (ISSN-L)
  • 1362-3001
OpenAlex
W4280549083
Cited by
1,036
References
69
Citations by year
2026: 549 · 2025: 323 · 2024: 137 · 2023: 27
FWCI
120.30
Type
journal article
Language
en
Open access
closed
Locations
  • Behaviour and Information Technology (publishedVersion)
  • RePEc: Research Papers in Economics (submittedVersion)
Funders
Ministry of Science and Technology of China (2018AAA0101700)
Topics
  • Social Sciences › Education › Digital literacy in education
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
  • Social Sciences › Gender Studies › Gender and Technology in Education
Keywords
AI literacy, AI literacy scale, user competence, AI awareness, AI ethics, AI evaluation, digital literacy, artificial intelligence use, human-AI interaction, scale development

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review