CoChat

Objective measurement of AI literacy: Development and validation of the AI competency objective scale (AICOS)

Markus, André, Carolus, Astrid, Wienrich, Carolin · 2025 · Computers and Education: Artificial Intelligence
Cited by 30

The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/j.caeai.2025.100485

Cites

25 of 25 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

1 retracted

Show all 25 references

Research works printed but not linked: 60

  1. Ajzen, 2011, Knowledge and the prediction of behavior: The role of information accuracy in the theory of planned behavior, Basic and Applied Social Psychology, 33, 101, 10.1080/01973533.2011.568834 · DOI · Paper page
  2. Alcalá-Quintana, 2013, Fitting model-based psychometric functions to simultaneity and temporal-order judgment data: MATLAB and R routines, Behavior Research Methods, 45, 972, 10.3758/s13428-013-0325-2 · DOI
  3. Ames, 2015, An NCME instructional module on item‐fit statistics for item response theory models, Educational Measurement: Issues and Practice, 34, 39, 10.1111/emip.12067 · DOI
  4. Antonenko, 2023, In-service teachers'(mis) conceptions of artificial intelligence in K-12 science education, Journal of Research on Technology in Education, 55, 64, 10.1080/15391523.2022.2119450 · DOI · Paper page
  5. Asio, 2024, Artificial intelligence (AI) literacy and academic performance of tertiary level students: A preliminary analysis, Social Sciences, Humanities and Education Journal (SHE Journal), 5, 309
  6. Barone, 2015, When deal depth doesn't matter: How handedness consistency influences consumer response to horizontal versus vertical price comparisons, Marketing Letters, 26, 213, 10.1007/s11002-013-9276-8 · DOI
  7. Beauducel, 2006, On the performance of maximum likelihood versus means and variance adjusted weighted least squares estimation in CFA, Structural Equation Modeling, 13, 186, 10.1207/s15328007sem1302_2 · DOI · Paper page
  8. Benzakour, 2023, Artificial intelligence in spine surgery, International Orthopaedics, 47, 457, 10.1007/s00264-022-05517-8 · DOI
  9. Borges, 2017, Measuring the quality of life in hypertension according to item response theory, Revista de Saúde Pública, 51, 45, 10.1590/s1518-8787.2017051006845 · DOI
  10. Brady, 2005, Assessment of learning with multiple-choice questions, Nurse Education in Practice, 5, 238, 10.1016/j.nepr.2004.12.005 · DOI
  11. Carlson, 2009, Objective and subjective knowledge relationships: A quantitative analysis of consumer research findings, Journal of Consumer Research, 35, 864, 10.1086/593688 · DOI · Paper page
  12. Chalmers, 2012, mirt: A multidimensional item response theory package for the R environment, Journal of Statistical Software, 48, 1, 10.18637/jss.v048.i06 · DOI · Paper page
  13. Chen, 1997, Local dependence indexes for item pairs using item response theory, Journal of Educational and Behavioral Statistics, 22, 265, 10.3102/10769986022003265 · doi:10.3102/10769986022003265 · Paper page
  14. Chiu, 2024, Developing and validating measures for AI literacy tests: From self-reported to objective measures, Computers and Education: Artificial Intelligence, 7
  15. Cohen, 1992, A power primer, Psychological Bulletin, 112, 155, 10.1037/0033-2909.112.1.155 · doi:10.1037/0033-2909.112.1.155 · Paper page
  16. Cronbach, 1955, Construct validity in psychological tests, Psychological Bulletin, 52, 281, 10.1037/h0040957 · DOI · Paper page
  17. Ding, 2024, Development of an AI literacy assessment for non-technical individuals: What do teachers know?, Contemporary Educational Technology, 16, ep512, 10.30935/cedtech/14619 · DOI
  18. Feuerstahler, 2022, Metric stability in item response models, Multivariate Behavioral Research, 57, 94, 10.1080/00273171.2020.1809980 · DOI
  19. Hair, 2014, PLS-SEM: Indeed a silver bullet, Journal of Marketing Theory and Practice, 19, 139, 10.2753/MTP1069-6679190202 · DOI · Paper page
  20. Hammond, 1998, Multiple‐choice examinations: Adopting an evidence‐based approach to exam technique, Anaesthesia, 53, 1105, 10.1046/j.1365-2044.1998.00583.x · doi:10.1046/j.1365-2044.1998.00583.x
  21. Hayo, 2014, The German public and its trust in the ECB: The role of knowledge and information search, Journal of International Money and Finance, 47, 286, 10.1016/j.jimonfin.2014.07.003 · doi:10.1016/j.jimonfin.2014.07.003
  22. Henseler, 2015, A new criterion for assessing discriminant validity in variance-based structural equation modeling, Journal of the Academy of Marketing Science, 43, 115, 10.1007/s11747-014-0403-8 · DOI · Paper page
  23. Jin, 2024, GLAT: The generative AI literacy assessment test, arXiv.org
  24. Kanniainen, 2022, Online research and comprehension performance profiles among sixth‐grade students, including those with reading difficulties and/or attention and executive function difficulties, Reading Research Quarterly, 57, 1213, 10.1002/rrq.463 · DOI
  25. Kaur, 2023, Exploring AI literacy among older adults, Assistive Technology: Shaping a Sustainable and Inclusive World, 306, 9
  26. Khare, 2023, AI-Powered fraud prevention: A comprehensive analysis of machine learning applications in online transactions, Journal of Emerging Technologies and Innovative Research, 10, 2349
  27. Kharvi, 2024, Understanding the impact of AI-Generated deepfakes on public opinion, political discourse, and personal security in social media, IEEE Security and Privacy, 22, 115, 10.1109/MSEC.2024.3405963 · DOI
  28. Kılıç, 2021, Comparison of confirmatory factor analysis estimation methods on mixed-format data, International Journal of Assessment Tools in Education, 8, 21, 10.21449/ijate.782351 · DOI
  29. Klerck, 2007, The effect of knowledge types on consumer‐perceived risk and adoption of genetically modified foods, Psychology and Marketing, 24, 171, 10.1002/mar.20157 · DOI · Paper page
  30. Kose, 2012, Comparison of unidimensional and multidimensional models based on item response theory in terms of both variables of test length and sample size, Procedia - Social and Behavioral Sciences, 46, 135, 10.1016/j.sbspro.2012.05.082 · DOI
  31. Lewis, 2003, Measuring transactive memory systems in the field: Scale development and validation, Journal of Applied Psychology, 88, 587, 10.1037/0021-9010.88.4.587 · DOI · Paper page
  32. Linacre, 2017, Teaching rasch measurement, Rasch Measurement Transactions, 31, 1630
  33. Lund, 2023, Information literacy, data literacy, privacy literacy, and ChatGPT: Technology literacies align with perspectives on emerging technology adoption within communities, Human Technology, 19, 163, 10.14254/1795-6889.2023.19-2.2 · DOI
  34. Ma, 2023, Are digital natives overconfident in their privacy literacy? Discrepancy between self-assessed and actual privacy literacy, and their impacts on privacy protection behavior, Frontiers in Psychology, 14, 10.3389/fpsyg.2023.1224168 · DOI
  35. MacCallum, 1999, Sample size in factor analysis, Psychological Methods, 4, 84, 10.1037/1082-989X.4.1.84 · DOI · Paper page
  36. Manika, 2021, Drawing on subjective knowledge and information receptivity to examine an environmental sustainability policy: Insights from the UK's bag charge policy, European Management Review, 18, 249, 10.1111/emre.12453 · DOI
  37. Markus, 2024, Effects of AI understanding-training on AI literacy, usage, self-determined interactions, and anthropomorphization with voice assistants, Computers and Education Open, 6, 10.1016/j.caeo.2024.100176 · DOI · Paper page
  38. Maydeu-Olivares, 2013, Goodness-of-fit assessment of item response theory models, Measurement: Interdisciplinary Research and Perspectives, 11, 71
  39. Maydeu-Olivares, 2006, Limited information goodness-of-fit testing in multidimensional contingency tables, Psychometrika, 71, 713, 10.1007/s11336-005-1295-9 · DOI · Paper page
  40. Mertala, 2024, Finnish 5th and 6th graders' misconceptions about artificial intelligence, International Journal of Child-Computer Interaction, 39, 10.1016/j.ijcci.2023.100630 · DOI · Paper page
  41. Messick, 1995, Validity of psychological assessment: Validation of inferences from persons' responses and performances as scientific inquiry into score meaning, American Psychologist, 50, 741, 10.1037/0003-066X.50.9.741 · DOI · Paper page
  42. Moore, 2008, The trouble with overconfidence, Psychological Review, 115, 502, 10.1037/0033-295X.115.2.502 · DOI · Paper page
  43. Moorman, 2004, Subjective knowledge, search locations, and consumer choice, Journal of Consumer Research, 31, 673, 10.1086/425102 · DOI · Paper page
  44. Nader, 2024, Public understanding of artificial intelligence through entertainment media, AI & Society, 39, 713, 10.1007/s00146-022-01427-w · DOI · Paper page
  45. Pinski, 2024, Building metaknowledge in AI literacy–the effect of gamified vs. text-based learning on AI literacy metaknowledge, 10.24251/HICSS.2024.619 · DOI
  46. Pratama, 2023, Revolutionizing education: Harnessing the power of artificial intelligence for personalized learning, Klasikal: Journal of education, language teaching and science, 5, 350, 10.52208/klasikal.v5i2.877 · DOI · Paper page
  47. Raju, 1995, Differential effects of subjective knowledge, objective knowledge, and usage experience on decision making: An exploratory investigation, Journal of Consumer Psychology, 4, 153, 10.1207/s15327663jcp0402_04 · DOI · Paper page
  48. Raju, 2007, Standardized conditional SEM: A case for conditional reliability, Applied Psychological Measurement, 31, 169, 10.1177/0146621606291569 · DOI
  49. Reeve, 2005, Applying item response theory modeling for evaluating questionnaire item and scale properties, Assessing quality of life in clinical trials: methods of practice, 2, 55, 10.1093/oso/9780198527695.003.0005 · DOI · Paper page
  50. Reise, 2009, Item response theory and clinical measurement, Annual Review of Clinical Psychology, 5, 27, 10.1146/annurev.clinpsy.032408.153553 · DOI · Paper page
  51. Robinson, 2018, Using multi‐item psychometric scales for research and practice in human resource management, Human Resource Management, 57, 739, 10.1002/hrm.21852 · DOI · Paper page
  52. Schermelleh-Engel, 2003, Evaluating the fit of structural equation models: Tests of significance and descriptive goodness-of-fit measures, Methods of psychological research online, 8, 23
  53. Sourati, 2023, Accelerating science with human-aware artificial intelligence, Nature Human Behaviour, 7, 1682, 10.1038/s41562-023-01648-z · DOI · Paper page
  54. Sternberg, 1995, A prototype view of expert teaching, Educational Researcher, 24, 9, 10.3102/0013189X024006009 · doi:10.3102/0013189x024006009 · Paper page
  55. Toker Gokce, 2024, Investigating the level of artificial intelligence literacy of university students using decision trees, Education and Information Technologies, 1
  56. Verma, 2022, An investigation of skill requirements in artificial intelligence and machine learning job advertisements, Industry and Higher Education, 36, 63, 10.1177/0950422221990990 · DOI · Paper page
  57. Wang, 2024, Artificial intelligence self-efficacy: Scale development and validation, Education and Information Technologies, 29, 4785, 10.1007/s10639-023-12015-w · DOI · Paper page
  58. Waters, 2018, Examining the interrelations among objective and subjective health literacy and numeracy and their associations with health knowledge, Journal of General Internal Medicine, 33, 1945, 10.1007/s11606-018-4624-2 · DOI
  59. Yen, 1984, Effects of local item dependence on the fit and equating performance of the three-parameter logistic model, Applied Psychological Measurement, 8, 125, 10.1177/014662168400800201 · DOI · Paper page
  60. Yim, 2024, A critical review of teaching and learning artificial intelligence (AI) literacy: Developing an intelligence-based AI literacy framework for primary school education, Computers and Education: Artificial Intelligence

Cited by

See all 30

Metadata

Authors
Markus, A., Carolus, A., & Wienrich, C.
Venue
Computers and Education: Artificial Intelligence
Publisher
Elsevier BV
Published
2025-12
Volume
9
Pages
100485
ISSN
2666-920X
Cited by
30
References
25
Language
en
Licence
Funders
Federal Republic of Germany Ministry for Labour and Social Affairs (DKI.00.00030.21)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Objective measurement of AI literacy: Development and validation of the AI competency objective scale (AICOS). https://app.cochat.ai/papers/10.1016/j.caeai.2025.100485
The paper
Markus, A., Carolus, A., & Wienrich, C. (2025). Objective measurement of AI literacy: Development and validation of the AI competency objective scale (AICOS). Computers and Education: Artificial Intelligence. https://doi.org/10.1016/j.caeai.2025.100485

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.