Defining and assessing AI literacy for researchers across the research lifecycle
Open accessAbstract
Generative artificial intelligence (AI) is now embedded across the research lifecycle, from question formulation through dissemination. These systems create new opportunities for efficiency and access to knowledge. They also introduce significant risks for research integrity, reproducibility, and scholarly agency. Although existing work on AI literacy provides useful foundations, most frameworks focus on students, citizens, or general digital skills and offer limited guidance for researchers as knowledge producers. Drawing on the concept of cultural intermediaries and an established framework of functional, critical, and rhetorical literacy, this paper conceptualizes AI as a cultural intermediary in research. It argues that AI systems mediate scholarly norms, priorities, and forms of expression not through intentional curation but through structural mechanisms such as pattern reproduction, training data composition, and interface design. This extension reframes the cultural intermediary concept from an actor-centered to a function-centered one, and shifts attention from whether AI intends to shape research to whether it produces intermediary effects. Building on this framing and informed by sustained practitioner engagement with researchers across institutional contexts, we propose a capability map that defines AI literacy for researchers across functional, critical, and rhetorical dimensions and maps these capabilities across stages of the research lifecycle. An accompanying assessment rubric specifies observable behavioral indicators at three performance levels. These contributions position AI literacy as a form of scholarly practice rather than a set of technical skills, providing structured guidance for supporting responsible, transparent, and human-centered research in AI-mediated environments.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The danger is not that trainees use these tools, but that they use them in place of the foundational practice that develops critical evaluation.
“The danger is not that trainees use these tools, but that they use them in place of the foundational practice that develops critical evaluation 36 .”
From Reimagining biomedical science workflows in the age of large language models (2026) · cites this paper as [36]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Reassembling the Social: An Introduction to Actor-Network-Theory
Latour, B. (2005) · doi:10.1093/oso/9780199256044.001.0001 · Cited by 16,778 · see citing works
The weirdest people in the world?
Henrich, J., Heine, S. J., & Norenzayan, A. (2010) · Behavioral and Brain Sciences · doi:10.1017/s0140525x0999152x · Cited by 12,641 · see citing works
On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜
Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445922 · Cited by 6,988 · see citing works
What is AI Literacy? Competencies and Design Considerations
Long, D., & Magerko, B. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376727 · Cited by 3,241 · see citing works
Steps toward an ecology of infrastructure: Design and access for large information spaces
Star, S. L., & Ruhleder, K. (1996) · Information Systems Research · doi:10.1287/isre.7.1.111 · Cited by 3,238 · see citing works
How the machine “thinks”: Understanding opacity in machine learning algorithms
Burrell, J. (2016) · Big Data & Society · doi:10.1177/2053951715622512 · Cited by 3,196 · see citing works
Envisioning AI for K-12: What Should Every Child Know about AI?
Touretzky, D., Gardner-McCune, C., Martin, F., & Seehorn, D. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33019795 · Cited by 918 · see citing works
Rise of Machine Agency: A Framework for Studying the Psychology of Human–AI Interaction (HAII)
Sundar, S. S. (2020) · Journal of Computer-Mediated Communication · doi:10.1093/jcmc/zmz026 · Cited by 871 · see citing works
Academic attribution: citation and the construction of disciplinary knowledge
Hyland, K. (1999) · Applied Linguistics · doi:10.1093/applin/20.3.341 · Cited by 857 · see citing works
GPT detectors are biased against non-native English writers
Liang, W., Yuksekgonul, M., Mao, Y., Wu, E., & Zou, J. (2023) · Patterns · doi:10.1016/j.patter.2023.100779 · Cited by 673 · see citing works
Artificial intelligence literacy in higher and adult education: A scoping literature review
Laupichler, M. C., Aster, A., Schirch, J., & Raupach, T. (2022) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2022.100101 · Cited by 658 · see citing works
Southworth, J., Migliaccio, K., Glover, J., Glover, J., Reed, D., McCarty, C., Brendemuhl, J., & Thomas, A. (2023) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2023.100127 · Cited by 647 · see citing works
Fabrication and errors in the bibliographic citations generated by ChatGPT
Walters, W. H., & Wilder, E. I. (2023) · Scientific Reports · doi:10.1038/s41598-023-41032-5 · Cited by 499 · see citing works
Gardner, S. K. (2008) · The Journal of Higher Education · doi:10.1080/00221546.2008.11772101 · Cited by 456 · see citing works
Hicks, M. T., Humphries, J., & Slater, J. (2024) · Ethics and Information Technology · doi:10.1007/s10676-024-09775-5 · Cited by 456 · see citing works
The future of AI and education: Some cautionary notes
Selwyn, N. (2022) · European Journal of Education · doi:10.1111/ejed.12532 · Cited by 428 · see citing works
Knox, J. (2019) · Postdigital Science and Education · doi:10.1007/s42438-019-00045-y · Cited by 396 · see citing works
All the News That’s Fit to Fabricate: AI-Generated Text as a Tool of Media Misinformation
Kreps, S., McCain, R. M., & Brundage, M. (2022) · Journal of Experimental Political Science · doi:10.1017/xps.2020.37 · Cited by 360 · see citing works
AI competency framework for students
(2024) · UNESCO eBooks · doi:10.54675/jkjb9835 · Cited by 349 · see citing works
The CLEAR path: A framework for enhancing information literacy through prompt engineering
Lo, L. S. (2023) · The Journal of Academic Librarianship · doi:10.1016/j.acalib.2023.102720 · Cited by 347 · see citing works
Almatrafi, O., Johri, A., & Lee, H. (2024) · Computers and Education Open · doi:10.1016/j.caeo.2024.100173 · Cited by 341 · see citing works
An, Y., Yu, J. H., & James, S. (2025) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-025-00507-3 · Cited by 337 · see citing works
The Values Encoded in Machine Learning Research
Birhane, A., Kalluri, P., Card, D., Agnew, W., Dotan, R., & Bao, M. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533083 · Cited by 317 · see citing works
High Rates of Fabricated and Inaccurate References in ChatGPT-Generated Medical Content
Bhattacharyya, M., Miller, V. M., Bhattacharyya, D., & Miller, L. E. (2023) · Cureus · doi:10.7759/cureus.39238 · Cited by 294 · see citing works
Korngiebel, D. M., & Mooney, S. D. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00464-x · Cited by 259 · see citing works
Pinski, M., & Benlian, A. (2024) · Computers in Human Behavior: Artificial Humans · doi:10.1016/j.chbah.2024.100062 · Cited by 243 · see citing works
Bias of AI-generated content: an examination of news produced by large language models
Fang, X., Che, S., Mao, M., Zhang, H., Zhao, M., & Zhao, X. (2024) · Scientific Reports · doi:10.1038/s41598-024-55686-2 · Cited by 194 · see citing works
Eaton, S. E. (2023) · International Journal for Educational Integrity · doi:10.1007/s40979-023-00144-1 · Cited by 190 · see citing works
Seaver, N. (2019) · Princeton University Press eBooks · doi:10.1515/9780691190600-028 · Cited by 130
Andersen, J. P., Degn, L., Fishberg, R., Graversen, E., Horbach, S., Schmidt, E. K., Schneider, J. W., & Sørensen, M. P. (2025) · Technology and Society · doi:10.1016/j.techsoc.2025.102813 · Cited by 113 · see citing works
Seaver, N. (2019) · Princeton University Press eBooks · doi:10.2307/j.ctvc77mp9.30 · Cited by 109 · see citing works
Research integrity in the era of artificial intelligence: Challenges and responses
Chen, Z., Chen, C., Yang, G., He, X., Chi, X., Zeng, Z., & Chen, X. (2024) · Medicine · doi:10.1097/md.0000000000038811 · Cited by 109 · see citing works
Bjelobaba, S., Waddington, L., Perkins, M., Foltýnek, T., Bhattacharyya, S., & Weber-Wulff, D. (2025) · International Journal for Educational Integrity · doi:10.1007/s40979-025-00191-w · Cited by 96 · see citing works
Machine-in-the-loop writing: Optimizing the rhetorical load
Knowles, A. M. (2024) · Computers & composition/Computers and composition · doi:10.1016/j.compcom.2024.102826 · Cited by 90 · see citing works
The impact of artificial intelligence on research efficiency
Madanchian, M., & Taherdoost, H. (2025) · Results in Engineering · doi:10.1016/j.rineng.2025.104743 · Cited by 79 · see citing works
ChatGPT for Automated Writing Evaluation in Scholarly Writing Instruction
Parker, J. L., Becker, K., & Carroca, C. (2023) · Journal of Nursing Education · doi:10.3928/01484834-20231006-02 · Cited by 77 · see citing works
Self-citationHryciw, B. N., SEELY, A. J. E., & Kyeremanteng, K. (2023) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2023.1283353 · Cited by 48 · see citing works
Negotiating Meaning with Machines: AI’s Role in Doctoral Writing Pedagogy
Parker, J. L., Richard, V. M., Acabá, A., Escoffier, S., Flaherty, S., Jablonka, S., & Becker, K. P. (2024) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-024-00425-x · Cited by 46 · see citing works
Self-citationThe AI literacy heptagon: A structured approach to AI literacy in higher education
Hackl, V., Müller, A. E., & Sailer, M. (2026) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2026.100540 · Cited by 41 · see citing works
MetaWriter: Exploring the Potential and Perils of AI Writing Support in Scientific Peer Review
Sun, L., Tao, S., Hu, J., & Dow, S. P. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3637371 · Cited by 37 · see citing works
Trust in artificial intelligence: a survey experiment to assess trust in algorithmic decision-making
Orbán, F., & Stefkovics, Á. (2025) · AI & Society · doi:10.1007/s00146-025-02237-6 · Cited by 26 · see citing works
Rantisi, N. M., & Leslie, D. (2013) · Regional Studies · doi:10.1080/00343404.2013.822965 · Cited by 20 · see citing works
Tell me a story: a framework for critically investigating AI language models
Munn, L., & Henrickson, L. (2024) · Journal of Educational Media · doi:10.1080/17439884.2024.2327024 · Cited by 17 · see citing works
Zhong, Y., & Rosli, M. S. B. (2025) · International Journal of Academic Research in Progressive Education and Development · doi:10.6007/ijarped/v14-i3/25813 · Cited by 13 · see citing works
Parker, J., Richard, V. M., & Becker, K. (2023) · The Qualitative Report · doi:10.46743/2160-3715/2023.6801 · Cited by 12 · see citing works
Self-citationParker, J., Richard, V. M., & Becker, K. (2023) · The Qualitative Report · doi:10.46743/2160-3715/2023.6695 · Cited by 11 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 6
- Bathaee, Y. (2018). The artificial intelligence black box and the failure of intent and causation. Harv. J. Law. Technol. 31 (2), 889-938. Available online at: https://jolt.law. harvard.edu/assets/articlePDFs/v31/The-Artificial-Intelligence-Black-Box-and-the- Failure-of-Intent-and-Causation-Yavar-Bathaee.pdf
- Biagini, G., Cuomo, S., and Ranieri, M. (2024). Developing and validating a multidimensional AI literacy questionnaire: operationalizing AI literacy for higher education', in proceedings of the 22nd international conference of the Italian association for artificial intelligence (AIxIA 2023). CEUR. Workshop. Proc. 3605, 91-101.
- Bourdieu, P. (1984). Distinction: A Social Critique of the Judgment of Taste. Translated by R. Nice. Cambridge, MA: Harvard University Press.
- Chen, Z., Luo, Y., and Sra, M. (2025). Engaging with AI: how interface design shapes human-AI collaboration in high-stakes decision-making. arXiv. Available online at: https://arxiv.org/abs/2501.16627 · arXiv
- Hammerschmidt, T., Passlack, N., Stolz, K., and Posegga, O. (2024) 'AI Narratives: what can they tell US about individuals' AI literacy and emotional attitudes toward AI assistants?', in Proceedings of the 57th Hawaii International Conference on System Sciences, pp. 431-440. doi: 10.24251/HICSS.2024.051 · DOI
- Selber, S. (2004). Multiliteracies for a Digital age. Carbondale: Southern Illinois University Press.
Cited by
Sorted by citations
Chauncey, S. (2026) · Frontiers of Computer Science · doi:10.3389/fcomp.2026.1947835
Reimagining biomedical science workflows in the age of large language models
Roberts, K. F., Koutarapu, S., Melendez, J., Landsness, E. C., Reese, J. T., Elbert, D. L., & Bateman, R. J. (2026) · npj Dementia · doi:10.1038/s44400-026-00126-3
Using generative AI to revise articles: How much is too much?
Todd, R. W. (2026) · Applied Language Sciences · doi:10.65553/als.260108
From Algorithmic Output to Human Understanding
Saha, S., Singh, M. K., & Choudhary, P. K. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-2600-1232-1.ch013
Authorship and Legitimation in AI-Mediated Scholarship: A Reflexive Case Study of Human–AI Agency
Li, S. (2026) · Springer eBooks · doi:10.1007/60490_2026_37
Pareja, C. G. G., Pera, L. Y. P., Lizares, A. A., Rojas, L. M. H., Gomez, H., Tavera, Z. R. D., Andrade, C. P. A., Wong, F. M. R., Santana, W. M. R., Salcedo, C. M. D., et al. (2026) · Encyclopedia · doi:10.3390/encyclopedia6100209
Alzahrani, T. A., & Alqurashi, H. S. (2026) · Journal of Educational and Human Sciences · doi:10.33193/jeahs.53.2026.812
- Authors
- Parker, J. L., & Becker, K. P.
- Affiliations
- Massachusetts College of Pharmacy and Health Sciences (US)
- Midland University (US)
- Corresponding author
- Parker, Jessica L.
- ORCID
- Parker, Jessica L.
- Venue
- Frontiers in Education
- Publisher
- Frontiers Media SA
- Published
- 2026-04-28
- Volume
- 11
- ISSN
- 2504-284X (ISSN-L)
- OpenAlex
- W7157339500
- Cited by
- 5
- References
- 42
- Citations by year
- 2026: 5
- FWCI
- 81.55
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Frontiers in Education (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Social Sciences › Library and Information Sciences › Library Science and Information Literacy
- Physical Sciences › Computer Science › Information Systems › Artificial Intelligence in Education
- Physical Sciences › Computer Science › Information Systems › Digital literacy in education
- Keywords
- AI literacy, generative AI, researchers, research lifecycle, cultural intermediaries, functional literacy, critical literacy, capability map, assessment rubrics, research integrity, reproducibility, responsible AI, human-centered research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review