Curriculum-embedded AI literacy: a mixed-method study of framework implementation in undergraduate management education
Open accessThe DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index; none of the 33 sources its claims cite is checked for support yet.
Abstract
This paper reports findings from a mixed-methods study examining the integration of Generative Artificial Intelligence (GenAI) literacy within an undergraduate Business Management programme. Drawing on Zhou and Schofield’s (2024) AI literacy framework, AI-integrated learning activities were embedded across each year of study to support four dimensions of AI literacy: ’Know and Understand’, ‘Use and Apply’, ‘Evaluate and Create’, and ‘AI Ethics’. Data collected through surveys and focus groups suggest that students perceived curriculum-embedded AI activities as supporting AI literacy development; however, outcomes varied. Year 1 students reported the strongest development in the Know and Understand dimension, while Year 2 students demonstrated greater development in Use and Apply, and in Evaluate and Create. Year 3 students continued to emphasise foundational understanding, highlighting the need for greater scaffolding of advanced competencies. Engagement with AI Ethics remained comparatively limited. The study demonstrates the importance of a strategic, curriculum-wide approach to AI literacy development.
Overview
CoChat Summary
TL;DR
This mixed-methods study embedded GenAI literacy activities across three years of an undergraduate Business Management programme using Zhou and Schofield’s (2024) four-dimension AI literacy framework. Students perceived the curriculum-embedded activities as supporting AI literacy, but development varied by year and dimension, with AI Ethics consistently least reported.
Key findings
- Students’ most frequent GenAI uses were summarising information (59.8%, n = 76), information searching (55.1%, n = 70), brainstorming (46.5%, n = 59), and data analysis (33.9%, n = 43); presentation preparation (14.2%, n = 18) and systematic literature reviews (11.8%, n = 15) were less common.
- Reported AI-literacy development varied by year: Year 1 most often reported “Know and Understand AI” (71.6%), with lower “Use and Apply AI” (18.52%) and “Evaluate and Create with AI” (4.94%); Year 2 reported stronger “Use and Apply AI” (27.78%) and “Evaluate and Create with AI” (38.89%); Year 3 most often reported “Know and Understand AI” (64.29%) and fewer reported “Evaluate and Create with AI” (10.71%). Across all modules, “AI Ethics” recorded the lowest reported development, ranging from 4.94% to 11.11%.
- Students reported confidence in using GenAI tools (mean 4.00) but some difficulty with specific applications (3.63); they also reported questioning GenAI responses (3.83), evaluating evidence (3.97), and using AI to support original thinking (3.94). Lower scores were recorded for systematic problem-solving (1.26–1.39) and proactive planning (1.39). The highest-rated statement, “I find GenAI useful in my studies,” had a mean of 4.05.
- Students identified four main support needs: prompt engineering guidance, evaluating accuracy and reliability of AI outputs, enhanced technical integration of GenAI tools, and clearer guidance on appropriate AI use.
Methods
- The study embedded AI literacy across the BSc Business Management curriculum from Year 1 to Year 3 in three compulsory modules: Year 1 “Challenges in Business and Management” (e.g., Microsoft Copilot for note-taking, presentations, brainstorming, summarisation); Year 2 “Working with Business Data” (e.g., Copilot, Power BI, Bricks, Julius for data analysis, visualisation, interpretation); and Year 3 “Strategic Analysis and Practice” (GenAI within business simulations for application, evaluation, and co-creation).
- Data were collected through a structured survey administered to 127 undergraduate students, using closed-ended five-point Likert items and open-ended questions, plus four focus groups involving a total of 15 students (one Year 1, two Year 2, one Year 3).
- Quantitative survey data were analysed using descriptive statistics (frequencies, percentages, mean scores); qualitative focus-group and open-ended survey data were analysed using thematic analysis (Braun & Clarke, 2006), and findings were triangulated.
Limitations
- The paper states the study was conducted within a single institution and focused on business-related modules, which may limit transferability to other disciplinary contexts.
- The paper states the design was cross-sectional rather than longitudinal: data came from different student groups at each level rather than tracking the same cohort, so findings provide indicative evidence of progression rather than direct evidence of individual AI-literacy development.
- The paper states the study relied on self-reported perceptions and did not include objective measures of AI-literacy competence, so findings should not be interpreted as evidence of actual gains in AI literacy. Evident in the text, though not framed as a limitation by the authors, the focus groups involved only 15 students and participation was voluntary.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 Valid · 0 Not valid · 25 Not checked · 89 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Relatively high scores were recorded for questioning GenAI-generated responses (3.83), evaluating evidence (3.97), and using AI to support original thinking (3.94).”
§ Curriculum-embedded AI literacy: a mixed-method study of framework implementation in undergraduate management education > RQ2: How does the development of AI literacy influence students' learning experiences and the development of transferable skills?
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In the Year 2 module, students reported stronger development in the 'Use and Apply AI' (27.78%) and 'Evaluate and Create with AI' (38.89%) dimensions.”
§ Curriculum-embedded AI literacy: a mixed-method study of framework implementation in undergraduate management education > RQ1: Students' use of GenAI and perceived AI literacy development
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Less frequently reported uses included presentation preparation (14.2%; n = 18) and systematic literature reviews (11.8%; n = 15).”
§ Curriculum-embedded AI literacy: a mixed-method study of framework implementation in undergraduate management education > Results
plainn = 18- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Year 1 students reported the strongest development in the Know and Understand dimension, while Year 2 students demonstrated greater development in Use and Apply, and in Evaluate and Create.”
§ Curriculum-embedded AI literacy: a mixed-method study of framework implementation in undergraduate management education > Abstract
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Year 3 students continued to emphasise foundational understanding, highlighting the need for greater scaffolding of advanced competencies.”
§ Curriculum-embedded AI literacy: a mixed-method study of framework implementation in undergraduate management education > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
58 more claims
Create a free account to see all 114 claims and to verify the 28 references still open.
- It may state two separate claims as one. 27
- Probably not a substantial claim. 31
- The quote only partly states this claim. 2
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Curriculum-embedded AI literacy: a mixed-method study of framework implementation in undergraduate management education > Theoretical implications
“the dimensions proposed by Ng et al. (2003) and Zhou and Schofield (2024)”
§ Curriculum-embedded AI literacy: a mixed-method study of framework implementation in undergraduate management education > References
“Ng, D. T. K., Leung, J. K. L., Su, J., Ng, R. C. W., & Chu, S. K. W. (2023). Teachers' AI digital competencies and twenty-first century skills in the post-pandemic world.”
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
ChatGPT for good? On opportunities and challenges of large language models for education
Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · Learning and Individual Differences · doi:10.1016/j.lindif.2023.102274 · Cited by 7,326
Teachers’ AI digital competencies and twenty-first century skills in the post-pandemic world
(2023) · doi:10.1007/s11423-023-10203-6 · Cited by 734
Song, C., & Song, Y. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1260843 · Cited by 717
Artificial intelligence literacy in higher and adult education: A scoping literature review
Laupichler, M. C., Aster, A., Schirch, J., & Raupach, T. (2022) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2022.100101 · Cited by 658
Southworth, J., Migliaccio, K., Glover, J., Glover, J., Reed, D., McCarty, C., Brendemuhl, J., & Thomas, A. (2023) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2023.100127 · Cited by 647
The role of ChatGPT in higher education: Benefits, challenges, and future research directions
(2023) · Journal of Applied Learning & Teaching · doi:10.37074/jalt.2023.6.1.29 · Cited by 561
In search of artificial intelligence (AI) literacy in teacher education: A scoping review
Sperling, K., Stenberg, C.-J., McGrath, C., Åkerfeldt, A., Heintz, F., & Stenliden, L. (2024) · Computers and Education Open · doi:10.1016/j.caeo.2024.100169 · Cited by 498
AI competency framework for students
(2024) · UNESCO eBooks · doi:10.54675/jkjb9835 · Cited by 488
Exploring social constructivism: theories and practicalities
Adams, P. (2006) · Education 3-13 · doi:10.1080/03004270600898893 · Cited by 376
Research works printed but not linked: 1
- Vygotsky, L. S. (1978). Mind in society: the development of higher psychological processes. Harvard University Press.
Cited by
Refozar, R. F. G., Manalo, L. V., & Atento, R. G. (2026) · Journal of Enterprise Strategy and Management Innovation · doi:10.65166/knngcb04
Metadata
- Authors
- Schofield, L., Zhou, X., Petrov, G., & Woon, A.
- Affiliations
- Queen Mary University of London (GB)
- University of Leicester (GB)
- Monash University Malaysia (MY)
- Venue
- Journal of Learning Development in Higher Education
- Published
- 2026-09-30
- Issue
- 41
- ISSN
- 1759-667X (ISSN-L)
- OpenAlex
- W7214944314
- Semantic Scholar
- a9fcf5efe799bdf2258db828d4183492487af213
- Cited by
- 1
- References
- 22
- Citations by year
- 2026: 1
- FWCI
- 3.61
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Locations
- Journal of Learning Development in Higher Education (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Topics
- Social Sciences › Education › Digital literacy in education
- Social Sciences › Education › Artificial Intelligence in Education
- Social Sciences › Library and Information Sciences › Library Science and Information Literacy
- Keywords
- AI literacy, generative AI, curriculum integration, undergraduate management education, AI ethics, student perceptions, scaffolding, competence development
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-11-20, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-20 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Curriculum-embedded AI literacy: a mixed-method study of framework implementation in undergraduate management education. https://app.cochat.ai/papers/10.47408/jldhe.vi41.1835
- The paper
- Schofield, L., Zhou, X., Petrov, G., & Woon, A. (2026). Curriculum-embedded AI literacy: a mixed-method study of framework implementation in undergraduate management education. Journal of Learning Development in Higher Education. https://doi.org/10.47408/jldhe.vi41.1835
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
