Integrating Generative AI into public health education: a mixed methods evaluation of student experiences
Open accessThe DOI matches its Crossref record; 37 of the 50 references it cites were found in a registry or an index; 7 of the 23 sources its claims cite were checked for support.
Abstract
Introduction: As Generative Artificial Intelligence (GenAI) continues to influence pedagogical practices in higher education, prevailing discourse has largely focused on issues of assessment integrity, often overlooking student perspectives. Yet, understanding student voices is essential to ensure that AI-enhanced teaching and assessment remain student centred, equitable, and aligned with intended learning outcomes. This study aimed to explore postgraduate health science students’ perceptions and experiences of the structured integration of GenAI into teaching and assessment within the Epidemiology and Principles of Research unit at the University of Canberra. Methods: A mixed-methods study was conducted using pre- and post-intervention surveys administered to all enrolled students, with 78 participants completing the evaluation. The intervention involved the scaffolded integration of GenAI into a critical appraisal assessment. Quantitative data were analysed using descriptive statistics and Fisher’s exact test to assess changes over time. Qualitative data from open-ended responses were analysed using thematic analysis following Braun and Clarke’s six-phase approach. Results: Students reported statistically significant improvements in their understanding of GenAI and perceived ability to use it effectively ( p < 0.001). Thematic analysis identified five key themes: tensions between automation and authentic learning; prompt literacy as a new academic skill; GenAI as a support for metacognitive engagement; ethical ambiguity and cognitive dissonance; and future-oriented learning. Conclusion: The findings highlight the importance of thoughtful pedagogical designs that center student voice, support critical engagement, and prepare learners for responsible and reflective use in future professional practice.
Overview
CoChat Summary
TL;DR
This mixed-methods evaluation of 78 postgraduate health science students found that scaffolded integration of GenAI into an epidemiology critical appraisal assessment was associated with significant gains in self-reported GenAI understanding, familiarity, and effective use. Qualitative themes highlighted tensions between automation and authentic learning, prompt literacy, metacognitive engagement, ethical ambiguity, and future-oriented learning.
Key findings
- Among 78 participants (71% response rate from 110 invited), statistically significant improvements occurred in general understanding of GenAI (moderate to extensive understanding rose from 53.4% to 88.0%), familiarity with GenAI tools (“familiar” or “very familiar” rose from 21.7% to 67.1%), and perceived ability to use GenAI effectively (“effective” or “very effective” rose from 25.0% to 55.4%), all p < 0.001.
- Concerns regarding GenAI use increased significantly, from 43.3% pre-intervention to 56.8% post-intervention (p < 0.001), and interest in receiving more GenAI training also increased from 83.0% to 87.1% (p = 0.002).
- Perceived usefulness, ease of use, feelings about integration, and belief that GenAI can improve epidemiological research did not change significantly (p = 0.760, 0.699, 0.239, and 0.753, respectively).
- Thematic analysis identified five key themes: tensions between automation and authentic learning; prompt literacy as a new academic skill; GenAI as a support for metacognitive engagement; ethical ambiguity and cognitive dissonance; and future-oriented learning.
Methods
- A convergent mixed-methods study was conducted in the Epidemiology and Principles of Research postgraduate unit at the University of Canberra in 2025; all enrolled students (n = 110) were invited, and 78 completed the evaluation.
- The intervention scaffolded GenAI (Copilot) into a critical appraisal assessment worth 40% of the final grade, with a 10% critical reflection, using a 2-hour tutorial informed by Salmon’s five-stage model, RTSI prompt writing, and the Joanna Briggs Institute appraisal tool.
- Quantitative data were analysed in Stata 16 using descriptive statistics and Fisher’s exact test; qualitative open-ended responses were analysed using Braun and Clarke’s six-phase thematic analysis in NVivo 15 with inductive coding.
Limitations
- The paper states that the evaluation relied on survey data, including open-ended responses, and did not include structured baseline measures of students’ prior engagement with conventional critical appraisal tasks or their conceptions of authentic learning, limiting direct before-and-after comparison of learning processes.
- The paper states that future research should use more in-depth qualitative approaches such as focus groups or interviews and include baseline and comparative measures.
- Evident from the text: the study was conducted in a single unit and single cohort at one university, with no priori sample size calculation; the abstract reports five themes while the Results section says “six major themes” but lists only five; and professional preparedness was not directly measured, as the paper itself notes.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
5 Valid · 1 Not valid · 13 Not checked · 56 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“There is also a lack of research examining the structured integration of GenAI into discipline-specific assessments (25), such as critical appraisal tasks in epidemiology.”
§ Integrating Generative AI into public health education: a mixed methods evaluation of student experiences > Introduction
What the sources say
- Supportedcites [25] Zhao J Chapman E Sabet PG. Generative AI and educational assessments: a systematic review. Educ Res Perspectives. (2024) 51: 124– 55. doi: 10.70953/ERPv51.2412006 source
In “Designing and piloting new assessments to meet students’ needs in an AI-driven era” (page unavailable), the review says empirical evidence for GenAI assessment redesign is limited and calls for more research across disciplines to develop evidence-based models. That supports the cited claim of a research gap; the epidemiology task is the citing authors’ example, not a finding attributed to this source. (LLM, conf=0.87)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“In line with prior research (46), students viewed GenAI as relevant to their future practice.”
§ Integrating Generative AI into public health education: a mixed methods evaluation of student experiences > Discussion
What the sources say
- Could not verifycites [46] Kaplan A. Digital Transformation and Disruption of Higher Education. Cambridge: Cambridge University Press (2022). sourceExperimental — accuracy not yet measured
The Conclusion (p. 14) argues that students need AI-related skills for the future, but it does not report students’ views. Searches for students’ perceptions of generative AI and its relevance to future practice found no passage addressing that claim. (LLM, conf=0.75)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Two, a detailed deconstruction of the assessment design of the unit’s major critical appraisal assessment task showed that students are required to engage in complex cognitive processes to demonstrate achievement of these outcomes, even when GenAI is integrated.”
§ Integrating Generative AI into public health education: a mixed methods evaluation of student experiences > Methods > GenAI integration into public health education at the University of Canberra
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“In this study, students described prompt formulation as both a technical and cognitive challenge, indicating the need for explicit instructional support within curricula (44).”
§ Integrating Generative AI into public health education: a mixed methods evaluation of student experiences > Discussion
What the sources say
- Not checked — no full text of the sourcecites [44] Knoth N Tolzin A Janson A Leimeister JM. AI literacy and its implications for prompt engineering strategies. Comput Educ Artificial Intelligence. (2024) 6: 100225. doi: 10.1016/j.caeai.2024.100225 source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Student reflections revealed a sense of tension in their engagement with GenAI.”
§ Integrating Generative AI into public health education: a mixed methods evaluation of student experiences > Results > Ethical ambiguity and cognitive dissonance
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
27 more claims
Create a free account to see all 75 claims and to verify the 2 references still open.
- Probably not a substantial claim. 22
- It may state two separate claims as one. 28
- The quote only partly states this claim. 1
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Integrating Generative AI into public health education: a mixed methods evaluation of student experiences > Results > Generative AI knowledge, attitude and experience
“Thematic analysis of the open-ended response data revealed six major themes: (i) tensions between automation and authentic learning, (ii) prompt literacy as a new academic skill, (iii) GenAI as a catalyst for metacognitive engagement, (iv) ethical ambiguity and cognitive dissonance, and (v) future-oriented learning.”
§ Integrating Generative AI into public health education: a mixed methods evaluation of student experiences > Abstract > Results
“Thematic analysis identified five key themes: tensions between automation and authentic learning; prompt literacy as a new academic skill; GenAI as a support for metacognitive engagement; ethical ambiguity and cognitive dissonance; and future-oriented learning.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“| Agree | 26(43.3) | 33(41.1) | |”
§ Integrating Generative AI into public health education: a mixed methods evaluation of student experiences > Results > Generative AI knowledge, attitude and experience
Reported 41.1 · recomputed 47.142857
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
The origins of intelligence in children.
Piaget, J. (1952) · doi:10.1037/11494-000 · Cited by 10,687
Becoming a Self-Regulated Learner: An Overview
Zimmerman, B. J. (2002) · Theory Into Practice · doi:10.1207/s15430421tip4102_2 · Cited by 10,197 · cited 1×
“As Zimmerman (41) suggests, metacognitive awareness is essential for students to plan, monitor, and evaluate their academic work.”
Guest, G., MacQueen, K., & Namey, E. (2012) · doi:10.4135/9781483384436 · Cited by 7,924
Enhancing teaching through constructive alignment
Biggs, J. (1996) · Higher Education · doi:10.1007/bf00138871 · Cited by 4,084
SOCIAL CONSTRUCTIVIST PERSPECTIVES ON TEACHING AND LEARNING
Palincsar, A. S. (1998) · Annual Review of Psychology · doi:10.1146/annurev.psych.49.1.345 · Cited by 1,565 · cited 2×
“This interaction reinforced the principles of social constructivism, where knowledge is co-constructed through dialogue and collaboration (28).”
Barker, T. H., Stone, J. C., Sears, K., Klugar, M., Tufanaru, C., Leonardi-Bee, J., Aromataris, E., & Munn, Z. (2023) · JBI Evidence Synthesis · doi:10.11124/jbies-22-00430 · Cited by 1,225 · cited 1×
“Students (36).”
McDonald, N., Johri, A., Ali, A., & Collier, A. H. (2025) · Computers in Human Behavior: Artificial Humans · doi:10.1016/j.chbah.2025.100121 · Cited by 682
McDonald, N., Johri, A., Ali, A., & Hingle, A. (2024) · arXiv · doi:10.48550/arxiv.2402.01659 · Cited by 375
AI literacy and its implications for prompt engineering strategies
Knoth, N., Tolzin, A., Janson, A., & Leimeister, J. M. (2024) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2024.100225 · Cited by 368 · cited 1×
“In this study, students described prompt formulation as both a technical and cognitive challenge, indicating the need for explicit instructional support within curricula (44).”
Digital downsides: exploring university students’ negative engagements with digital technology
Selwyn, N. (2016) · Teaching in Higher Education · doi:10.1080/13562517.2016.1213229 · Cited by 281 · cited 1×
“However, the tension students described between automation and authentic learning reflects broader concerns about the use of educational technologies, consistent with Selwyn’s caution regarding the potential for superficial engagement (42).”
Evaluating the impact of students' generative AI use in educational contexts
Wood, D., & Moss, S. H. (2024) · Journal of Research in Innovative Teaching & Learning · doi:10.1108/jrit-06-2024-0151 · Cited by 136
Bjelobaba, S., Waddington, L., Perkins, M., Foltýnek, T., Bhattacharyya, S., & Weber-Wulff, D. (2025) · International Journal for Educational Integrity · doi:10.1007/s40979-025-00191-w · Cited by 124
Zhou, X., Teng, D., & Al-Samarraie, H. (2024) · Education Sciences · doi:10.3390/educsci14121302 · Cited by 119 · cited 2×
“The survey instrument was developed in alignment with the study objectives and informed by existing literature on GenAI use in higher education (38).”
Validity matters more than cheating
Dawson, P., Bearman, M., Dollinger, M., & Boud, D. (2024) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2024.2386662 · Cited by 118
Bobula, M. (2024) · Journal of Learning Development in Higher Education · doi:10.47408/jldhe.vi30.1137 · Cited by 113
Scaffolding in Health Sciences Education Programmes: An Integrative Review
Masava, B., Nyoni, C. N., & Botma, Y. (2022) · Medical Science Educator · doi:10.1007/s40670-022-01691-x · Cited by 113
Examining faculty and student perceptions of generative AI in university courses
Kim, J., Klopfer, M., Grohs, J. R., Eldardiry, H., Weichert, J., Cox, L. A., & Pike, D. (2025) · Innovative Higher Education · doi:10.1007/s10755-024-09774-w · Cited by 109
The Art and Science of Prompt Engineering: A New Literacy in the Information Age
Lo, L. S. (2023) · Internet Reference Services Quarterly · doi:10.1080/10875301.2023.2227621 · Cited by 104 · cited 1×
“A key focus of the tutorial was the introduction of the RTSI model, a structured approach to prompt writing that includes specifying the Role, Task, Structure, and Instructions (35).”
Artificial intelligence empowering public health education: prospects and challenges
Wang, J., & Li, J. (2024) · Frontiers in Public Health · doi:10.3389/fpubh.2024.1389026 · Cited by 101 · cited 2×
“In public health education, where critical appraisal, evidence-based reasoning, and ethical judgment are foundational competencies, these questions are particularly relevant (12, 13).”
Use of generative AI by higher education students
Sousa, A. E., & Cardoso, P. (2025) · Electronics · doi:10.3390/electronics14071258 · Cited by 95 · cited 1×
“As a result, established approaches to teaching, learning, and assessment are being reconsidered within higher education contexts (4).”
Zhang, X., Zhang, P., Shen, Y., Liu, M., Wang, Q., Gašević, D., & Fan, Y. (2024) · Frontiers of Digital Education · doi:10.1007/s44366-024-0028-5 · Cited by 83 · cited 1×
“Despite growing interest in this area, there remains limited empirical evidence examining how GenAI influences learning processes and outcomes across specific disciplinary contexts, making it difficult to evaluate its educational implications (8).”
Salmon, G. (2012) · Routledge eBooks · doi:10.4324/9780203816684 · Cited by 69
Higher Education Students’ Perceptions of GenAI Tools for Learning
Daher, W., & Hussein, A. (2024) · Information · doi:10.3390/info15070416 · Cited by 66
Enhancing Classroom Engagement Through Padlet as a Learning Tool: A Case Study
Zainuddin, N. M. M., Azmi, N. F. M., Yusoff, R. C. M., et al. (2020) · International Journal of Innovative Computing · doi:10.11113/ijic.v10n1.250 · Cited by 59
Using genAI in education: the case for critical thinking
Lee, C.-C., & Low, M. Y. H. (2024) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2024.1452131 · Cited by 58 · cited 1×
“With GenAI becoming more prevalent in university settings, educators are increasingly examining its implications for teaching and assessment, particularly in disciplines where critical thinking and originality are central to learning outcomes (5).”
Heil, J., Ifenthaler, D., Cooper, M., Mascia, M. L., Conti, R., & Penna, M. P. (2025) · Smart Learning Environments · doi:10.1186/s40561-025-00395-0 · Cited by 47
Generative AI and educational assessments: a systematic review
Graduate School of Education, T. U. O. W. A., Zhao, J., Chapman, E., Sabet, P. G. P., & Global Curtin, C. U. (2024) · Education Research and Perspectives · doi:10.70953/erpv51.2412006 · Cited by 45 · cited 1×
“There is also a lack of research examining the structured integration of GenAI into discipline-specific assessments (25), such as critical appraisal tasks in epidemiology.”
Generative AI in higher education: Perspectives of students, educators and administrators
Kutty, S., Chugh, R., Perera, P., Neupane, A., Jha, M., Li, L., Gunathilake, W., & Perera, N. C. (2024) · Journal of Applied Learning and Teaching · doi:10.37074/jalt.2024.7.2.27 · Cited by 45
Higher education assessment practice in the era of generative AI tools
(2024) · Journal of Applied Learning & Teaching · doi:10.37074/jalt.2024.7.1.28 · Cited by 37 · cited 1×
“The implications of GenAI are particularly salient in the context of assessment design, where its use challenges conventional approaches to evaluating student learning (9).”
Conrad, E. J., & Hall, K. C. (2024) · Pedagogy in Health Promotion · doi:10.1177/23733799241232641 · Cited by 32 · cited 2×
“…into curricula in meaningful and ethical ways, several important questions arise regarding how students engage with these tools during assessment tasks (3), how GenAI may influence their learning processes (10), and how its use relates to the development of core disciplinary competencies (11).”
Hwang, Y., Lee, J. H., & Shin, D. (2023) · arXiv · doi:10.48550/arxiv.2311.05373 · Cited by 29
Nguyen, A., Duong, A. T., Nguyen, D. T. B., Lai, V. T. T., & Dang, B. (2025) · Information and Learning Sciences · doi:10.1108/ils-11-2024-0148 · Cited by 24
Digital Transformation and Disruption of Higher Education
(2022) · doi:10.1017/9781108979146 · Cited by 23
Global justice and the use of AI in education: ethical and epistemic aspects
Vučković, A., & Sikimić, V. (2025) · AI & SOCIETY · doi:10.1007/s00146-024-02076-x · Cited by 22 · cited 2×
“Consistent with recent research (45), participants expressed concerns related to academic integrity and environmental implications of GenAI use.”
McLaughlin, J. E., Ponte, C. D., & Lyons, K. (2025) · BMC Medical Education · doi:10.1186/s12909-025-07390-6 · Cited by 21
Ng, J., Tong, M., Tsang, E. Y. M., Chu, K., & Tsang, W. (2025) · SN Computer Science · doi:10.1007/s42979-025-04010-4 · Cited by 18
Webb, P. M., Bain, C., & Page, A. C. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108766784 · Cited by 16
Anderson, O. S., Laubepin, F. A., & August, E. T. (2024) · Pedagogy in Health Promotion · doi:10.1177/23733799241246954 · Cited by 8
The future of knowledge: conversations about artificial intelligence and epistemic insight
Billingsley, B., Grzes, M., & Annetta, L. (2025) · Science & Education · doi:10.1007/s11191-025-00636-1 · Cited by 8 · cited 1×
“Similar to earlier developments in digital literacy, prompt literacy may require students to engage more actively with how knowledge is generated and interpreted in interaction with AI systems (43).”
Leveraging generative AI to foster metacognition and self-directed learning
Lowry, B., McGrath, S., Eitel, C., Hall, H., & Clapp, T. R. (2026) · Journal of Microbiology & Biology Education · doi:10.1128/jmbe.00153-25 · Cited by 7 · cited 1×
“This is consistent with previous studies that position GenAI as supporting reflective and self-regulated learning processes in higher education (38, 40).”
Editorial: ChatGPT and other generative AI tools
Küchemann, S., Rau, M. A., Neumann, K., & Kühn, J. (2025) · Frontiers in Psychology · doi:10.3389/fpsyg.2025.1535128 · Cited by 3
The data layer: the importance of sources critical appraisal
Gorasso, V., den Borre, L. V., Scohy, A., et al. (2024) · European Journal of Public Health · doi:10.1093/eurpub/ckae144.614
Roleplaying with GenAI – The Peer Review
Denny (2024)
UnresolvedHow Generative AI is Transforming Medical Education
School (2024)
UnresolvedGenerative Artificial Intelligence in Epidemiology Teaching and Training: Students’ and Faculty Use, Perceptions, and Needs. Swiss Tropical and Public Health Institute Report
Veillat (2024)
UnresolvedThe Evolving Risk to Academic Integrity Posed by Generative Artificial Intelligence: Options for Immediate Action
Lodge (2024)
UnresolvedMind in Society
Cole (1978)
UnresolvedA Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom's Taxonomy of Educational Objectives
Anderson (2001)
UnresolvedMind in Society: The Development of Higher Psychological Processes
Vygotsky (1978)
Unresolved
Cited by
Metadata
- Authors
- Mengesha, Z., Estellore, J., Smith, J., George, M. S., McFarlane, R. A., & Parmar, J.
- Affiliations
- University of Canberra (AU)
- Learning and Teaching, University of Canberra
- Discipline of Public Health, University of Canberra
- Venue
- Frontiers in Public Health
- Publisher
- Frontiers Media SA
- Published
- 2026-07-15
- Volume
- 14
- Pages
- 1825937-1825937
- ISSN
- 2296-2565 (ISSN-L)
- PMC
- PMC13415378
- OpenAlex
- W4415790800
- Cited by
- 1
- References
- 49
- Citations by year
- 2026: 1
- FWCI
- 2.44
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Frontiers in Public Health (publishedVersion, cc-by)
- Research Square (acceptedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- PubMed Central (submittedVersion, cc-by)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
- Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
- Keywords
- generative AI, public health education, student perceptions, prompt literacy, metacognition, AI ethics, assessment integrity, artificial intelligence in higher education
- MeSH terms
- Academia, Generative Artificial Intelligence, Female, Humans, Male, Public Health, Surveys and Questionnaires
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.