Digital affordances of AI chatbots in nursing education: a systematic review of learning gains and gaps in the evidence
Open accessThe DOI matches its Crossref record; 70 of the 73 references it cites were found in a registry or an index; 40 of the 64 sources its claims cite were checked for support.
Abstract
Background: Digital affordances refer to the possibilities provided by digital environments for learners. In the context of nursing education, artificial intelligence (AI) chatbots currently offer multimodal learning approaches and demonstrate various possibilities for digital actions. Therefore, exploring the digital affordances of AI chatbots in nursing education is crucial for the continuous advancement of the field. Objective: To evaluate the digital affordances of AI chatbots in nursing education, focusing on the relationship between digital affordances and learning gains. Methods: We employed affordance theory to conceptualize the potential actions of AI chatbots and utilized a taxonomy of affective, behavioral and cognitive learning gains to conduct a systematic review in nursing education. Results and conclusions: A total of 25 studies were identified in this systematic review. The geographical distribution of the studies is mainly in Asia. The most used study designs were quantitative designs ( n = 12) with sample sizes between 16 and 457. The duration of these studies is usually short, ranging from a few hours to 3 months. The included studies reported several digital affordances of AI chatbots in nursing education, including assistance provision, personalization, human-like conversing, distilling information, and fostering familiarity. However, four digital affordances-facilitation, enriching information, context identification, and ensuring privacy-still lack empirical support. The evidence for the digital affordances of AI chatbots in nursing education was dominated by cognitive learning gains (such as learning achievement, critical thinking, and problem solving) and followed by affective (such as learning interest, self-efficacy, and enjoyment) and behavioral learning gains (such as engagement, diagnostic skills and clinical practice). However, several studies reported no statistically significant improvement in certain cognitive learning gains, particularly knowledge acquisition and clinical reasoning competency. Similarly, limited evidence was found for improvements in learners’ confidence and satisfaction. These findings suggest that the current evidence remains inconclusive. Future research should employ longer study durations and larger sample sizes to further examine the educational impact of AI chatbots.
Overview
CoChat Summary
TL;DR
This systematic review of 25 studies maps the digital affordances of AI chatbots in nursing education and their links to affective, behavioral, and cognitive learning gains. It finds strong evidence for assistance provision and personalization but concludes that the overall evidence remains inconclusive, with several affordances lacking empirical support and some learning outcomes showing no significant improvement.
Key findings
- Across 25 included studies, the most common study design was quantitative (n = 12), sample sizes ranged from 16 to 457, and study durations ranged from a few hours to 3 months; the geographical distribution was mainly in Asia.
- Five digital affordances were identified: assistance provision, personalization, human-like conversing, distilling information, and fostering familiarity. Assistance provision was the most common (n = 15), while four affordances—facilitation, enriching information, context identification, and ensuring privacy—still lacked empirical support.
- Evidence was dominated by cognitive learning gains (14 of 18 related affordances), followed by affective (12) and behavioral (9) learning gains. Reported gains included learning achievement, critical thinking, problem solving, learning interest, self-efficacy, enjoyment, engagement, diagnostic skills, and clinical practice.
- Some studies reported no statistically significant improvement in certain cognitive learning gains, particularly knowledge acquisition and clinical reasoning competency, and limited evidence was found for improvements in learners’ confidence and satisfaction.
Methods
- Systematic review searching PubMed and Web of Science in November–December 2025; 323 records were identified, 88 duplicates removed, 235 records screened, 205 excluded, 30 full texts assessed, 5 excluded, and 25 studies included.
- Inclusion used a PIOS framework: nurses and nursing students; interventions involving AI chatbots or similar dialogue systems; outcomes concerning use as an educational or training tool; all study designs; no direct comparator group specified.
- Analysis used affordance theory and a simplified coding framework based on Mygland et al.’s high-level digital affordances, combined with the ABC taxonomy of affective, behavioral, and cognitive learning gains.
Limitations
- Stated in the paper: study durations were usually short (a few hours to 3 months), sample sizes were small (16–457), some studies did not specify technical details, and 6 studies did not specify their research methodology; the current evidence remains inconclusive.
- Stated in the paper: four high-level affordances lacked empirical support, behavioral learning gains were less studied, and some cognitive and affective outcomes showed no significant improvement.
- Evident from the text: the search was restricted to PubMed and Web of Science, and no risk-of-bias or formal quality appraisal is reported; Table 4 also shows missing data for sample size (n = 9), duration (n = 10), and research design (n = 7).
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
26 Valid · 1 Not valid · 12 Not checked · 60 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Secondly, the veracity of professional information dispensed by AI chatbots in nursing education is yet to be ascertained (51).”
§ Digital affordances of AI chatbots in nursing education: a systematic review of learning gains and gaps in the evidence > Discussion > RQ1: What digital affordances do AI chatbots provide in nursing education?
What the sources say
- Partly supportedcites [51] Busch F Hoffmann L Rueger C van Dijk EH Kader R Ortiz-Prado E. Current applications and challenges in large language models for patient care: a systematic review. Commun Med. (2025) 5: 26. doi: 10.1038/s43856-024-00717-2 39838160 PMC11751060 sourceExperimental — accuracy not yet measured
The Discussion (page not provided) says LLMs are not yet reliable enough for autonomous medical use and calls for oversight of their outputs. That supports concern about the veracity of chatbot information generally, but the review addresses patient care, not the accuracy of professional information dispensed in nursing education. (LLM, conf=0.86)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“However, fewer studies (16) have reported significant changes in students’ affective learning gains (e.g., confidence and satisfaction) or cognitive learning gains (e.g., knowledge and clinical reasoning competency).”
§ Digital affordances of AI chatbots in nursing education: a systematic review of learning gains and gaps in the evidence > Discussion > RQ2: What types of evidence have been employed to assess the impact of AI chatbots on learning gains in nursing education?
What the sources say
- Partly supportedcites [16] Han J-W Park J Lee H. Analysis of the effect of an artificial intelligence chatbot educational program on non-face-to-face classes: a quasi-experimental study. BMC Med Educ. (2022) 22: 830. doi: 10.1186/s12909-022-03898-3, 36457086 PMC9713176 sourceExperimental — accuracy not yet measured
The Abstract Results and Results > Hypothesis testing report no statistically significant differences between groups in confidence, feedback satisfaction, knowledge, or clinical reasoning competency. The Discussion also notes a lack of comparable studies measuring clinical reasoning competency. These passages support the cited study as an example, but do not establish the broader claim that fewer studies have reported significant changes across those outcomes. (LLM, conf=0.83)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“However, one study found no significant change in affective learning gains related to nursing students’ confidence and satisfaction (16).”
§ Digital affordances of AI chatbots in nursing education: a systematic review of learning gains and gaps in the evidence > Results > Relationships between digital affordances and learning gains
What the sources say
- Supportedcites [16] Han J-W Park J Lee H. Analysis of the effect of an artificial intelligence chatbot educational program on non-face-to-face classes: a quasi-experimental study. BMC Med Educ. (2022) 22: 830. doi: 10.1186/s12909-022-03898-3, 36457086 PMC9713176 source
The Abstract Results report no statistically significant differences between the chatbot and control groups in confidence or feedback satisfaction. The Results’ Hypothesis testing table shows that confidence gains did not differ significantly between groups (p = .264); feedback satisfaction was measured after the program and also did not differ significantly (p = .090). (LLM, conf=0.88)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“However, one study reported no statistically significant improvement in cognitive learning gains related to nursing students’ knowledge and clinical reasoning competency (16).”
§ Digital affordances of AI chatbots in nursing education: a systematic review of learning gains and gaps in the evidence > Results > Relationships between digital affordances and learning gains
What the sources say
- Supportedcites [16] Han J-W Park J Lee H. Analysis of the effect of an artificial intelligence chatbot educational program on non-face-to-face classes: a quasi-experimental study. BMC Med Educ. (2022) 22: 830. doi: 10.1186/s12909-022-03898-3, 36457086 PMC9713176 source
The Discussion (page not provided) reports no statistically significant between-group difference in nursing students’ EFM knowledge or clinical reasoning competency after the chatbot program. This supports the claim about the absence of significant improvement relative to the control group. (LLM, conf=0.93)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Furthermore, ethical concerns may arise from employing AI chatbots in delicate domains pertaining to patient care, privacy, and confidentiality (52–54).”
§ Digital affordances of AI chatbots in nursing education: a systematic review of learning gains and gaps in the evidence > Discussion > RQ1: What digital affordances do AI chatbots provide in nursing education?
What the sources say
- Supportedcites [52] Chen Y Esmaeilzadeh P. Generative AI in medical practice: in-depth exploration of privacy and security challenges. J Med Internet Res. (2024) 26: e53008. doi: 10.2196/53008, 38457208 PMC10960211 source
The Virtual Health Assistants section says conversational agents respond to patient questions and concerns, while identifying privacy and information accuracy as challenges. The Security Objectives subsection also names confidentiality and privacy protection as objectives for health AI systems. Page numbers were not provided in our copy. (LLM, conf=0.91)
- Supportedcites [53] Haltaufderheide J Ranisch R. The ethics of ChatGPT in medicine and healthcare: a systematic review on large language models (LLMs). npj Digit Med. (2024) 7: 183. doi: 10.1038/s41746-024-01157-x, 38977771 PMC11231310 source
The Introduction describes healthcare as particularly sensitive to ethical dilemmas involving LLMs, including patient-data privacy and potential harm to patients. Results > Clinical applications explicitly identifies confidentiality, privacy, and data security concerns when patient data are processed, especially by models such as ChatGPT. (LLM, conf=0.94)
- Supportedcites [54] Hua S Jin S Jiang S. The limitations and ethical considerations of ChatGPT. Data Intell. (2024) 6: 201– 39. doi: 10.1162/dint_a_00243 source
Section 3.1.1 warns that erroneous ChatGPT-generated drug instructions could endanger patients. Sections 3.4.2 and 4.3.3 address leakage of sensitive user information and the need to protect data confidentiality. Together, these passages support the hedged claim about concerns in patient care, privacy, and confidentiality; page numbers are unavailable in our copy. (LLM, conf=0.90)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
56 more claims · 8 with their cited sources checked
Create a free account to see all 99 claims and every source verdict.
- It may state two separate claims as one. 29
- Probably not a substantial claim. 15
- The quote only partly states this claim. 1
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Digital affordances of AI chatbots in nursing education: a systematic review of learning gains and gaps in the evidence > Discussion > RQ2: What types of evidence have been employed to assess the impact of AI chatbots on learning gains in nursing education?
“However, there is a lack of evidence supporting the role of related affordances provided by AI chatbots, such as error reduction, feedback, flow maintenance, and comfort growth in enhancing cognitive learning gains.”
§ Digital affordances of AI chatbots in nursing education: a systematic review of learning gains and gaps in the evidence > Results > Relationships between digital affordances and learning gains
“| Distilling information | Flow maintenance | | ✓ | ✓ |”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Digital affordances of AI chatbots in nursing education: a systematic review of learning gains and gaps in the evidence > Discussion
“Three qualitative studies explored students’ perceptions, attitudes, and experiences with chatbots. Four mixed-methods studies evaluated multi-dimensional learning gains. However, another 6 studies did not specify their research methodology”
§ Digital affordances of AI chatbots in nursing education: a systematic review of learning gains and gaps in the evidence > Results
“| Qualitative (interviews) | 2 | | Mixed methods (document-analysis, usability tests, cross-sectional technology validation study) | 4 | | No information available | 7 |”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Digital affordances of AI chatbots in nursing education: a systematic review of learning gains and gaps in the evidence > Results > Relationships between digital affordances and learning gains
“However, research on using AI chatbots for distilling information (n = 1) and enhancing familiarity (n = 1) to support cognitive learning gains is still limited.”
§ Digital affordances of AI chatbots in nursing education: a systematic review of learning gains and gaps in the evidence > Results > Relationships between digital affordances and learning gains
“including assistance provision (n = 7), personalization (n = 3), human-like conversing (n = 2), and distilling information (n = 2).”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Digital affordances of AI chatbots in nursing education: a systematic review of learning gains and gaps in the evidence > Results > Relationships between digital affordances and learning gains
“However, research on using AI chatbots for distilling information (n = 1) and enhancing familiarity (n = 1) to support cognitive learning gains is still limited.”
§ Digital affordances of AI chatbots in nursing education: a systematic review of learning gains and gaps in the evidence > Results > Relationships between digital affordances and learning gains
“| Fostering familiarity | Emotional connection | ✓ | ✓ | | | Fostering familiarity | Comfort growth | ✓ | | |”
Citations
Cites
The Ecological Approach to Visual Perception: Classic Edition
Gibson, J. J. (2014) · doi:10.4324/9781315740218 · Cited by 12,132
Haddaway, N. R., Page, M. J., Pritchard, C. C., & McGuinness, L. A. (2022) · Campbell Systematic Reviews · doi:10.1002/cl2.1230 · Cited by 3,486
Methley, A. M., Campbell, S., Chew-Graham, C., McNally, R., & Cheraghi-Sohi, S. (2014) · BMC Health Services Research · doi:10.1186/s12913-014-0579-0 · Cited by 2,706 · cited 1×
“The inclusion criteria for this study were established using the PIOS framework (see Table 2), which is adapted from the widely used PICOS (participants, interventions, comparators, outcomes, and study design) strategy (36).”
Generative AI and ChatGPT: applications, challenges, and AI-human collaboration
Fui-Hoon Nah, F., Zheng, R., Cai, J., Siau, K., & Chen, L. (2023) · Journal of Information Technology Case and Application Research · doi:10.1080/15228053.2023.2233814 · Cited by 1,363
Bentley University, U., Markus, M. L., Silver, M., & Fordham University (2008) · Journal of the Association for Information Systems · doi:10.17705/1jais.00176 · Cited by 927 · cited 1×
“We conceptualize digital affordance as “the possibility of goal-oriented action offered to a specific group of users through a technological object” (38).”
Interacting with educational chatbots: A systematic review
Kuhail, M. A., Alturki, N., Alramlawi, S., & Alhejori, K. (2023) · Education and Information Technologies · doi:10.1007/s10639-022-11177-3 · Cited by 841
Huang, W., Hew, K. F., & Fryer, L. K. (2022) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12610 · Cited by 830 · cited 2×
“This finding aligns with the existing view that chatbots have the potential to promote learners’ development and evaluation (31, 32, 47, 48).”
Jeon, J., & Lee, S. (2023) · Education and Information Technologies · doi:10.1007/s10639-023-11834-1 · Cited by 696 · cited 7×
“For instance, ANCOVA analysis in Chang et al. (19) revealed that 50 nursing students using a CIDI model-based ChatGPT learning method scored significantly higher in problem-solving skills than those using conventional learning methods.”
InfluentialChen, Y., Jensen, S., Albert, L. J., Gupta, S., & Lee, T. (2023) · Information Systems Frontiers · doi:10.1007/s10796-022-10291-4 · Cited by 685 · cited 2×
“…data, issues of accuracy, reliability, and potential bias remain a concern (11); there has been a lack of content and programs for instruction using chatbots (12); and there are concerns about over-reliance on technology, such as issues with plagiarism and limiting critical thinking skills (13).”
Do AI chatbots improve students learning outcomes? Evidence from a meta‐analysis
Wu, R., & Yu, Z. (2024) · British Journal of Educational Technology · doi:10.1111/bjet.13334 · Cited by 576 · cited 2×
“Due to the increasing popularity of AI chatbots, some empirical studies have explored their effects on students’ learning gains (4).”
Preiksaitis, C., & Rose, C. (2023) · JMIR Medical Education · doi:10.2196/48785 · Cited by 552
Ethical Considerations of Using ChatGPT in Health Care
Wang, C., Liu, S., Yang, H., Guo, J., Wu, Y., & Liu, J. (2023) · Journal of Medical Internet Research · doi:10.2196/48009 · Cited by 541 · cited 1×
“Furthermore, the introduction of AI may raise patient privacy and ethical concerns (57), and traditional teaching philosophies could hinder the adoption of new technologies (58).”
A review of opportunities and challenges of chatbots in education
Hwang, G.-J., & Chang, C.-Y. (2023) · Interactive Learning Environments · doi:10.1080/10494820.2021.1952615 · Cited by 530
Chatbot learning partners: connecting learning experiences, interest and competence
Fryer, L. K., Nakao, K., & Thompson, A. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2018.12.023 · Cited by 470 · cited 1×
“The concept of digital affordance is therefore relevant and takes into account (1) the competencies and learning goals of nursing students and (2) the characteristics of the AI chatbot (39).”
Human-AI collaboration patterns in AI-assisted academic writing
Nguyen, A., Hong, Y., Dang, B., & Huang, X. (2024) · Studies in Higher Education · doi:10.1080/03075079.2024.2323593 · Cited by 449
Rao, A., Pang, M., Kim, J., Kamineni, M., Lie, W., Prasad, A. K., Landman, A., Dreyer, K., & Succi, M. D. (2023) · Journal of Medical Internet Research · doi:10.2196/48659 · Cited by 412
Haltaufderheide, J., & Ranisch, R. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01157-x · Cited by 396
Current applications and challenges in large language models for patient care: a systematic review
Busch, F., Hoffmann, L., Rueger, C., van Dijk, E. H., Kader, R., Ortiz-Prado, E., Makowski, M. R., Saba, L., Hadamitzky, M., Kather, J. N., et al. (2025) · Communications Medicine · doi:10.1038/s43856-024-00717-2 · Cited by 358 · cited 6×
“…include: since ChatGPT responses are based on patterns learned from data, issues of accuracy, reliability, and potential bias remain a concern (11); there has been a lack of content and programs for instruction using chatbots (12); and there are concerns about over-reliance on technology,…”
InfluentialGenerative AI in medical practice: in-depth exploration of privacy and security challenges
Chen, Y., & Esmaeilzadeh, P. (2024) · Journal of Medical Internet Research · doi:10.2196/53008 · Cited by 353
Chocarro, R., Cortiñas, M., & Marcos-Matás, G. (2023) · Educational Studies · doi:10.1080/03055698.2020.1850426 · Cited by 343 · cited 1×
“Moreover, chatbots in educational programs have been described using various terms, including “Conversational Agents” (32), “AI agent” (33), “artificial intelligent agent” (34) and “ChatGPT” (35).”
Chang, C., Hwang, G., & Gau, M. (2022) · British Journal of Educational Technology · doi:10.1111/bjet.13158 · Cited by 294 · cited 3×
“Another study demonstrated that AI chat-bots enhanced students’ learning performance and self-efficacy in obstetric vaccine education by engaging with case-based scenarios (18).”
Someone out there? A study on the social presence of anthropomorphized chatbots
Konya-Baumbach, E., Biller, M., & von Janda, S. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107513 · Cited by 283 · cited 1×
“Lastly, certain individuals persist in favoring conventional teaching methodologies, posing conceptual obstacles to the adoption of novel technologies, as they are inclined to view chatbots solely as utilitarian devices rather than as collaborative educational partners (55).”
Hew, K. F., Huang, W., Du, J., & Jia, C. (2023) · Journal of Computing in Higher Education · doi:10.1007/s12528-022-09338-x · Cited by 245 · cited 2×
“The results indicate that the usage scenarios of AI chatbots involve dialogue facilitation, intent understanding, and providing instant feedback (37), with both short-term and long-term interventions potentially improving learning gains.”
Shorey, S., Ang, E., Yap, J., Ng, E. D., Lau, S. T., & Chui, C. K. (2019) · Journal of Medical Internet Research · doi:10.2196/14658 · Cited by 238 · cited 4×
“Several studies have utilized AI chatbots in various methods to assess the quality of nursing education (25), such as Han et al. (16), who employed AI chatbots for assessing skills in electronic fetal monitoring, and Shorey et al. (17), who used AI chatbots in patient communication simulations.”
InfluentialThe Role of Large Language Models in Medical Education: Applications and Implications
Safranek, C. W., Sidamon-Eristoff, A. E., Gilson, A., & Chartash, D. (2023) · JMIR Medical Education · doi:10.2196/50945 · Cited by 233 · cited 1×
“With rapid advances in generative pretraining transformer (GPT) technology, the application of AI chatbots in nursing education has opened up new possibilities for goal-oriented actions (1–4), sparking extensive academic discussions on their innovative applications (5–7).”
Tam, W., Huynh, T., Tang, A., Luong, S., Khatri, Y., & Zhou, W. (2023) · Nurse Education Today · doi:10.1016/j.nedt.2023.105917 · Cited by 221 · cited 1×
“…data, issues of accuracy, reliability, and potential bias remain a concern (11); there has been a lack of content and programs for instruction using chatbots (12); and there are concerns about over-reliance on technology, such as issues with plagiarism and limiting critical thinking skills (13).”
The impact of educational chatbot on student learning experience
Ait Baha, T., El Hajji, M., Es-Saady, Y., & Fadili, H. (2024) · Education and Information Technologies · doi:10.1007/s10639-023-12166-w · Cited by 206
Xia, Q., Chiu, T. K. F., Chai, C. S., & Xie, K. (2023) · British Journal of Educational Technology · doi:10.1111/bjet.13305 · Cited by 203
Stokes, F., & Palmer, A. (2020) · Nursing Philosophy · doi:10.1111/nup.12306 · Cited by 200 · cited 1×
“This phenomenon might stem from the strong tradition of human-to-human interaction in nursing education, leading to resistance towards replacing or supplementing these interactions with AI chat-bots (49).”
Han, J.-W., Park, J., & Lee, H. (2022) · BMC Medical Education · doi:10.1186/s12909-022-03898-3 · Cited by 187
Kumar, J. A. (2021) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-021-00302-w · Cited by 183 · cited 1×
“This finding supports existing research that calls for further exploration and optimization of chat-bot technology in education (45, 46).”
Guo, K., Pan, M., Li, Y., & Lai, C. (2024) · The Internet and Higher Education · doi:10.1016/j.iheduc.2024.100962 · Cited by 173 · cited 1×
“For instance, researchers have reported that AI-based chatbots can significantly improve learners’ metacognitive awareness (40).”
Choi, E. P. H., Lee, J. J., Ho, M.-H., Kwok, J. Y. Y., & Lok, K. Y. W. (2023) · Nurse Education Today · doi:10.1016/j.nedt.2023.105796 · Cited by 172
Assessing the utility of ChatGPT throughout the entire clinical workflow
Rao, A., Pang, M., Kim, J., Kamineni, M., Lie, W., Prasad, A. K., Landman, A., Dreyer, K. J., & Succi, M. D. (2023) · doi:10.1101/2023.02.21.23285886 · Cited by 134
The limitations and ethical considerations of ChatGPT
Hua, S., Jin, S., & Jiang, S. (2024) · Data Intelligence · doi:10.1162/dint_a_00243 · Cited by 120 · cited 1×
“Furthermore, ethical concerns may arise from employing AI chat-bots in delicate domains pertaining to patient care, privacy, and confidentiality (52–54).”
Moons, P., & Van Bulck, L. (2023) · European Journal of Cardiovascular Nursing · doi:10.1093/eurjcn/zvad022 · Cited by 118
McIntosh, T. R., Susnjak, T., Liu, T., Watters, P., Xu, D., Liu, D., & Halgamuge, M. N. (2025) · Technologies · doi:10.3390/technologies13020051 · Cited by 102 · cited 1×
“With rapid advances in generative pretraining transformer (GPT) technology, the application of AI chatbots in nursing education has opened up new possibilities for goal-oriented actions (1–4), sparking extensive academic discussions on their innovative applications (5–7).”
Knote, R., Research Center for IS Design (ITeG), U. O. K., Janson, A., Institute of Information Management, U. O. S. G., Söllner, M., Research Center for IS Design (ITeG), U. O. K., Leimeister, J. M., & Research Center for IS Design (ITeG), U. O. K. (2021) · Journal of the Association for Information Systems · doi:10.17705/1jais.00667 · Cited by 102
Sáiz-Manzanares, M. C., Marticorena-Sánchez, R., Martín-Antón, L. J., González Díez, I., & Almeida, L. (2023) · Heliyon · doi:10.1016/j.heliyon.2023.e12843 · Cited by 96 · cited 10×
“Similarly, personalization ( n = 3) by AI chatbots was found to significantly enhance nursing students’ prior knowledge and academic performance (25, 28).”
InfluentialProposing a Principle-Based Approach for Teaching AI Ethics in Medical Education
Weidener, L., & Fischer, M. (2024) · JMIR Medical Education · doi:10.2196/55368 · Cited by 90 · cited 1×
“When adopting new technologies in nursing education and practice, factors such as ethics, privacy, and professional development must be carefully weighed (61).”
Gunawan, J., Aungsuroch, Y., & Montayre, J. (2024) · Nurse Education Today · doi:10.1016/j.nedt.2024.106323 · Cited by 90 · cited 1×
“Second, integrating AI chatbots into traditional nursing education is involved complex and dynamic interactions, and the interplay between teachers, students, and AI chatbots remains insufficiently clarified (19, 20).”
Dever, D. A., Sonnenfeld, N. A., Wiedbusch, M. D., Schmorrow, S. G., Amon, M. J., & Azevedo, R. (2023) · Metacognition and Learning · doi:10.1007/s11409-023-09346-x · Cited by 83 · cited 1×
“Future research could employ methods such as sequence clustering, process mining, self-report questionnaires, trace data, and lag sequential analysis to provide clearer insights into the concept of “learning gains” for both teachers and students (28, 63–65).”
Making sense of learning gain in higher education
Evans, C., Kandiko Howson, C., & Forsythe, A. (2018) · Higher Education Pedagogies · doi:10.1080/23752696.2018.1508360 · Cited by 81
Liang, H., Hwang, G., Hsu, T., & Yeh, J. (2024) · British Journal of Educational Technology · doi:10.1111/bjet.13448 · Cited by 78 · cited 2×
“In one study, an AI chatbot named Eva was integrated into an online peer review system, significantly improving the quality of student feedback (41).”
Value-Added Modeling and Educational Accountability: Are We Answering the Real Questions?
Everson, K. C. (2017) · Review of Educational Research · doi:10.3102/0034654316637199 · Cited by 68 · cited 1×
“Lastly, it remains uncertain to what extent the digital affordances of AI chatbot contributes to measurable learning gains, and there is a need to analyze and distinguish these learning gains and their assessment methods (21, 22).”
Reviewing affective, behavioural and cognitive learning gains in higher education
Rogaten, J., Rienties, B., Sharpe, R., Cross, S., Whitelock, D., Lygo-Baker, S., & Littlejohn, A. (2019) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2018.1504277 · Cited by 67 · cited 6×
“A possible reason is that current studies using pre-post test and qualitative focus group inter-views to measure cognitive learning gains (16, 24), which primarily assess students’ performances in areas such as prior knowledge (28), learning achievement (18), academic performance (25), critical…”
InfluentialQualitative exploration of digital chatbot use in medical education: A pilot study
Kaur, A., Singh, S., Chandan, J. S., Robbins, T., & Patel, V. (2021) · DIGITAL HEALTH · doi:10.1177/20552076211038151 · Cited by 67
The Role and Potential Contributions of the Artificial Intelligence Language Model ChatGPT
Berşe, S., Akça, K., Dirgar, E., & Kaplan Serin, E. (2024) · Annals of Biomedical Engineering · doi:10.1007/s10439-023-03296-w · Cited by 63 · cited 1×
“Potential reasons could include the following: Firstly, nursing education aims to cultivate professional competencies such as nursing skills, clinical experiences, and critical thinking, which current AI chatbots find challenging to simulate in authentic clinical nursing environments (50).”
Facilitating nursing and health education by incorporating ChatGPT into learning designs
Chang (2024) · DOAJ (DOAJ: Directory of Open Access Journals) · doi:10.30191/ets.202401_27(1).tp02 · Cited by 61
Chow, J. C. L., Wong, V., Sanders, L., & Li, K. (2023) · Healthcare · doi:10.3390/healthcare11172417 · Cited by 60
Durmuş Sarıkahya, S., Özbay, Ö., Torpuş, K., Usta, G., & Çınar Özbay, S. (2025) · Nurse Education Today · doi:10.1016/j.nedt.2025.106755 · Cited by 60
How affordances of chatbots cross the chasm between social and traditional enterprise systems
Stoeckli, E., Dremel, C., Uebernickel, F., & Brenner, W. (2020) · Electronic Markets · doi:10.1007/s12525-019-00359-6 · Cited by 55 · cited 1×
“The application of AI chatbots has significantly expanded the scope of nursing education, offering students new goal-oriented action possibilities (i.e., affordances) (14).”
Noble, J. M., Zamani, A., Gharaat, M., Merrick, D., Maeda, N., Lambe Foster, A., Nikolaidis, I., Goud, R., Stroulia, E., Agyapong, V. I. O., et al. (2022) · JMIR Research Protocols · doi:10.2196/33717 · Cited by 53 · cited 1×
“…studies have revealed that AI chatbots facilitate well-designed multimodal conversations that can effectively assist in a variety of areas such as patient intervention (8), postoperative support (9), and psychiatric care (10), which has attracted great interest in nursing education research (3).”
Perceptions of science graduating students on their learning gains
Varsavsky, C., Matthews, K. E., & Hodgson, Y. (2014) · International Journal of Science Education · doi:10.1080/09500693.2013.830795 · Cited by 53 · cited 1×
“However, there are fewer learning gains have been studied for behavioral change, but some researchers believe that behavioral learning gains deserve further study and that skill development and engagement are as important as knowledge acquisition (37, 42, 43).”
Maurya, R. K. (2024) · Counselling and Psychotherapy Research · doi:10.1002/capr.12699 · Cited by 51 · cited 1×
“This aligns with existing research conclusions that AI currently struggles to realistically simulate clinical scenarios and provide reliable professional information (56).”
Riedel, M., Kaefinger, K., Stuehrenberg, A., Ritter, V., Amann, N., Graf, A., Recker, F., Klein, E., Kiechle, M., Riedel, F., et al. (2023) · Frontiers in Medicine · doi:10.3389/fmed.2023.1296615 · Cited by 49 · cited 2×
“Reported growth in behavioral learning gains encompasses self-directed learning (16), diagnostic skills (44), clinical practice (26), engagement (19), and chat-bot usage frequency (28).”
Mastering medical terminology with ChatGPT and Termbot
Hsu, M.-H. (2024) · Health Education Journal · doi:10.1177/00178969231197371 · Cited by 47
Vermunt, J. D., Ilie, S., & Vignoles, A. (2018) · Higher Education Pedagogies · doi:10.1080/23752696.2018.1484672 · Cited by 46 · cited 3×
“Lastly, it remains uncertain to what extent the digital affordances of AI chatbot contributes to measurable learning gains, and there is a need to analyze and distinguish these learning gains and their assessment methods (21, 22).”
Termbot: A Chatbot-Based Crossword Game for Gamified Medical Terminology Learning
Hsu, M.-H., Chan, T.-M., & Yu, C.-S. (2023) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph20054185 · Cited by 41
Boztepe, H., Akdeniz Kudubeş, A., Semerci Şahin, R., Durmuş Sarıkahya, S., & Çınar Özbay, S. (2025) · Nurse Education in Practice · doi:10.1016/j.nepr.2025.104568 · Cited by 38 · cited 2×
“In addition, AI literacy is incorporated to account for nursing students’ knowledge, skills, and attitudes required to effectively understand, evaluate, and interact with AI chatbots (31).”
Moussawi, S. (2018) · ACM SIGCPR Conference on Computer Personnel Research (SIGCPR) · doi:10.1145/3209626.3209709 · Cited by 37
Affordances in Human-Chatbot Interaction: A Review of the Literature
Mygland, M. J., Schibbye, M., Pappas, I. O., & Vassilakopoulou, P. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-85447-8_1 · Cited by 34
Language teachers’ beliefs about using high-immersion virtual reality
Kaplan-Rakowski, R., Dhimolea, T. K., & Khukalenko, I. S. (2023) · Education and Information Technologies · doi:10.1007/s10639-023-11686-9 · Cited by 31 · cited 1×
“Furthermore, the introduction of AI may raise patient privacy and ethical concerns (57), and traditional teaching philosophies could hinder the adoption of new technologies (58).”
Barnett, A. G., Herbert, D. L., Campbell, M., et al. (2015) · BMC Health Services Research · doi:10.1186/s12913-015-0721-7 · Cited by 30
Students’ Perceptions on Chatbots’ Potential and Design Characteristics in Healthcare Education
Natalia, S., Sokratis, N., Klas, K., Konstantinidis Stathis, T., Bamidis Panagiotis, D., Pattichis Constantinos, S., & Nadia, D. (2020) · Studies in Health Technology and Informatics · doi:10.3233/shti200531 · Cited by 29 · cited 1×
“Previous literature has indicated that AI chatbots in nursing education provide nursing students with various digital learning opportunities (15).”
Chen, Y., Lin, Q., Chen, X., Liu, T., Ke, Q., Yang, Q., Guan, B., & Ming, W.-K. (2023) · Digital Health · doi:10.1177/20552076231185435 · Cited by 24
Otero‐Agra, M., Jorge-Soto, C., Cobos, O. J. C., Blanco-Prieto, J., Alfaya-Fernández, C., Ordóñez, E. G., & Barcala‐Furelos, R. (2022) · The American Journal of Emergency Medicine · doi:10.1016/j.ajem.2022.09.013 · Cited by 16
Londral, A., Azevedo, S., Dias, P., Ramos, C., Santos, J., Martins, F., Silva, R., Semedo, H., Vital, C., Gualdino, A., et al. (2022) · BMC Health Services Research · doi:10.1186/s12913-022-08073-4 · Cited by 15 · cited 1×
“…studies have revealed that AI chatbots facilitate well-designed multimodal conversations that can effectively assist in a variety of areas such as patient intervention (8), postoperative support (9), and psychiatric care (10), which has attracted great interest in nursing education research (3).”
Naing, S. Z. S., & Udomwong, P. (2024) · Data Intelligence · doi:10.1162/dint_a_00250 · Cited by 15
Beyeler, M., Légeret, C., Kiwitz, F., & van der Horst, K. (2023) · JMIR Human Factors · doi:10.2196/47913 · Cited by 14 · cited 1×
“…studies have revealed that AI chatbots facilitate well-designed multimodal conversations that can effectively assist in a variety of areas such as patient intervention (8), postoperative support (9), and psychiatric care (10), which has attracted great interest in nursing education research (3).”
Lippert, A. M., Gatewood, J. D., Cai, Z., & Graesser, A. C. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-22341-0_26 · Cited by 14
Human or Machine? A Study of Anthropomorphism Through an Affordance Lens
Lunberry, D., & Liebenau, J. M. (2020) · Lecture notes in information systems and organisation · doi:10.1007/978-3-030-47539-0_15 · Cited by 10
Untitled work
Chang (2022) · doi:10.30191/ets.202201_25(1).0002
Research works printed but not linked: 6
- Yang S Evans C. (2019). Opportunities and challenges in using AI chatbots in higher education. Proceedings of the 2019 3rd International Conference on Education and E-Learning. 79– 83
- Stolk JD Martello R. Can disciplinary integration promote students’ lifelong learning attitudes and skills in project-based engineering courses? Int J Eng Educ. (2015) 31: 434– 49.
- Li S Zheng J Lajoie SP. Temporal structures and sequential patterns of self-regulated learning behaviors in problem solving with an intelligent tutoring system. Educ Technol Soc. (2024) 25: 1– 14.
- Waizenegger L Seeber I Dawson G Desouza KC. (2020). Conversational agents—exploring generative mechanisms and second-hand effects of actualized technology affordances. Hawaii International Conference on System Sciences
- Stoeckli E Uebernickel F Brenner W. (2018). Exploring affordances of slack integrations and their actualization within enterprises—towards an understanding of how chatbots create value. Hawaii International Conference on System Sciences (HICSS).
- Meske C Amojo I. (2020). Understanding the affordances of conversational agents in mental mobile health services. 41st International Conference on Information Systems (ICIS)
Cited by
Wang, C., Yang, L., Cai, X., Wu, Y., Lin, Y., huang, F., & Geng, C. (2026) · doi:10.2196/preprints.112293
Metadata
- Authors
- Wei, S., Wei, W., & Zou, G.
- Affiliations
- Guangxi Open University (CN)
- Macao Polytechnic University (MO)
- Guangzhou University of Chinese Medicine (CN)
- Corresponding author
- Wei, Wei
- Venue
- Frontiers in Medicine
- Publisher
- Frontiers Media SA
- Published
- 2026-04-24
- Volume
- 13
- Pages
- 1832598-1832598
- ISSN
- 2296-858X (ISSN-L)
- PMC
- PMC13152810
- OpenAlex
- W7155487391
- Cited by
- 2
- References
- 68
- Citations by year
- 2026: 2
- FWCI
- 1.22
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Frontiers in Medicine (publishedVersion, cc-by)
- PubMed (publishedVersion)
- PubMed Central (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- “Macao Polytechnic University Research Grant” (RP/FCA-07-2025)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Education › Artificial Intelligence in Education
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Keywords
- AI chatbots, digital affordances, nursing education, learning gains, affordance theory, cognitive learning outcomes, affective learning outcomes, personalized learning, clinical reasoning, self-efficacy, critical thinking, multimodal learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.


