Qualitative exploration of digital chatbot use in medical education: A pilot study
Open accessThe DOI matches its Crossref record; 14 of the 15 references it cites were found in a registry or an index.
Abstract
PURPOSE: During the coronavirus disease 2019 pandemic, face-to-face teaching has been severely disrupted and limited for medical students internationally. This study explores the views of medical students and academic medical staff regarding the suitability and limitations, of a bespoke chatbot tool to support medical education. METHODS: Five focus groups, with a total of 16 participants, were recruited using a convenience sample. The participants included medical students across all year groups and academic staff. The pre-determined focus group topic guide explored how chatbots can augment existing teaching practices. A thematic analysis was conducted using the transcripts to determine key themes. RESULTS: Thematic analysis identified five main themes: (1) chatbot use as a clinical simulation tool; (2) chatbot use as a revision tool; (3) differential usefulness by medical school year group; (4) standardisation of education and assessment; (5) challenges of use and implementation. CONCLUSIONS: Both staff and students have clear benefits from using chatbots in medical education. However, they documented possible limitations to their use. The creation of chatbots to support the medical curriculum should be further explored and urgently evaluated to assess their impact on medical students training both during and after the global pandemic.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The use of chatbots has been increasingly reported [40, 112–115]. Gorashi et al. analyzed their strengths, weaknesses, opportunities, and threats in this context [107]. Chatbots have assisted students in history-taking practice [116] and preparing for objective structured clinical examinations (OSCE) [117]. In one study comparing the use of ChatGPT with a traditional textbook for learning medical”
From Artificial intelligence in undergraduate medical education: an updated scoping review (2025) · cites this paper as [40]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“In contrast, a few of them employed either qualitative methods [38–40] or a mixed-methods approach [41–45].”
From Artificial intelligence in undergraduate medical education: an updated scoping review (2025) · cites this paper as [40]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Qualitative data analysis for applied policy research
(2002) · Analyzing Qualitative Data · doi:10.4324/9780203413081-14 · Cited by 4,964
Member Checking: A Tool to Enhance Trustworthiness or Merely a Nod to Validation?
Birt, L., Scott, S., Cavers, D., Campbell, C., & Walter, F. (2016) · Qualitative Health Research · doi:10.1177/1049732316654870 · Cited by 3,970
Qualitative Data Analysis for Applied Policy Research
Ritchie, J., & Spencer, L. (2002) · The Qualitative Researcher's Companion · doi:10.4135/9781412986274.n12 · Cited by 905
Kononowicz, A. A., Woodham, L. A., Edelbring, S., Stathakarou, N., Davies, D., Saxena, N., Tudor Car, L., Carlstedt-Duke, J., Car, J., & Zary, N. (2019) · Journal of Medical Internet Research · doi:10.2196/14676 · Cited by 600
Sampling methods in Clinical Research; an Educational Review.
Elfil, M., & Negida, A. (2017) · Archives of Academic Emergency Medicine · doi:10.22037/aaem.v5i1.177 · Cited by 463
Physicians’ perceptions of chatbots in health Care: cross-sectional web-based survey
Palanica, A., Flaschner, P., Thommandram, A., Li, M., & Fossat, Y. (2019) · Journal of Medical Internet Research · doi:10.2196/12887 · Cited by 384 · cited 1×
“This was consistent with the fi ndings of another research group 12 whereby physicians felt that chatbots would not be able to comprehend the emotional aspect when dealing with patients and thus would not provide a realistic experience for the student.”
ResultMobile learning in medicine: an evaluation of attitudes and behaviours of medical students
Chase, T. J. G., Julius, A., Chandan, J. S., Powell, E., Hall, C. S., Phillips, B. L., Burnett, R., Gill, D., & Fernando, B. (2018) · BMC Medical Education · doi:10.1186/s12909-018-1264-5 · Cited by 147
Self-citationComplex consultations and the 'edge of chaos'.
Innes, A., Campion, P. D., & Griffiths, F. E. (2005) · Europe PMC (PubMed Central) · Cited by 126
A Multi-Institutional Randomized Controlled Trial of Adjuvant Web-Based Teaching to Medical Students
Kerfoot, B. P., Baker, H. E., Jackson, T. L., Hulbert, W. C., Federman, D. D., Oates, R. D., & DeWolf, W. C. (2006) · Academic Medicine · doi:10.1097/00001888-200603000-00004 · Cited by 107
Teacher Attitude towards Use of Chatbots in Routine Teaching
P. K, B., Too, J. K., & Mukwa, C. W. (2018) · Universal Journal of Educational Research · doi:10.13189/ujer.2018.060719 · Cited by 81
Research works printed but not linked: 5
- Kazi H, 2012, Int J Comput Appl, 55, 1
- Webber GM. Data representation and algorithms for biomedical informatics applications . PhD thesis, Harvard University, 2005.
- Nair R, 2007, Int J Clin Skills, 1, 25
- Innes AD, 2005, Br J Gen Pract, 55, 47
- Luft J, 1955, Proceedings of the Western Training Laboratory in Group Development
Cited by
A scoping review of artificial intelligence in medical education: BEME Guide No. 84
Gordon, M., Daniel, M., Ajiboye, A., Uraiby, H., Xu, N. Y., Bartlett, R., Hanson, J., Haas, M., Spadafore, M., Grafton-Clarke, C., et al. (2024) · Medical Teacher · doi:10.1080/0142159x.2024.2314198 · Cited by 679
Sallam, M., Salim, N., Barakat, M., & Al-Tammemi, A. (2023) · Narra J · doi:10.52225/narra.v3i1.103 · Cited by 331
“In this study, ChatGPT responses based on the evaluation of the expert panel, correctly listed the benefits of integrating such technology among other LLMs in medical education, which could represent a valuable tool to improve learning and assessment, ultimately leading to improved learning outcomes [44].”
MethodHan, J.-W., Park, J., & Lee, H. (2022) · BMC Medical Education · doi:10.1186/s12909-022-03898-3 · Cited by 187
“A chatbot also has various applications in the education field, as people can use it to learn without time and space restrictions [4].”
BackgroundMapping the use of artificial intelligence in medical education: a scoping review
Rincón, E. H. H., Jimenez, D., Aguilar, L. A. C., Flórez, J. M. P., Tapia, Á. E. R., & Peñuela, C. L. J. (2025) · BMC Medical Education · doi:10.1186/s12909-025-07089-8 · Cited by 145
“In addition, different authors mention that AI improves self-learning [41, 42] and interdisciplinary teaching, although it faces challenges in exam stand-ardization [43] and requires human supervision to ensure accuracy [44, 45].”
InfluentialYusuf, H., Money, A., & Daylamani-Zad, D. (2025) · Educational technology research and development · doi:10.1007/s11423-025-10447-4 · Cited by 112
Metadata
- Authors
- Kaur, A., Singh, S., Chandan, J. S., Robbins, T., & Patel, V.
- Affiliations
- University of Warwick (GB)
- University Hospital Coventry (GB)
- Corresponding author
- Kaur, Anjuli
- Venue
- DIGITAL HEALTH
- Publisher
- SAGE Publications
- Published
- 2021-01
- Volume
- 7
- Pages
- 20552076211038151-20552076211038151
- ISSN
- 2055-2076 (ISSN-L)
- PMC
- PMC8424726
- OpenAlex
- W3197802091
- Cited by
- 67
- References
- 15
- Citations by year
- 2026: 11 · 2025: 14 · 2024: 20 · 2023: 15 · 2022: 7
- FWCI
- 3.06
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Digital Health (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- University of Birmingham Research Portal (University of Birmingham) (publishedVersion, cc-by-nc)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- University of Birmingham
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Education › Innovations in Medical Education
- Social Sciences › Education › Artificial Intelligence in Education
- Keywords
- chatbots, medical education, COVID-19 pandemic, clinical simulation, medical students, academic staff perceptions, assessment standardization, implementation barriers
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Qualitative exploration of digital chatbot use in medical education: A pilot study. https://app.cochat.ai/papers/10.1177/20552076211038151
- The paper
- Kaur, A., Singh, S., Chandan, J. S., Robbins, T., & Patel, V. (2021). Qualitative exploration of digital chatbot use in medical education: A pilot study. DIGITAL HEALTH. https://doi.org/10.1177/20552076211038151
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.