Twelve tips to leverage AI for efficient and effective medical question generation: A guide for educators using Chat GPT
The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Crafting quality assessment questions in medical education is a crucial yet time-consuming, expertise-driven undertaking that calls for innovative solutions. Large language models (LLMs), such as ChatGPT (Chat Generative Pre-Trained Transformer), present a promising yet underexplored avenue for such innovations. AIMS: This study explores the utility of ChatGPT to generate diverse, high-quality medical questions, focusing on multiple-choice questions (MCQs) as an illustrative example, to increase educator's productivity and enable self-directed learning for students. DESCRIPTION: Leveraging 12 strategies, we demonstrate how ChatGPT can be effectively used to generate assessment questions aligned with Bloom's taxonomy and core knowledge domains while promoting best practices in assessment design. CONCLUSION: Integrating LLM tools like ChatGPT into generating medical assessment questions like MCQs augments but does not replace human expertise. With continual instruction refinement, AI can produce high-standard questions. Yet, the onus of ensuring ultimate quality and accuracy remains with subject matter experts, affirming the irreplaceable value of human involvement in the artificial intelligence-driven education paradigm.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The creation of high-quality MCQs is a time-consuming task [5, 6], even more considering that changes in the curriculum or students collecting questions from previous years requires teachers to create new sets of questions every once in a while [7].”
From Docimological Quality Analysis of LLM-Generated Multiple Choice Questions in Computer Science and Medicine (2024) · cites this paper as [6]
In the citing paper
“Content experts remain responsible for checking the accuracy of the generated questions, and while editing is certainly necessary, it takes less time to edit generated questions than to create them from scratch [6, 7].”
From Docimological Quality Analysis of LLM-Generated Multiple Choice Questions in Computer Science and Medicine (2024) · cites this paper as [6]
In the citing paper
“Content experts remain responsible for checking the accuracy of the generated questions, and while editing is certainly necessary, it takes less time to edit generated questions than to create them from scratch [6, 7].”
From Docimological Quality Analysis of LLM-Generated Multiple Choice Questions in Computer Science and Medicine (2024) · cites this paper as [6]
In the citing paper
“Incorporating the target level of Bloom’s taxonomy in the prompt was recommended by Indran et al. [6].”
From Docimological Quality Analysis of LLM-Generated Multiple Choice Questions in Computer Science and Medicine (2024) · cites this paper as [6]
In the citing paper
“Three studies reported the use of AI, particularly ChatGPT, for generating exam questions [133, 134, 136].”
From Artificial intelligence in undergraduate medical education: an updated scoping review (2025) · cites this paper as [136]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Ray, P. P. (2023) · Internet of Things and Cyber-Physical Systems · doi:10.1016/j.iotcps.2023.04.003 · Cited by 2,463 · cited 1×
“LLMs democratise education with their global accessibility, multilingual proficiency, and scalable resources, breaking both language and economic barriers (Ray 2023).”
Ali, R., Tang, O. Y., Connolly, I. D., Fridley, J. S., Shin, J. H., Zadnik Sullivan, P. L., Cielo, D., Oyelese, A. A., Doberstein, C. E., Telfeian, A. E., et al. (2023) · Neurosurgery · doi:10.1227/neu.0000000000002551 · Cited by 354
Palmer, E. J., & Devitt, P. G. (2007) · BMC Medical Education · doi:10.1186/1472-6920-7-49 · Cited by 294
Reconceptualizing ChatGPT and generative AI as a student-driven innovation in higher education
Dai, Y., Liu, A., & Lim, C. P. (2023) · Procedia CIRP · doi:10.1016/j.procir.2023.05.002 · Cited by 294
How AI Responds to Common Lung Cancer Questions: ChatGPT versus Google Bard
Rahsepar, A. A., Tavakoli, N., Kim, G. H. J., Hassani, C., Abtin, F., & Bedayat, A. (2023) · Radiology · doi:10.1148/radiol.230922 · Cited by 283
ChatGPT: The cognitive effects on learning and memory
Bai, L., Liu, X., & Su, J. (2023) · Brain‐X · doi:10.1002/brx2.30 · Cited by 180
Ethical issues of the use of AI-driven mobile apps for education
Klimova, B., Pikhart, M., & Kacetl, J. (2023) · Frontiers in Public Health · doi:10.3389/fpubh.2022.1118116 · Cited by 173
Thompson, A. R., & O'Loughlin, V. D. (2015) · Anatomical Sciences Education · doi:10.1002/ase.1507 · Cited by 123
Kim, M., Patel, R. A., Uchizono, J. A., & Beck, L. (2012) · American Journal of Pharmaceutical Education · doi:10.5688/ajpe766114 · Cited by 106
Guidelines for the construction of multiple choice questions tests
Al-Rukban, M. (2006) · Journal of Family and Community Medicine · doi:10.4103/2230-8229.97543 · Cited by 78
Research works printed but not linked: 1
- OpenAI. 2023. GPT-4 technical report. arXiv.
Cited by
Kıyak, Y. S., & Emekli, E. (2024) · Postgraduate Medical Journal · doi:10.1093/postmj/qgae065 · Cited by 137
Matos, T., Santos, W., Zdravevski, E., Coelho, P. J., Pires, I. M., & Madeira, F. (2025) · Decision Analytics Journal · doi:10.1016/j.dajour.2025.100571 · Cited by 158
Law, A. K.-K., So, J. L. T., Lui, C. T., Choi, Y. F., Cheung, K. H., Hung, K. K. C., & Graham, C. A. (2025) · BMC Medical Education · doi:10.1186/s12909-025-06796-6 · Cited by 127
Lubbe, A., Marais, E., & Kruger, D. (2025) · Education and Information Technologies · doi:10.1007/s10639-025-13476-x · Cited by 61
Kıyak, Y. S., Çoşkun, Ö., Budakoğlu, I. İ., & Uluoğlu, C. (2024) · European Journal of Clinical Pharmacology · doi:10.1007/s00228-024-03649-x · Cited by 100
Metadata
- Authors
- Indran, I. R., Paranthaman, P., Gupta, N., & Mustafa, N.
- Affiliations
- National University of Singapore (SG)
- Corresponding author
- Indran, Inthrani Raja
- Venue
- Medical Teacher
- Publisher
- Informa UK Limited
- Published
- 2023-12-26
- Volume
- 46
- Issue
- 8
- Pages
- 1021-1026
- ISSN
- 0142-159X (ISSN-L)
- 1466-187X
- OpenAlex
- W4390229778
- Semantic Scholar
- 7c2ca5e66b10a8f92bc3db4b6ef6ccc493ba3224
- Cited by
- 89
- References
- 11
- Citations by year
- 2026: 24 · 2025: 46 · 2024: 19
- FWCI
- 3.54
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Medical Teacher (publishedVersion)
- PubMed (publishedVersion)
- National University of Singapore (submittedVersion)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Education › Artificial Intelligence in Education
- Social Sciences › Education › Innovations in Medical Education
- Keywords
- ChatGPT, large language models, multiple-choice questions, Bloom's taxonomy, self-directed learning, artificial intelligence in education, medical education
- MeSH terms
- Artificial Intelligence, Education, Medical, Educational Measurement, Humans
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Twelve tips to leverage AI for efficient and effective medical question generation: A guide for educators using Chat GPT. https://app.cochat.ai/papers/10.1080/0142159x.2023.2294703
- The paper
- Indran, I. R., Paranthaman, P., Gupta, N., & Mustafa, N. (2024). Twelve tips to leverage AI for efficient and effective medical question generation: A guide for educators using Chat GPT. Medical Teacher. https://doi.org/10.1080/0142159x.2023.2294703
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.