The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Chat Generative Pretrained Transformer Fails the Multiple-Choice American College of Gastroenterology Self-Assessment Test
Abstract
INTRODUCTION: Chat Generative Pretrained Transformer (ChatGPT) is a natural language processing model that generates human-like text. METHODS: ChatGPT-3 and ChatGPT-4 were used to answer the 2022 and 2021 American College of Gastroenterology self-assessment tests. The exact questions were inputted in both versions of ChatGPT. A score of 70% or higher was required to pass the assessment. RESULTS: Overall, ChatGPT-3 scored 65.1% on 455 included questions and GPT-4 scored 62.4%. DISCUSSION: ChatGPT did not pass the American College of Gastroenterology self-assessment test. We do not recommend its use for medical education in gastroenterology in its current form.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Adapting AI models to specific tasks and datasets without losing robustness is a significant hurdle, often resulting in significant variability in accuracy across different settings.
“While these models offer powerful foundational capabilities, adapting them to specific tasks and datasets without losing robustness is a significant hurdle, often resulting in significant variability in accuracy across different settings.7,9,10”
Citations
Cites
ChatGPT for Good? On Opportunities and Challenges of Large Language Models for Education
Kasneci, E., Seßler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · doi:10.35542/osf.io/5er8f · Cited by 7,552
ChatGPT for good? On opportunities and challenges of large language models for education
Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · Learning and Individual Differences · doi:10.1016/j.lindif.2023.102274 · Cited by 7,326
Kung, T. H., Cheatham, M., ChatGPT, Medenilla, A., Sillos, C., De Leon, L., Elepaño, C., Madriaga, M., Aggabao, R., Diaz-Candido, G., et al. (2022) · doi:10.1101/2022.12.19.22283643 · Cited by 4,115
Kung, T. H., Cheatham, M., Medenilla, A., Sillos, C., De Leon, L., Elepaño, C., Madriaga, M., Aggabao, R., Diaz-Candido, G., Maningo, J., et al. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000198 · Cited by 4,115
Gilson, A., Safranek, C. W., Huang, T., Socrates, V., Chi, L., Taylor, R. A., & Chartash, D. (2023) · JMIR Medical Education · doi:10.2196/45312 · Cited by 2,078
Vision, challenges, roles and research issues of Artificial Intelligence in Education
Hwang, G.-J., Xie, H., Wah, B. W., & Gašević, D. (2020) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2020.100001 · Cited by 1,435
Introducing artificial intelligence training in medical education
Paranjape, K., Schinkel, M., Nannan Panday, R., Car, J., & Nanayakkara, P. (2019) · JMIR Medical Education · doi:10.2196/16048 · Cited by 634
Medical Education Must Move From the Information Age to the Age of Artificial Intelligence
Wartman, S. A., & Combs, C. D. (2018) · Academic Medicine · doi:10.1097/acm.0000000000002044 · Cited by 585
Aye, AI! ChatGPT passes multiple-choice family medicine exam
Morreel, S., Mathysen, D., & Verhoeven, V. (2023) · Medical Teacher · doi:10.1080/0142159x.2023.2187684 · Cited by 56
Flagged first, then by citations
Cited by
Sorted by citations
A scoping review of artificial intelligence in medical education: BEME Guide No. 84
Gordon, M., Daniel, M., Ajiboye, A., Uraiby, H., Xu, N. Y., Bartlett, R., Hanson, J., Haas, M., Spadafore, M., Grafton-Clarke, C., et al. (2024) · Medical Teacher · doi:10.1080/0142159x.2024.2314198 · Cited by 679
Evaluation of ChatGPT-generated medical responses: A systematic review and meta-analysis
Wei, Q., Yao, Z., Cui, Y., Wei, B., Jin, Z., & Xu, X. (2024) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2024.104620 · Cited by 226
Miao, J., Thongprayoon, C., Suppadungsuk, S., Valencia, O. A. G., & Cheungpasitporn, W. (2024) · Medicina · doi:10.3390/medicina60030445 · Cited by 198
Önder, Ç. E., Koç, G., Gökbulut, P., Taşkaldıran, I., & Kuşkonmaz, Ş. M. (2024) · Scientific Reports · doi:10.1038/s41598-023-50884-w · Cited by 133
A Systematic Review of the Limitations and Associated Opportunities of ChatGPT
Cong‐Lem, N., Soyoof, A., & Tsering, D. (2024) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2024.2344142 · Cited by 140
Wu, S., Koo, M., Blum, L., Black, A., Kao, L., Fei, Z., Scalzo, F., & Kurtz, I. (2024) · NEJM AI · doi:10.1056/aidbp2300092 · Cited by 97
Performance of ChatGPT in medical examinations: A systematic review and a meta‐analysis
Levin, G., Horesh, N., Brezinov, Y., & Meyer, R. (2023) · BJOG An International Journal of Obstetrics & Gynaecology · doi:10.1111/1471-0528.17641 · Cited by 90
Jin, H. K., Lee, H. E., & Kim, E. (2024) · BMC Medical Education · doi:10.1186/s12909-024-05944-8 · Cited by 85
Moshirfar, M., Altaf, A. W., Stoakes, I. M., Tuttle, J. J., & Hoopes, P. C. (2023) · Cureus · doi:10.7759/cureus.40822 · Cited by 124
Graduate Instructors Navigating the AI Frontier: The Role of ChatGPT in Higher Education
Parker, L., Carter, C., Karakas, A., Loper, A. J., & Sokkar, A. (2024) · Computers and Education Open · doi:10.1016/j.caeo.2024.100166 · Cited by 95
Evaluating large language models and agents in healthcare: key challenges in clinical applications
Chen, X., Xiang, J., Lu, S., Liu, Y., He, M., & Shi, D. (2025) · Intelligent Medicine · doi:10.1016/j.imed.2025.03.002 · Cited by 97
Meo, S. A., Al-Masri, A. A., Alotaibi, M., Meo, M. Z. S., & Meo, M. O. S. (2023) · Healthcare · doi:10.3390/healthcare11142046 · Cited by 74
Guillen-Grima, F., Guillen-Aguinaga, S., Guillen-Aguinaga, L., Alas-Brun, R., Onambele, L., Ortega, W., Montejo, R., Aguinaga-Ontoso, E., Barach, P., & Aguinaga-Ontoso, I. (2023) · Clinics and Practice · doi:10.3390/clinpract13060130 · Cited by 72
Performance of ChatGPT on Nephrology Test Questions
Miao, J., Thongprayoon, C., Valencia, O. A. G., Krisanapan, P., Sheikh, M. S., Davis, P. W., Mekraksakit, P., Suarez, M. L. G., Craici, I. M., & Cheungpasitporn, W. (2023) · Clinical Journal of the American Society of Nephrology · doi:10.2215/cjn.0000000000000330 · Cited by 72
Evaluating the performance of ChatGPT-4 on the United Kingdom Medical Licensing Assessment
Lai, U. H., Wu, K. S., Hsu, T.-Y., & Kan, J. K. C. (2023) · Frontiers in Medicine · doi:10.3389/fmed.2023.1240915 · Cited by 67
Accuracy of ChatGPT in Common Gastrointestinal Diseases: Impact for Patients and Providers
Kerbage, A., Kassab, J. T., Dahdah, J. E., Burke, C. A., Achkar, J., & Rouphael, C. (2023) · Clinical Gastroenterology and Hepatology · doi:10.1016/j.cgh.2023.11.008 · Cited by 66
Analyzing evaluation methods for large language models in the medical field: a scoping review
Lee, J., Park, S., Shin, J., & Cho, B. (2024) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-024-02709-7 · Cited by 52
Wang, L., Li, J., Zhuang, B., Huang, S., Fang, M., Wang, C., Li, W., Zhang, M., & Gong, S. (2025) · Journal of Medical Internet Research · doi:10.2196/64486 · Cited by 51
Giuffrè, M., Kresevic, S., Pugliese, N., You, K., & Shung, D. L. (2024) · Liver International · doi:10.1111/liv.15974 · Cited by 62
Systematic review: The use of large language models as medical chatbots in digestive diseases
Giuffrè, M., Kresevic, S., You, K., Dupont, J., Huebner, J., Grimshaw, A. A., & Shung, D. L. (2024) · Alimentary Pharmacology & Therapeutics · doi:10.1111/apt.18058 · Cited by 60
Şişmanoğlu, S., & Çapan, B. Ş. (2025) · BMC Medical Education · doi:10.1186/s12909-024-06389-9 · Cited by 70
ChatGPT and Other Large Language Models in Medical Education — Scoping Literature Review
Aster, A., Laupichler, M. C., Rockwell-Kollmann, T., Masala, G., Bala, E., & Raupach, T. (2024) · Medical Science Educator · doi:10.1007/s40670-024-02206-6 · Cited by 61
Klang, E., Sourosh, A., Nadkarni, G. N., Sharif, Κ., & Lahat, A. (2023) · Therapeutic Advances in Gastroenterology · doi:10.1177/17562848231218618 · Cited by 53
Gravina, A. G., Pellegrino, R., Palladino, G., Imperio, G., Ventura, A., & Federico, A. (2024) · Digestive and Liver Disease · doi:10.1016/j.dld.2024.02.019 · Cited by 53
The model student: GPT-4 performance on graduate biomedical science exams
Stribling, D., Xia, Y., Amer, M. K., Graim, K. S., Mulligan, C. J., & Renne, R. (2024) · Scientific Reports · doi:10.1038/s41598-024-55568-7 · Cited by 60
Large language models: a primer and gastroenterology applications
Shahab, O., Kurdi, B. E., Shaukat, A., Nadkarni, G. N., & Soroush, A. (2024) · Therapeutic Advances in Gastroenterology · doi:10.1177/17562848241227031 · Cited by 47
Exploring the potential of artificial intelligence chatbots in prosthodontics education
Eraslan, R., Ayata, M., Yağcı, F., & Albayrak, H. (2025) · BMC Medical Education · doi:10.1186/s12909-025-06849-w · Cited by 41
Performance of ChatGPT and Bard in self-assessment questions for nephrology board renewal
Noda, R., Izaki, Y., Kitano, F., Komatsu, J., Ichikawa, D., & Shibagaki, Y. (2024) · Clinical and Experimental Nephrology · doi:10.1007/s10157-023-02451-w · Cited by 43
Khan, A. A., Yunus, R. A., Sohail, M., Rehman, T. A. Z. U., Saeed, S., Bu, Y., Jackson, C. D., Sharkey, A. M., Mahmood, F. U., & Matyal, R. (2024) · Journal of Cardiothoracic and Vascular Anesthesia · doi:10.1053/j.jvca.2024.01.032 · Cited by 37
Oh, J. H., & Sinn, D. H. (2024) · Journal of Liver Cancer · doi:10.17998/jlc.2024.02.27 · Cited by 34
Kollitsch, L., Eredics, K., Marszalek, M., Rauchenwald, M., Brookman-May, S. D., Burger, M., Körner-Riffard, K., & May, M. (2024) · World Journal of Urology · doi:10.1007/s00345-023-04749-6 · Cited by 35
Fear, K., & Gleber, C. D. (2023) · JMIR Aging · doi:10.2196/51776 · Cited by 32
Chen, J., Cadiente, A., Kasselman, L. J., & Pilkington, B. (2024) · Journal of Medical Ethics · doi:10.1136/jme-2023-109366 · Cited by 28
The potential of ChatGPT in medicine: an example analysis of nephrology specialty exams in Poland
Nicikowski, J., Szczepański, M., Miedziaszczyk, M., & Kudliński, B. (2024) · Clinical Kidney Journal · doi:10.1093/ckj/sfae193 · Cited by 29
Suitability of GPT-4o as an evaluator of cardiopulmonary resuscitation skills examinations
Wang, L., Mao, Y., Wang, L., Sun, Y., Song, J., & Zhang, Y. (2024) · Resuscitation · doi:10.1016/j.resuscitation.2024.110404 · Cited by 29
A large language model for complex cardiology care
O’Sullivan, J. W., Palepu, A. K., Saab, K. K., Weng, W., Amponsah, D., Cheng, E., Cheng, Y., Chu, E. L., Desai, Y. B., Elezaby, A., et al. (2026) · Nature Medicine · doi:10.1038/s41591-025-04190-9 · Cited by 33
Evaluation of ChatGPT pathology knowledge using board-style questions
Geetha, S. D., Khan, A., Khan, A. I., Kannadath, B. S., & Vitkovski, T. (2023) · American Journal of Clinical Pathology · doi:10.1093/ajcp/aqad158 · Cited by 27
Luke, W. A. N. V., Seow Chong, L., Ban, K. H., Wong, A. H., Zhi Xiong, C., Shuh Shing, L., Taneja, R., Samarasekera, D. D., & Yap, C. T. (2024) · Medical Teacher · doi:10.1080/0142159x.2024.2308779 · Cited by 24
ChatGPT in Medical Education: Bibliometric and Visual Analysis
Zhang, Y., Xie, X., & Xu, Q. (2025) · JMIR Medical Education · doi:10.2196/72356 · Cited by 33
Comparative analysis of artificial intelligence policies in universities across five countries
Parker, L., Loper, A. J., Hayes, J. E., Karakas, A., White, S. H., & Hallman, H. L. (2025) · Discover Computing · doi:10.1007/s10791-025-09745-5 · Cited by 42
Evaluation of ChatGPT's performance in providing treatment recommendations for pediatric diseases
Wei, Q., Wang, Y., Yao, Z., Cui, Y., Wei, B., Li, T., & Xu, X. (2023) · Pediatric Discovery · doi:10.1002/pdi3.42 · Cited by 23
Moglia, A., Georgiou, K. E., Cerveri, P., Mainardi, L. T., Satava, R. M., & Cuschieri, A. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10849-5 · Cited by 27
Shukla, R., Mishra, A. K., Banerjee, N., & Verma, A. (2024) · Cureus · doi:10.7759/cureus.58232 · Cited by 31
The emerging role of generative artificial intelligence in transplant medicine
Deeb, M., Gangadhar, A., Rabindranath, M., Rao, K. R., Brudno, M., Sidhu, A., Wang, B., & Bhat, M. (2024) · American Journal of Transplantation · doi:10.1016/j.ajt.2024.06.009 · Cited by 21
Safavi‐Naini, S. A. A., Ali, S., Shahab, O., Shahhoseini, Z., Savage, T., Rafiee, S., Samaan, J. S., Shabeeb, R. Q. A., Ladak, F., Yang, J. O., et al. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-02174-0 · Cited by 28
Nakajima, N., Fujimori, T., Furuya, M., Kanie, Y., Imai, H., Kita, K., Uemura, K., & Okada, S. (2024) · Cureus · doi:10.7759/cureus.56402 · Cited by 21
Performance of GPT-4 Vision on kidney pathology exam questions
Miao, J., Thongprayoon, C., Cheungpasitporn, W., & Cornell, L. D. (2024) · American Journal of Clinical Pathology · doi:10.1093/ajcp/aqae030 · Cited by 19
Waterman, M., Gorelik, Y., Ghersin, I., Weisshof, R., Koifman, E., Bar‐Yoseph, H., Hur, D. B., Maza, I., Hasnis, E., Nasser, R., et al. (2024) · Endoscopy · doi:10.1055/a-2289-5732 · Cited by 19
Schoch, J., Schmelz, H. U., Strauch, A., Borgmann, H., & Nestler, T. (2024) · World Journal of Urology · doi:10.1007/s00345-024-05137-4 · Cited by 20
Simmons, A., Takkavatakarn, K., McDougal, M., Nadkarni, G. N., Sakhuja, A., Dilcher, B., Pincavitch, J. D., Meadows, L., Kauffman, J., Klang, E., et al. (2024) · Applied Clinical Informatics · doi:10.1055/a-2491-3872 · Cited by 21
Pereyra, L., Schlottmann, F., Steinberg, L., & Lasa, J. (2024) · Journal of Clinical Gastroenterology · doi:10.1097/mcg.0000000000001979 · Cited by 18
Performance of ChatGPT in Israeli Hebrew OBGYN national residency examinations
Cohen, A., Alter, R., Lessans, N., Meyer, R., Brezinov, Y., & Levin, G. (2023) · Archives of Gynecology and Obstetrics · doi:10.1007/s00404-023-07185-4 · Cited by 17
Performance of ChatGPT in Otolaryngology knowledge assessment
Revercomb, L., Patel, A. M., Choudhry, H. S., & Filimonov, A. (2023) · American Journal of Otolaryngology · doi:10.1016/j.amjoto.2023.104082 · Cited by 17
Trends in research on ChatGPT and adoption-related issues discussed in articles: a narrative review
Kim, S.-J. (2023) · Science Editing · doi:10.6087/kcse.321 · Cited by 17
Ali, H., Patel, P., Obaitan, I., Mohan, B. P., Sohail, A. H., Smith-Martinez, L., Lambert, K., Gangwani, M. K., Easler, J. J., & Adler, D. G. (2023) · iGIE · doi:10.1016/j.igie.2023.10.001 · Cited by 15
Meo, S. A., Alotaibi, M. S., Meo, M. Z. S., Meo, M. O. S., & Hamid, M. (2024) · Frontiers in Public Health · doi:10.3389/fpubh.2024.1360597 · Cited by 15
Blacker, S. N., Chen, F., Winecoff, D., Antonio, B. L., Arora, H., Hierlmeier, B. J., Kacmar, R. M., Passannante, A. N., Plunkett, A., Zvara, D. A., et al. (2024) · Anesthesia & Analgesia · doi:10.1213/ane.0000000000006875 · Cited by 17
Artificial Intelligence and IBD: Where are We Now and Where Will We Be in the Future?
Ahmed, M., Stone, M. L., & Stidham, R. W. (2024) · Current Gastroenterology Reports · doi:10.1007/s11894-024-00918-8 · Cited by 19
ChatGPT Performs Worse on USMLE-Style Ethics Questions Compared to Medical Knowledge Questions
Danehy, T., Hecht, J., Kentis, S., Schechter, C. B., & Jariwala, S. P. (2024) · Applied Clinical Informatics · doi:10.1055/a-2405-0138 · Cited by 15
Penny, P., Bane, R., & Riddle, V. (2024) · Cureus · doi:10.7759/cureus.76309 · Cited by 16
Role of chatbots on gastroenterology: Let's chat about the future
Li, L. (2023) · Gastroenterology & Endoscopy · doi:10.1016/j.gande.2023.06.002 · Cited by 15
ChatGPT in prostate cancer: myth or reality?
Lombardo, R., Cicione, A. M., Santoro, G., & Nunzio, C. D. (2023) · Prostate Cancer and Prostatic Diseases · doi:10.1038/s41391-023-00750-7 · Cited by 14
Blacker, S. N., Kang, M., Chakraborty, I., Chowdhury, T., Williams, J., Lewis, C., Zimmer, M., Wilson, B., & Lele, A. V. (2023) · Journal of Neurosurgical Anesthesiology · doi:10.1097/ana.0000000000000949 · Cited by 13
Clinical experience and perception of risk affect the acceptance and trust of using AI in medicine
Schulz, P. J., Kee, K. M., Lwin, M. O., Goh, W. W., Chia, K. Y., Cheung, M. F. K., Lam, T. Y. T., & Sung, J. J. Y. (2025) · Frontiers in Digital Health · doi:10.3389/fdgth.2025.1620127 · Cited by 12
Ibrahim, A., Danpanichkul, P., Hayek, A., Paul, E., Farag, A., Mansoor, M. A., Thongprayoon, C., Cheungpasitporn, W., & Othman, M. O. (2025) · The American Journal of Gastroenterology · doi:10.14309/ajg.0000000000003552 · Cited by 12
Yoon, S.-H., Oh, S. K., Lim, B. G., & Lee, H.-J. (2024) · JMIR Medical Education · doi:10.2196/56859 · Cited by 10
Smith, J., Choi, P. M. C., & Buntine, P. (2023) · Emergency Medicine Australasia · doi:10.1111/1742-6723.14280 · Cited by 12
Suwała, S., Szulc, P., Dudek, A., Białczyk, A., Koperska, K., & Junik, R. (2023) · Polskie Archiwum Medycyny Wewnętrznej · doi:10.20452/pamw.16608 · Cited by 12
Su, J., Hsu, S., Fang, T., & Wang, P.-C. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.108765 · Cited by 11
Prompt engineering to increase GPT3.5’s performance on the Plastic Surgery In-Service Exams
Nahass, G. R., Chin, S. W., Scharf, I. M., Kazmouz, S., Kaplan, N., Chiu, R., Yang, K., Zeid, N. B., Corcoran, J. F., & Alkureishi, L. W. T. (2024) · Journal of Plastic Reconstructive & Aesthetic Surgery · doi:10.1016/j.bjps.2024.09.001 · Cited by 9
AI-assisted human clinical reasoning in the ICU: beyond “to err is human”
Gharib, K. E., Jundi, B., Furfaro, D. M., & Abdulnour, R.-E. E. (2024) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2024.1506676 · Cited by 9
Ullah, R., Shaikh, M. S., Shahani, N., Lone, M. A., Fareed, M. A., & Zafar, M. S. (2025) · European Journal of Dentistry · doi:10.1055/s-0045-1808254 · Cited by 9
Gökbulut, P. (2024) · SiSli Etfal Hastanesi Tip Bulteni / The Medical Bulletin of Sisli Hospital · doi:10.14744/semb.2024.23697 · Cited by 8
Fine-tuning AI models for enhanced consistency and precision in chemistry educational assessments
Yamtinah, S., Wiyarsi, A., Widarti, H. R., Shidiq, A. S., & Ramadhani, D. G. (2025) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2025.100399 · Cited by 14
Yu, S., & Liu, J. (2026) · Medicine · doi:10.1097/md.0000000000047489 · Cited by 9
OpenAI ChatGPT: A Potential Medical Application
Chaddad, A., Jiang, Y., & He, C. (2023) · IEEE International Conference on e-Health Networking, Applications and Services (Healthcom) · doi:10.1109/healthcom56612.2023.10472387 · Cited by 9
Nadkarni, G. N., Sakhuja, A., Klang, E., Gill, J., Sharma, A., Leibner, E. S., Sabounchi, M., Freeman, R., Kohli-Seth, R. D., Kovatch, P., et al. (2025) · Applied Clinical Informatics · doi:10.1055/a-2617-6572 · Cited by 7
Ketchem, C. J., Lynch, K. L., Chang, J. W., & Dellon, E. S. (2023) · Clinical Gastroenterology and Hepatology · doi:10.1016/j.cgh.2023.10.004 · Cited by 7
May, M., Körner-Riffard, K., Kollitsch, L., Burger, M., Brookman-May, S. D., Rauchenwald, M., Marszalek, M., & Eredics, K. (2024) · Urologia Internationalis · doi:10.1159/000537854 · Cited by 8
Simmons, A., Takkavatakarn, K., McDougal, M., Dilcher, B., Pincavitch, J. D., Meadows, L., Kauffman, J., Klang, E., Wig, R., Smith, G. S., et al. (2024) · medRxiv · doi:10.1101/2024.04.29.24306573 · Cited by 9
Anvari, S., Lee, Y., Jin, D., Malone, S., & Collins, M. (2025) · Journal of the Canadian Association of Gastroenterology · doi:10.1093/jcag/gwae055 · Cited by 6
Jain, S., Chakraborty, B., Agarwal, A., & Sharma, R. (2025) · Cureus · doi:10.7759/cureus.81618 · Cited by 6
Ali, S., Shahab, O., Shabeeb, R. Q. A., Ladak, F., Yang, J. O., Nadkarni, G. N., Echavarria, J., Babar, S., Shaukat, A., Soroush, A., et al. (2023) · medRxiv · doi:10.1101/2023.09.21.23295918 · Cited by 8
Liu, W., & Liu, X. (2025) · PLoS ONE · doi:10.1371/journal.pone.0329410 · Cited by 5
Accuracy of ChatGPT3.5 in answering clinical questions on guidelines for severe acute pancreatitis
Qiu, J., Luo, L., & Zhou, Y. (2024) · BMC Gastroenterology · doi:10.1186/s12876-024-03348-y · Cited by 5
Integrating Clinical Guidelines With ChatGPT-4 Enhances Its’ Skills
Tariq, R., Voth, E. R., & Khanna, S. (2024) · Mayo Clinic Proceedings Digital Health · doi:10.1016/j.mcpdig.2024.02.004 · Cited by 5
Guo, A., Canagasingham, A., Rasiah, K., Chalasani, V., Mundy, J. A., & Chung, A. S. J. (2025) · ANZ Journal of Surgery · doi:10.1111/ans.70186 · Cited by 4
Gül, M. C. (2025) · BMC Medical Education · doi:10.1186/s12909-025-07856-7 · Cited by 4
Tang, H., Wang, J., Liu, Q., Bao, J., & Zeng, W. (2024) · BMJ Open · doi:10.1136/bmjopen-2023-083697 · Cited by 4
Essis, M. D., Hartman, H., Tung, W. S., Oh, I. C., Peden, S. C., & Gianakos, A. L. (2025) · Journal of the American Academy of Orthopaedic Surgeons · doi:10.5435/jaaos-d-24-01049 · Cited by 4
Lockhart, K. R., Canagasingham, A., Zhong, W., Ashrafi, D., March, B., Cole‐Clark, D., Grant, A., & Chung, A. S. J. (2025) · British Journal of Urology · doi:10.1111/bju.16806 · Cited by 4
Tuttle, J. J., Moshirfar, M., Garcia, J., Altaf, A. W., Omidvarnia, S., & Hoopes, P. C. (2024) · Cureus · doi:10.7759/cureus.64768 · Cited by 4
Taşkaldıran, I., Önder, Ç. E., Gökbulut, P., Koç, G., & Kuşkonmaz, Ş. M. (2024) · Digital Health · doi:10.1177/20552076241278692 · Cited by 4
Şimşek, C., de Madaria, E., Ebigbo, A., Vaněk, P., Elshaarawy, O., Voiosu, A. M., Antonelli, G., Turró, R., Gisbert, J. P., Nyssen, O. P., et al. (2025) · Endoscopy International Open · doi:10.1055/a-2637-2163 · Cited by 4
Samaan, J. S., Margolis, S., Srinivasan, N., Srinivasan, A., Yeo, Y. H., Anand, R., Samaan, F. S., Mirocha, J., Safavi‐Naini, S. A. A., Kurdi, B. E., et al. (2024) · medRxiv · doi:10.1101/2024.07.27.24310809 · Cited by 4
Tarris, G., & Martin, L. (2025) · Digital Health · doi:10.1177/20552076241310630 · Cited by 3
Generative Artificial Intelligence for Gastroenterology: Neither Friend nor Foe
Dang, F., & Samarasena, J. (2023) · The American Journal of Gastroenterology · doi:10.14309/ajg.0000000000002573 · Cited by 3
Physician in the Loop Design of Interactive Agents
Griot, M., Vanderdonckt, J., Yuksel, D., & Hemptinne, C. (2025) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-91760-8_7 · Cited by 2
El‐Kassas, M., Khalifa, R., Al-Naamani, K. M., Shousha, H. I., Yilmaz, Y. N., Sanai, F. M., Almattooq, M., Labidi, A., Akroush, M., Debzi, N., et al. (2025) · Journal of Hepatocellular Carcinoma · doi:10.2147/jhc.s528470 · Cited by 2
Large language models versus human examinee performance on Israeli anesthesiology board examinations
Ronen, A., Fein, S., Orbach‐Zinger, S., Heesen, P., Shpack, O., Kashkush, A., Iluz‐Freundlich, D., Binyamin, Y., Lahav, M., Sheffy, N., et al. (2026) · Scientific Reports · doi:10.1038/s41598-026-45411-6 · Cited by 2
Metadata
- Authors
- Suchman, K., Garg, S., & Trindade, A. J.
- Affiliations
- Northwell Health (US)
- Arkansas Gastroenterology, North Little Rock, Arkansas, USA;
- Corresponding author
- Trindade, Arvind J.
- Venue
- American Journal of Gastroenterology
- Published
- 2023-05-22
- Volume
- 118
- Issue
- 12
- Pages
- 2280-2282
- ISSN
- 0002-9270 (ISSN-L)
- 1572-0241
- OpenAlex
- W4377220156
- Cited by
- 139
- References
- 7
- Citations by year
- 2026: 13 · 2025: 32 · 2024: 61 · 2023: 32
- FWCI
- 5.59
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- The American Journal of Gastroenterology (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Education › Innovations in Medical Education
- Social Sciences › Education › Artificial Intelligence in Education
- Keywords
- ChatGPT, large language models, gastroenterology education, medical knowledge assessment, ChatGPT-3, ChatGPT-4, artificial intelligence in medical education
- MeSH terms
- Gastroenterology, Humans, Self-Assessment, Universities
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
