The DOI matches its Crossref record; 12 of the 13 references it cites were found in a registry or an index, and 1 are not checked yet.
ChatGPT goes to the operating room: evaluating GPT-4 performance and its potential in surgical education and training in the era of large language models
Open accessPublished version of a preprint
Abstract
Purpose: This study aimed to assess the performance of ChatGPT, specifically the GPT-3.5 and GPT-4 models, in understanding complex surgical clinical information and its potential implications for surgical education and training. Methods: The dataset comprised 280 questions from the Korean general surgery board exams conducted between 2020 and 2022. Both GPT-3.5 and GPT-4 models were evaluated, and their performances were compared using McNemar test. Results: GPT-3.5 achieved an overall accuracy of 46.8%, while GPT-4 demonstrated a significant improvement with an overall accuracy of 76.4%, indicating a notable difference in performance between the models (P < 0.001). GPT-4 also exhibited consistent performance across all subspecialties, with accuracy rates ranging from 63.6% to 83.3%. Conclusion: ChatGPT, particularly GPT-4, demonstrates a remarkable ability to understand complex surgical clinical information, achieving an accuracy rate of 76.4% on the Korean general surgery board exam. However, it is important to recognize the limitations of large language models and ensure that they are used in conjunction with human expertise and judgment.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“GAI demonstrates potential in multidisciplinary knowledge acquisition within medical education by providing high-quality knowledge across various medical subfields [87-94].”
From Applications, Challenges, and Prospects of Generative Artificial Intelligence Empowering Medical Education: Scoping Review (2025) · cites this paper as [88]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Only a handful of these studies delved into the potential implications of generative AI's performance on these tests [8,33]. Those that did posited that this technology could be useful for self-directed learning or exam preparation [8,11,34]. However, none of these studies provided an explicit exploration of this process.”
From Opportunities, Challenges, and Future Directions of Generative Artificial Intelligence in Medical Education: Scoping Review (2023) · cites this paper as [11]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Notably, GPT-4 consistently performs well across different subspecialties, suggesting its capability to comprehend complex clinical information and enhance surgical education and training.”
From A Survey on Evaluation of Large Language Models (2024) · cites this paper as [143]
The cited source says what the claim attributes to it.
In the citing paper
“The results indicate an overall accuracy of 46.8% for GPT-3.5 and 76.4% for GPT-4, demonstrating a significant performance difference between the two models.”
From A Survey on Evaluation of Large Language Models (2024) · cites this paper as [143]
The cited source says what the claim attributes to it.
In the citing paper
“Several studies focused on the role of generative AI models in tests of medical knowledge [8-11,13,26,27,31-39].”
From Opportunities, Challenges, and Future Directions of Generative Artificial Intelligence in Medical Education: Scoping Review (2023) · cites this paper as [11]
The cited source says what the claim attributes to it.
In the citing paper
“The precision and trustworthiness of generative AI are fundamental concerns thoroughly elaborated in many publications [8,11-15,20,22,24,32,35,41,42].”
From Opportunities, Challenges, and Future Directions of Generative Artificial Intelligence in Medical Education: Scoping Review (2023) · cites this paper as [11]
The cited source says what the claim attributes to it.
In the citing paper
“A few studies outline potential scenarios in which educators or learners might interact with AI systems, such as in self-directed learning, simulation environments, and writing assistance [8,11,12,14,19,22,23,25,28,34,35,38,40,64].”
From Opportunities, Challenges, and Future Directions of Generative Artificial Intelligence in Medical Education: Scoping Review (2023) · cites this paper as [11]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Moreover, concerns have arisen that generative AI may produce biased content or lack representation of all populations [8,11-15,19,20,22,24,32,35,41,42].”
From Opportunities, Challenges, and Future Directions of Generative Artificial Intelligence in Medical Education: Scoping Review (2023) · cites this paper as [11]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜
Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445922 · Cited by 6,988 · cited 1×
“4% accuracy rate on the Korean surgical board exam, it is important to remember that LLMs are generative models, often referred to as “stochastic parrots” [11].”
LLaMA: Open and Efficient Foundation Language Models
Touvron, H., Lavril, T., Izacard, G., Martinet, X., Lachaux, M.-A., Lacroix, T., Rozière, B., Goyal, N., Hambro, E., Azhar, F., et al. (2023) · arXiv · doi:10.48550/arxiv.2302.13971 · Cited by 4,602
Kung, T. H., Cheatham, M., Medenilla, A., Sillos, C., De Leon, L., Elepaño, C., Madriaga, M., Aggabao, R., Diaz-Candido, G., Maningo, J., et al. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000198 · Cited by 4,115
BioGPT: generative pre-trained transformer for biomedical text generation and mining
Luo, R., Sun, L., Xia, Y., Qin, T., Zhang, S., Poon, H., & Liu, T.-Y. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbac409 · Cited by 1,150
Medical Education Must Move From the Information Age to the Age of Artificial Intelligence
Wartman, S. A., & Combs, C. D. (2018) · Academic Medicine · doi:10.1097/acm.0000000000002044 · Cited by 585
ChatGPT Goes to Law SchoolPreprint
Choi, J. H., Hickman, K. E., Monahan, A., & Schwarcz, D. B. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4335905 · Cited by 565
Han, E.-R., Yeo, S., Kim, M.-J., Lee, Y.-H., Park, K.-H., & Roh, H. (2019) · BMC Medical Education · doi:10.1186/s12909-019-1891-5 · Cited by 393
American Surgical Association Blue Ribbon Committee Report on Surgical Education: 2004
Debas, H. T., Bass, B. L., Brennan, M. F., Flynn, T. C., Folse, J. R., Freischlag, J. A., Friedmann, P., Greenfield, L. J., Jones, R. S., Lewis, F. R., et al. (2005) · Annals of Surgery · doi:10.1097/01.sla.0000150066.83563.52 · Cited by 319
ChatGPT passing USMLE shines a spotlight on the flaws of medical education
Mbakwe, A. B., Lourentzou, I., Celi, L. A., Mechanic, O. J., & Dagan, A. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000205 · Cited by 273
Martelli, G., Boracchi, P., Palo, M. D., Pilotti, S., Oriana, S., Zucali, R., Daidone, M. G., & Palo, G. D. (2005) · Annals of Surgery · doi:10.1097/01.sla.0000167759.15670.14 · Cited by 199
Research works printed but not linked: 1
- Touvron, 2023, arXiv [Preprint]
Cited by
Sorted by citations
Items 101–200 of 202
Can ChatGPT generate surgical multiple-choice questions comparable to those written by a surgeon?
Kıyak, Y. S., Coskun, A. K., Kaymak, Ş., Çoşkun, Ö., & Budakoğlu, I. İ. (2024) · Baylor University Medical Center Proceedings · doi:10.1080/08998280.2024.2418752 · Cited by 10
Le, Q., Lavingia, K. S., & Amendola, M. F. (2024) · JVS-Vascular Insights · doi:10.1016/j.jvsvi.2023.100052 · Cited by 11
Artificial intelligence model GPT4 narrowly fails simulated radiological protection exam
Roemer, G. E., Li, A., Mahmood, U. A., Dauer, L. T., & Bellamy, M. B. (2024) · Journal of Radiological Protection · doi:10.1088/1361-6498/ad1fdf · Cited by 10
Luo, S., Canavese, F., Aroojis, A. J., Andreacchio, A., Antičević, D., Bouchard, M. L., Castañeda, P. G., Rosa, V. D., Fiogbe, M. A., Frick, S. L., et al. (2024) · Journal of Pediatric Orthopaedics · doi:10.1097/bpo.0000000000002682 · Cited by 10
Gandhi, A. P., Joesph, F. K., Rajagopal, V., Aparnavi, P., Katkuri, S., Dayama, S., Satapathy, P., Khatib, M. N., Gaidhane, S., Zahiruddin, Q. S., et al. (2024) · JMIR Formative Research · doi:10.2196/49964 · Cited by 9
Measuring the Effectiveness of AI Tools in Clinical Research and Writing: A Case Study in Healthcare
Salisu, S., Alyasiri, O. M., Younis, H. A., Sahib, T. M., Ali, A. H., Noor, A. A., & Hayder, I. M. (2024) · Mesopotamian Journal of Artificial Intelligence in Healthcare · doi:10.58496/mjaih/2024/002 · Cited by 11
Kaewboonlert, N., Poontananggul, J., Pongsuwan, N., & Bhakdisongkhram, G. (2024) · JMIR Medical Education · doi:10.2196/58898 · Cited by 10
Assessing the Impact of ChatGPT on EFL Students’ Writing Productivity and Proficiency
Alwasidi, M. A., & Al-Khalifah, K. S. (2025) · Journal of Language Teaching and Research · doi:10.17507/jltr.1603.29 · Cited by 11
Sousa, S. A., Bukhari, S. S. U. H., Steagall, P. V. M., Bęczkowski, P. M., Giuliano, A., & Flay, K. J. (2025) · Frontiers in Veterinary Science · doi:10.3389/fvets.2025.1616566 · Cited by 12
Efficacy of large language models and their potential in Obstetrics and Gynecology education
Eoh, K. J., Kwon, G. Y., Lee, E. J., Lee, J., Lee, I., Kim, Y. T., & Nam, E. J. (2024) · Obstetrics & Gynecology Science · doi:10.5468/ogs.24211 · Cited by 8
Zhou, S., Wang, H., Ng, S. T., Li, D., Xie, S., Chen, K., & Wang, W. (2025) · Engineering Construction & Architectural Management · doi:10.1108/ecam-06-2024-0701 · Cited by 8
Yang, X., Zhang, Y., Jiang, J., Chen, Z., Bai, R., Yuan, Z., Dong, L., Xiao, Y., Liu, D., Deng, H., et al. (2025) · Digital Health · doi:10.1177/20552076251346703 · Cited by 8
AlShenaiber, A., Datta, S., Mosa, A. J., Binhammer, P., & Ing, E. B. (2024) · Journal of Hand Surgery Global Online · doi:10.1016/j.jhsg.2024.07.011 · Cited by 8
ChatGPT vs. Bard: A Comparative StudyPreprint
Ahmed, I., Kajol, M. A., Hasan, U., & Datta, P. P. (2023) · doi:10.36227/techrxiv.23536290 · Cited by 8
May, M., Körner-Riffard, K., Kollitsch, L., Burger, M., Brookman-May, S. D., Rauchenwald, M., Marszalek, M., & Eredics, K. (2024) · Urologia Internationalis · doi:10.1159/000537854 · Cited by 9
Trust and Reliance in Evolving Human-AI Workflows (TREW)
Ashktorab, Z., Bansal, G., Buçinca, Z., Holstein, K., Hullman, J. R., Smith, A., Wu, T., & Zhang, W. (2024) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3613905.3636319 · Cited by 9
Sanders, A., Lim, R., Jones, D., & Vosburg, R. W. (2024) · Surgical Endoscopy · doi:10.1007/s00464-024-11267-y · Cited by 7
Wang, Y.-M., Shen, H.-W., Chen, T., Chiang, S., & Lin, T.-G. (2025) · JMIR Medical Education · doi:10.2196/56850 · Cited by 8
ChatGPT and Bard in Plastic Surgery: Hype or Hope?
Labouchère, A., & Raffoul, W. (2024) · Surgeries · doi:10.3390/surgeries5010006 · Cited by 8
Igarashi, Y., Nakahara, K., Norii, T., Miyake, N., Tagami, T., & Yokobori, S. (2024) · Journal of Nippon Medical School · doi:10.1272/jnms.jnms.2024_91-205 · Cited by 11
Responses to the Initial Hype: ChatGPT Supporting Teaching, Learning, and Scholarship?
Cefa, B., Macgilchrist, F., ElGamal, H., Bai, J. Y. H., Zawacki‐Richter, O., & Loglo, F. S. (2025) · Open Praxis · doi:10.55982/openpraxis.17.2.872 · Cited by 10
Xiao, Y., Pan, Q., Liu, H., He, Y., Zhang, Y., & Jiang, N. (2025) · Health Informatics Journal · doi:10.1177/14604582251381240 · Cited by 6
Application of DeepSeek-based AI teaching assistant in teaching anesthesiology theories
Hao, F., Du, W., Yan, J., & Jiang, H. (2025) · BMC Medical Education · doi:10.1186/s12909-025-08494-9 · Cited by 6
Şanlı, A. N., Şanlı, D. E. T., & Karabulut, A. (2025) · The American Surgeon · doi:10.1177/00031348251341956 · Cited by 6
Shiraishi, M., Tsuruda, S., Tomioka, Y., Chang, J., Hori, A., Ishii, S., Fujinaka, R., Ando, T., Ohba, J., & Okazaki, M. (2024) · Aesthetic Plastic Surgery · doi:10.1007/s00266-024-04377-4 · Cited by 6
ChatGPT vsPreprint
Ahmed, I., Kajol, M. A., Hasan, U., & Datta, P. P. (2023) · doi:10.36227/techrxiv.23536290.v1 · Cited by 9
A Survey of Large-Scale Deep Learning Models in Medicine and Healthcare
Chen, Z., Liu, R., Huang, S., Guo, Y., & Ren, Y. (2025) · Computer Modeling in Engineering & Sciences · doi:10.32604/cmes.2025.067809 · Cited by 6
Evolving surgical teams in the age of artificial intelligence and robotics
Granados, A., Khanna, R., Fischer, N., Raison, N., Ciabattini, M., Robertshaw, H. H., Boels, M., Malik, M., Granados, V., Vercauteren, T. K., et al. (2026) · Frontiers in Science · doi:10.3389/fsci.2026.1783803 · Cited by 5
Drouaud, A., Stocchi, C., Tang, J. E., Gonsalves, G., Cheung, Z. B., Szatkowski, J., & Forsh, D. A. (2024) · JBJS Open Access · doi:10.2106/jbjs.oa.24.00081 · Cited by 6
Mehta, R., Reitz, J. G., Venna, A. M., Selçuk, A., Dhamala, B., Klein, J. H., Sawda, C. N., Haverty, M. C., Yerebakan, C., Tongut, A., et al. (2025) · Journal of Thoracic and Cardiovascular Surgery · doi:10.1016/j.jtcvs.2025.01.022 · Cited by 5
Ok, F., Karip, B., & Korkmaz, F. T. (2025) · European Journal of Therapeutics · doi:10.58600/eurjther2611 · Cited by 5
SheepDoctor: A knowledge graph enhanced large language model for sheep disease diagnosis
Xiong, J., Zhou, Y., Tian, F., Ni, F., & Zhao, L. (2025) · Smart Agricultural Technology · doi:10.1016/j.atech.2025.101001 · Cited by 7
Bulloch, G., Seth, I., & Lee, C. H. A. (2023) · ANZ Journal of Surgery · doi:10.1111/ans.18544 · Cited by 6
RISK-GPT: Using ChatGPT to construct a reliable risk factor database for all known diseases
Chen, X., Zhang, X., Liu, Y., Wang, Z., Zhou, Y., & Chu, M. (2023) · Journal of Global Health · doi:10.7189/jogh.13.03037 · Cited by 4
Bhattacharya, M., Pal, S., Chatterjee, S., Alshammari, A., Albekairi, T. H., Jagga, S., Ohimain, E. I., Zayed, H., Byrareddy, S. N., Lee, S., et al. (2024) · Current Research in Biotechnology · doi:10.1016/j.crbiot.2024.100194 · Cited by 7
AI did not pass Finnish plastic surgery written board examination
Kelloniemi, M., & Koljonen, V. (2023) · Journal of Plastic Reconstructive & Aesthetic Surgery · doi:10.1016/j.bjps.2023.10.059 · Cited by 5
Jędrzejczak, W. W., Skarżyńśki, H., & Kochanek, K. (2024) · medRxiv · doi:10.1101/2024.10.08.24315089 · Cited by 5
Lockhart, K. R., Canagasingham, A., Zhong, W., Ashrafi, D., March, B., Cole‐Clark, D., Grant, A., & Chung, A. S. J. (2025) · British Journal of Urology · doi:10.1111/bju.16806 · Cited by 4
Large Language Model for Geometric Algebra: A Preliminary Attempt
Wang, J., Wang, Z., Wang, H., Luo, W., Yuan, L., Lü, G., & Yu, Z. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-50078-7_19 · Cited by 4
Poonprasartporn, A., Uttaranakorn, P., & Chuaybamroong, R. (2023) · The Thai Journal of Pharmaceutical Sciences · doi:10.56808/3027-7922.2838 · Cited by 4
Taşkaldıran, I., Önder, Ç. E., Gökbulut, P., Koç, G., & Kuşkonmaz, Ş. M. (2024) · Digital Health · doi:10.1177/20552076241278692 · Cited by 4
Pavone, M., Palmieri, L., Bizzarri, N., Rosati, A., Campolo, F., Innocenzi, C., Taliento, C., Restaino, S., Catena, U., Vizzielli, G., et al. (2024) · Facts Views and Vision in ObGyn · doi:10.52054/fvvo.16.4.052 · Cited by 4
Kurapati, S., Barnett, D. J., Yaghy, A., Sabet, C., Younessi, D. N., Nguyen, D., Lin, J. C., & Scott, I. U. (2025) · Ophthalmologica · doi:10.1159/000544917 · Cited by 4
Cao, Y., Li, Z., Cui, L., & Miao, C. (2025) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3706599.3719852 · Cited by 3
Bernstein, E., Ramsamooj, A., Millar, K. L., & Lum, Z. C. (2025) · JMIR AI · doi:10.2196/68603 · Cited by 3
Khazanchi, R., Chen, A. R., Desai, P., Herrera, D. E., Staub, J. R., Follett, M. A., Krushelnytskyy, M. D., Kemeny, H. R., Hsu, W. K., Patel, A. A., et al. (2025) · Skeletal Radiology · doi:10.1007/s00256-025-05027-9 · Cited by 3
(2024) · Asia-pacific Journal of Convergent Research Interchange · doi:10.47116/apjcri.2024.02.23 · Cited by 3
Liu, Y., Melton, G. B., & Zhang, R. (2024) · PubMed Central · Cited by 3
Zare, S., Vafaeian, S., Amini, M., Farhadi, K., Vali, M., & Golestani, A. (2024) · Scientific Reports · doi:10.1038/s41598-024-79335-w · Cited by 3
Nawari, A. N., Zahir, J., Kumar, S., Ocampo, L., Opara, O. A., Ahmad, H., Crawford, B., & Feeley, B. T. (2025) · Journal of Orthopaedic Experience & Innovation · doi:10.60118/001c.124070 · Cited by 3
Can ChatGPT Solve Undergraduate Exams from Warehousing Studies? An Investigation
Franke, S., Pott, C., Rutinowski, J., Pauly, M., Reining, C., & Kirchheim, A. (2025) · Computers · doi:10.3390/computers14020052 · Cited by 2
Where You Say Matters: A Study of Positional Bias of Small LLMs
Vella, S., Sharieh, S., Hussain, F. A., & Ferworn, A. (2025) · IEEE World AI IoT Congress (AIIoT) · doi:10.1109/aiiot65859.2025.11105359 · Cited by 3
The Utility of ChatGPT for Medical Students on Plastic and Reconstructive Surgery Rotations
Raquepo, T. M., Yamin, M., Gettings, M., Puducheri, S., Tobin, M. J., Won, S., & Cauley, R. P. (2025) · Aesthetic Plastic Surgery · doi:10.1007/s00266-025-05358-x · Cited by 3
Integration and Assessment of ChatGPT in Medical Case Reporting: A Multifaceted Approach
Lin, K.-C., Chen, T.-A., Lin, M.-H., Chen, Y., & Chen, T. (2024) · European Journal of Investigation in Health Psychology and Education · doi:10.3390/ejihpe14040057 · Cited by 3
Yitzhaki, S., Peled, N., Kaplan, E., Kadmon, G., Nahum, E., Gendler, Y., & Weissbach, A. (2025) · Journal of Paediatrics and Child Health · doi:10.1111/jpc.70080 · Cited by 4
Artificial Intelligence in Healthcare
Huarng, K., Yu, T. H., & Huang, D.-H. (2023) · Advances in human and social aspects of technology book series · doi:10.4018/978-1-6684-9591-9.ch003 · Cited by 3
Davies, N., Wilson, R., Winder, M. S., Tunster, S. J., McVicar, K. A., Thakrar, S., Williams, J., & Reid, A. (2023) · medRxiv · doi:10.1101/2023.07.04.23291894 · Cited by 3
ChatGPT vsPreprint
Ahmed, I., Kajol, M. A., Hasan, U., & Datta, P. P. (2023) · doi:10.36227/techrxiv.23536290.v2 · Cited by 5
Zhou, Y., Si, M., & Doll, J. (2024) · Communications in computer and information science · doi:10.1007/978-3-031-78561-0_17 · Cited by 2
Nazarenko, A. G., Kleymenova, E. B., Kakabadze, N. M., Molodchenkov, A. I., & Yashina, L. P. (2025) · N N Priorov Journal of Traumatology and Orthopedics · doi:10.17816/vto642647 · Cited by 2
A Comparative Analysis of GPT-4o and ERNIE Bot in a Chinese Radiation Oncology Exam
Wang, W., Fu, J., Zhang, Y., & Hu, K. (2025) · Journal of Cancer Education · doi:10.1007/s13187-025-02652-9 · Cited by 4
Performance of multimodal large language models in the Japanese surgical specialist examination
Miyamoto, Y., Nakaura, T., Nakamura, H., Hirai, T., & Iwatsuki, M. (2025) · BMC Medical Education · doi:10.1186/s12909-025-07938-6 · Cited by 3
Ming, S., Guo, Q., Cheng, W., & Lei, B. (2023) · doi:10.2196/preprints.52784 · Cited by 2
Salim, R. A., Delvin, D., Harefa, J., & Jingga, K. (2024) · International Conference on Informatics, Multimedia, Cyber and Information System (ICIMCIS) · doi:10.1109/icimcis63449.2024.10957638 · Cited by 1
Responses of ChatGPT-4 on intraocular lenses: an evolving artificial intelligence assessment
Aydın, F. O., & Ermiş, S. (2025) · Clinical and Experimental Optometry · doi:10.1080/08164622.2025.2515970 · Cited by 1
Development of generative artificial intelligence in medical education: a bibliometric profiling
Lu, Q. (2025) · Frontiers in Education · doi:10.3389/feduc.2025.1613067 · Cited by 2
Large language models and their impact in medical imaging education
Zhu, J., & Cai, H. (2025) · PeerJ Computer Science · doi:10.7717/peerj-cs.3433 · Cited by 2
da Silveira, C. A. B., Rasador, A. C. D., Nogueira, R., Takeuchi, M., Kitagawa, Y., Malcher, F., Heniford, B. T., & Lima, D. L. (2026) · Journal of Laparoendoscopic & Advanced Surgical Techniques · doi:10.1177/10926429251408802 · Cited by 1
Generative artificial intelligence in healthcare: a bibliometric analysis.
Tian, X., Meng, F.-Y., Guo, H.-X., Li, Z., Jia, S.-P., Wang, Z.-Q., & Peng, C. (2026) · International Journal of Surgery · doi:10.1097/js9.0000000000004041
Prasad, P., Amin, M., Sari, E. F., Annamma, L. M., Jayaraj, K. N., Yasothkumar, D., & Ahmed, M. (2026) · Frontiers in Dental Medicine · doi:10.3389/fdmed.2026.1874590 · Cited by 1
Lee, S., Roh, Y. H., Shin, H.-J., Song, J. H., Kim, S. E., Lee, I., Lee, H. H., Jeong, O., Jung, M. R., Hur, H., et al. (2026) · Journal of the Korean Gastric Cancer Association · doi:10.5230/jgc.2026.26.e40 · Cited by 1
Xi, W., Zhao, X., Bo-ya, W., Zhu, Y., & Li, H. (2024) · International Journal of Clinical Practice · doi:10.1155/2024/1432594 · Cited by 2
Miranda, D., Palma-Ramírez, D., Fernández, A., Noël, R., Cechinel, C., & Muñoz, R. (2024) · International Conference of the Chilean Computer Science Society (SCCC) · doi:10.1109/sccc63879.2024.10767612 · Cited by 1
Digital Innovation in Medical Education: The Process and Challenges of Digital Transformation
Kim, Y. (2025) · Korean Medical Education Review · doi:10.17496/kmer.24.040 · Cited by 1
Ridha, A., Ahmed, I., Raj, S., Syed, F., Wasim, A. S., Smith, T. O., & Khatri, C. (2023) · Research Square · doi:10.21203/rs.3.rs-3339904/v1
Diniz-Freitas, M., Rivas-Mundiña, B., García‐Iglesias, J. R., García-Mato, E., & Diz-Dios, P. (2023) · Oral Diseases · doi:10.1111/odi.14833
Kaewboonlert, N., Poontananggul, J., Pongsuwan, N., & Bhakdisongkhram, G. (2024) · doi:10.2196/preprints.58898
Choi, S. J., Seo, J., & Hwang, S. W. (2024) · doi:10.2196/preprints.65063
Bernstein, E., Ramsamooj, A., Miller, K. L., & Lum, Z. C. (2024) · doi:10.2196/preprints.68603
Embracing Large Language Models for Adult Life Support Learning
Patel, S., & Patel, R. B. (2024) · Cureus · doi:10.7759/cureus.75961
Qiang, S., Liao, Y., Gu, Y., Gu, Y., Zhang, Y., Wang, Y., Xu, Z., Xu, Z., Han, N., Zhang, H., et al. (2025) · doi:10.2196/preprints.73226
Gupta, S., Ray, K., & Kanwer, B. (2025) · Lecture notes in networks and systems · doi:10.1007/978-981-96-0185-1_10
Dafonte, N., Cadiente, A., Implicito, C., Becker, N., & Surick, B. G. (2025) · Global Surgical Education - Journal of the Association for Surgical Education · doi:10.1007/s44186-025-00369-3
Dejean-Bouyer, E., Kanlagna, A., Thuau, F., Perrot, P., & Lancien, U. (2025) · Journal of Educational Evaluation for Health Professions · doi:10.3352/jeehp.2025.22.27
La, N., Rattanapitoon, S. K., Aeksanti, T., & Rattanapitoon, N. K. (2025) · Journal of Paediatrics and Child Health · doi:10.1111/jpc.70213
Position Bias Across LLM Model Families
Vella, S., Sharieh, S., & Ferworn, A. (2025) · Interdisciplinary Conference on Electrics and Computer (INTCEC) · doi:10.1109/intcec65580.2025.11255828
ChatGPT-4: A fresh lens on holistic education’s reimagination
Baskara, F. R. (2025) · AIP conference proceedings · doi:10.1063/5.0261979
Exploring the roles of Large Language Models in Medical Assistant
Tiwari, D. S. (2023) · Open Research Knowledge Graph (ORKG) · doi:10.48366/r641180
Kim, S., Choi, D., & Son, J. (2025) · World Journal of Pediatric Surgery · doi:10.1136/wjps-2025-001117
Ethical Considerations in AI-Enabled Healthcare
Aldemir, E., Bloom, C., Honeyman, S. I., & Vardanyan, R. (2026) · Biomedical visualization · doi:10.1007/978-3-032-06520-9_5
Virtual Reality, Large Language Models, and Chatbots in Surgical Education and Training
de Simone, B. D., Meo, G. D., Litvin, A., & Catena, F. (2026) · Hot topics in acute care surgery and trauma · doi:10.1007/978-3-032-09357-8_24
Bibliometric mapping of artificial intelligence research in surgical education (1997–2025)
Wu, J., & Zhao, J. (2026) · Frontiers in Surgery · doi:10.3389/fsurg.2026.1759439 · Cited by 1
Vella, S., Sharieh, S., Hussain, F., & Ferworn, A. (2025) · International Conference on Electrical, Computer and Energy Technologies (ICECET) · doi:10.1109/icecet63943.2025.11472552
Artificial Intelligence in Surgical Education: A Pilot Study Using ASCRS Guideline-Derived Questions
Pandya, S., Wilson, T. W., Meyer, R. J., Bresler, T. E., & Fujita, M. (2026) · The American Surgeon · doi:10.1177/00031348261443342
Harnessing large language models to summarize landmark surgical studies for resident education
Pettigrew, M. F., Tyler, L. A., Gregory, A. L., Nomellini, V., Bhat, S. G., Murphy, J. T., Purcell, L. N., Butler, D. F., Park, C., Clark, A. T., et al. (2026) · Global Surgical Education - Journal of the Association for Surgical Education · doi:10.1007/s44186-026-00537-z
Ethical considerations and privacy in artificial intelligence-driven metaverse healthcare
Katepaka, S., Bej, A., Das, A., & Nandi, A. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-27692-7.00025-3
Assessing Generative Pre-trained Transformer 4 in Clinical Trial Inclusion Criteria Matching
Pasichnyk, V., Dyyak, I., Horlatch, V., & Pasichnyk, T. (2024) · International Workshop on Computer Modeling and Intelligent Systems (CMIS) · doi:10.55056/ceur-ws.org/vol-3702/paper25.pdf
Inteligencia artificial en la formación y el entrenamiento quirúrgico: revisión narrativa
Mayol, J. M. (2026) · Medicina Clínica · doi:10.1016/j.medcli.2026.107505
Ling, X., & Wang, C. (2026) · Discover Computing · doi:10.1007/s10791-026-10445-x
Artificial intelligence in surgical training and education: A narrative review
Mayol, J. (2026) · Medicina Clínica (English Edition) · doi:10.1016/j.medcle.2026.107505
Metadata
- Authors
- Oh, N., Choi, G.-S., & Lee, W. Y.
- Affiliations
- Samsung Medical Center (KR)
- Corresponding author
- Lee, Woo Yong
- Venue
- Annals of Surgical Treatment and Research
- Publisher
- XMLink
- Published
- 2023
- Volume
- 104
- Issue
- 5
- Pages
- 269
- ISSN
- 2288-6575 (ISSN-L)
- 2288-6796
- PMC
- PMC10172028
- OpenAlex
- W4372047097
- Cited by
- 201
- References
- 12
- Citations by year
- 2026: 16 · 2025: 62 · 2024: 89 · 2023: 34
- FWCI
- 8.07
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- Locations
- Annals of Surgical Treatment and Research (publishedVersion, cc-by-nc)
- medRxiv (acceptedVersion, cc-by-nc-nd)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- Funders
- Samsung
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Medicine › Surgery › Surgical Simulation and Training
- Social Sciences › Education › Innovations in Medical Education
- Keywords
- ChatGPT, GPT-4, large language models, surgical training, model performance comparison, GPT-3.5, artificial intelligence in healthcare
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
