Appropriateness and Comprehensiveness of Using ChatGPT for Perioperative Patient Education in Thoracic Surgery in Different Language Contexts: Survey Study
Open accessPublished version of a preprint
The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
Background: ChatGPT, a dialogue-based artificial intelligence language model, has shown promise in assisting clinical workflows and patient-clinician communication. However, there is a lack of feasibility assessments regarding its use for perioperative patient education in thoracic surgery. Objective: This study aimed to assess the appropriateness and comprehensiveness of using ChatGPT for perioperative patient education in thoracic surgery in both English and Chinese contexts. Methods: This pilot study was conducted in February 2023. A total of 37 questions focused on perioperative patient education in thoracic surgery were created based on guidelines and clinical experience. Two sets of inquiries were made to ChatGPT for each question, one in English and the other in Chinese. The responses generated by ChatGPT were evaluated separately by experienced thoracic surgical clinicians for appropriateness and comprehensiveness based on a hypothetical draft response to a patient’s question on the electronic information platform. For a response to be qualified, it required at least 80% of reviewers to deem it appropriate and 50% to deem it comprehensive. Statistical analyses were performed using the unpaired chi-square test or Fisher exact test, with a significance level set at P<.05. Results: The set of 37 commonly asked questions covered topics such as disease information, diagnostic procedures, perioperative complications, treatment measures, disease prevention, and perioperative care considerations. In both the English and Chinese contexts, 34 (92%) out of 37 responses were qualified in terms of both appropriateness and comprehensiveness. The remaining 3 (8%) responses were unqualified in these 2 contexts. The unqualified responses primarily involved the diagnosis of disease symptoms and surgical-related complications symptoms. The reasons for determining the responses as unqualified were similar in both contexts. There was no statistically significant difference (34/37, 92% vs 34/37, 92%; P=.99) in the qualification rate between the 2 language sets. Conclusions: This pilot study demonstrates the potential feasibility of using ChatGPT for perioperative patient education in thoracic surgery in both English and Chinese contexts. ChatGPT is expected to enhance patient satisfaction, reduce anxiety, and improve compliance during the perioperative period. In the future, there will be remarkable potential application for using artificial intelligence, in conjunction with human review, for patient education and health consultation after patients have provided their informed consent.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Both the relevance and comprehensiveness of the English and Chinese responses were high [27].”
From Is there any room for ChatGPT AI bot in speech-language pathology? (2025) · cites this paper as [27]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cascella, M., Montomoli, J., Bellini, V., & Bignami, E. (2023) · Journal of Medical Systems · doi:10.1007/s10916-023-01925-4 · Cited by 1,120
Utility of ChatGPT in Clinical Practice
Liu, J., Wang, C., & Liu, S. (2023) · Journal of Medical Internet Research · doi:10.2196/48568 · Cited by 505
Ettinger, D. S., Wood, D. E., Aisner, D. L., Akerley, W., Bauman, J. R., Bharat, A., Bruno, D. S., Chang, J. Y., Chirieac, L. R., DeCamp, M., et al. (2023) · Journal of the National Comprehensive Cancer Network · doi:10.6004/jnccn.2023.0020 · Cited by 498
Sarraju, A., Bruemmer, D., Van Iterson, E., Cho, L., Rodriguez, F., & Laffin, L. (2023) · JAMA · doi:10.1001/jama.2023.1044 · Cited by 452
Using ChatGPT to write patient clinic letters
Ali, S. R., Dobbs, T. D., Hutchings, H. A., & Whitaker, I. S. (2023) · The Lancet Digital Health · doi:10.1016/s2589-7500(23)00048-1 · Cited by 375 · cited 1×
“Several studies have documented the utilization of ChatGPT in the medical field, such as clinical decision assistance [2,3], medical document generation [4,5], and medical question answering [6-8].”
Hirosawa, T., Harada, Y., Yokose, M., Sakamoto, T., Kawamura, R., & Shimizu, T. (2023) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph20043378 · Cited by 343
Johnson, S. B., King, A. J., Warner, E. L., Aneja, S., Kann, B. H., & Bylund, C. L. (2023) · JNCI Cancer Spectrum · doi:10.1093/jncics/pkad015 · Cited by 289
The exciting potential for ChatGPT in obstetrics and gynecology
Grünebaum, A., Chervenak, J., Pollet, S. L., Katz, A., & Chervenak, F. A. (2023) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2023.03.009 · Cited by 234 · cited 1×
“Several studies have documented the utilization of ChatGPT in the medical field, such as clinical decision assistance [2,3], medical document generation [4,5], and medical question answering [6-8].”
Early applications of ChatGPT in medical practice, education and research
Sedaghat, S. (2023) · Clinical Medicine · doi:10.7861/clinmed.2023-0078 · Cited by 163
Assessing the Value of ChatGPT for Clinical Decision Support Optimization
Liu, S., Wright, A. P., Patterson, B. L., Wanderer, J. P., Turer, R. W., Nelson, S. D., McCoy, A. B., Sittig, D. F., & Wright, A. (2023) · doi:10.1101/2023.02.21.23286254 · Cited by 90
Cited by
Tam, T. Y. C., Sivarajkumar, S., Kapoor, S., Stolyar, A. V., Polanska, K., McCarthy, K. R., Osterhoudt, H., Wu, X., Visweswaran, S., Fu, S., et al. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01258-7 · Cited by 424
Current applications and challenges in large language models for patient care: a systematic review
Busch, F., Hoffmann, L., Rueger, C., van Dijk, E. H., Kader, R., Ortiz-Prado, E., Makowski, M. R., Saba, L., Hadamitzky, M., Kather, J. N., et al. (2025) · Communications Medicine · doi:10.1038/s43856-024-00717-2 · Cited by 358
Large language models in patient education: a scoping review of applications in medicine
Aydin, S., Karabacak, M., Vlachos, V., & Margetis, K. (2024) · Frontiers in Medicine · doi:10.3389/fmed.2024.1477898 · Cited by 288
Large Language Models for Chatbot Health Advice Studies: A Systematic Review
Huo, B., Boyle, A., Marfo, N., Tangamornsuksan, W., Steen, J. P., McKechnie, T., Lee, Y., Mayol, J., Antoniou, S. A., Thirunavukarasu, A. J., et al. (2025) · JAMA Network Open · doi:10.1001/jamanetworkopen.2024.57879 · Cited by 283
A bibliometric analysis of the rise of ChatGPT in medical research
Barrington, N. M., Gupta, N., Musmar, B., Doyle, D., Panico, N., Godbole, N., Reardon, T., & D’Amico, R. S. (2023) · Medical Sciences · doi:10.3390/medsci11030061 · Cited by 69
“For patients, ChatGPT may provide a tool to access health information on simple topics or conditions, or to clarify and summarize complex medical literature that would otherwise be challenging to comprehend [27,28].”
BackgroundAnalyzing evaluation methods for large language models in the medical field: a scoping review
Lee, J., Park, S., Shin, J., & Cho, B. (2024) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-024-02709-7 · Cited by 52
Credibility of ChatGPT in the assessment of obesity in type 2 diabetes according to the guidelines
Barlas, T., Altınova, A. E., Aktürk, M., & Törüner, F. B. (2023) · International Journal of Obesity · doi:10.1038/s41366-023-01410-5 · Cited by 59
He, W., Zhang, W., Jin, Y., Zhou, Q., Zhang, H., & Xia, Q. (2024) · Journal of Medical Internet Research · doi:10.2196/54706 · Cited by 52
A review of Chinese sentiment analysis: subjects, methods, and trends
Wang, Z., Huang, D., Cui, J., Zhang, X., Ho, S.-B., & Cambria, E. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-024-10988-9 · Cited by 69
Luo, P.-W., Liu, J., Xie, X., Jiang, J., Huo, X., Chen, Z.-L., Huang, Z.-C., Jiang, S., & Li, M. (2025) · American Journal of Clinical and Experimental Urology · doi:10.62347/uiap7979 · Cited by 41
Nedbal, C., Naik, N., Castellani, D., Gauhar, V., Geraghty, R. M., & Somani, B. K. (2023) · Current Opinion in Urology · doi:10.1097/mou.0000000000001151 · Cited by 43
The Evaluation of Generative AI Should Include Repetition to Assess Stability
Zhu, L., Mou, W., Hong, C., Yang, T., Lai, Y., Qi, C., Lin, A., Zhang, J., & Luo, P. (2024) · JMIR mHealth and uHealth · doi:10.2196/57978 · Cited by 38
“Shao et al [13] examined the suitability of using ChatGPT for perioperative patient education in thoracic surgery within English and Chinese contexts.”
BackgroundAssessing the Quality of ChatGPT’s Dietary Advice for College Students from Dietitians’ Perspectives
Liao, L., Chang, L., & Lai, I. (2024) · Nutrients · doi:10.3390/nu16121939 · Cited by 43
Evaluating the Reliability of ChatGPT for Health-Related Questions: A Systematic Review
Beheshti, M., Toubal, I. E., Alaboud, K., Almalaysha, M., Ogundele, O. B., Turabieh, H., Abdalnabi, N., Boren, S. A., Scott, G. J., & Dahu, B. M. (2025) · Informatics · doi:10.3390/informatics12010009 · Cited by 47
Gan, W., Ouyang, J., She, G., Xue, Z., Zhu, L., Lin, A., Mou, W., Jiang, A., Chang, Q., Cheng, Q., et al. (2025) · International Journal of Surgery · doi:10.1097/js9.0000000000002223 · Cited by 40
Self-citationTrapp, C., Schmidt-Hegemann, N., Keilholz, M., Brose, S. F., Marschner, S. N., Schönecker, S., Maier, S. H., Dehelean, D.-C., Rottler, M., Konnerth, D., et al. (2025) · Strahlentherapie und Onkologie · doi:10.1007/s00066-024-02342-3 · Cited by 29
ChatGPT and Health Communication: A Systematic Literature Review
Li, M., & Guenier, A. W. (2024) · International Journal of E-Health and Medical Communications · doi:10.4018/ijehmc.349980 · Cited by 34
Comparing ChatGPT's and Surgeon's Responses to Thyroid-related Questions From Patients
Guo, S., Li, R., Li, G., Chen, W., Huang, J., He, L., Ma, Y., Wang, L., Zheng, H., Tian, C., et al. (2024) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/clinem/dgae235 · Cited by 24
Ferrari‐Light, D., Merritt, R. E., D’Souza, D. M., Ferguson, M. K., Harrison, S. W., Madariaga, M. L. L., Lee, B. E., Moffatt, S. D., & Kneuertz, P. J. (2024) · Journal of Thoracic and Cardiovascular Surgery · doi:10.1016/j.jtcvs.2024.09.030 · Cited by 23
Improving Readability and Automating Content Analysis of Plastic Surgery Webpages With ChatGPT
Fanning, J. E., Escobar‐Domingo, M. J., Foppiani, J., Lee, D., Miller, A. S., Janis, J. E., & Lee, B. T. (2024) · Journal of Surgical Research · doi:10.1016/j.jss.2024.04.006 · Cited by 19
Liu, Y., Li, H., Ouyang, J., Xue, Z., Wang, M., He, H., Song, B., Zheng, X., & Gan, W. (2025) · JMIR Perioperative Medicine · doi:10.2196/70047 · Cited by 17
Self-citationGlobal trends and hotspots of ChatGPT in medical research: a bibliometric and visualized study
Liu, L., Qu, S., Zhao, H., Kong, L., Xie, Z., Jiang, Z., & Zou, P. (2024) · Frontiers in Medicine · doi:10.3389/fmed.2024.1406842 · Cited by 14
Chang, L., Sun, C., Chen, T.-H., Tsai, D., Lin, H., & Liao, L. (2024) · Digital Health · doi:10.1177/20552076241277021 · Cited by 20
Emile, S. H., Horesh, N., Garoufalia, Z., Gefen, R., Boutros, M., & Wexner, S. D. (2025) · The American Surgeon · doi:10.1177/00031348251367031 · Cited by 23
From Emergence to Endemicity: A Comprehensive Review of COVID-19
Naik, R., Avula, S., Palleti, S. K., Gummadi, J., Ramachandran, R., Chandramohan, D., Dhillon, G. S., Gill, A. S., Paiwal, K., Shaik, B. F., et al. (2023) · Cureus · doi:10.7759/cureus.48046 · Cited by 21
Piao, Y., Chen, H., Wu, S., Li, X., Li, Z., & Yang, D. (2024) · Digital Health · doi:10.1177/20552076241284771 · Cited by 17
Dastani, M., Mardaneh, J., & Rostamian, M. (2025) · Scientific Reports · doi:10.1038/s41598-025-03074-9 · Cited by 19
Is there any room for ChatGPT AI bot in speech-language pathology?
Birol, N. Y., Çiftci, H. B., Yılmaz, A., Çağlayan, A., & Alkan, F. (2025) · European Archives of Oto-Rhino-Laryngology · doi:10.1007/s00405-025-09295-y · Cited by 12
Armstrong, D. L., Paul, C., McGlaughlin, B., & Hill, D. M. (2024) · JACCP JOURNAL OF THE AMERICAN COLLEGE OF CLINICAL PHARMACY · doi:10.1002/jac5.2006 · Cited by 12
Yuan, X., Shao, C.-Y., Zhang, Z.-Z., & Qian, D. (2025) · Digital Health · doi:10.1177/20552076251315511 · Cited by 10
Self-citationEnhancing perinatal health patient information through ChatGPT – An accuracy study
de Vries, P. L. M., Baud, D., Baggio, S., Ceulemans, M., Favre, G., Gerbier, E., Legardeur, H., Maisonneuve, É., Pena-Reyes, C., Pomar, L., et al. (2025) · PEC Innovation · doi:10.1016/j.pecinn.2025.100381 · Cited by 14
Troian, M., Lovadina, S., Ravasin, A., Arbore, A., Aleksova, A., Baratella, E., & Cortale, M. (2025) · Journal of Clinical Medicine · doi:10.3390/jcm14051676 · Cited by 17
Qiu, J., & Zhou, Y. (2024) · PLoS ONE · doi:10.1371/journal.pone.0311937 · Cited by 11
Richlitzki, C., Mansoorian, S., Käsmann, L., Stoleriu, M. G., Kovács, J., Sienel, W. G. R., Kauffmann-Guerrero, D. E., Duell, T., Schmidt-Hegemann, N.-S., Belka, C., et al. (2025) · JMIR Cancer · doi:10.2196/69783 · Cited by 11
The Performance of ChatGPT-4.0 and ChatGPT-4omni on Answering Thyroid Question: A Multicenter Study
Guo, S., Li, G., Gou, J., Gong, Y., Zhao, W., Li, Z., Yang, X., Liu, Z., Li, Z., & Lei, J. (2025) · Journal of Surgical Research · doi:10.1016/j.jss.2025.06.066 · Cited by 9
ChatGPT-4 in Neurosurgery: Improving Patient Education Materials
Singh, A., Gupta, N. K., Chien, D., Singh, R., Sachdeva, A., Danasekaran, K., Gajjar, A. A., Houk, C., Jalal, M. I., Li, A. Y., et al. (2025) · Neurosurgery · doi:10.1227/neu.0000000000003606 · Cited by 10
Palmarin, E., Lando, S., Marchet, A., Saibene, T., Michieletto, S., Cagol, M., Milardi, F., Gregori, D., & Lorenzoni, G. (2025) · Journal of Clinical Medicine · doi:10.3390/jcm14155411 · Cited by 9
GÜNGÖR, N. D., Esen, F. S., Taşçı, T., Güngör, K., & Cil, K. (2024) · Oncology Research and Treatment · doi:10.1159/000543173 · Cited by 5
Leveraging Large Language Models to Enhance Patient Educational Resources in Rhinology
Shaari, A. L., Ho, R., Xu, A., Patil, D. P., Berisha, L., & Hsueh, W. D. (2025) · Annals of Otology Rhinology & Laryngology · doi:10.1177/00034894251342969 · Cited by 3
Not a Doctor, but I Write Like One: ChatGPT in General Surgery Informed Consent
Helbing, A. H. B., Boualoy, T., & Moten, A. S. (2026) · Journal of Surgical Research · doi:10.1016/j.jss.2026.03.004 · Cited by 2
Dale, R., Cheng, M., Pines, K. C., & Currie, M. E. (2025) · medRxiv · doi:10.1101/2025.05.20.25328009 · Cited by 2
Liao, Z., Huang, J., Liu, Y., Li, F., Tang, L., Cong, L., Wang, H., & Luo, S. (2025) · Aesthetic Plastic Surgery · doi:10.1007/s00266-025-05314-9 · Cited by 2
Tulone, G., Pavan, N., Giaimo, R., Simonato, A. F., Salzano, A., Cosentino, D., Claps, F., & Simonato, A. (2026) · Andrology · doi:10.1111/andr.70236 · Cited by 1
Richlitzki, C., Mansoorian, S., Käsmann, L., Stoleriu, M. G., Kovács, J., Sienel, W. G. R., Kauffmann-Guerrero, D. E., Duell, T., Schmidt-Hegemann, N.-S., Belka, C., et al. (2024) · doi:10.2196/preprints.69783
He, Q., Shi, J., Liu, X., Tian, F., Bu, S., & Jiang, Y. (2026) · iScience · doi:10.1016/j.isci.2026.115002
Self-citationEnhancing Patients' Informed Consent Through Artificial Intelligence: A Systematic Review (Preprint)Preprint
Dababneh, S., Hebert, N., Meloche, L., Dababneh, N. E., Aleksieva, P., & Tanoubi, I. (2026) · doi:10.2196/preprints.93501
Karabulut, A., Kantarcı, S., Dağlı, U., GÜDÜKLÜ, A., Uçar, İ., Karataşlı, V., & İnan, A. H. (2026) · The Anatolian Journal of General Medical Research · doi:10.4274/anatoljmed.2026.97759
Enhancing Patients’ Informed Consent Through AI: Systematic Review
Dababneh, S., Hebert, N., Meloche, L., Dababneh, N. E., Aleksieva, P., & Tanoubi, I. (2026) · JMIR AI · doi:10.2196/93501
AlSamhori, J. F., AlSamhori, A. R. F., Amourah, R. M., Aldweik, H., AlSamhori, A. F., Holy, L. M., Zakraoui, R., Alomari, S. H., & Shahait, A. D. (2026) · Cureus · doi:10.7759/cureus.116502
Metadata
- Authors
- Shao, C.-Y., Li, H., Liu, X.-L., Li, C., Yang, L.-Q., Zhang, Y.-J., Luo, J., & Zhao, J.
- Affiliations
- First Affiliated Hospital of Soochow University (CN)
- Nanjing General Hospital of Nanjing Military Command (CN)
- Corresponding author
- Zhao, Jun
- Venue
- Interactive Journal of Medical Research
- Publisher
- JMIR Publications Inc.
- Published
- 2023-08-14
- Volume
- 12
- Pages
- e46900
- ISSN
- 1929-073X (ISSN-L)
- PMC
- PMC10463083
- OpenAlex
- W4385299173
- Cited by
- 49
- References
- 13
- Citations by year
- 2026: 7 · 2025: 21 · 2024: 17 · 2023: 4
- FWCI
- 1.95
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Interactive Journal of Medical Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Health Professions › General Health Professions › Health Literacy and Information Accessibility
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Keywords
- ChatGPT, perioperative patient education, thoracic surgery, artificial intelligence in healthcare, language barriers, patient-clinician communication, perioperative complications, patient information
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.