Putting ChatGPT’s Medical Advice to the (Turing) Test: Survey Study
Open accessPublished version of a preprint
The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Abstract
Background: Chatbots are being piloted to draft responses to patient questions, but patients’ ability to distinguish between provider and chatbot responses and patients’ trust in chatbots’ functions are not well established. Objective: This study aimed to assess the feasibility of using ChatGPT (Chat Generative Pre-trained Transformer) or a similar artificial intelligence–based chatbot for patient-provider communication. Methods: A survey study was conducted in January 2023. Ten representative, nonadministrative patient-provider interactions were extracted from the electronic health record. Patients’ questions were entered into ChatGPT with a request for the chatbot to respond using approximately the same word count as the human provider’s response. In the survey, each patient question was followed by a provider- or ChatGPT-generated response. Participants were informed that 5 responses were provider generated and 5 were chatbot generated. Participants were asked—and incentivized financially—to correctly identify the response source. Participants were also asked about their trust in chatbots’ functions in patient-provider communication, using a Likert scale from 1-5. Results: A US-representative sample of 430 study participants aged 18 and older were recruited on Prolific, a crowdsourcing platform for academic studies. In all, 426 participants filled out the full survey. After removing participants who spent less than 3 minutes on the survey, 392 respondents remained. Overall, 53.3% (209/392) of respondents analyzed were women, and the average age was 47.1 (range 18-91) years. The correct classification of responses ranged between 49% (192/392) to 85.7% (336/392) for different questions. On average, chatbot responses were identified correctly in 65.5% (1284/1960) of the cases, and human provider responses were identified correctly in 65.1% (1276/1960) of the cases. On average, responses toward patients’ trust in chatbots’ functions were weakly positive (mean Likert score 3.4 out of 5), with lower trust as the health-related complexity of the task in the questions increased. Conclusions: ChatGPT responses to patient questions were weakly distinguishable from provider responses. Laypeople appear to trust the use of chatbots to answer lower-risk health questions. It is important to continue studying patient-chatbot interaction as chatbots move from administrative to more clinical roles in health care.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“GPT-4 can generate fluent, human-like text, even about complex topics like medicine58.”
From Text classification models for assessing the completeness of randomized controlled trial publications based on CONSORT reporting guidelines (2024) · cites this paper as [58]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜
Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445922 · Cited by 6,988 · cited 1×
“Research to mitigate risks of AI chatbot–generated responses, including the potential for patient harm caused by incorrect answers; cybersecurity vulnerabilities [31]; and environmental, social, and financial risks [32] should also be further explored.”
BackgroundSurvey of Hallucination in Natural Language Generation
Ji, Z., Lee, N., Frieske, R., Yu, T., Su, D., Xu, Y., Ishii, E., Bang, Y. J., Madotto, A., & Fung, P. (2023) · ACM Computing Surveys · doi:10.1145/3571730 · Cited by 5,025 · cited 1×
“These include biases from the underlying data (eg, social biases such as racism and sexism) [7,8], the ability to “hallucinate” information that is untrue [9], and the lack of mental models that would allow for true reasoning rather than simply probabilistic text generation (leading it to make errors in response to qu…”
BackgroundFisher, R. A. (1936) · BMJ · doi:10.1136/bmj.1.3923.554-a · Cited by 4,980
Large Language Models Encode Clinical Knowledge
Singhal, K., Azizi, S., Tu, T., Mahdavi, S. S., Wei, J., Chung, H. W., Scales, N., Tanwani, A., Cole-Lewis, H., Pfohl, S., et al. (2022) · arXiv · doi:10.48550/arxiv.2212.13138 · Cited by 4,083
Large language models encode clinical knowledge
Singhal, K., Azizi, S., Tu, T., Mahdavi, S. S., Wei, J., Chung, H. W., Scales, N., Tanwani, A., Cole-Lewis, H., Pfohl, S., et al. (2023) · Nature · doi:10.1038/s41586-023-06291-2 · Cited by 4,083 · cited 3×
“Recent studies have had health care professionals judge ChatGPT’s responses to health-related questions [14-16], with findings such as 84% of answers to cardiovascular disease prevention questions being appropriate [15] and ChatGPT overall scoring higher for quality and empathy than health care…”
BackgroundMethodInfluentialAyers, J. W., Poliak, A., Dredze, M., Leas, E. C., Zhu, Z., Kelley, J. B., Faix, D. J., Goodman, A. M., Longhurst, C. A., Hogarth, M., et al. (2023) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2023.1838 · Cited by 2,613
Benefits, Limits, and Risks of GPT-4 as an AI Chatbot for Medicine
Lee, P., Bubeck, S., & Petro, J. (2023) · New England Journal of Medicine · doi:10.1056/nejmsr2214184 · Cited by 1,738
Nadarzynski, T., Miles, O., Cowie, A., & Ridge, D. (2019) · DIGITAL HEALTH · doi:10.1177/2055207619871808 · Cited by 810
Role of Chat GPT in public health
Biswas, S. S. (2023) · Annals of Biomedical Engineering · doi:10.1007/s10439-023-03172-7 · Cited by 673 · cited 1×
“Recently, the launch of ChatGPT (Chat Generative Pre-trained Transformer; OpenAI) [1] has prompted a surge of interest in AI-based chatbots, both from the health care field [2,3] and the general public [4,5].”
BackgroundPhysician stress and burnout: the impact of health information technology
Gardner, R. L., Cooper, E., Haskell, J., Harris, D. A., Poplau, S., Kroth, P. J., & Linzer, M. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy145 · Cited by 566
Research works printed but not linked: 1
- BolukbasiTChangKWZouJSaligramaVKalaiAMan is to computer programmer as woman is to homemaker? debiasing word embeddings2016125NIPS'16: 30th International Conference on Neural Information Processing SystemsDecember 5-10, 2016Barcelona, Spain43564364
Cited by
Items 101–199 of 199
Zhang, Y., Tian, J., & Deng, F. (2025) · Interacting with Computers · doi:10.1093/iwc/iwaf029 · Cited by 13
Using AI as a Learning Tool Through Simulation Interviews to Enhance Adult Learning
Lin, X. Y., zhao, T., Schmidt, S. W., & Zhou, S. (2025) · Adult Learning · doi:10.1177/10451595251345274 · Cited by 12
Under pressure: how time constraints, task complexity, and AI reliability shape human-AI interaction
Hermanns, L., & Teubner, T. (2025) · Behaviour and Information Technology · doi:10.1080/0144929x.2025.2587732 · Cited by 13
Hahne, J., & Carpenter, B. D. (2026) · Patient Education and Counseling · doi:10.1016/j.pec.2026.109492 · Cited by 13
Sketch-to-Energy model automation with multimodal LLMs and retrieval-augmented generation
Zhang, Y., Wang, G., & Xu, P. (2026) · Energy and Buildings · doi:10.1016/j.enbuild.2026.117387 · Cited by 7
Meter, A. V., Wheaton, M. G., Cosgrove, V. E., Andreadis, K., & Robertson, R. E. (2025) · PLOS Digital Health · doi:10.1371/journal.pdig.0000711 · Cited by 8
Mendel, T., Mandal, S., Nov, O., & Wiesenfeld, B. M. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757524 · Cited by 10
Self-citationZhang, L., Shu, J., Hu, J., Li, F., He, J., Wang, P., & Shen, Y. (2024) · Electronics · doi:10.3390/electronics13112002 · Cited by 14
Kerr, W. T., McFarlane, K. N., Pucci, G. F., Carns, D. R., Israel, A., Vighetti, L., Pennell, P. B., Stern, J. M., Xia, Z., & Wang, Y. (2025) · Epilepsia · doi:10.1111/epi.18272 · Cited by 9
TwinStar: A Novel Design for Enhanced Test Question Generation Using Dual-LLM Engine
Zhuge, Q., Wang, H., & Chen, X. (2025) · Applied Sciences · doi:10.3390/app15063055 · Cited by 11
Impact of ChatGPT on Diabetes Mellitus Self-Management Among Patients in Saudi Arabia
Alanzi, T. M., Arif, W. M., Alotaibi, A., Alnafisi, A., Alhwaimal, R., Altowairqi, N., Alnifaie, A., Aldossari, K., Althumali, K., & Alanzi, N. (2025) · Cureus · doi:10.7759/cureus.81855 · Cited by 8
The early wave of ChatGPT research: A review and future agenda
Busch, P. A., Hausvik, G. I., & Nielsen, J. A. (2025) · Computers in Human Behavior Artificial Humans · doi:10.1016/j.chbah.2025.100213 · Cited by 13
Erden, Y., Temel, M. H., & Bağcıer, F. (2025) · Reumatologia/Rheumatology · doi:10.5114/reum/207526 · Cited by 6
An Evaluation System for Large Language Models based on Open-Ended Questions
Cao, Z., Ma, Z., & Chen, M. (2024) · IEEE International Conference on Cyber Security and Cloud Computing (CSCloud) · doi:10.1109/cscloud62866.2024.00019 · Cited by 5
A cross-lingual syntactic investigation of gender bias and stereotyping in GPT-4o: English vs Hindi
Arora, S., & Srivastava, A. (2024) · AI and Ethics · doi:10.1007/s43681-024-00565-9 · Cited by 6
Zeljković, I., Novak, M., Jordán, A., Lisičić, A., Blažić, T. N., Pavlović, N., & Manola, Š. (2024) · Heart Rhythm O2 · doi:10.1016/j.hroo.2024.10.005 · Cited by 7
Utilization of ChatGPT for Rhinology Patient Education: Limitations in a Surgical Sub‐Specialty
Huang, A. E., Chang, M. T., Khanwalkar, A. R., Yan, C. H., Phillips, K. M., Yong, M., Nayak, J. V., Hwang, P. H., & Patel, Z. M. (2025) · OTO Open · doi:10.1002/oto2.70065 · Cited by 5
Comparison of ChatGPT knowledge against 2020 consensus statement on ankyloglossia in children
Howard, E. C., Chong, N. Y. K., Carnino, J. M., & Levi, J. R. (2024) · International Journal of Pediatric Otorhinolaryngology · doi:10.1016/j.ijporl.2024.111957 · Cited by 6
Triangle of Trust in Cancer Care? The physician, the patient, and artificial intelligence chatbot
Turner, J. H. (2023) · Cancer Biotherapy and Radiopharmaceuticals · doi:10.1089/cbr.2023.0112 · Cited by 5
Fede, G. D., Alrabie, L., & Andolina, S. (2025) · Springer eBooks · doi:10.1007/978-981-97-8440-0_49-2 · Cited by 5
Performance Analysis on the Applications of Large Language Models: A Case for Elderly Care
Wang, S., Deng, J., Li, Q., Wu, J., & Zhao, Z. (2024) · IEEE International Conference on High Performance Computing and Communications; IEEE International Conference on Smart City; IEEE International Conference on Data Science and Systems (HPCC/SmartCity/DSS) · doi:10.1109/hpcc64274.2024.00029 · Cited by 5
Fede, G. D., Alrabie, L., & Andolina, S. (2025) · Springer eBooks · doi:10.1007/978-981-97-8440-0_49-1 · Cited by 5
Patients, Doctors, and Chatbots
Erren, T. C. (2023) · JMIR Medical Education · doi:10.2196/50869 · Cited by 5
Şimşek, C., de Madaria, E., Ebigbo, A., Vaněk, P., Elshaarawy, O., Voiosu, A. M., Antonelli, G., Turró, R., Gisbert, J. P., Nyssen, O. P., et al. (2025) · Endoscopy International Open · doi:10.1055/a-2637-2163 · Cited by 6
Proceedings of The ACM Collective Intelligence Conference
(2023) · doi:10.1145/3582269 · Cited by 4
Why Would University Students Use ChatGPT for Health Discourses? A Moderated Mediation Analysis
Vu, C. B., & Park, D. Y. (2025) · Journal of Consumer Health on the Internet · doi:10.1080/15398285.2025.2491042 · Cited by 4
Guerrero, J., Martínez-Cruz, C., Espinilla, M., Díaz-Jiménez, D., & López, J. L. (2025) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2025.108878 · Cited by 5
Demir, G., Sevri, M., Hacıosmanoğlu, C. D., Büyüktaşkın, D., & Özaslan, A. (2025) · Gazi Medical Journal · doi:10.12996/gmj.2025.4451 · Cited by 6
Su, J., Yang, X., Li, X., Chen, J., Jiang, C., Wang, Y., Zhuang, L., & Li, H. (2025) · Clinical Cosmetic and Investigational Dermatology · doi:10.2147/ccid.s552979 · Cited by 4
Gazola, A. A., Bishop, N. S., Schmid, B. E., Pirracchio, R., Valley, T. S., Bhavani, S. V., Krutsinger, D. C., Giannini, H. M., Lu, Y., Ungar, L., et al. (2025) · BMJ Open · doi:10.1136/bmjopen-2025-106757 · Cited by 3
Babalola, A. E., Johnson, V. M., Bolarinwa, O., Ogwuche, A. O., Somoye, V. A., Williams, T., Azeez, O. A., Onasanya, O. J., Okiti, R. O., & Oludiran, O. D. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-00863-7 · Cited by 3
A Comprehensive Examination of ChatGPT's Contribution to the Healthcare Sector and Hepatology
Kumari, K., Pahuja, S. K., & Kumar, K. S. (2024) · Digestive Diseases and Sciences · doi:10.1007/s10620-024-08659-4 · Cited by 3
ChatGPT: An Artificial Intelligence-Based Approach to Enhance Medical Applications
Chaddad, A., He, C., & Jiang, Y. (2023) · IEEE International Conference on Bioinformatics and Bioengineering (BIBE) · doi:10.1109/bibe60311.2023.00078 · Cited by 3
McDarby, M., Mroz, E. L., Hahne, J., Malling, C. D., Carpenter, B. D., & Parker, P. A. (2024) · Journal of Palliative Medicine · doi:10.1089/jpm.2024.0256 · Cited by 3
Dede, B. T., Oğuz, M., Alyanak, B., Bağcıer, F., & Yıldızgören, M. T. (2025) · HSS Journal® The Musculoskeletal Journal of Hospital for Special Surgery · doi:10.1177/15563316251340697 · Cited by 3
Using AI for Simulation Interviews to Enhance Adult Learning
Lin, X. Y., Zhao, T., & Zhou, S. (2025) · doi:10.1109/icaie64856.2025.11158060 · Cited by 5
Is Consent-GPT valid? Public attitudes to generative AI use in surgical consent
Allen, J. W., Hannikainen, I. R., Savulescu, J., Wilkinson, D. J. C., & Earp, B. D. (2025) · AI & Society · doi:10.1007/s00146-025-02644-9 · Cited by 5
Giguere, A. M. C., Auclair-Rochon, D., Robin, M., Augustine, L., Ayre, J., & McCaffery, K. J. (2025) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2025-113675 · Cited by 2
When GenAI writes public foresight reports: Effects on convincing citizens
Zumbrunn, L., & Guenduez, A. A. (2025) · Public Policy and Administration · doi:10.1177/09520767251403049 · Cited by 4
An umbrella review encompassing 42 systematic reviews on medical applications of ChatGPT
Ramadan, S., Calvieri, C., Gracia-Ramos, A. E., FERRARI, G. R., Pepe, M., & BIONDI-ZOCCAI, G. (2026) · Minerva Medica · doi:10.23736/s0026-4806.25.09664-8 · Cited by 2
Tang, G., & Wu, A. (2026) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3772363.3798576 · Cited by 2
Zhang, T., Qiu, J., & Xu, Z. (2026) · Acta Psychologica · doi:10.1016/j.actpsy.2026.106907 · Cited by 3
Tran, H. H.-V., Thu, A., Twayana, A. R., Fuertes, A., Gonzalez, M., Basta, M., James, M., Frishman, W. H., & Aronow, W. S. (2025) · Cardiology in Review · doi:10.1097/crd.0000000000001042 · Cited by 5
The Tightrope Between Human and AI-Generated Innovation: A Turing TestPreprint
Stock‐Homburg, R. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4610978 · Cited by 2
Dale, R., Cheng, M., Pines, K. C., & Currie, M. E. (2025) · medRxiv · doi:10.1101/2025.05.20.25328009 · Cited by 2
Issues and Perspectives on Integrating a Healthcare Monitoring Tool with an LLM Module
Pilato, G., Persia, F., & D’Auria, D. (2025) · IEEE International Conference on Semantic Computing (ICSC) · doi:10.1109/icsc64641.2025.00048 · Cited by 1
Stock‐Homburg, R. (2025) · Creativity and Innovation Management · doi:10.1111/caim.70000 · Cited by 1
Nguyen, O. T., Ahmad, A., & Wiegmann, D. A. (2025) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/10711813251357910 · Cited by 1
Peck, S., O'Brien, C., Bourret, J. C., & Agostinelli, D. (2025) · Journal of Applied Behavior Analysis · doi:10.1002/jaba.70029 · Cited by 2
People Evaluate Agents Based on the Algorithms That Drive Their Behavior
Bigelow, E., & Ullman, T. D. (2025) · Open Mind · doi:10.1162/opmi.a.26 · Cited by 4
Minian, N., Mehra, K., Rose, J., Veldhuizen, S., Zawertailo, L. A., Ratto, M., Ting‐A‐Kee, R. A., Melamed, O. C., Tang, V. M., & Selby, P. L. (2025) · Digital Health · doi:10.1177/20552076251380324 · Cited by 1
Nonlinear transformation of probabilities by large language models
Hintze, A., Bisht, C., Schossau, J., & Hertwig, R. (2025) · Computers in Human Behavior: Artificial Humans · doi:10.1016/j.chbah.2025.100227 · Cited by 1
From Bytes to Bedside: Exploring the Impact of AI on Medicine and Education
Winkel, A. F., Myrick, O., Smith, M., & Triola, M. M. (2025) · Clinical Obstetrics & Gynecology · doi:10.1097/grf.0000000000000982 · Cited by 1
Yin, C., Sun, X., Dai, A., Ye, X., Lu, Y., Wang, W., Chen, Y., Jiang, H., Yu, J., Chong, S., et al. (2026) · APL Bioengineering · doi:10.1063/5.0299327 · Cited by 2
DALKILIÇ, S. (2026) · Acibadem Universitesi Saglik Bilimleri Dergisi · doi:10.31067/acusaglik.1884686 · Cited by 1
Mukhtar, A., Arzu, G. E., Toor, W. T., & Ali, U. (2026) · Parkinsonism & Related Disorders · doi:10.1016/j.parkreldis.2026.108292 · Cited by 4
A Comparative Evaluation of Large Language Models on Pediatric Board-Style Examinations
Schönberg, N., Deschler, D. J. P., Hauer, J., & Zeumer, M. (2026) · Hospital Pediatrics · doi:10.1542/hpeds.2025-009153 · Cited by 1
Ethical issues of large language models: a multi-level thematic synthesis of the academic literature
Pervez, H., Minkkinen, M., Jylhä, H., & Mäntymäki, M. (2026) · AI and Ethics · doi:10.1007/s43681-026-01173-5 · Cited by 5
Çelik, G., Hekim, H. H., Filiz, M. B., Toraman, N. F., & Yapar, D. (2026) · BMC Pediatrics · doi:10.1186/s12887-026-07126-5 · Cited by 1
Privacy-preserving Virtual Contrast-enhanced MRI for Nasopharyngeal Carcinoma: A Multicenter Study
Li, W., Li, Z., Shi, Y., Lam, S., Xiao, L., Cheung, A. H.-Y., Liu, C., Liu, S., Yang, J., Zeng, G., et al. (2026) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/j.ijrobp.2026.06.3057 · Cited by 1
Wang, Y., Romy, R. W., Deng, Y., & Chen, X. (2026) · Frontiers in Public Health · doi:10.3389/fpubh.2026.1916780 · Cited by 1
On the question of the specifics of the formulation and use of the Turing test for the ChatGPT
Osipov, M. Y. (2023) · Программные системы и вычислительные методы · doi:10.7256/2454-0714.2023.4.68680 · Cited by 1
Enhancing Medical Education with CHATGPT: A Promising Tool for the Future
Sani, I. (2024) · Canadian Journal of Medicine · doi:10.33844/cjm.2024.6032 · Cited by 1
Beyond Text: The Impact of Clinical Context on GPT-4’s 12-lead ECG Interpretation AccuracyPreprint
Lisičić, A., Jordán, A., Šerman, A., Jurin, I., Novák, A., Pavlović, N., Manola, Š., & Zeljković, I. (2024) · Research Square · doi:10.21203/rs.3.rs-4047752/v1 · Cited by 1
21. Yüzyıl’da Sağlık Bilimleri: Yöntem, Kuram ve Vaka
Yıldız, E. K., & Tur, K. (2023) · Özgür Yayınları eBooks · doi:10.58830/ozgur.pub282
Research Note the Tightrope between Human and Ai-Generated Innovation: A Turing TestPreprint
Stock‐Homburg, R. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4613427 · Cited by 1
Das Aderhautmelanom im Zeitalter der generativen künstlichen Intelligenz – im Gespräch mit ChatGPT
Martynov, A., Bechrakis, N. E., & Lever, M. J. (2024) · Klinische Monatsblätter für Augenheilkunde · doi:10.1055/a-2318-9946
Wang, L., Li, J., Zhuang, B., Huang, S., Wang, C., Li, W., Fang, M., & Gong, S. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4888108
Yan, S., Luo, Z., Luo, S., & Qiu, Y. (2024) · Lecture notes in computer science · doi:10.1007/978-981-97-9431-7_23
Detecting Large Language Models in Exam Essays
de Giorgio, A., Matrone, G., & Maffei, A. (2025) · IEEE World Engineering Education Conference (EDUNINE) · doi:10.1109/edunine62377.2025.10981412 · Cited by 1
Ardabili, A. K., Sadr, A. V., Abedi, V., & Bonavia, A. S. (2025) · medRxiv · doi:10.1101/2025.05.14.25327650
AppHerb: Language Model for Recommending Traditional Thai Medicine
Piyasawetkul, T., Tiyaworanant, S., & Srisongkram, T. (2025) · AI · doi:10.3390/ai6080170 · Cited by 2
AI in psychiatry: Perspectives of patients from Southeast Europe on ChatGPT
Arbanas, G., Sušac, J., Periša, A., Badurina, M., Biliškov, I., & Arbanas, D. (2025) · Primenjena psihologija · doi:10.19090/pp.v18i3.2572
Artificial research participants in behavioral science
Medina, V. A., & Mohan, M. (2025) · Journal of Ethics in Entrepreneurship and Technology · doi:10.1108/jeet-03-2025-0014
ChatGPT in Political Education: A Comparative Study of Student and Faculty Perspectives
Song, H. (2025) · Education as Change · doi:10.25159/1947-9417/19336 · Cited by 1
The Impact of Appearance and Task Outcome on User Psychology in Interactions with LLM-Based Agents
Yoshiwara, K., Mino, A., & Kobayashi, K. (2025) · doi:10.1109/icitee66631.2025.11338514
Zhang, Y., & Xu, P. (2026) · E3S Web of Conferences · doi:10.1051/e3sconf/202668908004 · Cited by 2
Selinger, E. M., & Cahn, A. F. (2026) · Cambridge University Press eBooks · doi:10.1017/9781009466592.012
Asl, M. M. B., & Spiotta, A. M. (2026) · The Joint Commission Journal on Quality and Patient Safety · doi:10.1016/j.jcjq.2026.03.011
Fede, G. D., Alrabie, L., & Andolina, S. (2026) · Springer eBooks · doi:10.1007/978-981-95-3658-0_49 · Cited by 1
Guo, Y., Hu, D., Zhou, Y., Lyu, T., Yang, Z., Reynolds, T. L., & Zheng, K. (2026) · npj Health Systems · doi:10.1038/s44401-026-00091-2 · Cited by 2
Generative AI and responsible innovation: impact of ChatGPT
Bhardwaj, S., & Choudhary, P. (2026) · Cogent Education · doi:10.1080/2331186x.2026.2687177 · Cited by 1
Alencar, V. B., Teles, M. M., da Cunha, D. F., Piropo, P. H. N., Robazzi, P. S. M., & Faleiro, T. B. (2026) · Revista Brasileira de Ortopedia · doi:10.1055/s-0046-1820461
Alencar, V. B., Teles, M. M., da Cunha, D. F., Piropo, P. H. N., Robazzi, P. S. M., & Faleiro, T. B. (2026) · Revista Brasileira de Ortopedia · doi:10.1055/s-0046-1820460
Samal, J. (2025) · International Journal of Health & Allied Sciences · doi:10.4103/ijhas.ijhas_64_25
MARCHI, G., Gambini, G., Guglielmi, G., Pistelli, F., & Carrozzi, L. (2026) · Minerva Respiratory Medicine · doi:10.23736/s2784-8477.26.02245-x
Pop, M. A., Moca, A. E., Porumb, M., & Porumb, A. (2026) · Dentistry Journal · doi:10.3390/dj14070424
Ni, J., Yang, F. Y., Xuan, W., Wu, Z. B., & Jiang, L. (2026) · Medicine · doi:10.1097/md.0000000000049785
Denecke, K., & Gabarrón, E. (2026) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2026.1785085
Hao, Z., Wang, L., Wu, Y., Zhao, M., & Li, H. (2026) · Frontiers in Public Health · doi:10.3389/fpubh.2026.1915867
Leite, M. V., Abe, J. M., dos Santos, J. G. B., Thomas, L. C. D. S., & Souza, M. L. H. (2026) · Advances in sustainability science and technology · doi:10.1007/978-3-032-25267-8_12
Healthcare Chatbots: From Rule-Based Systems to LLMs based
Reddy, P. U. K., Pandey, M. K., & Goel, P. (2026) · International Conference on NextGen Data Science and Analytics (ICNDSA) · doi:10.1109/icndsa68777.2026.11652327
Zuo, X., Zuo, H., Zhang, M., & Zheng, W. (2026) · Frontiers in Public Health · doi:10.3389/fpubh.2026.1926980
Yang, S., Han, H., & Lee, H. S. (2026) · Ophthalmology Science · doi:10.1016/j.xops.2026.101398
Caimi, E., Vaccari, S., Lupacchini, A. M., Cavallero, M. F., Furlan, S., Giuli, R. D., Bandi, V., Catania, B., Veronesi, A., Klinger, M. E. A., et al. (2026) · Aesthetic Plastic Surgery · doi:10.1007/s00266-026-06283-3
Mao, T., Bian, F., Liu, W., Zhou, X., & Zhang, G. (2026) · Frontiers in Musculoskeletal Disorders · doi:10.3389/fmscd.2026.1935149
Tritya, D., Fadhilah, S. N., Tarigan, A. K., Adhikara, R., Andriani, I., Park, J., Kim, E. S., & Oh, H. (2026) · doi:10.2196/preprints.115073
Metadata
- Authors
- Nov, O., Singh, N., & Mann, D.
- Affiliations
- New York University (US)
- NYU Langone Health (US)
- Corresponding author
- Nov, Oded
- Venue
- JMIR Medical Education
- Publisher
- JMIR Publications Inc.
- Published
- 2023-07-10
- Volume
- 9
- Pages
- e46939
- ISSN
- 2369-3762 (ISSN-L)
- PMC
- PMC10366957
- OpenAlex
- W4380575774
- Cited by
- 198
- References
- 28
- Citations by year
- 2026: 35 · 2025: 67 · 2024: 68 · 2023: 28
- FWCI
- 7.91
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Medical Education (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Science Foundation (1928614, 2129076)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
- Keywords
- ChatGPT, large language models, chatbots, patient-provider communication, source identification, trust in chatbots, patient questions, health information seeking, artificial intelligence in healthcare, Turing test, health literacy, task complexity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.