An exploratory survey about using ChatGPT in education, healthcare, and research
Open accessAbstract
Objective ChatGPT is the first large language model (LLM) to reach a large, mainstream audience. Its rapid adoption and exploration by the population at large has sparked a wide range of discussions regarding its acceptable and optimal integration in different areas. In a hybrid (virtual and in-person) panel discussion event, we examined various perspectives regarding the use of ChatGPT in education, research, and healthcare. Materials and Methods We surveyed in-person and online attendees using an audience interaction platform (Slido). We quantitatively analyzed received responses on questions about the use of ChatGPT in various contexts. We compared pairwise categorical groups with Fisher's Exact. Furthermore, we used qualitative methods to analyze and code discussions. Results We received 420 responses from an estimated 844 participants (response rate 49.7%). Only 40% of the audience had tried ChatGPT. More trainees had tried ChatGPT compared with faculty. Those who had used ChatGPT were more interested in using it in a wider range of contexts going forwards. Of the three discussed contexts, the greatest uncertainty was shown about using ChatGPT in education. Pros and cons were raised during discussion for the use of this technology in education, research, and healthcare. Discussion There was a range of perspectives around the uses of ChatGPT in education, research, and healthcare, with still much uncertainty around its acceptability and optimal uses. There were different perspectives from respondents of different roles (trainee vs faculty vs staff). More discussion is needed to explore perceptions around the use of LLMs such as ChatGPT in vital sectors such as education, healthcare and research. Given involved risks and unforeseen challenges, taking a thoughtful and measured approach in adoption would reduce the likelihood of harm.
AI snapshot
Written from the paper’s full text.
TL;DR
In a hybrid event survey, 420 respondents (estimated response rate 49.7%) reported limited experience with ChatGPT, with only 40% having tried it and trainees more likely than faculty to have used it. Prior users were more interested in and accepting of ChatGPT across contexts, while uncertainty was greatest for education.
Key findings
- Only 40% of the audience had tried ChatGPT. Medical trainees were more likely to have tried it (64.2%) than clinical faculty (31.1%), p=0.03; graduate students/postdocs (56.6%) versus research faculty (49.2%) was not significant, p=0.46.
- Those who had used ChatGPT had higher interest in using it going forward: 39.9% were interested “to a great extent” versus 15.9% of non-users, p<0.001.
- Prior users were more likely to deem ChatGPT acceptable for research (89.3% vs 75%, p<0.001), healthcare (62.5% vs 48.8%, p=0.008), and education (63.9% vs 30.2%, p<0.001).
- Uncertainty about use was greater for education and healthcare than research: “I don’t know, it is too early to make a statement” was selected by 226 (53.8%) for education, 177 (42.2%) for healthcare, and 75 (17.9%) for research (p<0.001 for both comparisons with research). For healthcare, 42% approved of administrative uses and 12.2% thought it could be used for any purpose.
Methods
- Hybrid (virtual and in-person) panel event survey using Slido; 420 responses were collected, with a conservative estimated response rate of 49.7%. The Northwestern IRB granted exemption, and data were anonymized.
- Quantitative analysis was performed in Python v3.8 with scipy, matplotlib, seaborn, tableone, and plot_likert. Responses were binarized as “yes” versus “No + unsure,” and pairwise categorical groups were compared with Fisher’s Exact tests. For 18 respondents with multiple roles, the most senior and most clinical role was used.
- Qualitative analysis transcribed the session and inductively coded transcripts using three topic areas (education, healthcare, research), then three subcodes per area (possible positive impacts, possible negative impacts, remaining questions), for nine codes total; panel feedback was sought on the draft report.
Limitations
- Stated in the paper: the large “Other” respondent category could not be broken down further; respondents were likely interested in ChatGPT because they registered for and attended the event, so results may not represent the academic community; medical trainees were the smallest group (3.3% of respondents), and their positive views may reflect role-related interest.
- Evident from the text: this was a single-event, self-selected convenience sample, limiting generalizability; the cross-sectional survey and discussion cannot establish causal relationships or track changes over time.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
0 of 10 cited sources checked · 0 supported · 0 flagged
- Findingown data
There was greater uncertainty about using ChatGPT in Education and Healthcare compared to Research.
“In response to questions about whether ChatGPT can be used, there was greater uncertainty around its use in Healthcare and Education, compared to using it in Research.”
Quote in the paperNot a substantial claim - Findingown data
Those with prior experience thought ChatGPT was acceptable to use in healthcare (62.5% vs 48.8%, 13.7% higher, p=0.008).
“Similarly, those with prior experience thought it was acceptable to use in healthcare 62.5% vs 48.8%, 13.7% higher, p=0.008.”
Quote in the paperNot a substantial claim - Findingown data
Those who had already used ChatGPT were more likely to deem it acceptable for research purposes (89.3% vs 75%, 14.3% higher, p<0.001).
“Those who had already used ChatGPT were more likely to deem it acceptable for research purposes (89.3% 'yes') versus those who had not used it before (75% ‘yes’), 14.3% higher, p<0.001 (Figure 6).”
Quote in the paperNot a substantial claim - Findingown data
Research trainees (graduate students and postdoctoral researchers) had a similar rate of having tried ChatGPT compared with research faculty (56.6% vs 49.2%, p=0.46).
“A more similar number of graduate students and postdoctoral researchers had tried ChatGPT (56.6%) compared with research faculty (49.2%), p=0.46.”
Quote in the paperNot a substantial claim - Findingown data
Across all roles except medical trainees, the most common response regarding interest in using ChatGPT going forwards was 'Somewhat'.
“Across all roles except medical trainees, the most common response regarding interest in using ChatGPT going forwards was ‘Somewhat’ (Figure 3).”
Quote in the paperNot a substantial claim
- Findingown data
Those with prior experience thought ChatGPT was more acceptable to use in education (63.9% vs 30.2%, 33.7% higher, p<0.001).
“They also thought it was more acceptable to use in education, 63.9% vs 30.2%, 33.7% higher, p<0.001.”
Quote in the paperNot a substantial claim - Findingown data
Only 40% of the audience had tried ChatGPT.
“Only 40% of the audience had tried ChatGPT.”
- Also stated in: § Survey results · plain
“Overall, only 40% of the audience has tried ChatGPT.”
- Also stated in: § Discussion · plain
“Only 40% of our respondents had already tried ChatGPT.”
Quote in the paperSubstantial claim - Also stated in: § Survey results · plain
- Findingown data
Medical trainees felt it was more acceptable to use ChatGPT for healthcare purposes (including administrative purposes) compared with clinical faculty (92.9% vs 48.9%, p=0.004).
“Medical trainees felt it was more acceptable to use this technology for healthcare purposes (including administrative purposes), compared with clinical faculty 92.9% ‘yes’ vs 48.9% ‘yes’, p=0.004 (Figure 5).”
Quote in the paperNot a substantial claim - Findingown data
Medical trainees were more likely to have tried ChatGPT than clinical faculty (64.2% vs 31.1%, p=0.03).
“Significantly more medical trainees (medical student, residents, fellows) had tried ChatGPT (64.2%) compared with clinical faculty (31.1%), p=0.03.”
Quote in the paperNot a substantial claim - Interpretationown data
More trainees than faculty had already tried ChatGPT.
“More trainees than faculty had already tried ChatGPT.”
Quote in the paperSubstantial claim - Interpretationown data
There were different perspectives from respondents of different roles (trainee vs faculty vs staff).
“There were different perspectives from respondents of different roles (trainee vs faculty vs staff).”
Quote in the paperNot a substantial claim - Study design and conductreasoning
Because respondents were likely interested in ChatGPT to register for and attend the event and complete the survey, the results might not be representative of the various cohorts within the academic community.
“Since respondents were likely interested in ChatGPT to register for and attend the event, and also complete the survey, our results might not be representative of the various cohorts within the academic community.”
Quote in the paperNot a substantial claim - Interpretationown data
There was greater consensus that it was acceptable to use ChatGPT for research and healthcare (including for administrative tasks) than there was for education purposes.
“There was greater consensus that it was acceptable to use for research and healthcare (including for administrative tasks) than there was for education purposes.”
Quote in the paperSubstantial claim - Premisecitation
ChatGPT generates fluent and convincing abstracts that are difficult for human reviewers or traditional plagiarism detectors to identify.
“ChatGPT, on the other hand, generates fluent and convincing abstracts that are difficult for human reviewers or traditional plagiarism detectors to identify[12].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [12] Gao CA, Howard FM, Markov NS, Comparing scientific abstracts generated by ChatGPT to original abstracts using an artificial intelligence output detector, plagiarism detector, and blinded human reviewers. 2022;:2022.12.23.521610. doi: 10.1101/2022.12.23.521610
Not checked in the free run.
- May combine two claims. 17
- Classified as probably not a substantial claim. 19
May combine two claims.
Findingown dataFor Research, 17.9% (75) selected 'I don't know, it is too early to make a statement', compared with 53.8% (226) for Education (p<0.001) and 42.2% (177) for Healthcare (p<0.001).
“For Research, only 75 (17.9%) of respondents selected ‘I don’t know, it is too early to make a statement’, compared with 226 (53.8%) when asked about using it in Education (p<0.001), and 177 (42.2%), when asked about using it in Healthcare (p<0.001), (Table 1, Supplemental Document).”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThose who had used ChatGPT had higher interest in using it going forwards compared with those who had not; 39.9% had interest 'to a great extent' vs 15.9%, p<0.001.
“Those who had used ChatGPT already had higher interest in using it compared with those who did not; 39.9% had interest in using it ‘to a great extent’ compared with 15.9%, p<0.001) (Figure 4).”
- Also stated in: § Results · plain
“Those who had used ChatGPT were more interested in using it in a wider range of contexts going forwards.”
Quote in the paperNot a substantial claim- Also stated in: § Results · plain
May combine two claims.
Findingown dataMedical and research trainees were more interested in using ChatGPT for education purposes compared with clinical and research faculty, though this was not statistically significant.
“Medical and research trainees were more interested in using it for education purposes compared with clinical and research faculty, though this was not statistically significant.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataThe largest group of respondents identified as 'Other' (173, 41.2%).
“The largest group of respondents identified as ‘Other’, with 173 respondents (41.2% of all respondents).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataPros and cons were raised during discussion for the use of ChatGPT in education, research, and healthcare.
“Pros and cons were raised during discussion for the use of this technology in education, research, and healthcare.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataWhen responding about using ChatGPT in Healthcare, 42% of respondents approved of using it for administrative purposes, and 12.2% thought it could be used for any purpose.
“Of note, when responding to the question about using ChatGPT in Healthcare, a significant portion (42% of respondents) of respondents approved of using it for administrative purposes (for example, writing letters to insurance companies) and there was a smaller population of respondents who thought it could be used for any purpose (12.2%) (Table 1, Supplemental Document).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataMedical trainees were the smallest group of respondents (14, 3.3%).
“The smallest group were medical trainees (medical students, residents, and fellows) at 14 respondents (3.3% of all respondents)”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
InterpretationreasoningThe broad interest and engagement sparked by ChatGPT strongly suggests that, while a work in progress, LLMs have a significant potential for disruption.
“The broad interest and engagement sparked by ChatGPT strongly suggests that, while a work in progress, LLMs have a significant potential for disruption.”
Quote in the paperNot a substantial claim- Rests on an assumption: ChatGPT is the first large language model to reach a large, mainstream audience.
- Rests on an assumption: ChatGPT's rapid adoption and exploration by the population at large has sparked a wide range of discussions regarding its acceptable and optimal integration in different areas.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenA limitation of the study is the inability to break down and better delineate the large 'Other' category of respondents.
“Some of the limitations include inability to break down and better delineate the large “Other” category of respondents.”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationown dataThere was a range of perspectives around the uses of ChatGPT in education, research, and healthcare, with still much uncertainty around its acceptability and optimal uses.
“There was a range of perspectives around the uses of ChatGPT in education, research, and healthcare, with still much uncertainty around its acceptability and optimal uses.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationown dataTrainees were more interested in using ChatGPT than faculty, having more positive views, interest, and acceptability beliefs in using the technology.
“Trainees were more interested in using ChatGPT than faculty, having more positive views, interest, and acceptability beliefs in using the technology.”
Quote in the paperSubstantial claimMay combine two claims.
Study design and conductown dataAlthough medical trainees had positive views towards ChatGPT and its use, they were the smallest group of respondents (3.3% of the cohort).
“Although medical trainees had positive views towards ChatGPT and its use, they were our smallest group of respondents (3.3% of our cohort).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenThe Northwestern IRB granted exemption (STU00218786).
“The Northwestern IRB granted exemption (STU00218786).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductown dataThe event had 1,174 registrations, a peak of 718 webinar participants, and 126 people indicating they would attend in-person.
“We had 1,174 people register for the event. The peak number of webinar participants during the event was 718, and 126 people indicated they would attend in-person.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenAnonymized data were collected using a paid version of Slido.
“We collected anonymized data using a paid version of Slido (Bratislava, Slovakia; https://www.sli.do/).”
Quote in the paperNot a substantial claimMay combine two claims.
Study design and conductown dataThe survey received 420 responses from an estimated 844 participants, a response rate of 49.7%.
“We received 420 responses from an estimated 844 participants (response rate 49.7%).”
- Also stated in: § Survey results · hedged
“We received survey responses from 420 people; a conservative estimated response rate is 49.7%.”
Quote in the paperNot a substantial claim- Also stated in: § Survey results · hedged
May combine two claims.
Interpretationown dataParticipants who had used the technology before had a tendency to have a more optimistic outlook about LLMs in general, whereas never-users seemed to have more concerns about its widespread adoption.
“Participants that had used the technology before had a tendency to have a more optimistic outlook about LLMs in general whereas never-users seemed to have more concerns about its widespread adoption.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductown dataParticipants were informed about survey details and offered a chance to view the information sheet and consent form before the survey.
“Participants were informed about the survey details, such as anonymized data collection and voluntary participation, and were offered a chance to view the information sheet and consent form before the start of the survey.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningThe findings point to a potential generational divide between early adopters (trainees) and late adopters (faculty), with the latter in positions of power to dictate policy to trainees and the academic community at large.
“This points to a potential generational divide between early adopters (trainees) and late adopters (faculty), with the latter in positions of power to dictate policy to trainees and the academic community at large.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.
InterpretationreasoningDetection applications such as the OpenAI Classifier seem unreliable and for the foreseeable future will likely remain so.
“Detection applications such as the OpenAI Classifier, which uses four (ambiguous) categories to label inputted text (Very unlikely, Unlikely, Unclear if it is/Possibly or Likely AI-generated) seem unreliable and for the foreseeable future will likely remain so.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductown dataThe recruitment material for the event took a neutral tone to the technology, as evidenced by respondents from other roles who had more lukewarm or uncertain feelings towards ChatGPT.
“We took a neutral tone to the technology in our recruitment material for the event, as evidenced by the respondents from other roles who had more lukewarm or uncertain feelings towards ChatGPT.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningThe authors suspect there is high interest from medical trainees inherent to their role.
“Hence, we suspect there is high interest from this group inherent to their role.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationEven before the introduction of OpenAI's ChatGPT, using computer generated text in academic publications had an estimated prevalence of 4.29 papers for every one million papers as per 2021.
“Even before the introduction of OpenAI’s ChatGPT, using computer generated text in academic publications had an estimated prevalence of “4.29 papers for every one million papers” as per 2021[10].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [10] Cabanac G, Labbé C, Magazinov A. Tortured phrases: A dubious writing style emerging in science. Evidence of critical issues affecting established journals. 2021. doi: 10.48550/arXiv.2107.06751
Not checked in the free run.
Probably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningAs ChatGPT and other recently developed applications based on LLMs mainstream the use of AI-generated content, detection will likely become much more difficult.
“As ChatGPT and other recently developed applications based on LLMs mainstream the use of AI-generated content, detection will likely become much more difficult.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThere were concerns about the negative impact of using LLMs on the integrity of academic publications.
“There were concerns about the negative impact of using LLMs on the integrity of academic publications[11].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [11] Cabanac G, Labbé C. Prevalence of nonsensical algorithmically generated papers in the scientific literature. J Assoc Inf Sci Technol 2021; 72: 1461– 76. doi: 10.1002/asi.24495
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationSome New York schools banned students from using ChatGPT, while others adopted policies in their syllabus that encourage students to engage with these models as long as they disclose it.
“For instance, some New York schools banned students from using ChatGPT[1], while others adopted policies in their syllabus that encourage students to engage with these models as long as they disclose it[2].”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites [1] Yang M. New York City schools ban AI chatbot that writes essays and answers prompts. The Guardian. 2023. https://www.theguardian.com/us-news/2023/jan/06/new-york-city-schools-ban-ai-chatbot-chatgpt (accessed 27 Mar 2023).
Not checked in the free run.
- cites [2] Mollick E. All my classes suddenly became AI classes. One Useful Thing Also Some Things. 2023. https://oneusefulthing.substack.com/p/all-my-classes-suddenly-became-ai (accessed 25 Jan 2023).
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationVarious journal editors and professional societies have developed disclosure guidelines, stressing that LLMs cannot be authors, and suggesting that disclosure should happen as part of the methods section, describing who used the system, when, and using which prompts plus adding it among cited references.
“Various journal editors and professional societies have developed disclosure guidelines, stressing that LLMs cannot be authors[13,14], and suggesting that disclosure should happen as part of the methods section, describing who used the system, when, and using which prompts plus adding it among cited references[15].”
Quote in the paperNot a substantial claim0 of 3 sources checked- cites [13] Flanagin A, Bibbins-Domingo K, Berkwits M, Nonhuman “Authors” and Implications for the Integrity of Scientific Publication and Medical Knowledge. JAMA 2023; 329: 637– 9. doi: 10.1001/jama.2023.1344 36719674
Not checked in the free run.
- cites [14] Zielinski C, Winker M, Aggarwal R, Chatbots, ChatGPT, and Scholarly Manuscripts: WAME Recommendations on ChatGPT and Chatbots in Relation to Scholarly Publications. 2023. https://wame.org/page3.php?id=106 37615142
Not checked in the free run.
- cites [15] Hosseini M, Rasmussen LM, Resnik DB. Using AI to write scholarly publications. Account Res 2023; 0: 1– 9. doi: 10.1080/08989621.2023.2168535 PMC10366336 36697395
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationSome educators fed ChatGPT questions from a freely available United States Medical Licensing Examination (USMLE) and reported a near or at passing range performance.
“Some educators fed ChatGPT questions from a freely available United States Medical Licensing Examination (USMLE) and reported a near or at passing range performance[3].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [3] Kung TH, Cheatham M, Medenilla A, Performance of ChatGPT on USMLE: Potential for AI-assisted medical education using large language models. PLOS Digit Health 2023; 2: e0000198. doi: 10.1371/journal.pdig.0000198 36812645 PMC9931230
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationLLMs can be used in scholarly reviews to support editorial practices, but various risks such as inaccuracies and biases require researchers to engage with LLMs cautiously.
“Besides writing scholarly manuscripts, LLMs can also be used in scholarly reviews to support editorial practices,e.g., supporting the search for suitable reviewers, the initial screening of manuscripts, and the write-up of final decision letters from individual review reports, but various risks such as inaccuracies and biases require researchers to engage with LLMs cautiously[16].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [16] Hosseini M, Horbach SPJM. Fighting reviewer fatigue or amplifying bias? Considerations and recommendations for use of ChatGPT and other Large Language Models in scholarly peer review. 2023. doi: 10.21203/rs.3.rs-2587766/v1 PMC10191680 37198671
Not checked in the free run.
The paper relies on this without support.
ChatGPT is the first large language model to reach a large, mainstream audience.
“ChatGPT is the first large language model (LLM) to reach a large, mainstream audience.”
“The introduction of OpenAI's ChatGPT has delivered large language model (LLM) systems to a mainstream audience.”
The paper relies on this without support.
ChatGPT's rapid adoption and exploration by the population at large has sparked a wide range of discussions regarding its acceptable and optimal integration in different areas.
“Its rapid adoption and exploration by the population at large has sparked a wide range of discussions regarding its acceptable and optimal integration in different areas.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Although the number of respondents exceeded the required sample size, the response rate was lower compared with similar studies, which may limit the generalizability of the findings.
“First, although the number of respondents exceeded the required sample size, the response rate was lower compared with similar studies [19, 21, 22, 24, 25, 29, 31, 34, 37, 40, 62], which may limit the generalizability of the findings.”
From Knowledge and use, Perceptions of Benefits and Limitations of Artificial Intelligence Chatbots among Italian Physiotherapy students: a cross-sectional National Study (2025) · cites this paper as [21]
The Survey results section reports a 49.7% response rate, providing a figure the citing authors could use for comparison. The source does not establish that the citing study’s response rate was lower or that its respondent count exceeded a required sample size. Its Limitations section raises a representativeness concern about its own survey, but attributes that concern to likely participant interest in ChatGPT, not to the response rate. (LLM, conf=0.83)
Experimental — accuracy not yet measuredItalian physiotherapy students are still in an exploratory phase with AI Chatbots, showing a prevailing sense of uncertainty and skepticism and having yet to adopt a clear stance on the technology's advantages and disadvantages.
“As reported in the literature [21, 43], these results highlight a prevailing sense of uncertainty and skepticism, suggesting that Italian students are still in an exploratory phase with this emerging technology and have yet to adopt a clear stance on its advantages and disadvantages.”
From Knowledge and use, Perceptions of Benefits and Limitations of Artificial Intelligence Chatbots among Italian Physiotherapy students: a cross-sectional National Study (2025) · cites this paper as [21]
The Discussion reports uncertainty about ChatGPT’s acceptability, and the Results describe respondents who felt it was too early to judge its use in education. These passages support the comparison to uncertainty in the literature, but this survey did not study Italian physiotherapy students; the conclusion about those students comes from the citing authors’ own results. (LLM, conf=0.87)
Experimental — accuracy not yet measuredThere is a notable scarcity of literature that evaluates the proficiency of Google's Bard and ChatGPT specifically in the field of endocrinology, diabetes, and diabetes technology.
“Nevertheless, there is a notable scarcity of literature that evaluates the proficiency of Google's Bard and ChatGPT specifically in the field of endocrinology, diabetes, and diabetes technology.7,8”
From The Scientific Knowledge of Bard and ChatGPT in Endocrinology, Diabetes, and Diabetes Technology: Multiple-Choice Questions Examination-Based Performance (2025) · cites this paper as [8]
The Introduction’s healthcare section discusses general medical uses of ChatGPT, including answering questions and generating clinical vignettes. Our copy does not assess the literature on Bard and ChatGPT proficiency in endocrinology, diabetes, or diabetes technology; searches for those topics found no relevant passage. No page numbers were provided. (LLM, conf=0.76)
Experimental — accuracy not yet measuredLLMs are not able to replicate a process of clinical reasoning in general and fail to comprehend the complexity of the process.
“This is in line with others noting that LLMs are not able to replicate a process of clinical reasoning in general and, hence, fail to comprehend the complexity of the process44,59,75.”
From The ethics of ChatGPT in medicine and healthcare: a systematic review on large language models (LLMs) (2024) · cites this paper as [44]
Power concentration means pricing control lies with LLM companies, with revenues predominantly directed towards them.
“Power concentration also means pricing control lies with LLM companies, with revenues predominantly directed towards them44.”
From The ethics of ChatGPT in medicine and healthcare: a systematic review on large language models (LLMs) (2024) · cites this paper as [44]
Medical education can benefit significantly from AI-driven tools like ChatGPT.
“Medical education can benefit significantly from AI-driven tools like ChatGPT.”
ChatGPT has the ability to analyse and generate descriptions for medical images, which can enhance the workflow of radiologists.
“The potential of ChatGPT lies in its ability to analyse and generate descriptions for medical images, which can enhance the workflow of radiologists.”
ChatGPT's ability to explain intricate medical terminology in a comprehensible manner aids in knowledge acquisition, fostering continuous learning and improving medical literacy.
“Its ability to explain intricate medical terminology in a comprehensible manner aids in knowledge acquisition, fostering continuous learning and improving medical literacy [6,9,13,14,15,16,17,18,19,20,21,22,23].”
ChatGPT can provide initial observations that highlight regions of interest and assist radiologists in their analyses.
“It has the ability to provide initial observations, which can highlight regions of interest and assist radiologists in their analyses [13,25,26,27,28,29,30,31,32,33].”
In a hybrid panel discussion, approximately 40% of participants had utilised ChatGPT, with a higher number of trainees compared to faculty members having experimented with it.
“According to the study, approximately 40% of the participants had utilised ChatGPT, with a higher number of trainees compared to faculty members having experimented with it.”
Cites
A General Inductive Approach for Analyzing Qualitative Evaluation Data
Thomas, D. R. (2006) · American Journal of Evaluation · doi:10.1177/1098214005283748 · Cited by 10,858 · see citing works
Kung, T. H., Cheatham, M., Medenilla, A., Sillos, C., De Leon, L., Elepaño, C., Madriaga, M., Aggabao, R., Diaz-Candido, G., Maningo, J., et al. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000198 · Cited by 4,115 · see citing works
The rise of artificial intelligence in healthcare applications
Bohr, A., & Memarzadeh, K. (2020) · Artificial Intelligence in Healthcare · doi:10.1016/b978-0-12-818438-7.00002-2 · Cited by 1,636 · see citing works
Gao, C. A., Howard, F. M., Markov, N. S., Dyer, E. C., Ramesh, S., Luo, Y., & Pearson, A. T. (2022) · doi:10.1101/2022.12.23.521610 · Cited by 1,099 · see citing works
Self-citationGao, C. A., Howard, F. M., Markov, N. S., Dyer, E. C., Ramesh, S., Luo, Y., & Pearson, A. T. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00819-6 · Cited by 1,099 · see citing works
Self-citationWong, A., Otles, E., Donnelly, J. P., Krumm, A., McCullough, J., DeTroyer-Cooley, O., Pestrue, J., Phillips, M., Konye, J., Penoza, C., et al. (2021) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2021.2626 · Cited by 995 · see citing works
ChatGPT makes medicine easy to swallow: an exploratory case study on simplified radiology reports
Jeblick, K., Schachtner, B., Dexl, J., Mittermeier, A., Stüber, A. T., Topalis, J., Weber, T., Wesp, P., Sabel, B. O., Ricke, J., et al. (2023) · European Radiology · doi:10.1007/s00330-023-10213-1 · Cited by 549 · see citing works
Flanagin, A., Bibbins-Domingo, K., Berkwits, M., & Christiansen, S. L. (2023) · JAMA · doi:10.1001/jama.2023.1344 · Cited by 420 · see citing works
Using AI to write scholarly publications
Hosseini, M., Rasmussen, L. M., & Resnik, D. B. (2024) · Accountability in Research · doi:10.1080/08989621.2023.2168535 · Cited by 286 · see citing works
Self-citationHosseini, M., & Horbach, S. P. J. M. (2023) · Research Integrity and Peer Review · doi:10.1186/s41073-023-00133-5 · Cited by 243 · see citing works
Self-citationCabanac, G., Labbé, C., & Magazinov, A. (2021) · arXiv · doi:10.48550/arxiv.2107.06751 · Cited by 224 · see citing works
Putting ChatGPT’s Medical Advice to the (Turing) Test: Survey Study
Nov, O., Singh, N., & Mann, D. (2023) · JMIR Medical Education · doi:10.2196/46939 · Cited by 198 · see citing works
tableone: An open source Python package for producing summary statistics for research papers
Pollard, T., Johnson, A. E. W., Raffa, J. D., & Mark, R. G. (2018) · JAMIA Open · doi:10.1093/jamiaopen/ooy012 · Cited by 184 · see citing works
ChatGPT Makes Medicine Easy to Swallow: An Exploratory Case Study on Simplified Radiology Reports
Jeblick, K., Schachtner, B., Dexl, J., Mittermeier, A., Stüber, A. T., Topalis, J., Weber, T., Wesp, P., Sabel, B., Ricke, J., et al. (2022) · arXiv · doi:10.48550/arxiv.2212.14882 · Cited by 97 · see citing works
Zielinski, C., Winker, M. A., Aggarwal, R., Ferris, L. E., Heinemann, M., Lapeña, J. F., Pai, S. A., Ing, E., & Citrome, L. (2023) · National Medical Journal of India · doi:10.21608/aeji.2023.282936 · Cited by 97 · see citing works
Prevalence of nonsensical algorithmically generated papers in the scientific literature
Cabanac, G., & Labbé, C. (2021) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.24495 · Cited by 83 · see citing works
ChatGPT for Clinical Vignette Generation, Revision, and Evaluation
Benoit, J. R. A. (2023) · doi:10.1101/2023.02.04.23285478 · Cited by 74 · see citing works
Zielinski, C., Winker, M. A., Aggarwal, R., Ferris, L. E., Heinemann, M., Lapeña, J. F. F., Pai, S. A., Ing, E. B., & Citrome, L. (2023) · The National Medical Journal of India · doi:10.25259/nmji_365_23 · Cited by 70 · see citing works
Putting ChatGPT’s Medical Advice to the (Turing) TestPreprint
Nov, O., Singh, N. P., & Mann, D. M. (2023) · medRxiv · doi:10.1101/2023.01.23.23284735 · Cited by 50 · see citing works
Hosseini, M., & Horbach, S. (2023) · Research Square · doi:10.21203/rs.3.rs-2587766/v1 · Cited by 43 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Haltaufderheide, J., & Ranisch, R. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01157-x · Cited by 396 · see citing works
Younis, H. A., Eisa, T. A. E., Nasser, M., Sahib, T. M., Noor, A. A., Alyasiri, O. M., Salisu, S., Hayder, I. M., & Younis, H. A. (2024) · Diagnostics · doi:10.3390/diagnostics14010109 · Cited by 242 · see citing works
Xu, X., Chen, Y., & Miao, J. (2024) · Journal of Educational Evaluation for Health Professions · doi:10.3352/jeehp.2024.21.6 · Cited by 169 · see citing works
Teaching AI Ethics in Medical Education: A Scoping Review of Current Literature and Practices
Weidener, L., & Fischer, M. (2023) · Perspectives on Medical Education · doi:10.5334/pme.954 · Cited by 133 · see citing works
A scoping review of ChatGPT's role in healthcare education and research
Shorey, S., Mattar, C., Pereira, T. L.-B., & Choolani, M. (2024) · Nurse Education Today · doi:10.1016/j.nedt.2024.106121 · Cited by 96 · see citing works
Meo, S. A., Al-Masri, A. A., Alotaibi, M., Meo, M. Z. S., & Meo, M. O. S. (2023) · Healthcare · doi:10.3390/healthcare11142046 · Cited by 74 · see citing works
Meo, S. A., Al-Khlaiwi, T., AbuKhalaf, A. A., Meo, A. S., & Klonoff, D. C. (2025) · Journal of Diabetes Science and Technology · doi:10.1177/19322968231203987 · Cited by 40 · see citing works
Tortella, F., Palese, A., Turolla, A., Castellini, G., Pillastrini, P., Landuzzi, M. G., Cook, C., Galeoto, G., Giovannico, G., Rodeghiero, L., et al. (2025) · BMC Medical Education · doi:10.1186/s12909-025-07176-w · Cited by 28 · see citing works
Hassoulas, A., Powell, N., Roberts, L., Umla-Runge, K., Gray, L., & Coffey, M. J. (2023) · Journal of Applied Learning and Teaching · doi:10.37074/jalt.2023.6.2.13 · Cited by 28 · see citing works
Luo, Y., Weng, H., Yang, L., Ding, Z., & Wang, Q. (2023) · JMIR Formative Research · doi:10.2196/50413 · Cited by 28 · see citing works
Self-citationSkin and Syntax: Large Language Models in Dermatopathology
Shah, A., Wahood, S., Guermazi, D., Brem, C. E., & Saliba, E. (2024) · Dermatopathology · doi:10.3390/dermatopathology11010009 · Cited by 25 · see citing works
Atcheson, A., Khan, O., Siemann, B., Jain, A., & Karahalios, K. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714121 · Cited by 22 · see citing works
- Authors
- Hosseini, M., Gao, C. A., Liebovitz, D. M., Carvalho, A. M., Ahmad, F. S., Luo, Y., MacDonald, N., Holmes, K. L., & Kho, A.
- Affiliations
- Northwestern University (US)
- Corresponding author
- Hosseini, Mohammad
- ORCID
- Venue
- PLoS ONE
- Publisher
- openRxiv
- Published
- 2023-04-03
- Volume
- 18
- Issue
- 10
- Pages
- e0292216-e0292216
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC10104227
- OpenAlex
- W4387363029
- Cited by
- 238
- References
- 20
- Citations by year
- 2026: 38 · 2025: 76 · 2024: 95 · 2023: 29
- FWCI
- 9.48
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- PLoS ONE (publishedVersion, cc-by)
- medRxiv (acceptedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- PubMed Central (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- American Heart Association (856917, AHA number 856917)
- Northwestern University (UL1 TR001422)
- National Institutes of Health (UL1TR001422)
- National Heart, Lung, and Blood Institute (K23HL155970, 856917, F32HL162377)
- National Institute of Diabetes and Digestive and Kidney Diseases (P30DK092949)
- National Center for Advancing Translational Sciences
- NHLBI Division of Intramural Research (F32HL162377)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Information Systems › Artificial Intelligence in Education
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Keywords
- ChatGPT, large language models, generative AI adoption, artificial intelligence in education, artificial intelligence in healthcare, artificial intelligence in research, user perception, technology acceptance, AI risks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-09.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-09.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review