CoChat

Putting ChatGPT’s Medical Advice to the (Turing) Test

Open access
Nov, Oded, Singh, Nina, Mann, Devin M. · 2023 · medRxiv
PreprintCited by 39

The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.

Abstract

Importance: Chatbots could play a role in answering patient questions, but patients’ ability to distinguish between provider and chatbot responses, and patients’ trust in chatbots’ functions are not well established. Objective: To assess the feasibility of using ChatGPT or a similar AI-based chatbot for patient-provider communication. Design: Survey in January 2023 Setting: Survey Participants: A US representative sample of 430 study participants aged 18 and above was recruited on Prolific, a crowdsourcing platform for academic studies. 426 participants filled out the full survey. After removing participants who spent less than 3 minutes on the survey, 392 respondents remained. 53.2% of respondents analyzed were women; their average age was 47.1. Exposure(s): Ten representative non-administrative patient-provider interactions were extracted from the EHR. Patients’ questions were placed in ChatGPT with a request for the chatbot to respond using approximately the same word count as the human provider’s response. In the survey, each patient’s question was followed by a provider- or ChatGPT-generated response. Participants were informed that five responses were provider-generated and five were chatbot-generated. Participants were asked, and incentivized financially, to correctly identify the response source. Participants were also asked about their trust in chatbots’ functions in patient-provider communication, using a Likert scale of 1-5. Main Outcome(s) and Measure(s): Main outcome: Proportion of responses correctly classified as provider- vs chatbot-generated. Secondary outcomes: Average and standard deviation of responses to trust questions. Results: The correct classification of responses ranged between 49.0% to 85.7% for different questions. On average, chatbot responses were correctly identified 65.5% of the time, and provider responses were correctly distinguished 65.1% of the time. On average, responses toward patients’ trust in chatbots’ functions were weakly positive (mean Likert score: 3.4), with lower trust as the health-related complexity of the task in questions increased. Conclusions and Relevance: ChatGPT responses to patient questions were weakly distinguishable from provider responses. Laypeople appear to trust the use of chatbots to answer lower risk health questions. It is important to continue studying patient-chatbot interaction as chatbots move from administrative to more clinical roles in healthcare. Conclusions and Relevance: AI in Medicine; ChatGPT; Generative AI; Healthcare AI; Turing Test;

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1101/2023.01.23.23284735

Cites

4 of 4 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 4 references

Research works printed but not linked: 8

  1. 10.1093/jamia/ocab268 · DOI · Paper page
  2. 10.1055/s-0037-1620263 · DOI
  3. 2022, Why would you use medical chatbots? interview and survey, International Journal of Medical Informatics, 165, 104827, 10.1016/j.ijmedinf.2022.104827 · DOI
  4. 2023, Stakeholder Perspectives of Clinical Artificial Intelligence Implementation: Systematic Review of Qualitative Evidence, Journal of Medical Internet Research, 25, e39742
  5. 10.1038/s41591-022-02053-1 · DOI · Paper page
  6. 2019, Association of use of online symptom checkers with patients’ plans for seeking care, JAMA network open, 2, e1918561, 10.1001/jamanetworkopen.2019.18561 · DOI
  7. Mann DM , Lawrence K. Reimagining Connected Care in the Era of Digital Medicine. JMIR mHealth and uHealth 2022. p. e34483–e34483. · DOI
  8. Singhal K , Azizi S , Tu T , et al. Large Language Models Encode Clinical Knowledge. arXiv preprint arXiv:221213138. 2022;

Cited by

See all 39

Metadata

Authors
Nov, O., Singh, N., & Mann, D. M.
Venue
medRxiv
Publisher
openRxiv
Published
2023-01-24
OpenAlex
W4317840265
Cited by
39
References
4
Type
posted content
Language
en
Open access
green

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Putting ChatGPT’s Medical Advice to the (Turing) Test. https://app.cochat.ai/papers/10.1101/2023.01.23.23284735
The paper
Nov, O., Singh, N., & Mann, D. M. (2023). Putting ChatGPT’s Medical Advice to the (Turing) Test. medRxiv. https://doi.org/10.1101/2023.01.23.23284735

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.