ChatGPT Influence on Medical Decision-Making, Bias, and Equity: A Randomized Study of Clinicians Evaluating Clinical Vignettes
Open accessThe DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
In a randomized, pre-post intervention study, we evaluated the influence of a large language model (LLM) generative AI system on accuracy of physician decision-making and bias in healthcare. 50 US-licensed physicians reviewed a video clinical vignette, featuring actors representing different demographics (a White male or a Black female) with chest pain. Participants were asked to answer clinical questions around triage, risk, and treatment based on these vignettes, then asked to reconsider after receiving advice generated by ChatGPT+ (GPT4). The primary outcome was the accuracy of clinical decisions based on pre-established evidence-based guidelines. Results showed that physicians are willing to change their initial clinical impressions given AI assistance, and that this led to a significant improvement in clinical decision-making accuracy in a chest pain evaluation scenario without introducing or exacerbating existing race or gender biases. A survey of physician participants indicates that the majority expect LLM tools to play a significant role in clinical decision making.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures

Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Basics of Qualitative Research (3rd ed.): Techniques and Procedures for Developing Grounded Theory
Corbin, J., & Strauss, A. (2008) · SAGE · doi:10.4135/9781452230153 · Cited by 12,136
Dissecting racial bias in an algorithm used to manage the health of populations
Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019) · Science · doi:10.1126/science.aax2342 · Cited by 7,137
The potential for artificial intelligence in healthcare
Davenport, T., & Kalakota, R. (2019) · Future Healthcare Journal · doi:10.7861/futurehosp.6-2-94 · Cited by 3,800
Large language models propagate race-based medicine
Omiye, J. A., Lester, J. C., Spichak, S., Rotemberg, V., & Daneshjou, R. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00939-z · Cited by 417 · cited 1×
“…case prompts (including with vs. without demographic information) to confirm that the produced LLM outputs remained similar in meaning (and not showing different suggestions depending on the patient’s stated race or gender that has been observed under other specific adversarial scenarios) 10 .”
BackgroundHealth equity among black women in the United States
Chinn, J. J., Martin, I. K., & Redmond, N. (2021) · Journal of Women's Health · doi:10.1089/jwh.2020.8868 · Cited by 320
Chatbot vs medical student performance on free-response clinical reasoning examinations.
Strong, E., DiGiammarino, A., Weng, Y., Kumar, A., Hosamani, P., Hom, J., & Chen, J. H. (2023) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2023.2909 · Cited by 169
Self-citationThe Hawthorne effect in direct observation research with physicians and patients
Goodwin, M. A., Stange, K. C., Zyzanski, S. J., Crabtree, B. F., Borawski, E. A., & Flocke, S. A. (2017) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.12781 · Cited by 142
“Who goes first? Influences of human-AI workflow on decision making in clinical imaging,”
Fogliato, R., Chappidi, S., Lungren, M., Fisher, P., Wilson, D., Fitzke, M., Parkinson, M., Horvitz, E., Inkpen, K., & Nushi, B. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533193 · Cited by 103
Ito, N., Kadomatsu, S., Fujisawa, M., Fukaguchi, K., Ishizawa, R., Kanda, N., Kasugai, D., Nakajima, M., Goto, T., & Tsugawa, Y. (2023) · JMIR Medical Education · doi:10.2196/47532 · Cited by 63
Assessing Biases in Medical Decisions via Clinician and AI Chatbot Responses to Patient Vignettes
Kim, J., Cai, Z. R., Chen, M. L., Simard, J. F., & Linos, E. (2023) · JAMA Network Open · doi:10.1001/jamanetworkopen.2023.38050 · Cited by 59
Research works printed but not linked: 1
- Marshall C , Rossman GB . Designing Qualitative Research. 5th ed. Thousand Oaks, CA: SAGE Publications; 2010.
Cited by
Large Language Model Influence on Diagnostic Reasoning: A Randomized Clinical Trial
Goh, E., Gallo, R., Hom, J., Strong, E., Weng, Y., Kerman, H., Cool, J. A., Kanjee, Z., Parsons, A. S., Ahuja, N., et al. (2024) · JAMA Network Open · doi:10.1001/jamanetworkopen.2024.40969 · Cited by 724
Self-citationFine-Tuning Large Language Models for Specialized Use Cases
Anisuzzaman, D., Malins, J. G., Friedman, P. A., & Attia, Z. I. (2024) · Mayo Clinic Proceedings Digital Health · doi:10.1016/j.mcpdig.2024.11.005 · Cited by 266
Addressing 6 challenges in generative AI for digital health: A scoping review
Templin, T., Perez, M. W., Sylvia, S., Leek, J. T., & Sinnott-Armstrong, N. (2024) · PLOS Digital Health · doi:10.1371/journal.pdig.0000503 · Cited by 139
ChatGPT: Transforming Healthcare with AI
Neha, F., Bhati, D., Shukla, D. K., & Amiruzzaman, M. (2024) · AI · doi:10.3390/ai5040126 · Cited by 59
Cognitive Biases and Artificial Intelligence
Wang, J., & Redelmeier, D. A. (2024) · NEJM AI · doi:10.1056/aics2400639 · Cited by 56
Metadata
- Authors
- Goh, E., Bunning, B., Khoong, E., Gallo, R., Milstein, A., Centola, D., & Chen, J. H.
- Affiliations
- Stanford University (US)
- San Francisco General Hospital (US)
- VA Palo Alto Health Care System (US)
- University of Pennsylvania (US)
- Stanford Medicine (US)
- Corresponding author
- Goh, Ethan
- ORCID
- Venue
- medRxiv
- Publisher
- openRxiv
- Published
- 2023-11-27
- PMC
- PMC10705632
- OpenAlex
- W4389041771
- Cited by
- 37
- References
- 12
- Citations by year
- 2026: 6 · 2025: 16 · 2024: 14 · 2023: 1
- Type
- posted content
- Language
- en
- Open access
- green
- doi.org
- Licence
- cc-by
- Locations
- medRxiv (acceptedVersion, cc-by)
- PubMed (publishedVersion)
- PubMed Central (submittedVersion, cc-by)
- Funders
- U.S. Department of Veterans Affairs
- Intermountain Healthcare
- Peterson Center on Healthcare
- National Institutes of Health
- National Heart, Lung, and Blood Institute (K23HL157750)
- National Institute on Drug Abuse (UG1DA015815)
- U.S. National Library of Medicine (T15LM007033)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Keywords
- ChatGPT, large language models, generative AI, clinical decision-making, physician bias, racial bias, gender bias, health care equity, chest pain evaluation, clinical vignettes, AI-assisted clinical decision support, physician attitudes toward AI
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: ChatGPT Influence on Medical Decision-Making, Bias, and Equity: A Randomized Study of Clinicians Evaluating Clinical Vignettes. https://app.cochat.ai/papers/10.1101/2023.11.24.23298844
- The paper
- Goh, E., Bunning, B., Khoong, E., Gallo, R., Milstein, A., Centola, D., & Chen, J. H. (2023). ChatGPT Influence on Medical Decision-Making, Bias, and Equity: A Randomized Study of Clinicians Evaluating Clinical Vignettes. medRxiv. https://doi.org/10.1101/2023.11.24.23298844
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.