CoChat

GPT-4 in a Cancer Center — Institute-Wide Deployment Challenges and Lessons Learned

Open access
Umeton, Renato, Kwok, Anne, Maurya, Rahul, Leco, Domenic, Lenane, Naomi, Willcox, Jennifer, Abel, Gregory A., Tolikas, Mary, Johnson, Jason M. · 2024 · NEJM AI
Cited by 36

The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.

Abstract

Generative AI has both significant untapped potential and unique risks for healthcare. Here we report on the implementation challenges, technology solutions, and lessons learned in broad deployment of large language models to the workforce of Dana-Farber Cancer Institute. In order that other organizations might benefit from our experience, we detail the aspects of sponsorship, governance, technical implementation and configurations, program launch, socialization, and ongoing support that went into making generative AI available to our entire workforce in a compliant, auditable, and secure manner. ----- The enormous potential for generative pre-trained transformers and other artificial intelligence large language models to improve healthcare has become increasingly clear since the release of ChatGPT in November 2022. Software tools based on large language models have been shown to perform as well as or better than humans on many healthcare-related tasks, including generation of clinical documentation, extraction of structured data from medical records, performance on a growing number of medical board exams, and writing accurate and empathetic responses to patients’ medical questions. However, healthcare settings pose unique ethical, legal, regulatory, and technical challenges for large-scale deployment and adoption of large language models, including the essentiality of patient data privacy and security, the direct negative consequences of errors and biases, the need for model interpretability and supporting evidence, the need to safeguard intellectual property and proprietary data, and the difficulty of modifying clinical and operational workflows. Because of these risks and challenges, few large language models are in use in hospitals outside of controlled research studies or small pilots, and none to our knowledge are yet broadly deployed in a dedicated cancer center. In this case study, we report on the implementation challenges and lessons learned in the evaluation and deployment of large language models at Dana-Farber Cancer Institute for use by all business areas including research and clinical operations. In early discussions about whether and how to proceed, it became clear that while some inherent risks could be mitigated by clear policy guardrails and a secure technical environment, significant risks would remain, including compliance with rapidly evolving regulations (e.g., for academic use of LLMs). We also recognized the substantial, ongoing work that would be required for appropriate ethical consideration of each use case, and to ensure patient- and human-centric decision-making. After robust discussion over many months, we believed it would be better for our institution to tackle these questions and challenges together as a community, with broad participation and discussion, in an audited, continuous-learning environment, than to prohibit all use of LLMs. Here we detail aspects of sponsorship, governance, technical implementation, program launch, socialization and ongoing support that went into making generative AI broadly available to our 12,500-member workforce in a compliant, auditable, and secure manner. We also share our source code and infrastructure-as-code to benefit others who may follow the same path. We hope other institutions can benefit from our experience as they consider deployment of generative AI that furthers their medical and research missions.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1056/aics2300191

Cites

34 of 34 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 34 references

Cited by

See all 36

Metadata

Authors
Umeton, R., Kwok, A., Maurya, R., Leco, D., Lenane, N., Willcox, J., Abel, G. A., Tolikas, M., & Johnson, J. M.
Venue
NEJM AI
Published
2024-03-28
Volume
1
Issue
4
ISSN
2836-9386 (ISSN-L)
OpenAlex
W4393259351
Cited by
36
References
34
FWCI
2.89
Type
journal article
Language
en
Open access
gold

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: GPT-4 in a Cancer Center — Institute-Wide Deployment Challenges and Lessons Learned. https://app.cochat.ai/papers/10.1056/aics2300191
The paper
Umeton, R., Kwok, A., Maurya, R., Leco, D., Lenane, N., Willcox, J., Abel, G. A., Tolikas, M., & Johnson, J. M. (2024). GPT-4 in a Cancer Center — Institute-Wide Deployment Challenges and Lessons Learned. NEJM AI. https://doi.org/10.1056/aics2300191

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.