Using AI to Empower Collaborative Team Workflows: Two Implementations for Advance Care Planning and Care Escalation
The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
SummaryTo facilitate the development of machine-learning (ML) models in care delivery, which remain poorly understood and executed, Stanford Medicine targeted an effort to address this implementation gap at the health system by addressing three key challenges: developing a framework for designing integration of artificial intelligence (AI) into complex health care work systems; identifying and building the teams of people, technologies, and processes to successfully develop and implement AI-enabled systems; and executing in a manner that is sustainable and scalable for the health care enterprise. In this article, the authors describe two pilots of real-world implementations that integrate AI into care delivery: one to improve advance care planning and the other to decrease unplanned escalations of care. While these two implementations used different ML models for different use cases, they shared a set of principles for integrating AI into care delivery. The authors describe how these shared principles were applied to the health system, the barriers and facilitators encountered, and how these experiences guided processes for collaboratively designing and implementing user-centered AI-enabled solutions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Taylor, M. J., McNicholas, C., Nicolay, C., Darzi, A., Bell, D., & Reed, J. E. (2014) · BMJ Quality & Safety · doi:10.1136/bmjqs-2013-001862 · Cited by 1,871
Work system design for patient safety: the SEIPS model
Carayon, P., Schoofs Hundt, A., Karsh, B.-T., Gurses, A. P., Alvarado, C. J., Smith, M., & Flatley Brennan, P. (2006) · Quality in Health Care · doi:10.1136/qshc.2005.015842 · Cited by 1,795
Self-citationMaking Machine Learning Models Clinically Useful
Shah, N. H., Milstein, A., & Bagley, P. (2019) · JAMA · doi:10.1001/jama.2019.10306 · Cited by 294
Self-citationA primer on PDSA: executing plan-do-study-act cycles in practice, not just in name
Leis, J. A., & Shojania, K. G. (2017) · BMJ Quality & Safety · doi:10.1136/bmjqs-2016-006245 · Cited by 235
Singh, K., Valley, T. S., Tang, S., Li, B. Y., Kamran, F., Sjoding, M. W., Wiens, J., Otles, E., Donnelly, J. P., Wei, M. Y., et al. (2021) · Annals of the American Thoracic Society · doi:10.1513/annalsats.202006-698oc · Cited by 111
From Code to Bedside: Implementing Artificial Intelligence Using Quality Improvement Methods
Smith, M., Sattler, A., Hong, G., & Lin, S. (2021) · Journal of General Internal Medicine · doi:10.1007/s11606-020-06394-w · Cited by 51
Self-citation
Cited by
Impact of a deep learning sepsis prediction model on quality of care and survival
Boussina, A., Shashikumar, S. P., Malhotra, A., Owens, R. L., El-Kareh, R., Longhurst, C. A., Quintero, K., Donahue, A., Chan, T. C., Nemati, S., et al. (2024) · npj Digital Medicine · doi:10.1038/s41746-023-00986-6 · Cited by 170
Competencies for the Use of Artificial Intelligence in Primary Care
Liaw, W., Kueper, J. K., Lin, S., Bazemore, A., & Kakadiaris, I. (2022) · The Annals of Family Medicine · doi:10.1370/afm.2887 · Cited by 83
“39 In 1991, Gordon Guyatt introduced the term EBM to highlight the need to integrate evidence into medical decision making.”
BackgroundSelf-citationGallo, R. J., Shieh, L., Smith, M., Marafino, B. J., Geldsetzer, P., Asch, S. M., Shum, K., Lin, S., Westphal, J., Hong, G., et al. (2024) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2024.0084 · Cited by 58
Self-citationPotential uses of AI for perioperative nursing handoffs: a qualitative study
King, C. R., Shambe, A., & Abraham, J. (2023) · JAMIA Open · doi:10.1093/jamiaopen/ooad015 · Cited by 27
APLUS: A Python library for usefulness simulations of machine learning models in healthcare
Wornow, M., Gyang Ross, E., Callahan, A., & Shah, N. H. (2023) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2023.104319 · Cited by 26
Self-citation
Metadata
- Authors
- Li, R. C., Smith, M., Lu, J., Avati, A., Wang, S., Teuteberg, W. G., Shum, K., Hong, G., Seevaratnam, B., Westphal, J., Dougherty, M., Rao, P., Asch, S., Lin, S., Sharp, C., Shieh, L., & Shah, N. H.
- Venue
- NEJM Catalyst
- Publisher
- Massachusetts Medical Society
- Published
- 2022-03-16
- Volume
- 3
- Issue
- 4
- ISSN
- 2642-0007 (ISSN-L)
- OpenAlex
- W4220712879
- Cited by
- 37
- References
- 6
- FWCI
- 1.70
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Using AI to Empower Collaborative Team Workflows: Two Implementations for Advance Care Planning and Care Escalation. https://app.cochat.ai/papers/10.1056/cat.21.0457
- The paper
- Li, R. C., Smith, M., Lu, J., Avati, A., Wang, S., Teuteberg, W. G., Shum, K., Hong, G., Seevaratnam, B., Westphal, J., Dougherty, M., Rao, P., Asch, S., Lin, S., Sharp, C., Shieh, L., & Shah, N. H. (2022). Using AI to Empower Collaborative Team Workflows: Two Implementations for Advance Care Planning and Care Escalation. NEJM Catalyst. https://doi.org/10.1056/cat.21.0457
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.