The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index; 26 of the 43 sources its claims cite were checked for support.
Improving Communication in Intensive Care Unit to Ward Transitions: Protocol for Multisite National Implementation of the ICU-PAUSE Handoff Tool
Open accessAbstract
BACKGROUND: The intensive care unit (ICU)-ward transfer poses a particularly high-risk period for patients. The period after transfer has been associated with adverse events and additional work for care teams related to miscommunication or omission of information. Standardized handoff processes have been found to reduce communication errors and adverse patient events in other clinical environments but are understudied at the ICU-ward interface. We previously developed an electronic ICU-ward transfer tool, ICU-PAUSE, which embeds the key elements and diagnostic reasoning to facilitate a safe transfer of care at ICU discharge. OBJECTIVE: The aim of this study is to evaluate the implementation process of the ICU-PAUSE handoff tool across 10 academic medical centers, including the rate of adoption and acceptability, as perceived by clinical care teams. METHODS: ICU-PAUSE will be implemented in the medical ICU across 10 academic hospitals, with each site customizing the tool to their institution's needs. Our mixed methods study will include a combination of a chart review, quantitative surveys, and qualitative interviews. After a 90-day implementation period, we will conduct a retrospective chart review to evaluate the rate of uptake of ICU-PAUSE. We will also conduct postimplementation surveys of providers to assess perceptions of the tool and its impact on the frequency of communication errors and adverse events during ICU-ward transfers. Lastly, we will conduct semistructured interviews of faculty stakeholders with subsequent thematic analysis with the goal of identifying benefits and barriers in implementing and using ICU-PAUSE. RESULTS: ICU-PAUSE was piloted in the medical ICU at Barnes-Jewish Hospital, the teaching hospital of Washington University School of Medicine in St. Louis, in 2019. As of July 2022, implementation of ICU-PAUSE is ongoing at 6 of 10 participating sites. Our results will be published in 2023. CONCLUSIONS: Our process of ICU-PAUSE implementation embeds each step of template design, uptake, and customization in the needs of users and key stakeholders. Here, we introduce our approach to evaluate its acceptability, usability, and impact on communication errors according to the tenets of sociotechnical theory. We anticipate that ICU-PAUSE will offer an effective handoff tool for the ICU-ward transition that can be generalized to other institutions. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/40918.
Overview
CoChat Summary
TL;DR
This is a protocol for a convergent mixed methods implementation study evaluating the ICU-PAUSE electronic health record–embedded handoff tool for ICU-to-ward transfers across 10 academic medical centers. The study will assess adoption, acceptability, feasibility, and perceived impact on communication failures and medical errors, with results expected in 2023.
Key findings
As a protocol, no outcome results are reported; the paper states the following expectations and design parameters:
- ICU-PAUSE was piloted in the medical ICU at Barnes-Jewish Hospital in 2019 and is now the standard transfer summary documentation there; as of July 2022, implementation was ongoing at 6 of 10 participating sites.
- The authors hypothesize ICU-PAUSE will be used in at least 70% of ICU-ward transfer notes.
- They anticipate a reduction in communication-related adverse events (frequency of omission or miscommunication of information in ICU-ward transfer notes) and no change or improvements in major adverse events (eg, delayed discharge, patient death, ICU readmission).
- Preimplementation data already collected: semistructured interviews (n=7) and surveys (n=7) with faculty champions from each validation site in October–November 2021.
Methods
- Design: convergent mixed methods implementation study using (1) quantitative surveys, (2) a retrospective chart review, and (3) qualitative semistructured interviews, informed by the Consolidated Framework for Implementation Research (CFIR) and Sittig and Singh's sociotechnical theory.
- Sample/data: implementation in medical ICUs at 10 academic medical centers (Cedars-Sinai, Kaiser Permanente Oakland, Ohio State, Penn State Hershey, Rutgers, University of Chicago, University of Iowa, University of Kentucky, UCSF, plus pilot site BJH). Aim 1 participants: 1 faculty champion and 1 stakeholder per institution; chart review of patients (n=300) transferred August–October 2022; postimplementation interviews of 2 interviewees per institution (n=14). Aim 2 participants: PGY-2 and PGY-3 internal medicine residents, ICU attending physicians, and ward attending physicians (n=175), with PGY-1 residents excluded.
- Analysis: descriptive statistics comparing pre- and postimplementation uptake, acceptability, and feasibility; paired t tests for pre/post survey comparison; nonresponse bias assessment comparing early and late respondents; Stata 17 with P<.05 significance; deductive thematic analysis of deidentified transcripts coded against the 8 dimensions of sociotechnical theory using Dedoose, with two independent coders.
Limitations
- Stated: the postimplementation survey cohort will not be identical to the preimplementation cohort from the prior study, though the authors note this is a known limitation of medical education research and they will control for unpaired groups; potential selection bias from interviewing faculty champions with personal or professional interests in ICU-PAUSE's success; exclusion of other stakeholders including other specialty practitioners, nursing staff, and patients; conduct at medical ICUs at academic medical centers may preclude generalizability to specialty ICUs; patient satisfaction data were considered but not used as a secondary outcome because most such surveys are collected after discharge, making it hard to isolate the ICU transfer process.
- Evident from the text: the paper reports no outcome data, so all anticipated effects (including the ≥70% uptake hypothesis) remain untested; the primary investigator is a stakeholder in ICU-PAUSE development and conducts the faculty champion interviews, with reflexivity measures (medical student observers, regular bias discussions) proposed to mitigate this.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
![Figure 1 ICU-PAUSE Electronic Tool. ***: Free text placeholder; ACP: Advanced Care Planning; DPOA: Designated Power of Attorney; ICU: Intensive Care Unit; N/A: not applicable; OT: Occupational Therapy; PT: Physical Therapy; SLP: Speech and Language Pathology; VTE: Venous Thromboembolism Prophylaxis. Reproduced from Santhosh et al [12], which is published under Creative Commons Attribution Non-Commercial No Derivatives License 4.0 [15]).](https://figures.cochat.ai/paper-figures/c317624e282840698fffda4bbbfe756d/improving-communication-in-intensive-care-unit-to-ward-transitions-protocol-for-figure-1.jpg)
Verification
Claims the paper makes
24 Valid · 1 Not valid · 10 Not checked · 26 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“which remains vulnerable to nonstandard and suboptimal practices [8].”
§ Improving Communication in Intensive Care Unit to Ward Transitions: Protocol for Multisite National Implementation of the ICU-PAUSE Handoff Tool > Introduction > Background
What the sources say
- Supportedcites [8] source
The Background describes ICU-to-ward discharge as high risk and says suboptimal handover can lead to adverse outcomes. The Key messages and Implications for practice identify variation in discharge practices and call for agreed discharge criteria, supporting the characterization of the transition as vulnerable to nonstandard and suboptimal practices. Page numbers are not provided in our copy. (LLM, conf=0.91)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“but are understudied at the ICU-ward interface.”
- Also stated in: § Background · plain
“these approaches are surprisingly understudied during this high-risk ICU-ward transition [6,7]”
§ Improving Communication in Intensive Care Unit to Ward Transitions: Protocol for Multisite National Implementation of the ICU-PAUSE Handoff Tool > Abstract > Background
What the sources say
- Supportedcites [6] source
The Introduction says a comprehensive evaluation of interventions to improve ICU-to-ward handovers was lacking. The Discussion reports that the review found only 11 relevant studies, indicating that few studies had examined this interface, including interventions such as handover forms. (LLM, conf=0.92)
- Not checked — no full text of the sourcecites [7] source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Background · plain
Every source the paper cites for this claim was checked and supports it.
In the paper
“We previously developed an electronic ICU-ward transfer tool, ICU-PAUSE, which embeds the key elements and diagnostic reasoning to facilitate a safe transfer of care at ICU discharge.”
§ Improving Communication in Intensive Care Unit to Ward Transitions: Protocol for Multisite National Implementation of the ICU-PAUSE Handoff Tool > Abstract > Background
What the sources say
- Supportedcites [12] source
The Results describe ICU-PAUSE as an ICU–ward transfer tool that includes core handoff information and a diagnostic pause to document uncertainty. The Discussion links that pause to reducing poor information transfer and premature closure. The claim describes the tool’s intended function, not a demonstrated safety outcome. (LLM, conf=0.90)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Standardized handoff processes have been found to reduce communication errors and adverse patient events in other clinical environments but are understudied at the ICU-ward interface.”
- Also stated in: § Background · plain
“Although standardized practices and structured handoff tools reduce these errors and associated negative outcomes [5]”
§ Improving Communication in Intensive Care Unit to Ward Transitions: Protocol for Multisite National Implementation of the ICU-PAUSE Handoff Tool > Abstract > Background
What the sources say
- Partly supportedcites [5] sourceExperimental — accuracy not yet measured
The Medical Errors and Adverse Events section reports fewer medical errors and preventable adverse events after implementation of the I-PASS handoff bundle. The Written and Oral Handoff Quality section reports improved communication content, but does not establish a reduction in communication errors as a distinct outcome. The study concerned pediatric inpatient resident handoffs, not the ICU–ward interface. (LLM, conf=0.84)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Background · plain
Every source the paper cites for this claim was checked and supports it.
In the paper
“These elements were identified and incorporated into our user-engaged creation of ICU-PAUSE, a novel clinical template specific to the ICU-ward transition [12].”
§ Improving Communication in Intensive Care Unit to Ward Transitions: Protocol for Multisite National Implementation of the ICU-PAUSE Handoff Tool > Discussion
What the sources say
- Supportedcites [12] source
The Abstract’s Objective and Conclusion describe ICU-PAUSE as a novel electronic ICU–ward transfer tool cocreated with Internal Medicine trainees. The Methods and Results describe workshops and resident prototypes used to develop the tool, supporting the user-engaged creation described in the citing sentence. (LLM, conf=0.94)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
13 more claims · 4 with their cited sources checked
Create a free account to see all 61 claims and every source verdict.
- Probably not a substantial claim. 36
- It may state two separate claims as one. 12
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ Improving Communication in Intensive Care Unit to Ward Transitions: Protocol for Multisite National Implementation of the ICU-PAUSE Handoff Tool > Methods > Analysis
“Pre- and postimplementation survey data will be compared using paired t tests.”
§ Improving Communication in Intensive Care Unit to Ward Transitions: Protocol for Multisite National Implementation of the ICU-PAUSE Handoff Tool > Discussion
“A notable limitation is the inconsistency of our postimplementation survey cohort of internal medicine trainees and attendings, which will not be identical to the preimplementation cohort from our prior study [9]. However, this is a known limitation of medical education research with resident trainees, and we will control for unpaired groups in our statistical analysis.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Improving Communication in Intensive Care Unit to Ward Transitions: Protocol for Multisite National Implementation of the ICU-PAUSE Handoff Tool > Methods > Analysis
“We will also compare pre- and postimplementation surveys of self-reported communication failures, handoff errors, and time spent on ICU-ward transfers (Table 3) [9].”
§ Improving Communication in Intensive Care Unit to Ward Transitions: Protocol for Multisite National Implementation of the ICU-PAUSE Handoff Tool > Methods > Data Collection
“Table: Table 3 Postimplementation semistructured interview measures.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Improving Communication in Intensive Care Unit to Ward Transitions: Protocol for Multisite National Implementation of the ICU-PAUSE Handoff Tool > Methods > Data Collection
“Two follow-up emails will be sent 1 week later and 2 weeks later to maximize the response rate.”
§ Improving Communication in Intensive Care Unit to Ward Transitions: Protocol for Multisite National Implementation of the ICU-PAUSE Handoff Tool > Methods > Analysis
“Early respondents are defined as participants who complete the survey within the first 2 weeks, whereas late respondents are those who complete the survey after a third reminder email is sent at 2 weeks [26].”
Citations
Cites
How Many Interviews Are Enough?: An Experiment with Data Saturation and Variability
Guest, G., Bunce, A., & Johnson, L. (2006) · Field Methods · doi:10.1177/1525822x05279903 · Cited by 20,808
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496 · cited 4×
“The CFIR also provides the basis of our quantitative analysis to evaluate the implementation of ICU-PAUSE [14].”
InfluentialPsychometric assessment of three newly developed implementation outcome measures
Weiner, B. J., Lewis, C. C., Stanick, C., Powell, B. J., Dorsey, C. N., Clary, A. S., Boynton, M. H., & Halko, H. (2017) · Implementation Science · doi:10.1186/s13012-017-0635-3 · Cited by 2,819 · cited 2×
“…appropriateness, and feasibility of ICU-PAUSE (as measured by the Acceptability of Intervention Measure [AIM], Intervention Appropriateness Measure [IAM], and Feasibility of Intervention Measure [FIM]) [21], perceived resource needs or constraints, and barriers or facilitators to implementation.”
Wiltsey Stirman, S., Baumann, A. A., & Miller, C. J. (2019) · Implementation Science · doi:10.1186/s13012-019-0898-y · Cited by 1,329
Changes in medical errors after implementation of a handoff program
Starmer, A. J., Spector, N. D., Srivastava, R., West, D. C., Rosenbluth, G., Allen, A. D., Noble, E. L., Tse, L. L., Dalal, A. K., Keohane, C. A., et al. (2014) · New England Journal of Medicine · doi:10.1056/nejmsa1405556 · Cited by 947
Sittig, D. F., & Singh, H. (2010) · Quality and Safety in Health Care · doi:10.1136/qshc.2010.042085 · Cited by 897 · cited 8×
“A coding framework rooted in the 8 dimensions of sociotechnical theory has been developed along the following codes: hardware and software, clinical content, human-computer interface, people, workflow and communication, internal organizational features, and external rules and regulations [13].”
InfluentialResponse Rates and Nonresponse Errors in Surveys
Johnson, T. P. (2012) · JAMA · doi:10.1001/jama.2012.3532 · Cited by 701 · cited 1×
“We will also evaluate for nonresponse bias by comparing the demographic data and survey responses of early respondents and late respondents, under the assumption that late respondents are similar to nonrespondents [25].”
Starmer, A. J., O’Toole, J. K., Rosenbluth, G., Calaman, S., Balmer, D., West, D. C., Bale, J. F., Yu, C. E., Noble, E. L., Tse, L. L., et al. (2014) · Academic Medicine · doi:10.1097/acm.0000000000000264 · Cited by 186
Lyon, A. R., Brewer, S. K., & Areán, P. A. (2020) · American Psychologist · doi:10.1037/amp0000652 · Cited by 152 · cited 1×
“Accordingly, we used human-centered design methods across multiple internal medicine residency programs to create and iteratively prototype a structured ICU-to-ward transfer tool embedded within the electronic health record (EHR) [11].”
van Sluisveld, N., Hesselink, G., van der Hoeven, J. G., Westert, G., Wollersheim, H., & Zegers, M. (2015) · Intensive Care Medicine · doi:10.1007/s00134-015-3666-8 · Cited by 130
Research works printed but not linked: 1
- Creswell, JW, 2011, Designing and conducting mixed methods research, 2nd ed
Cited by
Bohart, S., Nielsen, A. H., Sørensen, J. L., Andreasen, A. S., Waldau, T. E., Møller, A. M., & Thomsen, T. (2024) · Journal of Critical Care · doi:10.1016/j.jcrc.2024.154859 · Cited by 13
Diagnostic Uncertainty Among Critically Ill Children Admitted to the PICU: A Multicenter Study
Cifra, C. L., Custer, J. W., Smith, C. M., Smith, K. A., Bagdure, D. N., Bloxham, J., Goldhar, E., Gorga, S. M., Hoppe, E. M., Miller, C. D., et al. (2024) · Critical Care Medicine · doi:10.1097/ccm.0000000000006511 · Cited by 10
Lyons, P. G., Rojas, J. C., Bewley, A. F., Malone, S. M., & Santhosh, L. (2024) · ATS Scholar · doi:10.34197/ats-scholar.2023-0094oc · Cited by 8
“…mPDQI-9 scores before and after implementing a standardized ICU – ward transfer note template would provide valuable objective data beyond clinician perspectives (33 – 35) and might offer important mechanistic information to aid interpretation of other implementation, process, and patient outcomes.”
BackgroundSelf-citationParikh, N. R., Francisco, L. S., Balikai, S. C., Luangrath, M. A., Elmore, H. R., Erdahl, J., Badheka, A. V., Chegondi, M., Landrigan, C. P., Pennathur, P. R., et al. (2024) · The Joint Commission Journal on Quality and Patient Safety · doi:10.1016/j.jcjq.2024.01.010 · Cited by 4
The Epidemiology of ICU Readmissions Across Ten Health Systems
Amagai, S., Chaudhari, V., Chhikara, K., Ingraham, N. E., Hochberg, C. H., Barker, A., Mao, C., Ortiz, A. C., Weissman, G. E., Schmid, B. E., et al. (2025) · Critical Care Explorations · doi:10.1097/cce.0000000000001341 · Cited by 4
Self-citation
Metadata
- Authors
- Fukui, E. M., Lyons, P. G., Harris, E., McCune, E. K., Rojas, J. C., & Santhosh, L.
- Affiliations
- University of California, San Francisco (US)
- BJC HealthCare (US)
- Rush University (US)
- Corresponding author
- Fukui, Elle Mizuki
- Venue
- JMIR Research Protocols
- Publisher
- JMIR Publications Inc.
- Published
- 2023-02-06
- Volume
- 12
- Pages
- e40918
- ISSN
- 1929-0748 (ISSN-L)
- PMC
- PMC9941899
- OpenAlex
- W4319294371
- Cited by
- 9
- References
- 25
- Citations by year
- 2025: 5 · 2024: 4
- FWCI
- 2.76
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Research Protocols (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- Digital Commons@Becker (Washington University School of Medicine) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Academy of Medicine
- Topics
- Health Sciences › Nursing › Leadership and Management › Hospital Admissions and Outcomes
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Patient Safety and Medication Errors
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Keywords
- patient handover, communication errors, adverse events, implementation, socio-technical systems theory, medical intensive care unit
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.