Validity and usefulness of members reports of implementation progress in a quality improvement initiative: findings from the Team Check-up Tool (TCT)
Open accessThe DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Team-based interventions are effective for improving safety and quality of healthcare. However, contextual factors, such as team functioning, leadership, and organizational support, can vary significantly across teams and affect the level of implementation success. Yet, the science for measuring context is immature. The goal of this study is to validate measures from a short instrument tailored to track dynamic context and progress for a team-based quality improvement (QI) intervention. DESIGN: Secondary cross-sectional and longitudinal analysis of data from a clustered randomized controlled trial (RCT) of a team-based quality improvement intervention to reduce central line-associated bloodstream infection (CLABSI) rates in intensive care units (ICUs). SETTING: Forty-six ICUs located within 35 faith-based, not-for-profit community hospitals across 12 states in the U.S. POPULATION: Team members participating in an ICU-based QI intervention. MEASURES: The primary measure is the Team Check-up Tool (TCT), an original instrument that assesses context and progress of a team-based QI intervention. The TCT is administered monthly. Validation measures include CLABSI rate, Team Functioning Survey (TFS) and Practice Environment Scale (PES) from the Nursing Work Index. ANALYSIS: Temporal stability, responsiveness and validity of the TCT. RESULTS: We found evidence supporting the temporal stability, construct validity, and responsiveness of TCT measures of intervention activities, perceived group-level behaviors, and barriers to team progress. CONCLUSIONS: The TCT demonstrates good measurement reliability, validity, and responsiveness. By having more validated measures on implementation context, researchers can more readily conduct rigorous studies to identify contextual variables linked to key intervention and patient outcomes and strengthen the evidence base on successful spread of efficacious team-based interventions. QI teams participating in an intervention should also find data from a validated tool useful for identifying opportunities to improve their own implementation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“we did come across a number of articles that included these outcomes (e.g., number of bloodstream infections [83]) alone or in combination with other implementation outcomes.”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An Intervention to Decrease Catheter-Related Bloodstream Infections in the ICU
Pronovost, P., Needham, D., Berenholtz, S., Sinopoli, D., Chu, H., Cosgrove, S., Sexton, B., Hyzy, R., Welsh, R., Roth, G., et al. (2006) · New England Journal of Medicine · doi:10.1056/nejmoa061115 · Cited by 4,387 · cited 1×
“In fact, substantial reductions in central line-associated bloodstream infection (CLABSI) rates for intensive care units (ICUs), shorter hospital stays for stroke patients, and improvements in end-of-life care have been reported for team-based interventions [2-4].”
BackgroundDevelopment of the practice environment scale of the nursing work index†‡
Lake, E. T. (2002) · Research in Nursing & Health · doi:10.1002/nur.10032 · Cited by 1,769 · cited 2×
“The PES is part of the Nursing Work Index (NWI) that was designed to measure organizational factors associated with job satisfaction and the quality of nursing care delivery [14].”
What Do We Know about Health Care Team Effectiveness? A Review of the Literature
Lemieux-Charles, L., & McGuire, W. L. (2006) · Medical Care Research and Review · doi:10.1177/1077558706287003 · Cited by 844 · cited 3×
“Team-based interventions are effective for improving safety and quality of healthcare for a variety of settings and patient populations [1].”
BackgroundInfluentialQuality collaboratives: lessons from research
Ovretveit, J. (2002) · Quality and Safety in Health Care · doi:10.1136/qhc.11.4.345 · Cited by 568 · cited 3×
“Given that data collection is one of the major challenges faced by teams participating in collaboratives [5], having a measure that is relevant, evaluates multiple domains, and is feasible to administer on a routine basis is necessary for successfully monitoring progress for a given intervention.”
BackgroundCreating High Reliability in Health Care Organizations
Pronovost, P. J., Berenholtz, S. M., Goeschel, C. A., Needham, D. M., Sexton, J. B., Thompson, D. A., Lubomski, L. H., Marsteller, J. A., Makary, M. A., & Hunt, E. (2006) · Health Services Research · doi:10.1111/j.1475-6773.2006.00567.x · Cited by 410 · cited 1×
“published elsewhere [3,16-18].”
Self-citationThe Role of Perceived Team Effectiveness in Improving Chronic Illness Care
Shortell, S. M., Marsteller, J. A., Lin, M., Pearson, M. L., Wu, S.-Y., Mendel, P., Cretin, S., & Rosen, M. (2004) · Medical Care · doi:10.1097/00005650-200411000-00002 · Cited by 395 · cited 6×
“The TFS [7] is adapted from the team effectiveness instrument originally developed by G.”
BackgroundMethodInfluentialSelf-citationImproving patient safety in intensive care units in Michigan
Pronovost, P. J., Berenholtz, S. M., Goeschel, C., Thom, I., Watson, S. R., Holzmueller, C. G., Lyon, J. S., Lubomski, L. H., Thompson, D. A., Needham, D., et al. (2008) · Journal of Critical Care · doi:10.1016/j.jcrc.2007.09.002 · Cited by 324 · cited 1×
“published elsewhere [3,16-18].”
Self-citationDeterminants of Implementation Effectiveness: Adapting a Framework for Complex Innovations
Helfrich, C. D., Weiner, B. J., McKinney, M. M., & Minasian, L. (2007) · Medical Care Research and Review · doi:10.1177/1077558707299887 · Cited by 314
Implementing and Validating a Comprehensive Unit-Based Safety Program
Pronovost, P., Weast, B., Rosenstein, B., Sexton, J. B., Holzmueller, C. G., Paine, L., Davis, R., & Rubin, H. R. (2005) · Journal of Patient Safety · doi:10.1097/01209203-200503000-00008 · Cited by 288
Assessing the Implementation of the Chronic Care Model in Quality Improvement Collaboratives
Pearson, M. L., Wu, S., Schaefer, J., Bonomi, A. E., Shortell, S. M., Mendel, P. J., Marsteller, J. A., Louis, T. A., Rosen, M., & Keeler, E. B. (2005) · Health Services Research · doi:10.1111/j.1475-6773.2005.00397.x · Cited by 205 · cited 1×
“Qualitative reports of team activities and perceptions have been used to study implementation processes in QI collaboratives [8-10].”
MethodSelf-citation
Research works printed but not linked: 1
- Marsteller JA, Sexton B, Hsu YJ, Hsiao CJ, Pronovost PJ, Thompson DA: A multicenter, phased cluster-randomized controlled trial to reduce central line-associated blood stream infections. Johns Hopkins Bloomberg School of Public Health and Johns Hopkins School of Medicine. 2010, July , submitted to a peer-reviewed journal
Cited by
Chaudoir, S. R., Dugan, A. G., & Barr, C. H. (2013) · Implementation Science · doi:10.1186/1748-5908-8-22 · Cited by 800
“, number of bloodstream infections [83]) alone or in combination with other implementation outcomes.”
BackgroundSociety for Prevention Research Type 2 Translational Task Force Members and Contributing Authors, Spoth, R., Rohrbach, L. A., Greenberg, M., Leaf, P., Brown, C. H., Fagan, A., Catalano, R. F., Pentz, M. A., Sloboda, Z., et al. (2013) · Prevention Science · doi:10.1007/s11121-012-0362-6 · Cited by 283
Reducing Hospital Errors: Interventions that Build Safety Culture
Singer, S. J., & Vogus, T. J. (2013) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-031912-114439 · Cited by 195
Defining and assessing context in healthcare implementation studies: a systematic review
Rogers, L., De Brún, A., & McAuliffe, E. (2020) · BMC Health Services Research · doi:10.1186/s12913-020-05212-7 · Cited by 158
Welp, A., & Manser, T. (2016) · BMC Health Services Research · doi:10.1186/s12913-016-1535-y · Cited by 165
“sights, but – with one exception [88] – were excluded”
BackgroundMethodInfluential
Metadata
- Authors
- Chan, K. S., Hsu, Y.-J., Lubomski, L. H., & Marsteller, J. A.
- Affiliations
- Johns Hopkins University (US)
- Corresponding author
- Chan, Kitty S
- Venue
- Implementation Science
- Published
- 2011-10-03
- Volume
- 6
- Issue
- 1
- Pages
- 115-115
- ISSN
- 1748-5908 (ISSN-L)
- PMC
- PMC3205035
- OpenAlex
- W2157663627
- Cited by
- 25
- References
- 25
- Citations by year
- 2024: 1 · 2022: 1 · 2020: 5 · 2019: 1 · 2018: 1 · 2017: 1 · 2016: 3 · 2015: 4 · 2014: 3 · 2013: 4 · 2012: 1
- FWCI
- 4.76
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Implementation Science (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- Robert Wood Johnson Foundation (65248)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Healthcare Quality and Management
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Patient Safety and Medication Errors
- Keywords
- implementation context, instrument validation, central line-associated bloodstream infection, intensive care unit, team functioning, nursing work environment, temporal stability, construct validity, responsiveness
- MeSH terms
- Cross-Sectional Studies, Humans, Intensive Care Units, Longitudinal Studies, Patient Care Team, Quality Assurance, Health Care, Reproducibility of Results, Program Evaluation, Program Development, Quality Indicators, Health Care, Catheter-Related Infections, Quality Improvement
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Validity and usefulness of members reports of implementation progress in a quality improvement initiative: findings from the Team Check-up Tool (TCT). https://app.cochat.ai/papers/10.1186/1748-5908-6-115
- The paper
- Chan, K. S., Hsu, Y.-J., Lubomski, L. H., & Marsteller, J. A. (2011). Validity and usefulness of members reports of implementation progress in a quality improvement initiative: findings from the Team Check-up Tool (TCT). Implementation Science. https://doi.org/10.1186/1748-5908-6-115
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

