Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index; 17 of the 22 sources its claims cite were checked for support.

Lowering the burden: Shorter versions of the Program Sustainability Assessment Tool (PSAT) and Clinical Sustainability Assessment Tool (CSAT)

Open access
Malone, Sara, Prewitt, Kim, McKay, Virginia, Zabotka, Luke, Bacon, Caren, Luke, Douglas A. · 2024 · Implementation Science Communications

Abstract

Background: Although significant advances have been made in the conceptualization of sustainability, having pragmatic, psychometrically valid tools remains a need within the field. Our previous work has developed frameworks and tools to assess both program sustainability and clinical sustainability capacity. This work presents new, psychometrically tested short versions of the Program Sustainability Assessment Tool (PSAT) and the Clinical Sustainability Assessment Tool (CSAT). Methods: These methods were conducted in identical, parallel processes for the CSAT and PSAT. Previously collected data for these instruments was obtained across a variety of settings, contexts, and participants. We first conducted testing to determine cronbach’s alpha of shortened domains (3 items each) and then conducted Confirmatory Factor Analysis to ensure that the domains were still appropriate for the tool. After, the team met to review the results and determine the final versions of the short PSAT and short CSAT. Results: The short PSAT retained cronbach’s alpha’s of 0.82 – 0.91 for each domain of the tool, with which maintains excellent reliability for the tool. Confirmatory factor analysis highlights that the short PSAT retains conceptual distinction across the 8 domains, with CFI scores greater than 0.90, RMSEA scores below 0.6, and SRMR scores less than 0.08. The short CSAT had cronbach’s alpha of 0.84 – 0.92 for each of the domains of the tool, also suggesting excellent reliability of the domains within the measure after dropping two items/domain. Confirmatory factor analysis of the short CSAT meets the same specifications as above, again highlighting conceptual distinction across the domains. Conclusion: Each tool was able to be shortened to three items per domain while maintaining strong psychometric properties. This results in a tool that takes less time to complete, meeting one of the key calls for pragmatic measures within implementation science. This advances our abilities to measure and test sustainability within implementation science.

Overview

CoChat Summary

TL;DR

This brief report developed and psychometrically tested 3-item-per-domain short forms of the Program Sustainability Assessment Tool (PSAT) and Clinical Sustainability Assessment Tool (CSAT), each 40% shorter than the original long forms. Both short tools retained strong reliability and acceptable confirmatory factor analysis fit, supporting less burdensome sustainability capacity assessment.

Key findings

  • The short PSAT retained all 8 domains with 3 items each, resulting in a 24-item measure that is 40% shorter than the original. Cronbach’s alphas ranged from .825 to .912 across domains, and CFA fit for the short version was CFI = .969, RMSEA = .040, SRMR = .036 (N = 5,706).
  • The short CSAT retained all 7 domains with 3 items each, resulting in a 21-item measure that is 40% shorter than the original. Cronbach’s alphas ranged from .842 to .924 across domains, and CFA fit for the short version was CFI = .946, RMSEA = .056, SRMR = .045 (N = 501).
  • Both short versions maintained conceptual distinction across their domains, with the authors concluding they are reliable, precise, and pragmatic measures. The authors state the short forms are not intended to replace the longer versions, which may be preferable when comprehensive or nuanced domain assessment is needed.

Methods

  • This was a parallel psychometric study using previously collected data. PSAT data came from sustaintool.org for 2014–2019 (N = 5,706); CSAT data combined website responses from 2018–2022 with prior studies of antimicrobial stewardship, cancer screening, and smoking cessation (N = 501).
  • For each tool, the team calculated Cronbach’s alpha for the original 5-item domains, identified the two lowest item-total correlation items per domain, reviewed item drops for conceptual importance, recalculated alpha for the new 3-item domains, and conducted confirmatory factor analysis comparing long and short forms. Analyses were conducted in R, with “not applicable” treated as missing and test/incomplete data removed.

Limitations

  • The authors state that all data were collected using the longer versions of the tools for other purposes, and future work should test data collected on both versions with a new sample.
  • The authors state the short versions are not intended to replace the longer versions; some scenarios, especially cross-sectional designs, may call for the original, more comprehensive items.
  • The text makes evident that the CSAT analyses rely on a smaller, combined sample (N = 501) from website and prior studies, while the PSAT uses a large online sample (N = 5,706); the authors also note that “stakeholder” terminology was replaced and future psychometric analyses with the new language are planned.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1186/s43058-024-00656-y

Cites

20 of 20 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

9 Valid · 2 Not valid · 1 Not checked · 28 Own results and interpretations

6 more claims

Create a free account to see all 40 claims and every source verdict.

See all claims — free account
  • Probably not a substantial claim. 20
  • It may state two separate claims as one. 13
  • The quote only partly states this claim. 2

Create a free account to see these claims.

Citations

Cites

Show all 20 references

Research works printed but not linked: 1

  1. Malone S, Prewitt K, Luke D. Assessing clinical sustainability: a new, user-friendly tool for evaluating real-world practices. In American Evaluation Association’s annual conference. 2019.

Cited by

See all 12

Metadata

Authors
Malone, S., Prewitt, K., McKay, V., Zabotka, L., Bacon, C., & Luke, D. A.
Affiliations
Washington University in St. Louis (US)
Corresponding author
Malone, Sara
Venue
Implementation Science Communications
Published
2024-10-10
Volume
5
Issue
1
Pages
113-113
ISSN
2662-2211 (ISSN-L)
OpenAlex
W4403288069
Cited by
12
References
20
Citations by year
2026: 7 · 2025: 5
FWCI
7.00
Type
journal article
Language
en
Open access
Licence
Locations
  • Implementation Science Communications (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Digital Commons@Becker (Washington University School of Medicine) (submittedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
Funders
  • National Cancer Institute (P50CA244431, R37CA276215)
  • Centers for Disease Control and Prevention (75D301-20-R-68063)
Topics
  • Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
  • Health Sciences › Nursing › Research and Theory › Health Education and Validation
  • Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
Keywords
program sustainability, short-form instrument, psychometric validation, reliability statistics, factor structure, burden reduction

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Lowering the burden: Shorter versions of the Program Sustainability Assessment Tool (PSAT) and Clinical Sustainability Assessment Tool (CSAT). https://app.cochat.ai/papers/10.1186/s43058-024-00656-y
The paper
Malone, S., Prewitt, K., McKay, V., Zabotka, L., Bacon, C., & Luke, D. A. (2024). Lowering the burden: Shorter versions of the Program Sustainability Assessment Tool (PSAT) and Clinical Sustainability Assessment Tool (CSAT). Implementation Science Communications. https://doi.org/10.1186/s43058-024-00656-y

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.