Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 58 of the 59 references it cites were found in a registry or an index; 48 of the 70 sources its claims cite were checked for support.

Using qualitative comparative analysis to uncover multiple pathways to program sustainment: implications for community-based youth substance misuse prevention

Open access

Abstract

Background: In order to achieve wide-scale impact in community settings, programs must be sustained. Theory and empirical evidence suggest that intervention characteristics, organizational context, capacity for program implementation, and processes related to implementation are associated with continued program delivery. However, few studies examine how combinations of these factors work together in different settings to influence program sustainment. Methods: Using scales specified in the Program Sustainability Assessment Tool (PSAT), the current cross-sectional study aims to identify the necessary and sufficient conditions for the sustainment of the Strengthening Families Program for Parents and Youth 10-14 (SFP 10-14). Staff (n = 59) at SFP 10-14 implementation sites across Washington State completed an online survey reporting on their current level of SFP 10-14 sustainment. They also completed PSAT, with eight scales designed to assess conditions that consistently produce sustainment. Data were analyzed using qualitative comparative analysis. Results: Environmental support was the only necessary condition for sustainment success. Four solutions sufficient to achieve sustainment were also identified. These included the combined presence of (1) environmental support, organizational capacity, and funding stability; (2) environmental support, organizational capacity, communication, and program evaluation, in the absence of strategic planning; (3) environmental support, organizational capacity, program evaluation, and partnerships, in the absence of strategic planning; and (4) environmental support, communication, partnerships, and funding stability, in the absence of program evaluation. Conclusions: Environmental support in combination with organizational capacity appeared to most consistently produce sustainment of SFP 10-14 programs in Washington State. Program providers will benefit from a focusing on enhancing those conditions to increase program sustainment.

Overview

CoChat Summary

TL;DR

This cross-sectional crisp-set QCA study of 32 SFP 10-14 implementation staff in Washington State found environmental support was the only necessary condition for program sustainment and identified four sufficient combinations of PSAT conditions. Environmental support plus organizational capacity appeared in three of four pathways, suggesting multiple routes to sustainment.

Key findings

  • Environmental support was the only necessary condition: 94% of cases with average or above environmental support reported routinized sustainment (consistency .94, coverage .84); the absence of environmental support was the only condition sufficient for sustainment failure.
  • Four sufficient intermediate solutions were identified: (1) environmental support + organizational capacity + funding stability (consistency .90, raw coverage .53, unique coverage .41); (2) environmental support + organizational capacity + communication + program evaluation + absence of strategic planning (consistency 1.00, raw coverage .12); (3) environmental support + organizational capacity + program evaluation + partnerships + absence of strategic planning (consistency 1.00, raw coverage .06); and (4) environmental support + communication + partnerships + funding stability + absence of program evaluation (consistency 1.00, raw coverage .18).
  • Of the 32 analytic cases, 14 (43.7%) achieved sustainment. Funding stability was not necessary and appeared in only two of four solutions; strategic planning absence appeared in two solutions; program evaluation appeared in two solutions but was required to be absent in one.

Methods

  • Cross-sectional online survey conducted January–February 2015 with SFP 10-14 coordinators, facilitators, and other staff across Washington State; 119 contacts were emailed, 59 completed the survey (49.6%), and the final QCA analytic sample was 32 cases with complete data.
  • Sustainment was measured with one item: Level 4 “routinized” was coded as sustained/present, while Levels 1–3 were coded absent. Conditions were the eight PSAT scales (five items each, 7-point response scale); program adaptation was excluded due to lack of face validity and empirical support, and remaining conditions were mean-split dichotomized.
  • Data were analyzed using crisp-set qualitative comparative analysis, including truth-table construction, necessity analysis with a consistency threshold of 0.9, sufficiency analysis using the intermediate solution with a consistency cutoff of 0.8, and model fit assessed via solution coverage and consistency.

Limitations

  • Stated: the small sample may have limited identification of all possible combinations; the QCA complete-data requirement and lack of missing-data techniques may bias results; dichotomization and mean-split calibration may obscure partial contributions and limit generalizability, though sensitivity analyses with other cutpoints were highly similar; single-reporter measurement of both conditions and sustainment, and possible multiple staff from the same site, may have inflated associations; implementer characteristics and other intervention characteristics were not included.
  • Evident: the cross-sectional design cannot establish temporal or causal ordering, and the sample is limited to SFP 10-14 sites in Washington State, restricting generalizability.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1186/s43058-022-00303-4

Cites

58 of 58 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

27 Valid · 1 Not valid · 7 Not checked · 58 Own results and interpretations

46 more claims · 4 with their cited sources checked

Create a free account to see all 93 claims and every source verdict.

See all claims — free account
  • It may state two separate claims as one. 20
  • Probably not a substantial claim. 26
  • The quote only partly states this claim. 1

Create a free account to see these claims.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

1 of 1

Citations

Cites

Show all 59 references

Research works printed but not linked: 3

  1. National Academies of Sciences, Engineering, Medicine. Fostering healthy mental, emotional. In: and behavioral development in children and youth: a national agenda. Washington, DC: National Academies Press; 2019.
  2. U.S. Department of Health and Human Services (HHS). Facing addiction in America: the Surgeon General’s Report on alcohol, drugs, and health. Washington, DC; 2016. Available from: https://pubmed.ncbi.nlm.nih.gov/28252892/.
  3. Legewie N. An introduction to applied data analysis with qualitative comparative analysis. Forum Qual Soc Res/Forum Qual Sozialforsch. 2013;14(3):45 Available from: http://www.qualitative-research.net/ [cited 28 Jul 2020].

Cited by

See all 7

Metadata

Authors
Cooper, B. R., Hill, L. G., Parker, L., Jenkins, G. J., Shrestha, G., & Funaiole, A.
Affiliations
  • Washington State University (US)
  • Washington State Department of Health (US)
Corresponding author
Cooper, Brittany Rhoades
Venue
Implementation Science Communications
Published
2022-05-26
Volume
3
Issue
1
Pages
55-55
ISSN
2662-2211 (ISSN-L)
OpenAlex
W4281678781
Cited by
7
References
59
Citations by year
2025: 3 · 2024: 4
FWCI
2.01
Type
journal article
Language
en
Open access
Licence
Locations
  • Implementation Science Communications (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
State of Washington Initiative Measure No. 171
Topics
  • Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
  • Health Sciences › Medicine › Epidemiology › Substance Abuse Treatment and Outcomes
  • Social Sciences › Public Administration › Evaluation and Performance Assessment
Keywords
program sustainment, community-based prevention, Strengthening Families Program, environmental support, organizational capacity, funding stability, program evaluation, strategic planning, partnership, communication, necessary and sufficient conditions

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Using qualitative comparative analysis to uncover multiple pathways to program sustainment: implications for community-based youth substance misuse prevention. https://app.cochat.ai/papers/10.1186/s43058-022-00303-4
The paper
Cooper, B. R., Hill, L. G., Parker, L., Jenkins, G. J., Shrestha, G., & Funaiole, A. (2022). Using qualitative comparative analysis to uncover multiple pathways to program sustainment: implications for community-based youth substance misuse prevention. Implementation Science Communications. https://doi.org/10.1186/s43058-022-00303-4

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.