The DOI matches its Crossref record; 144 of the 144 references it cites were found in a registry or an index; 11 of the 139 sources its claims cite were checked for support.
The Sustainability of Evidence-Based Interventions and Practices in Public Health and Health Care
Open accessAbstract
There is strong interest in implementation science to address the gap between research and practice in public health. Research on the sustainability of evidence-based interventions has been growing rapidly. Sustainability has been defined as the continued use of program components at sufficient intensity for the sustained achievement of desirable program goals and population outcomes. This understudied area has been identified as one of the most significant translational research problems. Adding to this challenge is uncertainty regarding the extent to which intervention adaptation and evolution are necessary to address the needs of populations that differ from those in which interventions were originally tested or implemented. This review critically examines and discusses conceptual and methodological issues in studying sustainability, summarizes the multilevel factors that have been found to influence the sustainability of interventions in a range of public health and health care settings, and highlights key areas for future research.
Overview
AI snapshot
Written from the paper’s full text.
TL;DR
This review synthesizes conceptual, methodological, and empirical work on the sustainability of evidence-based interventions (EBIs) in public health and health care, arguing that sustainability is an understudied translational problem and an increasingly dynamic construct that permits adaptation. It proposes an Integrated Sustainability Framework of multilevel factors and lays out a research agenda for measurement, design, and sustainment strategies.
Key findings
- Rates of sustainability are variable and variably reported: in Scheirer's review of 19 health-related programs, 40–60% reported continuing in the community to some extent one to six years after adoption; in Stirman and colleagues' systematic review of 125 empirical studies, partial sustainability was much more common than continued implementation of the entire intervention, and fewer than half of programs continued at high levels of fidelity.
- Measurement and definitional problems are pervasive: 65% of studies in Stirman et al.'s review did not define sustainability, only 45% of the 125 studies measured continued delivery of program components among sites or providers, and only 22% reported information about health behaviors or outcomes.
- Empirical evidence supports dynamic, multilevel influences on sustainability, categorized as outer contextual factors, inner contextual/organizational factors, processes, intervention characteristics, and implementer characteristics (presented in the Integrated Sustainability Framework and Table 1).
- Setting-specific findings include: in a study of 110 Communities That Care sites in Pennsylvania, 90% of coalitions continued after the three-year initial funding period, with 3–8% of sites terminating each year after; in Cooper et al.'s study of 77 EBIs in a statewide youth substance-use and delinquency initiative, sustained programs more often reported stakeholder connection/communication, fit with organizational capacity, program knowledge, communication with the trainer/developer, and sustainability planning; a review of 41 studies across 26 countries in sub-Saharan Africa highlighted community engagement, community resources, and mobilization.
Methods
- Narrative critical review (published in the Annual Review of Public Health symposium on Implementation Science and Public Health), not a primary study; it examines conceptual and methodological issues, summarizes multilevel influencing factors, and identifies future research directions.
- Evidence base is the published sustainability literature across community, health care/social service, low- and middle-income country, and whole-systems settings, including prior systematic reviews (e.g., 125 studies; 19 programs; 41 studies across 26 countries).
- The authors synthesize this literature into an Integrated Sustainability Framework (Figure 1) and a table of emerging factors associated with sustainability across settings (Table 1).
Limitations
- Stated in the paper: the sustainability literature has been naturalistic, descriptive, exploratory, retrospective, and shaped by short-term funding cycles; few studies are guided by conceptual frameworks with clear operational definitions or rigorous outcome measures; follow-up periods are variable; most studies rely on self-report with few independent observations or fidelity assessments; there is no consensus on measures and psychometric properties are unreported for most; most conceptual frameworks have not been empirically tested; and there are gaps regarding which factors are most critical, how they interact, and whether importance differs by context or intervention type.
- Stated in the paper: the underlying evidence base for EBIs often prioritizes internal over external validity, is drawn from well-resourced settings and unrepresentative populations, and reports short-term effectiveness metrics.
- Evident from the text: as a narrative review rather than a systematic review with a stated search strategy, the synthesis is selective and does not report formal quality appraisal or quantitative pooling of the cited studies.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
73 Not checked yet · 16 Own interpretation · 12 No basis given · 6 Partly supported · 1 Supported · accuracy not yet measured
None of the sources cited for this claim have been checked yet.
In the paper
“Whereas the early literature on sustainability focused largely on institutionalization and routinization (e.g., integrating a new set of practices into the routine operations of an organization) (129, 149), there has been recognition over the past 20 years that institutionalization may impede organizations or communities from adopting more effective practices when new evidence emerges (135).”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“Furthermore, discontinuing or abandoning programs in community settings may result in low levels of community support and trust in research and public health/medical institutions (122).”
What the sources say
- Not checked yetcites [122] source
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“In a systematic review of 125 empirical studies focused on the sustainability of public health and clinical interventions (135), researchers found that even when full implementation was originally achieved, partial sustainability was much more common than the continued implementation of the entire intervention.”
What the sources say
- Not checked yetcites [135] source
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Additionally, the metrics of effectiveness that are reported in these contexts are typically short-term.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“However, a challenge in capturing these data and comparing rates has been the variability in how sustainability has been conceptualized, defined, and measured across studies.”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“Initial research considered deviations from the intervention as originally specified in a protocol or manual to be an implementation failure, even when the setting, population, or circumstances differed substantially from those of the initial experimental research that had proved the intervention's effectiveness (3, 9).”
What the sources say
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Whereas significant advancements have been made in understanding the adoption and implementation of EBIs across a range of community and health care settings, less is known about their sustainability.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“Overall, fewer than half of the programs continued at high levels of fidelity.”
What the sources say
- Not checked yetcites [135] source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“Whereas the early literature on sustainability focused largely on institutionalization and routinization (e.g., integrating a new set of practices into the routine operations of an organization) (129, 149), there has been recognition over the past 20 years that institutionalization may impede organizations or communities from adopting more effective practices when new evidence emerges (135).”
What the sources say
- Not checked yetcites [135] source
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“Although numerous evidence-based public health interventions and clinical preventive strategies and treatments are available, it can be challenging to implement and sustain them outside of controlled settings, particularly if they were originally tested in narrow populations or unrepresentative circumstances (49).”
What the sources say
- Not checked yetcites [49] source
plainstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Probably not a substantial claim. 50
- It may state two separate claims as one. 35
- The quote only partly states this claim. 1
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Researchers have often conceptualized sustainability as the final stage in the overall life cycle of an intervention, including development, adoption, implementation (with potential adaptations), and sustainability (14, 31, 52, 110, 115, 118).”
What the sources say
- Not checked yetcites [14] source
- Partly supportedcites [31] sourceExperimental — accuracy not yet measured
The Classical Diffusion Paradigm describes potential adopters progressing through consideration, adoption, implementation, and maintained use; Intervention Adaptation also discusses sustainability following adoption and implementation. These passages support the general sequence, but they do not explicitly establish that researchers have often conceptualized sustainability as the final stage of an intervention’s overall life cycle. (LLM, conf=0.78)
- Not checked yetcites [52] source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Although several studies have applied the PSAT measure or framework (62, 76, 138, 141), it is not evident whether the tool captures all relevant domains, and research is needed to validate the tool across diverse contexts.”
What the sources say
- Supportedcites [62] source
The citation is attached to the statement that studies have applied the PSAT, not to the citing authors’ subsequent concern about whether it captures all relevant domains. The Methods > Measures passage describes this study’s use of the PSAT’s eight subscales and reports their reliability in its samples. (LLM, conf=0.94)
- Partly supportedcites [76] sourceExperimental — accuracy not yet measured
The Introduction identifies the PSAT and says it was tested in public health programs. The Discussion (page unavailable) says testing had been limited to chronic disease programs and calls for research on its utility in other fields, supporting the need for validation across contexts. It does not establish that several studies had applied the tool or explicitly question whether its eight domains capture all relevant domains. (LLM, conf=0.82)
- Supportedcites [138] source
The Abstract Methods section reports that this study administered the PSAT across four program sites, confirming its use as an example of a study applying the tool. The citations in the citing sentence attach to that application claim; the subsequent uncertainty about whether the tool captures all relevant domains is the citing authors’ own assessment. (LLM, conf=0.91)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Whether various phases of the implementation process have different predictors that necessitate distinct conceptual frameworks is unknown (135).”
What the sources say
- Partly supportedcites [135] sourceExperimental — accuracy not yet measured
The Background says factors that facilitate initial implementation may diminish in influence over time, and the Discussion recommends separating initial implementation from the post-implementation phase. The Discussion also says it is not yet known which sustainability models suit differing programs and circumstances. It does not specifically say that whether different implementation phases require distinct conceptual frameworks is unknown. (LLM, conf=0.82)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Some research suggests that adaptation is likely necessary to promote sustainability (7, 8, 23), although other studies suggest that certain types of adaptation decrease the benefits associated with the intervention (68, 128).”
What the sources say
- Partly supportedcites [7] sourceExperimental — accuracy not yet measured
The paper’s sustainability discussion (page not provided) says intervention fit and modifiability are associated with sustainment, and describes adaptation as critical under changing conditions. But it treats the broader claim that adaptations increase sustainability as insufficiently tested; it does not establish that adaptation is generally necessary. (LLM, conf=0.84)
- Not checked yetcites [8] 8. Baumann A, Cabassa L, Wiltsey Stirman S. 2017. Adaptation in dissemination and implementation science. See Ref. 17, pp. 285–300 source
- Supportedcites [23] source
The Abstract (Discussion) proposes ongoing adaptation of interventions to maintain their fit with changing contexts as they are sustained. The Background (Understanding and advancing sustainability research) also describes an adaptation phase in which changes improve integration into ongoing care. These passages support the citing sentence’s hedged claim. (LLM, conf=0.91)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The core domains they identified include environmental support, funding stability, partnerships, organizational capacity, program evaluation, program adaptation, communications, and strategic planning.”
What the sources say
- Partly supportedcites [121] sourceExperimental — accuracy not yet measured
The Results (Concept mapping; Development of capacity for sustainability framework) identify seven of the eight domains listed in the claim. The paper lists nine domains in total: it does not name “environmental support” as a domain, and the claim omits Political Support and Public Health Impacts. No page numbers are available in our copy. (LLM, conf=0.91)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“More work is needed to determine what types of adaptation may specifically enhance sustainability and what types may erode the benefits or delivery of the intervention over time (135, 137).”
What the sources say
- Supportedcites [135] source
In Discussion > Recommendations for advancing the empirical literature (page not available), the paper calls for research on how different types and degrees of adaptation affect health benefits. It also describes refinements that may facilitate continued use and adaptations that may erode an intervention’s core elements and desired outcomes. This supports the claim that more work is needed to distinguish helpful from harmful adaptations over time. (LLM, conf=0.93)
- Supportedcites [137] source
The Discussion calls for investigating how specific modifications affect sustainability and clinical outcomes. It also says that the types of modification that can occur without compromising effectiveness or degrading fidelity have not been sufficiently explored. Together, these passages support the claim that more work is needed to distinguish adaptations that help sustain an intervention from those that erode its benefits or delivery. (LLM, conf=0.90)
plainstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Despite this breadth, there are still gaps, including a dearth of studies focused on understanding the sustainability of interventions for people living with chronic diseases (142).”
What the sources say
- Partly supportedcites [142] sourceExperimental — accuracy not yet measured
The Introduction says many implementation studies examine short-term outcomes rather than long-term sustainability, and the Abstract’s Methods and analysis identifies chronic disease management as the planned review’s focus. But this is a review protocol: it does not establish that studies specifically concerning interventions for people living with chronic diseases are scarce. (LLM, conf=0.84)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Partly supported
None of the sources cited for this claim have been checked yet.
In the paper
“Recently, experts have prioritized sustainability as an understudied area (45), identifying it as “one of the most significant translational research problems of our time” (103, p. 2) and as a persistent challenge across a range of settings and service delivery sectors, and across health behaviors and outcomes.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“It is also worth noting that sustainability, as defined above, is not the only endpoint to consider in the implementation process. As the eligible population changes and the needs of the community change, or more effective or appropriate interventions are identified, the evolution or even replacement of an intervention might be more warranted than sustainment.”
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. It may state two separate claims as one.
In the paper
“This framework challenges scholars in the field to scrutinize their assumptions about which elements are indeed core elements of the intervention and to consider data-driven adaptation and evolution as essential aspects of sustainability (23).”
What the sources say
- Not checked yetcites [23] source
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“However, as noted above, Chambers and colleagues (23) introduced the Dynamic Sustainability Framework (DSF) to address this gap, consistent with recent conceptualizations that move away from thinking about sustainability as the endgame to see it as an ongoing dynamic process (118).”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“In light of these conceptual challenges as well as the relative infancy of the literature on sustainability, little is known about the extent to which EBIs in health care and public health settings are sustained or about whether their impact on health is maintained after the initial implementation.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Rates of sustainability have been variable and variably reported.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“These studies also tend to be conducted in well-resourced settings and unrepresentative populations, making the conditions of implementation also unrepresentative (48).”
What the sources say
- Not checked yetcites [48] source
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For example, as public health programs evolve over time in response to changes in (and input from) the community, the maturation of program staff, and increased skills and refinement in delivery, the sustainability of public health interventions may look different from that of medical interventions, which are highly standardized and may require closer adherence to protocols.”
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. It may state two separate claims as one.
- Rests on an assumption: Medical interventions are highly standardized and may require closer adherence to protocols.
- Rests on an assumption: Public health programs evolve over time in response to changes in and input from the community, the maturation of program staff, and increased skills and refinement in delivery.
None of the sources cited for this claim have been checked yet.
In the paper
“Among those studies that did provide definitions, sustainability was the most commonly used term (116, 122, 135).”
What the sources say
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“The DSF suggests instead that interventions should not be considered optimized until they have been implemented, tested, and refined in the settings in which they will be ultimately delivered.”
What the sources say
- Not checked yetcites [23] source
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“Sustainability has been increasingly conceptualized as a more dynamic construct that allows for adaptation and capacity building in response to new evidence, policies, or other influences (23, 58, 66, 72).”
What the sources say
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Despite a growing interest in research on sustainability, the literature has been highly fragmented across topical areas and disciplines.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“It is important for researchers to consider that sustainability may very well differ across settings and by type of intervention.”
hedgedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
In the paper
“This finding is consistent with a recent review of sustained EBIs in under-resourced settings (60).”
What the sources say
- Not checked yetcites [60] source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“In Stirman and colleagues’ (135) review, 65% of studies did not define sustainability, and many definitions were developed anew by the study's authors.”
What the sources say
- Not checked yetcites [135] source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“For example, very little is known about the nature and influence of processes (training, planning, partnerships, evaluation, engagement) on sustainability.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
In the paper
“Schell and colleagues (121) recently developed a framework to identify the core domains of a public health program's capacity for sustainability.”
What the sources say
- Not checked yetcites [121] source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“In recent years, scholars have developed an overarching multilevel framework of recognized influences on sustainability (118, 122), which includes the categories of intervention characteristics, organizational setting factors, and the broader context/community environment.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“Rather than testing comprehensive frameworks, many studies have examined individual factors or have used qualitative research to identify stakeholder perspectives on sustainability (38, 70, 95).”
What the sources say
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“A number of sustainability frameworks have been developed in recent years (132), with some focusing on intervention characteristics that influence sustainability (107) and others focusing more on contextual influences (2, 58).”
What the sources say
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Such measures, rather than diluting the interventions, may ultimately improve them and increase the likelihood of sustainability.”
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one. The quote only partly states this claim.
None of the sources cited for this claim have been checked yet.
In the paper
“It is important to consider that some adaptations are not deviations from the original effective components of the program and may be beneficial (11, 21, 22, 148).”
What the sources say
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“Few studies have been guided by conceptual frameworks with clear operational definitions or have used rigorous outcome measures of sustainability.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“In Stirman and colleagues’ (135) review, only 45% of the 125 studies measured continued delivery of program components among sites or providers, and only 22% of the studies reported information about health behaviors or outcomes.”
What the sources say
- Not checked yetcites [135] source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“They assert that the factors that influence the initial adoption of EBIs may differ from those that influence sustainability (115, 122), and that different factors might be more influential at different time points (2).”
hedgedstates a possible cause- Asserted: fails — The authors may not put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The authors may not put it forward as true. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“These categories are similar to those identified in existing implementation frameworks (2, 30) and are fairly consistent with Stirman's classifications (innovation characteristics, context, capacity, processes), as well as with factors hypothesized to influence sustainment in the EPIS model (135).”
What the sources say
hedgedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“What is currently known, though, is that although high fidelity has been associated with positive program outcomes (34), adaptation is fairly common (3, 86, 125, 150) and often necessary.”
What the sources say
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“Some have suggested that an intervention should remain recognizable to be considered sustained (135).”
What the sources say
- Not checked yetcites [135] source
hedged- Asserted: fails — The authors may not put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The authors may not put it forward as true. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For example, some elements may be necessary for some populations but not others.”
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Rests on an assumption: Some intervention elements may be necessary for some populations but not others.
In the paper
“They assert that the factors that influence the initial adoption of EBIs may differ from those that influence sustainability (115, 122), and that different factors might be more influential at different time points (2).”
What the sources say
- Not checked yetcites [2] source
hedgedstates a possible cause- Asserted: fails — The authors may not put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The authors may not put it forward as true. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“Some research suggests that adaptation is likely necessary to promote sustainability (7, 8, 23), although other studies suggest that certain types of adaptation decrease the benefits associated with the intervention (68, 128).”
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“What is currently known, though, is that although high fidelity has been associated with positive program outcomes (34), adaptation is fairly common (3, 86, 125, 150) and often necessary.”
What the sources say
- Not checked yetcites [34] source
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“One review found that most of the empirical research on sustainability has focused on multicomponent interventions across diverse fields and topics, with about one-third of the programs focused on health care interventions, one-third on behavioral and mental health interventions, and one-third on health promotion interventions (135).”
What the sources say
- Not checked yetcites [135] source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Although more research is needed, research to date suggests that additional factors to consider include synchronization between local, regional, and state policies; potential conflicting stakeholder interests; and the potential need for adaptation, given that homogenous implementation is difficult across systems.”
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: Homogenous implementation is difficult across systems.
In the paper
“Scheirer (117) proposed that one size does not fit all with interventions, and that sustainability research and planning might differ based on intervention structure (e.g., what the interventions are and how they are implemented).”
What the sources say
- Not checked yetcites [117] source
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
In the paper
“Scheirer proposed six types of interventions or programs distinguished by their structure, namely (a) interventions implemented by individual providers; (b) interventions requiring coordination among multiple staff; (c) new policies, procedures, and technologies; (d) capacity or infrastructure building; (e) collaborative partnerships or coalitions; and (f) broad-scale system change.”
What the sources say
- Not checked yetcites [117] source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“In terms of measuring multilevel factors related to the sustainability of community-based health interventions, Mancini & Marek (80) introduced the Program Sustainability Index; although this framework is promising, more work is needed in establishing its validity.”
What the sources say
- Not checked yetcites [80] source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“Such studies indicate the importance of strategic partnerships (89, 112) and the impact of the broader social context and of health system weaknesses (15, 63) as important influences on sustainability.”
What the sources say
hedgedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“To date, the empirical literature suggests the existence of important categories of factors that influence sustainability across settings and are dynamically related. They are outer contextual factors (e.g., sociopolitical context, funding environment), inner contextual or organizational factors (e.g., financial resources, leadership, program champions, organizational support, staff stability, po”
What the sources say
hedgedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“Other examples include the British National Health Service Sustainability Index, a 10-item measure of an organization's likelihood to sustain practices (78), the Program Sustainability Assessment Tool (76, 138), and the Sustained Implementation Support Scale, a scale that measures factors that affect the implementation process among practitioners (61).”
What the sources say
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“A study of 110 CTC sites in Pennsylvania found that 90% of coalitions continued after the three-year initial funding period, with 3–8% of sites terminating each year after (36).”
What the sources say
- Not checked yetcites [36] source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“In recent years, sustainability outcomes have been conceptualized as (118, 119, 135) (a) continuing or improving health benefits or outcomes for patients/consumers at the individual level; (b) maintaining community-level partnerships or coalitions and community capacity for collaboration; (c) maintaining organizational practices, procedures, and policies started during implementation (institutiona”
What the sources say
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“As the discussion of fidelity and adaptation above suggests, there has also been debate about how to measure the core components of a program, particularly when applied to varied contexts and populations (22).”
What the sources say
- Not checked yetcites [22] source
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Recent research suggests that multiple aspects of sustainability may require different data sources and levels of analysis, and sustainability outcome indicators may vary (120).”
What the sources say
- Not checked yetcites [120] source
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Time periods for follow-up have been variable (due in part to funding constraints, and because the health issues/behaviors studied are variable), and most studies have used self-report, with very few studies using independent observation and/or fidelity assessments.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“Prospective, multilevel, and mixed-methods study designs are ideal for studying sustainability (94, 98).”
What the sources say
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“Additional proposed sustainability outcomes include documentation of the extent to which the interventions continue to be implemented (135), adaptation of intervention components (135), sustained attention to an issue or problem (media, public, policy agendas) (118), and program diffusion and replication in other sites (118).”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“There is a growing body of literature documenting the efficacy of implementation strategies through randomized controlled trials, which have shown impacts on implementation outcomes like adoption and fidelity; however, few studies have examined their effects on sustainability (101, 102).”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“3. Sustainability is increasingly conceptualized as a dynamic construct that allows for adaptation in response to new or changing populations, evidence, policies, or other contextual influences.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“1. Sustainability is critical to address, as it is a persistent challenge across a range of public health and health care settings, service delivery sectors, and health behaviors and outcomes.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“2. There have been methodological and conceptual limitations in measuring sustainability and determining both how much of the original intervention must be in place for it to be considered sustained, and what types and how much adaptation is necessary and appropriate in real-world settings that may include new populations and contexts.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“5. Recommended sustainability outcomes include continuation of program components, capacity building, and continued health benefits or outcomes.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“9. Conceptual and methodological guidance and agendas for conducting sustainability research have been introduced in recent years, providing an opportunity for this rapidly evolving field to coalesce with the next generation of research.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Different terms are used that mean similar concepts, and there are discrepancies in terms of which factor fits under which category within different conceptual frameworks.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“7. As illustrated in the Integrated Sustainability Framework, empirical literature suggests the existence of dynamic interactions among outer contextual factors, inner contextual or organizational factors, processes, intervention characteristics, and implementer characteristics; these appear to be important categories of factors influencing sustainability across settings.”
hedgedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Sustainability research is a rapidly evolving area within implementation science.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“4. Contextual factors such as differences in population, service structures, and sociopolitical context can influence the ways in which interventions evolve after implementation and are sustained across time in real-world settings, particularly if interventions were originally tested among narrow populations or under unrepresentative circumstances.”
plainstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“A particularly important issue to address is the tension between the long-term sustainability of the program (and associated expectations of fidelity to its original form) and adaptation.”
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
The paper relies on this without support.
Medical interventions are highly standardized and may require closer adherence to protocols.
“which are highly standardized and may require closer adherence to protocols.”
The paper relies on this without support.
Public health programs evolve over time in response to changes in and input from the community, the maturation of program staff, and increased skills and refinement in delivery.
“as public health programs evolve over time in response to changes in (and input from) the community, the maturation of program staff, and increased skills and refinement in delivery”
The paper relies on this without support.
Some intervention elements may be necessary for some populations but not others.
“For example, some elements may be necessary for some populations but not others.”
The paper relies on this without support.
Homogenous implementation is difficult across systems.
“given that homogenous implementation is difficult across systems.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The Exploration, Preparation, Implementation, and Sustainment (EPIS) model of implementation [50] and the Integrated Sustainability Framework [16] have recognized inner (e.g., inter-organizational support and champions, adequate staff) and outer (e.g., socio-political context and funding environment) contextual factors predictive of successful initial and continued program implementation.”
From Using qualitative comparative analysis to uncover multiple pathways to program sustainment: implications for community-based youth substance misuse prevention (2022) · cites this paper as [16]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These findings align with existing implementation and sustainment frameworks.”
From Using qualitative comparative analysis to uncover multiple pathways to program sustainment: implications for community-based youth substance misuse prevention (2022) · cites this paper as [16]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This work will aid in the development of interventions and strategies that respond to identified gaps based on these measures, which will serve to further advance sustainability of evidence informed programs and practices [1].”
From Lowering the burden: Shorter versions of the Program Sustainability Assessment Tool (PSAT) and Clinical Sustainability Assessment Tool (CSAT) (2024) · cites this paper as [1]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“This assessment responds to the need for reliable measures within implementation science, specifically in the area of sustainability research (1, 32, 33).”
From Assessing the sustainability capacity of evidence-based programs in community and health settings (2022) · cites this paper as [1]
The cited source says what the claim attributes to it.
In the citing paper
“Despite an increase in the number of studies focusing on program sustainment, there remains a relative dearth of empirical evidence on the combinations of factors associated with sustainment [15, 16, 59], especially those guided by established sustainment frameworks and measurement tools [23].”
The cited source says what the claim attributes to it.
In the citing paper
“While methodological advances have been made within the area, reviews have still highlighted an need to develop psychometrically tested measures to assess sustainability and sustainment [1].”
From Lowering the burden: Shorter versions of the Program Sustainability Assessment Tool (PSAT) and Clinical Sustainability Assessment Tool (CSAT) (2024) · cites this paper as [1]
In the citing paper
“Team 1 has been sustained since 2017 and Team 2 since 2018, longer than the 2 years suggested as a minimum for defining a sustained program [47, 56]”
From Factors influencing sustainability and scale-up of rural primary healthcare memory clinics: perspectives of clinic team members (2022) · cites this paper as [56]
Citations
Cites
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496
Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0319-7 · Cited by 8,721
Crossing the Quality Chasm: A New Health System for the 21st Century
Committee on Quality of Health Care in America (2002) · Journal for Healthcare Quality · doi:10.1111/j.1945-1474.2002.tb00463.x · Cited by 8,508
Evaluating the public health impact of health promotion interventions: the RE-AIM framework.
Glasgow, R. E., Vogt, T. M., & Boles, S. M. (1999) · American Journal of Public Health · doi:10.2105/ajph.89.9.1322 · Cited by 7,217
Durlak, J. A., & DuPre, E. P. (2008) · American Journal of Community Psychology · doi:10.1007/s10464-008-9165-0 · Cited by 5,304
Powell, B. J., Waltz, T. J., Chinman, M. J., Damschroder, L. J., Smith, J. L., Matthieu, M. M., Proctor, E. K., & Kirchner, J. E. (2015) · Implementation Science · doi:10.1186/s13012-015-0209-1 · Cited by 4,963
Curran, G. M., Bauer, M., Mittman, B., Pyne, J. M., & Stetler, C. (2012) · Medical Care · doi:10.1097/mlr.0b013e3182408812 · Cited by 4,058
Gluesing, J. C. (2012) · Sage eBooks · doi:10.4135/9781412994231.n14 · Cited by 3,264
Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors
Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0327-7 · Cited by 3,240
Bellg, A. J., Treatment Fidelity Workgroup of the NIH Behavior Change Consortium, Borrelli, B., Resnick, B., Hecht, J., Minicucci, D. S., Ory, M., Ogedegbe, G., Orwig, D., Ernst, D., et al. (2004) · Health Psychology · doi:10.1037/0278-6133.23.5.443 · Cited by 2,620
Research works printed but not linked: 4
- 55. Green LW, Kreuter MW. 2005. Health Program Planning: An Educational and Ecological Approach . New York: McGraw-Hill Co.
- 85. Minkler M, Wallerstein N. 2011. Community-Based Participatory Research for Health: From Process to Outcomes . New York: Wiley
- Moore JE, 2016, Healthc. Policy, 11, 27
- Stirman SW, Optimizing the Cancer Control Continuum: Advancing Implementation Research, 2018
Cited by
Sorted by citations
Items 101–200 of 823
Making the connection between health equity and sustainability
Shelton, R. C., Hailemariam, M., & Iwelunmor, J. (2023) · Frontiers in Public Health · doi:10.3389/fpubh.2023.1226175 · Cited by 33
Self-citationMehta, T. G., Mahoney, J., Leppin, A. L., Stevens, K. R., Nooraie, R. Y., Pollock, B. H., Shelton, R. C., Dolor, R. J., Pincus, H. A., Patel, S., et al. (2021) · Journal of Clinical and Translational Science · doi:10.1017/cts.2021.815 · Cited by 30
Self-citationUnderstanding the sustainment of population health programmes from a whole-of-system approach
Crane, M. A., Nathan, N., McKay, H. A., Lee, K., Wiggers, J., & Bauman, A. E. (2022) · Health Research Policy and Systems · doi:10.1186/s12961-022-00843-0 · Cited by 35
Fathi, L. I., Walker, J. L., Dix, C. F., Cartwright, J. R., Joubert, S., Carmichael, K. A., Huang, Y.-S., Littlewood, R., & Truby, H. (2023) · Public Health Nutrition · doi:10.1017/s1368980023001647 · Cited by 30
Embracing Change: A Mindful Medical Center Meets COVID-19
Klatt, M. D., Bawa, R., Gabram, O., Blake, A., Steinberg, B. A., Westrick, A., & Holliday, S. A. (2020) · Global Advances in Health and Medicine · doi:10.1177/2164956120975369 · Cited by 30
Jennings, P. A. (2023) · Mindfulness · doi:10.1007/s12671-022-02062-8 · Cited by 30
Iwelunmor, J., Ezechi, O., Obiezu‐Umeh, C., Gbaja-Biamila, T. A., Musa, A. Z., Oladele, D. A., Idigbe, I. E., Ohihoin, A. G., Gyamfi, J., Aifah, A. A., et al. (2019) · PLoS ONE · doi:10.1371/journal.pone.0217703 · Cited by 29
King, K. M., Pullmann, M. D., Lyon, A. R., Dorsey, S., & Lewis, C. C. (2019) · Journal of Abnormal Psychology · doi:10.1037/abn0000417 · Cited by 36
Larson, E., Mbaruku, G. M., Cohen, J., & Kruk, M. E. (2019) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzz126 · Cited by 28
Layla’s Got You : Developing a tailored contraception chatbot for Black and Hispanic young women
Bonnevie, E., Lloyd, T. D., Rosenberg, S. D., Williams, K., Goldbarg, J., & Smyser, J. (2020) · Health Education Journal · doi:10.1177/0017896920981122 · Cited by 28
Critical success factors for high routine immunization performance: A case study of Senegal
Sakas, Z., Hester, K. A., Rodriguez, K., Diatta, S. A., Ellis, A. S., Gueye, D. M., Mapatano, D., Mboup, S., Ogutu, E. A., Yang, C., et al. (2023) · Vaccine X · doi:10.1016/j.jvacx.2023.100296 · Cited by 28
Dopp, A. R., Hunter, S. B., Godley, M. D., Pham, C., Han, B., Smart, R., Cantor, J., Kilmer, B., Hindmarch, G., González, I. E., et al. (2022) · Implementation Science Communications · doi:10.1186/s43058-022-00298-y · Cited by 28
Kyambade, M., Mwesigwa, R., Alinda, K., Tumwine, S., & Lwanga, F. (2025) · Social Sciences & Humanities Open · doi:10.1016/j.ssaho.2025.102046 · Cited by 28
Flynn, R., Mrklas, K., Campbell, A., Wasylak, T., & Scott, S. D. (2021) · BMC Health Services Research · doi:10.1186/s12913-021-07214-5 · Cited by 29
Gagliardi, C., Piccinini, F., Lamura, G., Casanova, G., Fabbietti, P., & Socci, M. (2022) · Sustainability · doi:10.3390/su14063375 · Cited by 27
Thompson-Brenner, H., Singh, S., Gardner, T., Brooks, G. E., Smith, M. T., Lowe, M. R., & Boswell, J. F. (2021) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2021.641601 · Cited by 26
“, adoption, initial implementation) (54, 55), sustainability can be defined as the consistent usage of key program components demonstrating continued achievement of intended outcomes over an extended period of time (56, 57).”
BackgroundCurtis, K. A., Kennedy, B., Considine, J., Murphy, M., Lam, M. K., Aggar, C., Fry, M., Shaban, R. Z., & Kourouche, S. (2024) · Implementation Science · doi:10.1186/s13012-024-01383-7 · Cited by 26
Márquez, D. X., Wilbur, J., Hughes, S. L., Wilson, R. S., Büchner, D. M., Berbaum, M. L., McAuley, E., Aguiñaga, S., Balbim, G. M., Vásquez, P. M., et al. (2022) · Annals of Behavioral Medicine · doi:10.1093/abm/kaac009 · Cited by 26
Nwaozuru, U., Murphy, P., Richard, A., Obiezu‐Umeh, C., Shato, T., Obionu, I. M., Gbaja-Biamila, T. A., Oladele, D. A., Mason, S., Takenaka, B. P., et al. (2025) · Implementation Science Communications · doi:10.1186/s43058-025-00716-x · Cited by 28
Fort, M. P., Paniagua-Ávila, A., Beratarrechea, A. G., Cardona, S., Figueroa, J. C., Martínez-Folgar, K., Moyano, D. L., Barrios, E., Mazariegos, B. E., Palacios, E., et al. (2019) · Global Heart · doi:10.1016/j.gheart.2019.05.005 · Cited by 25
Arnold, K. T., Porter, K. M. P., Frattaroli, S., Durham, R. E., Clary, L. K., & Mendelson, T. (2021) · School Mental Health · doi:10.1007/s12310-020-09402-w · Cited by 33
Grüne, E., Popp, J., Carl, J., Semrau, J., & Pfeifer, K. (2022) · BMC Public Health · doi:10.1186/s12889-022-13133-9 · Cited by 25
Using Feedback to Improve Accountability in Global Environmental Health and Engineering
Thomas, E., & Brown, J. M. (2020) · Environmental Science & Technology · doi:10.1021/acs.est.0c04115 · Cited by 24
Specifying and reporting implementation strategies used in a school-based prevention efficacy trial
Moore, S. A., Arnold, K. T., Beidas, R. S., & Mendelson, T. (2021) · Implementation Research and Practice · doi:10.1177/26334895211047841 · Cited by 24
Donessouné, F. M. G., Sossa, G. O., & Kouanda, S. (2023) · BMC Health Services Research · doi:10.1186/s12913-023-09320-y · Cited by 24
Seshadri, S., Felsen, C. B., Sellers, C. R., & Dumyati, G. K. (2020) · Infection Control and Hospital Epidemiology · doi:10.1017/ice.2020.1217 · Cited by 23
STOCKER, S. L., Carland, J. E., Reuter, S. E., Stacy, A. E., Schaffer, A. L., Stefani, M., Lau, C., Kirubakaran, R., Yang, J. J., Shen, C. F. J., et al. (2020) · Clinical Pharmacology & Therapeutics · doi:10.1002/cpt.2113 · Cited by 23
Closing the gap: advancing implementation science through training and capacity building
Brownson, R. C., Cabassa, L. J., Drake, B. F., & Shelton, R. C. (2024) · Implementation Science · doi:10.1186/s13012-024-01371-x · Cited by 23
Self-citationAssessing the sustainability capacity of evidence-based programs in community and health settings
Bacon, C., Malone, S., Prewitt, K., Hackett, R., Hastings, M., Dexter, S., & Luke, D. A. (2022) · Frontiers in Health Services · doi:10.3389/frhs.2022.1004167 · Cited by 22
Primary Care–Based Digital Health–Enabled Stroke Management Intervention
Tan, J., Gong, E., Gallis, J. A., Sun, S., Chen, X., Turner, E. L., Luo, S., Duan, J., Li, Z., Wang, Y., et al. (2024) · JAMA Network Open · doi:10.1001/jamanetworkopen.2024.49561 · Cited by 23
Moucheraud, C., Sarma, H., Hà, T. T. T., Ahmed, T., Epstein, A., Glenn, J. D., Hanh, H. H., Huong, T. T., Luies, S. K., Moitry, A. N., et al. (2020) · BMC Public Health · doi:10.1186/s12889-020-09438-2 · Cited by 24
Minogue, V., Matvienko‐Sikar, K., Hayes, C. B., Morrissey, M., Gorman, G., & Terrés, A. (2021) · Health Research Policy and Systems · doi:10.1186/s12961-021-00747-5 · Cited by 23
Hughes, J. M., Zullig, L. L., Choate, A., Decosimo, K. P., Wang, V., Houtven, C. H. V., Allen, K. D., & Hastings, S. N. (2022) · The Gerontologist · doi:10.1093/geront/gnac130 · Cited by 23
Koning, I. M., Kock, C. D., van der Kreeft, P., Percy, A., Sanchez, Z. M., & Burkhart, G. (2020) · Drugs Education Prevention and Policy · doi:10.1080/09687637.2020.1863916 · Cited by 22
Hunter, S. B., Felician, M., Dopp, A. R., Godley, S. H., Pham, C., Bouskill, K., Slaughter, M. E., & Garner, B. R. (2020) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2020.107999 · Cited by 21
Jackson, C. B., Herschell, A. D., Scudder, A. T., Hart, J., Schaffner, K. F., Kolko, D. J., & Mrozowski, S. J. (2021) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-021-01126-6 · Cited by 21
Conroy, M. A., Sutherland, K. S., Granger, K. L., Marcoulides, K. M., Huang, K., & Montesion, A. (2021) · Journal of Early Intervention · doi:10.1177/10538151211018662 · Cited by 21
Walker, A. E., Wattick, R. A., & Olfert, M. D. (2021) · Current Developments in Nutrition · doi:10.1093/cdn/nzab105 · Cited by 21
Sustained effects of the INFORM cluster randomized trial: an observational post-intervention study
Hoben, M., Ginsburg, L. R., Norton, P., Doupe, M. B., Berta, W. B., Dearing, J. W., Keefe, J. M., & Estabrooks, C. A. (2021) · Implementation Science · doi:10.1186/s13012-021-01151-x · Cited by 23
Measurement Properties for a Scale Assessing Self-Regulation in Parents and Parenting Practitioners
Tellegen, C. L., Ma, T., Day, J. J., Hodges, J., Panahi, B., Mazzucchelli, T. G., & Sanders, M. R. (2022) · Journal of Child and Family Studies · doi:10.1007/s10826-022-02307-z · Cited by 21
Stahmer, A. C., Suhrheinrich, J., Rieth, S. R., Roesch, S., Vejnoska, S., Chan, J., Nahmias, A. S., & Wang, T. (2022) · Focus on Autism and Other Developmental Disabilities · doi:10.1177/10883576221133486 · Cited by 21
Leveraging Implementation Science in Human-Centred Design for Digital Health
Waddell, A., Seguin, J. P., Wu, L., Stragalinos, P., Wherton, J. P., Watterson, J., Prawira, C. O., Olivier, P. L., Manning, V., Lubman, D. I., et al. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642161 · Cited by 30
Helseth, S. A., Peer, S. O., Are, F. G., Korell, A. M., Saunders, B. E., Schoenwald, S. K., Chapman, J. E., & Hanson, R. F. (2020) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-020-01024-3 · Cited by 21
Veldman, S. L. C., Jones, R. A., Stanley, R. M., Cliff, D. P., Vella, S. A., Howard, S. J., Parrish, A., & Okely, A. D. (2020) · Journal of Physical Activity and Health · doi:10.1123/jpah.2019-0381 · Cited by 21
Padek, M. M., Mazzucca, S., Allen, P. M., Weno, E. R., Tsai, E., Luke, D. A., & Brownson, R. C. (2021) · BMC Public Health · doi:10.1186/s12889-020-10101-z · Cited by 23
Agulnik, A., Malone, S., Puerto-Torres, M., Gonzalez-Ruiz, A., Vedaraju, Y., Wang, H., Graetz, D., Prewitt, K., Villegas, C., Cardenas-Aguierre, A., et al. (2021) · BMJ Open · doi:10.1136/bmjopen-2021-053116 · Cited by 20
Hall, A., Shoesmith, A., Shelton, R. C., Lane, C., Wolfenden, L., & Nathan, N. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph182111414 · Cited by 20
Self-citationMorgan, D., Kosteniuk, J., O’Connell, M. E., Seitz, D., Elliot, V., Bayly, M., Chow, A. F., & Cameron, C. (2022) · BMC Health Services Research · doi:10.1186/s12913-022-07550-0 · Cited by 20
White, S. W., Conner, C. M., Beck, K. B., & Mazefsky, C. A. (2021) · Evidence-Based Practice in Child and Adolescent Mental Health · doi:10.1080/23794925.2020.1796551 · Cited by 20
Yue, F., Wang, S.-J., Du, Y., Sun, F.-Y., Wang, Y., & Guo, Y. (2024) · Journal of Nursing Management · doi:10.1155/2024/6828123 · Cited by 23
MacDonald, J. R., Doyle, L. A., Moore, J. L., & Rafferty, M. R. (2021) · Implementation Science Communications · doi:10.1186/s43058-021-00205-x · Cited by 20
Dopp, A. R., Gilbert, M., Silovsky, J. F., Ringel, J. S., Schmidt, S. R., Funderburk, B. W., Jorgensen, A. G., Powell, B. J., Luke, D. A., Mandell, D. S., et al. (2022) · Implementation Science Communications · doi:10.1186/s43058-021-00234-6 · Cited by 20
Modification of the Individual Placement and Support Model of Supported Employment
Drake, R. E., Bond, G. R., & Mascayano, F. (2023) · Psychiatric Services · doi:10.1176/appi.ps.20220484 · Cited by 20
Li, W. W., McIntyre, R., Reid, C., & Chao, M. (2024) · Mindfulness · doi:10.1007/s12671-024-02440-4 · Cited by 20
Perspectives on program mis-implementation among U.S. local public health departments
Allen, P. M., Jacob, R. R., Parks, R. G., Mazzucca, S., Hu, H., Robinson, M. V., Dobbins, M., Dekker, D. K., Padek, M. M., & Brownson, R. C. (2020) · BMC Health Services Research · doi:10.1186/s12913-020-05141-5 · Cited by 20
Sustainability of an interprofessional collaborative practice model for population health
Shirey, M. R., Selleck, C. S., White-Williams, C., Talley, M., & Harper, D. C. (2020) · Nursing Administration Quarterly · doi:10.1097/naq.0000000000000429 · Cited by 19
Medication self-management interventions for persons with stroke: A scoping review
Cadel, L., Cimino, S. R., Bradley-Ridout, G., Hitzig, S. L., Patel, T., Ho, C., Packer, T. L., Lofters, A., Hahn‐Goldberg, S., McCarthy, L. M., et al. (2023) · PLoS ONE · doi:10.1371/journal.pone.0285483 · Cited by 19
Moller, N., Tellegen, C. L., Ma, T., & Sanders, M. R. (2024) · School Mental Health · doi:10.1007/s12310-023-09629-3 · Cited by 19
Jain, H. (2024) · World sustainability series · doi:10.1007/978-3-031-60545-1_7 · Cited by 19
Haroz, E. E., Ingalls, A., Wadlin, J., Kee, C., Begay, M., Neault, N. B., & Barlow, A. (2020) · Journal of Community Psychology · doi:10.1002/jcop.22281 · Cited by 19
Bottorff, J. L., Huisken, A., Hopkins, M., & Nesmith, C. (2020) · BMC Public Health · doi:10.1186/s12889-020-09737-8 · Cited by 19
Yoong, S. L., Pearson, N., Reilly, K., Wolfenden, L., Jones, J. Z., Nathan, N., Okely, A. D., Naylor, P., Jackson, J. K., Giles, L., et al. (2022) · BMC Public Health · doi:10.1186/s12889-022-12883-w · Cited by 19
Expanding access to medications for opioid use disorder through locally-initiated implementation
Wyse, J. J. B., Mackey, K., Lovejoy, T. I., Kansagara, D. L., Tuepker, A., Gordon, A. J., Korthuis, P. T., Herreid-O’Neill, A., Williams, B. E., & Morasco, B. J. (2022) · Addiction Science & Clinical Practice · doi:10.1186/s13722-022-00312-7 · Cited by 19
Madrigal, C. B., Mills, W. L., Keleher, V., Pimentel, C. B., Hartmann, C. W., Snow, A. L., Camp, C. J., & Hilgeman, M. M. (2022) · The Gerontologist · doi:10.1093/geront/gnac133 · Cited by 21
Hirt, J., Vetsch, J., Weissenfels, I., & Heinrich, S. (2024) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2024.104756 · Cited by 21
Drivers of continued implementation of cultural competence in substance use disorder treatment
Guerrero, E. G., Khachikian, T., Frimpong, J. A., Kong, Y., Howard, D. L., & Hunter, S. B. (2019) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2019.07.009 · Cited by 20
Ametaj, A., Smith, A. M., & Valentine, S. E. (2021) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-021-01129-3 · Cited by 21
Barnett, M. L., Brookman-Frazee, L. I., Yu, S. H., Lind, T., Lui, J. H. L., Timmer, S. G., Boys, D. K., Urquiza, A. J., Innes-Gomberg, D., Quick-Abdullah, D., et al. (2021) · Evidence-Based Practice in Child and Adolescent Mental Health · doi:10.1080/23794925.2020.1855613 · Cited by 23
Ford, J. H., Stumbo, S. P., & Robinson, J. M. (2018) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2018.06.012 · Cited by 18
Azizatunnisa’, L., Cintyamena, U., Mahendradhata, Y., & Ahmad, R. A. (2021) · BMC Public Health · doi:10.1186/s12889-021-11642-7 · Cited by 18
Smith, J. D., Fu, E. S., Rado, J. T., Rosenthal, L. J., Carroll, A. J., Atlas, J. A., Carlo, A. D., Burnett‐Zeigler, I., Jordan, N., Brown, C. H., et al. (2021) · Contemporary Clinical Trials Communications · doi:10.1016/j.conctc.2021.100823 · Cited by 18
Zetterlund, J., Schwarz, U. V. T., Hasson, H., & Neher, M. (2022) · Frontiers in Health Services · doi:10.3389/frhs.2022.883072 · Cited by 20
Ångerman, S., Kirves, H., & Nurmi, J. O. (2023) · Scandinavian Journal of Trauma Resuscitation and Emergency Medicine · doi:10.1186/s13049-023-01086-w · Cited by 18
Wolfenden, L., Shoesmith, A., Hall, A. E., Bauman, A. E., & Nathan, N. (2024) · Implementation Science Communications · doi:10.1186/s43058-024-00555-2 · Cited by 19
Malone, S. M., Firnhaber, J., O’Hagan, A. D., O’Keeffe, S., McNamara, J. G., & O’Connor, S. (2024) · Journal of Rural Studies · doi:10.1016/j.jrurstud.2024.103508 · Cited by 18
Abamecha, F., Midaksa, G., Sudhakar, M., Abebe, L., Kebede, Y., Alemayehu, G., & Birhanu, Z. (2021) · BMC Public Health · doi:10.1186/s12889-021-11216-7 · Cited by 20
Bello‐Manga, H., Haliru, L., Tabari, A. M., Farouk, B. U., Suleiman, A., Bahago, G. Y., Sani, A. M., Baumann, A. A., DeBaun, M. R., & King, A. A. (2022) · BMC Research Notes · doi:10.1186/s13104-021-05885-1 · Cited by 18
Frech, S., Doherty, R. M., Duque, M., Ramírez, Ó., Pomata, A., Samudio, A., Antwi, O.-A., Htun, Y. Y., Mra, R., Htoon, P. T., et al. (2021) · JCO Global Oncology · doi:10.1200/go.20.00606 · Cited by 18
Gelman, R., Whelan, J., Spiteri, S., Duric, D., Oakhill, W., Cassar, S., & Love, P. (2023) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-023-01433-1 · Cited by 17
Hoste, M. E., Borek, A., Santillo, M., Roberts, N. W., Tonkin-Crine, S. K., & Anthierens, S. (2024) · Journal of Antimicrobial Chemotherapy · doi:10.1093/jac/dkae349 · Cited by 17
Borst, R. A. J., Wehrens, R., Bal, R. A., & Kok, M. O. (2022) · Social Science & Medicine · doi:10.1016/j.socscimed.2022.114735 · Cited by 18
A typology of social procurement champions in the construction and engineering industry
Loosemore, M., Keast, R. L., & Barraket, J. (2022) · Construction Management and Economics · doi:10.1080/01446193.2022.2043554 · Cited by 17
Yue, J., Liu, J., Zhao, Y., Williams, S., Zhang, B., Zhang, L., Zhang, Q., Liu, X., Wall, S. N., & Zhao, G. (2022) · BMC Health Services Research · doi:10.1186/s12913-022-07493-6 · Cited by 17
Local Adaptations to Implement the Strengthening Families Program in Northeastern Brazil
de Menezes, J. C. L., Nobre-Sandoval, L. D. A., & Murta, S. G. (2020) · International Journal of Mental Health and Addiction · doi:10.1007/s11469-019-00196-w · Cited by 16
Kolko, D. J., McGuier, E. A., Turchi, R. M., Thompson, E., Iyengar, S., Smith, S. N., Hoagwood, K., Liebrecht, C., Bennett, I. M., Powell, B. J., et al. (2022) · Implementation Science · doi:10.1186/s13012-022-01195-7 · Cited by 16
Engelhart, A., Mason, S., Nwaozuru, U., Obiezu‐Umeh, C., Carter, V., Shato, T., Gbaja-Biamila, T. A., Oladele, D. A., & Iwelunmor, J. (2022) · Frontiers in Health Services · doi:10.3389/frhs.2022.889390 · Cited by 20
Niang, M., Alami, H., Gagnon, M., & Dupéré, S. (2023) · Global Health Action · doi:10.1080/16549716.2023.2230813 · Cited by 21
Veroniki, A. A., Soobiah, C., Nincic, V., Lai, Y., Rios, P. D. L., MacDonald, H. R., Khan, P. A., Ghassemi, M., Yazdi, F., Brownson, R. C., et al. (2023) · BMC Medicine · doi:10.1186/s12916-023-02966-9 · Cited by 16
Kepper, M. M., L’Hotta, A. J., Shato, T., Kwan, B. M., Glasgow, R. E., Luke, D. A., Graham, A. K., Baumann, A. A., Brownson, R. C., & Morse, B. (2024) · Implementation Science · doi:10.1186/s13012-024-01410-7 · Cited by 17
Acosta, J., Chinman, M., Ebener, P. A., Malone, P. S., Cannon, J. S., & D’Amico, E. J. (2020) · Prevention Science · doi:10.1007/s11121-020-01118-2 · Cited by 17
Sullivan, J. L., Kim, B., Miller, C. J., Elwy, A. R., Drummond, K. L., Connolly, S. L., Riendeau, R. P., & Bauer, M. S. (2021) · Implementation Science Communications · doi:10.1186/s43058-021-00133-w · Cited by 16
Desselle, S. P., Moczygemba, L. R., Coe, A. B., Hess, K. M., & Zgarrick, D. P. (2019) · Pharmacy · doi:10.3390/pharmacy7030099 · Cited by 16
Popowich, A. D., Mushquash, A. R., Pearson, E., Schmidt, F., & Mushquash, C. J. (2020) · Counselling and Psychotherapy Research · doi:10.1002/capr.12250 · Cited by 15
Perialathan, K., Johari, M. Z., Jaafar, N., Lin, K. Y., Lan, L. L., Sodri, N. A., & Yunus, S. N. N. M. (2021) · Journal of Primary Care & Community Health · doi:10.1177/21501327211014096 · Cited by 15
Wickremasinghe, D., Hamza, Y. A., Umar, N., Willey, B., Okolo, M., Gana, A., Shuaibu, A., Anyanti, J., Marchant, T., & Spicer, N. (2021) · Health Policy and Planning · doi:10.1093/heapol/czab063 · Cited by 15
Evidence-based study of the impacts of maintenance practices on asset sustainability
Ghaleb, M. A., & Taghipour, S. (2022) · International Journal of Production Research · doi:10.1080/00207543.2022.2152893 · Cited by 15
Abamecha, F., Midaksa, G., Sudhakar, M. N., Abebe, L. G., Kebede, Y., Mamo, A., Alemayehu, G., & Birhanu, Z. (2021) · BMC Public Health · doi:10.1186/s12889-021-11995-z · Cited by 15
Szefler, S. J., Cicutto, L. C., Brewer, S. E., Gleason, M. C., McFarlane, A. E., DeCamp, L. R., Brinton, J. T., & Huebschmann, A. G. (2022) · Journal of Allergy and Clinical Immunology · doi:10.1016/j.jaci.2022.04.029 · Cited by 15
Ramanadhan, S., Daly, J. J., Lee, R. M., Kruse, G. R., & Deutsch, C. (2020) · Frontiers in Public Health · doi:10.3389/fpubh.2020.00213 · Cited by 15
Roadmap for implementing a multi-tiered system of supports framework to improve school attendance.
Graczyk, P. A., & Kearney, C. A. (2024) · Current Psychology · doi:10.1007/s12144-023-05478-0 · Cited by 14
Metadata
- Authors
- Shelton, R. C., Cooper, B. R., & Stirman, S. W.
- Affiliations
- Columbia University (US)
- Washington State University (US)
- National Center for Post Traumatic Stress Disorder (US)
- Venue
- Annual Review of Public Health
- Publisher
- Annual Reviews
- Published
- 2018-04-01
- Volume
- 39
- Issue
- 1
- Pages
- 55-76
- ISSN
- 0163-7525 (ISSN-L)
- 1545-2093
- OpenAlex
- W2783052600
- Semantic Scholar
- cecca204e8a2126b0f8915310c7371c7960ac74c
- Cited by
- 806
- References
- 144
- Citations by year
- 2026: 89 · 2025: 124 · 2024: 130 · 2023: 115 · 2022: 118 · 2021: 107 · 2020: 83 · 2019: 30 · 2018: 9
- FWCI
- 10.40
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Annual Review of Public Health (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- National Institutes of Health
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Public Health Policies and Education
- Keywords
- intervention sustainability, evidence-based interventions, implementation science, research-practice gap, translational research, intervention adaptation, multilevel factors, public health programs, health interventions
- MeSH terms
- Implementation Science, Humans, Public Health, Research, Public Health Practice, Evidence-Based Practice, Capacity Building
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-06, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-06 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
