The DOI matches its Crossref record; 118 of the 120 references it cites were found in a registry or an index; 1 of the 102 sources its claims cite were checked for support.
A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions
Open accessAbstract
Objective: This systematic review examines experimental studies that test the effectiveness of strategies intended to integrate empirically supported mental health interventions into routine care settings. Our goal was to characterize the state of the literature and to provide direction for future implementation studies. Method: A literature search was conducted using electronic databases and a manual search. Results: Eleven studies were identified that tested implementation strategies with a randomized ( n = 10) or controlled clinical trial design ( n = 1). The wide range of clinical interventions, implementation strategies, and outcomes evaluated precluded meta-analysis. However, the majority of studies ( n = 7; 64%) found a statistically significant effect in the hypothesized direction for at least one implementation or clinical outcome. Conclusion: There is a clear need for more rigorous research on the effectiveness of implementation strategies, and we provide several suggestions that could improve this research area.
Overview
AI snapshot
Written from the paper’s full text.
TL;DR
This systematic review characterizes 11 experimental studies testing strategies to implement empirically supported mental health interventions into routine care. Most included studies were randomized (10/11) and tested multifaceted strategies (10/11), but heterogeneity precluded meta-analysis; 7 of 11 studies (64%) found a statistically significant effect in the hypothesized direction for at least one implementation or clinical outcome.
Key findings
- Eleven studies met inclusion criteria: 10 RCTs and 1 controlled clinical trial. Eight focused on child/adolescent mental health and three on adult mental health. The majority (n = 7; 64%) found a statistically significant effect in the hypothesized direction for at least one implementation or clinical outcome; all studies except Azocar et al. (2003) provided at least some support for the implementation strategies used.
- Only one study evaluated a discrete strategy (guideline dissemination), while 10 (91%) evaluated multifaceted strategies; nine of those included training. Only Glisson et al. (2010) evaluated a blended, manualized strategy (ARC). Passive strategies in isolation—such as disseminating guidelines or manuals and using opinion leaders—were ineffective.
- CFIR domains targeted by implementation strategies were: characteristics of individuals (100%, n = 11), inner setting (82%, n = 9), process of implementation (64%, n = 7), outer setting (55%, n = 6), and intervention characteristics (45%, n = 5). Mean domains addressed was 3.45 (range = 2–5) and mean subdomains was 9.73 (range = 4–20); there was no clear relationship between number of domains/subdomains and effectiveness.
- Ninety-one percent of studies (n = 10) evaluated at least one implementation or service system outcome, 36% (n = 4) evaluated clinical outcomes in addition, and 9% (n = 1) evaluated only clinical outcomes. Fidelity and provider attitudes/satisfaction were most frequent; only one study assessed costs (Kauth et al., 2010: $2,458.80 total cost for approximately 28 additional hours of CBT per month per therapist). Mean implementation/service system outcomes assessed was 2.09 (SD = 1.30); mean client outcomes was .82 (SD = 1.33).
Methods
- Systematic review searching CINAHL Plus, Medline, PubMed, PsycINFO, and SocINDEX on January 4, 2011, plus hand searches. The search identified 501 abstracts (492 database, 9 hand search), 25 full-text articles were screened, and 11 met inclusion criteria.
- Inclusion required empirical research implementing an empirically supported psychosocial treatment or practice guideline in mental health or social service systems, with both an implementation strategy and a comparative design meeting EPOC standards (RCT, CCT, controlled before-and-after, or interrupted time series). Studies focused primarily on physical health, substance abuse, pharmacological interventions, or testing clinical intervention efficacy/effectiveness were excluded.
- At least two reviewers independently extracted data using a modified Cochrane EPOC Data Abstraction Form, a Proctor et al. (2009)-guided outcomes checklist, and a CFIR-based checklist for strategy targets. No inter-rater reliability statistics were calculated; discrepancies were resolved through consensus meetings. Synthesis used tabulation, textual description, and vote-counting because meta-analysis was precluded.
Limitations
- The paper states that the small number of studies and diverse clinical interventions, implementation strategies, and outcomes made firm conclusions difficult; vote-counting gives equal weight to studies of varying sample sizes, effect sizes, and significance levels. It also states that grey literature was excluded, risk of bias/study quality was not assessed, reporting bias may have led to underestimating CFIR domains/subdomains addressed, the focus on rigorous designs limits learning from other designs, and the conceptual frameworks used have not been fully established empirically.
- Evident from the text: no meta-analysis was possible, no inter-rater reliability statistics were calculated, coding reliability was difficult particularly for CFIR domains, and only one included study evaluated implementation costs.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
73 Not checked yet · 42 Own result · 17 Own interpretation · 14 Own method · 7 No basis given · 1 Couldn’t confirm · accuracy not yet measured
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“Kauth et al. (2010) assessed the costs and benefits of external facilitation in increasing the use of cognitive-behavioral therapy (CBT).”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Results > Implementation, Service System, and Clinical Outcomes Evaluated
What the sources say
- Could not verifycites Kauth et al., 2010 sourceExperimental — accuracy not yet measured
The Methods > Intervention section describes a trial comparing blended learning with a lecture for teaching general practitioners about dementia management. Our copy does not address Kauth et al. or an assessment of the costs and benefits of external facilitation for increasing CBT use (searched: Kauth, external facilitation, cognitive-behavioral therapy). No page numbers were provided for the indexed passages. (LLM, conf=0.76)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, the majority of studies (n = 7; 64%) found a statistically significant effect in the hypothesized direction for at least one implementation or clinical outcome.”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Abstract > Results
plainn = 7- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The wide range of clinical interventions, implementation strategies, and outcomes evaluated precluded meta-analysis.”
- Also stated in: § Methods of Synthesis · plain
“The wide range of clinical interventions, implementation strategies, and outcomes evaluated in the included studies (see below) precluded meta-analysis.”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Abstract > Results
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Methods of Synthesis · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“45% (n = 5) of studies employed strategies that targeted intervention characteristics.”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Results > Implementation Research Conceptual Domains
plainn = 5- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“no other theory aside from Diffusion of Innovations theory was discussed more than once.”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Results > Guiding Theories and Conceptual Models
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Five studies (45%) explicitly referenced and/or discussed a guiding theory or conceptual model.”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Results > Guiding Theories and Conceptual Models
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Rogers’ (2003) Diffusion of Innovation theory was the most commonly mentioned, as it was discussed and/or cited in four articles.”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Results > Guiding Theories and Conceptual Models
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“Azocar, Cuffel, Goldman, & McCarter (2003) conducted the only evaluation of a discrete strategy (disseminating guidelines), while the remaining studies (n =10; 91%) evaluated multifaceted implementation strategies (i.e., combinations of multiple implementation strategies).”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Results > Types of Strategies Evaluated
What the sources say
- Not checked yetcites Azocar et al., 2003
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The child and adolescent mental health studies were conducted in diverse service settings, including: schools, daycare centers, foster care and child welfare settings, and community mental health agencies.”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Results > Populations and Treatment Settings in Included Studies
plainn = 3- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“9% (n = 1) evaluated only clinical outcomes”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Results > Implementation, Service System, and Clinical Outcomes Evaluated
plainSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- It may state two separate claims as one. 36
- Probably not a substantial claim. 40
- The quote only partly states this claim. 1
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Eleven studies were identified that tested implementation strategies with a randomized (n = 10) or controlled clinical trial design (n = 1).”
- Also stated in: § Study Designs · plain
“The majority of the studies (n = 10; 91%) were RCTs, and one study was a CCT.”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Abstract > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- The authors state this as an assumption: The authors treated a treatment as empirically supported if the included study's authors cited evidence supporting its efficacy or effectiveness.
- Also stated in: § Study Designs · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Abstracts were screened for eligibility and 25 full-text articles were identified as potentially relevant.”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Results > Search Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The mean number of domains addressed was 3.45 (range = 2–5), and the mean number of sub-domains addressed was 9.73 (range = 4–20).”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Results > Implementation Research Conceptual Domains
plainn = 11- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“A total of 501 abstracts were identified through the database (n = 492) and hand search (n = 9) process.”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Results > Search Results
plainn = 492- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“For example, Glisson et al. (2010) and Chamberlain, Price, Reid, & Landsverk (2008) both conducted large-scale RCTs involving over 600 youth, whereas Kauth and colleagues (2010) and Kramer and Burns (2008) conducted small randomized studies (n = 23 and n = 17 respectively) that could be characterized as feasibility or pilot studies.”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Results > Study Designs
What the sources say
- Not checked yetcites Kauth and colleagues (2010)
- Not checked yetcites Kramer and Burns (2008)
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Though their implementation approaches would not technically be classified as blended owing to a lack of manualization, we note that several studies evaluated multifaceted, multi-level implementation strategies by targeting multiple domains of the implementation context.”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Results > Types of Strategies Evaluated
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“the mean number of sub-domains addressed was 9.73 (range = 4–20).”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Results > Implementation Research Conceptual Domains
plainn = 11- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The majority of studies (n = 7; 64%) found a statistically significant effect in the hypothesized direction for at least one implementation or clinical outcome”
- Also stated in: § Discussion and Applications to Social Work · boosted
“A promising finding of this review was that approximately two-thirds (64%) of studies demonstrated beneficial effects of employing implementation strategies to improve intermediate and/or clinical outcomes over the comparison conditions.”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Results > Effectiveness of Implementation Strategies
boosteddirectn = 7- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: The outcome measures used in the included studies validly indicate implementation, service system, and clinical outcomes, so that the review's synthesis of their effects is meaningful.
- Also stated in: § Discussion and Applications to Social Work · boosted
In the paper
“Kramer and Burns (2008) draw upon the characteristics of innovations that may make them easier to implement as they justify their selection of cognitive behavioral therapy by noting its relative advantage (it has been demonstrated to be effective in community trials), trialability (standardized components and manuals have been developed and can”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Results > Guiding Theories and Conceptual Models
What the sources say
- Not checked yetcites Kramer and Burns, 2008
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The quote only partly states this claim.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The adult mental health service settings included: outpatient mental health (through a managed behavioral health care organization), Department of Veterans Affairs hospitals, and psychiatric clinics (in Stockholm, Sweden)”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Results > Populations and Treatment Settings in Included Studies
plainn = 3- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“Atkins and colleagues (2008) supported the use of opinion leaders as an implementation strategy by stating, “diffusion theory posits that novel interventions are initiated by a relatively small group of key opinion leaders (KOLs) who serve as influential models for others in their social network” (p. 905).”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Results > Guiding Theories and Conceptual Models
What the sources say
- Not checked yetcites Atkins et al., 2008
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“Some studies testing very comprehensive implementation strategies demonstrated positive effects (e.g., Forsner et al., 2010; Glisson et al., 2010); however, other studies also demonstrated positive effects with less comprehensive strategies (e.g., Herschell et al., 2009; Lochman et al., 2009).”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Results > Effectiveness of Implementation Strategies
What the sources say
- Not checked yetcites Forsner et al., 2010
- Not checked yetcites Glisson et al., 2010
- Not checked yetcites Herschell et al., 2009
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: The outcome measures used in the included studies validly indicate implementation, service system, and clinical outcomes, so that the review's synthesis of their effects is meaningful.
None of the sources cited for this claim have been checked yet.
In the paper
“One of the studies described in the Palinkas et al. (2008) article did not have final data published at the time of this search; however, the results have subsequently been published and the more recent article (Weisz et al., 2012) was examined in this review.”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Results > Search Results
What the sources say
- Not checked yetcites Palinkas et al. (2008)
- Not checked yetcites Weisz et al., 2012
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“For example, Glisson et al. (2010) and Chamberlain, Price, Reid, & Landsverk (2008) both conducted large-scale RCTs involving over 600 youth, whereas Kauth and colleagues (2010) and Kramer and Burns (2008) conducted small randomized studies (n = 23 and n = 17 respectively) that could be characterized as feasibility or pilot studies.”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Results > Study Designs
What the sources say
- Not checked yetcites Glisson et al. (2010)
- Not checked yetcites Chamberlain, Price, Reid, & Landsverk (2008)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“The external facilitation strategy resulted in a total cost (facilitator’s and therapists’ time) of $2,458.80 for a benefit of approximately 28 additional hours of CBT per month per therapist.”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Results > Implementation, Service System, and Clinical Outcomes Evaluated
What the sources say
- Not checked yetcites Kauth et al., 2010 source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Client outcomes included symptom/behavioral checklists and out-of-home placements.”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Results > Implementation, Service System, and Clinical Outcomes Evaluated
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Though we did not calculate inter-rater reliability statistics (i.e., Cohen’s kappa), we found it difficult to achieve high reliability during the first round of coding, particularly when coding the theoretical domains outlined by Damschroder and colleagues (2009).”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Methods > Data Extraction and Coding Procedures
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Eight of the eleven included studies were conducted in child and adolescent mental health, with the remaining three focusing on adult mental health.”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Results > Populations and Treatment Settings in Included Studies
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The mean number of implementation or service system outcomes assessed was 2.09 (SD = 1.30)”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Results > Implementation, Service System, and Clinical Outcomes Evaluated
plainn = 10- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“In the present study, we found no difference in outcome attainment (clinical or implementation) between studies that targeted multiple theoretical domains or subdomains of the CFIR and studies that targeted fewer domains or subdomains, providing evidence that is consistent with Grimshaw and colleagues (2006).”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Discussion and Applications to Social Work
What the sources say
- Not checked yetcites Grimshaw et al., 2006
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: The number of CFIR domains or subdomains addressed by a study is a meaningful measure of the comprehensiveness of its implementation strategy, so that comparing studies by domain counts can inform conclusions about strategy effectiveness.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“In many other cases it was difficult to determine the scope and detail of the implementation strategies used, which obviously limits one’s ability to understand the implementation approach, let alone replicate it.”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Discussion and Applications to Social Work
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“For instance, while most studies effectively differentiated between clinical interventions and implementation strategies, the description and reporting of implementation strategies could be vastly improved.”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Discussion and Applications to Social Work
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“Forsner et al. (2010) is one excellent example of a study that clearly describes the implementation strategies (even providing a separate box detailing the different strategies employed).”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Discussion and Applications to Social Work
What the sources say
- Not checked yetcites Forsner et al., 2010
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Efforts are underway to catalog and rate the quality of implementation related measures (Rabin et al., 2012) to promote the use of a wider array of valid and reliable instruments and serve to catalyze the development of new measures needed to advance the field.”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Discussion and Applications to Social Work
What the sources say
- Not checked yetcites Rabin et al., 2012
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“For example, some studies (e.g., Atkins et al., 2008) addressed many CFIR domains and subdomains, but used implementation strategies that have been classified as passive (e.g., opinion leaders and educational meetings), whereas other studies (e.g., Lochman et al., 2009) addressed few domains but used implementation strategies that are considered relatively intensive”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Discussion and Applications to Social Work
What the sources say
- Not checked yetcites Atkins et al., 2008
- Not checked yetcites Lochman et al., 2009
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“Raghavan, Bright, & Shadoin (2008) have highlighted a number of potential change levers at the level of the “policy ecology;” however, few if any of these strategies have been tested empirically.”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Discussion and Applications to Social Work
What the sources say
- Not checked yetcites Raghavan, Bright, & Shadoin, 2008
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“has led Landsverk, Brown, Rolls Reutz, Palinkas, & Horwitz (2011) to conclude that the field of mental health has lagged behind other disciplines in building an evidence-base for implementation.”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Introduction > Implementation Strategies
What the sources say
- Not checked yetcites Landsverk, Brown, Rolls Reutz, Palinkas, & Horwitz (2011)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
None of the sources cited for this claim have been checked yet.
In the paper
“Implementation research has emerged as one way of addressing the quality gaps in a variety of fields, including mental health (Brownson, Colditz, & Proctor, 2012, McMillen, 2012).”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Introduction > Implementation Research
What the sources say
- Not checked yetcites Brownson, Colditz, & Proctor, 2012
- Not checked yetcites McMillen, 2012
plainconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
None of the sources cited for this claim have been checked yet.
In the paper
“It has been prioritized and supported by the National Institutes of Health (NIH; National Institute of Mental Health, 2008; National Institutes of Health, 2013) and the Institute of Medicine (IOM; Institute of Medicine, 2007, 2009b), both of which have called for more research that focuses on the identification, development, refinement, and testing of implementation strategies.”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Introduction > Implementation Research
What the sources say
- Not checked yetcites National Institute of Mental Health, 2008
- Not checked yetcites National Institutes of Health, 2013
- Not checked yetcites Institute of Medicine, 2007
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“as Proctor, Powell, Baumann, Hamilton, & Santens (2012) note, conceptual models can be “…useful in framing a study theoretically and providing a ‘big picture’ of the hypothesized relationships between variables” (p. 6)”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Introduction > Overview of Implementation Models
What the sources say
- Not checked yetcites Proctor, Powell, Baumann, Hamilton, & Santens (2012)
plainconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
In the paper
“the most consistent finding from this literature is that while passive approaches to implementation (e.g., single session workshops, distribution of treatment manuals) may increase provider knowledge and even predispose providers to adopt a treatment, passive approaches do little to produce provider behavior change (Davis & Davis, 2009).”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Introduction > Implementation Strategies
What the sources say
- Not checked yetcites Davis & Davis, 2009
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“For example, the review by Powell et al. (2012) identified 68 discrete strategies that can be used to plan, educate, finance, restructure, manage quality, and attend to the policy context to facilitate implementation.”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Introduction > Implementation Strategies
What the sources say
- Not checked yetcites Powell et al., 2012
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Each mutable aspect of the implementation context that the CFIR highlights is potentially amenable to the application of targeted and tailored implementation strategies (Powell et al., 2012).”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Introduction > Overview of Implementation Models
What the sources say
- Not checked yetcites Powell et al., 2012
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“EPOC designates four designs as appropriate for testing the effectiveness of implementation strategies, including: 1) randomized controlled trials (RCTs), 2) controlled clinical trials (CCTs), 3) controlled before and after studies, and 4) interrupted time series studies.”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Methods > Inclusion and Exclusion Criteria
What the sources say
- Not checked yetcites Cochrane Effective Practice and Organisation of Care Group, 2002a
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
In the paper
“This model captures the complex, multi-level nature (Shortell, 2004) of implementation, and suggests (implicitly) that successful implementation may necessitate the use of an array of strategies that exert their effects at multiple levels of the implementation context.”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Introduction > Overview of Implementation Models
What the sources say
- Not checked yetcites Shortell, 2004
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
In the paper
“The CFIR suggests that implementation is influenced by: 1) intervention characteristics (evidentiary support, relative advantage, adaptability, trialability, and complexity), 2) the outer setting (patient needs and resources, organizational connectedness, peer pressure, external policy and incentives), 3) the inner setting (structural characteristics, networks and communications, culture, climate,”
- Also stated in: § Overview of Implementation Models · plain
“4) the characteristics of individuals involved (knowledge, self-efficacy, stage of change, identification with organization, etc.), and 5) the process of implementation (planning, engaging, executing, reflecting, evaluating).”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Introduction > Overview of Implementation Models
What the sources say
- Not checked yetcites Damschroder et al., 2009
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Also stated in: § Overview of Implementation Models · plain
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Though we did not calculate inter-rater reliability statistics (i.e., Cohen’s kappa), we found it difficult to achieve high reliability during the first round of coding, particularly when coding the theoretical domains outlined by Damschroder and colleagues (2009).”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Methods > Data Extraction and Coding Procedures
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“This approach was previously used to enrich the understanding of implementation strategies applied to alcohol screening and brief intervention (Williams et al., 2011).”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Methods > Data Extraction and Coding Procedures
What the sources say
- Not checked yetcites Williams et al., 2011
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This is partly due to wide variations in the quality of reporting and the justification for the use of implementation strategies in the included studies, a point that we consider further in the discussion section.”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Methods > Data Extraction and Coding Procedures
plainconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“At least two reviewers independently reviewed and extracted data from each article.”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Methods > Data Extraction and Coding Procedures
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“thus, we temper our interpretation of results accordingly.”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Methods > Methods of Synthesis
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“These challenges compelled us to hold a number of face-to-face meetings in which coding discrepancies were discussed and resolved through consensus.”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Methods > Data Extraction and Coding Procedures
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Indeed, while the CFIR’s utility as a framework to guide empirical research is not fully established, it is consistent with the vast majority of frameworks and conceptual models in dissemination and implementation research in its emphasis of multi-level ecological factors (Tabak et al., 2012).”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Introduction > Overview of Implementation Models
What the sources say
- Not checked yetcites Tabak et al., 2012
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Our study design criteria required the use of a comparative design to test the implementation strategy that met standards of rigor set forth by the Cochrane Effective Practice and Organisation of Care (EPOC) group (2002a).”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Methods > Inclusion and Exclusion Criteria
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
In the paper
“Thus, there may be room for implementation programs that integrate protocolized adaptations, much in the same way that modular treatments (Weisz et al., 2012) allow clinicians to shift treatment protocols to meet client need.”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Discussion and Applications to Social Work
What the sources say
- Not checked yetcites Weisz et al., 2012
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Another challenge we faced was interpreting the results of studies that evaluated multifaceted strategies.”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Discussion and Applications to Social Work
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Finally, there may also be opportunities to address the “process” of implementation to develop implementation programs that are more flexible and adaptive to the needs of the implementation context.”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Discussion and Applications to Social Work
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“Studies of large-scale implementation efforts have identified the importance of policy level implementation strategies (e.g., aligning financial incentives, altering certification and licensing standards, state partnerships with academic institutions to develop ESI training curriculum for students), and have suggested that different ESIs may even require different policy-level interventions (Isett”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Discussion and Applications to Social Work
What the sources say
- Not checked yetcites Isett et al., 2007
- Not checked yetcites Magnabosco, 2006
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Other approaches that have been described in the literature such as the “common elements” and transdiagnostic approaches to treatment may be similarly effective.”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Discussion and Applications to Social Work
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“These common elements can be systematically identified, taught to clinicians, and applied flexibly to meet clients’ needs, relieving clinicians of the burden of learning a whole host of ESI protocols (Barth et al., 2012; Chorpita, Becker, & Daleiden, 2007).”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Discussion and Applications to Social Work
What the sources say
- Not checked yetcites Barth et al., 2012
- Not checked yetcites Chorpita, Becker, & Daleiden, 2007
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The results from several studies seem to suggest that passive strategies (e.g., disseminating guidelines or manuals, opinion leaders) may represent promising approaches to implementation when combined with other strategies; however, in isolation, they may lack the intensity and comprehensiveness that successful implementation requires.”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Discussion and Applications to Social Work
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Although we did not formally evaluate the methodological quality of included studies, the need for reporting guidelines in implementation research were readily apparent.”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Discussion and Applications to Social Work
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“In an effort to make meaningful comparisons between studies that had different design characteristics we linked the implementation strategies in the included studies to a conceptual framework of implementation (Damschroder et al., 2009). Doing so allowed us to explore implementation effectiveness at the level of the implementation context, which indirectly provided insight into debates regarding”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Discussion and Applications to Social Work
What the sources say
- Not checked yetcites Damschroder et al., 2009
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Unfortunately, cost was assessed in only one of the eleven studies, which severely limits the usefulness of this research to policy makers and organizational leaders who are charged with making decisions about which implementation”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Discussion and Applications to Social Work
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“Others have suggested that the reason for Grimshaw and colleagues’ (2006) finding is that many multifaceted strategies focus on only one level of the implementation context (Wensing, Bosch, & Grol, 2009).”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Discussion and Applications to Social Work
What the sources say
- Not checked yetcites Wensing, Bosch, & Grol, 2009
hedgedconditional- Asserted: fails — The authors may not put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The authors may not put it forward as true. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“To our knowledge, this is the first systematic review that assesses the effectiveness of implementation strategies within diverse settings where mental health treatments are delivered (e.g., community mental health centers, schools, daycare centers, foster care, etc.), and that links implementation strategies to conceptual targets deemed important in the implementation literature.”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Discussion and Applications to Social Work
hedgedcorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Implementation outcomes such as acceptability, appropriateness, cost, and feasibility may all have direct bearing on whether a strategy or set of strategies will be effective in the “real world.””
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Discussion and Applications to Social Work
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“these measures and frameworks can serve a very practical purpose by guiding the targeted application of implementation strategies to increase the likelihood of implementation success (Aarons et al., 2012).”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Discussion and Applications to Social Work
What the sources say
- Not checked yetcites Aarons et al., 2012
plainconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Both of these approaches attempt to simplify the provision of evidence-based care by manipulating characteristics of the intervention to make them more widely applicable to the types of clients that clinicians are likely to serve in routine care, and may represent promising opportunities for implementation research.”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Discussion and Applications to Social Work
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“The common elements approach is predicated on the idea that ESIs for a given disorder (e.g., childhood anxiety disorders) share many common features that contribute to their effectiveness.”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Discussion and Applications to Social Work
What the sources say
- Not checked yetcites Barth et al., 2012
- Not checked yetcites Chorpita, Becker, & Daleiden, 2007
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Grimshaw et al.’s (2006) extensive review of guideline implementation strategies in health concluded that there was no evidence that multifaceted strategies were superior to single-component strategies.”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Discussion and Applications to Social Work
What the sources say
- Not checked yetcites Grimshaw et al., 2006
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
In the paper
“Transdiagnostic treatments provide unified treatment protocols for clinical disorders that have overlapping clinical features, high levels of co-occurrence, or common maintaining mechanisms (McHugh, Murray, & Barlow, 2009).”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Discussion and Applications to Social Work
What the sources say
- Not checked yetcites McHugh, Murray, & Barlow, 2009
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“As Alexander and Hearld (2012) note, it is “difficult to parse out the effects of individual intervention components and determine whether some components are more important than others” (p. 4).”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Discussion and Applications to Social Work
What the sources say
- Not checked yetcites Alexander and Hearld, 2012
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Third, we did not assess risk of bias/study quality of the included studies”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Discussion and Applications to Social Work
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Second, we did not include “grey literature;” thus, we may have missed unpublished studies meeting our other inclusion criteria.”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Discussion and Applications to Social Work
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“A recently developed checklist based upon the WIDER Recommendations may further assist implementation researchers in reporting their studies (Albrecht, Archibald, Arseneau, & Scott, 2013).”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Discussion and Applications to Social Work
What the sources say
- Not checked yetcites Albrecht, Archibald, Arseneau, & Scott, 2013
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“We chose to use a “vote counting” approach to synthesis. This approach is prone to the limitations discussed above in the “methods of synthesis” section, but can be a useful way of providing an initial description of the patterns found across studies (Popay et al., 2006) and, coupled with the narrative approach to synthesis that we have utilized, is a useful way of summarizing included studies.”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Discussion and Applications to Social Work
What the sources say
- Not checked yetcites Popay et al., 2006
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“Despite the utility of the WIDER Recommendations and other reporting guidelines, we also affirm Eccles et al. (2009) call for a suite of reporting guidelines for different types of implementation research.”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Discussion and Applications to Social Work
What the sources say
- Not checked yetcites Eccles et al., 2009
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“These guidelines may be very helpful to researchers studying implementation strategies in mental health, as they implore researchers to: 1) provide detailed descriptions of interventions (and implementation strategies) in published papers, 2) clarify assumed change processes and design principles, 3) provide access to manuals and protocols that provide information about the clinical interventions”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Discussion and Applications to Social Work
What the sources say
- Not checked yetcites Michie et al., 2009
- Not checked yetcites Workgroup for Intervention Development and Evaluation Research, 2008
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“our focus on the effectiveness of implementation strategies compelled us to focus on rigorous designs that minimize threats to internal validity”
§ A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions > Discussion and Applications to Social Work
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The authors state this as an assumption.
The authors treated a treatment as empirically supported if the included study's authors cited evidence supporting its efficacy or effectiveness.
“We assumed a treatment to be “empirically supported” if the authors cited evidence that supported its efficacy or effectiveness.”
The paper relies on this without support.
The published trial reports included in the review adequately disclose the theories or conceptual models that guided the studies, so that the review's assessment of theory use is not substantially limited by undisclosed theoretical foundations.
“We do acknowledge that our systematic review was focused on the discussion of theory within the published trial, yet it is possible that the theoretical foundation of the implementation intervention was discussed elsewhere.”
The paper relies on this without support.
The number of CFIR domains or subdomains addressed by a study is a meaningful measure of the comprehensiveness of its implementation strategy, so that comparing studies by domain counts can inform conclusions about strategy effectiveness.
“It is also possible that counting the number of CFIR domains addressed is a limited proxy for the intensity and comprehensives of the strategies.”
The paper relies on this without support.
The outcome measures used in the included studies validly indicate implementation, service system, and clinical outcomes, so that the review's synthesis of their effects is meaningful.
“Third, we did not assess risk of bias/study quality of the included studies”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“In contrast, Powell and colleagues (2014) identified the use of 50 implementation strategies by agencies related to planning, education, finances, restructuring, and quality improvement.”
From Implementation-as-Usual in Community-Based Organizations Providing Specialized Services to Individuals with Autism Spectrum Disorder: A Mixed Methods Study (2021) · cites this paper as Powell et al., 2014
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These integrated findings indicate that implementation of new ASD practices within ASD-CBOs may involve various strategies-some with supportive evidence (e.g., pilot ASD-EBP within the agency and revise, if needed; Powell et al., 2014) and others without evidence to support that they effectively change provider behavior (e.g., train staff only, 'just use [the practice]'; Fixsen et al., 2009).”
From Implementation-as-Usual in Community-Based Organizations Providing Specialized Services to Individuals with Autism Spectrum Disorder: A Mixed Methods Study (2021) · cites this paper as Powell et al., 2014
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“One of the richest descriptions of IAU comes from a mixed-methods study of seven social service organizations serving children, youth and families (Powell et al., 2013; Powell, 2014).”
From Implementation-as-Usual in Community-Based Organizations Providing Specialized Services to Individuals with Autism Spectrum Disorder: A Mixed Methods Study (2021) · cites this paper as Powell, 2014
Experimental — accuracy not yet measured
Citations
Cites
Case Study Research: Design and Methods
Chaiklin, H. (1991) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-199102000-00025 · Cited by 39,639
Rogers, E. M., Singhal, A., & Quinlan, M. M. (2019) · Routledge eBooks · doi:10.4324/9780203710753-35 · Cited by 37,670
Valente, T. W. (2003) · Genetics in Medicine · doi:10.1097/01.gim.0000061743.67794.c4 · Cited by 20,559
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496
Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0319-7 · Cited by 8,721
Self-citationCrossing the Quality Chasm: A New Health System for the 21st Century
Committee on Quality of Health Care in America (2002) · Journal for Healthcare Quality · doi:10.1111/j.1945-1474.2002.tb00463.x · Cited by 8,508
Organizational innovation: A meta-analysis of effects of determinants and moderators
Damanpour, F. (1991) · Academy of Management Journal · doi:10.2307/256406 · Cited by 6,542
Audit and feedback: effects on professional practice and healthcare outcomes
Ivers, N., Jamtvedt, G., Flottorp, S., Young, J. M., Odgaard-Jensen, J., French, S. D., O'Brien, M. A., Johansen, M., Grimshaw, J., & Oxman, A. D. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000259.pub3 · Cited by 5,485
Cane, J., O’Connor, D., & Michie, S. (2012) · Implementation Science · doi:10.1186/1748-5908-7-37 · Cited by 4,888 · cited 1×
“For more examples of individual level factors that may be important to address during implementation, we direct readers to the Theoretical Domains Framework (Cane et al., 2012; Michie et al., 2005).”
BackgroundMaking psychological theory useful for implementing evidence based practice: a consensus approach
Michie, S. (2005) · Quality and Safety in Health Care · doi:10.1136/qshc.2004.011155 · Cited by 3,440
Yin, R. K. (2009). Case study research: Design and methods (4th Ed.). Thousand Oaks, CA: Sage.
Aberdeen, T. (2013) · The Canadian Journal of Action Research · doi:10.33524/cjar.v14i1.73 · Cited by 3,250
Knowledge translation of research findings
Grimshaw, J. M., Eccles, M. P., Lavis, J. N., Hill, S. J., & Squires, J. E. (2012) · Implementation Science · doi:10.1186/1748-5908-7-50 · Cited by 2,407
Welcome to Implementation Science
Eccles, M. P., & Mittman, B. S. (2006) · Implementation Science · doi:10.1186/1748-5908-1-1 · Cited by 2,254
Popay, J., Roberts, H., Sowden, A., Petticrew, M., Arai, L., Rodgers, M., Britten, N., Roen, K., & Duffy, S. (2006) · Lancaster University · doi:10.13140/2.1.1018.4643 · Cited by 2,070
(2009) · Cited by 2,013
Cochrane Database of Systematic Reviews
Lyons, R. (2006) · Progress in Neurology and Psychiatry · doi:10.1002/pnp.208 · Cited by 1,907
Proctor, E. K., Landsverk, J., Aarons, G., Chambers, D., Glisson, C., & Mittman, B. (2009) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-008-0197-4 · Cited by 1,894
Self-citationOxman, A. D., Thomson, M., Davis, D. A., & Haynes, R. B. (1995) · PubMed Central · Cited by 1,847
Leavitt, M. (2001) · PubMed · Cited by 1,835
Update on empirically validated therapies, II: (619622010-001)
Chambless, D. L., Baker, M. J., Baucom, D. H., Beutler, L. E., Calhoun, K. S., Crits-Christoph, P., Daiuto, A., DeRubeis, R., Detweiler, J., Haaga, D. A. F., et al. (1997) · PsycEXTRA Dataset · doi:10.1037/e619622010-001 · Cited by 1,488
Bridging Research and Practice
Tabak, R. G., Khoong, E. C., Chambers, D. A., & Brownson, R. C. (2012) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2012.05.024 · Cited by 1,386
What Works for Whom?: A Critical Review of Psychotherapy Research
Roth, A. D., & Fonagy, P. (1996) · Cited by 1,382
Dissemination and Implementation Research in HealthTranslating Science to Practice
Brownson, R. C., Colditz, G. A., & Proctor, E. K. (2012) · doi:10.1093/acprof:oso/9780199751877.001.0001 · Cited by 1,355
Self-citationKitson, A. L., Rycroft-Malone, J., Harvey, G., McCormack, B., Seers, K., & Titchen, A. (2008) · Implementation Science · doi:10.1186/1748-5908-3-1 · Cited by 1,314
Journal of General Internal Medicine
(2013) · Journal of General Internal Medicine · doi:10.1007/11606.1525-1497 · Cited by 1,284
Mixed method designs in implementation research
Palinkas, L. A., Aarons, G. A., Horwitz, S., Chamberlain, P., Hurlburt, M., & Landsverk, J. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0314-z · Cited by 1,187
Flottorp, S. A., Oxman, A. D., Krause, J., Musila, N. R., Wensing, M., Godycki-Cwirko, M., Baker, R., & Eccles, M. P. (2013) · Implementation Science · doi:10.1186/1748-5908-8-35 · Cited by 1,138
Kazdin, A. E. (2008) · American Psychologist · doi:10.1037/0003-066x.63.3.146 · Cited by 1,112
Beidas, R. S., & Kendall, P. C. (2010) · Clinical Psychology: Science and Practice · doi:10.1111/j.1468-2850.2009.01187.x · Cited by 1,085
A compilation of strategies for implementing clinical innovations in health and mental health
Powell, B. J., McMillen, J. C., Proctor, E. K., Carpenter, C. R., Griffey, R. T., Bunger, A. C., Glass, J. E., & York, J. L. (2012) · Medical Care Research and Review · doi:10.1177/1077558711430690 · Cited by 1,069
Self-citationWells, K. B., Sherbourne, C., Schoenbaum, M., Duan, N., Meredith, L., Unützer, J., Miranda, J., Carney, M. F., & Rubenstein, L. V. (2000) · JAMA · doi:10.1001/jama.283.2.212 · Cited by 1,021
Specifying and reporting complex behaviour change interventions: the need for a scientific method
Michie, S., Fixsen, D., Grimshaw, J. M., & Eccles, M. P. (2009) · Implementation Science · doi:10.1186/1748-5908-4-40 · Cited by 976
Planning and Studying Improvement in Patient Care: The Use of Theoretical Perspectives
GROL, R. P. T. M., BOSCH, M. C., HULSCHER, M. E. J. L., ECCLES, M. P., & WENSING, M. (2007) · The Milbank Quarterly · doi:10.1111/j.1468-0009.2007.00478.x · Cited by 943
The PARIHS Framework—A Framework for Guiding the Implementation of Evidence-based Practice
Rycroft-Malone, J. (2004) · Journal of Nursing Care Quality · doi:10.1097/00001786-200410000-00002 · Cited by 923
Audit and feedback: effects on professional practice and health care outcomes
Jamtvedt, G., Young, J. M., Kristoffersen, D. T., O'Brien, M. A., & Oxman, A. D. (2006) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000259.pub2 · Cited by 912
Weisz, J. R. (2012) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2011.147 · Cited by 827
Berwick, D. M. (2008) · JAMA · doi:10.1001/jama.299.10.1182 · Cited by 809
A primer on leading the improvement of systems: Fig 1
Berwick, D. M. (1996) · BMJ · doi:10.1136/bmj.312.7031.619 · Cited by 793
Herschell, A. D., Kolko, D. J., Baumann, B. L., & Davis, A. C. (2010) · Clinical Psychology Review · doi:10.1016/j.cpr.2010.02.005 · Cited by 713
Vollmar, H. C., Mayer, H., Ostermann, T., Butzlaff, M. E., Sandars, J. E., Wilm, S., & Rieger, M. A. (2010) · Implementation Science · doi:10.1186/1748-5908-5-1 · Cited by 693
Knowledge Translation in Health Care: Moving from Evidence to Practice
(2009) · International Journal of Health Care Quality Assurance · doi:10.1108/ijhcqa.2009.06222fae.002 · Cited by 689
Wang, P. S., Berglund, P., & Kessler, R. C. (2000) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2000.9908044.x · Cited by 686
Toward Evidence-Based Quality Improvement.
Grimshaw, J., Eccles, M., Thomas, R. E., MacLennan, G., Ramsay, C. R., Fraser, C. M., & Vale, L. D. (2006) · Journal of General Internal Medicine · doi:10.1111/j.1525-1497.2006.00357.x · Cited by 657
Davies, P., Walker, A. E., & Grimshaw, J. M. (2010) · Implementation Science · doi:10.1186/1748-5908-5-14 · Cited by 619
Audit and feedback: Effects on professional practice and healthcare outcomes
Jamtvedt, G., Jm, Y., Kristoffersen, D., O'Brien, M. T., & Oxman, A. D. (2003) · Physiotherapy · doi:10.1016/s0031-9406(05)60176-9 · Cited by 582
Improving Patient Care: The Implementation of Change in Clinical Practice
Cosby, J. (2006) · BMJ Quality & Safety · doi:10.1136/qshc.2005.016824 · Cited by 560
Improving the Quality of Health Care for Mental and Substance-Use Conditions
Institute of Medicine (2006) · National Academies Press eBooks · doi:10.17226/11470 · Cited by 559
The Breakthrough Series: IHI’s Collaborative Model for Achieving Breakthrough Improvement
Institute for Healthcare Improvement (2004) · Diabetes Spectrum · doi:10.2337/diaspect.17.2.97 · Cited by 526
An implementation research agenda
Eccles, M. P., Armstrong, D., Baker, R., Cleary, K., Davies, H., Davies, S., Glasziou, P., Ilott, I., Kinmonth, A.-L., Leng, G., et al. (2009) · Implementation Science · doi:10.1186/1748-5908-4-18 · Cited by 481
Sundquist, J. L. (1973) · Political Science Quarterly · doi:10.2307/2148170 · Cited by 474
National Survey of Psychotherapy Training in Psychiatry, Psychology, and Social Work
Weissman, M. M., Verdeli, H., Gameroff, M. J., Bledsoe, S. E., Betts, K., Mufson, L., Fitterling, H., & Wickramaratne, P. (2006) · Archives of General Psychiatry · doi:10.1001/archpsyc.63.8.925 · Cited by 422
Initial National Priorities for Comparative Effectiveness Research
(2010) · Critical Values · doi:10.1093/criticalvalues/3.1.16 · Cited by 394
Designing theoretically-informed implementation interventions
The Improved Clinical Effectiveness through Behavioural Research Group (ICEBeRG) (2006) · Implementation Science · doi:10.1186/1748-5908-1-4 · Cited by 380
Glisson, C., & Schoenwald, S. K. (2005) · Mental Health Services Research · doi:10.1007/s11020-005-7456-1 · Cited by 373
McKibbon, K. A., Lokker, C., Wilczynski, N. L., Ciliska, D., Dobbins, M., Davis, D. A., Haynes, R. B., & Straus, S. E. (2010) · Implementation Science · doi:10.1186/1748-5908-5-16 · Cited by 345 · cited 1×
“The specific terms used in the ‘‘implementation/ dissemination’’ concept were selected due to their superiority in accurately identifying knowledge translation (otherwise known as implementation) studies in a recent systematic review (McKibbon et al., 2010).”
MethodMcHugh, R. K., Murray, H. W., & Barlow, D. H. (2009) · Behaviour Research and Therapy · doi:10.1016/j.brat.2009.07.005 · Cited by 320
Glisson, C., Dukes, D., & Green, P. (2006) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2005.12.010 · Cited by 298
Teaching Evidence-Based Practice: Toward a New Paradigm for Social Work Education
Howard, M. O., McMillen, C. J., & Pollio, D. E. (2003) · Research on Social Work Practice · doi:10.1177/1049731502250404 · Cited by 296
Understanding the Common Elements of Evidence-Based Practice
Chorpita, B. F., Becker, K. D., & Daleiden, E. L. (2007) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/chi.0b013e318033ff71 · Cited by 292
Rakovshik, S. G., & McManus, F. (2010) · Clinical Psychology Review · doi:10.1016/j.cpr.2010.03.004 · Cited by 281 · cited 2×
“Several reviews of implementation strategies in mental health have focused on training in ESIs (e.g., Beidas & Kendall, 2010; Herschell, Kolko, Baumann, & Davis, 2010; Rakovshik & McManus, 2010).”
BackgroundTailoring quality improvement interventions to identified barriers: a multiple case analysis
Bosch, M., Van Der Weijden, T., Wensing, M., & Grol, R. (2007) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2006.00660.x · Cited by 272
The meaning and measurement of implementation climate
Weiner, B. J., Belden, C. M., Bergmire, D. M., & Johnston, M. (2011) · Implementation Science · doi:10.1186/1748-5908-6-78 · Cited by 260
Albrecht, L., Archibald, M., Arseneau, D., & Scott, S. D. (2013) · Implementation Science · doi:10.1186/1748-5908-8-52 · Cited by 252
Randomized trial of MST and ARC in a two-level evidence-based treatment implementation strategy.
Glisson, C., Schoenwald, S. K., Hemmelgarn, A., Green, P., Dukes, D., Armstrong, K. S., & Chapman, J. E. (2010) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0019160 · Cited by 243
Mental Health Care for Children With Disruptive Behavior Problems: A View Inside Therapists' Offices
Garland, A. F., Brookman-Frazee, L. I., Hurlburt, M. S., Accurso, E. C., Zoffness, R. J., Haine‐Schlagel, R., & Ganger, W. C. (2010) · Psychiatric Services · doi:10.1176/ps.2010.61.8.788 · Cited by 236
A systematic review of the use of theory in randomized controlled trials of audit and feedback
Colquhoun, H. L., Brehaut, J. C., Sales, A., Ivers, N., Grimshaw, J., Michie, S., Carroll, K., Chalifoux, M., & Eva, K. W. (2013) · Implementation Science · doi:10.1186/1748-5908-8-66 · Cited by 231
Report of the 2005 Presidential Task Force on Evidence-Based Practice
(2005) · PsycEXTRA Dataset · doi:10.1037/e582372010-001 · Cited by 228
Henggeler, S. W., Schoenwald, S. K., Liao, J., Letourneau, E. J., & Edwards, D. L. (2002) · Journal of Clinical Child & Adolescent Psychology · doi:10.1207/s15374424jccp3102_02 · Cited by 224
Raghavan, R., Bright, C. L., & Shadoin, A. L. (2008) · Implementation Science · doi:10.1186/1748-5908-3-26 · Cited by 205
Evidence-Based Practice at a Crossroads
Barth, R. P., Lee, B. R., Lindsey, M. A., Collins, K. S., Strieder, F. H., Chorpita, B. F., Becker, K. D., & Sparks, J. A. (2011) · Research on Social Work Practice · doi:10.1177/1049731511408440 · Cited by 198
Mixed-Methods Designs in Mental Health Services Research: A Review
Palinkas, L. A., Horwitz, S. M., Chamberlain, P., Hurlburt, M. S., & Landsverk, J. A. (2011) · Psychiatric Services · doi:10.1176/ps.62.3.pss6203_0255 · Cited by 195
Brekke, J. S., Ell, K., & Palinkas, L. A. (2006) · Research on Social Work Practice · doi:10.1177/1049731506293693 · Cited by 185
Show Me, Don’t Tell Me: Behavioral Rehearsal as a Training and Analogue Fidelity Tool
Beidas, R. S., Cross, W. F., & Dorsey, S. (2013) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2013.04.002 · Cited by 176
Teacher key opinion leaders and mental health consultation in low-income urban schools.
Atkins, M. S., Frazier, S. L., Leathers, S. J., Graczyk, P. A., Talbott, E., Jakobsons, L., Adil, J. A., Marinez-Lora, A., Demirtas, H., Gibbons, R. B., et al. (2008) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0013036 · Cited by 174
Implementing Evidence-Based Practice
Gray, M., Joy, E., Plath, D., & Webb, S. A. (2012) · Research on Social Work Practice · doi:10.1177/1049731512467072 · Cited by 170
Writing implementation research grant proposals: ten key ingredients
Proctor, E. K., Powell, B. J., Baumann, A. A., Hamilton, A. M., & Santens, R. L. (2012) · Implementation Science · doi:10.1186/1748-5908-7-96 · Cited by 169
Self-citationMitchell, D. (1919) · The Journal of Abnormal Psychology · doi:10.1037/h0073493 · Cited by 166
Linking Sustainability Research to Intervention Types
Scheirer, M. A. (2013) · American Journal of Public Health · doi:10.2105/ajph.2012.300976 · Cited by 161
The State Policy Context of Implementation Issues for Evidence-Based Practices in Mental Health
Isett, K. R., Burnam, M. A., Coleman-Beattie, B., Hyde, P. S., MORRISSEY, J. P., Magnabosco, J. L., Rapp, C. A., Ganju, V. K., & Goldman, H. H. (2007) · Psychiatric Services · doi:10.1176/ps.2007.58.7.914 · Cited by 146
Dissemination of the Coping Power program: Importance of intensity of counselor training.
Lochman, J. E., Boxmeyer, C. L., Powell, N. P., Lixin Qu, A., Wells, K., & Windle, M. T. (2009) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0014514 · Cited by 146
Shortell, S. M. (2004) · Medical Care Research and Review · doi:10.1177/1077558704266768 · Cited by 145
Cognitive and behavioral practice
Davis, D. D., & Peterson, L. (1994) · Cognitive and Behavioral Practice · doi:10.1016/s1077-7229(05)80083-5 · Cited by 142
Williams, E. C., Johnson, M. L., Lapham, G. T., Caldeiro, R. M., Chew, L., Fletcher, G. S., McCormick, K. A., Weppner, W. G., & Bradley, K. A. (2011) · Psychology of Addictive Behaviors · doi:10.1037/a0022102 · Cited by 138
Zima, B. T., Hurlburt, M. S., Knapp, P., Ladd, H., Tang, L., Duan, N., Wallace, P., Rosenblatt, A., Landsverk, J., & Wells, K. B. (2005) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-200502000-00005 · Cited by 117
Palinkas, L. A., Schoenwald, S. K., Hoagwood, K., Landsverk, J. A., Chorpita, B. F., & Weisz, J. R. (2008) · Psychiatric Services · doi:10.1176/ps.2008.59.7.738 · Cited by 109
Systematic review of economic evaluations and cost analyses of guideline implementation strategies
Vale, L., Thomas, R., MacLennan, G., & Grimshaw, J. (2007) · The European Journal of Health Economics · doi:10.1007/s10198-007-0043-8 · Cited by 107
Advancing the application, quality and harmonization of implementation science measures
Rabin, B. A., Purcell, P., Naveed, S., Moser, R. P., Henton, M. D., Proctor, E. K., Brownson, R. C., & Glasgow, R. E. (2012) · Implementation Science · doi:10.1186/1748-5908-7-119 · Cited by 106
Self-citationKauth, M. R., Sullivan, G., Blevins, D., Cully, J. A., Landes, R. D., Said, Q., & Teasdale, T. A. (2010) · Implementation Science · doi:10.1186/1748-5908-5-75 · Cited by 98
Landsverk, J. A., Brown, C. H., Rolls-Reutz, J., Palinkas, L. A., & Horwitz, S. M. (2010) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0315-y · Cited by 94
Magnabosco, J. L. (2006) · Implementation Science · doi:10.1186/1748-5908-1-13 · Cited by 90
Ebert, L., Amaya-Jackson, L. M., Markiewicz, J. M., Kisiel, C., & Fairbank, J. A. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-011-0347-y · Cited by 89
Practitioner Expertise in Evidence-Based Practice Decision Making
Mccracken, S., & Marsh, J. (2008) · Research on Social Work Practice · doi:10.1177/1049731507308143 · Cited by 87
Measurement Issues in Dissemination and Implementation Research
Proctor, E. K., & Brownson, R. C. (2012) · Dissemination and Implementation Research in HealthTranslating Science to Practice · doi:10.1093/acprof:oso/9780199751877.003.0013 · Cited by 87
Self-citationGrypma, L., Haverkamp, R., Little, S., & Unützer, J. (2006) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2005.10.008 · Cited by 86
Raghavan, R., Inoue, M., Ettner, S. L., Hamilton, B. H., & Landsverk, J. (2010) · American Journal of Public Health · doi:10.2105/ajph.2008.151472 · Cited by 83
The Role of Organizational Processes in Dissemination and Implementation Research
Aarons, G. A., Moullin, J. C., & Ehrhart, M. G. (2017) · Oxford University Press eBooks · doi:10.1093/oso/9780190683214.003.0008 · Cited by 82
Methods and metrics challenges of delivery-system research
Alexander, J. A., & Hearld, L. R. (2012) · Implementation Science · doi:10.1186/1748-5908-7-15 · Cited by 78
Cascading implementation of a foster and kinship parent intervention.
Chamberlain, P., Price, J. M., Reid, J. B., & Landsverk, J. A. (2008) · PubMed · Cited by 74
Powell, B. J., Proctor, E. K., Glisson, C. A., Kohl, P. L., Raghavan, R., Brownson, R. C., Stoner, B. P., Carpenter, C. R., & Palinkas, L. A. (2013) · Implementation Science · doi:10.1186/1748-5908-8-92 · Cited by 71
Self-citationAzocar, F., Cuffel, B., Goldman, W., & McCarter, L. (2005) · Journal of Behavioral Health Services & Research · doi:10.1007/bf02287816 · Cited by 61
Evaluation of a Treatment Manual and Workshops for Disseminating, Parent–Child Interaction Therapy
Herschell, A. D., McNeil, C. B., Urquiza, A. J., McGrath, J. M., Zebell, N. M., Timmer, S. G., & Porter, A. (2008) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-008-0194-7 · Cited by 57
Ngo, V. K., Asarnow, J. R., Lange, J. M., Jaycox, L. H., Rea, M. M., Landon, C., Tang, L., & Miranda, J. M. (2009) · Psychiatric Services · doi:10.1176/ps.2009.60.10.1357 · Cited by 55
The Role of Organizational Processes in Dissemination and Implementation Research
Aarons, G. A., Horowitz, J. D., Dlugosz, L. R., & Ehrhart, M. G. (2012) · Dissemination and Implementation Research in HealthTranslating Science to Practice · doi:10.1093/acprof:oso/9780199751877.003.0007 · Cited by 52
The Role of Economic Evaluation in Dissemination and Implementation Research
Raghavan, R. (2012) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199751877.003.0005 · Cited by 49
Evidence-based practice and clinical social work
Thyer, B. A. (2002) · Evidence-Based Mental Health · doi:10.1136/ebmh.5.1.6 · Cited by 42
Supported local implementation of clinical guidelines in psychiatry: a two-year follow-up
Forsner, T., Wistedt, A. Å., Brommels, M., Janszky, I., de León, A. P., & Forsell, Y. (2010) · Implementation Science · doi:10.1186/1748-5908-5-4 · Cited by 39
Selecting, Tailoring, and implementing knowledge translation interventions
Wensing, M., Bosch, M., & Grol, R. P. T. M. (2009) · Cited by 39
Knowledge Translation in Mental Health: A Scoping Review
Goldner, E. M., Jeffries, V., Bilsker, D., Jenkins, E., Menear, M., & Petermann, L. (2011) · Healthcare policy · doi:10.12927/hcpol.2011.22620 · Cited by 37
Parent Training: Implementation Strategies for Adventures in Parenting
Bert, S. C., Farris, J. R., & Borkowski, J. G. (2008) · The Journal of Primary Prevention · doi:10.1007/s10935-008-0135-y · Cited by 35
Kramer, T. L., & Burns, B. J. (2008) · Implementation Science · doi:10.1186/1748-5908-3-14 · Cited by 30
Asarnow, J. R., Jaycox, L. H., Duan, N., LaBorde, A. P., Rea, M. M., Murray, P., Anderson, M., Landon, C., Tang, L., & Wells, K. B. (2005) · JAMA · doi:10.1001/jama.293.3.311 · Cited by 27
Powell, B. J., McMillen, J. C., Hawley, K. M., & Proctor, E. K. (2013) · Psychiatric Services · doi:10.1176/appi.ps.003602012 · Cited by 26
Self-citationEvidence-Based Clearinghouses in Social Work
Soydan, H., Mullen, E. J., Alexandra, L., Rehnman, J., & Li, Y. (2010) · Research on Social Work Practice · doi:10.1177/1049731510367436 · Cited by 25
The State of Parent Training: Program Offerings and Empirical Support
Kohl, P. L., Schurer, J., & Bellamy, J. L. (2009) · Families in Society The Journal of Contemporary Social Services · doi:10.1606/1044-3894.3894 · Cited by 24
Consumers and families as partners in implementing evidence-based practice
Birkel, R. C., Hall, L. L., Lane, T., McNulty, K. C., & Miller, J. E. (2003) · Psychiatric Clinics of North America · doi:10.1016/s0193-953x(03)00065-0 · Cited by 20
Spoont, M. R., Greer, N. L., Su, J. W., Fitzgerald, P., Rutks, I. R., & Wilt, T. J. (2011) · Cited by 13
The Role of Economic Incentives in Improving the Quality of Mental Health Care
Ettner, S. L., & Schoenbaum, M. (2006) · Edward Elgar Publishing eBooks · doi:10.4337/9781845428914.00039 · Cited by 11
Dissemination and Implementation in Social Service Settings
McMillen, C. J. (2012) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199751877.003.0018 · Cited by 5
Research works printed but not linked: 11
- References marked with an asterisk indicate studies included in the systematic review.
- *Chamberlain P., 2008, Child Welfare, 87, 27
- Cochrane Effective Practice and Organisation of Care Group. (2002a). Data collection checklist (pp. 1–30). Retrieved from http://epoc.cochrane.org/sites/epoc.cochrane.org/files/uploads/datacollectionchecklist.pdf
- Gibbs L. E., 2003, Evidence-based practice for the helping professions
- Goldner E. M., 2011, Healthcare Policy, 7, 83
- Institute of Medicine, 2007, The state of quality improvement and implementation research: Workshop summary
- *Kauth M. R., 2010, Implementation Science, 5, 1, 10.1186/1748-5908-5-1 · DOI · Paper page
- National Institute of Mental Health, 2008, National Institute of Mental Health strategic plan
- Oxman A. D., 1995, Canadian Medical Association Journal, 153, 1424
- President’s New Freedom Commission on Mental Health, 2003, Achieving the promise: Transforming mental health care in America: Final report
- Wensing M., 2009, Knowledge translation in health care: Moving from evidence to practice, 94
Cited by
Sorted by citations
Methods to Improve the Selection and Tailoring of Implementation Strategies
Powell, B. J., Beidas, R. S., Lewis, C. C., Aarons, G. A., McMillen, J. C., Proctor, E. K., & Mandell, D. S. (2017) · The Journal of Behavioral Health Services & Research · doi:10.1007/s11414-015-9475-6 · Cited by 967
Self-citationAguirre Velasco, A., Cruz, I. S. S., Billings, J., Jimenez, M., & Rowe, S. (2020) · BMC Psychiatry · doi:10.1186/s12888-020-02659-0 · Cited by 736
“For this the theme of contextualization is fundamental and the specificities of the process of implementation (planning, engaging, executing, reflecting and evaluating) [126, 127].”
Lewis, C. C., Klasnja, P., Powell, B. J., Lyon, A. R., Tuzzio, L., Jones, S., Walsh-Bailey, C., & Weiner, B. (2018) · Frontiers in Public Health · doi:10.3389/fpubh.2018.00136 · Cited by 588
Self-citationBirken, S. A., Powell, B. J., Shea, C. M., Haines, E. R., Alexis Kirk, M., Leeman, J., Rohweder, C., Damschroder, L., & Presseau, J. (2017) · Implementation Science · doi:10.1186/s13012-017-0656-y · Cited by 471
Self-citationReframing implementation science to address inequities in healthcare delivery
Baumann, A. A., & Cabassa, L. J. (2020) · BMC Health Services Research · doi:10.1186/s12913-020-4975-3 · Cited by 479
Metadata
- Authors
- Powell, B. J., Proctor, E. K., & Glass, J. E.
- Affiliations
- Washington University in St. Louis (US)
- University of Wisconsin–Madison (US)
- Corresponding author
- Powell, Byron J.
- Venue
- Research on Social Work Practice
- Publisher
- SAGE Publications
- Published
- 2013-10-08
- Volume
- 24
- Issue
- 2
- Pages
- 192-212
- ISSN
- 1049-7315 (ISSN-L)
- 1552-7581
- PMC
- PMC4002057
- OpenAlex
- W2046149030
- Semantic Scholar
- 8f506d0a995878915bf1933974516664dc87746c
- Cited by
- 268
- References
- 120
- Citations by year
- 2026: 8 · 2025: 22 · 2024: 24 · 2023: 20 · 2022: 31 · 2021: 38 · 2020: 28 · 2019: 18 · 2018: 19 · 2017: 19 · 2016: 15 · 2015: 25 · 2014: 1
- FWCI
- 1.65
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Research on Social Work Practice (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institutes of Health (UL1TR000448, TL1TR000449, 5p30mh068579-05)
- National Institute on Alcohol Abuse and Alcoholism (F31AA021034)
- National Institute of Mental Health (P30-MH-068579, F31MH098478, T32MH019960)
- National Institute on Drug Abuse (T32DA015035)
- National Center for Research Resources (TL1RR024995, UL1RR024992)
- National Center for Advancing Translational Sciences
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Social Sciences › Psychology › Clinical Psychology › Psychiatric care and mental health services
- Keywords
- implementation strategies, empirically supported treatments, mental health interventions, implementation research, intervention effectiveness, mental health services
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-07, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-07 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
