A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project
Open accessThe DOI matches its Crossref record; 61 of the 62 references it cites were found in a registry or an index; 15 of the 30 sources its claims cite were checked for support.
Abstract
BACKGROUND: Identifying, developing, and testing implementation strategies are important goals of implementation science. However, these efforts have been complicated by the use of inconsistent language and inadequate descriptions of implementation strategies in the literature. The Expert Recommendations for Implementing Change (ERIC) study aimed to refine a published compilation of implementation strategy terms and definitions by systematically gathering input from a wide range of stakeholders with expertise in implementation science and clinical practice. METHODS: Purposive sampling was used to recruit a panel of experts in implementation and clinical practice who engaged in three rounds of a modified Delphi process to generate consensus on implementation strategies and definitions. The first and second rounds involved Web-based surveys soliciting comments on implementation strategy terms and definitions. After each round, iterative refinements were made based upon participant feedback. The third round involved a live polling and consensus process via a Web-based platform and conference call. RESULTS: Participants identified substantial concerns with 31% of the terms and/or definitions and suggested five additional strategies. Seventy-five percent of definitions from the originally published compilation of strategies were retained after voting. Ultimately, the expert panel reached consensus on a final compilation of 73 implementation strategies. CONCLUSIONS: This research advances the field by improving the conceptual clarity, relevance, and comprehensiveness of implementation strategies that can be used in isolation or combination in implementation research and practice. Future phases of ERIC will focus on developing conceptually distinct categories of strategies as well as ratings for each strategy's importance and feasibility. Next, the expert panel will recommend multifaceted strategies for hypothetical yet real-world scenarios that vary by sites' endorsement of evidence-based programs and practices and the strength of contextual supports that surround the effort.
Overview
CoChat Summary
TL;DR
This paper reports the ERIC project’s modified Delphi process to refine a published compilation of implementation strategy terms and definitions through expert consensus. The result is a final compilation of 73 discrete implementation strategies, with 75% of original definitions retained after voting.
Key findings
- A panel of 71 experts participated across three modified Delphi rounds; round participation was 57, 43, and 40 experts, respectively.
- Participants identified substantial concerns with 31% of the original terms and/or definitions and suggested five additional strategies.
- Seventy-five percent of definitions from the original Powell et al. compilation were retained after voting, and the final compilation included 73 discrete implementation strategies.
- Of 21 alternative definitions suggested, an alternative was selected 81% of the time and the original definition was maintained 19% of the time; all five new strategies were retained in some form, with an average 84% vote to retain (range 100–71%).
Methods
- Purposive sampling recruited an expert panel of 71 implementation and clinical practice experts, mostly from the USA, with some Canadian affiliation.
- A three-round modified Delphi process was used: two Web-based surveys for feedback and iterative refinement, followed by a live Web-based polling and consensus meeting.
- Consensus voting used approval voting with a ≥60% supermajority threshold, followed by structured discussion and runoff voting when no clear winner emerged.
Limitations
- The paper states that using a different starting taxonomy may have yielded different results; the panel was limited to North America and mostly USA experts; online rather than in-person meetings may have produced less nuanced discussion; and some participants abstained from Round 3 voting for unknown reasons.
- The paper also states content limitations: the evidence base for each strategy was not considered, strategies were not explicitly tied to theories or conceptual models, and some strategies may be more applicable to US or North American settings.
- Evident from the text: the compilation is not intended as a checklist, and the authors note that no implementation effort could feasibly use every strategy; future research is needed to identify contexts and circumstances under which each discrete strategy is effective.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
![Figure 1 Overview of the voting process in the final round of the modified Delphi task. In the third and final round of the modified Delphi task, expert panelists will vote on all strategies where concerns were raised regarding the core definition in the first two online survey rounds. For each strategy, the original and proposed alternate definitions will be presented for an approval poll where participants can vote to approve all definition alternatives they find acceptable. In the first round of voting, if one definition receives a supermajority of votes (≥60%) and receives more votes than all others, that definition will be declared the winner and the poll will move to the next term. If there is no consensus, a 5-min discussion period is opened. When the discussion concludes, a runoff poll is conducted to determine the most acceptable definition alternative [13].](https://figures.cochat.ai/paper-figures/92946ab952d24e4a9b9a287e8a399838/a-refined-compilation-of-implementation-strategies-results-from-the-expert-figure-1.jpg)
Verification
Claims the paper makes
9 Valid · 0 Not valid · 8 Not checked · 53 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Second, published descriptions of implementation strategies too often do not include sufficient detail to enable either scientific or real-world replication [1,6]”
§ A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project > Background
What the sources say
- Could not verifycites [1] Proctor EK, Powell BJ, McMillen JC. Implementation strategies: recommendations for specifying and reporting. Implement Sci. 2013;8:1–11. sourceExperimental — accuracy not yet measured
Our copy of SENTRY contains no statement that published descriptions of implementation strategies lack sufficient detail for scientific or real-world replication; searched for replication/reproduce, intervention description detail, fidelity, reporting checklist, and generalizability. The closest passages are different points: the Background (p. n/a) notes prior single-centre and high-tech KT studies whose results 'are not applicable to hospitals without the required computer infrastructure' and whose generalizability remains untested, and the Discussion (p. n/a) concedes 'the lack of data on fidelity in the intervention group (i.e., the extent to which the intervention components were used/received as intended)' in their own trial. Neither addresses the adequacy of published reporting of implementation strategies, so this source neither supports nor contradicts the attributed claim. (LLM, conf=0.70)
- Supportedcites [6] Michie S, Fixsen DL, Grimshaw JM, Eccles MP. Specifying and reporting complex behaviour change interventions: the need for a scientific method. Implement Sci. 2009;4:1–6. source
The 'Interventions aren't described' section (What is the problem?) states that published intervention evaluations 'are seldom reported by researchers or practitioners in enough detail to replicate them', and that researchers were less confident they could replicate behavioural interventions and judged they would need more information to deliver them in practice settings — covering both scientific and real-world replication. The Abstract reinforces this: complex behaviour change interventions 'are not well described; when they are described, the terminology used is inconsistent. This constrains scientific replication, and limits the subsequent introduction of successful interventions.' The only slight shift is terminological: this source speaks of 'behaviour change interventions' rather than 'implementation strategies', which the paired citation [6] presumably covers. (LLM, conf=0.88)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“However, efforts to identify, develop, and test implementation strategies have been complicated by a lack of conceptual clarity [1,6-9].”
§ A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project > Background
What the sources say
- Could not verifycites [1] Proctor EK, Powell BJ, McMillen JC. Implementation strategies: recommendations for specifying and reporting. Implement Sci. 2013;8:1–11. sourceExperimental — accuracy not yet measured
The Background describes how the SENTRY intervention was developed, and the Discussion identifies practical barriers to testing and scaling it. The Results say that clinical risk terms such as “immobility” and “sepsis” needed clearer definitions, but no passage found in the search addresses a lack of conceptual clarity about implementation strategies as a complication in identifying, developing, or testing them. (LLM, conf=0.73)
- Supportedcites [6] Michie S, Fixsen DL, Grimshaw JM, Eccles MP. Specifying and reporting complex behaviour change interventions: the need for a scientific method. Implement Sci. 2009;4:1–6. source
In “What is the problem? > Interventions aren't described” (page unavailable), the paper says interventions are often based on unstated or weakly applied models, leaving each new intervention and evaluation relatively isolated. It also says inconsistent terminology makes interventions difficult to distinguish and limits synthesis. Together, these passages support the claim that a lack of conceptual clarity complicates developing and testing implementation strategies. (LLM, conf=0.86)
- Partly supportedcites [7] McKibbon KA, Lokker C, Wilczynski NL, Ciliska D, Dobbins M, Davis DA, et al. A cross-sectional study of the number and frequency of terms used to refer to knowledge translation in a body of health literature in 2006: a tower of Babel? Implement Sci. 2010;5:1–11. sourceExperimental — accuracy not yet measured
The Discussion (page unavailable) reports inconsistent terminology and definitions in knowledge translation and says this makes relevant research harder to find and understand. It does not specifically establish that this lack of clarity has complicated identifying, developing, or testing implementation strategies. (LLM, conf=0.84)
- Could not verifycites [8] Colquhoun H, Leeman J, Michie S, Lokker C, Bragge P, Hempel S, et al. Towards a common terminology: a simplified framework of interventions to promote and integrate evidence into health practices, systems, and policies. Implement Sci. 2014;9:1–6. sourceExperimental — accuracy not yet measured
The Background discusses factors affecting de-implementation and proposes a framework for prioritizing healthcare practices. The Empirical testing section discusses testing health policies, but neither section says that a lack of conceptual clarity has complicated efforts to identify, develop, or test implementation strategies. Searches for that phrase and related terms found no supporting passage in our copy. (LLM, conf=0.72)
- Supportedcites [9] Waltz TJ, Powell BJ, Chinman MJ, Smith JL, Matthieu MM, Proctor EK, et al. Expert Recommendations for Implementing Change (ERIC): protocol for a mixed methods study. Implement Sci. 2014;9:1–12. source
The Background section, “Lack of conceptual clarity for implementation strategies” (page not provided), says inconsistent terms and definitions hinder interpretation of research, synthesis, and replication. This supports the claim that conceptual ambiguity complicates work to identify, develop, and test implementation strategies. (LLM, conf=0.90)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“First, terms and definitions for implementation strategies are inconsistent [7,10].”
§ A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project > Background
What the sources say
- Partly supportedcites [7] McKibbon KA, Lokker C, Wilczynski NL, Ciliska D, Dobbins M, Davis DA, et al. A cross-sectional study of the number and frequency of terms used to refer to knowledge translation in a body of health literature in 2006: a tower of Babel? Implement Sci. 2010;5:1–11. sourceExperimental — accuracy not yet measured
The Discussion reports inconsistent use of terms in articles about knowledge translation, and the Summary calls for standardizing terms and definitions. The study examines terminology for knowledge translation generally, however; it does not establish that definitions of implementation strategies specifically are inconsistent. The supplied copy gives section labels but no page numbers. (LLM, conf=0.83)
- Supportedcites [10] Powell BJ, McMillen JC, Proctor EK, Carpenter CR, Griffey RT, Bunger AC, et al. A compilation of strategies for implementing clinical innovations in health and mental health. Med Care Res Rev. 2012;69:123–57. source
The Introduction says implementation strategies are rarely defined and that the terminology used to describe them is inconsistent. The Limitations section likewise describes improving consistency and clarity as an unfinished task. (LLM, conf=0.94)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Powell et al. [10] proposed a consolidated compilation of 68 discrete (as opposed to multifaceted) implementation strategies and definitions based upon a review of the health and mental health literatures.”
§ A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project > Background
What the sources say
- Supportedcites [10] Powell BJ, McMillen JC, Proctor EK, Carpenter CR, Griffey RT, Bunger AC, et al. A compilation of strategies for implementing clinical innovations in health and mental health. Med Care Res Rev. 2012;69:123–57. source
The Abstract states that the authors present a consolidated compilation of 68 discrete implementation strategies and definitions based on a review of 205 sources. The Introduction identifies health and mental health as the fields covered, and the Discussion distinguishes the discrete strategies from multifaceted implementation plans. (LLM, conf=0.95)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Powell et al. [10] reviewed 41 compilations and reviews of implementation strategies and summarized them according to their foci and disciplines/clinical specialties that they represented”
§ A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project > Background
What the sources say
- Supportedcites [10] Powell BJ, McMillen JC, Proctor EK, Carpenter CR, Griffey RT, Bunger AC, et al. A compilation of strategies for implementing clinical innovations in health and mental health. Med Care Res Rev. 2012;69:123–57. source
The Methods (Sources Identified) state that among the 205 sources identified, 41 were 'compilations, taxonomies, or reviews of multiple strategies', and the Introduction states 'For illustrative purposes, we provide brief summaries of 41 reviews and compilations of implementation strategies in Table 1.' The same Introduction section characterizes those sources by their foci — narrow scope on strategies with known effectiveness evidence, on 'specific medical conditions, fields of practice or disciplines', on a setting/study, exemplar programs, one level of target, or one type of strategy — which matches the claim's 'foci and disciplines/clinical specialties'. Only caveat: our copy does not reproduce Table 1's column headings, and the paper's overall review covered 205 sources rather than 41 alone. (LLM, conf=0.85)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
17 more claims · 3 with their cited sources checked
Create a free account to see all 70 claims and to verify the 15 references still open.
- Probably not a substantial claim. 40
- It may state two separate claims as one. 23
- The quote only partly states this claim. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In 2015, the Expert Recommendations for Implementing Change (ERIC) study organized a panel of implementation scientists to compile a standardized set of implementation strategy terms and definitions [2–4].”
From A systematic review of experimentally tested implementation strategies across health and human service settings: evidence from 2010-2022 (2024) · cites this paper as [2]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“While there has been a rapid increase in the number of implementation trials over the past decade, the quality of trials has been criticised, and the effects of the strategies for such trials on implementation, patient or public health outcomes have been modest [11–13].”
From Guidance for conducting feasibility and pilot studies for implementation trials (2020) · cites this paper as [12]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The implementation of a new model of care is an ongoing process, usually lasting between 2 and 4 years [21,22].”
From Implementation of Brief Admission by Self-Referral in Child and Adolescent Psychiatry in Sweden: Insights from Implementers and Staff (2023) · cites this paper as [22]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Second, the operations manager was confident about the project, with an attitude that spread throughout the organization and helped us obtain a supportive organization [22].”
From Implementation of Brief Admission by Self-Referral in Child and Adolescent Psychiatry in Sweden: Insights from Implementers and Staff (2023) · cites this paper as [22]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Several resources can inform the use of implementation strategies, including established taxonomies of implementation strategies (6, 7, 24, 25) and behavior change techniques (27, 28), repositories of systematic reviews (38, 103, 104), methods for selecting and tailoring implementation strategies (40, 55, 56), and reporting guidelines that promote replicability (4, 98–100).”
From Enhancing the Impact of Implementation Strategies in Healthcare: A Research Agenda (2019) · cites this paper as [7]
11 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496 · cited 3×
“, the Consolidated Framework for Implementation Research [47], Theoretical Domains Framework [48,49], Promoting Action on Research Implementation in Health Services (PARIHS) framework [50]).”
MethodSelf-citationPalinkas, L. A., Horwitz, S. M., Green, C. A., Wisdom, J. P., Duan, N., & Hoagwood, K. (2015) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-013-0528-y · Cited by 12,038
Crossing the Quality Chasm: A New Health System for the 21st Century
Baker, A. (2001) · BMJ · doi:10.1136/bmj.323.7322.1192 · Cited by 10,736
Crossing the Quality Chasm: A New Health System for the 21st Century
Committee on Quality of Health Care in America (2002) · Journal For Healthcare Quality · doi:10.1111/j.1945-1474.2002.tb00463.x · Cited by 8,483
Cane, J., O’Connor, D., & Michie, S. (2012) · Implementation Science · doi:10.1186/1748-5908-7-37 · Cited by 4,888 · cited 2×
“, the Consolidated Framework for Implementation Research [47], Theoretical Domains Framework [48,49], Promoting Action on Research Implementation in Health Services (PARIHS) framework [50]).”
MethodFrom best evidence to best practice: effective implementation of change in patients' care
Grol, R., & Grimshaw, J. (2003) · The Lancet · doi:10.1016/s0140-6736(03)14546-1 · Cited by 4,531
Making psychological theory useful for implementing evidence based practice: a consensus approach
Michie, S. (2005) · Quality and Safety in Health Care · doi:10.1136/qshc.2004.011155 · Cited by 3,440 · cited 2×
“, the Consolidated Framework for Implementation Research [47], Theoretical Domains Framework [48,49], Promoting Action on Research Implementation in Health Services (PARIHS) framework [50]).”
MethodImplementation strategies: recommendations for specifying and reporting
Proctor, E. K., Powell, B. J., & McMillen, J. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-139 · Cited by 2,585 · cited 6×
“Taken together, these two deficiencies complicate the acquisition and interpretation of knowledge, preclude research syntheses such as systematic reviews and meta-analyses, limit replication in both research and practice, and ultimately stymie the translation and application of empirical studies that could inform impl…”
BackgroundMethodInfluentialSelf-citationBero, L. A., Grilli, R., Grimshaw, J. M., Harvey, E., Oxman, A. D., & Thomson, M. A. (1998) · BMJ · doi:10.1136/bmj.317.7156.465 · Cited by 2,396
Welcome to Implementation Science
Eccles, M. P., & Mittman, B. S. (2006) · Implementation Science · doi:10.1186/1748-5908-1-1 · Cited by 2,254
Research works printed but not linked: 4
- Cochrane Effective Practice and Organisation of Care Group. Data collection checklist. 2002. p. 1–30.
- Walter I, Nutley S, Davies H. Developing a taxonomy of interventions used to increase the impact of research. Andrews: University of St. Andrews of St. Andrews; 2003.
- Ryan R, Lowe D, Santesso N, Hill S. Development of a taxonomy of interventions directed at consumers to promote evidence-based prescribing and medicines use: a tool for evidence-based decision-making. Melbourne, Australia: In National Medicines Symposium; 2010.
- Shojania KG, McDonald KM, Wachter RM, Owens DK. Closing the quality gap: a critical analysis of quality improvement strategies, volume 1—series overview and methodology. Technical review 9. Agency for Healthcare Research and Quality: Rockville, MD; 2004.
Cited by
The updated consolidated framework for implementation research based on user feedback
Damschroder, L. J., Reardon, C. M., Widerquist, M. A. O., & Lowery, J. (2022) · Implementation Science · doi:10.1186/s13012-022-01245-0 · Cited by 4,452
“Distinguish the innovation (the “thing” that continues when implementation is complete) [20, 25] from the implementation process and strategies used to implement the innovation [26, 27] (activities that end after implementation is complete) [28].”
MethodInfluentialSelf-citationPsychometric assessment of three newly developed implementation outcome measures
Weiner, B. J., Lewis, C. C., Stanick, C., Powell, B. J., Dorsey, C. N., Clary, A. S., Boynton, M. H., & Halko, H. (2017) · Implementation Science · doi:10.1186/s13012-017-0635-3 · Cited by 2,819
“These outcomes are relevant to assessing stakeholders’ perceptions of clinical and public health interventions, as well as assessing perceptions of implementation strategies, which are often complex interventions in and of themselves [1, 32, 33].”
BackgroundSelf-citationKronenberg, F., Mora, S., Stroes, E. S. G., Ference, B. A., Arsenault, B. J., Berglund, L., Dweck, M. R., Koschinsky, M., Lambert, G., Mach, F., et al. (2022) · European Heart Journal · doi:10.1093/eurheartj/ehac361 · Cited by 1,449
“Increasing general awareness and training a wide spectrum of healthcare and laboratory practitioners regarding the importance of managing elevated Lp(a) are essential (Table 3 and Supplementary material online, Figure S6).(208) Table 3 Suggested recommendations for implementing better care of elevated lipoprotein(a)”
BackgroundWaltz, T. J., Powell, B. J., Fernández, M. E., Abadie, B., & Damschroder, L. J. (2019) · Implementation Science · doi:10.1186/s13012-019-0892-4 · Cited by 1,136
Self-citationWaltz, T. J., Powell, B. J., Matthieu, M. M., Damschroder, L. J., Chinman, M. J., Smith, J. L., Proctor, E. K., & Kirchner, J. E. (2015) · Implementation Science · doi:10.1186/s13012-015-0295-0 · Cited by 1,108
“Method A purposive sampling procedure was used to recruit an expert panel of implementation science and clinical experts (N = 35) to participate in concept mapping and rating tasks [9, 10].”
MethodSelf-citation
Metadata
- Authors
- Powell, B. J., Waltz, T. J., Chinman, M. J., Damschroder, L. J., Smith, J. L., Matthieu, M. M., Proctor, E. K., & Kirchner, J. E.
- Affiliations
- University of Pennsylvania (US)
- Eastern Michigan University (US)
- RAND Corporation (US)
- VA Ann Arbor Healthcare System (US)
- Central Arkansas Veterans Healthcare System (US)
- Washington University in St. Louis (US)
- Corresponding author
- Powell, Byron J
- ORCID
- Venue
- Implementation Science
- Published
- 2015-02-12
- Volume
- 10
- Issue
- 1
- Pages
- 21-21
- ISSN
- 1748-5908 (ISSN-L)
- PMC
- PMC4328074
- OpenAlex
- W2010049072
- Cited by
- 4,963
- References
- 62
- Citations by year
- 2026: 687 · 2025: 734 · 2024: 800 · 2023: 659 · 2022: 645 · 2021: 576 · 2020: 357 · 2019: 217 · 2018: 142 · 2017: 77 · 2016: 43 · 2015: 20
- FWCI
- 171.87
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- Implementation Science (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- U.S. Department of Veterans Affairs (VISN4 MIRECC)
- Doris Duke Charitable Foundation
- Purdue University
- University of Pennsylvania
- Health Services Research and Development (QLP 55-025)
- University of Minnesota (55-025)
- Washington University in St. Louis
- University of Washington
- Johns Hopkins University
- Indiana University-Purdue University Indianapolis
- University of Arkansas for Medical Sciences
- Fahs-Beck Fund for Research and Experimentation
- Saint Louis University
- University of Massachusetts Boston
- Eastern Michigan University
- University of Toronto
- Quality Enhancement Research Initiative
- University of California, Los Angeles
- Perelman School of Medicine, University of Pennsylvania
- VISN 4 Mental Illness Research, Education, and Clinical Center
- National Institute of Mental Health (F31MH098478)
- National Institute of Diabetes and Digestive and Kidney Diseases (P30DK092950)
- NIH Clinical Center
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Keywords
- implementation strategies, Expert Recommendations for Implementing Change, terminology and definitions, expert consensus, Delphi method, stakeholder feedback, contextual support
- MeSH terms
- Delphi Technique, Humans, Organizational Innovation, Program Development, Quality Improvement
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-05, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-05 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. https://app.cochat.ai/papers/10.1186/s13012-015-0209-1
- The paper
- Powell, B. J., Waltz, T. J., Chinman, M. J., Damschroder, L. J., Smith, J. L., Matthieu, M. M., Proctor, E. K., & Kirchner, J. E. (2015). A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implementation Science. https://doi.org/10.1186/s13012-015-0209-1
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.