The DOI matches its Crossref record; 18 of the 19 references it cites were found in a registry or an index.
Using the Consolidated Framework for Implementation Research (CFIR) to produce actionable findings: a rapid-cycle evaluation approach to improving implementation
Open accessAbstract
BACKGROUND: Much research does not address the practical needs of stakeholders responsible for introducing health care delivery interventions into organizations working to achieve better outcomes. In this article, we present an approach to using the Consolidated Framework for Implementation Research (CFIR) to guide systematic research that supports rapid-cycle evaluation of the implementation of health care delivery interventions and produces actionable evaluation findings intended to improve implementation in a timely manner. METHODS: To present our approach, we describe a formative cross-case qualitative investigation of 21 primary care practices participating in the Comprehensive Primary Care (CPC) initiative, a multi-payer supported primary care practice transformation intervention led by the Centers for Medicare and Medicaid Services. Qualitative data include observational field notes and semi-structured interviews with primary care practice leadership, clinicians, and administrative and medical support staff. We use intervention-specific codes, and CFIR constructs to reduce and organize the data to support cross-case analysis of patterns of barriers and facilitators relating to different CPC components. RESULTS: Using the CFIR to guide data collection, coding, analysis, and reporting of findings supported a systematic, comprehensive, and timely understanding of barriers and facilitators to practice transformation. Our approach to using the CFIR produced actionable findings for improving implementation effectiveness during this initiative and for identifying improvements to implementation strategies for future practice transformation efforts. CONCLUSIONS: The CFIR is a useful tool for guiding rapid-cycle evaluation of the implementation of practice transformation initiatives. Using the approach described here, we systematically identified where adjustments and refinements to the intervention could be made in the second year of the 4-year intervention. We think the approach we describe has broad application and encourage others to use the CFIR, along with intervention-specific codes, to guide the efficient and rigorous analysis of rich qualitative data. TRIAL REGISTRATION: NCT02318108.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Some implementers and evaluators have reported struggling to translate the complex and sometimes repetitive construct definitions to fit their initiatives1, 3, 4”
From CFIR simplified: Pragmatic application of and adaptations to the Consolidated Framework for Implementation Research (CFIR) for evaluation of a patient‐centered care transformation within a learning health system (2020) · cites this paper as [4]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This experience has been reported by other researchers applying the framework to complex evaluations and has been acknowledged by CFIR's creators.1, 3, 4, 14, 15”
From CFIR simplified: Pragmatic application of and adaptations to the Consolidated Framework for Implementation Research (CFIR) for evaluation of a patient‐centered care transformation within a learning health system (2020) · cites this paper as [4]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Reported use of CFIR in the context of evaluation of multifaceted, patient‐centered care transformations is rare; we know of only a handful of instances, recently reported.2, 4, 5, 6”
In the citing paper
“While others have also used CFIR in evaluating care transformations and found the framework valuable in their efforts,4, 5, 6 we are the first to add depth to the “inner setting” domain and recognize the need to elevate patient‐facing elements of redesign by making “patient needs and resources” its own domain rather than a construct within a domain.”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Qualitative Data Analysis: An Expanded Sourcebook
(1994) · Journal of Environmental Psychology · doi:10.1016/s0272-4944(05)80231-2 · Cited by 48,420 · cited 3×
“A conceptual framework is a system of concepts, assumptions, expectations, beliefs, and theories that “explains either graphically or in narrative form, the main things to be studied—the key factors, constructs or variables” that influence a phenomenon of interest [8].”
Qualitative Data Analysis: A Methods Sourcebook
Miles, M. B., Huberman, A. M., & Saldaña, J. (1988) · Cited by 20,701
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496 · cited 4×
“The CFIR is composed of five major domains, each of which may affect an intervention’s implementation [7]:”
BackgroundInfluentialSelf-citationQualitative Data Analysis: A Sourcebook of New Methods
Lotto, L. S., Miles, M. B., & Huberman, A. M. (1986) · Educational Evaluation and Policy Analysis · doi:10.2307/1163741 · Cited by 10,315
Delmont, S., & Mason, J. (1997) · The British Journal of Sociology · doi:10.2307/591613 · Cited by 4,262
King, N. (2012) · Qualitative Organizational Research: Core Methods and Current Challenges · doi:10.4135/9781526435620.n24 · Cited by 902 · cited 1×
“book) to balance the structure involved in using a framework to analyze data with the flexibility necessary to adapt the codebook to the study context [15].”
BackgroundDamschroder, L. J., & Lowery, J. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-51 · Cited by 734
Mendel, P., Meredith, L. S., Schoenbaum, M., Sherbourne, C. D., & Wells, K. B. (2008) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-007-0144-9 · Cited by 407 · cited 1×
“evidence base for understanding implementation and developing theories to guide successful change [7, 21].”
BackgroundA Proposal to Speed Translation of Healthcare Research Into Practice
Kessler, R., & Glasgow, R. E. (2011) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2011.02.023 · Cited by 376 · cited 1×
“needs of the stakeholders responsible for introducing these interventions into the health care delivery organizations working to achieve better outcomes [4, 5]; these stakeholders can include payers and providers, and those helping providers alter care delivery.”
BackgroundDeveloping Robust, Sustainable, Implementation Systems Using Rigorous, Rapid and Relevant Science
Glasgow, R. E., & Chambers, D. (2012) · Clinical and Translational Science · doi:10.1111/j.1752-8062.2011.00383.x · Cited by 278
Research works printed but not linked: 2
- Taylor EF, Dale S, Peikes D, Brown R, Ghosh A, Crosson J, Anglin G, Keith R, Shapiro R. Evaluation of the Comprehensive Primary Care Initiative: first annual report. Princeton: Mathematica Policy Research; 2015. Report prepared for the U.S. Department of Health and Human Services, Centers for Medicare & Medicaid Services.
- Peikes D, Taylor EF, Dale S, O’Malley A, Ghosh A, Anglin G, Swankoski K, Zutshi A, Converse L, Brown R. Evaluation of the Comprehensive Primary Care Initiative: second annual report. Princeton: v; 2016. Report prepared for the U.S. Department of Health and Human Services, Centers for Medicare & Medicaid Services.
Cited by
Qualitative methods in implementation research: An introduction
Hamilton, A. B., & Finley, E. P. (2019) · Psychiatry Research · doi:10.1016/j.psychres.2019.112516 · Cited by 1,315
Gale, R. C., Wu, J., Erhardt, T., Bounthavong, M., Reardon, C. M., Damschroder, L. J., & Midboe, A. M. (2019) · Implementation Science · doi:10.1186/s13012-019-0853-y · Cited by 846
Ten recommendations for using implementation frameworks in research and practice
Moullin, J. C., Dickson, K. S., Stadnick, N. A., Albers, B., Nilsen, P., Broder-Fingert, S., Mukasa, B., & Aarons, G. A. (2020) · Implementation Science Communications · doi:10.1186/s43058-020-00023-7 · Cited by 488
Evidence-Based Strategies for Clinical Organizations to Address COVID-19 Vaccine Hesitancy
Finney Rutten, L. J., Zhu, X., Leppin, A. L., Ridgeway, J. L., Swift, M. D., Griffin, J. M., St Sauver, J. L., Virk, A., & Jacobson, R. M. (2021) · Mayo Clinic Proceedings · doi:10.1016/j.mayocp.2020.12.024 · Cited by 301
“and adapting the right interventions over time.(51)”
Ibrahim, N., Thompson, D., Nixdorf, R., Kalha, J., Mpango, R., Moran, G., Mueller-Stierlin, A., Ryan, G., Mahlke, C., Shamba, D., et al. (2020) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-019-01739-1 · Cited by 251
Metadata
- Authors
- Keith, R. E., Crosson, J. C., O’Malley, A. S., Cromp, D., & Taylor, E. F.
- Affiliations
- Mathematica Policy Research (US)
- Kaiser Permanente Washington Health Research Institute (US)
- Corresponding author
- Keith, Rosalind E.
- Venue
- Implementation Science
- Published
- 2017-02-10
- Volume
- 12
- Issue
- 1
- Pages
- 15-15
- ISSN
- 1748-5908 (ISSN-L)
- PMC
- PMC5303301
- OpenAlex
- W2587416630
- Cited by
- 710
- References
- 19
- Citations by year
- 2026: 52 · 2025: 74 · 2024: 107 · 2023: 113 · 2022: 134 · 2021: 98 · 2020: 72 · 2019: 44 · 2018: 12 · 2017: 4
- FWCI
- 58.51
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0/ (tdm)
- creativecommons.org/licenses/by/4.0/ (vor)
- Locations
- Implementation Science (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Funders
- National Institute of Diabetes and Digestive and Kidney Diseases (7R18DK091810-02)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- Consolidated Framework for Implementation Research, primary care practice transformation, barriers and facilitators, implementation improvement
- MeSH terms
- Delivery of Health Care, Humans, Primary Health Care, Research Design, Qualitative Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Using the Consolidated Framework for Implementation Research (CFIR) to produce actionable findings: a rapid-cycle evaluation approach to improving implementation. https://app.cochat.ai/papers/10.1186/s13012-017-0550-7
- The paper
- Keith, R. E., Crosson, J. C., O’Malley, A. S., Cromp, D., & Taylor, E. F. (2017). Using the Consolidated Framework for Implementation Research (CFIR) to produce actionable findings: a rapid-cycle evaluation approach to improving implementation. Implementation Science. https://doi.org/10.1186/s13012-017-0550-7
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.