The DOI matches its Crossref record; 165 of the 165 references it cites were found in a registry or an index; 12 of the 74 sources its claims cite were checked for support.
Measuring factors affecting implementation of health innovations: a systematic review of structural, organizational, provider, patient, and innovation level measures
Open accessAbstract
BACKGROUND: Two of the current methodological barriers to implementation science efforts are the lack of agreement regarding constructs hypothesized to affect implementation success and identifiable measures of these constructs. In order to address these gaps, the main goals of this paper were to identify a multi-level framework that captures the predominant factors that impact implementation outcomes, conduct a systematic review of available measures assessing constructs subsumed within these primary factors, and determine the criterion validity of these measures in the search articles. METHOD: We conducted a systematic literature review to identify articles reporting the use or development of measures designed to assess constructs that predict the implementation of evidence-based health innovations. Articles published through 12 August 2012 were identified through MEDLINE, CINAHL, PsycINFO and the journal Implementation Science. We then utilized a modified five-factor framework in order to code whether each measure contained items that assess constructs representing structural, organizational, provider, patient, and innovation level factors. Further, we coded the criterion validity of each measure within the search articles obtained. RESULTS: Our review identified 62 measures. Results indicate that organization, provider, and innovation-level constructs have the greatest number of measures available for use, whereas structural and patient-level constructs have the least. Additionally, relatively few measures demonstrated criterion validity, or reliable association with an implementation outcome (e.g., fidelity). DISCUSSION: In light of these findings, our discussion centers on strategies that researchers can utilize in order to identify, adapt, and improve extant measures for use in their own implementation research. In total, our literature review and resulting measures compendium increases the capacity of researchers to conceptualize and measure implementation-related constructs in their ongoing and future research.
Overview
CoChat Summary
TL;DR
This systematic review proposes a five-factor multi-level framework (structural, organizational, provider, patient, innovation) for constructs hypothesized to affect implementation outcomes and identifies 62 measures assessing them. It finds that organizational, provider, and innovation measures are most available, while structural and patient measures are scarce, and that criterion validity is rarely demonstrated.
Key findings
- The review identified 62 measures; most (42; 67.7%) assessed only one factor, and only one measure—the Barriers and Facilitators Assessment Instrument—included items for all five factors.
- Provider-level constructs were assessed by 35 measures (56.5%), organizational-level by 37 (59.7%), and innovation-level by 16 (25.8%); structural-level and patient-level constructs were each assessed by only 5 measures (8.1%).
- Almost half of measures (30; 48.4%) showed no criterion validity in the original validation study or search articles; among the 32 measures with criterion validity examined, adoption was the most frequent outcome (29 of 32; 90.1%), fidelity was examined in 5 of 32 (15.6%), and no studies examined implementation cost, penetration, or sustainability.
- Most measures (47; 75.8%) were developed and/or implemented in healthcare-related settings.
Methods
- Systematic literature review searching MEDLINE, PsycINFO, CINAHL, and Implementation Science through 12 August 2012, using implementation science, health, and measure-related keywords and database restrictions.
- Search yielded 589 unique peer-reviewed records; 210 full-text articles were reviewed, yielding 125 full-text articles from which 112 measures were extracted and 62 measures retained.
- Measures were item-coded for whether they contained two or more items assessing structural, organizational, provider, patient, or innovation factors; criterion validity was coded by identifying implementation outcomes (adoption, fidelity, implementation cost, penetration, sustainability) and whether measures significantly predicted them. Inter-rater reliability across coding stages ranged from 87% to 100% agreement.
Limitations
- The authors state that search strategies affect located articles and conclusions: use of MEDLINE, CINAHL, PsycINFO, and Implementation Science may miss relevant literature in databases such as ERIC or Business Source Complete; keyword and database restrictions, lack of truncation/spelling variants, and limiting to two instrument-related fields may have omitted relevant studies and measures.
- The authors state that criterion validity was assessed only from articles identified in the current search, not from separate exhaustive searches for each of the 62 measures, so criterion validity findings are based on a sampling of the literature; they also note recently developed scales may show weak criterion validity because they have been evaluated less frequently.
- Evident from the text: the review excluded non-health-related innovations, unpublished/unobtainable measures, foreign-language measures, and qualitative measures, which may further narrow the compendium beyond the authors’ stated database and keyword limitations.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
10 Valid · 1 Not valid · 31 Not checked · 52 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“And, the measures used to assess these constructs are frequently developed without direct connection to substantive theory or guiding frameworks and with minimal analysis of psychometric properties, such as internal reliability and construct validity [12].”
§ Measuring factors affecting implementation of health innovations: a systematic review of structural, organizational, provider, patient, and innovation level measures > Background
What the sources say
- Supportedcites [12] Squires JE, Estabrooks CA, O'Rourke HM, Gustavsson P, Newburn-Cook CV, Wallin L: A systematic review of the psychometric properties of self-report research utilization measures used in healthcare. Implem Sci. 2011, 6: 83- source
Split into 2 atoms — 2 confirmed, 0 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“The right side of the figure depicts the implementation outcomes—such as adoption, fidelity, implementation cost, penetration, and sustainability [6] — that are affected by the causal factors.”
§ Measuring factors affecting implementation of health innovations: a systematic review of structural, organizational, provider, patient, and innovation level measures > Background > A multi-level framework guiding implementation science research
What the sources say
- Supportedcites [6] Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, Griffey R, Hensley M: Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Hlth. 2011, 38: 65-76. source
The citation follows the list of examples, and the paper identifies adoption, fidelity, implementation cost, penetration, and sustainability as implementation outcomes. The claim about causal factors appears to describe the citing document’s figure rather than something attributed to this source. The Taxonomy of Implementation Outcomes and Level of Analysis for Outcomes passages establish the identification; page numbers were not provided. (LLM, conf=0.92)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Patient-level variables such as behavioral risk factors (e.g., alcohol use [29]) and motivation [30,31] often moderate the retention in and efficacy of behavioral risk reduction interventions.”
§ Measuring factors affecting implementation of health innovations: a systematic review of structural, organizational, provider, patient, and innovation level measures > Background > A multi-level framework guiding implementation science research
What the sources say
- Partly supportedcites [29] Kalichman SC, Cain D, Eaton L, Jooste S, Simbayi LC: Randomized Clinical Trial of Brief Risk Reduction Counseling for Sexually Transmitted Infection Clinic Patients in Cape Town, South Africa. Am J Public Health. 2011, 101: e9-e17. sourceExperimental — accuracy not yet measured
The Discussion (page not provided) says alcohol use significantly moderated intervention outcomes, with effects less robust and durable for heavier drinkers. The paper also reports missed baseline sessions, but does not show that alcohol use moderated retention. The motivation claim is attached to other citations and is not assessed here. (LLM, conf=0.86)
- Partly supportedcites [30] Noguchi K, Albarracin D, Durantini MR, Glasman LR: Who participates in which health promotion programs? A meta-analysis of motivations underlying enrollment and retention in HIV-prevention interventions. Psychol Bull. 2007, 133: 955-975. sourceExperimental — accuracy not yet measured
The Results report that prior motivation and condom use were associated with retention, and that these relationships varied with intervention content. But the paper measured enrollment and completion of HIV-prevention programs, not whether patient-level variables moderated the interventions’ efficacy in reducing risk behavior. Its findings also do not establish the claim across behavioral risk-reduction interventions generally. (LLM, conf=0.88)
- Partly supportedcites [31] Vernon SW, Bartholomew LK, McQueen A, Bettencourt JL, Greisinger A, Coan SP, Lairson D, Chan W, Hawley ST, Myers RE: A randomized controlled trial of a tailored interactive computer-delivered intervention to promote colorectal cancer screening: sometimes more is just the same. nn Behav Med. 2011, 41: 284-299. sourceExperimental — accuracy not yet measured
The Results (Moderator Analyses; page unavailable) report that baseline stage of change, a measure of readiness, moderated the intervention’s effect on colorectal cancer screening. The Results (Preliminary Analyses; page unavailable) also report that participants who dropped out were less likely to have been in the contemplation stage. These findings support a role for motivation in this trial, but do not establish that it often moderates retention and efficacy across behavioral risk-reduction interventions. (LLM, conf=0.86)
plainstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Many of these measures assessed constructs outlined in Roger’s diffusion of innovations theory [18] such as relative advantage, compatibility, complexity, trialability, and observability [26].”
§ Measuring factors affecting implementation of health innovations: a systematic review of structural, organizational, provider, patient, and innovation level measures > Results > Factors assessed
What the sources say
- Not checked yetcites [18] Rogers EM: Diffusion of innovations 5th edn. 2003, New York: Free Press
- Supportedcites [26] Scott S, Plotnikoff R, Karunamuni N, Bize R, Rodgers W: Factors influencing the adoption of an innovation: An examination of the uptake of the Canadian Heart Health Kit (HHK). Implem Sci. 2008, 3: 41-Article included in review source
The Background identifies relative advantage, compatibility, complexity, trialability, and observability as the five attributes in Rogers’ diffusion of innovations theory. Methods > Questionnaire states that the study assessed attributes of the innovation using measures for each of those five constructs. (LLM, conf=0.95)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Every source the paper cites for this claim was checked and supports it.
In the paper
“we did come across a number of articles that included these outcomes (e.g., number of bloodstream infections [83]) alone or in combination with other implementation outcomes.”
§ Measuring factors affecting implementation of health innovations: a systematic review of structural, organizational, provider, patient, and innovation level measures > Discussion > Criterion validity
What the sources say
- Supportedcites [83] Chan K, Hsu Y-J, Lubomski L, Marsteller J: Validity and usefulness of members reports of implementation progress in a quality improvement initiative: findings from the Team Check-up Tool (TCT). Implem Sci. 2011, 6: 115-Article included in review source
The cited paper is exactly the kind of article the citing sentence offers it as an example of: its Methods > Validation measures describe collecting 'the number of CLABSIs occurring within an ICU and number of catheter-line days ... monthly by the hospital infection preventionist', and the Abstract's Measures list CLABSI rate alongside the Team Check-up Tool implementation measures (intervention activities, unit-level prevention behaviours, barriers to team progress). Results > Measure validity then analyse time to first quarter with no CLABSI in combination with infection prevention behaviour outcomes, so a patient health outcome appears in combination with implementation outcomes rather than alone. (LLM, conf=0.86)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
52 more claims · 2 with their cited sources checked
Create a free account to see all 94 claims and to verify the 62 references still open.
- It may state two separate claims as one. 12
- Probably not a substantial claim. 28
- The quote only partly states this claim. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“we situate our intervention domain at the nexus of all the domains because intervention characteristics can both influence and be influenced by the other factors—a position also supported by the CFIR [32, 35].”
From Barriers and facilitators to implementation of evidence-based task-sharing mental health interventions in low- and middle-income countries: a systematic review using implementation science frameworks (2022) · cites this paper as [35]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“An update of that review in 2010 focused explicitly on organizational-level adoption and mainstreaming of technological innovations [3]. It identified some new literature on organizational-level routinization [4], but little new evidence on scale-up, spread, or sustainability—a finding that has been confirmed by other reviews since [5-9].”
From Beyond Adoption: A New Framework for Theorizing and Evaluating Nonadoption, Abandonment, and Challenges to the Scale-Up, Spread, and Sustainability of Health and Care Technologies (2017) · cites this paper as [6]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Existing instrument reviews are limited in scope, methods, and findings.”
From The Society for Implementation Research Collaboration Instrument Review Project: A methodology to promote rigorous evaluation (2016) · cites this paper as [5]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Second, existing methodologies for instrument reviews are narrowly focused and only provide limited psychometric assessments of the instruments.”
From The Society for Implementation Research Collaboration Instrument Review Project: A methodology to promote rigorous evaluation (2016) · cites this paper as [5]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Systematic reviews of implementation context measures have been conducted, all of which have found significant gaps and signal the continued need for measure validation and development [89–95].”
From The updated consolidated framework for implementation research based on user feedback (2022) · cites this paper as [89]
9 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Measuring factors affecting implementation of health innovations: a systematic review of structural, organizational, provider, patient, and innovation level measures > Method > Measure and criterion validity coding
“the Organizational Readiness for Change scale [45] assesses several features of structural context in which drug treatment centers exist, including facility structure (independent versus part of a parent organization) and characteristics of the service area (rural, suburban, or urban).”
§ Measuring factors affecting implementation of health innovations: a systematic review of structural, organizational, provider, patient, and innovation level measures > Results > Literature search results
“| Organizational Readiness for Change [45] | | X | X | | | O: Institutional resources, Organizational climate, motivational readiness | [45] | None | Mental Health/ Substance Abuse |”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Measuring factors affecting implementation of health innovations: a systematic review of structural, organizational, provider, patient, and innovation level measures > Background > A multi-level framework guiding implementation science research
“with one identifying unifying constructs from empirical results [20] and the other identifying unifying constructs from existing conceptual frameworks [19]”
§ Measuring factors affecting implementation of health innovations: a systematic review of structural, organizational, provider, patient, and innovation level measures > Background > A multi-level framework guiding implementation science research
“Durlak and DuPre [19] reviewed meta-analyses and additional quantitative reports examining the predictors of successful implementation from over 500 studies. In contrast, Damschroder et al.[20] reviewed 19 existing implementation theories and frameworks”
Citations
Cites
The theory of planned behavior
Ajzen, I. (1991) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(91)90020-t · Cited by 90,587
Rogers, E. M., Singhal, A., & Quinlan, M. M. (2019) · An Integrated Approach to Communication Theory and Research · doi:10.4324/9780203710753-35 · Cited by 37,322
Social Cognitive Theory: An Agentic Perspective
Bandura, A. (2001) · Annual Review of Psychology · doi:10.1146/annurev.psych.52.1.1 · Cited by 15,510
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496
Health Behavior and Health Education: Theory, Research, and Practice
(1992) · Annals of Internal Medicine · doi:10.7326/0003-4819-116-4-350_1 · Cited by 13,207
Organizational Culture and Leadership
Tierney, W. G., & Schein, E. H. (1986) · The Academy of Management Review · doi:10.2307/258322 · Cited by 9,601
Stages and processes of self-change of smoking: Toward an integrative model of change.
Prochaska, J. O., & DiClemente, C. C. (1983) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.51.3.390 · Cited by 9,098
Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0319-7 · Cited by 8,721
Diffusion of Innovations in Service Organizations: Systematic Review and Recommendations
GREENHALGH, T., ROBERT, G., MACFARLANE, F., BATE, P., & KYRIAKIDOU, O. (2004) · The Milbank Quarterly · doi:10.1111/j.0887-378x.2004.00325.x · Cited by 7,448 · cited 1×
“It involves attention to a wide array of multi-level variables related to the innovation itself, the local implementation context, and the behavioral strategies used to implement the innovation [8,9].”
MethodEvaluating the public health impact of health promotion interventions: the RE-AIM framework.
Glasgow, R. E., Vogt, T. M., & Boles, S. M. (1999) · American Journal of Public Health · doi:10.2105/ajph.89.9.1322 · Cited by 7,217 · cited 1×
“More recently, however, many frameworks have converged to outline a set of multi-level factors that are hypothesized to impact implementation outcomes [9,16-18].”
Background
Research works printed but not linked: 13
- Grimshaw J: Improving the scientific basis of health care research dissemination and implementation. 2007, Paper presented at the NIH Conference on Building the Sciences of Dissemination and Implementation in the Service of: Public Health
- Rogers EM: Diffusion of innovations 5th edn. 2003, New York: Free Press
- Peters MA, Harmsen M, Laurant MGH, Wensing M: Ruimte voor verandering? Knelpunten en mogelijkheden voor verbeteringen in de patiëntenzorg [Room for improvement? Barriers to and facilitators for improvement of patient care]. 2002, Nijmegen, the Netherlands: Centre for Quality of Care Research (WOK), Radboud University Nijmegen Medical Centre, Article included in review
- American Psychological Association: National Council on Measurement in Education, American Educational Research Association: Standards for educational and psychological testing. 1999, Washington, DC: American Educational Research Association
- Pain K, Hagler P, Warren S: Development of an instrument to evaluate the research orientation of clinical professionals. Can J Rehabil. 1996, 9: 93-100. Article included in review
- Thompson CJ: Extent and factors influencing research utilization among critical care nurses. 1997, Texas Woman's University, Unpublished doctoral dissertation
- Meissner HI: Proceedings from the 3rd Annual NIH Conference on the Science of Dissemination and Implementation: Methods and Measurement. 2010, Bethesda, MD
- Rogers EM: Diffusion of innovations 4th edn. 1995, New York: Free Press, 4
- Facione PA, Facione CF: The California Critical Thinking Disposition Inventory: Test manual. 1992, Millbrae, CA: California Academic Press, Article included in review
- Estrada N, Verran J: Nursing practice environments: Strengthening the future of health systems: learning organizations and evidence-based practice by RNs. Commun Nurs Res. 2007, 40: 187-Article included in review
- Fineout-Overholt E, Melnyk BM: Organizational Culture and Readiness for System-Wide Implementation of EBP (OCR-SIEP) scale. 2006, Gilbert, AZ: ARCC llc Publishing, Article included in review
- Melnyk BM, Fineout-Overholt E, Giggleman M: EBP organizational culture, EBP implementation, and intent to leave in nurses and health professionals. Commun Nurs Res. 2010, 43: 310-Article included in review
- James LR, Sells SB: Psychological climate. The situation: An interactional perspective. Edited by: Magnusson D. 1981, Hillsdale, NJ: Lawrence Erlbaum, Article included in review
Cited by
Making sense of implementation theories, models and frameworks
Nilsen, P. (2015) · Implementation Science · doi:10.1186/s13012-015-0242-0 · Cited by 4,447
The updated consolidated framework for implementation research based on user feedback
Damschroder, L. J., Reardon, C. M., Widerquist, M. A. O., & Lowery, J. (2022) · Implementation Science · doi:10.1186/s13012-022-01245-0 · Cited by 4,452
Greenhalgh, T., Wherton, J., Papoutsi, C., Lynch, J., Hughes, G., A'Court, C., Hinder, S., Fahy, N., Procter, R., & Shaw, S. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.8775 · Cited by 2,887
“It identified some new literature on organizational-level routinization [4], but little new evidence on scale-up, spread, or sustainability—a finding that has been confirmed by other reviews since [5-9].”
An introduction to implementation science for the non-specialist
Bauer, M. S., Damschroder, L., Hagedorn, H., Smith, J., & Kilbourne, A. M. (2015) · BMC Psychology · doi:10.1186/s40359-015-0089-9 · Cited by 1,611
Pfadenhauer, L. M., Gerhardus, A., Mozygemba, K., Lysdahl, K. B., Booth, A., Hofmann, B., Wahlster, P., Polus, S., Burns, J., Brereton, L., et al. (2017) · Implementation Science · doi:10.1186/s13012-017-0552-5 · Cited by 1,016
Metadata
- Authors
- Chaudoir, S. R., Dugan, A. G., & Barr, C. H.
- Affiliations
- College of the Holy Cross (US)
- University of Connecticut (US)
- Corresponding author
- Chaudoir, Stephenie R
- Venue
- Implementation Science
- Published
- 2013-02-17
- Volume
- 8
- Issue
- 1
- Pages
- 22-22
- ISSN
- 1748-5908 (ISSN-L)
- PMC
- PMC3598720
- OpenAlex
- W2143900697
- Semantic Scholar
- 9193bae8cbdc5da77d5f18b44dced4be2b9f818a
- Cited by
- 800
- References
- 165
- Citations by year
- 2026: 25 · 2025: 33 · 2024: 56 · 2023: 60 · 2022: 62 · 2021: 96 · 2020: 88 · 2019: 68 · 2018: 76 · 2017: 78 · 2016: 38 · 2015: 53 · 2014: 49 · 2013: 17
- FWCI
- 6.30
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Implementation Science (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- OpenCommons - UConn (University of Connecticut) (submittedVersion)
- Funders
- University of Connecticut
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- implementation research, implementation outcomes, implementation measures, criterion validity, structural factors, organizational factors, provider factors, patient factors, multi-level framework, fidelity
- MeSH terms
- Delivery of Health Care, Diffusion of Innovation, Health Services Research, Humans, Organizational Innovation, Evidence-Based Practice
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-04, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-04 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Measuring factors affecting implementation of health innovations: a systematic review of structural, organizational, provider, patient, and innovation level measures. https://app.cochat.ai/papers/10.1186/1748-5908-8-22
- The paper
- Chaudoir, S. R., Dugan, A. G., & Barr, C. H. (2013). Measuring factors affecting implementation of health innovations: a systematic review of structural, organizational, provider, patient, and innovation level measures. Implementation Science. https://doi.org/10.1186/1748-5908-8-22
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

