The DOI matches its Crossref record; 160 of the 165 references it cites were found in a registry or an index; 23 of the 74 sources its claims cite were checked for support.
Making sense of implementation theories, models and frameworks
Open accessAbstract
BACKGROUND: Implementation science has progressed towards increased use of theoretical approaches to provide better understanding and explanation of how and why implementation succeeds or fails. The aim of this article is to propose a taxonomy that distinguishes between different categories of theories, models and frameworks in implementation science, to facilitate appropriate selection and application of relevant approaches in implementation research and practice and to foster cross-disciplinary dialogue among implementation researchers. DISCUSSION: Theoretical approaches used in implementation science have three overarching aims: describing and/or guiding the process of translating research into practice (process models); understanding and/or explaining what influences implementation outcomes (determinant frameworks, classic theories, implementation theories); and evaluating implementation (evaluation frameworks). This article proposes five categories of theoretical approaches to achieve three overarching aims. These categories are not always recognized as separate types of approaches in the literature. While there is overlap between some of the theories, models and frameworks, awareness of the differences is important to facilitate the selection of relevant approaches. Most determinant frameworks provide limited "how-to" support for carrying out implementation endeavours since the determinants usually are too generic to provide sufficient detail for guiding an implementation process. And while the relevance of addressing barriers and enablers to translating research into practice is mentioned in many process models, these models do not identify or systematically structure specific determinants associated with implementation success. Furthermore, process models recognize a temporal sequence of implementation endeavours, whereas determinant frameworks do not explicitly take a process perspective of implementation.
Overview
CoChat Summary
TL;DR
This article proposes a taxonomy of five categories of theories, models and frameworks used in implementation science, organized by three overarching aims: describing/guiding translation of research into practice, understanding/explaining influences on implementation outcomes, and evaluating implementation. It argues that recognizing differences and overlaps among process models, determinant frameworks, classic theories, implementation theories, and evaluation frameworks can facilitate appropriate selection and cross-disciplinary dialogue.
Key findings
- The paper delineates five categories of theoretical approaches—process models, determinant frameworks, classic theories, implementation theories, and evaluation frameworks—to achieve three overarching aims: describing and/or guiding the process of translating research into practice; understanding and/or explaining what influences implementation outcomes; and evaluating implementation.
- Eight commonly cited determinant frameworks are compared in Table 2; the paper states they account for five types of determinants: characteristics of the implementation object, users/adopters, end users, context, and the strategy or other means of facilitating implementation, with outcomes varying across frameworks.
- Theoretical Domains Framework was constructed from a synthesis of 128 constructs related to behaviour change found in 33 behaviour change theories, sorted into 14 theoretical domains (originally 12 domains). Proctor et al. propose eight conceptually distinct implementation outcomes for evaluation: acceptability, adoption, appropriateness, costs, feasibility, fidelity, penetration, and sustainability.
- Most determinant frameworks provide limited “how-to” support because determinants are often too generic; process models mention barriers and enablers but do not identify or systematically structure specific determinants, and process models recognize a temporal sequence whereas determinant frameworks do not explicitly take a process perspective.
Methods
- Narrative review of selective literature: six textbooks providing comprehensive overviews of implementation science and evidence-based practice implementation were consulted, along with several overview papers on theories, models and frameworks.
- Implementation Science was searched using the terms “theory”, “model” and “framework”; titles and abstracts were scanned, and relevant articles were read in full.
- The analysis is a conceptual synthesis that identifies three overarching aims and proposes a five-category taxonomy; no systematic review, meta-analysis, or formal quality appraisal is reported.
Limitations
- The paper states it is not intended as a complete catalogue of all individual approaches available in implementation science, and that the proposed categories are not always recognized as separate types of approaches in the literature.
- The paper states there is considerable overlap between some categories, which can complicate selection and labelling of approaches.
- The text makes evident that the review is selective and narrative rather than systematic, so the taxonomy is conceptual and does not resolve inconsistent terminology across the field.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
8 Valid · 4 Not valid · 18 Not checked · 44 Own results and interpretations
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Poor theoretical underpinning makes it difficult to understand and explain how and why implementation succeeds or fails, thus restraining opportunities to identify factors that predict the likelihood of implementation success and develop better strategies to achieve more successful implementation.”
§ Making sense of implementation theories, models and frameworks > Background
What the sources say
- Not checked yetcites [1] Eccles M, Grimshaw J, Walker A, Johnston M, Pitts N. Changing the behavior of healthcare professionals: the use of theory in promoting the uptake of research findings. J Clin Epidemiol. 2005;58:107–12. source
- Supportedcites [3] Michie S, Johnston M, Abraham C, Lawton R, Parker D, Walker A. Making psychological theory useful for implementing evidence based practice: a consensus approach. Qual Saf Health Care. 2005;14:26–33. source
Split into 2 atoms — 2 confirmed, 0 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
- Not checked yetcites [4] Sales A, Smith J, Curran G, Kochevar L. Models, strategies, and tools: theory in implementing evidence-based findings into health care practice. J Gen Intern Med. 2006;21:S43–9.
- Supportedcites [5] Kitson AL, Harvey G, McCormack B. Enabling the implementation of evidence-based practice: a conceptual framework. Qual Health Care. 1998;7:149–58. source
Split into 2 atoms — 2 confirmed, 0 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Furthermore, many theories, models and frameworks have spawned instruments that serve evaluation purposes, e.g. tools linked to PARIHS [132,133], CFIR [134] and Theoretical Domains Framework [135].”
§ Making sense of implementation theories, models and frameworks > Discussion > Evaluating implementation
What the sources say
- Supportedcites [132] Estabrooks CA, Squires JE, Cummings GG, Birdell JM, Norton PG. Development and assessment of the Alberta Context Tool. BMC Health Serv Res. 2009;9:234. source
The Background (page unavailable) says the authors used the PARiHS framework to conceptualize organizational context and developed the Alberta Context Tool to assess it. This supports the citation as an example of a framework-linked assessment instrument; it does not need to establish the sentence’s separate examples linked to other frameworks. (LLM, conf=0.91)
- Not checked yetcites [133] McCormack B, McCarthy G, Wright J, Slater P, Coffey A. Development and testing of the Context Assessment Index (CAI). Worldviews Evid Based Nurs. 2009;6:27–35. source
- Supportedcites [134] Damschroder LJ, Lowery JC. Evaluation of a large-scale weight management program using the consolidated framework for implementation research (CFIR). Implement Sci. 2013;8:51. source
The Data collection procedures section describes a semi-structured interview guide whose questions probed CFIR constructs to evaluate implementation of the MOVE! program. The Conclusion also says the CFIR resource provides example interview guides. This supports citing the paper as an example of a framework linked to an evaluation instrument; it does not need to establish the sentence’s broader claim about other frameworks. (LLM, conf=0.90)
- Supportedcites [135] Dyson J, Lawton R, Jackson C, Cheater F. Development of a theory-based instrument to identify barriers and levers to best hand hygiene practice among healthcare practitioners. Implement Sci. 2013;8:111. source
This citation supplies the Theoretical Domains Framework example, not evidence for every framework in the sentence. The Background says the paper presents the development and testing of a TDF-based instrument to assess barriers and levers to hand hygiene practice, supporting its identification as an evaluation tool. (LLM, conf=0.92)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“For instance, Theoretical Domains Framework (e.g. [127,128]), and Normalization Process Theory [129] and COM-B (e.g. [130,131]) have all been widely used as evaluation frameworks.”
§ Making sense of implementation theories, models and frameworks > Discussion > Evaluating implementation
What the sources say
- Not checked yetcites [127] Phillips CJ, Marshall AP, Chaves NJ, Lin IB, Loy CT, Rees G, et al. Experiences of using Theoretical Domains Framework across diverse clinical environments: a qualitative study. J Multidiscip Healthc. 2015;8:139–46.
- Supportedcites [128] Fleming A, Bradley C, Cullinan S, Byrne S. Antibiotic prescribing in long-term care facilities: a qualitative, multidisciplinary investigation. BMJ Open. 2014;4(11):e006442. source
The Introduction says the TDF has been used in many types of studies, and the Methods and Discussion show this study using TDF and COM-B to analyse prescribing behaviour and identify intervention functions. This paper therefore serves as an example of their use as evaluation frameworks. Normalization Process Theory has its own citation in the citing sentence and is not attributed to this source. (LLM, conf=0.86)
- Supportedcites [129] McEvoy R, Ballini L, Maltoni S, O’Donnell CA, Mair FS, MacFarlane A. A qualitative systematic review of studies using the normalization process theory to research implementation processes. Implement Sci. 2014;9:2. source
The citation [129] is attached to Normalization Process Theory, not to the other two frameworks. The Results (‘How is NPT being operationalized?’; page unavailable) report that, in almost all studies reviewed, NPT was used as a framework for analysing and reporting implementation findings. The review included 29 studies, supporting the characterization of its widespread use as an evaluation framework. (LLM, conf=0.90)
- Partly supportedcites [130] Connell LA, McMahon NE, Redfern J, Watkins CL, Eng JJ. Development of a behaviour change intervention to increase upper limb exercise in stroke rehabilitation. Implement Sci. 2015;10:34. sourceExperimental — accuracy not yet measured
The Methods (Stage 2; page not provided) describe using COM-B to analyse target behaviours while developing an intervention. This supports COM-B as a framework used in this study, but the paper does not establish that it is widely used as an evaluation framework. This citation does not bear on the sentence’s separate claims about the Theoretical Domains Framework or Normalization Process Theory. (LLM, conf=0.82)
- Supportedcites [131] Praveen D, Patel A, Raghu A, Clifford GD, Maulik PK, Abdul AM, et al. Development and field evaluation of a mobile clinical decision support system for cardiovascular diseases in rural India. JMIR mHealth uHealth. 2014;2:e54. source
This source is cited as an example of COM-B use, not for the other two frameworks. The Methods (Evaluation and Analysis) say COM-B was used to design and analyze interview data, and the Results (Field Testing: Qualitative Evaluation) present the findings in its three domains. It therefore supports the cited example of COM-B as an evaluation framework, though this single study does not itself establish how widely COM-B is used. (LLM, conf=0.89)
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Although evaluation frameworks may be considered in a category of their own, theories, models and frameworks from the other four categories can also be applied for evaluation purposes because they specify concepts and constructs that may be operationalized and measured.”
§ Making sense of implementation theories, models and frameworks > Discussion > Evaluating implementation
What the sources say
- Not checked yetcites [127] Phillips CJ, Marshall AP, Chaves NJ, Lin IB, Loy CT, Rees G, et al. Experiences of using Theoretical Domains Framework across diverse clinical environments: a qualitative study. J Multidiscip Healthc. 2015;8:139–46.
- Partly supportedcites [128] Fleming A, Bradley C, Cullinan S, Byrne S. Antibiotic prescribing in long-term care facilities: a qualitative, multidisciplinary investigation. BMJ Open. 2014;4(11):e006442. sourceExperimental — accuracy not yet measured
The Introduction describes the TDF as a framework with defined domains and constructs, and Methods > Analysis says the authors assigned interview codes to those domains. This supports the possibility of applying a framework’s constructs in an analysis, but the paper does not discuss four categories other than evaluation frameworks or establish that frameworks across those categories can be used for evaluation and measurement. Page numbers are not available in our copy. (LLM, conf=0.78)
- Partly supportedcites [129] McEvoy R, Ballini L, Maltoni S, O’Donnell CA, Mair FS, MacFarlane A. A qualitative systematic review of studies using the normalization process theory to research implementation processes. Implement Sci. 2014;9:2. sourceExperimental — accuracy not yet measured
In Results, under “How is NPT being operationalized?” (page unavailable), the review reports that NPT constructs were used to analyze implementation and that an NPT-based instrument was developed to measure normalization processes. This supports NPT as an example of a theory used for analysis and measurement, but the paper does not address the citing sentence’s distinction between evaluation frameworks and four other categories or establish that all four can be used this way. (LLM, conf=0.84)
- Partly supportedcites [130] Connell LA, McMahon NE, Redfern J, Watkins CL, Eng JJ. Development of a behaviour change intervention to increase upper limb exercise in stroke rehabilitation. Implement Sci. 2015;10:34. sourceExperimental — accuracy not yet measured
The Discussion (page unavailable) says that specified behaviour-change techniques and toolkit performance measures could be used to measure intervention fidelity and investigate mechanisms in a future evaluation study. This supports the idea that a framework or taxonomy used for intervention development can also inform evaluation. The paper does not discuss four other categories of theories, models and frameworks or establish the claim for all of them. (LLM, conf=0.83)
- Partly supportedcites [131] Praveen D, Patel A, Raghu A, Clifford GD, Maulik PK, Abdul AM, et al. Development and field evaluation of a mobile clinical decision support system for cardiovascular diseases in rural India. JMIR mHealth uHealth. 2014;2:e54. sourceExperimental — accuracy not yet measured
The Methods (Evaluation and Analysis; page unavailable) say the COM-B theory was used to design and analyze evaluation interviews, and the Results (Field Testing: Qualitative Evaluation; page unavailable) organize findings under its capability, opportunity, and motivation domains. This supports the claim by example, but the paper does not establish the broader assertion about theories, models, and frameworks across the other four categories or say that their constructs can generally be measured. (LLM, conf=0.82)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“And while the relevance of addressing barriers and enablers to translating research into practice is mentioned in many process models, these models do not identify or systematically structure specific determinants associated with implementation success.”
§ Making sense of implementation theories, models and frameworks > Abstract > Summary
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
22 more claims
Create a free account to see all 74 claims and to verify the 51 references still open.
- Probably not a substantial claim. 31
- It may state two separate claims as one. 21
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“frameworks provide explicit guidance and justification for proposed hypotheses to be tested that strengthen proposals, projects, trials, and products, both research and practice based [2, 4].”
From Ten recommendations for using implementation frameworks in research and practice (2020) · cites this paper as [2]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Additional constructs were added in the updated CFIR to acknowledge scientific advancement since 2009 that are common across many process frameworks [8] and collective-level change theories [72].”
From The updated consolidated framework for implementation research based on user feedback (2022) · cites this paper as [8]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“There are over 100 identified KT theories, models and frameworks to choose from (e.g., Nilsen, 2015 [5]; Tabak et al., 2012 [14]; Straus et al., 2013 [15]).”
From Scoping review identifies significant number of knowledge translation theories, models, and frameworks with limited use (2018) · cites this paper as [5]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“For intermediaries and practitioners, they can provide shared language to familiarize stakeholders with implementation and function as practical tools for planning, executing, and evaluating real-world implementation efforts.”
From Ten recommendations for using implementation frameworks in research and practice (2020) · cites this paper as [2]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“When used in research, they can guide the design and conduct of studies, inform the theoretical and empirical thinking of research teams, and aid interpretation of findings.”
From Ten recommendations for using implementation frameworks in research and practice (2020) · cites this paper as [2]
Experimental — accuracy not yet measured
18 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Making sense of implementation theories, models and frameworks > Summary
“A framework such as the Active Implementation Frameworks [68] appears to have a dual aim”
§ Making sense of implementation theories, models and frameworks > References
“68. Holmes BJ Finegood DT Riley BL Best A Brownson RC Colditz GA Proctor EK Systems Thinking in Dissemination and Implementation Research”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Making sense of implementation theories, models and frameworks > Discussion > Theories, models and frameworks in implementation science
“model by Davies et al. [43]”
§ Making sense of implementation theories, models and frameworks > References
“43. Davis SM Peterson JC Helfrich CD Cunningham-Sabo L Introduction and conceptual model for utilization of prevention research”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Making sense of implementation theories, models and frameworks > References
“121. May C Finch T Mair F Ballini L Dowrick C Eccles M Understanding the implementation of complex interventions in health care: the normalization process model Implement Sci 2007 7 148”
§ Making sense of implementation theories, models and frameworks > References
“74. Ashton CM Khan MM Johnson ML Walder A Stanberry E Beyth RJ A quasi-experimental test of an intervention to increase the use of thiazide-based treatment regimens for people with hypertension Implement Sci 2007 2 5”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Making sense of implementation theories, models and frameworks > Discussion > Theories, models and frameworks in implementation science
“COM-B Capacity-Opportunities-Motivation-Behaviour”
§ Making sense of implementation theories, models and frameworks > Discussion > Understanding and explaining what influences implementation outcomes
“COM-B (Capability, Opportunity, Motivation and Behaviour)”
Citations
Cites
Self-efficacy: Toward a unifying theory of behavioral change
Bandura, A. (1977) · Psychological Review · doi:10.1037/0033-295x.84.2.191 · Cited by 43,925
Rogers, E. M., Singhal, A., & Quinlan, M. M. (2019) · An Integrated Approach to Communication Theory and Research · doi:10.4324/9780203710753-35 · Cited by 37,322
The Structure of Scientific Revolutions
Kuhn, T. S., & Schlegel, R. (1963) · Physics Today · doi:10.1063/1.3050879 · Cited by 35,538
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496
Valente, T. W. (2003) · Genetics in Medicine · doi:10.1097/01.gim.0000061743.67794.c4 · Cited by 13,723
Michie, S., van Stralen, M. M., & West, R. (2011) · Implementation Science · doi:10.1186/1748-5908-6-42 · Cited by 13,697
Absorptive Capacity: A Review, Reconceptualization, and Extension
Zahra, S. A., & George, G. (2002) · The Academy of Management Review · doi:10.5465/amr.2002.6587995 · Cited by 10,758
Self-efficacy: Toward a unifying theory of behavioral change
Bandura, A. (1978) · Advances in Behaviour Research and Therapy · doi:10.1016/0146-6402(78)90002-4 · Cited by 10,586
The Structure of Scientific Revolutions.
Bohm, D., & Kuhn, T. S. (1964) · The Philosophical Quarterly · doi:10.2307/2217783 · Cited by 9,130
Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0319-7 · Cited by 8,721
Research works printed but not linked: 10
- Davies P, Walker A, Grimshaw J. Theories of behavior change in studies of guideline implementation. Proc Br Psychol Soc. 2003;11:120.
- Rycroft-Malone J, Bucknall T. Models and Frameworks for Implementing Evidence-Based Practice: Linking Evidence to Action. Oxford: Wiley-Blackwell; 2010.
- Dubin R. Theory Building. New York: Free Press; 1978.
- Stetler CB. Stetler model. In: Rycroft-Malone J, Bucknall T, editors. Models and Frameworks for Implementing Evidence-Based Practice: Linking Evidence to Action. Oxford: Wiley-Blackwell; 2010. p. 51–82.
- Logan J, Graham I. The Ottawa Model of Research Use. In: Rycroft-Malone J, Bucknall T, editors. Models and Frameworks for Implementing Evidence-Based Practice: Linking Evidence to Action. Oxford: Wiley-Blackwell; 2010. p. 83–108.
- Rycroft-Malone J. Promoting Action on Research Implementation in Health Services (PARIHS). In: Rycroft-Malone J, Bucknall T, editors. Models and Frameworks for Implementing Evidence-Based Practice: Linking Evidence to Action. Oxford: Wiley-Blackwell; 2010. p. 109–36.
- Michie S, Atkins L, West R. A guide to using the Behaviour Change Wheel. London: Silverback Publishing; 2014.
- Fishbein M, Ajzen I. Belief, Attitude, Intention, and Behaviour. New York: John Wiley; 1975.
- Bandura A. Social Foundations of Thought and Action: A Cognitive Social Theory. Englewood-Cliffs, NJ: Prentice-Hall; 1986.
- DiMaggio PJ, Powell WW. The New Institutionalism and Organizational Analysis. Chicago, IL: University of Chicago Press; 1991.
Cited by
The updated consolidated framework for implementation research based on user feedback
Damschroder, L. J., Reardon, C. M., Widerquist, M. A. O., & Lowery, J. (2022) · Implementation Science · doi:10.1186/s13012-022-01245-0 · Cited by 4,452
“Additional constructs were added in the updated CFIR to acknowledge scientific advancement since 2009 that are common across many process frameworks [8] and collective-level change theories [72].”
BackgroundMethodInfluentialWaltz, T. J., Powell, B. J., Fernández, M. E., Abadie, B., & Damschroder, L. J. (2019) · Implementation Science · doi:10.1186/s13012-019-0892-4 · Cited by 1,136
Systematic review of the Exploration, Preparation, Implementation, Sustainment (EPIS) framework
Moullin, J. C., Dickson, K. S., Stadnick, N. A., Rabin, B., & Aarons, G. A. (2019) · Implementation Science · doi:10.1186/s13012-018-0842-6 · Cited by 1,223
Pfadenhauer, L. M., Gerhardus, A., Mozygemba, K., Lysdahl, K. B., Booth, A., Hofmann, B., Wahlster, P., Polus, S., Burns, J., Brereton, L., et al. (2017) · Implementation Science · doi:10.1186/s13012-017-0552-5 · Cited by 1,016
Nilsen, P., & Bernhardsson, S. (2019) · BMC Health Services Research · doi:10.1186/s12913-019-4015-3 · Cited by 1,014
Metadata
- Authors
- Nilsen, P.
- Venue
- Implementation Science
- Published
- 2015-04-21
- Volume
- 10
- Issue
- 1
- Pages
- 53-53
- ISSN
- 1748-5908 (ISSN-L)
- PMC
- PMC4406164
- OpenAlex
- W2101270539
- Semantic Scholar
- 20f099905076f17d25fc7ec3e4571339fea40ad7
- Cited by
- 4,447
- References
- 165
- Citations by year
- 2026: 480 · 2025: 470 · 2024: 614 · 2023: 528 · 2022: 519 · 2021: 531 · 2020: 491 · 2019: 309 · 2018: 228 · 2017: 161 · 2016: 85 · 2015: 22
- FWCI
- 301.59
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- Implementation Science (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DiVA (Linkoping University) (submittedVersion, other-oa)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- implementation theory, implementation model, implementation framework, process model, implementation outcomes, barriers and facilitators, research-to-practice translation, implementation evaluation, implementation research
- MeSH terms
- Humans, Program Development, Models, Organizational, Evidence-Based Medicine, Translational Research, Biomedical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-04, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-04 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Making sense of implementation theories, models and frameworks. https://app.cochat.ai/papers/10.1186/s13012-015-0242-0
- The paper
- Nilsen, P. (2015). Making sense of implementation theories, models and frameworks. Implementation Science. https://doi.org/10.1186/s13012-015-0242-0
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
