The DOI matches its Crossref record; 21 of the 22 references it cites were found in a registry or an index.
A checklist for identifying determinants of practice: A systematic review and synthesis of frameworks and taxonomies of factors that prevent or enable improvements in healthcare professional practice
Open accessAbstract
BACKGROUND: Determinants of practice are factors that might prevent or enable improvements. Several checklists, frameworks, taxonomies, and classifications of determinants of healthcare professional practice have been published. In this paper, we describe the development of a comprehensive, integrated checklist of determinants of practice (the TICD checklist). METHODS: We performed a systematic review of frameworks of determinants of practice followed by a consensus process. We searched electronic databases and screened the reference lists of key background documents. Two authors independently assessed titles and abstracts, and potentially relevant full text articles. We compiled a list of attributes that a checklist should have: comprehensiveness, relevance, applicability, simplicity, logic, clarity, usability, suitability, and usefulness. We assessed included articles using these criteria and collected information about the theory, model, or logic underlying how the factors (determinants) were selected, described, and grouped, the strengths and weaknesses of the checklist, and the determinants and the domains in each checklist. We drafted a preliminary checklist based on an aggregated list of determinants from the included checklists, and finalized the checklist by a consensus process among implementation researchers. RESULTS: We screened 5,778 titles and abstracts and retrieved 87 potentially relevant papers in full text. Several of these papers had references to papers that we also retrieved in full text. We also checked potentially relevant papers we had on file that were not retrieved by the searches. We included 12 checklists. None of these were completely comprehensive when compared to the aggregated list of determinants and domains. We developed a checklist with 57 potential determinants of practice grouped in seven domains: guideline factors, individual health professional factors, patient factors, professional interactions, incentives and resources, capacity for organisational change, and social, political, and legal factors. We also developed five worksheets to facilitate the use of the checklist. CONCLUSIONS: Based on a systematic review and a consensus process we developed a checklist that aims to be comprehensive and to build on the strengths of each of the 12 included checklists. The checklist is accompanied with five worksheets to facilitate its use in implementation research and quality improvement projects.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“A number of theories, conceptual models, and frameworks point to important ‘targets,’ and most emphasize that implementation strategies may be needed to address multiple ‘targets.’”
From Implementation strategies: recommendations for specifying and reporting (2013) · cites this paper as [43]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Implementation strategies are too often designed in an unsystematic manner and fail to address key contextual determinants (13–16).”
From Enhancing the Impact of Implementation Strategies in Healthcare: A Research Agenda (2019) · cites this paper as [15]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“All of these community or organisational characteristics jointly influence implementation climate [14, 15], system readiness for change [14, 17, 67] and capacity for change [15, 62, 68, 69] and thus the chances of an intervention being implemented successfully.”
From Making sense of complexity in context and implementation: the Context and Implementation of Complex Interventions (CICI) framework (2017) · cites this paper as [69]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Expansion of the Outer Setting also brings the updated CFIR into closer alignment with other implementation and policy frameworks [18, 78–80].”
From The updated consolidated framework for implementation research based on user feedback (2022) · cites this paper as [18]
The cited source says what the claim attributes to it.
In the citing paper
“In the ensuing 9 years, the field has expanded considerably and further taxonomies, checklists, conceptual frameworks, theories, and models of implementation have been developed [10,13,14,17,18].”
From A systematic review of implementation frameworks of innovations in healthcare and resulting generic implementation framework (2015) · cites this paper as [17]
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496
Why Don't Physicians Follow Clinical Practice Guidelines?: A Framework for Improvement
Cabana, M. D., Rand, C. S., Powe, N. R., Wu, A. W., Wilson, M. H., Abboud, P.-A. C., & Rubin, H. R. (1999) · JAMA · doi:10.1001/jama.282.15.1458 · Cited by 6,677
Making psychological theory useful for implementing evidence based practice: a consensus approach
Michie, S. (2005) · Quality and Safety in Health Care · doi:10.1136/qshc.2004.011155 · Cited by 3,440
Enabling the implementation of evidence based practice: a conceptual framework.
Kitson, A., Harvey, G., & McCormack, B. (1998) · Quality in Health Care · doi:10.1136/qshc.7.3.149 · Cited by 1,985
What drives change? Barriers to and incentives for achieving evidence‐based practice
Grol, R., & Wensing, M. (2004) · Medical Journal of Australia · doi:10.5694/j.1326-5377.2004.tb05948.x · Cited by 1,378
Self-citationKitson, A. L., Rycroft-Malone, J., Harvey, G., McCormack, B., Seers, K., & Titchen, A. (2008) · Implementation Science · doi:10.1186/1748-5908-3-1 · Cited by 1,314
Atkins, D., Eccles, M., Flottorp, S., Guyatt, G. H., Henry, D., Hill, S., Liberati, A., O'Connell, D., Oxman, A. D., Phillips, B., et al. (2004) · BMC Health Services Research · doi:10.1186/1472-6963-4-38 · Cited by 1,235
Self-citationBaker, R., Camosso-Stefinovic, J., Gillies, C., Shaw, E. J., Cheater, F., Flottorp, S., & Robertson, N. (2010) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005470.pub2 · Cited by 1,003
Self-citationValidation of an index of the quality of review articles
Oxman, A. D., & Guyatt, G. H. (1991) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(91)90160-b · Cited by 786
Self-citationGaps between knowing and doing: Understanding and assessing the barriers to optimal health care
Cochrane, L. J., Olson, C. A., Murray, S., Dupuis, M., Tooman, T., & Hayes, S. (2007) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.106 · Cited by 500
Research works printed but not linked: 3
- Rainbird K, Sanson-Fisher R, Buchan H: Identifying barriers to evidence uptake. 2006, Melbourne: National Institute of Clinical Studies (NICS)
- SURE Collaboration: SURE Guides for Preparing and Using Evidence-Based Policy Briefs: 5. Identifying and addressing barriers to implementing policy options. 2011, Version 2.0 [updated August 2011]. The SURE Collaboration
- Bosch M, Wensing M, Eccles MP, van der Weijden T, Grol R: How to develop an effective program for improving patient care. 2009, Nijmengen: Institute for Quality of Healthcare, 73-113.
Cited by
The updated consolidated framework for implementation research based on user feedback
Damschroder, L. J., Reardon, C. M., Widerquist, M. A. O., & Lowery, J. (2022) · Implementation Science · doi:10.1186/s13012-022-01245-0 · Cited by 4,452
Making sense of implementation theories, models and frameworks
Nilsen, P. (2015) · Implementation Science · doi:10.1186/s13012-015-0242-0 · Cited by 4,447
Implementation strategies: recommendations for specifying and reporting
Proctor, E. K., Powell, B. J., & McMillen, J. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-139 · Cited by 2,585
Harvey, G., & Kitson, A. (2015) · Implementation Science · doi:10.1186/s13012-016-0398-2 · Cited by 1,271
Pfadenhauer, L. M., Gerhardus, A., Mozygemba, K., Lysdahl, K. B., Booth, A., Hofmann, B., Wahlster, P., Polus, S., Burns, J., Brereton, L., et al. (2017) · Implementation Science · doi:10.1186/s13012-017-0552-5 · Cited by 1,016
Metadata
- Authors
- Flottorp, S. A., Oxman, A. D., Krause, J., Musila, N. R., Wensing, M., Godycki-Cwirko, M., Baker, R., & Eccles, M. P.
- Affiliations
- Nasjonalt Kunnskapssenter for Helsetjenesten (NO)
- University of Leicester (GB)
- African Institute for Development Policy (KE)
- Radboud University Medical Center (NL)
- Newcastle University (GB)
- Corresponding author
- Flottorp, Signe A
- Venue
- Implementation Science
- Published
- 2013-03-23
- Volume
- 8
- Issue
- 1
- Pages
- 35-35
- ISSN
- 1748-5908 (ISSN-L)
- PMC
- PMC3617095
- OpenAlex
- W2112383195
- Cited by
- 1,138
- References
- 22
- Citations by year
- 2026: 67 · 2025: 87 · 2024: 135 · 2023: 120 · 2022: 132 · 2021: 137 · 2020: 118 · 2019: 81 · 2018: 54 · 2017: 72 · 2016: 45 · 2015: 49 · 2014: 33 · 2013: 8
- FWCI
- 5.40
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Implementation Science (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Radboud Repository (Radboud University) (publishedVersion)
- NORA - Norwegian Open Research Archives (submittedVersion, cc-by)
- Figshare (submittedVersion, cc-by)
- Leicester Research Archive (University of Leicester) (submittedVersion, cc-by)
- Radboud Repository (Radboud University) (submittedVersion, other-oa)
- Newcastle University ePrints (Newcastle Univesity) (cc-by)
- Funders
- European Commission (258837, 2007–2013, FP7 2007-2013, FP7/2007)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- implementation checklist, implementation research, quality improvement, guideline adherence, organizational change, patient factors, professional interaction, consensus development
- MeSH terms
- Classification, Health Personnel, Humans, Professional Practice, Checklist, Quality Improvement
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A checklist for identifying determinants of practice: A systematic review and synthesis of frameworks and taxonomies of factors that prevent or enable improvements in healthcare professional practice. https://app.cochat.ai/papers/10.1186/1748-5908-8-35
- The paper
- Flottorp, S. A., Oxman, A. D., Krause, J., Musila, N. R., Wensing, M., Godycki-Cwirko, M., Baker, R., & Eccles, M. P. (2013). A checklist for identifying determinants of practice: A systematic review and synthesis of frameworks and taxonomies of factors that prevent or enable improvements in healthcare professional practice. Implementation Science. https://doi.org/10.1186/1748-5908-8-35
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
