Effectiveness and efficiency of guideline dissemination and implementation strategies
Open accessThe DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Abstract
OBJECTIVES: To undertake a systematic review of the effectiveness and costs of different guideline development, dissemination and implementation strategies. To estimate the resource implications of these strategies. To develop a framework for deciding when it is efficient to develop and introduce clinical guidelines. DATA SOURCES: MEDLINE, Healthstar, Cochrane Controlled Trial Register, EMBASE, SIGLE and the specialised register of the Cochrane Effective Practice and Organisation of Care (EPOC) group. REVIEW METHODS: Single estimates of dichotomous process variables were derived for each study comparison based upon the primary end-point or the median measure across several reported end-points. Separate analyses were undertaken for comparisons of different types of intervention. The study also explored whether the effects of multifaceted interventions increased with the number of intervention components. Studies reporting economic data were also critically appraised. A survey to estimate the feasibility and likely resource requirements of guideline dissemination and implementation strategies in UK settings was carried out with key informants from primary and secondary care. RESULTS: In total, 235 studies reporting 309 comparisons met the inclusion criteria; of these 73% of comparisons evaluated multifaceted interventions, although the maximum number of replications of a specific multifaceted intervention was 11 comparisons. Overall, the majority of comparisons reporting dichotomous process data observed improvements in care; however, there was considerable variation in the observed effects both within and across interventions. Commonly evaluated single interventions were reminders, dissemination of educational materials, and audit and feedback. There were 23 comparisons of multifaceted interventions involving educational outreach. The majority of interventions observed modest to moderate improvements in care. No relationship was found between the number of component interventions and the effects of multifaceted interventions. Only 29.4% of comparisons reported any economic data. The majority of studies only reported costs of treatment; only 25 studies reported data on the costs of guideline development or guideline dissemination and implementation. The majority of studies used process measures for their primary end-point, despite the fact that only three guidelines were explicitly evidence based (and may not have been efficient). Respondents to the key informant survey rarely identified existing budgets to support guideline dissemination and implementation strategies. In general, the respondents thought that only dissemination of educational materials and short (lunchtime) educational meetings were generally feasible within current resources. CONCLUSIONS: There is an imperfect evidence base to support decisions about which guideline dissemination and implementation strategies are likely to be efficient under different circumstances. Decision makers need to use considerable judgement about how best to use the limited resources they have for clinical governance and related activities to maximise population benefits. They need to consider the potential clinical areas for clinical effectiveness activities, the likely benefits and costs required to introduce guidelines and the likely benefits and costs as a result of any changes in provider behaviour. Further research is required to: develop and validate a coherent theoretical framework of health professional and organisational behaviour and behaviour change to inform better the choice of interventions in research and service settings, and to estimate the efficiency of dissemination and implementation strategies in the presence of different barriers and effect modifiers.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, recent reviews (Farmer 2008; Grimshaw 2004) found that printed educational materials have a small (but potentially important) effect.”
From Audit and feedback: effects on professional practice and healthcare outcomes (2012) · cites this paper as Grimshaw 2004
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“while a systematic review of 235 implementation trials by Grimshaw et al. found no relationship between the number of component interventions and the effects of multifaceted interventions [100].”
From Writing implementation research grant proposals: ten key ingredients (2012) · cites this paper as [100]
The cited source says what the claim attributes to it.
In the citing paper
“It is important to note that the high frequency of educational interventions is not exclusive to the allied health professions, and a similar trend is seen in nursing [11] and in the guideline implementation literature, which is largely dominated by physicians [6].”
From Systematic review of knowledge translation strategies in the allied health professions (2012) · cites this paper as [6]
In the citing paper
“The empirical evidence for the effectiveness of multifaceted strategies has been mixed, because early research touted the benefits of multifaceted strategies [98,99], while a systematic review of 235 implementation trials by Grimshaw et al. found no relationship between the number of component interventions and the effects of multifaceted interventions [100].”
From Writing implementation research grant proposals: ten key ingredients (2012) · cites this paper as [100]
In the citing paper
“the bulk of the research evidence comes from the medical e.g., [4-9] and nursing literature e.g., [10,11].”
From Systematic review of knowledge translation strategies in the allied health professions (2012) · cites this paper as [6]
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2005) · Technometrics · doi:10.1198/tech.2005.s303 · Cited by 17,923
Methods for the Economic Evaluation of Health Care Programmes
Drummond, M. E., Sculpher, M. J., Torrance, G. W., O’Brien, B. J., & Stoddart, G. L. (2005) · doi:10.1093/oso/9780198529446.001.0001 · Cited by 13,648
(1979) · Medical Entomology and Zoology · Cited by 11,252
Quasi-experimentation: Design and analysis issues for field settings
Shrout, P. E. (1980) · Evaluation and Program Planning · doi:10.1016/0149-7189(80)90063-4 · Cited by 6,010
The cochrane database of systematic reviews
Geddes, J. (1996) · Journal of Psychosomatic Research · doi:10.1016/s0022-3999(96)90063-x · Cited by 5,989
Clinical guidelines: Potential benefits, limitations, and harms of clinical guidelines
Woolf, S. H., Grol, R., Hutchinson, A., Eccles, M., & Grimshaw, J. (1999) · BMJ · doi:10.1136/bmj.318.7182.527 · Cited by 2,548
Self-citationSystematic Reviews: Identifying relevant studies for systematic reviews
Dickersin, K., Scherer, R., & Lefebvre, C. (1994) · BMJ · doi:10.1136/bmj.309.6964.1286 · Cited by 2,256
Effectiveness and Efficiency: Random Reflections on Health Services
(1973) · Public Health · doi:10.1016/s0033-3506(73)80082-4 · Cited by 1,912
Guidelines for authors and peer reviewers of economic submissions to the BMJ
Drummond, M. F., & Jefferson, T. O. (1996) · BMJ · doi:10.1136/bmj.313.7052.275 · Cited by 1,827
Davis, D. A. (1995) · JAMA · doi:10.1001/jama.1995.03530090032018 · Cited by 1,763
Research works printed but not linked: 12
- [2]2. NHS Centre for Reviews and Dissemination. Getting evidence into practice. Effective Health Care 1999; 5 :1-16.
- [4]4. NHS Centre for Reviews and Dissemination and Nuffield Institute for Health. Implementing clinical guidelines. Can guidelines be used to improve clinical practice? Effective Health Care 1994; 1 :1-12.
- [9]9. Thomas L, Cullum N, McColl E, Rousseau N, Soutter J, Steen N. Clinical guidelines in nursing, midwifery and other professions allied to medicine (Cochrane Review). The Cochrane Library (Issue 1). Oxford: Update Software; 1999.
- [10]10. Bero L, Grilli R, Grimshaw JM, Mowatt G, Oxman A, Zwarenstein M. Cochrane Effective Practice and Organisation of Care Review Group (Cochrane Group Module). In Bero L, Grilli R, Grimshaw JM, Mowatt G, Oxman A, Zwarenstein M, editors. The Cochrane Library (Issue 3). Oxford: Update Software; 2001.
- [16]16. Bushman BJ. Vote counting methods in metaanalysis. In Cooper H, Hedges L, editors. The handbook of research synthesis. New York: Russell Sage Foundation; 1994; pp. 193-213.
- [17]17. Drummond M, O'Brien B, Stoddart G, Torrance GW. Methods of economic evaluation of health care programmes. Oxford: Oxford University Press; 1997.
- [18]18. McIntosh E. Economic evaluation of guideline implementation studies. In Makela M, Thorsen T, editors. Changing professional practice. Theory and practice of clinical guidelines implementation. Copenhagen: Danish Institute for Health Services Research and Development; 1999, pp. 77-98.
- [21]21. Jefferson TO, Demicheli V , Vale L. Methodological reviews of economic evaluations in health care. JAMA 2002; 287 :2809-12.
- [24]24. Mason J, Freemantle N, Nazereth I, Eccles M, Haines A, Drummond M. When is it cost effective - to change the behaviour of health professionals? JAMA 2001; 286 :2988-92.
- [27]27. Purves IN. PRODIGY: implementing clinical guidelines using computers. Br J Gen Pract 1998; 48 :1552-3.
- [34]34. Grol R. Beliefs and evidence in changing clinical practice. BMJ 1997; 315 :418-21.
- [36]36. Grimshaw JM, Eccles MP . Clinical practice guidelines. In Haines A, Silagy C, editors. Evidencebased practice in primary care. London: BMJ Publishing; 2001, pp. 120-34.
Cited by
Items 701–800 of 1,009
McIntyre, S. A., Francis, J., Gould, N. J., & Lorencatto, F. (2018) · Translational Behavioral Medicine · doi:10.1093/tbm/iby110 · Cited by 63
“, implementation interventions) have shown modest to moderate effects, outcomes vary widely [1].”
BackgroundRecovery-oriented training programmes for mental health professionals: A narrative literature review
Jackson-Blott, K., Hare, D. J., Davies, B. E. L., & Morgan, S. L. (2019) · Mental Health & Prevention · doi:10.1016/j.mhp.2019.01.005 · Cited by 57
McRae, I., Butler, J. R., Sibthorpe, B. M., Ruscoe, W., Snow, J., Rubiano, D., & Gardner, K. (2008) · BMC Health Services Research · doi:10.1186/1472-6963-8-205 · Cited by 52
“With any program addressing long term chronic diseases like diabetes, it is necessary to use modelling approaches to estimate long term outcomes and costs [14].”
BackgroundMethodMcDonald, M. V., Pezzin, L. E., Feldman, P. H., Murtaugh, C. M., & Peng, T. R. (2005) · Journal of Pain and Symptom Management · doi:10.1016/j.jpainsymman.2004.08.018 · Cited by 54
Goud, R., Hasman, A., & Peek, N. B. (2008) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2008.03.006 · Cited by 56
Foy, R., Penney, G. C., Grimshaw, J. M., Ramsay, C. R., Walker, A. E., MacLennan, G., Stearns, S. C., McKenzie, L., & Glasier, A. (2004) · BJOG: An International Journal of Obstetrics & Gynaecology · doi:10.1111/j.1471-0528.2004.00168.x · Cited by 44
“An economic evaluation was included, frequently absent from other evaluations despite the major opportunity costs of clinical effectiveness initiatives.(6) The patient survey response rate of 49%, although as good as other surveys of this client group,(9,15) might be associated with response bias.”
BackgroundMethodInfluentialSelf-citationSilva, M. T., Galvão, T. F., Chapman, E., da Silva, E. N., & Barreto, J. O. M. (2021) · Implementation Science · doi:10.1186/s13012-021-01164-6 · Cited by 51
Implementation costs of hospital-based computerised decision support systems: a systematic review
Donovan, T., Abell, B., Fernando, M., McPhail, S., & Carter, H. E. (2023) · Implementation Science · doi:10.1186/s13012-023-01261-8 · Cited by 55
“However, costs associated with implementation strategies are under-reported in the literature and often excluded from economic evaluations despite being a recognised implementation outcome [7–9].”
BackgroundPerspektiven der Leitlinienentwicklung und -implementation aus der Sicht der AWMF
Kopp, I. (2010) · Zeitschrift für Rheumatologie · doi:10.1007/s00393-009-0526-3 · Cited by 44
Parboosingh, J. T., Reed, V. A., Palmer, J. C., & Bernstein, H. H. (2011) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.20116 · Cited by 49
Francis, J., Duncan, E., Prior, M. E., MacLennan, G., Dombrowski, S. U., Bellingan, G. J., Campbell, M., Eccles, M., Rose, L., Rowan, K., et al. (2014) · Health Technology Assessment · doi:10.3310/hta18250 · Cited by 45
Self-citationCahill, N. E., & Heyland, D. K. (2010) · Journal of Parenteral and Enteral Nutrition · doi:10.1177/0148607110361907 · Cited by 56
Caries management: technical solutions to biological problems or evidence‐based care?
Baelum, V. (2008) · Journal of Oral Rehabilitation · doi:10.1111/j.1365-2842.2007.01784.x · Cited by 43
Kastner, M., & Straus, S. E. (2012) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2012.04.011 · Cited by 50
“These results highlight the need for better knowledge translation strategies [3].”
BackgroundKastner, M., & Straus, S. E. (2008) · Journal of General Internal Medicine · doi:10.1007/s11606-008-0871-y · Cited by 45
Family physicians' perceptions of academic detailing: a quantitative and qualitative study
Allen, M., Ferrier, S. N., O'Connor, N., & Fleming, I. (2007) · BMC Medical Education · doi:10.1186/1472-6920-7-36 · Cited by 44
“0%[1].”
Still no magic bullets: pursuing more rigorous research in quality improvement
Shojania, K. G., & Grimshaw, J. M. (2004) · The American Journal of Medicine · doi:10.1016/j.amjmed.2004.03.003 · Cited by 43
Self-citationMurray, M. A., Stacey, D., Wilson, K. G., & O'Connor, A. M. (2010) · Journal of Palliative Care · doi:10.1177/082585971002600207 · Cited by 43
“Evidence confirms that practical training, including audit and feedback, and interactive education are effective for converting innovation into practice (51,52).”
Use of Implementation Theory: A Focus on PARIHS
Ullrich, P. M., Sahay, A., & Stetler, C. B. (2014) · Worldviews on Evidence-Based Nursing · doi:10.1111/wvn.12016 · Cited by 43
“Even the most rigorous and costly efforts to implement evidence into practice can have highly variable effects (Eccles et al., 2009; Grimshaw et al., 2004).”
BackgroundMuche‐Borowski, C., & Kopp, I. (2011) · Zeitschrift für Herz- Thorax- und Gefäßchirurgie · doi:10.1007/s00398-011-0860-z · Cited by 43
Wensing, M., van Lieshout, J., Koetsenruijter, J., & Reeves, D. (2010) · Implementation Science · doi:10.1186/1748-5908-5-3 · Cited by 46
“However, currently available implementation interventions targeted at individual health professionals (focused on their motivation and competence) have mixed, and on average moderate impact [ 18 ].”
Self-citationGoderis, G., Borgermans, L. A. D., Grol, R. P. T. M., Broeke, C. V. D., Boland, B. B., Verbeke, G. N., Carbonez, A., Mathieu, C., & Heyrman, J. (2010) · Diabetes Research and Clinical Practice · doi:10.1016/j.diabres.2009.12.012 · Cited by 53
Sassen, B., Kok, G., & Vanhees, L. (2011) · BMC Public Health · doi:10.1186/1471-2458-11-246 · Cited by 52
“However, a substantial gap between clinical research findings and the daily practice of healthcare professionals remains [1-7].”
BackgroundSchleedoorn, M. J., Nelen, W. L. D. M., Dunselman, G. A. J., & Vermeulen, N. (2016) · Human Reproduction · doi:10.1093/humrep/dew078 · Cited by 43
“Implementation strategies tailored to these guideline-specific barriers are known to be the most effective in improving guideline adherence (Grol, 1997; Grimshaw et al., 2004).”
General practitioners' preferences for interventions to improve guideline adherence
Lugtenberg, M., Burgers, J. S., Han, D., & Westert, G. P. (2014) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.12209 · Cited by 45
“adherence [17–20].”
BackgroundSURGEONS’ ATTITUDES TOWARDS AND USAGE OF EVIDENCE‐BASED MEDICINE IN SURGICAL PRACTICE: A PILOT STUDY
Kitto, S. C., Villanueva, E., Chesters, J., Petrović, A., Waxman, B. P., & Smith, J. A. (2007) · ANZ Journal of Surgery · doi:10.1111/j.1445-2197.2007.04022.x · Cited by 43
Foy, R., Bamford, C., Francis, J. J., Johnston, M., Lecouturier, J., Eccles, M., Steen, N., & Grimshaw, J. (2007) · Implementation Science · doi:10.1186/1748-5908-2-31 · Cited by 43
“, reminder systems, interactive education) can be effective in changing professional behaviour [16].”
Self-citationCanadian Neonatal Network Partnerships for Health System Improvement Study Group, Lee, S. K., Aziz, K., Singhal, N., & Cronin, C. M. G. (2015) · Paediatrics & Child Health · doi:10.1093/pch/20.1.e1 · Cited by 48
Altman (2005) · doi:10.1016/s0025-7753(05)72203-x · Cited by 43
McKenzie, J. E., O'Connor, D. A., Page, M. J., Mortimer, D. S., French, S. D., Walker, B. F., Keating, J. L., Grimshaw, J. M., Michie, S., Francis, J. J., et al. (2010) · Implementation Science · doi:10.1186/1748-5908-5-86 · Cited by 42
“Consequently, we know little about how to formulate effective strategies for implementing CPGs.”
BackgroundMethodInfluentialSelf-citationLearning Collaboratives: a Strategy for Quality Improvement and Implementation in Behavioral Health
Gotham, H. J., Paris, M., & Hoge, M. A. (2022) · The Journal of Behavioral Health Services & Research · doi:10.1007/s11414-022-09826-z · Cited by 49
Kristensen, H. K., Borg, T., & Hounsgaard, L. (2011) · Scandinavian Journal of Occupational Therapy · doi:10.3109/11038128.2011.556197 · Cited by 60
“There is imperfect evidence to support decisions regarding what guideline dissemination and implementation strategies are likely to be effective (18,19).”
BackgroundPractices and views on fetal heart monitoring: a structured observation and interview study
Altaf, S., Oppenheimer, C. A., Shaw, R. L., Waugh, J. J. S., & Dixon‐Woods, M. (2006) · BJOG An International Journal of Obstetrics & Gynaecology · doi:10.1111/j.1471-0528.2006.00884.x · Cited by 44
Masso, M. R., & McCarthy, G. (2009) · International Journal of Evidence-Based Healthcare · doi:10.1111/j.1744-1609.2009.00132.x · Cited by 50
Wahabi, H., & Alziedan, R. A. (2012) · BMC Health Services Research · doi:10.1186/1472-6963-12-226 · Cited by 53
“Many studies investigated the barriers to the implementation of CPG in healthcare and the effective strategies for translating research into practice, however it is recognized that identification of local barriers to change is pivotal to changing practitioners’ behavior towards adoption of guidelines [11].”
BackgroundGrant, A. M., Sullivan, F., & Dowell, J. S. (2013) · Implementation Science · doi:10.1186/1748-5908-8-72 · Cited by 51
“Because the passive dissemination of research evidence has proven inadequate to improve the quality of prescribing [6,7], there has been substantial investment in a wide range of technologies and interventions designed to address this issue [8,9].”
BackgroundAudit and feedback interventions to improve endoscopist performance: Principles and effectiveness
Tinmouth, J., Patel, J., Hilsden, R. J., Ivers, N. M., & Llovet, D. (2016) · Best Practice & Research Clinical Gastroenterology · doi:10.1016/j.bpg.2016.04.002 · Cited by 44
“performance of healthcare over a specified period of time’ [9] and is one of the few quality improvement interventions that has been shown to improve physician performance, leading to better patient care [6].”
BackgroundVratsistas‐Curto, A., McCluskey, A., & Schurr, K. (2017) · BMJ Open Quality · doi:10.1136/bmjoq-2017-000212 · Cited by 44
Is Blood Pressure Improving in Children With Chronic Kidney Disease? A Period Analysis
Barletta, G., Pierce, C. B., Mitsnefes, M. M., Samuels, J., Warady, B. A., Furth, S. L., & Flynn, J. T. (2018) · Hypertension · doi:10.1161/hypertensionaha.117.09649 · Cited by 46
Bunn, F., Trivedi, D., Alderson, P., Hamilton, L., Martin, A., Pinkney, E., & Iliffe, S. (2015) · Health Technology Assessment · doi:10.3310/hta19280 · Cited by 42
Lasser, K. E., Shanahan, C. W., Parker, V. A., Beers, D., Xuan, Z., Heymann, O. D., Lange, A. V., & Liebschutz, J. M. (2015) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2015.06.018 · Cited by 48
“Visit content combines elements of audit and feedback (e.g. the expert reviews registry reports of individual PCP comparedwith that of peers and goals)with traditional educational outreach (Grimshaw et al., 2004; O'Brien et al., 2007; Soumerai et al., 1993).”
BackgroundEvaluation of PROforma as a language for implementing medical guidelines in a practical context
SUTTON, D. R., Taylor, P. M., & Earle, K. (2006) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-6-20 · Cited by 44
van der Wees, P. J., Hendriks, E., Jansen, M. J., van Beers, H., de Bie, R. A., & Dekker, J. (2007) · BMC Musculoskeletal Disorders · doi:10.1186/1471-2474-8-45 · Cited by 49
“Background Evidence-based clinical guidelines are considered important tools to improve quality in health care [1-3].”
BackgroundAchieving evidence-based nursing practice: impact of the Caledonian Development Model
Tolson, D., Booth, J., & Lowndes, A. (2008) · Journal of Nursing Management · doi:10.1111/j.1365-2834.2008.00889.x · Cited by 57
A framework for tobacco control: lessons learnt from Veterans Health Administration
Sherman, S. E. (2008) · BMJ · doi:10.1136/bmj.39510.805266.be · Cited by 43
“The chief feature of the first stage (in the VHA, before 1996) is the lack of a system. Providers act independently, as professionals have done for hundreds of years. Care is haphazard, with major variations between sites and between providers. Opinion leaders—influential peers—have a major effect on the behaviour of…”
BackgroundBland, M. D., Sturmoski, A., Whitson, M., Harris, H., Connor, L. T., Fucetola, R. P., Edmiaston, J., Huskey, T. N., Carter, A. R., Kramper, M., et al. (2013) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2013.02.004 · Cited by 45
Fretheim, A., Aaserud, M., & Oxman, A. D. (2006) · PLoS Medicine · doi:10.1371/journal.pmed.0030216 · Cited by 43
“The authors of a recent systematic review of guideline implementation strategies found that ‘‘relatively few studies considered any costs other than those of treatment and its consequences’’ [2].”
Backgroundvan Driel, M., Coenen, S., Dirven, K., Lobbestael, J., Janssens, I., Royen, P. V., Haaijer‐Ruskamp, F. M., Meyere, M. D., Maeseneer, J. D., & Christiaens, T. (2007) · BMJ Quality & Safety · doi:10.1136/qshc.2006.018663 · Cited by 50
Sakzewski, L., Ziviani, J. M., & Boyd, R. N. (2013) · Physical & Occupational Therapy In Pediatrics · doi:10.3109/01942638.2013.861890 · Cited by 51
“Specific strategies aimed to increase the uptake of evidence into practice and consequently change clinical behavior have had inconsistent results (Grimshaw et al., 2004).”
BackgroundEliciting Social Preference Weights for Functional Assessment of Cancer Therapy-Lung Health States
Kind, P., & Macran, S. (2005) · PharmacoEconomics · doi:10.2165/00019053-200523110-00006 · Cited by 42
Ramsay, J., Feder, G., Rivas, C., Carter, Y., Davidson, L., Hegarty, K., Taft, A., & Warburton, A. (2005) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005043 · Cited by 41
Bahtsevani, C., Willman, A., Khalaf, A., & Östman, M. (2008) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2007.00916.x · Cited by 41
Accounting for Attribute‐Level Non‐Attendance in a Health Choice Experiment: Does it Matter?
Erdem, S., Campbell, D., & Hole, A. R. (2014) · Health Economics · doi:10.1002/hec.3059 · Cited by 41
Kitson, A. A., Silverston, H., Wiechula, R., ZEITZ, K., Marcoionni, D., & Page, T. (2011) · Journal of Nursing Management · doi:10.1111/j.1365-2834.2011.01258.x · Cited by 52
Transformative Learning and Research Utilization in Nursing Practice: A Missing Link?
Matthew‐Maich, N., Ploeg, J., Jack, S. M., & Dobbins, M. (2009) · Worldviews on Evidence-Based Nursing · doi:10.1111/j.1741-6787.2009.00172.x · Cited by 62
Waldron, N., Dey, I., Nagree, Y., Xiao, J., & Flicker, L. A. (2011) · BMC Geriatrics · doi:10.1186/1471-2318-11-6 · Cited by 41
“The choice of a multi-faceted approach was likely to be important given that identified barriers existed at multiple levels, although such an approach may not always be required for guideline implementation [30].”
BackgroundResultGreen, L. A., Wyszewianski, L., Lowery, J. C., Kowalski, C. P., & Krein, S. L. (2007) · Implementation Science · doi:10.1186/1748-5908-2-41 · Cited by 44
“Background Reviews of research on practice guidelines implementation [1,2] and physician practice change [3-7] now widely conclude that no one type of intervention is likely to be successful, and that implementation efforts should use a combination of strategies tailored to the setting.”
PROHIBIT study group, Sax, H., Clack, L., Touveneau, S., Jantarada, F. D. L., Pittet, D., & Zingg, W. (2013) · Implementation Science · doi:10.1186/1748-5908-8-24 · Cited by 53
“Contextual factors are often cited as playing a role in the varied success of best practice interventions; however, existing literature reporting on implementation strategies often lacks details about specific contextual factors, and provides limited information about the real barriers and facilitators to implementati…”
BackgroundSimpson, F., & Doig, G. S. (2007) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2006.00717.x · Cited by 42
“Others have suggested that combinations of change interventions may have non-additive synergistic effects (Grimshaw et al. 2004a).”
BackgroundInfluentialFindlay, M., Rankin, N. M., Shaw, T. J., White, K., Boyer, M. J., Milross, C., Lourenço, R. D. A., Brown, C. S. B., Collett, G. K., Beale, P. J., et al. (2020) · Nutrients · doi:10.3390/nu12051465 · Cited by 44
“Although it has been recognised that the evidence base to support decision making regarding optimal guideline implementation strategies is imperfect [40], tailored interventions and adequate support are acknowledged to be key to successful guideline implementation [41].”
BackgroundPlanning and Implementation Intention Interventions
Rhodes, R. E., Grant, S. J., & de Bruijn, G. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108677318.039 · Cited by 49
Krones, T., Keller, H., Becker, A., Sönnichsen, A. C., Baum, E., & Donner‐Banzhoff, N. (2009) · Patient Education and Counseling · doi:10.1016/j.pec.2009.06.010 · Cited by 50
Byrne, K., Doody, C., & Hurley, D. A. (2005) · Manual Therapy · doi:10.1016/j.math.2005.06.002 · Cited by 48
Implementing clinical guidelines in low-income settings: A review of literature
Chakkalakal, R. J., Cherlin, E. J., Thompson, J., Lindfield, T., Lawson, R., & Bradley, E. H. (2013) · Global Public Health · doi:10.1080/17441692.2013.815794 · Cited by 41
“The economics and efficiency of guideline implementation and dissemination are not well known and would be particularly important to better understand prior to implementing guidelines in resource-limited settings (Grimshaw et al., 2004).”
BackgroundQuality of care: the need for medical, contextual and policy evidence in primary care
van Driel, M., Sutter, A. I. D., Christiaens, T., & Maeseneer, J. M. D. (2005) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2005.00549.x · Cited by 46
Pay for performance in health care: strategic issues for Australian experiments
Scott, I. A. (2007) · The Medical Journal of Australia · doi:10.5694/j.1326-5377.2007.tb01111.x · Cited by 41
Peters‐Klimm, F., Müller‐Tasch, T., Remppis, A., Szecsenyi, J., & Schellberg, D. (2008) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2008.01060.x · Cited by 41
Scaglione, L., Piobbici, M., Pagano, E., Ballini, L., Tamponi, G., & Ciccone, G. (2005) · PubMed · Cited by 47
Etxeberría, A., Pérez, I., Alcorta, I., Emparanza, J. I., de Velasco, E. R., Iglesias, M. T., Orozco‐Beltrán, D., & del Campo, R. R. (2013) · BMC Health Services Research · doi:10.1186/1472-6963-13-438 · Cited by 40
“It is important that guideline implementation interventions are designed in accordance with a coherent theoretical foundation, a body of evidence to support them and taking into account the barriers and facilitators of the local setting [6,11-13].”
BackgroundInfluentialFallon, T., Buikstra, E., Cameron, M., Hegney, D. G., Mackenzie, D., March, J., Moloney, C., & Pitt, J. (2006) · International Journal of Evidence-Based Healthcare · doi:10.1111/j.1479-6988.2006.00040.x · Cited by 46
“System supports or reminders are regarded as an effective strategy for producing behaviour change in multifaceted implementations.(22,34) Fortunately, a vehicle for this strategy existed in the facilities in the form of care plans.”
BackgroundZwarenstein, M., Shiller, S. K., Croxford, R., Grimshaw, J. M., Kelsall, D., Paterson, J. M., Laupacis, A., Austin, P. C., Tu, K., Yun, L., et al. (2014) · Implementation Science · doi:10.1186/1748-5908-9-87 · Cited by 35
“To clarify the usefulness of PEMs, large, pragmatic [7,10], and well-designed randomized controlled trials on the effect of PEMs on guideline adherence, conducted in real world settings, amongst typical practitioners are needed.”
BackgroundSelf-citationLeykum, L. K., Palmer, R., Lanham, H. L., Jordan, M. E., McDaniel, R. R., Noël, P. H., & Parchman, M. L. (2011) · BMC Health Services Research · doi:10.1186/1472-6963-11-44 · Cited by 41
“However, systematic reviews suggest that educational or knowledge-based interventions targeting individual providers to improve quality of care have been largely unsuccessful [12-14].”
BackgroundDogherty, E. J., Harrison, M. B., Graham, I. D., & Keeping‐Burke, L. (2014) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000008 · Cited by 47
“(4) S earch strategies used by Grimshaw et al.(26) for their investigation of the effectiveness and efficiency of guideline dissemination and implementation interventions in the context of medicine.”
MethodAttitudes and Persuasive Communication Interventions
Hamilton, K., & Johnson, B. T. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108677318.031 · Cited by 60
Hart, L., Jorm, A. F., Paxton, S. J., & Cvetkovski, S. (2012) · Early Intervention in Psychiatry · doi:10.1111/j.1751-7893.2012.00345.x · Cited by 46
“Although this result suggests that only a proportion of those who downloaded the guidelines will go on to show behaviour change, this finding is consistent with the broader literature on guidelines, which suggests that achieving change in knowledge is much easier than achieving behaviour change and adherence.(22,23) I…”
ResultTranslating Guidelines for the Diagnosis and Management of Sports-Related Concussion Into Practice
Donaldson, A., Newton, J., McCrory, P. R., White, P. E., Davis, G. A., Makdissi, M., & Finch, C. F. (2014) · American Journal of Lifestyle Medicine · doi:10.1177/1559827614538751 · Cited by 47
“In addition, a 2010 systematic review of the effectiveness and efficiency of a wide range of clinical guideline dissemination and implementation strategies indicated that most guideline implementation research is not informed by cognitive, behavioral, or organizational theory(127) and the majority of interventions wer…”
BackgroundCost-Effectiveness of a Quality Improvement Collaborative Focusing on Patients With Diabetes
Schouten, L., Niessen, L. W., van de Pas, J. W. A. M., Grol, R. P. T. M., & Hulscher, M. (2010) · Medical Care · doi:10.1097/mlr.0b013e3181eb318f · Cited by 42
Developing and implementing clinical guidelines: lessons from the NICE Schizophrenia Guideline
Pilling, S., & Price, K. (2006) · Epidemiologia e Psichiatria Sociale · doi:10.1017/s1121189x00004309 · Cited by 40
Evans, D. W., Foster, N. E., Underwood, M. R., Vogel, S. K., Breen, A. C., & Pincus, T. (2005) · BMC Musculoskeletal Disorders · doi:10.1186/1471-2474-6-41 · Cited by 46
“'Active' educational interventions, with which practitioners are directly engaged, are usually regarded as more effective at changing behaviour than 'passive' interventions, which act as vehicles for disseminating information such as behaviour recommendations, and are commonly in a written format [59-62].”
BackgroundMethodInfluentialBunn, F., Trivedi, D. P., Alderson, P., Hamilton, L. K., Martin, A. E., & Iliffe, S. (2014) · Systematic Reviews · doi:10.1186/2046-4053-3-125 · Cited by 41
“Although the implementation of NICE guidance has been shown to be variable [54,55], there is evidence that clinical guidelines can be effective in changing the process and outcome of care [56-60].”
BackgroundEccles, M., Steen, I. N., Whitty, P., & Hall, L. (2007) · Implementation Science · doi:10.1186/1748-5908-2-23 · Cited by 90
“However, a subsequent review of guideline implementation strategies concluded that there was the possibility of modest effects from the postal distribution of educational materials [1].”
InfluentialSelf-citationDrury, P., Levi, C. R., D’Este, C. A., McElduff, P., McInnes, E., Hardy, J., Dale, S., Cheung, N. W., Grimshaw, J., Quinn, C., et al. (2013) · International Journal of Stroke · doi:10.1111/ijs.12202 · Cited by 44
Self-citationHealth professionals’ decision‐making in wound management: a grounded theory
Gillespie, B. M., Chaboyer, W. P., John, W. S., Morley, N., & Nieuwenhoven, P. (2014) · Journal of Advanced Nursing · doi:10.1111/jan.12598 · Cited by 50
Scott, S. D., Grimshaw, J., Klassen, T. P., Nettel‐Aguirre, A., & Johnson, D. W. (2011) · Implementation Science · doi:10.1186/1748-5908-6-133 · Cited by 41
“The published literature includes a wealth of studies about KT interventions that have successful outcomes [28,34], however there are a limited number of studies that disentangle the factors that facilitate or hinder successful outcomes, characterize the failure to achieve success, or attempt to document the steps inv…”
BackgroundSelf-citationBrown, B. B., Young, J. M., Smith, D. P., Kneebone, A. B., Brooks, A. J., Xhilaga, M., Dominello, A., O’Connell, D. L., & Haines, M. (2014) · Implementation Science · doi:10.1186/1748-5908-9-64 · Cited by 49
“Intervention elements have been informed by reviews of the clinical practice change literature [9,11,37,38,42-61], and refined and tailored to take account of the organisational context in which providers practice through a multi-component needs and barriers analysis, including: iterative workshops with members of the…”
Practice guidelines need to address the ‘how’ and the ‘what’ of implementation
McKillop, A., Crisp, J., & Walsh, K. D. (2011) · Primary Health Care Research & Development · doi:10.1017/s1463423611000405 · Cited by 41
“%) and a mere 6% showed improvement using multifaceted educational outreach (Grimshaw et al., 2004).”
Changing Behavior: A Theory- and Evidence-Based Approach
Hagger, M. S., Cameron, L. D., Hamilton, K., Hankonen, N. E., & Lintunen, T. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108677318.001 · Cited by 62
Changing Behavior Using Integrated Theories
Hagger, M. S., & Hamilton, K. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108677318.015 · Cited by 51
Changing Behavior Using Habit Theory
Orbell, S., & Verplanken, B. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108677318.013 · Cited by 61
Bridging the gap in ageing: Translating policies into practice in Malaysian Primary Care
Krishnapillai, A. D. S., Ramli, A. S., Ariaratnam, S., Tauhid, N., Clearihan, L., & Browning, C. J. (2011) · Asia Pacific Family Medicine · doi:10.1186/1447-056x-10-2 · Cited by 39
Global use of the WHO Pocket Book of Hospital Care for Children
Li, M. Y., Kelly, J., Subhi, R., Were, W. M., & Duke, T. (2013) · Paediatrics and International Child Health · doi:10.1179/2046905512y.0000000017 · Cited by 50
A 38-Year-Old Woman With Fetal Loss and Hysterectomy
Sachs, B. P. (2005) · JAMA · doi:10.1001/jama.294.7.833 · Cited by 39
Voogdt-Pruis, H. R., Van Ree, J. W., Gorgels, A. P. M., & Beusmans, G. H. M. I. (2011) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2010.11.008 · Cited by 38
Determinants of impact of a practice accreditation program in primary care: a qualitative study
Nouwens, E., van Lieshout, J., & Wensing, M. (2015) · BMC Family Practice · doi:10.1186/s12875-015-0294-x · Cited by 41
“While accreditation may serve several purposes, improvement of professional performance and practice organization are prominent among these in the Dutch program [4–6].”
BackgroundSelf-citationKnowledge Transfer on Complex Social Interventions in Public Health: A Scoping Study
Dagenais, C., Malo, M., Robert, É., Ouimet, M., Berthelette, D., & Ridde, V. (2013) · PLoS ONE · doi:10.1371/journal.pone.0080233 · Cited by 51
“We now know that one-way, push-pull-type strategies are often insufficient to promote knowledge application [10,47] compared to two-way strategies [48].”
BackgroundGnich, W., Bonetti, D. L., Sherriff, A., Sharma, S., Conway, D. I., & Macpherson, L. M. D. (2015) · Community Dentistry And Oral Epidemiology · doi:10.1111/cdoe.12151 · Cited by 45
on behalf of the ASPIRE programme team, Glidewell, L., Willis, T. A., Petty, D. R., Lawton, R., McEachan, R., Ingleson, E., Heudtlass, P., Davies, A., Jamieson, T., et al. (2018) · Implementation Science · doi:10.1186/s13012-017-0704-7 · Cited by 40
“Many implementation studies focus on one clinical behaviour or condition [18, 19]; it is uncertain whether an implementation strategy developed for one problem will work for another.”
BackgroundKredo, T., Cooper, S., Abrams, A. L., Müller, J. G., Volmink, J. A., & Atkins, S. A. (2018) · BMC Health Services Research · doi:10.1186/s12913-018-3778-2 · Cited by 44
“Available evidence suggests that tailored, multi-faceted approaches may do better than generic and single-focused interventions [13, 14].”
BackgroundRashidian, A., & Russell, I. T. (2011) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2011.01690.x · Cited by 48
Gonzalez-Suarez, C., Dizon, J. M. R., King, Lorenzo, L., Valdecanas, Gambito, Fidel, & Grimmer, K. A. (2012) · Journal of Healthcare Leadership · doi:10.2147/jhl.s35370 · Cited by 46
“This research highlights that no matter how well a guideline is constructed, it will not implement itself.(14,15) Strong and informed leadership that plans and implements multipronged evidence–translation approaches is required to embed guideline recommendations into widespread and sustainable local practice.”
Metadata
- Authors
- Grimshaw, J., Thomas, R., MacLennan, G., Fraser, C., Ramsay, C., Vale, L., Whitty, P., Eccles, M., Matowe, L., Shirran, L., Wensing, M., Dijkstra, R., & Donaldson, C.
- Affiliations
- University of Aberdeen (GB)
- Newcastle University (GB)
- Radboud University Nijmegen (NL)
- University of Calgary (CA)
- Venue
- Health Technology Assessment
- Published
- 2004-02
- Volume
- 8
- Issue
- 6
- Pages
- iii-iv, 1
- ISSN
- 1366-5278 (ISSN-L)
- 2046-4924
- OpenAlex
- W2038028146
- Cited by
- 3,044
- References
- 38
- Citations by year
- 2026: 45 · 2025: 45 · 2024: 72 · 2023: 65 · 2022: 69 · 2021: 100 · 2020: 163 · 2019: 87 · 2018: 112 · 2017: 129 · 2016: 133 · 2015: 184 · 2014: 188 · 2013: 288 · 2012: 167
- FWCI
- 20.52
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- Locations
- Health Technology Assessment (publishedVersion, other-oa)
- PubMed (publishedVersion)
- Radboud Repository (Radboud University) (submittedVersion, other-oa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Radboud Repository (Radboud University) (submittedVersion)
- Newcastle University ePrints (Newcastle Univesity)
- Funders
- Health Technology Assessment programme (94/08/29)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Keywords
- guideline dissemination, guideline implementation, guideline development, multicomponent intervention, educational outreach, reminders, audit and feedback, teaching materials, cost-effectiveness, resource requirements, clinical governance, primary care, secondary care, evidence-based recommendations, process indicators, healthcare quality improvement
- MeSH terms
- Cost-Benefit Analysis, United Kingdom, Medical Informatics, State Medicine, Practice Guidelines as Topic, Information Dissemination
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.