Effectiveness and efficiency of guideline dissemination and implementation strategies
Open accessThe DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Abstract
OBJECTIVES: To undertake a systematic review of the effectiveness and costs of different guideline development, dissemination and implementation strategies. To estimate the resource implications of these strategies. To develop a framework for deciding when it is efficient to develop and introduce clinical guidelines. DATA SOURCES: MEDLINE, Healthstar, Cochrane Controlled Trial Register, EMBASE, SIGLE and the specialised register of the Cochrane Effective Practice and Organisation of Care (EPOC) group. REVIEW METHODS: Single estimates of dichotomous process variables were derived for each study comparison based upon the primary end-point or the median measure across several reported end-points. Separate analyses were undertaken for comparisons of different types of intervention. The study also explored whether the effects of multifaceted interventions increased with the number of intervention components. Studies reporting economic data were also critically appraised. A survey to estimate the feasibility and likely resource requirements of guideline dissemination and implementation strategies in UK settings was carried out with key informants from primary and secondary care. RESULTS: In total, 235 studies reporting 309 comparisons met the inclusion criteria; of these 73% of comparisons evaluated multifaceted interventions, although the maximum number of replications of a specific multifaceted intervention was 11 comparisons. Overall, the majority of comparisons reporting dichotomous process data observed improvements in care; however, there was considerable variation in the observed effects both within and across interventions. Commonly evaluated single interventions were reminders, dissemination of educational materials, and audit and feedback. There were 23 comparisons of multifaceted interventions involving educational outreach. The majority of interventions observed modest to moderate improvements in care. No relationship was found between the number of component interventions and the effects of multifaceted interventions. Only 29.4% of comparisons reported any economic data. The majority of studies only reported costs of treatment; only 25 studies reported data on the costs of guideline development or guideline dissemination and implementation. The majority of studies used process measures for their primary end-point, despite the fact that only three guidelines were explicitly evidence based (and may not have been efficient). Respondents to the key informant survey rarely identified existing budgets to support guideline dissemination and implementation strategies. In general, the respondents thought that only dissemination of educational materials and short (lunchtime) educational meetings were generally feasible within current resources. CONCLUSIONS: There is an imperfect evidence base to support decisions about which guideline dissemination and implementation strategies are likely to be efficient under different circumstances. Decision makers need to use considerable judgement about how best to use the limited resources they have for clinical governance and related activities to maximise population benefits. They need to consider the potential clinical areas for clinical effectiveness activities, the likely benefits and costs required to introduce guidelines and the likely benefits and costs as a result of any changes in provider behaviour. Further research is required to: develop and validate a coherent theoretical framework of health professional and organisational behaviour and behaviour change to inform better the choice of interventions in research and service settings, and to estimate the efficiency of dissemination and implementation strategies in the presence of different barriers and effect modifiers.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, recent reviews (Farmer 2008; Grimshaw 2004) found that printed educational materials have a small (but potentially important) effect.”
From Audit and feedback: effects on professional practice and healthcare outcomes (2012) · cites this paper as Grimshaw 2004
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“while a systematic review of 235 implementation trials by Grimshaw et al. found no relationship between the number of component interventions and the effects of multifaceted interventions [100].”
From Writing implementation research grant proposals: ten key ingredients (2012) · cites this paper as [100]
The cited source says what the claim attributes to it.
In the citing paper
“It is important to note that the high frequency of educational interventions is not exclusive to the allied health professions, and a similar trend is seen in nursing [11] and in the guideline implementation literature, which is largely dominated by physicians [6].”
From Systematic review of knowledge translation strategies in the allied health professions (2012) · cites this paper as [6]
In the citing paper
“The empirical evidence for the effectiveness of multifaceted strategies has been mixed, because early research touted the benefits of multifaceted strategies [98,99], while a systematic review of 235 implementation trials by Grimshaw et al. found no relationship between the number of component interventions and the effects of multifaceted interventions [100].”
From Writing implementation research grant proposals: ten key ingredients (2012) · cites this paper as [100]
In the citing paper
“the bulk of the research evidence comes from the medical e.g., [4-9] and nursing literature e.g., [10,11].”
From Systematic review of knowledge translation strategies in the allied health professions (2012) · cites this paper as [6]
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2005) · Technometrics · doi:10.1198/tech.2005.s303 · Cited by 17,923
Methods for the Economic Evaluation of Health Care Programmes
Drummond, M. E., Sculpher, M. J., Torrance, G. W., O’Brien, B. J., & Stoddart, G. L. (2005) · doi:10.1093/oso/9780198529446.001.0001 · Cited by 13,648
(1979) · Medical Entomology and Zoology · Cited by 11,252
Quasi-experimentation: Design and analysis issues for field settings
Shrout, P. E. (1980) · Evaluation and Program Planning · doi:10.1016/0149-7189(80)90063-4 · Cited by 6,010
The cochrane database of systematic reviews
Geddes, J. (1996) · Journal of Psychosomatic Research · doi:10.1016/s0022-3999(96)90063-x · Cited by 5,989
Clinical guidelines: Potential benefits, limitations, and harms of clinical guidelines
Woolf, S. H., Grol, R., Hutchinson, A., Eccles, M., & Grimshaw, J. (1999) · BMJ · doi:10.1136/bmj.318.7182.527 · Cited by 2,548
Self-citationSystematic Reviews: Identifying relevant studies for systematic reviews
Dickersin, K., Scherer, R., & Lefebvre, C. (1994) · BMJ · doi:10.1136/bmj.309.6964.1286 · Cited by 2,256
Effectiveness and Efficiency: Random Reflections on Health Services
(1973) · Public Health · doi:10.1016/s0033-3506(73)80082-4 · Cited by 1,912
Guidelines for authors and peer reviewers of economic submissions to the BMJ
Drummond, M. F., & Jefferson, T. O. (1996) · BMJ · doi:10.1136/bmj.313.7052.275 · Cited by 1,827
Davis, D. A. (1995) · JAMA · doi:10.1001/jama.1995.03530090032018 · Cited by 1,763
Research works printed but not linked: 12
- [2]2. NHS Centre for Reviews and Dissemination. Getting evidence into practice. Effective Health Care 1999; 5 :1-16.
- [4]4. NHS Centre for Reviews and Dissemination and Nuffield Institute for Health. Implementing clinical guidelines. Can guidelines be used to improve clinical practice? Effective Health Care 1994; 1 :1-12.
- [9]9. Thomas L, Cullum N, McColl E, Rousseau N, Soutter J, Steen N. Clinical guidelines in nursing, midwifery and other professions allied to medicine (Cochrane Review). The Cochrane Library (Issue 1). Oxford: Update Software; 1999.
- [10]10. Bero L, Grilli R, Grimshaw JM, Mowatt G, Oxman A, Zwarenstein M. Cochrane Effective Practice and Organisation of Care Review Group (Cochrane Group Module). In Bero L, Grilli R, Grimshaw JM, Mowatt G, Oxman A, Zwarenstein M, editors. The Cochrane Library (Issue 3). Oxford: Update Software; 2001.
- [16]16. Bushman BJ. Vote counting methods in metaanalysis. In Cooper H, Hedges L, editors. The handbook of research synthesis. New York: Russell Sage Foundation; 1994; pp. 193-213.
- [17]17. Drummond M, O'Brien B, Stoddart G, Torrance GW. Methods of economic evaluation of health care programmes. Oxford: Oxford University Press; 1997.
- [18]18. McIntosh E. Economic evaluation of guideline implementation studies. In Makela M, Thorsen T, editors. Changing professional practice. Theory and practice of clinical guidelines implementation. Copenhagen: Danish Institute for Health Services Research and Development; 1999, pp. 77-98.
- [21]21. Jefferson TO, Demicheli V , Vale L. Methodological reviews of economic evaluations in health care. JAMA 2002; 287 :2809-12.
- [24]24. Mason J, Freemantle N, Nazereth I, Eccles M, Haines A, Drummond M. When is it cost effective - to change the behaviour of health professionals? JAMA 2001; 286 :2988-92.
- [27]27. Purves IN. PRODIGY: implementing clinical guidelines using computers. Br J Gen Pract 1998; 48 :1552-3.
- [34]34. Grol R. Beliefs and evidence in changing clinical practice. BMJ 1997; 315 :418-21.
- [36]36. Grimshaw JM, Eccles MP . Clinical practice guidelines. In Haines A, Silagy C, editors. Evidencebased practice in primary care. London: BMJ Publishing; 2001, pp. 120-34.
Cited by
Items 301–400 of 1,009
Policy strategies to reduce waits for elective care: a synthesis of international evidence
Kreindler, S. A. (2010) · British Medical Bulletin · doi:10.1093/bmb/ldq014 · Cited by 119
Putrik, P., Ramiro, S., Kvien, T. K., Sokka, T., Uhlig, T., Boonen, A. E. R. C. H., Collaku, L., Harutyunyan, R., Radner, H., Soroka, N., et al. (2013) · Annals of the Rheumatic Diseases · doi:10.1136/annrheumdis-2013-203819 · Cited by 117
Care bundles: the holy grail of infectious risk management in hospital?
Marwick, C., & Davey, P. G. (2009) · Current Opinion in Infectious Diseases · doi:10.1097/qco.0b013e32832e0736 · Cited by 121
Chan, W. V., Pearson, T. A., Bennett, G. C., Cushman, W. C., Gaziano, T. A., Gorman, P. N., Handler, J., Krumholz, H. M., Kushner, R. F., MacKenzie, T. D., et al. (2017) · Circulation · doi:10.1161/cir.0000000000000481 · Cited by 99
Thompson, C. A., McCaughan, D., Cullum, N. A., Sheldon, T., & Raynor, P. (2005) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2005.03609.x · Cited by 132
“2001) and interventions to increase the implementation of clinical guidelines (Grimshaw et al. 2004) offer few explanations.”
BackgroundAntimicrobial stewardship in Australian hospitals
Duguid, M. J., & Cruickshank, M. (2011) · Cited by 134
Seers, K., Rycroft-Malone, J., Cox, K., Crichton, N., Edwards, R. T., Eldh, A. C., Estabrooks, C. A., Harvey, G., Hawkes, C., Jones, C., et al. (2018) · Implementation Science · doi:10.1186/s13012-018-0831-9 · Cited by 116
“[8 – 10] Facilitation has been described as a process and a role [11].”
BackgroundClinical nurse educators as agents for change: increasing research utilization
Milner, F. M., Estabrooks, C. A., & Humphrey, C. (2005) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2004.11.006 · Cited by 141
Smoking cessation guidelines for Australian general practice.
Zwar, N. A., RICHMOND, R. L., Borland, R., Stillman, S., Cunningham, M., & Litt, J. (2005) · PubMed · Cited by 115
Davies, B., Edwards, N., Ploeg, J., & Virani, T. (2008) · BMC Health Services Research · doi:10.1186/1472-6963-8-29 · Cited by 114
“Cost considerations such as staffing for increased workload due to new procedures recommended in guidelines are critical for decision-makers [8], yet few authors have attempted to estimate these costs.”
BackgroundMethodResultInfluentialImproving the detection and management of depression in primary care
Gilbody, S. M. (2003) · Quality and Safety in Health Care · doi:10.1136/qhc.12.2.149 · Cited by 117
“…on educational and organisational interventions to improve the management and outcome of depression in primary care settings builds upon a review of all guideline implementation strategies commissioned by the UK NHS HTA programme 21 and a Cochrane review of mental health workers in primary care.”
MethodInterventions to improve continuity of care in the follow-up of patients with cancer
Aubin, M., Giguere, A. M. C., Martin, M., Verreault, R., Fitch, M. I., Kazanjian, A., & Carmichael, P. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007672.pub2 · Cited by 143
Improving adherence in mood disorders: the struggle against relapse, recurrence and suicide risk
Pompili, M., Serafini, G., Del Casale, A., Rigucci, S., Innamorati, M., Girardi, P., Tatarelli, R., & Lester, D. (2009) · Expert Review of Neurotherapeutics · doi:10.1586/ern.09.62 · Cited by 113
Helder, O. K., van Goudoever, J. B., Looman, C. W. N., van Goudoever, J. B., & Kornelisse, R. F. (2010) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2010.03.005 · Cited by 134
Koh, S. S. L., Manias, E., Hutchinson, A. M., Donath, S. M., & Johnston, L. J. (2008) · BMC Health Services Research · doi:10.1186/1472-6963-8-105 · Cited by 138
“Grimshaw et al [19] in their latest systematic review argued that across all combinations of interventions, multifaceted interventions did not appear to be more effective than single interventions.”
BackgroundWhat Do We Know About Knowledge Translation in the Care of Older Adults? A Scoping Review
Boström, A., Slaughter, S. E., Chojecki, D., & Estabrooks, C. A. (2011) · Journal of the American Medical Directors Association · doi:10.1016/j.jamda.2010.12.004 · Cited by 125
Eldh, A. C., Almost, J., DeCorby-Watson, K., Gifford, W., Harvey, G., Hasson, H., Kenny, D. J., Moodie, S., Wallin, L., & Yost, J. (2017) · BMC Health Services Research · doi:10.1186/s12913-016-1958-5 · Cited by 124
“Implementation interventions are usually complex, with methods or techniques designed to change behaviours at organisational, practitioner or patient levels [15, 16] and to enhance the adoption of a clinical intervention [4, 17].”
BackgroundJain, M. K., Heyland, D., Dhaliwal, R., Day, A. G., Drover, J., Keefe, L., & Gelula, M. (2006) · Critical Care Medicine · doi:10.1097/01.ccm.0000234044.91893.9c · Cited by 109
“(15) summarized all cluster randomized trials of multifaceted intervention strategies compared with a control group that also received some form of intervention (in contrast to “no intervention”) and demonstrated that the average effect size was 8.”
BackgroundInfluentialBierbaum, M., Rapport, F., Arnolda, G., Easpaig, B. N. G., Lamprell, K., Hutchinson, K., Delaney, G. P., Liauw, W., Kefford, R. F., Olver, I., et al. (2020) · Implementation Science · doi:10.1186/s13012-020-00991-3 · Cited by 117
“The implementation of CPGs often lags behind dissemination [8].”
BackgroundSystematic review of economic evaluations and cost analyses of guideline implementation strategies
Vale, L., Thomas, R., MacLennan, G., & Grimshaw, J. (2007) · The European Journal of Health Economics · doi:10.1007/s10198-007-0043-8 · Cited by 107
“The following databases were searched using an extensive search strategy that was 92% sensitive for studies meeting the inclusion criteria [13]: MEDLINE (1966– 1998); EMBASE (1980–1998); HealthSTAR (1975–1998); SIGLE (1980–1998); the Cochrane Controlled Trials Register (4th edition 1998) and the register of the Cochra…”
MethodSelf-citationCurran, J. A., Brehaut, J., Patey, A. M., Osmond, M., Stiell, I., & Grimshaw, J. M. (2013) · Implementation Science · doi:10.1186/1748-5908-8-25 · Cited by 107
“The effects of an intervention may vary by patient condition or environmental context as the causal mechanisms are often modified by different enablers and barriers [13].”
BackgroundSelf-citationAdherence to Guidelines in Adult Patients with Traumatic Brain Injury: A Living Systematic Review
Cnossen, M. C., Scholten, A. C., Lingsma, H. F., Synnot, A., Tavender, E., Gantner, D., Lecky, F., Steyerberg, E. W., & Polinder, S. (2021) · Journal of Neurotrauma · doi:10.1089/neu.2015.4121 · Cited by 107
Girlanda, F., Fiedler, I., Becker, T., Barbui, C., & Koesters, M. (2017) · British Journal of Psychiatry · doi:10.1192/bjp.bp.115.179093 · Cited by 105
Patient-mediated interventions to improve professional practice
Fønhus, M. S., Dalsbø, T. K., Johansen, M., Fretheim, A., Skirbekk, H., & Flottorp, S. A. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012472.pub2 · Cited by 126
Changing Behavior Using the Health Action Process Approach
Schwarzer, R., & Hamilton, K. (2020) · The Handbook of Behavior Change · doi:10.1017/9781108677318.007 · Cited by 102
Légaré, F., O'Connor, A., Graham, I. D., Saucier, D., Côté, L., Cauchon, M., & Paré, L. (2006) · Europe PMC (PubMed Central) · Cited by 137
Prytys, M., Garety, P. A., Jolley, S., Onwumere, J., & Craig, T. (2011) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.691 · Cited by 107
“Grimshaw et al. (2004) conducted a comprehensive systematic review of 235 studies of guideline dissemination and implementation strategies in health care.”
BackgroundEriksen, J., Gustafsson, L. L., Ateva, K., Bastholm‐Rahmner, P., Ovesjö, M., Jirlow, M., Juhasz-Haverinen, M., Lärfars, G., Malmström, R. E., Wettermark, B., et al. (2017) · BMJ Open · doi:10.1136/bmjopen-2016-014345 · Cited by 114
“15 16 Multifaceted interventions, academic detailing and reminders have all been found to be effective.(16) 41 42 Financial incentives were introduced in Stockholm healthcare region in 2008(14) and have also been shown to contribute to the high adherence.”
BackgroundShanbhag, D., Graham, I. D., Harlos, K., Haynes, R. B., Gabizon, I., Connolly, S. J., & Spall, H. G. C. V. (2018) · BMJ Open · doi:10.1136/bmjopen-2017-017765 · Cited by 121
Weinmann, S., Koesters, M., & Becker, T. M. (2007) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.2007.01016.x · Cited by 126
“Instruments and quality assessment Methodological quality was assessed by using the Cochrane Effective Practice and Organisation of Care Review Group (EPOC) criteria as reported by Grimshaw (10).”
BackgroundMethodKwag, K. H., González‐Lorenzo, M., Banzi, R., Bonovas, S., & Moja, L. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5234 · Cited by 113
“Point-of-care information summaries offer predigested syntheses of medical research intended to be used when the patient and physician interact (ie, point-of-care) [1].”
Clinical guidelines: what can we do to increase their use?
Grol, R. P. T. M., & Buchan, H. (2006) · The Medical Journal of Australia · doi:10.5694/j.1326-5377.2006.tb00580.x · Cited by 104
Tomasone, J. R., Kauffeldt, K. D., Chaudhary, R., & Brouwers, M. C. (2020) · Implementation Science · doi:10.1186/s13012-020-0971-6 · Cited by 103
Audit and feedback: effects on professional practice
Ivers, N., Yogasingam, S., Lacroix, M., Brown, K. A., Antony, J., Soobiah, C., Simeoni, M., Willis, T. A., Crawshaw, J., Antonopoulou, V., et al. (2025) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000259.pub4 · Cited by 78
Self-citationThornicroft, G., & Tansella, M. (2008) · Cambridge University Press eBooks · doi:10.1017/cbo9780511544347 · Cited by 103
Florin, J., Ehrenberg, A., Wallin, L., & Gustavsson, P. J. (2011) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2011.05792.x · Cited by 119
Backman, R., Bayliss, S. E., Moore, D., & Litchfield, I. J. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0627-z · Cited by 113
“Background Implementation of desirable clinical behaviours, such as compliance with national guidelines, has taken a variety of forms within healthcare [1, 2].”
BackgroundGenetic education for primary care providers: improving attitudes, knowledge, and confidence.
Carroll, J. C., Rideout, A. L., Wilson, B. J., Allanson, J. M., Blaine, S., Esplen, M. J., Farrell, S. A., Graham, G. E., MacKenzie, J. J., Meschino, W. S., et al. (2009) · PubMed Central · Cited by 102
Fretheim, A., Munabi-Babigumira, S., Oxman, A. D., Lavis, J. N., & Lewin, S. (2009) · Health Research Policy and Systems · doi:10.1186/1478-4505-7-s1-s6 · Cited by 101
“Several strategies aimed at achieving behavioural change among healthcare professionals have been rigorously assessed [20-23].”
Squires, J. E., Estabrooks, C. A., O'Rourke, H. M., Gustavsson, P., Newburn-Cook, C. V., & Wallin, L. (2011) · Implementation Science · doi:10.1186/1748-5908-6-83 · Cited by 101
“[8] in their review of guideline dissemination and implementation strategies.”
BackgroundResultInfluentialYost, J., Ganann, R., Thompson, D., Aloweni, F. B. A. B., Newman, K., Hazzan, A. A., McKibbon, A., Dobbins, M., & Ciliska, D. K. (2015) · Implementation Science · doi:10.1186/s13012-015-0286-1 · Cited by 122
“A list of KT interventions was compiled from similar systematic reviews conducted by the EPOC review group and the UK Health Technology Assessment Programme [6, 8, 71, 84, 101] (e.”
BackgroundMethodResultInfluentialKnowledge creation: synthesis, tools and products
Brouwers, M. C., Stacey, D., & O'Connor, A. M. C. (2009) · Canadian Medical Association Journal · doi:10.1503/cmaj.081230 · Cited by 118
“Interventions for implementation ranged from mass-media interventions to use of local opinion-leaders and include interventions targeted toward the public, health care professionals, managers and others.(23) However, the potential benefits of clinical practice guidelines are only as good as the quality of the guidelin…”
BackgroundBeeckman, D., Clays, E., Van Hecke, A., Vanderwee, K., Schoonhoven, L., & Verhaeghe, S. (2013) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2012.09.007 · Cited by 100
Pincus, T., Foster, N. E., Vogel, S. K., Santos, R., Breen, A. C., & Underwood, M. R. (2006) · Manual Therapy · doi:10.1016/j.math.2006.06.005 · Cited by 114
“One method to inform clinical decision-making is through the use of clinical practice guidelines (Grimshaw et al., 2004).”
MethodRational prescribing in primary care (RaPP): a cluster randomized trial of a tailored intervention
Fretheim, A., Oxman, A. D., Håvelsrud, K., Treweek, S., Kristoffersen, D. T., & Bjørndal, A. (2006) · PLoS Medicine · doi:10.1371/journal.pmed.0030134 · Cited by 99
“Several randomized trials of guideline implementation strategies have been conducted, generally demonstrating only modest effects [4].”
What is evidence-based behavior analysis?
Smith, T. H. (2013) · The Behavior Analyst · doi:10.1007/bf03392290 · Cited by 126
“However, in keeping with the previous discussion about the difficulty of replicating unstandardized packages, little is known about how best to promote accurate implementation of such guidelines (Grimshaw et al., 2004).”
BackgroundMorgan, D. J., Leppin, A. L., Smith, C. D., & Korenstein, D. R. (2017) · Journal of Hospital Medicine · doi:10.12788/jhm.2738 · Cited by 109
Spoon, D., Rietbergen, T., Huis, A. M. P., Heinen, M. M., van Dijk, M., van Bodegom‐Vos, L., & Ista, E. (2020) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2020.103748 · Cited by 121
Do practices comply with key recommendations of the British Asthma Guideline? If not, why not?
Wiener-Ogilvie, S., Pinnock, H., Huby, G. Ø., Sheikh, A., Partridge, M. R., & Gillies, J. C. M. (2007) · Primary Care Respiratory Journal · doi:10.3132/pcrj.2007.00074 · Cited by 111
Michota, F. A. (2007) · Journal of General Internal Medicine · doi:10.1007/s11606-007-0369-z · Cited by 99
“Few direct comparisons of different types of quality initiatives have been undertaken, making it difficult to abstract optimal strategies.(11,12)”
BackgroundThomas, R. E., Croal, B. L., Ramsay, C. R., Eccles, M., & Grimshaw, J. (2006) · The Lancet · doi:10.1016/s0140-6736(06)68888-0 · Cited by 99
Self-citationInterventions for the interruption or reduction of the spread of respiratory viruses
Jefferson, T., Foxlee, R., Del Mar, C., Dooley, L., Ferroni, E., Hewak, B., Prabhala, A., Nair, S., & Rivetti, A. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006207.pub2 · Cited by 97
Rouleau, G., Gagnon, M., & Côté, J. (2015) · Systematic Reviews · doi:10.1186/s13643-015-0062-y · Cited by 128
Potential functional and pathological side effects related to off-target pharmacological activity
Lynch, J. J., Vleet, T. R. V., Mittelstadt, S. W., & Blomme, E. A. G. (2017) · Journal of Pharmacological and Toxicological Methods · doi:10.1016/j.vascn.2017.02.020 · Cited by 102
Côté, A.-M., Durand, M., Tousignant, M., & Poitras, S. (2009) · Journal of Occupational Rehabilitation · doi:10.1007/s10926-009-9167-2 · Cited by 107
Barriers to implementation of isoniazid preventive therapy in HIV clinics: a qualitative study
Lester, R., Hamilton, R., Charalambous, S., Dwadwa, T., Chandler, C., Churchyard, G., & Grant, A. D. (2010) · AIDS · doi:10.1097/01.aids.0000391021.18284.12 · Cited by 98
“However, our study highlights that the promotion of IPT guidelines does not guarantee that policy will translate into practice, mirroring findings from other areas of medicine [7].”
ResultThe education of health practitioners supporting breastfeeding women: time for critical reflection
Dykes, F. (2006) · Maternal and Child Nutrition · doi:10.1111/j.1740-8709.2006.00071.x · Cited by 124
Knowledge translation in physical therapy: from theory to practice
Zidarov, D., Thomas, A., & Poissant, L. (2013) · Disability and Rehabilitation · doi:10.3109/09638288.2012.748841 · Cited by 116
Bonetti, D. L., Pitts, N. B., Eccles, M., Grimshaw, J., Johnston, M., Steen, N., Glidewell, L., Thomas, R. E., MacLennan, G., Clarkson, J., et al. (2006) · Social Science & Medicine · doi:10.1016/j.socscimed.2006.04.005 · Cited by 110
“However, systematic reviews of implementation interventions have shown that these methods of increasing knowledge and skills have a variable success rate, often failing to achieve changes across a variety of clinical behaviours (Grimshaw et al 2001; Grimshaw et al, 2004).”
BackgroundSelf-citationSpiby, H., McCormick, F. M., WALLACE, L. M., Renfrew, M. J., D'Souza, L., & Dyson, L. (2007) · Midwifery · doi:10.1016/j.midw.2007.01.006 · Cited by 128
Davis, D. (2006) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.46 · Cited by 99
Gagliardi, A. R., & Brouwers, M. C. (2012) · Implementation Science · doi:10.1186/1748-5908-7-67 · Cited by 111
“Because these manifest downstream of guideline development, single and combined interventions can be applied to address these barriers and improve compliance with guideline recommendations, although their impact can be variable and inconsistent [11].”
BackgroundA Scoping Review of the Use of Theory in Studies of Knowledge Translation
Colquhoun, H. L., Letts, L. J., Law, M., MacDermid, J. C., & Missiuna, C. A. (2010) · Canadian Journal of Occupational Therapy · doi:10.2182/cjot.2010.77.5.3 · Cited by 123
“Despite the significant attention that KT has received in the literature, the field has not advanced in identifying effective strategies (Grimshaw et al., 2004).”
BackgroundWettermark, B., Godman, B., Jacobsson, B., & Haaijer‐Ruskamp, F. M. (2009) · Applied Health Economics and Health Policy · doi:10.1007/bf03256147 · Cited by 109
Doebbeling, B. N., Chou, A. F., & Tierney, W. M. (2006) · Journal of General Internal Medicine · doi:10.1111/j.1525-1497.2006.00363.x · Cited by 109
Cunningham, S., Logan, C., Lockerbie, L., Dunn, M., McMurray, A., & Prescott, R. J. (2007) · The Journal of Pediatrics · doi:10.1016/j.jpeds.2007.09.033 · Cited by 96
Arditi, C., Rège-Walther, M., Durieux, P., & Burnand, B. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001175.pub4 · Cited by 96
Gagliardi, A. R., Légaré, F., Brouwers, M. C., Webster, F., Badley, E., & Straus, S. (2015) · Implementation Science · doi:10.1186/s13012-016-0389-3 · Cited by 71
“In contrast, interventions targeting patients (or consumers) appeared to have a moderate to large impact on care delivery and clinical outcomes and represent a promising means by which to achieve health care system improvement in a way that is responsive to patient needs and values [5, 9, 10].”
BackgroundKirsh, S. R., Lawrence, R. H., & Aron, D. C. (2008) · Implementation Science · doi:10.1186/1748-5908-3-34 · Cited by 95
“This phenomenon of context-dependence has led to calls for tailoring interventions [ 6 ,15-20].”
Stokes, T., Shaw, E. J., Camosso‐Stefinovic, J., Imamura, M., Kanguru, L., & Hussein, J. (2016) · Implementation Science · doi:10.1186/s13012-016-0508-1 · Cited by 105
“based clinical practice guidelines [2].”
BackgroundWerfalli, M., Raubenheimer, P. J., Engel, M. E., Musekiwa, A., Bobrow, K., Peer, N., Hoegfeldt, C. A., Kalula, S., Kengne, A. P., & Levitt, N. S. (2020) · Systematic Reviews · doi:10.1186/s13643-020-01377-8 · Cited by 112
Primary sclerosing cholangitis
Silveira, M. G., & Lindor, K. D. (2008) · Canadian Journal of Gastroenterology · doi:10.1155/2008/824168 · Cited by 93
Claxton, K., Cohen, J. T., & Neumann, P. J. (2005) · Health Affairs · doi:10.1377/hlthaff.24.1.93 · Cited by 97
Bird, V. J., Boutillier, C. L., Leamy, M., Williams, J., Bradstreet, S., & Slade, M. (2014) · British Journal of Psychiatry · doi:10.1192/bjp.bp.113.128314 · Cited by 90
Interventions to increase attendance for diabetic retinopathy screening
Lawrenson, J. G., Graham-Rowe, E., Lorencatto, F., Burr, J., Bunce, C., Francis, J. J., Aluko, P., Rice, S., Vale, L., Peto, T., et al. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012054.pub2 · Cited by 92
Self-citationA strategy for patient involvement in clinical practice guidelines: methodological approaches
del Campo, P. D., Gracia, J., Blasco‐Amaro, J. A., & Andradas, E. (2011) · BMJ Quality & Safety · doi:10.1136/bmjqs.2010.049031 · Cited by 104
Developing and introducing evidence based clinical practice guidelines for serious illness in Kenya
Irimu, G., Wamae, A., Wasunna, A. E. O., Were, F., Ntoburi, S., Opiyo, N., Ayieko, P., Peshu, N., & English, M. (2008) · Archives of Disease in Childhood · doi:10.1136/adc.2007.126508 · Cited by 99
“However, few hospitals or health workers in Kenya have any access to either the WHO recommendations or any local, modern practice guidelines [3] and it is known that a wide range of factors affect the actual ability to improve care and outcomes [12-15].”
Review: What Can We Learn From Quality Improvement Research?
Alexander, J. A., & Hearld, L. R. (2009) · Medical Care Research and Review · doi:10.1177/1077558708330424 · Cited by 107
“…(b) case/disease management, (c) evidence-based medicine, (d) information technology, (e) task integration/ decomposition, (f) multidisciplinary teams, (g) practitioner education, (h) patient education, and (i) multiple interventions (grimshaw et al., 2004; McLaughlin & Kaluzny, 2006).”
BackgroundWhen financial incentives do more good than harm: a checklist
Glasziou, P., Buchan, H., Mar, C. D., Doust, J. A., Harris, M., Knight, R., Scott, A., Scott, I. A., & Stockwell, A. (2012) · BMJ · doi:10.1136/bmj.e5047 · Cited by 93
FIRE (facilitating implementation of research evidence): a study protocol
Seers, K., Cox, K., Crichton, N. J., Edwards, R. T., Eldh, A. C., Estabrooks, C. A., Harvey, G., Hawkes, C., Kitson, A., Linck, P., et al. (2012) · Implementation Science · doi:10.1186/1748-5908-7-25 · Cited by 93
“Whilst researchers investigating knowledge translation routinely collect summative data in RCTs of interventions, they rarely collect process data (Grimshaw et al. 2004).”
BackgroundDyson, J., & Cowdell, F. (2021) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzab106 · Cited by 113
Interventions for improving the appropriate use of imaging in people with musculoskeletal conditions
French, S. D., Green, S., Buchbinder, R., & Barnes, H. (2010) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006094.pub2 · Cited by 90
May, C., Sibley, A., & Hunt, K. (2014) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2013.06.019 · Cited by 93
“…clinical practice guidelines across the range of healthcare activities, and this literature is part of a much larger body of work that relates to knowledge transfer and mobilisation around evidencebased practice (Davies et al., 2010; Grimshaw et al., 2004; Thomas et al., 1999; Vale et al., 2007).”
Backgroundfor the BETTER Trial Investigators, Grunfeld, E., Manca, D. P., Moineddin, R., Thorpe, K. E., Hoch, J. S., Campbell-Scherer, D. L., Meaney, C. A., Rogers, J., Beca, J. M., et al. (2013) · BMC Family Practice · doi:10.1186/1471-2296-14-175 · Cited by 106
“Evidence on how best to implement effective care has shown that tailored, active, and multifaceted interventions using an amalgam of strategies are most effective [19-22].”
BackgroundAshcraft, L. E., Goodrich, D. E., Hero, J., Phares, A., Bachrach, R. L., Quinn, D. A., Qureshi, N., Ernecoff, N. C., Lederer, L. G., Scheunemann, L. P., et al. (2024) · Implementation Science · doi:10.1186/s13012-024-01369-5 · Cited by 89
“This may reflect the fact that education strategies are generally considered to be “necessary but not sufficient” for successful implementation [43, 44].”
BackgroundDeveloping Leadership Capacity for Guideline Use: A Pilot Cluster Randomized Control Trial
Gifford, W. A., Davies, B. L., Graham, I. D., Tourangeau, A., Woodend, A. K., & Lefebre, N. (2013) · Worldviews on Evidence-Based Nursing · doi:10.1111/j.1741-6787.2012.00254.x · Cited by 86
O'Donnell, A. J., McParlin, C., Robson, S. C., Beyer, F. R., Moloney, E., Bryant, A., Bradley, J., Muirhead, C. R., Nelson‐Piercy, C., Newbury‐Birch, D., et al. (2016) · Health Technology Assessment · doi:10.3310/hta20740 · Cited by 114
Self-citationClarke, D. J., Godfrey, M., Hawkins, R., Sadler, E., Harding, G., Forster, A., McKevitt, C., Dickerson, J., & Farrin, A. (2013) · Implementation Science · doi:10.1186/1748-5908-8-96 · Cited by 88
Grimshaw, J. M., Zwarenstein, M., Tetroe, J. M., Godin, G., Graham, I. D., Lemyre, L., Eccles, M. P., Johnston, M., Francis, J. J., Hux, J., et al. (2007) · Implementation Science · doi:10.1186/1748-5908-2-38 · Cited by 86
“However the current evidence base [4] indicates that the effects of interventions do appear to vary by condition, professional group, and context, presumably because the causal mechanisms of the interventions are modified in the presence of different barriers and enablers.”
Self-citationSpanning the know-do gap: Understanding knowledge application and capacity in long-term care homes
Berta, W. B., Teare, G. F., Gilbart, E., Ginsburg, L. S., Lemieux‐Charles, L., Davis, D., & Rappolt, S. G. (2010) · Social Science & Medicine · doi:10.1016/j.socscimed.2009.11.028 · Cited by 97
Munce, S., Graham, I. D., Salbach, N. M., Jaglal, S. B., Richards, C. L., Eng, J. J., Desrosiers, J., MacKay-Lyons, M. J., Wood-Dauphinée, S., Korner-Bitensky, N. A., et al. (2017) · BMC Health Services Research · doi:10.1186/s12913-017-2389-7 · Cited by 98
Gaur, S., Achenbach, S. S., Leipsic, J. A., Mauri, L., Bezerra, H. G., Jensen, J. M., Bøtker, H. E., Lassen, J. F., & Nørgaard, B. L. (2013) · Journal of cardiovascular computed tomography · doi:10.1016/j.jcct.2013.09.003 · Cited by 84
Stetler, C. B., Ritchie, J., Rycroft-Malone, J., Schultz, A., & Charns, M. (2007) · Implementation Science · doi:10.1186/1748-5908-2-3 · Cited by 84
“There are now calls both for better theoretical underpinnings for implementation interventions at the individual provider level and for better information about the critical influence of organizational context [11,19,32].”
InfluentialDisposal of unwanted medicines from households in Kuwait
Abahussain, E., & Ball, D. E. (2007) · Pharmacy World & Science · doi:10.1007/s11096-006-9082-y · Cited by 88
“More active interventions or the addition of further components (multifaceted interventions) are more likely to be successful in changing behavior [15, 16].”
BackgroundEvans, D. W., Breen, A. C., Pincus, T., Sim, J., Underwood, M., Vogel, S., & Foster, N. E. (2010) · Spine · doi:10.1097/brs.0b013e3181d4e04b · Cited by 83
“43) Sex† Male 344 (39) 347 (39) Female 532 (61) 535 (61) Profession† Chiropractor 170 (19) 166 (19) Osteopath 297 (34) 301 (34) Physiotherapist 409 (47) 415 (47) Years of professional practice‡ 14 (8–20) 14 (8–21) Activity† Consistent 499 (57) 511 (58) Not consistent 377 (43) 371 (42) Work† Consistent 474 (54) 479 (54…”
Tol, W. A., Barbui, C., Bisson, J., Cohen, J., Hijazi, Z., Jones, L., de Jong, J. T. V. M., Magrini, N., Omigbodun, O., Seedat, S., et al. (2014) · PLoS Medicine · doi:10.1371/journal.pmed.1001769 · Cited by 83
“, demand-side preferences of clients versus delivery-side training and preferences of mental health workers)? What are the perspectives of mental health professionals in LMICs with regard to evidence-based approaches that often originate in high-income countries? What are key barriers and facilitators for implementati…”
Légaré, F., O'Connor, A. M. C., Graham, I. D., Saucier, D., Côté, L., Blais, J., Cauchon, M., & Paré, L. (2006) · Patient Education and Counseling · doi:10.1016/j.pec.2006.04.011 · Cited by 93
“However, our approach is congruent with the observation by other health services researchers on ‘‘the few resources that are available for clinical effectiveness activities and the need for maximising benefits from any one of those’’ [61,62].”
ResultGuidelines in lower‐middle income countries
Olayemi, E., Asare, E. V., & Kuma, A. B.-A. (2017) · British Journal of Haematology · doi:10.1111/bjh.14583 · Cited by 90
“In some circumstances, the cost of guideline development and implementation may outweigh potential benefits (Grimshaw et al, 2004; Baradaran-Seyed et al, 2013).”
BackgroundOptimizing the language and format of guidelines to improve guideline uptake
Gupta, S., Rai, N., Bhattacharrya, O., Cheng, A. Y. Y., Connelly, K. A., Boulet, L.-P., Kaplan, A., Brouwers, M. C., & Kastner, M. (2016) · Canadian Medical Association Journal · doi:10.1503/cmaj.151102 · Cited by 82
Becker, A., Leonhardt, C., Kochen, M. M., Keller, S., Wegscheider, K., Baum, E., Donner-Banzhoff, N., Pfingsten, M., Hildebrandt, J., Basler, H.-D., et al. (2008) · Spine · doi:10.1097/brs.0b013e3181657e0d · Cited by 84
“Recent reviews have shown that postal dissemination of guidelines alone or didactic educational meetings, such as lectures, are not effective.(4) To achieve changes in practice, multifaceted interventions combining 2 or more components, such as information material and workshops, and an active approach, e.”
Background
Metadata
- Authors
- Grimshaw, J., Thomas, R., MacLennan, G., Fraser, C., Ramsay, C., Vale, L., Whitty, P., Eccles, M., Matowe, L., Shirran, L., Wensing, M., Dijkstra, R., & Donaldson, C.
- Affiliations
- University of Aberdeen (GB)
- Newcastle University (GB)
- Radboud University Nijmegen (NL)
- University of Calgary (CA)
- Venue
- Health Technology Assessment
- Published
- 2004-02
- Volume
- 8
- Issue
- 6
- Pages
- iii-iv, 1
- ISSN
- 1366-5278 (ISSN-L)
- 2046-4924
- OpenAlex
- W2038028146
- Cited by
- 3,044
- References
- 38
- Citations by year
- 2026: 45 · 2025: 45 · 2024: 72 · 2023: 65 · 2022: 69 · 2021: 100 · 2020: 163 · 2019: 87 · 2018: 112 · 2017: 129 · 2016: 133 · 2015: 184 · 2014: 188 · 2013: 288 · 2012: 167
- FWCI
- 20.52
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- Locations
- Health Technology Assessment (publishedVersion, other-oa)
- PubMed (publishedVersion)
- Radboud Repository (Radboud University) (submittedVersion, other-oa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Radboud Repository (Radboud University) (submittedVersion)
- Newcastle University ePrints (Newcastle Univesity)
- Funders
- Health Technology Assessment programme (94/08/29)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Keywords
- guideline dissemination, guideline implementation, guideline development, multicomponent intervention, educational outreach, reminders, audit and feedback, teaching materials, cost-effectiveness, resource requirements, clinical governance, primary care, secondary care, evidence-based recommendations, process indicators, healthcare quality improvement
- MeSH terms
- Cost-Benefit Analysis, United Kingdom, Medical Informatics, State Medicine, Practice Guidelines as Topic, Information Dissemination
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.