Effectiveness and efficiency of guideline dissemination and implementation strategies
Open accessThe DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Abstract
OBJECTIVES: To undertake a systematic review of the effectiveness and costs of different guideline development, dissemination and implementation strategies. To estimate the resource implications of these strategies. To develop a framework for deciding when it is efficient to develop and introduce clinical guidelines. DATA SOURCES: MEDLINE, Healthstar, Cochrane Controlled Trial Register, EMBASE, SIGLE and the specialised register of the Cochrane Effective Practice and Organisation of Care (EPOC) group. REVIEW METHODS: Single estimates of dichotomous process variables were derived for each study comparison based upon the primary end-point or the median measure across several reported end-points. Separate analyses were undertaken for comparisons of different types of intervention. The study also explored whether the effects of multifaceted interventions increased with the number of intervention components. Studies reporting economic data were also critically appraised. A survey to estimate the feasibility and likely resource requirements of guideline dissemination and implementation strategies in UK settings was carried out with key informants from primary and secondary care. RESULTS: In total, 235 studies reporting 309 comparisons met the inclusion criteria; of these 73% of comparisons evaluated multifaceted interventions, although the maximum number of replications of a specific multifaceted intervention was 11 comparisons. Overall, the majority of comparisons reporting dichotomous process data observed improvements in care; however, there was considerable variation in the observed effects both within and across interventions. Commonly evaluated single interventions were reminders, dissemination of educational materials, and audit and feedback. There were 23 comparisons of multifaceted interventions involving educational outreach. The majority of interventions observed modest to moderate improvements in care. No relationship was found between the number of component interventions and the effects of multifaceted interventions. Only 29.4% of comparisons reported any economic data. The majority of studies only reported costs of treatment; only 25 studies reported data on the costs of guideline development or guideline dissemination and implementation. The majority of studies used process measures for their primary end-point, despite the fact that only three guidelines were explicitly evidence based (and may not have been efficient). Respondents to the key informant survey rarely identified existing budgets to support guideline dissemination and implementation strategies. In general, the respondents thought that only dissemination of educational materials and short (lunchtime) educational meetings were generally feasible within current resources. CONCLUSIONS: There is an imperfect evidence base to support decisions about which guideline dissemination and implementation strategies are likely to be efficient under different circumstances. Decision makers need to use considerable judgement about how best to use the limited resources they have for clinical governance and related activities to maximise population benefits. They need to consider the potential clinical areas for clinical effectiveness activities, the likely benefits and costs required to introduce guidelines and the likely benefits and costs as a result of any changes in provider behaviour. Further research is required to: develop and validate a coherent theoretical framework of health professional and organisational behaviour and behaviour change to inform better the choice of interventions in research and service settings, and to estimate the efficiency of dissemination and implementation strategies in the presence of different barriers and effect modifiers.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, recent reviews (Farmer 2008; Grimshaw 2004) found that printed educational materials have a small (but potentially important) effect.”
From Audit and feedback: effects on professional practice and healthcare outcomes (2012) · cites this paper as Grimshaw 2004
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“while a systematic review of 235 implementation trials by Grimshaw et al. found no relationship between the number of component interventions and the effects of multifaceted interventions [100].”
From Writing implementation research grant proposals: ten key ingredients (2012) · cites this paper as [100]
The cited source says what the claim attributes to it.
In the citing paper
“It is important to note that the high frequency of educational interventions is not exclusive to the allied health professions, and a similar trend is seen in nursing [11] and in the guideline implementation literature, which is largely dominated by physicians [6].”
From Systematic review of knowledge translation strategies in the allied health professions (2012) · cites this paper as [6]
In the citing paper
“The empirical evidence for the effectiveness of multifaceted strategies has been mixed, because early research touted the benefits of multifaceted strategies [98,99], while a systematic review of 235 implementation trials by Grimshaw et al. found no relationship between the number of component interventions and the effects of multifaceted interventions [100].”
From Writing implementation research grant proposals: ten key ingredients (2012) · cites this paper as [100]
In the citing paper
“the bulk of the research evidence comes from the medical e.g., [4-9] and nursing literature e.g., [10,11].”
From Systematic review of knowledge translation strategies in the allied health professions (2012) · cites this paper as [6]
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2005) · Technometrics · doi:10.1198/tech.2005.s303 · Cited by 17,923
Methods for the Economic Evaluation of Health Care Programmes
Drummond, M. E., Sculpher, M. J., Torrance, G. W., O’Brien, B. J., & Stoddart, G. L. (2005) · doi:10.1093/oso/9780198529446.001.0001 · Cited by 13,648
(1979) · Medical Entomology and Zoology · Cited by 11,252
Quasi-experimentation: Design and analysis issues for field settings
Shrout, P. E. (1980) · Evaluation and Program Planning · doi:10.1016/0149-7189(80)90063-4 · Cited by 6,010
The cochrane database of systematic reviews
Geddes, J. (1996) · Journal of Psychosomatic Research · doi:10.1016/s0022-3999(96)90063-x · Cited by 5,989
Clinical guidelines: Potential benefits, limitations, and harms of clinical guidelines
Woolf, S. H., Grol, R., Hutchinson, A., Eccles, M., & Grimshaw, J. (1999) · BMJ · doi:10.1136/bmj.318.7182.527 · Cited by 2,548
Self-citationSystematic Reviews: Identifying relevant studies for systematic reviews
Dickersin, K., Scherer, R., & Lefebvre, C. (1994) · BMJ · doi:10.1136/bmj.309.6964.1286 · Cited by 2,256
Effectiveness and Efficiency: Random Reflections on Health Services
(1973) · Public Health · doi:10.1016/s0033-3506(73)80082-4 · Cited by 1,912
Guidelines for authors and peer reviewers of economic submissions to the BMJ
Drummond, M. F., & Jefferson, T. O. (1996) · BMJ · doi:10.1136/bmj.313.7052.275 · Cited by 1,827
Davis, D. A. (1995) · JAMA · doi:10.1001/jama.1995.03530090032018 · Cited by 1,763
Research works printed but not linked: 12
- [2]2. NHS Centre for Reviews and Dissemination. Getting evidence into practice. Effective Health Care 1999; 5 :1-16.
- [4]4. NHS Centre for Reviews and Dissemination and Nuffield Institute for Health. Implementing clinical guidelines. Can guidelines be used to improve clinical practice? Effective Health Care 1994; 1 :1-12.
- [9]9. Thomas L, Cullum N, McColl E, Rousseau N, Soutter J, Steen N. Clinical guidelines in nursing, midwifery and other professions allied to medicine (Cochrane Review). The Cochrane Library (Issue 1). Oxford: Update Software; 1999.
- [10]10. Bero L, Grilli R, Grimshaw JM, Mowatt G, Oxman A, Zwarenstein M. Cochrane Effective Practice and Organisation of Care Review Group (Cochrane Group Module). In Bero L, Grilli R, Grimshaw JM, Mowatt G, Oxman A, Zwarenstein M, editors. The Cochrane Library (Issue 3). Oxford: Update Software; 2001.
- [16]16. Bushman BJ. Vote counting methods in metaanalysis. In Cooper H, Hedges L, editors. The handbook of research synthesis. New York: Russell Sage Foundation; 1994; pp. 193-213.
- [17]17. Drummond M, O'Brien B, Stoddart G, Torrance GW. Methods of economic evaluation of health care programmes. Oxford: Oxford University Press; 1997.
- [18]18. McIntosh E. Economic evaluation of guideline implementation studies. In Makela M, Thorsen T, editors. Changing professional practice. Theory and practice of clinical guidelines implementation. Copenhagen: Danish Institute for Health Services Research and Development; 1999, pp. 77-98.
- [21]21. Jefferson TO, Demicheli V , Vale L. Methodological reviews of economic evaluations in health care. JAMA 2002; 287 :2809-12.
- [24]24. Mason J, Freemantle N, Nazereth I, Eccles M, Haines A, Drummond M. When is it cost effective - to change the behaviour of health professionals? JAMA 2001; 286 :2988-92.
- [27]27. Purves IN. PRODIGY: implementing clinical guidelines using computers. Br J Gen Pract 1998; 48 :1552-3.
- [34]34. Grol R. Beliefs and evidence in changing clinical practice. BMJ 1997; 315 :418-21.
- [36]36. Grimshaw JM, Eccles MP . Clinical practice guidelines. In Haines A, Silagy C, editors. Evidencebased practice in primary care. London: BMJ Publishing; 2001, pp. 120-34.
Cited by
Diffusion of Innovations in Service Organizations: Systematic Review and Recommendations
GREENHALGH, T., ROBERT, G., MACFARLANE, F., BATE, P., & KYRIAKIDOU, O. (2004) · The Milbank Quarterly · doi:10.1111/j.0887-378x.2004.00325.x · Cited by 7,448
Audit and feedback: effects on professional practice and healthcare outcomes
Ivers, N., Jamtvedt, G., Flottorp, S., Young, J. M., Odgaard-Jensen, J., French, S. D., O'Brien, M. A., Johansen, M., Grimshaw, J., & Oxman, A. D. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000259.pub3 · Cited by 5,485
Self-citationLost in knowledge translation: Time for a map?
Graham, I. D., Logan, J., Harrison, M. B., Straus, S. E., Tetroe, J., Caswell, W., & Robinson, N. (2006) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.47 · Cited by 4,705
Clinical Practice Guidelines We Can Trust
Committee on Standards for Developing Trustworthy Clinical Practice Guidelines, Board on Health Care Services, & Institute of Medicine (2011) · National Academies Press eBooks · doi:10.17226/13058 · Cited by 3,081
Garg, A. X., Adhikari, N. K. J., McDonald, H., Rosas-Arellano, M. P., Devereaux, P. J., Beyene, J., Sam, J., & Haynes, R. B. (2005) · JAMA · doi:10.1001/jama.293.10.1223 · Cited by 2,936
“Finally, cheaper, noncomputerized alternatives may be equally or more effective in improving care and reducing medical errors.(124-127) One of the primary considerations in”
BackgroundKnowledge translation of research findings
Grimshaw, J. M., Eccles, M. P., Lavis, J. N., Hill, S. J., & Squires, J. E. (2012) · Implementation Science · doi:10.1186/1748-5908-7-50 · Cited by 2,407
“Grimshaw and colleagues explored whether there was a dose response curve for multifaceted interventions and observed that effect sizes did not necessarily increase with increasing number of components (Figure 1) [20].”
BackgroundSelf-citationEffective techniques in healthy eating and physical activity interventions: A meta-regression.
Michie, S., Abraham, C., Whittington, C., McAteer, J., & Gupta, S. (2009) · Health Psychology · doi:10.1037/a0016136 · Cited by 2,229
“Interventions designed to change health-related behaviors generally include many components and typically produce small effects in meta-analyses, but with large heterogeneity in effectiveness (e.g., Dishman & Buckworth, 1996; Grimshaw et al., 2004; National Institute for Health & Clinical Excellence, 2007).”
BackgroundIAP/APA evidence-based guidelines for the management of acute pancreatitis
(2013) · Pancreatology · doi:10.1016/j.pan.2013.07.063 · Cited by 2,025
“Although there is no optimal strategy to ensure good implementation of a guideline [95], there is clearly a role for pancreatologists in this process.”
BackgroundDeveloping and Evaluating Complex Interventions: New Guidance
Craig, P., Dieppe, P. A., MacIntyre, S., Michie, S., Nazareth, I., & Petticrew, M. P. (2006) · UCL Discovery (University College London) · Cited by 1,974
Interventions to improve antibiotic prescribing practices for hospital inpatients
Davey, P., Brown, E., Charani, E., Fenelon, L., Gould, I. M., Holmes, A., Ramsay, C. R., Wiffen, P. J., & Wilcox, M. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003543.pub3 · Cited by 1,864
Self-citationForsetlund, L., Bjørndal, A., Rashidian, A., Jamtvedt, G., O'Brien, M. A., Wolf, F. M., Davis, D., Odgaard-Jensen, J., & Oxman, A. D. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003030.pub2 · Cited by 1,849
Michie, S., Johnston, M., Francis, J., Hardeman, W., & Eccles, M. (2008) · Applied Psychology · doi:10.1111/j.1464-0597.2008.00341.x · Cited by 1,789
Self-citationFrench, S. D., Green, S. E., O’Connor, D. A., McKenzie, J. E., Francis, J. J., Michie, S., Buchbinder, R., Schattner, P., Spike, N., & Grimshaw, J. M. (2012) · Implementation Science · doi:10.1186/1748-5908-7-38 · Cited by 1,338
“To date, implementation interventions have had limited and varied effects [2].”
Self-citationEducational outreach visits: effects on professional practice and health care outcomes
O'Brien, M. A., Rogers, S., Jamtvedt, G., Oxman, A. D., Odgaard-Jensen, J., Kristoffersen, D. T., Forsetlund, L., Bainbridge, D., Freemantle, N., Davis, D., et al. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000409.pub2 · Cited by 1,279
Miller, S., Abalos, E., Chamillard, M., Ciapponi, A., Colaci, D., Comandé, D., Diaz, V., Geller, S., Hanson, C., Langer, A., et al. (2016) · The Lancet · doi:10.1016/s0140-6736(16)31472-6 · Cited by 1,181
Francke, A. L., Smit, M. C., de Veer, A. J., & Mistiaen, P. (2008) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-8-38 · Cited by 1,134
“For most combinations as well as for most single strategies, Grimshaw et al. [41,42] found some effects.”
InfluentialGreenwood, J. P., Maredia, N., Younger, J. F., Brown, J. M., Nixon, J., Everett, C. C., Bijsterveld, P., Ridgway, J. P., Radjenovic, A., Dickinson, C. J., et al. (2012) · The Lancet · doi:10.1016/s0140-6736(11)61335-4 · Cited by 1,114
Godin, G., Bélanger-Gravel, A., Eccles, M., & Grimshaw, J. (2008) · Implementation Science · doi:10.1186/1748-5908-3-36 · Cited by 1,096
“This has led to calls for more theory-based research to better inform the design of interventions to change healthcare professionals' behaviour [1,5,6].”
Self-citationLocal opinion leaders: effects on professional practice and health care outcomes
Flodgren, G., Parmelli, E., Doumit, G., Gattellari, M., O'Brien, M. A., Grimshaw, J., & Eccles, M. P. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000125.pub4 · Cited by 1,070
Self-citationA compilation of strategies for implementing clinical innovations in health and mental health
Powell, B. J., McMillen, J. C., Proctor, E. K., Carpenter, C. R., Griffey, R. T., Bunger, A. C., Glass, J. E., & York, J. L. (2012) · Medical Care Research and Review · doi:10.1177/1077558711430690 · Cited by 1,069
“Create a learning collaborative (Carpinello, et al.,2002; Davis & Davis,2009; Institute for Healthcare Improvement, 2003;Magnabosco, 2006;Markiewicz, Ebert,Ling, Amaya-Jackson, & Kisiel,2006; Sosna & Marsenich, 2006) Develop and use groups of providers or provider organizations that will implement the clinical innovat…”
BackgroundInfluentialHow can we achieve and maintain high-quality performance of health workers in low-resource settings?
Rowe, A. K., de Savigny, D., Lanata, C. F., & Victora, C. G. (2005) · The Lancet · doi:10.1016/s0140-6736(05)67028-6 · Cited by 1,045
Baker, R., Camosso-Stefinovic, J., Gillies, C., Shaw, E. J., Cheater, F., Flottorp, S., & Robertson, N. (2010) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005470.pub2 · Cited by 1,003
Planning and Studying Improvement in Patient Care: The Use of Theoretical Perspectives
GROL, R. P. T. M., BOSCH, M. C., HULSCHER, M. E. J. L., ECCLES, M. P., & WENSING, M. (2007) · The Milbank Quarterly · doi:10.1111/j.1468-0009.2007.00478.x · Cited by 943
Self-citationEccles, M., Grimshaw, J., Walker, A., Johnston, M., & Pitts, N. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.09.002 · Cited by 917
“There have been a number of reviews of implementation research [7–10] that have consistently shown that the majority of interventions can achieve moderate improvements in care with considerable variation in the observed effects within and across interventions.”
BackgroundMethodSelf-citationStorylines of research in diffusion of innovation: a meta-narrative approach to systematic review
Greenhalgh, T., Robert, G., Macfarlane, F., Bate, P., Kyriakidou, O., & Peacock, R. (2005) · Social Science & Medicine · doi:10.1016/j.socscimed.2004.12.001 · Cited by 913
Audit and feedback: effects on professional practice and health care outcomes
Jamtvedt, G., Young, J. M., Kristoffersen, D. T., O'Brien, M. A., & Oxman, A. D. (2006) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000259.pub2 · Cited by 912
Barriers and Strategies in Guideline Implementation—A Scoping Review
Fischer, F., Lange, K., Klose, K., Greiner, W., & Kraemer, A. (2016) · Healthcare · doi:10.3390/healthcare4030036 · Cited by 900
“In addition to active implementation strategies, passive dissemination of guidelines should not be disregarded because it offers a cheaper and more feasible approach that may still be effective [94].”
BackgroundGuidelines International Network: Toward International Standards for Clinical Practice Guidelines
Qaseem, A., Forland, F., Macbeth, F., Ollenschläger, G., Phillips, S., van der Wees, P., & for the Board of Trustees of the Guidelines International Network* (2012) · Annals of Internal Medicine · doi:10.7326/0003-4819-156-7-201204030-00009 · Cited by 902
Printed educational materials: effects on professional practice and healthcare outcomes
Giguère, A., Légaré, F., Grimshaw, J., Turcotte, S., Fiander, M., Grudniewicz, A., Makosso-Kallyth, S., Wolf, F. M., Farmer, A. P., & Gagnon, M.-P. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004398.pub3 · Cited by 878
Self-citationInterprofessional Teamwork for Health and Social Care
Reeves, S., Lewin, S., Espin, S., & Zwarenstein, M. (2010) · doi:10.1002/9781444325027 · Cited by 774
Interventions for improving the adoption of shared decision making by healthcare professionals
Légaré, F., Ratté, S., Stacey, D., Kryworuchko, J., Gravel, K., Graham, I. D., & Turcotte, S. (2010) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006732.pub2 · Cited by 823
Rotter, T., Kinsman, L., James, E. L., Machotta, A., Gothe, H., Willis, J., Snow, P., & Kugler, J. (2010) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006632.pub2 · Cited by 800
Physical interventions to interrupt or reduce the spread of respiratory viruses
Jefferson, T., Del Mar, C. B., Dooley, L., Ferroni, E., Al-Ansary, L. A., Bawazeer, G. A., van Driel, M. L., Nair, N. S., Jones, M. A., Thorning, S., et al. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006207.pub4 · Cited by 805
Moore, D. E., Green, J. S., & Gallis, H. A. (2009) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.20001 · Cited by 738
“Third, multifaceted activities that combine several different interventions have been shown to be effective.(13,19) Aware of these concerns and recent developments, the authors of this article have made an effort to synthesize current research into a conceptual model to guide CME practice as CME planners work to help…”
BackgroundRealist synthesis: illustrating the method for implementation research
Rycroft-Malone, J., McCormack, B., Hutchinson, A. M., DeCorby, K., Bucknall, T. K., Kent, B., Schultz, A., Snelgrove-Clarke, E., Stetler, C. B., Titler, M., et al. (2012) · Implementation Science · doi:10.1186/1748-5908-7-33 · Cited by 742
“While numerous systematic reviews have been conducted to determine the effectiveness of specific interventions [17-22], a systematic synthesis of the literature to examine the mechanisms by which such interventions work, and under what circumstances, has not been undertaken.”
Tailored interventions to address determinants of practice
Baker, R., Camosso-Stefinovic, J., Gillies, C., Shaw, E. J., Cheater, F., Flottorp, S., Robertson, N., Wensing, M., Fiander, M., Eccles, M. P., et al. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005470.pub3 · Cited by 711
Self-citationRamsay, C. R., Matowe, L., Grilli, R., Grimshaw, J. M., & Thomas, R. E. (2003) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462303000576 · Cited by 703
“The first review evaluated the effectiveness of mass media interventions targeted at improving the utilization of health services (35) and the second review evaluated the effectiveness of different clinical guideline dissemination and implementation strategies ( 36 ).”
BackgroundSelf-citationInterventions for increasing the use of shared decision making by healthcare professionals
Légaré, F., Adekpedjou, R., Stacey, D., Turcotte, S., Kryworuchko, J., Graham, I. D., Lyddiatt, A., Politi, M. C., Thomson, R., Elwyn, G., et al. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006732.pub4 · Cited by 698
“DOI: 10.1186/ 1748-5908-3-36 Grimshaw 2004 Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, et al. Effectiveness and efficiency of guideline dissemination and implementation strategies.”
BackgroundMethodInfluentialEASL Clinical Practice Guidelines on the prevention, diagnosis and treatment of gallstones
(2016) · Journal of Hepatology · doi:10.1016/j.jhep.2016.03.005 · Cited by 576
ASAS/EULAR recommendations for the management of ankylosing spondylitis
Zochling, J., van der Heijde, D., Burgos-Vargas, R., Collantes, E., Davis, J. C., Dijkmans, B., Dougados, M., Géher, P., Inman, R. D., Khan, M. A., et al. (2006) · Annals of the Rheumatic Diseases · doi:10.1136/ard.2005.041137 · Cited by 702
Vollmar, H. C., Mayer, H., Ostermann, T., Butzlaff, M. E., Sandars, J. E., Wilm, S., & Rieger, M. A. (2010) · Implementation Science · doi:10.1186/1748-5908-5-1 · Cited by 693
“Recently published studies show that a simple unsolicited distribution of guidelines does not lead to changes in practice [52-56].”
Evidence-Based Quality Improvement: The State Of The Science
Shojania, K. G., & Grimshaw, J. M. (2005) · Health Affairs · doi:10.1377/hlthaff.24.1.138 · Cited by 691
Self-citationGrimshaw, J., Eccles, M., Thomas, R., MacLennan, G., Ramsay, C., Fraser, C., & Vale, L. (2006) · Journal of General Internal Medicine · doi:10.1007/s11606-006-0269-7 · Cited by 631
“In this paper, we describe the available evidence published between 1966 and 1998 (and highlight its limitations) concerning the effectiveness of clinical practice guideline dissemination and implementation strategies (a common component of QI initiatives) based upon the findings of a systematic review that attempted…”
MethodInfluentialSelf-citationDavies, P., Walker, A. E., & Grimshaw, J. M. (2010) · Implementation Science · doi:10.1186/1748-5908-5-14 · Cited by 619
“To address this issue, we conducted a systematic review of the use of theory linked to a large systematic review of the effects of guideline dissemination and implementation strategies [3].”
Self-citationSystematic Review and Meta-Analysis of Practice Facilitation Within Primary Care Settings
Baskerville, N. B., Liddy, C., & Hogg, W. (2012) · The Annals of Family Medicine · doi:10.1370/afm.1312 · Cited by 571
Skivington, K., Matthews, L., Simpson, S. A., Craig, P., Baird, J., Blazeby, J. M., Boyd, K. A., Craig, N., French, D. P., McIntosh, E., et al. (2021) · Health Technology Assessment · doi:10.3310/hta25570 · Cited by 522
Adapting clinical guidelines to take account of multimorbidity
Guthrie, B., Payne, K., Alderson, P., McMurdo, M. E. T., & Mercer, S. W. (2012) · BMJ · doi:10.1136/bmj.e6341 · Cited by 530
Bridging the implementation gap between knowledge and action for health.
(2004) · Europe PMC (PubMed Central) · doi:10.1590/s0042-96862004001000005 · Cited by 527
Changing how we think about healthcare improvement
Braithwaite, J. (2018) · BMJ · doi:10.1136/bmj.k2014 · Cited by 524
Johnson, M. J., & May, C. R. (2015) · BMJ Open · doi:10.1136/bmjopen-2015-008592 · Cited by 513
“Goodwin 2011[39] Yes Yes Yes No No Yes Yes Yes Yes No No 7”
BackgroundDeveloping a Framework for Transferring Knowledge Into Action: A Thematic Analysis of the Literature
Ward, V., House, A., & Hamer, S. (2009) · Journal of Health Services Research & Policy · doi:10.1258/jhsrp.2009.008120 · Cited by 511
Prior, M., Guerin, M., & Grimmer‐Somers, K. (2008) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2008.01014.x · Cited by 507
Hughes, L. D., McMurdo, M. E. T., & Guthrie, B. (2013) · Age and Ageing · doi:10.1093/ageing/afs100 · Cited by 506
Rowe, A. K., Rowe, S. Y., Peters, D. H., Holloway, K. A., Chalker, J., & Ross-Degnan, D. (2018) · The Lancet Global Health · doi:10.1016/s2214-109x(18)30398-x · Cited by 482
Implementing clinical guidelines: Current evidence and future implications
Grimshaw, J., Eccles, M., & Tetroe, J. (2004) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.1340240506 · Cited by 487
Self-citationAn implementation research agenda
Eccles, M. P., Armstrong, D., Baker, R., Cleary, K., Davies, H., Davies, S., Glasziou, P., Ilott, I., Kinmonth, A.-L., Leng, G., et al. (2009) · Implementation Science · doi:10.1186/1748-5908-4-18 · Cited by 481
“Over the past 10 years, a body of Implementation Research has developed [ 5-7 ].”
BackgroundSelf-citationBloom, B. S. (2005) · International Journal of Technology Assessment in Health Care · doi:10.1017/s026646230505049x · Cited by 475
“knowledge into practice are available at both health system and individual physician levels (15;40).”
BackgroundEffects of evidence-based clinical practice guidelines on quality of care: a systematic review
Lugtenberg, M., Burgers, J. S., & Westert, G. P. (2009) · Quality and Safety in Health Care · doi:10.1136/qshc.2008.028043 · Cited by 478
“strategies are not necessarily better than single interventions.(1) 13 Finally, contextual, organisational and cultural factors may impede or limit guideline adoption regardless of how thoroughly they are implemented.”
BackgroundMethodLugtenberg, M., Zegers-van Schaick, J. M., Westert, G. P., & Burgers, J. S. (2009) · Implementation Science · doi:10.1186/1748-5908-4-54 · Cited by 478
“Background Clinical practice guidelines are commonly regarded as useful tools for quality improvement [1].”
Kwan, J. L., Lo, L., Ferguson, J., Goldberg, H., Diaz-Martinez, J. P., Tomlinson, G., Grimshaw, J. M., & Shojania, K. G. (2020) · BMJ · doi:10.1136/bmj.m3216 · Cited by 461
Self-citationHow can we improve guideline use? A conceptual framework of implementability
Gagliardi, A. R., Brouwers, M. C., Palda, V. A., Lemieux-Charles, L., & Grimshaw, J. M. (2011) · Implementation Science · doi:10.1186/1748-5908-6-26 · Cited by 472
“Many existing implementation strategies have limited effectiveness and are not routinely applied outside of experimental research due to their cost and complexity [9-18].”
BackgroundSelf-citationThe effects of on-screen, point of care computer reminders on processes and outcomes of care
Shojania, K. G., Jennings, A., Ramsay, C. R., Grimshaw, J. M., Kwan, J. L., & Lo, L. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001096.pub2 · Cited by 466
Self-citationGuide to clinical practice guidelines: the current state of play
Kredo, T., Bernhardsson, S., Machingaidze, S., Young, T., Louw, Q., Ochodo, E., & Grimmer, K. (2016) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzv115 · Cited by 444
“More is known about the effectiveness of various implementation strategies on process outcomes (how the system works) rather than clinical outcomes, although this impact is often modest [37, 40].”
BackgroundThe JBI model of evidence-based healthcare
Pearson, A., Wiechula, R., Court, A., & Lockwood, C. (2005) · International Journal of Evidence-Based Healthcare · doi:10.1111/j.1479-6988.2005.00026.x · Cited by 451
Campbell, M., Snowdon, C., Francis, D., Elbourne, D., McDonald, A., Knight, R., Entwistle, V, Garcia, J., Roberts, I., Grant, A., et al. (2007) · Health Technology Assessment · doi:10.3310/hta11480 · Cited by 433
Kwan, J. L., Lo, L., Sampson, M., & Shojania, K. G. (2013) · Annals of Internal Medicine · doi:10.7326/0003-4819-158-5-201303051-00006 · Cited by 422
“This approach was first used in a large review of guideline implementation strategies (33) and has since been applied in other systematic reviews of quality improvement interventions (34–37).”
MethodCheng, A., Nadkarni, V. M., Mancini, M. B., Hunt, E. A., Sinz, E. H., Merchant, R. M., Donoghue, A., Duff, J. P., Eppich, W., Auerbach, M., et al. (2018) · Circulation · doi:10.1161/cir.0000000000000583 · Cited by 418
Sheldon, T. A., Cullum, N., Dawson, D., Lankshear, A., Lowson, K., Watt, I., West, P., Wright, D., & Wright, J. (2004) · BMJ · doi:10.1136/bmj.329.7473.999 · Cited by 433
THE WORLD MEDICINES SITUATION 2011
Milani, B. (2011) · Cited by 429
A National Assessment of Pediatric Readiness of Emergency Departments
Gausche-Hill, M., Ely, M., Schmuhl, P., Telford, R., Remick, K. E., Edgerton, E. A., & Olson, L. M. (2015) · JAMA Pediatrics · doi:10.1001/jamapediatrics.2015.138 · Cited by 416
Middleton, S., McElduff, P., Ward, J., Grimshaw, J. M., Dale, S., D'Este, C., Drury, P., Griffiths, R., Cheung, N. W., Quinn, C., et al. (2011) · The Lancet · doi:10.1016/s0140-6736(11)61485-2 · Cited by 421
Self-citationThe Handbook of Behavior Change
(2020) · Cambridge University Press eBooks · doi:10.1017/9781108677318 · Cited by 407
Stetler, C. B., Legro, M. W., Rycroft-Malone, J., Bowman, C., Curran, G., Guihan, M., Hagedorn, H., Pineros, S., & Wallace, C. M. (2006) · Implementation Science · doi:10.1186/1748-5908-1-23 · Cited by 411
“In part, this is due to the current lack of substantive knowledge regarding both individual implementation interventions and the interrelationship of multiple interventions used in many studies [1-4].”
BackgroundMendel, P., Meredith, L. S., Schoenbaum, M., Sherbourne, C. D., & Wells, K. B. (2008) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-007-0144-9 · Cited by 407
“Most importantly, the framework is intended to provide a conceptual basis for organizing research and results across studies addressing different aspects of local contexts and pieces of the dissemination process (Grimshaw et al. 2004; Shojania and Grimshaw 2005; ICEBeRG 2006).”
BackgroundAdapting clinical practice guidelines to local context and assessing barriers to their use
Harrison, M. B., Legare, F., Graham, I. D., & Fervers, B. (2010) · Canadian Medical Association Journal · doi:10.1503/cmaj.081232 · Cited by 402
“Despite these efforts, evaluation of these strategies for implementation show that overall conformity of practices lags behind expectations.(6) Although high-quality guidelines may be seen as necessary, they are not sufficient to ensure evidence-based decisionmaking.”
BackgroundA Guide for applying a revised version of the PARIHS framework for implementation
Stetler, C. B., Damschroder, L. J., Helfrich, C. D., & Hagedorn, H. J. (2011) · Implementation Science · doi:10.1186/1748-5908-6-99 · Cited by 402
“[7,14,15,17-24], others to the Stetler model of EBP [25,26], and yet others to the general implementation science literature spanning the last decade [16,27-33].”
BackgroundAssessing country-level efforts to link research to action
Lavis, J. (2006) · Bulletin of the World Health Organization · doi:10.2471/blt.06.030312 · Cited by 404
Niessen, L. W., Mohan, D., Akuoku, J. K., Mirelman, A. J., Ahmed, S., Koehlmoos, T. P., Trujillo, A., Khan, J., & Peters, D. H. (2018) · The Lancet · doi:10.1016/s0140-6736(18)30482-3 · Cited by 394
Rivas, C., Ramsay, J., Sadowski, L., Davidson, L. L., Dunne, D., Eldridge, S., Hegarty, K., Taft, A., & Feder, G. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005043.pub3 · Cited by 392
Shiffman, R. N., Dixon, J., Brandt, C., Essaihi, A., Hsiao, A., Michel, G., & O'Connell, R. (2005) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-5-23 · Cited by 389
Huijg, J. M., Gebhardt, W. A., Crone, M. R., Dusseldorp, E., & Presseau, J. (2014) · Implementation Science · doi:10.1186/1748-5908-9-11 · Cited by 385
“In general, a valid TDF-based questionnaire will increase the use of theory in the assessment of barriers and facilitators for implementation problems [31,69,70], which can inform the selection of possible techniques that can be used to change healthcare professionals’ behaviors [15,23,26].”
Dua, T., Barbui, C., Clark, N., Fleischmann, A., Poznyak, V., van Ommeren, M., Yasamy, M. T., Ayuso-Mateos, J. L., Birbeck, G. L., Drummond, C., et al. (2011) · PLoS Medicine · doi:10.1371/journal.pmed.1001122 · Cited by 384
“These findings are in line with those of a landmark systematic review of implementation studies [16].”
ResultDesigning theoretically-informed implementation interventions
The Improved Clinical Effectiveness through Behavioural Research Group (ICEBeRG) (2006) · Implementation Science · doi:10.1186/1748-5908-1-4 · Cited by 380
Ivers, N. M., Grimshaw, J. M., Jamtvedt, G., Flottorp, S., O’Brien, M. A., French, S. D., Young, J., & Odgaard-Jensen, J. (2014) · Journal of General Internal Medicine · doi:10.1007/s11606-014-2913-y · Cited by 382
Self-citationAudit and feedback and clinical practice guideline adherence: Making feedback actionable
Hysong, S. J., Best, R. G., & Pugh, J. A. (2006) · Implementation Science · doi:10.1186/1748-5908-1-9 · Cited by 371
“Grimshaw and colleagues[5] reported a median effect size of A&F of +7% compared to no intervention using dichotomous process measures, with effect sizes ranging from 1.”
BackgroundMethodSquires, J. E., Sullivan, K., Eccles, M. P., Worswick, J., & Grimshaw, J. M. (2014) · Implementation Science · doi:10.1186/s13012-014-0152-6 · Cited by 368
“9/23 reviews reported findings consistent with both single-component and multifaceted interventions being generally effective compared to controls [7,8,18,20,22,24,28-30]”
BackgroundResultInfluentialSelf-citationAntibiotic prescribing in hospitals: a social and behavioural scientific approach
Hulscher, M. E., Grol, R. P., & van der Meer, J. W. (2010) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(10)70027-x · Cited by 362
Jamtvedt, G., Young, J. M., Kristoffersen, D. T., O'Brien, M. A., & Oxman, A. D. (2006) · Quality and Safety in Health Care · doi:10.1136/qshc.2006.018549 · Cited by 368
Huijg, J. M., Gebhardt, W. A., Dusseldorp, E., Verheijden, M. W., van der Zouwe, N., Middelkoop, B. J., & Crone, M. R. (2014) · Implementation Science · doi:10.1186/1748-5908-9-33 · Cited by 352
“Research has shown that active implementation strategies, such as educational outreach and reminders, can be effective in enhancing implementation behaviors [20,21].”
BackgroundNilsen, P., Ståhl, C., Roback, K., & Cairney, P. (2013) · Implementation Science · doi:10.1186/1748-5908-8-63 · Cited by 346
“provement among the patients has thus far received relatively limited research attention [75,76].”
BackgroundKarnon, J., Stahl, J., Brennan, A., Caro, J. J., Mar, J., & Möller, J. (2012) · Medical Decision Making · doi:10.1177/0272989x12455462 · Cited by 336
“[35] Grimshaw JM, Thomas RE, MacLennan G, et al.”
BackgroundEffect of point-of-care computer reminders on physician behaviour: a systematic review
Shojania, K. G., Jennings, A., Mayhew, A., Ramsay, C., Eccles, M., & Grimshaw, J. (2010) · Canadian Medical Association Journal · doi:10.1503/cmaj.090578 · Cited by 338
Self-citationInterventions for improving the adoption of shared decision making by healthcare professionals
Légaré, F., Stacey, D., Turcotte, S., Cossi, M.-J., Kryworuchko, J., Graham, I. D., Lyddiatt, A., Politi, M. C., Thomson, R., Elwyn, G., et al. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006732.pub3 · Cited by 327
Stein, D. J., Shoptaw, S. J., Vigo, D. V., Lund, C., Cuijpers, P., Bantjes, J., Sartorius, N., & Maj, M. (2022) · World Psychiatry · doi:10.1002/wps.20998 · Cited by 331
Systematic review of knowledge translation strategies in the allied health professions
Scott, S. D., Albrecht, L., O’Leary, K., Ball, G. D., Hartling, L., Hofmeyer, A., Jones, C. A., Klassen, T. P., Burns, K. K., Newton, A. S., et al. (2012) · Implementation Science · doi:10.1186/1748-5908-7-70 · Cited by 331
“nursing [11] and in the guideline implementation literature, which is largely dominated by physicians [6].”
Thomas, A., Menon, A., Boruff, J., Rodriguez, A. M., & Ahmed, S. (2014) · Implementation Science · doi:10.1186/1748-5908-9-54 · Cited by 325
“(2005) and others [16,17] recommend a more systematic use of theory to increase the chances of successful implementation, theories have been rarely used to inform the design and evaluation of KT interventions [5,18].”
BackgroundSynthesising quantitative evidence in systematic reviews of complex health interventions
Higgins, J. P. T., López-López, J. A., Becker, B. J., Davies, S. R., Dawson, S., Grimshaw, J. M., McGuinness, L. A., Moore, T. H. M., Rehfuess, E. A., Thomas, J., et al. (2019) · BMJ Global Health · doi:10.1136/bmjgh-2018-000858 · Cited by 322
“41 exploring heterogeneity Diversity in the types of participants (and contexts), interventions and outcomes are key to understanding sources of complexity.”
BackgroundSelf-citationPereira, V. C., Silva, S. N., Carvalho, V. K. S., Zanghelini, F., & Barreto, J. O. M. (2022) · Health Research Policy and Systems · doi:10.1186/s12961-022-00815-4 · Cited by 294
“The materials may have been delivered personally or through mass mailings [58] Interventions targeted at healthcare workers Educational meetings EME Courses, workshops, conferences or other educational meetings [67]”
BackgroundTETROE, J. M., GRAHAM, I. D., FOY, R., ROBINSON, N., ECCLES, M. P., WENSING, M., DURIEUX, P., LÉGARÉ, F., NIELSON, C. P., ADILY, A., et al. (2008) · The Milbank Quarterly · doi:10.1111/j.1468-0009.2007.00515.x · Cited by 317
Self-citationManagement of Patients With Venous Leg Ulcers: Challenges and Current Best Practice
Franks, P. J., Barker, J., Collier, M., Gethin, G., Haesler, E., Jawien, A., Laeuchli, S., Mosti, G., Probst, S., & Weller, C. (2016) · Journal of Wound Care · doi:10.12968/jowc.2016.25.sup6.s1 · Cited by 311
Metadata
- Authors
- Grimshaw, J., Thomas, R., MacLennan, G., Fraser, C., Ramsay, C., Vale, L., Whitty, P., Eccles, M., Matowe, L., Shirran, L., Wensing, M., Dijkstra, R., & Donaldson, C.
- Affiliations
- University of Aberdeen (GB)
- Newcastle University (GB)
- Radboud University Nijmegen (NL)
- University of Calgary (CA)
- Venue
- Health Technology Assessment
- Published
- 2004-02
- Volume
- 8
- Issue
- 6
- Pages
- iii-iv, 1
- ISSN
- 1366-5278 (ISSN-L)
- 2046-4924
- OpenAlex
- W2038028146
- Cited by
- 3,044
- References
- 38
- Citations by year
- 2026: 45 · 2025: 45 · 2024: 72 · 2023: 65 · 2022: 69 · 2021: 100 · 2020: 163 · 2019: 87 · 2018: 112 · 2017: 129 · 2016: 133 · 2015: 184 · 2014: 188 · 2013: 288 · 2012: 167
- FWCI
- 20.52
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- Locations
- Health Technology Assessment (publishedVersion, other-oa)
- PubMed (publishedVersion)
- Radboud Repository (Radboud University) (submittedVersion, other-oa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Radboud Repository (Radboud University) (submittedVersion)
- Newcastle University ePrints (Newcastle Univesity)
- Funders
- Health Technology Assessment programme (94/08/29)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Keywords
- guideline dissemination, guideline implementation, guideline development, multicomponent intervention, educational outreach, reminders, audit and feedback, teaching materials, cost-effectiveness, resource requirements, clinical governance, primary care, secondary care, evidence-based recommendations, process indicators, healthcare quality improvement
- MeSH terms
- Cost-Benefit Analysis, United Kingdom, Medical Informatics, State Medicine, Practice Guidelines as Topic, Information Dissemination
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.