Effectiveness and efficiency of guideline dissemination and implementation strategies
Open accessThe DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Abstract
OBJECTIVES: To undertake a systematic review of the effectiveness and costs of different guideline development, dissemination and implementation strategies. To estimate the resource implications of these strategies. To develop a framework for deciding when it is efficient to develop and introduce clinical guidelines. DATA SOURCES: MEDLINE, Healthstar, Cochrane Controlled Trial Register, EMBASE, SIGLE and the specialised register of the Cochrane Effective Practice and Organisation of Care (EPOC) group. REVIEW METHODS: Single estimates of dichotomous process variables were derived for each study comparison based upon the primary end-point or the median measure across several reported end-points. Separate analyses were undertaken for comparisons of different types of intervention. The study also explored whether the effects of multifaceted interventions increased with the number of intervention components. Studies reporting economic data were also critically appraised. A survey to estimate the feasibility and likely resource requirements of guideline dissemination and implementation strategies in UK settings was carried out with key informants from primary and secondary care. RESULTS: In total, 235 studies reporting 309 comparisons met the inclusion criteria; of these 73% of comparisons evaluated multifaceted interventions, although the maximum number of replications of a specific multifaceted intervention was 11 comparisons. Overall, the majority of comparisons reporting dichotomous process data observed improvements in care; however, there was considerable variation in the observed effects both within and across interventions. Commonly evaluated single interventions were reminders, dissemination of educational materials, and audit and feedback. There were 23 comparisons of multifaceted interventions involving educational outreach. The majority of interventions observed modest to moderate improvements in care. No relationship was found between the number of component interventions and the effects of multifaceted interventions. Only 29.4% of comparisons reported any economic data. The majority of studies only reported costs of treatment; only 25 studies reported data on the costs of guideline development or guideline dissemination and implementation. The majority of studies used process measures for their primary end-point, despite the fact that only three guidelines were explicitly evidence based (and may not have been efficient). Respondents to the key informant survey rarely identified existing budgets to support guideline dissemination and implementation strategies. In general, the respondents thought that only dissemination of educational materials and short (lunchtime) educational meetings were generally feasible within current resources. CONCLUSIONS: There is an imperfect evidence base to support decisions about which guideline dissemination and implementation strategies are likely to be efficient under different circumstances. Decision makers need to use considerable judgement about how best to use the limited resources they have for clinical governance and related activities to maximise population benefits. They need to consider the potential clinical areas for clinical effectiveness activities, the likely benefits and costs required to introduce guidelines and the likely benefits and costs as a result of any changes in provider behaviour. Further research is required to: develop and validate a coherent theoretical framework of health professional and organisational behaviour and behaviour change to inform better the choice of interventions in research and service settings, and to estimate the efficiency of dissemination and implementation strategies in the presence of different barriers and effect modifiers.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, recent reviews (Farmer 2008; Grimshaw 2004) found that printed educational materials have a small (but potentially important) effect.”
From Audit and feedback: effects on professional practice and healthcare outcomes (2012) · cites this paper as Grimshaw 2004
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“while a systematic review of 235 implementation trials by Grimshaw et al. found no relationship between the number of component interventions and the effects of multifaceted interventions [100].”
From Writing implementation research grant proposals: ten key ingredients (2012) · cites this paper as [100]
The cited source says what the claim attributes to it.
In the citing paper
“It is important to note that the high frequency of educational interventions is not exclusive to the allied health professions, and a similar trend is seen in nursing [11] and in the guideline implementation literature, which is largely dominated by physicians [6].”
From Systematic review of knowledge translation strategies in the allied health professions (2012) · cites this paper as [6]
In the citing paper
“The empirical evidence for the effectiveness of multifaceted strategies has been mixed, because early research touted the benefits of multifaceted strategies [98,99], while a systematic review of 235 implementation trials by Grimshaw et al. found no relationship between the number of component interventions and the effects of multifaceted interventions [100].”
From Writing implementation research grant proposals: ten key ingredients (2012) · cites this paper as [100]
In the citing paper
“the bulk of the research evidence comes from the medical e.g., [4-9] and nursing literature e.g., [10,11].”
From Systematic review of knowledge translation strategies in the allied health professions (2012) · cites this paper as [6]
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2005) · Technometrics · doi:10.1198/tech.2005.s303 · Cited by 17,923
Methods for the Economic Evaluation of Health Care Programmes
Drummond, M. E., Sculpher, M. J., Torrance, G. W., O’Brien, B. J., & Stoddart, G. L. (2005) · doi:10.1093/oso/9780198529446.001.0001 · Cited by 13,648
(1979) · Medical Entomology and Zoology · Cited by 11,252
Quasi-experimentation: Design and analysis issues for field settings
Shrout, P. E. (1980) · Evaluation and Program Planning · doi:10.1016/0149-7189(80)90063-4 · Cited by 6,010
The cochrane database of systematic reviews
Geddes, J. (1996) · Journal of Psychosomatic Research · doi:10.1016/s0022-3999(96)90063-x · Cited by 5,989
Clinical guidelines: Potential benefits, limitations, and harms of clinical guidelines
Woolf, S. H., Grol, R., Hutchinson, A., Eccles, M., & Grimshaw, J. (1999) · BMJ · doi:10.1136/bmj.318.7182.527 · Cited by 2,548
Self-citationSystematic Reviews: Identifying relevant studies for systematic reviews
Dickersin, K., Scherer, R., & Lefebvre, C. (1994) · BMJ · doi:10.1136/bmj.309.6964.1286 · Cited by 2,256
Effectiveness and Efficiency: Random Reflections on Health Services
(1973) · Public Health · doi:10.1016/s0033-3506(73)80082-4 · Cited by 1,912
Guidelines for authors and peer reviewers of economic submissions to the BMJ
Drummond, M. F., & Jefferson, T. O. (1996) · BMJ · doi:10.1136/bmj.313.7052.275 · Cited by 1,827
Davis, D. A. (1995) · JAMA · doi:10.1001/jama.1995.03530090032018 · Cited by 1,763
Research works printed but not linked: 12
- [2]2. NHS Centre for Reviews and Dissemination. Getting evidence into practice. Effective Health Care 1999; 5 :1-16.
- [4]4. NHS Centre for Reviews and Dissemination and Nuffield Institute for Health. Implementing clinical guidelines. Can guidelines be used to improve clinical practice? Effective Health Care 1994; 1 :1-12.
- [9]9. Thomas L, Cullum N, McColl E, Rousseau N, Soutter J, Steen N. Clinical guidelines in nursing, midwifery and other professions allied to medicine (Cochrane Review). The Cochrane Library (Issue 1). Oxford: Update Software; 1999.
- [10]10. Bero L, Grilli R, Grimshaw JM, Mowatt G, Oxman A, Zwarenstein M. Cochrane Effective Practice and Organisation of Care Review Group (Cochrane Group Module). In Bero L, Grilli R, Grimshaw JM, Mowatt G, Oxman A, Zwarenstein M, editors. The Cochrane Library (Issue 3). Oxford: Update Software; 2001.
- [16]16. Bushman BJ. Vote counting methods in metaanalysis. In Cooper H, Hedges L, editors. The handbook of research synthesis. New York: Russell Sage Foundation; 1994; pp. 193-213.
- [17]17. Drummond M, O'Brien B, Stoddart G, Torrance GW. Methods of economic evaluation of health care programmes. Oxford: Oxford University Press; 1997.
- [18]18. McIntosh E. Economic evaluation of guideline implementation studies. In Makela M, Thorsen T, editors. Changing professional practice. Theory and practice of clinical guidelines implementation. Copenhagen: Danish Institute for Health Services Research and Development; 1999, pp. 77-98.
- [21]21. Jefferson TO, Demicheli V , Vale L. Methodological reviews of economic evaluations in health care. JAMA 2002; 287 :2809-12.
- [24]24. Mason J, Freemantle N, Nazereth I, Eccles M, Haines A, Drummond M. When is it cost effective - to change the behaviour of health professionals? JAMA 2001; 286 :2988-92.
- [27]27. Purves IN. PRODIGY: implementing clinical guidelines using computers. Br J Gen Pract 1998; 48 :1552-3.
- [34]34. Grol R. Beliefs and evidence in changing clinical practice. BMJ 1997; 315 :418-21.
- [36]36. Grimshaw JM, Eccles MP . Clinical practice guidelines. In Haines A, Silagy C, editors. Evidencebased practice in primary care. London: BMJ Publishing; 2001, pp. 120-34.
Cited by
Items 201–300 of 1,009
Recommendations for sepsis management in resource-limited settings
Dünser, M. W., Festic, E., Dondorp, A., Kissoon, N., Ganbat, T., Kwizera, A., Haniffa, R., Baker, T., Schultz, M. J., & Global Intensive Care Working Group of the European Society of Intensive Care Medicine (2012) · Intensive Care Medicine · doi:10.1007/s00134-012-2468-5 · Cited by 176
“Although it is yet unclear which guideline implementation strategy is most likely to be efficient [104], several approaches have been successfully applied.”
BackgroundWolfenden, L., Nathan, N. K., Sutherland, R., Yoong, S. L., Hodder, R. K., Wyse, R. J., Delaney, T., Grady, A., Fielding, A., Tzelepis, F., et al. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011677.pub2 · Cited by 171
Fuller, C., Michie, S., Savage, J., McAteer, J., Besser, S., Charlett, A., Hayward, A., Cookson, B. D., Cooper, B. S., Duckworth, G., et al. (2012) · PLoS ONE · doi:10.1371/journal.pone.0041617 · Cited by 166
“Such difficulties are well documented [33] in healthcare settings, but may also reflect changes in the National Health Service, including having to compete with other quality improvement initiatives.”
BackgroundRefining a taxonomy for guideline implementation: results of an exercise in abstract classification
Mazza, D., Bairstow, P., Buchan, H., Chakraborty, S. P., Van Hecke, O., Grech, C., & Kunnamo, I. (2013) · Implementation Science · doi:10.1186/1748-5908-8-32 · Cited by 173
“Nevertheless, these domains are in line with the intervention categories described in the literature [2,26] and, as such, were used as a starting point to develop the taxonomy described in this paper.”
MethodSimple rules for evidence translation in complex systems: A qualitative study
Reed, J. E., Howe, C., Doyle, C., & Bell, D. (2018) · BMC Medicine · doi:10.1186/s12916-018-1076-9 · Cited by 165
“Evaluations have focused on identifying simple causal relationships between interventions and outcomes, aiming to produce generalisable knowledge about what works [16].”
BackgroundContinuing Medical Education Effect on Practice Performance
Davis, D., & Galbraith, R. (2009) · Chest · doi:10.1378/chest.08-2517 · Cited by 172
Arditi, C., Rège-Walther, M., Wyatt, J. C., Durieux, P., & Burnand, B. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001175.pub3 · Cited by 175
Hoffmann-Eßer, W., Siering, U., Neugebauer, E. A. M., Brockhaus, A. C., Lampert, U., & Eikermann, M. (2017) · PLoS ONE · doi:10.1371/journal.pone.0174831 · Cited by 171
Improving patient discharge and reducing hospital readmissions by using Intervention Mapping
Hesselink, G., Zegers, M., Vernooij-Dassen, M., Barach, P., Kalkman, C., Flink, M., Ön, G., Olsson, M., Bergenbrant, S., Orrego, C., et al. (2014) · BMC Health Services Research · doi:10.1186/1472-6963-14-389 · Cited by 168
“Strategies that address the barriers to change are required to implement interventions in daily practice [36].”
BackgroundFairall, L. R., Zwarenstein, M., Bateman, E. D., Bachmann, M., Lombard, C., Majara, B. P., Joubert, G., English, R. G., Bheekie, A., van Rensburg, D., et al. (2005) · BMJ · doi:10.1136/bmj.331.7519.750 · Cited by 172
Tinmouth, A., MacDougall, L., Fergusson, D., Amin, M., Graham, I. D., Hebert, P. C., & Wilson, K. (2005) · Archives of Internal Medicine · doi:10.1001/archinte.165.8.845 · Cited by 173
Writing implementation research grant proposals: ten key ingredients
Proctor, E. K., Powell, B. J., Baumann, A. A., Hamilton, A. M., & Santens, R. L. (2012) · Implementation Science · doi:10.1186/1748-5908-7-96 · Cited by 169
“found no relationship between the number of component interventions and the effects of multifaceted interventions [100].”
BackgroundHoben, M., Clarke, A., Huynh, K. T., Kobagi, N., Kent, A., Hu, H., Pereira, R. A. C., Xiong, T., Yu, K., Xiang, H., et al. (2017) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2017.05.003 · Cited by 166
“Research on innovation diffusion and change implementation (Fixsen et al., 2005; Greenhalgh et al., 2005; Grimshaw et al., 2004) suggests that education is important to effective change strategies but may not be sufficient.”
BackgroundKortteisto, T., Kaila, M., Komulainen, J., Mäntyranta, T., & Rissanen, P. (2010) · Implementation Science · doi:10.1186/1748-5908-5-51 · Cited by 164
“guidelines, there is a need to better understand the complexity of changing clinical practice and especially the implementation problems that relate to professional attitudes and experiences associated with use of guidelines in the healthcare context [9-12].”
BackgroundAyieko, P., Ntoburi, S., Wagai, J., Opondo, C., Opiyo, N., Migiro, S., Wamae, A., Mogoa, W., Were, F., Wasunna, A., et al. (2011) · PLoS Medicine · doi:10.1371/journal.pmed.1001018 · Cited by 165
“success in developed countries [15], we used a multifaceted”
BackgroundMethodInfluentialØvretveit, J. (2009) · Cited by 268
Roberts, S. L. E., Healey, A., & Sevdalis, N. (2019) · Implementation Science · doi:10.1186/s13012-019-0901-7 · Cited by 161
“in 2004 [4]), the use of economic methods in evaluating the implementation of evidence-based guidelines was examined, and the authors found evidence of limited quality and scope for understanding the cost-effectiveness of implementation strategies.”
MethodMichie, S., Pilling, S., Garety, P., Whitty, P., Eccles, M. P., Johnston, M., & Simmons, J. (2007) · Implementation Science · doi:10.1186/1748-5908-2-8 · Cited by 161
Self-citationAbu-Dalbouh (2013) · Journal of Computer Science · doi:10.3844/jcssp.2013.763.770 · Cited by 161
Yamada, J., Shorkey, A., Barwick, M., Widger, K., & Stevens, B. J. (2015) · BMJ Open · doi:10.1136/bmjopen-2014-006808 · Cited by 161
Sinuff, T., Cook, D., Giacomini, M., Heyland, D., & Dodek, P. (2007) · Critical Care Medicine · doi:10.1097/01.ccm.0000281446.15342.74 · Cited by 161
Légaré, F., Boivin, A., van der Weijden, T., Pakenham, C., Burgers, J., Légaré, J., St-Jacques, S., & Gagnon, S. (2011) · Medical Decision Making · doi:10.1177/0272989x11424401 · Cited by 163
“Nonetheless, implementing CPGs has been a major challenge.(7) CPGs often fail to reconcile patients’ preferences and social norms with best evidence(8,9) and do not always account for patients’ increased demands to play a more active role in their own care.”
BackgroundImplementation Research Is Needed to Achieve International Health Goals
Sanders, D., & Haines, A. (2006) · PLoS Medicine · doi:10.1371/journal.pmed.0030186 · Cited by 159
Forsner, T., Hansson, J., Brommels, M., Wistedt, A. Å., & Forsell, Y. (2010) · BMC Psychiatry · doi:10.1186/1471-244x-10-8 · Cited by 161
“New methods in psychiatry, as in all other areas of medicine, are continuously introduced but implementing evidence to practice is complex and there is no simple solution [2,6,27].”
InfluentialTools developed and disseminated by guideline producers to promote the uptake of their guidelines
Flodgren, G., Hall, A. M., Goulding, L., Eccles, M. P., Grimshaw, J. M., Leng, G. C., & Shepperd, S. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010669.pub2 · Cited by 159
Self-citationAlthabe, F., Bergel, E., Cafferata, M. L., Gibbons, L., Ciapponi, A., Alemán, A., Colantonio, L., & Palacios, A. R. (2008) · Paediatric and Perinatal Epidemiology · doi:10.1111/j.1365-3016.2007.00912.x · Cited by 164
Pit, S. W., Byles, J. E., Henry, D. A., Holt, L., Hansen, V., & Bowman, D. A. (2007) · Medical Journal of Australia · doi:10.5694/j.1326-5377.2007.tb01110.x · Cited by 158
Gagnon, M.-P., Légaré, F., Labrecque, M., Frémont, P., Pluye, P., Gagnon, J., Car, J., Pagliari, C., Desmartis, M., Turcot, L., et al. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006093.pub2 · Cited by 157
Delirium: Guidelines for general hospitals
Michaud, L., Büla, C., Berney, A., Camus, V., Voellinger, R., Stiefel, F., & Burnand, B. (2007) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2006.10.004 · Cited by 184
“Additional clinical resources and redesigning of the system seem to be necessary to improve practice, according to current evidence on guidelines implementation [19].”
BackgroundVan de Velde, S., Heselmans, A., Delvaux, N., Brandt, L., Marco-Ruiz, L., Spitaels, D., Cloetens, H., Kortteisto, T., Roshanov, P., Kunnamo, I., et al. (2018) · Implementation Science · doi:10.1186/s13012-018-0790-1 · Cited by 156
Education as a low-value improvement intervention: often necessary but rarely sufficient
Soong, C., & Shojania, K. G. (2019) · BMJ Quality & Safety · doi:10.1136/bmjqs-2019-010411 · Cited by 168
Weening-Verbree, L. F., Waal, G. H., van Dusseldorp, L., van Achterberg, T., & Schoonhoven, L. (2013) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2012.12.004 · Cited by 174
Printed educational materials: effects on professional practice and healthcare outcomes
Giguere, A. M. C., Zomahoun, H. T. V., Carmichael, P., Uwizeye, C. B., Légaré, F., Grimshaw, J., Gagnon, M., Auguste, D. U., & Massougbodji, J. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004398.pub4 · Cited by 211
Self-citationContextual influences on health worker motivation in district hospitals in Kenya
Mbindyo, P., Gilson, L., Blaauw, D., & English, M. (2009) · Implementation Science · doi:10.1186/1748-5908-4-43 · Cited by 197
Godman, B., Shrank, W., Andersen, M., Berg, C., Bishop, I., Burkhardt, T., Garuoliene, K., Herholz, H., Joppi, R., Kalaba, M., et al. (2010) · Expert Review of Pharmacoeconomics & Outcomes Research · doi:10.1586/erp.10.72 · Cited by 153
Smith, D. H., Perrin, N., Feldstein, A., Yang, X., Kuang, D., Simon, S. R., Sittig, D. F., Platt, R., & Soumerai, S. B. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.10.1098 · Cited by 114
What are the most effective strategies for improving quality and safety of health care?
Scott, I. (2009) · Internal Medicine Journal · doi:10.1111/j.1445-5994.2008.01798.x · Cited by 153
French, S. D., McKenzie, J. E., O'Connor, D. A., Grimshaw, J. M., Mortimer, D., Francis, J. J., Michie, S., Spike, N., Schattner, P., Kent, P., et al. (2013) · PLoS ONE · doi:10.1371/journal.pone.0065471 · Cited by 156
“However we have little information to guide the choice of intervention to promote the uptake of guidelines for any given implementation problem [1].”
BackgroundSelf-citationWhy are we failing to implement effective therapies in cardiovascular disease?
Nieuwlaat, R., Schwalm, J.-D., Khatib, R., & Yusuf, S. (2013) · European Heart Journal · doi:10.1093/eurheartj/ehs481 · Cited by 152
Implementation of the Canadian C-Spine Rule: prospective 12 centre cluster randomised trial
Stiell, I. G., Clement, C. M., Grimshaw, J., Brison, R. J., Rowe, B. H., Schull, M. J., Lee, J. S., Brehaut, J., McKnight, R. D., Eisenhauer, M. A., et al. (2009) · BMJ · doi:10.1136/bmj.b4146 · Cited by 153
“Although the reductions noted in this trial were not as large, our previous implementation trials used expensive strategies, many of which were not practical for routine use. The implementation strategies used in this study were simple, inexpensive, and could easily be adopted on a permanent basis. It is well document…”
ResultInfluentialSelf-citationSales, A. E., Smith, J. L., Curran, G. M., & Kochevar, L. K. (2006) · Journal of General Internal Medicine · doi:10.1111/j.1525-1497.2006.00362.x · Cited by 215
Eccles, M. P., Grimshaw, J. M., Johnston, M., Steen, N., Pitts, N. B., Thomas, R., Glidewell, E., Maclennan, G., Bonetti, D., & Walker, A. (2007) · Implementation Science · doi:10.1186/1748-5908-2-26 · Cited by 149
“reviewed studies of interventions to promote the uptake of clinical guidelines and showed that all interventions were effective some of the time, with a median absolute effect size of approximately 9% [20].”
Self-citationMedves, J., Godfrey, C., Turner, C., Paterson, M., Harrison, M., MacKenzie, L., & Durando, P. (2010) · International Journal of Evidence-Based Healthcare · doi:10.1111/j.1744-1609.2010.00166.x · Cited by 142
Gagliardi, A. R., Marshall, C., Huckson, S., James, R., & Moore, V. (2015) · Implementation Science · doi:10.1186/s13012-015-0205-5 · Cited by 192
“The effectiveness of most implementation strategies is small and inconsistent, limiting their impact on guideline adoption [6].”
BackgroundDevelopment of evidence-based clinical practice guidelines (CPGs): comparing approaches
Turner, T., Misso, M. L., Harris, C., & Green, S. (2008) · Implementation Science · doi:10.1186/1748-5908-3-45 · Cited by 162
“While the potential of CPGs to support implementation of evidence has been demonstrated, it is not currently being achieved [6].”
Hall, A. M., Scurrey, S. R. M., Pike, A. E., Albury, C., Richmond, H., Matthews, J. J., Toomey, E. C., Hayden, J. A., & Etchegary, H. (2019) · Implementation Science · doi:10.1186/s13012-019-0884-4 · Cited by 168
Acute Post-Surgical Pain Management: A Critical Appraisal of Current Practice
Rathmell, J. P., Wu, C. L., SINATRA, R., Ballantyne, J. C., Ginsberg, B., GORDON, D., LIU, S., PERKINS, F., Reuben, S. S., & Rosenquist, R. W. (2006) · Regional Anesthesia & Pain Medicine · doi:10.1016/j.rapm.2006.05.002 · Cited by 149
Foy, R., Ovretveit, J., Shekelle, P. G., Pronovost, P. J., Taylor, S. L., Dy, S., Hempel, S., McDonald, K. M., Rubenstein, L. V., & Wachter, R. M. (2011) · BMJ Quality & Safety · doi:10.1136/bmjqs.2010.047993 · Cited by 148
“Systematic reviews of interventions to improve practice consistently indicate that most interventions, across different categories, are effective some of the timedbut none all of the timedand that intervention effects range from none to large.(4) 5 This is analogous to clinical research in which drugs or other therapi…”
BackgroundTreggiari, M. M., Martin, D. P., Yanez, N. D., Caldwell, E., Hudson, L. D., & Rubenfeld, G. D. (2007) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.200701-165oc · Cited by 157
“Although a large number of protocols were in place in all types of ICU models, their reported availability in the survey may not reflect use and use may not affect performance (37).”
BackgroundChanging Behavior Using the Model of Action Phases
Keller, L., Gollwitzer, P. M., & Sheeran, P. (2020) · The Handbook of Behavior Change · doi:10.1017/9781108677318.006 · Cited by 147
Gagliardi, A. R., Kothari, A., & Graham, I. D. (2017) · Journal of Epidemiology and Community Health · doi:10.1136/jech-2016-207743 · Cited by 146
Leykum, L. K., Pugh, J. A., Lanham, H. J., Harmon, J., & McDaniel, R. R. (2009) · Implementation Science · doi:10.1186/1748-5908-4-69 · Cited by 146
van der Wees, P. J., Jamtvedt, G., Rebbeck, T. J., de Bie, R. A., Dekker, J., & Hendriks, E. (2008) · Australian Journal of Physiotherapy · doi:10.1016/s0004-9514(08)70002-3 · Cited by 166
“Effects of guideline implementation strategies in health care Grimshaw et al (2004) conducted a systematic review of the effectiveness and cost of different implementation strategies Multifaceted strategies may increase implementation of physiotherapy clinical guidelines: a systematic review Philip…”
BackgroundKnowledge translation and implementation research in nursing
Wallin, L. (2008) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2008.05.006 · Cited by 176
“For example, it has been shown that guideline implementation through reminders has a median improvement effect of 14% (changes in practitioner behaviour or patient outcomes) and that various intervention strategies (reminders, audit and feedback, educational outreach and dissemination of educational materials) have an…”
BackgroundInfluentialStetler, C. B., McQueen, L., Demakis, J., & Mittman, B. S. (2008) · Implementation Science · doi:10.1186/1748-5908-3-30 · Cited by 142
“For example, methodological issues relevant to implementation are increasingly recognized and addressed [3-5]; and clinician and system barriers to the uptake of evidence have been extensively studied, with solutions being suggested and tested [6,7].”
Jenkins, H. J., Hancock, M. J., French, S. D., Maher, C. G., Engel, R. M., & Magnussen, J. S. (2015) · Canadian Medical Association Journal · doi:10.1503/cmaj.141183 · Cited by 142
Antibiotic stewardship: does it work in hospital practice? A review of the evidence base
Hulscher, M., & Prins, J. M. (2017) · Clinical Microbiology and Infection · doi:10.1016/j.cmi.2017.07.017 · Cited by 151
Cheung, A., Weir, M., Mayhew, A., Kozloff, N., Brown, K., & Grimshaw, J. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-36 · Cited by 141
“This effect size is consistent with other interventions that have been used to improve professional behavior [12].”
BackgroundResultSelf-citationFlodgren, G., Conterno, L. D. O., Mayhew, A., Omar, O., Pereira, C. R., & Shepperd, S. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006559.pub2 · Cited by 185
Krein, S. L., Damschroder, L. J., Kowalski, C. P., Forman, J. H., Hofer, T. P., & Saint, S. K. (2010) · Social Science & Medicine · doi:10.1016/j.socscimed.2010.07.041 · Cited by 141
Leykum, L. K., Pugh, J., Lawrence, V., Parchman, M., Noël, P. H., Cornell, J., & McDaniel, R. R. (2007) · Implementation Science · doi:10.1186/1748-5908-2-28 · Cited by 141
A systematic review of integrated use of disease-management interventions in asthma and COPD
Lemmens, K. M. M., Nieboer, A. P., & Huijsman, R. (2009) · Respiratory Medicine · doi:10.1016/j.rmed.2008.11.017 · Cited by 158
The metabolic syndrome in hypertension: European society of hypertension position statement
Redon, J., Cifkova, R., Laurent, S., Nilsson, P., Narkiewicz, K., Erdine, S., & Mancia, G. (2008) · Journal of Hypertension · doi:10.1097/hjh.0b013e328302ca38 · Cited by 143
Systematic Review of Interventions to Improve Prescribing
Ostini, R., Hegney, D., Jackson, C., Williamson, M., Mackson, J. M., Gurman, K., Hall, W., & Tett, S. E. (2009) · Annals of Pharmacotherapy · doi:10.1345/aph.1l488 · Cited by 141
Use of theory to plan or evaluate guideline implementation among physicians: a scoping review
Members of the Guidelines International Network Implementation Working Group, Liang, L., Bernhardsson, S., Vernooij, R. W. M., Armstrong, M. J., Bussières, A., Brouwers, M. C., & Gagliardi, A. R. (2017) · Implementation Science · doi:10.1186/s13012-017-0557-0 · Cited by 157
Bosch-Capblanch, X., Lavis, J. N., Lewin, S., Atun, R., Røttingen, J.-A., Dröschel, D., Beck, L., Abalos, E., El-Jardali, F., Gilson, L., et al. (2012) · PLoS Medicine · doi:10.1371/journal.pmed.1001185 · Cited by 139
“, distribution of educational materials, educational meetings and outreach visits, involvement of local opinion leaders, audit and feedback) that have moderate effects on outcomes [51].”
BackgroundPromoting Evidence-based Practice: Models and Mechanisms From Cross-Sector Review
Nutley, S., Walter, I., & Davies, H. T. O. (2009) · Research on Social Work Practice · doi:10.1177/1049731509335496 · Cited by 190
“Grimshaw et al. (2004) propose that strategies to promote evidence-based practice need to be built from an assessment of barriers to change and be underpinned by a clear theoretical framework.”
BackgroundPetrov, M. S., & Savides, T. J. (2009) · British journal of surgery · doi:10.1002/bjs.6667 · Cited by 138
Paton, C., Barnes, T. R. E., Cavanagh, M.-R., Taylor, D. M., & Lelliott, P. T. (2008) · The British Journal of Psychiatry · doi:10.1192/bjp.bp.107.042895 · Cited by 159
Ollenschlager, G. (2004) · Quality and Safety in Health Care · doi:10.1136/qhc.13.6.455 · Cited by 137
Varonen, H., Kortteisto, T., Kaila, M., & for the EBMeDS Study Group (2008) · Family Practice · doi:10.1093/fampra/cmn020 · Cited by 139
From evidence-based policy making to policy analytics
Marchi, G. D., Lucertini, G., & Tsoukiàs, A. (2014) · Annals of Operations Research · doi:10.1007/s10479-014-1578-6 · Cited by 187
Estabrooks, C. A., Squires, J. E., Cummings, G. G., Teare, G. F., & Norton, P. (2009) · Implementation Science · doi:10.1186/1748-5908-4-52 · Cited by 142
“For example, in studying physician behaviour, investigators have focused on interventions, such as academic detailing [22], educational influentials [23-25], reminder systems [22,26], and audit and feedback [27,28].”
Carlfjord, S., Lindberg, M., Bendtsen, P., Nilsen, P., & Andersson, A. (2010) · BMC Family Practice · doi:10.1186/1471-2296-11-60 · Cited by 133
“[8], who conducted a review of publications in the area.”
BackgroundRoberts, A. S., Benrimoj, S. I., Chen, T. F., Williams, K. A., & Aslani, P. (2006) · International Journal of Pharmacy Practice · doi:10.1211/ijpp.14.3.0002 · Cited by 134
On the trail of quality and safety in health care
Grol, R., Berwick, D. M., & Wensing, M. (2008) · BMJ · doi:10.1136/bmj.39413.486944.ad · Cited by 135
Self-citationClinical practice guidelines for dementia in Australia
Laver, K., Cumming, R. G., Dyer, S. M., Agar, M. R., Anstey, K. J., Beattie, E., Brodaty, H., Broe, T., Clemson, L., Crotty, M., et al. (2016) · Medical Journal of Australia · doi:10.5694/mja15.01339 · Cited by 134
“[43] Factors associated with dementia in the Kimberley study included: older age, male gender, no formal education, head injury, current smoking, previous stroke and epilepsy.[5]”
InfluentialKnowledge translation versus knowledge integration: A “funder's” perspective
Kerner, J. F. (2006) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.53 · Cited by 135
Légaré, F., St‐Jacques, S., Gagnon, S., Njoya, M. M., Brisson, M., Frémont, P., & Rousseau, F. (2011) · Prenatal Diagnosis · doi:10.1002/pd.2624 · Cited by 143
“Most implementation research tends to overlook clinician–patient interaction (Grimshaw et al., 2004).”
BackgroundCar, L. T., Soong, A., Kyaw, B. M., Chua, K. L., Low‐Beer, N., & Majeed, A. (2019) · BMC Medicine · doi:10.1186/s12916-019-1370-1 · Cited by 149
“Traditional learning, especially the face-to-face type, can be time-consuming, costly and inaccessible [9, 12].”
BackgroundThe contribution of case study research to knowledge of how to improve quality of care
Baker, G. R. (2011) · BMJ Quality & Safety · doi:10.1136/bmjqs.2010.046490 · Cited by 184
Stone, S. P., Cooper, B. S., Kibbler, C. C., Cookson, B. D., Roberts, J. A., Medley, G. F., Duckworth, G., Lai, R., Ebrahim, S., Brown, E. M., et al. (2007) · Journal of Antimicrobial Chemotherapy · doi:10.1093/jac/dkm055 · Cited by 131
Atkins, D., Fink, K., & Slutsky, J. (2005) · Annals of Internal Medicine · doi:10.7326/0003-4819-142-12_part_2-200506211-00002 · Cited by 129
Hoffmann-Eßer, W., Siering, U., Neugebauer, E. A. M., Brockhaus, A. C., McGauran, N., & Eikermann, M. (2018) · BMC Health Services Research · doi:10.1186/s12913-018-2954-8 · Cited by 146
Translating Knowledge in Rehabilitation: Systematic Review
Jones, C. A., Roop, S. C., Pohar, S. L., Albrecht, L., & Scott, S. D. (2014) · Physical Therapy · doi:10.2522/ptj.20130512 · Cited by 146
Finch, T. L., Mair, F. S., O’Donnell, C., Murray, E., & May, C. R. (2012) · BMC Medical Research Methodology · doi:10.1186/1471-2288-12-69 · Cited by 127
Hoffmann-Eßer, W., Siering, U., Neugebauer, E. A. M., Lampert, U., & Eikermann, M. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.12.009 · Cited by 133
A guide to the translation of the Global Initiative for Asthma (GINA) strategy into improved care
Boulet, L., FitzGerald, J. M., Levy, M. L., Cruz, Á. A., Pedersen, S., Haahtela, T., & Bateman, E. (2012) · European Respiratory Journal · doi:10.1183/09031936.00184511 · Cited by 129
Bentz, C., Bayley, B., Bonin, K., Fleming, L., Hollis, J., Hunt, J., LeBlanc, B., McAfee, T., Payne, N., & Siemienczuk, J. (2007) · Nicotine & Tobacco Research · doi:10.1080/14622200701188828 · Cited by 126
“This finding could have several causes, including that feedback is a relatively low-level intervention (Grimshaw et al., 2004) that is more useful when combined with other interventions such as alerts and reminders (Thomson O’Brien, Oxman, Haynes et al.”
BackgroundAssessing the adequacy of pressure ulcer prevention in hospitals: a nationwide prevalence survey
Vanderwee, K., Defloor, T., Beeckman, D., Demarré, L., Verhaeghe, S. T. L., Durme, T. V., & Gobert, M. (2011) · BMJ Quality & Safety · doi:10.1136/bmjqs.2010.043125 · Cited by 127
“To increase their effectiveness, implementation strategies should address these barriers.(40) The use of tailored multifaceted implementation strategies is another possible option.”
BackgroundHanbury, A., Prosser, M., & Rickinson, M. (2008) · Studies in Higher Education · doi:10.1080/03075070802211844 · Cited by 123
“2004 ), and findings could be shared between the two perspectives.”
BackgroundDijkstra, R. F., Wensing, M., Thomas, R. E., Akkermans, R., Braspenning, J. C. C., Grimshaw, J., & Grol, R. P. T. M. (2006) · BMC Health Services Research · doi:10.1186/1472-6963-6-53 · Cited by 146
“Details of the search strategies and their development are described elsewhere[2].”
Self-citationBuilding theories of knowledge translation interventions: Use the entire menu of constructs
Brehaut, J. C., & Eva, K. W. (2012) · Implementation Science · doi:10.1186/1748-5908-7-114 · Cited by 120
“Perhaps not surprisingly, systematic reviews of many commonly used implementation techniques [4-8] have shown their effectiveness to be highly variable.”
Reeves, P., Edmunds, K., Searles, A., & Wiggers, J. (2019) · Public Health · doi:10.1016/j.puhe.2019.01.012 · Cited by 120
Developing a theory‐based taxonomy of methods for implementing change in practice
Leeman, J., Baernholdt, M., & Sandelowski, M. (2007) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2006.04207.x · Cited by 120
Can we improve adenoma detection rates? A systematic review of intervention studies
Corley, D. A., Jensen, C. D., & Marks, A. R. (2011) · Gastrointestinal Endoscopy · doi:10.1016/j.gie.2011.04.017 · Cited by 123
Bower, P., Cartwright, M., Hirani, S. P., Barlow, J., Hendy, J., Knapp, M., Henderson, C., Rogers, A., Sanders, C., Bardsley, M., et al. (2011) · BMC Health Services Research · doi:10.1186/1472-6963-11-184 · Cited by 119
“Health service innovation is not linear or orderly [50,51] and technological innovation requires both individual and organisational change [52].”
Lomas, J. (2005) · Healthcare Policy | Politiques de Santé · doi:10.12927/hcpol..17567 · Cited by 120
Lang, C. C., Smith, K., Wingham, J., Eyre, V., Greaves, C. J., Warren, F. C., Green, C., Jolly, K., Davis, R. C., Doherty, P. J., et al. (2018) · BMJ Open · doi:10.1136/bmjopen-2017-019649 · Cited by 119
Use and effects of implementation strategies for practice guidelines in nursing: a systematic review
Cassidy, C. E., Harrison, M. B., Godfrey, C. M., Nincic, V., Khan, P. A., Oakley, P., Ross‐White, A., Grantmyre, H., & Graham, I. D. (2021) · Implementation Science · doi:10.1186/s13012-021-01165-5 · Cited by 134
“Reporting continues to be an issue identified in this review, as was also identified in previous systematic reviews in medicine [22], allied health [13, 15, 16, 83], and nursing [19].”
BackgroundMethodResultInfluential
Metadata
- Authors
- Grimshaw, J., Thomas, R., MacLennan, G., Fraser, C., Ramsay, C., Vale, L., Whitty, P., Eccles, M., Matowe, L., Shirran, L., Wensing, M., Dijkstra, R., & Donaldson, C.
- Affiliations
- University of Aberdeen (GB)
- Newcastle University (GB)
- Radboud University Nijmegen (NL)
- University of Calgary (CA)
- Venue
- Health Technology Assessment
- Published
- 2004-02
- Volume
- 8
- Issue
- 6
- Pages
- iii-iv, 1
- ISSN
- 1366-5278 (ISSN-L)
- 2046-4924
- OpenAlex
- W2038028146
- Cited by
- 3,044
- References
- 38
- Citations by year
- 2026: 45 · 2025: 45 · 2024: 72 · 2023: 65 · 2022: 69 · 2021: 100 · 2020: 163 · 2019: 87 · 2018: 112 · 2017: 129 · 2016: 133 · 2015: 184 · 2014: 188 · 2013: 288 · 2012: 167
- FWCI
- 20.52
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- Locations
- Health Technology Assessment (publishedVersion, other-oa)
- PubMed (publishedVersion)
- Radboud Repository (Radboud University) (submittedVersion, other-oa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Radboud Repository (Radboud University) (submittedVersion)
- Newcastle University ePrints (Newcastle Univesity)
- Funders
- Health Technology Assessment programme (94/08/29)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Keywords
- guideline dissemination, guideline implementation, guideline development, multicomponent intervention, educational outreach, reminders, audit and feedback, teaching materials, cost-effectiveness, resource requirements, clinical governance, primary care, secondary care, evidence-based recommendations, process indicators, healthcare quality improvement
- MeSH terms
- Cost-Benefit Analysis, United Kingdom, Medical Informatics, State Medicine, Practice Guidelines as Topic, Information Dissemination
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.