Effectiveness and efficiency of guideline dissemination and implementation strategies
Open accessThe DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Abstract
OBJECTIVES: To undertake a systematic review of the effectiveness and costs of different guideline development, dissemination and implementation strategies. To estimate the resource implications of these strategies. To develop a framework for deciding when it is efficient to develop and introduce clinical guidelines. DATA SOURCES: MEDLINE, Healthstar, Cochrane Controlled Trial Register, EMBASE, SIGLE and the specialised register of the Cochrane Effective Practice and Organisation of Care (EPOC) group. REVIEW METHODS: Single estimates of dichotomous process variables were derived for each study comparison based upon the primary end-point or the median measure across several reported end-points. Separate analyses were undertaken for comparisons of different types of intervention. The study also explored whether the effects of multifaceted interventions increased with the number of intervention components. Studies reporting economic data were also critically appraised. A survey to estimate the feasibility and likely resource requirements of guideline dissemination and implementation strategies in UK settings was carried out with key informants from primary and secondary care. RESULTS: In total, 235 studies reporting 309 comparisons met the inclusion criteria; of these 73% of comparisons evaluated multifaceted interventions, although the maximum number of replications of a specific multifaceted intervention was 11 comparisons. Overall, the majority of comparisons reporting dichotomous process data observed improvements in care; however, there was considerable variation in the observed effects both within and across interventions. Commonly evaluated single interventions were reminders, dissemination of educational materials, and audit and feedback. There were 23 comparisons of multifaceted interventions involving educational outreach. The majority of interventions observed modest to moderate improvements in care. No relationship was found between the number of component interventions and the effects of multifaceted interventions. Only 29.4% of comparisons reported any economic data. The majority of studies only reported costs of treatment; only 25 studies reported data on the costs of guideline development or guideline dissemination and implementation. The majority of studies used process measures for their primary end-point, despite the fact that only three guidelines were explicitly evidence based (and may not have been efficient). Respondents to the key informant survey rarely identified existing budgets to support guideline dissemination and implementation strategies. In general, the respondents thought that only dissemination of educational materials and short (lunchtime) educational meetings were generally feasible within current resources. CONCLUSIONS: There is an imperfect evidence base to support decisions about which guideline dissemination and implementation strategies are likely to be efficient under different circumstances. Decision makers need to use considerable judgement about how best to use the limited resources they have for clinical governance and related activities to maximise population benefits. They need to consider the potential clinical areas for clinical effectiveness activities, the likely benefits and costs required to introduce guidelines and the likely benefits and costs as a result of any changes in provider behaviour. Further research is required to: develop and validate a coherent theoretical framework of health professional and organisational behaviour and behaviour change to inform better the choice of interventions in research and service settings, and to estimate the efficiency of dissemination and implementation strategies in the presence of different barriers and effect modifiers.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, recent reviews (Farmer 2008; Grimshaw 2004) found that printed educational materials have a small (but potentially important) effect.”
From Audit and feedback: effects on professional practice and healthcare outcomes (2012) · cites this paper as Grimshaw 2004
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“while a systematic review of 235 implementation trials by Grimshaw et al. found no relationship between the number of component interventions and the effects of multifaceted interventions [100].”
From Writing implementation research grant proposals: ten key ingredients (2012) · cites this paper as [100]
The cited source says what the claim attributes to it.
In the citing paper
“It is important to note that the high frequency of educational interventions is not exclusive to the allied health professions, and a similar trend is seen in nursing [11] and in the guideline implementation literature, which is largely dominated by physicians [6].”
From Systematic review of knowledge translation strategies in the allied health professions (2012) · cites this paper as [6]
In the citing paper
“The empirical evidence for the effectiveness of multifaceted strategies has been mixed, because early research touted the benefits of multifaceted strategies [98,99], while a systematic review of 235 implementation trials by Grimshaw et al. found no relationship between the number of component interventions and the effects of multifaceted interventions [100].”
From Writing implementation research grant proposals: ten key ingredients (2012) · cites this paper as [100]
In the citing paper
“the bulk of the research evidence comes from the medical e.g., [4-9] and nursing literature e.g., [10,11].”
From Systematic review of knowledge translation strategies in the allied health professions (2012) · cites this paper as [6]
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2005) · Technometrics · doi:10.1198/tech.2005.s303 · Cited by 17,923
Methods for the Economic Evaluation of Health Care Programmes
Drummond, M. E., Sculpher, M. J., Torrance, G. W., O’Brien, B. J., & Stoddart, G. L. (2005) · doi:10.1093/oso/9780198529446.001.0001 · Cited by 13,648
(1979) · Medical Entomology and Zoology · Cited by 11,252
Quasi-experimentation: Design and analysis issues for field settings
Shrout, P. E. (1980) · Evaluation and Program Planning · doi:10.1016/0149-7189(80)90063-4 · Cited by 6,010
The cochrane database of systematic reviews
Geddes, J. (1996) · Journal of Psychosomatic Research · doi:10.1016/s0022-3999(96)90063-x · Cited by 5,989
Clinical guidelines: Potential benefits, limitations, and harms of clinical guidelines
Woolf, S. H., Grol, R., Hutchinson, A., Eccles, M., & Grimshaw, J. (1999) · BMJ · doi:10.1136/bmj.318.7182.527 · Cited by 2,548
Self-citationSystematic Reviews: Identifying relevant studies for systematic reviews
Dickersin, K., Scherer, R., & Lefebvre, C. (1994) · BMJ · doi:10.1136/bmj.309.6964.1286 · Cited by 2,256
Effectiveness and Efficiency: Random Reflections on Health Services
(1973) · Public Health · doi:10.1016/s0033-3506(73)80082-4 · Cited by 1,912
Guidelines for authors and peer reviewers of economic submissions to the BMJ
Drummond, M. F., & Jefferson, T. O. (1996) · BMJ · doi:10.1136/bmj.313.7052.275 · Cited by 1,827
Davis, D. A. (1995) · JAMA · doi:10.1001/jama.1995.03530090032018 · Cited by 1,763
Research works printed but not linked: 12
- [2]2. NHS Centre for Reviews and Dissemination. Getting evidence into practice. Effective Health Care 1999; 5 :1-16.
- [4]4. NHS Centre for Reviews and Dissemination and Nuffield Institute for Health. Implementing clinical guidelines. Can guidelines be used to improve clinical practice? Effective Health Care 1994; 1 :1-12.
- [9]9. Thomas L, Cullum N, McColl E, Rousseau N, Soutter J, Steen N. Clinical guidelines in nursing, midwifery and other professions allied to medicine (Cochrane Review). The Cochrane Library (Issue 1). Oxford: Update Software; 1999.
- [10]10. Bero L, Grilli R, Grimshaw JM, Mowatt G, Oxman A, Zwarenstein M. Cochrane Effective Practice and Organisation of Care Review Group (Cochrane Group Module). In Bero L, Grilli R, Grimshaw JM, Mowatt G, Oxman A, Zwarenstein M, editors. The Cochrane Library (Issue 3). Oxford: Update Software; 2001.
- [16]16. Bushman BJ. Vote counting methods in metaanalysis. In Cooper H, Hedges L, editors. The handbook of research synthesis. New York: Russell Sage Foundation; 1994; pp. 193-213.
- [17]17. Drummond M, O'Brien B, Stoddart G, Torrance GW. Methods of economic evaluation of health care programmes. Oxford: Oxford University Press; 1997.
- [18]18. McIntosh E. Economic evaluation of guideline implementation studies. In Makela M, Thorsen T, editors. Changing professional practice. Theory and practice of clinical guidelines implementation. Copenhagen: Danish Institute for Health Services Research and Development; 1999, pp. 77-98.
- [21]21. Jefferson TO, Demicheli V , Vale L. Methodological reviews of economic evaluations in health care. JAMA 2002; 287 :2809-12.
- [24]24. Mason J, Freemantle N, Nazereth I, Eccles M, Haines A, Drummond M. When is it cost effective - to change the behaviour of health professionals? JAMA 2001; 286 :2988-92.
- [27]27. Purves IN. PRODIGY: implementing clinical guidelines using computers. Br J Gen Pract 1998; 48 :1552-3.
- [34]34. Grol R. Beliefs and evidence in changing clinical practice. BMJ 1997; 315 :418-21.
- [36]36. Grimshaw JM, Eccles MP . Clinical practice guidelines. In Haines A, Silagy C, editors. Evidencebased practice in primary care. London: BMJ Publishing; 2001, pp. 120-34.
Cited by
Items 501–600 of 1,009
Attieh, R., Gagnon, M., Estabrooks, C. A., Légaré, F., Ouimet, M., Roch, G., Ghandour, E. K., & Grimshaw, J. (2013) · Implementation Science · doi:10.1186/1748-5908-8-138 · Cited by 73
“KT strategies, targeted at individual healthcare workers, are insufficient to change healthcare professionals’ performance [13] and to influence patient outcomes.”
BackgroundSelf-citationRamsay, C. R., Thomas, R. E., Croal, B. L., Grimshaw, J. M., & Eccles, M. P. (2010) · Implementation Science · doi:10.1186/1748-5908-5-71 · Cited by 66
“However, the effects of interventions do appear to vary by condition, professional group, and context, presumably because the causal mechanisms of the interventions are modified in the presence of different barriers and enablers [1].”
BackgroundSelf-citationUrquhart, R., Porter, G. A., Sargeant, J. M., Jackson, L. A., & Grunfeld, E. (2014) · Implementation Science · doi:10.1186/s13012-014-0121-0 · Cited by 76
“, academic detailing, opinion leadership, reminder systems) on the uptake of clinical practice guidelines [115].”
BackgroundFretheim, A., Schünemann, H. J., & Oxman, A. D. (2006) · Health Research Policy and Systems · doi:10.1186/1478-4505-4-27 · Cited by 65
“hensive review of evaluations of the effects of strategies for guideline implementation found that "The majority of interventions observed modest to moderate improvements in care", but there was "considerable variation in the observed effects both within and across interventions"[13].”
BackgroundThe effectiveness of guideline implementation strategies in the dental setting: a systematic review
Villarosa, A. R., Maneze, D., Ramjan, L. M., Srinivas, R., Camilleri, M., & George, A. (2019) · Implementation Science · doi:10.1186/s13012-019-0954-7 · Cited by 74
An overview of research on the effects of results-based financing
Oxman, A. D., & Fretheim, A. (2008) · BIBSYS Brage (BIBSYS (Norway)) · Cited by 86
Nilsen, P., Kaner, E., & Babor, T. F. (2008) · Nordic Studies on Alcohol and Drugs · doi:10.1177/145507250802500608 · Cited by 64
Revisiting interaction in knowledge translation
Ginsburg, L. R., Lewis, S. J., Zackheim, L., & Casebeer, A. L. (2007) · Implementation Science · doi:10.1186/1748-5908-2-34 · Cited by 76
“Even studies with discrete outcomes, such as a systematic review of the effectiveness of a specific treatment in a certain clinical situation, face considerable challenges when it comes to successful knowledge transfer and uptake [48,49].”
Primary sclerosing cholangitis associated with inflammatory bowel disease: an update
Rossi, R. E., Conte, D., & Massironi, S. (2015) · European Journal of Gastroenterology & Hepatology · doi:10.1097/meg.0000000000000532 · Cited by 74
Advanced Chronic Kidney Disease Practice Patterns among Nephrologists and Non-Nephrologists
Patwardhan, M. B., Samsa, G. P., Matchar, D. B., & Haley, W. E. (2007) · Clinical Journal of the American Society of Nephrology · doi:10.2215/cjn.02600706 · Cited by 64
“Evidence also suggests that the nontrivial task of implementing guidelines to optimize management can be accomplished through multifaceted tools (17,25,26).”
BackgroundBoulet, L., Becker, A. B., BOWIE, D. M., Hernandez, P., McIvor, A., Rouleau, M., Bourbeau, J., Graham, I. D., Logan, J., Légaré, F., et al. (2006) · Canadian Respiratory Journal · doi:10.1155/2006/810978 · Cited by 77
Braddick, L., Tuckey, V., Abbas, Z., Lissauer, D. M., ISMAIL, K. M. K., Manaseki‐Holland, S., Ditai, J., & Stokes, T. (2015) · International Journal of Gynecology & Obstetrics · doi:10.1016/j.ijgo.2015.06.047 · Cited by 71
“, clinical audit and feedback) have been shown to be effective [2,5], although the evidence base for low- andmiddle-income countries is limited [6].”
BackgroundCastro‐Sánchez, E., Charani, E., Drumright, L. N., Sevdalis, N., Shah, N., & Holmes, A. H. (2014) · PLoS ONE · doi:10.1371/journal.pone.0086167 · Cited by 64
“would benefit from exploring individual [13], social and professional motivations [14], and structural and cultural influences within local organisational networks [15,16].”
BackgroundMauger, B., Marbella, A. M., Pines, E., Chopra, R., Black, E. R., & Aronson, N. (2014) · American Journal of Infection Control · doi:10.1016/j.ajic.2014.05.031 · Cited by 74
Bhattacharyya, O. K., Estey, E. A., & Zwarenstein, M. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.02.022 · Cited by 65
“Given the limited evidence base to work from, both practitioners and researchers involved in quality improvement (QI) have a responsibility to evaluate the effectiveness of their efforts [10] not only because many interventions are ineffective and may lead to a waste of resources [3] but also because evaluation create…”
BackgroundHuis, A. M. P., Holleman, G., van Achterberg, T., Grol, R. P. T. M., Schoonhoven, L., & Hulscher, M. (2013) · Implementation Science · doi:10.1186/1748-5908-8-41 · Cited by 83
“Background Strategies to improve adherence to practice guidelines are often multimodal and consist of a number of potentially effective components and related improvement activities [1-3] (See Table 1).”
BackgroundMedical admission order sets to improve deep vein thrombosis prophylaxis rates and other outcomes
O’Connor, C., Adhikari, N. K. J., DeCaire, K., & Friedrich, J. O. (2009) · Journal of Hospital Medicine · doi:10.1002/jhm.399 · Cited by 68
Gagliardi, A. R. (2012) · BMC Health Services Research · doi:10.1186/1472-6963-12-404 · Cited by 70
“Considerable research has also found that many guideline implementation strategies can be effective, but their cost and usefulness in different settings remains unclear [15-23].”
BackgroundOrganizational Cost of Quality Improvement for Depression Care
Liu, C., Rubenstein, L. V., Kirchner, J. E., Fortney, J. C., Perkins, M. W., Ober, S. K., Pyne, J. M., & Chaney, E. F. (2009) · Health Services Research · doi:10.1111/j.1475-6773.2008.00911.x · Cited by 63
“…cost-effectiveness analyses of QI efforts, however, focus on the patient care costs associated with the care model resulting from QI, rather than the organizational costs associated with the QI process itself (Wensing, van der Weijden, and Grol 1998; Greenhalgh et al. 2004; Grimshaw et al. 2004).”
BackgroundProfessional interventions for general practitioners on the management of musculoskeletal conditions
Tzortziou Brown, V., Underwood, M., Mohamed, N., Westwood, O., & Morrissey, D. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007495.pub2 · Cited by 62
the eCRT Research Team, McDermott, L., Yardley, L., Little, P., Ashworth, M., & Gulliford, M. (2010) · BMC Family Practice · doi:10.1186/1471-2296-11-90 · Cited by 62
“Computer-based decision support reminders for the implementation of guidelines have been found to improve clinical performance across a number of studies [12] and have been generally effective in changing health care professionals ’ behaviour [13,14].”
BackgroundGrimshaw, J. M., Schünemann, H. J., Burgers, J., Cruz, A. A., Heffner, J., Metersky, M., & Cook, D. (2012) · Proceedings of the American Thoracic Society · doi:10.1513/pats.201208-066st · Cited by 62
“Multifaceted interventions (29) An intervention including two or more components Target multiple barriers of the included intervention components AMSTAR score, 7 Grimshaw and colleagues failed to demonstrate a dose–response analysis (i.”
BackgroundSelf-citationIn, H., Neville, B. A., Lipsitz, S. R., Corso, K., Weeks, J. C., & Greenberg, C. C. (2012) · Annals of Surgery · doi:10.1097/sla.0b013e31824deae6 · Cited by 63
Hutton, J. L., Eccles, M., & Grimshaw, J. (2008) · Implementation Science · doi:10.1186/1748-5908-3-52 · Cited by 62
“However, these efforts have had variable success [2].”
Self-citationBarriers to physician adherence to a subfertility guideline
Haagen, E. C., Nelen, W. L. D. M., Hermens, R., Braat, D. D. M., Grol, R. P. T. M., & Kremer, J. A. M. (2005) · Human Reproduction · doi:10.1093/humrep/dei220 · Cited by 72
“Studies suggest that, besides publication and dissemination of guidelines, more intensive intervention strategies are necessary to promote guideline implementation and alter health-care delivery (Oxman et al., 1995; Bero et al., 1998; Grimshaw et al., 2004).”
BackgroundDonnellan, C., Sweetman, S., & Shelley, E. (2013) · Health Policy · doi:10.1016/j.healthpol.2013.04.002 · Cited by 62
van Dulmen, S. A., Maas, M. J. M., Staal, J. B., Rutten, G. M., Kiers, H., der Sanden, M. W. G. N., & van der Wees, P. J. (2014) · Physical Therapy · doi:10.2522/ptj.20130286 · Cited by 72
Factors Influencing Information Seeking by Physical Therapists Providing Stroke Management
Salbach, N. M., Guilcher, S. J. T., Jaglal, S. B., & Davis, D. (2009) · Physical Therapy · doi:10.2522/ptj.20090081 · Cited by 62
Bowser, D. M., Henry, B. F., & McCollister, K. E. (2021) · Implementation Science · doi:10.1186/s13012-021-01094-3 · Cited by 61
Smink, A. J., Dekker, J., Vlieland, T. P. M. V., Swierstra, B. A., Kortland, J. H., Bijlsma, J. W. J., Teerenstra, S., Voorn, T. B., Bierma‐Zeinstra, S., Schers, H., et al. (2013) · Arthritis Care & Research · doi:10.1002/acr.22222 · Cited by 66
“GP-related factors (n=70) Individual factors Demographics - Age, years; mean (SD) 49 (9) 4 - Sex, male; n (%) 51 (73) 0 - Length of time working, years; median (IQR) 17 (10-25) 4”
Training interventions for improving telephone consultation skills in clinicians
Vaona, A., Pappas, Y., Grewal, R. S., Ajaz, M., Majeed, A., & Car, J. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010034.pub2 · Cited by 65
Thompson‐Leduc, P., Clayman, M. L., Turcotte, S., & Légaré, F. (2014) · Health Expectations · doi:10.1111/hex.12176 · Cited by 87
Mousquès, J., Bourgueil, Y., Fur, P. L., & Yılmaz, E. (2010) · Health Policy · doi:10.1016/j.healthpol.2010.06.001 · Cited by 69
Cortoos, P., Witte, K. D., Peetermans, W. E., Simoens, S., & Laekeman, G. (2008) · Journal of Antimicrobial Chemotherapy · doi:10.1093/jac/dkn143 · Cited by 73
“Limited guideline use through the intranet and the need for personal initiative to obtain the booklet exemplify that passive distribution of information usually has little effect on physicians’ practice.(6) Communication and distribution of the guidelines require a more active approach as they now only reach the resid…”
BackgroundMethodCadogan, S. L., Browne, J. P., Bradley, C., & Cahill, M. R. (2015) · Implementation Science · doi:10.1186/s13012-015-0356-4 · Cited by 71
“Some multifaceted intervention strategies within the scope of this review have shown positive results although conflicting evidence exists in the wider literature on changing healthcare professional behaviours [43, 44].”
BackgroundFrancis, J. J., Tinmouth, A., Stanworth, S. J., Grimshaw, J. M., Johnston, M., Hyde, C., Stockton, C., Brehaut, J. C., Fergusson, D., & Eccles, M. P. (2009) · Implementation Science · doi:10.1186/1748-5908-4-70 · Cited by 60
“Although the transfer of research findings into practice is often slow, quality improvement research [12-14] has demonstrated that interventions can be effective, although providing less information to guide the choice or to optimise the components of complex interventions in actual practice [15].”
Self-citationCraig, L., Taylor, N. J., Grimley, R., Cadilhac, D. A.-M., McInnes, E., Phillips, R., Dale, S., O’Connor, D. A., Levi, C. R., Fitzgerald, M., et al. (2017) · Implementation Science · doi:10.1186/s13012-017-0616-6 · Cited by 73
“These were as follows: multidisciplinary barrier and enabler workshop [31], interactive and didactic education programme [32, 33], use of opinion leaders [25], reminders [34] and site support [34].”
MethodSelf-citationCadilhac, D. A.-M., Purvis, T. L., Kilkenny, M. F., Longworth, M., Mohr, K., Pollack, M. R. P., & Levi, C. R. (2013) · Stroke · doi:10.1161/strokeaha.113.001258 · Cited by 68
“Providing direct feedback on quality of care is an effective means of changing clinical practice.(28) Further monitoring of the quality of care at these hospitals should be encouraged.”
Backgroundvan Dulmen, S. A., Lukersmith, S., Muxlow, J., Santa Mina, E., Nijhuis‐van der Sanden, M. W. G., van der Wees, P. J., & G‐I‐N Allied Health Steering Group (2015) · Health Expectations · doi:10.1111/hex.12144 · Cited by 58
Haastrup, P., Paulsen, M. S., Zwisler, J. E., Begtrup, L. M., Hansen, J. M., Rasmussen, S., & Jarbøl, D. E. (2014) · European Journal of General Practice · doi:10.3109/13814788.2014.905535 · Cited by 60
Developing a minimum standard of care for treating people with osteoarthritis of the hip and knee
MARCH, L. M., Amatya, B., Osborne, R. H., & Brand, C. A. (2010) · Best Practice & Research Clinical Rheumatology · doi:10.1016/j.berh.2009.10.002 · Cited by 70
O’Leary, D., & Mhaolrúnaigh, S. N. (2011) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2011.05750.x · Cited by 80
Measuring organizational readiness for knowledge translation in chronic care
Gagnon, M.-P., Labarthe, J., Légaré, F., Ouimet, M., Estabrooks, C. A., Roch, G., Ghandour, E. K., & Grimshaw, J. (2011) · Implementation Science · doi:10.1186/1748-5908-6-72 · Cited by 60
“As these strategies appear to be insufficient for changing healthcare professionals’ performance [40] and influencing patients’ outcomes, other elements, such as contextual or organizational factors, must be taken into consideration [38,41-45].”
BackgroundSelf-citationRautakorpi, U.-M., Huikko, S., Honkanen, P. O., Klaukka, T., Mākelä, M., Palva, E., Roine, R. P., Sarkkinen, H., Varonen, H., Huovinen, P., et al. (2006) · Clinical Infectious Diseases · doi:10.1086/503036 · Cited by 78
“1% depending on the method of implementation [30].”
MethodAcademic Burnout and Motivation of Chinese Secondary Students
Zhang, X., Klassen, R. M., & Wang, Y. (2013) · International Journal of Social Science and Humanity · doi:10.7763/ijssh.2013.v3.212 · Cited by 65
Estimating Costs of an Implementation Intervention
Wagner, T. H., Yoon, J., Jacobs, J. C., So, A., Kilbourne, A. M., Yu, W., & Goodrich, D. E. (2020) · Medical Decision Making · doi:10.1177/0272989x20960455 · Cited by 59
“However, this assumption may be problematic for some implementation studies if unit costs change as the quantity produced changes.(42) Measuring economies of scale quantitatively requires collecting data over time and across production units where there is variation in scale.”
BackgroundStein, J., Lewin, S., Fairall, L., Mayers, P., English, R., Bheekie, A., Bateman, E., & Zwarenstein, M. (2008) · BMC Health Services Research · doi:10.1186/1472-6963-8-240 · Cited by 59
“The intervention nonetheless involved a training programme to facilitate guideline use, given that the impacts of passive guideline dissemination on practice are modest [20].”
Chhina, H., Bhole, V., Goldsmith, C. H., Hall, W. A., Kaczorowski, J. A., & Lacaille, D. V. (2013) · Journal of Pharmacy & Pharmaceutical Sciences · doi:10.18433/j3kk6c · Cited by 65
“Our results complement information from other reviews [2, 3, 10, 11] that have synthesized data on the effectiveness of AD in different clinical contexts, including a previous Cochrane review [11].”
BackgroundResultElectronic communities of practice: Guidelines from a project
Ho, K., Jarvis-Selinger, S., Norman, C. D., LI, L. C., Olatunbosun, T., Cressman, C., & Nguyen, A. (2010) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.20071 · Cited by 81
Gifford, W., Davies, B., Tourangeau, A. E., & Lefebre, N. (2010) · Journal of Nursing Management · doi:10.1111/j.1365-2834.2010.01140.x · Cited by 79
“With guidelines use increasingly recognized as a tool for improving quality of care (Grimshaw et al. 2004), findings of the present study are important to understand how to assist leaders to better facilitate and support guideline implementation efforts.”
BackgroundMethodInfluentialIncorporation of uncertainty in health economic modelling studies
O’Hagan, A., McCabe, C. J., Akehurst, R. L., Brennan, A., Briggs, A. H., Claxton, K., Fenwick, E. A. L., Fryback, D. G., Sculpher, M., Spiegelhalter, D. J., et al. (2005) · PharmacoEconomics · doi:10.2165/00019053-200523060-00001 · Cited by 67
Brooks, S. C., & Morrison, L. J. (2008) · Resuscitation · doi:10.1016/j.resuscitation.2008.01.017 · Cited by 60
The Contribution of Conceptual Frameworks to Knowledge Translation Interventions in Physical Therapy
Hudon, A., Gervais, M.-J., & Hunt, M. R. (2014) · Physical Therapy · doi:10.2522/ptj.20130483 · Cited by 77
Bell, R., Glinianaia, S. V., van der Waal, Z., Close, A. J., Moloney, E., Jones, S. E., Araújo‐Soares, V., Hamilton, S., Milne, E. M. G., Shucksmith, J., et al. (2017) · Tobacco Control · doi:10.1136/tobaccocontrol-2016-053476 · Cited by 61
“23 Some of the effect of the intervention may be attributable to increased attention, focus and priority on smoking in pregnancy, irrespective of the particular elements unique to this intervention.”
BackgroundSelf-citationBravata, D. M., McDonald, K. M., Shojania, K. G., Sundaram, V., & Owens, D. K. (2005) · Annals of Internal Medicine · doi:10.7326/0003-4819-142-12_part_2-200506211-00005 · Cited by 59
“To preserve the essential meaning of the outcomes while still permitting pooling across studies, the investigators adopted a method developed for the United Kingdom Health Technology Assessment monograph on the impact of clinical practice guidelines (37).”
MethodBehavioural medicine: changing our behaviour
Marteau, T., Dieppe, P., Foy, R., Kinmonth, A.-L., & Schneiderman, N. (2006) · BMJ · doi:10.1136/bmj.332.7539.437 · Cited by 57
Malnutrition and nutritional care practices in hospital wards for older people
Vanderwee, K., Clays, E., Bocquaert, I., Verhaeghe, S. T. L., Lardennois, M., Gobert, M., & Defloor, T. (2010) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2010.05531.x · Cited by 67
Efficient computation of partial expected value of sample information using Bayesian approximation
Brennan, A., & Kharroubi, S. A. (2006) · Journal of Health Economics · doi:10.1016/j.jhealeco.2006.06.002 · Cited by 65
Do implementation strategies increase adherence to pain assessment in hospitals? A systematic review
Ista, E., van Dijk, M., & van Achterberg, T. (2012) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2012.11.003 · Cited by 72
From What We Know to What We Do: Translating Stroke Rehabilitation Research into Practice
Walker, M. F., Fisher, R. J., Korner-Bitensky, N. A., McCluskey, A., & Carey, L. M. (2012) · International Journal of Stroke · doi:10.1111/j.1747-4949.2012.00974.x · Cited by 71
Bonetti, D., Johnston, M., Clarkson, J. E., Grimshaw, J., Pitts, N. B., Eccles, M., Steen, N., Thomas, R., Maclennan, G., Glidewell, L., et al. (2010) · Implementation Science · doi:10.1186/1748-5908-5-25 · Cited by 57
“Implementation research, the scientific study of methods to promote the uptake of research findings, includes the development and testing of interventions that enable healthcare professionals to use research findings more effectively [11-13].”
Self-citationExploring the disconnect in policy implementation: A case of enterprise policy in England
Arshed, N., Mason, C. M., & Carter, S. (2016) · Environment and Planning C Government and Policy · doi:10.1177/0263774x16628181 · Cited by 71
“(2009) and Roper and Hart (2013). Arshed et al.”
BackgroundQuittner, A. L., Abbott, J., Hussain, S. B., Ong, T., Uluer, A., Hempstead, S. E., Lomas, P., & Smith, B. A. (2020) · Pediatric Pulmonology · doi:10.1002/ppul.24949 · Cited by 62
“Dissemination and implementation of guidelines have always faced significant challenges, in part because changes to health care systems and practices are so complex.(25) However, with the support of the CFF, efforts by the MHAC and strategic planning, we demonstrated positive results in implementing these guidelines.”
BackgroundMiller, S. H., Thompson, J. N., Mazmanian, P. E., Aparicio, A., Davis, D. A., Spivey, B. E., & Kahn, N. B. (2008) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.164 · Cited by 64
“Multifaceted interventions often included educational outreach in combination with other interventions: here, the majority of interventions observed modest to moderate improvements in care.(12) While a recently reported systematic review evaluating the effectiveness of CME ~1981–2006!(13) judged many studies of CME ef…”
BackgroundVersorgungsLeitlinie, N. (2011) · Cited by 58
Gagnon, M.-P., Sánchez, E., & Pons, J. M. (2006) · Implementation Science · doi:10.1186/1748-5908-1-8 · Cited by 57
“However, the literature on physician adoption of scientific evidence and interventions to improve it is extensive [19].”
BackgroundPostacute Rehabilitation Quality of Care: Toward a Shared Conceptual Framework
Jesus, T. S., & Hoenig, H. (2014) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2014.12.007 · Cited by 69
Impact of a fall prevention programme in acute hospital settings in Singapore.
Koh, S. S. L., Hafizah, N., Lee, J. Y., Loo, Y., & Muthu, R. (2009) · PubMed · Cited by 68
Guidelines for dementia or Parkinson’s disease with depression or anxiety: a systematic review
Goodarzi, Z., Mele, B., Guo, S., Hanson, H. M., Jetté, N., Patten, S. B., Pringsheim, T. M., & Holroyd-Leduc, J. M. (2016) · BMC Neurology · doi:10.1186/s12883-016-0754-5 · Cited by 62
Lambert, T., Reavley, N. J., Jorm, A. F., & Browne, M. A. O. (2017) · Australian & New Zealand Journal of Psychiatry · doi:10.1177/0004867416686693 · Cited by 61
“However, the development and publication of guidelines does not in itself ensure their use in practice and consideration must be given to dissemination and implementation (Grimshaw et al., 2004).”
BackgroundPractice guidelines as multipurpose tools: A qualitative study of noninvasive ventilation*
Sinuff, T., Kahnamoui, K., Cook, D. J., & Giacomini, M. K. (2007) · Critical Care Medicine · doi:10.1097/01.ccm.0000256848.47911.77 · Cited by 57
Cancer survivorship: a challenge for primary care physicians.
Grunfeld, E. (2005) · Europe PMC (PubMed Central) · Cited by 57
Looijmans-van den Akker, I., van Delden, J. J. M., Verheij, T. J. M., van der Sande, M. A. B., van Essen, G. A., Riphagen-Dalhuisen, J., Hulscher, M. E., & Hak, E. (2010) · Vaccine · doi:10.1016/j.vaccine.2010.05.003 · Cited by 56
Vukadin, M., Schaafsma, F. G., Westerman, M. J., Michon, H. W. C., & Anema, J. R. (2018) · BMC Psychiatry · doi:10.1186/s12888-018-1729-4 · Cited by 55
“showed that most strategies focused on professionals involved [30].”
BackgroundLawrenson, J. G., Graham-Rowe, E., Lorencatto, F., Rice, S., Bunce, C., Francis, J. J., Burr, J. M., Aluko, P., Vale, L., Peto, T., et al. (2018) · Health Technology Assessment · doi:10.3310/hta22290 · Cited by 36
Self-citationExtending analytic methods for economic evaluation in implementation science
O’Leary, M. C., Lich, K. H., Frerichs, L., Leeman, J., Reuland, D. S., & Wheeler, S. B. (2022) · Implementation Science · doi:10.1186/s13012-022-01192-w · Cited by 63
Siron, S., Dagenais, C., & Ridde, V. (2015) · International Journal of Public Health · doi:10.1007/s00038-015-0716-5 · Cited by 73
“…to be effective in low-income countries, the scientific literature does not report any clear relationship between the number of activities implemented and the outcomes achieved; the same is true for the literature on high-income countries (Grimshaw et al. 2004, 2006, 2012; Walter et al. 2005).”
BackgroundResultInfluentialSodhi, S., Banda, H., Kathyola, D., Joshua, M., Richardson, F., Mah, E., MacGregor, H., Kanike, E., Thompson, S., Fairall, L., et al. (2014) · BMC Health Services Research · doi:10.1186/1472-6963-14-s1-s8 · Cited by 56
“Although the clinical tool was designed to be simple and self-explanatory, the PALM PLUS package included a training program on how to use the guideline, since evidence has shown that the impact of passive guideline dissemination on practice is minimal [4].”
MethodWolters, R., Regierer, A. C., Schwentner, L., Geyer, V., Possinger, K., Kreienberg, R., Wischnewsky, M. B., & Wöckel, A. (2011) · European Journal of Cancer · doi:10.1016/j.ejca.2011.06.020 · Cited by 58
Ventilator-associated pneumonia: Improving outcomes through guideline implementation
Sinuff, T., Muscedere, J., Cook, D., Dodek, P., & Heyland, D. K. (2008) · Journal of Critical Care · doi:10.1016/j.jcrc.2007.11.013 · Cited by 64
“Passive strategies, such as distribution of educational materials and didactic lectures, can lead to improvements in processes of care, but may not result in sustained behavior change or improvements in clinical outcome [9].”
BackgroundInfluentialBischoff, K. E., Goel, A., Hollander, H., Ranji, S. R., & Mourad, M. (2013) · BMJ Quality & Safety · doi:10.1136/bmjqs-2012-001671 · Cited by 56
Lewin, S. A., Oxman, A. D., Lavis, J. N., & Fretheim, A. (2009) · Health Research Policy and Systems · doi:10.1186/1478-4505-7-s1-s8 · Cited by 66
the members of the Guidelines International Network Implementation Working Group, Vernooij, R. W. M., Willson, M. L., & Gagliardi, A. R. (2015) · Implementation Science · doi:10.1186/s13012-016-0419-1 · Cited by 70
“Thus further research is required to understand how guideline implementation can be optimized [5, 6].”
BackgroundGuidelines for the public on how to provide mental health first aid: narrative review
Jorm, A. F., & Ross, A. (2018) · BJPsych Open · doi:10.1192/bjo.2018.58 · Cited by 63
Guidelines for preoperative assessment: impact on clinical practice and costs
Ferrando, A., Ivaldi, C., Buttiglieri, A., Pagano, E., Bonetto, C., Arione, R., Scaglione, L., Gelormino, E., Merletti, F., & Ciccone, G. (2005) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzi039 · Cited by 56
“This suggests that a formal economic evaluation would be an important step in changing current practice [20].”
BackgroundHysong, S. J., Best, R. G., & Pugh, J. A. (2007) · Health Services Research · doi:10.1111/j.1475-6773.2006.00610.x · Cited by 55
“A recent review of the area found (Grimshaw et al. 2004) ‘‘multifaceted interventions did not appear to be more effective than single interventions and the effects of multifaceted interventions did not appear to increase with the number of component interventions’’ (p.”
BackgroundA model to evaluate quality and effectiveness of disease management
Lemmens, K. M. M., Nieboer, A. P., van Schayck, O. C. P., Asin, J., & Huijsman, R. (2008) · BMJ Quality & Safety · doi:10.1136/qshc.2006.021865 · Cited by 67
Miao, M., Power, E., & O’Halloran, R. (2014) · Disability and Rehabilitation · doi:10.3109/09638288.2014.932444 · Cited by 60
Becker, A., Held, H., Redaèlli, M., Chenot, J., Leonhardt, C., Keller, S., Baum, E., Pfingsten, M., Hildebrandt, J., Basler, H.-D., et al. (2011) · Spine · doi:10.1097/brs.0b013e31822b01bd · Cited by 62
The Chronic Care Model and Technological Research and Innovation: A Scoping Review at the Crossroads
Gammon, D., Berntsen, G. K. R., Koricho, A. T., Sygna, K., & Ruland, C. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.3547 · Cited by 53
“Nevertheless, similar to the gap between medical evidence and practice [13], there is a gap between technological research and innovation, and applications in health care.”
ASAS/EULAR recommendations for the management of ankylosing spondylitis: the patient version
Kiltz, U., van der Heijde, D. M. F. M., Mielants, H., Feldtkeller, E., & Braun, J. (2008) · Annals of the Rheumatic Diseases · doi:10.1136/ard.2008.096073 · Cited by 55
“Support of patient knowledge and participation in the management of chronic diseases is likely to be beneficial since it is well established that one powerful strategy to change behaviour of patients is to involve them directly in the development of guidelines or recommendations.”
BackgroundStevens, B., Yamada, J., Promislow, S., Stinson, J., Harrison, D. M., & Victor, J. C. (2014) · Implementation Science · doi:10.1186/s13012-014-0120-1 · Cited by 70
“However, Grimshaw and colleagues [1,3] reported that in multifaceted interventions, effect sizes did not necessarily increase with the number of KT strategies implemented.”
BackgroundGvozdenović, E., Allaart, C. F., van der Heijde, D. M. F. M., Ferraccioli, G., Smolen, J. S., Huizinga, T. W. J., & Landewé, R. (2016) · RMD Open · doi:10.1136/rmdopen-2015-000221 · Cited by 56
Hidden curriculum in continuing medical education
Bennett, N. L., Lockyer, J., Mann, K. V., Batty, H. P., Laforet, K., Rethans, J., & Silver, I. (2004) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.1340240305 · Cited by 61
Evidence‐based medicine training and implementation in surgery: the role of surgical cultures
Kitto, S. C., Petrović, A., Gruen, R. L., & Smith, J. A. (2011) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2010.01526.x · Cited by 57
Wettermark, B., Pehrsson, Å., Juhasz-Haverinen, M., Vég, A., Edlert, M., Bergen-Dahl, G. T., Almkvist, H., Godman, B., Granath, F., & Bergman, U. (2009) · PubMed · Cited by 54
Akl, E. A., Mustafa, R. A., Slomka, T., Alawneh, A., Vedavalli, A., & Schünemann, H. J. (2008) · BMC Medical Education · doi:10.1186/1472-6920-8-50 · Cited by 56
“Consequently it would be ideal to implement it as part of a multifaceted interventions [1].”
BackgroundBernhardsson, S., Larsson, M. E. H., Eggertsen, R., Olsén, M. F., Johansson, K. M., Nilsén, P., Nordeman, L., van Tulder, M. W., & Öberg, B. E. (2014) · BMC Health Services Research · doi:10.1186/1472-6963-14-105 · Cited by 66
“Systematic reviews [53,54] have reported average effects of guideline implementation on performance or process of care between 5% and 10%, consistent with the findings of this study.”
ResultCost-Effectiveness of Guideline-Based Care for Workers with Mental Health Problems
Rebergen, D. S., Bruinvels, D. J., van Tulder, M. W., van der Beek, A. J., & van Mechelen, W. (2009) · Journal of Occupational & Environmental Medicine · doi:10.1097/jom.0b013e3181990d8e · Cited by 54
Niquille, A., Ruggli, M., Buchmann, M., Jordan, D., & Bugnon, O. (2010) · Annals of Pharmacotherapy · doi:10.1345/aph.1m537 · Cited by 56
Metadata
- Authors
- Grimshaw, J., Thomas, R., MacLennan, G., Fraser, C., Ramsay, C., Vale, L., Whitty, P., Eccles, M., Matowe, L., Shirran, L., Wensing, M., Dijkstra, R., & Donaldson, C.
- Affiliations
- University of Aberdeen (GB)
- Newcastle University (GB)
- Radboud University Nijmegen (NL)
- University of Calgary (CA)
- Venue
- Health Technology Assessment
- Published
- 2004-02
- Volume
- 8
- Issue
- 6
- Pages
- iii-iv, 1
- ISSN
- 1366-5278 (ISSN-L)
- 2046-4924
- OpenAlex
- W2038028146
- Cited by
- 3,044
- References
- 38
- Citations by year
- 2026: 45 · 2025: 45 · 2024: 72 · 2023: 65 · 2022: 69 · 2021: 100 · 2020: 163 · 2019: 87 · 2018: 112 · 2017: 129 · 2016: 133 · 2015: 184 · 2014: 188 · 2013: 288 · 2012: 167
- FWCI
- 20.52
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- Locations
- Health Technology Assessment (publishedVersion, other-oa)
- PubMed (publishedVersion)
- Radboud Repository (Radboud University) (submittedVersion, other-oa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Radboud Repository (Radboud University) (submittedVersion)
- Newcastle University ePrints (Newcastle Univesity)
- Funders
- Health Technology Assessment programme (94/08/29)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Keywords
- guideline dissemination, guideline implementation, guideline development, multicomponent intervention, educational outreach, reminders, audit and feedback, teaching materials, cost-effectiveness, resource requirements, clinical governance, primary care, secondary care, evidence-based recommendations, process indicators, healthcare quality improvement
- MeSH terms
- Cost-Benefit Analysis, United Kingdom, Medical Informatics, State Medicine, Practice Guidelines as Topic, Information Dissemination
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.