Effectiveness and efficiency of guideline dissemination and implementation strategies
Open accessThe DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Abstract
OBJECTIVES: To undertake a systematic review of the effectiveness and costs of different guideline development, dissemination and implementation strategies. To estimate the resource implications of these strategies. To develop a framework for deciding when it is efficient to develop and introduce clinical guidelines. DATA SOURCES: MEDLINE, Healthstar, Cochrane Controlled Trial Register, EMBASE, SIGLE and the specialised register of the Cochrane Effective Practice and Organisation of Care (EPOC) group. REVIEW METHODS: Single estimates of dichotomous process variables were derived for each study comparison based upon the primary end-point or the median measure across several reported end-points. Separate analyses were undertaken for comparisons of different types of intervention. The study also explored whether the effects of multifaceted interventions increased with the number of intervention components. Studies reporting economic data were also critically appraised. A survey to estimate the feasibility and likely resource requirements of guideline dissemination and implementation strategies in UK settings was carried out with key informants from primary and secondary care. RESULTS: In total, 235 studies reporting 309 comparisons met the inclusion criteria; of these 73% of comparisons evaluated multifaceted interventions, although the maximum number of replications of a specific multifaceted intervention was 11 comparisons. Overall, the majority of comparisons reporting dichotomous process data observed improvements in care; however, there was considerable variation in the observed effects both within and across interventions. Commonly evaluated single interventions were reminders, dissemination of educational materials, and audit and feedback. There were 23 comparisons of multifaceted interventions involving educational outreach. The majority of interventions observed modest to moderate improvements in care. No relationship was found between the number of component interventions and the effects of multifaceted interventions. Only 29.4% of comparisons reported any economic data. The majority of studies only reported costs of treatment; only 25 studies reported data on the costs of guideline development or guideline dissemination and implementation. The majority of studies used process measures for their primary end-point, despite the fact that only three guidelines were explicitly evidence based (and may not have been efficient). Respondents to the key informant survey rarely identified existing budgets to support guideline dissemination and implementation strategies. In general, the respondents thought that only dissemination of educational materials and short (lunchtime) educational meetings were generally feasible within current resources. CONCLUSIONS: There is an imperfect evidence base to support decisions about which guideline dissemination and implementation strategies are likely to be efficient under different circumstances. Decision makers need to use considerable judgement about how best to use the limited resources they have for clinical governance and related activities to maximise population benefits. They need to consider the potential clinical areas for clinical effectiveness activities, the likely benefits and costs required to introduce guidelines and the likely benefits and costs as a result of any changes in provider behaviour. Further research is required to: develop and validate a coherent theoretical framework of health professional and organisational behaviour and behaviour change to inform better the choice of interventions in research and service settings, and to estimate the efficiency of dissemination and implementation strategies in the presence of different barriers and effect modifiers.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, recent reviews (Farmer 2008; Grimshaw 2004) found that printed educational materials have a small (but potentially important) effect.”
From Audit and feedback: effects on professional practice and healthcare outcomes (2012) · cites this paper as Grimshaw 2004
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“while a systematic review of 235 implementation trials by Grimshaw et al. found no relationship between the number of component interventions and the effects of multifaceted interventions [100].”
From Writing implementation research grant proposals: ten key ingredients (2012) · cites this paper as [100]
The cited source says what the claim attributes to it.
In the citing paper
“It is important to note that the high frequency of educational interventions is not exclusive to the allied health professions, and a similar trend is seen in nursing [11] and in the guideline implementation literature, which is largely dominated by physicians [6].”
From Systematic review of knowledge translation strategies in the allied health professions (2012) · cites this paper as [6]
In the citing paper
“The empirical evidence for the effectiveness of multifaceted strategies has been mixed, because early research touted the benefits of multifaceted strategies [98,99], while a systematic review of 235 implementation trials by Grimshaw et al. found no relationship between the number of component interventions and the effects of multifaceted interventions [100].”
From Writing implementation research grant proposals: ten key ingredients (2012) · cites this paper as [100]
In the citing paper
“the bulk of the research evidence comes from the medical e.g., [4-9] and nursing literature e.g., [10,11].”
From Systematic review of knowledge translation strategies in the allied health professions (2012) · cites this paper as [6]
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2005) · Technometrics · doi:10.1198/tech.2005.s303 · Cited by 17,923
Methods for the Economic Evaluation of Health Care Programmes
Drummond, M. E., Sculpher, M. J., Torrance, G. W., O’Brien, B. J., & Stoddart, G. L. (2005) · doi:10.1093/oso/9780198529446.001.0001 · Cited by 13,648
(1979) · Medical Entomology and Zoology · Cited by 11,252
Quasi-experimentation: Design and analysis issues for field settings
Shrout, P. E. (1980) · Evaluation and Program Planning · doi:10.1016/0149-7189(80)90063-4 · Cited by 6,010
The cochrane database of systematic reviews
Geddes, J. (1996) · Journal of Psychosomatic Research · doi:10.1016/s0022-3999(96)90063-x · Cited by 5,989
Clinical guidelines: Potential benefits, limitations, and harms of clinical guidelines
Woolf, S. H., Grol, R., Hutchinson, A., Eccles, M., & Grimshaw, J. (1999) · BMJ · doi:10.1136/bmj.318.7182.527 · Cited by 2,548
Self-citationSystematic Reviews: Identifying relevant studies for systematic reviews
Dickersin, K., Scherer, R., & Lefebvre, C. (1994) · BMJ · doi:10.1136/bmj.309.6964.1286 · Cited by 2,256
Effectiveness and Efficiency: Random Reflections on Health Services
(1973) · Public Health · doi:10.1016/s0033-3506(73)80082-4 · Cited by 1,912
Guidelines for authors and peer reviewers of economic submissions to the BMJ
Drummond, M. F., & Jefferson, T. O. (1996) · BMJ · doi:10.1136/bmj.313.7052.275 · Cited by 1,827
Davis, D. A. (1995) · JAMA · doi:10.1001/jama.1995.03530090032018 · Cited by 1,763
Research works printed but not linked: 12
- [2]2. NHS Centre for Reviews and Dissemination. Getting evidence into practice. Effective Health Care 1999; 5 :1-16.
- [4]4. NHS Centre for Reviews and Dissemination and Nuffield Institute for Health. Implementing clinical guidelines. Can guidelines be used to improve clinical practice? Effective Health Care 1994; 1 :1-12.
- [9]9. Thomas L, Cullum N, McColl E, Rousseau N, Soutter J, Steen N. Clinical guidelines in nursing, midwifery and other professions allied to medicine (Cochrane Review). The Cochrane Library (Issue 1). Oxford: Update Software; 1999.
- [10]10. Bero L, Grilli R, Grimshaw JM, Mowatt G, Oxman A, Zwarenstein M. Cochrane Effective Practice and Organisation of Care Review Group (Cochrane Group Module). In Bero L, Grilli R, Grimshaw JM, Mowatt G, Oxman A, Zwarenstein M, editors. The Cochrane Library (Issue 3). Oxford: Update Software; 2001.
- [16]16. Bushman BJ. Vote counting methods in metaanalysis. In Cooper H, Hedges L, editors. The handbook of research synthesis. New York: Russell Sage Foundation; 1994; pp. 193-213.
- [17]17. Drummond M, O'Brien B, Stoddart G, Torrance GW. Methods of economic evaluation of health care programmes. Oxford: Oxford University Press; 1997.
- [18]18. McIntosh E. Economic evaluation of guideline implementation studies. In Makela M, Thorsen T, editors. Changing professional practice. Theory and practice of clinical guidelines implementation. Copenhagen: Danish Institute for Health Services Research and Development; 1999, pp. 77-98.
- [21]21. Jefferson TO, Demicheli V , Vale L. Methodological reviews of economic evaluations in health care. JAMA 2002; 287 :2809-12.
- [24]24. Mason J, Freemantle N, Nazereth I, Eccles M, Haines A, Drummond M. When is it cost effective - to change the behaviour of health professionals? JAMA 2001; 286 :2988-92.
- [27]27. Purves IN. PRODIGY: implementing clinical guidelines using computers. Br J Gen Pract 1998; 48 :1552-3.
- [34]34. Grol R. Beliefs and evidence in changing clinical practice. BMJ 1997; 315 :418-21.
- [36]36. Grimshaw JM, Eccles MP . Clinical practice guidelines. In Haines A, Silagy C, editors. Evidencebased practice in primary care. London: BMJ Publishing; 2001, pp. 120-34.
Cited by
Items 401–500 of 1,009
Hoomans, T., Fenwick, E. A. L., Palmer, S., & Claxton, K. (2008) · Value in Health · doi:10.1111/j.1524-4733.2008.00431.x · Cited by 93
Nzinga, J., Mbindyo, P., Mbaabu, L., Warira, A., & English, M. (2009) · Implementation Science · doi:10.1186/1748-5908-4-44 · Cited by 81
“These initial concepts were informed by the considerable experience of some authors of working with rural Kenyan hospitals and insights from a variety of perspectives in the literature on health systems, quality improvement, guideline implementation, and behavioural research [9,11-19].”
BackgroundDyson, J., Lawton, R., Jackson, C., & Cheater, F. (2013) · Implementation Science · doi:10.1186/1748-5908-8-111 · Cited by 81
Dijkstra, R. F., Niessen, L. W., Braspenning, J. C. C., Adang, E., & Grol, R. T. P. M. (2006) · Diabetic Medicine · doi:10.1111/j.1464-5491.2005.01751.x · Cited by 81
Self-citationJust‐in‐Time Evidence‐Based E‐mail “Reminders” in Home Health Care: Impact on Patient Outcomes
Feldman, P. H., Murtaugh, C. M., Pezzin, L. E., McDonald, M. V., & Peng, T. R. (2005) · Health Services Research · doi:10.1111/j.1475-6773.2005.00389.x · Cited by 81
Hendrick, P. A., Mani, R., Bishop, A., Milosavljevic, S., & Schneiders, A. G. (2012) · Manual Therapy · doi:10.1016/j.math.2012.09.002 · Cited by 88
"What lies beneath it all?" – an interview study of GPs' attitudes to the use of guidelines
Carlsen, B., & Norheim, O. F. (2008) · BMC Health Services Research · doi:10.1186/1472-6963-8-218 · Cited by 97
“Descriptive studies indicate that clinical practice guidelines are read and adopted to varying degrees [4,5].”
BackgroundKryworuchko, J., Stacey, D., Bai, N., & Graham, I. D. (2009) · Implementation Science · doi:10.1186/1748-5908-4-49 · Cited by 83
Translating Research into Practice in Nursing Homes: Can We Close the Gap?
Rahman, A. N., Applebaum, R., Schnelle, J. F., & Simmons, S. F. (2012) · The Gerontologist · doi:10.1093/geront/gnr157 · Cited by 82
Brouwers, M. C., Makarski, J., Kastner, M., Hayden, L., & Bhattacharyya, O. K. (2015) · Implementation Science · doi:10.1186/s13012-015-0225-1 · Cited by 94
“While the potential for PGs is strong [3-5], impacts on processes and outcomes of care are not consistently reported [4,5].”
BackgroundSelecting, presenting and delivering clinical guidelines: are there any “magic bullets”?
Eccles, M., & Grimshaw, J. (2004) · The Medical Journal of Australia · doi:10.5694/j.1326-5377.2004.tb05946.x · Cited by 99
“The review by Grimshaw et al 15 suggests that postal delivery may be effective to some degree, and also provides strong support for various forms of reminder systems.”
BackgroundSelf-citationStrategies for Reducing Regional Variation in the Use of Surgery: A Systematic Review
Reames, B. N., Shubeck, S. P., & Birkmeyer, J. D. (2013) · Annals of Surgery · doi:10.1097/sla.0000000000000248 · Cited by 92
Combating inappropriate use of medicines
Holloway, K. (2011) · Expert Review of Clinical Pharmacology · doi:10.1586/ecp.11.14 · Cited by 99
‘Bench To Behavior’: Translating Comparative Effectiveness Research Into Improved Clinical Practice
Avorn, J., & Fischer, M. A. (2010) · Health Affairs · doi:10.1377/hlthaff.2010.0696 · Cited by 89
Stevens, J. G. A., & Beurskens, A. J. H. M. (2010) · Physical Therapy · doi:10.2522/ptj.20090105 · Cited by 92
Couper, K., Kimani, P., Abella, B. S., Chilwan, M., Cooke, M. W., Davies, R. P., Field, R. A., Gao, F., Quinton, S., Stallard, N., et al. (2015) · Critical Care Medicine · doi:10.1097/ccm.0000000000001202 · Cited by 86
“The implementation of guidelines in clinical practice is complex, such that the most effective guideline implementation strategy remains unclear (9, 22).”
Clack, L., Zingg, W., Saint, S. K., Casillas, A., Touveneau, S., Jantarada, F. D. L., Willi, U., van der Kooi, T. I. I., Damschroder, L. J., Forman, J. H., et al. (2018) · BMJ Quality & Safety · doi:10.1136/bmjqs-2017-007675 · Cited by 91
Peláez, S., Lamontagne, A. J., Collin, J., Gauthier, A., Grad, R. M., Blais, L., Lavoie, K. L., Bacon, S. L., Ernst, P., Guay, H., et al. (2015) · BMC Pulmonary Medicine · doi:10.1186/s12890-015-0044-9 · Cited by 79
“The lack of prior identification of relevant barriers and facilitators before planning an intervention is one of the main reasons why knowledge translation interventions aiming at various clinical issues have either failed or had a modest effect [12].”
Dupont, C., Touzet, S., Colin, C., Deneux‐Tharaux, C., Rabilloud, M., Clement, H. J., Lansac, J., Bouvier‐Colle, M., & Rudigoz, R. C. (2009) · International Journal of Obstetric Anesthesia · doi:10.1016/j.ijoa.2009.02.017 · Cited by 79
Presseau, J., Sniehotta, F. F., Francis, J. J., & Campbell, N. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-77 · Cited by 77
“Background Translation of research evidence into clinical practice remains a challenge [1,2].”
Daly, J. M. (2007) · Yearbook of Surgery · doi:10.1016/s0090-3671(08)70139-3 · Cited by 79
Khalifa, M., & Khalid, P. (2015) · Procedia Computer Science · doi:10.1016/j.procs.2015.08.368 · Cited by 101
Evidence-Based Decision Making: When Should We Wait For More Information?
Chalkidou, K., Lord, J., Fischer, A., & Littlejohns, P. (2008) · Health Affairs · doi:10.1377/hlthaff.27.6.1642 · Cited by 88
Lee, S. K., Shah, P. S., Singhal, N., Aziz, K., Synnes, A. R., McMillan, D., & Seshia, M. M. K. (2014) · Canadian Medical Association Journal · doi:10.1503/cmaj.140399 · Cited by 78
“GA 260 to 286 wk 285/1019 (28) 247/1092 (23) 227/1031 (22) 164/951 (17)”
Why Consider Patients’ Preferences?: A Discourse Analysis of Clinical Practice Guideline Developers
Boivin, A., Green, J., van der Meulen, J., Légaré, F., & Nolte, E. (2009) · Medical Care · doi:10.1097/mlr.0b013e3181a81158 · Cited by 78
“Elucidating these discourses helps understand the broader interests around patient and public involvement initiatives in the context of difficult guideline implementation and common criticisms that CPG promote a form of cookbook medicine.(36,37) The rising interest by CPG developers for shared decision-making and pati…”
BackgroundMcKenzie, J. E., French, S. D., O'Connor, D. A., Grimshaw, J. M., Mortimer, D., Michie, S., Francis, J., Spike, N., Schattner, P., Kent, P. M., et al. (2008) · Implementation Science · doi:10.1186/1748-5908-3-11 · Cited by 77
“Interventions comparing standard CPG dissemination with no intervention control groups have shown improvements in care of approximately 8% [2].”
InfluentialSelf-citationThe demonstration of a theory-based approach to the design of localized patient safety interventions
Taylor, N., Lawton, R., Slater, B., & Foy, R. (2013) · Implementation Science · doi:10.1186/1748-5908-8-123 · Cited by 77
“Interventions to change professional behavior have modest and variable effects [8].”
BackgroundHolloway, K., & van Dijk, L. (2011) · Data Archiving and Networked Services (DANS) · Cited by 77
Health professionals’ adherence to stroke clinical guidelines: A review of the literature
Donnellan, C., Sweetman, S., & Shelley, E. (2013) · Health Policy · doi:10.1016/j.healthpol.2013.05.002 · Cited by 89
“There is evidence that adoption of clinical guidelines has a positive impact on the quality and effectiveness of services and reduces inequalities regarding access to healthcare [1–10].”
BackgroundMethodTromp, M., Hulscher, M., Bleeker‐Rovers, C. P., Peters, L., van den Berg, D. T. N. A., Borm, G. F., Kullberg, B. J., van Achterberg, T., & Pickkers, P. (2010) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2010.04.007 · Cited by 125
“Substantial evidence suggests that successful implementation strategies should be based on obstacles and facilitators to change (Bero et al., 1998; Grimshaw et al., 2001; Grimshaw et al., 2004).”
BackgroundHuman factors in the management of the critically ill patient
Bion, J., Abrusci, T., & Hibbert, P. D. (2010) · British Journal of Anaesthesia · doi:10.1093/bja/aeq126 · Cited by 94
Using audit and feedback to health professionals to improve the quality and safety of health care
Flottorp, S. A., Jamtvedt, G., Gibis, B., & McKee, M. (2010) · Cited by 137
Rowe, S., Peters, D. H., Holloway, K., Chalker, J. C., Ross‐Degnan, D., & Rowe, A. K. (2019) · PLoS ONE · doi:10.1371/journal.pone.0217617 · Cited by 85
“The largest of these reviews [43] had few studies from LMICs.”
BackgroundIJsbrandy, C., Hermens, R., Boerboom, L. W. M., Gerritsen, W. R., van Harten, W. H., & Ottevanger, P. B. (2019) · Journal of Cancer Survivorship · doi:10.1007/s11764-019-00789-3 · Cited by 89
Cranney, A., Lam, M., Rühland, L., Brison, R., Godwin, M., Harrison, M., Harrison, M. B., Anastassiades, T., Grimshaw, J., & Graham, I. D. (2008) · Osteoporosis International · doi:10.1007/s00198-008-0669-0 · Cited by 82
“For example, reminder messages have resulted in improvements in practice with modest effect sizes of 10–20% [16, 17].”
Self-citationSteinman, M. A., Ranji, S. R., Shojania, K. G., & Gonzales, R. (2006) · Medical Care · doi:10.1097/01.mlr.0000215846.25591.22 · Cited by 76
“Nonetheless, the absence of a positive association between multifaceted versus more simple intervention strategies (ie, education plus feedback versus education alone) is consistent with other recent meta-analyses and reviews.(18,46,47) These findings suggest that where limited resources are available, enhancing the i…”
BackgroundResultWatkins, K., Wood, H. A., Schneider, C. R., & Clifford, R. M. (2015) · Implementation Science · doi:10.1186/s13012-015-0337-7 · Cited by 83
“Supporting the evidence of benefit for CDSS in the community pharmacy setting is the fact that reminders have improved outcomes in other settings [2, 25, 86].”
BackgroundResultInfluentialGoud, R., van Engen-Verheul, M. M., de Keizer, N. F., Bal, R. A., Hasman, A., Hellemans, I. M., & Peek, N. B. (2010) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2010.03.001 · Cited by 85
Goud, R., de Keizer, N. F., ter Riet, G., Wyatt, J. C., Hasman, A., Hellemans, I. M., & Peek, N. (2009) · BMJ · doi:10.1136/bmj.b1440 · Cited by 76
Haskell, L., Tavender, E. J., Wilson, C. L., O’Brien, S., Babl, F. E., Borland, M. L., Cotterell, E., Schembri, R., Orsini, F., Sheridan, N., et al. (2021) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/jamapediatrics.2021.0295 · Cited by 85
Fleming, A., Browne, J. P., & Byrne, S. (2013) · Drugs & Aging · doi:10.1007/s40266-013-0066-z · Cited by 81
“The provision of printed materials has been found to improve the processes of care [6].”
BackgroundBrusamento, S., Legido‐Quigley, H., Пантели, Д., Turk, E., Knai, C., Saliba, V., Car, J., McKee, M., & Busse, R. (2012) · Health Policy · doi:10.1016/j.healthpol.2012.08.005 · Cited by 81
“The authors concluded that multifaceted interventions were not more effective than single interventions and the effects of multifaceted interventions did not increase with the number of elements [6,42].”
BackgroundCarter, N. J., & Keating, G. M. (2010) · Drugs · doi:10.2165/11204560-000000000-00000 · Cited by 74
Saastad, E., Tveit, J. V. H., Flenady, V., Stray‐Pedersen, B., Fretts, R. C., Børdahl, P. E., & Frøen, J. F. (2010) · BMC Research Notes · doi:10.1186/1756-0500-3-2 · Cited by 78
“While the effect of printed educational materials as guidelines for health care providers is associated with some improvement in process of care [45], the addition of additional interventions such as outreach education and audit and feedback may enhance this effect [46].”
Implementing Best Practice Pain Management in a Pediatric Hospital
Ellis, J. A., McCleary, L., Blouin, R., Dubé, K., Rowley, B., MacNeil, M., & Cooke, C. (2007) · Journal for Specialists in Pediatric Nursing · doi:10.1111/j.1744-6155.2007.00121.x · Cited by 74
Engel, M. F., Postma, D. F., Hulscher, M., van Berkhout, F. T., Emmelot‐Vonk, M. H., Sankatsing, S. U. C., Gaillard, S., Bruns, A. H. W., Hoepelman, A. I. M., & Oosterheert, J. J. (2012) · European Respiratory Journal · doi:10.1183/09031936.00029412 · Cited by 74
Innovating to improve primary care in less developed countries: towards a global model
Fairall, L., Bateman, E., Cornick, R., Faris, G., Timmerman, V., Folb, N., Bachmann, M., Zwarenstein, M., & Smith, R. (2015) · BMJ Innovations · doi:10.1136/bmjinnov-2015-000045 · Cited by 72
Antimicrobial stewardship in the primary care setting: from dream to reality?
Avent, M. L., Cosgrove, S. E., Price‐Haywood, E. G., & van Driel, M. (2020) · BMC Family Practice · doi:10.1186/s12875-020-01191-0 · Cited by 86
“It is important to note that uptake of AMS interventions does not happen spontaneously; rather an active implementation approach over the long term is required [56].”
BackgroundPsychosocial health care needs assessment of adult cancer patients: a consensus-based guideline
Howell, D., Mayo, S. J., Currie, S., Jones, G. W., Boyle, M., Hack, T. F., Green, E., Hoffman, L., Collacutt, V., McLeod, D. L., et al. (2012) · Supportive Care in Cancer · doi:10.1007/s00520-012-1468-x · Cited by 84
“Clinical practice guidelines (1) Published since 2003[42] Focus limited to (1) individual physical symptoms (e.”
BackgroundSchouten, J. A., Hulscher, M. E. J. L., Trap-Liefers, J., Akkermans, R. P., Kullberg, B.-J., Grol, R. P. T. M., & van der Meer, J. W. M. (2007) · Clinical Infectious Diseases · doi:10.1086/512193 · Cited by 76
“In addition, the choice of intervention should be made on the basis of the assessment of potential barriers to performance change for the target group and context [14, 15].”
BackgroundDenneboom, W., Dautzenberg, M. G. H., Grol, R. P. T. M., & Smet, P. A. G. M. D. (2007) · PubMed · Cited by 73
Impact of the ALLHAT/JNC7 Dissemination Project on Thiazide-Type Diuretic Use
Stafford, R. S., Bartholomew, L. K., Cushman, W. C., Cutler, J. A., Davis, B. R., Dawson, G., Einhorn, P. T., Furberg, C. D., Piller, L. B., Pressel, S. L., et al. (2010) · Archives of Internal Medicine · doi:10.1001/archinternmed.2010.130 · Cited by 75
Antithrombotic and Thrombolytic Therapy: From Evidence to Application
Schünemann, H. J., Cook, D., Grimshaw, J., Liberati, A., Heffner, J. E., Tapson, V. F., & Guyatt, G. H. (2004) · CHEST Journal · doi:10.1378/chest.126.3_suppl.688s · Cited by 83
Self-citationStrategic opportunities for effective optimal prescribing and medication management.
SKETRIS, I. S., Ingram, E. L., & Lummis, H. L. (2009) · PubMed · Cited by 82
Jones, J., Wyse, R., Finch, M., Lecathelinais, C., Wiggers, J., Marshall, J., Falkiner, M., Pond, N., Yoong, S. L., Hollis, J., et al. (2015) · Implementation Science · doi:10.1186/s13012-015-0340-z · Cited by 72
Kastner, M., Estey, E., Perrier, L., Graham, I. D., Grimshaw, J., Straus, S. E., Zwarenstein, M., & Bhattacharyya, O. (2011) · Implementation Science · doi:10.1186/1748-5908-6-69 · Cited by 73
“A comprehensive review found that overall improvement in quality of care using extrinsic strategies was generally modest [7], and costs, when measured, were highly variable [7,8].”
BackgroundSelf-citationUnderstanding Work Contextual Factors: A Short‐Cut to Evidence‐Based Practice?
Wallin, L., Ewald, U., Wikblad, K., Scott‐Findlay, S., & Arnetz, B. B. (2006) · Worldviews on Evidence-Based Nursing · doi:10.1111/j.1741-6787.2006.00067.x · Cited by 72
A pragmatic cluster randomised trial evaluating three implementation interventions
Rycroft-Malone, J., Seers, K., Crichton, N., Chandler, J., Hawkes, C. A., Allen, C., Bullock, I., & Strunin, L. (2012) · Implementation Science · doi:10.1186/1748-5908-7-80 · Cited by 71
“Our findings suggest the effect size of the more active interventions compared to SD alone is small, thus supporting previous assertions that passive and simple interventions, may be as effective as active, and multi-faceted ones [10].”
BackgroundResultInfluentialHoomans, T., Evers, S. M. A. A., Ament, A. J. H. A., Hübben, M. W. A., van der Weijden, T., Grimshaw, J. M., & Severens, J. L. (2007) · Value in Health · doi:10.1111/j.1524-4733.2007.00175.x · Cited by 71
Self-citationChanging Behavior Using Social Cognitive Theory
Łuszczyńska, A., & Schwarzer, R. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108677318.003 · Cited by 104
Robertson, J., Walkom, E., Pearson, S., Hains, I., Williamson, M., & Newby, D. (2010) · International Journal of Pharmacy Practice · doi:10.1211/ijpp.18.02.0002 · Cited by 71
“However, there is conflicting evidence on whether behaviour change is more likely when interventions have multiple components (multi-faceted) compared with when they are implemented alone.([5,6]) Pharmacists play an important role in medication management.”
BackgroundGetting Started in Evidence-Based Practice for Childhood Speech-Language Disorders
Johnson, C. J. (2006) · American Journal of Speech-Language Pathology · doi:10.1044/1058-0360(2006/004 · Cited by 85
Family‐centred service: moving ideas into practice
Law, M., Teplicky, R., King, S., King, G. A., Kertoy, M. K., Moning, T., Rosenbaum, P., & Burke‐Gaffney, J. (2005) · Child Care Health and Development · doi:10.1111/j.1365-2214.2005.00568.x · Cited by 71
Barlow, G. D., Nathwani, D., Williams, F. L. R., Ogston, S., Winter, J. H., Jones, M., Slane, P. O., Myers, E. A., Sullivan, F., Stevens, N., et al. (2006) · Thorax · doi:10.1136/thx.2005.056689 · Cited by 72
Chandler, J., Rycroft‐Malone, J., Hawkes, C., & Noyes, J. (2016) · Journal of Advanced Nursing · doi:10.1111/jan.12815 · Cited by 70
Alford, D. P., Zisblatt, L., Ng, P., Hayes, S. M., Péloquin, S., Hardesty, I., & White, J. L. (2015) · Pain Medicine · doi:10.1111/pme.12878 · Cited by 94
A synthesis of implementation science frameworks and application to global health gaps
Dintrans, P. V., Bossert, T. J., Sherry, J., & Kruk, M. E. (2019) · Global Health Research and Policy · doi:10.1186/s41256-019-0115-1 · Cited by 82
Ricci‐Cabello, I., Vásquez-Mejía, A., Canelo‐Aybar, C., de Guzmán, E. N., Bracchiglione, J., Rabassa, M., Comas, D. R., Solà, I., Song, Y., Neamţiu, L., et al. (2020) · BMC Health Services Research · doi:10.1186/s12913-020-05753-x · Cited by 82
Heselmans, A., Van de Velde, S., Donceel, P., Aertgeerts, B., & Ramaekers, D. (2009) · Implementation Science · doi:10.1186/1748-5908-4-82 · Cited by 71
Implementation of Treatment Guidelines for Specialist Mental Health Care
Barbui, C., Girlanda, F., Ay, E., Cipriani, A., Becker, T. M., & Koesters, M. (2014) · Schizophrenia Bulletin · doi:10.1093/schbul/sbu065 · Cited by 74
Improving the use of research evidence in guideline development: 16. Evaluation
Oxman, A. D., Schünemann, H. J., & Fretheim, A. (2006) · Health Research Policy and Systems · doi:10.1186/1478-4505-4-28 · Cited by 70
“Strategies ranging from passive dissemination to intensive, complex interventions have been used to implement guidelines and a range of study designs has been used to evaluate the impact of these strategies using a range of outcome measures [18,19].”
BackgroundMethodHarting, J., Rutten, G. M., Rutten, S. T., & Kremers, S. (2009) · Physical Therapy · doi:10.2522/ptj.20080185 · Cited by 88
Can mass media campaigns change antimicrobial prescribing? A regional evaluation study
Lambert, M. F., Masters, G., & Brent, S. L. (2007) · Journal of Antimicrobial Chemotherapy · doi:10.1093/jac/dkl511 · Cited by 75
“Whilst we cannot assume equivalence of intensity of adjuvant or complementary interventions in the intervention and control group, merely counting the number of interventions used is unlikely to be a good predictor of the likely effects.(19) We did not isolate the effects of the mass media campaign from all other inte…”
BackgroundSchizophrenia guidelines across the world: A selective review and comparison
Gäebel, W., Riesbeck, M., & Wobrock, T. (2011) · International Review of Psychiatry · doi:10.3109/09540261.2011.606801 · Cited by 83
“…refers to the fact that besides development of evidence-based treatment guidelines at a high quality level, strategies for dissemination and implementation are likewise essential for quality improvement in practical healthcare (Grimshaw et al., 2004; Weinmann et al., 2006; Wobrock et al., 2009).”
BackgroundPark, J. S., Moore, J. E., Sayal, R., Holmes, B. J., Scarrow, G., Graham, I. D., Jeffs, L. P., Timmings, C., Rashid, S., Johnson, A. M., et al. (2018) · Implementation Science · doi:10.1186/s13012-018-0755-4 · Cited by 78
“Facilitation of social interaction [49, 54, 55] • The course included an online platform to stimulate discussion of participants’ projects and to promote social connectivity; participants were asked to share their learning materials with others through the online platform.”
BackgroundCase management of arthritis patients in primary care: A cluster‐randomized controlled trial
Rosemann, T., Joos, S., Laux, G., Gensichen, J., & Szecsenyi, J. (2007) · Arthritis Care & Research · doi:10.1002/art.23080 · Cited by 70
“However, implementing interventions in a primary care setting creates several problems (9,10).”
BackgroundCaring for families experiencing stillbirth: evidence-based guidance for maternity care providers
Peters, M. D. J., Lisy, K., Riitano, D., Jordan, Z., & Aromataris, E. (2015) · Women and Birth · doi:10.1016/j.wombi.2015.07.003 · Cited by 69
Guindon, G. E., Lavis, J. N., Becerra-Posada, F., Malekafzali, H., Shi, G., Yesudian, C. A. K., & Hoffman, S. J. (2010) · Canadian Medical Association Journal · doi:10.1503/cmaj.081165 · Cited by 80
“We looked specifically at networking activities between health care providers and researchers because interactions have been found to be associated with increased use of research-based evidence.(30,31) For missing values, we used multiple imputation, whereby each missing value was replaced by 10 different estimates.”
MethodGardner, B., Rebar, A. L., & Lally, P. J. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108677318.041 · Cited by 83
Cleland, J. A., Fritz, J. M., Brennan, G. P., & Magel, J. S. (2008) · Physical Therapy · doi:10.2522/ptj.20080033 · Cited by 74
Evidence-based nursing implementation in Mainland China: A scoping review
Cheng, L., Feng, S., & Hu, Y. (2016) · Nursing Outlook · doi:10.1016/j.outlook.2016.07.016 · Cited by 69
Bishay, K., Causada-Calo, N. S., Scaffidi, M. A., Walsh, C. M., Anderson, J., Rostom, A., Dube, C., Keswani, R. N., Heitman, S. J., Hilsden, R. J., et al. (2020) · Gastrointestinal Endoscopy · doi:10.1016/j.gie.2020.03.3865 · Cited by 68
Gibbons, R. J., & Araoz, P. A. (2004) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2004.08.050 · Cited by 68
Cheater, F. M., Baker, R., Reddish, S., Spiers, N., Wailoo, A., Gillies, C., Robertson, N., & Cawood, C. (2006) · Medical Care · doi:10.1097/01.mlr.0000215919.89893.8a · Cited by 67
Obstetrical brachial plexus injury (OBPI): Canada's national clinical practice guideline
Coroneos, C. J., Voineskos, S. H., Christakis, M. K., Thoma, A., Bain, J. R., & Brouwers, M. C. (2017) · BMJ Open · doi:10.1136/bmjopen-2016-014141 · Cited by 75
“97 98 There is insufficient evidence to support one guideline implementation strategy, or a cluster of strategies.(99) However, integrated knowledge translation (IKT) inter-”
BackgroundRutten, G. M., Harting, J., Bartholomew, L. K., Braspenning, J. C. C., van Dolder, R., Heijmans, M. F., Hendriks, E., Kremers, S., van Peppen, R. P., Rutten, S. T., et al. (2014) · Archives of Public Health · doi:10.1186/2049-3258-72-1 · Cited by 69
“Background Adherence to clinical practice guidelines (CPGs) is limited, and interventions to enhance uptake have been only moderately effective [1,2].”
BackgroundImplementation plans included in World Health Organisation guidelines
Wang, Z., Norris, S. L., & Bero, L. (2015) · Implementation Science · doi:10.1186/s13012-016-0440-4 · Cited by 65
“mation [8, 10].”
MethodMisso, M. L., Pitt, V. J., Jones, K., Barnes, H., Piterman, L., & Green, S. (2008) · The Medical Journal of Australia · doi:10.5694/j.1326-5377.2008.tb02086.x · Cited by 67
Barlow, G. D., Nathwani, D., Myers, E. A., Sullivan, F., Stevens, N., Duffy, R. M., & Davey, P. G. (2007) · Journal of Antimicrobial Chemotherapy · doi:10.1093/jac/dkm462 · Cited by 69
“although less than a quarter of evaluations include any preimplementation assessment of barriers to change.(9) In order to design our intervention, we identified barriers to the early delivery of appropriate antibiotics with two preimplementation surveys of junior and middle grade doctors.”
BackgroundFoy, R., Francis, J. J., Johnston, M., Eccles, M., Lecouturier, J., Bamford, C., & Grimshaw, J. (2007) · BMC Health Services Research · doi:10.1186/1472-6963-7-207 · Cited by 66
“Systematic reviews of implementation trials conducted to date have categorised interventions on an empirical basis with reviews of interventions such as audit and feedback, reminders, and outreach visiting [3].”
Self-citationDouglas, F., van Teijlingen, E., Torrance, N., Fearn, P., Kerr, A., & Meloni, S. (2006) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2006.03903.x · Cited by 92
Tobe, S. W., Stone, J. A., Brouwers, M. C., Bhattacharyya, O. K., Walker, K. M., Dawes, M. G., Genest, J. J., Grover, S. A., Gubitz, G. J., Lau, D. C. W., et al. (2011) · Canadian Medical Association Journal · doi:10.1503/cmaj.101508 · Cited by 79
“Intrinsic strategies, which guideline producers themselves can adopt, are inexpensive and can be incorporated into the development process.(44) The intrinsic strategies to be used by the C-CHANGE Initiative will in clude the use of a guideline implementability”
BackgroundStacey, D., Taljaard, M., Drake, E. R., & O'Connor, A. M. C. (2008) · Patient Education and Counseling · doi:10.1016/j.pec.2008.07.016 · Cited by 71
“Effective interventions to change health professionals’ practice include reminders, dissemination of educational materials, audit and feedback, and multiple interventions with educational outreach [12,13].”
Backgroundvan Gaal, B. G. I., Schoonhoven, L., Mintjes, J. A. J., Borm, G. F., Hulscher, M., Defloor, T., Habets, H., Voß, A., Vloet, L. C. M., Koopmans, R. T. C. M., et al. (2011) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2011.02.017 · Cited by 73
“There is no consistent evidence on the effectiveness of single versus multifaceted implementation strategies (Grimshaw et al., 2004; Hulscher et al., 1999).”
BackgroundVogel, J. P., Moore, J. E., Timmings, C., Khan, S., Khan, D. N., Defar, A., Hadush, A., Minwyelet Terefe, M., Teshome, L., Ba-Thike, K., et al. (2016) · PLOS ONE · doi:10.1371/journal.pone.0160020 · Cited by 68
“[30] Understanding that guideline development and dissemination activities are not enough to ensure changes in practices and outcomes, [14,15,29] the action cycle of the KTA model is designed to guide implementation planning in a variety of contexts (see Fig 1).”
BackgroundWhat Interventions Should Pharmacists Employ to Impact Health Practitioners’ Prescribing Practices?
Grindrod, K., Patel, P., & Martin, J. E. (2006) · Annals of Pharmacotherapy · doi:10.1345/aph.1g300 · Cited by 75
Toward the data-driven dissemination of findings from psychological science.
Purtle, J., Marzalik, J. S., Halfond, R. W., Bufka, L. F., Teachman, B. A., & Aarons, G. A. (2020) · American Psychologist · doi:10.1037/amp0000721 · Cited by 70
“…strategies are typically based on anecdote instead of evidence and are thus often ineffective at reaching practice audiences or meaningfully changing their awareness about, attitudes towards, or intentions to adopt an intervention or guideline (Grimshaw et al., 2004; McCormack et al., 2013).”
Advancing infection control in dental care settings
Cleveland, J. L., Foster, M., Barker, L. K., Brown, G. G., Lenfestey, N. F., Lux, L. J., Corley, T. J., & Bonito, A. J. (2012) · The Journal of the American Dental Association · doi:10.14219/jada.archive.2012.0044 · Cited by 66
Al‐Ansary, L. A., Tricco, A. C., Adi, Y., Bawazeer, G. A., Perrier, L., Alghonaim, M., Alyousefi, N. A., Tashkandi, M. F., & Straus, S. E. (2013) · PLoS ONE · doi:10.1371/journal.pone.0053744 · Cited by 73
“Of the CPGs used in 235 studies assessing the effectiveness and efficiency dissemination and implementation strategies, only 3% of guidelines used were based on good evidence [14].”
MethodA guide to the Canadian Medical Association Handbook on Clinical Practice Guidelines
Palda, V. A., Davis, D., & Goldman, J. (2007) · Canadian Medical Association Journal · doi:10.1503/cmaj.070880 · Cited by 91
Metadata
- Authors
- Grimshaw, J., Thomas, R., MacLennan, G., Fraser, C., Ramsay, C., Vale, L., Whitty, P., Eccles, M., Matowe, L., Shirran, L., Wensing, M., Dijkstra, R., & Donaldson, C.
- Affiliations
- University of Aberdeen (GB)
- Newcastle University (GB)
- Radboud University Nijmegen (NL)
- University of Calgary (CA)
- Venue
- Health Technology Assessment
- Published
- 2004-02
- Volume
- 8
- Issue
- 6
- Pages
- iii-iv, 1
- ISSN
- 1366-5278 (ISSN-L)
- 2046-4924
- OpenAlex
- W2038028146
- Cited by
- 3,044
- References
- 38
- Citations by year
- 2026: 45 · 2025: 45 · 2024: 72 · 2023: 65 · 2022: 69 · 2021: 100 · 2020: 163 · 2019: 87 · 2018: 112 · 2017: 129 · 2016: 133 · 2015: 184 · 2014: 188 · 2013: 288 · 2012: 167
- FWCI
- 20.52
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- Locations
- Health Technology Assessment (publishedVersion, other-oa)
- PubMed (publishedVersion)
- Radboud Repository (Radboud University) (submittedVersion, other-oa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Radboud Repository (Radboud University) (submittedVersion)
- Newcastle University ePrints (Newcastle Univesity)
- Funders
- Health Technology Assessment programme (94/08/29)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Keywords
- guideline dissemination, guideline implementation, guideline development, multicomponent intervention, educational outreach, reminders, audit and feedback, teaching materials, cost-effectiveness, resource requirements, clinical governance, primary care, secondary care, evidence-based recommendations, process indicators, healthcare quality improvement
- MeSH terms
- Cost-Benefit Analysis, United Kingdom, Medical Informatics, State Medicine, Practice Guidelines as Topic, Information Dissemination
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.