Effectiveness and efficiency of guideline dissemination and implementation strategies
Open accessThe DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Abstract
OBJECTIVES: To undertake a systematic review of the effectiveness and costs of different guideline development, dissemination and implementation strategies. To estimate the resource implications of these strategies. To develop a framework for deciding when it is efficient to develop and introduce clinical guidelines. DATA SOURCES: MEDLINE, Healthstar, Cochrane Controlled Trial Register, EMBASE, SIGLE and the specialised register of the Cochrane Effective Practice and Organisation of Care (EPOC) group. REVIEW METHODS: Single estimates of dichotomous process variables were derived for each study comparison based upon the primary end-point or the median measure across several reported end-points. Separate analyses were undertaken for comparisons of different types of intervention. The study also explored whether the effects of multifaceted interventions increased with the number of intervention components. Studies reporting economic data were also critically appraised. A survey to estimate the feasibility and likely resource requirements of guideline dissemination and implementation strategies in UK settings was carried out with key informants from primary and secondary care. RESULTS: In total, 235 studies reporting 309 comparisons met the inclusion criteria; of these 73% of comparisons evaluated multifaceted interventions, although the maximum number of replications of a specific multifaceted intervention was 11 comparisons. Overall, the majority of comparisons reporting dichotomous process data observed improvements in care; however, there was considerable variation in the observed effects both within and across interventions. Commonly evaluated single interventions were reminders, dissemination of educational materials, and audit and feedback. There were 23 comparisons of multifaceted interventions involving educational outreach. The majority of interventions observed modest to moderate improvements in care. No relationship was found between the number of component interventions and the effects of multifaceted interventions. Only 29.4% of comparisons reported any economic data. The majority of studies only reported costs of treatment; only 25 studies reported data on the costs of guideline development or guideline dissemination and implementation. The majority of studies used process measures for their primary end-point, despite the fact that only three guidelines were explicitly evidence based (and may not have been efficient). Respondents to the key informant survey rarely identified existing budgets to support guideline dissemination and implementation strategies. In general, the respondents thought that only dissemination of educational materials and short (lunchtime) educational meetings were generally feasible within current resources. CONCLUSIONS: There is an imperfect evidence base to support decisions about which guideline dissemination and implementation strategies are likely to be efficient under different circumstances. Decision makers need to use considerable judgement about how best to use the limited resources they have for clinical governance and related activities to maximise population benefits. They need to consider the potential clinical areas for clinical effectiveness activities, the likely benefits and costs required to introduce guidelines and the likely benefits and costs as a result of any changes in provider behaviour. Further research is required to: develop and validate a coherent theoretical framework of health professional and organisational behaviour and behaviour change to inform better the choice of interventions in research and service settings, and to estimate the efficiency of dissemination and implementation strategies in the presence of different barriers and effect modifiers.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, recent reviews (Farmer 2008; Grimshaw 2004) found that printed educational materials have a small (but potentially important) effect.”
From Audit and feedback: effects on professional practice and healthcare outcomes (2012) · cites this paper as Grimshaw 2004
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“while a systematic review of 235 implementation trials by Grimshaw et al. found no relationship between the number of component interventions and the effects of multifaceted interventions [100].”
From Writing implementation research grant proposals: ten key ingredients (2012) · cites this paper as [100]
The cited source says what the claim attributes to it.
In the citing paper
“It is important to note that the high frequency of educational interventions is not exclusive to the allied health professions, and a similar trend is seen in nursing [11] and in the guideline implementation literature, which is largely dominated by physicians [6].”
From Systematic review of knowledge translation strategies in the allied health professions (2012) · cites this paper as [6]
In the citing paper
“The empirical evidence for the effectiveness of multifaceted strategies has been mixed, because early research touted the benefits of multifaceted strategies [98,99], while a systematic review of 235 implementation trials by Grimshaw et al. found no relationship between the number of component interventions and the effects of multifaceted interventions [100].”
From Writing implementation research grant proposals: ten key ingredients (2012) · cites this paper as [100]
In the citing paper
“the bulk of the research evidence comes from the medical e.g., [4-9] and nursing literature e.g., [10,11].”
From Systematic review of knowledge translation strategies in the allied health professions (2012) · cites this paper as [6]
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2005) · Technometrics · doi:10.1198/tech.2005.s303 · Cited by 17,923
Methods for the Economic Evaluation of Health Care Programmes
Drummond, M. E., Sculpher, M. J., Torrance, G. W., O’Brien, B. J., & Stoddart, G. L. (2005) · doi:10.1093/oso/9780198529446.001.0001 · Cited by 13,648
(1979) · Medical Entomology and Zoology · Cited by 11,252
Quasi-experimentation: Design and analysis issues for field settings
Shrout, P. E. (1980) · Evaluation and Program Planning · doi:10.1016/0149-7189(80)90063-4 · Cited by 6,010
The cochrane database of systematic reviews
Geddes, J. (1996) · Journal of Psychosomatic Research · doi:10.1016/s0022-3999(96)90063-x · Cited by 5,989
Clinical guidelines: Potential benefits, limitations, and harms of clinical guidelines
Woolf, S. H., Grol, R., Hutchinson, A., Eccles, M., & Grimshaw, J. (1999) · BMJ · doi:10.1136/bmj.318.7182.527 · Cited by 2,548
Self-citationSystematic Reviews: Identifying relevant studies for systematic reviews
Dickersin, K., Scherer, R., & Lefebvre, C. (1994) · BMJ · doi:10.1136/bmj.309.6964.1286 · Cited by 2,256
Effectiveness and Efficiency: Random Reflections on Health Services
(1973) · Public Health · doi:10.1016/s0033-3506(73)80082-4 · Cited by 1,912
Guidelines for authors and peer reviewers of economic submissions to the BMJ
Drummond, M. F., & Jefferson, T. O. (1996) · BMJ · doi:10.1136/bmj.313.7052.275 · Cited by 1,827
Davis, D. A. (1995) · JAMA · doi:10.1001/jama.1995.03530090032018 · Cited by 1,763
Research works printed but not linked: 12
- [2]2. NHS Centre for Reviews and Dissemination. Getting evidence into practice. Effective Health Care 1999; 5 :1-16.
- [4]4. NHS Centre for Reviews and Dissemination and Nuffield Institute for Health. Implementing clinical guidelines. Can guidelines be used to improve clinical practice? Effective Health Care 1994; 1 :1-12.
- [9]9. Thomas L, Cullum N, McColl E, Rousseau N, Soutter J, Steen N. Clinical guidelines in nursing, midwifery and other professions allied to medicine (Cochrane Review). The Cochrane Library (Issue 1). Oxford: Update Software; 1999.
- [10]10. Bero L, Grilli R, Grimshaw JM, Mowatt G, Oxman A, Zwarenstein M. Cochrane Effective Practice and Organisation of Care Review Group (Cochrane Group Module). In Bero L, Grilli R, Grimshaw JM, Mowatt G, Oxman A, Zwarenstein M, editors. The Cochrane Library (Issue 3). Oxford: Update Software; 2001.
- [16]16. Bushman BJ. Vote counting methods in metaanalysis. In Cooper H, Hedges L, editors. The handbook of research synthesis. New York: Russell Sage Foundation; 1994; pp. 193-213.
- [17]17. Drummond M, O'Brien B, Stoddart G, Torrance GW. Methods of economic evaluation of health care programmes. Oxford: Oxford University Press; 1997.
- [18]18. McIntosh E. Economic evaluation of guideline implementation studies. In Makela M, Thorsen T, editors. Changing professional practice. Theory and practice of clinical guidelines implementation. Copenhagen: Danish Institute for Health Services Research and Development; 1999, pp. 77-98.
- [21]21. Jefferson TO, Demicheli V , Vale L. Methodological reviews of economic evaluations in health care. JAMA 2002; 287 :2809-12.
- [24]24. Mason J, Freemantle N, Nazereth I, Eccles M, Haines A, Drummond M. When is it cost effective - to change the behaviour of health professionals? JAMA 2001; 286 :2988-92.
- [27]27. Purves IN. PRODIGY: implementing clinical guidelines using computers. Br J Gen Pract 1998; 48 :1552-3.
- [34]34. Grol R. Beliefs and evidence in changing clinical practice. BMJ 1997; 315 :418-21.
- [36]36. Grimshaw JM, Eccles MP . Clinical practice guidelines. In Haines A, Silagy C, editors. Evidencebased practice in primary care. London: BMJ Publishing; 2001, pp. 120-34.
Cited by
Items 101–200 of 1,009
Infection control measures to limit the spread of Clostridium difficile
Vonberg, R.-P., Kuijper, E. J., Wilcox, M. H., Barbut, F., Tüll, P., Gastmeier, P., van den Broek, P. J., Colville, A., Coignard, B., Daha, T., et al. (2008) · Clinical Microbiology and Infection · doi:10.1111/j.1469-0691.2008.01992.x · Cited by 314
“IA 1a [156,157], 2b [172], 4 [86,174], 5 [128]”
Ploeg, J., Davies, B., Edwards, N., Gifford, W., & Miller, P. E. (2007) · Worldviews on Evidence-Based Nursing · doi:10.1111/j.1741-6787.2007.00106.x · Cited by 321
Sauro, K. M., Smith, C., Ibadin, S., Thomas, A., Ganshorn, H., Bakunda, L., Bajgain, B., Bisch, S. P., & Nelson, G. (2024) · JAMA Network Open · doi:10.1001/jamanetworkopen.2024.17310 · Cited by 269
Stone, S. P., Cooper, B. S., Kibbler, C. C., Cookson, B. D., Roberts, J. A., Medley, G. F., Duckworth, G., Lai, R., Ebrahim, S., Brown, E. M., et al. (2007) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(07)70082-8 · Cited by 310
“Moreover, any change in practice consumes resources that could have been used for other purposes and therefore has an opportunity cost.(22) Care should be taken when attributing the costs to ensure that the attribution is appropriate.”
BackgroundMeta-Analysis: Audit and Feedback Features Impact Effectiveness on Care Quality
Hysong, S. J. (2009) · Medical Care · doi:10.1097/mlr.0b013e3181893f6b · Cited by 306
Rycroft-Malone, J., Seers, K., Chandler, J., Hawkes, C. A., Crichton, N., Allen, C., Bullock, I., & Strunin, L. (2013) · Implementation Science · doi:10.1186/1748-5908-8-28 · Cited by 303
“Drawing on a variable evidence base about the relative effectiveness of implementation interventions [18-24], three trial interventions were developed and randomly allocated to 19 participating hospitals in England, Scotland, Wales, and Northern Ireland: standard dissemination, a web-based resource championed by an op…”
BackgroundMethodGlisson, C., Dukes, D., & Green, P. (2006) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2005.12.010 · Cited by 298
“Feedback about work team performance using valid outcome indicators is a key factor contributing to the successful adoption of new practices and other improvements by creating a “tension for change” (Burke, 1993; Green, 1998; Grimshaw et al., 2004; Merlani, Garnerin, Diby, Ferring, & Ricou, 2001; Meyer & Goes, 1988; P…”
BackgroundMethodQuality Improvement Strategies for Hypertension Management: A Systematic Review
Walsh, J. M. E., McDonald, K. M., Shojania, K. G., Sundaram, V., Nayak, S., Lewis, R., Owens, D. K., & Goldstein, M. K. (2006) · Medical Care · doi:10.1097/01.mlr.0000220260.30768.32 · Cited by 297
“strategy.(14) For example, we computed the median of net change in SBP for the QI strategy of provider education.”
MethodIntroduction to PRISMA 2020 and implications for research synthesis methodologists
Page, M. J., Moher, D., & McKenzie, J. E. (2022) · Research Synthesis Methods · doi:10.1002/jrsm.1535 · Cited by 270
Forsetlund, L., O'Brien, M. A., Forsén, L., Mwai, L., Reinar, L. M., Okwen, M. P., Horsley, T., & Rose, C. J. (2021) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003030.pub3 · Cited by 268
Systematic reviews of the effectiveness of quality improvement strategies and programmes
Grimshaw, J. (2003) · Quality and Safety in Health Care · doi:10.1136/qhc.12.4.298 · Cited by 292
“for studies within its scope, and has searched Medline, EMBASE, Cinahl and SIGLE retrospectively and prospectively.”
BackgroundSelf-citationUse of evidence in WHO recommendations
Oxman, A. D., Lavis, J. N., & Fretheim, A. (2007) · The Lancet · doi:10.1016/s0140-6736(07)60675-8 · Cited by 287
Foster, N. E., Mullis, R., Hill, J. C., Lewis, M., Whitehurst, D. G. T., Doyle, C., Konstantinou, K., Main, C., Somerville, S., Sowden, G., et al. (2014) · The Annals of Family Medicine · doi:10.1370/afm.1625 · Cited by 284
“39 Neutral 23 (10) 41 (13) Not satisfied 44 (19) 52 (17) Satisfaction with results of care, No.”
Using realist evaluation to open the black box of knowledge translation: a state-of-the-art review
Salter, K. L., & Kothari, A. (2014) · Implementation Science · doi:10.1186/s13012-014-0115-y · Cited by 279
“Early reviews of knowledge translation interventions focused on aggregate assessments of effectiveness, often defined as ‘improvements in care’ or ‘performance’ [47].”
BackgroundDhaliwal, R., Cahill, N., Lemieux, M., & Heyland, D. K. (2014) · Nutrition in Clinical Practice · doi:10.1177/0884533613510948 · Cited by 282
De-implementing wisely: developing the evidence base to reduce low-value care
Grimshaw, J. M., Patey, A. M., Kirkham, K. R., Hall, A., Dowling, S. K., Rodondi, N., Ellen, M., Kool, T., van Dulmen, S. A., Kerr, E. A., et al. (2020) · BMJ Quality & Safety · doi:10.1136/bmjqs-2019-010060 · Cited by 279
Self-citationInfluence of Organizational Characteristics and Context on Research Utilization
Cummings, G. G., Estabrooks, C. A., Midodzi, W. K., Wallin, L., & Hayduk, L. (2007) · Nursing Research · doi:10.1097/01.nnr.0000280629.63654.95 · Cited by 277
“The most recent systematic review of guideline implementation, where only 10% of included studies provided an explicit theoretical rationale for the intervention being evaluated (Grimshaw et al., 2004), supports claims that investigators use too little theory in this field.”
BackgroundInterventions for preventing delirium in hospitalised patients
Siddiqi, N., Holt, R., Britton, A. M., & Holmes, J. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005563.pub2 · Cited by 280
Tailoring quality improvement interventions to identified barriers: a multiple case analysis
Bosch, M., Van Der Weijden, T., Wensing, M., & Grol, R. (2007) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2006.00660.x · Cited by 272
Self-citationThou shalt versus thou shalt not: a meta-synthesis of GPs' attitudes to clinical practice guidelines
Carlsen, B., Glenton, C., & Pope, C. (2007) · British Journal of General Practice · doi:10.3399/096016407782604820 · Cited by 278
“While there have been several qualitative studies exploring GPs’ attitudes towards guidelines, there has been no attempt to review and synthesise their findings systematically.(1) Methods for systematically reviewing quantitative research are well established, but comparable methods for synthesising the findings of qu…”
BackgroundA systematic review of hand hygiene improvement strategies: a behavioural approach
Huis, A., van Achterberg, T., de Bruin, M., Grol, R., Schoonhoven, L., & Hulscher, M. (2012) · Implementation Science · doi:10.1186/1748-5908-7-92 · Cited by 267
“Improving HH compliance implies behaviour change; therefore, application of knowledge from the behavioural and social sciences appears valuable [23-25].”
Changing Behavior Using the Theory of Planned Behavior
Ajzen, I., & Schmidt, P. (2020) · The Handbook of Behavior Change · doi:10.1017/9781108677318.002 · Cited by 266
McArthur, C., Bai, Y., Hewston, P., Giangregorio, L., Straus, S., & Papaioannou, A. (2021) · Implementation Science · doi:10.1186/s13012-021-01140-0 · Cited by 260
“Guideline implementation into routine healthcare can be unpredictable, and trial-and-error approaches have been costly and ineffective, producing variable results of guideline dissemination and implementation [4, 5].”
BackgroundGetting a clinical innovation into practice: An introduction to implementation strategies
Kirchner, J. E., Smith, J. L., Powell, B. J., Waltz, T. J., & Proctor, E. K. (2020) · Psychiatry Research · doi:10.1016/j.psychres.2019.06.042 · Cited by 258
Evidence‐Based Strategies for Reducing Cesarean Section Rates: A Meta‐Analysis
Chaillet, N., & Dumont, A. (2007) · Birth · doi:10.1111/j.1523-536x.2006.00146.x · Cited by 263
Local opinion leaders: effects on professional practice and healthcare outcomes
Flodgren, G., O'Brien, M. A., Parmelli, E., & Grimshaw, J. M. (2019) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000125.pub5 · Cited by 259
Self-citationSlade, S. C., Kent, P., Patel, S., Bucknall, T., & Buchbinder, R. (2016) · The Clinical Journal of Pain · doi:10.1097/ajp.0000000000000324 · Cited by 261
Sivera, F., Andrés, M., Carmona, L., Kydd, A. S. R., Moi, J., Seth, R., Sriranganathan, M., van Durme, C., van Echteld, I., Vinik, O., et al. (2014) · Annals of the Rheumatic Diseases · doi:10.1136/annrheumdis-2013-203325 · Cited by 262
Menon, A., Korner-Bitensky, N., Kastner, M., McKibbon, K., & Straus, S. (2009) · Journal of Rehabilitation Medicine · doi:10.2340/16501977-0451 · Cited by 260
Improving the Use of Research Evidence in Guideline Development
Oxman, A. D., Schünemann, H. J., Fretheim, A., Boyd, E. A., Bero, L. A., & Edejer, T. T.-T. (2007) · BIBSYS Brage (BIBSYS (Norway)) · Cited by 261
Pantoja, T., Opiyo, N., Lewin, S., Paulsen, E., Ciapponi, A., Wiysonge, C. S., Herrera, C. A., Rada, G., Peñaloza, B., Dudley, L., et al. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011086.pub2 · Cited by 252
Tilson, J. K., Kaplan, S. L., Harris, J. L., Hutchinson, A., Ilic, D., Niederman, R., Potomkova, J., & Zwolsman, S. E. (2011) · BMC Medical Education · doi:10.1186/1472-6920-11-78 · Cited by 259
“• Research based treatments/interventions are not clinically relevant When assessing attitudes about EBP, it is important to remember that attitudes are hypothesized to be modified by the assessment process [20].”
BackgroundInfluentialAabakken, L., Karlsen, T., Albert, J., Arvanitakis, M., Chazouilleres, O., Dumonceau, J.-M., Färkkilä, M., Fickert, P., Hirschfield, G., Laghi, A., et al. (2017) · Endoscopy · doi:10.1055/s-0043-107029 · Cited by 255
Imamura, M., Abrams, P., Bain, C., Buckley, B., Cardozo, L., Cody, J., Cook, J., Eustice, S., Glazener, C., Grant, A., et al. (2010) · Health Technology Assessment · doi:10.3310/hta14400 · Cited by 254
Self-citationLau, R., Stevenson, F., Ong, B. N., Dziedzic, K., Treweek, S., Eldridge, S., Everitt, H., Kennedy, A., Qureshi, N., Rogers, A., et al. (2015) · BMJ Open · doi:10.1136/bmjopen-2015-009993 · Cited by 254
Garg, A. X., Adhikari, N. K. J., McDonald, H., Rosas-Arellano, M. P., Devereaux, P. J., Beyene, J., Sam, J., & Haynes, R. B. (2007) · Cited by 253
EUS vs MRCP for detection of choledocholithiasis
Verma, D., Kapadia, A., Eisen, G. M., & Adler, D. G. (2006) · Gastrointestinal Endoscopy · doi:10.1016/j.gie.2005.12.038 · Cited by 254
Foy, R., Eccles, M., Jamtvedt, G., Young, J., Grimshaw, J., & Baker, R. (2005) · BMC Health Services Research · doi:10.1186/1472-6963-5-50 · Cited by 250
“For each of these strategies a number of trials of their effectiveness have been drawn together within systematic reviews.[1,2] By examining interventions in a range of Published: 13 July 2005”
BackgroundSelf-citationPrinted educational materials: effects on professional practice and health care outcomes
Farmer, A. P., Légaré, F., Turcot, L., Grimshaw, J., Harvey, E., McGowan, J., & Wolf, F. M. (2008) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004398.pub2 · Cited by 249
Self-citationWensing, M., Wollersheim, H., & Grol, R. (2006) · Implementation Science · doi:10.1186/1748-5908-1-2 · Cited by 246
“These strategies appear to achieve a median of 10% absolute change of professional performance and no strategy is uniquely and consistently effective [3].”
Self-citationInterventions to improve antibiotic prescribing practices for hospital inpatients
Davey, P., Brown, E., Fenelon, L., Finch, R., Gould, I., Hartman, G., Holmes, A., Ramsay, C., Taylor, E., Wilcox, M., et al. (2005) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003543.pub2 · Cited by 248
Self-citationKarnon, J., Stahl, J., Brennan, A., Caro, J. J., Mar, J., & Möller, J. (2012) · Value in Health · doi:10.1016/j.jval.2012.04.013 · Cited by 240
Guidance for updating clinical practice guidelines: a systematic review of methodological handbooks
Vernooij, R. W., Sanabria, A. J., Solà, I., Alonso-Coello, P., & Martínez García, L. (2014) · Implementation Science · doi:10.1186/1748-5908-9-3 · Cited by 225
“If adequately implemented, CPGs have the potential of reducing variability and translating scientific research into clinical practice and consequently improve the quality and safety of healthcare [2-4].”
BackgroundContinuing Medical Education Effect on Clinical Outcomes
Mazmanian, P. E., Davis, D. A., & Galbraith, R. (2009) · Chest · doi:10.1378/chest.08-2518 · Cited by 239
Evidence-Based Strategies for Implementing Guidelines in Obstetrics: A Systematic Review
Chaillet, N., Dubé, E., Dugas, M., Audibert, F., Tourigny, C., Fraser, W. D., & Dumont, A. (2006) · Obstetrics & Gynecology · doi:10.1097/01.aog.0000236434.74160.8b · Cited by 233
Appraisal Tools for Clinical Practice Guidelines: A Systematic Review
Siering, U., Eikermann, M., Hausner, E., Hoffmann-Eßer, W., & Neugebauer, E. A. (2013) · PLoS ONE · doi:10.1371/journal.pone.0082915 · Cited by 233
“%) of the 235 studies included in their review reported improvements in health care [6,7].”
BackgroundFrancis, J. J., Stockton, C., Eccles, M. P., Johnston, M., Cuthbertson, B. H., Grimshaw, J. M., Hyde, C., Tinmouth, A., & Stanworth, S. J. (2009) · British Journal of Health Psychology · doi:10.1348/135910708x397025 · Cited by 230
Self-citationRanji, S. R., Steinman, M. A., Shojania, K. G., & Gonzales, R. (2008) · Medical Care · doi:10.1097/mlr.0b013e318178eabd · Cited by 230
Trends in guideline implementation: a scoping systematic review
and the members of the Guidelines International Network Implementation Working Group, Gagliardi, A. R., & Alhabib, S. (2015) · Implementation Science · doi:10.1186/s13012-015-0247-8 · Cited by 229
“Other systematic reviews of guideline implementation included a larger number of studies but spanned many more years and healthcare diseases or issues [13,60].”
BackgroundInfluentialGustafsson, L. L., Wettermark, B., Godman, B., Andersén‐Karlsson, E., Bergman, U., Hasselström, J., Hensjö, L., Hjemdahl, P., Jägre, I., Julander, M., et al. (2011) · Basic & Clinical Pharmacology & Toxicology · doi:10.1111/j.1742-7843.2011.00682.x · Cited by 224
Bayliss, E. A., Bonds, D. E., Boyd, C. M., Davis, M. M., Finke, B., Fox, M. H., Glasgow, R. E., Goodman, R. A., Heurtin-Roberts, S., Lachenmayr, S., et al. (2014) · The Annals of Family Medicine · doi:10.1370/afm.1643 · Cited by 225
Evidence-based practice: attitudes, knowledge and behaviour among allied health care professionals
Heiwe, S., Kajermo, K. N., Tyni-Lenne, R., Guidetti, S., Samuelsson, M., Andersson, I.-L., & Wengstrom, Y. (2011) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzq083 · Cited by 227
“Factors influencing effective implementation of evidencebased guidelines remain poorly understood [5, 6]; it is a complex process where factors and characteristics at both contextual (social, organizational, economic and political) and individual (both care-giver and -taker) levels play an active role [7–9].”
BackgroundMethodWilkinson, S., Thomas, S., Phillips, C. J., Marshall, A. P., Chaves, N. J., Jankelowitz, S. K., Lin, I., Loy, C. T., Rees, G., Sakzewski, L., et al. (2015) · Journal of Multidisciplinary Healthcare · doi:10.2147/jmdh.s78458 · Cited by 223
“Attempts at implementing evidence-based interventions that are tailored to the particular context have yielded mixed results.(3) A number of factors can influence the uptake of an evidence-based intervention, and the success of implementation efforts depends on a careful assessment of barriers to and enablers of the b…”
Schizophrenia practice guidelines: International survey and comparison
Gaebel, W., Weinmann, S., Sartorius, N., Rutz, W., & McIntyre, J. S. (2005) · British Journal of Psychiatry · doi:10.1192/bjp.187.3.248 · Cited by 227
Douglas, F., Torrance, N., van Teijlingen, E., Meloni, S., & Kerr, A. (2006) · BMC Public Health · doi:10.1186/1471-2458-6-138 · Cited by 221
“However, the lack of use or adherence to clinical guidelines amongst GPs remains a challenge [27].”
Guideline implementation in allied health professions: a systematic review of the literature
Hakkennes, S., & Dodd, K. (2008) · Quality and Safety in Health Care · doi:10.1136/qshc.2007.023804 · Cited by 218
Chan, W. V., Pearson, T. A., Bennett, G. C., Cushman, W. C., Gaziano, T. A., Gorman, P. N., Handler, J., Krumholz, H. M., Kushner, R. F., MacKenzie, T. D., et al. (2017) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2016.11.004 · Cited by 222
“Educational Outreach Visits Good (9,21,28,29) Fair (10,12,23,25,30–33) Fair (11) N/A Good (9) Fair (12,25,33) Fair (10) Good (28)”
InfluentialNursing Implementation Science: How Evidence‐Based Nursing Requires Evidence‐Based Implementation
Van Achterberg, T., Schoonhoven, L., & Grol, R. (2008) · Journal of Nursing Scholarship · doi:10.1111/j.1547-5069.2008.00243.x · Cited by 217
“Reviews by Grol and Grimshaw (2003) and Grimshaw and Eccles (2004) provide overviews of evidence regarding implementation strategies.”
BackgroundPhysical interventions to interrupt or reduce the spread of respiratory viruses
Jefferson, T., Del Mar, C., Dooley, L., Ferroni, E., Al-Ansary, L. A., Bawazeer, G. A., van Driel, M. L., Nair, S., Foxlee, R., & Rivetti, A. (2010) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006207.pub3 · Cited by 212
Is evidence‐based implementation of evidence‐based care possible?
Grimshaw, J. M., & Eccles, M. P. (2004) · Medical Journal of Australia · doi:10.5694/j.1326-5377.2004.tb05945.x · Cited by 216
“5,6 We have recently completed a systematic review of 235 rigorous evaluations of different guideline dissemination and implementation strategies published up to 1998.(7) The good news is that our review suggests that it is possible to change healthcare provider behaviour.”
BackgroundSelf-citationKnowledge brokering: Exploring the process of transferring knowledge into action
Ward, V. L., House, A. O., & Hamer, S. (2009) · BMC Health Services Research · doi:10.1186/1472-6963-9-12 · Cited by 214
“These include characteristics of the research such as rigour and credibility, characteristics of the organisation such as size and innovativeness and characteristics of the intervention such as timing and intensity [11-13].”
Carlbom, D. J., & Rubenfeld, G. D. (2007) · Critical Care Medicine · doi:10.1097/01.ccm.0000298122.49245.d7 · Cited by 215
“An understanding of the barriers to changing practices in the intensive care unit is essential to developing effective interventions to change practices (26, 27).”
BackgroundFoy, R., Hempel, S., Rubenstein, L., Suttorp, M., Seelig, M., Shanman, R., & Shekelle, P. G. (2010) · Annals of Internal Medicine · doi:10.7326/0003-4819-152-4-201002160-00010 · Cited by 214
“Our review adds to a growing evidence base that informs key elements of integrated care, such as the use of health information technology to promote the quality and safety of care (74) and interventions to support clinical decision making (75).”
BackgroundThe need for systems change: reflections on knowledge translation and organizational change
Kitson, A. L. (2009) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2008.04864.x · Cited by 214
Spencer, K., Carr, A., & Doherty, M. (2012) · Annals of the Rheumatic Diseases · doi:10.1136/annrheumdis-2011-200801 · Cited by 211
Effects of policy options for human resources for health: an analysis of systematic reviews
Chopra, M., Munro, S., Lavis, J. N., Vist, G., & Bennett, S. (2008) · The Lancet · doi:10.1016/s0140-6736(08)60305-0 · Cited by 214
From Knowledge Translation to Engaged Scholarship: Promoting Research Relevance and Utilization
Bowen, S. J., & Graham, I. D. (2013) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2012.04.037 · Cited by 208
“In spite of increasing attention to the importance of using research to address major health issues, efforts to date have resulted in limited impact, even in the clinical area.(18) Implementation of CPGs is perhaps the most common example of the knowledge transfer paradigm.”
BackgroundInterventions aimed at increasing research use in nursing: a systematic review
Thompson, D. S., Estabrooks, C. A., Scott-Findlay, S., Moore, K., & Wallin, L. (2007) · Implementation Science · doi:10.1186/1748-5908-2-15 · Cited by 205
PPAR-γ agonist attenuates renal interstitial fibrosis and inflammation through reduction of TGF-β
Kawai, T., Masaki, T., Doi, S., Arakawa, T., Yokoyama, Y., Doi, T., Kohno, N., & Yorioka, N. (2009) · Laboratory Investigation · doi:10.1038/labinvest.2008.104 · Cited by 203
Moving knowledge to action through dissemination and exchange
Gagnon, M. L. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.08.013 · Cited by 208
“In the health services and clinical realms, such evidence might include systematic reviews that examine the effectiveness and efficiency of dissemination strategies targeted at health professionals [23,24].”
BackgroundDeveloping and selecting interventions for translating knowledge to action
Wensing, M., Bosch, M., & Grol, R. (2010) · Canadian Medical Association Journal · doi:10.1503/cmaj.081233 · Cited by 207
“A review of all of the evidence on developing and selecting interventions is beyond the scope of this paper; instead we will summarize available systematic reviews.(7,8) Many interventions for knowledge translation have not been well evaluated with rigorous studies.”
BackgroundInfluentialSelf-citationDECIDE Consortium, Treweek, S., Oxman, A. D., Alderson, P., Bossuyt, P. M., Brandt, L., Brożek, J., Davoli, M., Flottorp, S., Harbour, R., et al. (2013) · Implementation Science · doi:10.1186/1748-5908-8-6 · Cited by 201
Boivin, A., Currie, K., Fervers, B., Gracia, J., James, M., Marshall, C., Sakala, C., Sanger, S., Strid, J., Thomas, V., et al. (2010) · BMJ Quality & Safety · doi:10.1136/qshc.2009.034835 · Cited by 201
“INTRODUCTION Clinical practice guidelines (CPGs) are important tools for improving patient care.(1) 2 Many national organisations and experts recommend involving patients, consumers and the public in CPG development and implementation.”
BackgroundReframing Evidence Synthesis As Rhetorical Action in the Policy Making Drama
Greenhalgh, T., & Russell, J. (2006) · Healthcare Policy | Politiques de Santé · doi:10.12927/hcpol.2006.17873 · Cited by 198
“Jeremy Grimshaw, who heads the Cochrane Collaboration’s Effective Practice and Organization of Care Group, has recently lamented that despite 30 years’ research, we still lack a generalizable evidence base to inform management and policy making (Grimshaw et al. 2004), but his proposed solution – that we should do more…”
BackgroundLewin, S., Lavis, J. N., Oxman, A. D., Bastías, G., Chopra, M., Ciapponi, A., Flottorp, S., Martí, S. G., Pantoja, T., Rada, G., et al. (2008) · The Lancet · doi:10.1016/s0140-6736(08)61403-8 · Cited by 197
The advantages and limitations of guideline adaptation frameworks
Wang, Z., Norris, S. L., & Bero, L. (2018) · Implementation Science · doi:10.1186/s13012-018-0763-4 · Cited by 193
Quality Improvement: Theory and Practice in Healthcare
Boaden, R., Harvey, G., Moxham, C., & Proudlove, N. C. (2008) · Research Explorer (The University of Manchester) · Cited by 238
Pearson, S.-A., Moxey, A., Robertson, J., Hains, I., Williamson, M., Reeve, J., & Newby, D. (2009) · BMC Health Services Research · doi:10.1186/1472-6963-9-154 · Cited by 193
“However, in a review of more than 200 studies assessing the effectiveness of guideline implementation strategies, Grimshaw and colleagues [75] found multi-faceted interventions did not appear to be more effective than single strategy interventions but emphasised the difficultly in drawing generalisable conclusions abo…”
BackgroundStacey, D., Murray, M. A., Légaré, F., Sandy, D., Menard, P., & O'Connor, A. (2008) · Worldviews on Evidence-Based Nursing · doi:10.1111/j.1741-6787.2007.00108.x · Cited by 192
Bayley, M. T., Hurdowar, A., Richards, C. L., Korner-Bitensky, N., Wood-Dauphinee, S., Eng, J. J., McKay-Lyons, M., Harrison, E., Teasell, R., Harrison, M., et al. (2012) · Disability and Rehabilitation · doi:10.3109/09638288.2012.656790 · Cited by 194
Framework for Patient Safety Research and Improvement
Pronovost, P. J., Goeschel, C. A., Marsteller, J. A., Sexton, J. B., Pham, J. C., & Berenholtz, S. M. (2009) · Circulation · doi:10.1161/circulationaha.107.729848 · Cited by 190
van der Velden, A. W., Pijpers, E. J., Kuyvenhoven, M. M., Tonkin-Crine, S. K., Little, P., & Verheij, T. J. (2012) · British Journal of General Practice · doi:10.3399/bjgp12x659268 · Cited by 192
Psychosocial Influences on Low Back Pain, Disability, and Response to Treatment
Hill, J. C., & Fritz, J. M. (2011) · Physical Therapy · doi:10.2522/ptj.20100280 · Cited by 191
A Behavioral Intervention to Improve Obstetrical Care
Althabe, F., Buekens, P., Bergel, E., Belizán, J. M., Campbell, M. K., Moss, N., Hartwell, T., & Wright, L. L. (2008) · New England Journal of Medicine · doi:10.1056/nejmsa071456 · Cited by 190
Strategies for promoting organizational and practice change by advancing implementation research
Rubenstein, L. V., & Pugh, J. (2006) · Journal of General Internal Medicine · doi:10.1007/s11606-006-0276-8 · Cited by 190
“Identifying and assessing progression along these dimensions can enable research funders to identify unneeded, repetitive studies of the same techniques as well as continuing gaps in our knowledge base that need research.(9,14) Pursuing active progression along these dimensions will ultimately foster better policy dev…”
BackgroundFowler, S., Webber, A., Cooper, B. S., Phimister, A., Price, K., Carter, Y., Kibbler, C. C., Simpson, A. J. H., & Stone, S. P. (2007) · Journal of Antimicrobial Chemotherapy · doi:10.1093/jac/dkm014 · Cited by 190
Rashidian, A., Eccles, M. P., & Russell, I. (2008) · Health Policy · doi:10.1016/j.healthpol.2007.07.011 · Cited by 184
Self-citationLégaré, F., O'Connor, A. M., Graham, I. D., Wells, G. A., & Tremblay, S. (2006) · Medical Decision Making · doi:10.1177/0272989x06290492 · Cited by 184
“This is in line with reports from other authors regarding the difficulty of training physicians in the context of a research project(70,71) and the limited resources available for translating research evidence into practice.(72) This is why we added other components to the implementation process, such as feedback and…”
ResultHorbar, J. D., Carpenter, J. H., Buzas, J., Soll, R. F., Suresh, G., Bracken, M. B., Leviton, L. C., Plsek, P. E., & Sinclair, J. C. (2004) · BMJ · doi:10.1136/bmj.329.7473.1004 · Cited by 187
Home care across Europe : current structure and future challenges
Genêt, N., Boerma, W. G. W., Kroneman, M. W., Hutchinson, A., & Saltman, R. B. (2012) · Data Archiving and Networked Services (DANS) · Cited by 322
Bussières, A. E., Stewart, G., Al-Zoubi, F., Decina, P., Descarreaux, M., Hayden, J., Hendrickson, B., Hincapié, C., Pagé, I., Passmore, S., et al. (2016) · Journal of Manipulative and Physiological Therapeutics · doi:10.1016/j.jmpt.2016.08.007 · Cited by 183
Cheater, F., Baker, R., Gillies, C., Hearnshaw, H., Flottorp, S., Robertson, N., Shaw, E. J., & Oxman, A. D. (2005) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005470 · Cited by 175
Economic evaluation of implementation strategies in health care
Hoomans, T., & Severens, J. L. (2014) · Implementation Science · doi:10.1186/s13012-014-0168-y · Cited by 181
“egies for implementing clinical practice guidance before 2008 [2,6,7], with no substantial progress since then.”
BackgroundMethodHolopainen, R., Simpson, P., Piirainen, A., Karppinen, J., Schütze, R., Smith, A., O'Sullivan, P., & Kent, P. (2020) · Pain · doi:10.1097/j.pain.0000000000001809 · Cited by 180
“Despite this, most interventions to improve health care, including those reported by the studies included in this review, are targeted at the skills and knowledge of individual professionals.(25) However, the training itself is not individualized, although physiotherapists come from different backgrounds, with differe…”
BackgroundBehavior change techniques used to promote walking and cycling: A systematic review.
Bird, E. L., iConnect Consortium, Baker, G., Mutrie, N., Ogilvie, D., Sahlqvist, S., & Powell, J. (2013) · Health Psychology · doi:10.1037/a0032078 · Cited by 178
“…differences in study design and methodological quality (such as varying outcome measures and evaluation criteria or lack of controlled comparisons) as well as to differences in intervention content and program theory such as the cognitive and behavioral techniques reported (Grimshaw et al., 2004).”
Designing and implementing behaviour change interventions to improve population health
Michie, S. (2008) · Journal of Health Services Research & Policy · doi:10.1258/jhsrp.2008.008014 · Cited by 182
Das, J. K., Kumar, R., Salam, R. A., Lassi, Z. S., & Bhutta, Z. A. (2014) · Reproductive Health · doi:10.1186/1742-4755-11-s2-s4 · Cited by 173
“The effects of attempts to translate research evidence into practice and improve performance for these interventions remain inconsistent [18,19].”
Integrated knowledge translation
Bowen, S., & Graham, I. D. (2013) · Knowledge Translation in Health Care · doi:10.1002/9781118413555.ch02 · Cited by 170
Kringos, D. S., Sunol, R., Wagner, C., Mannion, R., Michel, P., Klazinga, N. S., Groene, O., & on behalf of the DUQuE Consortium (2015) · BMC Health Services Research · doi:10.1186/s12913-015-0906-0 · Cited by 175
Ament, S. M. C., de Groot, J. J. A., Maessen, J. M. C., Dirksen, C. D., van der Weijden, T., & Kleijnen, J. (2015) · BMJ Open · doi:10.1136/bmjopen-2015-008073 · Cited by 177
“spontaneously and often an active implementation approach is required.(3) Moreover, once a guideline is successfully implemented in practice, it may be difficult to sustain the quality improvements over a longer period of time.”
Background
Metadata
- Authors
- Grimshaw, J., Thomas, R., MacLennan, G., Fraser, C., Ramsay, C., Vale, L., Whitty, P., Eccles, M., Matowe, L., Shirran, L., Wensing, M., Dijkstra, R., & Donaldson, C.
- Affiliations
- University of Aberdeen (GB)
- Newcastle University (GB)
- Radboud University Nijmegen (NL)
- University of Calgary (CA)
- Venue
- Health Technology Assessment
- Published
- 2004-02
- Volume
- 8
- Issue
- 6
- Pages
- iii-iv, 1
- ISSN
- 1366-5278 (ISSN-L)
- 2046-4924
- OpenAlex
- W2038028146
- Cited by
- 3,044
- References
- 38
- Citations by year
- 2026: 45 · 2025: 45 · 2024: 72 · 2023: 65 · 2022: 69 · 2021: 100 · 2020: 163 · 2019: 87 · 2018: 112 · 2017: 129 · 2016: 133 · 2015: 184 · 2014: 188 · 2013: 288 · 2012: 167
- FWCI
- 20.52
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- Locations
- Health Technology Assessment (publishedVersion, other-oa)
- PubMed (publishedVersion)
- Radboud Repository (Radboud University) (submittedVersion, other-oa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Radboud Repository (Radboud University) (submittedVersion)
- Newcastle University ePrints (Newcastle Univesity)
- Funders
- Health Technology Assessment programme (94/08/29)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Keywords
- guideline dissemination, guideline implementation, guideline development, multicomponent intervention, educational outreach, reminders, audit and feedback, teaching materials, cost-effectiveness, resource requirements, clinical governance, primary care, secondary care, evidence-based recommendations, process indicators, healthcare quality improvement
- MeSH terms
- Cost-Benefit Analysis, United Kingdom, Medical Informatics, State Medicine, Practice Guidelines as Topic, Information Dissemination
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.