Effectiveness and efficiency of guideline dissemination and implementation strategies
Open accessThe DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Abstract
OBJECTIVES: To undertake a systematic review of the effectiveness and costs of different guideline development, dissemination and implementation strategies. To estimate the resource implications of these strategies. To develop a framework for deciding when it is efficient to develop and introduce clinical guidelines. DATA SOURCES: MEDLINE, Healthstar, Cochrane Controlled Trial Register, EMBASE, SIGLE and the specialised register of the Cochrane Effective Practice and Organisation of Care (EPOC) group. REVIEW METHODS: Single estimates of dichotomous process variables were derived for each study comparison based upon the primary end-point or the median measure across several reported end-points. Separate analyses were undertaken for comparisons of different types of intervention. The study also explored whether the effects of multifaceted interventions increased with the number of intervention components. Studies reporting economic data were also critically appraised. A survey to estimate the feasibility and likely resource requirements of guideline dissemination and implementation strategies in UK settings was carried out with key informants from primary and secondary care. RESULTS: In total, 235 studies reporting 309 comparisons met the inclusion criteria; of these 73% of comparisons evaluated multifaceted interventions, although the maximum number of replications of a specific multifaceted intervention was 11 comparisons. Overall, the majority of comparisons reporting dichotomous process data observed improvements in care; however, there was considerable variation in the observed effects both within and across interventions. Commonly evaluated single interventions were reminders, dissemination of educational materials, and audit and feedback. There were 23 comparisons of multifaceted interventions involving educational outreach. The majority of interventions observed modest to moderate improvements in care. No relationship was found between the number of component interventions and the effects of multifaceted interventions. Only 29.4% of comparisons reported any economic data. The majority of studies only reported costs of treatment; only 25 studies reported data on the costs of guideline development or guideline dissemination and implementation. The majority of studies used process measures for their primary end-point, despite the fact that only three guidelines were explicitly evidence based (and may not have been efficient). Respondents to the key informant survey rarely identified existing budgets to support guideline dissemination and implementation strategies. In general, the respondents thought that only dissemination of educational materials and short (lunchtime) educational meetings were generally feasible within current resources. CONCLUSIONS: There is an imperfect evidence base to support decisions about which guideline dissemination and implementation strategies are likely to be efficient under different circumstances. Decision makers need to use considerable judgement about how best to use the limited resources they have for clinical governance and related activities to maximise population benefits. They need to consider the potential clinical areas for clinical effectiveness activities, the likely benefits and costs required to introduce guidelines and the likely benefits and costs as a result of any changes in provider behaviour. Further research is required to: develop and validate a coherent theoretical framework of health professional and organisational behaviour and behaviour change to inform better the choice of interventions in research and service settings, and to estimate the efficiency of dissemination and implementation strategies in the presence of different barriers and effect modifiers.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, recent reviews (Farmer 2008; Grimshaw 2004) found that printed educational materials have a small (but potentially important) effect.”
From Audit and feedback: effects on professional practice and healthcare outcomes (2012) · cites this paper as Grimshaw 2004
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“while a systematic review of 235 implementation trials by Grimshaw et al. found no relationship between the number of component interventions and the effects of multifaceted interventions [100].”
From Writing implementation research grant proposals: ten key ingredients (2012) · cites this paper as [100]
The cited source says what the claim attributes to it.
In the citing paper
“It is important to note that the high frequency of educational interventions is not exclusive to the allied health professions, and a similar trend is seen in nursing [11] and in the guideline implementation literature, which is largely dominated by physicians [6].”
From Systematic review of knowledge translation strategies in the allied health professions (2012) · cites this paper as [6]
In the citing paper
“The empirical evidence for the effectiveness of multifaceted strategies has been mixed, because early research touted the benefits of multifaceted strategies [98,99], while a systematic review of 235 implementation trials by Grimshaw et al. found no relationship between the number of component interventions and the effects of multifaceted interventions [100].”
From Writing implementation research grant proposals: ten key ingredients (2012) · cites this paper as [100]
In the citing paper
“the bulk of the research evidence comes from the medical e.g., [4-9] and nursing literature e.g., [10,11].”
From Systematic review of knowledge translation strategies in the allied health professions (2012) · cites this paper as [6]
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2005) · Technometrics · doi:10.1198/tech.2005.s303 · Cited by 17,923
Methods for the Economic Evaluation of Health Care Programmes
Drummond, M. E., Sculpher, M. J., Torrance, G. W., O’Brien, B. J., & Stoddart, G. L. (2005) · doi:10.1093/oso/9780198529446.001.0001 · Cited by 13,648
(1979) · Medical Entomology and Zoology · Cited by 11,252
Quasi-experimentation: Design and analysis issues for field settings
Shrout, P. E. (1980) · Evaluation and Program Planning · doi:10.1016/0149-7189(80)90063-4 · Cited by 6,010
The cochrane database of systematic reviews
Geddes, J. (1996) · Journal of Psychosomatic Research · doi:10.1016/s0022-3999(96)90063-x · Cited by 5,989
Clinical guidelines: Potential benefits, limitations, and harms of clinical guidelines
Woolf, S. H., Grol, R., Hutchinson, A., Eccles, M., & Grimshaw, J. (1999) · BMJ · doi:10.1136/bmj.318.7182.527 · Cited by 2,548
Self-citationSystematic Reviews: Identifying relevant studies for systematic reviews
Dickersin, K., Scherer, R., & Lefebvre, C. (1994) · BMJ · doi:10.1136/bmj.309.6964.1286 · Cited by 2,256
Effectiveness and Efficiency: Random Reflections on Health Services
(1973) · Public Health · doi:10.1016/s0033-3506(73)80082-4 · Cited by 1,912
Guidelines for authors and peer reviewers of economic submissions to the BMJ
Drummond, M. F., & Jefferson, T. O. (1996) · BMJ · doi:10.1136/bmj.313.7052.275 · Cited by 1,827
Davis, D. A. (1995) · JAMA · doi:10.1001/jama.1995.03530090032018 · Cited by 1,763
Research works printed but not linked: 12
- [2]2. NHS Centre for Reviews and Dissemination. Getting evidence into practice. Effective Health Care 1999; 5 :1-16.
- [4]4. NHS Centre for Reviews and Dissemination and Nuffield Institute for Health. Implementing clinical guidelines. Can guidelines be used to improve clinical practice? Effective Health Care 1994; 1 :1-12.
- [9]9. Thomas L, Cullum N, McColl E, Rousseau N, Soutter J, Steen N. Clinical guidelines in nursing, midwifery and other professions allied to medicine (Cochrane Review). The Cochrane Library (Issue 1). Oxford: Update Software; 1999.
- [10]10. Bero L, Grilli R, Grimshaw JM, Mowatt G, Oxman A, Zwarenstein M. Cochrane Effective Practice and Organisation of Care Review Group (Cochrane Group Module). In Bero L, Grilli R, Grimshaw JM, Mowatt G, Oxman A, Zwarenstein M, editors. The Cochrane Library (Issue 3). Oxford: Update Software; 2001.
- [16]16. Bushman BJ. Vote counting methods in metaanalysis. In Cooper H, Hedges L, editors. The handbook of research synthesis. New York: Russell Sage Foundation; 1994; pp. 193-213.
- [17]17. Drummond M, O'Brien B, Stoddart G, Torrance GW. Methods of economic evaluation of health care programmes. Oxford: Oxford University Press; 1997.
- [18]18. McIntosh E. Economic evaluation of guideline implementation studies. In Makela M, Thorsen T, editors. Changing professional practice. Theory and practice of clinical guidelines implementation. Copenhagen: Danish Institute for Health Services Research and Development; 1999, pp. 77-98.
- [21]21. Jefferson TO, Demicheli V , Vale L. Methodological reviews of economic evaluations in health care. JAMA 2002; 287 :2809-12.
- [24]24. Mason J, Freemantle N, Nazereth I, Eccles M, Haines A, Drummond M. When is it cost effective - to change the behaviour of health professionals? JAMA 2001; 286 :2988-92.
- [27]27. Purves IN. PRODIGY: implementing clinical guidelines using computers. Br J Gen Pract 1998; 48 :1552-3.
- [34]34. Grol R. Beliefs and evidence in changing clinical practice. BMJ 1997; 315 :418-21.
- [36]36. Grimshaw JM, Eccles MP . Clinical practice guidelines. In Haines A, Silagy C, editors. Evidencebased practice in primary care. London: BMJ Publishing; 2001, pp. 120-34.
Cited by
Items 901–1,000 of 1,009
Bonetti, D., Johnston, M., Pitts, N. B., Deery, C., Ricketts, I., Tilley, C., & Clarkson, J. E. (2009) · International Journal of Behavioral Medicine · doi:10.1007/s12529-008-9017-1 · Cited by 32
“Literature reviews [3, 5 – 7] suggest that implementation interventions continue to be developed and trialed without any understanding or description of possible causal mechanisms driving their design.”
The science of changing providers’ behaviour: the missing link in evidence‐based practice
Sanson‐Fisher, R. W., Grimshaw, J. M., & Eccles, M. P. (2004) · Medical Journal of Australia · doi:10.5694/j.1326-5377.2004.tb05884.x · Cited by 30
“A recent systematic review of 235 evaluations of guideline dissemination and implementation strategies concluded that “the majority of interventions observed modest to moderate improvements in care”.(4) However, the quality of reporting of important aspects of the studies reviewed (such as details of the study interve…”
BackgroundSelf-citationTransgender health care in Germany: Participatory approaches and the development of a guideline
Nieder, T. O., & Strauss, B. M. (2015) · International Review of Psychiatry · doi:10.3109/09540261.2015.1074562 · Cited by 33
“To avoid the problem of an insuffi cient implementation process, which is well known for other guideline procedures (Grimshaw et al., 2004; Nast et al., 2008), strategies for reaching guideline acceptance have to be found for both health care professionals and transgender people in need of…”
MethodGifford, W., Graham, I. D., & Davies, B. (2013) · Journal of Nursing Management · doi:10.1111/jonm.12129 · Cited by 43
“Despite the emphasis by healthcare leaders, government agencies and professional organisations that health care delivery should be based on high quality evidence, a significant gap exists between recommendations for evidence based care and actual clinical care provided to patients and populations (Grimshaw et al. 2004…”
BackgroundRautenbach, P., Mbananga, N., Mashamba, T., Kwinda, H., & Horner, V. (2013) · Applied Clinical Informatics · doi:10.4338/aci-2012-10-ra-0044 · Cited by 32
How to develop a program to increase influenza vaccine uptake among workers in health care settings?
den Akker, I. L., Hulscher, M., Verheij, T. J., Riphagen‐Dalhuisen, J., van Delden, J. J., & Hak, E. (2011) · Implementation Science · doi:10.1186/1748-5908-6-47 · Cited by 35
“To be most effective, implementation programs to change behaviour should be built upon a coherent theoretical base and should target all relevant determinants of influenza vaccine uptake among HCWs [13-15].”
BackgroundLynch, E. A., Cadilhac, D. A.-M., Luker, J. A., & Hillier, S. (2015) · Implementation Science · doi:10.1186/s13012-016-0487-2 · Cited by 38
“Our results compare favourably with median results of 6 % that were reported in a systematic review regarding the effect of onsite education interventions on professional practice and health care outcomes [17, 19].”
BackgroundResultInfluentialHawkins, E. J., Goldberg, S. B., Malte, C. A., & Saxon, A. J. (2019) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.18m12689 · Cited by 34
González‐María, E., Moreno‐Casbas, T., Albornos-Muñóz, L., Grinspun, D. R., Moreno‐Casbas, T., González‐María, E., Albornos-Muñóz, L., Abad-Sanz, C., Alonso-Poncelas, M. E., Arza-Alonso, N., et al. (2019) · Enfermería Clínica · doi:10.1016/j.enfcli.2019.09.018 · Cited by 48
Facilitating Guideline Implementation in Primary Health Care Practices
Peters, S., Bussières, A., Depreitere, B., Vanholle, S., Cristens, J., Vermandere, M., & Thomas, A. (2020) · Journal of Primary Care & Community Health · doi:10.1177/2150132720916263 · Cited by 42
Changing Behavior Using the Health Belief Model and Protection Motivation Theory
Orbell, S., Zahid, H., & Henderson, C. J. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108677318.004 · Cited by 40
Frantsve‐Hawley, J., Abt, E., Carrasco‐Labra, A., Dawson, T., Michaels, M., Pahlke, S. C., Rindal, D. B., Spallek, H., & Weyant, R. J. (2022) · The Journal of the American Dental Association · doi:10.1016/j.adaj.2022.07.012 · Cited by 39
Corson, K., Doak, M. N., Denneson, L., Crutchfield, M., Soleck, G., Dickinson, K. C., Gerrity, M. S., & Dobscha, S. K. (2011) · Pain Medicine · doi:10.1111/j.1526-4637.2011.01231.x · Cited by 32
Dale, S., Levi, C. R., Ward, J., Grimshaw, J., Jammali‐Blasi, A., D’Este, C. A., Griffiths, R., Quinn, C., Evans, M. K., Cadilhac, D. A.-M., et al. (2015) · Worldviews on Evidence-Based Nursing · doi:10.1111/wvn.12078 · Cited by 39
Self-citationBonetti, D. L., Johnston, M., Clarkson, J., & Turner, S. (2008) · Psychology and Health · doi:10.1080/08870440802108918 · Cited by 34
“Interventions to increase the implementation of evidence-based practice have met with variable success (Grimshaw et al., 2004).”
BackgroundMethodLost in (Knowledge) Translation!
Heyland, D. K., Cahill, N. E., & Dhaliwal, R. (2010) · Journal of Parenteral and Enteral Nutrition · doi:10.1177/0148607110361909 · Cited by 37
Wasunna, B., Zurovac, D., Bruce, J., Jones, C. O. H., Webster, J., & Snow, R. W. (2010) · Malaria Journal · doi:10.1186/1475-2875-9-261 · Cited by 39
“Several health worker performance studies have indicated that single one-off interventions without follow up often do not translate into the desired outcomes [16], notably single one off didactic training of health workers does not translate to improved case-management practices [10].”
BackgroundHerzer, K. R., Niessen, L. W., Constenla, D. O., Ward, W. J., & Pronovost, P. J. (2014) · BMJ Open · doi:10.1136/bmjopen-2014-006065 · Cited by 35
“of quality improvement programmes.[14-16] Similarly, because the estimated gross costs of Page 5 of 72”
Andronis, L., & Barton, P. M. (2015) · Medical Decision Making · doi:10.1177/0272989x15614814 · Cited by 38
“However, in the absence of specific measures, implementation is likely to reach an ‘‘improved’’ level, which is likely to be higher than that of ‘‘current’’ implementation but lower than ‘‘optimal’’ implementation.(29,30) A series of measures of the value of information can be derived from combining different states o…”
BackgroundNothacker, M., Muche‐Borowski, C., & Kopp, I. (2014) · Geburtshilfe und Frauenheilkunde · doi:10.1055/s-0034-1368227 · Cited by 37
“A number of strategies have proved to be useful [22,23].”
Voorn, V. M. A., de Mheen, P. J. M., van der Hout, A., Hofstede, S. N., So‐Osman, C., Marle, M. E. V. D. A., Kaptein, A. A., Stijnen, T., Gemert, A. W. M. M. K.-V., Dahan, A., et al. (2017) · Implementation Science · doi:10.1186/s13012-017-0601-0 · Cited by 38
Goddard, S. L., Lorencatto, F., Koo, E., Rose, L., Fan, E., Kho, M. E., Needham, D. M., Rubenfeld, G. D., Francis, J., & Cuthbertson, B. H. (2018) · Journal of Intensive Care · doi:10.1186/s40560-018-0273-0 · Cited by 42
“There is broader evidence that the translation of complex, evidence-based interventions into clinical practice is often a slow and haphazard process [19, 20].”
BackgroundOxford Handbook of Public Health Practice
(2013) · doi:10.1093/med/9780199586301.001.0001 · Cited by 35
Interactive voice response systems for improving delivery of ambulatory care.
Oake, N., Jennings, A., van Walraven, C., & Forster, A. J. (2009) · PubMed · Cited by 34
Community-acquired pneumonia: doctors do not follow national guidelines
Collini, P., Beadsworth, M., Anson, J., Neal, T. J., Burnham, P., Deegan, P., Beeching, N. J., & Miller, A. (2007) · Postgraduate Medical Journal · doi:10.1136/pgmj.2006.056556 · Cited by 32
Ohlsson, H., & Merlo, J. (2007) · BMC Health Services Research · doi:10.1186/1472-6963-7-68 · Cited by 33
“Moreover, even if guideline dissemination alone has a less important effect on prescribing patterns [9,33,34], it has proved to be effective as part of a multifaceted intervention and as a predisposing foundation for other strategies.”
Diagnostic Evaluation of Dementia in the Secondary Health Care Sector
Phung, T. K. T., Andersen, B. B., Kessing, L. V., Mortensen, P. B., & Waldemar, G. (2009) · Dementia and Geriatric Cognitive Disorders · doi:10.1159/000223664 · Cited by 32
“which can be an important point of entry for many patients with dementia [Phung et al., submitted]. It is necessary to change the doctors’ attitude in the secondary health care sector concerning diagnosing dementia. Similar to diagnosing a chronic, progressive and life-threatening illness such as cancer, a diagnosis o…”
BackgroundReid, H. A. B., Smith, R., Williamson, W., Baldock, J., Caterson, J., Kluzek, S., Jones, N., & Copeland, R. J. (2022) · BMC Public Health · doi:10.1186/s12889-022-14178-6 · Cited by 43
Geng, E., Powell, B. J., Goss, C. W., Lewis, C. C., Sales, A. E., & Kim, B. (2025) · Implementation Science · doi:10.1186/s13012-025-01427-6 · Cited by 38
Diabetes management in an Australian primary care population
Krass, I., Hebing, R. C. F., Mitchell, B., Hughes, J., Peterson, G. M., Song, Y. J. C., Stewart, K., & Armour, C. L. (2011) · Journal of Clinical Pharmacy and Therapeutics · doi:10.1111/j.1365-2710.2010.01221.x · Cited by 34
“However, the uptake of evidence-based recommendations in clinical practice has been highly variable (9, 11, 12) resulting in a range of therapeutic and management gaps (13, 14).”
BackgroundPresseau, J., Hawthorne, G., Sniehotta, F. F., Steen, N., Francis, J., Johnston, M., Mackintosh, J. E., Grimshaw, J., Kaner, E., Elovainio, M. J., et al. (2014) · Implementation Science · doi:10.1186/1748-5908-9-61 · Cited by 31
“Interventions to improve the quality of care that patients receive can be effective, but previous studies provided little theoretical or conceptual rationale for their choice of intervention [6] and only limited descriptions of the interventions and contextual data [7].”
BackgroundSelf-citationNakrem, S., Stensvik, G.-T., Skjong, R. J., & Ostaszkiewicz, J. (2019) · BMC Health Services Research · doi:10.1186/s12913-019-4034-0 · Cited by 34
A practitioner behaviour change intervention for deprescribing in the hospital setting
Scott, S., May, H. M., Patel, M., Wright, D. J., & Bhattacharya, D. (2020) · Age and Ageing · doi:10.1093/ageing/afaa169 · Cited by 36
Changing Behavior Using the Transtheoretical Model
DiClemente, C. C., & Graydon, M. M. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108677318.010 · Cited by 39
Reese, T. J., Schlechter, C. R., Kramer, H., Kukhareva, P., Weir, C. R., Fiol, G. D., Caverly, T. J., Hess, R., Flynn, M. C., Taft, T., et al. (2021) · Translational Behavioral Medicine · doi:10.1093/tbm/ibab115 · Cited by 33
McConnell, E. S., Lekan, D. A., Bunn, M., Egerton, E. O., Corazzini, K., Hendrix, C. D., & Bailey, D. E. (2009) · Journal of Gerontological Nursing · doi:10.3928/00989134-20090401-10 · Cited by 31
Sarkies, M., Robins, L., Jepson, M., Williams, C., Taylor, N. F., O’Brien, L., Martin, J., Bardoel, A., Morris, M. E., Carey, L. M., et al. (2021) · PLoS Medicine · doi:10.1371/journal.pmed.1003833 · Cited by 32
“To be reported in other publications Justification Evidence-based practice recommendation documents are one of the few implementation strategies that have been evaluated for hospital managers [41,50,51], which have the potential to increase engagement with research implementation [52].”
BackgroundCaractéristiques du marché des médicaments et stratégies des firmes pharmaceutiques
Abécassis, P., & Coutinet, N. (2008) · Horizons stratégiques · doi:10.3917/hori.007.0111 · Cited by 55
Evaluating the effectiveness of educational interventions to prevent delirium
Wand, A. P. F. (2011) · Australian Journal on Ageing · doi:10.1111/j.1741-6612.2010.00502.x · Cited by 31
Chimeddamba, O., Peeters, A., Ayton, D., Tumenjargal, E., Sodov, S., & Joyce, C. (2015) · Implementation Science · doi:10.1186/s13012-015-0307-0 · Cited by 42
Assessment of the implementation of a national patient safety alert to reduce wrong site surgery
Rhodes, P., Giles, S. J., Cook, G. A., Grange, A., Hayton, R., Maxwell, M. J., Sheldon, T., & Wright, J. (2008) · BMJ Quality & Safety · doi:10.1136/qshc.2007.023010 · Cited by 39
Variation in subfertility care measured by guideline-based performance indicators
Mourad, S. M., Nelen, W. L. D. M., Hermens, R., Bancsi, L. F. J. M. M., Braat, D. D. M., Zielhuis, G. A., Grol, R. P. T. M., & Kremer, J. A. M. (2008) · Human Reproduction · doi:10.1093/humrep/den281 · Cited by 42
“To improve both outcome and process of health care, clinical practice guidelines have been developed summarizing the best available evidence (Grimshaw et al., 2004).”
BackgroundKasje, W. N., Denig, P., Stewart, R. E., de Graeff, P. A., & Haaijer‐Ruskamp, F. M. (2005) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2005.00625.x · Cited by 34
“Patient specific feedback was given by reviewing the treatment of individual patients of the participants, in contrast to other programmes that usually focus on the general management of a disease ( Grimshaw et al . 2004 ).”
MethodErdem, S., Campbell, D., & Thompson, C. A. (2014) · Journal of Health Economics · doi:10.1016/j.jhealeco.2014.06.012 · Cited by 31
Taylor, N. J., Lawton, R., Moore, S. G., Craig, J., Slater, B., Cracknell, A. L., Wright, J., & Mohammed, M. A. (2014) · BMC Health Services Research · doi:10.1186/s12913-014-0648-4 · Cited by 37
“Consequently, a range of methods have been developed to implement guidelines in routine practice – but, evaluations of these approaches have demonstrated variable effects [2,3].”
McAteer, J., Stone, S. P., Fuller, C., & Michie, S. (2014) · American Journal of Infection Control · doi:10.1016/j.ajic.2013.12.022 · Cited by 31
“5), “social influences” (8), and “emotion” (8.”
Commitment to change instrument enhances program planning, implementation, and evaluation
White, M., Grzybowski, S., & Broudo, M. (2004) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.1340240306 · Cited by 31
The Enhancing Secondary Prevention in Coronary Artery Disease trial
McAlister, F. A., Fradette, M., Majumdar, S. R., Williams, R., Graham, M. M., McMeekin, J., Ghali, W. A., Tsuyuki, R. T., Knudtson, M. L., & Grimshaw, J. (2009) · Canadian Medical Association Journal · doi:10.1503/cmaj.090917 · Cited by 33
“Duke jeopardy score,‡ mean % (SD) 44 (33) 47 (31) 44 (34) 41 (33)”
Self-citationPeter, W. F., van der Wees, P. J., Verhoef, J., de Jong, Z., van Bodegom‐Vos, L., Hilberdink, W. K. H. A., Fiocco, M. F., & Vlieland, T. P. M. V. (2014) · Disability and Rehabilitation · doi:10.3109/09638288.2014.913708 · Cited by 32
Shared Decision Making Does Not Influence Physicians against Clinical Practice Guidelines
Guerrier, M., Légaré, F., Turcotte, S., Labrecque, M., & Rivest, L. (2013) · PLoS ONE · doi:10.1371/journal.pone.0062537 · Cited by 37
“Little is known about translating SDM and CPGs together into clinical practice and it is unclear whether physicians are likely to adopt both at once [16,17].”
BackgroundDeveloping an Integrated System of Care for Frail Seniors
Heckman, G. A., Hillier, L. M., Manderson, B., McKinnon-Wilson, J., Santi, S. M., & Stolee, P. (2013) · Healthcare Management Forum · doi:10.1016/j.hcmf.2013.09.003 · Cited by 38
Immediate versus sustained effects: interrupted time series analysis of a tailored intervention
Hanbury, A., Farley, K., Thompson, C. A., Wilson, P. M., Chambers, D., & Holmes, H. (2013) · Implementation Science · doi:10.1186/1748-5908-8-130 · Cited by 37
“While associated with only small effects on professional practice [17], educational materials are relatively low cost and feasible in most settings, making them a potentially worthwhile intervention [18].”
BackgroundDo guidelines create uniformity in medical practice?
de Jong, J. D., Groenewegen, P., Spreeuwenberg, P. M. M., Schellevis, F., & Westert, G. P. (2009) · Social Science & Medicine · doi:10.1016/j.socscimed.2009.10.016 · Cited by 46
Nurses’ experiences of guideline implementation: a focus group study
Alanen, S., Valimaki, M. A., Kaila, M., & for the ECCE Study Group (2009) · Journal of Clinical Nursing · doi:10.1111/j.1365-2702.2008.02754.x · Cited by 48
Do clinical guidelines enhance safe practice in obstetrics and gynaecology?
Penney, G. C., & Foy, R. (2007) · Best Practice & Research Clinical Obstetrics & Gynaecology · doi:10.1016/j.bpobgyn.2007.01.014 · Cited by 40
KASTRUP, M., CARL, M., SPIES, C., SANDER, M., MARKEWITZ, A., & SCHIRMER, U. (2013) · Acta Anaesthesiologica Scandinavica · doi:10.1111/aas.12009 · Cited by 31
“Besides the definition of clinical areas in which quality improvement initiatives are necessary, attention should be given to the likely effectiveness of different dissemination and implementation strategies.(4) In order to answer these questions, evidence about the effects of quality improvement strategies and the cl…”
BackgroundFaria, R., Walker, S., Whyte, S., Dixon, S., Palmer, S., & Sculpher, M. (2016) · Medical Decision Making · doi:10.1177/0272989x16645577 · Cited by 32
“These activities can include audits and feedback, education and training, decision support systems, and outreach activities.(5) Implementation activities are complex interventions in that they attempt to affect behaviors and different groups of individuals, including health organizations, clinicians, and patients.”
BackgroundHarrison, D. M., Loughnan, P. M., Manias, E., & Johnston, L. J. (2009) · Journal of Pain · doi:10.1016/j.jpain.2008.12.011 · Cited by 34
“However, reminders, in isolation, have been shown to have little or no impact on implementation of clinical practice guidelines.(22) In addition, the Sucrose Clinical Practice Guidelines were introduced into the participating NICU 4 years before this study,(24) and there had been no active knowledge translation activi…”
BackgroundAsaro, P. V., Sheldahl, A. L., & Char, D. M. (2006) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.2006.tb00325.x · Cited by 35
Bissett, S. M., Preshaw, P. M., Presseau, J., & Rapley, T. (2019) · Primary care diabetes · doi:10.1016/j.pcd.2019.11.010 · Cited by 35
The effectiveness of clinical guideline implementation strategies in oncology—a systematic review
Zorger, A.-M., Piechotta, V., Kreuzberger, N., Monsef, I., Wender, A., Follmann, M., Nothacker, M., & Skoetz, N. (2023) · BMC Health Services Research · doi:10.1186/s12913-023-09189-x · Cited by 33
Implementation of ERAS Protocols: In Theory and Practice
Özçelik, M. (2024) · Türk anesteziyoloji ve reanimasyon derneği dergisi · doi:10.4274/tjar.2024.241723 · Cited by 34
Nurses' Caring Attitude: Fall Prevention Program Implementation as an Example of Its Importance
Tzeng, H. (2011) · Nursing Forum · doi:10.1111/j.1744-6198.2011.00222.x · Cited by 41
“Multifaceted interventions (e.g., reminders, education sessions, and barrier-oriented interventions) did not appear to be more effective than a single intervention, particularly reminders (Dijkstra et al., 2006; Grimshaw et al., 2001, 2004; Titler, 2007).”
BackgroundPrihodová, L., Guérin, S., & Kernohan, G. W. (2015) · Journal of Advanced Nursing · doi:10.1111/jan.12642 · Cited by 35
“…of particular KTE strategy in different circumstances, there is a need for further research to develop and validate a new coherent KTE model (Grimshaw et al. 2004, Colquhoun et al. 2014), while others stress that rather than developing a new KTE framework, research should evaluate the…”
BackgroundUnderpinning a Guiding Theory of Patient-Centered E-Health
Wilson, E. V., Wang, W., & Sheetz, S. D. (2014) · Communications of the Association for Information Systems · doi:10.17705/1cais.03416 · Cited by 33
“Healthcare is frequently criticized for its reluctance to build and follow theory-based research frameworks [Eccles, Grimshaw, Walker, Johnston and Pitts, 2005; Grimshaw et al., 2004], even though there is recognized need “to establish the theoretical basis of interventions and undertake exploratory studies to choose…”
Hanbury, A., Wallace, L., & Clark, M. (2009) · British Journal of Health Psychology · doi:10.1348/135910708x369558 · Cited by 30
“Time and fiscal constraints placed on the putative intervention, common to intervention studies in health care settings, further suggested an educational intervention to be most feasible (e.g. Grimshaw et al., 2004).”
BackgroundInfluentialChamberlain, C., Martin, R. M., Busby, J., Gilbert, R., Cahill, D. J., & Hollingworth, W. (2013) · BMC Public Health · doi:10.1186/1471-2458-13-112 · Cited by 30
“Clinical practice decisions are influenced by a number of factors including relevant literature, clinical guidelines, peer or senior support, as well as the policy environment [10,23-25].”
BackgroundFörberg, U., Unbeck, M., Wallin, L., Johansson, E., Petzold, M., Ygge, B., & Ehrenberg, A. (2015) · Implementation Science · doi:10.1186/s13012-016-0375-9 · Cited by 35
“An expected decrease of complications for the intervention units was set at 6–10 % based on findings from a systematic review [23].”
BackgroundSarkies, M., White, J. H., Morris, M. E., Taylor, N. F., Williams, C., O’Brien, L., Martin, J., Bardoel, A., Holland, A. E., Carey, L. M., et al. (2018) · Implementation Science · doi:10.1186/s13012-018-0752-7 · Cited by 32
“Developing evidence-based policy recommendations for allied health decision-makers has the potential to increase engagement with research implementation [29].”
BackgroundYost, J., Thompson, D., Ganann, R., Aloweni, F. B. A. B., Newman, K., McKibbon, A., Dobbins, M., & Ciliska, D. K. (2014) · Worldviews on Evidence-Based Nursing · doi:10.1111/wvn.12043 · Cited by 44
Adaptation of Trustworthy Guidelines Developed Using the GRADE Methodology
Kristiansen, A., Brandt, L., Agoritsas, T., Akl, E. A., Berge, E., Bondi, J., Dahm, A. E. A., Granan, L., Halvorsen, S., Holme, P. A., et al. (2014) · CHEST Journal · doi:10.1378/chest.13-2828 · Cited by 40
Perron, B. E., Bunger, A. C., Bender, K., Vaughn, M. G., & Howard, M. O. (2010) · Substance Use & Misuse · doi:10.3109/10826080903442836 · Cited by 30
“Treatment guidelines are important components of broader strategies for moving research into practice and changing provider practice patterns (Grimshaw et al., 2001, 2004).”
Attitudes Toward Guidelines in Finnish Primary Care Nursing: A Questionnaire Survey
Alanen, S., Kaila, M., Valimaki, M. A., & for the ECCE Study Group (2009) · Worldviews on Evidence-Based Nursing · doi:10.1111/j.1741-6787.2009.00167.x · Cited by 41
Systematic reviews, systematic error and the acquisition of clinical knowledge
Mickenautsch, S. (2010) · BMC Medical Research Methodology · doi:10.1186/1471-2288-10-53 · Cited by 31
“Furthermore, systematic reviews are increasingly utilized in appraising the evidence regarding the cost-effectiveness of interventions [8,9], the costs of guideline dissemination and implementation [10] or evidence from qualitative studies [11].”
BackgroundNast, A., ERDMANN, R., Pathirana, D., & Rzany, B. (2008) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2008.00971.x · Cited by 30
Rojnik, K., & Naveršnik, K. (2007) · Value in Health · doi:10.1111/j.1524-4733.2007.00244.x · Cited by 30
Vision and challenges of Evidence-Based Health Informatics: A case study of a CPOE meta-analysis
Ammenwerth, E., Schnell‐Inderst, P., & Siebert, U. (2009) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2008.11.003 · Cited by 33
Understanding the implementation of evidence-based care: A structural network approach
Parchman, M. L., Scoglio, C., & Schumm, P. (2011) · Implementation Science · doi:10.1186/1748-5908-6-14 · Cited by 36
“Background Efforts to date to understand the slowness of physicians to implement evidence-based guidelines has been hindered by an overreliance on the attributes, knowledge, decision making, and actions of individual clinicians and an under-recognition of the network of care within which they operate [1-5].”
BackgroundThe cycle of change: implementing best-evidence clinical practice
Carey, M. L., Buchan, H., & Sanson‐Fisher, R. (2008) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzn049 · Cited by 38
“Evidence-based clinical guidelines aim to do this; however guidelines alone may not result in the required change in clinical practice [2].”
BackgroundJohnson, T. V., Symanski, J. D., Patel, S. R., & Rose, G. A. (2011) · Journal of the American Society of Echocardiography · doi:10.1016/j.echo.2011.08.018 · Cited by 31
Gagliardi, A. R., Brouwers, M. C., Palda, V. A., Lemieux‐Charles, L., & Grimshaw, J. (2009) · Implementation Science · doi:10.1186/1748-5908-4-36 · Cited by 34
“Recent syntheses of guideline implementation research found that there is considerable variation in the observed effects within and across interventions by condition and setting of care [17].”
BackgroundSelf-citationMcKillop, A., Crisp, J., & Walsh, K. D. (2011) · Worldviews on Evidence-Based Nursing · doi:10.1111/j.1741-6787.2011.00233.x · Cited by 39
“intervention for the implementation of evidence, researchers have turned their attention to the interplay of the complexities of clinical practice and their effect on the implementation of evidence (Grol 1997; Estabrooks et al. 2003; Grimshaw et al. 2004; Grol & Wensing 2004; Rycroft-Malone 2008).”
BackgroundDormuth, C. R., Carney, G., Taylor, S., Bassett, K. L., & Maclure, M. (2012) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.21140 · Cited by 34
Peter, W. F., van der Wees, P. J., Verhoef, J., de Jong, Z., van Bodegom‐Vos, L., Hilberdink, W. K. H. A., Fiocco, M. F., & Vlieland, T. P. M. V. (2012) · Rheumatology · doi:10.1093/rheumatology/kes264 · Cited by 37
Lankshear, A. J. (2005) · BMJ Quality & Safety · doi:10.1136/qshc.2004.011874 · Cited by 31
Hawkins, E. J., Malte, C. A., Hagedorn, H., Berger, D. B., Frank, A. N., Lott, A. M. K., Achtmeyer, C. E., Mariano, A. J., & Saxon, A. J. (2016) · Pain Medicine · doi:10.1093/pm/pnw140 · Cited by 33
Rätsep, A., Kalda, R., Oja, I., & Lember, M. (2006) · BMC Family Practice · doi:10.1186/1471-2296-7-36 · Cited by 31
“Nevertheless there is imperfect evidence to support decisions about which guideline dissemination and implementation strategies are likely to be efficient under different circumstances [24].”
Bloomfield, H. E. (2005) · Quality and Safety in Health Care · doi:10.1136/qshc.2004.012617 · Cited by 30
Knowledge Transfer in Mental Health Care: How Do We Bring Evidence into Day-to-Day Practice?
Grol, R. P. T. M. (2008) · The Canadian Journal of Psychiatry · doi:10.1177/070674370805300501 · Cited by 32
Interventions for improving the adoption of shared decision making by healthcare professionals
Légaré, F., Ratté, S., Stacey, D., Kryworuchko, J., Gravel, K., Turcot, L., & Graham, I. D. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006732 · Cited by 33
Sibley, K. M., & Salbach, N. M. (2014) · Physical Therapy · doi:10.2522/ptj.20130486 · Cited by 32
van der Veer, S. N., Tomson, C., Jager, K. J., & Biesen, W. V. (2013) · Nephrology Dialysis Transplantation · doi:10.1093/ndt/gft496 · Cited by 32
“This was in line with the results of an extensive review on the effectiveness of guideline dissemination and implementation strategies [44].”
ResultNørskov, A. K., Rosenstock, C. V., Wetterslev, J., & Lundstrøm, L. H. (2013) · Trials · doi:10.1186/1745-6215-14-347 · Cited by 35
“We presented ‘state of the art’ study methodology for testing the implementation of a multifacetted recommendation [33, 52, 53].”
MethodIntegrative Review of Implementation Strategies for Translation of Research-Based Evidence by Nurses
Wuchner, S. S. (2014) · Clinical Nurse Specialist · doi:10.1097/nur.0000000000000055 · Cited by 36
Bartlem, K. M., Bowman, J., Freund, M., Wye, P. M., Barker, D., McElwaine, K., Wolfenden, L., Campbell, E. M., McElduff, P., Gillham, K. E., et al. (2015) · Implementation Science · doi:10.1186/s13012-016-0408-4 · Cited by 29
Implementing guidelines in nursing homes: a systematic review
Diehl, H., Graverholt, B., Espehaug, B., & Lund, H. (2016) · BMC Health Services Research · doi:10.1186/s12913-016-1550-z · Cited by 35
“Their effects were small to moderate and variable, which concurs with evidence from multiple systematic reviews reporting on the topic [9, 11, 38].”
ResultMcGoldrick, E., Crawford, T. J., Brown, J. A., Groom, K. M., & Crowther, C. A. (2016) · BMC Health Services Research · doi:10.1186/s12913-016-1858-8 · Cited by 34
“Improving implementation of evidence-based practice by healthcare professionals often requires changing multiple behaviours of a number of individuals at many different levels [3].”
BackgroundKastner, M., Perrier, L., Munce, S., Adhihetty, C., Lau, A., Hamid, J. S., Treister, V., Chan, J., Lai, Y., & Straus, S. E. (2017) · Osteoporosis International · doi:10.1007/s00198-017-4248-0 · Cited by 31
Towards a systematic approach for (de)implementation of patient blood management strategies
Voorn, V. M. A., van Bodegom‐Vos, L., & So‐Osman, C. (2018) · Transfusion Medicine · doi:10.1111/tme.12520 · Cited by 33
“The described studies use interventions to change behaviours that are common in implementation research, although the abovementioned factors may differ (Grimshaw et al., 2004).”
BackgroundKnowledge transfer and exchange in health and safety: a rapid review
Eerd, D. V. (2019) · Policy and Practice in Health and Safety · doi:10.1080/14773996.2018.1508116 · Cited by 34
“Reviews have shown that multiple dissemination/exchange activities are superior to single activities (Grimshaw et al., 2004; Grol & Jones, 2000).”
Background
Metadata
- Authors
- Grimshaw, J., Thomas, R., MacLennan, G., Fraser, C., Ramsay, C., Vale, L., Whitty, P., Eccles, M., Matowe, L., Shirran, L., Wensing, M., Dijkstra, R., & Donaldson, C.
- Affiliations
- University of Aberdeen (GB)
- Newcastle University (GB)
- Radboud University Nijmegen (NL)
- University of Calgary (CA)
- Venue
- Health Technology Assessment
- Published
- 2004-02
- Volume
- 8
- Issue
- 6
- Pages
- iii-iv, 1
- ISSN
- 1366-5278 (ISSN-L)
- 2046-4924
- OpenAlex
- W2038028146
- Cited by
- 3,044
- References
- 38
- Citations by year
- 2026: 45 · 2025: 45 · 2024: 72 · 2023: 65 · 2022: 69 · 2021: 100 · 2020: 163 · 2019: 87 · 2018: 112 · 2017: 129 · 2016: 133 · 2015: 184 · 2014: 188 · 2013: 288 · 2012: 167
- FWCI
- 20.52
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- Locations
- Health Technology Assessment (publishedVersion, other-oa)
- PubMed (publishedVersion)
- Radboud Repository (Radboud University) (submittedVersion, other-oa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Radboud Repository (Radboud University) (submittedVersion)
- Newcastle University ePrints (Newcastle Univesity)
- Funders
- Health Technology Assessment programme (94/08/29)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Keywords
- guideline dissemination, guideline implementation, guideline development, multicomponent intervention, educational outreach, reminders, audit and feedback, teaching materials, cost-effectiveness, resource requirements, clinical governance, primary care, secondary care, evidence-based recommendations, process indicators, healthcare quality improvement
- MeSH terms
- Cost-Benefit Analysis, United Kingdom, Medical Informatics, State Medicine, Practice Guidelines as Topic, Information Dissemination
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.