Effectiveness and efficiency of guideline dissemination and implementation strategies
Open accessThe DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Abstract
OBJECTIVES: To undertake a systematic review of the effectiveness and costs of different guideline development, dissemination and implementation strategies. To estimate the resource implications of these strategies. To develop a framework for deciding when it is efficient to develop and introduce clinical guidelines. DATA SOURCES: MEDLINE, Healthstar, Cochrane Controlled Trial Register, EMBASE, SIGLE and the specialised register of the Cochrane Effective Practice and Organisation of Care (EPOC) group. REVIEW METHODS: Single estimates of dichotomous process variables were derived for each study comparison based upon the primary end-point or the median measure across several reported end-points. Separate analyses were undertaken for comparisons of different types of intervention. The study also explored whether the effects of multifaceted interventions increased with the number of intervention components. Studies reporting economic data were also critically appraised. A survey to estimate the feasibility and likely resource requirements of guideline dissemination and implementation strategies in UK settings was carried out with key informants from primary and secondary care. RESULTS: In total, 235 studies reporting 309 comparisons met the inclusion criteria; of these 73% of comparisons evaluated multifaceted interventions, although the maximum number of replications of a specific multifaceted intervention was 11 comparisons. Overall, the majority of comparisons reporting dichotomous process data observed improvements in care; however, there was considerable variation in the observed effects both within and across interventions. Commonly evaluated single interventions were reminders, dissemination of educational materials, and audit and feedback. There were 23 comparisons of multifaceted interventions involving educational outreach. The majority of interventions observed modest to moderate improvements in care. No relationship was found between the number of component interventions and the effects of multifaceted interventions. Only 29.4% of comparisons reported any economic data. The majority of studies only reported costs of treatment; only 25 studies reported data on the costs of guideline development or guideline dissemination and implementation. The majority of studies used process measures for their primary end-point, despite the fact that only three guidelines were explicitly evidence based (and may not have been efficient). Respondents to the key informant survey rarely identified existing budgets to support guideline dissemination and implementation strategies. In general, the respondents thought that only dissemination of educational materials and short (lunchtime) educational meetings were generally feasible within current resources. CONCLUSIONS: There is an imperfect evidence base to support decisions about which guideline dissemination and implementation strategies are likely to be efficient under different circumstances. Decision makers need to use considerable judgement about how best to use the limited resources they have for clinical governance and related activities to maximise population benefits. They need to consider the potential clinical areas for clinical effectiveness activities, the likely benefits and costs required to introduce guidelines and the likely benefits and costs as a result of any changes in provider behaviour. Further research is required to: develop and validate a coherent theoretical framework of health professional and organisational behaviour and behaviour change to inform better the choice of interventions in research and service settings, and to estimate the efficiency of dissemination and implementation strategies in the presence of different barriers and effect modifiers.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, recent reviews (Farmer 2008; Grimshaw 2004) found that printed educational materials have a small (but potentially important) effect.”
From Audit and feedback: effects on professional practice and healthcare outcomes (2012) · cites this paper as Grimshaw 2004
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“while a systematic review of 235 implementation trials by Grimshaw et al. found no relationship between the number of component interventions and the effects of multifaceted interventions [100].”
From Writing implementation research grant proposals: ten key ingredients (2012) · cites this paper as [100]
The cited source says what the claim attributes to it.
In the citing paper
“It is important to note that the high frequency of educational interventions is not exclusive to the allied health professions, and a similar trend is seen in nursing [11] and in the guideline implementation literature, which is largely dominated by physicians [6].”
From Systematic review of knowledge translation strategies in the allied health professions (2012) · cites this paper as [6]
In the citing paper
“The empirical evidence for the effectiveness of multifaceted strategies has been mixed, because early research touted the benefits of multifaceted strategies [98,99], while a systematic review of 235 implementation trials by Grimshaw et al. found no relationship between the number of component interventions and the effects of multifaceted interventions [100].”
From Writing implementation research grant proposals: ten key ingredients (2012) · cites this paper as [100]
In the citing paper
“the bulk of the research evidence comes from the medical e.g., [4-9] and nursing literature e.g., [10,11].”
From Systematic review of knowledge translation strategies in the allied health professions (2012) · cites this paper as [6]
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2005) · Technometrics · doi:10.1198/tech.2005.s303 · Cited by 17,923
Methods for the Economic Evaluation of Health Care Programmes
Drummond, M. E., Sculpher, M. J., Torrance, G. W., O’Brien, B. J., & Stoddart, G. L. (2005) · doi:10.1093/oso/9780198529446.001.0001 · Cited by 13,648
(1979) · Medical Entomology and Zoology · Cited by 11,252
Quasi-experimentation: Design and analysis issues for field settings
Shrout, P. E. (1980) · Evaluation and Program Planning · doi:10.1016/0149-7189(80)90063-4 · Cited by 6,010
The cochrane database of systematic reviews
Geddes, J. (1996) · Journal of Psychosomatic Research · doi:10.1016/s0022-3999(96)90063-x · Cited by 5,989
Clinical guidelines: Potential benefits, limitations, and harms of clinical guidelines
Woolf, S. H., Grol, R., Hutchinson, A., Eccles, M., & Grimshaw, J. (1999) · BMJ · doi:10.1136/bmj.318.7182.527 · Cited by 2,548
Self-citationSystematic Reviews: Identifying relevant studies for systematic reviews
Dickersin, K., Scherer, R., & Lefebvre, C. (1994) · BMJ · doi:10.1136/bmj.309.6964.1286 · Cited by 2,256
Effectiveness and Efficiency: Random Reflections on Health Services
(1973) · Public Health · doi:10.1016/s0033-3506(73)80082-4 · Cited by 1,912
Guidelines for authors and peer reviewers of economic submissions to the BMJ
Drummond, M. F., & Jefferson, T. O. (1996) · BMJ · doi:10.1136/bmj.313.7052.275 · Cited by 1,827
Davis, D. A. (1995) · JAMA · doi:10.1001/jama.1995.03530090032018 · Cited by 1,763
Research works printed but not linked: 12
- [2]2. NHS Centre for Reviews and Dissemination. Getting evidence into practice. Effective Health Care 1999; 5 :1-16.
- [4]4. NHS Centre for Reviews and Dissemination and Nuffield Institute for Health. Implementing clinical guidelines. Can guidelines be used to improve clinical practice? Effective Health Care 1994; 1 :1-12.
- [9]9. Thomas L, Cullum N, McColl E, Rousseau N, Soutter J, Steen N. Clinical guidelines in nursing, midwifery and other professions allied to medicine (Cochrane Review). The Cochrane Library (Issue 1). Oxford: Update Software; 1999.
- [10]10. Bero L, Grilli R, Grimshaw JM, Mowatt G, Oxman A, Zwarenstein M. Cochrane Effective Practice and Organisation of Care Review Group (Cochrane Group Module). In Bero L, Grilli R, Grimshaw JM, Mowatt G, Oxman A, Zwarenstein M, editors. The Cochrane Library (Issue 3). Oxford: Update Software; 2001.
- [16]16. Bushman BJ. Vote counting methods in metaanalysis. In Cooper H, Hedges L, editors. The handbook of research synthesis. New York: Russell Sage Foundation; 1994; pp. 193-213.
- [17]17. Drummond M, O'Brien B, Stoddart G, Torrance GW. Methods of economic evaluation of health care programmes. Oxford: Oxford University Press; 1997.
- [18]18. McIntosh E. Economic evaluation of guideline implementation studies. In Makela M, Thorsen T, editors. Changing professional practice. Theory and practice of clinical guidelines implementation. Copenhagen: Danish Institute for Health Services Research and Development; 1999, pp. 77-98.
- [21]21. Jefferson TO, Demicheli V , Vale L. Methodological reviews of economic evaluations in health care. JAMA 2002; 287 :2809-12.
- [24]24. Mason J, Freemantle N, Nazereth I, Eccles M, Haines A, Drummond M. When is it cost effective - to change the behaviour of health professionals? JAMA 2001; 286 :2988-92.
- [27]27. Purves IN. PRODIGY: implementing clinical guidelines using computers. Br J Gen Pract 1998; 48 :1552-3.
- [34]34. Grol R. Beliefs and evidence in changing clinical practice. BMJ 1997; 315 :418-21.
- [36]36. Grimshaw JM, Eccles MP . Clinical practice guidelines. In Haines A, Silagy C, editors. Evidencebased practice in primary care. London: BMJ Publishing; 2001, pp. 120-34.
Cited by
Items 601–700 of 1,009
Chong, P. N., Tan, N. C., & Lim, T. K. (2008) · Annals of the Academy of Medicine Singapore · doi:10.47102/annals-acadmedsg.v37n2p114 · Cited by 54
Graham, I. D., Logan, J., Davies, B., & Nimrod, C. (2004) · Birth · doi:10.1111/j.0730-7659.2004.00322.x · Cited by 56
Rebergen, D. S., Bruinvels, D. J., Bos, C. M., van der Beek, A. J., & van Mechelen, W. (2010) · Scandinavian Journal of Work Environment & Health · doi:10.5271/sjweh.3084 · Cited by 63
Goderis, G., Borgermans, L., Mathieu, C., Van Den Broeke, C., Hannes, K., Heyrman, J., & Grol, R. (2009) · Implementation Science · doi:10.1186/1748-5908-4-41 · Cited by 54
“However, a clear understanding on how to overcome these barriers seems to be lacking [13-15], despite previous studies which outlined the obstacles that prevent GPs from following the guidelines [16-24].”
Canadian breast cancer guidelines: Have they made a difference?
Latosinsky, S., Fradette, K., Lix, L. M., Hildebrand, K. J., & Turner, D. (2007) · Canadian Medical Association Journal · doi:10.1503/cmaj.060854 · Cited by 54
Unverzagt, S., Oemler, M., Braun, K., & Klement, A. (2014) · Family Practice · doi:10.1093/fampra/cmt080 · Cited by 54
First Aid for Eating Disorders
Hart, L. M., Jorm, A. F., Paxton, S. J., Kelly, C. M., & Kitchener, B. A. (2009) · Eating Disorders · doi:10.1080/10640260903210156 · Cited by 52
“The economic cost of implementation has also been cited as a negative implication of guideline research (Grimshaw et al., 2004).”
BackgroundEffect of the Low Risk Ankle Rule on the frequency of radiography in children with ankle injuries
Boutis, K., Grootendorst, P. V., Willan, A. R., Plint, A. C., Babyn, P., Brison, R. J., Sayal, A., Parker, M. J., Mamen, N., Schuh, S., et al. (2013) · Canadian Medical Association Journal · doi:10.1503/cmaj.122050 · Cited by 53
Self-citationArabi, Y. M., Al-Dorzi, H. M., Alamry, A., Hijazi, R., Alsolamy, S., Al Salamah, M., Tamim, H. M., Al-Qahtani, S., Al-Dawood, A., Marini, A. M., et al. (2017) · Annals of Intensive Care · doi:10.1186/s13613-017-0280-7 · Cited by 52
Suman, A., Schaafsma, F. G., van de Ven, P. M., Slottje, P., Buchbinder, R., van Tulder, M. W., & Anema, J. R. (2018) · BMC Health Services Research · doi:10.1186/s12913-018-3166-y · Cited by 57
“Over the past decades, ongoing debate over the effectiveness of CME on changing professional performance has been observed [28, 29].”
BackgroundWarner, L. M., & French, D. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108677318.032 · Cited by 77
Waterreus, A. J., & Laugharne, J. D. E. (2009) · Medical Journal of Australia · doi:10.5694/j.1326-5377.2009.tb02344.x · Cited by 54
Patient and Organizational Factors Associated With Delays in Antimicrobial Therapy for Septic Shock*
Amaral, A. C. K. B., Fowler, R. A., Pinto, R., Rubenfeld, G. D., Ellis, P., Bookatz, B., Marshall, J. C., Martinka, G., Keenan, S., Laporta, D., et al. (2016) · Critical Care Medicine · doi:10.1097/ccm.0000000000001868 · Cited by 51
“Streptococcus pneumoniae 398 (5) 369 (5) 29 (3)”
Rotter, T., Plishka, C., Hansia, M. R., Goodridge, D. M., Penz, E. D., Kinsman, L., Lawal, A. K., O’Quinn, S., Buchan, N., Comfort, P., et al. (2017) · BMC Health Services Research · doi:10.1186/s12913-017-2750-x · Cited by 58
Wilson, P. M., & Kislov, R. (2022) · Cambridge University Press eBooks · doi:10.1017/9781009237055 · Cited by 72
Hadely, K. A., Power, E., & O’Halloran, R. (2014) · BMC Health Services Research · doi:10.1186/1472-6963-14-110 · Cited by 60
“As the overwhelming evidence suggests that dissemination of CPG alone is ineffective [18,19], this may further illustrate why speech pathologists may find it difficult to implement guidelines.”
BackgroundMethodInfluentialYost, J., Ciliska, D. K., & Dobbins, M. (2014) · BMC Medical Education · doi:10.1186/1472-6920-14-13 · Cited by 66
“Such active interventions include reminders, educational outreach, opinion leaders, audit and feedback, as well as point-of-care computer reminders [5-19].”
Continuous quality improvement: effects on professional practice and healthcare outcomes
Brennan, S., McKenzie, J. E., Whitty, P., Buchan, H., & Green, S. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003319.pub2 · Cited by 55
Self-citationRetractedMatthew‐Maich, N., Ploeg, J., Dobbins, M., & Jack, S. M. (2012) · Worldviews on Evidence-Based Nursing · doi:10.1111/j.1741-6787.2012.00259.x · Cited by 60
Lionis, C., Papadakaki, M., Saridaki, A., Dowrick, C., O'Donnell, C. A., Mair, F. S., van den Muijsenbergh, M., Burns, N., de Brún, T., O'Reilly de Brún, M., et al. (2016) · BMJ Open · doi:10.1136/bmjopen-2015-010822 · Cited by 52
“As mentioned earlier, this is in line with recommendations for implementation of G/TIs 32 – 34 and it is also in line with current policy imperatives priori-tising patient and public involvement in research.”
Hassan, S. Z., Chan, V. W. S., Stevens, J. E., & Stupans, I. (2021) · Systematic Reviews · doi:10.1186/s13643-021-01577-w · Cited by 58
“[100] highlight that previous reviews comparing interventions often used vote-counting to determine effect, whilst providing minimal information regarding effect sizes of interventions.”
MethodResultBlangis, F., Allali, S., Cohen, J. F., Vabres, N., Adamsbaum, C., Rey‐Salmon, C., Werner, A., Refes, Y., Adnot, P., Guen, C. G., et al. (2021) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.29068 · Cited by 57
English, R., Bachmann, M. O., Bateman, E. D., Zwarenstein, M., Fairall, L. R., Bheekie, A., Majara, B. P., Lombard, C. J., Scherpbier, R. W., & Ottomani, S. E. (2006) · BMC Pulmonary Medicine · doi:10.1186/1471-2466-6-22 · Cited by 53
“In common with other studies, cough, difficult breathing, sputum production, weight loss, and night sweats, were common presenting features in patients with bacteriologically-confirmed tuberculosis [10,21,22].”
Touzé, E., Coste, J., Voicu, M.-C., Kansao, J., Masmoudi, R., Doumenc, B., Durieux, P., & Mas, J. (2008) · Stroke · doi:10.1161/strokeaha.107.503094 · Cited by 60
“LDL cholesterol 1 g/L, n (%) 24/183 (13) 85/155 (55) 79/159 (50) 0.”
InfluentialCreating case scenarios or vignettes using factorial study design methods
Brauer, P. M., Hanning, R. M., Arocha, J. F., Royall, D., Goy, R., Grant, A., Dietrich, L., Martino, R., & Horrocks, J. (2009) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2009.05055.x · Cited by 71
Nutrition Care Process Chains: The “Missing Link” between Research and Evidence-Based Practice
Thompson, K. L., Davidson, P., Swan, W. I., Hand, R. K., Rising, C. J., Dunn, A. V., Lewis, N., & Murphy, W. J. (2015) · Journal of the Academy of Nutrition and Dietetics · doi:10.1016/j.jand.2015.04.014 · Cited by 51
Ketelaar, M., Russell, D. J., & Gorter, J. W. (2008) · Physical & Occupational Therapy In Pediatrics · doi:10.1080/01942630802192610 · Cited by 52
Farley, K., Thompson, C., Hanbury, A., & Chambers, D. (2013) · Implementation Science · doi:10.1186/1748-5908-8-56 · Cited by 51
“: the local burden of disease, the availability of ‘effective and efficient healthcare interventions,’ and ‘local evidence of current suboptimal performance’ [4].”
BackgroundInfluentialChanging Behavior Using Ecological Models
Salmon, J., Hesketh, K. D., Arundell, L., Downing, K. L., & Biddle, S. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108677318.017 · Cited by 89
Wright, J., Bibby, J., Eastham, J., Harrison, S., McGeorge, M., Patterson, C., Price, N., Russell, D., Russell, I., Small, N., et al. (2007) · Quality and Safety in Health Care · doi:10.1136/qshc.2006.019778 · Cited by 53
Dissemination of evidence‐based mental health interventions: importance to the trauma field
Katon, W. J., Zatzick, D., Bond, G., & Williams, J. (2006) · Journal of Traumatic Stress · doi:10.1002/jts.20147 · Cited by 50
Bahtsevani, C., Willman, A., Stoltz, P. H., & Östman, M. (2010) · Scandinavian Journal of Caring Sciences · doi:10.1111/j.1471-6712.2009.00743.x · Cited by 76
Sustained effects of online genetics education: a randomized controlled trial on oncogenetics
Houwink, E. J. F., van Teeffelen, S. R., Muijtjens, A. M. M., Henneman, L., Jacobi, F., van Luijk, S. J., Dinant, G., van der Vleuten, C. P. M., & Cornel, M. C. (2013) · European Journal of Human Genetics · doi:10.1038/ejhg.2013.163 · Cited by 54
Connecting Research to Action: Perspectives on Research Utilisation
Gray, M., Sharland, E., Heinsch, M., & Schubert, L. (2014) · The British Journal of Social Work · doi:10.1093/bjsw/bcu089 · Cited by 57
“As Grimshaw et al. (2004) put it, ‘the implementation of most clinical guidelines requires changing the system and, hence, organizational as well as individual change’ (p. 591).”
BackgroundFrønsdal, K. B., Facey, K. M., Klemp, M., Norderhaug, I. N., Mørland, B., & Røttingen, J. (2010) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462310000309 · Cited by 50
Newton, A. S., Zou, B., Hamm, M. P., Curran, J., Gupta, S., Dumonceaux, C., & Lewis, M. (2010) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.2009.00640.x · Cited by 53
A qualitative study of the variable effects of audit and feedback in the ICU
Sinuff, T., Muscedere, J., Rozmovits, L., Dale, C., & Scales, D. C. (2015) · BMJ Quality & Safety · doi:10.1136/bmjqs-2015-003978 · Cited by 59
Fossum, M., Ehnfors, M., Svensson, E., Hansen, L. M., & Ehrenberg, A. (2013) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2013.05.009 · Cited by 58
Increasing smoking cessation care provision in hospitals: A meta-analysis of intervention effect
Freund, M., Campbell, E. M., Paul, C. L., Sakrouge, R., McElduff, P., Walsh, R. A., Wiggers, J., Knight, J., & Girgis, A. (2009) · Nicotine & Tobacco Research · doi:10.1093/ntr/ntp056 · Cited by 56
Newlands, R. S. N., Duncan, E., Prior, M. E., Elouafkaoui, P., Elders, A., Young, L. C., Clarkson, J., & Ramsay, C. R. (2015) · Implementation Science · doi:10.1186/s13012-016-0372-z · Cited by 64
“There is ample evidence that the implementation of guidance by health care professionals (including dentists) is variable, and understanding how to improve implementation is limited [15–18].”
BackgroundSelf-citationFung‐Kee‐Fung, M., Goubanova, E., Sequeira, K., Abdulla, A., Cook, R., Crossley, C., Langer, B., Smith, A. J., & Stern, H. (2008) · Quality Management in Health Care · doi:10.1097/01.qmh.0000316995.79167.be · Cited by 59
Jensen, C. E., Riis, A., Petersen, K. D., Jensen, M. B., & Pedersen, K. M. (2017) · Pain · doi:10.1097/j.pain.0000000000000851 · Cited by 52
“Furthermore, reviews have shown that postal dissemination of clinical practice guidelines alone is ineffective in changing practitioner behaviour and that there is a need for multifaceted implementation strategies (MuIS), which combine 2 or more components, to increase uptake.(5,17) In relation to the publication of a…”
BackgroundImplementation of treatment guidelines for specialist mental health care
Bighelli, I., Ostuzzi, G., Girlanda, F., Cipriani, A., Becker, T. M., Koesters, M., & Barbui, C. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd009780.pub3 · Cited by 79
Performance Measurement for Health System ImprovementPreprint
Smith, P., Mossialos, E. A., Papanicolas, I., & Leatherman, S. T. (2010) · RePEc: Research Papers in Economics · Cited by 50
Kastner, M., Estey, E. A., Hayden, L., Chatterjee, A., Grudniewicz, A., Graham, I. D., & Bhattacharyya, O. K. (2014) · BMC Family Practice · doi:10.1186/1471-2296-15-19 · Cited by 56
“However these strategies have had modest impact on quality of care with highly variable costs [6].”
BackgroundErdem, S., & Thompson, C. A. (2014) · BMC Health Services Research · doi:10.1186/1472-6963-14-360 · Cited by 50
“The strength of the evidence underpinning effectiveness is a determinant of innovation diffusion and adoption [36,37].”
BackgroundResearch Dissemination and Diffusion: Translation Within Science and Society
Kerner, J. F., & Hall, K. L. (2009) · Research on Social Work Practice · doi:10.1177/1049731509335585 · Cited by 50
“As Grimshaw et al. (2004) note, given this implementation complexity, decision makers need to exercise considerable judgment about how best to use the limited resources they have for clinical decision making to maximize benefits.”
BackgroundMethodFlanagan, M. E., Ramanujam, R., & Doebbeling, B. N. (2009) · Implementation Science · doi:10.1186/1748-5908-4-71 · Cited by 49
“Background Improving the quality of patient care requires the effective implementation of clinical practice guidelines (CPGs) that promote interventions of proven benefit and discourage ineffective interventions [1].”
de Lusignan, S., Gallagher, H., Chan, T., Thomas, N., van Vlymen, J. N., Nation, M., Jain, N., Tahir, A., du Bois, E., Crinson, I., et al. (2009) · Implementation Science · doi:10.1186/1748-5908-4-39 · Cited by 52
“The most commonly used strategy is dissemination of clinical practice guidelines with prompts [18].”
Howes, D. W., Gray, S. H., Brooks, S. C., Boyd, J. G., Djogovic, D., Golan, E., Green, R. S., Jacka, M. J., Sinuff, T., Chaplin, T., et al. (2015) · Resuscitation · doi:10.1016/j.resuscitation.2015.07.052 · Cited by 58
Minen, M. T., Shome, A., Halpern, A., Tishler, L. W., Brennan, K. C., Loder, E., Lipton, R. B., & Silbersweig, D. (2016) · Headache The Journal of Head and Face Pain · doi:10.1111/head.12803 · Cited by 52
“3 (5-80) 10–20% 18 Which medications contribute to rebound/medication overuse headache? NSAIDs – 85.”
BackgroundHofstede, S. N., de Mheen, P. J. M., Vlieland, T. P. M. V., van den Ende, C. H. M., Nelissen, R. G. H. H., & van Bodegom‐Vos, L. (2016) · PLoS ONE · doi:10.1371/journal.pone.0147406 · Cited by 51
Changing Behavior Using Self-Determination Theory
Hagger, M. S., Hankonen, N. E., Chatzisarantis, N. L. D., & Ryan, R. M. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108677318.008 · Cited by 83
The Role of Self-Monitoring and Response Inhibition in Improving Sleep Behaviours
Todd, J., & Mullan, B. A. (2013) · International Journal of Behavioral Medicine · doi:10.1007/s12529-013-9328-8 · Cited by 57
“A majority of young people have irregular and insufficient sleep, with tension and stress being the greatest predictor of poor sleep quality [1].”
BackgroundUndergraduate medical education accreditation as a driver of lifelong learning
Simon, F. A., & Aschenbrener, C. A. (2005) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.23 · Cited by 49
Development of a mentorship strategy: A knowledge translation case study
Straus, S. E., Graham, I. D., Taylor, M., & Lockyer, J. (2008) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.179 · Cited by 50
“This was done with attention to the limited evidence supporting change in the presence of focused and planned interventions.(12) Following development of the key messages, strategies and targets for dissemination were outlined ~TABLE 1!.”
MethodWiener-Ogilvie, S., Huby, G., Pinnock, H., Gillies, J., & Sheikh, A. (2008) · BMC Family Practice · doi:10.1186/1471-2296-9-32 · Cited by 48
“While many approaches have been trialled to improve guideline implementation [7-13], evidence to support decisions about which guideline dissemination and implementation strategies are effective, under different circumstances, is limited [14].”
BackgroundFrom practice guidelines to clinical decision support: closing the loop
Fox, J., Patkar, V., Chronakis, I., & Beǵent, R. H. J. (2009) · Journal of the Royal Society of Medicine · doi:10.1258/jrsm.2009.090010 · Cited by 60
O’Rielly, C. M., Ng-Kamstra, J. S., Kania‐Richmond, A., Dort, J. C., White, J. S., Robert, J., Brindle, M. E., & Sauro, K. M. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-043966 · Cited by 57
Kampman, M. T., Johansen, S.-V., Stenvold, H., & Acharya, G. (2005) · Epilepsia · doi:10.1111/j.1528-1167.2005.04205.x · Cited by 48
“We hope that further research will identify interventions that more effectively alter professional behaviour (8).”
BackgroundInfluentialPrediction of health professionals' intention to screen for decisional conflict in clinical practice
Légaré, F., Graham, I. D., O’Connor, A. C., Aubin, M., Baillargeon, L., Leduc, Y., & Maziade, J. (2007) · Health Expectations · doi:10.1111/j.1369-7625.2007.00465.x · Cited by 48
Mendelian Randomization analysis of the causal effect of adiposity on hospital costs
Dixon, P., Hollingworth, W., Harrison, S., Davies, N. M., & Davey Smith, G. (2020) · Journal of Health Economics · doi:10.1016/j.jhealeco.2020.102300 · Cited by 48
Presseau, J., Francis, J. J., Campbell, N. C., & Sniehotta, F. F. (2011) · Implementation Science · doi:10.1186/1748-5908-6-73 · Cited by 47
“In their review of the effectiveness of guidelines for changing health professionals’ behaviour, Grimshaw and colleagues argued for the need for testing and developing theory [26].”
Vecchio, A. L., Giannattasio, A., Duggan, C., Masi, S. D., Ortisi, M. T., Parola, L., & Guarino, A. (2010) · Journal of Pediatric Gastroenterology and Nutrition · doi:10.1097/mpg.0b013e3181e233ac · Cited by 48
Electronic decision support for diagnostic imaging in a primary care setting
Curry, L., & Reed, M. H. (2011) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000049 · Cited by 56
“Median improvement in practice with this methodology was 14% as opposed to half that amount from dissemination of educational materials (8%), audit and feedback (7%), and multifaceted educational intervention involving educational outreach (detailing) (6%).”
MethodGattellari, M., Donnelly, N., Taylor, N. F., Meerkin, M., Hirst, G., & Ward, J. (2005) · Family Practice · doi:10.1093/fampra/cmi028 · Cited by 52
MacFarlane, A., O’Donnell, C., Mair, F., O’Reilly-de Brún, M., de Brún, T., Spiegel, W., van den Muijsenbergh, M., van Weel-Baumgarten, E., Lionis, C., Burns, N., et al. (2012) · Implementation Science · doi:10.1186/1748-5908-7-111 · Cited by 47
Grimshaw, J., Presseau, J., Tetroe, J., Eccles, M., Francis, J., Godin, G., Graham, I. D., Hux, J. E., Johnston, M., Légaré, F., et al. (2014) · Implementation Science · doi:10.1186/1748-5908-9-86 · Cited by 50
“The interventions in the OPEM trial were chosen based on empirical evidence of their potential effectiveness across a number of conditions and settings [16], rather than any specific, or theoretically driven, assessment of the determinants of retinopathy screening.”
Self-citationFigg-Latham, J., & Rajendran, D. (2016) · Musculoskeletal Science and Practice · doi:10.1016/j.math.2016.10.006 · Cited by 56
Loeffen, E. A. H., Kremer, L. C. M., Mulder, R. L., Font‐Gonzalez, A., Dupuis, L. L., Sung, L., Robinson, P. D., van de Wetering, M. D., & Tissing, W. J. E. (2016) · Supportive Care in Cancer · doi:10.1007/s00520-016-3501-y · Cited by 54
Edwards, H. E., Chang, A. M., Gibb, M., Finlayson, K. J., Parker, C. N., OʼReilly, M., McDowell, J., & Shuter, P. (2017) · Journal of Clinical Nursing · doi:10.1111/jocn.13752 · Cited by 52
“Moderate improvements in the process of care can also be achieved with the use of reminders, for example stickers in residents’ medical records, and electronic reminders (Grimshaw et al. 2004, French et al. 2012).”
BackgroundKovacs, E., Strobl, R., Phillips, A., Stephan, A., Müller, M., Gensichen, J. S., & Grill, E. (2018) · Journal of General Internal Medicine · doi:10.1007/s11606-018-4435-5 · Cited by 55
Ospina, M. B., Taenzer, P., Rashiq, S., MacDermid, J. C., Carr, E., Chojecki, D., Harstall, C., & Henry, J. L. (2013) · Pain Research and Management · doi:10.1155/2013/120784 · Cited by 48
Boivin, A., Légaré, F., & Gagnon, M. (2008) · Journal of Health Services Research & Policy · doi:10.1258/jhsrp.2007.007052 · Cited by 50
Measures for assessing practice change in medical practitioners
Hakkennes, S., & Green, S. (2006) · Implementation Science · doi:10.1186/1748-5908-1-29 · Cited by 51
“The number of studies reported in this review that included cost as an outcome is less than the 63 as reported by Grimshaw et al. [2].”
InfluentialPreventing tomorrow's sudden cardiac death today
Al‐Khatib, S. M., Sanders, G. D., Carlson, M. D., Cicic, A., Curtis, A. B., Fonarow, G. C., Groeneveld, P. W., Hayes, D. L., Heidenreich, P. A., Mark, D. B., et al. (2008) · American Heart Journal · doi:10.1016/j.ahj.2008.05.027 · Cited by 52
A practitioner's guide to developing critical appraisal skills
Brignardello‐Petersen, R., Carrasco‐Labra, A., Shah, P. S., & Azarpazhooh, A. (2013) · The Journal of the American Dental Association · doi:10.14219/jada.archive.2013.0187 · Cited by 48
Boström, A., Soest, D. V., Kolewaski, B., Milke, D. L., & Estabrooks, C. A. (2010) · Journal of the American Medical Directors Association · doi:10.1016/j.jamda.2010.07.005 · Cited by 47
Rutten, G. M., Kremers, S., Rutten, S. T., & Harting, J. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.04.004 · Cited by 54
Grimshaw, J., Eccles, M., Steen, N., Johnston, M., Pitts, N. B., Glidewell, L., MacLennan, G., Thomas, R. E., Bonetti, D. L., & Walker, A. E. (2011) · Implementation Science · doi:10.1186/1748-5908-6-55 · Cited by 51
“This research demonstrates that dissemination and implementation interventions can be effective, but provides little information to guide the choice or optimise the components of such complex interventions in practice [12,13].”
BackgroundSelf-citationCooke, J., Alexander, K., Charani, E., Hand, K. S. P., Hills, T., Howard, P., Jamieson, C., Lawson, W., Richardson, J., & Wade, P. (2010) · Journal of Antimicrobial Chemotherapy · doi:10.1093/jac/dkq367 · Cited by 48
Sinnema, H., Majo, M. C., Volker, D., Hoogendoorn, A., Terluin, B., Wensing, M., & van Balkom, A. (2015) · Implementation Science · doi:10.1186/s13012-015-0210-8 · Cited by 45
“Previous studies have shown that interventions targeting medical professionals’ adherence to guidelines can increase adherence by up to 10% [44].”
BackgroundSelf-citationSalvador‐Carulla, L., Lukersmith, S., & Sullivan, W. F. (2017) · Epidemiology and Psychiatric Sciences · doi:10.1017/s2045796016000767 · Cited by 53
“Yet the translation of research evidence, implementation of guideline recommendations to health care practice faces significant challenges (Grimshaw et al. 2004; Grol & Buchan, 2006), particularly in highly complex areas such as mental health, where guidelines should be developed under conditions…”
Backgroundmembers of the Guidelines International Network Implementation Working Group, Liang, L., Safi, J. A., & Gagliardi, A. R. (2017) · Implementation Science · doi:10.1186/s13012-017-0668-7 · Cited by 50
“Over the last three decades, a plethora of research has shown that, despite their proven benefits [2], guidelines are widely underused, leading to suboptimal health services and poor patient outcomes [3–5].”
BackgroundNew Rules on Patient’s Safety and Professional Liability for the Italian Health Service
Albolino, S., Bellandi, T., Cappelletti, S., Paolo, M. D., Fineschi, V., Frati, P., Offidani, C., Tanzini, M., Tartaglia, R., & Turillazzi, E. (2019) · Current Pharmaceutical Biotechnology · doi:10.2174/1389201020666190408094016 · Cited by 58
Tappenden, P., Saccardi, R., Confavreux, C., Sharrack, B., Muraro, P. A., Mancardi, G., Kozák, T., Farge, D., Madan, J. J., Rafia, R., et al. (2009) · Bone Marrow Transplantation · doi:10.1038/bmt.2009.305 · Cited by 46
Getting Research into Clinical Practice – Barriers and Solutions
Clarkson, J. (2004) · Caries Research · doi:10.1159/000077772 · Cited by 47
“%) were cluster randomised controlled trials [Grimshaw et al., 2001, 2004].”
BackgroundBarasa, E., Ayieko, P., Cleary, S., & English, M. (2012) · PLoS Medicine · doi:10.1371/journal.pmed.1001238 · Cited by 47
“In analyzing the costs, we included the costs of developing clinical guidelines that are often left out in such analyses [25].”
BackgroundUnderstanding paediatric rehabilitation therapists' lack of use of outcome measures
King, G. A., Wright, F. V., & Russell, D. J. (2011) · Disability and Rehabilitation · doi:10.3109/09638288.2011.582924 · Cited by 56
“A recent review of EBP in children’s mental health indicated that measurement training had little effect on practitioners’ use of measures and proposed that participatory approaches considering therapists’ needs and preferences are required [17].”
BackgroundInfluentialDuff, J. S., Walker, K., & Omari, A. (2010) · Worldviews on Evidence-Based Nursing · doi:10.1111/j.1741-6787.2010.00209.x · Cited by 54
Puspitasari, A. J., Heredia, D., Gentry, M., Sawchuk, C., Theobald, B., Moore, W., Tiede, M., Galardy, C., & Schak, K. (2021) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2021.05.002 · Cited by 45
“, 2012, 2015) and frameworks can help ensure the effective translation of best practices into clinical practice (Grimshaw et al., 2004).”
Castor, C., Hallström, I., Hansson, H., & Landgren, K. (2017) · Journal of Clinical Nursing · doi:10.1111/jocn.13821 · Cited by 56
“There is scarce evidence on how to best facilitate implementation in healthcare services (Grimshaw et al., 2004) and no approach has been shown to stand superior to any other approach (Grol & Grimshaw, 2003).”
BackgroundSetkowski, K., Boogert, K., Hoogendoorn, A. W., Gilissen, R., & van Balkom, A. J. L. M. (2021) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.13332 · Cited by 50
Mahan, C. E., & Spyropoulos, A. C. (2010) · Hospital Practice · doi:10.3810/hp.2010.02.284 · Cited by 52
Gifford, W. A., Davies, B., Graham, I. D., Lefebre, N., Tourangeau, A., & Woodend, K. (2008) · Implementation Science · doi:10.1186/1748-5908-3-51 · Cited by 43
Clinical Practice Guidelines for Delirium Management: Potential Application in Palliative Care
Bush, S. H., Bruera, E. D., Lawlor, P. G., Kanji, S., Davis, D. H. J., Agar, M. R., Wright, D. K., Hartwick, M., Currow, D. C., Gagnon, B., et al. (2014) · Journal of Pain and Symptom Management · doi:10.1016/j.jpainsymman.2013.09.023 · Cited by 46
“The implementation of guidelines requires ongoing education, organizational change, management ‘‘buy in,’’ and budgetary support.(9,38,53) Long-term organizational support is also critical to ensure sustainability.”
Hart, L., Damiano, S. R., Chittleborough, P., Paxton, S. J., & Jorm, A. F. (2014) · Body Image · doi:10.1016/j.bodyim.2014.06.010 · Cited by 55
Knowles, S., Lam, L. T.-M., McInnes, E., Elliott, D., Hardy, J., & Middleton, S. (2015) · BMC Nursing · doi:10.1186/s12912-015-0056-z · Cited by 50
“A tailored multi-faceted implementation intervention was developed to optimise uptake of the new BMP into practice [22,34].”
BackgroundMethodThe Influence of Black Race on Treatment and Mortality for Early-Stage Breast Cancer
Berz, J. P. B., Johnston, K. T., Backus, B. M., Doros, G. D., Rose, A. J., Pierre, S., & Battaglia, T. A. (2009) · Medical Care · doi:10.1097/mlr.0b013e31819e1f2b · Cited by 49
Stephan, A., Kovacs, E., Phillips, A., Schelling, J., Ulrich, S. M., & Grill, E. (2018) · Implementation Science · doi:10.1186/s13012-018-0716-y · Cited by 59
“This presents a unique chance for action, since appropriate support measures accompanying guideline introduction have the potential to increase guideline use and effectiveness [13], for example through identifying and addressing barriers of adequate disease management.”
Background
Metadata
- Authors
- Grimshaw, J., Thomas, R., MacLennan, G., Fraser, C., Ramsay, C., Vale, L., Whitty, P., Eccles, M., Matowe, L., Shirran, L., Wensing, M., Dijkstra, R., & Donaldson, C.
- Affiliations
- University of Aberdeen (GB)
- Newcastle University (GB)
- Radboud University Nijmegen (NL)
- University of Calgary (CA)
- Venue
- Health Technology Assessment
- Published
- 2004-02
- Volume
- 8
- Issue
- 6
- Pages
- iii-iv, 1
- ISSN
- 1366-5278 (ISSN-L)
- 2046-4924
- OpenAlex
- W2038028146
- Cited by
- 3,044
- References
- 38
- Citations by year
- 2026: 45 · 2025: 45 · 2024: 72 · 2023: 65 · 2022: 69 · 2021: 100 · 2020: 163 · 2019: 87 · 2018: 112 · 2017: 129 · 2016: 133 · 2015: 184 · 2014: 188 · 2013: 288 · 2012: 167
- FWCI
- 20.52
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- Locations
- Health Technology Assessment (publishedVersion, other-oa)
- PubMed (publishedVersion)
- Radboud Repository (Radboud University) (submittedVersion, other-oa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Radboud Repository (Radboud University) (submittedVersion)
- Newcastle University ePrints (Newcastle Univesity)
- Funders
- Health Technology Assessment programme (94/08/29)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Keywords
- guideline dissemination, guideline implementation, guideline development, multicomponent intervention, educational outreach, reminders, audit and feedback, teaching materials, cost-effectiveness, resource requirements, clinical governance, primary care, secondary care, evidence-based recommendations, process indicators, healthcare quality improvement
- MeSH terms
- Cost-Benefit Analysis, United Kingdom, Medical Informatics, State Medicine, Practice Guidelines as Topic, Information Dissemination
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.