Effectiveness and efficiency of guideline dissemination and implementation strategies
Open accessThe DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Abstract
OBJECTIVES: To undertake a systematic review of the effectiveness and costs of different guideline development, dissemination and implementation strategies. To estimate the resource implications of these strategies. To develop a framework for deciding when it is efficient to develop and introduce clinical guidelines. DATA SOURCES: MEDLINE, Healthstar, Cochrane Controlled Trial Register, EMBASE, SIGLE and the specialised register of the Cochrane Effective Practice and Organisation of Care (EPOC) group. REVIEW METHODS: Single estimates of dichotomous process variables were derived for each study comparison based upon the primary end-point or the median measure across several reported end-points. Separate analyses were undertaken for comparisons of different types of intervention. The study also explored whether the effects of multifaceted interventions increased with the number of intervention components. Studies reporting economic data were also critically appraised. A survey to estimate the feasibility and likely resource requirements of guideline dissemination and implementation strategies in UK settings was carried out with key informants from primary and secondary care. RESULTS: In total, 235 studies reporting 309 comparisons met the inclusion criteria; of these 73% of comparisons evaluated multifaceted interventions, although the maximum number of replications of a specific multifaceted intervention was 11 comparisons. Overall, the majority of comparisons reporting dichotomous process data observed improvements in care; however, there was considerable variation in the observed effects both within and across interventions. Commonly evaluated single interventions were reminders, dissemination of educational materials, and audit and feedback. There were 23 comparisons of multifaceted interventions involving educational outreach. The majority of interventions observed modest to moderate improvements in care. No relationship was found between the number of component interventions and the effects of multifaceted interventions. Only 29.4% of comparisons reported any economic data. The majority of studies only reported costs of treatment; only 25 studies reported data on the costs of guideline development or guideline dissemination and implementation. The majority of studies used process measures for their primary end-point, despite the fact that only three guidelines were explicitly evidence based (and may not have been efficient). Respondents to the key informant survey rarely identified existing budgets to support guideline dissemination and implementation strategies. In general, the respondents thought that only dissemination of educational materials and short (lunchtime) educational meetings were generally feasible within current resources. CONCLUSIONS: There is an imperfect evidence base to support decisions about which guideline dissemination and implementation strategies are likely to be efficient under different circumstances. Decision makers need to use considerable judgement about how best to use the limited resources they have for clinical governance and related activities to maximise population benefits. They need to consider the potential clinical areas for clinical effectiveness activities, the likely benefits and costs required to introduce guidelines and the likely benefits and costs as a result of any changes in provider behaviour. Further research is required to: develop and validate a coherent theoretical framework of health professional and organisational behaviour and behaviour change to inform better the choice of interventions in research and service settings, and to estimate the efficiency of dissemination and implementation strategies in the presence of different barriers and effect modifiers.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, recent reviews (Farmer 2008; Grimshaw 2004) found that printed educational materials have a small (but potentially important) effect.”
From Audit and feedback: effects on professional practice and healthcare outcomes (2012) · cites this paper as Grimshaw 2004
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“while a systematic review of 235 implementation trials by Grimshaw et al. found no relationship between the number of component interventions and the effects of multifaceted interventions [100].”
From Writing implementation research grant proposals: ten key ingredients (2012) · cites this paper as [100]
The cited source says what the claim attributes to it.
In the citing paper
“It is important to note that the high frequency of educational interventions is not exclusive to the allied health professions, and a similar trend is seen in nursing [11] and in the guideline implementation literature, which is largely dominated by physicians [6].”
From Systematic review of knowledge translation strategies in the allied health professions (2012) · cites this paper as [6]
In the citing paper
“The empirical evidence for the effectiveness of multifaceted strategies has been mixed, because early research touted the benefits of multifaceted strategies [98,99], while a systematic review of 235 implementation trials by Grimshaw et al. found no relationship between the number of component interventions and the effects of multifaceted interventions [100].”
From Writing implementation research grant proposals: ten key ingredients (2012) · cites this paper as [100]
In the citing paper
“the bulk of the research evidence comes from the medical e.g., [4-9] and nursing literature e.g., [10,11].”
From Systematic review of knowledge translation strategies in the allied health professions (2012) · cites this paper as [6]
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2005) · Technometrics · doi:10.1198/tech.2005.s303 · Cited by 17,923
Methods for the Economic Evaluation of Health Care Programmes
Drummond, M. E., Sculpher, M. J., Torrance, G. W., O’Brien, B. J., & Stoddart, G. L. (2005) · doi:10.1093/oso/9780198529446.001.0001 · Cited by 13,648
(1979) · Medical Entomology and Zoology · Cited by 11,252
Quasi-experimentation: Design and analysis issues for field settings
Shrout, P. E. (1980) · Evaluation and Program Planning · doi:10.1016/0149-7189(80)90063-4 · Cited by 6,010
The cochrane database of systematic reviews
Geddes, J. (1996) · Journal of Psychosomatic Research · doi:10.1016/s0022-3999(96)90063-x · Cited by 5,989
Clinical guidelines: Potential benefits, limitations, and harms of clinical guidelines
Woolf, S. H., Grol, R., Hutchinson, A., Eccles, M., & Grimshaw, J. (1999) · BMJ · doi:10.1136/bmj.318.7182.527 · Cited by 2,548
Self-citationSystematic Reviews: Identifying relevant studies for systematic reviews
Dickersin, K., Scherer, R., & Lefebvre, C. (1994) · BMJ · doi:10.1136/bmj.309.6964.1286 · Cited by 2,256
Effectiveness and Efficiency: Random Reflections on Health Services
(1973) · Public Health · doi:10.1016/s0033-3506(73)80082-4 · Cited by 1,912
Guidelines for authors and peer reviewers of economic submissions to the BMJ
Drummond, M. F., & Jefferson, T. O. (1996) · BMJ · doi:10.1136/bmj.313.7052.275 · Cited by 1,827
Davis, D. A. (1995) · JAMA · doi:10.1001/jama.1995.03530090032018 · Cited by 1,763
Research works printed but not linked: 12
- [2]2. NHS Centre for Reviews and Dissemination. Getting evidence into practice. Effective Health Care 1999; 5 :1-16.
- [4]4. NHS Centre for Reviews and Dissemination and Nuffield Institute for Health. Implementing clinical guidelines. Can guidelines be used to improve clinical practice? Effective Health Care 1994; 1 :1-12.
- [9]9. Thomas L, Cullum N, McColl E, Rousseau N, Soutter J, Steen N. Clinical guidelines in nursing, midwifery and other professions allied to medicine (Cochrane Review). The Cochrane Library (Issue 1). Oxford: Update Software; 1999.
- [10]10. Bero L, Grilli R, Grimshaw JM, Mowatt G, Oxman A, Zwarenstein M. Cochrane Effective Practice and Organisation of Care Review Group (Cochrane Group Module). In Bero L, Grilli R, Grimshaw JM, Mowatt G, Oxman A, Zwarenstein M, editors. The Cochrane Library (Issue 3). Oxford: Update Software; 2001.
- [16]16. Bushman BJ. Vote counting methods in metaanalysis. In Cooper H, Hedges L, editors. The handbook of research synthesis. New York: Russell Sage Foundation; 1994; pp. 193-213.
- [17]17. Drummond M, O'Brien B, Stoddart G, Torrance GW. Methods of economic evaluation of health care programmes. Oxford: Oxford University Press; 1997.
- [18]18. McIntosh E. Economic evaluation of guideline implementation studies. In Makela M, Thorsen T, editors. Changing professional practice. Theory and practice of clinical guidelines implementation. Copenhagen: Danish Institute for Health Services Research and Development; 1999, pp. 77-98.
- [21]21. Jefferson TO, Demicheli V , Vale L. Methodological reviews of economic evaluations in health care. JAMA 2002; 287 :2809-12.
- [24]24. Mason J, Freemantle N, Nazereth I, Eccles M, Haines A, Drummond M. When is it cost effective - to change the behaviour of health professionals? JAMA 2001; 286 :2988-92.
- [27]27. Purves IN. PRODIGY: implementing clinical guidelines using computers. Br J Gen Pract 1998; 48 :1552-3.
- [34]34. Grol R. Beliefs and evidence in changing clinical practice. BMJ 1997; 315 :418-21.
- [36]36. Grimshaw JM, Eccles MP . Clinical practice guidelines. In Haines A, Silagy C, editors. Evidencebased practice in primary care. London: BMJ Publishing; 2001, pp. 120-34.
Cited by
Items 801–900 of 1,009
Knowledge translation and guidelines: a transfer, translation or transformation process?
Kitson, A. A. (2009) · International Journal of Evidence-Based Healthcare · doi:10.1111/j.1744-1609.2009.00130.x · Cited by 56
Choi, T., Choi, J., Lee, J. A., Jun, J. H., Park, B., & Lee, M. S. (2015) · Implementation Science · doi:10.1186/s13012-015-0294-1 · Cited by 41
“To improve clinical practice and health outcomes, both well-developed CPGs and effective methods of CPG implementation are required [38].”
MethodEccles, M. P., Johnston, M., Hrisos, S., Francis, J., Grimshaw, J., Steen, N., & Kaner, E. F. (2007) · Implementation Science · doi:10.1186/1748-5908-2-27 · Cited by 37
“While the effectiveness of interventions varies across different clinical problems, contexts, and organizations [18], studies provide scant theoretical or conceptual rationale for their choice of intervention [19].”
Self-citationTheory-based identification of barriers to quality improvement: induced abortion care
Foy, R. (2005) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzi017 · Cited by 38
“continuing medical education, reminders) but little is known about why these work in some circumstances rather than others [5].”
BackgroundEmery, J. D., Gray, V., Walter, F. M., Cheetham, S., Croager, E. J., Slevin, T. J., Saunders, C. M., Threlfall, T. J., Auret, K. A., Nowak, A. K., et al. (2017) · British Journal of Cancer · doi:10.1038/bjc.2017.310 · Cited by 40
“The GP resource card was implemented through a series of four academic detailing practice visits, supplemented by a series of case studies completed between visits designed to reinforce key messages (Grimshaw et al, 2004).”
Kastner, M., & Straus, S. E. (2008) · Journal of General Internal Medicine · doi:10.1007/s11606-008-0812-9 · Cited by 45
Lühnen, J., Albrecht, M., Hanßen, K., Hildebrandt, J., & Steckelberg, A. (2015) · Zeitschrift für Evidenz Fortbildung und Qualität im Gesundheitswesen · doi:10.1016/j.zefq.2015.03.004 · Cited by 37
Mousquès, J., Renaud, T., & Scemama, O. (2010) · Social Science & Medicine · doi:10.1016/j.socscimed.2009.12.016 · Cited by 52
Welch, C. E., Lunen, B. L. V., Hankemeier, D. A., Wyant, A. L., Mutchler, J. M., Pitney, W. A., & Hays, D. G. (2014) · Journal of Athletic Training · doi:10.4085/1062-6050-49.2.14 · Cited by 43
Irimu, G., Greene, A. C., Gathara, D., Kihara, H., Maina, C., Mbori‐Ngacha, D., Zurovac, D., Migiro, S., & English, M. (2014) · BMC Health Services Research · doi:10.1186/1472-6963-14-59 · Cited by 47
Cahill, N. E., Murch, L., Cook, D., Heyland, D. K., & on Behalf of the Canadian Critical Care Trials Group (2013) · Nutrition in Clinical Practice · doi:10.1177/0884533613516512 · Cited by 40
Acolet, D., Allen, E., Houston, R., Wilkinson, A. R., Costeloe, K., & Elbourne, D. (2011) · Archives of Disease in Childhood - Fetal and Neonatal Edition · doi:10.1136/adc.2010.207522 · Cited by 38
Quality assurance in psychiatry: quality indicators and guideline implementation
Wobrock, T., Weinmann, S., Falkai, P., & Gäebel, W. (2009) · European Archives of Psychiatry and Clinical Neuroscience · doi:10.1007/s00406-009-0072-7 · Cited by 46
“Several countries have initiated national clinical guideline programmes [16, 18, 36].”
BackgroundLiddy, C. E., Hogg, W. E., Russell, G. M., Wells, G. A., Armstrong, C. D., Akbari, A., Dahrouge, S., Taljaard, M., Mayo-Bruinsma, L., Singh, J., et al. (2011) · Implementation Science · doi:10.1186/1748-5908-6-110 · Cited by 41
“Changing practice behavior requires an internal organizational change of operations best achieved through a process that integrates staff roles and responsibilities in a practice-individualized manner [18,53-56].”
Tarrant, M., Haslam, C., Carter, M., Calitri, R., & Haslam, S. A. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108677318.044 · Cited by 42
Fervers, B., Carretier, J., & Bataillard, A. (2010) · Journal of Visceral Surgery · doi:10.1016/j.jviscsurg.2010.10.010 · Cited by 45
French, S. D., Green, S., Francis, J., Buchbinder, R., O’Connor, D. A., Grimshaw, J., & Michie, S. (2015) · BMJ Open · doi:10.1136/bmjopen-2015-007886 · Cited by 40
“However, implementation interventions have had limited and varied effects.(4) There is a growing body of research demonstrating that interventions to change health professional practice behaviour in line with research findings should be targeted at specific health professional clinical practice behaviours and be under…”
BackgroundSelf-citationRichardson, T. E., O’Reilly, C. L., & Chen, T. F. (2014) · International Journal of Clinical Pharmacy · doi:10.1007/s11096-014-9997-7 · Cited by 34
“To address this pharmacists reported that they regularly participated in or lead the development of internal policies for the mental health ward, yet the benefit of such policies to alter practice was believed to only be modest [43].”
BackgroundImplementation of evidence-based practices: Applying a goal commitment framework
Chou, A. F., Vaughn, T. E., McCoy, K. D., & Doebbeling, B. N. (2011) · Health Care Management Review · doi:10.1097/hmr.0b013e3181dc8233 · Cited by 36
“Although many theorists have proposedmodels to study factors influencing the implementation process, empirical tests remain limited (Grimshaw et al., 2004, 2006).”
BackgroundMatowe, L. K., Waako, P. J., Adome, R. O., Kibwage, I. O., Minzi, O., & Bienvenu, E. (2008) · Human Resources for Health · doi:10.1186/1478-4491-6-30 · Cited by 40
“However, there is abundant evidence that training alone is often insufficiently effective to change practice [5-7].”
BackgroundSelf-citationThe Physicians’ Practice Assessment Questionnaire on asthma and COPD
Boulet, L., Devlin, H. M., & O’Donnell, D. E. (2010) · Respiratory Medicine · doi:10.1016/j.rmed.2010.07.022 · Cited by 39
“This last method however also has some weaknesses, as physicians do not always record their actions following patient encounters.(17,18) In regard to the relatively short time interval between the two questionnaires, we cannot exclude the possibility of overestimating the reproducibility of the questionnaire due to a…”
MethodMihalopoulos, C., Magnus, A., Lal, A., Dell, L., Forbes, D., & Phelps, A. J. (2014) · Australian & New Zealand Journal of Psychiatry · doi:10.1177/0004867414553948 · Cited by 45
“This is a significant policy question since it is widely recognized that clinical adherence to treatment guideline publications is not necessarily a linear process and a multifactorial approach to guideline implementation is required (Grimshaw et al., 2004).”
BackgroundImplementing guidelines into clinical practice: what is the value?
Hoomans, T., Ament, A. J. H. A., Evers, S., & Severens, J. L. (2010) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2010.01557.x · Cited by 40
Institutionalization of evidence-informed practices in healthcare settings
Novotná, G., Dobbins, M., & Henderson, J. L. (2012) · Implementation Science · doi:10.1186/1748-5908-7-112 · Cited by 45
“Given that changes in clinical practice are not solely dependent on the actions of clinicians, but rather require organizational and systems support, KT strategies and interventions targeting only individual-level factors are limited in their capacity to bring about and sustain significant change [8,9].”
Schürer-Maly, C. C., Frahne, J., Lelgemann, M., Butzlaff, M. E., & Vollmar, H. C. (2006) · Methods of Information in Medicine · doi:10.1055/s-0038-1634093 · Cited by 39
From Paper Based Clinical Practice Guidelines to Declarative Workflow Management
Lyng, K. M., Hildebrandt, T., & Mukkamala, R. R. (2009) · Lecture notes in business information processing · doi:10.1007/978-3-642-00328-8_34 · Cited by 36
“Thirdly, no coherent theoretical framework of health professional and organizational behaviour and behaviour change has yet been established [12].”
BackgroundKonsensusfindung in evidenzbasierten Leitlinien – vom Mythos zur rationalen Strategie
Kopp, I., Selbmann, H.-K., & Koller, M. T. (2007) · Zeitschrift für ärztliche Fortbildung und Qualität im Gesundheitswesen - German Journal for Quality in Health Care · doi:10.1016/j.zgesun.2007.01.002 · Cited by 36
Evidence in the learning organization
Crites, G. E., McNamara, M., Akl, E. A., Richardson, W. S., Umscheid, C. A., & Nishikawa, J. (2009) · Health Research Policy and Systems · doi:10.1186/1478-4505-7-4 · Cited by 46
Ashish, K. C., Målqvist, M., Wrammert, J., Verma, S., Aryal, D. R., Clark, R. B., Naresh Pratap, K. C., Vitrakoti, R., Baral, K. P., & Ewald, U. (2012) · BMC Pediatrics · doi:10.1186/1471-2431-12-159 · Cited by 37
“Systematic review by the Effective Practice and Organization of Care (EPOC) Cochrane group showed that multi-faceted interventions - training and supervision - improve health workers’ performance [17-19].”
BackgroundSupported local implementation of clinical guidelines in psychiatry: a two-year follow-up
Forsner, T., Wistedt, A. Å., Brommels, M., Janszky, I., de Leon, A. P., & Forsell, Y. (2010) · Implementation Science · doi:10.1186/1748-5908-5-4 · Cited by 36
“Background Transferring research results into routine clinical practice is complicated; several studies have described implementation difficulties and the complexity of achieving performance change in health care [1,2].”
BackgroundPeters-Klimm, F., Campbell, S., Müller‐Tasch, T., Schellberg, D., Gelbrich, G., Herzog, W., & Szécsényi, J. (2009) · Trials · doi:10.1186/1745-6215-10-68 · Cited by 39
“However, the evidence for the effectiveness and efficiency of general practice based clinical practice guidelines is limited [20-22].”
BackgroundThomas, S., & Mackintosh, S. F. (2014) · Physical Therapy · doi:10.2522/ptj.20130412 · Cited by 43
the Translation Research in a Dental Setting (TRiaDS) Research Methodology Group, Prior, M., Elouafkaoui, P., Elders, A., Young, L., Duncan, E. M., Newlands, R., Clarkson, J. E., & Ramsay, C. R. (2014) · Implementation Science · doi:10.1186/1748-5908-9-50 · Cited by 36
“This was highlighted in the Health Technology Assessment (HTA) systematic review of the effectiveness and efficiency of guideline dissemination and implementation strategies [8], which found evidence that although dissemination and implementation of guidance could lead to compliance with recommendations, the effect va…”
BackgroundSelf-citationGuthrie, B., Thompson, A., Dumbreck, S., Flynn, A., Alderson, P., Nairn, M., Treweek, S. P., & Payne, K. (2017) · Health Services and Delivery Research · doi:10.3310/hsdr05160 · Cited by 42
Willis, T. A., Collinson, M., Glidewell, L., Farrin, A. J., Holland, M., Meads, D. M., Hulme, C. T., Petty, D. R., Alderson, S. L., Hartley, S., et al. (2020) · PLoS Medicine · doi:10.1371/journal.pmed.1003045 · Cited by 38
“Furthermore, the clinical significance of behaviours often targeted in implementation studies, such as receipt of processes of care or investigations, is doubtful [6].”
BackgroundDenno, D. M., Plesons, M., & Chandra‐Mouli, V. (2020) · International Journal of Adolescent Medicine and Health · doi:10.1515/ijamh-2019-0245 · Cited by 44
Metz, A. J. R., Kainz, K., & Boaz, A. (2023) · Frontiers in Health Services · doi:10.3389/frhs.2022.959386 · Cited by 45
Von Leitlinien zur Qualitätssicherung
Kopp, I. (2011) · Bundesgesundheitsblatt - Gesundheitsforschung - Gesundheitsschutz · doi:10.1007/s00103-010-1207-8 · Cited by 48
Exercise training programs in Dutch cardiac rehabilitation centres
Vromen, T., Spee, R. F., Kraal, J. J., Peek, N. B., van Engen-Verheul, M. M., Kraaijenhagen, R. A., Gijsbers, H., & Kemps, H. (2013) · Netherlands Heart Journal · doi:10.1007/s12471-013-0374-2 · Cited by 42
“Strategies for achieving better guideline implementation should be attuned to the specific barriers that are obstructing it [26].”
BackgroundEvidence-based medicine in psychopharmacotherapy: possibilities, problems and limitations
Möller, H., & Maier, W. (2009) · European Archives of Psychiatry and Clinical Neuroscience · doi:10.1007/s00406-009-0070-9 · Cited by 39
Scott, I. A., Poole, P., & Jayathissa, S. (2007) · Internal Medicine Journal · doi:10.1111/j.1445-5994.2007.01456.x · Cited by 36
Sauro, K. M., Wiebe, S., Perucca, E., French, J. A., Dunkley, C., de Marinis, A., Kirkpatrick, M., & Jetté, N. (2015) · Epilepsia · doi:10.1111/epi.13217 · Cited by 41
“Therefore, quality indicators or metrics are often developed to measure the quality of care over time using a before-and-after or interrupted time series design.(35,42) Because quality indicators are based on CPGs, it is not onerous to propose auditing measures or quality indicators that could be assessed based on the…”
BackgroundSlade, S. C., Kent, P., Bucknall, T., Molloy, E., Patel, S., & Buchbinder, R. (2015) · BMJ Open · doi:10.1136/bmjopen-2014-007265 · Cited by 35
Opondo, C., Ayieko, P., Ntoburi, S., Wagai, J. N., Opiyo, N., Irimu, G., Allen, E., Carpenter, J. R., & English, M. (2011) · BMC Pediatrics · doi:10.1186/1471-2431-11-109 · Cited by 39
“Studies in a variety of settings and clinical fields generally show that guidelines improve processes and outcomes of care [27].”
BackgroundCardarelli, R., Reese, D. R., Roper, K. L., Cardarelli, K., Feltner, F. J., Studts, J. L., Knight, J. R., Armstrong, D. K., Weaver, A. D., & Shaffer, D. C. (2016) · Cancer Epidemiology · doi:10.1016/j.canep.2016.11.003 · Cited by 39
“The impact of the recommendation itself, however, is likely to be minimal unless efforts are made to overcome implementation delays and barriers to awareness and uptake of evidence-based screening guidelines.(7) Early studies on implementation of LDCT screening show that patients are not aware of the recommendation(8)…”
An Overview of Practice Facilitation Programs in Canada: Current Perspectives and Future Directions
Liddy, C. E., Laferriere, D., Baskerville, B., Dahrouge, S., Knox, L. M., & Hogg, W. E. (2013) · Healthcare policy · doi:10.12927/hcpol.2013.23177 · Cited by 40
“The challenge to improving primary care often lies in the inability of practices to implement adaptive changes that can enhance their ability to deliver evidence-based guidelines and best practices (Cabana et al. 1999; Grimshaw et al. 2005; Hulscher et al. 1997; McKenna et al. 2004; Stange 1996).”
BackgroundKavanagh, T., Stevens, B., Seers, K., Sidani, S., & Watt-Watson, J. (2010) · Implementation Science · doi:10.1186/1748-5908-5-90 · Cited by 35
“Reviews of interventions to implement clinical practice guidelines in healthcare indicate that they are variably effective in different contexts [e.g., [ 3-5 ]].”
BackgroundAssessment of Labor Practices in Healthcare Using an Innovatory Framework for Sustainability
Moldovan, F., Moldovan, L., & Bataga, T. (2023) · Medicina · doi:10.3390/medicina59040796 · Cited by 35
“On the whole, dissemination of educational materials and short educational meetings seem to be the most feasible given the limited resources available [50].”
BackgroundGad, M., Salem, A. M. H., Oortwijn, W., Hill, R. A., & Godman, B. (2020) · Frontiers in Pharmacology · doi:10.3389/fphar.2020.00144 · Cited by 36
“Academic detailing, sometimes called educational outreach visits, typically includes a visit of a trained health professional such as a physician or pharmacist to a general practitioner in their own setting on a one-on-one basis to provide information to help change behaviour (86-90).”
BackgroundThe Ottawa Knee Rule: Examining Use in an Academic Emergency Department
Beutel, B. G., Trehan, S. K., Shalvoy, R. M., & Mello, M. J. (2012) · Western Journal of Emergency Medicine · doi:10.5811/westjem.2012.2.6892 · Cited by 35
Turner, T. (2009) · BMC Health Services Research · doi:10.1186/1472-6963-9-235 · Cited by 35
“There is some evidence to support the role of EBCPGs, with research demonstrating that in some situations, with rigorous development and thorough implementation, EBCPGs can improve both the quality and outcomes of care[1]”
BackgroundStergiou‐Kita, M. (2010) · Australian Occupational Therapy Journal · doi:10.1111/j.1440-1630.2009.00842.x · Cited by 44
“…implementation strategies Review of existing systematic reviews and meta- reviews, and pooling relevant factors implementation in health professionals Grimshaw et al. (2004a) To review the evidence on implementation interventions to identify effective interventions, barriers to change and…”
BackgroundMethodResultInfluentialDissemination of Clinical Practice Guidelines: A Content Analysis of Patient Versions
Santesso, N. A., Morgano, G. P., Jack, S. M., Haynes, R. B., Hill, S., Treweek, S. P., Schünemann, H. J., DECIDE Workpackage 3 Group, Callaghan, M., Graham, K., et al. (2016) · Medical Decision Making · doi:10.1177/0272989x16644427 · Cited by 38
Quality appraisal of clinical guidelines for surgical site infection prevention: A systematic review
Gillespie, B. M., Bull, C. F., Walker, R., Lin, F. F., Roberts, S., & Chaboyer, W. P. (2018) · PLoS ONE · doi:10.1371/journal.pone.0203354 · Cited by 38
Nimptsch, U., & Mansky, T. (2013) · Health Affairs · doi:10.1377/hlthaff.2012.0925 · Cited by 39
Hetrick, S., Álvarez-Jiménez, M., Parker, A., Hughes, F., Willet, M., Morley, K., Fraser, R., McGorry, P. D., & Thompson, A. (2010) · Australasian Psychiatry · doi:10.3109/10398561003731189 · Cited by 34
Effects of thiazolidinediones on blood pressure
Giles, T. D., & Sander, G. E. (2007) · Current Hypertension Reports · doi:10.1007/s11906-007-0060-0 · Cited by 36
Knowledge Translation Efforts in Child and Youth Mental Health: A Systematic Review
Barwick, M. A., Schachter, H., Bennett, L. M., McGowan, J., Ly, M., Wilson, A., BENNETT, K. J., Buchanan, D. H., Fergusson, D. A., & Manion, I. G. (2012) · Journal of Evidence-Based Social Work · doi:10.1080/15433714.2012.663667 · Cited by 43
“Many KT studies have been conducted over the last two decades in other health-related disciplines such as medicine, HIV, and substance use, and there are several high quality reviews of reviews that synthesize what is known to be successful for a range of objectives, audiences, and outcomes ( Bero et al, 1998 ; Grimsh…”
BackgroundFrykman, M., Hasson, H., Athlin, Å. M., & Schwarz, U. V. T. (2014) · BMC Health Services Research · doi:10.1186/1472-6963-14-218 · Cited by 49
“Few prior empirical studies in health care have reported a theoretical rationale for the choice of BCIs [13,15,23,24].”
BackgroundImpact of Electronic Health Record Clinical Decision Support on the Management of Pediatric Obesity
Shaikh, U., Berrong, J., Nettiksimmons, J., & Byrd, R. S. (2014) · American Journal of Medical Quality · doi:10.1177/1062860613517926 · Cited by 37
Evidence into practice: a theory based study of achieving national health targets in primary care
Michie, S., Hendy, J., Smith, J., & Adshead MSc FFPH, F. (2004) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2004.00520.x · Cited by 35
Implementing Nutrition Guidelines in the Critical Care Setting: A Worthwhile and Achievable Goal?
Jones, N. E., & Heyland, D. K. (2008) · JAMA · doi:10.1001/jama.2008.814 · Cited by 35
Lowery, J. C., Fagerlin, A., Larkin, A., Wiener, R. S., Skurla, S. E., & Caverly, T. J. (2021) · JMIR Human Factors · doi:10.2196/32399 · Cited by 35
Elouafkaoui, P., Bonetti, D. L., Clarkson, J., Stirling, D., Young, L. C., & Cassie, H. (2015) · BDJ · doi:10.1038/sj.bdj.2014.1141 · Cited by 36
Vogt, F., Hall, S. L., Hankins, M. C., & Marteau, T. M. (2009) · Health Psychology · doi:10.1037/a0013783 · Cited by 40
Improving anticoagulation in atrial fibrillation: observational study in three primary care trusts
Robson, J. P., Dostal, I., Mathur, R., Sohanpal, R., Hull, S., Antoniou, S., MacCallum, P., SCHILLING, R. J., Ayerbe, L., & Boomla, K. (2014) · British Journal of General Practice · doi:10.3399/bjgp14x679705 · Cited by 37
The translation research in a dental setting (TRiaDS) programme protocol
Clarkson, J., Ramsay, C. R., Eccles, M., Eldridge, S. M., Grimshaw, J., Johnston, M., Michie, S., Treweek, S. P., Walker, A. J., Young, L. C., et al. (2010) · Implementation Science · doi:10.1186/1748-5908-5-57 · Cited by 39
“It has been demonstrated that interventions can be effective, but their effectiveness varies across different clinical problems, contexts, and organisations and this variation is, as yet, largely unexplained [11].”
BackgroundSelf-citationOvertreatment in couples with unexplained infertility
Kersten, F. A. M., Hermens, R., Braat, D. D. M., Hoek, A., Mol, B. W., Goddijn, M., & Nelen, W. L. D. M. (2014) · Human Reproduction · doi:10.1093/humrep/deu262 · Cited by 41
for the Canada Prime Plus team, Patey, A. M., Curran, J., Sprague, A. E., Francis, J., Driedger, S. M., Légaré, F., Lemyre, L., Pomey, M., & Grimshaw, J. (2017) · BMC Pregnancy and Childbirth · doi:10.1186/s12884-017-1517-z · Cited by 40
“Theoretically-based interventions provide evidence about causal pathways of change, avoid implied causal assumption [18, 19] and have a better chance of yielding desirable changes [13, 14].”
BackgroundSelf-citationSystematic review of determinants influencing knowledge implementation in occupational therapy
Pellerin, M., Lamontagne, M., Viau‐Guay, A., & Poulin, V. (2019) · Australian Occupational Therapy Journal · doi:10.1111/1440-1630.12612 · Cited by 41
Salam, R. A., Lassi, Z. S., Das, J. K., & Bhutta, Z. A. (2014) · Reproductive Health · doi:10.1186/1742-4755-11-s2-s3 · Cited by 52
Wiechula, R., Kitson, A. A., Marcoionni, D., Page, T., Zeitz, K., & Silverston, H. (2009) · International Journal of Evidence-Based Healthcare · doi:10.1111/j.1744-1609.2009.00145.x · Cited by 36
LINEKER, S. C., & HUSTED, J. A. (2010) · The Journal of Rheumatology · doi:10.3899/jrheum.100045 · Cited by 35
Slaughter, S. E., & Estabrooks, C. A. (2013) · BMC Geriatrics · doi:10.1186/1471-2318-13-110 · Cited by 40
“Reviews on the dissemination and implementation of guidelines found that only 3% of studies were based in nursing homes [24,25].”
BackgroundHolroyd-Leduc, J. M., Abelseth, G., Khandwala, F., Silvius, J. L., Hogan, D. B., Schmaltz, H. N., Frank, C. B., & Straus, S. E. (2010) · Implementation Science · doi:10.1186/1748-5908-5-81 · Cited by 36
“The evidence base around appropriate dissemination and implementation strategies is imperfect [17].”
BackgroundEstimating the Cost-Effectiveness of Implementation: Is Sufficient Evidence Available?
Whyte, S., Dixon, S., Faria, R., Walker, S., Palmer, S., Sculpher, M., & Radford, S. (2016) · Value in Health · doi:10.1016/j.jval.2015.12.009 · Cited by 39
Pohontsch, N. J., Heser, K., Löffler, A., Haenisch, B., Parker, D., Luck, T., Riedel-Heller, S. G., Maier, W., Jessen, F., & Scherer, M. (2017) · BMC Family Practice · doi:10.1186/s12875-017-0595-3 · Cited by 34
“medical guidelines [31, 32] and tools to help appropriate prescribing [10, 33].”
BackgroundWillis, T. A., West, R. M., Rushforth, B., Stokes, T., Glidewell, L., Carder, P., Faulkner, S., Foy, R., & on behalf of the ASPIRE programme team (2017) · PLoS ONE · doi:10.1371/journal.pone.0177949 · Cited by 36
“audit and feedback, educational outreach) have modest if variable effects [50, 51].”
BackgroundSalbach, N. M., Veinot, P. L., Jaglal, S. B., Bayley, M. T., & Rolfe, D. E. (2010) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2010.01456.x · Cited by 38
Adapting knowledge to local context
Harrison, M. B., Graham, I. D., Fervers, B., & van den Hoek, J. (2013) · Wiley eBooks · doi:10.1002/9781118413555.ch10 · Cited by 42
Evidence-based palliative care: beliefs and evidence for changing practice
Lunder, U., Sauter, S., & Fürst, C.-J. (2004) · Palliative Medicine · doi:10.1191/0269216304pm900ed · Cited by 34
Johnston, M., & Dixon, D. (2008) · Psychology & Health · doi:10.1080/08870440701816728 · Cited by 33
Sepsis Bundles and Compliance With Clinical Guidelines
Stoneking, L., Denninghoff, K. R., DeLuca, L., Keim, S. M., & Munger, B. S. (2011) · Journal of Intensive Care Medicine · doi:10.1177/0885066610387988 · Cited by 47
“They have needed to consider the impact potential of different clinical areas for clinical effectiveness activities, the likely benefits and costs required to introduce guidelines and CDSS, and the likely benefits and costs as a result of any change in provider behaviors.(63) Sepsis appears to be a clinical domain of…”
BackgroundEmpiric TB Treatment of Severely Ill Patients With HIV and Presumed Pulmonary TB Improves Survival
Katagira, W., Walter, N. D., den Boon, S., Kalema, N., Ayakaka, I., Vittinghoff, E., Worodria, W. O., Cattamanchi, A., Huang, L., & Davis, J. L. (2016) · JAIDS Journal of Acquired Immune Deficiency Syndromes · doi:10.1097/qai.0000000000000970 · Cited by 39
Systematic Quality Assessment of Published Antishivering Protocols
Choi, K.-E., Park, B., Moheet, A. M., Rosen, A., Lahiri, S., & Rosengart, A. J. (2016) · Anesthesia & Analgesia · doi:10.1213/ane.0000000000001571 · Cited by 38
for the AFFINITIE programme, Hartley, S., Foy, R., Walwyn, R. E. A., Cicero, R., Farrin, A. J., Francis, J., Lorencatto, F., Gould, N. J., Grant‐Casey, J., et al. (2017) · Implementation Science · doi:10.1186/s13012-017-0614-8 · Cited by 33
“Active strategies are usually needed to close the gap between recommended and actual clinical practice [5].”
BackgroundSelf-citationDyson, J., & Madeo, M. (2017) · Journal of Infection Prevention · doi:10.1177/1757177417714045 · Cited by 33
“Audit and feedback is known means of enhancing clinical practice (Grimshaw et al., 2004) and is not new to the practice of HH (e.g. the aforementioned cleanyourhands campaign).”
BackgroundVolovici, V., Ercole, A., Citerio, G., Stocchetti, N., Haitsma, I., Huijben, J. A., Dirven, C. M. F., van der Jagt, M., Steyerberg, E. W., Nelson, D., et al. (2019) · World Neurosurgery · doi:10.1016/j.wneu.2019.01.116 · Cited by 33
Kredo, T., Cooper, S., Abrams, A. L., Müller, J. G., Schmidt, B., Volmink, J. A., & Atkins, S. A. (2020) · BMJ Open · doi:10.1136/bmjopen-2019-031468 · Cited by 36
Reducing the amount of blood transfused by changing clinicians' transfusion practices
Tinmouth, A. T. (2007) · Transfusion · doi:10.1111/j.1537-2995.2007.01369.x · Cited by 33
Shah, B. R., Hux, J. E., Laupacis, A., Zinman, B., & Zwarenstein, M. (2007) · Journal of General Internal Medicine · doi:10.1007/s11606-006-0027-x · Cited by 38
“Furthermore, educational interventions appear not to be additive: Multiple interventions do not significantly change behavior beyond what is achieved by a single intervention.(25) The enormous gaps that remain in our ability to effectively change the delivery of care underline an urgent need to devise interventions to…”
BackgroundThompson, A. D., Hetrick, S. E., Álvarez‐Jiménez, M., Parker, A. G., Willet, M. R., Hughes, F., Gariup, M., Gomez, D. L., & McGorry, P. D. (2011) · Australian & New Zealand Journal of Psychiatry · doi:10.3109/00048674.2011.595370 · Cited by 36
Regional variation and adherence to guidelines for drug treatment of asthma
Arnlind, M. H., Wettermark, B., Nokela, M., Hjemdahl, P., Rehnberg, C., & Jonsson, E. W. (2009) · European Journal of Clinical Pharmacology · doi:10.1007/s00228-009-0731-7 · Cited by 33
“Optimizing cost-effectiveness can also be a key message to physicians, especially as resource pressures grow [52].”
BackgroundKastner, M., Li, J. J., Lottridge, D. M., Marquez, C., Newton, D. C., & Straus, S. E. (2010) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-10-40 · Cited by 35
“This evidence-to-care gap highlights the need for better knowledge translation (KT) strategies [18].”
BackgroundGriffiths, C. E. M., Taylor, H. C., Collins, S. I., Hobson, J. E., Collier, P. A., Chalmers, R. J. G., Stewart, E. J. C., & Dey, P. (2006) · British Journal of Dermatology · doi:10.1111/j.1365-2133.2006.07354.x · Cited by 33
What Motivates Family Physicians to Participate in Training Programs in Shared Decision Making?
Allaire, A.-S., Labrecque, M., Giguere, A. M. C., Gagnon, M., & Légaré, F. (2012) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.21132 · Cited by 41
A scoping review of adult chronic kidney disease clinical pathways for primary care
Elliott, M. J., Gil, S., Hemmelgarn, B. R., Manns, B., Tonelli, M. A., Jun, M., & Donald, M. (2016) · Nephrology Dialysis Transplantation · doi:10.1093/ndt/gfw208 · Cited by 37
Vogt, F., HALL, S. L., & Marteau, T. M. (2006) · BMC Public Health · doi:10.1186/1471-2458-6-277 · Cited by 35
“Interventions to increase adherence to guidelines using a wide-variety of methods including incentives, prompts/reminders, and education have had mixed results and there is no clear evidence to favour any particular strategy [13].”
BackgroundIPCRG Consensus statement: Tackling the smoking epidemic — practical guidance for primary care
van Schayck, O. C. P., Pinnock, H., Østrem, A., Litt, J., Tomlins, R., Williams, S., Buffels, J., Giannopoulos, D., Henrichsen, S. H., Kaper, J., et al. (2008) · Primary Care Respiratory Journal · doi:10.3132/pcrj.2008.00060 · Cited by 42
Stetler, C. B., & Caramanica, L. (2007) · Worldviews on Evidence-Based Nursing · doi:10.1111/j.1741-6787.2007.00097.x · Cited by 36
Metadata
- Authors
- Grimshaw, J., Thomas, R., MacLennan, G., Fraser, C., Ramsay, C., Vale, L., Whitty, P., Eccles, M., Matowe, L., Shirran, L., Wensing, M., Dijkstra, R., & Donaldson, C.
- Affiliations
- University of Aberdeen (GB)
- Newcastle University (GB)
- Radboud University Nijmegen (NL)
- University of Calgary (CA)
- Venue
- Health Technology Assessment
- Published
- 2004-02
- Volume
- 8
- Issue
- 6
- Pages
- iii-iv, 1
- ISSN
- 1366-5278 (ISSN-L)
- 2046-4924
- OpenAlex
- W2038028146
- Cited by
- 3,044
- References
- 38
- Citations by year
- 2026: 45 · 2025: 45 · 2024: 72 · 2023: 65 · 2022: 69 · 2021: 100 · 2020: 163 · 2019: 87 · 2018: 112 · 2017: 129 · 2016: 133 · 2015: 184 · 2014: 188 · 2013: 288 · 2012: 167
- FWCI
- 20.52
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- Locations
- Health Technology Assessment (publishedVersion, other-oa)
- PubMed (publishedVersion)
- Radboud Repository (Radboud University) (submittedVersion, other-oa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Radboud Repository (Radboud University) (submittedVersion)
- Newcastle University ePrints (Newcastle Univesity)
- Funders
- Health Technology Assessment programme (94/08/29)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Keywords
- guideline dissemination, guideline implementation, guideline development, multicomponent intervention, educational outreach, reminders, audit and feedback, teaching materials, cost-effectiveness, resource requirements, clinical governance, primary care, secondary care, evidence-based recommendations, process indicators, healthcare quality improvement
- MeSH terms
- Cost-Benefit Analysis, United Kingdom, Medical Informatics, State Medicine, Practice Guidelines as Topic, Information Dissemination
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.