Achieving change in primary care—effectiveness of strategies for improving implementation of complex interventions: systematic review of reviews
Open accessThe DOI matches its Crossref record; 121 of the 123 references it cites were found in a registry or an index.
Abstract
Objective: To identify, summarise and synthesise available literature on the effectiveness of implementation strategies for optimising implementation of complex interventions in primary care. Design: Systematic review of reviews. Data sources: MEDLINE, EMBASE, CINAHL, Cochrane Library and PsychINFO were searched, from first publication until December 2013; the bibliographies of relevant articles were screened for additional reports. Eligibility criteria for selecting studies: Eligible reviews had to (1) examine effectiveness of single or multifaceted implementation strategies, (2) measure health professional practice or process outcomes and (3) include studies from predominantly primary care in developed countries. Two reviewers independently screened titles/abstracts and full-text articles of potentially eligible reviews for inclusion. Data synthesis: Extracted data were synthesised using a narrative approach. Results: 91 reviews were included. The most commonly evaluated strategies were those targeted at the level of individual professionals, rather than those targeting organisations or context. These strategies (eg, audit and feedback, educational meetings, educational outreach, reminders) on their own demonstrated a small to modest improvement (2–9%) in professional practice or behaviour with considerable variability in the observed effects. The effects of multifaceted strategies targeted at professionals were mixed and not necessarily more effective than single strategies alone. There was relatively little review evidence on implementation strategies at the levels of organisation and wider context. Evidence on cost-effectiveness was limited and data on costs of different strategies were scarce and/or of low quality. Conclusions: There is a substantial literature on implementation strategies aimed at changing professional practices or behaviour. It remains unclear which implementation strategies are more likely to be effective than others and under what conditions. Future research should focus on identifying and assessing the effectiveness of strategies targeted at the wider context and organisational levels and examining the costs and cost-effectiveness of implementation strategies. PROSPERO registration number: CRD42014009410.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“As reviews by Lau et al. [7, 8] have shown, changes in policy direction, organisational turbulence and the exigencies of everyday work in complex healthcare settings, all affect implementation processes.”
From Implementation, context and complexity (2016) · cites this paper as [8]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
2 retracted
Printed educational materials: effects on professional practice and health care outcomes
Freemantle, N., Harvey, E., Wolf, F., Grimshaw, J., Grilli, R., & Bero, L. (1997) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000172 · Cited by 326
RetractedInterventions to implement prevention in primary care
Hulscher, M., Wensing, M., van der Weijden, T., & Grol, R. (1997) · The Cochrane Database of Systematic Reviews (Complete Reviews) · doi:10.1002/14651858.cd000362 · Cited by 199 · cited 1×
“could be addressed.(60) However, the data suggested the effects of multifaceted strategies were variable and either no more effective or only slightly more effective in changing practice than single strategies.”
BackgroundRetractedLiberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164
Developing and evaluating complex interventions: the new Medical Research Council guidance
Craig, P., Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., & Petticrew, M. (2008) · BMJ · doi:10.1136/bmj.a1655 · Cited by 10,995 · cited 1×
“They include changes in individual clinicians’ diagnostic and treatment approaches, in operational systems including information technology, altered divisions of labour between healthcare professionals and organisation of care; and require change at multiple levels.(3) For instance, improving hand hygiene practices ma…”
BackgroundLiberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00136 · Cited by 10,349
Audit and feedback: effects on professional practice and healthcare outcomes
Ivers, N., Jamtvedt, G., Flottorp, S., Young, J. M., Odgaard-Jensen, J., French, S. D., O'Brien, M. A., Johansen, M., Grimshaw, J., & Oxman, A. D. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000259.pub3 · Cited by 5,485
Powell, B. J., Waltz, T. J., Chinman, M. J., Damschroder, L. J., Smith, J. L., Matthieu, M. M., Proctor, E. K., & Kirchner, J. E. (2015) · Implementation Science · doi:10.1186/s13012-015-0209-1 · Cited by 4,963 · cited 1×
“This is a list of strategies for implementing clinical innovations in health and mental health based on sources such as published reviews and through expert consensus.(102) We undertook a post hoc exercise and mapped the included reviews to the ERIC refined compilation of implementation strategies (see online suppleme…”
MethodEffectiveness and efficiency of guideline dissemination and implementation strategies
Grimshaw, J., Thomas, R., MacLennan, G., Fraser, C., Ramsay, C., Vale, L., Whitty, P., Eccles, M., Matowe, L., Shirran, L., et al. (2004) · Health Technology Assessment · doi:10.3310/hta8060 · Cited by 3,044
Effect of clinical guidelines on medical practice: a systematic review of rigorous evaluations
Grimshaw, J. M., & Russell, I. T. (1993) · The Lancet · doi:10.1016/0140-6736(93)92244-n · Cited by 2,770
Implementation strategies: recommendations for specifying and reporting
Proctor, E. K., Powell, B. J., & McMillen, J. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-139 · Cited by 2,585 · cited 1×
“Implementation strategies can be defined as techniques or methods aimed at improving or optimising the uptake and implementation of complex interventions into routine care.(8) In this paper, we use this definition of implementation strategies, and use the term ‘strategy’ where we focus on implementation, to differenti…”
MethodBero, L. A., Grilli, R., Grimshaw, J. M., Harvey, E., Oxman, A. D., & Thomson, M. A. (1998) · BMJ · doi:10.1136/bmj.317.7156.465 · Cited by 2,396
Davis, D., O'Brien, M. A. T., Freemantle, N., Wolf, F. M., Mazmanian, P., & Taylor-Vaisey, A. (1999) · JAMA · doi:10.1001/jama.282.9.867 · Cited by 2,364
The Meaning of Translational Research and Why It Matters
Woolf, S. H. (2008) · JAMA · doi:10.1001/jama.2007.26 · Cited by 1,910 · cited 1×
“The need to reduce the delay in translating evidence-based interventions into every day clinical practice, known as the ‘second translational gap’, is widely acknowledged.(1) 2 Almost all changes to practice in primary care involve ‘complex interventions’, that is, interventions with multiple interacting components.”
BackgroundForsetlund, L., Bjørndal, A., Rashidian, A., Jamtvedt, G., O'Brien, M. A., Wolf, F. M., Davis, D., Odgaard-Jensen, J., & Oxman, A. D. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003030.pub2 · Cited by 1,849
Davis, D. A. (1995) · JAMA · doi:10.1001/jama.1995.03530090032018 · Cited by 1,763 · cited 1×
“Previous literature had suggested that multifaceted strategies could be more effective than single strategies, 94 97 98 and their use was advocated in the 2008 Medical Research Council (MRC) complex intervention guidance as potentially useful approaches to implementation.”
Educational outreach visits: effects on professional practice and health care outcomes
O'Brien, M. A., Rogers, S., Jamtvedt, G., Oxman, A. D., Odgaard-Jensen, J., Kristoffersen, D. T., Forsetlund, L., Bainbridge, D., Freemantle, N., Davis, D., et al. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000409.pub2 · Cited by 1,279 · cited 1×
“Benchmark reviews mentioned that few primary studies reported costs or cost-effectiveness of the strategy.(50)”
BackgroundHorrocks, S., Anderson, E., & Salisbury, C. (2002) · BMJ · doi:10.1136/bmj.324.7341.819 · Cited by 1,235 · cited 1×
“28 61 69 78 83 84 In general, these reviews demonstrated an improvement in process of care outcomes.”
Background(1997) · Europe PMC (PubMed Central) · Cited by 1,226
Local opinion leaders: effects on professional practice and health care outcomes
Flodgren, G., Parmelli, E., Doumit, G., Gattellari, M., O'Brien, M. A., Grimshaw, J., & Eccles, M. P. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000125.pub4 · Cited by 1,070 · cited 1×
“Similarly, two trials compared opinion leaders alone to other strategies (standardised lectures and audit and feedback) and found a 14% absolute increase in adherence to desired practice for opinion leaders alone.(65) No conclusions could be drawn from the limited evidence.”
ResultRenders, C. M., Valk, G. D., Griffin, S. J., Wagner, E. H., Eijk van, J. T., & Assendelft, W. J. J. (2001) · Diabetes Care · doi:10.2337/diacare.24.10.1821 · Cited by 1,066
Evidence for the effectiveness of CME. A review of 50 randomized controlled trials
Davis, D. A. (1992) · JAMA · doi:10.1001/jama.268.9.1111 · Cited by 1,055
Baker, R., Camosso-Stefinovic, J., Gillies, C., Shaw, E. J., Cheater, F., Flottorp, S., & Robertson, N. (2010) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005470.pub2 · Cited by 1,003
Specifying and reporting complex behaviour change interventions: the need for a scientific method
Michie, S., Fixsen, D., Grimshaw, J. M., & Eccles, M. P. (2009) · Implementation Science · doi:10.1186/1748-5908-4-40 · Cited by 976
Printed educational materials: effects on professional practice and healthcare outcomes
Giguère, A., Légaré, F., Grimshaw, J., Turcotte, S., Fiander, M., Grudniewicz, A., Makosso-Kallyth, S., Wolf, F. M., Farmer, A. P., & Gagnon, M.-P. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004398.pub3 · Cited by 878
Effectiveness and efficiency of guideline dissemination and implementation strategies
Grimshaw, J. M., Thomas, R. E., MacLennan, G., Fraser, C., Ramsay, C. R., Vale, L., Whitty, P., Eccles, M. P., Matowe, L., Shirran, L., et al. (2005) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462305290190 · Cited by 864
Gilbody, S., Whitty, P., Grimshaw, J., & Thomas, R. (2003) · JAMA · doi:10.1001/jama.289.23.3145 · Cited by 749
Weingarten, S. R. (2002) · BMJ · doi:10.1136/bmj.325.7370.925 · Cited by 735
Does Pay-for-Performance Improve the Quality of Health Care?
Petersen, L. A., Woodard, L. D., Urech, T., Daw, C., & Sookanan, S. (2006) · Annals of Internal Medicine · doi:10.7326/0003-4819-145-4-200608150-00006 · Cited by 699
Barriers to diabetes management: patient and provider factors
Nam, S., Chesla, C., Stotts, N. A., Kroon, L., & Janson, S. L. (2011) · Diabetes Research and Clinical Practice · doi:10.1016/j.diabres.2011.02.002 · Cited by 680
Interventions to improve hand hygiene compliance in patient care
Gould, D. J., Moralejo, D., Drey, N., Chudleigh, J. H., & Taljaard, M. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005186.pub4 · Cited by 663
Systematic Review and Meta-Analysis of Practice Facilitation Within Primary Care Settings
Baskerville, N. B., Liddy, C., & Hogg, W. (2012) · The Annals of Family Medicine · doi:10.1370/afm.1312 · Cited by 571 · cited 1×
“43) times more likely to adopt evidence-based guidelines through practice facilitation.(82) Similar significant effects were observed in other reviews.”
BackgroundThe effect of financial incentives on the quality of health care provided by primary care physicians
Scott, A., Sivey, P., Ait Ouakrim, D., Willenberg, L., Naccarella, L., Furler, J., & Young, D. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd008451.pub2 · Cited by 568 · cited 2×
“The benchmark review included seven studies and showed that financial strategies had positive but modest and variable effects on a small number of performance and quality of care outcomes.(91) Other relevant reviews also reported mixed effectiveness.”
BackgroundXyrichis, A., & Lowton, K. (2008) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2007.01.015 · Cited by 556
Mair, F. S., May, C., O’Donnell, C., Finch, T., Sullivan, F., & Murray, E. (2012) · Bulletin of the World Health Organization · doi:10.2471/blt.11.099424 · Cited by 553 · cited 1×
“For example, Forsetlund et al 12 was chosen as the benchmark review paper for continuing medical education because (1) it included the largest number of primary studies covering a number of broad topics, that is, general management of various health conditions such as prescribing behaviour,…”
MethodSelf-citationBambra, C., Gibson, M., Sowden, A., Wright, K., Whitehead, M., & Petticrew, M. (2010) · Journal of Epidemiology and Community Health · doi:10.1136/jech.2008.082743 · Cited by 535 · cited 1×
“It is also widely recognised that the policy context, professional and organisational context and political economic circumstances impacting on the healthcare environment impact on the design and implementation of complex interventions.(5) Ninety per cent of patient contacts take place in primary care in England.”
BackgroundSystematic review: Effects, design choices, and context of pay-for-performance in health care
Van Herck, P., De Smedt, D., Annemans, L., Remmen, R., Rosenthal, M. B., & Sermeus, W. (2010) · BMC Health Services Research · doi:10.1186/1472-6963-10-247 · Cited by 523
College of General Practitioners
Abercrombie, G. F., Hughes, H. L. G., & Hunt, J. H. (1954) · BMJ · doi:10.1136/bmj.1.4857.336-c · Cited by 504
The effects of on-screen, point of care computer reminders on processes and outcomes of care
Shojania, K. G., Jennings, A., Ramsay, C. R., Grimshaw, J. M., Kwan, J. L., & Lo, L. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001096.pub2 · Cited by 466
Aarons, G. A., Ehrhart, M. G., Farahnak, L. R., & Hurlburt, M. S. (2015) · Implementation Science · doi:10.1186/s13012-014-0192-y · Cited by 435 · cited 1×
“Similarly Aarons et al 96 conducted a randomised mixed-methods pilot study of a leadership and organisation development strategy for evidence-based mental health practice implementation.”
BackgroundInterventions to improve outpatient referrals from primary care to secondary care
Akbari, A., Mayhew, A., Al-Alawi, M. A., Grimshaw, J., Winkens, R., Glidewell, E., Pritchard, C., Thomas, R., & Fraser, C. (2008) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005471.pub2 · Cited by 402
Squires, J. E., Sullivan, K., Eccles, M. P., Worswick, J., & Grimshaw, J. M. (2014) · Implementation Science · doi:10.1186/s13012-014-0152-6 · Cited by 368
CHAIX-COUTURIER, C., DURAND-ZALESKI, I., JOLLY, D., & DURIEUX, P. (2000) · International Journal for Quality in Health Care · doi:10.1093/intqhc/12.2.133 · Cited by 363
Effects of feedback of information on clinical practice: a review.
Mugford, M., Banfield, P., & O'Hanlon, M. (1991) · BMJ · doi:10.1136/bmj.303.6799.398 · Cited by 330
Improving Drug Prescribing in Primary Care: A Critical Analysis of the Experimental Literature
SOUMERAI, S. B., McLAUGHLIN, T. J., & AVORN, J. (2005) · The Milbank Quarterly · doi:10.1111/j.1468-0009.2005.00435.x · Cited by 327
Impact of payment method on behaviour of primary care physicians: a systematic review
Gosden, T., Forland, F., Kristiansen, I. S., Sutton, M., Leese, B., Giuffrida, A., Sergison, M., & Pedersen, L. (2001) · Journal of Health Services Research & Policy · doi:10.1258/1355819011927198 · Cited by 318
Words Without Action? The Production, Dissemination, and Impact of Consensus Recommendations
Lomas, J. (1991) · Annual Review of Public Health · doi:10.1146/annurev.pu.12.050191.000353 · Cited by 303
Wiggins, M., Oakley, A., Roberts, I., Turner, H., Rajan, L., Austerberry, H., Mujica, R., & Mugford, M. (2004) · Health Technology Assessment · doi:10.3310/hta8320 · Cited by 296
Hand hygiene: simple and complex
Jumaa, P. A. (2005) · International Journal of Infectious Diseases · doi:10.1016/j.ijid.2004.05.005 · Cited by 278 · cited 2×
“For instance, improving hand hygiene practices may appear simple but on closer inspection, it requires change at multiple levels.(4) At the individual level, education might change attitudes and acceptance; local opinion leaders might be effective motivators; and reminders could prompt hand hygiene.”
BackgroundSystematic Review: Enhancing the Use and Quality of Colorectal Cancer Screening
Holden, D. J., Jonas, D. E., Porterfield, D. S., Reuland, D., & Harris, R. (2010) · Annals of Internal Medicine · doi:10.7326/0003-4819-152-10-201005180-00239 · Cited by 276
Words Without Action? The Production, Dissemination, And Impact Of Consensus Recommendations
Lomas, J. (1991) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.12.1.41 · Cited by 274
Improving Drug Prescribing in Primary Care: A Critical Analysis of the Experimental Literature
Soumerai, S. B., McLaughlin, T. J., & Avorn, J. (1989) · The Milbank Quarterly · doi:10.2307/3350142 · Cited by 264
Gardner, B., Whittington, C., McAteer, J., Eccles, M. P., & Michie, S. (2010) · Social Science & Medicine · doi:10.1016/j.socscimed.2010.01.039 · Cited by 225
A Review of Quantitative Studies of Adherence to Mental Health Clinical Practice Guidelines
Bauer, M. S. (2002) · Harvard Review of Psychiatry · doi:10.1080/10673220216217 · Cited by 191
The clinical value of computerized information services. A review of 98 randomized clinical trials
Balas, E. A. (1996) · Archives of Family Medicine · doi:10.1001/archfami.5.5.271 · Cited by 190
Economic evaluation of implementation strategies in health care
Hoomans, T., & Severens, J. L. (2014) · Implementation Science · doi:10.1186/s13012-014-0168-y · Cited by 181 · cited 1×
“They also found that studies on implementation strategies tend to assess only their effect on practice and health outcomes, and very few conducted economic evaluations.(103)”
BackgroundDexheimer, J. W., Talbot, T. R., Sanders, D. L., Rosenbloom, S. T., & Aronsky, D. (2008) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2555 · Cited by 179
Interventions to improve hand hygiene compliance in patient care
Gould, D. J., Moralejo, D., Drey, N., & Chudleigh, J. H. (2010) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005186.pub3 · Cited by 175
Interventions to increase influenza vaccination rates of those 60 years and older in the community
Thomas, R. E., & Lorenzetti, D. L. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005188.pub3 · Cited by 174
A systematic review of chronic disease management
Zwar, N. A., Harris, M., Griffiths, R., Roland, M. O., Dennis, S. M., Davies, G. P., & Hasan, I. (2021) · UNSWorks (University of New South Wales, Sydney, Australia) · doi:10.26190/unsworks/384 · Cited by 159
Gagnon, M.-P., Légaré, F., Labrecque, M., Frémont, P., Pluye, P., Gagnon, J., Car, J., Pagliari, C., Desmartis, M., Turcot, L., et al. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006093.pub2 · Cited by 157
Nilsen, P., Aalto, M., Bendtsen, P., & Seppä, K. (2006) · Scandinavian Journal of Primary Health Care · doi:10.1080/02813430500475282 · Cited by 148
Effect of physician profiling on utilization: Meta-analysis of randomized clinical trials
Balas, E. A., Boren, S. A., Brown, G. D., Ewigman, B., Mitchell, J. A., & Perkoff, G. T. (1996) · Journal of General Internal Medicine · doi:10.1007/bf02599025 · Cited by 144
Practice facilitators: a review of the literature.
Nagykaldi, Z. J., Mold, J. W., & ASPY, C. B. (2005) · PubMed · Cited by 144
Medves, J., Godfrey, C., Turner, C., Paterson, M., Harrison, M., MacKenzie, L., & Durando, P. (2010) · International Journal of Evidence-Based Healthcare · doi:10.1111/j.1744-1609.2010.00166.x · Cited by 142
Effectiveness of interventions to enhance physician screening for breast cancer.
Mandelblatt, J. S., & Kanetsky, P. A. (1995) · PubMed · Cited by 140
Williams, E. C., Johnson, M. L., Lapham, G. T., Caldeiro, R. M., Chew, L., Fletcher, G. S., McCormick, K. A., Weppner, W. G., & Bradley, K. A. (2011) · Psychology of Addictive Behaviors · doi:10.1037/a0022102 · Cited by 138
Economic incentives and physicians’ delivery of preventive care
Town, R., Kane, R. L., Johnson, P., & Butler, M. E. (2005) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2004.10.013 · Cited by 128
Clinical guidelines: their implementation in general practice.
Conroy, M., & Shannon, W. (1995) · PubMed · Cited by 127
Glynn, L. G., Murphy, A. W., Smith, S. M., Schroeder, K., & Fahey, T. (2010) · British Journal of General Practice · doi:10.3399/bjgp10x544113 · Cited by 122
The Effects of Continuing Education on Nursing Practice: A Meta-Analysis
Waddell, D. L. (1992) · The Journal of Continuing Education in Nursing · doi:10.3928/0022-0124-19920701-08 · Cited by 118
Target payments in primary care: effects on professional practice and health care outcomes
Giuffrida, A., Gosden, T., Forland, F., Kristiansen, I., Sergison, M., Leese, B., Pedersen, L., & Sutton, M. (1999) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000531 · Cited by 114
Effects of educational interventions on primary dementia care: A systematic review
Perry, M., Drašković, I., Lucassen, P., Vernooij‐Dassen, M., van Achterberg, T., & Rikkert, M. O. (2011) · International Journal of Geriatric Psychiatry · doi:10.1002/gps.2479 · Cited by 111
Interventions to Modify Health Care Provider Adherence to Asthma Guidelines: A Systematic Review
Okelo, S. O., Butz, A. M., Sharma, R., Diette, G. B., Pitts, S. I., King, T. M., Linn, S. T., Reuben, M., Chelladurai, Y., & Robinson, K. A. (2013) · Pediatrics · doi:10.1542/peds.2013-0779 · Cited by 109
Barriers to evidence based practice in primary care: a review of the literature
McKenna, H., Ashton, S., & Keeney, S. (2003) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2003.10.008 · Cited by 101
Implementing Practice Guidelines for Appropriate Antimicrobial Usage: A Systematic Review
Gross, P. A., & Pujat, D. (2001) · Medical Care · doi:10.1097/00005650-200108002-00004 · Cited by 100
Effect of physician reminders on preventive care: meta-analysis of randomized clinical trials.
Austin, S., Balas, E. A., Mitchell, J. A., & Ewigman, B. (1994) · PubMed Central · Cited by 90
Flodgren, G., Deane, K., Dickinson, H. O., Kirk, S., Alberti, H., Beyer, F. R., Brown, J. G., Penney, T. L., Summerbell, C. D., & Eccles, M. P. (2010) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000984.pub2 · Cited by 90
Securing the future of general practice: new models of primary care
Smith, J., Holder, H., Edwards, N., Maybin, J., Parker, H., Rosen, R., & Walsh, N. (2013) · Cited by 90
Goodwin, V. A., Jones-Hughes, T., Coon, J. T., Boddy, K., & Stein, K. (2011) · Journal of Safety Research · doi:10.1016/j.jsr.2011.07.008 · Cited by 87
Increasing Cancer Screening: A Meta-Analysis
Snell, J. L., & Buck, E. L. (1996) · Preventive Medicine · doi:10.1006/pmed.1996.0109 · Cited by 85
Comino, E. J., Davies, G. P., Krastev, Y., Haas, M. R., Christl, B., Furler, J., Raymont, A., & Harris, M. (2012) · BMC Health Services Research · doi:10.1186/1472-6963-12-415 · Cited by 81
Brusamento, S., Legido‐Quigley, H., Пантели, Д., Turk, E., Knai, C., Saliba, V., Car, J., McKee, M., & Busse, R. (2012) · Health Policy · doi:10.1016/j.healthpol.2012.08.005 · Cited by 81
The Effects of Continuing Education on Nursing Practice: A Meta-Analysis
Waddell, D. L. (1991) · The Journal of Continuing Education in Nursing · doi:10.3928/0022-0124-19910501-09 · Cited by 78
Helping Practices Reach Primary Care Goals: Lessons From the Literature
Yano, E. M., Fink, A., Hirsch, S. H., Robbins, A. S., & Rubenstein, L. V. (1995) · Archives of Internal Medicine · doi:10.1001/archinte.1995.00430110051006 · Cited by 77 · cited 2×
“19 21 22 25 28 29 37 40 49 58 60 66–77 Ten reviews (11%) reported data on organisational implementation strategies (including revising professional roles and facilitation).(28) 61 69 78–84 Eleven reviews (12%) reported data on strategies targeted at the context level; all focused on financial strategies (eg, performan…”
BackgroundThe effectiveness of strategies to change organisational culture to improve healthcare performance
Parmelli, E., Flodgren, G., Schaafsma, M. E., Baillie, N., Beyer, F. R., & Eccles, M. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd008315.pub2 · Cited by 76 · cited 1×
“Changing organisational culture One review assessed strategies to change organisational culture to improve professional practice.(93) However, the authors were unable to draw conclusions about effective strategies for changing culture as no relevant primary studies fulfilled the methodological criteria for inclusion.”
BackgroundThomas, D. C., Johnston, B., Dunn, K., Sullivan, G. M., Brett, B., Matzko, M., & Levine, S. A. (2006) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.2006.00879.x · Cited by 74
Helping practices reach primary care goals. Lessons from the literature
Yano, E. M. (1995) · Archives of Internal Medicine · doi:10.1001/archinte.155.11.1146 · Cited by 71
Randomized controlled trials of continuing medical education: What makes them most effective?
Cauffman, J. G., Forsyth, R. A., Clark, V. A., Foster, J. P., Martin, K. J., Lapsys, F. X., & Davis, D. A. (2002) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.1340220405 · Cited by 69
Van Cleave, J., Kuhlthau, K. A., Bloom, S., Newacheck, P. W., Nozzolillo, A. A., Homer, C. J., & Perrin, J. M. (2012) · Academic Pediatrics · doi:10.1016/j.acap.2012.02.004 · Cited by 62
The effectiveness of continuing medical education: A quantitative synthesis
Beaudry, J. S. (1989) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.4750090414 · Cited by 61
Anderson, P., & Jané‐Llopis, E. (2004) · Addiction · doi:10.1111/j.1360-0443.2003.00672.x · Cited by 60
Vernon, S. W., McQueen, A., Tiro, J. A., & del Junco, D. J. (2010) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/djq223 · Cited by 60
Changing doctor prescribing behaviour.
Gill, P. S., Mākelä, M., Vermeulen, K. M., Freemantle, N., Ryan, G., Bond, C., Thorsen, T., & Haaijer‐Ruskamp, F. M. (1999) · Pharmacy World & Science · doi:10.1023/a:1008719129305 · Cited by 59
Organizational culture change in U.S. hospitals: a mixed methods longitudinal intervention study
Curry, L. A., Linnander, E. L., Brewster, A. L., Ting, H. H., Krumholz, H. M., & Bradley, E. H. (2015) · Implementation Science · doi:10.1186/s13012-015-0218-0 · Cited by 59 · cited 1×
“There are some ongoing studies especially around promoting leadership and organisational culture, for instance, Curry et al 95 have developed a theoretically informed intervention (multifaceted strategy approach) aimed at promoting organisational culture by encouraging organisational leadership…”
BackgroundInterventions to promote colorectal cancer screening: An integrative review
Rawl, S. M., Menon, U., Burness, A., & Breslau, E. S. (2012) · Nursing Outlook · doi:10.1016/j.outlook.2011.11.003 · Cited by 58
Trials of providing costing information to general practitioners: a systematic review
Beilby, J. J., & Silagy, C. A. (1997) · Medical Journal of Australia · doi:10.5694/j.1326-5377.1997.tb138787.x · Cited by 58
Dementia diagnosis and management: a narrative review of changing practice
Koch, T., & Iliffe, S. (2011) · British Journal of General Practice · doi:10.3399/bjgp11x588493 · Cited by 56
Unverzagt, S., Oemler, M., Braun, K., & Klement, A. (2014) · Family Practice · doi:10.1093/fampra/cmt080 · Cited by 54
An updated systematic review of interventions to improve health professionals’ management of obesity
Harvey, E. L., Glenny, A. ‐., Kirk, S. F. L., & Summerbell, C. D. (2002) · Obesity Reviews · doi:10.1046/j.1467-789x.2002.00053.x · Cited by 47
Dulko, D. (2007) · Worldviews on Evidence-Based Nursing · doi:10.1111/j.1741-6787.2007.00098.x · Cited by 38
Schichtel, M., Rose, P. W., & Sellers, C. (2013) · Education for Primary Care · doi:10.1080/14739879.2013.11494186 · Cited by 37
Boonacker, C. W., Hoes, A. W., Dikhoff, M.-J., Schilder, A. G., & Rovers, M. M. (2010) · International Journal of Pediatric Otorhinolaryngology · doi:10.1016/j.ijporl.2010.07.008 · Cited by 37
Kupets, R., & Covens, A. L. (2001) · Gynecologic Oncology · doi:10.1006/gyno.2001.6387 · Cited by 36
LINEKER, S. C., & HUSTED, J. A. (2010) · The Journal of Rheumatology · doi:10.3899/jrheum.100045 · Cited by 35
Interventions to increase influenza vaccination rates of those 60 years and older in the community
Thomas, R. E., Russell, M., & Lorenzetti, D. (2010) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005188.pub2 · Cited by 32
Arroyave, A. M., Peñaranda, E., & Lewis, C. L. (2010) · Journal of Community Health · doi:10.1007/s10900-010-9309-7 · Cited by 31
Implementation strategies for collaborative primary care-mental health models
Franx, G. C., Dixon, L. B., Wensing, M., & Pincus, H. A. (2013) · Current Opinion in Psychiatry · doi:10.1097/yco.0b013e328363a69f · Cited by 31 · cited 1×
“Five reviews 78 – 82 examined the effects of practice facilitation, de fi ned as having experienced facilitators, who can be internal or external to an organisation, to work with individual practices in order to facilitate and support a range of processes and activities, such as education,…”
BackgroundKnowledge Transfer and Improvement of Primary and Ambulatory Care for Patients with Anxiety
Hilbink, M., Laurant, M. G. H., Roberge, P., van Balkom, A. J. L. M., van Rijswijk, E., Bower, P., & Grol, R. P. T. M. (2008) · The Canadian Journal of Psychiatry · doi:10.1177/070674370805300502 · Cited by 30
Influencing the prescribing behaviour of physicians: a metaevaluation
Pippalla, R. S., Riley, D. A., & Chinburapa, V. (1995) · Journal of Clinical Pharmacy and Therapeutics · doi:10.1111/j.1365-2710.1995.tb00648.x · Cited by 30
Lau, R., Stevenson, F., Ong, B. N., Dziedzic, K., Eldridge, S., Everitt, H., Kennedy, A., Kontopantelis, E., Little, P., Qureshi, N., et al. (2014) · BMJ Open · doi:10.1136/bmjopen-2014-005548 · Cited by 26
Self-citationFreudenstein, U., & Howe, A. (1999) · Europe PMC (PubMed Central) · Cited by 17
Implementation of pressure ulcer guidelines: what constitutes a successful strategy?
Tooher, R. L., Middleton, P., & Babidge, W. (2003) · Journal of Wound Care · doi:10.12968/jowc.2003.12.10.26551 · Cited by 17
Bywood, P. T., Lunnay, B., & ROCHE, A. M. (2008) · Drug and Alcohol Review · doi:10.1080/09595230802245535 · Cited by 17
Interventions to promote the evidence-based care of children with ADHD in primary-care settings
Langberg, J. M., Brinkman, W. B., Lichtenstein, P. K., & Epstein, J. N. (2009) · Expert Review of Neurotherapeutics · doi:10.1586/ern.09.5 · Cited by 16 · cited 1×
“82 81 Practice facilitation improved adoption of guidelines in various clinical areas that focused on prevention, system-level improvements and outcomes associated with chronic disease management within practice settings.”
BackgroundQureshi, N., Allen, J., & Hapgood, R. (2002) · European Journal of General Practice · doi:10.3109/13814780209160826 · Cited by 15
Self-citationHowe, A. C., Ashton, K. E., & Hooper, L. (2006) · Primary Care and Community Psychiatry · doi:10.1185/135525707x183049 · Cited by 12
Implementing alcohol disorders treatment throughout the community
Gual, A., & do Amaral-Sabadini, M. B. (2011) · Current Opinion in Psychiatry · doi:10.1097/yco.0b013e3283459256 · Cited by 10
New primary care series: Easily Missed?
Harnden, A., & Lehman, R. (2009) · BMJ · doi:10.1136/bmj.b491 · Cited by 8
Easily Missed? New primary care series: Easily Missed?
Harnden, A., & Lehman, R. C. (2009) · Cited by 1
(1998) · Europe PMC (PubMed Central)
(1995) · PubMed
Research works printed but not linked: 2
- EPOC 2002. Cochrane Effective Practice and Organisation of Care Group: Data Collection Checklist. EPOC resources for review authors Revised 2002. 2002 [ http://www.epoc.cochrane.org/en/handsearchers.html].
- 10.1001/archfami.1996.01850420025011 · doi:10.1001/archfami.1996.01850420025011
Cited by
Implementation, context and complexity
May, C. R., Johnson, M., & Finch, T. (2016) · Implementation Science · doi:10.1186/s13012-016-0506-3 · Cited by 978
“[7, 8] have shown, changes in policy direction, organisational turbulence and the exigencies of everyday work in complex healthcare settings, all affect implementation”
BackgroundSalisbury, C., Man, M.-S., Bower, P., Guthrie, B., Chaplin, K., Gaunt, D. M., Brookes, S., Fitzpatrick, B., Gardner, C., Hollinghurst, S., et al. (2018) · The Lancet · doi:10.1016/s0140-6736(18)31308-4 · Cited by 414
Stevans, J. M., Delitto, A., Khoja, S. S., Patterson, C. G., Smith, C. N., Schneider, M. J., Freburger, J. K., Greco, C. M., Freel, J. A., Sowa, G. A., et al. (2021) · JAMA Network Open · doi:10.1001/jamanetworkopen.2020.37371 · Cited by 314
Wolfenden, L., Nathan, N. K., Sutherland, R., Yoong, S. L., Hodder, R. K., Wyse, R. J., Delaney, T., Grady, A., Fielding, A., Tzelepis, F., et al. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011677.pub2 · Cited by 171
Varsi, C., Solberg Nes, L., Kristjansdottir, O. B., Kelders, S. M., Stenberg, U., Zangi, H. A., Børøsund, E., Weiss, K. E., Stubhaug, A., Asbjørnsen, R. A., et al. (2019) · Journal of Medical Internet Research · doi:10.2196/14255 · Cited by 148
“Several of the included studies reported training of health care personnel as a preferred implementation strategy, and this strategy was also found to be widely used by others, even though effects appear inconsistent [62,64].”
BackgroundResultInfluential
Metadata
- Authors
- Lau, R., Stevenson, F., Ong, B. N., Dziedzic, K., Treweek, S., Eldridge, S., Everitt, H., Kennedy, A., Qureshi, N., Rogers, A., Peacock, R., & Murray, E.
- Affiliations
- University College London (GB)
- Arthritis Research UK (GB)
- University of Aberdeen (GB)
- Queen Mary University of London (GB)
- University of Southampton (GB)
- University of Nottingham (GB)
- Archway Healthcare Library, London, UK
- Corresponding author
- Lau, Rosa
- ORCID
- Venue
- BMJ Open
- Publisher
- BMJ
- Published
- 2015-12
- Volume
- 5
- Issue
- 12
- Pages
- e009993
- ISSN
- 2044-6055 (ISSN-L)
- PMC
- PMC4691771
- OpenAlex
- W2229259759
- Cited by
- 254
- References
- 123
- Citations by year
- 2026: 14 · 2025: 15 · 2024: 33 · 2023: 26 · 2022: 21 · 2021: 35 · 2020: 39 · 2019: 17 · 2018: 25 · 2017: 21 · 2016: 8
- FWCI
- 3.25
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- BMJ Open (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- ePrints Soton (University of Southampton) (acceptedVersion)
- Keele Research Repository (Keele University) (submittedVersion, cc-by)
- Aberdeen University Research Archive (Aberdeen University) (submittedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Funders
- National Institute for Health and Care Research (NF-SI-0513-10103, WMCLAHRC-2014-1, CAT CDRF 10-018, RP-PG-0407-10386, KMRF-2014-03-002)
- Collaboration for Leadership in Applied Health Research and Care - Greater Manchester
- NIHR School for Primary Care Research
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Keywords
- implementation strategies, complex interventions, primary care, multicomponent intervention, audit and feedback, educational outreach, reminders, cost-effectiveness, organizational change, professional conduct
- MeSH terms
- Humans, Outcome and Process Assessment, Health Care, Primary Health Care, Developed Countries
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.