Achieving change in primary care—effectiveness of strategies for improving implementation of complex interventions: systematic review of reviews
Open accessThe DOI matches its Crossref record; 121 of the 123 references it cites were found in a registry or an index.
Abstract
Objective: To identify, summarise and synthesise available literature on the effectiveness of implementation strategies for optimising implementation of complex interventions in primary care. Design: Systematic review of reviews. Data sources: MEDLINE, EMBASE, CINAHL, Cochrane Library and PsychINFO were searched, from first publication until December 2013; the bibliographies of relevant articles were screened for additional reports. Eligibility criteria for selecting studies: Eligible reviews had to (1) examine effectiveness of single or multifaceted implementation strategies, (2) measure health professional practice or process outcomes and (3) include studies from predominantly primary care in developed countries. Two reviewers independently screened titles/abstracts and full-text articles of potentially eligible reviews for inclusion. Data synthesis: Extracted data were synthesised using a narrative approach. Results: 91 reviews were included. The most commonly evaluated strategies were those targeted at the level of individual professionals, rather than those targeting organisations or context. These strategies (eg, audit and feedback, educational meetings, educational outreach, reminders) on their own demonstrated a small to modest improvement (2–9%) in professional practice or behaviour with considerable variability in the observed effects. The effects of multifaceted strategies targeted at professionals were mixed and not necessarily more effective than single strategies alone. There was relatively little review evidence on implementation strategies at the levels of organisation and wider context. Evidence on cost-effectiveness was limited and data on costs of different strategies were scarce and/or of low quality. Conclusions: There is a substantial literature on implementation strategies aimed at changing professional practices or behaviour. It remains unclear which implementation strategies are more likely to be effective than others and under what conditions. Future research should focus on identifying and assessing the effectiveness of strategies targeted at the wider context and organisational levels and examining the costs and cost-effectiveness of implementation strategies. PROSPERO registration number: CRD42014009410.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“As reviews by Lau et al. [7, 8] have shown, changes in policy direction, organisational turbulence and the exigencies of everyday work in complex healthcare settings, all affect implementation processes.”
From Implementation, context and complexity (2016) · cites this paper as [8]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
2 retracted
Printed educational materials: effects on professional practice and health care outcomes
Freemantle, N., Harvey, E., Wolf, F., Grimshaw, J., Grilli, R., & Bero, L. (1997) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000172 · Cited by 326
RetractedInterventions to implement prevention in primary care
Hulscher, M., Wensing, M., van der Weijden, T., & Grol, R. (1997) · The Cochrane Database of Systematic Reviews (Complete Reviews) · doi:10.1002/14651858.cd000362 · Cited by 199 · cited 1×
“could be addressed.(60) However, the data suggested the effects of multifaceted strategies were variable and either no more effective or only slightly more effective in changing practice than single strategies.”
BackgroundRetractedLiberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164
Developing and evaluating complex interventions: the new Medical Research Council guidance
Craig, P., Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., & Petticrew, M. (2008) · BMJ · doi:10.1136/bmj.a1655 · Cited by 10,995 · cited 1×
“They include changes in individual clinicians’ diagnostic and treatment approaches, in operational systems including information technology, altered divisions of labour between healthcare professionals and organisation of care; and require change at multiple levels.(3) For instance, improving hand hygiene practices ma…”
BackgroundLiberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00136 · Cited by 10,349
Audit and feedback: effects on professional practice and healthcare outcomes
Ivers, N., Jamtvedt, G., Flottorp, S., Young, J. M., Odgaard-Jensen, J., French, S. D., O'Brien, M. A., Johansen, M., Grimshaw, J., & Oxman, A. D. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000259.pub3 · Cited by 5,485
Powell, B. J., Waltz, T. J., Chinman, M. J., Damschroder, L. J., Smith, J. L., Matthieu, M. M., Proctor, E. K., & Kirchner, J. E. (2015) · Implementation Science · doi:10.1186/s13012-015-0209-1 · Cited by 4,963 · cited 1×
“This is a list of strategies for implementing clinical innovations in health and mental health based on sources such as published reviews and through expert consensus.(102) We undertook a post hoc exercise and mapped the included reviews to the ERIC refined compilation of implementation strategies (see online suppleme…”
MethodEffectiveness and efficiency of guideline dissemination and implementation strategies
Grimshaw, J., Thomas, R., MacLennan, G., Fraser, C., Ramsay, C., Vale, L., Whitty, P., Eccles, M., Matowe, L., Shirran, L., et al. (2004) · Health Technology Assessment · doi:10.3310/hta8060 · Cited by 3,044
Effect of clinical guidelines on medical practice: a systematic review of rigorous evaluations
Grimshaw, J. M., & Russell, I. T. (1993) · The Lancet · doi:10.1016/0140-6736(93)92244-n · Cited by 2,770
Implementation strategies: recommendations for specifying and reporting
Proctor, E. K., Powell, B. J., & McMillen, J. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-139 · Cited by 2,585 · cited 1×
“Implementation strategies can be defined as techniques or methods aimed at improving or optimising the uptake and implementation of complex interventions into routine care.(8) In this paper, we use this definition of implementation strategies, and use the term ‘strategy’ where we focus on implementation, to differenti…”
Method
Research works printed but not linked: 3
- EPOC 2002. Cochrane Effective Practice and Organisation of Care Group: Data Collection Checklist. EPOC resources for review authors Revised 2002. 2002. [ http://www.epoc.cochrane.org/en/handsearchers.html ].
- 10.1001/jama.1992.03490090053014 · DOI · Paper page
- 10.1001/archfami.1996.01850420025011 · doi:10.1001/archfami.1996.01850420025011
Cited by
Implementation, context and complexity
May, C. R., Johnson, M., & Finch, T. (2016) · Implementation Science · doi:10.1186/s13012-016-0506-3 · Cited by 978
“[7, 8] have shown, changes in policy direction, organisational turbulence and the exigencies of everyday work in complex healthcare settings, all affect implementation”
BackgroundSalisbury, C., Man, M.-S., Bower, P., Guthrie, B., Chaplin, K., Gaunt, D. M., Brookes, S., Fitzpatrick, B., Gardner, C., Hollinghurst, S., et al. (2018) · The Lancet · doi:10.1016/s0140-6736(18)31308-4 · Cited by 414
Stevans, J. M., Delitto, A., Khoja, S. S., Patterson, C. G., Smith, C. N., Schneider, M. J., Freburger, J. K., Greco, C. M., Freel, J. A., Sowa, G. A., et al. (2021) · JAMA Network Open · doi:10.1001/jamanetworkopen.2020.37371 · Cited by 314
Wolfenden, L., Nathan, N. K., Sutherland, R., Yoong, S. L., Hodder, R. K., Wyse, R. J., Delaney, T., Grady, A., Fielding, A., Tzelepis, F., et al. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011677.pub2 · Cited by 171
Varsi, C., Solberg Nes, L., Kristjansdottir, O. B., Kelders, S. M., Stenberg, U., Zangi, H. A., Børøsund, E., Weiss, K. E., Stubhaug, A., Asbjørnsen, R. A., et al. (2019) · Journal of Medical Internet Research · doi:10.2196/14255 · Cited by 148
“Several of the included studies reported training of health care personnel as a preferred implementation strategy, and this strategy was also found to be widely used by others, even though effects appear inconsistent [62,64].”
BackgroundResultInfluential
Metadata
- Authors
- Lau, R., Stevenson, F., Ong, B. N., Dziedzic, K., Treweek, S., Eldridge, S., Everitt, H., Kennedy, A., Qureshi, N., Rogers, A., Peacock, R., & Murray, E.
- Affiliations
- University College London (GB)
- Arthritis Research UK (GB)
- University of Aberdeen (GB)
- Queen Mary University of London (GB)
- University of Southampton (GB)
- University of Nottingham (GB)
- Archway Healthcare Library, London, UK
- Corresponding author
- Lau, Rosa
- ORCID
- Venue
- BMJ Open
- Publisher
- BMJ
- Published
- 2015-12
- Volume
- 5
- Issue
- 12
- Pages
- e009993
- ISSN
- 2044-6055 (ISSN-L)
- PMC
- PMC4691771
- OpenAlex
- W2229259759
- Cited by
- 254
- References
- 123
- Citations by year
- 2026: 14 · 2025: 15 · 2024: 33 · 2023: 26 · 2022: 21 · 2021: 35 · 2020: 39 · 2019: 17 · 2018: 25 · 2017: 21 · 2016: 8
- FWCI
- 3.25
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- BMJ Open (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- ePrints Soton (University of Southampton) (acceptedVersion)
- Keele Research Repository (Keele University) (submittedVersion, cc-by)
- Aberdeen University Research Archive (Aberdeen University) (submittedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Funders
- National Institute for Health and Care Research (NF-SI-0513-10103, WMCLAHRC-2014-1, CAT CDRF 10-018, RP-PG-0407-10386, KMRF-2014-03-002)
- Collaboration for Leadership in Applied Health Research and Care - Greater Manchester
- NIHR School for Primary Care Research
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Keywords
- implementation strategies, complex interventions, primary care, multicomponent intervention, audit and feedback, educational outreach, reminders, cost-effectiveness, organizational change, professional conduct
- MeSH terms
- Humans, Outcome and Process Assessment, Health Care, Primary Health Care, Developed Countries
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Achieving change in primary care—effectiveness of strategies for improving implementation of complex interventions: systematic review of reviews. https://app.cochat.ai/papers/10.1136/bmjopen-2015-009993
- The paper
- Lau, R., Stevenson, F., Ong, B. N., Dziedzic, K., Treweek, S., Eldridge, S., Everitt, H., Kennedy, A., Qureshi, N., Rogers, A., Peacock, R., & Murray, E. (2015). Achieving change in primary care—effectiveness of strategies for improving implementation of complex interventions: systematic review of reviews. BMJ Open. https://doi.org/10.1136/bmjopen-2015-009993
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.