What we know about designing an effective improvement intervention (but too often fail to put into practice)
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
It is temptingly easy to treat improvement interventions as if they are drugs—technical, stable and uninfluenced by the environment in which they work. Doing so makes life so much easier for everyone. It allows improvement practitioners to plan their work with a high degree of certainty, funders to be confident that they know what they are buying and evaluators to focus on what really matters—whether or not ‘it’ works. But of course most people know that life is not as simple as that. Experienced improvers have long recognised that interventions—the specific tools and activities introduced into a healthcare system with the aim of changing its performance for the better1—flex and morph. Clever improvers watch and describe how this happens. Even more clever improvers plan and actively manage the process in a way that optimises the impact of the improvement initiative. The challenge is that while most improvers (the authors included) appreciate the importance of carefully designing an improvement intervention, they (we) rarely do so in a sufficiently clever way. In this article, we describe our attempts as an experienced team of practitioners, improvers, commissioners and evaluators to design an effective intervention to improve the safety of people living in care homes in England. We highlight how the design of the intervention, as described in the original grant proposal, changed significantly throughout the initiative. We outline how the changes that were made resulted in a more effective intervention but how our failure to design a better intervention from the start reduced the overall impact of the project. Drawing on the rapidly expanding literature in the field and our own experience, we reflect on what we would do differently if we could have our time again. A growing number of vulnerable older people are living in care homes and are …
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hoffmann, T. C., Glasziou, P. P., Boutron, I., Milne, R., Perera, R., Moher, D., Altman, D. G., Barbour, V., Macdonald, H., Johnston, M., et al. (2014) · BMJ · doi:10.1136/bmj.g1687 · Cited by 10,548
From best evidence to best practice: effective implementation of change in patients' care
Grol, R., & Grimshaw, J. (2003) · The Lancet · doi:10.1016/s0140-6736(03)14546-1 · Cited by 4,531
Ogrinc, G., Davies, L., Goodman, D., Batalden, P., Davidoff, F., & Stevens, D. (2016) · BMJ Quality & Safety · doi:10.1136/bmjqs-2015-004411 · Cited by 2,996
The core of ‘design thinking’ and its application
Dorst, K. (2011) · Design Studies · doi:10.1016/j.destud.2011.07.006 · Cited by 1,897
Demystifying theory and its use in improvement
Davidoff, F., Dixon-Woods, M., Leviton, L., & Michie, S. (2015) · BMJ Quality & Safety · doi:10.1136/bmjqs-2014-003627 · Cited by 714
Explaining Michigan: Developing an Ex Post Theory of a Quality Improvement Program
DIXON-WOODS, M., BOSK, C. L., AVELING, E. L., GOESCHEL, C. A., & PRONOVOST, P. J. (2011) · Milbank Quarterly · doi:10.1111/j.1468-0009.2011.00625.x · Cited by 603
The problem with plan-do-study-act cycles
Reed, J. E., & Card, A. J. (2016) · BMJ Quality & Safety · doi:10.1136/bmjqs-2015-005076 · Cited by 352
Recommendations for Evaluation of Health Care Improvement Initiatives
Parry, G. J., Carson-Stevens, A., Luff, D. F., McPherson, M. E., & Goldmann, D. A. (2013) · Academic Pediatrics · doi:10.1016/j.acap.2013.04.007 · Cited by 124
Cited by
Lean Methodology in Health Care
Cohen, R. I. (2018) · Chest · doi:10.1016/j.chest.2018.06.005 · Cited by 92
Marshall, M., Shah, R., & Stokes-Lampard, H. (2018) · BMJ · doi:10.1136/bmj.k1195 · Cited by 58
Self-citationDesigning for Control in Nurse-AI Collaboration During Emergency Medical Calls
Berge, A., Guribye, F., Fotland, S.-L. S., Fonnes, G., Johansen, I. H., & Trattner, C. (2023) · Proceedings of the 2023 ACM Designing Interactive Systems Conference · doi:10.1145/3563657.3596110 · Cited by 20
Metadata
- Authors
- Marshall, M., de Silva, D., Cruickshank, L., Shand, J., Wei, L., & Anderson, J.
- Venue
- BMJ Quality & Safety
- Publisher
- BMJ
- Published
- 2016-12-16
- Volume
- 26
- Issue
- 7
- Pages
- 578-582
- ISSN
- 1475-3898 (ISSN-L)
- 2044-5415
- 2044-5423
- OpenAlex
- W2562692733
- Cited by
- 71
- References
- 8
- FWCI
- 18.03
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: What we know about designing an effective improvement intervention (but too often fail to put into practice). https://app.cochat.ai/papers/10.1136/bmjqs-2016-006143
- The paper
- Marshall, M., de Silva, D., Cruickshank, L., Shand, J., Wei, L., & Anderson, J. (2017). What we know about designing an effective improvement intervention (but too often fail to put into practice). BMJ Quality & Safety. https://doi.org/10.1136/bmjqs-2016-006143
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.