Do large-scale hospital- and system-wide interventions improve patient outcomes: a systematic review
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
Background: While health care services are beginning to implement system-wide patient safety interventions, evidence on the efficacy of these interventions is sparse. We know that uptake can be variable, but we do not know the factors that affect uptake or how the interventions establish change and, in particular, whether they influence patient outcomes. We conducted a systematic review to identify how organisational and cultural factors mediate or are mediated by hospital-wide interventions, and to assess the effects of those factors on patient outcomes. Methods: A systematic review was conducted and reported in accordance with Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Database searches were conducted using MEDLINE from 1946, CINAHL from 1991, EMBASE from 1947, Web of Science from 1934, PsycINFO from 1967, and Global Health from 1910 to September 2012. The Lancet, JAMA, BMJ, BMJ Quality and Safety, The New England Journal of Medicine and Implementation Science were also hand searched for relevant studies published over the last 5 years. Eligible studies were required to focus on organisational determinants of hospital- and system-wide interventions, and to provide patient outcome data before and after implementation of the intervention. Empirical, peer-reviewed studies reporting randomised and non-randomised controlled trials, observational, and controlled before and after studies were included in the review. Results: Six studies met the inclusion criteria. Improved outcomes were observed for studies where outcomes were measured at least two years after the intervention. Associations between organisational factors, intervention success and patient outcomes were undetermined: organisational culture and patient outcomes were rarely measured together, and measures for culture and outcome were not standardised. Conclusions: Common findings show the difficulty of introducing large-scale interventions, and that effective leadership and clinical champions, adequate financial and educational resources, and dedicated promotional activities appear to be common factors in successful system-wide change. The protocol has been registered in the international prospective register of systematic reviews, PROSPERO (Registration No. CRD42103003050).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Effectiveness of a hospital-wide programme to improve compliance with hand hygiene
Pittet, D., Hugonnet, S., Harbarth, S., Mourouga, P., Sauvan, V., Touveneau, S., & Perneger, T. V. (2000) · The Lancet · doi:10.1016/s0140-6736(00)02814-2 · Cited by 2,524 · cited 1×
“[42] including giveaways; social functions; “slogan’’ competitions; quizzes, crosswords and word searches; pay slip”
BackgroundKnowledge translation of research findings
Grimshaw, J. M., Eccles, M. P., Lavis, J. N., Hill, S. J., & Squires, J. E. (2012) · Implementation Science · doi:10.1186/1748-5908-7-50 · Cited by 2,407
Morrison, A., Polisena, J., Husereau, D., Moulton, K., Clark, M., Fiander, M., Mierzwinski-Urban, M., Clifford, T., Hutton, B., & Rabb, D. (2012) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462312000086 · Cited by 1,257 · cited 1×
“Although we restricted the search to English language articles, a recent systematic review of empirical studies on the effect of restricting studies to English language found no evidence of systematic bias associated with this procedure in systematic reviews in conventional medicine [26].”
MethodTemporal Trends in Rates of Patient Harm Resulting from Medical Care
Landrigan, C. P., Parry, G. J., Bones, C. B., Hackbarth, A. D., Goldmann, D. A., & Sharek, P. J. (2010) · New England Journal of Medicine · doi:10.1056/nejmsa1004404 · Cited by 1,144 · cited 1×
“We know that there is variability in uptake of systemwide healthcare interventions, [9,17,18] but we do not fully appreciate how organisations and cultures affect interventions or how organisational factors affect uptake [19-23].”
BackgroundExplaining Michigan: Developing an Ex Post Theory of a Quality Improvement Program
DIXON-WOODS, M., BOSK, C. L., AVELING, E. L., GOESCHEL, C. A., & PRONOVOST, P. J. (2011) · Milbank Quarterly · doi:10.1111/j.1468-0009.2011.00625.x · Cited by 603 · cited 1×
“Economic appraisals or qualitative studies are needed to better answer these questions [46].”
Background
Research works printed but not linked: 44
- Berwick DM, Calkins DR, McCannon CJ, Hackbarth AD: The 100,000 lives campaign: setting a goal and a deadline for improving health care quality. J. Am. Med. Assoc. 2006, 295 (3): 324-327. 10.1001/jama.295.3.324. · DOI · Paper page
- Braithwaite J, Coiera E: Beyond patient safety flatland. J R Soc Med. 2010, 103 (6): 219-225. 10.1258/jrsm.2010.100032. · DOI
- Donaldson L: An organisation with a memory: report of an expert group on learning from adverse events in the NHS. 2000, London: UK Department of Health
- Garling P: Final report of the Special Commission of Inquiry: Acute Care Services in NSW Public Hospitals. 2008, NSW Government: Sydney, 1–3.
- Kohn LT, Corrigan JM, Donaldson MS: To err is human: building a safer health system. A report of the Committee on Quality of Health Care in America, Institute of Medicine. 2000, Washington, DC: National Academy Press
- Braithwaite J, Clay-Williams R, Nugus P, Plumb J: Health care as a complex adaptive system. Resilient Health Care. Edited by: Hollnagel E, Braithwaite J, Wears R. Surrey, UK: Ashgate Publishing Limited, In press (accepted 17/10/12)
- Clay-Williams R: Restructuring and the resilient organisation: implications for health care. Resilient Health Care. Edited by: Hollnagel E, Braithwaite J, Wears R. Surrey, UK: Ashgate Publishing Limited, In press (accepted 17/10/12)
- Braithwaite J, Westbrook M, Travaglia J: Attitudes toward the large-scale implementation of an incident reporting system. Int. J. Qual. Health Care. 2008, 20: 184-191. 10.1093/intqhc/mzn004. · DOI
- Hillman K, Chen J, Cretikos M, Bellomo R, Brown D, Doig G, Finfer S, Flabouris A: Introduction of the medical emergency team (MET) system: a cluster-randomised controlled trial. Lancet. 2005, 365 (9477): 2091-2097. · DOI · Paper page
- Braithwaite J, Westbrook M, Nugus P, Greenfield D, Travaglia JF, Runciman W, Foxwell A, Boyce R, Devinney T, Westbrook J: Continuing differences between health professions' attitudes: the saga of accomplishing systems-wide interprofessionalism. Int. J. Qual. Health Care. 2013, 25 (1): 8-15. 10.1093/intqhc/mzs071. · DOI
- Braithwaite J, Westbrook M, Nugus P, Greenfield D, Travaglia JF, Runciman W, Foxwell A, Boyce R, Devinney T, Westbrook J: A four-year, systems-wide intervention promoting interprofessional collaboration. BMC Health Serv. Res. 2012, 12: 99-10.1186/1472-6963-12-99. · DOI · Paper page
- Benn J, Burnett S, Parand A, Pinto A, Iskander S, Vincent C: Studying large-scale programmes to improve patient safety in whole care systems: challenges for research. Soc. Sci. Med. 2006, 69 (12): 1767-1776. · DOI
- Hillman K, Parr M, Flabouris A, Bishop G, Stewart A: Redefining in-hospital resuscitation: the concept of the medical emergency team. Resuscitation. 2001, 48 (2): 105-110. 10.1016/S0300-9572(00)00334-8. · DOI
- Sakai T, DeVita MA: Rapid response system. J. Anesth. 2009, 23 (3): 403-408. 10.1007/s00540-009-0778-8. · doi:10.1007/s00540-009-0778-8
- Schouten LM, Hulscher ME, Everdingen JJ, Huijsman R, Grol RP: Evidence for the impact of quality improvement collaboratives: systematic review. Br. Med. J. 2008, 336 (7659): 1491-1494. 10.1136/bmj.39570.749884.BE. · DOI · Paper page
- Braithwaite J, Greenfield D, Westbrook J, Pawsey M, Westbrook M, Gibberd R, Naylor J, Nathan S, Robinson M, Runciman B, Jackson M, Travaglia J, Johnston B, Yen D, McDonald H, Low L, Redman S, Johnson B, Corbett A, Hennessy D, Clark J, Lancaster J: Health service accreditation as a predictor of clinical and organisational performance: a blinded, random, stratified study. Qual Saf Health Care. 2010, 19 (1): 14-21. 10.1136/qshc.2009.033928. · DOI · Paper page
- Braithwaite J: A lasting legacy from Tony Blair? NHS culture change. J. R. Soc. Med. 2011, 104 (2): 87-89. 10.1258/jrsm.2010.100364. · doi:10.1258/jrsm.2010.100364
- Braithwaite J, Runciman W, Merry A: Towards safer, better healthcare: harnessing the natural properties of complex sociotechnical systems. Qual Saf Health Care. 2009, 18 (1): 37-41. 10.1136/qshc.2007.023317. · DOI · Paper page
- Braithwaite J, Westbrook M, Iedema R, Mallock N, Forsyth R, Zhang K: A tale of two hospitals: assessing cultural landscapes and compositions. Soc. Sci. Med. 2005, 60: 1149-1162. 10.1016/j.socscimed.2004.06.046. · DOI
- Mannion R, Davies H, Harrison S, Frederick K, Jacobs R, Walshe K: Changing management cultures in the English National Heath Service. Culture and Climate in Health Care Organisations. Edited by: Braithwaite J, Hyde P, Pope C. 2009, Basingstoke, UK: Palgrave Macmillan, 19-30.
- Mannion R, Davies H, Harrison S, Konteh F, Greener I, McDonald R: Quantitative explorations of culture and performance relationship: changing organisational cultures and hospital performance in the NHS. 2010, Birmingham, UK: National Institute for Health Research Service Delivery and Organisation Programme, 42-72.
- Cameron K, Freeman S: Culture, congruence, strength and type: relationship to effectiveness research in organizational change and development. Res Organizational Change Dev. 1991, 5: 23-58.
- Nosrati H, Clay-Williams R, Cunningham F, Hillman K, Braithwaite J: The role of organisational and cultural factors in the implementation of system-wide interventions in acute hospitals to improve patient outcomes: protocol for a systematic literature review. BMJ Open. 2013, 3 (3): 1-4. · DOI
- Webb D: Safer Patients Initiative phase one. In. 2011, UK: The Health Foundation
- Webb D: Safer Patients Initiative phase two. In. 2011, UK: The Health Foundation
- Grayson L, Russo P, Ryan K, Bellis K, Havers S, Heard K, Simpson P: Hand Hygiene Australia Manual. In. 2010, Australia: Australian Comission on Safety and Quality in Healthcare
- Benning A, Dixon-Woods M, Nwulu U, Ghaleb M, Dawson J, Barber N, Franklin BD, Girling A, Hemming K, Carmalt M, Rudge G, Naicker T, Kotecha A, Derrington MC, Lilford R: Multiple component patient safety intervention in English hospitals: controlled evaluation of second phase. Br. Med. J. 2011, 342: d199-10.1136/bmj.d199. · DOI · Paper page
- Benning A, Ghaleb M, Suokas A, Dixon-Woods M, Dawson J, Barber N, Franklin BD, Girling A, Hemming K, Carmalt M, Rudge G, Naicker T, Nwulu U, Choudhury S, Lilford R: Large scale organisational intervention to improve patient safety in four UK hospitals: mixed method evaluation. Br. Med. J. 2011, 342: d195-10.1136/bmj.d195. · DOI · Paper page
- Grayson ML, Russo PL, Crulckshank M, Bear JL, Gee CA, Hughes CF, Johnson PDR, McCann R, McMillan AJ, Mitchell BG, Selvey CE, Smith RE, Wilkinson I: Outcomes from the first 2 years of the Australian National Hand Hygiene Initiative. Med. J. Aust. 2011, 195 (10): 615-619. 10.5694/mja11.10747. · DOI
- Muething SE, Goudie A, Schoettker PJ, Donnelly LF, Goodfriend MA, Bracke TM, Brady PW, Wheeler DS, Anderson JM, Kotagal UR: Quality improvement initiative to reduce serious safety events and improve patient safety culture. Pediatrics. 2012, 130 (2): e423-431. 10.1542/peds.2011-3566. · DOI
- Nowinski CJ, Becker SM, Reynolds KS, Beaumont JL, Caprini CA, Hahn EA, Peres A, Arnold BJ: The impact of converting to an electronic health record on organizational culture and quality improvement. Int. J. Med. Inform. 2007, 76 (Suppl 1): S174-183. · DOI
- Higgins JPT, Green S, Collaboration C: Cochrane handbook for systematic reviews of interventions. 2008, Wiley Online Library: UK, 5. · DOI · Paper page
- Larson EL, Early E, Cloonan P, Sugrue S, Parides M: An organizational climate intervention associated with increased handwashing and decreased nosocomial infections. Behav. Med. 2000, 26 (1): 14-22. 10.1080/08964280009595749. · DOI · Paper page
- Mishi S, West M: Managing people and performance: an evidence-based framework applied to health service organisations. Int J Manage Rev. 2004, 5 (2): 91-111.
- Zammuto RF, Krakower JK: Quantitative and qualitative studies of organizational culture. Res Organizational Change Dev. 1991, 5: 83-114.
- Cameron KS, Quinn RE: Diagnosing and changing organizational culture: based on the competing values framework. 2011, US: Jossey-Bass
- Lilford R, Pronovost P: Using hospital mortality rates to judge hospital performance: a bad idea that just won’t go away. Br Med J. 2010, 340: C2016-10.1136/bmj.c2016. · DOI · Paper page
- Pitches DW, Mohammed MA, Lilford RJ: What is the empirical evidence that hospitals with higher-risk adjusted mortality rates provide poorer quality care? A systematic review of the literature. BMC Health Serv. Res. 2007, 7 (1): 91-10.1186/1472-6963-7-91. · DOI
- Wolosin R: Press Ganey Satisfaction Measurement, Client Reference Manua. 1997, US: Press Ganey, 9.
- Santamaria J, Tobin A, Holmes J: Changing cardiac arrest and hospital mortality rates through a medical emergency team takes time and constant review. Crit. Care Med. 2010, 38 (2): 445-10.1097/CCM.0b013e3181cb0ff1. · DOI · Paper page
- Braithwaite J, Westbrook J, Iedema R: Restructuring as gratification. J. R. Soc. Med. 2005, 98 (12): 542-544. 10.1258/jrsm.98.12.542. · doi:10.1258/jrsm.98.12.542
- Kaplan HC, Brady PW, Dritz MC, Hooper DK, Linam W, Froehle CM, Margolis P: The influence of context on quality improvement success in health care: a systematic review of the literature. Milbank Q. 2010, 88 (4): 500-559. 10.1111/j.1468-0009.2010.00611.x. · DOI · Paper page
- Van Herck P, De Smedt D, Annemans L, Remmen R, Rosenthal MB, Sermeus W: Systematic review: effects, design choices, and context of pay-for-performance in health care. BMC Health Serv Res. 2010, 10 (1): 247-10.1186/1472-6963-10-247. · DOI · Paper page
- Kaplan HC, Provost LP, Froehle CM, Margolis PA: The Model for Understanding Success in Quality (MUSIQ): building a theory of context in healthcare quality improvement. BMJ Qual Saf. 2012, 21 (1): 13-20. 10.1136/bmjqs-2011-000010. · DOI · Paper page
Cited by
The struggle of translating science into action: Foundational concepts of implementation science
Rapport, F., Clay‐Williams, R., Churruca, K., Shih, P., Hogden, A., & Braithwaite, J. (2018) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.12741 · Cited by 319
Self-citationAgar, M., Luckett, T., Luscombe, G., Phillips, J., Beattie, E., Pond, D., Mitchell, G., Davidson, P. M., Cook, J., Brooks, D., et al. (2017) · PLOS ONE · doi:10.1371/journal.pone.0181020 · Cited by 74
Luckett, T., Chenoweth, L., Phillips, J., Brooks, D., Cook, J., Mitchell, G., Pond, D., Davidson, P. M., Beattie, E., Luscombe, G., et al. (2017) · International Psychogeriatrics · doi:10.1017/s1041610217000977 · Cited by 41
Metadata
- Authors
- Clay-Williams, R., Nosrati, H., Cunningham, F. C., Hillman, K., & Braithwaite, J.
- Venue
- BMC Health Services Research
- Published
- 2014-09-03
- Volume
- 14
- Issue
- 1
- Pages
- 369-369
- ISSN
- 1472-6963 (ISSN-L)
- OpenAlex
- W2103703645
- Cited by
- 64
- References
- 5
- FWCI
- 1.45
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Do large-scale hospital- and system-wide interventions improve patient outcomes: a systematic review. https://app.cochat.ai/papers/10.1186/1472-6963-14-369
- The paper
- Clay-Williams, R., Nosrati, H., Cunningham, F. C., Hillman, K., & Braithwaite, J. (2014). Do large-scale hospital- and system-wide interventions improve patient outcomes: a systematic review. BMC Health Services Research. https://doi.org/10.1186/1472-6963-14-369
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.