CoChat

Do large-scale hospital- and system-wide interventions improve patient outcomes: a systematic review

Open access
Clay-Williams, Robyn, Nosrati, Hadis, Cunningham, Frances C, Hillman, Kenneth, Braithwaite, Jeffrey · 2014 · BMC Health Services Research
Cited by 64

The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.

Abstract

Background: While health care services are beginning to implement system-wide patient safety interventions, evidence on the efficacy of these interventions is sparse. We know that uptake can be variable, but we do not know the factors that affect uptake or how the interventions establish change and, in particular, whether they influence patient outcomes. We conducted a systematic review to identify how organisational and cultural factors mediate or are mediated by hospital-wide interventions, and to assess the effects of those factors on patient outcomes. Methods: A systematic review was conducted and reported in accordance with Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Database searches were conducted using MEDLINE from 1946, CINAHL from 1991, EMBASE from 1947, Web of Science from 1934, PsycINFO from 1967, and Global Health from 1910 to September 2012. The Lancet, JAMA, BMJ, BMJ Quality and Safety, The New England Journal of Medicine and Implementation Science were also hand searched for relevant studies published over the last 5 years. Eligible studies were required to focus on organisational determinants of hospital- and system-wide interventions, and to provide patient outcome data before and after implementation of the intervention. Empirical, peer-reviewed studies reporting randomised and non-randomised controlled trials, observational, and controlled before and after studies were included in the review. Results: Six studies met the inclusion criteria. Improved outcomes were observed for studies where outcomes were measured at least two years after the intervention. Associations between organisational factors, intervention success and patient outcomes were undetermined: organisational culture and patient outcomes were rarely measured together, and measures for culture and outcome were not standardised. Conclusions: Common findings show the difficulty of introducing large-scale interventions, and that effective leadership and clinical champions, adequate financial and educational resources, and dedicated promotional activities appear to be common factors in successful system-wide change. The protocol has been registered in the international prospective register of systematic reviews, PROSPERO (Registration No. CRD42103003050).

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/1472-6963-14-369

Cites

5 of 5 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 5 references

Research works printed but not linked: 44

  1. Berwick DM, Calkins DR, McCannon CJ, Hackbarth AD: The 100,000 lives campaign: setting a goal and a deadline for improving health care quality. J. Am. Med. Assoc. 2006, 295 (3): 324-327. 10.1001/jama.295.3.324. · DOI · Paper page
  2. Braithwaite J, Coiera E: Beyond patient safety flatland. J R Soc Med. 2010, 103 (6): 219-225. 10.1258/jrsm.2010.100032. · DOI
  3. Donaldson L: An organisation with a memory: report of an expert group on learning from adverse events in the NHS. 2000, London: UK Department of Health
  4. Garling P: Final report of the Special Commission of Inquiry: Acute Care Services in NSW Public Hospitals. 2008, NSW Government: Sydney, 1–3.
  5. Kohn LT, Corrigan JM, Donaldson MS: To err is human: building a safer health system. A report of the Committee on Quality of Health Care in America, Institute of Medicine. 2000, Washington, DC: National Academy Press
  6. Braithwaite J, Clay-Williams R, Nugus P, Plumb J: Health care as a complex adaptive system. Resilient Health Care. Edited by: Hollnagel E, Braithwaite J, Wears R. Surrey, UK: Ashgate Publishing Limited, In press (accepted 17/10/12)
  7. Clay-Williams R: Restructuring and the resilient organisation: implications for health care. Resilient Health Care. Edited by: Hollnagel E, Braithwaite J, Wears R. Surrey, UK: Ashgate Publishing Limited, In press (accepted 17/10/12)
  8. Braithwaite J, Westbrook M, Travaglia J: Attitudes toward the large-scale implementation of an incident reporting system. Int. J. Qual. Health Care. 2008, 20: 184-191. 10.1093/intqhc/mzn004. · DOI
  9. Hillman K, Chen J, Cretikos M, Bellomo R, Brown D, Doig G, Finfer S, Flabouris A: Introduction of the medical emergency team (MET) system: a cluster-randomised controlled trial. Lancet. 2005, 365 (9477): 2091-2097. · DOI · Paper page
  10. Braithwaite J, Westbrook M, Nugus P, Greenfield D, Travaglia JF, Runciman W, Foxwell A, Boyce R, Devinney T, Westbrook J: Continuing differences between health professions' attitudes: the saga of accomplishing systems-wide interprofessionalism. Int. J. Qual. Health Care. 2013, 25 (1): 8-15. 10.1093/intqhc/mzs071. · DOI
  11. Braithwaite J, Westbrook M, Nugus P, Greenfield D, Travaglia JF, Runciman W, Foxwell A, Boyce R, Devinney T, Westbrook J: A four-year, systems-wide intervention promoting interprofessional collaboration. BMC Health Serv. Res. 2012, 12: 99-10.1186/1472-6963-12-99. · DOI · Paper page
  12. Benn J, Burnett S, Parand A, Pinto A, Iskander S, Vincent C: Studying large-scale programmes to improve patient safety in whole care systems: challenges for research. Soc. Sci. Med. 2006, 69 (12): 1767-1776. · DOI
  13. Hillman K, Parr M, Flabouris A, Bishop G, Stewart A: Redefining in-hospital resuscitation: the concept of the medical emergency team. Resuscitation. 2001, 48 (2): 105-110. 10.1016/S0300-9572(00)00334-8. · DOI
  14. Sakai T, DeVita MA: Rapid response system. J. Anesth. 2009, 23 (3): 403-408. 10.1007/s00540-009-0778-8. · doi:10.1007/s00540-009-0778-8
  15. Schouten LM, Hulscher ME, Everdingen JJ, Huijsman R, Grol RP: Evidence for the impact of quality improvement collaboratives: systematic review. Br. Med. J. 2008, 336 (7659): 1491-1494. 10.1136/bmj.39570.749884.BE. · DOI · Paper page
  16. Braithwaite J, Greenfield D, Westbrook J, Pawsey M, Westbrook M, Gibberd R, Naylor J, Nathan S, Robinson M, Runciman B, Jackson M, Travaglia J, Johnston B, Yen D, McDonald H, Low L, Redman S, Johnson B, Corbett A, Hennessy D, Clark J, Lancaster J: Health service accreditation as a predictor of clinical and organisational performance: a blinded, random, stratified study. Qual Saf Health Care. 2010, 19 (1): 14-21. 10.1136/qshc.2009.033928. · DOI · Paper page
  17. Braithwaite J: A lasting legacy from Tony Blair? NHS culture change. J. R. Soc. Med. 2011, 104 (2): 87-89. 10.1258/jrsm.2010.100364. · doi:10.1258/jrsm.2010.100364
  18. Braithwaite J, Runciman W, Merry A: Towards safer, better healthcare: harnessing the natural properties of complex sociotechnical systems. Qual Saf Health Care. 2009, 18 (1): 37-41. 10.1136/qshc.2007.023317. · DOI · Paper page
  19. Braithwaite J, Westbrook M, Iedema R, Mallock N, Forsyth R, Zhang K: A tale of two hospitals: assessing cultural landscapes and compositions. Soc. Sci. Med. 2005, 60: 1149-1162. 10.1016/j.socscimed.2004.06.046. · DOI
  20. Mannion R, Davies H, Harrison S, Frederick K, Jacobs R, Walshe K: Changing management cultures in the English National Heath Service. Culture and Climate in Health Care Organisations. Edited by: Braithwaite J, Hyde P, Pope C. 2009, Basingstoke, UK: Palgrave Macmillan, 19-30.
  21. Mannion R, Davies H, Harrison S, Konteh F, Greener I, McDonald R: Quantitative explorations of culture and performance relationship: changing organisational cultures and hospital performance in the NHS. 2010, Birmingham, UK: National Institute for Health Research Service Delivery and Organisation Programme, 42-72.
  22. Cameron K, Freeman S: Culture, congruence, strength and type: relationship to effectiveness research in organizational change and development. Res Organizational Change Dev. 1991, 5: 23-58.
  23. Nosrati H, Clay-Williams R, Cunningham F, Hillman K, Braithwaite J: The role of organisational and cultural factors in the implementation of system-wide interventions in acute hospitals to improve patient outcomes: protocol for a systematic literature review. BMJ Open. 2013, 3 (3): 1-4. · DOI
  24. Webb D: Safer Patients Initiative phase one. In. 2011, UK: The Health Foundation
  25. Webb D: Safer Patients Initiative phase two. In. 2011, UK: The Health Foundation
  26. Grayson L, Russo P, Ryan K, Bellis K, Havers S, Heard K, Simpson P: Hand Hygiene Australia Manual. In. 2010, Australia: Australian Comission on Safety and Quality in Healthcare
  27. Benning A, Dixon-Woods M, Nwulu U, Ghaleb M, Dawson J, Barber N, Franklin BD, Girling A, Hemming K, Carmalt M, Rudge G, Naicker T, Kotecha A, Derrington MC, Lilford R: Multiple component patient safety intervention in English hospitals: controlled evaluation of second phase. Br. Med. J. 2011, 342: d199-10.1136/bmj.d199. · DOI · Paper page
  28. Benning A, Ghaleb M, Suokas A, Dixon-Woods M, Dawson J, Barber N, Franklin BD, Girling A, Hemming K, Carmalt M, Rudge G, Naicker T, Nwulu U, Choudhury S, Lilford R: Large scale organisational intervention to improve patient safety in four UK hospitals: mixed method evaluation. Br. Med. J. 2011, 342: d195-10.1136/bmj.d195. · DOI · Paper page
  29. Grayson ML, Russo PL, Crulckshank M, Bear JL, Gee CA, Hughes CF, Johnson PDR, McCann R, McMillan AJ, Mitchell BG, Selvey CE, Smith RE, Wilkinson I: Outcomes from the first 2 years of the Australian National Hand Hygiene Initiative. Med. J. Aust. 2011, 195 (10): 615-619. 10.5694/mja11.10747. · DOI
  30. Muething SE, Goudie A, Schoettker PJ, Donnelly LF, Goodfriend MA, Bracke TM, Brady PW, Wheeler DS, Anderson JM, Kotagal UR: Quality improvement initiative to reduce serious safety events and improve patient safety culture. Pediatrics. 2012, 130 (2): e423-431. 10.1542/peds.2011-3566. · DOI
  31. Nowinski CJ, Becker SM, Reynolds KS, Beaumont JL, Caprini CA, Hahn EA, Peres A, Arnold BJ: The impact of converting to an electronic health record on organizational culture and quality improvement. Int. J. Med. Inform. 2007, 76 (Suppl 1): S174-183. · DOI
  32. Higgins JPT, Green S, Collaboration C: Cochrane handbook for systematic reviews of interventions. 2008, Wiley Online Library: UK, 5. · DOI · Paper page
  33. Larson EL, Early E, Cloonan P, Sugrue S, Parides M: An organizational climate intervention associated with increased handwashing and decreased nosocomial infections. Behav. Med. 2000, 26 (1): 14-22. 10.1080/08964280009595749. · DOI · Paper page
  34. Mishi S, West M: Managing people and performance: an evidence-based framework applied to health service organisations. Int J Manage Rev. 2004, 5 (2): 91-111.
  35. Zammuto RF, Krakower JK: Quantitative and qualitative studies of organizational culture. Res Organizational Change Dev. 1991, 5: 83-114.
  36. Cameron KS, Quinn RE: Diagnosing and changing organizational culture: based on the competing values framework. 2011, US: Jossey-Bass
  37. Lilford R, Pronovost P: Using hospital mortality rates to judge hospital performance: a bad idea that just won’t go away. Br Med J. 2010, 340: C2016-10.1136/bmj.c2016. · DOI · Paper page
  38. Pitches DW, Mohammed MA, Lilford RJ: What is the empirical evidence that hospitals with higher-risk adjusted mortality rates provide poorer quality care? A systematic review of the literature. BMC Health Serv. Res. 2007, 7 (1): 91-10.1186/1472-6963-7-91. · DOI
  39. Wolosin R: Press Ganey Satisfaction Measurement, Client Reference Manua. 1997, US: Press Ganey, 9.
  40. Santamaria J, Tobin A, Holmes J: Changing cardiac arrest and hospital mortality rates through a medical emergency team takes time and constant review. Crit. Care Med. 2010, 38 (2): 445-10.1097/CCM.0b013e3181cb0ff1. · DOI · Paper page
  41. Braithwaite J, Westbrook J, Iedema R: Restructuring as gratification. J. R. Soc. Med. 2005, 98 (12): 542-544. 10.1258/jrsm.98.12.542. · doi:10.1258/jrsm.98.12.542
  42. Kaplan HC, Brady PW, Dritz MC, Hooper DK, Linam W, Froehle CM, Margolis P: The influence of context on quality improvement success in health care: a systematic review of the literature. Milbank Q. 2010, 88 (4): 500-559. 10.1111/j.1468-0009.2010.00611.x. · DOI · Paper page
  43. Van Herck P, De Smedt D, Annemans L, Remmen R, Rosenthal MB, Sermeus W: Systematic review: effects, design choices, and context of pay-for-performance in health care. BMC Health Serv Res. 2010, 10 (1): 247-10.1186/1472-6963-10-247. · DOI · Paper page
  44. Kaplan HC, Provost LP, Froehle CM, Margolis PA: The Model for Understanding Success in Quality (MUSIQ): building a theory of context in healthcare quality improvement. BMJ Qual Saf. 2012, 21 (1): 13-20. 10.1136/bmjqs-2011-000010. · DOI · Paper page

Cited by

See all 64

Metadata

Authors
Clay-Williams, R., Nosrati, H., Cunningham, F. C., Hillman, K., & Braithwaite, J.
Venue
BMC Health Services Research
Published
2014-09-03
Volume
14
Issue
1
Pages
369-369
ISSN
1472-6963 (ISSN-L)
OpenAlex
W2103703645
Cited by
64
References
5
FWCI
1.45
Type
journal article
Language
en
Open access
gold

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Do large-scale hospital- and system-wide interventions improve patient outcomes: a systematic review. https://app.cochat.ai/papers/10.1186/1472-6963-14-369
The paper
Clay-Williams, R., Nosrati, H., Cunningham, F. C., Hillman, K., & Braithwaite, J. (2014). Do large-scale hospital- and system-wide interventions improve patient outcomes: a systematic review. BMC Health Services Research. https://doi.org/10.1186/1472-6963-14-369

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.