The DOI matches its Crossref record; 96 of the 96 references it cites were found in a registry or an index.
Use and misuse of process and outcome data in managing performance of acute medical care: avoiding institutional stigma.
Open accessAbstract
The history of monitoring the outcomes of health care by external agencies can be traced to ancient times. However, the danger, now as then, is that in the search for improvement, comparative measures of mortality and morbidity are often overinterpreted, resulting in judgments about the underlying quality of care. Such judgments can translate into performance management strategies in the form of capricious sanctions (such as star ratings) and unjustified rewards (such as special freedoms or financial allocations). The resulting risk of stigmatising an entire institution injects huge tensions into health-care organisations and can divert attention from genuine improvement towards superficial improvement or even gaming behaviour (ie, manipulating the system). These dangers apply particularly to measures of outcome and throughput. We argue that comparative outcome data (league tables) should not be used by external agents to make judgments about quality of hospital care. Although they might provide a reasonable measure of quality in some high-risk surgical situations, they have little validity in acute medical settings. Their use to support a system of reward and punishment is unfair and, unsurprisingly, often resisted by clinicians and managers. We argue further that although outcome data are useful for research and monitoring trends within an organisation, those who wish to improve care for patients and not penalise doctors and managers, should concentrate on direct measuremen…
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Core outcomes are identified as ROSC, survival at hospital discharge/30-days, and neurological outcome at hospital discharge. 302,303”
From European Resuscitation Council Guidelines 2021: Ethics of resuscitation and end of life decisions (2021) · cites this paper as [302]
In the citing paper
“Variation may reflect differences at several levels, including data collection methods, case-mix, and treatment. 293,294”
From European Resuscitation Council Guidelines 2021: Ethics of resuscitation and end of life decisions (2021) · cites this paper as [293]
In the citing paper
“This high risk of a false negative results arises because the signal-to-noise ratio is high when mortality and morbidity are used as measures of service quality [28].”
From Evaluating eHealth: How to Make Evaluation More Methodologically Robust (2009) · cites this paper as [28]
Citations
Cites
(2000) · New England Journal of Medicine · doi:10.1056/nejm200005043421801 · Cited by 12,941
Crossing the Quality Chasm: A New Health System for the 21st Century
Baker, A. (2001) · BMJ · doi:10.1136/bmj.323.7322.1192 · Cited by 10,736
HUSELID, M. A. (1995) · Academy of Management Journal · doi:10.2307/256741 · Cited by 9,342
Crossing the Quality Chasm: A New Health System for the 21st Century
Committee on Quality of Health Care in America (2002) · Journal For Healthcare Quality · doi:10.1111/j.1945-1474.2002.tb00463.x · Cited by 8,483
Deming, W. E. (1982) · Medical Entomology and Zoology · Cited by 7,297
Hospital Nurse Staffing and Patient Mortality, Nurse Burnout, and Job Dissatisfaction
Aiken, L. H. (2002) · JAMA · doi:10.1001/jama.288.16.1987 · Cited by 5,226
beta Blockade after myocardial infarction: systematic review and meta regression analysis
Freemantle, N., Cleland, J., Young, P., Mason, J., & Harrison, J. (1999) · BMJ · doi:10.1136/bmj.318.7200.1730 · Cited by 1,509
Physician Staffing Patterns and Clinical Outcomes in Critically Ill Patients: A Systematic Review
Pronovost, P. J., Angus, D. C., Dorman, T., Robinson, K. A., Dremsizov, T. T., & Young, T. L. (2002) · JAMA · doi:10.1001/jama.288.17.2151 · Cited by 1,506
Confidential inquiry into quality of care before admission to intensive care
McQuillan, P., Pilkington, S., Allan, A., Taylor, B., Short, A., Morgan, G., Nielsen, M., Barrett, D., & Smith, G. (1998) · BMJ · doi:10.1136/bmj.316.7148.1853 · Cited by 1,463
League Tables and Their Limitations: Statistical Issues in Comparisons of Institutional Performance
Goldstein, H., & Spiegelhalter, D. J. (1996) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2983325 · Cited by 1,069
Self-citation
Cited by
Truog, R. D., Campbell, M. L., Curtis, J. R., Haas, C. E., Luce, J. M., Rubenfeld, G. D., Rushton, C. H., & Kaufman, D. C. (2008) · Critical Care Medicine · doi:10.1097/ccm.0b013e3181659096 · Cited by 1,091
Appropriate prescribing in elderly people: how well can it be measured and optimised?
Spinewine, A., Schmader, K. E., Barber, N., Hughes, C., Lapane, K. L., Swine, C., & Hanlon, J. T. (2007) · The Lancet · doi:10.1016/s0140-6736(07)61091-5 · Cited by 1,090
The Use of Control Charts in Health-Care and Public-Health Surveillance
Woodall, W. H. (2006) · Journal of Quality Technology · doi:10.1080/00224065.2006.11918593 · Cited by 583
Translating evidence into practice: a model for large scale knowledge translation
Pronovost, P. J., Berenholtz, S. M., & Needham, D. M. (2008) · BMJ · doi:10.1136/bmj.a1714 · Cited by 577
Post-operative mortality, missed care and nurse staffing in nine countries: A cross-sectional study
Ball, J. E., Bruyneel, L., Aiken, L. H., Sermeus, W., Sloane, D. M., Rafferty, A. M., Lindqvist, R., Tishelman, C., & Griffiths, P. (2018) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2017.08.004 · Cited by 544
Metadata
- Authors
- Lilford, R., Mohammed, M. A., Spiegelhalter, D., & Thomson, R.
- Affiliations
- University of Birmingham (GB)
- MRC Biostatistics Unit (GB)
- Newcastle University (GB)
- Corresponding author
- Lilford, Richard
- Venue
- The Lancet
- Publisher
- Elsevier BV
- Published
- 2004-04
- Volume
- 363
- Issue
- 9415
- Pages
- 1147-1154
- ISSN
- 0099-5355 (ISSN-L)
- 0140-6736
- OpenAlex
- W2099023772
- Cited by
- 448
- References
- 96
- Citations by year
- 2026: 7 · 2025: 4 · 2024: 12 · 2023: 7 · 2022: 12 · 2021: 9 · 2020: 14 · 2019: 16 · 2018: 12 · 2017: 19 · 2016: 20 · 2015: 28 · 2014: 28 · 2013: 31 · 2012: 30
- FWCI
- 68.33
- Type
- journal article
- Language
- en
- Open access
- green
- doi.org
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- Locations
- The Lancet (publishedVersion)
- PubMed (publishedVersion)
- University of Birmingham Research Portal (University of Birmingham) (submittedVersion)
- DigitalGeorgetown (Georgetown University Library) (submittedVersion)
- Newcastle University ePrints (Newcastle Univesity)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Healthcare Quality and Management
- Health Sciences › Health Professions › General Health Professions › Patient Satisfaction in Healthcare
- Health Sciences › Medicine › Family Practice › Primary Care and Health Outcomes
- Keywords
- hospital performance management, league tables, institutional stigma, star ratings, reward and punishment, acute care, quality of care, hospital throughput
- MeSH terms
- Critical Care, Delivery of Health Care, Health Services Research, Humans, Quality of Health Care, Process Assessment, Health Care, Total Quality Management, Quality Indicators, Health Care, Risk Adjustment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Use and misuse of process and outcome data in managing performance of acute medical care: avoiding institutional stigma. https://app.cochat.ai/papers/10.1016/s0140-6736(04)15901-1
- The paper
- Lilford, R., Mohammed, M. A., Spiegelhalter, D., & Thomson, R. (2004). Use and misuse of process and outcome data in managing performance of acute medical care: avoiding institutional stigma. The Lancet. https://doi.org/10.1016/s0140-6736(04)15901-1
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.