The DOI matches its Crossref record.
Using routine comparative data to assess the quality of health care: understanding and avoiding common pitfalls
Open accessAbstract
Measuring the quality of health care has become a major concern for funders and providers of health services in recent decades. One of the ways in which quality of care is currently assessed is by taking routinely collected data and analysing them quantitatively. The use of routine data has many advantages but there are also some important pitfalls. Collating numerical data in this way means that comparisons can be made--whether over time, with benchmarks, or with other healthcare providers (at individual or institutional levels of aggregation). Inevitably, such comparisons reveal variations. The natural inclination is then to assume that such variations imply rankings: that the measures reflect quality and that variations in the measures reflect variations in quality. This paper identifies reasons why these assumptions need to be applied with care, and illustrates the pitfalls with examples from recent empirical work. It is intended to guide not only those who wish to interpret comparative quality data, but also those who wish to develop systems for such analyses themselves.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Mitchell, A. J., Malone, D., & Doebbeling, C. C. (2009) · British Journal of Psychiatry · doi:10.1192/bjp.bp.107.045732 · Cited by 360
Adriaenssens, N., Coenen, S., Tonkin-Crine, S., Verheij, T. J. M., Little, P., & Goossens, H. (2011) · BMJ Quality & Safety · doi:10.1136/bmjqs.2010.049049 · Cited by 309
van der Veer, S. N., de Keizer, N. F., Ravelli, A. C. J., Tenkink, S., & Jager, K. J. (2010) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2010.01.011 · Cited by 184
“As a result of governmental regulations, public demand, but also at their own initiative, more and more health care organizations have started to collect data inmedical registries [1,3,4].”
BackgroundImportance of accurately identifying disease in studies using electronic health records
Manuel, D. G., Rosella, L. C., & Stukel, T. A. (2010) · BMJ · doi:10.1136/bmj.c4226 · Cited by 159
Determinants of cesarean delivery: a classification tree analysis
Stivanello, E., Rucci, P., Lenzi, J., & Fantini, M. P. (2014) · BMC Pregnancy and Childbirth · doi:10.1186/1471-2393-14-215 · Cited by 32
Metadata
- Authors
- Powell, A. E.
- Venue
- Quality and Safety in Health Care
- Publisher
- BMJ
- Published
- 2003-04-01
- Volume
- 12
- Issue
- 2
- Pages
- 122-128
- ISSN
- 1475-3898 (ISSN-L)
- 1475-3901
- OpenAlex
- W2128556524
- Cited by
- 223
- References
- 0
- FWCI
- 13.51
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Using routine comparative data to assess the quality of health care: understanding and avoiding common pitfalls. https://app.cochat.ai/papers/10.1136/qhc.12.2.122
- The paper
- Powell, A. E. (2003). Using routine comparative data to assess the quality of health care: understanding and avoiding common pitfalls. Quality and Safety in Health Care. https://doi.org/10.1136/qhc.12.2.122
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.