Evaluation of Surveillance Bias and the Validity of the Venous Thromboembolism Quality Measure
The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
IMPORTANCE: Postoperative venous thromboembolism (VTE) rates are widely reported quality metrics soon to be used in pay-for-performance programs. Surveillance bias occurs when some clinicians use imaging studies to detect VTE more frequently than other clinicians. Because they look more, they find more VTE events, paradoxically worsening their hospital's VTE quality measure performance. A surveillance bias may influence VTE measurement if (1) greater hospital VTE prophylaxis adherence fails to result in lower measured VTE rates, (2) hospitals with characteristics suggestive of higher quality (eg, more accreditations) have greater VTE prophylaxis adherence rates but worse VTE event rates, and (3) higher hospital VTE imaging utilization use rates are associated with higher measured VTE event rates. OBJECTIVE: To examine whether a surveillance bias influences the validity of reported VTE rates. DESIGN, SETTING, AND PARTICIPANTS: 2010 Hospital Compare and American Hospital Association data from 2838 hospitals were merged. Next, 2009-2010 Medicare claims data for 954,926 surgical patient discharges from 2786 hospitals who were undergoing 1 of 11 major operations were used to calculate VTE imaging (duplex ultrasonography, chest computed tomography/magnetic resonance imaging, and ventilation-perfusion scans) and VTE event rates. MAIN OUTCOMES AND MEASURES: The association between hospital VTE prophylaxis adherence and risk-adjusted VTE event rates was examined. The relationship between a summary score of hospital structural characteristics reflecting quality (hospital size, numbers of accreditations/quality initiatives) and performance on VTE prophylaxis and risk-adjusted VTE measures was examined. Hospital-level VTE event rates were compared across VTE diagnostic imaging rate quartiles and with a quantile regression. RESULTS: Greater hospital VTE prophylaxis adherence rates were weakly associated with worse risk-adjusted VTE event rates (r2 = 4.2%; P = .03). Hospitals with increasing structural quality scores had higher VTE prophylaxis adherence rates (93.3% vs 95.5%, lowest vs highest quality quartile; P < .001) but worse risk-adjusted VTE rates (4.8 vs 6.4 per 1000, lowest vs highest quality quartile; P < .001). Mean VTE diagnostic imaging rates ranged from 32 studies per 1000 in the lowest imaging use quartile to 167 per 1000 in the highest quartile (P < .001). Risk-adjusted VTE rates increased significantly with VTE imaging use rates in a stepwise fashion, from 5.0 per 1000 in the lowest quartile to 13.5 per 1000 in the highest quartile (P < .001). CONCLUSIONS AND RELEVANCE: Hospitals with higher quality scores had higher VTE prophylaxis rates but worse risk-adjusted VTE rates. Increased hospital VTE event rates were associated with increasing hospital VTE imaging use rates. Surveillance bias limits the usefulness of the VTE quality measure for hospitals working to improve quality and patients seeking to identify a high-quality hospital.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Kearon (2012) · doi:10.1378/chest.11-2301 · Cited by 6,119
Sackett, D. L. (1979) · Journal of Chronic Diseases · doi:10.1016/0021-9681(79)90012-2 · Cited by 2,075
Schmaltz, S. P., Williams, S. C., Chassin, M. R., Loeb, J. M., & Wachter, R. M. (2011) · Journal of Hospital Medicine · doi:10.1002/jhm.905 · Cited by 172
Cited by
Secular Trends in Occurrence of Acute Venous Thromboembolism: The Worcester VTE Study (1985-2009)
Huang, W., Goldberg, R. J., Anderson, F. A., Kiefe, C. I., & Spencer, F. A. (2014) · The American Journal of Medicine · doi:10.1016/j.amjmed.2014.03.041 · Cited by 297
Erekson, E., Murchison, R. L., Gerjevic, K. A., Meljen, V. T., & Strohbehn, K. (2017) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2017.05.052 · Cited by 34
Metadata
- Authors
- Bilimoria, K. Y., Chung, J., Ju, M. H., Haut, E. R., Bentrem, D. J., Ko, C. Y., & Baker, D. W.
- Venue
- JAMA
- Publisher
- American Medical Association (AMA)
- Published
- 2013-10-09
- Volume
- 310
- Issue
- 14
- Pages
- 1482
- ISSN
- 0002-9955 (ISSN-L)
- 0098-7484
- OpenAlex
- W1969335466
- Cited by
- 201
- References
- 3
- FWCI
- 23.70
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.