Using Automated Clinical Data for Risk Adjustment: Development and Validation of Six Disease-Specific Mortality Predictive Models for Pay-for-Performance
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Clinically plausible risk-adjustment methods are needed to implement pay-for-performance protocols. Because billing data lacks clinical precision, may be gamed, and chart abstraction is costly, we sought to develop predictive models for mortality that maximally used automated laboratory data and intentionally minimized the use of administrative data (Laboratory Models). We also evaluated the additional value of vital signs and altered mental status (Full Models). METHODS: Six models predicting in-hospital mortality for ischemic and hemorrhagic stroke, pneumonia, myocardial infarction, heart failure, and septicemia were derived from 194,903 admissions in 2000-2003 across 71 hospitals that imported laboratory data. Demographics, admission-based labs, International Classification of Diseases (ICD)-9 variables, vital signs, and altered mental status were sequentially entered as covariates. Models were validated using abstractions (629,490 admissions) from 195 hospitals. Finally, we constructed hierarchical models to compare hospital performance using the Laboratory Models and the Full Models. RESULTS: Model c-statistics ranged from 0.81 to 0.89. As constructed, laboratory findings contributed more to the prediction of death compared with any other risk factor characteristic groups across most models except for stroke, where altered mental status was more important. Laboratory variables were between 2 and 67 times more important in predicting mortality than ICD-9 variables. The hospital-level risk-standardized mortality rates derived from the Laboratory Models were highly correlated with the results derived from the Full Models (average rho = 0.92). CONCLUSIONS: Mortality can be well predicted using models that maximize reliance on objective pathophysiologic variables whereas minimizing input from billing data. Such models should be less susceptible to the vagaries of billing information and inexpensive to implement.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Pearson, T. A., Mensah, G. A., Alexander, R. W., Anderson, J. L., Cannon, R. O., Criqui, M., Fadl, Y. Y., Fortmann, S. P., Hong, Y., Myers, G. L., et al. (2003) · Circulation · doi:10.1161/01.cir.0000052939.59093.45 · Cited by 6,401 · cited 1×
“ischemia and poorer prognosis.(38) These findings seem to support disease-specific modeling.”
League Tables and Their Limitations: Statistical Issues in Comparisons of Institutional Performance
Goldstein, H., & Spiegelhalter, D. J. (1996) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2983325 · Cited by 1,069
Cited by
Risk Prediction Models for Hospital Readmission: A Systematic Review
Kansagara, D., Englander, H., Salanitro, A., Kagen, D., Theobald, C., Freeman, M., & Kripalani, S. (2011) · JAMA · doi:10.1001/jama.2011.1515 · Cited by 1,707
The early prediction of mortality in acute pancreatitis: a large population-based study
Wu, B. U., Johannes, R. S., Sun, X., Tabak, Y., Conwell, D. L., & Banks, P. A. (2008) · Gut · doi:10.1136/gut.2008.152702 · Cited by 919
Self-citationMortality after Hospitalization with Mild, Moderate, and Severe Hyponatremia
Waikar, S. S., Mount, D. B., & Curhan, G. C. (2009) · The American Journal of Medicine · doi:10.1016/j.amjmed.2009.01.027 · Cited by 724
Saltzman, J. R., Tabak, Y. P., Hyett, B. H., Sun, X., Travis, A. C., & Johannes, R. S. (2011) · Gastrointestinal Endoscopy · doi:10.1016/j.gie.2011.06.024 · Cited by 541
Self-citationImproving palliative care with deep learning
Avati, A., Jung, K., Harman, S., Downing, L., Ng, A., & Shah, N. H. (2017) · 2017 IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm.2017.8217669 · Cited by 439
Metadata
- Authors
- Tabak, Y. P., Johannes, R. S., & Silber, J. H.
- Venue
- Medical Care
- Published
- 2007-08
- Volume
- 45
- Issue
- 8
- Pages
- 789-805
- ISSN
- 0025-7079 (ISSN-L)
- OpenAlex
- W2017197553
- Cited by
- 94
- References
- 2
- FWCI
- 8.27
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Using Automated Clinical Data for Risk Adjustment: Development and Validation of Six Disease-Specific Mortality Predictive Models for Pay-for-Performance. https://app.cochat.ai/papers/10.1097/mlr.0b013e31803d3b41
- The paper
- Tabak, Y. P., Johannes, R. S., & Silber, J. H. (2007). Using Automated Clinical Data for Risk Adjustment: Development and Validation of Six Disease-Specific Mortality Predictive Models for Pay-for-Performance. Medical Care. https://doi.org/10.1097/mlr.0b013e31803d3b41
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.