The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Risk Prediction Models for Hospital Readmission: A Systematic Review
Open accessAbstract
CONTEXT: Predicting hospital readmission risk is of great interest to identify which patients would benefit most from care transition interventions, as well as to risk-adjust readmission rates for the purposes of hospital comparison. OBJECTIVE: To summarize validated readmission risk prediction models, describe their performance, and assess suitability for clinical or administrative use. DATA SOURCES AND STUDY SELECTION: The databases of MEDLINE, CINAHL, and the Cochrane Library were searched from inception through March 2011, the EMBASE database was searched through August 2011, and hand searches were performed of the retrieved reference lists. Dual review was conducted to identify studies published in the English language of prediction models tested with medical patients in both derivation and validation cohorts. DATA EXTRACTION: Data were extracted on the population, setting, sample size, follow-up interval, readmission rate, model discrimination and calibration, type of data used, and timing of data collection. DATA SYNTHESIS: Of 7843 citations reviewed, 30 studies of 26 unique models met the inclusion criteria. The most common outcome used was 30-day readmission; only 1 model specifically addressed preventable readmissions. Fourteen models that relied on retrospective administrative data could be potentially used to risk-adjust readmission rates for hospital comparison; of these, 9 were tested in large US populations and had poor discriminative ability (c statistic range: 0.55-0.65). Seven models could potentially be used to identify high-risk patients for intervention early during a hospitalization (c statistic range: 0.56-0.72), and 5 could be used at hospital discharge (c statistic range: 0.68-0.83). Six studies compared different models in the same population and 2 of these found that functional and social variables improved model discrimination. Although most models incorporated variables for medical comorbidity and use of prior medical services, few examined variables associated with overall health and function, illness severity, or social determinants of health. CONCLUSIONS: Most current readmission risk prediction models that were designed for either comparative or clinical purposes perform poorly. Although in certain settings such models may prove useful, efforts to improve their performance are needed as use becomes more widespread.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Charlson, M. E., Pompei, P., Ales, K. L., & MacKenzie, C. R. (1987) · Journal of Chronic Diseases · doi:10.1016/0021-9681(87)90171-8 · Cited by 49,742
The Care Transitions Intervention: Results of a Randomized Controlled Trial
Coleman, E. A., Parry, C., Chalmers, S., & Min, S.-J. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.17.1822 · Cited by 1,937
Naylor, M. D., Brooten, D., Campbell, R., Jacobsen, B. S., Mezey, M. D., Pauly, M. V., & Schwartz, J. S. (1999) · JAMA · doi:10.1001/jama.281.7.613 · Cited by 1,831
A Reengineered Hospital Discharge Program to Decrease Rehospitalization: A Randomized Trial
Jack, B. W., Chetty, V. K., Anthony, D., Greenwald, J. L., Sanchez, G. M., Johnson, A. E., Forsythe, S. R., O'Donnell, J. K., Paasche-Orlow, M. K., Manasseh, C., et al. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-150-3-200902030-00007 · Cited by 1,565
Evaluation of the Quality of Prognosis Studies in Systematic Reviews
Hayden, J. A., Côté, P., & Bombardier, C. (2006) · Annals of Internal Medicine · doi:10.7326/0003-4819-144-6-200603210-00010 · Cited by 1,452
Hernandez, A. F. (2010) · JAMA · doi:10.1001/jama.2010.533 · Cited by 1,032
Users' Guides to the Medical Literature: XXII: How to Use Articles About Clinical Decision Rules
McGinn, T. G., Guyatt, G. H., Wyer, P. C., Naylor, C. D., Stiell, I. G., Richardson, W. S., & for the Evidence-Based Medicine Working Group (2000) · JAMA · doi:10.1001/jama.284.1.79 · Cited by 1,014
Fung, C. H., Lim, Y.-W., Mattke, S., Damberg, C., & Shekelle, P. G. (2008) · Annals of Internal Medicine · doi:10.7326/0003-4819-148-2-200801150-00006 · Cited by 980
van Walraven, C., Dhalla, I. A., Bell, C., Etchells, E., Stiell, I. G., Zarnke, K., Austin, P. C., & Forster, A. J. (2010) · Canadian Medical Association Journal · doi:10.1503/cmaj.091117 · Cited by 960
Risk Adjustment for Measuring Healthcare Outcomes
Iezzoni, L. I. (1994) · Cited by 955
Kripalani, S., Jackson, A. T., Schnipper, J. L., & Coleman, E. A. (2007) · Journal of Hospital Medicine · doi:10.1002/jhm.228 · Cited by 821
Self-citationProportion of hospital readmissions deemed avoidable: a systematic review
van Walraven, C., Bennett, C., Jennings, A., Austin, P. C., & Forster, A. J. (2011) · Canadian Medical Association Journal · doi:10.1503/cmaj.101860 · Cited by 711
Schneeweiss, S. (2001) · American Journal of Epidemiology · doi:10.1093/aje/154.9.854 · Cited by 711
Predictors of readmission among elderly survivors of admission with heart failure
Krumholz, H. M., Chen, Y.-T., Wang, Y., Vaccarino, V., Radford, M. J., & Horwitz, R. I. (2000) · American Heart Journal · doi:10.1016/s0002-8703(00)90311-9 · Cited by 438
Amarasingham, R., Moore, B. J., Tabak, Y. P., Drazner, M. H., Clark, C. A., Zhang, S., Reed, W. G., Swanson, T. S., Ma, Y., & Halm, E. A. (2010) · Medical Care · doi:10.1097/mlr.0b013e3181ef60d9 · Cited by 437
Posthospital Care Transitions: Patterns, Complications, and Risk Identification
Coleman, E. A., Min, S., Chomiak, A., & Kramer, A. M. (2004) · Health Services Research · doi:10.1111/j.1475-6773.2004.00298.x · Cited by 416
Hospital Readmission in General Medicine Patients: A Prediction Model
Hasan, O., Meltzer, D. O., Shaykevich, S. A., Bell, C. M., Kaboli, P. J., Auerbach, A. D., Wetterneck, T. B., Arora, V. M., Zhang, J., & Schnipper, J. L. (2010) · Journal of General Internal Medicine · doi:10.1007/s11606-009-1196-1 · Cited by 399
Billings, J., Dixon, J., Mijanovich, T., & Wennberg, D. (2006) · BMJ · doi:10.1136/bmj.38870.657917.ae · Cited by 372
Hospital Readmission as an Accountability Measure
Axon, R. N., & Williams, M. V. (2011) · JAMA · doi:10.1001/jama.2011.72 · Cited by 370
Ross, J. S. (2008) · Archives of Internal Medicine · doi:10.1001/archinte.168.13.1371 · Cited by 343
Krumholz, H. M., Brindis, R. G., Brush, J. E., Cohen, D. J., Epstein, A. J., Furie, K., Howard, G., Peterson, E. D., Rathore, S. S., Smith, S. C., et al. (2006) · Circulation · doi:10.1161/circulationaha.105.170769 · Cited by 341
Screening Elders for Risk of Hospital Admission
Boult, C., Dowd, B., McCaffrey, D., Boult, L., Hernandez, R., & Krulewitch, H. (1993) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.1993.tb06175.x · Cited by 333
Krumholz, H. M. (2008) · Circulation: Cardiovascular Quality and Outcomes · doi:10.1161/circoutcomes.108.814509 · Cited by 289
Halfon, P., Eggli, Y., Prêtre-Rohrbach, I., Meylan, D., Marazzi, A., & Burnand, B. (2006) · Medical Care · doi:10.1097/01.mlr.0000228002.43688.c2 · Cited by 257
Philbin, E. F., & DiSalvo, T. G. (1999) · Journal of the American College of Cardiology · doi:10.1016/s0735-1097(99)00059-5 · Cited by 253
Risk Factors for 30-Day Hospital Readmission in Patients ≥65 Years of Age
Silverstein, M. D., Qin, H., Mercer, S. Q., Fong, J., & Haydar, Z. (2008) · Baylor University Medical Center Proceedings · doi:10.1080/08998280.2008.11928429 · Cited by 251
Measuring potentially avoidable hospital readmissions
Halfon, P., Eggli, Y., van Melle, G., Chevalier, J., Wasserfallen, J.-B., & Burnand, B. (2002) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(01)00521-2 · Cited by 245
Joynt, K. E., & Jha, A. K. (2011) · Circulation: Cardiovascular Quality and Outcomes · doi:10.1161/circoutcomes.110.950964 · Cited by 231
Risk Stratification and Therapeutic Decision Making in Acute Coronary Syndromes
Ohman, E. M. (2000) · JAMA · doi:10.1001/jama.284.7.876 · Cited by 193
Determinants of preventable readmissions in the United States: a systematic review
Vest, J. R., Gamm, L. D., Oxford, B. A., Gonzalez, M. I., & Slawson, K. M. (2010) · Implementation Science · doi:10.1186/1748-5908-5-88 · Cited by 191
A conceptual framework for the study of early readmission as an indicator of quality of care
Ashton, C. M., & Wray, N. P. (1996) · Social Science & Medicine · doi:10.1016/s0277-9536(96)00049-4 · Cited by 180
Inability of Providers to Predict Unplanned Readmissions
Allaudeen, N., Schnipper, J. L., Orav, E. J., Wachter, R. M., & Vidyarthi, A. R. (2011) · Journal of General Internal Medicine · doi:10.1007/s11606-011-1663-3 · Cited by 175
Bahadori, K., & FitzGerald, J. M. (2007) · PubMed Central · Cited by 162
Identifying Patients at High Risk of Emergency Hospital Admissions: A Logistic Regression Analysis
Bottle, A., Aylin, P. P., & Majeed, A. (2006) · Journal of the Royal Society of Medicine · doi:10.1258/jrsm.99.8.406 · Cited by 158
A multipurpose comorbidity scoring system performed better than the Charlson index
Holman, C. D. J., Preen, D. B., Baynham, N. J., Finn, J., & Semmens, J. B. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.01.020 · Cited by 142
Hospital Readmissions and Quality of Care
Weissman, J. S., Ayanian, J. Z., Chasan-Taber, S., Sherwood, M. J., Roth, C. P., & Epstein, A. M. (1999) · Medical Care · doi:10.1097/00005650-199905000-00008 · Cited by 135
Improving the management of care for high-cost Medicaid patients.
Billings, J., & Mijanovich, T. (2007) · Health Affairs · doi:10.1377/hlthaff.26.6.1643 · Cited by 132
Hammill, B. G., Curtis, L. H., Fonarow, G. C., Heidenreich, P. A., Yancy, C. W., Peterson, E. D., & Hernandez, A. F. (2010) · Circulation Cardiovascular Quality and Outcomes · doi:10.1161/circoutcomes.110.954693 · Cited by 121
Classifying general medicine readmissions
Oddone, E. Z., Weinberger, M., Horner, M., Mengel, C., Goldstein, F., Ginier, P., Smith, D. G., Huey, J., Farber, N. J., Asch, D. A., et al. (1996) · Journal of General Internal Medicine · doi:10.1007/bf02599027 · Cited by 120
Statistical Models and Patient Predictors of Readmission for Acute Myocardial Infarction
Desai, M. M., Stauffer, B. D., Feringa, H. H. H., & Schreiner, G. C. (2009) · Circulation Cardiovascular Quality and Outcomes · doi:10.1161/circoutcomes.108.832949 · Cited by 108
Factors predicting readmission of older general medicine patients
Burns, R. A., & Nichols, L. O. (1991) · Journal of General Internal Medicine · doi:10.1007/bf02598158 · Cited by 105
Using routine inpatient data to identify patients at risk of hospital readmission
Howell, S. C., Coory, M. D., Martin, J. H., & Duckett, S. J. (2009) · BMC Health Services Research · doi:10.1186/1472-6963-9-96 · Cited by 96
Tabak, Y. P., Johannes, R. S., & Silber, J. H. (2007) · Medical Care · doi:10.1097/mlr.0b013e31803d3b41 · Cited by 95
Postdischarge Care and Readmissions
Smith, D. M., Weinberger, M., Katz, B. P., & MOORE, P. S. (1988) · Medical Care · doi:10.1097/00005650-198807000-00005 · Cited by 72
Nonelective readmissions of medical patients
Smith, D. M., Norton, J. A., & McDonald, C. J. (1985) · Journal of Chronic Diseases · doi:10.1016/0021-9681(85)90064-5 · Cited by 67
Identifying factors associated with health care use: A hospital-based risk screening index
Evans, R. L., Hendricks, R. D., Lawrence, K. V., & Bishop, D. S. (1988) · Social Science & Medicine · doi:10.1016/0277-9536(88)90286-9 · Cited by 49
Novotny, N. L., & Anderson, M. A. (2008) · Nursing Research · doi:10.1097/nnr.0b013e31818c3e06 · Cited by 38
Naessens, J. M., Leibson, C. L., Krishan, I., & Ballard, D. (1992) · Mayo Clinic Proceedings · doi:10.1016/s0025-6196(12)61143-4 · Cited by 37
Influence of Drugs, Demographics and Medical History on Hospital Readmission of Elderly Patients
Morrissey, E. F., McElnay, J. C., Scott, M., & McConnell, B. J. (2003) · Clinical Drug Investigation · doi:10.2165/00044011-200323020-00005 · Cited by 33
Risk factors for nonelective hospital readmissions
Smith, D. M., Katz, B. P., Huster, G. A., Fitzgerald, J. F., Martin, D., & Freedman, J. A. (1996) · Journal of General Internal Medicine · doi:10.1007/bf02598996 · Cited by 24
Cited by
PROBAST: A Tool to Assess the Risk of Bias and Applicability of Prediction Model Studies
Wolff, R. F., Moons, K. G. M., Riley, R. D., Whiting, P. F., Westwood, M., Collins, G. S., Reitsma, J. B., Kleijnen, J., Mallett, S., & for the PROBAST Group† (2019) · Annals of Internal Medicine · doi:10.7326/m18-1376 · Cited by 2,984
Scalable and accurate deep learning with electronic health records
Rajkomar, A., Oren, E., Chen, K., Dai, A. M., Hajaj, N., Hardt, M., Liu, P. J., Liu, X., Marcus, J., Sun, M., et al. (2018) · npj Digital Medicine · doi:10.1038/s41746-018-0029-1 · Cited by 2,648
“The primary endpoints for those predictions were at discharge, when most readmission prediction scores are computed and when all information necessary to assign billing diagnoses is available [28].”
BackgroundUnderstanding Black-box Predictions via Influence Functions
Koh, P. W., & Liang, P. (2017) · arXiv · doi:10.48550/arxiv.1703.04730 · Cited by 1,514
Neighborhood Socioeconomic Disadvantage and 30-Day Rehospitalization: A Retrospective Cohort Study
Kind, A. J. H., Jencks, S., Brock, J., Yu, M., Bartels, C., Ehlenbach, W., Greenberg, C., & Smith, M. (2014) · Annals of Internal Medicine · doi:10.7326/m13-2946 · Cited by 1,379
Post-Hospital Syndrome — An Acquired, Transient Condition of Generalized Risk
Krumholz, H. M. (2013) · New England Journal of Medicine · doi:10.1056/nejmp1212324 · Cited by 1,218
Metadata
- Authors
- Kansagara, D., Englander, H., Salanitro, A., Kagen, D., Theobald, C., Freeman, M., & Kripalani, S.
- Venue
- JAMA
- Publisher
- American Medical Association (AMA)
- Published
- 2011-10-19
- Volume
- 306
- Issue
- 15
- Pages
- 1688
- ISSN
- 0002-9955 (ISSN-L)
- 0098-7484
- OpenAlex
- W2086923543
- Cited by
- 1,707
- References
- 50
- FWCI
- 96.76
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.