The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Risk Prediction Models for Hospital Readmission: A Systematic Review
Open accessAbstract
CONTEXT: Predicting hospital readmission risk is of great interest to identify which patients would benefit most from care transition interventions, as well as to risk-adjust readmission rates for the purposes of hospital comparison. OBJECTIVE: To summarize validated readmission risk prediction models, describe their performance, and assess suitability for clinical or administrative use. DATA SOURCES AND STUDY SELECTION: The databases of MEDLINE, CINAHL, and the Cochrane Library were searched from inception through March 2011, the EMBASE database was searched through August 2011, and hand searches were performed of the retrieved reference lists. Dual review was conducted to identify studies published in the English language of prediction models tested with medical patients in both derivation and validation cohorts. DATA EXTRACTION: Data were extracted on the population, setting, sample size, follow-up interval, readmission rate, model discrimination and calibration, type of data used, and timing of data collection. DATA SYNTHESIS: Of 7843 citations reviewed, 30 studies of 26 unique models met the inclusion criteria. The most common outcome used was 30-day readmission; only 1 model specifically addressed preventable readmissions. Fourteen models that relied on retrospective administrative data could be potentially used to risk-adjust readmission rates for hospital comparison; of these, 9 were tested in large US populations and had poor discriminative ability (c statistic range: 0.55-0.65). Seven models could potentially be used to identify high-risk patients for intervention early during a hospitalization (c statistic range: 0.56-0.72), and 5 could be used at hospital discharge (c statistic range: 0.68-0.83). Six studies compared different models in the same population and 2 of these found that functional and social variables improved model discrimination. Although most models incorporated variables for medical comorbidity and use of prior medical services, few examined variables associated with overall health and function, illness severity, or social determinants of health. CONCLUSIONS: Most current readmission risk prediction models that were designed for either comparative or clinical purposes perform poorly. Although in certain settings such models may prove useful, efforts to improve their performance are needed as use becomes more widespread.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Charlson, M. E., Pompei, P., Ales, K. L., & MacKenzie, C. R. (1987) · Journal of Chronic Diseases · doi:10.1016/0021-9681(87)90171-8 · Cited by 49,742
The Care Transitions Intervention: Results of a Randomized Controlled Trial
Coleman, E. A., Parry, C., Chalmers, S., & Min, S.-J. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.17.1822 · Cited by 1,937
Naylor, M. D., Brooten, D., Campbell, R., Jacobsen, B. S., Mezey, M. D., Pauly, M. V., & Schwartz, J. S. (1999) · JAMA · doi:10.1001/jama.281.7.613 · Cited by 1,831
A Reengineered Hospital Discharge Program to Decrease Rehospitalization: A Randomized Trial
Jack, B. W., Chetty, V. K., Anthony, D., Greenwald, J. L., Sanchez, G. M., Johnson, A. E., Forsythe, S. R., O'Donnell, J. K., Paasche-Orlow, M. K., Manasseh, C., et al. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-150-3-200902030-00007 · Cited by 1,565
Evaluation of the Quality of Prognosis Studies in Systematic Reviews
Hayden, J. A., Côté, P., & Bombardier, C. (2006) · Annals of Internal Medicine · doi:10.7326/0003-4819-144-6-200603210-00010 · Cited by 1,452
Hernandez, A. F. (2010) · JAMA · doi:10.1001/jama.2010.533 · Cited by 1,032
Users' Guides to the Medical Literature: XXII: How to Use Articles About Clinical Decision Rules
McGinn, T. G., Guyatt, G. H., Wyer, P. C., Naylor, C. D., Stiell, I. G., Richardson, W. S., & for the Evidence-Based Medicine Working Group (2000) · JAMA · doi:10.1001/jama.284.1.79 · Cited by 1,014
Fung, C. H., Lim, Y.-W., Mattke, S., Damberg, C., & Shekelle, P. G. (2008) · Annals of Internal Medicine · doi:10.7326/0003-4819-148-2-200801150-00006 · Cited by 980
van Walraven, C., Dhalla, I. A., Bell, C., Etchells, E., Stiell, I. G., Zarnke, K., Austin, P. C., & Forster, A. J. (2010) · Canadian Medical Association Journal · doi:10.1503/cmaj.091117 · Cited by 960
Risk Adjustment for Measuring Healthcare Outcomes
Iezzoni, L. I. (1994) · Cited by 955
Cited by
PROBAST: A Tool to Assess the Risk of Bias and Applicability of Prediction Model Studies
Wolff, R. F., Moons, K. G. M., Riley, R. D., Whiting, P. F., Westwood, M., Collins, G. S., Reitsma, J. B., Kleijnen, J., Mallett, S., & for the PROBAST Group† (2019) · Annals of Internal Medicine · doi:10.7326/m18-1376 · Cited by 2,984
“Prediction models, both diagnostic and prognostic, are widely used for a variety of medical domains and settings,(14-16) evidenced by the large number of models developed, especially in cancer,(17, 18) neurology,(19, 20) and cardiovascular disease domains.”
BackgroundScalable and accurate deep learning with electronic health records
Rajkomar, A., Oren, E., Chen, K., Dai, A. M., Hajaj, N., Hardt, M., Liu, P. J., Liu, X., Marcus, J., Sun, M., et al. (2018) · npj Digital Medicine · doi:10.1038/s41746-018-0029-1 · Cited by 2,648
“The primary endpoints for those predictions were at discharge, when most readmission prediction scores are computed and when all information necessary to assign billing diagnoses is available [28].”
BackgroundUnderstanding Black-box Predictions via Influence Functions
Koh, P. W., & Liang, P. (2017) · arXiv · doi:10.48550/arxiv.1703.04730 · Cited by 1,514
Neighborhood Socioeconomic Disadvantage and 30-Day Rehospitalization: A Retrospective Cohort Study
Kind, A. J. H., Jencks, S., Brock, J., Yu, M., Bartels, C., Ehlenbach, W., Greenberg, C., & Smith, M. (2014) · Annals of Internal Medicine · doi:10.7326/m13-2946 · Cited by 1,379
Post-Hospital Syndrome — An Acquired, Transient Condition of Generalized Risk
Krumholz, H. M. (2013) · New England Journal of Medicine · doi:10.1056/nejmp1212324 · Cited by 1,218
Enhancing Recovery From Sepsis: A Review
Prescott, H. C., & Angus, D. C. (2018) · JAMA · doi:10.1001/jama.2017.17687 · Cited by 1,059
“However, it is important to recognize and treat mental health impairments because they are associated with a more complicated clinical course.(52,53)”
Hospital Readmissions Reduction Program
McIlvennan, C. K., Eapen, Z. J., & Allen, L. A. (2015) · Circulation · doi:10.1161/circulationaha.114.010270 · Cited by 689
Rehospitalization for Heart Failure: Predict or Prevent?
Desai, A. S., & Stevenson, L. W. (2012) · Circulation · doi:10.1161/circulationaha.112.125435 · Cited by 613
Reducing Hospital Readmission Rates: Current Strategies and Future Directions
Kripalani, S., Theobald, C. N., Anctil, B., & Vasilevskis, E. E. (2014) · Annual Review of Medicine · doi:10.1146/annurev-med-022613-090415 · Cited by 576
Self-citationDonzé, J., Aujesky, D., Williams, D., & Schnipper, J. L. (2013) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2013.3023 · Cited by 553
Calvillo–King, L., Arnold, D., Eubank, K. J., Lo, M., Yunyongying, P., Stieglitz, H., & Halm, E. A. (2013) · Journal of General Internal Medicine · doi:10.1007/s11606-012-2235-x · Cited by 435
Analysis of machine learning techniques for heart failure readmissions
Mortazavi, B. J., Downing, N. S., Bucholz, E. M., Dharmarajan, K., Manhapra, A., Li, S.-X., Negahban, S. N., & Krumholz, H. M. (2016) · Circulation: Cardiovascular Quality and Outcomes · doi:10.1161/circoutcomes.116.003039 · Cited by 401
Preventability and Causes of Readmissions in a National Cohort of General Medicine Patients
Auerbach, A. D., Kripalani, S., Vasilevskis, E. E., Sehgal, N., Lindenauer, P. K., Metlay, J. P., Fletcher, G., Ruhnke, G. W., Flanders, S. A., Kim, C., et al. (2016) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2015.7863 · Cited by 386
Self-citationInsights From Advanced Analytics At The Veterans Health Administration
Fihn, S. D., Francis, J., Clancy, C., Nielson, C., Nelson, K., Rumsfeld, J., Cullen, T., Bates, J., & Graham, G. L. (2014) · Health Affairs · doi:10.1377/hlthaff.2014.0054 · Cited by 367
Frizzell, J. D., Liang, L., Schulte, P. J., Yancy, C. W., Heidenreich, P. A., Hernandez, A. F., Bhatt, D. L., Fonarow, G. C., & Laskey, W. K. (2017) · JAMA Cardiology · doi:10.1001/jamacardio.2016.3956 · Cited by 361
Ouwerkerk, W., Voors, A. A., & Zwinderman, A. H. (2014) · JACC: Heart Failure · doi:10.1016/j.jchf.2014.04.006 · Cited by 328
Wang, L., Porter, B., Maynard, C., Evans, G., Bryson, C., Sun, H., Gupta, I., Lowy, E., McDonell, M., Frisbee, K., et al. (2013) · Medical Care · doi:10.1097/mlr.0b013e31827da95a · Cited by 319
Calibration drift in regression and machine learning models for acute kidney injury
Davis, S. E., Lasko, T. A., Chen, G., Siew, E. D., & Matheny, M. E. (2017) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocx030 · Cited by 312
Zhou, H., Della, P. R., Roberts, P., Goh, L., & Dhaliwal, S. S. (2016) · BMJ Open · doi:10.1136/bmjopen-2016-011060 · Cited by 293
A comparison of models for predicting early hospital readmissions
Futoma, J., Morris, J., & Lucas, J. (2015) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2015.05.016 · Cited by 283
Kangovi, S., Mitra, N., Grande, D., White, M. L., McCollum, S., Sellman, J., Shannon, R. P., & Long, J. A. (2014) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2013.14327 · Cited by 274
Combining structured and unstructured data for predictive models: a deep learning approach
Zhang, D., Yin, C., Zeng, J., Yuan, X., & Zhang, P. (2020) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-020-01297-6 · Cited by 269
Functional Impairment and Hospital Readmission in Medicare Seniors
Greysen, S. R., Stijacic Cenzer, I., Auerbach, A. D., & Covinsky, K. E. (2015) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2014.7756 · Cited by 269
Frailty status at admission to hospital predicts multiple adverse outcomes
Hubbard, R. E., Peel, N. M., Samanta, M., Gray, L. C., Mitnitski, A., & Rockwood, K. (2017) · Age and Ageing · doi:10.1093/ageing/afx081 · Cited by 265
Hospital-Initiated Transitional Care Interventions as a Patient Safety Strategy: A Systematic Review
Rennke, S., Nguyen, O. K., Shoeb, M. H., Magan, Y., Wachter, R. M., & Ranji, S. R. (2013) · Annals of Internal Medicine · doi:10.7326/0003-4819-158-5-201303051-00011 · Cited by 263
The Prevention of Hospital Readmissions in Heart Failure
Ziaeian, B., & Fonarow, G. C. (2016) · Progress in Cardiovascular Diseases · doi:10.1016/j.pcad.2015.09.004 · Cited by 260
Patient Characteristics and Differences in Hospital Readmission Rates
Barnett, M. L., Hsu, J., & McWilliams, J. M. (2015) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2015.4660 · Cited by 259
Voors, A. A., Ouwerkerk, W., Zannad, F., van Veldhuisen, D. J., Samani, N. J., Ponikowski, P., Ng, L. L., Metra, M., ter Maaten, J. M., Lang, C. C., et al. (2017) · European Journal of Heart Failure · doi:10.1002/ejhf.785 · Cited by 256
Transitional Care Interventions Prevent Hospital Readmissions For Adults With Chronic Illnesses
Verhaegh, K. J., MacNeil-Vroomen, J. L., Eslami, S., Geerlings, S. E., de Rooij, S. E., & Buurman, B. M. (2014) · Health Affairs · doi:10.1377/hlthaff.2014.0160 · Cited by 255
Association of impaired functional status at hospital discharge and subsequent rehospitalization
Hoyer, E. H., Needham, D. M., Atanelov, L., Knox, B., Friedman, M., & Brotman, D. J. (2014) · Journal of Hospital Medicine · doi:10.1002/jhm.2152 · Cited by 184
Hospital Readmission and Social Risk Factors Identified from Physician Notes
Navathe, A. S., Zhong, F., Lei, V. J., Chang, F. Y., Sordo, M., Topaz, M., Navathe, S. B., Rocha, R. A., & Zhou, L. (2018) · Health Services Research · doi:10.1111/1475-6773.12670 · Cited by 161
Best Practices for Reducing Unplanned Acute Care for Patients With Cancer
Handley, N. R., Schuchter, L. M., & Bekelman, J. E. (2018) · Journal of Oncology Practice · doi:10.1200/jop.17.00081 · Cited by 137
Bayati, M., Braverman, M., Gillam, M., Mack, K. M., Ruiz, G., Smith, M. S., & Horvitz, E. (2014) · PLoS ONE · doi:10.1371/journal.pone.0109264 · Cited by 122
Walsh, C. G., Chaudhry, B., Dua, P., Goodman, K. W., Kaplan, B., Kavuluru, R., Solomonides, A., & Subbian, V. (2020) · JAMIA Open · doi:10.1093/jamiaopen/ooz054 · Cited by 118
Chen, J. H., Alagappan, M., Goldstein, M. K., Asch, S. M., & Altman, R. B. (2017) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2017.03.006 · Cited by 101
Surgeon perception of risk and benefit in the decision to operate.
Sacks, G. D., Dawes, A. J., Ettner, S. L., Brook, R. H., Fox, C. R., Maggard-Gibbons, M., Ko, C. Y., & Russell, M. M. (2016) · Annals of Surgery · doi:10.1097/sla.0000000000001784 · Cited by 100
Functional Status Impairment Is Associated With Unplanned Readmissions
Hoyer, E. H., Needham, D. M., Miller, J., Deutschendorf, A., Friedman, M., & Brotman, D. J. (2013) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2013.05.028 · Cited by 98
O’Caoimh, R., Cornally, N., Weathers, E., O'Sullivan, R., Fitzgerald, C., Orfila, F., Clarnette, R., Paúl, C., & Molloy, D. W. (2015) · Maturitas · doi:10.1016/j.maturitas.2015.03.009 · Cited by 89
“Hospitalisation was defined as an unplanned admission to an acute (secondary or tertiary referral) hospital, not including elective admissions or planned rehabilitation or readmission within 30 days of discharge, the most common timeline for measuring re-hospitalisation [17].”
BackgroundResultNguyen, O. K., Makam, A. N., Clark, C., Zhang, S., Xie, B., Velasco, F., Amarasingham, R., & Halm, E. A. (2016) · Journal of Hospital Medicine · doi:10.1002/jhm.2568 · Cited by 76
Walsh, C., & Hripcsak, G. (2014) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2014.08.006 · Cited by 75
“A simple OVID Medline search for ‘‘Patient readmission’’ in 2011 produced 5476 hits [4], while it yields 7576 results at the start of 2014.”
BackgroundKasthurirathne, S. N., Vest, J. R., Menachemi, N., Halverson, P. K., & Grannis, S. J. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocx130 · Cited by 71
Wang, H. E., Landers, M., Adams, R., Subbaswamy, A., Kharrazi, H., Gaskin, D. J., & Saria, S. (2022) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocac065 · Cited by 63
A systematic approach to chronic heart failure care: a consensus statement
Page, K., Marwick, T. H., Lee, R., Grenfell, R., Abhayaratna, W. P., Aggarwal, A., Briffa, T. G., Cameron, J., Davidson, P. M., Driscoll, A., et al. (2014) · Medical Journal of Australia · doi:10.5694/mja14.00032 · Cited by 59
Dementia and Risk of 30‐Day Readmission in Older Adults After Discharge from Acute Care Hospitals
Sakata, N., Okumura, Y., Fushimi, K., Nakanishi, M., & Ogawa, A. (2018) · Journal of the American Geriatrics Society · doi:10.1111/jgs.15282 · Cited by 56
Greenwald, J. L., Cronin, P. R., Carballo, V., Danaei, G., & Choy, G. (2017) · Medical Care · doi:10.1097/mlr.0000000000000651 · Cited by 47
Participatory design of probability-based decision support tools for in-hospital nurses
Jeffery, A. D., Novak, L. L., Kennedy, B., Dietrich, M. S., & Mion, L. C. (2017) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocx060 · Cited by 46
Prediction Accuracy With Electronic Medical Records Versus Administrative Claims
Zeltzer, D., Balicer, R. D., Shir, T., Flaks-Manov, N., Einav, L., & Shadmi, E. (2019) · Medical Care · doi:10.1097/mlr.0000000000001135 · Cited by 34
Walsh, C. G., McKillop, M. M., Lee, P., Harris, J. W., Simpson, C., & Novak, L. L. (2021) · JAMIA Open · doi:10.1093/jamiaopen/ooab092 · Cited by 26
Hwang, A. B., Schuepfer, G., Pietrini, M., & Boes, S. (2021) · PLOS ONE · doi:10.1371/journal.pone.0258338 · Cited by 19
Improving hospital readmission prediction using individualized utility analysis
Ko, M., Chen, E., Agrawal, A., Rajpurkar, P., Avati, A., Ng, A., Basu, S., & Shah, N. H. (2021) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2021.103826 · Cited by 15
A review of literature on risk prediction tools for hospital readmissions in older adults
Gatt, M. L., Cassar, M., & Buttigieg, S. C. (2022) · Journal of Health Organization and Management · doi:10.1108/jhom-11-2020-0450 · Cited by 13
Metadata
- Authors
- Kansagara, D., Englander, H., Salanitro, A., Kagen, D., Theobald, C., Freeman, M., & Kripalani, S.
- Venue
- JAMA
- Publisher
- American Medical Association (AMA)
- Published
- 2011-10-19
- Volume
- 306
- Issue
- 15
- Pages
- 1688
- ISSN
- 0002-9955 (ISSN-L)
- 0098-7484
- OpenAlex
- W2086923543
- Cited by
- 1,707
- References
- 50
- FWCI
- 96.76
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.