Prediction Models for Prolonged Intensive Care Unit Stay After Cardiac Surgery: Systematic Review and Validation Study
Open accessAbstract
Background— Several models have been developed to predict prolonged stay in the intensive care unit (ICU) after cardiac surgery. However, no extensive quantitative validation of these models has yet been conducted. This study sought to identify and validate existing prediction models for prolonged ICU length of stay after cardiac surgery. Methods and Results— After a systematic review of the literature, the identified models were applied on a large registry database comprising 11 395 cardiac surgical interventions. The probabilities of prolonged ICU length of stay based on the models were compared with the actual outcome to assess the discrimination and calibration performance of the models. Literature review identified 20 models, of which 14 could be included. Of the 6 models for the general cardiac surgery population, the Parsonnet model showed the best discrimination (area under the receiver operating characteristic curve=0.75 [95% confidence interval, 0.73 to 0.76]), followed by the European system for cardiac operative risk evaluation (EuroSCORE) (0.71 [0.70 to 0.72]) and a model by Huijskes and colleagues (0.71 [0.70 to 0.73]). Most of the models showed good calibration. Conclusions— In this validation of prediction models for prolonged ICU length of stay, 2 widely implemented models (Parsonnet, EuroSCORE), although originally designed for prediction of mortality, were superior in identifying patients with prolonged ICU length of stay.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The quality of reporting in published articles describing the development or validation of multivariable prediction models in medicine is poor.
“Many reviews have showed that the quality of reporting in published articles describing the development or validation of multivariable prediction models in medicine is poor [23–27,29].”
From Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD Statement (2015) · cites this paper as [29]
The quality of reporting of prediction model studies is generally poor.
“However, the overwhelming evidence shows that the quality of reporting of prediction model studies is poor.”
From Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis (TRIPOD): The TRIPOD Statement (2015) · cites this paper as [29]
The quality of reporting in published articles describing the development or validation of multivariable prediction models in medicine is poor.
“Many reviews have showed that the quality of reporting in published articles describing the development or validation of multivariable prediction models in medicine is poor.23–27,29”
From Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis (TRIPOD): The TRIPOD Statement (2015) · cites this paper as [29]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
The meaning and use of the area under a receiver operating characteristic (ROC) curve.
Hanley, J. A., & McNeil, B. J. (1982) · Radiology · doi:10.1148/radiology.143.1.7063747 · Cited by 21,856 · see citing works
Regression Modeling Strategies
Harrell, F. E. (2001) · Springer series in statistics · doi:10.1007/978-1-4757-3462-1 · Cited by 9,270 · see citing works
Assessing the Performance of Prediction Models: A Framework for Traditional and Novel Measures
Steyerberg, E. W., Vickers, A. J., Cook, N. R., Gerds, T., Gonen, M., Obuchowski, N., Pencina, M. J., & Kattan, M. W. (2010) · Epidemiology · doi:10.1097/ede.0b013e3181c30fb2 · Cited by 5,170 · see citing works
European system for cardiac operative risk evaluation (EuroSCORE)
Nashef, S. A. M., Roques, F., Michel, P., Gauducheau, E., Lemeshow, S., & Salamon, R. (1999) · European Journal of Cardio-Thoracic Surgery · doi:10.1016/s1010-7940(99)00134-7 · Cited by 3,362 · see citing works
Clinical Prediction Models: A Practical Approach to Development, Validation, and Updating
Steyerberg, E. W. (2019) · Statistics for Biology and Health · doi:10.1007/978-3-030-16399-0 · Cited by 3,281 · see citing works
Review: a gentle introduction to imputation of missing values.
Donders, A. R. T., van der Heijden, G. J. M. G., Stijnen, T., & Moons, K. G. M. (2006) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.01.014 · Cited by 2,582 · see citing works
Self-citationUse and Misuse of the Receiver Operating Characteristic Curve in Risk Prediction
Cook, N. R. (2007) · Circulation · doi:10.1161/circulationaha.106.672402 · Cited by 2,123 · see citing works
Roques, F. (1999) · European Journal of Cardio-Thoracic Surgery · doi:10.1016/s1010-7940(99)00106-2 · Cited by 1,767 · see citing works
Prognosis and prognostic research: what, why, and how?
Moons, K. G. M., Royston, P., Vergouwe, Y., Grobbee, D. E., & Altman, D. G. (2009) · BMJ · doi:10.1136/bmj.b375 · Cited by 1,337 · see citing works
Self-citationAssessing the Generalizability of Prognostic Information
Justice, A. C., Covinsky, K. E., & Berlin, J. A. (1999) · Annals of Internal Medicine · doi:10.7326/0003-4819-130-6-199903160-00016 · Cited by 1,160 · see citing works
Parsonnet, V., DEAN, D. L., & Bernstein, A. D. (1989) · PubMed · Cited by 1,112 · see citing works
Reilly, B. M., & Evans, A. T. (2006) · Annals of Internal Medicine · doi:10.7326/0003-4819-144-3-200602070-00009 · Cited by 794 · see citing works
Laupacis, A. (1997) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1997.03540300056034 · Cited by 793 · see citing works
Missing covariate data in medical research: To impute is better than to ignore
Janssen, K. J. M., Donders, A. R. T., Harrell, F. E., Vergouwe, Y., Chen, Q., Grobbee, D. E., & Moons, K. G. M. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.12.008 · Cited by 593 · see citing works
Self-citationUpdating methods improved the performance of a clinical prediction model in new patients
Janssen, K. J. M., Moons, K. G. M., Kalkman, C. J., Grobbee, D. E., & Vergouwe, Y. (2007) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.04.018 · Cited by 381 · see citing works
Self-citationProbabilistic prediction in patient management and clinical trials
Spiegelhalter, D. J. (1986) · Statistics in Medicine · doi:10.1002/sim.4780050506 · Cited by 362 · see citing works
Risk stratification in heart surgery: comparison of six score systems
Geissler, H. J. (2000) · European Journal of Cardio-Thoracic Surgery · doi:10.1016/s1010-7940(00)00385-7 · Cited by 334 · see citing works
Morbidity and Duration of ICU Stay after Cardiac Surgery
Turnan, K. J., McCarthy, R. J., MARCH, R. J., Najafi, H., & Ivankovich, A. D. (1992) · CHEST Journal · doi:10.1378/chest.102.1.36 · Cited by 234 · see citing works
Wong, D. T., Cheng, D., Kustra, R., Tibshirani, R. J., Karski, J. M., Carroll-Munro, J., & Sandler, A. N. (1999) · Anesthesiology · doi:10.1097/00000542-199910000-00012 · Cited by 195 · see citing works
Prolonged Intensive Care Unit Stay in Cardiac Surgery: Risk Factors and Long-Term-Survival
Hein, O. V., Birnbaum, J., Wernecke, K. D., England, M. R., Konertz, W. F., & Spies, C. (2006) · The Annals of Thoracic Surgery · doi:10.1016/j.athoracsur.2005.09.077 · Cited by 182 · see citing works
Family History of Premature Coronary Heart Disease and Coronary Artery Calcification
Nasir, K., Budoff, M. J., Wong, N. D., Scheuner, M. T., Herrington, D. M., Arnett, D. K., Szklo, M., Greenland, P., & Blumenthal, R. S. (2007) · Circulation · doi:10.1161/circulationaha.107.688739 · Cited by 175 · see citing works
Ready-Made, Recalibrated, or Remodeled?
Ivanov, J., Tu, J. V., & Naylor, C. D. (1999) · Circulation · doi:10.1161/01.cir.99.16.2098 · Cited by 158 · see citing works
Scott, B. H., Seifert, F. C., GRIMSON, R. C., & Glass, P. S. A. (2005) · Journal of Cardiothoracic and Vascular Anesthesia · doi:10.1053/j.jvca.2005.03.030 · Cited by 128 · see citing works
EuroSCORE Predicts Intensive Care Unit Stay and Costs of Open Heart Surgery
Nilsson, J., Algotsson, L., Höglund, P., Lührs, C., & Brandt, J. (2004) · The Annals of Thoracic Surgery · doi:10.1016/j.athoracsur.2004.04.060 · Cited by 119 · see citing works
Fast-Track Anesthesia and Cardiac Surgery: A Retrospective Cohort Study of 7989 Patients
Svircevic, V., Nierich, A. P., Moons, K. G. M., Bruinsma, G. J. B. B., Kalkman, C. J., & van Dijk, D. (2009) · Anesthesia & Analgesia · doi:10.1213/ane.0b013e318193c423 · Cited by 106 · see citing works
Self-citationGhotkar, S. V., Grayson, A. D., Fabri, B. M., Dihmis, W. C., & Pullan, D. M. (2006) · Journal of Cardiothoracic Surgery · doi:10.1186/1749-8090-1-14 · Cited by 100 · see citing works
Prognostic models based on literature and individual patient data in logistic regression analysis
Steyerberg, E. W., Eijkemans, M. J. C., van Houwelingen, H. C., Lee, K. L., & Habbema, J. D. F. (2000) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(20000130)19:2 · Cited by 90 · see citing works
Long-Term Survival of the Very Elderly Undergoing Coronary Artery Bypass Grafting
Likosky, D. S., Dacey, L. J., Baribeau, Y. R., Leavitt, B. J., Clough, R. A., Cochran, R. P., Quinn, R. D., Sisto, D., Charlesworth, D. C., Malenka, D. J., et al. (2008) · The Annals of Thoracic Surgery · doi:10.1016/j.athoracsur.2007.12.066 · Cited by 88 · see citing works
Pätilä, T., Kukkonen, S., Vento, A. E., Pettilä, V., & Suojaranta-Ylinen, R. T. (2006) · The Annals of Thoracic Surgery · doi:10.1016/j.athoracsur.2006.06.025 · Cited by 79 · see citing works
A Predictive Index for Length of Stay in the Intensive Care Unit Following Cardiac Surgery
Tu, J. V., Mazer, C. D., Levinton, C. M., Armstrong, P. W., & Naylor, C. D. (1995) · Survey of Anesthesiology · doi:10.1097/00132586-199504000-00013 · Cited by 76 · see citing works
Lawrence, D., Valencia, O., Smith, E. E. J., Murday, A., & Treasure, T. (2000) · Heart · doi:10.1136/heart.83.4.429 · Cited by 76 · see citing works
Predictors of prolonged ICU stay after on-pump versus off-pump coronary artery bypass grafting
Bucerius, J. A., Gummert, J. F., Walther, T., Doll, N., Falk, V., Schmitt, D. V., & Mohr, F. W. (2004) · Intensive Care Medicine · doi:10.1007/s00134-003-1950-5 · Cited by 76 · see citing works
Pitkänen, O., Niskanen, M. M., Rehnberg, S., Hippeläinen, M., & Hynynen, M. J. (2000) · European Journal of Cardio-Thoracic Surgery · doi:10.1016/s1010-7940(00)00579-0 · Cited by 73 · see citing works
Parolari, A., Pesce, L. L., Trezzi, M., Loardi, C. M., Kassem, S., Brambillasca, C., Miguel, B., Tremoli, E., Biglioli, P., & Alamanni, F. (2008) · European Heart Journal · doi:10.1093/eurheartj/ehn581 · Cited by 72 · see citing works
Risk Factors for Prolonged Stay in the Intensive Care Unit and on the Ward After Cardiac Surgery
Atoui, R., Ma, F., Langlois, Y., & Morin, J. (2008) · Journal of Cardiac Surgery · doi:10.1111/j.1540-8191.2007.00564.x · Cited by 72 · see citing works
Preoperative prediction of prolonged stay in the intensive care unit for coronary bypass surgery
Janssen, D. P. B. (2003) · European Journal of Cardio-Thoracic Surgery · doi:10.1016/j.ejcts.2003.11.005 · Cited by 70 · see citing works
Christakis, G. T. (1996) · Cardiovascular Surgery · doi:10.1016/0967-2109(96)83780-x · Cited by 56 · see citing works
Determinants of duration of ICU stay after coronary artery bypass graft surgery
Michalopoulos, A., Tzelepis, G., Pavlides, G., Kriaras, J., Dafni, U., & Geroulanos, S. (1996) · British Journal of Anaesthesia · doi:10.1093/bja/77.2.208 · Cited by 55 · see citing works
Can EuroSCORE predict direct costs of cardiac surgery?
Pintor, P. P., Bobbio, M., Colangelo, S., Veglia, F., Marras, R., & Diena, M. (2003) · European Journal of Cardio-Thoracic Surgery · doi:10.1016/s1010-7940(02)00868-0 · Cited by 54 · see citing works
Rosenfeld, R., Smith, J. M., Woods, S. E., & Engel, A. M. (2006) · Journal of Cardiac Surgery · doi:10.1111/j.1540-8191.2006.00196.x · Cited by 49 · see citing works
Messaoudi, N., Cocker, J. D., Stockman, B. A., Bossaert, L. L., & Rodrigus, I. E. R. (2008) · Journal of Cardiac Surgery · doi:10.1111/j.1540-8191.2008.00716.x · Cited by 47 · see citing works
Opposite trends in coronary artery and valve surgery in a large multisurgeon practice, 1979–1999
Northrup, W. F., Emery, R. W., Nicoloff, D. M., Lillehei, T. J., Holter, A. R., & Blake, D. P. (2004) · The Annals of Thoracic Surgery · doi:10.1016/s0003-4975(03)01359-6 · Cited by 44 · see citing works
Preoperative risk prediction and intraoperative events in cardiac surgery
Stoica, S. C. (2002) · European Journal of Cardio-Thoracic Surgery · doi:10.1016/s1010-7940(01)01077-6 · Cited by 43 · see citing works
Huijskes, R. V. H. P., Rosseel, P. M. J., & Tijssen, J. G. P. (2003) · European Journal of Cardio-Thoracic Surgery · doi:10.1016/s1010-7940(03)00471-8 · Cited by 38 · see citing works
Ivanov, J., Borger, M. A., David, T. E., Cohen, G. N., Walton, N. A., & Naylor, C. D. (2000) · The Annals of Thoracic Surgery · doi:10.1016/s0003-4975(00)01387-4 · Cited by 31 · see citing works
Determinants of Morbidity and Intensive Care Unit Stay after Coronary Surgery
Abrahamyan, L., Demirchyan, A., Thompson, M. E., & Hovaguimian, H. (2006) · Asian Cardiovascular and Thoracic Annals · doi:10.1177/021849230601400207 · Cited by 27 · see citing works
Off-pump aortic valve replacement with catheter-mounted valved stents. Is the future already here?
Antunes, M. J. (2006) · European Journal of Cardio-Thoracic Surgery · doi:10.1016/j.ejcts.2006.10.001 · Cited by 16 · see citing works
Ouattara, A., Niculescu, M., Boccara, G., Landi, M., Vaissier, E., Léger, P., Riou, B., Gandjbackch, I., & Coriat, P. (2003) · Annales Françaises d Anesthésie et de Réanimation · doi:10.1016/s0750-7658(03)00058-3 · Cited by 14 · see citing works
Prediction for Major Adverse Outcomes in Cardiac Surgery: Comparison of Three Prediction Models
Hsieh, C.-H., Peng, S.-K., Tsai, T.-C., Shih, Y.-R., & Peng, S.-Y. (2007) · Journal of the Formosan Medical Association · doi:10.1016/s0929-6646(08)60037-6 · Cited by 12 · see citing works
Can ICU stay be predicted accurately enough for fasttracking cardiac surgical patients?
Salamonsen, M., Bailey, M., & Salamonsen, R. F. (2008) · Critical Care and Resuscitation · doi:10.1016/s1441-2772(23)01019-0 · Cited by 6 · see citing works
Harrell, F., Jr. (1996) · doi:10.1002/(sici)1097-0258(19960229)15:4
Flagged first, then by citations
1 of the 52 references couldn’t be matched to a known paper.
Research works printed but not linked: 3
- Ouattara A, Niculescu M, Boccara G, Landi M, Vaissier E, Le ´ger P, Riou B, Gandjbakch I, Coriat P. Identification of risk factors for allogenic transfusion in cardiac surgery from an observational study. Ann Fr Anesth Reanim. 2003;22:278 -283.
- Laupacis A, Sekar N, Stiell IG. Clinical prediction rules: a review and suggested modifications of methodological standards. JAMA. 1997;277:488-494.
- Harrell FE Jr. Regression Modelling Strategies. New York, NY: Springer; 2001.
Cited by
Sorted by citations
Moons, K. G. M., Altman, D. G., Reitsma, J. B., Ioannidis, J. P. A., Macaskill, P., Steyerberg, E. W., Vickers, A. J., Ransohoff, D. F., & Collins, G. S. (2015) · Annals of Internal Medicine · doi:10.7326/m14-0698 · Cited by 5,147 · see citing works
Self-citationCollins, P. G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · British Journal of Cancer · doi:10.1038/bjc.2014.639 · Cited by 3,312 · see citing works
Self-citationCollins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · Annals of Internal Medicine · doi:10.7326/m14-0697 · Cited by 3,267 · see citing works
Self-citationMoons, K. G. M., de Groot, J. A. H., Bouwmeester, W., Vergouwe, Y., Mallett, S., Altman, D. G., Reitsma, J. B., & Collins, G. S. (2014) · PLoS Medicine · doi:10.1371/journal.pmed.1001744 · Cited by 2,018 · see citing works
Self-citationCollins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. (2015) · BMC Medicine · doi:10.1186/s12916-014-0241-z · Cited by 1,927 · see citing works
Self-citationRisk prediction models: II. External validation, model updating, and impact assessment
Moons, K. G. M., Kengne, A. P., Grobbee, D. E., Royston, P., Vergouwe, Y., Altman, D. G., & Woodward, M. (2012) · Heart · doi:10.1136/heartjnl-2011-301247 · Cited by 1,195 · see citing works
Self-citationPrediction models for cardiovascular disease risk in the general population: systematic review
Damen, J. A. A. G., Hooft, L., Schuit, E., Debray, T. P. A., Collins, G. S., Tzoulaki, I., Lassale, C. M., Siontis, G. C. M., Chiocchia, V., Roberts, C., et al. (2016) · BMJ · doi:10.1136/bmj.i2416 · Cited by 935 · see citing works
Self-citationCollins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · British Journal of Surgery · doi:10.1002/bjs.9736 · Cited by 889 · see citing works
Self-citationCollins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · Circulation · doi:10.1161/circulationaha.114.014508 · Cited by 793 · see citing works
Self-citationCollins, G. S., de Groot, J. A., Dutton, S., Omar, O., Shanyinde, M., Tajar, A., Voysey, M., Wharton, R., Yu, L.-M., Moons, K. G., et al. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-40 · Cited by 729 · see citing works
Self-citationCollins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · European Urology · doi:10.1016/j.eururo.2014.11.025 · Cited by 439 · see citing works
Self-citationCollins, P. G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.11.010 · Cited by 333 · see citing works
Self-citationCowley, L., Farewell, D. M., Maguire, S., & Kemp, A. (2019) · Diagnostic and Prognostic Research · doi:10.1186/s41512-019-0060-y · Cited by 265 · see citing works
Whitlock, E. L., Torres, B. A., Lin, N., Helsten, D. L., Nadelson, M. R., Mashour, G. A., & Avidan, M. S. (2014) · Anesthesia & Analgesia · doi:10.1213/ane.0000000000000028 · Cited by 193 · see citing works
Does EuroSCORE II perform better than its original versions? A multicentre validation study
Barili, F., Pacini, D., Capo, A., Rasovic, O., Grossi, C., Alamanni, F., Bartolomeo, R. D., & Parolari, A. (2012) · European Heart Journal · doi:10.1093/eurheartj/ehs342 · Cited by 185 · see citing works
Surveillance for ocular hypertension: an evidence synthesis and economic evaluation.
Burr, J., Botello-Pinzon, P., Takwoingi, Y., Hernández, R., Vazquez-Montes, M., Elders, A., Asaoka, R., Banister, K., van der Schoot, J., Fraser, C., et al. (2012) · Health Technology Assessment · doi:10.3310/hta16290 · Cited by 180 · see citing works
Yamazaki, Y., Oba, K., Matsui, Y., & Morimoto, Y. (2018) · Journal of Anesthesia · doi:10.1007/s00540-018-2447-2 · Cited by 137 · see citing works
Collins, P. G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · BJOG An International Journal of Obstetrics & Gynaecology · doi:10.1111/1471-0528.13244 · Cited by 141 · see citing works
Self-citationDeep Learning for Improved Risk Prediction in Surgical Outcomes
Jalali, A., Lonsdale, H., Do, N., Peck, J., Gupta‐Malhotra, M., Kutty, S., Ghazarian, S. R., Jacobs, J. P., Rehman, M., & Ahumada, L. M. (2020) · Scientific Reports · doi:10.1038/s41598-020-62971-3 · Cited by 76 · see citing works
Meta‐analysis and aggregation of multiple published prediction models
Debray, T. P. A., Koffijberg, H., Nieboer, D., Vergouwe, Y., Steyerberg, E. W., & Moons, K. G. M. (2014) · Statistics in Medicine · doi:10.1002/sim.6080 · Cited by 73 · see citing works
Self-citationMeadows, K., Gibbens, R., Gerrard, C., & Vuylsteke, A. (2018) · Journal of Cardiothoracic and Vascular Anesthesia · doi:10.1053/j.jvca.2018.03.007 · Cited by 68 · see citing works
Collins, P. G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · European Journal of Clinical Investigation · doi:10.1111/eci.12376 · Cited by 60 · see citing works
Self-citationDelgado, J. C. L., Esteve, F., Javierre, C. F., Torrado, H., Rodríguez-Castro, D., Carrió, M. L., Farrero, E., Skaltsa, K., Máñez, R., & Ventura, J. L. (2015) · Journal of Cardiothoracic and Vascular Anesthesia · doi:10.1053/j.jvca.2015.04.024 · Cited by 59 · see citing works
Szelkowski, L. A., Puri, N. K., Singh, R., & Massimiano, P. S. (2014) · Current Problems in Surgery · doi:10.1067/j.cpsurg.2014.10.001 · Cited by 57 · see citing works
Fracture Risk Assessment: State of the Art, Methodologically Unsound, or Poorly Reported?
Collins, G. S., & Michaëlsson, K. (2012) · Current Osteoporosis Reports · doi:10.1007/s11914-012-0108-1 · Cited by 51 · see citing works
Fast-track practice in cardiac surgery: results and predictors of outcome
Haanschoten, M. C., van Straten, A. H. M., Woorst, J. T., Stepaniak, P. S., van der Meer, A. D., van Zundert, A. A. J., & Hamad, M. A. S. (2012) · Interactive Cardiovascular and Thoracic Surgery · doi:10.1093/icvts/ivs393 · Cited by 51 · see citing works
Preoperative Endogenous Ouabain Predicts Acute Kidney Injury in Cardiac Surgery Patients*
Bignami, E. G., Casamassima, N., Frati, E., Lanzani, C. L., Corno, L., Alfieri, O., Gottlieb, S. S., Simonini, M., Shah, K. B., Mizzi, A., et al. (2013) · Critical Care Medicine · doi:10.1097/ccm.0b013e3182741599 · Cited by 50 · see citing works
Wang, T. K. M., Oh, T., Voss, J., Gamble, G. D., Kang, N., & Pemberton, J. (2014) · Heart and Vessels · doi:10.1007/s00380-014-0472-0 · Cited by 49 · see citing works
Predicting length of stay in hospitals intensive care unit using general admission features
Abd-Elrazek, M. A., Eltahawi, A. A., Elaziz, M., & Abd-Elwhab, M. N. (2021) · Ain Shams Engineering Journal · doi:10.1016/j.asej.2021.02.018 · Cited by 48 · see citing works
Participatory design of probability-based decision support tools for in-hospital nurses
Jeffery, A. D., Novak, L. L., Kennedy, B., Dietrich, M. S., & Mion, L. C. (2017) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocx060 · Cited by 46 · see citing works
Predicting Prolonged Length of ICU Stay through Machine Learning
Wu, J., Lin, Y., Li, P., Hu, Y., Zhang, L., & Kong, G. (2021) · Diagnostics · doi:10.3390/diagnostics11122242 · Cited by 47 · see citing works
Hassan, A., Anderson, C. A., Kypson, A. P., Kindell, L. C., Ferguson, T. B., Chitwood, W. R., & Rodríguez, E. (2011) · The Annals of Thoracic Surgery · doi:10.1016/j.athoracsur.2011.10.024 · Cited by 42 · see citing works
Prediction of Prolonged Intensive Care Unit Length of Stay Following Cardiac Surgery
Rotar, E. P., Beller, J. P., Smolkin, M. E., Chancellor, W. Z., Ailawadi, G., Yarboro, L. T., Hulse, M., Ratcliffe, S. J., & Teman, N. R. (2021) · Seminars in Thoracic and Cardiovascular Surgery · doi:10.1053/j.semtcvs.2021.02.021 · Cited by 41 · see citing works
Widyastuti, Y., Stenseth, R., Wahba, A., Pleym, H., & Videm, V. (2012) · Interactive Cardiovascular and Thoracic Surgery · doi:10.1093/icvts/ivs302 · Cited by 41 · see citing works
Ohnuma, T., & Uchino, S. (2017) · PLoS ONE · doi:10.1371/journal.pone.0169341 · Cited by 38 · see citing works
Meyfroidt, G., Güiza, F., Cottem, D., Becker, W. D., Loon, K. V., Aerts, J., Berckmans, D., Ramon, J., Bruynooghe, M., & den Berghe, G. V. (2011) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-11-64 · Cited by 38 · see citing works
Composite Outcomes in Clinical Prediction Modeling: Are We Trying to Predict Apples and Oranges?
Dash, K., Goodacre, S. W., & Sutton, L. (2022) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2022.01.046 · Cited by 36 · see citing works
Koster, A., Zittermann, A., Börgermann, J., Knabbe, C., Diekmann, J., Schirmer, U. B., & Gummert, J. F. (2015) · European Journal of Cardio-Thoracic Surgery · doi:10.1093/ejcts/ezv252 · Cited by 34 · see citing works
Wang, Z., Ma, S., Wang, C., Zappitelli, M., Devarajan, P., & Parikh, C. R. (2014) · Statistics in Medicine · doi:10.1002/sim.6314 · Cited by 34 · see citing works
Silberman, S., Bitran, D., Fink, D. L., Tauber, R., & Merin, O. (2013) · The Annals of Thoracic Surgery · doi:10.1016/j.athoracsur.2013.01.103 · Cited by 32 · see citing works
Determinants of prolonged intensive care unit stay after cardiac surgery in the elderly
Cacciatore, F., Anello, C. B., Ferrara, N., Mazzella, F., Manzi, M., Angelis, U. D., & Abete, P. (2012) · Aging Clinical and Experimental Research · doi:10.1007/bf03654834 · Cited by 30 · see citing works
A score to estimate 30-day mortality after intensive care admission after cardiac surgery
Lamarche, Y., Elmi-Sarabi, M., Ding, L., Abel, J. G., Sirounis, D., & Denault, A. Y. (2016) · Journal of Thoracic and Cardiovascular Surgery · doi:10.1016/j.jtcvs.2016.11.039 · Cited by 29 · see citing works
Chen, Q., Zhang, B., Yang, J., Mo, X., Zhang, L., Li, M., Chen, Z., Jin, F., Wang, F., Huang, W., et al. (2021) · Frontiers in Cardiovascular Medicine · doi:10.3389/fcvm.2021.675431 · Cited by 29 · see citing works
Fast-Track Failure After Cardiac Surgery
Lee, A. S. Y., Zhu, F., Underwood, M. J., & Gomersall, C. D. (2013) · Critical Care Medicine · doi:10.1097/ccm.0b013e31827711ad · Cited by 29 · see citing works
Predictors of Prolonged Stay in the Intensive Care Unit following Cardiac Surgery
Eltheni, R., Giakoumidakis, K., Brokalaki, H., Galanis, P., Nenekidis, I., & Fildissis, G. (2012) · ISRN Nursing · doi:10.5402/2012/691561 · Cited by 28 · see citing works
Prolonged ventilation post cardiac surgery - tips and pitfalls of the prediction game
Knapik, P., Cieśla, D., Borowik, D., Czempik, P. F., & Knapik, T. (2011) · Journal of Cardiothoracic Surgery · doi:10.1186/1749-8090-6-158 · Cited by 28 · see citing works
Barili, F., Barzaghi, N., Cheema, F. H., Capo, A., Jiang, J., Ardemagni, E., Argenziano, M., & Grossi, C. (2012) · International Journal of Cardiology · doi:10.1016/j.ijcard.2012.09.091 · Cited by 27 · see citing works
Mori, M., McCracken, C., Maher, K. O., Kogon, B. E., Mahle, W. T., Kanter, K. R., & Alsoufi, B. (2016) · Journal of Thoracic and Cardiovascular Surgery · doi:10.1016/j.jtcvs.2016.04.040 · Cited by 26 · see citing works
Critical care after lung resection: CALoR 1, a single‐centre pilot study
McCall, P. J., Macfie, A., Kinsella, J., & Shelley, B. (2015) · Anaesthesia · doi:10.1111/anae.13267 · Cited by 25 · see citing works
Bootsma, I. T., Scheeren, T., de Lange, F., Haenen, J., Boonstra, P. W., & Boerma, E. C. (2018) · Journal of Intensive Care · doi:10.1186/s40560-018-0351-3 · Cited by 25 · see citing works
Zayat, R., Menon, A. K., Goetzenich, A., Schaelte, G., Autschbach, R., Stoppe, C., Simon, T.-P., Tewarie, L., & Moza, A. K. (2017) · Journal of Cardiothoracic Surgery · doi:10.1186/s13019-017-0573-9 · Cited by 24 · see citing works
Otokiti, A. U., Ozoude, M. M., Williams, K. S., Sadiq-Onilenla, R. A., Ojo, S. A., Warsame, L., Walsh, S., & Edomwande, M. (2022) · JMIR Research Protocols · doi:10.2196/37685 · Cited by 24 · see citing works
Zarrizi, M., Paryad, E., Khanghah, A. G., Leili, E. K., & Faghani, H. (2020) · Brazilian Journal of Cardiovascular Surgery · doi:10.21470/1678-9741-2019-0405 · Cited by 22 · see citing works
Risk factors associated with longer stays in cardiovascular surgical intensive care unit after CABG
Kao, K.-D., Lee, S. K. C., Liu, C., & Chou, N. (2021) · Journal of the Formosan Medical Association · doi:10.1016/j.jfma.2021.04.020 · Cited by 22 · see citing works
Ettema, R. G., Hoogendoorn, M. E., Kalkman, C. J., & Schuurmans, M. J. (2014) · European Journal of Cardiovascular Nursing · doi:10.1177/1474515113511715 · Cited by 21 · see citing works
Self-citationCollins, P. G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · Diabetic Medicine · doi:10.1111/dme.12654 · Cited by 20 · see citing works
Self-citationMcIsaac, D. I., McDonald, B. J., Wong, C. A., & van Walraven, C. (2018) · Canadian Journal of Anesthesia/Journal canadien d anesthésie · doi:10.1007/s12630-018-1159-2 · Cited by 20 · see citing works
Surgical scheduling via optimization and machine learning with long-tailed data
Shi, Y., Mahdian, S., Blanchet, J., Glynn, P. W., Shin, A. Y., & Scheinker, D. (2023) · Health Care Management Science · doi:10.1007/s10729-023-09649-0 · Cited by 19 · see citing works
Liu, H., Zheng, S., Li, X., Zeng, Z., Zhong, J., Chen, J.-Q., Chen, T., Liu, Z., Liu, X., & Shao, Y. (2019) · Journal of the American Heart Association · doi:10.1161/jaha.119.013388 · Cited by 19 · see citing works
Sun, L. Y., Eddeen, A. B., Ruel, M., MacPhee, E., & Mesana, T. G. (2020) · Journal of the American Heart Association · doi:10.1161/jaha.120.017847 · Cited by 19 · see citing works
Comparison of Risk Scores for Prediction of Complications following Aortic Valve Replacement
Wang, T. K. M., Choi, D. H.-M., Haydock, D. A., Gamble, G. D., Stewart, R., & Ruygrok, P. (2014) · Heart Lung and Circulation · doi:10.1016/j.hlc.2014.11.021 · Cited by 18 · see citing works
Critical care management of patients following transcatheter aortic valve replacement
Raiten, J. M., Gutsche, J. T., Horák, J., & Augoustides, J. G. (2013) · F1000Research · doi:10.12688/f1000research.2-62.v1 · Cited by 17 · see citing works
Applying a BP Neural Network Model to Predict the Length of Hospital Stay
Li, J., Tian, Y., Liu, Y., Shu, T., & Liang, M. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-37899-7_2 · Cited by 15 · see citing works
Predicting prolonged intensive care unit stays in older cardiac surgery patients: a validation study
Ettema, R. G. A., Peelen, L. M., Kalkman, C. J., Nierich, A. P., Moons, K. G. M., & Schuurmans, M. J. (2011) · Intensive Care Medicine · doi:10.1007/s00134-011-2314-1 · Cited by 15 · see citing works
Self-citationA Method to Account for Variation in Congenital Heart Surgery Length of Stay*
Brennan, A., Gauvreau, K., Connor, J. A., Almodovar, M. C., DiNardo, J. A., Banka, P., Nathan, M., Mathieu, D., Kaza, A. K., Mayer, J. E., et al. (2017) · Pediatric Critical Care Medicine · doi:10.1097/pcc.0000000000001168 · Cited by 15 · see citing works
Deschka, H., Schreier, R., El-Ayoubi, L., Erler, S., Müller, D., Alken, A., & Wimmer‐Greinecker, G. (2013) · Interactive Cardiovascular and Thoracic Surgery · doi:10.1093/icvts/ivt229 · Cited by 14 · see citing works
Risk Prediction Models in Perioperative Medicine: Methodological Considerations
Collins, P. G. S., Ma, J., Gerry, S., Ohuma, E. O., Odondi, L., Trivella, M., de Beyer, J. A., & Vazquez-Montes, M. (2016) · Current anesthesiology reports · doi:10.1007/s40140-016-0171-8 · Cited by 14 · see citing works
Coulson, T. G., Bailey, M., Reid, C. M., Tran, T., Mullany, D. V., Parker, J., Hicks, P. R., & Pilcher, D. V. (2016) · British Journal of Anaesthesia · doi:10.1093/bja/aew180 · Cited by 14 · see citing works
Barbini, P., Barbini, E., Furini, S., & Cevenini, G. (2014) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-14-89 · Cited by 14 · see citing works
Can soluble urokinase plasminogen receptor predict outcomes after cardiac surgery?
Schultz‐Swarthfigure, C. T., McCall, P. J., Docking, R. I., Galley, H. F., & Shelley, B. (2020) · Interactive Cardiovascular and Thoracic Surgery · doi:10.1093/icvts/ivaa239 · Cited by 13 · see citing works
Vogt, M. O., Hörer, J., Grünewald, S., Otto, D., Kaemmerer, H. M., Schreiber, C., & Hess, J. (2011) · Pediatric Cardiology · doi:10.1007/s00246-011-0093-7 · Cited by 13 · see citing works
Selective Prediction-Set Models with Coverage Rate Guarantees
Feng, J., Sondhi, A., Perry, J., & Simon, N. (2021) · Biometrics · doi:10.1111/biom.13612 · Cited by 25 · see citing works
Association between Preoperative Plasma sRAGE Levels and Recovery from Cardiac Surgery
Creagh-Brown, B. C., Quinlan, G. J., Hector, L. R., Evans, T. W., & Burke-Gaffney, A. C. (2013) · Mediators of Inflammation · doi:10.1155/2013/496031 · Cited by 12 · see citing works
Cologne, K. G., Byers, S., Rosen, D. R., Hwang, G. S., Ortega, A. E., Ault, G. T., & Lee, S. W. (2016) · The American Surgeon · doi:10.1177/000313481608201022 · Cited by 12 · see citing works
Langerak, A. J., McCambridge, A. B., Stubbs, P. W., Fabricius, J., Rogers, K. D., de Oliveira, C. Q., Nielsen, J. F., & Verhagen, A. P. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.03.022 · Cited by 12 · see citing works
Lee, J., Govindan, S., Celi, L. A., Khabbaz, K. R., & Subramaniam, B. (2013) · World Journal of Cardiovascular Surgery · doi:10.4236/wjcs.2013.35034 · Cited by 11 · see citing works
Tribuddharat, S., Sathitkarnmanee, T., Ngamsaengsirisup, K., Charuluxananan, S., Hurst, C. P., Silarat, S., & Lertmemongkolchai, G. (2014) · BioMed Research International · doi:10.1155/2014/158051 · Cited by 11 · see citing works
Cromhout, P. F., Berg, S. K., Moons, P., Damgaard, S., Nashef, S. A. M., & Thygesen, L. C. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-026745 · Cited by 10 · see citing works
Ljubačev, A., Medved, I., Ostric, M., Žuvić-Butorac, M., & Sokolici, J. (2013) · Acta chirurgica Belgica · doi:10.1080/00015458.2013.11680909 · Cited by 10 · see citing works
Zhang, H., Chen, W., Zhao, Y., Guan, L., Yu, M., Wang, R., & Chen, X. (2021) · Journal of Cardiothoracic Surgery · doi:10.1186/s13019-021-01463-5 · Cited by 9 · see citing works
Labata, C., Oliveras, T., Berastegui, E., Ruyra, X., Romero, B., Cámara, M.-L., Just, M.-S., Serra, J., Rueda, F., Ferrer, M., et al. (2018) · Revista Española de Cardiología · doi:10.1016/j.recesp.2017.10.018 · Cited by 9 · see citing works
Aiello, S., & Loomba, R. S. (2017) · Children · doi:10.3390/children4110101 · Cited by 9 · see citing works
Alexander, P. M. A., DiOrio, M., Andren, K. G., Gauvreau, K., Mistry, K. P., Mathieu, D., Wright, J., Allan, C. K., Nathan, M., Mayer, J. E., et al. (2018) · Pediatric Critical Care Medicine · doi:10.1097/pcc.0000000000001668 · Cited by 9 · see citing works
Moons, K. G. M., Altman, D. G., Reitsma, J. B., loannidis, J. P. A., Macaskill, P., Steyerberg, E. W., Vickers, A. J., Ransohoff, D. F., & Collins, P. G. S. (2022) · Digital Diagnostics · doi:10.17816/dd110794 · Cited by 8 · see citing works
Self-citationPrediction models for the risk of postoperative nausea and vomiting
Pace, N. L., Carlisle, J. B., Eberhart, L. H. J., Kranke, P., Trivella, M., Lee, A. S. Y., & Bennett, M. H. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011318 · Cited by 8 · see citing works
Augustin, P., Tanaka, S., Chhor, V., Provenchère, S., Arnaudovski, D., Ibrahim, H., Dilly, M., Allou, N., Montravers, P., & Philip, I. (2016) · Journal of Cardiothoracic and Vascular Anesthesia · doi:10.1053/j.jvca.2016.07.029 · Cited by 7 · see citing works
Katipoğlu, B., Aydınlı, B., Demir, A., & Özmen, H. (2022) · Biomarkers in Medicine · doi:10.2217/bmm-2022-0341 · Cited by 7 · see citing works
Barton, H., Zechendorf, E., Ostareck, D. H., Ostareck‐Lederer, A., Stoppe, C., Zayat, R., Simon, T. P., Marx, G., & Bickenbach, J. (2021) · Disease Markers · doi:10.1155/2021/5564334 · Cited by 7 · see citing works
Hădăreanu, C.-D., Hădăreanu, D.-R., Stoiculescu, F.-M., Berceanu, M. C., Donoiu, I., Istrătoaie, O., Florescu, C., Novac, M.-B., & Raicea, V.-C. (2025) · Journal of Clinical Medicine · doi:10.3390/jcm14082747 · Cited by 6 · see citing works
Outcomes After Prolonged ICU Stays in Postoperative Cardiac Surgery Patients
Curran, T. F. (2022) · Federal Practitioner · doi:10.12788/fp.0300 · Cited by 6 · see citing works
Liu, C., Qi, Y., Liu, X., Chen, M., Xiong, Y., Huang, S., Zou, K., Tan, J., & Sun, X. (2023) · BMC Medical Research Methodology · doi:10.1186/s12874-023-01832-9 · Cited by 6 · see citing works
Prediction of in-hospital death following acute type A aortic dissection
Chen, J., Bai, Y., Liu, H., Qin, M., & Guo, Z. (2023) · Frontiers in Public Health · doi:10.3389/fpubh.2023.1143160 · Cited by 6 · see citing works
Algengi og áhættuþættir lengdrar dvalar á gjörgæsludeild eftir kransæðahjáveituaðgerð
Gunnarsdóttir, E. L. T., Gunnarsdóttir, S. L. X., Heimisdóttir, A. A., Heiðarsdóttir, S. R., Helgadóttir, S., Guðbjartsson, T., Sigurdsson, M. I., & Sigurðsson, M. I. (2020) · Læknablaðið · doi:10.17992/lbl.2020.03.471 · Cited by 6 · see citing works
Risk prediction models: are they really necessary?
Braile, D. M., Monteiro, R., Brandau, R., & Jatene, F. B. (2010) · PubMed · Cited by 6 · see citing works
Intermediate Care Unit After Cardiac Surgery: Impact on Length of Stay and Outcomes
Labata, C., Oliveras, T., Berastegui, E., Ruyra, X., Romero, B., Cámara, M.-L., Just, M.-S., Serra, J., Rueda, F., Ferrer, M., et al. (2017) · Revista Española de Cardiología (English Edition) · doi:10.1016/j.rec.2017.10.018 · Cited by 5 · see citing works
Anantasit, N., Boyd, J. H., Russell, J. A., Fjell, C. D., Lichtenstein, S. V., & Walley, K. R. (2014) · Journal of Thoracic and Cardiovascular Surgery · doi:10.1016/j.jtcvs.2013.11.043 · Cited by 5 · see citing works
Yang, E., He, X., Li, L., Cui, Y., Yang, H., & Wang, Q. (2025) · European Journal of Cardiovascular Nursing · doi:10.1093/eurjcn/zvaf075 · Cited by 4 · see citing works
Cromhout, P. F., Thygesen, L. C., Moons, P., Nashef, S. A. M., Damgaard, S., Christensen, A. V., Rasmussen, T. B., Borregaard, B., Thrysoee, L., Thorup, C. B., et al. (2020) · Journal of Cardiac Surgery · doi:10.1111/jocs.15227 · Cited by 4 · see citing works
Multivariable Risk Prediction Models
Collins, P. G. S., & Manach, Y. L. (2013) · Anesthesiology · doi:10.1097/aln.0b013e31828e13e9 · Cited by 4 · see citing works
Invasive Mediastinal Staging in Lung Cancer. Use a Prediction Model or Just Do It?
Tanner, N. T., & Gould, M. K. (2017) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.201702-0397ed · Cited by 3 · see citing works
- Authors
- Ettema, R. G. A., Peelen, L. M., Schuurmans, M. J., Nierich, A. P., Kalkman, C. J., & Moons, K. G. M.
- Affiliations
- University of Applied Sciences Utrecht (NL)
- ORCID
- Venue
- Circulation
- Published
- 2010-08-17
- Volume
- 122
- Issue
- 7
- Pages
- 682-689
- ISSN
- 0009-7322 (ISSN-L)
- 1524-4539
- OpenAlex
- W1998435896
- Cited by
- 130
- References
- 52
- Citations by year
- 2026: 2 · 2025: 6 · 2023: 9 · 2022: 6 · 2021: 11 · 2020: 6 · 2019: 4 · 2018: 8 · 2017: 7 · 2016: 8 · 2015: 14 · 2014: 15 · 2013: 15 · 2012: 9
- FWCI
- 7.38
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Circulation (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Medicine › Cardiology and Cardiovascular Medicine › Cardiac Valve Diseases and Treatments
- Health Sciences › Medicine › Cardiology and Cardiovascular Medicine › Cardiac, Anesthesia and Surgical Outcomes
- Health Sciences › Medicine › Surgery › Cardiac and Coronary Surgery Techniques
- Keywords
- cardiac surgery, prediction model, model validation, EuroSCORE, model discrimination, model calibration, postoperative outcomes
- MeSH terms
- Aged, Female, Cardiac Surgical Procedures, Humans, Intensive Care Units, Length of Stay, Male, Middle Aged, Postoperative Period, Predictive Value of Tests, Risk Factors, Time Factors, Models, Statistical, Treatment Outcome
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review