Discriminative Accuracy of Physician and Nurse Predictions for Survival and Functional Outcomes 6 Months After an ICU Admission
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
IMPORTANCE: Predictions of long-term survival and functional outcomes influence decision making for critically ill patients, yet little is known regarding their accuracy. OBJECTIVE: To determine the discriminative accuracy of intensive care unit (ICU) physicians and nurses in predicting 6-month patient mortality and morbidity, including ambulation, toileting, and cognition. DESIGN, SETTING, AND PARTICIPANTS: Prospective cohort study conducted in 5 ICUs in 3 hospitals in Philadelphia, Pennsylvania, and enrolling patients who spent at least 3 days in the ICU from October 2013 until May 2014 and required mechanical ventilation, vasopressors, or both. These patients' attending physicians and bedside nurses were also enrolled. Follow-up was completed in December 2014. MAIN OUTCOMES AND MEASURES: ICU physicians' and nurses' binary predictions of in-hospital mortality and 6-month outcomes, including mortality, return to original residence, ability to toilet independently, ability to ambulate up 10 stairs independently, and ability to remember most things, think clearly, and solve day-to-day problems (ie, normal cognition). For each outcome, physicians and nurses provided a dichotomous prediction and rated their confidence in that prediction on a 5-point Likert scale. Outcomes were assessed via interviews with surviving patients or their surrogates at 6 months. Discriminative accuracy was measured using positive and negative likelihood ratios (LRs), C statistics, and other operating characteristics. RESULTS: Among 340 patients approached, 303 (89%) consented (median age, 62 years [interquartile range, 53-71]; 57% men; 32% African American); 6-month follow-up was completed for 299 (99%), of whom 169 (57%) were alive. Predictions were made by 47 physicians and 128 nurses. Physicians most accurately predicted 6-month mortality (positive LR, 5.91 [95% CI, 3.74-9.32]; negative LR, 0.41 [95% CI, 0.33-0.52]; C statistic, 0.76 [95% CI, 0.72-0.81]) and least accurately predicted cognition (positive LR, 2.36 [95% CI, 1.36-4.12]; negative LR, 0.75 [95% CI, 0.61-0.92]; C statistic, 0.61 [95% CI, 0.54-0.68]). Nurses most accurately predicted in-hospital mortality (positive LR, 4.71 [95% CI, 2.94-7.56]; negative LR, 0.61 [95% CI, 0.49-0.75]; C statistic, 0.68 [95% CI, 0.62-0.74]) and least accurately predicted cognition (positive LR, 1.50 [95% CI, 0.86-2.60]; negative LR, 0.88 [95% CI, 0.73-1.06]; C statistic, 0.55 [95% CI, 0.48-0.62]). Discriminative accuracy was higher when physicians and nurses were confident about their predictions (eg, for physicians' confident predictions of 6-month mortality: positive LR, 33.00 [95% CI, 8.34-130.63]; negative LR, 0.18 [95% CI, 0.09-0.35]; C statistic, 0.90 [95% CI, 0.84-0.96]). Compared with a predictive model including objective clinical variables, a model that also included physician and nurse predictions had significantly higher discriminative accuracy for in-hospital mortality, 6-month mortality, and return to original residence (P < .01 for all). CONCLUSIONS AND RELEVANCE: ICU physicians' and nurses' discriminative accuracy in predicting 6-month outcomes of critically ill patients varied depending on the outcome being predicted and confidence of the predictors. Further research is needed to better understand how clinicians derive prognostic estimates of long-term outcomes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
DeLong, E. R., DeLong, D. M., & Clarke-Pearson, D. L. (1988) · Biometrics · doi:10.2307/2531595 · Cited by 22,649
Long-term cognitive impairment after critical illness
Pandharipande, P. P., Girard, T. D., Jackson, J. C., Morandi, A., Thompson, J. L., Pun, B. T., Brummel, N. E., Hughes, C. G., Vasilevskis, E. E., Shintani, A. K., et al. (2013) · New England Journal of Medicine · doi:10.1056/nejmoa1301372 · Cited by 2,842
Long-term cognitive impairment and functional disability among survivors of severe sepsis.
Iwashyna, T. J., Ely, E. W., Smith, D. M., & Langa, K. M. (2010) · JAMA · doi:10.1001/jama.2010.1553 · Cited by 2,582 · cited 1×
“(%) Physicians (n = 47) Nurses (n = 128) Age, median (IQR), y 41 (38-52) 29 (27-37)”
The development of a comorbidity index with physical function as the outcome
GROLL, D., TO, T., BOMBARDIER, C., & WRIGHT, J. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.10.018 · Cited by 1,198
Withdrawal of Mechanical Ventilation in Anticipation of Death in the Intensive Care Unit
Cook, D., Rocker, G., Marshall, J., Sjokvist, P., Dodek, P., Griffith, L., Freitag, A., Varon, J., Bradley, C., Levy, M., et al. (2003) · New England Journal of Medicine · doi:10.1056/nejmoa030083 · Cited by 434
Unroe, M., Kahn, J. M., Carson, S. S., Govert, J. A., Martinu, T., Sathy, S. J., Clay, A. S., Chia, J., Gray, A., Tulsky, J. A., et al. (2010) · Annals of Internal Medicine · doi:10.7326/0003-4819-153-3-201008030-00007 · Cited by 427 · cited 2×
“1) Ventilator days, median (IQR)a 6 (3-10) Required vasoactive infusionsa 247 (81.”
White, D. B., Ernecoff, N., Buddadhumaruk, P., Hong, S., Weissfeld, L., Curtis, J. R., Luce, J. M., & Lo, B. (2016) · JAMA · doi:10.1001/jama.2016.5351 · Cited by 232
Cited by
Brennan, M., Puri, S., Ozrazgat-Baslanti, T., Feng, Z., Ruppert, M., Hashemighouchani, H., Momcilovic, P., Li, X., Wang, D. Z., & Bihorac, A. (2019) · Surgery · doi:10.1016/j.surg.2019.01.002 · Cited by 131
“Female sex, n (%) 5 (25) Age (years), n (%) 30 2 (10)”
Kruser, J. M., Benjamin, B. T., Gordon, E. J., Michelson, K. N., Wunderink, R. G., Holl, J. L., & Schwarze, M. L. (2019) · Critical Care Medicine · doi:10.1097/ccm.0000000000003711 · Cited by 50
Grossert, A., Meffert, C., Hess, V., Rochlitz, C., Pless, M., Hunziker, S., Wössmer, B., Geuter, U., Meinlschmidt, G., & Schaefert, R. (2019) · BMC Psychology · doi:10.1186/s40359-019-0357-1 · Cited by 6
Metadata
- Authors
- Detsky, M. E., Harhay, M. O., Bayard, D. F., Delman, A. M., Buehler, A. E., Kent, S. A., Ciuffetelli, I. V., Cooney, E., Gabler, N. B., Ratcliffe, S. J., Mikkelsen, M. E., & Halpern, S. D.
- Venue
- JAMA
- Publisher
- American Medical Association (AMA)
- Published
- 2017-06-06
- Volume
- 317
- Issue
- 21
- Pages
- 2187
- ISSN
- 0002-9955 (ISSN-L)
- 0098-7484
- OpenAlex
- W2615919757
- Cited by
- 193
- References
- 7
- FWCI
- 20.27
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Discriminative Accuracy of Physician and Nurse Predictions for Survival and Functional Outcomes 6 Months After an ICU Admission. https://app.cochat.ai/papers/10.1001/jama.2017.4078
- The paper
- Detsky, M. E., Harhay, M. O., Bayard, D. F., Delman, A. M., Buehler, A. E., Kent, S. A., Ciuffetelli, I. V., Cooney, E., Gabler, N. B., Ratcliffe, S. J., Mikkelsen, M. E., & Halpern, S. D. (2017). Discriminative Accuracy of Physician and Nurse Predictions for Survival and Functional Outcomes 6 Months After an ICU Admission. JAMA. https://doi.org/10.1001/jama.2017.4078
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.