Prediction of Critical Illness During Out-of-Hospital Emergency Care
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
CONTEXT: Early identification of nontrauma patients in need of critical care services in the emergency setting may improve triage decisions and facilitate regionalization of critical care. OBJECTIVES: To determine the out-of-hospital clinical predictors of critical illness and to characterize the performance of a simple score for out-of-hospital prediction of development of critical illness during hospitalization. DESIGN AND SETTING: Population-based cohort study of an emergency medical services (EMS) system in greater King County, Washington (excluding metropolitan Seattle), that transports to 16 receiving facilities. PATIENTS: Nontrauma, non-cardiac arrest adult patients transported to a hospital by King County EMS from 2002 through 2006. Eligible records with complete data (N = 144,913) were linked to hospital discharge data and randomly split into development (n = 87,266 [60%]) and validation (n = 57,647 [40%]) cohorts. MAIN OUTCOME MEASURE: Development of critical illness, defined as severe sepsis, delivery of mechanical ventilation, or death during hospitalization. RESULTS: Critical illness occurred during hospitalization in 5% of the development (n = 4835) and validation (n = 3121) cohorts. Multivariable predictors of critical illness included older age, lower systolic blood pressure, abnormal respiratory rate, lower Glasgow Coma Scale score, lower pulse oximetry, and nursing home residence during out-of-hospital care (P < .01 for all). When applying a summary critical illness prediction score to the validation cohort (range, 0-8), the area under the receiver operating characteristic curve was 0.77 (95% confidence interval [CI], 0.76-0.78), with satisfactory calibration slope (1.0). Using a score threshold of 4 or higher, sensitivity was 0.22 (95% CI, 0.20-0.23), specificity was 0.98 (95% CI, 0.98-0.98), positive likelihood ratio was 9.8 (95% CI, 8.9-10.6), and negative likelihood ratio was 0.80 (95% CI, 0.79- 0.82). A threshold of 1 or greater for critical illness improved sensitivity (0.98; 95% CI, 0.97-0.98) but reduced specificity (0.17; 95% CI, 0.17-0.17). CONCLUSIONS: In a population-based cohort, the score on a prediction rule using out-of-hospital factors was significantly associated with the development of critical illness during hospitalization. This score requires external validation in an independent population.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Information Theory and an Extension of the Maximum Likelihood Principle
Akaike, H. (1992) · Springer Series in Statistics · doi:10.1007/978-1-4612-0919-5_38 · Cited by 3,028
Multiple Imputation of Missing Values
Royston, P. (2004) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x0400400301 · Cited by 2,340 · cited 3×
“Components of critical illness during hospitalizationd In-hospital mortality 1718 (35) 1108 (36)”
A REVIEW OF GOODNESS OF FIT STATISTICS FOR USE IN THE DEVELOPMENT OF LOGISTIC REGRESSION MODELS1
LEMESHOW, S., & HOSMER, D. W. (1982) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a113284 · Cited by 1,947
Prognosis and prognostic research: Developing a prognostic model
Royston, P., Moons, K. G. M., Altman, D. G., & Vergouwe, Y. (2009) · BMJ · doi:10.1136/bmj.b604 · Cited by 1,172
Kramer, A. A., & Zimmerman, J. E. (2007) · Critical Care Medicine · doi:10.1097/01.ccm.0000275267.64078.b0 · Cited by 886 · cited 5×
“Electrocardiographic monitoring 2838 (59) 27 656 (34) 1858 (60) 18 048 (33)”
InfluentialRacial Variation in the Incidence, Care, and Outcomes of Severe Sepsis
Barnato, A. E., Alexander, S. L., Linde-Zwirble, W. T., & Angus, D. C. (2008) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.200703-480oc · Cited by 284 · cited 2×
“Urgent 2428 (50) 38 564 (47) 1606 (52) 25 495 (47)”
Validation of probabilistic predictions
Miller, M. E., Langefeld, C. D., Tierney, W. M., Hui, S. L., & McDonald, C. J. (1993) · Medical Decision Making · doi:10.1177/0272989x9301300107 · Cited by 129 · cited 3×
“Patient side to departure 26 (20-34) 21 (16-27) 26 (19-35) 21 (16-27)”
Verification of forecasts expressed in terms of probability
BRIER, G. W. (1950) · Monthly Weather Review · doi:10.1175/1520-0493(1950)078%3c0001:vofeit%3e2.0.co;2 · cited 2×
“Patient side to departure 26 (20-34) 21 (16-27) 26 (19-35) 21 (16-27)”
Cited by
Seymour, C. W., Liu, V. X., Iwashyna, T. J., Brunkhorst, F. M., Rea, T. D., Scherag, A., Rubenfeld, G., Kahn, J. M., Shankar-Hari, M., Singer, M., et al. (2016) · JAMA · doi:10.1001/jama.2016.0288 · Cited by 3,939
Self-citationPhotoplethysmographic derivation of respiratory rate: A review of relevant physiology
Meredith, D. J., Clifton, D., Charlton, P., Brooks, J., Pugh, C. W., & Tarassenko, L. (2012) · Journal of Medical Engineering & Technology · doi:10.3109/03091902.2011.638965 · Cited by 226
Lee, S., Park, H. J., Hwang, J., Lee, S. W., Han, K. S., Kim, W. Y., Jeong, J., Kang, H., Kim, A., Lee, C., et al. (2023) · Emergency Medicine International · doi:10.1155/2023/1221704 · Cited by 8
Metadata
- Authors
- Seymour, C. W.
- Venue
- JAMA
- Publisher
- American Medical Association (AMA)
- Published
- 2010-08-18
- Volume
- 304
- Issue
- 7
- Pages
- 747
- ISSN
- 0002-9955 (ISSN-L)
- 0098-7484
- OpenAlex
- W1991991793
- Cited by
- 161
- References
- 8
- FWCI
- 9.79
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Prediction of Critical Illness During Out-of-Hospital Emergency Care. https://app.cochat.ai/papers/10.1001/jama.2010.1140
- The paper
- Seymour, C. W. (2010). Prediction of Critical Illness During Out-of-Hospital Emergency Care. JAMA. https://doi.org/10.1001/jama.2010.1140
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.