The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Reliability and Validity of Scores on the Emergency Severity Index Version 3
Abstract
OBJECTIVES: No widely used triage instrument accurately assesses patient acuity. The Emergency Severity Index (ESI) promises to facilitate reliable acuity assessment and possibly predict patient disposition. However, reliability and validity of ESI scores have not been established in emergency departments (EDs) outside the original research sites, and version 3 (v.3) of the ESI has not been evaluated. The study hypothesis was that scores on the ESI v.3 show good interrater reliability and predict hospital admission, admission site, and death. METHODS: The authors conducted an ED-based cross-sectional retrospective study of 403 systematically selected ED records of patients who presented to an academic medical center. Twenty-seven variables were abstracted, including triage level assigned, admission status, site, and death. Using a standard process, the researchers determined the true triage level. Weighted kappa and Pearson correlation were used to calculate interrater reliability between true triage level and triage score assigned by the registered nurse (RN). The relationships between the true ESI level and admission, admission site, and death were assessed. RESULTS: Interrater reliability between RN ESI level and the true ESI level was kappa = 0.89; Pearson r = 0.83 (p < 0.001). Hospital admission by ESI level was as follows: 1 (80%), 2 (73%), 3 (51%), 4 (6%), and 5 (5%). A higher percentage of ESI level-1 and level-2 patients (40%, 12%) were admitted to the intensive care unit than ESI levels 3-5 (2%, 0%, 0%). Admission to telemetry for ESI levels 1-5 was 20%, 19%, 7%, 1%, and 0%, respectively. Three of four patients who died were ESI level 1 or 2. CONCLUSIONS: Scores on the ESI assigned by nurses have excellent interrater reliability and predict hospital admission and location of admission.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Not surprisingly, the triage level encoded by the Emergency Severity Index (ESI) had high information gain [44,45]”
From Predicting hospital admission at emergency department triage using machine learning (2018) · cites this paper as [44]
Citations
Cites
American college of emergency physicians
Haeck, W. T. (1980) · Annals of Emergency Medicine · doi:10.1016/s0196-0644(80)80511-7 · Cited by 1,539
Overcrowding in the nation’s emergency departments: Complex causes and disturbing effects
Derlet, R. W., & Richards, J. R. (2000) · Annals of Emergency Medicine · doi:10.1016/s0196-0644(00)70105-3 · Cited by 1,052
Australasian College for Emergency Medicine
(1994) · Emergency Medicine Australasia · doi:10.1111/j.1442-2026.1994.tb00150.x · Cited by 723
Frequent Overcrowding in U.S. Emergency Departments
Derlet, R. W., Richards, J. R., & Kravitz, R. L. (2001) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.2001.tb01280.x · Cited by 572
Reliability and Validity of a New Five‐level Triage Instrument
Wuerz, R. C., Milne, L. W., Eitel, D. R., Travers, D., & Gilboy, N. (2000) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.2000.tb01066.x · Cited by 554
Implementation and Refinement of the Emergency Severity Index
Wuerz, R. C., Travers, D. A., Gilboy, N., Eitel, D. R., Rosenau, A. M., & Yazhari, R. (2001) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.2001.tb01283.x · Cited by 258
Mackway-Jones, K. C., Marsden, J., Windle, J., & Manchester Triage Group (2013) · Wiley eBooks · doi:10.1002/9781118299029 · Cited by 253
A prospective study of ED pain management practices and the patient's perspective
Tanabe, P. J., & Buschmann, M. T. (1999) · Journal of Emergency Nursing · doi:10.1016/s0099-1767(99)70200-x · Cited by 221
Self-citationFive-level triage system more effective than three-level in tertiary emergency department
Travers, D. A., Waller, A. E., Bowling, J. M., Flowers, D., & Tintinalli, J. (2002) · Journal of Emergency Nursing · doi:10.1067/men.2002.127184 · Cited by 189
Trends in the use and capacity of California's emergency departments, 1990-1999
Lambe, S., Washington, D. L., Fink, A., Herbst, K. W., Liu, H., Fosse, J. S., & Asch, S. M. (2002) · Annals of Emergency Medicine · doi:10.1067/mem.2002.122433 · Cited by 179
Triage: Limitations in Predicting Need for Emergent Care and Hospital Admission☆☆☆★★★
Brillman, J. C., Doezema, D., Tandberg, D., Sklar, D. P., Davis, K. D., Simms, S., & SKIPPER, B. J. (1996) · Annals of Emergency Medicine · doi:10.1016/s0196-0644(96)70240-8 · Cited by 163
Inconsistency of Emergency Department Triage
Wuerz, R. C., Fernandes, C. M. B., & Alarcon, J. (1998) · Annals of Emergency Medicine · doi:10.1016/s0196-0644(98)70171-4 · Cited by 157
Rochester, New York A Decade of Emergency Department Overcrowding
Schneider, S. M., Zwemer, F. L., Doniger, A. S., Dick, R., Czapranski, T., & Davis, E. A. (2001) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.2001.tb01113.x · Cited by 132
Gill, J. S., REESEIV, C., & Diamond, J. M. (1996) · Annals of Emergency Medicine · doi:10.1016/s0196-0644(96)70108-7 · Cited by 132
Optimal Data Analysis: A Guidebook with Software for Windows
Yarnold, P. R., & Soltysik, R. C. (2004) · Cited by 131
Self-citationEmergency Severity Index Triage Category Is Associated with Six‐month Survival
Wuerz, R. C. (2001) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.2001.tb00554.x · Cited by 97
Theoretical Distributions of Optima for Univariate Discrimination of Random Data*
Yarnold, P. R., & Soltysik, R. C. (1991) · Decision Sciences · doi:10.1111/j.1540-5915.1991.tb00362.x · Cited by 77
Self-citationTying a Knot in the Unraveling Health Care Safety Net
Asplin, B. R. (2001) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.2001.tb01118.x · Cited by 33
One-tailed Type I error rates for balanced two-category UniODA with a random ordered attribute
Carmony, L. A., Yarnold, P. R., & Naeymi-Rad, F. (1997) · Annals of Operations Research · doi:10.1023/a:1018922421450 · Cited by 13
Self-citationEmergency Services Crisis of 2000—The Arizona Experience
Taylor, T. B. (2001) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.2001.tb01124.x · Cited by 10
Flagged first, then by citations
Research works printed but not linked: 4
- McCaig L, 2002, Division of Health Care Statistics, Centers for Disease Control. National Hospital Ambulatory Medical Care Survey: 2000 Emergency Department Survey, Advance Data from vital and health statistics., 326, 1
- Emergency Nurses Association, 2001, Triage: Making the Right Decision: A Triage Curriculum
- Emergency Nurses Association, 1996, National Emergency Department Database Survey
- Emergency Nurses Association, 1998, Triage: Meeting the Challenge
Cited by
Sorted by citations
Triage in Medicine, Part I: Concept, History, and Types
Iserson, K. V., & Moskop, J. C. (2006) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2006.05.019 · Cited by 520
Modern Triage in the Emergency Department
Christ, M., Grossmann, F. F., Winter, D., Bingisser, R. M., & Platz, E. (2010) · Deutsches Ärzteblatt international · doi:10.3238/arztebl.2010.0892 · Cited by 511
Increasing utilization of computed tomography in the adult emergency department, 2000–2005
Broder, J. S., & Warshauer, D. M. (2006) · Emergency Radiology · doi:10.1007/s10140-006-0493-9 · Cited by 477
Farrohknia, N., Castrén, M. K., Ehrenberg, A., Lind, L., Oredsson, S., Jonsson, H., Asplund, K., & Göransson, K. E. (2011) · Scandinavian Journal of Trauma Resuscitation and Emergency Medicine · doi:10.1186/1757-7241-19-42 · Cited by 337
Predicting hospital admission at emergency department triage using machine learning
Hong, W. S., Haimovich, A. D., & Taylor, R. A. (2018) · PLOS ONE · doi:10.1371/journal.pone.0201016 · Cited by 326
Metadata
- Authors
- Tanabe, P., Gimbel, R., Yarnold, P. R., Kyriacou, D. N., & Adams, J. G.
- Affiliations
- Northwestern University (US)
- Venue
- Academic Emergency Medicine
- Publisher
- Wiley
- Published
- 2004-01
- Volume
- 11
- Issue
- 1
- Pages
- 59-65
- ISSN
- 1069-6563 (ISSN-L)
- 1553-2712
- OpenAlex
- W1995360315
- Cited by
- 326
- References
- 20
- Citations by year
- 2026: 10 · 2025: 4 · 2024: 8 · 2023: 13 · 2022: 12 · 2021: 17 · 2020: 24 · 2019: 21 · 2018: 15 · 2017: 18 · 2016: 15 · 2015: 20 · 2014: 10 · 2013: 21 · 2012: 15
- FWCI
- 14.07
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Academic Emergency Medicine (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Medicine › Emergency Medicine › Emergency and Acute Care Studies
- Health Sciences › Medicine › Emergency Medicine › Trauma and Emergency Care Studies
- Health Sciences › Medicine › Critical Care and Intensive Care Medicine › Sepsis Diagnosis and Treatment
- Keywords
- Emergency Severity Index, emergency department triage, patient acuity assessment, inter-rater reliability, validity, hospital admission prediction, patient disposition, mortality prediction, nurse triage
- MeSH terms
- Adult, Aged, Algorithms, Cross-Sectional Studies, Emergencies, Emergency Service, Hospital, Female, Hospitals, Urban, Humans, Male, Medical Records, Middle Aged, Nursing Assessment, Nursing Staff, Hospital, Outcome and Process Assessment, Health Care, Patient Admission, Severity of Illness Index, Triage, United States, Emergency Nursing, Hospital Mortality
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review