An Electronic Emergency Triage System to Improve Patient Distribution by Critical Outcomes
Abstract
Background Patient triage is necessary to manage excessive patient volumes and identify those with critical conditions. The most common triage system used today, Emergency Severity Index (ESI), focuses on resources utilized and critical outcomes.Objective This study derives and validates a computer-based electronic triage system (ETS) to improve patient acuity distribution based on serious patient outcomes.Methods This cross-sectional study of 25,198 (97 million weighted) adult emergency department visits from the 2009 National Hospital Ambulatory Medical Care Survey. The ETS distributes patients by using a composite outcome based on the estimated probability of mortality, intensive care unit admission, or transfer to operating room or catheterization suite. We compared the ETS with the ESI based on the differentiation of patients, outcomes, inpatient hospitalization, and resource utilization.Results Of the patients included, 3.3% had the composite outcome and 14% were admitted, and 2.52 resources/patient were used. Of the 90% triaged to low-acuity levels, ETS distributed patients evenly (Level 3: 30%; Level 4: 30%, and Level 5: 29%) compared to ESI (46%, 34%, and 7%, respectively). The ETS better-identified patients with the composite outcome present in 40% of ETS Level 1 vs. 17% for ESI and the ETS area under the receiver operating characteristic curve (AUC) was 0.83 vs. ESI 0.73. Similar results were found for hospital admission (ETS AUC = 0.83 vs. ESI AUC = 0.72). The ETS demonstrated slight improvements in discriminating patient resource utilization.Conclusions The ETS is a triage system based on the frequency of critical outcomes that demonstrate improved differentiation of patients compared to the current standard ESI.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Most prior models predicting hospital admission at ED triage include only information collected at triage such as demographics, vital signs, chief complaint, nursing notes, and early diagnostics.
“Most models only include information collected at triage such as demographics, vital signs, chief complaint, nursing notes, and early diagnostics [11,14–19]”
From Predicting hospital admission at emergency department triage using machine learning (2018) · cites this paper as [14]
A patient's likelihood of admission may serve as a proxy for acuity, which is used in downstream decisions such as bed placement and the need for emergency intervention.
“From the perspective of patient care in the ED setting, a patient's likelihood of admission may serve as a proxy for acuity, which is used in a number of downstream decisions such as bed placement and the need for emergency intervention [12–14].”
From Predicting hospital admission at emergency department triage using machine learning (2018) · cites this paper as [14]
Cites
Reliability and Validity of a New Five‐level Triage Instrument
Wuerz, R. C., Milne, L. W., Eitel, D. R., Travers, D., & Gilboy, N. (2000) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.2000.tb01066.x · Cited by 554 · see citing works
Modern Triage in the Emergency Department
Christ, M., Grossmann, F. F., Winter, D., Bingisser, R. M., & Platz, E. (2010) · Deutsches Ärzteblatt international · doi:10.3238/arztebl.2010.0892 · Cited by 511 · see citing works
Reliability and validity of scores on The Emergency Severity Index version 3
Tanabe, P., Gimbel, R., Yarnold, P. R., Kyriacou, D. N., & Adams, J. G. (2004) · Academic Emergency Medicine · doi:10.1197/j.aem.2003.06.013 · Cited by 326 · see citing works
A systematic review of triage-related interventions to improve patient flow in emergency departments
Oredsson, S., Jonsson, H., Rognes, J., Lind, L., Göransson, K. E., Ehrenberg, A., Asplund, K., Castrén, M. K., & Farrohknia, N. (2011) · Scandinavian Journal of Trauma Resuscitation and Emergency Medicine · doi:10.1186/1757-7241-19-43 · Cited by 305 · see citing works
The Emergency Severity Index Triage Algorithm Version 2 Is Reliable and Valid
Eitel, D. R., Travers, D. A., Rosenau, A. M., Gilboy, N., & Wuerz, R. C. (2003) · Academic Emergency Medicine · doi:10.1197/s1069-6563(03)00350-6 · Cited by 291 · see citing works
Five-Level Triage: A Report from the ACEP/ENA Five-Level Triage Task Force
Fernandes, C. M. B., Tanabe, P. J., Gilboy, N., Johnson, L. A., McNair, R. S., Rosenau, A. M., Sawchuk, P., Thompson, D. A., Travers, D. A., Bonalumi, N. M., et al. (2005) · Journal of Emergency Nursing · doi:10.1016/j.jen.2004.11.002 · Cited by 282 · see citing works
Implementation and Refinement of the Emergency Severity Index
Wuerz, R. C., Travers, D. A., Gilboy, N., Eitel, D. R., Rosenau, A. M., & Yazhari, R. (2001) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.2001.tb01283.x · Cited by 258 · see citing works
Mackway-Jones, K. C., Marsden, J., Windle, J., & Manchester Triage Group (2013) · Wiley eBooks · doi:10.1002/9781118299029 · Cited by 253 · see citing works
Canadian Emergency Department Triage and Acuity Scale : implementation guidelines
Beveridge, R. (1999) · Medical Entomology and Zoology · Cited by 250 · see citing works
McCaig, L. F., & Burt, C. W. (2012) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2012.07.010 · Cited by 213 · see citing works
Survival of the Fittest: The Hidden Cost of Undertriage of Major Trauma
Haas, B., Gómez, D., Zagorski, B., et al. (2010) · Journal of the American College of Surgeons · doi:10.1016/j.jamcollsurg.2010.08.014 · Cited by 205 · see citing works
Barfod, C., Lauritzen, M. M. P., Danker, J. K., Sölétormos, G., Forberg, J. L., Berlac, P. A., Lippert, F. K., Lundstrøm, L. H., Antonsen, K., & Lange, K. H. W. (2012) · Scandinavian Journal of Trauma Resuscitation and Emergency Medicine · doi:10.1186/1757-7241-20-28 · Cited by 194 · see citing works
Tanabe, P. J., Gimbel, R., Yarnold, P. R., & Adams, J. G. (2004) · Journal of Emergency Nursing · doi:10.1016/j.jen.2003.11.004 · Cited by 165 · see citing works
McHugh, M., Tanabe, P. J., McClelland, M. S., & Khare, R. K. (2011) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.2011.01240.x · Cited by 159 · see citing works
The Future of Emergency Care in the United States Health System
Dharshi, A. S. (2006) · Journal of Pediatric Surgery · doi:10.1016/j.jpedsurg.2006.07.016 · Cited by 114 · see citing works
Emergency Triage: Comparing a Novel Computer Triage Program with Standard Triage
Dong, S. L. (2005) · Academic Emergency Medicine · doi:10.1197/j.aem.2005.01.005 · Cited by 94 · see citing works
Yurkova, I., & Wolf, L. A. (2011) · Journal of Emergency Nursing · doi:10.1016/j.jen.2011.01.016 · Cited by 72 · see citing works
Undertriage in the Manchester triage system: an assessment of severity and options for improvement
Seiger, N., van Veen, M., Steyerberg, E. W., Ruige, M., van Meurs, A. H. J., & Moll, H. A. (2011) · Archives of Disease in Childhood · doi:10.1136/adc.2010.206797 · Cited by 60 · see citing works
Emergency Department Abnormal Vital Sign “Triggers” Program Improves Time to Therapy
McGillicuddy, D. C., O’Connell, F., Shapiro, N. I., Calder, S. A., Mottley, L., Roberts, J. C., & Sánchez, L. D. (2011) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.2011.01056.x · Cited by 37 · see citing works
Emergency Triage: Comparing a Novel Computer Triage Program with Standard Triage
Dong, S. L., Bullard, M. J., Meurer, D. P., et al. (2005) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.2005.tb00889.x · Cited by 36 · see citing works
Australasian Triage Scale: Consumer perspective
Meek, R., & Phiri, W. (2005) · Emergency Medicine Australasia · doi:10.1111/j.1742-6723.2005.00725.x · Cited by 15 · see citing works
Roe, B. H. (2013) · Journal of Advanced Nursing · doi:10.1111/jan.12216 · Cited by 12 · see citing works
On nuclear war and emergency health care
Magnotto, L., Kline, J. S., Mauer, D., et al. (1984) · Annals of Emergency Medicine · doi:10.1016/s0196-0644(84)80098-0 · Cited by 4 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Levin, S., Toerper, M., Hamrock, E., Hinson, J. S., Barnes, S., Gardner, H., Dugas, A., Linton, B., Kirsch, T., & Kelen, G. (2018) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2017.08.005 · Cited by 424 · see citing works
Self-citationPredicting hospital admission at emergency department triage using machine learning
Hong, W. S., Haimovich, A. D., & Taylor, R. A. (2018) · PLOS ONE · doi:10.1371/journal.pone.0201016 · Cited by 326 · see citing works
Goto, T., Camargo, C. A., Faridi, M. K., Freishtat, R. J., & Hasegawa, K. (2019) · JAMA Network Open · doi:10.1001/jamanetworkopen.2018.6937 · Cited by 285 · see citing works
Machine learning and artificial intelligence: applications in healthcare epidemiology
Hamilton, A. J., Strauss, A. T., Martinez, D. A., Hinson, J. S., Levin, S., Lin, G., & Klein, E. Y. (2021) · Antimicrobial Stewardship & Healthcare Epidemiology · doi:10.1017/ash.2021.192 · Cited by 58 · see citing works
Self-citationHinson, J. S., Klein, E., Smith, A., Toerper, M., Dungarani, T., Hager, D., Hill, P., Kelen, G., Niforatos, J. D., Stephens, R. S., et al. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00646-1 · Cited by 30 · see citing works
Self-citation
- Authors
- Dugas, A. F., Kirsch, T. D., Toerper, M., Korley, F., Yenokyan, G., France, D., Hager, D., & Levin, S.
- Affiliations
- Johns Hopkins University (US)
- Vanderbilt University (US)
- Corresponding author
- Dugas, Andrea Freyer
- ORCID
- Venue
- The Journal of Emergency Medicine
- Publisher
- Elsevier BV
- Published
- 2016-06
- Volume
- 50
- Issue
- 6
- Pages
- 910-918
- ISSN
- 0736-4679 (ISSN-L)
- OpenAlex
- W2345073978
- Cited by
- 132
- References
- 24
- Citations by year
- 2026: 7 · 2025: 16 · 2024: 15 · 2023: 8 · 2022: 11 · 2021: 22 · 2020: 24 · 2019: 14 · 2018: 9 · 2017: 6
- FWCI
- 12.80
- Type
- journal article
- Language
- en
- Update notices
- erratum (2016-08-01)
- Open access
- closed
- Locations
- Journal of Emergency Medicine (publishedVersion)
- PubMed (publishedVersion)
- Funders
- PACER: National Center for Study of Preparedness and Response (2010-ST-061-PA0001)
- Topics
- Health Sciences › Medicine › Emergency Medicine › Emergency and Acute Care Studies
- Health Sciences › Medicine › Emergency Medicine › Trauma and Emergency Care Studies
- Health Sciences › Medicine › Epidemiology › Sepsis Diagnosis and Treatment
- Keywords
- emergency department triage, Emergency Severity Index, mortality prediction, intensive care unit admission, hospitalization, resource utilization (health care), critical outcomes
- MeSH terms
- Adolescent, Adult, Aged, Aged, 80 and over, Cross-Sectional Studies, Emergency Service, Hospital, Female, Humans, Male, Middle Aged, Retrospective Studies, Severity of Illness Index, Triage, Area Under Curve, Young Adult, Electronic Health Records
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review