The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Reliability and validity of the Manchester Triage System in a general emergency department patient population in the Netherlands: results of a simulation study
Abstract
OBJECTIVE: To assess the reliability and validity of the Manchester Triage System (MTS) in a general emergency department patient population. METHODS: A prospective evaluation study was conducted in two general hospitals in the Netherlands. Emergency department nurses from both hospitals triaged 50 patient vignettes into one of five triage categories in the MTS. Triage ratings were compared with the ratings of two Dutch MTS experts to measure inter-rater reliability. Nineteen days after triaging the patient vignettes, triage nurses were asked to rate the same vignettes again to measure test-retest reliability. Reliability in relation to the work experience of emergency department nurses was also studied. Validity was assessed by calculating percentages for overtriage, undertriage, sensitivity and specificity. RESULTS: Inter-rater reliability was "substantial" (weighted kappa 0.62 (95% CI 0.60 to 0.65)) and test-retest reliability was high (intraclass correlation coefficient 0.75 (95% CI 0.72 to 0.77)). No significant association was found between the experience of emergency department nurses and the reliability score (kappa). Undertriage occurred more frequently than overtriage, especially in elderly patients (25.3% vs 7.6%). Sensitivity for urgent patients in the MTS was 53.2% and specificity was 95.1%. The patient vignettes representing children aged <16 years revealed a higher sensitivity (83.3%). CONCLUSIONS: Inter-rater reliability is "moderate" to "substantial" and test-retest reliability is high. The reliability of the MTS is not influenced by nurses' work experience. Undertriage mainly occurs in the MTS categories orange and yellow. The MTS is more sensitive for children who need immediate or urgent care than for other patients in the emergency department.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
High agreement but low Kappa: I. the problems of two paradoxes
Feinstein, A. R., & Cicchetti, D. V. (1990) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(90)90158-l · Cited by 3,034
Dependence of Weighted Kappa Coefficients on the Number of Categories
Brenner, H., & Kliebsch, U. (1996) · Epidemiology · doi:10.1097/00001648-199603000-00016 · Cited by 255
The analysis of ordinal agreement data: beyond weighted kappa
Graham, P., & Jackson, R. (1993) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(93)90173-x · Cited by 121
Cited by
Modern Triage in the Emergency Department
Christ, M., Grossmann, F., Winter, D., Bingisser, R., & Platz, E. (2010) · Deutsches Ärzteblatt international · doi:10.3238/arztebl.2010.0892 · Cited by 493
Farrohknia, N., Castrén, M., Ehrenberg, A., Lind, L., Oredsson, S., Jonsson, H., Asplund, K., & Göransson, K. E. (2011) · Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine · doi:10.1186/1757-7241-19-42 · Cited by 337
Triage Performance in Emergency Medicine: A Systematic Review
Hinson, J. S., Martinez, D. A., Cabral, S., George, K., Whalen, M., Hansoti, B., & Levin, S. (2019) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2018.09.022 · Cited by 293
Human intelligence versus Chat-GPT: who performs better in correctly classifying patients in triage?
Zaboli, A., Brigo, F., Sibilio, S., Mian, M., & Turcato, G. (2024) · The American Journal of Emergency Medicine · doi:10.1016/j.ajem.2024.02.008 · Cited by 85
Metadata
- Authors
- van der Wulp, I., van Baar, M. E., & Schrijvers, A. J. P.
- Venue
- Emergency Medicine Journal
- Publisher
- BMJ
- Published
- 2008-07-01
- Volume
- 25
- Issue
- 7
- Pages
- 431-434
- ISSN
- 1351-0622 (ISSN-L)
- 1472-0205
- 1472-0213
- OpenAlex
- W1968351933
- Cited by
- 181
- References
- 3
- FWCI
- 13.93
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Reliability and validity of the Manchester Triage System in a general emergency department patient population in the Netherlands: results of a simulation study. https://app.cochat.ai/papers/10.1136/emj.2007.055228
- The paper
- van der Wulp, I., van Baar, M. E., & Schrijvers, A. J. P. (2008). Reliability and validity of the Manchester Triage System in a general emergency department patient population in the Netherlands: results of a simulation study. Emergency Medicine Journal. https://doi.org/10.1136/emj.2007.055228
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.