NHS Direct: consistency of triage outcomes
Open accessThe DOI matches its Crossref record.
Abstract
OBJECTIVES: To examine the consistency of triage outcomes by nurses using four types of computerised decision support software in NHS Direct. METHODS: 119 scenarios were constructed based on calls to ambulance services that had been assigned the lowest priority category by the emergency medical dispatch systems in use. These scenarios were presented to nurses working in four NHS Direct call centres using different computerised decision support software, including the NHS Clinical Assessment System. RESULTS: The overall level of agreement between the nurses using the four systems was "fair" rather than "moderate" or "good" (kappa=0.375, 95% CI: 0.34 to 0.41). For example, the proportion of calls triaged to accident and emergency departments varied from 22% (26 of 119) to 44% (53 of 119). Between 21% (25 of 119) and 31% (37 of 119) of these low priority ambulance calls were triaged back to the 999 ambulance service. No system had both high sensitivity and specificity for referral to accident and emergency services. CONCLUSIONS: There were large differences in outcome between nurses using different software systems to triage the same calls. If the variation is primarily attributable to the software then standardising on a single system will obviously eliminate this. As the calls were originally made to ambulance services and given the lowest priority, this study also suggests that if, in the future, ambulance services pass such calls to NHS Direct then at least a fifth of these may be passed back unless greater sensitivity in the selection of calls can be achieved.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Applying corpus linguistics in a health care context
Adolphs, S., Brown, B., Carter, R., Crawford, P., & Sahota, O. (2004) · Journal of Applied Linguistics · doi:10.1558/japl.1.1.9.55871 · Cited by 107
Michel, J., Manns, A., Boudersa, S., Jaubert, C., Dupic, L., Vivien, B., Burgun, A., Campeotto, F., & Tsopra, R. (2024) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2024.105347 · Cited by 26
Turnbull, J., Pope, C., Rowsell, A., Prichard, J., Halford, S., Jones, J., May, C., & Lattimer, V. (2014) · Health Services and Delivery Research · doi:10.3310/hsdr02030 · Cited by 22
Metadata
- Authors
- O'Cathain, A.
- Venue
- Emergency Medicine Journal
- Publisher
- BMJ
- Published
- 2003-05-01
- Volume
- 20
- Issue
- 3
- Pages
- 289-292
- ISSN
- 1351-0622 (ISSN-L)
- 1472-0205
- 1472-0213
- OpenAlex
- W2122484368
- Cited by
- 65
- References
- 0
- FWCI
- 2.29
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: NHS Direct: consistency of triage outcomes. https://app.cochat.ai/papers/10.1136/emj.20.3.289
- The paper
- O'Cathain, A. (2003). NHS Direct: consistency of triage outcomes. Emergency Medicine Journal. https://doi.org/10.1136/emj.20.3.289
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.