The DOI matches its Crossref record.
Variation between experienced observers in the interpretation of accident and emergency radiographs.
Abstract
Skill mix and role extension initiatives have highlighted the difficulty of establishing quality standards for the accuracy of plain film reporting. An acceptable performance might be one which is indistinguishable from that of a group of experienced consultant radiologists. In order to assess the feasibility of setting such a standard, the variation between experienced observers must first be established. This study examines the variation found between three observers with the three major types of plain film examination. 402 plain film examinations (205 skeletal, 100 chest and 97 abdominal) performed on accident and emergency patients were reported retrospectively and independently by three experienced radiologists. The clinical data supplied on the request cards were available to the readers. Each examination was categorized by each reader as being normal, as showing significant abnormality relevant to the current clinical problem, or as showing insignificant or irrelevant abnormality. Concordance between all three readers was found in 51%, 61% and 74% of abdominal, chest and skeletal radiographs, respectively. Weighted kappa values confirmed that the level of agreement between pairs of observers was higher with skeletal radiographs (kappa w = 0.76-0.77) than with chest (kappa w = 0.63-0.68), or abdominal (kappa w = 0.50-0.78) examinations. However, the frequency of major disagreements (at least one reader reporting "normal" and one reporting "relevant abnormality") was similar for abdominal (11%), chest (12%) and skeletal (10%) radiographs. When the reports were reclassified into only two groups--either significantly abnormal or not--pairs of observers disagreed on 9-10% of skeletal, 11-19% of chest and 8-18% of abdominal cases. The average incidence of errors per observer was estimated to be in the range 3-6%. The magnitude of interobserver variation in plain film reporting is considerable, and must be taken into account when designing assessment techniques and setting quality standards for this activity.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
PadChest: A large chest x-ray image dataset with multi-label annotated reports
Bustos, A., Pertusa, A., Salinas, J.-M., & de la Iglesia-Vayá, M. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101797 · Cited by 691
Moonesinghe, S. R., Mythen, M. G., Das, P., Rowan, K. M., & Grocott, M. P. W. (2013) · Anesthesiology · doi:10.1097/aln.0b013e3182a4e94d · Cited by 334
Added value of double reading in diagnostic radiology,a systematic review
Geijer, H., & Geijer, M. (2018) · Insights into Imaging · doi:10.1007/s13244-018-0599-0 · Cited by 117
Hazell, L., Motto, J., & Chipeya, L. (2015) · Journal of medical imaging and radiation sciences · doi:10.1016/j.jmir.2015.03.002 · Cited by 38
Metadata
- Authors
- Robinson, P. J., Wilson, D., Coral, A., Murphy, A., & Verow, P.
- Venue
- The British Journal of Radiology
- Publisher
- Oxford University Press (OUP)
- Published
- 1999-04-01
- Volume
- 72
- Issue
- 856
- Pages
- 323-330
- ISSN
- 0007-1285 (ISSN-L)
- 1748-880X
- OpenAlex
- W1990393899
- Cited by
- 162
- References
- 0
- FWCI
- 4.56
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Variation between experienced observers in the interpretation of accident and emergency radiographs. https://app.cochat.ai/papers/10.1259/bjr.72.856.10474490
- The paper
- Robinson, P. J., Wilson, D., Coral, A., Murphy, A., & Verow, P. (1999). Variation between experienced observers in the interpretation of accident and emergency radiographs. The British Journal of Radiology. https://doi.org/10.1259/bjr.72.856.10474490
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.