Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 162

The DOI matches its Crossref record.

Variation between experienced observers in the interpretation of accident and emergency radiographs.

Robinson, P J, Wilson, D, Coral, A, Murphy, A, Verow, P·1999·The British Journal of Radiology

Abstract

Skill mix and role extension initiatives have highlighted the difficulty of establishing quality standards for the accuracy of plain film reporting. An acceptable performance might be one which is indistinguishable from that of a group of experienced consultant radiologists. In order to assess the feasibility of setting such a standard, the variation between experienced observers must first be established. This study examines the variation found between three observers with the three major types of plain film examination. 402 plain film examinations (205 skeletal, 100 chest and 97 abdominal) performed on accident and emergency patients were reported retrospectively and independently by three experienced radiologists. The clinical data supplied on the request cards were available to the readers. Each examination was categorized by each reader as being normal, as showing significant abnormality relevant to the current clinical problem, or as showing insignificant or irrelevant abnormality. Concordance between all three readers was found in 51%, 61% and 74% of abdominal, chest and skeletal radiographs, respectively. Weighted kappa values confirmed that the level of agreement between pairs of observers was higher with skeletal radiographs (kappa w = 0.76-0.77) than with chest (kappa w = 0.63-0.68), or abdominal (kappa w = 0.50-0.78) examinations. However, the frequency of major disagreements (at least one reader reporting "normal" and one reporting "relevant abnormality") was similar for abdominal (11%), chest (12%) and skeletal (10%) radiographs. When the reports were reclassified into only two groups--either significantly abnormal or not--pairs of observers disagreed on 9-10% of skeletal, 11-19% of chest and 8-18% of abdominal cases. The average incidence of errors per observer was estimated to be in the range 3-6%. The magnitude of interobserver variation in plain film reporting is considerable, and must be taken into account when designing assessment techniques and setting quality standards for this activity.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1259/bjr.72.856.10474490

Cites

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cited by

See all 162

Metadata

Authors
Robinson, P. J., Wilson, D., Coral, A., Murphy, A., & Verow, P.
Venue
The British Journal of Radiology
Published
1999-04-01
Volume
72
Issue
856
Pages
323-330
ISSN
  • 0007-1285 (ISSN-L)
  • 1748-880X
OpenAlex
W1990393899
Cited by
162
References
0
FWCI
4.56
Type
journal article
Language
en
Open access
closed

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Variation between experienced observers in the interpretation of accident and emergency radiographs. https://app.cochat.ai/papers/10.1259/bjr.72.856.10474490
The paper
Robinson, P. J., Wilson, D., Coral, A., Murphy, A., & Verow, P. (1999). Variation between experienced observers in the interpretation of accident and emergency radiographs. The British Journal of Radiology. https://doi.org/10.1259/bjr.72.856.10474490

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.