The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
Assessment of the reproducibility of clinical coding in routinely collected hospital activitydata: a study in two hospitals
Abstract
BACKGROUND: The aim of the study was to assess the reproducibility of clinical coding in two National Health Service hospitals within North West Thames region. METHODS: A retrospective audit was carried out, of clinical coding in hospital episode statistics, involving comparison of the codes assigned by local staff with those assigned by members of an external team unaware of the locally assigned codes. Where local and external coders disagreed, the records were reviewed for a third time by a further independent coder. The subjects were a random sample of 1607 non-maternity, non-psychiatric admissions occurring between 1991 and 1993, stratified for year and type of disease (asthma, diabetes, appendicitis, fractured femur and 'general'--a random selection of any diagnoses). The main outcome measures were the levels of exact agreement between local and external teams over codes for main diagnosis and procedure, and the level of approximate agreement (over the first three characters of the ICD-9 code for diagnosis and the letter and first two digits of the OPCS-4 code for procedure). For disagreements, the outcome measure was the level of agreement between the 'third' coder and the local and external coders. RESULTS: For the main diagnosis in the 'general' group at hospital A, internal and external coders agreed exactly in 43 per cent of the admissions examined and agreed 'approximately' in 55 per cent (kappa = 0.54). For hospital B the corresponding figures were 60 per cent and 72 per cent (kappa = 0.72). Approximate agreement was higher for the specific diseases considered, particularly for asthma (A: 86 per cent; B: 91 per cent) and fractured femur (A: 84 per cent; B: 89 per cent). For the main procedure at hospital A, there was exact agreement for 58 per cent and approximate agreement for 70 per cent (kappa = 0.66). For hospital B, the corresponding figures were 76 per cent and 83 per cent (kappa = 0.80). In cases of disagreement over the first three digits of the ICD-9 code for main diagnosis, the third coder disagreed with both local and external coders in 53 per cent at hospital A and 38 per cent at hospital B. Agreement was slightly better for discharges in 1992-1993 than in 1991-1992. CONCLUSIONS: The full clinical codes in NHS hospital episode statistics (HES) data should be treated with caution. The first three characters of ICD-9 codes for diagnoses and the OPCS-4 codes for procedures were more reliable. For some specific conditions such as asthma and fractured femur, reliability of the first three characters is much higher (for example, 86 per cent and 91 per cent for asthma in the two hospitals), but for the full codes can be worse. Secondary diagnoses or comorbidities may be significantly undercoded. A higher level of agreement in 1992-1993 than in 1991-1992 suggests that coding may be improving.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Quality of data in the Manchester orthopaedic database.
Barrie, J. L., & Marsh, D. R. (1992) · BMJ · doi:10.1136/bmj.304.6820.159 · Cited by 74
Cited by
Systematic review of discharge coding accuracy
Burns, E. M., Rigby, E., Mamidanna, R., Bottle, A., Aylin, P., Ziprin, P., & Faiz, O. D. (2012) · Journal of Public Health · doi:10.1093/pubmed/fdr054 · Cited by 690
Incidence and costs of unintentional falls in older people in the United Kingdom
Scuffham, P., Chaplin, S., & Legood, R. (2003) · Journal of Epidemiology and Community Health · doi:10.1136/jech.57.9.740 · Cited by 534
Smolina, K., Wright, F. L., Rayner, M., & Goldacre, M. J. (2012) · BMJ · doi:10.1136/bmj.d8059 · Cited by 384
A systematic review of discharge coding accuracy
Campbell, S. E., Campbell, M. K., Grimshaw, J. M., & Walker, A. E. (2001) · Journal of Public Health · doi:10.1093/pubmed/23.3.205 · Cited by 299
Eclampsia in the United Kingdom 2005
Knight, M. (2007) · BJOG: An International Journal of Obstetrics & Gynaecology · doi:10.1111/j.1471-0528.2007.01423.x · Cited by 275
Metadata
- Authors
- Dixon, J., Sanderson, C., Elliott, P., Walls, P., Jones, J., & Petticrew, M.
- Venue
- Journal of Public Health
- Publisher
- Oxford University Press (OUP)
- Published
- 1998-03-01
- Volume
- 20
- Issue
- 1
- Pages
- 63-69
- ISSN
- 0943-1853 (ISSN-L)
- 1741-3842
- 1741-3850
- OpenAlex
- W2135929873
- Cited by
- 159
- References
- 1
- FWCI
- 12.56
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Assessment of the reproducibility of clinical coding in routinely collected hospital activitydata: a study in two hospitals. https://app.cochat.ai/papers/10.1093/oxfordjournals.pubmed.a024721
- The paper
- Dixon, J., Sanderson, C., Elliott, P., Walls, P., Jones, J., & Petticrew, M. (1998). Assessment of the reproducibility of clinical coding in routinely collected hospital activitydata: a study in two hospitals. Journal of Public Health. https://doi.org/10.1093/oxfordjournals.pubmed.a024721
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.