Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 73 of the 74 references it cites were found in a registry or an index.

Accuracy of Electronic Health Record Data for Identifying Stroke Cases in Large-Scale Epidemiological Studies: A Systematic Review from the UK Biobank Stroke Outcomes Group

Open access
Woodfield, Rebecca, Grant, Ian, UK Biobank Stroke Outcomes Group, UK Biobank Follow-Up and Outcomes Working Group, Sudlow, Cathie L. M. · 2015 · PLOS ONE

Abstract

OBJECTIVE: Long-term follow-up of population-based prospective studies is often achieved through linkages to coded regional or national health care data. Our knowledge of the accuracy of such data is incomplete. To inform methods for identifying stroke cases in UK Biobank (a prospective study of 503,000 UK adults recruited in middle-age), we systematically evaluated the accuracy of these data for stroke and its main pathological types (ischaemic stroke, intracerebral haemorrhage, subarachnoid haemorrhage), determining the optimum codes for case identification. METHODS: We sought studies published from 1990-November 2013, which compared coded data from death certificates, hospital admissions or primary care with a reference standard for stroke or its pathological types. We extracted information on a range of study characteristics and assessed study quality with the Quality Assessment of Diagnostic Studies tool (QUADAS-2). To assess accuracy, we extracted data on positive predictive values (PPV) and-where available-on sensitivity, specificity, and negative predictive values (NPV). RESULTS: 37 of 39 eligible studies assessed accuracy of International Classification of Diseases (ICD)-coded hospital or death certificate data. They varied widely in their settings, methods, reporting, quality, and in the choice and accuracy of codes. Although PPVs for stroke and its pathological types ranged from 6-97%, appropriately selected, stroke-specific codes (rather than broad cerebrovascular codes) consistently produced PPVs >70%, and in several studies >90%. The few studies with data on sensitivity, specificity and NPV showed higher sensitivity of hospital versus death certificate data for stroke, with specificity and NPV consistently >96%. Few studies assessed either primary care data or combinations of data sources. CONCLUSIONS: Particular stroke-specific codes can yield high PPVs (>90%) for stroke/stroke types. Inclusion of primary care data and combining data sources should improve accuracy in large epidemiological studies, but there is limited published information about these strategies.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1371/journal.pone.0140533

Cites

73 of 73 references verified0 citation errors · 0 not checkable

Statistics

Figures

Fig 1 International Classification of Diseases (ICD) codes for cerebrovascular disease. * 433: occlusion/stenosis of pre-cerebral arteries with or without infarction. † 434: thrombosis/embolism of cerebral arteries with or without infarction. Codes in blue text denote ICD-9 codes which most closely represent stroke when subdivided using additional coding available in the clinically modified version of ICD-9 (ICD-9-CM) used in North America. In ICD-9-CM, ‘with infarction’ (433.x1, 434.x1) is distinguished from ‘without infarction’ (433.x0, 434.x0). ‡ 436: acute, ill-defined cerebrovascular disease ¶ a pathological term for ischaemic stroke § G46: not a diagnostic code; may be used for the presenting symptoms of either stroke or TIA.
Fig 1 International Classification of Diseases (ICD) codes for cerebrovascular disease. * 433: occlusion/stenosis of pre-cerebral arteries with or without infarction. † 434: thrombosis/embolism of cerebral arteries with or without infarction. Codes in blue text denote ICD-9 codes which most closely represent stroke when subdivided using additional coding available in the clinically modified version of ICD-9 (ICD-9-CM) used in North America. In ICD-9-CM, ‘with infarction’ (433.x1, 434.x1) is distinguished from ‘without infarction’ (433.x0, 434.x0). ‡ 436: acute, ill-defined cerebrovascular disease ¶ a pathological term for ischaemic stroke § G46: not a diagnostic code; may be used for the presenting symptoms of either stroke or TIA.CC BY · PubMed Central
Fig 2 Selection of studies. *Additional studies identified from bibliography screening. †Additional studies identified from review articles and bibliography screening.
Fig 2 Selection of studies. *Additional studies identified from bibliography screening. †Additional studies identified from review articles and bibliography screening.CC BY · PubMed Central
Fig 3 Positive predictive values of codes for stroke. H: hospital data, D: death certificates, H+D: hospital data and death certificates; x = number of coded events confirmed as ‘true cases’ by the reference standard; y = total number of coded events; x/y = PPV. Circles represent PPVs, and horizontal lines denote 95% confidence intervals (CIs). Circle size is proportional to the inverse variance of the PPV. Where more than one result was available for a particular study, the result for the largest number of coded events validated is shown. * Cerebrovascular codes: I60-I69+/-G45 (ICD-10) or 430–438 (ICD-9), unless otherwise specified † Mean PPV (taken from the range published in the study) ‡ Excluding codes 435 (TIA) and 438 (sequelae of cebrovascular disease) § Excluding code 435 (TIA) and including code 342 (hemiplegia and hemiparesis) ¶ Excluding code 435 (TIA) # Stroke-specific codes: 160, 161, 163, 164 (ICD-10), 430, 431, 434, 436 (ICD-9), 430, 431, 433.x1, 434.x1 (ICD-9-CM). ¥ Ischaemic stoke and unspecified stroke codes: I63, I64 (ICD-10), 434, 436 (ICD-9), 433.x1, 434.x1, 436 (ICD-9-CM) **Ischaemic stroke codes:163 (ICD-10), 434 (ICD-9), 433.x1, 434.x1 (ICD-9-CM) †† Haemorrhagic stroke codes:I60, I61 (ICD-10), 430, 431 (ICD-9) ‡‡ Subarachnoid haemorrhage stroke codes:I60 (ICD-10), 430 (ICD-9) ¶¶ Intracerebral haemorrhage stroke codes:I61 (ICD-10), 431 (ICD-9)
Fig 3 Positive predictive values of codes for stroke. H: hospital data, D: death certificates, H+D: hospital data and death certificates; x = number of coded events confirmed as ‘true cases’ by the reference standard; y = total number of coded events; x/y = PPV. Circles represent PPVs, and horizontal lines denote 95% confidence intervals (CIs). Circle size is proportional to the inverse variance of the PPV. Where more than one result was available for a particular study, the result for the largest number of coded events validated is shown. * Cerebrovascular codes: I60-I69+/-G45 (ICD-10) or 430–438 (ICD-9), unless otherwise specified † Mean PPV (taken from the range published in the study) ‡ Excluding codes 435 (TIA) and 438 (sequelae of cebrovascular disease) § Excluding code 435 (TIA) and including code 342 (hemiplegia and hemiparesis) ¶ Excluding code 435 (TIA) # Stroke-specific codes: 160, 161, 163, 164 (ICD-10), 430, 431, 434, 436 (ICD-9), 430, 431, 433.x1, 434.x1 (ICD-9-CM). ¥ Ischaemic stoke and unspecified stroke codes: I63, I64 (ICD-10), 434, 436 (ICD-9), 433.x1, 434.x1, 436 (ICD-9-CM) **Ischaemic stroke codes:163 (ICD-10), 434 (ICD-9), 433.x1, 434.x1 (ICD-9-CM) †† Haemorrhagic stroke codes:I60, I61 (ICD-10), 430, 431 (ICD-9) ‡‡ Subarachnoid haemorrhage stroke codes:I60 (ICD-10), 430 (ICD-9) ¶¶ Intracerebral haemorrhage stroke codes:I61 (ICD-10), 431 (ICD-9)CC BY · PubMed Central
Fig 4 Positive predictive values of codes for ischaemic stroke. H: hospital data, D: death certificates, H+D: hospital data and death certificates; x = number of coded events confirmed as ‘true cases’ by the reference standard; y = total number of coded events; x/y = PPV. Circles represent PPVs, and horizontal lines denote 95% confidence intervals (CIs). Circle size is proportional to the inverse variance of the PPV. Where more than one result was available for a particular study, the result for the largest number of coded events validated is shown. † Mean PPV (taken from the range published in the study) ¥ Ischaemic stoke and unspecified stroke codes: I63, I64 (ICD-10), 434, 436 (ICD-9), 433.x1, 434.x1, 436 (ICD-9-CM) **Ischaemic stroke codes:163 (ICD-10), 434 (ICD-9), 433.x1, 434.x1 (ICD-9-CM)
Fig 4 Positive predictive values of codes for ischaemic stroke. H: hospital data, D: death certificates, H+D: hospital data and death certificates; x = number of coded events confirmed as ‘true cases’ by the reference standard; y = total number of coded events; x/y = PPV. Circles represent PPVs, and horizontal lines denote 95% confidence intervals (CIs). Circle size is proportional to the inverse variance of the PPV. Where more than one result was available for a particular study, the result for the largest number of coded events validated is shown. † Mean PPV (taken from the range published in the study) ¥ Ischaemic stoke and unspecified stroke codes: I63, I64 (ICD-10), 434, 436 (ICD-9), 433.x1, 434.x1, 436 (ICD-9-CM) **Ischaemic stroke codes:163 (ICD-10), 434 (ICD-9), 433.x1, 434.x1 (ICD-9-CM)CC BY · PubMed Central
Fig 5 Positive predictive values of codes for haemorrhagic stroke. H: hospital data, D: death certificates, H+D: hospital data and death certificates; x = number of coded events confirmed as ‘true cases’ by the reference standard; y = total number of coded events; x/y = PPV. Circles represent PPVs, and horizontal lines denote 95% confidence intervals (CIs). Circle size is proportional to the inverse variance of the PPV. Where more than one result was available for a particular study, the result for the largest number of coded events validated is shown. † Mean PPV (taken from the range published in the study) †† Haemorrhagic stroke codes:I60, I61 (ICD-10), 430, 431 (ICD-9) ‡‡ Subarachnoid haemorrhage stroke codes:I60 (ICD-10), 430 (ICD-9) ¶¶ Intracerebral haemorrhage stroke codes:I61 (ICD-10), 431 (ICD-9)
Fig 5 Positive predictive values of codes for haemorrhagic stroke. H: hospital data, D: death certificates, H+D: hospital data and death certificates; x = number of coded events confirmed as ‘true cases’ by the reference standard; y = total number of coded events; x/y = PPV. Circles represent PPVs, and horizontal lines denote 95% confidence intervals (CIs). Circle size is proportional to the inverse variance of the PPV. Where more than one result was available for a particular study, the result for the largest number of coded events validated is shown. † Mean PPV (taken from the range published in the study) †† Haemorrhagic stroke codes:I60, I61 (ICD-10), 430, 431 (ICD-9) ‡‡ Subarachnoid haemorrhage stroke codes:I60 (ICD-10), 430 (ICD-9) ¶¶ Intracerebral haemorrhage stroke codes:I61 (ICD-10), 431 (ICD-9)CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 74 references

Research works printed but not linked: 4

  1. N Mayo, 1993, Accuracy of Hospital discharge coding for stroke, Can J Cardiol, 9, 121D
  2. J Mant, 1997, How good is routine information? Validation of coding for acute stroke in Oxford hospitals, Health Trends, 29, 96
  3. B Panayiotou, 1993, The accuracy of diagnostic coding of cerebrovascular disease, Medical Audit News, 3, 153
  4. JM Ferro, 1996, Diagnosis of Transient Ischaemic Attack by the non-neurologist. A validation study, Stroke, 27, 2225, 10.1161/01.STR.27.12.2225 · DOI · Paper page

Cited by

See all 146

Metadata

Authors
Woodfield, R., Grant, I., UK Biobank Stroke Outcomes Group, UK Biobank Follow-Up and Outcomes Working Group, & Sudlow, C. L. M.
Affiliations
  • University of Edinburgh (GB)
  • National Health Service Scotland (GB)
  • UK Biobank (GB)
Corresponding author
Sudlow, Cathie L. M.
Venue
PLOS ONE
Published
2015-10-23
Volume
10
Issue
10
Pages
e0140533
ISSN
1932-6203 (ISSN-L)
OpenAlex
W2114176457
Cited by
145
References
74
Citations by year
2026: 13 · 2025: 13 · 2024: 23 · 2023: 16 · 2022: 11 · 2021: 18 · 2020: 8 · 2019: 16 · 2018: 13 · 2017: 8 · 2016: 6
FWCI
0.99
Type
journal article
Language
en
Open access
Locations
  • PLoS ONE (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • Figshare (submittedVersion, cc-by)
  • Edinburgh Research Explorer (University of Edinburgh) (submittedVersion, cc-by)
Funders
  • University of Dundee
  • Wellcome Trust (093707)
  • Cancer Research UK
  • University of Cambridge
  • University College London
  • University of Oxford
  • University of Nottingham
  • Cardiff University
  • Swansea University
  • Moorfields Eye Hospital NHS Foundation Trust
  • Medical Research Council (MR/K007017/1)
  • Menzies Centre for Australian Studies, King's College London, University of London
Topics
  • Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
  • Health Sciences › Medicine › Clinical Neurology › Acute Ischemic Stroke Management
Keywords
stroke, electronic health records, case finding, data linkage, ICD codes, ischemic stroke, intracerebral hemorrhage, subarachnoid hemorrhage, positive predictive value, hospitalization, death certificates, primary care data, UK Biobank, long-term follow-up
MeSH terms
Adult, Death Certificates, United Kingdom, Hospitalization, Humans, Middle Aged, Reproducibility of Results, Stroke, International Classification of Diseases, Electronic Health Records

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Accuracy of Electronic Health Record Data for Identifying Stroke Cases in Large-Scale Epidemiological Studies: A Systematic Review from the UK Biobank Stroke Outcomes Group. https://app.cochat.ai/papers/10.1371/journal.pone.0140533
The paper
Woodfield, R., Grant, I., UK Biobank Stroke Outcomes Group, UK Biobank Follow-Up and Outcomes Working Group, & Sudlow, C. L. M. (2015). Accuracy of Electronic Health Record Data for Identifying Stroke Cases in Large-Scale Epidemiological Studies: A Systematic Review from the UK Biobank Stroke Outcomes Group. PLOS ONE. https://doi.org/10.1371/journal.pone.0140533

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.