The DOI matches its Crossref record; 73 of the 74 references it cites were found in a registry or an index.
Accuracy of Electronic Health Record Data for Identifying Stroke Cases in Large-Scale Epidemiological Studies: A Systematic Review from the UK Biobank Stroke Outcomes Group
Open accessAbstract
OBJECTIVE: Long-term follow-up of population-based prospective studies is often achieved through linkages to coded regional or national health care data. Our knowledge of the accuracy of such data is incomplete. To inform methods for identifying stroke cases in UK Biobank (a prospective study of 503,000 UK adults recruited in middle-age), we systematically evaluated the accuracy of these data for stroke and its main pathological types (ischaemic stroke, intracerebral haemorrhage, subarachnoid haemorrhage), determining the optimum codes for case identification. METHODS: We sought studies published from 1990-November 2013, which compared coded data from death certificates, hospital admissions or primary care with a reference standard for stroke or its pathological types. We extracted information on a range of study characteristics and assessed study quality with the Quality Assessment of Diagnostic Studies tool (QUADAS-2). To assess accuracy, we extracted data on positive predictive values (PPV) and-where available-on sensitivity, specificity, and negative predictive values (NPV). RESULTS: 37 of 39 eligible studies assessed accuracy of International Classification of Diseases (ICD)-coded hospital or death certificate data. They varied widely in their settings, methods, reporting, quality, and in the choice and accuracy of codes. Although PPVs for stroke and its pathological types ranged from 6-97%, appropriately selected, stroke-specific codes (rather than broad cerebrovascular codes) consistently produced PPVs >70%, and in several studies >90%. The few studies with data on sensitivity, specificity and NPV showed higher sensitivity of hospital versus death certificate data for stroke, with specificity and NPV consistently >96%. Few studies assessed either primary care data or combinations of data sources. CONCLUSIONS: Particular stroke-specific codes can yield high PPVs (>90%) for stroke/stroke types. Inclusion of primary care data and combining data sources should improve accuracy in large epidemiological studies, but there is limited published information about these strategies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures





Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This large biobank has collected multiple layers of data from participants, including sociodemographic and lifestyle information, physical measurements, biological samples, 12-lead electrocardiograms and EHR data 82 .”
From Multimodal biomedical AI (2022) · cites this paper as [82]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies
Whiting, P. F., Rutjes, A. W. S., Westwood, M. E., Mallett, S., Deeks, J. J., Reitsma, J. B., Leeflang, M. M. G., Sterne, J. A. C., Bossuyt, P. M. M., & the QUADAS-2 Group* (2011) · Annals of Internal Medicine · doi:10.7326/0003-4819-155-8-201110180-00009 · Cited by 14,199
Lozano, R., Naghavi, M., Foreman, K., Lim, S., Shibuya, K., Aboyans, V., Abraham, J., Adair, T., Aggarwal, R., Ahn, S. Y., et al. (2012) · The Lancet · doi:10.1016/s0140-6736(12)61728-0 · Cited by 14,070
Sudlow, C., Gallacher, J., Allen, N., Beral, V., Burton, P., Danesh, J., Downey, P., Elliott, P., Green, J., Landray, M., et al. (2015) · PLOS Medicine · doi:10.1371/journal.pmed.1001779 · Cited by 12,728 · cited 1×
“By 2017, around 5,000 incident strokes are expected to have occurred among UK Biobank participants [12].”
BackgroundSelf-citationInterval Estimation for a Binomial Proportion
Brown, L. D., Cai, T. T., & DasGupta, A. (2001) · Statistical Science · doi:10.1214/ss/1009213286 · Cited by 3,538 · cited 1×
“We calculated 95% confidence intervals for PPV, sensitivity, specificity and NPV values in Stata (version 12) using the Wilson method for binomial proportions [26].”
MethodO'Donnell, M. J., Xavier, D., Liu, L., Zhang, H., Chin, S. L., Rao-Melacini, P., Rangarajan, S., Islam, S., Pais, P., McQueen, M. J., et al. (2010) · The Lancet · doi:10.1016/s0140-6736(10)60834-3 · Cited by 3,448
Experience from a multicentre stroke register: a preliminary report.
Hatano, S. (1976) · Europe PMC (PubMed Central) · Cited by 1,526
Validation and validity of diagnoses in the General Practice Research Database: a systematic review
Herrett, E., Thomas, S. L., Schoonen, W. M., Smeeth, L., & Hall, A. J. (2010) · British Journal of Clinical Pharmacology · doi:10.1111/j.1365-2125.2009.03537.x · Cited by 1,109
Rothwell, P., Coull, A., Giles, M., Howard, S., Silver, L., Bull, L., Gutnikov, S., Edwards, P., Mant, D., Sackley, C., et al. (2004) · The Lancet · doi:10.1016/s0140-6736(04)16405-2 · Cited by 1,094
Transient Ischemic Attack — Proposal for a New Definition
Albers, G. W., Caplan, L. R., Easton, J. D., Fayad, P. B., Mohr, J. P., Saver, J. L., & Sherman, D. G. (2002) · New England Journal of Medicine · doi:10.1056/nejmsb020987 · Cited by 840 · cited 1×
“[16] The more recent, alternative ‘tissue-based’ definition relies on the presence of brain infarction to diagnose stroke, irrespective of symptom duration (<24hours).[20] Accurate diagnosis of brain infarction depends on the availability, choice, and timing of brain imaging, which may vary between different centres.”
BackgroundRosamond, W. D., Folsom, A. R., Chambless, L. E., Wang, C.-H., McGovern, P. G., Howard, G., Copper, L. S., & Shahar, E. (1999) · Stroke · doi:10.1161/01.str.30.4.736 · Cited by 811
Research works printed but not linked: 4
- N Mayo, 1993, Accuracy of Hospital discharge coding for stroke, Can J Cardiol, 9, 121D
- J Mant, 1997, How good is routine information? Validation of coding for acute stroke in Oxford hospitals, Health Trends, 29, 96
- B Panayiotou, 1993, The accuracy of diagnostic coding of cerebrovascular disease, Medical Audit News, 3, 153
- JM Ferro, 1996, Diagnosis of Transient Ischaemic Attack by the non-neurologist. A validation study, Stroke, 27, 2225, 10.1161/01.STR.27.12.2225 · DOI · Paper page
Cited by
Acosta, J. N., Falcone, G. J., Rajpurkar, P., & Topol, E. J. (2022) · Nature Medicine · doi:10.1038/s41591-022-01981-2 · Cited by 1,365
Said, M. A., Verweij, N., & van der Harst, P. (2018) · JAMA Cardiology · doi:10.1001/jamacardio.2018.1717 · Cited by 641
Biobank, O. B. O. D. P. U. A. U., Wilkinson, T., Schnier, C., Bush, K., Rannikmäe, K., Henshall, D. E., Lerpiniere, C., Allen, N. E., Flaig, R., Russ, T. C., et al. (2019) · European Journal of Epidemiology · doi:10.1007/s10654-019-00499-1 · Cited by 452
Self-citationBanks, E., Joshy, G., Korda, R. J., Stavreski, B., Soga, K., Egger, S., Day, C., Clarke, N. E., Lewington, S., & Lopez, A. D. (2019) · BMC Medicine · doi:10.1186/s12916-019-1351-4 · Cited by 319
Descatha, A., Sembajwe, G. N., Pega, F., Ujita, Y., Baer, M., Boccuni, F., Tecco, C. D., Duret, C., Evanoff, B., Gagliardi, D., et al. (2020) · Environment International · doi:10.1016/j.envint.2020.105746 · Cited by 167
“Supporting our assessment of low risk, Kivimaki et al. (2015a) found no difference in their sensitivity analyses between self-reported and administrative records, which was similar to Wong et al. (2019), and the fair accuracy reported by other studies (Woodfield et al., 2015a, 2015b).”
BackgroundResult
Metadata
- Authors
- Woodfield, R., Grant, I., UK Biobank Stroke Outcomes Group, UK Biobank Follow-Up and Outcomes Working Group, & Sudlow, C. L. M.
- Affiliations
- University of Edinburgh (GB)
- National Health Service Scotland (GB)
- UK Biobank (GB)
- Corresponding author
- Sudlow, Cathie L. M.
- ORCID
- Sudlow, Cathie L. M.
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2015-10-23
- Volume
- 10
- Issue
- 10
- Pages
- e0140533
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC4619732
- OpenAlex
- W2114176457
- Semantic Scholar
- 8ea6f3c77795ef6e5a1bf43993cf0ff629cad481
- Cited by
- 145
- References
- 74
- Citations by year
- 2026: 13 · 2025: 13 · 2024: 23 · 2023: 16 · 2022: 11 · 2021: 18 · 2020: 8 · 2019: 16 · 2018: 13 · 2017: 8 · 2016: 6
- FWCI
- 0.99
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Edinburgh Research Explorer (University of Edinburgh) (submittedVersion, cc-by)
- Funders
- University of Dundee
- Wellcome Trust (093707)
- Cancer Research UK
- University of Cambridge
- University College London
- University of Oxford
- University of Nottingham
- Cardiff University
- Swansea University
- Moorfields Eye Hospital NHS Foundation Trust
- Medical Research Council (MR/K007017/1)
- Menzies Centre for Australian Studies, King's College London, University of London
- Topics
- Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Health Sciences › Medicine › Clinical Neurology › Acute Ischemic Stroke Management
- Keywords
- stroke, electronic health records, case finding, data linkage, ICD codes, ischemic stroke, intracerebral hemorrhage, subarachnoid hemorrhage, positive predictive value, hospitalization, death certificates, primary care data, UK Biobank, long-term follow-up
- MeSH terms
- Adult, Death Certificates, United Kingdom, Hospitalization, Humans, Middle Aged, Reproducibility of Results, Stroke, International Classification of Diseases, Electronic Health Records
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Accuracy of Electronic Health Record Data for Identifying Stroke Cases in Large-Scale Epidemiological Studies: A Systematic Review from the UK Biobank Stroke Outcomes Group. https://app.cochat.ai/papers/10.1371/journal.pone.0140533
- The paper
- Woodfield, R., Grant, I., UK Biobank Stroke Outcomes Group, UK Biobank Follow-Up and Outcomes Working Group, & Sudlow, C. L. M. (2015). Accuracy of Electronic Health Record Data for Identifying Stroke Cases in Large-Scale Epidemiological Studies: A Systematic Review from the UK Biobank Stroke Outcomes Group. PLOS ONE. https://doi.org/10.1371/journal.pone.0140533
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.