Accuracy of Electronic Health Record Data for Identifying Stroke Cases in Large-Scale Epidemiological Studies: A Systematic Review from the UK Biobank Stroke Outcomes Group
Open accessThe DOI matches its Crossref record; 73 of the 74 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: Long-term follow-up of population-based prospective studies is often achieved through linkages to coded regional or national health care data. Our knowledge of the accuracy of such data is incomplete. To inform methods for identifying stroke cases in UK Biobank (a prospective study of 503,000 UK adults recruited in middle-age), we systematically evaluated the accuracy of these data for stroke and its main pathological types (ischaemic stroke, intracerebral haemorrhage, subarachnoid haemorrhage), determining the optimum codes for case identification. METHODS: We sought studies published from 1990-November 2013, which compared coded data from death certificates, hospital admissions or primary care with a reference standard for stroke or its pathological types. We extracted information on a range of study characteristics and assessed study quality with the Quality Assessment of Diagnostic Studies tool (QUADAS-2). To assess accuracy, we extracted data on positive predictive values (PPV) and-where available-on sensitivity, specificity, and negative predictive values (NPV). RESULTS: 37 of 39 eligible studies assessed accuracy of International Classification of Diseases (ICD)-coded hospital or death certificate data. They varied widely in their settings, methods, reporting, quality, and in the choice and accuracy of codes. Although PPVs for stroke and its pathological types ranged from 6-97%, appropriately selected, stroke-specific codes (rather than broad cerebrovascular codes) consistently produced PPVs >70%, and in several studies >90%. The few studies with data on sensitivity, specificity and NPV showed higher sensitivity of hospital versus death certificate data for stroke, with specificity and NPV consistently >96%. Few studies assessed either primary care data or combinations of data sources. CONCLUSIONS: Particular stroke-specific codes can yield high PPVs (>90%) for stroke/stroke types. Inclusion of primary care data and combining data sources should improve accuracy in large epidemiological studies, but there is limited published information about these strategies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures





Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This large biobank has collected multiple layers of data from participants, including sociodemographic and lifestyle information, physical measurements, biological samples, 12-lead electrocardiograms and EHR data 82 .”
From Multimodal biomedical AI (2022) · cites this paper as [82]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies
Whiting, P. F., Rutjes, A. W. S., Westwood, M. E., Mallett, S., Deeks, J. J., Reitsma, J. B., Leeflang, M. M. G., Sterne, J. A. C., Bossuyt, P. M. M., & the QUADAS-2 Group* (2011) · Annals of Internal Medicine · doi:10.7326/0003-4819-155-8-201110180-00009 · Cited by 14,199
Lozano, R., Naghavi, M., Foreman, K., Lim, S., Shibuya, K., Aboyans, V., Abraham, J., Adair, T., Aggarwal, R., Ahn, S. Y., et al. (2012) · The Lancet · doi:10.1016/s0140-6736(12)61728-0 · Cited by 14,070
Sudlow, C., Gallacher, J., Allen, N., Beral, V., Burton, P., Danesh, J., Downey, P., Elliott, P., Green, J., Landray, M., et al. (2015) · PLOS Medicine · doi:10.1371/journal.pmed.1001779 · Cited by 12,728 · cited 1×
“By 2017, around 5,000 incident strokes are expected to have occurred among UK Biobank participants [12].”
BackgroundSelf-citationInterval Estimation for a Binomial Proportion
Brown, L. D., Cai, T. T., & DasGupta, A. (2001) · Statistical Science · doi:10.1214/ss/1009213286 · Cited by 3,538 · cited 1×
“We calculated 95% confidence intervals for PPV, sensitivity, specificity and NPV values in Stata (version 12) using the Wilson method for binomial proportions [26].”
MethodO'Donnell, M. J., Xavier, D., Liu, L., Zhang, H., Chin, S. L., Rao-Melacini, P., Rangarajan, S., Islam, S., Pais, P., McQueen, M. J., et al. (2010) · The Lancet · doi:10.1016/s0140-6736(10)60834-3 · Cited by 3,448
Experience from a multicentre stroke register: a preliminary report.
Hatano, S. (1976) · Europe PMC (PubMed Central) · Cited by 1,526
Validation and validity of diagnoses in the General Practice Research Database: a systematic review
Herrett, E., Thomas, S. L., Schoonen, W. M., Smeeth, L., & Hall, A. J. (2010) · British Journal of Clinical Pharmacology · doi:10.1111/j.1365-2125.2009.03537.x · Cited by 1,109
Rothwell, P., Coull, A., Giles, M., Howard, S., Silver, L., Bull, L., Gutnikov, S., Edwards, P., Mant, D., Sackley, C., et al. (2004) · The Lancet · doi:10.1016/s0140-6736(04)16405-2 · Cited by 1,094
Transient Ischemic Attack — Proposal for a New Definition
Albers, G. W., Caplan, L. R., Easton, J. D., Fayad, P. B., Mohr, J. P., Saver, J. L., & Sherman, D. G. (2002) · New England Journal of Medicine · doi:10.1056/nejmsb020987 · Cited by 840 · cited 1×
“[16] The more recent, alternative ‘tissue-based’ definition relies on the presence of brain infarction to diagnose stroke, irrespective of symptom duration (<24hours).[20] Accurate diagnosis of brain infarction depends on the availability, choice, and timing of brain imaging, which may vary between different centres.”
BackgroundRosamond, W. D., Folsom, A. R., Chambless, L. E., Wang, C.-H., McGovern, P. G., Howard, G., Copper, L. S., & Shahar, E. (1999) · Stroke · doi:10.1161/01.str.30.4.736 · Cited by 811
Research works printed but not linked: 4
- Mayo N, Danys I, Carlton J, Scott S. Accuracy of Hospital discharge coding for stroke. Can J Cardiol 1993; 9: 121D– 123D.
- Mant J, Mant F, Winner S. How good is routine information? Validation of coding for acute stroke in Oxford hospitals. Health Trends 1997; 29: 96– 99.
- Panayiotou B, Fotherby M, Potter J, Castleden C. The accuracy of diagnostic coding of cerebrovascular disease. Medical Audit News 1993; 3: 153– 155.
- Ferro JM, Falcao I, Rodrigues G, Canhao P, Melo TP, Falcao F, et al Diagnosis of Transient Ischaemic Attack by the non-neurologist. A validation study. Stroke. 1996; 27: 2225– 2229. 8969785 · DOI · Paper page
Cited by
Items 101–146 of 146
Bias of Inaccurate Disease Mentions in Electronic Health Record-based Phenotyping
Kagawa, R., Shinohara, E., Imai, T., Kawazoe, Y., & Ohe, K. (2018) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2018.12.004 · Cited by 5
Zeynalova, S., Worringen, P., Bassler, S., Martin, A., Czech, K., Greulich, L., Reusche, M., Enders, U., Reyes, N., Yahiaoui‐Doktor, M., et al. (2025) · Archives of Public Health · doi:10.1186/s13690-025-01606-3 · Cited by 4
Huo, S., Rivier, C. A., Clocchiatti‐Tuozzo, S., Renedo, D. B., Petersen, N., de Havenon, A., Meeker, D., Zhao, H., Ohno-Machado, L., Sheth, K. N., et al. (2025) · Annals of Neurology · doi:10.1002/ana.78009 · Cited by 4
Suicide After Stroke in the United States Veteran Health Administration Population
Wyrwa, J. M., Shirel, T., Hostetter, T. A., Schneider, A. L., Hoffmire, C. A., Stearns‐Yoder, K. A., Forster, J. E., Odom, N. E., & Brenner, L. A. (2021) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2021.03.009 · Cited by 4
Hau, C., Woods, P. A., Guski, A. S., Raju, S. I., Zhu, L., Alba, P. R., Cushman, W. C., Glassman, P. A., Ishani, A., Taylor, A. A., et al. (2024) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2024.104587 · Cited by 5
Polygenic Risk of Epilepsy and Post-Stroke EpilepsyPreprint
Rivier, C. A., Clocchiatti‐Tuozzo, S., Misra, S., Zelano, J., Mazumder, R., Sansing, L. H., de Havenon, A., Hirsch, L. J., Liebeskind, D. S., Gilmore, E. J., et al. (2023) · medRxiv · doi:10.1101/2023.09.18.23295739 · Cited by 4
“Within the UKB, stroke diagnoses were obtained through a validated diagnostic algorithm combining baseline health surveys, electronic health records, and death registries.(20) Diagnoses of TIA and epilepsy were made using the corresponding International Statistical Classification of Diseases and Related Health Problem…”
Swallow, D. M. A., & Counsell, C. E. (2024) · Journal of Neurology · doi:10.1007/s00415-024-12280-w · Cited by 3
“While coding accuracy has been reported for other neurological disorders [5, 15], including PD and parkinsonism more broadly [16], to our knowledge this is the first study to explore the accuracy of individual ICD-10 diagnostic codes for PSP and CBS specifically.”
BackgroundDing, X., Meng, Y., Xiang, L., & Boden-Albala, B. M. (2024) · Discover Public Health · doi:10.1186/s12982-024-00199-6 · Cited by 8
“The primary outcome of interest was stroke recurrence within 30 days following the initial stroke diagnosis (ICD-10 I60, I61, I63, I64, G45) [25].”
Development and Validation of Novel Residual Risk Scores for Patients With ASCVD
Mineeva, O., Li, C., Giulianini, F., Häfliger, S., Bubes, V. Y., Rätsch, G., Mora, S., & Demler, O. (2025) · JACC Advances · doi:10.1016/j.jacadv.2025.102162 · Cited by 3
Davidson, J. A., Banerjee, A., Muzambi, R., Smeeth, L. L., & Warren‐Gash, C. (2019) · BMJ Open · doi:10.1136/bmjopen-2019-031373 · Cited by 4
Jahani, M. A., Mahmoudi, G., Nikbakht, H., Farhadi, Z., & Mousavi, R. (2023) · PLoS ONE · doi:10.1371/journal.pone.0291139 · Cited by 2
Powell, E. M., Gungabissoon, U., Tazare, J., Smeeth, L. L., Baptiste, P. J., Hammad, T. M. B., Wong, A. Y. S., Douglas, I., & Wing, K. (2024) · PLoS Medicine · doi:10.1371/journal.pmed.1004377 · Cited by 4
Lipoprotein(a) and residual cardiovascular risk in statin-treated patients
Oftadeh, S.-L., Pütz, A., Jacobsen, M., Balfanz, P., Marx, N., Brandts, J., Müller‐Wieland, D., & Verket, M. (2026) · European Journal of Preventive Cardiology · doi:10.1093/eurjpc/zwag296 · Cited by 3
Nighttime light exposure and cardiac structure and function
Dai, J., Dai, W., Heianza, Y., & Qi, L. (2026) · European Heart Journal · doi:10.1093/eurheartj/ehag563 · Cited by 4
Association between deep neural network-derived electrocardiographic-age and incident stroke
Leung, R. A., Wang, B., Gottbrecht, M. F., Doerr, A., Marya, N. B., Soni, A., McManus, D. D., & Lin, H. (2024) · Frontiers in Cardiovascular Medicine · doi:10.3389/fcvm.2024.1368094 · Cited by 4
Ali, M., Hussain, M., Mushtaq, M., Ali, A., & Zaib, H. (2024) · Cureus · doi:10.7759/cureus.65625 · Cited by 2
“In the United States, up to 33% of discharge summaries remain deficient in vital patient information [6], while in Europe, these figures soar to a shocking 40% [7].”
BackgroundLing, Y., Cheng, H., Huang, X., Yuan, S., Tan, S., Tang, Y., Bai, Z., Li, X., Chen, J., Xu, A., et al. (2025) · International Journal of Stroke · doi:10.1177/17474930251359776 · Cited by 5
“19,20 The follow-up duration extended from the baseline data until the earliest occurrence of stroke diagnosis, death, loss to follow-up, or the last collection date (16 July 2023).”
Simpson, B. H., Reith, D. M., Medlicott, N. J., & Smith, A. J. (2019) · TH Open · doi:10.1055/s-0039-1693486 · Cited by 2
Yang, A., Kamien, S., Davoudi, A., Hwang, S., Gandhi, M., Urbanowicz, R. J., & Mowery, D. L. (2024) · Studies in health technology and informatics · doi:10.3233/shti231039 · Cited by 1
Schmidt, R., Huber, C., Pelz, J. O., Claßen, J., & Michalski, D. (2025) · Neurological Research and Practice · doi:10.1186/s42466-025-00404-0 · Cited by 1
“Due to prior validation studies indicating high sensitivity for capturing IS when using ICD-10 I63 and I64 [18–20], both codes were combined under the IS category.”
Kelly, R. K., Harris, K., Muntner, P., & Woodward, M. (2026) · Journal of the American Heart Association · doi:10.1161/jaha.125.045533 · Cited by 3
Rioux, B., Chong, M., Walker, R. M., McGlasson, S. L., Rannikmäe, K., McCartney, D. L., McCabe, J. J., Brown, R. B., Crow, Y. J., Hunt, D. P. J., et al. (2023) · Wellcome Open Research · doi:10.12688/wellcomeopenres.20385.1 · Cited by 1
“Stroke diagnoses from hospital and death 253 registries have a high sensitivity (point estimate range: 88-94%) and specificity (>99%) [45].”
BackgroundPhenotyping with Positive Unlabelled Learning for Genome-Wide Association Studies
Vauvelle, A., Tomlinson, H., Sim, A., & Denaxas, S. (2022) · Studies in computational intelligence · doi:10.1007/978-3-031-14771-5_9 · Cited by 1
Tschiderer, L., Peters, S. A. E., van der Schouw, Y. T., van Westing, A. C., Tong, T. Y. N., Willeit, P., Seekircher, L., Moreno‐Iribas, C., Huerta, J. M., Crous‐Bou, M., et al. (2023) · medRxiv · doi:10.1101/2023.02.08.23285676 · Cited by 1
Deshpande, C. G. (2016) · Digital Commons - URI (University of Rhode Island) · doi:10.23860/diss-deshpande-chinmay-2016
Poorthuis, M. H. F. (2021) · Utrecht University Repository (Utrecht University) · doi:10.33540/79
Han, X., Zeng, Y., Shang, Y., Hu, Y., Hou, C., Yang, H., Chen, W., Ying, Z., Sun, Y., Qu, Y., et al. (2021) · medRxiv · doi:10.1101/2021.09.28.21264283
“The 147 inpatient diagnosis of CVDs in UK Biobank has been validated, showing a satisfactory 148 accuracy (i.e., PPV= 72% for coronary heart disease and >90% for stroke(Kivimaki et al., 149 2017; Woodfield et al., 2015)).”
MethodSilent Brain Infarction: A Missed Opportunity for Prevention (Preprint)Preprint
Tsadok, M. A., Gilutz, H., Streifler, J. Y., Benbenishty, G., Man, N., Makori, A., Feldman, B., & Balicer, R. D. (2020) · doi:10.2196/preprints.18270 · Cited by 1
Han, X., Zeng, Y., Shang, Y., Hu, Y., Hou, C., Yang, H., Chen, W., Ying, Z., Sun, Y., Qu, Y., et al. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4201399
Moon, S., Yang, Y. S., Kimm, H., Jung, K. J., Lee, J., Jee, S. H., Lee, S., Kim, S. Y., & Nam, C. M. (2023) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph20064712 · Cited by 1
Rioux, B., Chong, M., Walker, R. M., McGlasson, S. L., Rannikmäe, K., McCartney, D. L., McCabe, J. J., Brown, R. B., Crow, Y. J., Hunt, D. P. J., et al. (2023) · medRxiv · doi:10.1101/2023.10.12.23296935
Blasi, C. D., Nobile, F., Settembrini, A. M., Stafoggia, M., Davoli, M., Michelozzi, P., Renzi, M., & Mannucci, P. M. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4857480
Ramchand, S., & Xie, X. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-67278-1_3
Kianersi, S., Potts, K. S., Wang, H.-M., Sofer, T., Noordam, R., Rutter, M. K., Rexrode, K. M., Redline, S., & Huang, T.-Y. (2025) · Research Square · doi:10.21203/rs.3.rs-6718332/v1 · Cited by 2
“…the PPVs for identifying stroke or its major pathological types from hospital and death registry data were at least 66%, validated against reference standard data sources (e.g., reviews by a specialist physician), though the accuracy of self-reported data was lower and inconsistent (40, 42, 43).”
Kelly, R. K., Tong, T. Y. N., Watling, C. Z., Reynolds, A., Piernas, C., Schmidt, J. A., Papier, K., Carter, J. L., Key, T. J., & Perez‐Cornago, A. (2024) · Figshare · doi:10.6084/m9.figshare.26564460
Nimmo, A., Steenkamp, R., Ravanan, R., & Taylor, D. M. (2021) · Figshare · doi:10.6084/m9.figshare.14234772
Genetic evidence for the beneficial effect of greater fat-free mass on cardiometabolic healthPreprint
Jiang, X., García‐Ureña, M., Cunha, C., Romero-Lado, M. J., Sørensen, T. I. A., & Kilpeläinen, T. O. (2025) · medRxiv · doi:10.64898/2025.12.02.25341439
Kimura, M., Saito, A., Doi, S., & Suzuki, T. (2026) · International Conference on Software and Information Engineering (ICSIE) · doi:10.1145/3789595.3789614
“…challenge is not unique to MID-NET ® ; systematic reviews of administrative data have consistently shown that while ICD-code-based algorithms for stroke often achieve high positive predictive values, their sensitivity varies widely, potentially leading to the under-identification of cases [4, 5].”
Prognosis of stroke subtypes in whole population health systems data: a matched cohort studyPreprint
Hosking, A., Iveson, M. H., Sherlock, L., Mukherjee, M., Grover, C., Alex, B., Parepalli, S. A., Mair, G., Doubal, F., Whalley, H. C., et al. (2026) · medRxiv · doi:10.64898/2026.04.17.26351150
Moura, L. M. V. R., Zaborski, L. B., Wojciechowski, A. M., Hsu, J., Grabowski, D. C., Normand, S. T., & Zafar, S. F. (2026) · Health Science Reports · doi:10.1002/hsr2.72247
Nichols, L. (2026) · Australasian Journal of Neuroscience · doi:10.2478/ajon-2026-0008
Sex differences in cardiovascular disease in people with and without HIV
Shi, F., Xia, H., Weissman, S., Li, X., & Yang, X. (2026) · AIDS · doi:10.1097/qad.0000000000004567
Li, N., Abner, E. L., Koton, S., Mathews, L., Matsushita, K., & Kucharska‐Newton, A. (2026) · Frontiers in Stroke · doi:10.3389/fstro.2026.1847066
“The International Classification of Diseases, 9th Revision, Clinical Modification (ICD-9-CM) codes 430–438 (Rosamond et al., 1999; Koton et al., 2014) or 10th Revision, Clinical Modification (ICD-10-CM) codes I60–I69 (Woodfield et al., 2015) were used to identify stroke events in MedPAR records.”
Janssen, H., Rinkel, G. J. E., Kanning, J. P., Ruigrok, Y. M., & Schaafsma, J. D. (2026) · European Stroke Journal · doi:10.1093/esj/aakag094
“11 Fourth, through linkage to National death registries as well as hospitalisation records, our prospective population-based cohort study also captured non-hospitalised sudden-deaths due to SAH.”
Ghafarian, A. M., Samani, A., Revankar, S., Charles, S., Oyibo, O., Alghamdi, F. S., Parray, K., Sutton, A., & Loggini, A. (2026) · Heart & Lung · doi:10.1016/j.hrtlng.2026.102967
Dai, W., Zhu, Y., 杨立明, Zhang, M., Chen, Y., Fang, Z., Qi, Z., Hou, P., & Guo, X. (2026) · Frontiers in Neurology · doi:10.3389/fneur.2026.1960098
Metadata
- Authors
- Woodfield, R., Grant, I., UK Biobank Stroke Outcomes Group, UK Biobank Follow-Up and Outcomes Working Group, & Sudlow, C. L. M.
- Affiliations
- University of Edinburgh (GB)
- National Health Service Scotland (GB)
- UK Biobank (GB)
- Corresponding author
- Sudlow, Cathie L. M.
- ORCID
- Sudlow, Cathie L. M.
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2015-10-23
- Volume
- 10
- Issue
- 10
- Pages
- e0140533
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC4619732
- OpenAlex
- W2114176457
- Semantic Scholar
- 8ea6f3c77795ef6e5a1bf43993cf0ff629cad481
- Cited by
- 145
- References
- 74
- Citations by year
- 2026: 13 · 2025: 13 · 2024: 23 · 2023: 16 · 2022: 11 · 2021: 18 · 2020: 8 · 2019: 16 · 2018: 13 · 2017: 8 · 2016: 6
- FWCI
- 0.99
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Edinburgh Research Explorer (University of Edinburgh) (submittedVersion, cc-by)
- Funders
- University of Dundee
- Wellcome Trust (093707)
- Cancer Research UK
- University of Cambridge
- University College London
- University of Oxford
- University of Nottingham
- Cardiff University
- Swansea University
- Moorfields Eye Hospital NHS Foundation Trust
- Medical Research Council (MR/K007017/1)
- Menzies Centre for Australian Studies, King's College London, University of London
- Topics
- Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Health Sciences › Medicine › Clinical Neurology › Acute Ischemic Stroke Management
- Keywords
- stroke, electronic health records, case finding, data linkage, ICD codes, ischemic stroke, intracerebral hemorrhage, subarachnoid hemorrhage, positive predictive value, hospitalization, death certificates, primary care data, UK Biobank, long-term follow-up
- MeSH terms
- Adult, Death Certificates, United Kingdom, Hospitalization, Humans, Middle Aged, Reproducibility of Results, Stroke, International Classification of Diseases, Electronic Health Records
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.