CoChat

Reliability and validity of the UK Biobank cognitive tests

Open access
Fawns-Ritchie, Chloe, Deary, Ian J. · 2020 · PLOS ONE

Published version of a preprint

The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.

Abstract

UK Biobank is a health resource with data from over 500,000 adults. The cognitive assessment in UK Biobank is brief and bespoke, and is administered without supervision on a touchscreen computer. Psychometric information on the UK Biobank cognitive tests are limited. Despite the non-standard nature of these tests and the limited psychometric information, the UK Biobank cognitive data have been used in numerous scientific publications. The present study examined the validity and short-term test-retest reliability of the UK Biobank cognitive tests. A sample of 160 participants (mean age = 62.59, SD = 10.24) was recruited who completed the UK Biobank cognitive assessment and a range of well-validated cognitive tests ('reference tests'). Fifty-two participants returned 4 weeks later to repeat the UK Biobank tests. Correlations were calculated between UK Biobank tests and reference tests. Two measures of general cognitive ability were created by entering scores on the UK Biobank cognitive tests, and scores on the reference tests, respectively, into separate principal component analyses and saving scores on the first principal component. Four-week test-retest correlations were calculated for UK Biobank tests. UK Biobank cognitive tests showed a range of correlations with their respective reference tests, i.e. those tests that are thought to assess the same underlying cognitive ability (mean Pearson r = 0.53, range = 0.22 to 0.83, p≤.005). The measure of general cognitive ability based on the UK Biobank cognitive tests correlated at r = 0.83 (p < .001) with a measure of general cognitive ability created using the reference tests. Four-week test-retest reliability of the UK Biobank tests were moderate-to-high (mean Pearson r = 0.55, range = 0.40 to 0.89, p≤.003). Despite the brief, non-standard nature of the UK Biobank cognitive tests, some tests showed substantial concurrent validity and test-retest reliability. These psychometric results provide currently-lacking information on the validity of the UK Biobank cognitive tests.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1371/journal.pone.0231627

Cites

33 of 33 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 33 references

Research works printed but not linked: 6

  1. D Wechsler, 2009, WMS-IV Technical and Interpretive Manual
  2. DC Delis, 2001, D-KEFS Technical Manual
  3. JC Mathers, 2015, Guidelines for biomarkers of healthy ageing
  4. D Wechsler, 2010, WMS-IV Administration and Scoring Manual
  5. D Wechsler, 2010, WAIS-IV Administration and Scoring Manual
  6. D Wechsler, 2008, WAIS-IV Technical and Interpretive Manual

Cited by

See all 396

Metadata

Authors
Fawns-Ritchie, C., & Deary, I. J.
Affiliations
University of Edinburgh (GB)
Corresponding author
Deary, Ian J.
Venue
PLOS ONE
Published
2020-04-20
Volume
15
Issue
4
Pages
e0231627
ISSN
1932-6203 (ISSN-L)
OpenAlex
W3016980863
Cited by
396
References
33
Citations by year
2026: 65 · 2025: 82 · 2024: 94 · 2023: 61 · 2022: 55 · 2021: 28 · 2020: 9
FWCI
36.98
Type
journal article
Language
en
Open access
Locations
  • PLoS ONE (publishedVersion, cc-by)
  • medRxiv (acceptedVersion, other-oa)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Edinburgh Research Explorer (University of Edinburgh) (publishedVersion, cc-by)
  • RePEc: Research Papers in Economics (submittedVersion)
  • Discovery Research Portal (University of Dundee) (submittedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • Figshare (submittedVersion, cc-by)
Funders
  • Biotechnology and Biological Sciences Research Council (grant number MR/K026992/1)
  • Medical Research Council (grant number MR/K026992/1, MR/L023784/2)
Topics
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Cognitive Abilities and Testing
  • Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
  • Health Sciences › Medicine › Psychiatry and Mental health › Dementia and Cognitive Impairment Research
Keywords
UK Biobank, cognitive tests, test-retest reliability, concurrent validity, general intelligence, psychometric properties, reference tests
MeSH terms
Aged, Cognition, Female, United Kingdom, Humans, Male, Middle Aged, Neuropsychological Tests, Reproducibility of Results, Databases as Topic

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Reliability and validity of the UK Biobank cognitive tests. https://app.cochat.ai/papers/10.1371/journal.pone.0231627
The paper
Fawns-Ritchie, C., & Deary, I. J. (2020). Reliability and validity of the UK Biobank cognitive tests. PLOS ONE. https://doi.org/10.1371/journal.pone.0231627

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.