Cognitive Test Scores in UK Biobank: Data Reduction in 480,416 Participants and Longitudinal Stability in 20,346 Participants
Open accessThe DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Abstract
UK Biobank includes 502,649 middle- and older-aged adults from the general population who have undergone detailed phenotypic assessment. The majority of participants completed tests of cognitive functioning, and on average four years later a sub-group of N = 20,346 participants repeated most of the assessment. These measures will be used in a range of future studies of health outcomes in this cohort. The format and content of the cognitive tasks were partly novel. The aim of the present study was to validate and characterize the cognitive data: to describe the inter-correlational structure of the cognitive variables at baseline assessment, and the degree of stability in scores across longitudinal assessment. Baseline cognitive data were used to examine the inter-correlational/factor-structure, using principal components analysis (PCA). We also assessed the degree of stability in cognitive scores in the subsample of participants with repeat data. The different tests of cognitive ability showed significant raw inter-correlations in the expected directions. PCA suggested a one-factor solution (eigenvalue = 1.60), which accounted for around 40% of the variance. Scores showed varying levels of stability across time-points (intraclass correlation range = 0.16 to 0.65). UK Biobank cognitive data has the potential to be a significant resource for researchers looking to investigate predictors and modifiers of cognitive abilities and associated health outcomes in the general population.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
Sudlow, C., Gallacher, J., Allen, N., Beral, V., Burton, P., Danesh, J., Downey, P., Elliott, P., Green, J., Landray, M., et al. (2015) · PLOS Medicine · doi:10.1371/journal.pmed.1001779 · Cited by 12,728 · cited 2×
“UK Biobank is a large general population cohort of more than 500,000 middle and olderage adults who underwent medical, sociodemographic, mental health and cognitive assessment between 2006 and 2010 [5,6].”
Self-citationThe global prevalence of dementia: a systematic review and metaanalysis.
Prince, M., Bryce, R., Albanese, E., Wimo, A., Ribeiro, W., & Ferri, C. P. (2013) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2012.11.007 · Cited by 4,941 · cited 1×
“7 million people by 2030 [4], and it is therefore important to understand the predictors”
QUANTIFYING TEST-RETEST RELIABILITY USING THE INTRACLASS CORRELATION COEFFICIENT AND THE SEM
WEIR, J. P. (2005) · Journal of Strength and Conditioning Research · doi:10.1519/00124278-200502000-00038 · Cited by 4,842
Human cognitive abilities a survey of factor-analytic studies
Carroll, J. B. (2004) · Cited by 3,400
Age-associated cognitive decline
Deary, I. J., Corley, J., Gow, A. J., Harris, S. E., Houlihan, L. M., Marioni, R. E., Penke, L., Rafnsson, S. B., & Starr, J. M. (2009) · British Medical Bulletin · doi:10.1093/bmb/ldp033 · Cited by 1,295 · cited 1×
“‘memory’ [24,25]).”
Self-citationStatistics Notes: Measurement error
Bland, J. M., & Altman, D. G. (1996) · BMJ · doi:10.1136/bmj.313.7059.744 · Cited by 1,070
The neuroscience of human intelligence differences
Deary, I. J., Penke, L., & Johnson, W. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2793 · Cited by 1,038 · cited 1×
“One of the most replicated phenomena in psychology is that cognitive scores inter-correlate [7], possibly because their brain substrates have been subject to shared genetic/environmental influences (the ‘Common cause hypothesis’ [8]).”
Self-citation(2000) · Cambridge University Press eBooks · doi:10.1017/cbo9780511807947 · Cited by 862
Statistics notes: Measurement error
Bland, J. M., & Altman, D. G. (1996) · BMJ · doi:10.1136/bmj.312.7047.1654 · Cited by 835
Cited by
Sex Differences in the Adult Human Brain: Evidence from 5216 UK Biobank Participants
Ritchie, S. J., Cox, S. R., Shen, X., Lombardo, M. V., Reus, L. M., Alloza, C., Harris, M. A., Alderson, H. L., Hunter, S., Neilson, E., et al. (2018) · Cerebral Cortex · doi:10.1093/cercor/bhy109 · Cited by 855
“The cognitive measures were relatively psychometrically poor compared to a full IQ assessment: the verbalnumerical reasoning had only 13 items, and the reaction time test had only 4 trials that counted towards the final score (see [59] for analyses of their reliability).”
MethodSelf-citationReliability and validity of the UK Biobank cognitive tests
Fawns-Ritchie, C., & Deary, I. J. (2020) · PLOS ONE · doi:10.1371/journal.pone.0231627 · Cited by 396
“49 on this component [3], confirming the scores were positively correlated and that a g component was present in the original UK Biobank tests.”
BackgroundMethodInfluentialSelf-citationElovainio, M., Hakulinen, C., Pulkki-Råback, L., Virtanen, M., Josefsson, K., Jokela, M., Vahtera, J., & Kivimäki, M. (2017) · The Lancet Public Health · doi:10.1016/s2468-2667(17)30075-0 · Cited by 411
Associations of Social Isolation and Loneliness With Later Dementia
Shen, C., Rolls, E. T., Cheng, W., Kang, J., Dong, G., Xie, C., Zhao, X.-M., Sahakian, B. J., & Feng, J. (2022) · Neurology · doi:10.1212/wnl.0000000000200583 · Cited by 266
Lyall, D. M., Celis-Morales, C., Ward, J., Iliodromiti, S., Anderson, J. J., Gill, J. M. R., Smith, D. J., Ntuk, U. E., Mackay, D. F., Holmes, M. V., et al. (2017) · JAMA Cardiology · doi:10.1001/jamacardio.2016.5804 · Cited by 235
“TheUKBiobank cohort is representative of the UK population in terms of some characteristics, suchasage, sex, ethnicity, anddeprivation,but notnecessarilyall (eg, someparticipantsare less likely tosmoke anddrinkalcohol regularly).(32)That said, thedisease rateswere similar to those reported in the British Heart Foundat…”
Self-citationSmeland, O. B., Bahrami, S., Frei, O., Shadrin, A., O’Connell, K., Savage, J., Watanabe, K., Krull, F., Bettella, F., Steen, N. E., et al. (2020) · Molecular Psychiatry · doi:10.1038/s41380-018-0332-x · Cited by 229
Recommendations for Increasing the Transparency of Analysis of Preexisting Data Sets
Weston, S. J., Ritchie, S. J., Rohrer, J. M., & Przybylski, A. K. (2019) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245919848684 · Cited by 203
Association of body mass index and waist-to-hip ratio with brain structure: UK Biobank study
Hamer, M., & Batty, G. D. (2019) · Neurology · doi:10.1212/wnl.0000000000006879 · Cited by 189
Structural brain imaging correlates of general intelligence in UK Biobank
Cox, S. R., Ritchie, S. J., Fawns-Ritchie, C., Tucker-Drob, E. M., & Deary, I. J. (2019) · Intelligence · doi:10.1016/j.intell.2019.101376 · Cited by 164
“The UK Biobank participants have completed various cognitive measures; originally, they were administered a battery of bespoke tests with relatively poor reliability (Lyall et al., 2016).”
MethodSelf-citationAssociation of Ultraprocessed Food Consumption With Risk of Dementia: A Prospective Cohort Study
Li, H., Li, S., Yang, H., Zhang, Y., Zhang, S., Ma, Y., Hou, Y., Zhang, X., Niu, K., Borné, Y., et al. (2022) · Neurology · doi:10.1212/wnl.0000000000200871 · Cited by 107
“These tests have been previously described with the demonstration of sufficient stability.(27) The reasoning assessed the ability to solve verbal and numeric reasoning problems.”
BackgroundFirth, J., Stubbs, B., Vancampfort, D., Firth, J. A., Large, M., Rosenbaum, S., Hallgren, M., Ward, P. B., Sarris, J., & Yung, A. R. (2018) · Schizophrenia Bulletin · doi:10.1093/schbul/sby034 · Cited by 105
Lyall, D. M., Cox, S. R., Lyall, L. M., Celis-Morales, C., Cullen, B., Mackay, D. F., Ward, J., Strawbridge, R. J., McIntosh, A. M., Sattar, N., et al. (2020) · Brain Imaging and Behavior · doi:10.1007/s11682-019-00069-9 · Cited by 97
Self-citationFirth, J., Firth, J. A., Stubbs, B., Vancampfort, D., Schuch, F. B., Hallgren, M., Veronese, N., Yung, A. R., & Sarris, J. (2018) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2018.0503 · Cited by 94
Piumatti, G., Moore, S. C., Berridge, D. M., Sarkar, C., & Gallacher, J. (2018) · Journal of Public Health · doi:10.1093/pubmed/fdx186 · Cited by 51
A Polygenic Score for Higher Educational Attainment is Associated with Larger Brains
Elliott, M. L., Belsky, D. W., Anderson, K., Corcoran, D. L., Ge, T., Knodt, A., Prinz, J. A., Sugden, K., Williams, B., Ireland, D., et al. (2019) · Cerebral Cortex · doi:10.1093/cercor/bhy219 · Cited by 50
Winer, J. R., Lok, R., Weed, L., He, Z., Poston, K. L., Mormino, E. C., & Zeitzer, J. M. (2024) · Alzheimer's Research & Therapy · doi:10.1186/s13195-024-01411-0 · Cited by 44
“Cognitive tests were designed specifically for the UK Biobank and were administered unsupervised using a computer touchscreen interface either during an in-person visit or remotely [29].”
MethodPaz, V., Dashti, H. S., & Garfield, V. (2023) · Sleep Health · doi:10.1016/j.sleh.2023.05.002 · Cited by 29
A General Cognitive Ability Factor for the UK Biobank
Williams, C. M., Labouret, G., Wolfram, T., Peyre, H., & Ramus, F. (2023) · Behavior Genetics · doi:10.1007/s10519-022-10127-6 · Cited by 18
“Others created a general intelligence (g) factor from 3 to 7 cognitive variables using principal component analysis (PCA) or confirmatory factor analysis (CFA; Cox et al. 2019a, b; Hepsomali and Groeger 2021; Lyall et al. 2016; Navrady et al. 2017; de la Fuente et al. 2021).”
BackgroundMethodJahanshad, N., Lenzini, P., & Bijsterbosch, J. (2025) · Neuropsychopharmacology · doi:10.1038/s41386-024-01938-8 · Cited by 12
“For example, the four-item recent depressive symptom (RDS) scale [41] and cognitive test battery [42] were previously validated for the UK Biobank.”
MethodLiu, Z., Wei, S., Chen, X., Liu, L., Wei, Z., Liao, Z., Wu, J., Li, Z., Zhou, H., & Wang, D. (2022) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2022.833365 · Cited by 10
Metadata
- Authors
- Lyall, D. M., Cullen, B., Allerhand, M., Smith, D. J., Mackay, D., Evans, J., Anderson, J., Fawns-Ritchie, C., McIntosh, A. M., Deary, I. J., & Pell, J. P.
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2016-04-25
- Volume
- 11
- Issue
- 4
- Pages
- e0154222
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2342934749
- Cited by
- 256
- References
- 29
- FWCI
- 29.56
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.