Theoretical and empirical quantification of the accuracy of polygenic scores in ancestry divergent populations
Open accessPublished version of a preprint
Abstract
Polygenic scores (PGS) have been widely used to predict disease risk using variants identified from genome-wide association studies (GWAS). To date, most GWAS have been conducted in populations of European ancestry, which limits the use of GWAS-derived PGS in non-European ancestry populations. Here, we derive a theoretical model of the relative accuracy (RA) of PGS across ancestries. We show through extensive simulations that the RA of PGS based on genome-wide significant SNPs can be predicted accurately from modelling linkage disequilibrium (LD), minor allele frequencies (MAF), cross-population correlations of causal SNP effects and heritability. We find that LD and MAF differences between ancestries can explain between 70 and 80% of the loss of RA of European-based PGS in African ancestry for traits like body mass index and type 2 diabetes. Our results suggest that causal variants underlying common genetic variation identified in European ancestry GWAS are mostly shared across continents.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The EduYears PGI shows substantial loss of prediction accuracy in samples of African genetic ancestries.
“We used a method that was recently developed by Wang et al.25 to investigate the factors contributing to the substantial loss of prediction accuracy of the EduYears PGI in samples of African genetic ancestries.”
From Polygenic prediction of educational attainment within and between families from genome-wide association analyses in 3 million individuals (2022) · cites this paper as Wang et al. [25]
Using UKB, the relative accuracy is smaller than would be predicted based on population differences in allele frequencies and LD alone, and this discrepancy is greater for EA than has been found in prior work for height, BMI, and six other phenotypes.
“Using the UKB, we find that the relative accuracy is smaller than would be predicted based on population differences in allele frequencies and LD alone (Online Methods), and this discrepancy is greater for EA than has been found in prior work25 for height, BMI, and six other phenotypes”
From Polygenic prediction of educational attainment within and between families from genome-wide association analyses in 3 million individuals (2022) · cites this paper as [25]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
A global reference for human genetic variation
The 1000 Genomes Project Consortium, authors, C., Auton, A., Abecasis, G. R., Steering committee, Altshuler, D. M., Durbin, R. M., Abecasis, G. R., Bentley, D. R., Chakravarti, A., et al. (2015) · Nature · doi:10.1038/nature15393 · Cited by 18,247 · see citing works
Self-citationHowie, B. N., Donnelly, P., & Marchini, J. (2009) · PLoS Genetics · doi:10.1371/journal.pgen.1000529 · Cited by 3,928 · see citing works
Mills, K. T., Bundy, J. D., Kelly, T. N., Reed, J. E., Kearney, P. M., Reynolds, K., Chen, J., & He, J. (2016) · Circulation · doi:10.1161/circulationaha.115.018912 · Cited by 3,531 · see citing works
Integrating common and rare genetic variation in diverse human populations
The International HapMap 3 Consortium (2010) · Nature · doi:10.1038/nature09298 · Cited by 3,026 · see citing works
Clinical use of current polygenic risk scores may exacerbate health disparities
Martin, A. R., Kanai, M., Kamatani, Y., Okada, Y., Neale, B. M., & Daly, M. J. (2019) · Nature Genetics · doi:10.1038/s41588-019-0379-x · Cited by 2,831 · see citing works
Global asthma prevalence in adults: findings from the cross-sectional world health survey
To, T., Stanojevic, S., Moores, G., Gershon, A. S., Bateman, E. D., Cruz, A. A., & Boulet, L.-P. (2012) · BMC Public Health · doi:10.1186/1471-2458-12-204 · Cited by 1,521 · see citing works
Human Demographic History Impacts Genetic Risk Prediction across Diverse Populations
Martin, A. R., Gignoux, C. R., Walters, R. K., Wojcik, G. L., Neale, B. M., Gravel, S., Daly, M. J., Bustamante, C. D., & Kenny, E. E. (2017) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2017.03.004 · Cited by 1,391 · see citing works
Analysis of polygenic risk score usage and performance in diverse human populations
Duncan, L., Shen, H., Gelaye, B., Meijsen, J., Ressler, K., Feldman, M., Peterson, R., & Domingue, B. (2019) · Nature Communications · doi:10.1038/s41467-019-11112-0 · Cited by 1,038 · see citing works
Comparative genetic architectures of schizophrenia in East Asian and European populations
Schizophrenia Working Group of the Psychiatric Genomics Consortium, Lam, M., Indonesia Schizophrenia Consortium, Genetic REsearch on schizophreniA neTwork-China and the Netherlands (GREAT-CN), Chen, C.-Y., Li, Z., Martin, A. R., Bryois, J., Ma, X., Gaspar, H., et al. (2019) · Nature Genetics · doi:10.1038/s41588-019-0512-x · Cited by 655 · see citing works
Signatures of negative selection in the genetic architecture of human complex traits
Zeng, J., de Vlaming, R., Wu, Y., Robinson, M. R., Lloyd-Jones, L. R., Yengo, L., Yap, C. X., Xue, A., Sidorenko, J., McRae, A. F., et al. (2018) · Nature Genetics · doi:10.1038/s41588-018-0101-4 · Cited by 391 · see citing works
Self-citationOxytocin pathway gene networks in the human brain
Quintana, D. S., Rokicki, J., van der Meer, D., Alnæs, D., Kaufmann, T., Córdova-Palomera, A., Dieset, I., Andreassen, O. A., & Westlye, L. T. (2019) · Nature Communications · doi:10.1038/s41467-019-08503-8 · Cited by 354 · see citing works
Li, Y. R., & Keating, B. J. (2014) · Genome Medicine · doi:10.1186/s13073-014-0091-5 · Cited by 214 · see citing works
Abbey, D. A., Funt, J., Lurie-Weinberger, M. N., Thompson, D. A., Regev, A., Myers, C. L., & Berman, J. (2014) · Genome Medicine · doi:10.1186/s13073-014-0100-8 · Cited by 147 · see citing works
Flagged first, then by citations
Research works printed but not linked: 40
- [1]Daetwyler HD Villanueva B Woolliams JA Accuracy of predicting the genetic risk of disease using a genome-wide approach PLoS ONE 2008 3 e3395 18852893 PMC2561058
- [4]Pszczola M Strabel T Mulder HAA Calus MPLPL Reliability of direct genomic values for animals with different relationships within and to the reference population J. Dairy Sci. 2012 95 389 400 22192218
- [5]Clark SA Hickey JM Daetwyler HD van der Werf JHJ The importance of information on relatives for the prediction of genomic breeding values and the implications for the makeup of reference data sets in livestock breeding schemes Genet. Sel. Evol. 2012 44 4 22321529 PMC3299588
- [7]Scutari M Mackay I Balding D Using genetic distance to infer the accuracy of genomic prediction PLoS Genet. 2016 12 e1006288 27589268 PMC5010218
- [8]De Roos APW Hayes BJ Spelman RJ Goddard ME Linkage disequilibrium and persistence of phase in Holstein-Friesian, Jersey and Angus cattle Genetics 2008 179 1503 1512 18622038 PMC2475750
- [9]Shengqiang Z Dekkers JCM Fernando RL Jannink JL Factors affecting accuracy from genomic selection in populations derived from multiple inbred lines: a barley case study Genetics 2009 182 355 364 19299342 PMC2674832
- [10]Habier D Tetens J Seefried F-R Lichtner P Thaller G The impact of genetic relationship information on genomic breeding values in German Holstein cattle Genet. Sel. Evol. 2010 42 5 20170500 PMC2838754
- [11]Brown BC Ye CJ Price AL Zaitlen N Transethnic genetic-correlation estimates from summary statistics Am. J. Hum. Genet. 2016 99 76 88 27321947 PMC5005434
- [12]Durvasula, A. & Kirk, E. Lohmueller. Negative selection on complex traits limits genetic risk prediction accuracy between populations. Preprint at 10.1101/721936 (2019). PMC8059340 33691092 · DOI
- [13]Bentley AR Multi-ancestry genome-wide gene–smoking interaction study of 387,272 individuals identifies new loci associated with serum lipids Nat. Genet. 2019 51 636 648 30926973 PMC6467258
- [14]Novembre J Barton NH Tread lightly interpreting polygenic tests of selection Genetics 2018 208 1351 1355 29618592 PMC5886544
- [15]Wientjes YCJ Empirical and deterministic accuracies of across-population genomic prediction Genet. Sel. Evol. 2015 47 1 14 25885467 PMC4320472
- [16]Wientjes YCJ Bijma P Veerkamp RF Calus MPL An equation to predict the accuracy of genomic values by combining data from multiple traits, populations, or environments Genetics 2016 202 799 823 26637542 PMC4788251
- [17]Henderson, C. R. Applications of Linear Models in Animal Breeding Vol. 462 (University of Guelph, 1984).
- [18]de Vlaming R Meta-GWAS accuracy and power (MetaGAP) calculator shows that hiding heritability is partially due to imperfect genetic correlations across studies PLoS Genet. 2017 13 1 23 PMC5240919 28095416
- [19]Grinde KE Generalizing polygenic risk scores from Europeans to Hispanics/Latinos Genet. Epidemiol. 2019 43 50 62 30368908 PMC6330129
- [21]Wu Y Zheng Z Visscher PM Yang J Quantifying the mapping precision of genome-wide association studies using whole-genome sequencing data Genome Biol. 2017 18 1 10 28506277 PMC5432979
- [23]Márquez-Luna C Multiethnic polygenic risk scores improve risk prediction in diverse populations Genet. Epidemiol. 2017 41 811 823 29110330 PMC5726434
- [25]Speed D Hemani G Johnson MR Balding DJ Improved heritability estimation from genome-wide SNPs. Am J. Hum. Genet. 2012 91 1011 1021 PMC3516604 23217325
- [26]Yang J Genetic variance estimation with imputed variants finds negligible missing heritability for human height and body mass index Nat. Genet. 2015 47 1114 1120 26323059 PMC4589513
- [27]Lee SH Estimation of SNP heritability from dense genotype data Am. J. Hum. Genet. 2013 93 1151 1155 24314550 PMC3852919
- [28]Speed D Cai N Johnson MR Nejentsev S Balding DJ Reevaluation of SNP heritability in complex human traits Nat. Genet. 2017 49 986 992 28530675 PMC5493198
- [29]Pritchard JK Are rare variants responsible for susceptibility to complex diseases? Am. J. Hum. Genet. 2001 69 124 137 11404818 PMC1226027
- [30]Zeng, J. et al. Bayesian analysis of GWAS summary data reveals differential signatures of natural selection across human complex traits and functional genomic categories. Preprint at 10.1101/752527 (2019). · DOI
- [31]Lee SH Goddard ME Wray NR Visscher PM A better coefficient of determination for genetic profile analysis Genet. Epidemiol. 2012 36 214 224 22714935
- [34]Saeedi, P. et al. Global and regional diabetes prevalence estimates for 2019 and projections for 2030 and 2045: results from the International Diabetes Federation Diabetes Atlas, 9th edition. Diabetes Res. Clin. Pract. 157, 107843 (2019). 31518657
- [35]Mills KT Global disparities of hypertension prevalence and control Circulation 2016 134 441 450 27502908 PMC4979614
- [36]Galinsky KJ Estimating cross-population genetic correlations of causal effect sizes Genet. Epidemiol. 2018 43 180 188 30474154 PMC6375794
- [37]Vilhjálmsson BJ Modeling linkage disequilibrium increases accuracy of polygenic risk scores Am. J. Hum. Genet. 2015 97 576 592 26430803 PMC4596916
- [38]Lloyd-Jones LR Improved polygenic prediction by Bayesian multiple regression on summary statistics Nat. Commun. 2019 10 522961 PMC6841727 31704910
- [39]Rüeger S McDaid A Kutalik Z Evaluation and application of summary statistic imputation to discover new height-associated loci PLoS Genet. 2018 14 1 32 PMC5983877 29782485
- [41]Magi R Trans-ethnic meta-regression of genome-wide association studies accounting for ancestry increases power for discovery and improves fine-mapping resolution Hum. Mol. Genet. 2017 26 3639 3650 28911207 PMC5755684
- [42]Coram MA Fang H Candille SI Assimes TL Tang H Leveraging multi-ethnic evidence for risk assessment of quantitative traits in minority populations. Am J. Hum. Genet. 2017 101 218 226 PMC5544393 28757202
- [43]Wojcik GL Genetic analyses of diverse populations improves discovery for complex traits Nature 2019 570 514 518 31217584 PMC6785182
- [45]Yengo L Meta-analysis of genome-wide association studies for height and body mass index in ∼700000 individuals of European ancestry Hum. Mol. Genet. 2018 27 3641 3649 30124842 PMC6488973
- [46]Yang J Lee SH Goddard ME Visscher PM GCTA: a tool for genome-wide complex trait analysis Am. J. Hum. Genet. 2011 88 76 82 21167468 PMC3014363
- [47]McCarthy S A reference panel of 64,976 haplotypes for genotype imputation Nat. Genet. 2016 48 1279 1283 27548312 PMC5388176
- [48]The UK10K Consortium. Europe PMC Funders Group The UK10K project identifies rare variants in health and disease Nature 2016 526 82 90 PMC4773891 26367797
- [49]Delaneau O Howie B Cox AJ Zagury JF Marchini J Haplotype estimation using sequencing reads Am. J. Hum. Genet. 2013 93 687 696 24094745 PMC3791270
- [52]Chang CC Second-generation PLINK: rising to the challenge of larger and richer datasets Gigascience 2015 4 7 25722852 PMC4342193
Cited by
Sorted by citations
Improving polygenic prediction in ancestrally diverse populations
Ruan, Y., Lin, Y.-F., Feng, Y.-C. A., Chen, C.-Y., Lam, M., Guo, Z., Initiatives, S. G. A., Ahn, Y. M., Akiyama, K., Arai, M., et al. (2022) · Nature Genetics · doi:10.1038/s41588-022-01054-7 · Cited by 707 · see citing works
Okbay, A., Wu, Y., Wang, N., Jayashankar, H., Bennett, M., Nehzati, S. M., Sidorenko, J., Kweon, H., Goldman, G., Gjorgjieva, T., et al. (2022) · Nature Genetics · doi:10.1038/s41588-022-01016-z · Cited by 654 · see citing works
Self-citationThe evolution of group differences in changing environments
Harpak, A., & Przeworski, M. (2021) · PLOS Biology · doi:10.1371/journal.pbio.3001072 · Cited by 50 · see citing works
“There are many reasons to expect that PGS would not port reliably from a GWAS sample to individuals of other genetic ancestries and several lines of empirical evidence that they do not [16,21,22,25,26].”
BackgroundNovel estimators for family-based genome-wide association studies increase power and robustness
Guan, J., Nehzati, S. M., Benjamin, D. J., & Young, A. I. (2022) · doi:10.1101/2022.10.24.513611 · Cited by 2 · see citing works
- Authors
- Wang, Y., Guo, J., Ni, G., Yang, J., Visscher, P. M., & Yengo, L.
- Affiliations
- The University of Queensland (AU)
- Venue
- Nature Communications
- Published
- 2020-07-31
- Volume
- 11
- Issue
- 1
- Pages
- 3865-3865
- ISSN
- 2041-1723 (ISSN-L)
- PMC
- PMC7395791
- OpenAlex
- W3046366876
- Cited by
- 271
- References
- 13
- Citations by year
- 2026: 48 · 2025: 35 · 2024: 56 · 2023: 45 · 2022: 56 · 2021: 24 · 2020: 6 · 2018: 1
- FWCI
- 19.17
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- Nature Communications (publishedVersion, cc-by)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by-nc-nd)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Department of Health | National Health and Medical Research Council (1113400)
- Australian Research Council
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic Associations and Epidemiology
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic and phenotypic traits in livestock
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Race, Genetics, and Society
- Keywords
- polygenic risk score, cross-population prediction, relative accuracy, linkage disequilibrium, minor allele frequency, heritability, African ancestry, body mass index, type 2 diabetes, common genetic variants
- MeSH terms
- Adult, Africa, Aged, Alleles, Asia, Asthma, Cholesterol, Computer Simulation, Diabetes Mellitus, Type 2, Europe, Female, Gene Frequency, Humans, Hypertension, Male, Middle Aged, Models, Genetic, Prognosis, Risk, Linkage Disequilibrium, Body Mass Index, Quantitative Trait, Heritable, Multifactorial Inheritance, Polymorphism, Single Nucleotide, Genome-Wide Association Study
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review