CoChat

Population Structure and Eigenanalysis

Open access
Patterson, Nick, Price, Alkes L., Reich, David · 2006 · PLoS Genetics

The DOI matches its Crossref record; 48 of the 49 references it cites were found in a registry or an index, and 1 are not checked yet.

Abstract

Current methods for inferring population structure from genetic data do not provide formal significance tests for population differentiation. We discuss an approach to studying population structure (principal components analysis) that was first applied to genetic data by Cavalli-Sforza and colleagues. We place the method on a solid statistical footing, using results from modern statistics to develop formal significance tests. We also uncover a general "phase change" phenomenon about the ability to detect structure in genetic data, which emerges from the statistical theory we use, and has an important implication for the ability to discover structure in genetic data: for a fixed but large dataset size, divergence between two populations (as measured, for example, by a statistic like FST) below a threshold is essentially undetectable, but a little above threshold, detection will be easy. This means that we can predict the dataset size needed to detect structure.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1371/journal.pgen.0020190

Cites

48 of 49 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 The Tracy–Widom Density Conventional percentile points are: P = 0.05, x = .9794; P = 0.01, x = 2.0236; P = 0.001, x = 3.2730.
Figure 1 The Tracy–Widom Density Conventional percentile points are: P = 0.05, x = .9794; P = 0.01, x = 2.0236; P = 0.001, x = 3.2730.CC BY · PubMed Central
Figure 2 Testing the Fit of the TW Distribution (A) We carried out 1,000 simulations of a panmictic population, where we have a sample size of m = 100 and n = 5,000 unlinked markers. We give a P–P plot of the TW statistic against the theoretical distribution; this shows the empirical cumulative distribution against the theoretical cumulative distribution for a given quantile. If the fit is good, we expect the plot will lie along the line y = x. Interest is primarily at the top right, corresponding to low p-values. (B) P–P plot corresponding to a sample size of m = 200 and n = 50,000 markers. The fit is again excellent, demonstrating the appropriateness of the Johnstone normalization.
Figure 2 Testing the Fit of the TW Distribution (A) We carried out 1,000 simulations of a panmictic population, where we have a sample size of m = 100 and n = 5,000 unlinked markers. We give a P–P plot of the TW statistic against the theoretical distribution; this shows the empirical cumulative distribution against the theoretical cumulative distribution for a given quantile. If the fit is good, we expect the plot will lie along the line y = x. Interest is primarily at the top right, corresponding to low p-values. (B) P–P plot corresponding to a sample size of m = 200 and n = 50,000 markers. The fit is again excellent, demonstrating the appropriateness of the Johnstone normalization.CC BY · PubMed Central
Figure 3 Testing the Fit of the Second Eigenvalue We generated genotype data in which the leading eigenvalue is overwhelmingly significant (FST = .01, m = 100, n = 5,000) with two equal-sized subpopulations. We show P–P plots for the TW statistic computed from the second eigenvalue. The fit at the high end is excellent.
Figure 3 Testing the Fit of the Second Eigenvalue We generated genotype data in which the leading eigenvalue is overwhelmingly significant (FST = .01, m = 100, n = 5,000) with two equal-sized subpopulations. We show P–P plots for the TW statistic computed from the second eigenvalue. The fit at the high end is excellent.CC BY · PubMed Central
Figure 4 Three African Populations Plots of the first two eigenvectors for some African populations in the CEPH–HGDP dataset [30]. Yoruba and Bantu-speaking populations are genetically quite close and were grouped together. The Mandenka are a West African group speaking a language in the Mande family [15, p. 182]. The eigenanalysis fails to find structure in the Bantu populations, but separation between the Bantu and Mandenka with the second eigenvector is apparent.
Figure 4 Three African Populations Plots of the first two eigenvectors for some African populations in the CEPH–HGDP dataset [30]. Yoruba and Bantu-speaking populations are genetically quite close and were grouped together. The Mandenka are a West African group speaking a language in the Mande family [15, p. 182]. The eigenanalysis fails to find structure in the Bantu populations, but separation between the Bantu and Mandenka with the second eigenvector is apparent.CC BY · PubMed Central
Figure 5 Three East Asian Populations Plots of the first two eigenvectors for a population from Thailand and Chinese and Japanese populations from the International Haplotype Map [32]. The Japanese population is clearly distinguished (though not by either eigenvector separately). The large dispersal of the Thai population, along a line where the Chinese are at an extreme, suggests some gene flow of a Chinese-related population into Thailand. Note the similarity to the simulated data of Figure 8.
Figure 5 Three East Asian Populations Plots of the first two eigenvectors for a population from Thailand and Chinese and Japanese populations from the International Haplotype Map [32]. The Japanese population is clearly distinguished (though not by either eigenvector separately). The large dispersal of the Thai population, along a line where the Chinese are at an extreme, suggests some gene flow of a Chinese-related population into Thailand. Note the similarity to the simulated data of Figure 8.CC BY · PubMed Central
Figure 6 The BBP Phase Change We ran a series of simulations, varying the sample size m and number of markers n but keeping the product at mn = 220. Thus the predicted phase change threshold is FST = 2−10. We vary FS and plot the log p-value of the Tracy–Widom statistic. (We clipped −log10 p at 20.) Note that below the threshold there is no statistical significance, while above threshold, we tend to get enormous significance.
Figure 6 The BBP Phase Change We ran a series of simulations, varying the sample size m and number of markers n but keeping the product at mn = 220. Thus the predicted phase change threshold is FST = 2−10. We vary FS and plot the log p-value of the Tracy–Widom statistic. (We clipped −log10 p at 20.) Note that below the threshold there is no statistical significance, while above threshold, we tend to get enormous significance.CC BY · PubMed Central
Figure 7 Simulation of an Admixed Population We show a simple demography generating an admixed population. Populations A,B,D trifurcated 100 generations ago, while population C is a recent admixture of A and B. Admixture weights for the proportion of population A in population C are Beta-distributed with parameters (3.5,1.5). Effective population sizes are 10,000.
Figure 7 Simulation of an Admixed Population We show a simple demography generating an admixed population. Populations A,B,D trifurcated 100 generations ago, while population C is a recent admixture of A and B. Admixture weights for the proportion of population A in population C are Beta-distributed with parameters (3.5,1.5). Effective population sizes are 10,000.CC BY · PubMed Central
Figure 8 A Plot of a Simulation Involving Admixture (See Main Text for Details) We plot the first two principal components. Population C is a recent admixture of two populations, B and a population not sampled. Note the large dispersion of population C along a line joining the two parental populations. Note the similarity of the simulated data to the real data of Figure 5.
Figure 8 A Plot of a Simulation Involving Admixture (See Main Text for Details) We plot the first two principal components. Population C is a recent admixture of two populations, B and a population not sampled. Note the large dispersion of population C along a line joining the two parental populations. Note the similarity of the simulated data to the real data of Figure 5.CC BY · PubMed Central
Figure 9 LD Correction with no LD Present P–P plots of the TW statistic, when no LD is present and after varying levels (k) of our LD correction. We first show this (A) for m = 500, n = 5,000, and then (B) for m = 200, n = 50,000. In both cases the LD correction makes little difference to the fit.
Figure 9 LD Correction with no LD Present P–P plots of the TW statistic, when no LD is present and after varying levels (k) of our LD correction. We first show this (A) for m = 500, n = 5,000, and then (B) for m = 200, n = 50,000. In both cases the LD correction makes little difference to the fit.CC BY · PubMed Central
Figure 10 LD Correction with Strong LD (A) Shows P–P plots of the TW statistic (m = 100, n = 5,000) with large blocks of complete LD. Uncorrected, the TW statistic is hopelessly poor, but after correction the fit is again good. Here, we show 1,000 runs with the same data size parameters as in Figure 2A, m = 500, n = 5,000, varying k, the number of columns used to “correct” for LD. The fit is adequate for any nonzero value of k. (B) Shows a similar analysis with m = 200, n = 50,000.
Figure 10 LD Correction with Strong LD (A) Shows P–P plots of the TW statistic (m = 100, n = 5,000) with large blocks of complete LD. Uncorrected, the TW statistic is hopelessly poor, but after correction the fit is again good. Here, we show 1,000 runs with the same data size parameters as in Figure 2A, m = 500, n = 5,000, varying k, the number of columns used to “correct” for LD. The fit is adequate for any nonzero value of k. (B) Shows a similar analysis with m = 200, n = 50,000.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 39

  1. Devlin, 1999, Biometrics, 55, 997
  2. Menozzi, 1978, Science, 201, 786
  3. Cavalli-Sforza, 2003, Nat Genet, 33, 266
  4. Shriver, 2005, Human Genomics, 2, 81
  5. Capelli, 2006, Ann Hum Genet, 70, 207
  6. Lovell, 2005, Ann Hum Genet, 69, 275
  7. Stoneking, 1997, Genome Res, 7, 1061
  8. Pritchard, 2000, Genetics, 155, 945
  9. Falush, 2003, Genetics, 164, 1567
  10. Hoggart, 2004, Am J Hum Genet, 74, 965
  11. Patterson, 2004, Am J Hum Genet, 74, 979
  12. Montana, 2004, Am J Hum Genet, 75, 771
  13. Price, 2006, Nat Genet, 38, 904
  14. Baik, 2005, Ann Probability, 33, 1643
  15. Baik, 2006, J Multivariate Anal, 97, 1643
  16. Nicholson, 2002, JRSS(B), 64, 695
  17. Bowcock, 1994, Nature, 368, 455
  18. Johnstone, 2001, Ann Stat, 29, 295
  19. Tracy, 1994, Commun Math Phys, 159, 151
  20. El Karoui, 2003, On the largest eigenvalue of Wishart matrices with identity covariance when p/n → ∞
  21. Soshnikov, 2002, J Stat Physics, 108, 1033
  22. Altshuler, 2005, Nature, 437, 1299
  23. Macarthur, 1957, Proc Natl Acad Sci U S A, 43, 293
  24. Pielou, 1975, Ecological diversity
  25. Ramachandran, 2005, Proc Natl Acad Sci, 102, 15942
  26. Gibbs, 2004, Nature, 426, 789
  27. Smith, 2004, Am J Hum Genet, 74, 1001
  28. Daly, 2001, Nat Genet, 29, 229
  29. Patil, 2001, Science, 294, 1719
  30. Allen, 2003, Am J Hum Genet, 72, 671
  31. Clayton, 2005, Nat Genet, 37, 1243
  32. Serre, 2004, Genome Res, 14, 1679
  33. Spielman, 1993, Am J Hum Genet, 52, 506
  34. Freedman, 2004, Nat Genet, 36, 388
  35. Marchini, 2004, Nat Genet, 36, 512
  36. Helgason, 2005, Nat Genet, 37, 90
  37. Balding, 1995, Genetica, 96, 3
  38. Rosenberg, 2006, Ann Hum Gen, 70, 841
  39. Schaffner, 2005, Genome Res, 15, 1576

Cited by

See all 5,280

Metadata

Authors
Patterson, N., Price, A. L., & Reich, D.
Affiliations
Broad Institute (US)
Corresponding author
Patterson, Nick
Venue
PLoS Genetics
Published
2006
Volume
2
Issue
12
Pages
e190
ISSN
  • 1553-7390 (ISSN-L)
  • 1553-7404
OpenAlex
W2108169091
Cited by
5,280
References
49
Citations by year
2026: 303 · 2025: 380 · 2024: 430 · 2023: 361 · 2022: 393 · 2021: 405 · 2020: 352 · 2019: 324 · 2018: 313 · 2017: 298 · 2016: 270 · 2015: 250 · 2014: 248 · 2013: 227 · 2012: 212
FWCI
35.78
Type
journal article
Language
en
Open access
Locations
  • PLoS Genetics (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Digital Access to Scholarship at Harvard (DASH) (Harvard University) (submittedVersion, cc-by)
  • RePEc: Research Papers in Economics (submittedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
Funders
  • Wellcome Trust
  • National Human Genome Research Institute (R01HG006399)
Topics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic diversity and population structure
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Forensic and Genetic Research
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic Associations and Epidemiology
Keywords
population structure, principal component analysis, significance tests, genetic differentiation, phase transitions, sample size determination, FST, genetic data, eigenvalue analysis
MeSH terms
Computer Simulation, Genetic Markers, Genetics, Medical, Genetics, Population, Humans, Models, Genetic, Genetic Variation, Models, Statistical, Principal Component Analysis

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.