Complex Diseases, Complex Genes: Keeping Pathways on the Right Track
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
In his “Defense of Beanbag Genetics,” J.B.S. Haldane1 responded to critics who challenged a marginal (ie, one-locus-at-a-time) approach to studying population genetics. Such “beanbag genetics” had been accused of being too simplistic and ignoring the contributions of multiple loci in different (and ever-changing) environmental contexts. Haldane conceded this point of principle (“beanbag genetics do not explain the physiologic interaction of genes and the interaction of genotype and environment”) but went on to argue that despite its simplifications, the marginal approach had proven itself in practice and led to important insights.1 The arrival of massive amounts of data from genome-wide association studies (GWAS) has turned up the heat on a similar debate in the field of genetic epidemiology. On the one hand, the admittedly simple approach of averaging over genetic and environmental backgrounds and testing each marker in a GWAS for association with the studied trait marginally has proven quite successful,2,3 despite early concerns that by ignoring the underlying complexity this naïve approach would fail.4,5 On the other hand, the loci discovered to date do not come close to explaining the observed heritability for most studied traits.6 “Pathway analyses” acknowledge complexity by considering multiple loci simultaneously and relating them to known functional annotations. In principle, pathway analyses could lead to new discoveries missed by the simple marginal analyses.7–11 Moreover, successful identification of associated pathways can clarify disease pathogenesis; indeed, for some phenotypes, multiple loci identified through GWAS have been linked to common pathways.12–15 However, in practice, multilocus pathway analyses present a number of challenges, some of which should be very familiar to epidemiologists.16,17 The paper by Breitling et al18 in this issue discusses the issue of overfitting when there is a large number of potential predictor variables. Other issues may be less familiar—the consequences of the peculiarities of genomic data and how it is annotated. Here we discuss 3 loosely defined approaches to “pathway analysis” and touch on potential pitfalls for each. Data mining. In this approach, investigators identify a group of functionally related genes, and then apply multivariable analysis techniques to the markers in these genes.10,19–23 The hope may be that, although none of the individual markers were credibly associated with the studied trait, the aggregate evidence for association may be strong. Alternatively, a more flexible analysis that incorporates nonlinear relations between the coded marker genotypes and the trait may uncover additional compelling evidence for association. The paper by Lesnick at al,24 discussed by Breitling et al, took this approach, analyzing single nucleotide polymorphisms (SNPs) in genes involved in the axon guidance process using a stepwise regression approach, incorporating SNP main effects and product interaction terms. As Breitling et al point out, extreme care must be taken with data-mining techniques that search over a large set of possible models, when applied to data sets with a large number of markers. (The “axon guidance pathway” contained between 1,195 and 1,460 markers, depending on the data set analyzed.) Failing to appropriately correct for the model selection procedure can lead to drastic, downwardly biased P-values and overestimates of the precision of predicted trait values based on the fit model in a new data set. Breitling et al use a permutation procedure to correct for this overfitting, and report a P-value for association that is 35 orders of magnitude larger than that presented by Lesnick et al in their abstract.24 We note that in the presence of population stratification or differential genotyping errors, a simple permutation procedure that randomizes phenotypes against genotypes may still yield downwardly biased P-values. Permutations should be done within strata assumed to be homogeneous with respect to ancestry or genotyping errors, if possible. An alternative approach to assess statistical significance is to compare the observed test statistic for the pathway to the distribution of the test statistic across multiple synthetic “pathways”: sets of genes randomly drawn from the genome (and assumed not to be associated with the studied trait). Although this procedure might account for population stratification bias or genotyping errors (assuming these affect the tested pathway and the rest of the genome similarly), it comes with its own set of potential biases. In particular, this approach could be confounded by differences in characteristics between the tested and synthetic pathways, such as differences in gene size, linkage disequilibrium, etc. Ideally, the synthetic pathways should be matched to the tested pathway on these characteristics. Lesnick et al implemented this approach by randomly selecting individual SNPs from the genome and fou
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Subramanian, A., Tamayo, P., Mootha, V. K., Mukherjee, S., Ebert, B. L., Gillette, M. A., Paulovich, A., Pomeroy, S. L., Golub, T. R., Lander, E. S., et al. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0506580102 · Cited by 53,625
Rioux, J. D., Xavier, R. J., Taylor, K. D., Silverberg, M. S., Goyette, P., Huett, A., Green, T., Kuballa, P., Barmada, M. M., Datta, L. W., et al. (2007) · Nature Genetics · doi:10.1038/ng2032 · Cited by 1,769
Personal genomes: The case of the missing heritability
Maher, B. (2008) · Nature · doi:10.1038/456018a · Cited by 1,737
Genetics of gene expression and its effect on disease
Emilsson, V., Thorleifsson, G., Zhang, B., Leonardson, A. S., Zink, F., Zhu, J., Carlson, S., Helgason, A., Walters, G. B., Gunnarsdottir, S., et al. (2008) · Nature · doi:10.1038/nature06758 · Cited by 1,296
A HapMap harvest of insights into the genetics of common disease
Manolio, T. A., Brooks, L. D., & Collins, F. S. (2008) · Journal of Clinical Investigation · doi:10.1172/jci34772 · Cited by 889
Variations in DNA elucidate molecular networks that cause disease
Chen, Y., Zhu, J., Lum, P. Y., Yang, X., Pinto, S., MacNeil, D. J., Zhang, C., Lamb, J., Edwards, S., Sieberts, S. K., et al. (2008) · Nature · doi:10.1038/nature06757 · Cited by 887
Franke, L., Bakel, H. V., Fokkens, L., de Jong, E. D., Egmont-Petersen, M., & Wijmenga, C. (2006) · The American Journal of Human Genetics · doi:10.1086/504300 · Cited by 476
Cited by
Analysing biological pathways in genome-wide association studies
Wang, K., Li, M., & Hakonarson, H. (2010) · Nature Reviews Genetics · doi:10.1038/nrg2884 · Cited by 766
Genetics and epigenetics of rheumatoid arthritis
Viatte, S., Plant, D., & Raychaudhuri, S. (2013) · Nature Reviews Rheumatology · doi:10.1038/nrrheum.2012.237 · Cited by 396
Self-citationGene set analysis of genome-wide association studies: Methodological issues and perspectives
Wang, L., Jia, P., Wolfinger, R. D., Chen, X., & Zhao, Z. (2011) · Genomics · doi:10.1016/j.ygeno.2011.04.006 · Cited by 207
How far from the SNP may the causative genes be?
Brodie, A., Azaria, J. R., & Ofran, Y. (2016) · Nucleic Acids Research · doi:10.1093/nar/gkw500 · Cited by 172
Implication of the Immune System in Alzheimer's Disease: Evidence from Genome-Wide Pathway Analysis
Lambert, J.-C., Grenier-Boley, B., Chouraki, V., Heath, S., Zelenika, D., Fievet, N., Hannequin, D., Pasquier, F., Hanon, O., Brice, A., et al. (2010) · Journal of Alzheimer's Disease · doi:10.3233/jad-2010-100018 · Cited by 144
“Despite these interesting results, our study suffered from the usual limitations of gene set enrichment analyses [11].”
Metadata
- Authors
- Kraft, P., & Raychaudhuri, S.
- Venue
- Epidemiology
- Published
- 2009-07
- Volume
- 20
- Issue
- 4
- Pages
- 508-511
- ISSN
- 1044-3983 (ISSN-L)
- OpenAlex
- W2011511782
- Cited by
- 29
- References
- 7
- FWCI
- 2.85
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.