CoChat

Complex Diseases, Complex Genes: Keeping Pathways on the Right Track

Open access
Kraft, Peter, Raychaudhuri, Soumya · 2009 · Epidemiology
Cited by 29

The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.

Abstract

In his “Defense of Beanbag Genetics,” J.B.S. Haldane1 responded to critics who challenged a marginal (ie, one-locus-at-a-time) approach to studying population genetics. Such “beanbag genetics” had been accused of being too simplistic and ignoring the contributions of multiple loci in different (and ever-changing) environmental contexts. Haldane conceded this point of principle (“beanbag genetics do not explain the physiologic interaction of genes and the interaction of genotype and environment”) but went on to argue that despite its simplifications, the marginal approach had proven itself in practice and led to important insights.1 The arrival of massive amounts of data from genome-wide association studies (GWAS) has turned up the heat on a similar debate in the field of genetic epidemiology. On the one hand, the admittedly simple approach of averaging over genetic and environmental backgrounds and testing each marker in a GWAS for association with the studied trait marginally has proven quite successful,2,3 despite early concerns that by ignoring the underlying complexity this naïve approach would fail.4,5 On the other hand, the loci discovered to date do not come close to explaining the observed heritability for most studied traits.6 “Pathway analyses” acknowledge complexity by considering multiple loci simultaneously and relating them to known functional annotations. In principle, pathway analyses could lead to new discoveries missed by the simple marginal analyses.7–11 Moreover, successful identification of associated pathways can clarify disease pathogenesis; indeed, for some phenotypes, multiple loci identified through GWAS have been linked to common pathways.12–15 However, in practice, multilocus pathway analyses present a number of challenges, some of which should be very familiar to epidemiologists.16,17 The paper by Breitling et al18 in this issue discusses the issue of overfitting when there is a large number of potential predictor variables. Other issues may be less familiar—the consequences of the peculiarities of genomic data and how it is annotated. Here we discuss 3 loosely defined approaches to “pathway analysis” and touch on potential pitfalls for each. Data mining. In this approach, investigators identify a group of functionally related genes, and then apply multivariable analysis techniques to the markers in these genes.10,19–23 The hope may be that, although none of the individual markers were credibly associated with the studied trait, the aggregate evidence for association may be strong. Alternatively, a more flexible analysis that incorporates nonlinear relations between the coded marker genotypes and the trait may uncover additional compelling evidence for association. The paper by Lesnick at al,24 discussed by Breitling et al, took this approach, analyzing single nucleotide polymorphisms (SNPs) in genes involved in the axon guidance process using a stepwise regression approach, incorporating SNP main effects and product interaction terms. As Breitling et al point out, extreme care must be taken with data-mining techniques that search over a large set of possible models, when applied to data sets with a large number of markers. (The “axon guidance pathway” contained between 1,195 and 1,460 markers, depending on the data set analyzed.) Failing to appropriately correct for the model selection procedure can lead to drastic, downwardly biased P-values and overestimates of the precision of predicted trait values based on the fit model in a new data set. Breitling et al use a permutation procedure to correct for this overfitting, and report a P-value for association that is 35 orders of magnitude larger than that presented by Lesnick et al in their abstract.24 We note that in the presence of population stratification or differential genotyping errors, a simple permutation procedure that randomizes phenotypes against genotypes may still yield downwardly biased P-values. Permutations should be done within strata assumed to be homogeneous with respect to ancestry or genotyping errors, if possible. An alternative approach to assess statistical significance is to compare the observed test statistic for the pathway to the distribution of the test statistic across multiple synthetic “pathways”: sets of genes randomly drawn from the genome (and assumed not to be associated with the studied trait). Although this procedure might account for population stratification bias or genotyping errors (assuming these affect the tested pathway and the rest of the genome similarly), it comes with its own set of potential biases. In particular, this approach could be confounded by differences in characteristics between the tested and synthetic pathways, such as differences in gene size, linkage disequilibrium, etc. Ideally, the synthetic pathways should be matched to the tested pathway on these characteristics. Lesnick et al implemented this approach by randomly selecting individual SNPs from the genome and fou

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1097/ede.0b013e3181a93b98

Cites

7 of 7 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 7 references

Cited by

See all 29

Metadata

Authors
Kraft, P., & Raychaudhuri, S.
Venue
Epidemiology
Published
2009-07
Volume
20
Issue
4
Pages
508-511
ISSN
1044-3983 (ISSN-L)
OpenAlex
W2011511782
Cited by
29
References
7
FWCI
2.85
Type
journal article
Language
en
Open access
green

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Complex Diseases, Complex Genes: Keeping Pathways on the Right Track. https://app.cochat.ai/papers/10.1097/ede.0b013e3181a93b98
The paper
Kraft, P., & Raychaudhuri, S. (2009). Complex Diseases, Complex Genes: Keeping Pathways on the Right Track. Epidemiology. https://doi.org/10.1097/ede.0b013e3181a93b98

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.