Relative performance of gene- and pathway-level methods as secondary analyses for genome-wide association studies
Open accessThe DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Despite the success of genome-wide association studies (GWAS), there still remains "missing heritability" for many traits. One contributing factor may be the result of examining one marker at a time as opposed to a group of markers that are biologically meaningful in aggregate. To address this problem, a variety of gene- and pathway-level methods have been developed to identify putative biologically relevant associations. A simulation was conducted to systematically assess the performance of these methods. Using genetic data from 4,500 individuals in the Wellcome Trust Case Control Consortium (WTCCC), case-control status was simulated based on an additive polygenic model. We evaluated gene-level methods based on their sensitivity, specificity, and proportion of false positives. Pathway-level methods were evaluated on the relationship between proportion of causal genes within the pathway and the strength of association. RESULTS: The gene-level methods had low sensitivity (20-63%), high specificity (89-100%), and low proportion of false positives (0.1-6%). The gene-level program VEGAS using only the top 10% of associated single nucleotide polymorphisms (SNPs) within the gene had the highest sensitivity (28.6%) with less than 1% false positives. The performance of the pathway-level methods depended on their reliance upon asymptotic distributions or if significance was estimated in a competitive manner. The pathway-level programs GenGen, GSA-SNP and MAGENTA had the best performance while accounting for potential confounders. CONCLUSIONS: Novel genes and pathways can be identified using the gene and pathway-level methods. These methods may provide valuable insight into the "missing heritability" of traits and provide biological interpretations to GWAS findings.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures

Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Analyses were limited to the top 10%, by P value, of SNPs per gene, an approach which has been shown to give rise to higher sensitivity and lower false positive rates compared to other gene-set methods [37].”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Subramanian, A., Tamayo, P., Mootha, V. K., Mukherjee, S., Ebert, B. L., Gillette, M. A., Paulovich, A., Pomeroy, S. L., Golub, T. R., Lander, E. S., et al. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0506580102 · Cited by 53,625 · cited 2×
“We systematically evaluated the relative performance of gene- and pathway-level methods for a case–control GWAS through a simulation of over 17,000 genes and 20 pathways from the Gene Ontology Biological Processes.”
MethodPLINK: a tool set for whole-genome association and population-based linkage analyses.
Purcell, S., Neale, B., Todd-Brown, K., Thomas, L., Ferreira, M. A. R., Bender, D., Maller, J., Sklar, P., de Bakker, P. I. W., Daly, M. J., et al. (2007) · The American Journal of Human Genetics · doi:10.1086/519795 · Cited by 34,089 · cited 6×
“Pathway-level methods can be separated into two groups: competitive (ALIGATOR, GenGen, GSA-SNP, GSEA-SNP, MAGENTA, MGFM, SNP Ratio Test) and self-contained (GRASS, HYST, Plink Set Test).”
MethodInfluentialPrincipal components analysis corrects for stratification in genome-wide association studies
Price, A. L., Patterson, N. J., Plenge, R. M., Weinblatt, M. E., Shadick, N. A., & Reich, D. (2006) · Nature Genetics · doi:10.1038/ng1847 · Cited by 10,248 · cited 1×
“Principal components analysis (PCA) was conducted to ensure a homogenous sample without outliers using EIGENSTRAT [10].”
MethodGenome-wide association study of 14,000 cases of seven common diseases and 3,000 shared controls
The Wellcome Trust Case Control Consortium, Management Committee, Burton, P. R., Clayton, D. G., Cardon, L. R., Craddock, N., Deloukas, P., Duncanson, A., Kwiatkowski, D. P., McCarthy, M. I., et al. (2007) · Nature · doi:10.1038/nature05911 · Cited by 9,442 · cited 1×
“Funding for the project was provided by the Wellcome Trust under award 076113, 085475, and 090355 [9].”
MethodHindorff, L. A., Sethupathy, P., Junkins, H. A., Ramos, E. M., Mehta, J. P., Collins, F. S., & Manolio, T. A. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0903103106 · Cited by 4,013 · cited 1×
“In less than one decade after their advent, genome-wide association studies (GWAS) have been remarkably successful and have elucidated many loci for diverse phenotypes [1].”
BackgroundGenome-wide association studies for complex traits: consensus, uncertainty and challenges
McCarthy, M. I., Abecasis, G. R., Cardon, L. R., Goldstein, D. B., Little, J., Ioannidis, J. P. A., & Hirschhorn, J. N. (2008) · Nature Reviews Genetics · doi:10.1038/nrg2344 · Cited by 2,891 · cited 1×
“5 million tests results in a p-value significance threshold of 5×10 [3], and biologically-relevant genetic associations may lie below this threshold, but are ignored in many traditional GWAS.”
BackgroundEfficiency and power in genetic association studies
de Bakker, P. I. W., Yelensky, R., Pe'er, I., Gabriel, S. B., Daly, M. J., & Altshuler, D. (2005) · Nature Genetics · doi:10.1038/ng1669 · Cited by 1,688 · cited 1×
“2) within the genic region and the 20 kilobase (kb) flanking regions using the program Tagger [13].”
MethodPathway-Based Approaches for Analysis of Genomewide Association Studies
Wang, K., Li, M., & Bucan, M. (2007) · The American Journal of Human Genetics · doi:10.1086/522374 · Cited by 858 · cited 8×
“Pathway-level methods can be separated into two groups: competitive (ALIGATOR, GenGen, GSA-SNP, GSEA-SNP, MAGENTA, MGFM, SNP Ratio Test) and self-contained (GRASS, HYST, Plink Set Test).”
MethodInfluentialA Versatile Gene-Based Test for Genome-wide Association Studies
Liu, J. Z., Mcrae, A. F., Nyholt, D. R., Medland, S. E., Wray, N. R., Brown, K. M., Hayward, N. K., Montgomery, G. W., Visscher, P. M., Martin, N. G., et al. (2010) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2010.06.009 · Cited by 791 · cited 1×
“For the Novel methods we evaluated VEGAS using all SNPs and using only the top 10% of associated SNPs [19].”
MethodCytoplasmic 5′-3′ exonuclease Xrn1p is also a genome-wide transcription factor in yeast
Medina, D. A., Jordán-Pla, A., Millán-Zambrano, G., Chávez, S., Choder, M., & Pérez-Ortín, J. E. (2014) · Frontiers in Genetics · doi:10.3389/fgene.2014.00001 · Cited by 757
Cited by
The Autism Spectrum Disorders Working Group of The Psychiatric Genomics Consortium (2017) · Molecular Autism · doi:10.1186/s13229-017-0137-9 · Cited by 587
Recombination Rate Variation, Hitchhiking, and Demographic History Shape Deleterious Load in Poplar
Zhang, M., Zhou, L., Bawa, R., Suren, H., & Holliday, J. A. (2016) · Molecular Biology and Evolution · doi:10.1093/molbev/msw169 · Cited by 68
“With linkage disequilibrium between genic SNPs, FDR correction allows correlation structure between SNPs and controls false positives at a similar level as other classical methods without losing power (Wojcik et al. 2015).”
BackgroundGermline Features Associated with Immune Infiltration in Solid Tumors
Shahamatdar, S., He, M. X., Reyna, M. A., Gusev, A., AlDubayan, S. H., Allen, E. M. V., & Ramachandran, S. (2020) · Cell Reports · doi:10.1016/j.celrep.2020.02.039 · Cited by 67
Gene and Network Analysis of Common Variants Reveals Novel Associations in Multiple Complex Diseases
Nakka, P., Raphael, B. J., & Ramachandran, S. (2016) · Genetics · doi:10.1534/genetics.116.188391 · Cited by 57
“To compare how well minSNP, SKAT, VEGAS, and PEGASUS can recover causal genes, we conducted a GWA study for a simulated complex phenotype with known genetic architecture based on the approach outlined in Wojcik et al. (2015) and applied these four methods to the simulated data (Figure S13).”
MethodMishra, A., & MacGregor, S. (2017) · Twin Research and Human Genetics · doi:10.1017/thg.2016.100 · Cited by 49
“Recently, Wojcik et al. (2015) compared 21 different methods for gene- and pathway-level analysis of GWAS data and reported that the VEGAS approach considering the top 10% of SNP association p values performs better in terms of both sensitivity and control of type 1 error rate.”
Metadata
- Authors
- Wojcik, G. L., Kao, W. L., & Duggal, P.
- Affiliations
- Johns Hopkins University (US)
- Corresponding author
- Wojcik, Genevieve L
- Venue
- BMC Genetics
- Published
- 2015-04-08
- Volume
- 16
- Issue
- 1
- Pages
- 34-34
- ISSN
- 1471-2156 (ISSN-L)
- PMC
- PMC4391470
- OpenAlex
- W2059283420
- Cited by
- 33
- References
- 28
- Citations by year
- 2026: 1 · 2023: 3 · 2022: 2 · 2021: 2 · 2020: 3 · 2019: 3 · 2018: 7 · 2017: 8 · 2016: 4
- FWCI
- 4.35
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- BMC Genetics (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- Bill and Melinda Gates Foundation
- Wellcome Trust (085475, 090355, 076113)
- National Institutes of Health
- U.S. Public Health Service (EYE02-1531)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic Associations and Epidemiology
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Bioinformatics and Genomic Networks
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic Mapping and Diversity in Plants and Animals
- Keywords
- missing heritability, Vega, magenta, sensitivity and specificity, false positives, polygenic model, Wellcome Trust Case Control Consortium, single nucleotide polymorphisms
- MeSH terms
- Genes, Humans, Sensitivity and Specificity, Reproducibility of Results, Signal Transduction, Case-Control Studies, Computational Biology, Polymorphism, Single Nucleotide, Genomics, Genome-Wide Association Study
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Relative performance of gene- and pathway-level methods as secondary analyses for genome-wide association studies. https://app.cochat.ai/papers/10.1186/s12863-015-0191-2
- The paper
- Wojcik, G. L., Kao, W. L., & Duggal, P. (2015). Relative performance of gene- and pathway-level methods as secondary analyses for genome-wide association studies. BMC Genetics. https://doi.org/10.1186/s12863-015-0191-2
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.