Gene set analysis methods: a systematic comparison
Open accessThe DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Gene set analysis is a valuable tool to summarize high-dimensional gene expression data in terms of biologically relevant sets. This is an active area of research and numerous gene set analysis methods have been developed. Despite this popularity, systematic comparative studies have been limited in scope. METHODS: In this study we present a semi-synthetic simulation study using real datasets in order to test and compare commonly used methods. RESULTS: A software pipeline, Flexible Algorithm for Novel Gene set Simulation (FANGS) develops simulated data based on a prostate cancer dataset where the KRAS and TGF-β pathways were differentially expressed. The FANGS software is compatible with other datasets and pathways. Comparisons of gene set analysis methods are presented for Gene Set Enrichment Analysis (GSEA), Significance Analysis of Function and Expression (SAFE), sigPathway, and Correlation Adjusted Mean RAnk (CAMERA) methods. All gene set analysis methods are tested using gene sets from the MSigDB knowledge base. The false positive rate and power are estimated and presented for comparison. Recommendations are made for the utility of the default settings of methods and each method's sensitivity towards various effect sizes. CONCLUSIONS: The results of this study provide empirical guidance to users of gene set analysis methods. The FANGS software is available for researchers for continued methods comparisons.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Subramanian, A., Tamayo, P., Mootha, V. K., Mukherjee, S., Ebert, B. L., Gillette, M. A., Paulovich, A., Pomeroy, S. L., Golub, T. R., Lander, E. S., et al. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0506580102 · Cited by 53,625
NCBI GEO: archive for functional genomics data sets—update
Barrett, T., Wilhite, S. E., Ledoux, P., Evangelista, C., Kim, I. F., Tomashevsky, M., Marshall, K. A., Phillippy, K. H., Sherman, P. M., Holko, M., et al. (2012) · Nucleic Acids Research · doi:10.1093/nar/gks1193 · Cited by 10,418 · cited 2×
“The first is a prostate cancer dataset from the Gene Expression Omnibus (GEO) database [3] (GSE62872).”
BackgroundMethodLamb, J., Crawford, E. D., Peck, D., Modell, J. W., Blat, I. C., Wrobel, M. J., Lerner, J., Brunet, J.-P., Subramanian, A., Ross, K. N., et al. (2006) · Science · doi:10.1126/science.1132939 · Cited by 5,257
Multiple comparisons among means
Dunn, O. J. (1961) · Journal of the American Statistical Association · doi:10.1080/01621459.1961.10482090 · Cited by 5,006
Caspi, R., Billington, R., Ferrer, L., Foerster, H., Fulcher, C. A., Keseler, I. M., Kothari, A., Krummenacker, M., Latendresse, M., Mueller, L. A., et al. (2016) · Nucleic Acids Research · doi:10.1093/nar/gkv1164 · Cited by 3,395
Caspi, R., Altman, T., Billington, R., Dreher, K., Foerster, H., Fulcher, C. A., Holland, T. A., Keseler, I. M., Kothari, A., Kubo, A., et al. (2014) · Nucleic Acids Research · doi:10.1093/nar/gkt1103 · Cited by 1,204
A novel signaling pathway impact analysis
Tarca, A. L., Draghici, S., Khatri, P., Hassan, S. S., Mittal, P., Kim, J.-S., Kim, C. J., Kusanovic, J. P., & Romero, R. (2009) · Bioinformatics · doi:10.1093/bioinformatics/btn577 · Cited by 1,031
The RSPO–LGR4/5–ZNRF3/RNF43 module controls liver zonation and size
Planas-Paz, L., Orsini, V., Boulter, L., Calabrese, D., Pikiolek, M., Nigsch, F., Xie, Y., Roma, G., Donovan, A., Marti, P., et al. (2016) · Nature Cell Biology · doi:10.1038/ncb3337 · Cited by 359 · cited 1×
“[ 13, 16, 17, 31, 34, 35, 41, 42, 44, 47].”
A general modular framework for gene set enrichment analysis
Ackermann, M., & Strimmer, K. (2009) · BMC Bioinformatics · doi:10.1186/1471-2105-10-47 · Cited by 358
Cited by
decoupleR: ensemble of computational methods to infer biological activities from omics data
(2022) · doi:10.1093/bioadv/vbac016 · Cited by 1,098
A practical guide to methods controlling false discoveries in computational biology
Korthauer, K., Kimes, P. K., Duvallet, C., Reyes, A., Subramanian, A., Teng, M., Shukla, C., Alm, E. J., & Hicks, S. C. (2019) · Genome Biology · doi:10.1186/s13059-019-1716-1 · Cited by 436
Balestra, C., Maj, C., Müller, E., & Mayr, A. (2023) · PLOS ONE · doi:10.1371/journal.pone.0282699 · Cited by 4
Metadata
- Authors
- Mathur, R., Rotroff, D., Ma, J., Shojaie, A., & Motsinger-Reif, A.
- Venue
- BioData Mining
- Published
- 2018-05-31
- Volume
- 11
- Issue
- 1
- Pages
- 8-8
- ISSN
- 1756-0381 (ISSN-L)
- OpenAlex
- W2807134042
- Cited by
- 91
- References
- 11
- FWCI
- 2.83
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Gene set analysis methods: a systematic comparison. https://app.cochat.ai/papers/10.1186/s13040-018-0166-8
- The paper
- Mathur, R., Rotroff, D., Ma, J., Shojaie, A., & Motsinger-Reif, A. (2018). Gene set analysis methods: a systematic comparison. BioData Mining. https://doi.org/10.1186/s13040-018-0166-8
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.