The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Analyzing gene expression data in terms of gene sets: methodological issues
Open accessAbstract
Motivation: Many statistical tests have been proposed in recent years for analyzing gene expression data in terms of gene sets, usually from Gene Ontology. These methods are based on widely different methodological assumptions. Some approaches test differential expression of each gene set against differential expression of the rest of the genes, whereas others test each gene set on its own. Also, some methods are based on a model in which the genes are the sampling units, whereas others treat the subjects as the sampling units. This article aims to clarify the assumptions behind different approaches and to indicate a preferential methodology of gene set testing. Results: We identify some crucial assumptions which are needed by the majority of methods. P-values derived from methods that use a model which takes the genes as the sampling unit are easily misinterpreted, as they are based on a statistical model that does not resemble the biological experiment actually performed. Furthermore, because these models are based on a crucial and unrealistic independence assumption between genes, the P-values derived from such methods can be wildly anti-conservative, as a simulation experiment shows. We also argue that methods that competitively test each gene set against the rest of the genes create an unnecessary rift between single gene testing and gene set testing. Contact: j.j.goeman@lumc.nl
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Subramanian, A., Tamayo, P., Mootha, V. K., Mukherjee, S., Ebert, B. L., Gillette, M. A., Paulovich, A., Pomeroy, S. L., Golub, T. R., Lander, E. S., et al. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0506580102 · Cited by 53,625
Gene Ontology: tool for the unification of biology
Ashburner, M., Ball, C. A., Blake, J. A., Botstein, D., Butler, H., Cherry, J. M., Davis, A. P., Dolinski, K., Dwight, S. S., Eppig, J. T., et al. (2000) · Nature Genetics · doi:10.1038/75556 · Cited by 43,206
KEGG: Kyoto Encyclopedia of Genes and Genomes
Ogata, H., Goto, S., Sato, K., Fujibuchi, W., Bono, H., & Kanehisa, M. (1999) · Nucleic Acids Research · doi:10.1093/nar/27.1.29 · Cited by 31,232
(2005) · Statistics for Biology and Health · doi:10.1007/0-387-27255-0_9 · Cited by 20,133
McCullagh, P., & Nelder, J. A. (1989) · doi:10.1007/978-1-4899-3242-6 · Cited by 16,836
In silico prediction of protein-protein interactions in human macrophages
Souiai, O., Guerfali, F., Ben Miled, S., Brun, C., & Benkahla, A. (2014) · BMC Research Notes · doi:10.1186/1756-0500-7-157 · Cited by 10,803
Mootha, V. K., Lindgren, C. M., Eriksson, K.-F., Subramanian, A., Sihag, S., Lehar, J., Puigserver, P., Carlsson, E., Ridderstråle, M., Laurila, E., et al. (2003) · Nature Genetics · doi:10.1038/ng1180 · Cited by 10,197
Distinct types of diffuse large B-cell lymphoma identified by gene expression profiling
Alizadeh, A. A., Eisen, M. B., Davis, R. E., Ma, C., Lossos, I. S., Rosenwald, A., Boldrick, J. C., Sabet, H., Tran, T., Yu, X., et al. (2000) · Nature · doi:10.1038/35000501 · Cited by 9,925
Generalized Linear Models (2nd ed.).
Therneau, T. M., McCullagh, P., & Nelder, J. A. (1993) · Journal of the American Statistical Association · doi:10.2307/2290358 · Cited by 4,907
Cited by
limma powers differential expression analyses for RNA-sequencing and microarray studies
Ritchie, M. E., Phipson, B., Wu, D., Hu, Y., Law, C. W., Shi, W., & Smyth, G. K. (2015) · Nucleic Acids Research · doi:10.1093/nar/gkv007 · Cited by 40,458
GSVA: gene set variation analysis for microarray and RNA-Seq data
Hänzelmann, S., Castelo, R., & Guinney, J. (2013) · BMC Bioinformatics · doi:10.1186/1471-2105-14-7 · Cited by 15,440
Huang, D. W., Sherman, B. T., & Lempicki, R. A. (2009) · Nucleic Acids Research · doi:10.1093/nar/gkn923 · Cited by 14,108
GOrilla: a tool for discovery and visualization of enriched GO terms in ranked gene lists
Eden, E., Navon, R., Steinfeld, I., Lipson, D., & Yakhini, Z. (2009) · BMC Bioinformatics · doi:10.1186/1471-2105-10-48 · Cited by 3,356
DNA methylation arrays as surrogate measures of cell mixture distribution
Houseman, E. A., Accomando, W. P., Koestler, D. C., Christensen, B. C., Marsit, C. J., Nelson, H. H., Wiencke, J. K., & Kelsey, K. T. (2012) · BMC Bioinformatics · doi:10.1186/1471-2105-13-86 · Cited by 3,175
Reimand, J., Isserlin, R., Voisin, V., Kucera, M., Tannus-Lopes, C., Rostamianfar, A., Wadi, L., Meyer, M., Wong, J., Xu, C., et al. (2019) · Nature Protocols · doi:10.1038/s41596-018-0103-9 · Cited by 1,970
Ten Years of Pathway Analysis: Current Approaches and Outstanding Challenges
Khatri, P., Sirota, M., & Butte, A. J. (2012) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002375 · Cited by 1,566
GAGE: generally applicable gene set enrichment for pathway analysis
Luo, W., Friedman, M. S., Shedden, K., Hankenson, K. D., & Woolf, P. J. (2009) · BMC Bioinformatics · doi:10.1186/1471-2105-10-161 · Cited by 1,333
Gene expression elucidates functional impact of polygenic risk for schizophrenia
Fromer, M., Roussos, P., Sieberts, S. K., Johnson, J. S., Kavanagh, D. H., Perumal, T. M., Ruderfer, D. M., Oh, E. C., Topol, A., Shah, H. R., et al. (2016) · Nature Neuroscience · doi:10.1038/nn.4399 · Cited by 1,091
Deep learning-based multi-omics integration robustly predicts survival in liver cancer
Chaudhary, K., Poirion, O. B., Lu, L., & Garmire, L. X. (2018) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-17-0853 · Cited by 1,091
Camera: a competitive gene set test accounting for inter-gene correlation
Wu, D., & Smyth, G. K. (2012) · Nucleic Acids Research · doi:10.1093/nar/gks461 · Cited by 891
Analysing biological pathways in genome-wide association studies
Wang, K., Li, M., & Hakonarson, H. (2010) · Nature Reviews Genetics · doi:10.1038/nrg2884 · Cited by 766
Phipson, B., & Smyth, G. K. (2010) · Statistical Applications in Genetics and Molecular Biology · doi:10.2202/1544-6115.1585 · Cited by 712
Väremo, L., Nielsen, J., & Nookaew, I. (2013) · Nucleic Acids Research · doi:10.1093/nar/gkt111 · Cited by 697
ROAST: rotation gene set tests for complex microarray experiments
Wu, D., Lim, E., Vaillant, F., Asselin-Labat, M.-L., Visvader, J. E., & Smyth, G. K. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btq401 · Cited by 560
Sausen, M., Phallen, J., Adleff, V., Jones, S., Leary, R. J., Barrett, M. T., Anagnostou, V., Parpart-Li, S., Murphy, D., Kay Li, Q., et al. (2015) · Nature Communications · doi:10.1038/ncomms8686 · Cited by 484
A DNA methylation biomarker of alcohol consumption
Liu, C., Marioni, R. E., Hedman, Å. K., Pfeiffer, L., Tsai, P.-C., Reynolds, L. M., Just, A. C., Duan, Q., Boer, C. G., Tanaka, T., et al. (2018) · Molecular Psychiatry · doi:10.1038/mp.2016.192 · Cited by 402
A general modular framework for gene set enrichment analysis
Ackermann, M., & Strimmer, K. (2009) · BMC Bioinformatics · doi:10.1186/1471-2105-10-47 · Cited by 358
Chipster: user-friendly analysis software for microarray and other high-throughput data
Kallio, M. A., Tuimala, J. T., Hupponen, T., Klemelä, P., Gentile, M., Scheinin, I., Koski, M., Käki, J., & Korpelainen, E. I. (2011) · BMC Genomics · doi:10.1186/1471-2164-12-507 · Cited by 348
Gene-set approach for expression pattern analysis
Nam, D., & Kim, S.-Y. (2008) · Briefings in Bioinformatics · doi:10.1093/bib/bbn001 · Cited by 338
Kuhn, A., Goldstein, D. R., Hodges, A., Strand, A. D., Sengstag, T., Kooperberg, C., Becanovic, K., Pouladi, M. A., Sathasivam, K., Cha, J.-H. J., et al. (2007) · Human Molecular Genetics · doi:10.1093/hmg/ddm133 · Cited by 328
Dietary palmitic acid promotes a prometastatic memory via Schwann cells
Pascual, G., Domínguez, D., Elosúa-Bayes, M., Beckedorff, F., Laudanna, C., Bigas, C., Douillet, D., Greco, C., Symeonidi, A., Hernández, I., et al. (2021) · Nature · doi:10.1038/s41586-021-04075-0 · Cited by 308
Metabolic Dynamics and Prediction of Gestational Age and Time to Delivery in Pregnant Women
Liang, L., Rasmussen, M.-L. H., Piening, B., Shen, X., Chen, S., Röst, H., Snyder, J. K., Tibshirani, R., Skotte, L., Lee, N. C., et al. (2020) · Cell · doi:10.1016/j.cell.2020.05.002 · Cited by 307
Pirinen, E., Auranen, M., Khan, N. A., Brilhante, V., Urho, N., Pessia, A., Hakkarainen, A., Kuula, J., Heinonen, U., Schmidt, M. S., et al. (2020) · Cell Metabolism · doi:10.1016/j.cmet.2020.04.008 · Cited by 278
Pathway Analysis: State of the Art
García-Campos, M. A., Espinal-Enríquez, J., & Hernández-Lemus, E. (2015) · Frontiers in Physiology · doi:10.3389/fphys.2015.00383 · Cited by 265
Improving gene set analysis of microarray data by SAM-GS
Dinu, I., Potter, J. D., Mueller, T., Liu, Q., Adewale, A. J., Jhangri, G. S., Einecke, G., Famulski, K. S., Halloran, P., & Yasui, Y. (2007) · BMC Bioinformatics · doi:10.1186/1471-2105-8-242 · Cited by 262
Yaari, G., Bolen, C. R., Thakar, J., & Kleinstein, S. H. (2013) · Nucleic Acids Research · doi:10.1093/nar/gkt660 · Cited by 261
Pathway analysis of genomic data: concepts, methods, and prospects for future development
Ramanan, V. K., Shen, L., Moore, J. H., & Saykin, A. J. (2012) · Trends in Genetics · doi:10.1016/j.tig.2012.03.004 · Cited by 253
Commentary: The seven plagues of epigenetic epidemiology
Heijmans, B. T., & Mill, J. (2012) · International Journal of Epidemiology · doi:10.1093/ije/dyr225 · Cited by 208
Gene set analysis of genome-wide association studies: Methodological issues and perspectives
Wang, L., Jia, P., Wolfinger, R. D., Chen, X., & Zhao, Z. (2011) · Genomics · doi:10.1016/j.ygeno.2011.04.006 · Cited by 207
A comparison of gene set analysis methods in terms of sensitivity, prioritization and specificity
Tarca, A. L., Bhatti, G., & Romero, R. (2013) · PLoS ONE · doi:10.1371/journal.pone.0079217 · Cited by 203
Applications of transformer-based language models in bioinformatics: a survey
Zhang, S., Fan, R., Liu, Y., Chen, S., Liu, Q., & Zeng, W. (2023) · Bioinformatics Advances · doi:10.1093/bioadv/vbad001 · Cited by 176
Mitochondrial CoQ deficiency is a common driver of mitochondrial oxidants and insulin resistance
Fazakerley, D. J., Chaudhuri, R., Yang, P., Maghzal, G. J., Thomas, K. C., Krycer, J. R., Humphrey, S. J., Parker, B. L., Fisher-Wellman, K. H., Meoli, C. C., et al. (2018) · eLife · doi:10.7554/elife.32111 · Cited by 160
Haas, J. T., Vonghia, L., Mogilenko, D. A., Verrijken, A., Molendi-Coste, O., Fleury, S., Deprince, A., Nikitin, A., Woitrain, E., Ducrocq-Geoffroy, L., et al. (2019) · Nature Metabolism · doi:10.1038/s42255-019-0076-1 · Cited by 155
Multi‐omic rejuvenation of naturally aged tissues by a single cycle of transient reprogramming
Chondronasiou, D., Gill, D., Mosteiro, L., Urdinguio, R. G., Berenguer‐Llergo, A., Aguilera, M., Durand, S., Aprahamian, F., Nirmalathasan, N., Abad, M., et al. (2022) · Aging Cell · doi:10.1111/acel.13578 · Cited by 133
DINGO: differential network analysis in genomics
Ha, M. J., Baladandayuthapani, V., & Do, K.-A. (2015) · Bioinformatics · doi:10.1093/bioinformatics/btv406 · Cited by 120
Rahmatallah, Y., Emmert-Streib, F., & Glazko, G. (2014) · Bioinformatics · doi:10.1093/bioinformatics/btt687 · Cited by 110
Integrating genetic and gene expression evidence into genome-wide association analysis of gene sets
Xiong, Q., Ancona, N., Hauser, E. R., Mukherjee, S., & Furey, T. S. (2012) · Genome Research · doi:10.1101/gr.124370.111 · Cited by 103
Linking Phenotypes and Modes of Action Through High-Content Screen Fingerprints
Reisen, F., Sauty de Chalon, A., Pfeifer, M., Zhang, X., Gabriel, D., & Selzer, P. (2015) · ASSAY and Drug Development Technologies · doi:10.1089/adt.2015.656 · Cited by 76
Efficient pathway enrichment and network analysis of GWAS summary data using GSA-SNP2
Yoon, S., Nguyen, H. C. T., Yoo, Y. J., Kim, J., Baik, B., Kim, S., Kim, J., Kim, S., & Nam, D. (2018) · Nucleic Acids Research · doi:10.1093/nar/gky175 · Cited by 81
Vivar, J. C., Pemu, P., McPherson, R., & Ghosh, S. (2013) · OMICS: A Journal of Integrative Biology · doi:10.1089/omi.2012.0083 · Cited by 44
Navigating Transcriptomic Connectivity Mapping Workflows to Link Chemicals with Bioactivities
Shah, I., Bundy, J., Chambers, B., Everett, L. J., Haggard, D., Harrill, J., Judson, R. S., Nyffeler, J., & Patlewicz, G. (2022) · Chemical Research in Toxicology · doi:10.1021/acs.chemrestox.2c00245 · Cited by 19
Poisson, L. M., Kaur, N., Felicella, M. M., & Singh, J. (2023) · Human Molecular Genetics · doi:10.1093/hmg/ddad144 · Cited by 8
Metadata
- Authors
- Goeman, J. J., & Bühlmann, P.
- Venue
- Bioinformatics
- Publisher
- Oxford University Press (OUP)
- Published
- 2007-02-15
- Volume
- 23
- Issue
- 8
- Pages
- 980-987
- ISSN
- 1367-4803 (ISSN-L)
- 1367-4811
- OpenAlex
- W2134736660
- Cited by
- 802
- References
- 46
- FWCI
- 18.32
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.