The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Analyzing gene expression data in terms of gene sets: methodological issues
Open accessAbstract
Motivation: Many statistical tests have been proposed in recent years for analyzing gene expression data in terms of gene sets, usually from Gene Ontology. These methods are based on widely different methodological assumptions. Some approaches test differential expression of each gene set against differential expression of the rest of the genes, whereas others test each gene set on its own. Also, some methods are based on a model in which the genes are the sampling units, whereas others treat the subjects as the sampling units. This article aims to clarify the assumptions behind different approaches and to indicate a preferential methodology of gene set testing. Results: We identify some crucial assumptions which are needed by the majority of methods. P-values derived from methods that use a model which takes the genes as the sampling unit are easily misinterpreted, as they are based on a statistical model that does not resemble the biological experiment actually performed. Furthermore, because these models are based on a crucial and unrealistic independence assumption between genes, the P-values derived from such methods can be wildly anti-conservative, as a simulation experiment shows. We also argue that methods that competitively test each gene set against the rest of the genes create an unnecessary rift between single gene testing and gene set testing. Contact: j.j.goeman@lumc.nl
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Subramanian, A., Tamayo, P., Mootha, V. K., Mukherjee, S., Ebert, B. L., Gillette, M. A., Paulovich, A., Pomeroy, S. L., Golub, T. R., Lander, E. S., et al. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0506580102 · Cited by 53,625
Gene Ontology: tool for the unification of biology
Ashburner, M., Ball, C. A., Blake, J. A., Botstein, D., Butler, H., Cherry, J. M., Davis, A. P., Dolinski, K., Dwight, S. S., Eppig, J. T., et al. (2000) · Nature Genetics · doi:10.1038/75556 · Cited by 43,206
KEGG: Kyoto Encyclopedia of Genes and Genomes
Ogata, H., Goto, S., Sato, K., Fujibuchi, W., Bono, H., & Kanehisa, M. (1999) · Nucleic Acids Research · doi:10.1093/nar/27.1.29 · Cited by 31,232
(2005) · Statistics for Biology and Health · doi:10.1007/0-387-27255-0_9 · Cited by 20,133
McCullagh, P., & Nelder, J. A. (1989) · doi:10.1007/978-1-4899-3242-6 · Cited by 16,836
In silico prediction of protein-protein interactions in human macrophages
Souiai, O., Guerfali, F., Ben Miled, S., Brun, C., & Benkahla, A. (2014) · BMC Research Notes · doi:10.1186/1756-0500-7-157 · Cited by 10,803
Mootha, V. K., Lindgren, C. M., Eriksson, K.-F., Subramanian, A., Sihag, S., Lehar, J., Puigserver, P., Carlsson, E., Ridderstråle, M., Laurila, E., et al. (2003) · Nature Genetics · doi:10.1038/ng1180 · Cited by 10,197
Distinct types of diffuse large B-cell lymphoma identified by gene expression profiling
Alizadeh, A. A., Eisen, M. B., Davis, R. E., Ma, C., Lossos, I. S., Rosenwald, A., Boldrick, J. C., Sabet, H., Tran, T., Yu, X., et al. (2000) · Nature · doi:10.1038/35000501 · Cited by 9,925
Generalized Linear Models (2nd ed.).
Therneau, T. M., McCullagh, P., & Nelder, J. A. (1993) · Journal of the American Statistical Association · doi:10.2307/2290358 · Cited by 4,907
Alon, U., Barkai, N., Notterman, D. A., Gish, K., Ybarra, S., Mack, D., & Levine, A. J. (1999) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.96.12.6745 · Cited by 4,167
Schuenemeyer, J. H., McCullagh, P., & Nelder, J. A. (1992) · Technometrics · doi:10.2307/1269238 · Cited by 2,667
Systematic variation in gene expression patterns in human cancer cell lines
Ross, D. T., Scherf, U., Eisen, M. B., Perou, C. M., Rees, C., Spellman, P., Iyer, V., Jeffrey, S. S., Van de Rijn, M., Waltham, M., et al. (2000) · Nature Genetics · doi:10.1038/73432 · Cited by 2,088
Boyle, E. I., Weng, S., Gollub, J., Jin, H., Botstein, D., Cherry, J. M., & Sherlock, G. (2004) · Bioinformatics · doi:10.1093/bioinformatics/bth456 · Cited by 2,067
Identifying biological themes within lists of genes with EASE
Hosack, D. A., Dennis, G., Sherman, B. T., Lane, H. C., & Lempicki, R. A. (2003) · Genome Biology · doi:10.1186/gb-2003-4-10-r70 · Cited by 1,950
Genome-wide analysis of DNA copy-number changes using cDNA microarrays
Pollack, J. R., Perou, C. M., Alizadeh, A. A., Eisen, M. B., Pergamenschikov, A., Williams, C. F., Jeffrey, S. S., Botstein, D., & Brown, P. O. (1999) · Nature Genetics · doi:10.1038/12640 · Cited by 1,423
Distinctive gene expression patterns in human mammary epithelial cells and breast cancers
Perou, C. M., Jeffrey, S. S., van de Rijn, M., Rees, C. A., Eisen, M. B., Ross, D. T., Pergamenschikov, A., Williams, C. F., Zhu, S. X., Lee, J. C. F., et al. (1999) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.96.16.9212 · Cited by 1,402
Dudoit, S., Yang, J. Y. H., Callow, M. J., & Speed, T. P. (2002) · UC Berkeley · Cited by 1,390
Microarray data analysis: from disarray to consolidation and consensus
Allison, D. B., Cui, X., Page, G. P., & Sabripour, M. (2006) · Nature Reviews Genetics · doi:10.1038/nrg1749 · Cited by 1,339 · cited 1×
“Contact: j.j.goeman@lumc.nl”
Analysis of Variance for Gene Expression Microarray Data
Kerr, M. K., Martin, M., & Churchill, G. A. (2000) · Journal of Computational Biology · doi:10.1089/10665270050514954 · Cited by 1,310
GOstat: find statistically overrepresented Gene Ontologies within a group of genes
Beißbarth, T., & Speed, T. P. (2004) · Bioinformatics · doi:10.1093/bioinformatics/bth088 · Cited by 1,257
GoMiner: a resource for biological interpretation of genomic and proteomic data
Zeeberg, B. R., Feng, W., Wang, G., Wang, M. D., Fojo, A. T., Sunshine, M., Narasimhan, S., Kane, D. W., Reinhold, W. C., Lababidi, S., et al. (2003) · Genome Biology · doi:10.1186/gb-2003-4-4-r28 · Cited by 1,198
FatiGO: a web tool for finding significant associations of Gene Ontology terms with groups of genes
Al-Shahrour, F., Díaz-Uriarte, R., & Dopazo, J. (2004) · Bioinformatics · doi:10.1093/bioinformatics/btg455 · Cited by 1,122
A global test for groups of genes: testing association with a clinical outcome
Goeman, J. J., van de Geer, S. A., de Kort, F., & van Houwelingen, H. C. (2004) · Bioinformatics · doi:10.1093/bioinformatics/btg382 · Cited by 1,069
Self-citationOntological analysis of gene expression data: current tools, limitations, and open problems
Khatri, P., & Drăghici, S. (2005) · Bioinformatics · doi:10.1093/bioinformatics/bti565 · Cited by 854
Higher criticism for detecting sparse heterogeneous mixtures
Donoho, D., & Jin, J. (2004) · The Annals of Statistics · doi:10.1214/009053604000000265 · Cited by 721
Zhang, B., Schmoyer, D., Kirov, S., & Snoddy, J. (2004) · BMC Bioinformatics · doi:10.1186/1471-2105-5-16 · Cited by 450
Pathway level analysis of gene expression using singular value decomposition
Tomfohr, J., Lu, J., & Kepler, T. B. (2005) · BMC Bioinformatics · doi:10.1186/1471-2105-6-225 · Cited by 420
Stereotyped and specific gene expression programs in human innate immune responses to bacteria
Boldrick, J. C., Alizadeh, A. A., Diehn, M., Dudoit, S., Liu, C. L., Belcher, C. E., Botstein, D., Staudt, L. M., Brown, P. O., & Relman, D. A. (2002) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.231625398 · Cited by 389
Barry, W. T., Nobel, A. B., & Wright, F. A. (2005) · Bioinformatics · doi:10.1093/bioinformatics/bti260 · Cited by 356
ErmineJ: Tool for functional analysis of gene expression data sets
Lee, H. K., Braynen, W., Keshav, K., & Pavlidis, P. (2005) · BMC Bioinformatics · doi:10.1186/1471-2105-6-269 · Cited by 278
Pavlidis, P., Qin, J., Arango, V., Mann, J. J., & Sibille, E. (2004) · Neurochemical Research · doi:10.1023/b:nere.0000023608.29741.45 · Cited by 237
Testing Against a High Dimensional Alternative
Goeman, J. J., Van De Geer, S. A., & Van Houwelingen, H. C. (2006) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2006.00551.x · Cited by 236
Self-citationWholePathwayScope: a comprehensive pathway-based analysis tool for high-throughput data
Yi, M., Horton, J. D., Cohen, J. C., Hobbs, H. H., & Stephens, R. M. (2006) · BMC Bioinformatics · doi:10.1186/1471-2105-7-30 · Cited by 210
Testing association of a pathway with survival using gene expression data
Goeman, J. J., Oosting, J., Cleton-Jansen, A.-M., Anninga, J. K., & van Houwelingen, H. C. (2005) · Bioinformatics · doi:10.1093/bioinformatics/bti267 · Cited by 169
Self-citationBreitling, R., Amtmann, A., & Herzyk, P. (2004) · BMC Bioinformatics · doi:10.1186/1471-2105-5-34 · Cited by 151
Group testing for pathway analysis improves comparability of different microarray datasets
Manoli, T., Gretz, N., Gröne, H., Kenzelmann, M., Eils, R., & Brors, B. (2006) · Bioinformatics · doi:10.1093/bioinformatics/btl424 · Cited by 150
Al‐Shahrour, F., Díaz‐Uriarte, R., & Dopazo, J. (2005) · Computer applications in the biosciences · doi:10.1093/bioinformatics/bti457 · Cited by 125
Statistical concerns about the GSEA procedure
Damian, D., & Gorfine, M. (2004) · Nature Genetics · doi:10.1038/ng0704-663a · Cited by 118
Meister, R., & Mansmann, U. (2005) · Methods of Information in Medicine · doi:10.1055/s-0038-1633992 · Cited by 118
Mansmann, U., & Meister, R. (2005) · PubMed · Cited by 108
Manduchi, E., Grant, G. R., McKenzie, S. E., Overton, G. C., Surrey, S., & Stoeckert, C. J. (2000) · Bioinformatics · doi:10.1093/bioinformatics/16.8.685 · Cited by 96
Comparing functional annotation analyses with Catmap
Breslin, T., Edén, P., & Krogh, M. (2004) · BMC Bioinformatics · doi:10.1186/1471-2105-5-193 · Cited by 87
Theme discovery from gene lists for identification and viewing of multiple functional groups
Pehkonen, P., Wong, G., & Törönen, P. (2005) · BMC Bioinformatics · doi:10.1186/1471-2105-6-162 · Cited by 54
Supervised Methods with Genomic Data: a Review and Cautionary View
Díaz‐Uriarte, R. (2005) · Wiley eBooks · doi:10.1002/0470094419.ch12 · Cited by 30
Klebanov, L. B., & Yakovlev, A. (2006) · Statistical Applications in Genetics and Molecular Biology · doi:10.2202/1544-6115.1185 · Cited by 22
Cited by
limma powers differential expression analyses for RNA-sequencing and microarray studies
Ritchie, M. E., Phipson, B., Wu, D., Hu, Y., Law, C. W., Shi, W., & Smyth, G. K. (2015) · Nucleic Acids Research · doi:10.1093/nar/gkv007 · Cited by 40,458
GSVA: gene set variation analysis for microarray and RNA-Seq data
Hänzelmann, S., Castelo, R., & Guinney, J. (2013) · BMC Bioinformatics · doi:10.1186/1471-2105-14-7 · Cited by 15,440
Huang, D. W., Sherman, B. T., & Lempicki, R. A. (2009) · Nucleic Acids Research · doi:10.1093/nar/gkn923 · Cited by 14,108
GOrilla: a tool for discovery and visualization of enriched GO terms in ranked gene lists
Eden, E., Navon, R., Steinfeld, I., Lipson, D., & Yakhini, Z. (2009) · BMC Bioinformatics · doi:10.1186/1471-2105-10-48 · Cited by 3,356
DNA methylation arrays as surrogate measures of cell mixture distribution
Houseman, E. A., Accomando, W. P., Koestler, D. C., Christensen, B. C., Marsit, C. J., Nelson, H. H., Wiencke, J. K., & Kelsey, K. T. (2012) · BMC Bioinformatics · doi:10.1186/1471-2105-13-86 · Cited by 3,175
Metadata
- Authors
- Goeman, J. J., & Bühlmann, P.
- Venue
- Bioinformatics
- Publisher
- Oxford University Press (OUP)
- Published
- 2007-02-15
- Volume
- 23
- Issue
- 8
- Pages
- 980-987
- ISSN
- 1367-4803 (ISSN-L)
- 1367-4811
- OpenAlex
- W2134736660
- Cited by
- 802
- References
- 46
- FWCI
- 18.32
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.