The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Enrichment or depletion of a GO category within a class of genes: which test?
Open accessAbstract
Motivation: A number of available program packages determine the significant enrichments and/or depletions of GO categories among a class of genes of interest. Whereas a correct formulation of the problem leads to a single exact null distribution, these GO tools use a large variety of statistical tests whose denominations often do not clarify the underlying P-value computations. Summary: We review the different formulations of the problem and the tests they lead to: the binomial, χ2, equality of two probabilities, Fisher's exact and hypergeometric tests. We clarify the relationships existing between these tests, in particular the equivalence between the hypergeometric test and Fisher's exact test. We recall that the other tests are valid only for large samples, the test of equality of two probabilities and the χ2-test being equivalent. We discuss the appropriateness of one- and two-sided P-values, as well as some discreteness and conservatism issues. Contact: isabelle.rivals@espci.fr Supplementary information: Supplementary data are available at Bioinformatics online.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hapeman, D. E. (1991) · Technometrics · doi:10.1080/00401706.1991.10484817 · Cited by 9,373
DAVID: Database for Annotation, Visualization, and Integrated Discovery
Dennis, G., Sherman, B. T., Hosack, D. A., Yang, J., Gao, W., Lane, H. C., & Lempicki, R. A. (2003) · Genome Biology · doi:10.1186/gb-2003-4-5-p3 · Cited by 9,327
Agresti, A. (2002) · Wiley Series in Probability and Statistics · doi:10.1002/0471249688 · Cited by 6,746
Testing Statistical Hypotheses
(2021) · Wiley Series in Probability and Statistics · doi:10.1002/9781119243830.ch12 · Cited by 5,106
An Introduction to the Theory of Statistics
(1911) · Nature · doi:10.1038/087345a0 · Cited by 4,394
Maere, S., Heymans, K., & Kuiper, M. (2005) · Bioinformatics · doi:10.1093/bioinformatics/bti551 · Cited by 4,155
DAVID: Database for Annotation, Visualization, and Integrated Discovery
Dennis, G., Sherman, B. T., Hosack, D. A., Yang, J., Gao, W., Lane, H. C., & Lempicki, R. A. (2003) · Genome Biology · doi:10.1186/gb-2003-4-9-r60 · Cited by 2,376
Boyle, E. I., Weng, S., Gollub, J., Jin, H., Botstein, D., Cherry, J. M., & Sherlock, G. (2004) · Bioinformatics · doi:10.1093/bioinformatics/bth456 · Cited by 2,067 · cited 1×
“GoMiner Fisher Zeeberg et al., 2003 GOstat x2, Fisher Beisbarth and Speed, 2004”
BackgroundIdentifying biological themes within lists of genes with EASE
Hosack, D. A., Dennis, G., Sherman, B. T., Lane, H. C., & Lempicki, R. A. (2003) · Genome Biology · doi:10.1186/gb-2003-4-10-r70 · Cited by 1,950
Testing Statistical Hypotheses
Lehmann, E. L. (1986) · Springer Texts in Statistics · doi:10.1007/978-1-4757-1923-9 · Cited by 1,873
Research works printed but not linked: 1
- Draghici, 2003, Global functional profiling of gene expression, Genomics, 81, 98
Cited by
Huang, D. W., Sherman, B. T., & Lempicki, R. A. (2009) · Nucleic Acids Research · doi:10.1093/nar/gkn923 · Cited by 14,108
Szklarczyk, D., Morris, J. H., Cook, H., Kuhn, M., Wyder, S., Simonovic, M., Santos, A., Doncheva, N. T., Roth, A., Bork, P., et al. (2017) · Nucleic Acids Research · doi:10.1093/nar/gkw937 · Cited by 6,980
“The enrichment tests are done for a variety of classification systems (Gene Ontology, KEGG, Pfam and InterPro), and employ a Fisher’s exact test followed by a correction for multiple testing (42,43).”
MethodBindea, G., Mlecnik, B., Hackl, H., Charoentong, P., Tosolini, M., Kirilovsky, A., Fridman, W.-H., Pagès, F., Trajanoski, Z., & Galon, J. (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp101 · Cited by 6,280
REVIGO summarizes and visualizes long lists of gene ontology terms
Supek, F., Bošnjak, M., Škunca, N., & Šmuc, T. (2011) · PLoS ONE · doi:10.1371/journal.pone.0021800 · Cited by 6,264
STRING v9.1: protein-protein interaction networks, with increased coverage and integration
Franceschini, A., Szklarczyk, D., Frankild, S., Kuhn, M., Simonovic, M., Roth, A., Lin, J., Minguez, P., Bork, P., von Mering, C., et al. (2012) · Nucleic Acids Research · doi:10.1093/nar/gks1094 · Cited by 4,398
Enrichment Map: A Network-Based Method for Gene-Set Enrichment Visualization and Interpretation
Merico, D., Isserlin, R., Stueker, O., Emili, A., & Bader, G. D. (2010) · PLoS ONE · doi:10.1371/journal.pone.0013984 · Cited by 2,235
“The one-tail Fisher’s Exact Test [17], based on the hypergeometric distribution , was the first method proposed to address this problem [18], and continues to be one of the most used testing methods of this type [19].”
MethodAnderson, C. A., Boucher, G., Lees, C. W., Franke, A., D'Amato, M., Taylor, K. D., Lee, J. C., Goyette, P., Imielinski, M., Latiano, A., et al. (2011) · Nature Genetics · doi:10.1038/ng.764 · Cited by 1,320
GOATOOLS: A Python library for Gene Ontology analyses
Klopfenstein, D. V., Zhang, L., Pedersen, B. S., Ramírez, F., Warwick Vesztrocy, A., Naldi, A., Mungall, C. J., Yunes, J. M., Botvinnik, O., Weigel, M., et al. (2018) · Scientific Reports · doi:10.1038/s41598-018-28948-z · Cited by 1,290
Integrative functional genomic analyses implicate specific molecular pathways and circuits in autism
Parikshak, N. N., Luo, R., Zhang, A., Won, H., Lowe, J. K., Chandran, V., Horvath, S., & Geschwind, D. H. (2013) · Cell · doi:10.1016/j.cell.2013.10.031 · Cited by 1,039
Hitomi, J., Christofferson, D. E., Ng, A., Yao, J., Degterev, A., Xavier, R. J., & Yuan, J. (2008) · Cell · doi:10.1016/j.cell.2008.10.044 · Cited by 989
Identifying biologically relevant differences between metagenomic communities
Parks, D. H., & Beiko, R. G. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btq041 · Cited by 947
Väremo, L., Nielsen, J., & Nookaew, I. (2013) · Nucleic Acids Research · doi:10.1093/nar/gkt111 · Cited by 697
GOEAST: a web-based software toolkit for Gene Ontology enrichment analysis
Zheng, Q., & Wang, X.-J. (2008) · Nucleic Acids Research · doi:10.1093/nar/gkn276 · Cited by 638
Seyfried, N. T., Dammer, E. B., Swarup, V., Nandakumar, D., Duong, D. M., Yin, L., Deng, Q., Nguyen, T., Hales, C. M., Wingo, T., et al. (2017) · Cell Systems · doi:10.1016/j.cels.2016.11.006 · Cited by 477
DIANA miRPath v.2.0: investigating the combinatorial effect of microRNAs in pathways
Vlachos, I. S., Kostoulas, N., Vergoulis, T., Georgakilas, G., Reczko, M., Maragkakis, M., Paraskevopoulou, M. D., Prionidis, K., Dalamagas, T., & Hatzigeorgiou, A. G. (2012) · Nucleic Acids Research · doi:10.1093/nar/gks494 · Cited by 526
Metabolomic and transcriptomic stress response of Escherichia coli
Jozefczuk, S., Klie, S., Catchpole, G., Szymanski, J., Cuadros‐Inostroza, A., Steinhauser, D., Selbig, J., & Willmitzer, L. (2010) · Molecular Systems Biology · doi:10.1038/msb.2010.18 · Cited by 504
Efficient Test and Visualization of Multi-Set Intersections
Wang, M., Zhao, Y., & Zhang, B. (2015) · Scientific Reports · doi:10.1038/srep16923 · Cited by 395
Schmollinger, S., Mühlhaus, T., Boyle, N. R., Blaby, I. K., Casero, D., Mettler, T., Moseley, J. L., Kropat, J., Sommer, F., Strenkert, D., et al. (2014) · The Plant Cell · doi:10.1105/tpc.113.122523 · Cited by 376
Genome-Wide Prediction of Metabolic Enzymes, Pathways, and Gene Clusters in Plants
Schläpfer, P., Zhang, P., Wang, C., Kim, T., Banf, M., Chae, L., Dreher, K., Chavali, A. K., Nilo-Poyanco, R., Bernard, T., et al. (2017) · Plant Physiology · doi:10.1104/pp.16.01942 · Cited by 376
Jalanka-Tuovinen, J., Salonen, A., Nikkilä, J., Immonen, O., Kekkonen, R., Lahti, L., Palva, A., & de Vos, W. M. (2011) · PLoS ONE · doi:10.1371/journal.pone.0023035 · Cited by 340
Gene-set approach for expression pattern analysis
Nam, D., & Kim, S.-Y. (2008) · Briefings in Bioinformatics · doi:10.1093/bib/bbn001 · Cited by 338
Personalized characterization of diseases using sample-specific networks
Liu, X., Wang, Y., Ji, H., Aihara, K., & Chen, L. (2016) · Nucleic Acids Research · doi:10.1093/nar/gkw772 · Cited by 317
Domazet-Lošo, T., & Tautz, D. (2010) · BMC Biology · doi:10.1186/1741-7007-8-66 · Cited by 311
Karp, P. D., Midford, P. E., Caspi, R., & Khodursky, A. (2021) · BMC Genomics · doi:10.1186/s12864-021-07502-8 · Cited by 266
Brunner, P. M., Suárez-Fariñas, M., He, H., Malik, K., Wen, H.-C., Gonzalez, J., Chan, T. C.-C., Estrada, Y., Zheng, X., Khattri, S., et al. (2017) · Scientific Reports · doi:10.1038/s41598-017-09207-z · Cited by 260
Specificity of Linear Motifs That Bind to a Common Mitogen-Activated Protein Kinase Docking Groove
Garai, Á., Zeke, A., Gógl, G., Törő, I., Fördős, F., Blankenburg, H., Bárkai, T., Varga, J., Alexa, A., Emig, D., et al. (2012) · Science Signaling · doi:10.1126/scisignal.2003004 · Cited by 177
Genetic architecture of plant stress resistance: Multi-trait genome-wide association mapping
Thoen, M. P. M., Davila Olivas, N. H., Kloth, K. J., Coolen, S., Huang, P., Aarts, M. G. M., Bac‐Molenaar, J. A., Bakker, J., Bouwmeester, H. J., Broekgaarden, C., et al. (2017) · New Phytologist · doi:10.1111/nph.14220 · Cited by 188
“3 Marker * Gene in LD Rivals et al. , 2007).”
Joint attention and brain functional connectivity in infants and toddlers
Eggebrecht, A. T., Elison, J. T., Feczko, E., Todorov, A., Wolff, J. J., Kandala, S., Adams, C. M., Snyder, A. Z., Lewis, J. D., Estes, A. M., et al. (2017) · Cerebral Cortex · doi:10.1093/cercor/bhw403 · Cited by 156
“Second, methods for enrichment analyses were adapted from those used in largescale genomic association studies (Rivals et al. 2007; Khatri et al. 2012; Backes et al. 2014).”
MethodChIP-Enrich: gene set enrichment testing for ChIP-seq data
Welch, R. P., Lee, C., Imbriano, P. M., Patil, S., Weymouth, T. E., Smith, R. A., Scott, L. J., & Sartor, M. A. (2014) · Nucleic Acids Research · doi:10.1093/nar/gku463 · Cited by 151
Identification of evolutionarily conserved gene networks mediating neurodegenerative dementia
Swarup, V., Hinz, F. I., Rexach, J. E., Noguchi, K.-I., Toyoshiba, H., Oda, A., Hirai, K., Sarkar, A., Seyfried, N. T., Cheng, C., et al. (2019) · Nature Medicine · doi:10.1038/s41591-018-0223-3 · Cited by 136
Sex differences in functional connectivity during fetal brain development
Wheelock, M. D., Hect, J. L., Hernandez-Andrade, E., Hassan, S. S., Romero, R., Eggebrecht, A. T., & Thomason, M. E. (2019) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2019.100632 · Cited by 126
A metabolomic and systems biology perspective on the brain of the fragile X syndrome mouse model
Davidovic, L., Navratil, V., Bonaccorso, C. M., Catania, M. V., Bardoni, B., & Dumas, M.-E. (2011) · Genome Research · doi:10.1101/gr.116764.110 · Cited by 118
Graze, R. M., McIntyre, L. M., Main, B. J., Wayne, M. L., & Nuzhdin, S. V. (2009) · Genetics · doi:10.1534/genetics.109.105957 · Cited by 100
Wren, J. D. (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp290 · Cited by 95
Thomason, M. E., Hect, J. L., Rauh, V. A., Trentacosta, C., Wheelock, M. D., Eggebrecht, A. T., Espinoza-Heredia, C., & Burt, S. A. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2019.02.017 · Cited by 94
“, (under review)), methods for enrichment analyses were adapted from those used in largescale genomic association studies (Backes et al., 2014; Khatri et al., 2012; Rivals et al., 2007).”
Rexach, J. E., Polioudakis, D., Yin, A., Swarup, V., Chang, T. S., Nguyen, T., Sarkar, A., Chen, L., Huang, J., Lin, L.-C., et al. (2020) · Cell Reports · doi:10.1016/j.celrep.2020.108398 · Cited by 94
Association of Prenatal Maternal Anxiety With Fetal Regional Brain Connectivity
De Asis-Cruz, J., Krishnamurthy, D., Zhao, L., Kapse, K., Vezina, G., Andescavage, N., Quistorff, J., Lopez, C., & Limperopoulos, C. (2020) · JAMA Network Open · doi:10.1001/jamanetworkopen.2020.22349 · Cited by 81
Phosphonate production by marine microbes: exploring new sources and potential function
Acker, M., Hogle, S. L., Berube, P. M., Hackl, T., Coe, A., Stepanauskas, R., Chisholm, S. W., & Repeta, D. J. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2113386119 · Cited by 76
Network control principles for identifying personalized driver genes in cancer
Guo, W.-F., Zhang, S.-W., Zeng, T., Akutsu, T., & Chen, L. (2020) · Briefings in Bioinformatics · doi:10.1093/bib/bbz089 · Cited by 44
Šestak, M. S., Božičević, V., Bakarić, R., Dunjko, V., & Domazet-Lošo, T. (2013) · Frontiers in Zoology · doi:10.1186/1742-9994-10-18 · Cited by 42
Navigating Transcriptomic Connectivity Mapping Workflows to Link Chemicals with Bioactivities
Shah, I., Bundy, J., Chambers, B., Everett, L. J., Haggard, D., Harrill, J., Judson, R. S., Nyffeler, J., & Patlewicz, G. (2022) · Chemical Research in Toxicology · doi:10.1021/acs.chemrestox.2c00245 · Cited by 19
Metadata
- Authors
- Rivals, I., Personnaz, L., Taing, L., & Potier, M.-C.
- Venue
- Bioinformatics
- Publisher
- Oxford University Press (OUP)
- Published
- 2006-12-20
- Volume
- 23
- Issue
- 4
- Pages
- 401-407
- ISSN
- 1367-4803 (ISSN-L)
- 1367-4811
- OpenAlex
- W2152274187
- Cited by
- 718
- References
- 41
- FWCI
- 7.61
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.