ChIP-Enrich: gene set enrichment testing for ChIP-seq data
Open accessThe DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Abstract
Gene set enrichment testing can enhance the biological interpretation of ChIP-seq data. Here, we develop a method, ChIP-Enrich, for this analysis which empirically adjusts for gene locus length (the length of the gene body and its surrounding non-coding sequence). Adjustment for gene locus length is necessary because it is often positively associated with the presence of one or more peaks and because many biologically defined gene sets have an excess of genes with longer or shorter gene locus lengths. Unlike alternative methods, ChIP-Enrich can account for the wide range of gene locus length-to-peak presence relationships (observed in ENCODE ChIP-seq data sets). We show that ChIP-Enrich has a well-calibrated type I error rate using permuted ENCODE ChIP-seq data sets; in contrast, two commonly used gene set enrichment methods, Fisher's exact test and the binomial test implemented in Genomic Regions Enrichment of Annotations Tool (GREAT), can have highly inflated type I error rates and biases in ranking. We identify DNA-binding proteins, including CTCF, JunD and glucocorticoid receptor α (GRα), that show different enrichment patterns for peaks closer to versus further from transcription start sites. We also identify known and potential new biological functions of GRα. ChIP-Enrich is available as a web interface (http://chip-enrich.med.umich.edu) and Bioconductor package.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“GO biological processes were ranked by HyperFdrQ and only GO terms made up of at least 5 genes were included. ChIP-seq data were also analyzed using ChIP-Enrich (Welch et al., 2014). GO terms with at least 5 genes were ranked by FDR.”
From Loss of epigenetic information as a cause of mammalian aging (2023) · cites this paper as Welch et al., 2014
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Subramanian, A., Tamayo, P., Mootha, V. K., Mukherjee, S., Ebert, B. L., Gillette, M. A., Paulovich, A., Pomeroy, S. L., Golub, T. R., Lander, E. S., et al. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0506580102 · Cited by 53,625
Systematic and integrative analysis of large gene lists using DAVID bioinformatics resources
Huang, D. W., Sherman, B. T., & Lempicki, R. A. (2009) · Nature Protocols · doi:10.1038/nprot.2008.211 · Cited by 35,890
Model-based Analysis of ChIP-Seq (MACS)
Zhang, Y., Liu, T., Meyer, C. A., Eeckhoute, J., Johnson, D. S., Bernstein, B. E., Nusbaum, C., Myers, R. M., Brown, M., Li, W., et al. (2008) · Genome Biology · doi:10.1186/gb-2008-9-9-r137 · Cited by 18,386
Generalized Additive Models: An Introduction with R
Wood, S. N. (2017) · doi:10.1201/9781315370279 · Cited by 13,852
Statistical significance for genomewide studies
Storey, J. D., & Tibshirani, R. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1530509100 · Cited by 9,692
A simulation study of the number of events per variable in logistic regression analysis
Peduzzi, P., Concato, J., Kemper, E., Holford, T. R., & Feinstein, A. R. (1996) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(96)00236-3 · Cited by 9,655 · cited 1×
“For testing in the manuscript and in our tool, we exclude GO terms with <10 genes as they have more limited power to detect significant results, and as a rule of thumb logistic regression requires at least 10 events for each explaining variable (26).”
MethodDAVID: Database for Annotation, Visualization, and Integrated Discovery
Dennis, G., Sherman, B. T., Hosack, D. A., Yang, J., Gao, W., Lane, H. C., & Lempicki, R. A. (2003) · Genome Biology · doi:10.1186/gb-2003-4-5-p3 · Cited by 9,327
Wood, S. N. (2011) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2010.00749.x · Cited by 7,537
Molecular signatures database (MSigDB) 3.0
Liberzon, A., Subramanian, A., Pinchback, R., Thorvaldsdóttir, H., Tamayo, P., & Mesirov, J. P. (2011) · Bioinformatics · doi:10.1093/bioinformatics/btr260 · Cited by 7,111
Gene ontology analysis for RNA-seq: accounting for selection bias
Young, M. D., Wakefield, M. J., Smyth, G. K., & Oshlack, A. (2010) · Genome Biology · doi:10.1186/gb-2010-11-2-r14 · Cited by 7,107
High-Resolution Profiling of Histone Methylations in the Human Genome
Barski, A., Cuddapah, S., Cui, K., Roh, T.-Y., Schones, D. E., Wang, Z., Wei, G., Chepelev, I., & Zhao, K. (2007) · Cell · doi:10.1016/j.cell.2007.05.009 · Cited by 6,845 · cited 1×
“(iii) We identified much stronger enrichment using ‘nearest TSS’ than ‘≤1 kb from TSS’ for H3K36me3 (Figure 3c), H3k79me2 and H4k20me1 (Supplementary Figure S9) which bind along gene bodies (39).”
MethodTopological domains in mammalian genomes identified by analysis of chromatin interactions
Dixon, J. R., Selvaraj, S., Yue, F., Kim, A., Li, Y., Shen, Y., Hu, M., Liu, J. S., & Ren, B. (2012) · Nature · doi:10.1038/nature11082 · Cited by 6,829 · cited 1×
“Although CTCF is a well-known insulator in intergenic regions, both CTCF binding and housekeeping genes are enriched in the boundary regions of genomic topological domains (40), and we see many of the same strongly enriched GO terms for CTCF binding ≤1 kb from a TSS D ow naded rom http/academ ic.”
BackgroundWood, S. N. (2006) · doi:10.1201/9781420010404 · Cited by 4,953
GREAT improves functional interpretation of cis-regulatory regions
McLean, C. Y., Bristor, D., Hiller, M., Clarke, S. L., Schaar, B. T., Lowe, C. B., Wenger, A. M., & Bejerano, G. (2010) · Nature Biotechnology · doi:10.1038/nbt.1630 · Cited by 4,502
Systematic determination of genetic network architecture
Tavazoie, S., Hughes, J. D., Campbell, M. J., Cho, R. J., & Church, G. M. (1999) · Nature Genetics · doi:10.1038/10343 · Cited by 2,507
ChIP-seq guidelines and practices of the ENCODE and modENCODE consortia
Landt, S. G., Marinov, G. K., Kundaje, A., Kheradpour, P., Pauli, F., Batzoglou, S., Bernstein, B. E., Bickel, P., Brown, J. B., Cayting, P., et al. (2012) · Genome Research · doi:10.1101/gr.136184.111 · Cited by 2,033
Guttman, M., Garber, M., Levin, J. Z., Donaghey, J., Robinson, J., Adiconis, X., Fan, L., Koziol, M. J., Gnirke, A., Nusbaum, C., et al. (2010) · Nature Biotechnology · doi:10.1038/nbt.1633 · Cited by 1,253
A systems biology approach for pathway level analysis
Draghici, S., Khatri, P., Tarca, A. L., Amin, K., Done, A., Voichita, C., Georgescu, C., & Romero, R. (2007) · Genome Research · doi:10.1101/gr.6202607 · Cited by 1,249
ChEA: transcription factor regulation inferred from integrating genome-wide ChIP-X experiments
Lachmann, A., Xu, H., Krishnan, J., Berger, S. I., Mazloom, A. R., & Ma'ayan, A. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btq466 · Cited by 1,029
Design and analysis of ChIP-seq experiments for DNA-binding proteins
Kharchenko, P. V., Tolstorukov, M. Y., & Park, P. J. (2008) · Nature Biotechnology · doi:10.1038/nbt.1508 · Cited by 916
Camera: a competitive gene set test accounting for inter-gene correlation
Wu, D., & Smyth, G. K. (2012) · Nucleic Acids Research · doi:10.1093/nar/gks461 · Cited by 891
On testing the significance of sets of genes
Efron, B., & Tibshirani, R. (2007) · The Annals of Applied Statistics · doi:10.1214/07-aoas101 · Cited by 798
Enrichment or depletion of a GO category within a class of genes: which test?
Rivals, I., Personnaz, L., Taing, L., & Potier, M.-C. (2007) · Bioinformatics · doi:10.1093/bioinformatics/btl633 · Cited by 718
Upton, G. J. G. (1992) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2982890 · Cited by 606
ROAST: rotation gene set tests for complex microarray experiments
Wu, D., Lim, E., Vaillant, F., Asselin-Labat, M.-L., Visvader, J. E., & Smyth, G. K. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btq401 · Cited by 560
Reddy, T. E., Pauli, F., Sprouse, R. O., Neff, N. F., Newberry, K. M., Garabedian, M. J., & Myers, R. M. (2009) · Genome Research · doi:10.1101/gr.097022.109 · Cited by 543
Segrè, A. V., DIAGRAM Consortium, MAGIC investigators, Groop, L., Mootha, V. K., Daly, M. J., & Altshuler, D. (2010) · PLoS Genetics · doi:10.1371/journal.pgen.1001058 · Cited by 463 · cited 1×
“Several approaches have been developed to adjust for locus length in ChIP-seq (12), RNA-seq (for example, GOseq (19)) and GWAS data (17,21).”
BackgroundGene Ontology Analysis of GWA Study Data Sets Provides Insights into the Biology of Bipolar Disorder
Holmans, P., Green, E. K., Pahwa, J. S., Ferreira, M. A. R., Purcell, S. M., Sklar, P., Owen, M. J., O'Donovan, M. C., & Craddock, N. (2009) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2009.05.011 · Cited by 378
Pathways to the analysis of microarray data
Curtis, R. K., Orešič, M., & Vidal-Puig, A. (2005) · Trends in Biotechnology · doi:10.1016/j.tibtech.2005.05.011 · Cited by 308
Direct Effect of Glucocorticoids on Lipolysis in Adipocytes
Xu, C., He, J., Jiang, H., Zu, L., Zhai, W., Pu, S., & Xu, G. (2009) · Molecular Endocrinology · doi:10.1210/me.2008-0464 · Cited by 291 · cited 2×
“However, because higher numbers of a bound DBP in a gene locus may exert stronger biological effects (49), the use of a model based on peak counts per gene, which accounts for extra variability and diverse locus length-to-peak count relationships, could be considered.”
BackgroundWang, J., Zhuang, J., Iyer, S., Lin, X.-Y., Greven, M. C., Kim, B.-H., Moore, J., Pierce, B. G., Dong, X., Virgil, D., et al. (2013) · Nucleic Acids Research · doi:10.1093/nar/gks1221 · Cited by 279
Evolution and functional classification of vertebrate gene deserts
Ovcharenko, I., Loots, G. G., Nobrega, M. A., Hardison, R. C., Miller, W., & Stubbs, L. (2005) · Genome Research · doi:10.1101/gr.3015505 · Cited by 237
Negative Glucocorticoid Receptor Response Elements and their Role in Glucocorticoid Action
A., D., & T., H. (2004) · Current Pharmaceutical Design · doi:10.2174/1381612043383601 · Cited by 225
Canudas, S., & Smith, S. (2009) · Journal of Cell Biology · doi:10.1083/jcb.200903096 · Cited by 186
Yu, C.-Y., Mayba, O., Lee, J. V., Tran, J., Harris, C., Speed, T. P., & Wang, J.-C. (2010) · PLoS ONE · doi:10.1371/journal.pone.0015188 · Cited by 180
Sartor, M. A., Leikauf, G. D., & Medvedovic, M. (2009) · Bioinformatics · doi:10.1093/bioinformatics/btn592 · Cited by 176
Self-citationTesting the goodness of fit of the binomial distribution
TARONE, R. E. (1979) · Biometrika · doi:10.1093/biomet/66.3.585 · Cited by 161
ConceptGen: a gene set enrichment and gene set relation mapping tool
Sartor, M. A., Mahavisno, V., Keshamouni, V. G., Cavalcoli, J., Wright, Z., Karnovsky, A., Kuick, R., Jagadish, H. V., Mirel, B., Weymouth, T., et al. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btp683 · Cited by 161
Self-citationMultiple facets of junD gene expression are atypical among AP-1 family members
Hernandez, J. M., Floyd, D. H., Weilbaecher, K. N., Green, P. L., & Boris‐Lawrie, K. (2008) · Oncogene · doi:10.1038/onc.2008.120 · Cited by 157
Small, G. R., Hadoke, P. W. F., Sharif, I., Dover, A. R., Armour, D., Kenyon, C. J., Gray, G. A., & Walker, B. R. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0500641102 · Cited by 118
From hematopoietic progenitors to B cells: mechanisms of lineage restriction and commitment
Ramírez, J., Lukin, K., & Hagman, J. (2010) · Current Opinion in Immunology · doi:10.1016/j.coi.2010.02.003 · Cited by 114
Onto-Tools: new additions and improvements in 2006
Khatri, P., Voichiţa, C., Kattan, K. A., Ansari, N., Khatri, A., Georgescu, C., Tarca, A. L., & Drăghici, S. (2007) · Nucleic Acids Research · doi:10.1093/nar/gkm327 · Cited by 105
LRpath analysis reveals common pathways dysregulated via DNA methylation across cancer types
Kim, J. H., Karnovsky, A., Mahavisno, V., Weymouth, T. E., Pande, M., Dolinoy, D. C., Rozek, L. S., & Sartor, M. A. (2012) · BMC Genomics · doi:10.1186/1471-2164-13-526 · Cited by 103
Self-citationWakasugi, T., Izumi, H., Uchiumi, T., Suzuki, H., Arao, T., Nishio, K., & Kohno, K. (2007) · Oncogene · doi:10.1038/sj.onc.1210326 · Cited by 63
Amoli, M., Carthy, D., Platt, H., & Ollier, W. (2008) · International Journal of Epidemiology · doi:10.1093/ije/dym285 · Cited by 53
The Werner syndrome protein at the crossroads of DNA repair and apoptosis
Comai, L., & Li, B. (2004) · Mechanisms of Ageing and Development · doi:10.1016/j.mad.2004.06.004 · Cited by 48
Ayalasomayajula, S. P., Ashton, P., & Kompella, U. B. (2009) · Journal of Ocular Pharmacology and Therapeutics · doi:10.1089/jop.2008.0090 · Cited by 44
Taher, L., & Ovcharenko, I. (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp043 · Cited by 29
Chromodomain helicase DNA‐binding protein 2 affects the repair of X‐ray and UV‐Induced DNA damage
Rajagopalan, S., Nepa, J., & Venkatachalam, S. (2011) · Environmental and Molecular Mutagenesis · doi:10.1002/em.20674 · Cited by 21
Joshi, A., Hannah, R., Diamanti, E., & Göttgens, B. (2012) · Experimental Hematology · doi:10.1016/j.exphem.2012.11.008 · Cited by 20
Vertebrate WRNIP1 and BLM are required for efficient maintenance of genome stability
Hayashi, T., Seki, M., Inoue, E., Yoshimura, A., Kusa, Y., Tada, S., & Enomoto, T. (2008) · Genes & Genetic Systems · doi:10.1266/ggs.83.95 · Cited by 17
Cited by
Loss of epigenetic information as a cause of mammalian aging
Yang, J.-H., Hayano, M., Griffin, P. T., Amorim, J. A., Bonkowski, M. S., Apostolides, J. K., Salfati, E. L., Blanchette, M., Munding, E. M., Bhakta, M., et al. (2023) · Cell · doi:10.1016/j.cell.2022.12.027 · Cited by 643
Ulgen, E., Ozisik, O., & Sezerman, O. U. (2019) · Frontiers in Genetics · doi:10.3389/fgene.2019.00858 · Cited by 469
Methods for ChIP-seq analysis: A practical workflow and advanced applications
Nakato, R., & Sakata, T. (2021) · Methods · doi:10.1016/j.ymeth.2020.03.005 · Cited by 267
Adelman, E. R., Huang, H.-T., Roisman, A., Olsson, A., Colaprico, A., Qin, T., Lindsley, R. C., Bejar, R., Salomonis, N., Grimes, H. L., et al. (2019) · Cancer Discovery · doi:10.1158/2159-8290.cd-18-1474 · Cited by 221
Undisclosed, unmet and neglected challenges in multi-omics studies
Tarazona, S., Arzalluz-Luque, A., & Conesa, A. (2021) · Nature Computational Science · doi:10.1038/s43588-021-00086-z · Cited by 176
Metadata
- Authors
- Welch, R. P., Lee, C., Imbriano, P. M., Patil, S., Weymouth, T. E., Smith, R. A., Scott, L. J., & Sartor, M. A.
- Affiliations
- University of Michigan (US)
- Corresponding author
- Scott, Laura J.
- Sartor, Maureen A.
- Venue
- Nucleic Acids Research
- Publisher
- Oxford University Press (OUP)
- Published
- 2014-05-30
- Volume
- 42
- Issue
- 13
- Pages
- e105-e105
- ISSN
- 0305-1048 (ISSN-L)
- 1362-4962
- PMC
- PMC4117744
- OpenAlex
- W2168131180
- Cited by
- 151
- References
- 52
- Citations by year
- 2026: 10 · 2025: 11 · 2024: 19 · 2023: 16 · 2022: 14 · 2021: 10 · 2020: 16 · 2019: 16 · 2018: 14 · 2017: 4 · 2016: 11 · 2015: 9 · 2014: 1
- FWCI
- 3.42
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- Nucleic Acids Research (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- National Institutes of Health (ES017885, DK062370)
- National Human Genome Research Institute (R56HG000376, R01HG000376, T32HG000040)
- National Cancer Institute (T32CA140044, R01CA158286)
- National Institute of Diabetes and Digestive and Kidney Diseases (DK-062370, R01DK062370)
- National Institute of Environmental Health Sciences (P30ES017885)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Bioinformatics and Genomic Networks
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Genomics and Chromatin Dynamics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Genomics and Phylogenetic Studies
- Keywords
- gene set enrichment analysis, ChIP-seq, type I error rate, GREAT, Fisher's exact test, binomial test, DNA-binding proteins, CTCF, JunD, glucocorticoid receptor alpha, transcription start sites, peak calling, ENCODE
- MeSH terms
- DNA-Binding Proteins, Genes, Receptors, Glucocorticoid, Logistic Models, Sequence Analysis, DNA, Chromatin Immunoprecipitation, Genetic Loci
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.