Large-Scale Quality Analysis of Published ChIP-seq Data
Open accessThe DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Abstract
ChIP-seq has become the primary method for identifying in vivo protein–DNA interactions on a genome-wide scale, with nearly 800 publications involving the technique appearing in PubMed as of December 2012. Individually and in aggregate, these data are an important and information-rich resource. However, uncertainties about data quality confound their use by the wider research community. Recently, the Encyclopedia of DNA Elements (ENCODE) project developed and applied metrics to objectively measure ChIP-seq data quality. The ENCODE quality analysis was useful for flagging datasets for closer inspection, eliminating or replacing poor data, and for driving changes in experimental pipelines. There had been no similarly systematic quality analysis of the large and disparate body of published ChIP-seq profiles. Here, we report a uniform analysis of vertebrate transcription factor ChIP-seq datasets in the Gene Expression Omnibus (GEO) repository as of April 1, 2012. The majority (55%) of datasets scored as being highly successful, but a substantial minority (20%) were of apparently poor quality, and another ∼25% were of intermediate quality. We discuss how different uses of ChIP-seq data are affected by specific aspects of data quality, and we highlight exceptional instances for which the metric values should not be taken at face value. Unexpectedly, we discovered that a significant subset of control datasets (i.e., no immunoprecipitation and mock immunoprecipitation samples) display an enrichment structure similar to successful ChIP-seq data. This can, in turn, affect peak calling and data interpretation. Published datasets identified here as high-quality comprise a large group that users can draw on for large-scale integrated analysis. In the future, ChIP-seq quality assessment similar to that used here could guide experimentalists at early stages in a study, provide useful input in the publication process, and be used to stratify ChIP-seq data for different community-wide uses.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
High-Resolution Profiling of Histone Methylations in the Human Genome
Barski, A., Cuddapah, S., Cui, K., Roh, T.-Y., Schones, D. E., Wang, Z., Wei, G., Chepelev, I., & Zhao, K. (2007) · Cell · doi:10.1016/j.cell.2007.05.009 · Cited by 6,845 · cited 1×
“Ultimately, the entire genome became accessible with the advent of high-throughput sequencing and the development of ChIP-seq (Johnson et al. 2007; Barski et al. 2007; Mikkelsen et al. 2007; Robertson et al. 2007).”
BackgroundHuman DNA methylomes at base resolution show widespread epigenomic differences
Lister, R., Pelizzola, M., Dowen, R. H., Hawkins, R. D., Hon, G., Tonti-Filippini, J., Nery, J. R., Lee, L., Ye, Z., Ngo, Q.-M., et al. (2009) · Nature · doi:10.1038/nature08514 · Cited by 4,673 · cited 1×
“2002).”
Genome-wide maps of chromatin state in pluripotent and lineage-committed cells
Mikkelsen, T. S., Ku, M., Jaffe, D. B., Issac, B., Lieberman, E., Giannoukos, G., Alvarez, P., Brockman, W., Kim, T.-K., Koche, R. P., et al. (2007) · Nature · doi:10.1038/nature06008 · Cited by 4,129 · cited 1×
“Ultimately, the entire genome became accessible with the advent of high-throughput sequencing and the development of ChIP-seq (Johnson et al. 2007; Barski et al. 2007; Mikkelsen et al. 2007; Robertson et al. 2007).”
BackgroundWidespread transcription at neuronal activity-regulated enhancers
Kim, T.-K., Hemberg, M., Gray, J. M., Costa, A. M., Bear, D. M., Wu, J., Harmin, D. A., Laptewicz, M., Barbara-Haley, K., Kuersten, S., et al. (2010) · Nature · doi:10.1038/nature09033 · Cited by 2,450
A unique chromatin signature uncovers early developmental enhancers in humans
Rada-Iglesias, A., Bajpai, R., Swigut, T., Brugmann, S. A., Flynn, R. A., & Wysocka, J. (2011) · Nature · doi:10.1038/nature09692 · Cited by 2,233
Mediator and cohesin connect gene expression and chromatin architecture
Kagey, M. H., Newman, J. J., Bilodeau, S., Zhan, Y., Orlando, D. A., van Berkum, N. L., Ebmeier, C. C., Goossens, J., Rahl, P. B., Levine, S. S., et al. (2010) · Nature · doi:10.1038/nature09380 · Cited by 1,939
ChIP-seq accurately predicts tissue-specific activity of enhancers
Visel, A., Blow, M. J., Li, Z., Zhang, T., Akiyama, J. A., Holt, A., Plajzer-Frick, I., Shoukry, M., Wright, C., Chen, F., et al. (2009) · Nature · doi:10.1038/nature07730 · Cited by 1,639
Robertson, G., Hirst, M., Bainbridge, M., Bilenky, M., Zhao, Y., Zeng, T., Euskirchen, G., Bernier, B., Varhol, R., Delaney, A., et al. (2007) · Nature Methods · doi:10.1038/nmeth1068 · Cited by 1,454 · cited 3×
“2002).”
BackgroundMethodDNA-binding factors shape the mouse methylome at distal regulatory regions
Stadler, M. B., Murr, R., Burger, L., Ivanek, R., Lienert, F., Schöler, A., Nimwegen, E. V., Wirbelauer, C., Oakeley, E. J., Gaidatzis, D., et al. (2011) · Nature · doi:10.1038/nature10716 · Cited by 1,383
Regulation of circadian behaviour and metabolism by REV-ERB-α and REV-ERB-β
Cho, H., Zhao, X., Hatori, M., Yu, R. T., Barish, G. D., Lam, M. T., Chong, L.-W., DiTacchio, L., Atkins, A. R., Glass, C. K., et al. (2012) · Nature · doi:10.1038/nature11048 · Cited by 1,037
Cited by
An atlas of dynamic chromatin landscapes in mouse fetal development
Gorkin, D. U., Barozzi, I., Zhao, Y., Zhang, Y., Huang, H., Lee, A. Y., Li, B., Chiou, J., Wildberg, A., Ding, B., et al. (2020) · Nature · doi:10.1038/s41586-020-2093-3 · Cited by 389
Identifying and mitigating bias in next-generation sequencing methods for chromatin biology
Meyer, C. A., & Liu, X. S. (2014) · Nature Reviews Genetics · doi:10.1038/nrg3788 · Cited by 338
Zhang, C., Chen, L., Peng, D., Jiang, A., He, Y., Zeng, Y., Xie, C., Zhou, H., Luo, X., Liu, H., et al. (2020) · Molecular Cell · doi:10.1016/j.molcel.2020.06.017 · Cited by 331
Transcriptome and epigenome landscape of human cortical development modeled in organoids
Amiri, A., Coppola, G., Scuderi, S., Wu, F., Roychowdhury, T., Liu, F., Pochareddy, S., Shin, Y., Safi, A., Song, L., et al. (2018) · Science · doi:10.1126/science.aat6720 · Cited by 307
An interactive environment for agile analysis and visualization of ChIP-sequencing data
Lerdrup, M., Johansen, J. V., Agrawal-Singh, S., & Hansen, K. (2016) · Nature Structural & Molecular Biology · doi:10.1038/nsmb.3180 · Cited by 274
Metadata
- Authors
- Marinov, G. K., Kundaje, A., Park, P. J., & Wold, B. J.
- Venue
- G3 Genes|Genomes|Genetics
- Publisher
- Oxford University Press (OUP)
- Published
- 2014-02-01
- Volume
- 4
- Issue
- 2
- Pages
- 209-223
- ISSN
- 2160-1836 (ISSN-L)
- OpenAlex
- W2109906618
- Cited by
- 147
- References
- 33
- FWCI
- 4.30
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Large-Scale Quality Analysis of Published ChIP-seq Data. https://app.cochat.ai/papers/10.1534/g3.113.008680
- The paper
- Marinov, G. K., Kundaje, A., Park, P. J., & Wold, B. J. (2014). Large-Scale Quality Analysis of Published ChIP-seq Data. G3 Genes|Genomes|Genetics. https://doi.org/10.1534/g3.113.008680
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.