Assessing Computational Methods of Cis-Regulatory Module Prediction
Open accessThe DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
Computational methods attempting to identify instances of cis-regulatory modules (CRMs) in the genome face a challenging problem of searching for potentially interacting transcription factor binding sites while knowledge of the specific interactions involved remains limited. Without a comprehensive comparison of their performance, the reliability and accuracy of these tools remains unclear. Faced with a large number of different tools that address this problem, we summarized and categorized them based on search strategy and input data requirements. Twelve representative methods were chosen and applied to predict CRMs from the Drosophila CRM database REDfly, and across the human ENCODE regions. Our results show that the optimal choice of method varies depending on species and composition of the sequences in question. When discriminating CRMs from non-coding regions, those methods considering evolutionary conservation have a stronger predictive power than methods designed to be run on a single genome. Different CRM representations and search strategies rely on different CRM properties, and different methods can complement one another. For example, some favour homotypical clusters of binding sites, while others perform best on short CRMs. Furthermore, most methods appear to be sensitive to the composition and structure of the genome to which they are applied. We analyze the principal features that distinguish the methods that performed well, identify weaknesses leading to poor performance, and provide a guide for users. We also propose key considerations for the development and evaluation of future CRM-prediction methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Heintzman, N. D., Stuart, R. K., Hon, G., Fu, Y., Ching, C. W., Hawkins, R. D., Barrera, L. O., Van Calcar, S., Qu, C., Ching, K. A., et al. (2007) · Nature Genetics · doi:10.1038/ng1966 · Cited by 3,398 · cited 1×
“Recently, other types of information have been used to assist the CRM prediction, such as the DNA double helix structure profile [72], chromatin structure and histone modification [73], and chromatin immunoprecipitation followed by microarray analysis (ChIP-chip) [74] or chromatin immunoprecipitation followed by high-…”
BackgroundHistone modifications at human enhancers reflect global cell-type-specific gene expression
Heintzman, N. D., Hon, G. C., Hawkins, R. D., Kheradpour, P., Stark, A., Harp, L. F., Ye, Z., Lee, L. K., Stuart, R. K., Ching, C. W., et al. (2009) · Nature · doi:10.1038/nature07829 · Cited by 2,533 · cited 1×
“Beyond identifying CRM locations, the future focus will also turn to measuring and predicting spatio-temporal cis-regulatory activity [74,78,79].”
BackgroundEvolution of genes and genomes on the Drosophila phylogeny
Drosophila 12 Genomes Consortium (2007) · Nature · doi:10.1038/nature06341 · Cited by 2,010 · cited 1×
“These raw multiple alignments for comparative analysis were produced by Colin Dewey in Lior Pachter’s group at UC Berkeley by their multiple-sequence aligner – MAVID [47], based on the first freeze of all the comparative assemblies of 12 Drosophila genomes in December 2005 and January 2006 [80].”
MethodWeintraub, H., & Groudine, M. (1976) · Science · doi:10.1126/science.948749 · Cited by 1,809 · cited 1×
“Certainly this assessment and analysis are also only based on the available annotations, such as the cell type dependant DNaseI hypersensitive sites [70] we used as potential CRMs, which mark the chromatin regions accessible to all types of proteins but not only limited to transcription factors.”
MethodChIP-seq accurately predicts tissue-specific activity of enhancers
Visel, A., Blow, M. J., Li, Z., Zhang, T., Akiyama, J. A., Holt, A., Plajzer-Frick, I., Shoukry, M., Wright, C., Chen, F., et al. (2009) · Nature · doi:10.1038/nature07730 · Cited by 1,639 · cited 1×
“Recently, other types of information have been used to assist the CRM prediction, such as the DNA double helix structure profile [72], chromatin structure and histone modification [73], and chromatin immunoprecipitation followed by microarray analysis (ChIP-chip) [74] or chromatin immunoprecipitation followed by high-…”
BackgroundLAGAN and Multi-LAGAN: Efficient tools for large-scale multiple alignment of genomic DNA
Brudno, M., Do, C. B., Cooper, G. M., Kim, M. F., Davydov, E., Program, N. C. S., Green, E. D., Sidow, A., & Batzoglou, S. (2003) · Genome Research · doi:10.1101/gr.926603 · Cited by 1,115
Chance caught on the wing: cis-regulatory evolution and the origin of pigment patterns in Drosophila
Gompel, N., Prud'homme, B., Wittkopp, P. J., Kassner, V. A., & Carroll, S. B. (2005) · Nature · doi:10.1038/nature03235 · Cited by 646
Repeated morphological evolution through cis-regulatory changes in a pleiotropic gene
Prud'homme, B., Gompel, N., Rokas, A., Kassner, V. A., Williams, T. M., Yeh, S.-D., True, J. R., & Carroll, S. B. (2006) · Nature · doi:10.1038/nature04597 · Cited by 507 · cited 1×
“In a later study [6] they showed the creation and destruction of distinct regulatory elements of same gene can lead to a same morphological change.”
BackgroundBergman, C. M., & Kreitman, M. (2001) · Genome Research · doi:10.1101/gr.178701 · Cited by 165
Moses, A. M., Chiang, D. Y., Pollard, D. A., Iyer, V. N., & Eisen, M. B. (2004) · Genome Biology · doi:10.1186/gb-2004-5-12-r98 · Cited by 153
Genome-wide prediction of transcription factor binding sites using an integrated model
Won, K.-J., Ren, B., & Wang, W. (2010) · Genome Biology · doi:10.1186/gb-2010-11-1-r7 · Cited by 116 · cited 1×
“[77] integrated strong Histone H3 Lys 4 methylations (H3K4me1/2/3) signals together with sequence affinity for transcription factor binding sites into one hidden Markov model to characterize regulatory regions on mouse embryonic stem cells.”
Background
Cited by
iRegulon: From a Gene List to a Gene Regulatory Network Using Large Motif and Track Collections
Janky, R., Verfaillie, A., Imrichová, H., Van de Sande, B., Standaert, L., Christiaens, V., Hulselmans, G., Herten, K., Naval Sanchez, M., Potier, D., et al. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003731 · Cited by 900
Kheradpour, P., Ernst, J., Melnikov, A., Rogov, P., Wang, L., Zhang, X., Alston, J., Mikkelsen, T. S., & Kellis, M. (2013) · Genome Research · doi:10.1101/gr.144899.112 · Cited by 315
Multiple sequence alignment modeling: Methods and applications
Chatzou, M., Magis, C., Chang, J.-M., Kemena, C., Bussotti, G., Erb, I., & Notredame, C. (2016) · Briefings in Bioinformatics · doi:10.1093/bib/bbv099 · Cited by 229
Interpretation of deep learning in genomics and epigenomics
Talukder, A., Barham, C., Li, X., & Hu, H. (2021) · Briefings in Bioinformatics · doi:10.1093/bib/bbaa177 · Cited by 142
Metadata
- Authors
- Su, J., Teichmann, S. A., & Down, T. A.
- Venue
- PLoS Computational Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2010-12-02
- Volume
- 6
- Issue
- 12
- Pages
- e1001020
- ISSN
- 1553-734X (ISSN-L)
- 1553-7358
- OpenAlex
- W1976148686
- Cited by
- 76
- References
- 11
- FWCI
- 3.66
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.