The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.
Evaluation of methods for modeling transcription factor sequence specificity
Open accessAbstract
Genomic analyses often involve scanning for potential transcription factor (TF) binding sites using models of the sequence specificity of DNA binding proteins. Many approaches have been developed to model and learn a protein's DNA-binding specificity, but these methods have not been systematically compared. Here we applied 26 such approaches to in vitro protein binding microarray data for 66 mouse TFs belonging to various families. For nine TFs, we also scored the resulting motif models on in vivo data, and found that the best in vitro-derived motifs performed similarly to motifs derived from the in vivo data. Our results indicate that simple models based on mononucleotide position weight matrices trained by the best methods perform similarly to more complex models for most TFs examined, but fall short in specific cases (<10% of the TFs examined here). In addition, the best-performing motifs typically have relatively low information content, consistent with widespread degeneracy in eukaryotic TF sequence preferences.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“and is instead consistent with recent observations that inhibiting p300 catalytic activity actually stabilizes interactions with chromatin51,52.”
From Single-molecule states link transcription factor binding to gene expression (2024) · cites this paper as [52]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
The Pfam Protein Families Database
Bateman, A. G. (2002) · Nucleic Acids Research · doi:10.1093/nar/30.1.276 · Cited by 14,075
WebLogo: A Sequence Logo Generator: Figure 1Preprint
Crooks, G. E., Hon, G. C., Chandonia, J., & Brenner, S. E. (2004) · Genome Research · doi:10.1101/gr.849004 · Cited by 12,418
Fitting a mixture model by expectation maximization to discover motifs in biopolymers.
Bailey, T. L., & Elkan, C. (1994) · PubMed · Cited by 4,982
Sequence logos: a new way to display consensus sequences
Schneider, T. D., & Stephens, R. M. (1990) · Nucleic Acids Research · doi:10.1093/nar/18.20.6097 · Cited by 3,354
The Pfam protein families database
Finn, R. D., Mistry, J., Tate, J., Coggill, P., Heger, A., Pollington, J. E., Gavin, O. L., Gunasekaran, P., Ceric, G., Forslund, K., et al. (2010) · Nucleic Acids Research · doi:10.1093/nar/gkp985 · Cited by 2,694
MEME-ChIP: motif analysis of large DNA datasets
Machanick, P., & Bailey, T. L. (2011) · Bioinformatics · doi:10.1093/bioinformatics/btr189 · Cited by 1,815
A NEW GENERATION OF HOMOLOGY SEARCH TOOLS BASED ON PROBABILISTIC INFERENCE
Eddy, S. R. (2009) · International Conference on Genome Informatics (GIW) · doi:10.1142/9781848165632_0019 · Cited by 1,275
NCBI GEO: archive for functional genomics data sets--10 years on
Barrett, T., Troup, D. B., Wilhite, S. E., Ledoux, P., Evangelista, C., Kim, I. F., Tomashevsky, M., Marshall, K. A., Phillippy, K., Sherman, P. M., et al. (2010) · Nucleic Acids Research · doi:10.1093/nar/gkq1184 · Cited by 1,127
Diversity and Complexity in DNA Recognition by Transcription Factors
Badis, G., Berger, M., Philippakis, A. A., Talukder, S., Gehrke, A. R., Jaeger, S., Chan, E. T., Metzler, G., Vedenko, A., Chen, X., et al. (2009) · Science · doi:10.1126/science.1162327 · Cited by 1,031
Self-citationThe UCSC Genome Browser database: extensions and updates 2013
Meyer, L. R., Zweig, A. S., Hinrichs, A. S., Karolchik, D., Kuhn, R. M., Wong, M., Sloan, C. A., Rosenbloom, K. R., Roe, G. R., Rhead, B. L., et al. (2012) · Nucleic Acids Research · doi:10.1093/nar/gks1048 · Cited by 901
Comprehensive Genome-wide Protein-DNA Interactions Detected at Single-Nucleotide Resolution
Rhee, H. S., & Pugh, B. F. (2011) · Cell · doi:10.1016/j.cell.2011.11.013 · Cited by 779
Selection of DNA binding sites by regulatory proteins
Berg, O. G., & von Hippel, P. H. (1987) · Journal of Molecular Biology · doi:10.1016/0022-2836(87)90354-8 · Cited by 754
Berger, M. F., Philippakis, A., Qureshi, A. M., He, F. S., Estep, P. W., & Bulyk, M. L. (2006) · Nature Biotechnology · doi:10.1038/nbt1246 · Cited by 685
Self-citationUse of the ‘Perceptron’ algorithm to distinguish translational initiation sites in E. coli
Stormo, G. D., Schneider, T. D., Gold, L., & Ehrenfeucht, A. (1982) · Nucleic Acids Research · doi:10.1093/nar/10.9.2997 · Cited by 651
Variation in Homeodomain DNA Binding Revealed by High-Resolution Analysis of Sequence Preferences
Berger, M. F., Badis, G., Gehrke, A. R., Talukder, S., Philippakis, A. A., Peña-Castillo, L., Alleyne, T. M., Mnaimneh, S., Botvinnik, O. B., Chan, E. T., et al. (2008) · Cell · doi:10.1016/j.cell.2008.05.024 · Cited by 606
Self-citationA systems approach to measuring the binding energy landscapes of transcription factors.
Maerkl, S. J., & Quake, S. R. (2007) · Science · doi:10.1126/science.1131007 · Cited by 584
Genome-wide analysis of ETS-family DNA-binding in vitro and in vivo
Wei, G., Badis, G., Berger, M. F., Kivioja, T., Palin, K., Enge, M., Bonke, M., Jolma, A., Varjosalo, M., Gehrke, A. R., et al. (2010) · The EMBO Journal · doi:10.1038/emboj.2010.106 · Cited by 568
Self-citationCofactor Binding Evokes Latent Differences in DNA Binding Specificity between Hox Proteins
Slattery, M. G., Riley, T., Liu, P., Abe, N., Gomez-Alcala, P., Dror, I., Zhou, T., Rohs, R., Honig, B. H., Bussemaker, H. J., et al. (2011) · Cell · doi:10.1016/j.cell.2011.10.053 · Cited by 497
Self-citationBadis, G., Chan, E. T., van Bakel, H., Peña‐Castillo, L., Tillo, D., Tsui, K., Carlson, C. D., Gossett, A. J., Hasinoff, M. J., Warren, C. L., et al. (2008) · Molecular Cell · doi:10.1016/j.molcel.2008.11.020 · Cited by 472
Self-citationPredicting expression patterns from regulatory sequence in Drosophila segmentation
Segal, E., Raveh-Sadka, T., Schroeder, M., Unnerstall, U., & Gaul, U. (2008) · Nature · doi:10.1038/nature06496 · Cited by 466
Jolma, A., Kivioja, T., Toivonen, J., Cheng, L., Wei, G., Enge, M., Taipale, M., Vaquerizas, J. M., Yan, J., Sillanpää, M. J., et al. (2010) · Genome Research · doi:10.1101/gr.100552.109 · Cited by 441
Self-citationTowards a rigorous assessment of systems biology models: the DREAM3 challenges
Prill, R. J., Marbach, D., Saez-Rodriguez, J., Sorger, P. K., Alexopoulos, L. G., Xue, X., Clarke, N. D., Altan-Bonnet, G., & Stolovitzky, G. (2010) · PLoS ONE · doi:10.1371/journal.pone.0009202 · Cited by 439
Self-citationHigh-resolution DNA-binding specificity analysis of yeast transcription factorsPreprint
Zhu, C., Byers, K. J. R. P., McCord, R. P., Shi, Z., Berger, M. F., Newburger, D. E., Saulrieta, K., Smith, Z., Shah, M. V., Radhakrishnan, M., et al. (2009) · Genome Research · doi:10.1101/gr.090233.108 · Cited by 402
Self-citationDialogue on Reverse‐Engineering Assessment and Methods
Stolovitzky, G. A., Monroe, D., & Califano, A. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1407.021 · Cited by 377
Self-citationThe UCSC Genome Browser database: extensions and updates 2011
Dreszer, T. R., Karolchik, D., Zweig, A. S., Hinrichs, A. S., Raney, B. J., Kuhn, R. M., Meyer, L. R., Wong, M., Sloan, C. A., Rosenbloom, K. R., et al. (2011) · Nucleic Acids Research · doi:10.1093/nar/gkr1055 · Cited by 349
Parkinson, H., Sarkans, U., Kolesnikov, N. N., Abeygunawardena, N., Burdett, T., Dyląg, M., Emam, I., Farne, A., Hastings, E., Holloway, E., et al. (2010) · Nucleic Acids Research · doi:10.1093/nar/gkq1040 · Cited by 337
Kinney, J. B., Murugan, A., Callan, C. G., & Cox, E. C. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1004290107 · Cited by 334
Determining the specificity of protein–DNA interactions
Stormo, G. D., & Zhao, Y. (2010) · Nature Reviews Genetics · doi:10.1038/nrg2845 · Cited by 314
Self-citationStatistical mechanical modeling of genome-wide transcription factor occupancy data by MatrixREDUCE
Foat, B. C., Morozov, A. V., & Bussemaker, H. J. (2006) · Bioinformatics · doi:10.1093/bioinformatics/btl223 · Cited by 269
Self-citationExtensive low-affinity transcriptional interactions in the yeast genomePreprint
Tanay, A. (2006) · Genome Research · doi:10.1101/gr.5113606 · Cited by 239
Defining the sequence-recognition profile of DNA-binding molecules
Warren, C. L., Kratochvil, N. C. S., Hauschild, K. E., Foister, S., Brezinski, M. L., Dervan, P. B., Phillips, G. N., & Ansari, A. Z. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0509843102 · Cited by 230
A bacterial one-hybrid system for determining the DNA-binding specificity of transcription factors
Meng, X., Brodsky, M. H., & Wolfe, S. A. (2005) · Nature Biotechnology · doi:10.1038/nbt1120 · Cited by 215
Inferring Binding Energies from Selected Binding Sites
Zhao, Y., Granas, D. M., & Stormo, G. D. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000590 · Cited by 208
Self-citation[13] Consensus patterns in DNA
Stormo, G. D. (1990) · Methods in enzymology on CD-ROM/Methods in enzymology · doi:10.1016/0076-6879(90)83015-2 · Cited by 204
Lessons from the DREAM2 Challenges
Stolovitzky, G. A., Prill, R. J., & Califano, A. (2009) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.2009.04497.x · Cited by 200
Self-citationDirect measurement of DNA affinity landscapes on a high-throughput sequencing instrument
Nutiu, R., Friedman, R. C., Luo, S., Khrebtukova, I., Silva, D., Li, R., Zhang, L., Schroth, G. P., & Burge, C. B. (2011) · Nature Biotechnology · doi:10.1038/nbt.1882 · Cited by 194
YeTFaSCo: a database of evaluated yeast transcription factor sequence specificities
de Boer, C. G., & Hughes, T. (2011) · Nucleic Acids Research · doi:10.1093/nar/gkr993 · Cited by 191
Self-citationFordyce, P. M., Gerber, D., Tran, D., Zheng, J., Li, H., DeRisi, J. L., & Quake, S. R. (2010) · Nature Biotechnology · doi:10.1038/nbt.1675 · Cited by 185
Linhart, C., Halperin, Y., & Ron Shamir, A. (2008) · Genome Research · doi:10.1101/gr.076117.108 · Cited by 184
Zhao, Y., & Stormo, G. D. (2011) · Nature Biotechnology · doi:10.1038/nbt.1893 · Cited by 174
Self-citationDeep and wide digging for binding motifs in ChIP-Seq data
Kulakovskiy, I. V., Boeva, V., Favorov, A. V., & Makeev, V. J. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btq488 · Cited by 160
Zhao, Y., Ruan, S., Pandey, M., & Stormo, G. D. (2012) · Genetics · doi:10.1534/genetics.112.138685 · Cited by 137
Self-citationZykovich, A., Korf, I. F., & Segal, D. J. (2009) · Nucleic Acids Research · doi:10.1093/nar/gkp802 · Cited by 131
A Feature-Based Approach to Modeling Protein–DNA Interactions
Sharon, E., Lubliner, S., & Segal, E. (2008) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000154 · Cited by 103
Siddharthan, R. (2010) · PLoS ONE · doi:10.1371/journal.pone.0009722 · Cited by 103
Finding Short DNA Motifs Using Permuted Markov Models
Zhao, X., Huang, H., & Speed, T. P. (2005) · Journal of Computational Biology · doi:10.1089/cmb.2005.12.894 · Cited by 95
Sequence specificity is obtained from the majority of modular C2H2 zinc-finger arrays
Lam, K. N., van Bakel, H., Coté, A. G., van der Ven, A., & Hughes, T. R. (2011) · Nucleic Acids Research · doi:10.1093/nar/gkq1303 · Cited by 86
Self-citationPrecise physical models of protein–DNA interaction from high-throughput data
Kinney, J. B., Tkačik, G., & Callan, C. G. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0609908104 · Cited by 74
Chen, X., Hughes, T. R., & Morris, Q. (2007) · Bioinformatics · doi:10.1093/bioinformatics/btm224 · Cited by 64
Self-citationAgius, P., Arvey, A. J., Chang, W., Noble, W. S., & Leslie, C. S. (2010) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000916 · Cited by 62
Design of Compact, Universal DNA Microarrays for Protein Binding Microarray Experiments
Philippakis, A., Qureshi, A. M., Berger, M. F., & Bulyk, M. L. (2008) · Journal of Computational Biology · doi:10.1089/cmb.2007.0114 · Cited by 57
Self-citationKeilwagen, J., Grau, J., Paponov, I. A., Posch, S., Marc Strickert, A., & Große, I. (2011) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1001070 · Cited by 52
Chen, L., Wu, G. Y., & Ji, H. (2011) · Bioinformatics · doi:10.1093/bioinformatics/btr156 · Cited by 46
A Linear Model for Transcription Factor Binding Affinity Prediction in Protein Binding Microarrays
Annala, M., Laurila, K., Lähdesmäki, H. J., & Nykter, M. (2011) · PLoS ONE · doi:10.1371/journal.pone.0020059 · Cited by 44
Self-citationJaeger, S. A., Chan, E. T., Berger, M. F., Stottmann, R. W., Hughes, T. R., & Bulyk, M. L. (2010) · Genomics · doi:10.1016/j.ygeno.2010.01.002 · Cited by 42
Self-citationJohn, S., Marais, R., Child, R., Light, Y., & Leonard, W. J. (1996) · The Journal of experimental medicine · doi:10.1084/jem.183.3.743 · Cited by 35
Discovering gapped binding sites of yeast transcription factors
Chen, C., Tsai, H., Hsu, C., Chen, M.-J. M., Hung, H.-G., Huang, G. T.-W., & Li, W. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0712188105 · Cited by 34
MAMOT: hidden Markov modeling tool
Schütz, F., & Delorenzi, M. (2008) · Bioinformatics · doi:10.1093/bioinformatics/btn201 · Cited by 16
Flagged first, then by citations
Cited by
Sorted by citations
The Human Transcription Factors
Lambert, S. A., Jolma, A., Campitelli, L. F., Das, P. K., Yin, Y., Albu, M., Chen, X., Taipale, J., Hughes, T. R., & Weirauch, M. T. (2018) · Cell · doi:10.1016/j.cell.2018.01.029 · Cited by 3,399
Self-citationPredicting the sequence specificities of DNA- and RNA-binding proteins by deep learning
Alipanahi, B., Delong, A., Weirauch, M. T., & Frey, B. J. (2015) · Nature Biotechnology · doi:10.1038/nbt.3300 · Cited by 2,873
Self-citationOpportunities and obstacles for deep learning in biology and medicine
Ching, T., Himmelstein, D. S., Beaulieu-Jones, B. K., Kalinin, A. A., Do, B. T., Way, G. P., Ferrero, E., Agapow, P.-M., Zietz, M., Hoffman, M. M., et al. (2018) · Journal of The Royal Society Interface · doi:10.1098/rsif.2017.0387 · Cited by 2,310
Determination and Inference of Eukaryotic Transcription Factor Sequence Specificity
Weirauch, M. T., Yang, A. W. H., Albu, M., Coté, A. G., Montenegro‐Montero, A., Drewe, P., Najafabadi, H. S., Lambert, S. A., Mann, I. K., Cook, K. B., et al. (2014) · Cell · doi:10.1016/j.cell.2014.08.009 · Cited by 1,749
Self-citationJASPAR 2020: update of the open-access database of transcription factor binding profiles
Fornes, O., Castro-Mondragon, J. A., Khan, A., van der Lee, R., Zhang, X., Richmond, P. A., Modi, B. P., Correard, S., Gheorghe, M., Baranašić, D., et al. (2019) · Nucleic Acids Research · doi:10.1093/nar/gkz1001 · Cited by 1,763
Metadata
- Authors
- DREAM5 Consortium, Weirauch, M. T., Cote, A., Norel, R., Annala, M., Zhao, Y., Riley, T. R., Saez-Rodriguez, J., Cokelaer, T., Vedenko, A., Talukder, S., Bussemaker, H. J., Morris, Q. D., Bulyk, M. L., Stolovitzky, G., & Hughes, T. R.
- Affiliations
- University of Toronto (CA)
- IBM (United States) (US)
- Tampere University of Technology (FI)
- University of Pennsylvania (US)
- Columbia University Irving Medical Center (US)
- European Bioinformatics Institute (GB)
- Brigham and Women's Hospital (US)
- Corresponding author
- Hughes, Timothy R
- ORCID
- Venue
- Nature Biotechnology
- Published
- 2013-01-27
- Volume
- 31
- Issue
- 2
- Pages
- 126-134
- ISSN
- 0733-222X (ISSN-L)
- 1087-0156
- 1546-1696
- PMC
- PMC3687085
- OpenAlex
- W2159324718
- Cited by
- 381
- References
- 59
- Citations by year
- 2026: 10 · 2025: 23 · 2024: 18 · 2023: 25 · 2022: 18 · 2021: 26 · 2020: 23 · 2019: 34 · 2018: 32 · 2017: 44 · 2016: 36 · 2015: 40 · 2014: 31 · 2013: 21
- FWCI
- 19.10
- Type
- journal article
- Language
- en
- Open access
- green
- europepmc.org
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature Biotechnology (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Cold Spring Harbor Laboratory Institutional Repository (Cold Spring Harbor Laboratory) (acceptedVersion)
- National University of Singapore (submittedVersion)
- Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion)
- Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion, cc-by-nc-nd)
- MPG.PuRe (Max Planck Society) (submittedVersion, other-oa)
- Funders
- National Science Foundation (R01HG003008, 0957573, 1022140)
- March of Dimes Foundation
- John Simon Guggenheim Memorial Foundation
- Canadian Institute for Advanced Research
- Genome Canada
- Ontario Genomics
- Ontario Genomics Institute
- European Commission (223575)
- Academy of Finland (260403)
- Israel Science Foundation (802/08)
- Tel Aviv University
- National Institutes of Health (U54-CA121852)
- Canadian Institutes of Health Research (MOP-77721)
- Simons Center for Quantitative Biology, Cold Spring Harbor Laboratory
- National Human Genome Research Institute (R01HG003985, R01HG003008)
- National Cancer Institute (U54CA121852)
- National Institute on Minority Health and Health Disparities (G12MD007591)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Genomics and Chromatin Dynamics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Genomics and Phylogenetic Studies
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene Regulatory Network Analysis
- Keywords
- transcription factor binding sites, DNA binding specificity, position weight matrices, protein binding microarrays, information content
- MeSH terms
- Algorithms, Animals, DNA-Binding Proteins, Transcription Factors, Genome, Computational Biology, Protein Array Analysis, Mice, Position-Specific Scoring Matrices, Nucleotide Motifs
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
