DREAM4: Combining Genetic and Dynamic Information to Identify Biological Networks and Dynamical Models
Open accessThe DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Current technologies have lead to the availability of multiple genomic data types in sufficient quantity and quality to serve as a basis for automatic global network inference. Accordingly, there are currently a large variety of network inference methods that learn regulatory networks to varying degrees of detail. These methods have different strengths and weaknesses and thus can be complementary. However, combining different methods in a mutually reinforcing manner remains a challenge. METHODOLOGY: We investigate how three scalable methods can be combined into a useful network inference pipeline. The first is a novel t-test-based method that relies on a comprehensive steady-state knock-out dataset to rank regulatory interactions. The remaining two are previously published mutual information and ordinary differential equation based methods (tlCLR and Inferelator 1.0, respectively) that use both time-series and steady-state data to rank regulatory interactions; the latter has the added advantage of also inferring dynamic models of gene regulation which can be used to predict the system's response to new perturbations. CONCLUSION/SIGNIFICANCE: Our t-test based method proved powerful at ranking regulatory interactions, tying for first out of methods in the DREAM4 100-gene in-silico network inference challenge. We demonstrate complementarity between this method and the two methods that take advantage of time-series data by combining the three into a pipeline whose ability to rank regulatory interactions is markedly improved compared to either method alone. Moreover, the pipeline is able to accurately predict the response of the system to new conditions (in this case new double knock-out genetic perturbations). Our evaluation of the performance of multiple methods for network inference suggests avenues for future methods development and provides simple considerations for genomic experimental design. Our code is publicly available at http://err.bio.nyu.edu/inferelator/.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
![Figure 1 Network inference pipelines tested. We developed and tested four network inference pipelines composed of the methods described in Table 1. Pipeline 1, MCZ, uses median corrected z-scores on the steady state genetic knock-out data (eq. 2). We submitted topology predictions from this method, tying for place. Pipeline 2, tlCLR-Inferelator, (eq. 19) uses tlCLR as a feature selection procedure, followed by further model selection and parameterization by the Inferelator 1.0. This pipeline was previously published and placed for the DREAM3 network inference competition [31]. Pipeline 3, tlCLR-Inferelator+MCZ, (eq. 20, developed to test the complementarity of the topology predictions made by pipelines 1 and 2). Pipeline 3 combines the results form pipelines 1 and 2. Double knock-out predictions from this pipeline were submitted, placing (topology predictions from this pipeline were submitted, placing ). Pipeline 4, Resampling+MCZ, (eq. 22) presents an alternate way to combine predictions made from complementary methods. In pipeline 4 a resampling approach was applied to pipeline 2 and the results were combined with pipeline 1 as described in the methods sections. Topology predictions from pipeline 4 outperformed those of pipeline 3, and double knock-out predictions were on par with those of pipeline 3.](https://figures.cochat.ai/paper-figures/0f4196a489714ecf917f9969b5813087/dream4-combining-genetic-and-dynamic-information-to-identify-biological-networks-figure-1.jpg)




Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The combination of CLR with another method, the Inferelator [78], became one of the top performers at the DREAM4 100-gene in silico network inference challenge [79].”
From Reverse engineering and identification in systems biology: strategies, perspectives and challenges (2014) · cites this paper as [79]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486
An Introduction to the Bootstrap
Efron, B., & Tibshirani, R. J. (1994) · doi:10.1201/9780429246593 · Cited by 40,500
An Introduction to the Bootstrap
Efron, B., & Tibshirani, R. J. (1993) · doi:10.1007/978-1-4899-4541-9 · Cited by 21,230
Cluster analysis and display of genome-wide expression patterns
Eisen, M. B., Spellman, P. T., Brown, P. O., & Botstein, D. (1998) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.95.25.14863 · Cited by 16,184
Efron, B., Hastie, T., Johnstone, I., & Tibshirani, R. (2004) · The Annals of Statistics · doi:10.1214/009053604000000067 · Cited by 9,357
Transcriptional Regulatory Networks in Saccharomyces cerevisiae
Lee, T. I., Rinaldi, N. J., Robert, F., Odom, D. T., Bar-Joseph, Z., Gerber, G. K., Hannett, N. M., Harbison, C. T., Thompson, C. M., Simon, I., et al. (2002) · Science · doi:10.1126/science.1075090 · Cited by 2,956
Genome-Wide Mapping of in Vivo Protein-DNA Interactions
Johnson, D. S., Mortazavi, A., Myers, R. M., & Wold, B. (2007) · Science · doi:10.1126/science.1141319 · Cited by 2,927
Margolin, A. A., Nemenman, I., Basso, K., Wiggins, C., Stolovitzky, G., Favera, R. D., & Califano, A. (2006) · BMC Bioinformatics · doi:10.1186/1471-2105-7-s1-s7 · Cited by 2,420
Margolin, A. A., Nemenman, I. M., Basso, K., Wiggins, C. H., Stolovitzky, G. A., Favera, R. D., & Califano, A. (2006) · BMC Bioinformatics · doi:10.7916/d8g15zbp · Cited by 2,246
TRANSFAC(R): transcriptional regulation, from patterns to profiles
Matys, V. (2003) · Nucleic Acids Research · doi:10.1093/nar/gkg108 · Cited by 1,985
Faith, J. J., Hayete, B., Thaden, J. T., Mogno, I., Wierzbowski, J., Cottarel, G., Kasif, S., Collins, J. J., & Gardner, T. S. (2007) · PLoS Biology · doi:10.1371/journal.pbio.0050008 · Cited by 1,563
Reverse engineering of regulatory networks in human B cells
Basso, K., Margolin, A. A., Stolovitzky, G., Klein, U., Dalla-Favera, R., & Califano, A. (2005) · Nature Genetics · doi:10.1038/ng1532 · Cited by 1,404
Inferring Genetic Networks and Identifying Compound Mode of Action via Expression Profiling
Gardner, T. S., di Bernardo, D., Lorenz, D., & Collins, J. J. (2003) · Science · doi:10.1126/science.1081900 · Cited by 1,117
BUTTE, A. J., & KOHANE, I. S. (1999) · Biocomputing 2000 · doi:10.1142/9789814447331_0040 · Cited by 945
Genetic network inference: from co-expression clustering to reverse engineering
D’haeseleer, P., Liang, S., & Somogyi, R. (2000) · Bioinformatics · doi:10.1093/bioinformatics/16.8.707 · Cited by 944
Discovering statistically significant biclusters in gene expression data
Tanay, A., Sharan, R., & Shamir, R. (2002) · Bioinformatics · doi:10.1093/bioinformatics/18.suppl_1.s136 · Cited by 855
How to infer gene networks from expression profiles
Bansal, M., Belcastro, V., Ambesi‐Impiombato, A., & di Bernardo, D. (2007) · Molecular Systems Biology · doi:10.1038/msb4100120 · Cited by 766
Gene regulatory network inference: Data integration in dynamic models—A review
Hecker, M., Lambeck, S., Toepfer, S., van Someren, E., & Guthke, R. (2009) · Biosystems · doi:10.1016/j.biosystems.2008.12.004 · Cited by 755
Revealing strengths and weaknesses of methods for gene network inference
Marbach, D., Prill, R. J., Schaffter, T., Mattiussi, C., Floreano, D., & Stolovitzky, G. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0913357107 · Cited by 752
Revealing modular organization in the yeast transcriptional network
Ihmels, J., Friedlander, G., Bergmann, S., Sarig, O., Ziv, Y., & Barkai, N. (2002) · Nature Genetics · doi:10.1038/ng941 · Cited by 690
Bonneau, R., Reiss, D. J., Shannon, P., Facciotti, M., Hood, L., Baliga, N. S., & Thorsson, V. (2006) · Genome Biology · doi:10.1186/gb-2006-7-5-r36 · Cited by 510 · cited 1×
“, to learn initial topology that is further optimized and parametrized by Inferelator 1.0”
BackgroundInfluentialSelf-citationGama-Castro, S., Jimenez-Jacinto, V., Peralta-Gil, M., Santos-Zavaleta, A., Penaloza-Spinola, M. I., Contreras-Moreira, B., Segura-Salazar, J., Muniz-Rascado, L., Martinez-Flores, I., Salgado, H., et al. (2007) · Nucleic Acids Research · doi:10.1093/nar/gkm994 · Cited by 491
Bootstrapping cluster analysis: Assessing the reliability of conclusions from microarray experiments
Kerr, M. K., & Churchill, G. A. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.161273698 · Cited by 474
Towards a rigorous assessment of systems biology models: the DREAM3 challenges
Prill, R. J., Marbach, D., Saez-Rodriguez, J., Sorger, P. K., Alexopoulos, L. G., Xue, X., Clarke, N. D., Altan-Bonnet, G., & Stolovitzky, G. (2010) · PLoS ONE · doi:10.1371/journal.pone.0009202 · Cited by 439
Marbach, D., Schaffter, T., Mattiussi, C., & Floreano, D. (2009) · Journal of Computational Biology · doi:10.1089/cmb.2008.09tt · Cited by 430
Iterative signature algorithm for the analysis of large-scale gene expression data
Bergmann, S., Ihmels, J., & Barkai, N. (2003) · Physical Review E · doi:10.1103/physreve.67.031902 · Cited by 419
Bansal, M., Gatta, G. D., & di Bernardo, D. (2006) · Bioinformatics · doi:10.1093/bioinformatics/btl003 · Cited by 382
A Yeast Synthetic Network for In Vivo Assessment of Reverse-Engineering and Modeling Approaches
Cantone, I., Marucci, L., Iorio, F., Ricci, M. A., Belcastro, V., Bansal, M., Santini, S., di Bernardo, M., di Bernardo, D., & Cosma, M. P. (2009) · Cell · doi:10.1016/j.cell.2009.01.055 · Cited by 376
Chemogenomic profiling on a genome-wide scale using reverse-engineered gene networks
di Bernardo, D., Thompson, M. J., Gardner, T. S., Chobot, S. E., Eastwood, E. L., Wojtovich, A. P., Elliott, S. J., Schaus, S. E., & Collins, J. J. (2005) · Nature Biotechnology · doi:10.1038/nbt1075 · Cited by 344
A Predictive Model for Transcriptional Control of Physiology in a Free Living Cell
Bonneau, R., Facciotti, M. T., Reiss, D. J., Schmid, A. K., Pan, M., Kaur, A., Thorsson, V., Shannon, P., Johnson, M. H., Bare, J. C., et al. (2007) · Cell · doi:10.1016/j.cell.2007.10.053 · Cited by 298
Self-citationData Analysis with Bayesian Networks: A Bootstrap Approach
Friedman, N., Goldszmidt, M., & Wyner, A. J. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1301.6695 · Cited by 255
Reiss, D. J., Baliga, N. S., & Bonneau, R. (2006) · BMC Bioinformatics · doi:10.1186/1471-2105-7-280 · Cited by 252
Self-citationÁlvarez, M. A., Luengo, D., & Lawrence, N. D. (2009) · International Conference on Artificial Intelligence and Statistics · Cited by 249
ChIP-seq: welcome to the new frontier
Mardis, E. R. (2007) · Nature Methods · doi:10.1038/nmeth0807-613 · Cited by 242
Artificial gene networks for objective comparison of analysis algorithms
Mendes, P., Sha, W., & Ye, K. (2003) · Bioinformatics · doi:10.1093/bioinformatics/btg1069 · Cited by 207
ChIP-chip: A genomic approach for identifying transcription factor binding sites
Horak, C. E., & Snyder, M. (2002) · Methods in Enzymology · doi:10.1016/s0076-6879(02)50979-4 · Cited by 177
Learning biological networks: from modules to dynamics
Bonneau, R. (2008) · Nature Chemical Biology · doi:10.1038/nchembio.122 · Cited by 153
Self-citationGeneral transcription factor specified global gene regulation in archaea
Facciotti, M. T., Reiss, D. J., Pan, M., Kaur, A., Vuthoori, M., Bonneau, R., Shannon, P. T., Srivastava, A., Donohoe, S., Hood, L., et al. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0611663104 · Cited by 137
Self-citationDREAM3: Network Inference Using Dynamic Context Likelihood of Relatedness and the Inferelator
Madar, A., Greenfield, A., Vanden-Eijnden, E., & Bonneau, R. (2010) · PLoS ONE · doi:10.1371/journal.pone.0009803 · Cited by 108
Self-citationYip, K. Y., Alexander, R. P., Yan, K.-K., & Gerstein, M. (2010) · PLoS ONE · doi:10.1371/journal.pone.0008121 · Cited by 105
Gene Regulatory Network Reconstruction Using Conditional Mutual Information
Liang, K.-C., & Wang, X. (2008) · EURASIP Journal on Bioinformatics and Systems Biology · doi:10.1155/2008/253894 · Cited by 98
Gaussian process regression bootstrapping: exploring the effects of uncertainty in time course data
Kirk, P. D. W., & Stumpf, M. P. H. (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp139 · Cited by 81
Least absolute regression network analysis of the murine osteoblast differentiation network
van Someren, E. P., Vaes, B. L. T., Steegenga, W. T., Sijbers, A. M., Dechering, K. J., & Reinders, M. J. T. (2006) · Bioinformatics · doi:10.1093/bioinformatics/bti816 · Cited by 81
ChIP-Seq Data Reveal Nucleosome Architecture of Human Promoters
Schmid, C. D., & Bücher, P. (2007) · Cell · doi:10.1016/j.cell.2007.11.017 · Cited by 80
He, F., Balling, R., & Zeng, A.-P. (2009) · Journal of Biotechnology · doi:10.1016/j.jbiotec.2009.07.013 · Cited by 72
Reconstructing nonlinear dynamic models of gene regulation using stochastic sampling
Mazur, J., Ritter, D., Reinelt, G., & Kaderali, L. (2009) · BMC Bioinformatics · doi:10.1186/1471-2105-10-448 · Cited by 54
The inferelator 2.0: A scalable framework for reconstruction of dynamic regulatory network models
Madar, A., Greenfield, A., Ostrer, H., Vanden-Eijnden, E., & Bonneau, R. (2009) · 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society · doi:10.1109/iembs.2009.5334018 · Cited by 46
Self-citationBenchmarking regulatory network reconstruction with GRENDEL
Haynes, B. C., & Brent, M. R. (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp068 · Cited by 43
INFLUENCE OF NETWORK TOPOLOGY AND DATA COLLECTION ON NETWORK INFERENCE
SMITH, V. A., JARVIS, E. D., & HARTEMINK, A. J. (2002) · Biocomputing 2003 · doi:10.1142/9789812776303_0016 · Cited by 41
Marbach, D., Mattiussi, C., & Floreano, D. (2009) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.2008.03945.x · Cited by 34
Shasha, D. E., & Wilson, M. (2008) · Synthesis lectures on mathematics and statistics · doi:10.1007/978-3-031-02393-4 · Cited by 15
Cited by
Wisdom of crowds for robust gene network inference
The DREAM5 Consortium, Marbach, D., Costello, J. C., Küffner, R., Vega, N. M., Prill, R. J., Camacho, D. M., Allison, K. R., Kellis, M., Collins, J. J., et al. (2012) · Nature Methods · doi:10.1038/nmeth.2016 · Cited by 1,667
A Validated Regulatory Network for Th17 Cell Specification
Ciofani, M., Madar, A., Galan, C., Sellars, M., Mace, K., Pauli, F., Agarwal, A., Huang, W., Parkurst, C. N., Muratet, M., et al. (2012) · Cell · doi:10.1016/j.cell.2012.09.016 · Cited by 1,160
Self-citationAn Arabidopsis gene regulatory network for secondary cell wall synthesis
Taylor-Teeples, M., Lin, L., de Lucas, M., Turco, G., Toal, T. W., Gaudinier, A., Young, N. F., Trabucco, G. M., Veling, M. T., Lamothe, R., et al. (2015) · Nature · doi:10.1038/nature14099 · Cited by 761
Network deconvolution as a general method to distinguish direct dependencies in networks
Feizi, S., Marbach, D., Médard, M., & Kellis, M. (2013) · Nature Biotechnology · doi:10.1038/nbt.2635 · Cited by 287
Deep learning for inferring gene relationships from single-cell expression data
Yuan, Y., & Bar-Joseph, Z. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1911536116 · Cited by 265
Metadata
- Authors
- Greenfield, A., Madar, A., Ostrer, H., & Bonneau, R.
- Affiliations
- New York University (US)
- Courant Institute of Mathematical Sciences (US)
- Corresponding author
- Bonneau, Richard
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2010-10-25
- Volume
- 5
- Issue
- 10
- Pages
- e13397
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC2963605
- OpenAlex
- W1986688807
- Cited by
- 255
- References
- 50
- Citations by year
- 2026: 8 · 2025: 15 · 2024: 15 · 2023: 10 · 2022: 16 · 2021: 12 · 2020: 27 · 2019: 23 · 2018: 11 · 2017: 19 · 2016: 21 · 2015: 26 · 2014: 11 · 2013: 13 · 2012: 20
- FWCI
- 5.34
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Science Foundation (0820757)
- Université du Luxembourg
- National Institutes of Health (5u54ca143907-05, U54CA143907)
- National Eye Institute (PN2EY016586)
- National Cancer Institute (IU54CA143907-01, U54-CA-143907)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene Regulatory Network Analysis
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Microbial Metabolic Engineering and Bioproduction
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Bioinformatics and Genomic Networks
- Keywords
- gene regulatory network inference, mutual information, ordinary differential equations, time series, method combination
- MeSH terms
- Models, Genetic, Likelihood Functions, Gene Regulatory Networks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.