Towards a Rigorous Assessment of Systems Biology Models: The DREAM3 Challenges
Open accessThe DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Systems biology has embraced computational modeling in response to the quantitative nature and increasing scale of contemporary data sets. The onslaught of data is accelerating as molecular profiling technology evolves. The Dialogue for Reverse Engineering Assessments and Methods (DREAM) is a community effort to catalyze discussion about the design, application, and assessment of systems biology models through annual reverse-engineering challenges. METHODOLOGY AND PRINCIPAL FINDINGS: We describe our assessments of the four challenges associated with the third DREAM conference which came to be known as the DREAM3 challenges: signaling cascade identification, signaling response prediction, gene expression prediction, and the DREAM3 in silico network challenge. The challenges, based on anonymized data sets, tested participants in network inference and prediction of measurements. Forty teams submitted 413 predicted networks and measurement test sets. Overall, a handful of best-performer teams were identified, while a majority of teams made predictions that were equivalent to random. Counterintuitively, combining the predictions of multiple teams (including the weaker teams) can in some cases improve predictive power beyond that of any single method. CONCLUSIONS: DREAM provides valuable feedback to practitioners of systems biology modeling. Lessons learned from the predictions of the community provide much-needed context for interpreting claims of efficacy of algorithms described in the scientific literature.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures








Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Their results show that, in addition to the obstacles identified by Prill et al. [94] (lack of data and deficiencies in the inference algorithms), we must be also aware of fundamental problems related to the uniqueness and distinguishability of these networks (even for the utopian case of fully observed networks with no noise).”
From Reverse engineering and identification in systems biology: strategies, perspectives and challenges (2014) · cites this paper as [94]
In the citing paper
“The organizers identify two major hurdles to be surmounted: lack of data and deficiencies in the inference algorithms.”
From Reverse engineering and identification in systems biology: strategies, perspectives and challenges (2014) · cites this paper as [94]
In the citing paper
“In other words, reliable network inference remains an unsolved problem.”
From Reverse engineering and identification in systems biology: strategies, perspectives and challenges (2014) · cites this paper as [94]
In the citing paper
“There are several notable examples where collaborations have been very successful, such as SBML [238], BioModels Database [239] or the DREAM challenges [94].”
From Reverse engineering and identification in systems biology: strategies, perspectives and challenges (2014) · cites this paper as [94]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Regularization and Variable Selection Via the Elastic Net
Zou, H., & Hastie, T. (2005) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00503.x · Cited by 20,957
Exploration, normalization, and summaries of high density oligonucleotide array probe level data
Irizarry, R. A. (2003) · Biostatistics · doi:10.1093/biostatistics/4.2.249 · Cited by 10,603 · cited 1×
“Measurements were normalized using the RMA algorithm [18] within the commercial software package, GeneSpring.”
MethodJournal of the Royal Statistical Society (B)
Fildes, R. (1993) · International Journal of Forecasting · doi:10.1016/0169-2070(93)90088-5 · Cited by 3,437
Margolin, A. A., Nemenman, I., Basso, K., Wiggins, C., Stolovitzky, G., Favera, R. D., & Califano, A. (2006) · BMC Bioinformatics · doi:10.1186/1471-2105-7-s1-s7 · Cited by 2,420 · cited 1×
“…be applied off-the-shelf, a strategy for guarding against bogus predictions is to employ a wide variety of algorithms that train on different features of the data (e.g., correlation [28], mutual information [29–32], synergy [33], etc.), then merge the results to gain confidence in the predictions.”
ResultSelf-citationMargolin, A. A., Nemenman, I. M., Basso, K., Wiggins, C. H., Stolovitzky, G. A., Favera, R. D., & Califano, A. (2006) · BMC Bioinformatics · doi:10.7916/d8g15zbp · Cited by 2,246
Self-citationReverse engineering of regulatory networks in human B cells
Basso, K., Margolin, A. A., Stolovitzky, G., Klein, U., Dalla-Favera, R., & Califano, A. (2005) · Nature Genetics · doi:10.1038/ng1532 · Cited by 1,404 · cited 1×
“, correlation [28], mutual information [29–32], synergy [33], etc.”
BackgroundSelf-citationBUTTE, A. J., & KOHANE, I. S. (1999) · Biocomputing 2000 · doi:10.1142/9789814447331_0040 · Cited by 945 · cited 1×
“, correlation [28], mutual information [29–32], synergy [33], etc.”
BackgroundNatarajan, K., Meyer, M. R., Jackson, B. M., Slade, D., Roberts, C., Hinnebusch, A. G., & Marton, M. J. (2001) · Molecular and Cellular Biology · doi:10.1128/mcb.21.13.4347-4368.2001 · Cited by 748 · cited 1×
“Expression levels were assayed separately in the three mutant strains and in the wild type strain at times 0, 10, 20, 30, 45, 60, 90 and 120 minutes following the addition of 3-aminotriazole (3AT) as described [17].”
MethodButte, A. J., Tamayo, P., Slonim, D., Golub, T. R., & Kohane, I. S. (2000) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.220392197 · Cited by 605 · cited 1×
“…be applied off-the-shelf, a strategy for guarding against bogus predictions is to employ a wide variety of algorithms that train on different features of the data (e.g., correlation [28], mutual information [29–32], synergy [33], etc.), then merge the results to gain confidence in the predictions.”
ResultBonneau, R., Reiss, D. J., Shannon, P., Facciotti, M., Hood, L., Baliga, N. S., & Thorsson, V. (2006) · Genome Biology · doi:10.1186/gb-2006-7-5-r36 · Cited by 510
Research works printed but not linked: 1
- [15]Alexopoulos L Saez-Rodriguez J Cosgrove B Lauffenburger D PK S 2009 Networks reconstructed from cell response data reveal profound dif ferences in signaling by tolllike receptors and nf-?b in normal and transformed human hepatocytes. Under review
Cited by
Items 301–400 of 427
A Learning Framework to Improve Unsupervised Gene Network Inference
Turki, T., Bassett, W., & Wang, J. T. L. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-41920-6_3 · Cited by 4
“We adopted the five time-series gene expression datasets available in the DREAM4 100-gene in silico network inference challenge [10,22,25,27].”
MethodWang, X.-D., Qi, Y.-X., & Jiang, Z.-L. (2011) · IET Systems Biology · doi:10.1049/iet-syb.2010.0041 · Cited by 3
Algorithms for modeling global and context-specific functional relationship networks
Zhu, F., Panwar, B., & Guan, Y. (2015) · Briefings in Bioinformatics · doi:10.1093/bib/bbv065 · Cited by 5
Akutekwe, A., & Şeker, H. (2015) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2015.7320292 · Cited by 3
Koike, C. Y., & Higa, C. H. A. (2016) · IEEE International Conference on Bioinformatics and Bioengineering (BIBE) · doi:10.1109/bibe.2016.54 · Cited by 3
“This way, the AUROC is a single number that summarizes this trade-off as the parameter k is varied [33].”
BackgroundMethodJurman, G., Filosi, M., Visintainer, R., Riccadonna, S., & Furlanello, C. (2018) · Methods in molecular biology · doi:10.1007/978-1-4939-8882-2_14 · Cited by 3
A multifactorial evaluation framework for gene regulatory network reconstruction
Mombaerts, L., Aalto, A., Markdahl, J., & Gonçalves, J. M. (2019) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2019.12.268 · Cited by 3
Gene Regulatory Network Inference Using Maximal Information Coefficient
Akhand, M. A. H., Nandi, R. N., Amran, S. M., & Murase, K. (2015) · International Journal of Bioscience Biochemistry and Bioinformatics · doi:10.17706/ijbbb.2015.5.5.296-310 · Cited by 3
“The selected datasets are popular for GRN inference and are employed in many exiting studies as benchmark [4]-[6], [35], [36].”
MethodDynamical Causality Under Latent Confounders for Biological Network Reconstruction
Yan, J., Zhang, X., Zhang, C., Huang, W., Shi, J., & Chen, L. (2026) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2026.3658839 · Cited by 5
Camargo, A. V., & Kim, J. T. (2012) · IET Systems Biology · doi:10.1049/iet-syb.2011.0004 · Cited by 3
PPNet: Identifying Functional Association Networks by Phylogenetic Profiling of Prokaryotic Genomes
Li, Y., Ma, B., Hua, K., Gong, H., He, R., Luo, R., Bi, D., Zhou, R., Langford, P. R., & Jin, H. (2023) · Microbiology Spectrum · doi:10.1128/spectrum.03871-22 · Cited by 3
“We assessed the performance of the methods used for S. suis based on the AUROC, the AUPR (35), and the overall score, all of which have been used to summarize the performance of networks (36) (Fig.”
BackgroundMethodInfluentialFirst and second order Markov posterior probabilities on multiple time-course data sets
Norris, J. L., Patton, K. L., Huang, S., John, D. J., & Muday, G. K. (2015) · IEEE SoutheastCon · doi:10.1109/secon.2015.7132880 · Cited by 4
“Simulations are important to measure the suitability of network models [24].”
BackgroundMorshed, N., Chetty, M., & Vinh, N. X. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-24958-7_29 · Cited by 3
Constraint Programming in Community-Based Gene Regulatory Network Inference
Fioretto, F., & Pontelli, E. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-40708-6_11 · Cited by 3
“We test our method on a set of 110 benchmarks proposed by the DREAM3 [14] and DREAM4 [16] challenges.”
MethodConstrained Community-Based Gene Regulatory Network Inference
Fioretto, F., Dovier, A., & Pontelli, E. (2015) · ACM Transactions on Modeling and Computer Simulation · doi:10.1145/2688909 · Cited by 3
“(2) D3: five networks from the DREAM3 competition [Prill et al. 2010], denoted by D31, . . . , D35 and consisting of 100 genes, built by extracting modules from the E. coli and from a yeast genetic interaction network [Reguly et al. 2006].”
BackgroundMethodInfluentialInferring Gene Regulatory Networks: Challenges and Opportunities
Wang, J. T. L. (2015) · Journal of Data Mining in Genomics & Proteomics · doi:10.4172/2153-0602.1000e118 · Cited by 3
“Marbach et al. [5, 6] developed an in silico benchmark suite within the DREAM (Dialogue on Reverse Engineering Assessment and Methods) project [7, 8], and assessed the performance of 29 network inference methods.”
BackgroundEffective gene expression data generation framework based on multi-model approach
Şirin, U., Erdoğdu, U., Polat, F., Tan, M., & Alhajj, R. (2016) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2016.05.003 · Cited by 3
Rahman, S., Khare, K., Michailidis, G. C., Martínez, C. A., & Carulla, J. (2023) · The Annals of Applied Statistics · doi:10.1214/22-aoas1636 · Cited by 3
Rapid Reconstruction of Time-varying Gene Regulatory Networks with Limited Main Memory
Pyne, S., & Anand, A. (2019) · IEEE Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2019.2946826 · Cited by 3
Study of gene regulatory networks inference methods from gene expression data
Bellot, P. (2017) · UPCommons institutional repository (Universitat Politècnica de Catalunya) · doi:10.5821/dissertation-2117-108235 · Cited by 5
Discovering Interactions in Multivariate Time Series
Tank, A. (2018) · ResearchWorks at the University of Washington (University of Washington) · Cited by 5
BiGSM: Bayesian inference of gene regulatory network via sparse modelling
Qin, H., Garbulowski, M., Sonnhammer, E. L. L., & Chatterjee, S. (2025) · Bioinformatics · doi:10.1093/bioinformatics/btaf318 · Cited by 2
“We benchmarked the BiGSM method against several inference methods including LSCON (Hillerton et al. 2022), LASSO (Tj € arnberg et al. 2015), SVM, Zscore (Prill et al. 2010), and GENIE3 (Huynh-Thu et al. 2010).”
Reimer, J., Page, J., Saha, P., Shen, S., Zhu, X., Qian, S., Mammen, M. J., Qu, J., Sethi, S., & Broderick, G. (2025) · PLoS ONE · doi:10.1371/journal.pone.0326062 · Cited by 3
Alkhateeb, N. J., & Awad, M. (2026) · Frontiers in Bioinformatics · doi:10.3389/fbinf.2026.1883130 · Cited by 2
“Unsupervised methods rely on expression data only but tend to achieve lower prediction accuracies than supervised methods (Prill et al., 2010).”
Wonkap, S. K., & Butler, G. (2019) · International Conference Computational Systems-Biology and Bioinformatics · doi:10.1145/3365953.3365955 · Cited by 2
“We rigorously tested our method on a community recognized benchmark dataset: the DREAM 4 challenge dataset [18, 19, 24], more precisely the size 10 and 100 in silico sub-challenges.”
BackgroundMethodJia, Z., & Zhang, X. (2022) · Frontiers in Genetics · doi:10.3389/fgene.2022.923339 · Cited by 3
“In order to test the predictive power of the DDTG method, DREAM3 datasets (Prill et al., 2010) about Yeast knockout genes with sizes 10, 50, and 100 and two networks of size 10 from the DREAM4 datasets (Daniel et al.”
MethodCausal Discovery Evaluation Framework in the Absence of Ground-Truth Causal Graph
Li, T., Wang, L., Peng, D., Liao, J., Liu, L., & Liu, Z. (2024) · IEEE Access · doi:10.1109/access.2024.3456233 · Cited by 4
Abduallah, Y., & Wang, J. T. L. (2017) · IEEE Intl Conf on Dependable, Autonomic and Secure Computing, Intl Conf on Pervasive Intelligence and Computing, Intl Conf on Cloud and Big Data Computing, Intl Conf on Cyber Science and Technology Congress (DASC/PiCom/CBDCom/CyberSciTech) · doi:10.1109/dasc-picom-datacom-cyberscitec.2017.179 · Cited by 2
“To evaluate the accuracy of the SAlgorithm, we adopted the five time-series gene expression datasets available in the DREAM4 100-gene in silico network inference challenge [19-22].”
MethodHigh Confidence Network Predictions from Big Biological Data
Magnusson, R. (2020) · Linköping studies in science and technology. Dissertations · doi:10.3384/diss.diva-165084 · Cited by 2
Wang, P., Li, Q., Sun, N., Gao, Y., Liu, J. S., Deng, K., & He, J. (2020) · Briefings in Bioinformatics · doi:10.1093/bib/bbaa117 · Cited by 2
Learning Gene Regulatory Networks using Graph Granger Causality
Patil, P., & Vaida, M. L. (2022) · EPiC series in computing · doi:10.29007/6cqn · Cited by 4
Zhang, W., & Zhou, T. (2015) · PLoS ONE · doi:10.1371/journal.pone.0130979 · Cited by 2
Systems Biology: Methods and Applications
Titz, B., Knorr, A., Sewer, A., Martin, F. P., Ivanov, N. V., Talikka, M., Suarez, I. G., Peitsch, M. C., & Hoeng, J. (2017) · Elsevier eBooks · doi:10.1016/b978-0-12-409547-2.12333-9 · Cited by 2
Bioinformatics and Systems Biology in Bioengineering
Nalluri, J. J., Barh, D., Azevedo, V., & Ghosh, P. (2017) · Elsevier eBooks · doi:10.1016/b978-0-12-804659-3.00013-0 · Cited by 2
Research on Multi-Time-Delay Gene Regulation Network Based on Fuzzy Label Propagation
Li, H., Zhang, Q., & Li, M. (2020) · Journal of Healthcare Engineering · doi:10.1155/2020/2389527 · Cited by 2
“In Bayesian networks, directed acyclic graphs are used to indicate the conditional dependence between random variables [15].”
MethodSymbolic Representation and Inference of Regulatory Network Structures
Maimari, N., Broda, K. B., Kakas, A. C., Krams, R., & Russo, A. (2014) · Wiley eBooks · doi:10.1002/9781119005223.ch1 · Cited by 2
Bayesian inference for protein signalling networks
Oates, C. J. (2026) · Warwick Research Archive Portal (University of Warwick) · doi:10.82444/warw.33634336 · Cited by 3
Using Noisy Extractions to Discover Causal KnowledgePreprint
Sridhar, D., Pujara, J., & Getoor, L. C. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.05900 · Cited by 2
“Our dataset for evaluation consists of a transcriptional regulatory network across 300 genes in yeast with simulated gene expression from the DREAM4 challenge [8, 10].”
MethodGanscha, S., Fortuin, V., Horn, M., Arvaniti, E., & Claassen, M. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/356477 · Cited by 3
Saengkyongam, S., & Silva, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.11528 · Cited by 2
“We base our semi-synthetic experiment on a gene expression dataset from the DREAM4 challenge (Marbach et al., 2010, 2009; Prill et al., 2010).”
MethodFIDDLE: Efficient Assembly of Networks That Satisfy Desired BehaviorPreprint
Butchy, A., Telmer, C. A., & Miškov-Živanov, N. (2021) · Research Square · doi:10.21203/rs.3.rs-562692/v1 · Cited by 2
Integration of Pathway Data as Prior Knowledge into Methods for Network Reconstruction
Krämer, F. (2014) · eDiss (Georg-August-Universität Göttingen) · doi:10.53846/goediss-4729 · Cited by 3
A comprehensive survey on graph neural networks for gene regulatory network inference
Alkhateeb, N. J., & Awad, M. (2026) · Briefings in Bioinformatics · doi:10.1093/bib/bbag443 · Cited by 1
“Unsupervised methods rely on expression data only but tend to achieve lower prediction accuracies than supervised methods [ 8].”
Determining interaction directionality in complex biochemical networks from stationary measurements
Leibovich, N. (2025) · Scientific Reports · doi:10.1038/s41598-025-86332-0 · Cited by 2
Montefusco, F., Cosentino, C., Amato, F., & Bates, D. G. (2011) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2011.6161266 · Cited by 1
“The in silico networks used in this paper for benchmarking purposes have been generated by using GeneNetWeaver, an open-source tool for in silico benchmark generation and performance profiling of network inference methods [15], [16], [17].”
MethodSystems Biology Meets Systemic Medicine: The Old, the New and the Blue
Mashayekhi, K., & Labusca, L. S. (2012) · International Conference on Emerging Security Technologies · doi:10.1109/est.2012.14 · Cited by 1
Kim, D.-C., Kang, M., Biswas, A. K., Liu, C., & Gao, J. (2015) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm.2015.7359672 · Cited by 1
Network inference by integrating biclustering and feature selection
Cannoodt, R., Ruyssinck, J., Preter, K. D., Dhaene, T., & Saeys, Y. (2013) · Ghent University Academic Bibliography (Ghent University) · Cited by 1
Bessonov, K., & Steen, K. V. (2016) · Genetic Epidemiology · doi:10.1002/gepi.22017 · Cited by 1
A novel probabilistic generator for large-scale gene association networks
Grimes, T., & Datta, S. (2021) · PLoS ONE · doi:10.1371/journal.pone.0259193 · Cited by 1
“The DREAM challenge used networks from both E. coli and yeast to establish how robust methods are to the underlying topology [30].”
Reconstruction of Triple-wise Relationships in Biological Networks from Profiling Data
Nguyen, Q. D., Pham, T. H., Ho, T. B., Nguyen, V. H., & Tran, D. H. (2013) · Advances in intelligent systems and computing · doi:10.1007/978-3-642-37371-8_24 · Cited by 2
Practical Approaches to Biological Network Discovery
Haynes, B. C. (2012) · Open Scholarship Institutional Repository (Washington University in St. Louis) · doi:10.7936/k72805pn · Cited by 1
“Widely used benchmark networks are provided by the DREAM (Dialog for Reverse Engineering Assessments) consortium [124].”
MethodTackling the DREAM Challenge for Gene Regulatory Networks Reverse Engineering
Visconti, A., Esposito, R., & Cordero, F. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-23954-0_34 · Cited by 1
“A p-value is evaluated for each AUROC and AUPR scores (additional details can be found in [18,19]).”
MethodAlmeer, H., Mall, R., Ullah, E., Megrez, N., & Bensmail, H. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-78723-7_6 · Cited by 1
Structure learning of sparse directed acyclic graphs incorporating the scale-free property
Guo, X., Zhang, H., Wang, Y., & Liang, Y. Q. (2018) · Computational Statistics · doi:10.1007/s00180-018-0841-8 · Cited by 1
Integracija strukturnih omejitev pri izpeljavi gensko regulatornih omrežij
Pušnik, Ž., & Moškon, M. (2021) · Uporabna informatika · doi:10.31449/upinf.vol29.num1.110 · Cited by 1
Gene regulatory network modelling with evolutionary algorithms -an integrative approach
Sîrbu, A. (2011) · Dublin City University Open Access Institutional Repository (Dublin City University) · Cited by 1
Gene Regulatory Network Inference Using Machine Learning Techniques
Wonkap, S. K. (2020) · Spectrum Research Repository (Concordia University) · Cited by 1
Gene Regulatory Network Review
Liu, E., Li, L., & Cheng, L. (2019) · Elsevier eBooks · doi:10.1016/b978-0-323-95502-7.00313-4 · Cited by 5
Towards Understanding Protein-Protein Interactions: The AI Approach
Kursa, M. B., Jendrej, J., Herman-Iżycka, J., & Rudnicki, W. R. (2011) · Studies in computational intelligence · doi:10.1007/978-3-642-22732-5_2
Systems Biology, Network Inference in.
Żola, J., & Aluru, S. (2011)
Causal inference from interventional data
Hauser, A. (2013) · Repository for Publications and Research Data (ETH Zurich) · doi:10.3929/ethz-a-009795024
Direct regulation estimation of cellular networks with time series and steady state data
Wang, Y., & Zhou, T. (2011) · Chinese Control Conference (CCC)
Multivariate models and algorithms for systems biology
Zhu, D., & Acharya, L. R. (2011) · ScholarWorks @ The University of New Orleans (The University of New Orleans)
Transcriptional Regulatory Networks across Species : Evolution, Inference, and Refinement
Zhang, X. (2011) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · doi:10.5075/epfl-thesis-5145
Learning Dynamic Systems from Time-series Data - An Application to Gene Regulatory Networks
Timóteo, I. J. P. M., & Holden, S. B. (2015) · International Conference on Pattern Recognition Applications and Methods · doi:10.5220/0005282303240332
An integrative approach to infer regulation programs in a transcription regulatory module network
Qi, J., Michoel, T., & Butler, G. (2011) · ACM International Conference on Bioinformatics, Computational Biology, and Health Informatics (ACM-BCB) · doi:10.1145/2147805.2147829
Reconstructing gene regulatory networks by integrating knockout and multifactorial perturbation data
Xiong, J., & Zhou, T. (2014) · Chinese Control Conference (CCC) · doi:10.1109/chicc.2014.6896130
“In topology estimations, highly confident predictions can become a good guidance to biological experiment designs[5].”
BackgroundMethodInfluentialTopology estimation of gene regulatory networks with relative expression level variations
Wang, Y., & Zhou, T. (2012) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.1109/acc.2012.6314870
“As commented in [9], in addition to the AUROC and the AUPR specifications, a desirable estimation algorithm is also expected to have a PR (precision-recall) curve starting from the left upper corner, and decreasing monotonically and slowly with the increment of the recall rate.”
BackgroundMethodInfluentialDifferential expression analysis with global network adjustment
Gelfond, J., Ibrahim, J. G., Gupta, M., Chen, M., & Cody, J. D. (2013) · BMC Bioinformatics · doi:10.1186/1471-2105-14-258
“There are many models for gene networks, but few have shown accurate predictions across many datasets [1].”
BackgroundUllah, M. O. (2012) · doi:10.18174/233181
“The Dialogue on Reverse Engineering Assessment and Methods (DREAM) project is working with the current state of systems biology modeling and it organizes reverse-engineering challenges to infer the connectivity of the molecular networks underlying the measurements, or related reverse-engineering [78-80].”
BackgroundSchaffter, T., Marbach, D., & Floreano, D. (2011)
Self-citationA 2-Level Granular Network Model for Biological Data Mining Analysis
Gadish, M. A. (2014) · The Atrium (University of Guelph)
Salleh, F. H. M., Arif, S. M., Zainuddin, S., & Firdaus‐Raih, M. (2013) · International Conference on Artificial Intelligence, Modelling and Simulation (AIMS) · doi:10.1109/aims.2013.19
“For example, the P-R curve indicates whether the first few edge predictions at the top of the prediction list are correct [4].”
BackgroundIntegrative approaches for biological network inferences
Kim, D. (2014) · UTA ResearchCommons (University of Texas Arlington)
Cokelaer, T., Bansal, M., Bare, C., Bilal, E., Bot, B. M., Neto, E. C., Eduati, F., Gönen, M., Hill, S. M., Hoff, B., et al. (2015)
Self-citationZhang, W., Zhang, Y., & Zhou, T. (2015) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2015.12.134
Gene-set-based inference of biological network topologies from big molecular profiling data
Acharya, L. R., & Zhu, D. (2015) · Cambridge University Press eBooks · doi:10.1017/cbo9781316162750.015
Belcastro, V., di Bernardo, D., Gregoretti, F., & Oliva, G. (2010) · International Workshop on Parallel and Distributed Methods in Verification and International Workshop on High Performance Computational Systems Biology (PDMC-HiBi) · doi:10.1109/pdmc-hibi.2010.20
“The remaining (null predicted) true edges are then ranked randomly, and this procedure gives rise to a p-value associated to both the AUROC (PAUROC) and the AUPR (PAUPR) scores.”
BackgroundMethodInfluentialInference of dynamic biological networks based on perturbation data
Pal, R. (2016) · Elsevier eBooks · doi:10.1016/b978-0-12-805274-7.00010-5
Algorithms for gene regulatory networks reconstruction
Maksimov, N. N. (2015) · TU/e Research Portal
Systems Uncertainty in Systems Biology & Gene Function Prediction
Falin, L. J. (2011) · VTechWorks (Virginia Tech)
Fuzzy Cognitive Maps: Learning Algorithms and Biomedical Applications
Chen, Y. (2015) · OhioLink ETD Center (Ohio Library and Information Network)
Gábor, A. (2017) · REAL-PhD (Hungarian Academy of Sciences) · doi:10.18136/pe.2017.639
Sparse reconstruction based structure estimation of GRNs using time series experimental data
Zhang, W., Zhang, Y., & Liu, Z. (2017) · Chinese Control and Decision Conference (CCDC) · doi:10.1109/ccdc.2017.7978479
“It should be noted that these typically performance metrics are utilized to evaluate the sparse reconstruction algorithm [14, 15].”
BackgroundDoctor of Philosophy at Virginia Commonwealth University
Chaitankar, V. (2012)
Constructing and analyzing gene regulatory networks in leaf senescence of arabidopsis thalina
Herath, H., Weerasinghe, A. R., & Wijesinghe, C. R. (2017) · International Conference on Advances in ICT for Emerging Regions · doi:10.1109/icter.2017.8257793
“Nevertheless, artificial network generators such as DREAM challenge (Prill et al., 2010), BionetBuilder (Avila et al.”
BackgroundMalik, S., Kim, C., Kumari, R., & Pathak, S. (2018) · Journal of Emerging Technologies and Innovative Research
Semantic Prioritization of Novel Causative Genomic Variants in Mendelian and Oligogenic Diseases
Boudellioua, I. (2019) · King Abdullah University of Science and Technology Repository (King Abdullah University of Science and Technology) · doi:10.25781/kaust-y5g20
“Spectral-based graph clustering techniques have also been demonstrated in the latest Disease Module Identification DREAM Challenge to precede other proposed approaches in performance [133].”
MethodMethods for Reconstructing Networks with Incomplete Information.
Henderson, J. B. (2015) · Deep Blue (University of Michigan)
Computational Tools and Resources for Integrative Modeling in Systems Biology
Wierling, C., & Hache, H. (2013) · Springer eBooks · doi:10.1007/978-94-007-6803-1_14
Dey, P., Khan, A., Saha, G. K., & Pal, R. K. (2021) · Advances in intelligent systems and computing · doi:10.1007/978-981-16-5952-2_14
Dunn, S.-J. (2019) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.722129179.793567423
Sullivan, R. (2011) · Humana Press eBooks · doi:10.1007/978-1-59745-290-8_11
Fang, W.-Q., Wu, Y., & Hwang, M. (2023) · Life · doi:10.3390/life13061331
“Introduction The network modeling of biological systems can capture many of their essential characteristics [1,2].”
Gene regulatory network inference based on modified adaptive lasso
Li, C., Huang, X., Luo, X., & Lin, X. (2024) · Journal of Bioinformatics and Computational Biology · doi:10.1142/s0219720024500264
Dynamic Regularized Granger Causality Learning Method
姚, 牧. (2025) · Hans Journal of Data Mining · doi:10.12677/hjdm.2025.152016
Ray, S. (2025) · Preprints.org · doi:10.20944/preprints202507.0417.v1
Metadata
- Authors
- Prill, R. J., Marbach, D., Saez-Rodriguez, J., Sorger, P. K., Alexopoulos, L. G., Xue, X., Clarke, N. D., Altan-Bonnet, G., & Stolovitzky, G.
- Affiliations
- IBM (United States) (US)
- École Polytechnique Fédérale de Lausanne (CH)
- Harvard University (US)
- National Technical University of Athens (GR)
- Genome Institute of Singapore (SG)
- Corresponding author
- Stolovitzky, Gustavo
- ORCID
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2010-02-23
- Volume
- 5
- Issue
- 2
- Pages
- e9202
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC2826397
- OpenAlex
- W2143076232
- Cited by
- 439
- References
- 33
- Citations by year
- 2026: 16 · 2025: 16 · 2024: 15 · 2023: 11 · 2022: 21 · 2021: 18 · 2020: 17 · 2019: 17 · 2018: 28 · 2017: 27 · 2016: 23 · 2015: 50 · 2014: 40 · 2013: 38 · 2012: 47
- FWCI
- 18.23
- Type
- journal article
- Language
- en
- Update notices
- correction (2010-03-09)
- Open access
- gold
- doi.org
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Digital Access to Scholarship at Harvard (DASH) (Harvard University) (submittedVersion, cc-by)
- National University of Singapore (submittedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- DSpace - NTUA (National Technical University of Athens) (submittedVersion, other-oa)
- Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion)
- Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion, cc-by-nc-nd)
- Funders
- National Science Foundation (GM68762, 0848030)
- National Institutes of Health (3p50gm068762-07s2, NIH P50, GM68762)
- National Cancer Institute (U54CA112967)
- National Institute of General Medical Sciences (P50 GM68762, P50-GM068762)
- National Institute of Allergy and Infectious Diseases (R56AI083408, AI083408, R01AI083408)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene Regulatory Network Analysis
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Bioinformatics and Genomic Networks
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Microbial Metabolic Engineering and Bioproduction
- Keywords
- network inference, reverse engineering, gene expression prediction, ensemble forecasting, model validation
- MeSH terms
- Algorithms, Animals, Humans, Models, Biological, Software, Reproducibility of Results, Signal Transduction, Cluster Analysis, Computational Biology, Gene Expression Profiling, Protein Interaction Mapping, Systems Biology, Gene Regulatory Networks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.