Benchmarking regulatory network reconstruction with GRENDEL
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
Motivation: Over the past decade, the prospect of inferring networks of gene regulation from high-throughput experimental data has received a great deal of attention. In contrast to the massive effort that has gone into automated deconvolution of biological networks, relatively little effort has been invested in benchmarking the proposed algorithms. The rate at which new network inference methods are being proposed far outpaces our ability to objectively evaluate and compare them. This is largely due to a lack of fully understood biological networks to use as gold standards. Results: We have developed the most realistic system to date that generates synthetic regulatory networks for benchmarking reconstruction algorithms. The improved biological realism of our benchmark leads to conclusions about the relative accuracies of reconstruction algorithms that are significantly different from those obtained with A-BIOCHEM, an established in silico benchmark. Availability: The synthetic benchmark utility and the specific benchmark networks that were used in our analyses are available at http://mblab.wustl.edu/software/grendel/ Contact: brent@cse.wustl.edu
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hucka, M., Finney, A., Sauro, H. M., Bolouri, H., Doyle, J. C., Kitano, H., Arkin, A. P., Bornstein, B. J., Bray, D., Cornish-Bowden, A., et al. (2003) · Bioinformatics · doi:10.1093/bioinformatics/btg015 · Cited by 3,060
COPASI—a COmplex PAthway SImulator
Hoops, S., Sahle, S., Gauges, R., Lee, C., Pahle, J., Simus, N., Singhal, M., Xu, L., Mendes, P., & Kummer, U. (2006) · Bioinformatics · doi:10.1093/bioinformatics/btl485 · Cited by 2,618
Stem cell transcriptome profiling via massive-scale mRNA sequencing
Cloonan, N., Forrest, A. R. R., Kolle, G., Gardiner, B. B. A., Faulkner, G. J., Brown, M. K., Taylor, D. F., Steptoe, A. L., Wani, S., Bethel, G., et al. (2008) · Nature Methods · doi:10.1038/nmeth.1223 · Cited by 1,035
Multiple-laboratory comparison of microarray platforms
Irizarry, R. A., Warren, D., Spencer, F., Kim, I. F., Biswal, S., Frank, B. C., Gabrielson, E., Garcia, J. G. N., Geoghegan, J., Germino, G., et al. (2005) · Nature Methods · doi:10.1038/nmeth756 · Cited by 862 · cited 3×
“Using these benchmarks, we evaluated the accuracy of four network reconstruction algorithms, most of which have not been directly compared before: ARACNE (Margolin et al., 2006), CLR (Faith et al., 2007), Symmetric-N (Agrawal, 2007; Chen et al., 2008) and DBmcmc ( Husmeier, 2003 ).”
BackgroundMethodInfluentialQuantification of protein half-lives in the budding yeast proteome
Belle, A., Tanay, A., Bitincka, L., Shamir, R., & O’Shea, E. K. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0605420103 · Cited by 678
Inferring gene networks from time series microarray data using dynamic Bayesian networks
Kim, S. Y. (2003) · Briefings in Bioinformatics · doi:10.1093/bib/4.3.228 · Cited by 308
Cited by
GeneNetWeaver: in silico benchmark generation and performance profiling of network inference methods
Schaffter, T., Marbach, D., & Floreano, D. (2011) · Bioinformatics · doi:10.1093/bioinformatics/btr373 · Cited by 535
Towards a rigorous assessment of systems biology models: the DREAM3 challenges
Prill, R. J., Marbach, D., Saez-Rodriguez, J., Sorger, P. K., Alexopoulos, L. G., Xue, X., Clarke, N. D., Altan-Bonnet, G., & Stolovitzky, G. (2010) · PLoS ONE · doi:10.1371/journal.pone.0009202 · Cited by 439
“Researchers have used a variety of algorithms to deduce the structure of very different biological and artificial networks [1] and have evaluated their success using various metrics [2–8].”
Greenfield, A., Madar, A., Ostrer, H., & Bonneau, R. (2010) · PLoS ONE · doi:10.1371/journal.pone.0013397 · Cited by 255
Lasri, A., Shahrezaei, V., & Sturrock, M. (2022) · BMC Bioinformatics · doi:10.1186/s12859-022-04778-9 · Cited by 5
Lasri, A., Shahrezaei, V., & Sturrock, M. (2021) · doi:10.1101/2021.10.13.464275
Metadata
- Authors
- Haynes, B. C., & Brent, M. R.
- Venue
- Bioinformatics
- Publisher
- Oxford University Press (OUP)
- Published
- 2009-02-02
- Volume
- 25
- Issue
- 6
- Pages
- 801-807
- ISSN
- 1367-4803 (ISSN-L)
- 1367-4811
- OpenAlex
- W2141956986
- Cited by
- 43
- References
- 6
- FWCI
- 1.68
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Benchmarking regulatory network reconstruction with GRENDEL. https://app.cochat.ai/papers/10.1093/bioinformatics/btp068
- The paper
- Haynes, B. C., & Brent, M. R. (2009). Benchmarking regulatory network reconstruction with GRENDEL. Bioinformatics. https://doi.org/10.1093/bioinformatics/btp068
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.