The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Benchmarking optimization methods for parameter estimation in large kinetic models
Open accessAbstract
Motivation: Kinetic models contain unknown parameters that are estimated by optimizing the fit to experimental data. This task can be computationally challenging due to the presence of local optima and ill-conditioning. While a variety of optimization methods have been suggested to surmount these issues, it is difficult to choose the best one for a given problem a priori. A systematic comparison of parameter estimation methods for problems with tens to hundreds of optimization variables is currently missing, and smaller studies provided contradictory findings. Results: We use a collection of benchmarks to evaluate the performance of two families of optimization methods: (i) multi-starts of deterministic local searches and (ii) stochastic global optimization metaheuristics; the latter may be combined with deterministic local searches, leading to hybrid methods. A fair comparison is ensured through a collaborative evaluation and a consideration of multiple performance metrics. We discuss possible evaluation criteria to assess the trade-off between computational efficiency and robustness. Our results show that, thanks to recent advances in the calculation of parametric sensitivities, a multi-start of gradient-based local methods is often a successful strategy, but a better performance can be obtained with a hybrid metaheuristic. The best performer combines a global scatter search metaheuristic with an interior point local method, provided with gradients estimated with adjoint-based sensitivities. We provide an implementation of this method to render it available to the scientific community. Availability and implementation: The code to reproduce the results is provided as Supplementary Material and is available at Zenodo https://doi.org/10.5281/zenodo.1304034. Supplementary information: Supplementary data are available at Bioinformatics online.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
No free lunch theorems for optimization
Wolpert, D. H., & Macready, W. G. (1997) · IEEE Transactions on Evolutionary Computation · doi:10.1109/4235.585893 · Cited by 14,237
A Whole-Cell Computational Model Predicts Phenotype from Genotype
Karr, J. R., Sanghvi, J. C., Macklin, D. N., Gutschow, M. V., Jacobs, J. M., Bolival, B., Assad-Garcia, N., Glass, J. I., & Covert, M. W. (2012) · Cell · doi:10.1016/j.cell.2012.05.044 · Cited by 1,300 · cited 1×
“During the last decade, many efforts have been devoted to developing increasingly detailed and, therefore, larger systems biology models [29,49,51].”
BackgroundParameter estimation in biochemical pathways: a comparison of global optimization methods
Moles, C. G., Mendes, P., & Banga, J. R. (2003) · Genome Research · doi:10.1101/gr.1262503 · Cited by 858
Self-citationStructural identifiability of systems biology models: a critical comparison of methods
Chis, O.-T., Banga, J. R., & Balsa-Canto, E. (2011) · PLoS ONE · doi:10.1371/journal.pone.0027755 · Cited by 448 · cited 1×
“State-of-the-art identifiability analysis methods have been recently evaluated elsewhere [10,33,38,45,54].”
MethodSelf-citationSystems biology: parameter estimation for biochemical models
Ashyraliyev, M., Fomekong‐Nanfack, Y., Kaandorp, J. A., & Blom, J. G. (2009) · The FEBS Journal · doi:10.1111/j.1742-4658.2008.06844.x · Cited by 323
Novel metaheuristic for parameter estimation in nonlinear dynamic biological systems
Rodriguez-Fernandez, M., Egea, J. A., & Banga, J. R. (2006) · BMC Bioinformatics · doi:10.1186/1471-2105-7-483 · Cited by 278
Self-citationLinking data to models: data regression
Jaqaman, K., & Danuser, G. (2006) · Nature Reviews Molecular Cell Biology · doi:10.1038/nrm2030 · Cited by 243
Reverse engineering and identification in systems biology: strategies, perspectives and challenges
Villaverde, A. F., & Banga, J. R. (2014) · Journal of The Royal Society Interface · doi:10.1098/rsif.2013.0505 · Cited by 229
Self-citationGlobal optimization for the parameter estimation of differential-algebraic systems
Esposito, W. R., & Floudas, C. A. (2000) · Industrial & Engineering Chemistry Research · doi:10.1021/ie990486w · Cited by 188
Scatter search for chemical and bio-process optimization
Egea, J. A., Rodríguez-Fernández, M., Banga, J. R., & Martí, R. (2007) · Journal of Global Optimization · doi:10.1007/s10898-006-9075-3 · Cited by 171
Self-citationFröhlich, F., Kessler, T., Weindl, D., Shadrin, A., Schmiester, L., Hache, H., Muradyan, A., Schütte, M., Lim, J.-H., Heinig, M., et al. (2018) · Cell Systems · doi:10.1016/j.cels.2018.10.013 · Cited by 143
Self-citationParameter estimation and optimal experimental design
Banga, J. R., & Balsa-Canto, E. (2008) · Essays in Biochemistry · doi:10.1042/bse0450195 · Cited by 141 · cited 2×
“In order to avoid suboptimal solutions, many studies have recommended the use of global optimization techniques (Ashyraliyev et al., 2009; Banga and Balsa-Canto, 2008; Chen et al., 2010; Mendes and Kell, 1998).”
BackgroundSelf-citationA cooperative strategy for parameter estimation in large scale systems biology models
Villaverde, A. F., Egea, J. A., & Banga, J. R. (2012) · BMC Systems Biology · doi:10.1186/1752-0509-6-75 · Cited by 56
Self-citationMiró, A., Pozo, C., Guillén-Gosálbez, G., Egea, J. A., & Jiménez, L. (2012) · BMC Bioinformatics · doi:10.1186/1471-2105-13-90 · Cited by 41
Cited by
Systems biology informed deep learning for inferring parameters and hidden dynamics
Yazdani, A., Lu, L., Raissi, M., & Karniadakis, G. E. (2020) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1007575 · Cited by 329
Microbiome modeling: a beginner's guide
Lange, E., Kranert, L., Krüger, J., Benndorf, D., & Heyer, R. (2024) · Frontiers in Microbiology · doi:10.3389/fmicb.2024.1368377 · Cited by 21
Metadata
- Authors
- Villaverde, A. F., Fröhlich, F., Weindl, D., Hasenauer, J., & Banga, J. R.
- Venue
- Bioinformatics
- Publisher
- Oxford University Press (OUP)
- Published
- 2018-08-23
- Volume
- 35
- Issue
- 5
- Pages
- 830-838
- ISSN
- 1367-4803 (ISSN-L)
- 1367-4811
- OpenAlex
- W2952056515
- Cited by
- 161
- References
- 14
- FWCI
- 7.92
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.