Optimal design of stimulus experiments for robust discrimination of biochemical reaction networks
Open accessThe DOI matches its Crossref record; 48 of the 50 references it cites were found in a registry or an index.
Abstract
Motivation: Biochemical reaction networks in the form of coupled ordinary differential equations (ODEs) provide a powerful modeling tool for understanding the dynamics of biochemical processes. During the early phase of modeling, scientists have to deal with a large pool of competing nonlinear models. At this point, discrimination experiments can be designed and conducted to obtain optimal data for selecting the most plausible model. Since biological ODE models have widely distributed parameters due to, e.g. biologic variability or experimental variations, model responses become distributed. Therefore, a robust optimal experimental design (OED) for model discrimination can be used to discriminate models based on their response probability distribution functions (PDFs). Results: In this work, we present an optimal control-based methodology for designing optimal stimulus experiments aimed at robust model discrimination. For estimating the time-varying model response PDF, which results from the nonlinear propagation of the parameter PDF under the ODE dynamics, we suggest using the sigma-point approach. Using the model overlap (expected likelihood) as a robust discrimination criterion to measure dissimilarities between expected model response PDFs, we benchmark the proposed nonlinear design approach against linearization with respect to prediction accuracy and design quality for two nonlinear biological reaction networks. As shown, the sigma-point outperforms the linearization approach in the case of widely distributed parameter sets and/or existing multiple steady states. Since the sigma-point approach scales linearly with the number of model parameter, it can be applied to large systems for robust experimental planning. Availability: An implementation of the method in MATLAB/AMPL is available at http://www.uni-magdeburg.de/ivt/svt/person/rf/roed.html. Contact: flassig@mpi-magdeburg.mpg.de Supplementary information: Supplementary data are are available at Bioinformatics online.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures

![Fig. 2. Expected responses of models A (crossed square), B (crossed circle) on log-scale for optimized stimuli (crossed triangle) and corresponding bands [first component only, (a)/(b) , (c)/(d) ]](https://figures.cochat.ai/paper-figures/0a3ff518138140a291d3a8300b535091/optimal-design-of-stimulus-experiments-for-robust-discrimination-of-biochemical-figure-2.jpg)

Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“The topic of optimal design of dynamic experiments in biological systems is receiving increased attention [144–152].”
From Reverse engineering and identification in systems biology: strategies, perspectives and challenges (2014) · cites this paper as [151]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An Analysis of Transformations
Box, G. E. P., & Cox, D. R. (1964) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1964.tb00553.x · Cited by 15,052
Completely Derandomized Self-Adaptation in Evolution Strategies
Hansen, N., & Ostermeier, A. (2001) · Evolutionary Computation · doi:10.1162/106365601750190398 · Cited by 4,397
Mitogen-Activated Protein (MAP) Kinase Pathways: Regulation and Physiological Functions*
Pearson, G., Robinson, F., Beers Gibson, T., Xu, B.-E., Karandikar, M., Berman, K., & Cobb, M. H. (2001) · Endocrine Reviews · doi:10.1210/edrv.22.2.0428 · Cited by 4,034
A new method for the nonlinear transformation of means and covariances in filters and estimators
Julier, S., Uhlmann, J., & Durrant-Whyte, H. F. (2000) · IEEE Transactions on Automatic Control · doi:10.1109/9.847726 · Cited by 3,735
Sensitivity analysis for non-linear mathematical models
Sobol, I. M. (1993) · Medical Entomology and Zoology · Cited by 3,174
SYSTEMS OF FREQUENCY CURVES GENERATED BY METHODS OF TRANSLATION
JOHNSON, N. L. (1949) · Biometrika · doi:10.1093/biomet/36.1-2.149 · Cited by 2,442
Practical markov chain monte carlo
Geyer, C. J. (1992) · Statistical Science · doi:10.1214/ss/1177011137 · Cited by 2,045
2007 IEEE International Conference on Acoustics, Speech, and Signal Processing
(2007) · 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07 · doi:10.1109/icassp.2007.366148 · Cited by 1,520
Raue, A., Kreutz, C., Maiwald, T., Bachmann, J., Schilling, M., Klingmüller, U., & Timmer, J. (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp358 · Cited by 1,442 · cited 3×
“Much work on optimal experimental stimulus design (OESD) for biological systems focuses on information maximization with respect to parameter identification (Balsa-Canto et al ., 2008; Bandara et al ., 2009; Heine et al ., 2008; Raue et al ., 2010; Schenkendorf et al ., 2009a).”
BackgroundMethodIntroduction to Global Optimization
Horst, R., Pardalos, P. M., & Thoai, N. V. (2000) · Nonconvex Optimization and Its Applications · doi:10.1007/978-1-4615-0015-5 · Cited by 1,217
Identification of parametric models : from experimental data
Walter, É., & Pronzato, L. (1997) · Cited by 1,197
Chemical reaction models for non-equilibrium phase transitions
Schl�gl, F. (1972) · Zeitschrift f�r Physik · doi:10.1007/bf01379769 · Cited by 1,004
Drud, A. S. (1994) · ORSA Journal on Computing · doi:10.1287/ijoc.6.2.207 · Cited by 690
Nonconvex Optimization and Its Applications
Pardalos, P. M., Mishra, S. K., Wang, S., & Lai, K. K. (2008) · Cited by 538
An overview of simultaneous strategies for dynamic optimization
Biegler, L. T. (2007) · Chemical Engineering and Processing: Process Intensification · doi:10.1016/j.cep.2006.06.021 · Cited by 520
A review of recent advances in global optimization
Floudas, C. A., & Gounaris, C. E. (2009) · Journal of Global Optimization · doi:10.1007/s10898-008-9332-8 · Cited by 455 · cited 2×
“Global optimality of the design can be achieved—but is not ensured—by (i) performing local optimizations from different initial starting points and/or (ii) deterministic/ stochastic/heuristic global optimizers (Floudas and Gounaris, 2009; Horst et al., 2000; Zabinsky, 2003).”
BackgroundDAISY: A new software tool to test global identifiability of biological and physiological systems
Bellu, G., Saccomani, M. P., Audoly, S., & D’Angiò, L. (2007) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2007.07.002 · Cited by 452
Discrimination Among Mechanistic Models
Box, G. E. P., & Hill, W. J. (1967) · Technometrics · doi:10.1080/00401706.1967.10490441 · Cited by 426
Some inequalities for information divergence and related measures of discrimination
Topsoe, F. (2000) · IEEE Transactions on Information Theory · doi:10.1109/18.850703 · Cited by 325
The design of experiments for discriminating between two rival models
ATKINSON, A. C., & FEDOROV, V. V. (1975) · Biometrika · doi:10.1093/biomet/62.1.57 · Cited by 301
Vellela, M., & Qian, H. (2009) · Journal of The Royal Society Interface · doi:10.1098/rsif.2008.0476 · Cited by 232
(1995) · Nonconvex Optimization and Its Applications · doi:10.1007/978-1-4613-3557-3 · Cited by 231
Introduction to Global Optimization (Nonconvex Optimization and Its Applications)
Horst, R. (2002) · Springer eBooks · Cited by 218
JebaraTony, KondorRisi, & HowardAndrew (2004) · Journal of Machine Learning Research · doi:10.5555/1005332.1016786 · Cited by 216
Stochastic Adaptive Search for Global Optimization
Zabinsky, Z. B. (2003) · Nonconvex Optimization and Its Applications · doi:10.1007/978-1-4419-9182-9 · Cited by 215
Designing robust optimal dynamic experiments
Asprey, S. P., & Macchietto, S. (2002) · Journal of Process Control · doi:10.1016/s0959-1524(01)00020-8 · Cited by 199 · cited 2×
“For chemical reaction kinetics and biotechnology, there exists some work on designing dynamic stimuli for the purpose of model discrimination (Asprey and Macchietto, 2002; Box and Hill, 1967; Kremling et al ., 2004).”
BackgroundIdentifiability and observability analysis for experimental design in nonlinear dynamical models
Raue, A., Becker, V., Klingmüller, U., & Timmer, J. (2010) · Chaos: An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/1.3528102 · Cited by 137
Optimal Experimental Design for Parameter Estimation of a Cell Signaling Model
Bandara, S., Schlöder, J. P., Eils, R., Bock, H. G., & Meyer, T. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000558 · Cited by 135 · cited 1×
“Much work on optimal experimental stimulus design (OESD) for biological systems focuses on information maximization with respect to parameter identification (Balsa-Canto et al ., 2008; Bandara et al ., 2009; Heine et al ., 2008; Raue et al ., 2010; Schenkendorf et al ., 2009a).”
BackgroundKremling, A., Fischer, S., Gadkar, K., Doyle, F. J., Sauter, T., Bullinger, E., Allgöwer, F., & Gilles, E. D. (2004) · Genome Research · doi:10.1101/gr.1226004 · Cited by 127 · cited 1×
“For chemical reaction kinetics and biotechnology, there exists some work on designing dynamic stimuli for the purpose of model discrimination (Asprey and Macchietto, 2002; Box and Hill, 1967; Kremling et al ., 2004).”
Behar, M., Hao, N., Dohlman, H. G., & Elston, T. C. (2007) · Biophysical Journal · doi:10.1529/biophysj.107.107516 · Cited by 125
Computational procedures for optimal experimental design in biological systems
Balsa-Canto, E., Alonso, A. A., & Banga, J. R. (2008) · IET Systems Biology · doi:10.1049/iet-syb:20070069 · Cited by 124
A Cybernetic Perspective of Microbial Growth
Ramkrishna, D. (1983) · ACS symposium series · doi:10.1021/bk-1983-0207.ch007 · Cited by 101
A bayesian approach to targeted experiment design
Vanlier, J., Tiemann, C. A., Hilbers, P. A. J., & van Riel, N. A. W. (2012) · Bioinformatics · doi:10.1093/bioinformatics/bts092 · Cited by 98
Optimal experimental design with the sigma point method
Schenkendorf, R., Kremling, A., & Mangold, M. (2009) · IET Systems Biology · doi:10.1049/iet-syb:20080094 · Cited by 79
Stimulus Design for Model Selection and Validation in Cell Signaling
Apgar, J. F., Toettcher, J. E., Endy, D., White, F. M., & Tidor, B. (2008) · PLoS Computational Biology · doi:10.1371/journal.pcbi.0040030 · Cited by 79
Chen, B. H., & Asprey, S. P. (2003) · Industrial & Engineering Chemistry Research · doi:10.1021/ie0203025 · Cited by 72
Foundations of Biochemical Engineering: Kinetics and Thermodynamics in Biological Systems
Blanch, H. W., Papoutsakis, E. T., & Stephanopoulos, G. N. (1983) · ACS symposium series · doi:10.1021/bk-1983-0207 · Cited by 63
Mélykúti, B., August, E., Papachristodoulou, A., & El-Samad, H. (2010) · BMC Systems Biology · doi:10.1186/1752-0509-4-38 · Cited by 58
An optimal experimental design approach to model discrimination in dynamic biochemical systems
Skanda, D., & Lebiedz, D. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btq074 · Cited by 42
Optimal Experimental Design for Discriminating Numerous Model Candidates: The AWDC Criterion
Michalik, C., Stuckert, M., & Marquardt, W. (2009) · Industrial & Engineering Chemistry Research · doi:10.1021/ie900903u · Cited by 39
Derivative-free optimal experimental design
Heine, T., Kawohl, M., & King, R. (2008) · Chemical Engineering Science · doi:10.1016/j.ces.2008.01.030 · Cited by 33
On nonlinear transformations of stochastic variables and its application to nonlinear filtering
Gustafsson, F., & Hendeby, G. (2008) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2008.4518435 · Cited by 33
Constrained control of nonlinear systems
Nevistic, V. (1997) · ETH Zürich Research Collection · doi:10.3929/ethz-a-001761150 · Cited by 23
Donckels, B. M. R., Pauw, D. J. W. D., Vanrolleghem, P. A., & Baets, B. D. (2011) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2011.06.008 · Cited by 18
A robust optimization approach to experimental design for model discrimination of dynamical systems
Skanda, D., & Lebiedz, D. (2012) · Mathematical Programming · doi:10.1007/s10107-012-0532-0 · Cited by 14
Discrimination of dynamical system models for biological and chemical processes
Lorenz, S., Diederichs, E., Telgmann, R., & Schütte, C. (2007) · Journal of Computational Chemistry · doi:10.1002/jcc.20674 · Cited by 12
Optimal Experimental Design and Model Selection by a Sigma Point Approach
Schenkendorf, R., Kremling, A., & Mangold, M. (2009) · Max Planck Institute for Plasma Physics · Cited by 4
On Establishing the Credibility of a Model for a System
Singh, S. (1998) · Process Safety and Environmental Protection · doi:10.1205/026387698525360 · Cited by 4
Research works printed but not linked: 1
- Sobol’, 1993, Sensitivity analysis for nonlinear mathematical models, Math. Mod. Com. Exp., 1, 407
Cited by
Reverse engineering and identification in systems biology: strategies, perspectives and challenges
Villaverde, A. F., & Banga, J. R. (2014) · Journal of The Royal Society Interface · doi:10.1098/rsif.2013.0505 · Cited by 229
“Other methods have exploited sigma-point approaches [151] or Kullback–Leibler optimality [150,152].”
MethodModel Selection in Systems Biology Depends on Experimental Design
Silk, D., Kirk, P., Barnes, C. P., Toni, T., & Stumpf, M. P. H. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003650 · Cited by 73
Optimal experiment design for model selection in biochemical networks
Vanlier, J., Tiemann, C. A., Hilbers, P. A. J., & van Riel, N. A. W. (2014) · BMC Systems Biology · doi:10.1186/1752-0509-8-20 · Cited by 55
Robust multi-objective dynamic optimization of chemical processes using the Sigma Point method
Vallerio, M., Telen, D., Cabianca, L., Manenti, F., van Impe, J. F. M., & Logist, F. (2015) · Chemical Engineering Science · doi:10.1016/j.ces.2015.09.012 · Cited by 49
Modeling metabolic systems: the need for dynamics
Song, H., DeVilbiss, F. T., & Ramkrishna, D. (2013) · Current Opinion in Chemical Engineering · doi:10.1016/j.coche.2013.08.004 · Cited by 46
Metadata
- Authors
- Flassig, R. J., & Sundmacher, K.
- Affiliations
- Otto-von-Guericke-Universität Magdeburg (DE)
- Max Planck Institute for Dynamics of Complex Technical Systems (DE)
- Corresponding author
- Flassig, R. J.
- Venue
- Bioinformatics
- Publisher
- Oxford University Press (OUP)
- Published
- 2012-10-09
- Volume
- 28
- Issue
- 23
- Pages
- 3089-3096
- ISSN
- 1367-4803 (ISSN-L)
- 1367-4811
- PMC
- PMC3516143
- OpenAlex
- W2155949509
- Cited by
- 31
- References
- 50
- Citations by year
- 2025: 1 · 2024: 1 · 2023: 1 · 2022: 1 · 2021: 1 · 2020: 1 · 2018: 5 · 2017: 2 · 2016: 4 · 2015: 4 · 2014: 5 · 2013: 4 · 2012: 1
- FWCI
- 5.93
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Bioinformatics (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- MPG.PuRe (Max Planck Society) (submittedVersion, other-oa)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Optimal Experimental Design Methods
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene Regulatory Network Analysis
- Physical Sciences › Engineering › Control and Systems Engineering › Control Systems and Identification
- Keywords
- optimal experimental design, model discrimination, biochemical reaction networks, robust design, parameter uncertainty, multiple steady states, optimal control
- MeSH terms
- Algorithms, Models, Biological, Probability, Research Design, Nonlinear Dynamics, Computational Biology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.