An optimal experimental design approach to model discrimination in dynamic biochemical systems
The DOI matches its Crossref record; 33 of the 35 references it cites were found in a registry or an index, and 1 are not checked yet.
Abstract
Motivation: Finding suitable models of dynamic biochemical systems is an important task in systems biology approaches to the biosciences. On the one hand, a correct model helps to understand the underlying mechanisms and on the other hand, one can use the model to predict the behavior of a biological system under various circumstances. Typically, before the correct model of a biochemical system is found, different hypothetical models might be reasonable and consistent with previous knowledge and available data. The main goal now is to find the best suited model out of different hypotheses. The process of falsifying inappropriate candidate models is called model discrimination. Results: We have developed a new computational tool to compute optimal experiments for biochemical kinetic systems with underlying ordinary differential equation (ODE) models for the purpose of model discrimination. We were inspired by the demands of biological experimentalists which perform one run measurement where perturbations to the system are possible. We provide a criterion which calculates the number and location of time points of optimal measurements as well as optimal initial conditions and optimal perturbations to the system. Availability: The model discrimination algorithm described here is implemented in C++ in the package ModelDiscriminationToolkit. The source code can be downloaded from http://omnibus.unifreiburg.de/~ds500/_software.html Contact: dirk.lebiedz@biologie.uni-freiburg.de Supplementary information: Supplementary data are available at Bioinformatics online.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The topic of optimal design of dynamic experiments in biological systems is receiving increased attention [144–152].”
From Reverse engineering and identification in systems biology: strategies, perspectives and challenges (2014) · cites this paper as [150]
Citations
Cites
Model selection and multimodel inference: a practical information-theoretic approach.
Guthery, F. S., Burnham, K. P., & Anderson, D. R. (2003) · The Journal of Wildlife Management · doi:10.2307/3802723 · Cited by 41,495
Wächter, A., & Biegler, L. T. (2006) · Mathematical Programming · doi:10.1007/s10107-004-0559-y · Cited by 9,483
Introduction to Numerical Analysis.
Froberg, C.-E., Stoer, J., & Bulirsch, R. (1981) · Mathematics of Computation · doi:10.2307/2007454 · Cited by 5,463
Introduction to Numerical Analysis
Stoer, J., & Bulirsch, R. (1980) · Springer eBooks · doi:10.1007/978-1-4757-5592-3 · Cited by 2,154
A Multiple Shooting Algorithm for Direct Solution of Optimal Control Problems *
Bock, H. G., & Plitt, K. J. (1984) · IFAC Proceedings Volumes · doi:10.1016/s1474-6670(17)61205-9 · Cited by 1,306
Biochemical Oscillations and Cellular Rhythms: The Molecular Bases of Periodic and Chaotic Behaviour
Goldbeter, A., & Keizer, J. (1998) · Physics Today · doi:10.1063/1.882194 · Cited by 610
Biochemical Oscillations and Cellular Rhythms: The Molecular Bases of Periodic and Chaotic Behaviour
Goldbeter, A., & Berridge, M. J. (1996) · Cambridge University Press eBooks · doi:10.1017/cbo9780511608193 · Cited by 608
The design of experiments for discriminating between two rival models
ATKINSON, A. C., & FEDOROV, V. V. (1975) · Biometrika · doi:10.1093/biomet/62.1.57 · Cited by 301
Parametric Statistical Inference
(1981) · Elsevier eBooks · doi:10.1016/c2013-0-03459-7 · Cited by 269
Systems biology: experimental design
Kreutz, C., & Timmer, J. (2009) · The FEBS Journal · doi:10.1111/j.1742-4658.2008.06843.x · Cited by 257
CVODES: The Sensitivity-Enabled ODE Solver in SUNDIALS
Serban, R., & Hindmarsh, A. C. (2005) · ASME International Design Engineering Technical Conferences and Computers and Information in Engineering Conference (IDETC/CIE) · doi:10.1115/detc2005-85597 · Cited by 215
Horn, R. (1987) · Biophysical Journal · doi:10.1016/s0006-3495(87)83331-3 · Cited by 201
Interpreting Kullback–Leibler divergence with the Neyman–Pearson lemma
Eguchi, S., & Copas, J. (2006) · Journal of Multivariate Analysis · doi:10.1016/j.jmva.2006.03.007 · Cited by 190
Numerical methods for optimum experimental design in DAE systems.
Bauer, I., Bock, H. G., Körkel, S., & Schlöder, J. P. (2000) · Journal of Computational and Applied Mathematics · doi:10.1016/s0377-0427(00)00300-9 · Cited by 185
Parametric Statistical Inference
Lindsey, J. K. (1996) · doi:10.1093/oso/9780198523598.001.0001 · Cited by 181
Scatter search for chemical and bio-process optimization
Egea, J. A., Rodríguez-Fernández, M., Banga, J. R., & Martí, R. (2007) · Journal of Global Optimization · doi:10.1007/s10898-006-9075-3 · Cited by 171 · cited 1×
“An effective way to search for a global optimum is the global scatter search method see for example Egea et al. (2007). A further numerical example for the situation that the model to simulate the data is different from both candidate models can be found in the supplementary material.”
MethodAdvances in Automatic Differentiation
Bischof, C. H., Bücker, H. M., Hovland, P., Naumann, U., & Utke, J. (2008) · Lecture notes in computational science and engineering · doi:10.1007/978-3-540-68942-3 · Cited by 169
Optimal experimental design for model discrimination.
Myung, J. I., & Pitt, M. A. (2009) · Psychological Review · doi:10.1037/a0016104 · Cited by 140
Scientific Computing in Chemical Engineering II
Hamburg, W. O. S. C. I. C. E. 1., Keil, F. J., Mackens, W., Kurths, J., & Hamburg, W. O. S. C. I. C. E. 1. (1999) · Springer eBooks · doi:10.1007/978-3-642-60185-9 · Cited by 137
Kremling, A., Fischer, S., Gadkar, K., Doyle, F. J., Sauter, T., Bullinger, E., Allgöwer, F., & Gilles, E. D. (2004) · Genome Research · doi:10.1101/gr.1226004 · Cited by 127
Computational procedures for optimal experimental design in biological systems
Balsa-Canto, E., Alonso, A. A., & Banga, J. R. (2008) · IET Systems Biology · doi:10.1049/iet-syb:20070069 · Cited by 124
An Optimal Experimental Design Criterion for Discriminating Between Non-Normal Models
López–Fidalgo, J., Tommasi, C., & Trandafir, P. C. (2007) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.1467-9868.2007.00586.x · Cited by 108
Discrimination and goodness of fit of multiresponse mechanistic models
Stewart, W. E., Shon, Y., & Box, G. E. P. (1998) · AIChE Journal · doi:10.1002/aic.690440618 · Cited by 98
Algorithmic Differentiation of Implicit Functions and Optimal Values
Bell, B. M., & Burke, J. V. (2008) · Lecture notes in computational science and engineering · doi:10.1007/978-3-540-68942-3_7 · Cited by 82
Stimulus Design for Model Selection and Validation in Cell Signaling
Apgar, J. F., Toettcher, J. E., Endy, D., White, F. M., & Tidor, B. (2008) · PLoS Computational Biology · doi:10.1371/journal.pcbi.0040030 · Cited by 79 · cited 3×
“g Apgar et al. (2008) and Markov chain Monte Carlo sampling methods Myung and Pitt (2009) are used to construct an appropriate design.”
BackgroundMethodInfluentialModel Discrimination and Mechanistic Interpretation of Kinetic Data in Protein Aggregation Studies
Bernacki, J. P., & Murphy, R. M. (2009) · Biophysical Journal · doi:10.1016/j.bpj.2008.12.3903 · Cited by 74
Modeling the nonlinear dynamics of cellular signal transduction
TIMMER, J., MÜLLER, T. G., SWAMEYE, I., SANDRA, O., & KLINGMÜLLER, U. (2004) · International Journal of Bifurcation and Chaos · doi:10.1142/s0218127404010461 · Cited by 68
Xie, L., Nyberg, G. B., Gu, X., Li, H., Möllborn, F., & Wang, D. I. C. (1997) · Biotechnology and Bioengineering · doi:10.1002/(sici)1097-0290(19971205)56:5<577::aid-bit11>3.0.co;2-9 · Cited by 61
Statistical analysis of synaptic transmission: model discrimination and confidence limits
Stricker, C., Redman, S., & Daley, D. J. (1994) · Biophysical Journal · doi:10.1016/s0006-3495(94)80513-2 · Cited by 45
Optimal dynamic experiments for bioreactor model discrimination
Cooney, M. J., & McDonald, K. A. (1995) · Applied Microbiology and Biotechnology · doi:10.1007/bf02431915 · Cited by 33
Experimental design for the identification of macrokinetic models and model discrimination
Takors, R., Wiechert, W., & Weuster‐Botz, D. (1997) · Biotechnology and Bioengineering · doi:10.1002/(sici)1097-0290(19971205)56:5<564::aid-bit10>3.0.co;2-c · Cited by 29
The design of pharmacokinetic experiments for model discrimination
Lacey, L., & Dunne, A. (1984) · Journal of Pharmacokinetics and Biopharmaceutics · doi:10.1007/bf01061725 · Cited by 15
Jain, R., Knorr, A. L., Bernacki, J. P., & Srivastava, R. (2006) · Biotechnology Progress · doi:10.1021/bp060161s · Cited by 14
Introduction to NumericalAnalysis
Bezuijen, A., & van Lottum, H. (2005) · doi:10.1201/9781439834268-33 · Cited by 6
Research works printed but not linked: 5
- Bock, 1987, Randwertproblemmethoden zur Parameteridentifizierung in Systemen nichtlinearer Differentialgleichungen
- HSL, 2007, A collection of fortran codes for large-scale scientific computation.
- Körkel, 1999, A sequential approach for nonlinear optimum experimental design in DAE systems, 338
- Uciński, 2004, Heteroscedastic T-optimum designs for multiresponse dynamic models, 191
- Wächter, 2002, An interior point algorithm for large-scale nonlinear optimization with applications in process engineering
Cited by
Reverse engineering and identification in systems biology: strategies, perspectives and challenges
Villaverde, A. F., & Banga, J. R. (2014) · Journal of The Royal Society Interface · doi:10.1098/rsif.2013.0505 · Cited by 229
“Other methods have exploited sigma-point approaches [151] or Kullback–Leibler optimality [150,152].”
MethodEgea, J. A., Henriques, D., Cokelaer, T., Villaverde, A. F., MacNamara, A., Danciu, D.-P., Banga, J. R., & Saez-Rodriguez, J. (2014) · BMC Bioinformatics · doi:10.1186/1471-2105-15-136 · Cited by 176
Advancing metabolic models with kinetic information
Link, H., Christodoulou, D., & Sauer, U. (2014) · Current Opinion in Biotechnology · doi:10.1016/j.copbio.2014.01.015 · Cited by 117
Online optimal experimental re‐design in robotic parallel fed‐batch cultivation facilities
Bournazou, M. N. C., Barz, T., Nickel, D. B., C., D. C. L., Glauche, F., Knepper, A., & Neubauer, P. B. (2016) · Biotechnology and Bioengineering · doi:10.1002/bit.26192 · Cited by 100
A bayesian approach to targeted experiment design
Vanlier, J., Tiemann, C. A., Hilbers, P. A. J., & van Riel, N. A. W. (2012) · Bioinformatics · doi:10.1093/bioinformatics/bts092 · Cited by 98
Metadata
- Authors
- Skanda, D., & Lebiedz, D.
- Affiliations
- University of Freiburg (DE)
- ORCID
- Lebiedz, Dirk
- Venue
- Bioinformatics
- Publisher
- Oxford University Press (OUP)
- Published
- 2010-02-21
- Volume
- 26
- Issue
- 7
- Pages
- 939-945
- ISSN
- 1367-4803 (ISSN-L)
- 1367-4811
- OpenAlex
- W2144197118
- Cited by
- 42
- References
- 35
- Citations by year
- 2021: 2 · 2020: 2 · 2019: 2 · 2018: 2 · 2017: 1 · 2016: 6 · 2015: 1 · 2014: 11 · 2013: 6 · 2012: 7
- FWCI
- 1.95
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Bioinformatics (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene Regulatory Network Analysis
- Social Sciences › Decision Sciences › Management Science and Operations Research › Optimal Experimental Design Methods
- Physical Sciences › Engineering › Control and Systems Engineering › Control Systems and Identification
- Keywords
- model discrimination, optimal experimental design, ordinary differential equations, time point selection, optimal perturbations, optimal initial conditions, systems biology
- MeSH terms
- Algorithms, Computational Biology, Systems Biology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.