Model Selection in Systems Biology Depends on Experimental Design
Open accessThe DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
Experimental design attempts to maximise the information available for modelling tasks. An optimal experiment allows the inferred models or parameters to be chosen with the highest expected degree of confidence. If the true system is faithfully reproduced by one of the models, the merit of this approach is clear - we simply wish to identify it and the true parameters with the most certainty. However, in the more realistic situation where all models are incorrect or incomplete, the interpretation of model selection outcomes and the role of experimental design needs to be examined more carefully. Using a novel experimental design and model selection framework for stochastic state-space models, we perform high-throughput in-silico analyses on families of gene regulatory cascade models, to show that the selected model can depend on the experiment performed. We observe that experimental design thus makes confidence a criterion for model choice, but that this does not necessarily correlate with a model's predictive power or correctness. Finally, in the special case of linear ordinary differential equation (ODE) models, we explore how wrong a model has to be before it influences the conclusions of a model selection analysis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Systems biology: a brief overview
Kitano, H. (2002) · Science · doi:10.1126/science.1069492 · Cited by 4,265
On a measure of the information provided by an experiment
Lindley, D. V. (1956) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177728069 · Cited by 1,509
Information-based objective functions for active data selection
MacKay, D. J. C. (1992) · Neural Computation · doi:10.1162/neco.1992.4.4.590 · Cited by 1,221
Simulation-based optimal bayesian experimental design for nonlinear systems
Huan, X., & Marzouk, Y. M. (2013) · Journal of Computational Physics · doi:10.1016/j.jcp.2012.08.013 · Cited by 438 · cited 1×
“al [2] that builds upon existing methods [3–8], by utilising a sequential approximate Bayesian computation framework to choose the experiment that maximises the expected mutual information between prior and posterior parameter distributions.”
MethodMaximizing the information content of experiments in systems biology
Liepe, J., Filippi, S., Komorowski, M., & Stumpf, M. P. H. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002888 · Cited by 170 · cited 3×
“[2], which are limited to exploring small sets of models and experiments.”
BackgroundMethodSelf-citationModel selection in systems and synthetic biology
Kirk, P., Thorne, T., & Stumpf, M. P. (2013) · Current Opinion in Biotechnology · doi:10.1016/j.copbio.2013.03.012 · Cited by 118
Self-citationA bayesian approach to targeted experiment design
Vanlier, J., Tiemann, C. A., Hilbers, P. A. J., & van Riel, N. A. W. (2012) · Bioinformatics · doi:10.1093/bioinformatics/bts092 · Cited by 98
Erguler, K., & Stumpf, M. P. H. (2011) · Molecular BioSystems · doi:10.1039/c0mb00107d · Cited by 91
Self-citationOptimal sampling time selection for parameter estimation in dynamic pathway modeling
Kutalik, Z., Cho, K.-H., & Wolkenhauer, O. (2004) · Biosystems · doi:10.1016/j.biosystems.2004.03.007 · Cited by 79
Chu, Y., & Hahn, J. (2008) · AIChE Journal · doi:10.1002/aic.11562 · Cited by 41
Cited by
Reconstructing gene regulatory dynamics from high-dimensional single-cell snapshot data
Ocone, A., Haghverdi, L., Mueller, N. S., & Theis, F. J. (2015) · Bioinformatics · doi:10.1093/bioinformatics/btv257 · Cited by 155
“Understanding stem cell differentiation is fundamental for advances in cell reprogramming research, with potentially practical applications in regenerative medicine and drug development (Cherry and Daley, 2012; Inoue and Yamanaka, 2011).”
A matter of time: Using dynamics and theory to uncover mechanisms of transcriptional bursting
Lammers, N. C., Kim, Y. J., Zhao, J., & Garcia, H. G. (2020) · Current Opinion in Cell Biology · doi:10.1016/j.ceb.2020.08.001 · Cited by 99
Recent developments in using mechanistic cardiac modelling for drug safety evaluation
Davies, M. R., Wang, K., Mirams, G. R., Caruso, A., Noble, D., Walz, A., Lavé, T., Schuler, F., Singer, T., & Polonchuk, L. (2016) · Drug Discovery Today · doi:10.1016/j.drudis.2016.02.003 · Cited by 66
Metadata
- Authors
- Silk, D., Kirk, P. D. W., Barnes, C. P., Toni, T., & Stumpf, M. P. H.
- Venue
- PLoS Computational Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2014-06-12
- Volume
- 10
- Issue
- 6
- Pages
- e1003650
- ISSN
- 1553-734X (ISSN-L)
- 1553-7358
- OpenAlex
- W1993903208
- Cited by
- 66
- References
- 11
- FWCI
- 2.92
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Model Selection in Systems Biology Depends on Experimental Design. https://app.cochat.ai/papers/10.1371/journal.pcbi.1003650
- The paper
- Silk, D., Kirk, P. D. W., Barnes, C. P., Toni, T., & Stumpf, M. P. H. (2014). Model Selection in Systems Biology Depends on Experimental Design. PLoS Computational Biology. https://doi.org/10.1371/journal.pcbi.1003650
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.