Maximizing the Information Content of Experiments in Systems Biology
Open accessThe DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index; 4 of the 24 sources its claims cite were checked for support.
Abstract
Our understanding of most biological systems is in its infancy. Learning their structure and intricacies is fraught with challenges, and often side-stepped in favour of studying the function of different gene products in isolation from their physiological context. Constructing and inferring global mathematical models from experimental data is, however, central to systems biology. Different experimental setups provide different insights into such systems. Here we show how we can combine concepts from Bayesian inference and information theory in order to identify experiments that maximize the information content of the resulting data. This approach allows us to incorporate preliminary information; it is global and not constrained to some local neighbourhood in parameter space and it readily yields information on parameter robustness and confidence. Here we develop the theoretical framework and apply it to a range of exemplary problems that highlight how we can improve experimental investigations into the structure and dynamics of biological systems and their behavior.
Overview
CoChat Summary
TL;DR
The paper develops a Bayesian experimental design framework that uses mutual information to select experiments maximizing information about model parameters or predictions in systems biology. It applies the method to repressilator, Hes1, and EGF-dependent AKT models, showing that selected experiments improve parameter inference or predictive certainty.
Key findings
- In the repressilator model, two of the four proposed experiments had the highest mutual information; ABC inference confirmed that data from those experiments allowed all parameters to be estimated, whereas data from the original repressilator system allowed only some parameters to be inferred with confidence.
- In the Hes1 model, mRNA measurements carried more information about all parameters than total cellular Hes protein measurements; entropy-difference analysis on simulated data was consistent, although one protein-parameter result diverged for a specific dataset because mutual information is an average over possible data.
- In the EGF-dependent AKT pathway, predictions under a noisy 5-pulse EGF input were highly uncertain using only the initial dataset; mutual information selected a step stimulus as most informative, and adding its outcome improved predictions and inferred EGFR turnover and EGFR initial condition at the required precision.
Methods
- The framework combines Bayesian inference and information theory: it selects experiments by maximizing mutual information between parameters and experimental output, or between a target prediction and candidate experiment output, with Monte Carlo estimation.
- Posterior parameter distributions are inferred using Approximate Bayesian Computation with sequential Monte Carlo (ABC-SMC), implemented in ABC-SysBio.
- Models include a repressilator ODE toy model with hypothetical experiments, a three-component Hes1 ODE model, and an EGF-dependent AKT pathway model using experimentally measured normalized Western blot data from the Kuroda lab; computations used GPU-parallel ODE solving and Monte Carlo estimation.
Limitations
- Stated: the approach chooses an optimal experiment from a finite, discrete set; continuous experimental design requires a different approach. Entropy estimates are histogram-based and biased, though comparisons across experiments remain valid if bin number and sample size are kept the same. Mutual information is an average over possible data, so it can diverge from entropy reduction for a specific dataset, as observed in the Hes1 example.
- Evident from the text: the repressilator experiments are hypothetical, and the AKT data are normalized Western blot measurements; the paper also notes that Bayesian posterior computation via MCMC/SMC is costly.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures

![Figure 2 The repressilator model (as described in [40]) and the set of possible experiments. (A) Illustration of the original repressilator model. The model consists of 3 mRNA species (coloured wavy lines, labeled , and ) and their corresponding proteins (circles shown in the same color with labels , and ). The 3 regulatory DNA regions are not modeled explicitly but included in the mRNA production process. They are shown for illustration purpose only. (B) The ordinary differential equations which describe the evolution of the concentration of the mRNAs and proteins over time. (C) Four potential modifications of the wild-type model. For each experimental intervention the modified parameters are listed (colours are as in A). The modifications of the wild-type model consist of decreasing one or several of the parameters of the system: in sets , and , the regime of the parameter is changed; in sets , and , respectively, parameters , and are modified for only one gene which breaks the symmetry of the system.](https://figures.cochat.ai/paper-figures/88bb0d64c033449e89e84f0542ab76d5/maximizing-the-information-content-of-experiments-in-systems-biology-figure-2.jpg)

![Figure 4 Experiment selection for parameter inference in the Hes model. (A) Diagram of the Hes model and the associated ordinary differential equations. The model shows a cell (green box) with its nucleus (white circle). Hes mRNA (wavy line with label ) is produced inside the nucleus and translated into Hes cellular protein (), which in turn is then transported into the nucleus and becomes nuclear Hes protein (). is regulating the production of . (B) The mutual information between each parameters and the output of the system for respectively mRNA measurement (left) and total cellular Hes measurement (right). The barplot represents the mean and the variance over repetitions of the Monte-Carlo estimation. (C) Estimation of the difference between the entropy of the parameter prior and the entropy of the posterior distribution given one dataset. The dataset results from simulation of the Hes system. The parameter was set to be 0.03 min−1 as experimentally determined by [42].](https://figures.cochat.ai/paper-figures/fb8b76f93f4e4249ad0322f2f45a0c8b/maximizing-the-information-content-of-experiments-in-systems-biology-figure-4.jpg)
![Figure 5 The EGF-dependent AKT pathway and an initial dataset. (A) Diagram of the model of the EGF-dependent AKT pathway. Epidermal growth factor (EGF, red triangle) is a stimulus for a signalling cascade, which results in the phosphorylation (green circle) of Akt (blue square) and S6 (purple square). EGF binds to the EGF membrane receptor EGFR (orange), which is generated from a pro-EGFR. The Binding results in the phosphorylation of the receptor, which consequently leads to the activation of downstream cascades (thick black circle). This simplified model was shown to capture the experimentally determined dynamics [45]. (B) A impulse input of EGF over seconds with an intensity of ng/ml (top) and the resulting time course of phosphorylated EGF receptor (pEGFR), phosphorylated Akt (pAKT) and phosphorylated S6 (pS6) in response to this stimulus (bottom). Data were provided by the authors of [45].](https://figures.cochat.ai/paper-figures/db6674a045ec4e83884bc4ed1dba2b6b/maximizing-the-information-content-of-experiments-in-systems-biology-figure-5.jpg)

Verification
Claims the paper makes
3 Valid · 0 Not valid · 15 Not checked · 53 Own results and interpretations
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“The mutual information for models of type (9) can be estimated using Monte Carlo simulations [26], [53].”
§ Maximizing the Information Content of Experiments in Systems Biology > Methods > Estimation of the mutual information
What the sources say
- Supportedcites [26] X Huan, 2012, Simulation-based optimal bayesian experimental design for nonlinear systems, Journal of Computational Physics source
The Introduction (p. 2) identifies mutual information as equivalent to expected information gain. Section 2.3 (pp. 7–8) describes estimating that quantity with nested Monte Carlo sampling for the paper’s nonlinear-model setting. (LLM, conf=0.91)
- Not checked yetcites [53] Berg BA (2004) Markov Chain Monte Carlo Simulations And Their Statistical Analysis. World Scientific Publishing. source
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“for experimental set we observe that mRNA and as well as protein carry equally high information.”
§ Maximizing the Information Content of Experiments in Systems Biology > Results > Experiment selection for parameter inference
plainSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The level of noise is amplified as can be observed in the pS6 time course.”
§ Maximizing the Information Content of Experiments in Systems Biology > Results > Experiment selection for prediction
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Moreover, pS6 does not have time to relax to its baseline between the pulses”
§ Maximizing the Information Content of Experiments in Systems Biology > Results > Experiment selection for prediction
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“whereas the addition of the outcome of the step stimulus experiment suggested by our methods infers these parameters at the required precision.”
§ Maximizing the Information Content of Experiments in Systems Biology > Results > Experiment selection for prediction
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
41 more claims
Create a free account to see all 71 claims and to verify the 20 references still open.
- Probably not a substantial claim. 14
- It may state two separate claims as one. 15
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“The importance of the role played by experimental design in this task had been stressed e.g. in [2, 32].”
From On the relationship between sloppiness and identifiability (2016) · cites this paper as [32]
Citations
Cites
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486
Information theory, inference, and learning algorithms
(2004) · Choice Reviews Online · doi:10.5860/choice.41-5949 · Cited by 6,362
A synthetic oscillatory network of transcriptional regulators
Elowitz, M. B., & Leibler, S. (2000) · Nature · doi:10.1038/35002125 · Cited by 4,630 · cited 2×
“The repressilator model (as described in [40]) and the set of possible experiments.”
MethodApproximate Bayesian computation in population genetics
Beaumont, M. A., Zhang, W., & Balding, D. J. (2002) · Genetics · doi:10.1093/genetics/162.4.2025 · Cited by 2,932
Bayesian Experimental Design: A Review
Chaloner, K., & Verdinelli, I. (1995) · Statistical Science · doi:10.1214/ss/1177009939 · Cited by 1,839 · cited 1×
“When faced with different experimental setups, q, and hence different datasets, Xq, choosing the set(s) which maximize I(Xq,H) will provide the best insights into the system via improved parameter estimates [20,38,39].”
BackgroundInternational encyclopedia of the social and behavioral sciences
(2015) · Choice Reviews Online · doi:10.5860/choice.192822 · Cited by 1,831
Causal Protein-Signaling Networks Derived from Multiparameter Single-Cell Data
Sachs, K., Perez, O., Pe'er, D., Lauffenburger, D. A., & Nolan, G. P. (2005) · Science · doi:10.1126/science.1105809 · Cited by 1,708 · cited 1×
“We can loosely group these methods into (i) those aimed at reconstructing network models [8–10] (using correlations or statistical dependencies in observed datasets), (ii) methods to estimate (biochemical reaction) rate parameters of models describing the dynamics of biological systems [11–13], and (iii) approaches th…”
MethodOn a measure of the information provided by an experiment
Lindley, D. V. (1956) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177728069 · Cited by 1,509 · cited 3×
“When faced with different experimental setups, q, and hence different datasets, Xq, choosing the set(s) which maximize I(Xq,H) will provide the best insights into the system via improved parameter estimates [20,38,39].”
BackgroundToni, T., Welch, D., Strelkowa, N., Ipsen, A., & Stumpf, M. P. H. (2009) · Journal of The Royal Society Interface · doi:10.1098/rsif.2008.0172 · Cited by 1,498 · cited 2×
“Specifically we use an ABC scheme based on sequential Monte Carlo, which has been developed for likelihood-free parameter inference in deterministic and stochastic systems [41].”
MethodSelf-citationEstimation of entropy and mutual information
Paninski, L. (2003) · Neural Computation · doi:10.1162/089976603321780272 · Cited by 1,442 · cited 1×
“It is also well known that such histogram approach leads to a biased estimate of the entropy [58].”
BackgroundUniversally Sloppy Parameter Sensitivities in Systems Biology Models
Gutenkunst, R. N., Waterfall, J. J., Casey, F. P., Brown, K. S., Myers, C. R., & Sethna, J. P. (2007) · PLoS Computational Biology · doi:10.1371/journal.pcbi.0030189 · Cited by 1,261 · cited 3×
“Unfortunately obtaining reliable parameter estimates for dynamical systems is plagued with difficulties [16,17].”
BackgroundMethodMarkov chain Monte Carlo without likelihoods
Marjoram, P., Molitor, J., Plagnol, V., & Tavaré, S. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0306899100 · Cited by 1,199 · cited 1×
“Finding the posterior, p(hDx), is usually achieved by means of powerful (if costly) computational algorithms such as Markov chain Monte Carlo (MCMC) and sequential Monte Carlo (SMC) methods, which also exist in the approximate Bayesian computation (ABC) framework [15,35,36].”
Use of Unlinked Genetic Markers to Detect Population Stratification in Association Studies
Pritchard, J. K., & Rosenberg, N. A. (1999) · The American Journal of Human Genetics · doi:10.1086/302449 · Cited by 1,198 · cited 1×
“Approximate Bayesian Computation (ABC) Once data x have been collected, we use an Approximate Bayesian Computation framework [55,56] to infer the posterior parameter distribution p(hDx ).”
MethodSequential Monte Carlo without likelihoods
Sisson, S. A., Fan, Y., & Tanaka, M. M. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0607208104 · Cited by 856 · cited 1×
“Finding the posterior, p(hDx), is usually achieved by means of powerful (if costly) computational algorithms such as Markov chain Monte Carlo (MCMC) and sequential Monte Carlo (SMC) methods, which also exist in the approximate Bayesian computation (ABC) framework [15,35,36].”
Oscillatory Expression of the bHLH Factor Hes1 Regulated by a Negative Feedback Loop
Hirata, H., Yoshiura, S., Ohtsuka, T., Bessho, Y., Harada, T., Yoshikawa, K., & Kageyama, R. (2002) · Science · doi:10.1126/science.1074560 · Cited by 763
Oxley, J. A. (1995) · Medical Entomology and Zoology · Cited by 761
Mendes, P., & Kell, D. (1998) · Bioinformatics · doi:10.1093/bioinformatics/14.10.869 · Cited by 676 · cited 1×
“We can loosely group these methods into (i) those aimed at reconstructing network models [8–10] (using correlations or statistical dependencies in observed datasets), (ii) methods to estimate (biochemical reaction) rate parameters of models describing the dynamics of biological systems [11–13], and (iii) approaches th…”
MethodPrinciples of Statistical Inference
Cox, D. R. (2006) · doi:10.1017/cbo9780511813559 · Cited by 670 · cited 1×
“The latter theory was first developed at a time when the number of alternative hypotheses was smaller than the amount of available data and replicates [19].”
BackgroundStochastic modelling for quantitative description of heterogeneous biological systems
Wilkinson, D. J. (2009) · Nature Reviews Genetics · doi:10.1038/nrg2509 · Cited by 574 · cited 1×
“Usually sparse and notoriously noisy data are fitted using models with large number of parameters [18].”
Expected Information as Expected Utility
Bernardo, J. M. (1979) · The Annals of Statistics · doi:10.1214/aos/1176344689 · Cited by 568 · cited 1×
“Several authors have used the information theoretical framework, in particular the expected gain in Shannon information to assess the information content of an experiment [20–24].”
Bruggeman, F. J., & Westerhoff, H. V. (2007) · Trends in Microbiology · doi:10.1016/j.tim.2006.11.003 · Cited by 531 · cited 1×
“Mathematical models of biomolecular systems are by design and necessity abstractions of a much more complicated reality [1,2].”
BackgroundSimulation-based optimal bayesian experimental design for nonlinear systems
Huan, X., & Marzouk, Y. M. (2013) · Journal of Computational Physics · doi:10.1016/j.jcp.2012.08.013 · Cited by 438 · cited 2×
“Huan and Marzouk used a framework, which is similar to ours, in that it maximizes mutual information via Monte Carlo approximation to find optimal experiments [26]; but they only focus on parameter inference and ignore prediction.”
MethodMeasurement of single-cell dynamics
Spiller, D. G., Wood, C. D., Rand, D. A., & White, M. R. H. (2010) · Nature · doi:10.1038/nature09232 · Cited by 411
Hausser, J., & Strimmer, K. (2008) · arXiv (Cornell University) · doi:10.48550/arxiv.0811.3579 · Cited by 356 · cited 1×
“We use the R package entropy [59] to estimate the entropy.”
MethodMarkov Chain Monte Carlo Simulations and Their Statistical Analysis: With Web-Based Fortran Code
Berg, B. A. (2004) · doi:10.1142/5602 · Cited by 345
A Bayesian approach to reconstructing genetic regulatory networks with hidden factors
Beal, M. J., Falciani, F., Ghahramani, Z., Rangel, C., & Wild, D. L. (2005) · Bioinformatics · doi:10.1093/bioinformatics/bti014 · Cited by 283
Uncertainty, Information, and Sequential Experiments
DeGroot, M. H. (1962) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177704567 · Cited by 266 · cited 1×
“Several authors have used the information theoretical framework, in particular the expected gain in Shannon information to assess the information content of an experiment [20–24].”
Simulation-based model selection for dynamical systems in systems and population biology
Toni, T., & Stumpf, M. P. H. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btp619 · Cited by 260
Self-citationSystems biology: experimental design
Kreutz, C., & Timmer, J. (2009) · The FEBS Journal · doi:10.1111/j.1742-4658.2008.06843.x · Cited by 257 · cited 1×
“We can loosely group these methods into (i) those aimed at reconstructing network models [8–10] (using correlations or statistical dependencies in observed datasets), (ii) methods to estimate (biochemical reaction) rate parameters of models describing the dynamics of biological systems [11–13], and (iii) approaches th…”
MethodBrenner, S. (2010) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2009.0221 · Cited by 244 · cited 1×
“Brenner [7]) as one of the major problems facing systems biologists.”
BackgroundMaximum entropy sampling and optimal bayesian experimental design
Sebastiani, P., & Wynn, H. P. (2000) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00225 · Cited by 243 · cited 3×
“In the information theoretic language, as by Lindley [20] and later by Sebastiani and Wynn [52] the initial (prior) uncertainty is given by the entropy H(H) of the prior distribution p(h), which after data xq have been collected (in experimental setup q) gives rise to Figure 6.”
BackgroundSensitivity, robustness, and identifiability in stochastic chemical kinetics models
Komorowski, M., Costa, M. J., Rand, D. A., & Stumpf, M. P. H. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1015814108 · Cited by 194 · cited 1×
“the Fisher information [29,33]; third, we obtain comprehensive statistical predictions (including confidence, sensitivity and robustness assessments if desired); and we are very flexible in the type of information that we seek to optimize.”
Self-citationDiseases as network perturbations
del Sol, A., Balling, R., Hood, L., & Galas, D. (2010) · Current Opinion in Biotechnology · doi:10.1016/j.copbio.2010.07.010 · Cited by 188 · cited 1×
“These difficulties are exacerbated in no small measure for many of the most important and topical research areas in biology [3–5].”
BackgroundStatistical inference of the time-varying structure of gene-regulation networks
Lèbre, S., Becq, J., Devaux, F., Stumpf, M. P., & Lelandais, G. (2010) · BMC Systems Biology · doi:10.1186/1752-0509-4-130 · Cited by 187 · cited 1×
“We can loosely group these methods into (i) those aimed at reconstructing network models [8–10] (using correlations or statistical dependencies in observed datasets), (ii) methods to estimate (biochemical reaction) rate parameters of models describing the dynamics of biological systems [11–13], and (iii) approaches th…”
MethodSelf-citationBayesian ranking of biochemical system models
Vyshemirsky, V., & Girolami, M. A. (2008) · Bioinformatics · doi:10.1093/bioinformatics/btm607 · Cited by 181
Data-based identifiability analysis of non-linear dynamical models
Hengl, S., Kreutz, C., Timmer, J., & Maiwald, T. (2007) · Bioinformatics · doi:10.1093/bioinformatics/btm382 · Cited by 166
Sloppy models, parameter uncertainty, and the role of experimental design
Apgar, J. F., Witmer, D. K., White, F. M., & Tidor, B. (2010) · Molecular BioSystems · doi:10.1039/b918098b · Cited by 146 · cited 1×
“Our approach improves on previous methods [25–32] in a number of ways: first we are able to incorporate but do not require preliminary experimental data; second, it is a global approach that is not limited to some neighbourhood in parameter space unlike approaches solely based on e.”
MethodABC-SysBio approximate Bayesian computation in Python with GPU support
Liepe, J., Barnes, C., Cule, E., Erguler, K., Kirk, P., Toni, T., & Stumpf, M. P. H. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btq278 · Cited by 136
Self-citationOptimal Experimental Design for Parameter Estimation of a Cell Signaling Model
Bandara, S., Schlöder, J. P., Eils, R., Bock, H. G., & Meyer, T. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000558 · Cited by 135
Parameter estimation in stochastic biochemical reactions
Reinker, S., Altman, R. M., & Timmer, J. (2006) · IEE Proceedings - Systems Biology · doi:10.1049/ip-syb:20050105 · Cited by 110 · cited 1×
“We can loosely group these methods into (i) those aimed at reconstructing network models [8–10] (using correlations or statistical dependencies in observed datasets), (ii) methods to estimate (biochemical reaction) rate parameters of models describing the dynamics of biological systems [11–13], and (iii) approaches th…”
MethodA bayesian approach to targeted experiment design
Vanlier, J., Tiemann, C. A., Hilbers, P. A. J., & van Riel, N. A. W. (2012) · Bioinformatics · doi:10.1093/bioinformatics/bts092 · Cited by 98 · cited 2×
“Previous approaches had taken a more local approach [25,29,30,47] that relied on initial parameter guesses and often data; our approach also readily incorporates different stimulus patterns [48].”
MethodErguler, K., & Stumpf, M. P. H. (2011) · Molecular BioSystems · doi:10.1039/c0mb00107d · Cited by 91 · cited 3×
“Unfortunately obtaining reliable parameter estimates for dynamical systems is plagued with difficulties [16,17].”
BackgroundMethodSelf-citationBayesian design of synthetic biological systems
Barnes, C. P., Silk, D., Sheng, X., & Stumpf, M. P. H. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1017972108 · Cited by 90 · cited 1×
“Target conditions could, for example, include clinical settings which are generally not experimentally amenable (at least in early stage research); here the current approach offers a rationale for designing [49] therapeutic interventions into complex systems based on investigations of suitable model systems.”
BackgroundSelf-citationGPU accelerated biochemical network simulation
Zhou, Y., Liepe, J., Sheng, X., Stumpf, M. P. H., & Barnes, C. (2011) · Bioinformatics · doi:10.1093/bioinformatics/btr015 · Cited by 87
Self-citationFujita, K. A., Toyoshima, Y., Uda, S., Ozaki, Y.-I., Kubota, H., & Kuroda, S. (2010) · Science Signaling · doi:10.1126/scisignal.2000810 · Cited by 84 · cited 7×
“This behavior fits with the low-pass filter characteristics previously described [45].”
BackgroundMethodResultInfluentialApplication of a Measure of Information to the Design and Comparison of Regression Experiments
Stone, M. (1959) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177706359 · Cited by 82 · cited 1×
“Several authors have used the information theoretical framework, in particular the expected gain in Shannon information to assess the information content of an experiment [20–24].”
The Cell in an Era of Systems Biology
Nurse, P., & Hayles, J. (2011) · Cell · doi:10.1016/j.cell.2011.02.045 · Cited by 81
Stimulus Design for Model Selection and Validation in Cell Signaling
Apgar, J. F., Toettcher, J. E., Endy, D., White, F. M., & Tidor, B. (2008) · PLoS Computational Biology · doi:10.1371/journal.pcbi.0040030 · Cited by 79 · cited 2×
“The approach we presented here yields the potential for model discrimination or checking the target of our analysis [48,51], and, for example, choose experimental designs that maximize our ability to distinguish between competing alternative hypotheses or models.”
BackgroundMethodOptimal sampling time selection for parameter estimation in dynamic pathway modeling
Kutalik, Z., Cho, K.-H., & Wolkenhauer, O. (2004) · Biosystems · doi:10.1016/j.biosystems.2004.03.007 · Cited by 79
Casey, F. P., Baird, D., Feng, Q., Gutenkunst, R. N., Waterfall, J. J., Myers, C. R., Brown, K. S., Cerione, R. A., & Sethna, J. P. (2007) · IET Systems Biology · doi:10.1049/iet-syb:20060065 · Cited by 77 · cited 1×
“Our approach improves on previous methods [25–32] in a number of ways: first we are able to incorporate but do not require preliminary experimental data; second, it is a global approach that is not limited to some neighbourhood in parameter space unlike approaches solely based on e.”
MethodSilk, D., Kirk, P. D. W., Barnes, C. P., Toni, T., Rose, A., Moon, S., Dallman, M. J., & Stumpf, M. P. H. (2011) · Nature Communications · doi:10.1038/ncomms1496 · Cited by 76 · cited 1×
“The Hes1 oscillator can be modelled by a simple three-component ODE model [43] as shown in Figure 4 A.”
MethodSelf-citationAn integrated strategy for prediction uncertainty analysis
Vanlier, J., Tiemann, C. A., Hilbers, P. A. J., & van Riel, N. A. W. (2012) · Bioinformatics · doi:10.1093/bioinformatics/bts088 · Cited by 67 · cited 1×
“Our approach improves on previous methods [25–32] in a number of ways: first we are able to incorporate but do not require preliminary experimental data; second, it is a global approach that is not limited to some neighbourhood in parameter space unlike approaches solely based on e.”
MethodMélykúti, B., August, E., Papachristodoulou, A., & El-Samad, H. (2010) · BMC Systems Biology · doi:10.1186/1752-0509-4-38 · Cited by 58 · cited 1×
“The approach we presented here yields the potential for model discrimination or checking the target of our analysis [48,51], and, for example, choose experimental designs that maximize our ability to distinguish between competing alternative hypotheses or models.”
BackgroundRecent Developments in the Foundations of Utility and Risk Theory
(1986) · Springer eBooks · doi:10.1007/978-94-009-4616-3 · Cited by 55
Chu, Y., & Hahn, J. (2008) · AIChE Journal · doi:10.1002/aic.11562 · Cited by 41 · cited 2×
“the Fisher information [29,33]; third, we obtain comprehensive statistical predictions (including confidence, sensitivity and robustness assessments if desired); and we are very flexible in the type of information that we seek to optimize.”
MethodLiepe, J., Taylor, H., Barnes, C. P., Huvet, M., Bugeon, L., Thorne, T., Lamb, J. R., Dallman, M. J., & Stumpf, M. P. H. (2012) · Integrative Biology · doi:10.1039/c2ib00175f · Cited by 33 · cited 1×
“The regulatory, metabolic and signalling processes involved in cellfate and other biological decision-making processes are often only indirectly observable; moreover, when studied in isolation their behavior can often be markedly altered compared to the experimentally more challenging in vivo contexts [6].”
BackgroundSelf-citationExperimental Design: A Bayesian Perspective
Clyde, M. A. (2001) · Cited by 33
A global parallel model based design of experiments method to minimize model output uncertainty
Bazil, J. N., Buzzard, G. T., & Rundell, A. E. (2012) · Bulletin of Mathematical Biology · doi:10.1007/s11538-011-9686-9 · Cited by 28 · cited 1×
“approach, as for example shown in [50].”
Toyoshima, Y., Kakuda, H., Fujita, K. A., Uda, S., & Kuroda, S. (2012) · Nature Communications · doi:10.1038/ncomms1745 · Cited by 21 · cited 1×
“In further support earlier studies [46] found that a downstream molecule can be more sensitive to an upstream activator than the direct target molecule of the activator.”
Experimental Design: Bayesian Designs
Clyde, M. A. (2001) · Elsevier eBooks · doi:10.1016/b0-08-043076-7/00421-6 · Cited by 19
Concepts of Information Based on Utility
DeGroot, M. H. (1986) · Springer eBooks · doi:10.1007/978-94-009-4616-3_17 · Cited by 17 · cited 1×
“Several authors have used the information theoretical framework, in particular the expected gain in Shannon information to assess the information content of an experiment [20–24].”
Molecular Systems Biology in Drug Development
Silver, P. A., & Way, J. C. (2007) · Clinical Pharmacology & Therapeutics · doi:10.1038/sj.clpt.6100293 · Cited by 15 · cited 1×
“These difficulties are exacerbated in no small measure for many of the most important and topical research areas in biology [3–5].”
BackgroundThe Role of Space in the Exploitation of Resources
Kang, Y. Y., & Lanchier, N. (2011) · Bulletin of Mathematical Biology · doi:10.1007/s11538-011-9649-1 · Cited by 10
Research works printed but not linked: 1
- J Bazil, 2012, A global parallel model based design of experiments method to minimize model output uncertainty, Bulletin of mathematical biology, 74, 1, 10.1007/s11538-011-9686-9 · DOI · Paper page
Cited by
A Review of Modern Computational Algorithms for Bayesian Optimal Design
Ryan, E. G., Drovandi, C. C., McGree, J. M., & Pettitt, A. N. (2016) · International Statistical Review · doi:10.1111/insr.12107 · Cited by 312
“One of the most commonly used and versatile Bayesian design criteria is the mutual information, which is based on entropy, and has been used for designing for efficient parameter estimation (Bernardo, 1979; Ryan, 2003; Paninski, 2005), minimising prediction uncertainty (Liepe et al., 2013) and model discrimination (Bo…”
MethodColloquium : Machine learning in nuclear physics
Boehnlein, A., Diefenthaler, M., Sato, N., Schram, M., Ziegler, V., Fanelli, C., Hjorth-Jensen, M., Horn, T., Kuchera, M. P., Lee, D., et al. (2022) · Reviews of Modern Physics · doi:10.1103/revmodphys.94.031003 · Cited by 257
“We would also like to point to the theory of Bayesian Experimental Design (BED) (Chaloner and Verdinelli, 1995; Liepe et al. , 2013) – a theory that is tailored for making optimal decisions under uncertainty.”
MethodReverse engineering and identification in systems biology: strategies, perspectives and challenges
Villaverde, A. F., & Banga, J. R. (2014) · Journal of The Royal Society Interface · doi:10.1098/rsif.2013.0505 · Cited by 229
“[199] illustrated the combination of Bayesian inference with information theory to design experiments with maximum information content and applied it to three different problems.”
BackgroundLiepe, J., Kirk, P., Filippi, S., Toni, T., Barnes, C. P., & Stumpf, M. P. H. (2014) · Nature Protocols · doi:10.1038/nprot.2014.025 · Cited by 217
“This task is easily performed by sampling a set of particles from the obtained posterior distribution and simulating the model (or the variation of the model) for each of the particles 65 .”
MethodSelf-citationUncertainty and variability in computational and mathematical models of cardiac physiology
Mirams, G. R., Pathmanathan, P., Gray, R. A., Challenor, P., & Clayton, R. H. (2016) · The Journal of Physiology · doi:10.1113/jp271671 · Cited by 164
Metadata
- Authors
- Liepe, J., Filippi, S., Komorowski, M., & Stumpf, M. P. H.
- Affiliations
- Imperial College London (GB)
- Institute of Fundamental Technological Research (PL)
- Corresponding author
- Liepe, Juliane
- Filippi, Sarah
- Komorowski, Michał
- Stumpf, Michael P. H.
- Venue
- PLoS Computational Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2013-01-31
- Volume
- 9
- Issue
- 1
- Pages
- e1002888
- ISSN
- 1553-734X (ISSN-L)
- 1553-7358
- PMC
- PMC3561087
- OpenAlex
- W2092692908
- Semantic Scholar
- 58272574a816e9dc6122feae1705d7024fe1f94c
- Cited by
- 170
- References
- 63
- Citations by year
- 2026: 6 · 2025: 3 · 2024: 6 · 2023: 11 · 2022: 13 · 2021: 11 · 2020: 18 · 2019: 21 · 2018: 19 · 2017: 11 · 2016: 10 · 2015: 15 · 2014: 20 · 2013: 6
- FWCI
- 7.61
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS Computational Biology (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- MPG.PuRe (Max Planck Society) (submittedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Max Planck Digital Library (submittedVersion, cc-by)
- Figshare (submittedVersion, cc-by)
- Minerva Access (University of Melbourne) (submittedVersion, cc-by)
- Spiral (Imperial College London) (submittedVersion, other-oa)
- Funders
- Wellcome Trust
- Medical Research Council
- Biotechnology and Biological Sciences Research Council (BB/G001863/1, BB/G530268/1, BB/G020434/1, BB/G007934/1)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene Regulatory Network Analysis
- Physical Sciences › Engineering › Control and Systems Engineering › Control Systems and Identification
- Social Sciences › Decision Sciences › Management Science and Operations Research › Optimal Experimental Design Methods
- Keywords
- experimental design, information content, Bayesian inference, information theory, parameter estimation, parameter robustness, biological systems, model inference, prior information
- MeSH terms
- Bayes Theorem, Models, Theoretical, Uncertainty, Systems Biology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-05, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-05 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.