Maximizing the Information Content of Experiments in Systems Biology
Open accessThe DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index; 4 of the 24 sources its claims cite were checked for support.
Abstract
Our understanding of most biological systems is in its infancy. Learning their structure and intricacies is fraught with challenges, and often side-stepped in favour of studying the function of different gene products in isolation from their physiological context. Constructing and inferring global mathematical models from experimental data is, however, central to systems biology. Different experimental setups provide different insights into such systems. Here we show how we can combine concepts from Bayesian inference and information theory in order to identify experiments that maximize the information content of the resulting data. This approach allows us to incorporate preliminary information; it is global and not constrained to some local neighbourhood in parameter space and it readily yields information on parameter robustness and confidence. Here we develop the theoretical framework and apply it to a range of exemplary problems that highlight how we can improve experimental investigations into the structure and dynamics of biological systems and their behavior.
Overview
CoChat Summary
TL;DR
The paper develops a Bayesian experimental design framework that uses mutual information to select experiments maximizing information about model parameters or predictions in systems biology. It applies the method to repressilator, Hes1, and EGF-dependent AKT models, showing that selected experiments improve parameter inference or predictive certainty.
Key findings
- In the repressilator model, two of the four proposed experiments had the highest mutual information; ABC inference confirmed that data from those experiments allowed all parameters to be estimated, whereas data from the original repressilator system allowed only some parameters to be inferred with confidence.
- In the Hes1 model, mRNA measurements carried more information about all parameters than total cellular Hes protein measurements; entropy-difference analysis on simulated data was consistent, although one protein-parameter result diverged for a specific dataset because mutual information is an average over possible data.
- In the EGF-dependent AKT pathway, predictions under a noisy 5-pulse EGF input were highly uncertain using only the initial dataset; mutual information selected a step stimulus as most informative, and adding its outcome improved predictions and inferred EGFR turnover and EGFR initial condition at the required precision.
Methods
- The framework combines Bayesian inference and information theory: it selects experiments by maximizing mutual information between parameters and experimental output, or between a target prediction and candidate experiment output, with Monte Carlo estimation.
- Posterior parameter distributions are inferred using Approximate Bayesian Computation with sequential Monte Carlo (ABC-SMC), implemented in ABC-SysBio.
- Models include a repressilator ODE toy model with hypothetical experiments, a three-component Hes1 ODE model, and an EGF-dependent AKT pathway model using experimentally measured normalized Western blot data from the Kuroda lab; computations used GPU-parallel ODE solving and Monte Carlo estimation.
Limitations
- Stated: the approach chooses an optimal experiment from a finite, discrete set; continuous experimental design requires a different approach. Entropy estimates are histogram-based and biased, though comparisons across experiments remain valid if bin number and sample size are kept the same. Mutual information is an average over possible data, so it can diverge from entropy reduction for a specific dataset, as observed in the Hes1 example.
- Evident from the text: the repressilator experiments are hypothetical, and the AKT data are normalized Western blot measurements; the paper also notes that Bayesian posterior computation via MCMC/SMC is costly.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures

![Figure 2 The repressilator model (as described in [40]) and the set of possible experiments. (A) Illustration of the original repressilator model. The model consists of 3 mRNA species (coloured wavy lines, labeled , and ) and their corresponding proteins (circles shown in the same color with labels , and ). The 3 regulatory DNA regions are not modeled explicitly but included in the mRNA production process. They are shown for illustration purpose only. (B) The ordinary differential equations which describe the evolution of the concentration of the mRNAs and proteins over time. (C) Four potential modifications of the wild-type model. For each experimental intervention the modified parameters are listed (colours are as in A). The modifications of the wild-type model consist of decreasing one or several of the parameters of the system: in sets , and , the regime of the parameter is changed; in sets , and , respectively, parameters , and are modified for only one gene which breaks the symmetry of the system.](https://figures.cochat.ai/paper-figures/88bb0d64c033449e89e84f0542ab76d5/maximizing-the-information-content-of-experiments-in-systems-biology-figure-2.jpg)

![Figure 4 Experiment selection for parameter inference in the Hes model. (A) Diagram of the Hes model and the associated ordinary differential equations. The model shows a cell (green box) with its nucleus (white circle). Hes mRNA (wavy line with label ) is produced inside the nucleus and translated into Hes cellular protein (), which in turn is then transported into the nucleus and becomes nuclear Hes protein (). is regulating the production of . (B) The mutual information between each parameters and the output of the system for respectively mRNA measurement (left) and total cellular Hes measurement (right). The barplot represents the mean and the variance over repetitions of the Monte-Carlo estimation. (C) Estimation of the difference between the entropy of the parameter prior and the entropy of the posterior distribution given one dataset. The dataset results from simulation of the Hes system. The parameter was set to be 0.03 min−1 as experimentally determined by [42].](https://figures.cochat.ai/paper-figures/fb8b76f93f4e4249ad0322f2f45a0c8b/maximizing-the-information-content-of-experiments-in-systems-biology-figure-4.jpg)
![Figure 5 The EGF-dependent AKT pathway and an initial dataset. (A) Diagram of the model of the EGF-dependent AKT pathway. Epidermal growth factor (EGF, red triangle) is a stimulus for a signalling cascade, which results in the phosphorylation (green circle) of Akt (blue square) and S6 (purple square). EGF binds to the EGF membrane receptor EGFR (orange), which is generated from a pro-EGFR. The Binding results in the phosphorylation of the receptor, which consequently leads to the activation of downstream cascades (thick black circle). This simplified model was shown to capture the experimentally determined dynamics [45]. (B) A impulse input of EGF over seconds with an intensity of ng/ml (top) and the resulting time course of phosphorylated EGF receptor (pEGFR), phosphorylated Akt (pAKT) and phosphorylated S6 (pS6) in response to this stimulus (bottom). Data were provided by the authors of [45].](https://figures.cochat.ai/paper-figures/db6674a045ec4e83884bc4ed1dba2b6b/maximizing-the-information-content-of-experiments-in-systems-biology-figure-5.jpg)

Verification
Claims the paper makes
3 Valid · 0 Not valid · 15 Not checked · 53 Own results and interpretations
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“The mutual information for models of type (9) can be estimated using Monte Carlo simulations [26], [53].”
§ Maximizing the Information Content of Experiments in Systems Biology > Methods > Estimation of the mutual information
What the sources say
- Supportedcites [26] X Huan, 2012, Simulation-based optimal bayesian experimental design for nonlinear systems, Journal of Computational Physics source
The Introduction (p. 2) identifies mutual information as equivalent to expected information gain. Section 2.3 (pp. 7–8) describes estimating that quantity with nested Monte Carlo sampling for the paper’s nonlinear-model setting. (LLM, conf=0.91)
- Not checked yetcites [53] Berg BA (2004) Markov Chain Monte Carlo Simulations And Their Statistical Analysis. World Scientific Publishing. source
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“for experimental set we observe that mRNA and as well as protein carry equally high information.”
§ Maximizing the Information Content of Experiments in Systems Biology > Results > Experiment selection for parameter inference
plainSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The level of noise is amplified as can be observed in the pS6 time course.”
§ Maximizing the Information Content of Experiments in Systems Biology > Results > Experiment selection for prediction
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Moreover, pS6 does not have time to relax to its baseline between the pulses”
§ Maximizing the Information Content of Experiments in Systems Biology > Results > Experiment selection for prediction
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“whereas the addition of the outcome of the step stimulus experiment suggested by our methods infers these parameters at the required precision.”
§ Maximizing the Information Content of Experiments in Systems Biology > Results > Experiment selection for prediction
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
41 more claims
Create a free account to see all 71 claims and to verify the 20 references still open.
- Probably not a substantial claim. 14
- It may state two separate claims as one. 15
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“The importance of the role played by experimental design in this task had been stressed e.g. in [2, 32].”
From On the relationship between sloppiness and identifiability (2016) · cites this paper as [32]
Citations
Cites
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486
Information theory, inference, and learning algorithms
(2004) · Choice Reviews Online · doi:10.5860/choice.41-5949 · Cited by 6,362
A synthetic oscillatory network of transcriptional regulators
Elowitz, M. B., & Leibler, S. (2000) · Nature · doi:10.1038/35002125 · Cited by 4,630 · cited 2×
“The repressilator model (as described in [40]) and the set of possible experiments.”
MethodApproximate Bayesian computation in population genetics
Beaumont, M. A., Zhang, W., & Balding, D. J. (2002) · Genetics · doi:10.1093/genetics/162.4.2025 · Cited by 2,932
Bayesian Experimental Design: A Review
Chaloner, K., & Verdinelli, I. (1995) · Statistical Science · doi:10.1214/ss/1177009939 · Cited by 1,839 · cited 1×
“When faced with different experimental setups, q, and hence different datasets, Xq, choosing the set(s) which maximize I(Xq,H) will provide the best insights into the system via improved parameter estimates [20,38,39].”
BackgroundInternational encyclopedia of the social and behavioral sciences
(2015) · Choice Reviews Online · doi:10.5860/choice.192822 · Cited by 1,831
Causal Protein-Signaling Networks Derived from Multiparameter Single-Cell Data
Sachs, K., Perez, O., Pe'er, D., Lauffenburger, D. A., & Nolan, G. P. (2005) · Science · doi:10.1126/science.1105809 · Cited by 1,708 · cited 1×
“We can loosely group these methods into (i) those aimed at reconstructing network models [8–10] (using correlations or statistical dependencies in observed datasets), (ii) methods to estimate (biochemical reaction) rate parameters of models describing the dynamics of biological systems [11–13], and (iii) approaches th…”
MethodOn a measure of the information provided by an experiment
Lindley, D. V. (1956) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177728069 · Cited by 1,509 · cited 3×
“When faced with different experimental setups, q, and hence different datasets, Xq, choosing the set(s) which maximize I(Xq,H) will provide the best insights into the system via improved parameter estimates [20,38,39].”
BackgroundToni, T., Welch, D., Strelkowa, N., Ipsen, A., & Stumpf, M. P. H. (2009) · Journal of The Royal Society Interface · doi:10.1098/rsif.2008.0172 · Cited by 1,498 · cited 2×
“Specifically we use an ABC scheme based on sequential Monte Carlo, which has been developed for likelihood-free parameter inference in deterministic and stochastic systems [41].”
MethodSelf-citationEstimation of entropy and mutual information
Paninski, L. (2003) · Neural Computation · doi:10.1162/089976603321780272 · Cited by 1,442 · cited 1×
“It is also well known that such histogram approach leads to a biased estimate of the entropy [58].”
Background
Research works printed but not linked: 1
- J Bazil, 2012, A global parallel model based design of experiments method to minimize model output uncertainty, Bulletin of mathematical biology, 74, 1, 10.1007/s11538-011-9686-9 · DOI · Paper page
Cited by
A Review of Modern Computational Algorithms for Bayesian Optimal Design
Ryan, E. G., Drovandi, C. C., McGree, J. M., & Pettitt, A. N. (2016) · International Statistical Review · doi:10.1111/insr.12107 · Cited by 312
“One of the most commonly used and versatile Bayesian design criteria is the mutual information, which is based on entropy, and has been used for designing for efficient parameter estimation (Bernardo, 1979; Ryan, 2003; Paninski, 2005), minimising prediction uncertainty (Liepe et al., 2013) and model discrimination (Bo…”
MethodColloquium : Machine learning in nuclear physics
Boehnlein, A., Diefenthaler, M., Sato, N., Schram, M., Ziegler, V., Fanelli, C., Hjorth-Jensen, M., Horn, T., Kuchera, M. P., Lee, D., et al. (2022) · Reviews of Modern Physics · doi:10.1103/revmodphys.94.031003 · Cited by 257
“We would also like to point to the theory of Bayesian Experimental Design (BED) (Chaloner and Verdinelli, 1995; Liepe et al. , 2013) – a theory that is tailored for making optimal decisions under uncertainty.”
MethodReverse engineering and identification in systems biology: strategies, perspectives and challenges
Villaverde, A. F., & Banga, J. R. (2014) · Journal of The Royal Society Interface · doi:10.1098/rsif.2013.0505 · Cited by 229
“[199] illustrated the combination of Bayesian inference with information theory to design experiments with maximum information content and applied it to three different problems.”
BackgroundLiepe, J., Kirk, P., Filippi, S., Toni, T., Barnes, C. P., & Stumpf, M. P. H. (2014) · Nature Protocols · doi:10.1038/nprot.2014.025 · Cited by 217
“This task is easily performed by sampling a set of particles from the obtained posterior distribution and simulating the model (or the variation of the model) for each of the particles 65 .”
MethodSelf-citationUncertainty and variability in computational and mathematical models of cardiac physiology
Mirams, G. R., Pathmanathan, P., Gray, R. A., Challenor, P., & Clayton, R. H. (2016) · The Journal of Physiology · doi:10.1113/jp271671 · Cited by 164
The Limitations of Model-Based Experimental Design and Parameter Estimation in Sloppy Systems
White, A., Tolman, M., Thames, H. D., Withers, H. R., Mason, K. A., & Transtrum, M. K. (2016) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1005227 · Cited by 124
Identifiability analysis for stochastic differential equation models in systems biology
Browning, A. P., Warne, D. J., Burrage, K., Baker, R. E., & Simpson, M. J. (2020) · Journal of The Royal Society Interface · doi:10.1098/rsif.2020.0652 · Cited by 143
“In a deterministic modelling framework, it is common to assume that all the variability in the data is uncorrelated and sourced from the observation process [37,80, 154].”
BackgroundGet on the BAND Wagon: a Bayesian framework for quantifying model uncertainties in nuclear dynamics
Phillips, D. R., Furnstahl, R. J., Heinz, U., Maiti, T., Nazarewicz, W., Nunes, F. M., Plumlee, M., Pratola, M. T., Pratt, S., Viens, F. G., et al. (2021) · Journal of Physics G Nuclear and Particle Physics · doi:10.1088/1361-6471/abf1df · Cited by 108
Calibration of ionic and cellular cardiac electrophysiology models
Whittaker, D. J., Clerx, M., Lei, C. L., Christini, D. J., & Mirams, G. R. (2020) · WIREs Systems Biology and Medicine · doi:10.1002/wsbm.1482 · Cited by 104
“In a Bayesian framework, reducing uncertainty becomes narrowing the posterior distribution for parameters, as discussed in a systems biology context by Liepe, Filippi, Komorowski, and Stumpf (2013).”
BackgroundWarne, D. J., Baker, R. E., & Simpson, M. J. (2019) · Journal of The Royal Society Interface · doi:10.1098/rsif.2018.0943 · Cited by 83
“2 Bayesian inference Bayesian methods have been demonstrated to provide a powerful framework for the design of experiments, model selection and parameter estimation, especially in the life sciences [15,34,86,91,92,138,143,145].”
MethodHow to deal with parameters for whole-cell modelling
Babtie, A. C., & Stumpf, M. P. H. (2017) · Journal of The Royal Society Interface · doi:10.1098/rsif.2017.0237 · Cited by 83
Self-citationOn the relationship between sloppiness and identifiability
Chis, O.-T., Villaverde, A. F., Banga, J. R., & Balsa-Canto, E. (2016) · Mathematical Biosciences · doi:10.1016/j.mbs.2016.10.009 · Cited by 84
Multivariate moment closure techniques for stochastic kinetic models
Lakatos, E., Ale, A. B. F., Kirk, P., & Stumpf, M. P. H. (2015) · The Journal of Chemical Physics · doi:10.1063/1.4929837 · Cited by 96
“35,51,52 This field o ff ers numerous mathematical and engineering tools developed for di ff erential equation systems, which applied to a stochastic model followed with our algorithm could lead to automatic, in silico experimental design for biochemical systems, for example, determining the…”
BackgroundMethodSelf-citationWarne, D. J., Baker, R. E., & Simpson, M. J. (2019) · Bulletin of Mathematical Biology · doi:10.1007/s11538-019-00589-x · Cited by 87
“Bayesian frameworks have been demonstrated to be highly effective at determining optimal experimental designs to minimise parameter uncertainty under the presence of systematic and measurement error (Browning et al., 2017; Johnston et al., 2016; Liepe et al., 2013; Parker et al., 2018; Vanlier et al., 2012; Warne et a…”
BackgroundInfluentialMeyer, P., Cokelaer, T., Chandran, D., Kim, K., Loh, P.-R., Tucker, G., Lipson, M., Berger, B., Kreutz, C., Raue, A., et al. (2014) · BMC Systems Biology · doi:10.1186/1752-0509-8-13 · Cited by 73
“How to choose among all these options is not obvious and, despite the critical importance of these questions, the problem of parameter estimation and iterative experimental design remains one of the hardest challenges in systems biology [4-6,9,20,21].”
BackgroundDesigning experiments to understand the variability in biochemical reaction networks
Ruess, J., Milias‐Argeitis, A., & Lygeros, J. (2013) · Journal of The Royal Society Interface · doi:10.1098/rsif.2013.0588 · Cited by 79
“Approximating the Fisher information The amount of information about model structure or parameters which can be gained from measurements may be highly dependent on the experimental setup that is chosen [24, 25, 26, 27, 28].”
BackgroundModel Selection in Systems Biology Depends on Experimental Design
Silk, D., Kirk, P. D. W., Barnes, C. P., Toni, T., & Stumpf, M. P. H. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003650 · Cited by 66
“[2], which are limited to exploring small sets of models and experiments.”
BackgroundMethodSelf-citationEisenberg, M. C., & Jain, H. V. (2017) · Journal of Theoretical Biology · doi:10.1016/j.jtbi.2017.07.018 · Cited by 79
“…is referred to Kreutz et al. (2012), Skanda and Lebiedz (2010), Anguelova et al. (2012), Cheung et al. (2013), Chu and Hahn (2008), Apgar et al. (2010), Banga and Balsa-Canto (2008), Vanlier et al. (2012a) and Liepe et al. (2013) (which include FIM, Bayesian, and information theoretic methods).”
BackgroundIterative experiment design guides the characterization of a light-inducible gene expression circuit
Ruess, J., Parise, F., Milias‐Argeitis, A., Khammash, M., & Lygeros, J. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1423947112 · Cited by 72
“For instance, mean and variance of the fluorescence intensities are obtained as μi ðt; γÞ= r · μ i ðt; γÞ+ μi , i= 1,2, [4]”
Metabolic kinetic modeling provides insight into complex biological questions, but hurdles remain
Strutz, J., Martin, J. P., Greene, J. L., Broadbelt, L. J., & Tyo, K. E. J. (2019) · Current Opinion in Biotechnology · doi:10.1016/j.copbio.2019.02.005 · Cited by 71
Bayesian Experimental Design for Models with Intractable Likelihoods
Drovandi, C., & Pettitt, A. N. (2013) · Biometrics · doi:10.1111/biom.12081 · Cited by 66
“Liepe et al. (2013) propose to estimate the Kullback– Leibler divergence based on computing the difference between histograms based on samples from the prior and posterior.”
Jagiella, N., Rickert, D., Theis, F. J., & Hasenauer, J. (2017) · Cell Systems · doi:10.1016/j.cels.2016.12.002 · Cited by 65
Thompson, J. C., Zavala, V. M., & Venturelli, O. S. (2023) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1011436 · Cited by 61
“The framework differs from most previous work on optimal experimental design of biological systems [21, 22, 24] since it leverages model uncertainty to select a set of experimental conditions for the purpose of optimizing a function of interest (exploitation and exploration), as opposed to designing experiments for th…”
MethodHarnessing QbD, Programming Languages, and Automation for Reproducible Biology
Sadowski, M. I., Grant, C., & Fell, T. S. (2015) · Trends in biotechnology · doi:10.1016/j.tibtech.2015.11.006 · Cited by 60
“[125] present a useful framework in which predictive accuracy is directly optimized, for instance, building on much other recent work in the area [126–130].”
MethodGuerriero, G., Sergeant, K., & Hausman, J.-F. (2013) · International Journal of Molecular Sciences · doi:10.3390/ijms140610958 · Cited by 50
“DoE (design of experiments) and multivariate analysis can then be applied to systems biology to better interpret the data and deduce models [133].”
MethodMahon, S. S. M., Sim, A., Filippi, S., Johnson, R., Liepe, J., Smith, D., & Stumpf, M. P. H. (2014) · Seminars in Cell and Developmental Biology · doi:10.1016/j.semcdb.2014.06.011 · Cited by 59
Self-citationNear-optimal experimental design for model selection in systems biology
Busetto, A. G., Hauser, A., Krummenacher, G., Sunnåker, M., Dimopoulos, S., Ong, C. S., Stelling, J., & Buhmann, J. M. (2013) · Bioinformatics · doi:10.1093/bioinformatics/btt436 · Cited by 60
“The gain yielded by a dataset is given by the relative entropy (also known as Kullback-Leibler divergence) between prior and posterior probabilities [3, 29]”
MethodBayesian Model Comparison and Parameter Inference in Systems Biology Using Nested Sampling
Pullen, N., & Morris, R. J. (2014) · PLoS ONE · doi:10.1371/journal.pone.0088419 · Cited by 51
“If there was some uncertainty as to the model or its parameters, designing experiments that can maximise the information in the data is an approach that has been explored recently [75].”
BackgroundLiepe, J., Holzhütter, H., Bellavista, E., Kloetzel, P. M., Stumpf, M. P. H., & Mishto, M. (2015) · eLife · doi:10.7554/elife.07545 · Cited by 49
“To understand the proteasomal mechanisms in detail we therefore investigate product formation under carefully designed experimental conditions (Liepe et al., 2013), and measure the degradation of Suc-LLVY-MCA, Bz-VGR-MCA and Z-LLE-MCA over time by mouse proteasome for different initial substrate…”
InfluentialSelf-citationOptimal experiment design for model selection in biochemical networks
Vanlier, J., Tiemann, C. A., Hilbers, P. A. J., & van Riel, N. A. W. (2014) · BMC Systems Biology · doi:10.1186/1752-0509-8-20 · Cited by 55
“Previously, predictive distributions have been used to perform experiment design targeted at reducing the uncertainty of specific predictions [29-31].”
Zhang, Z., Orski, S. V., Woys, A. M., Yuan, G., Zarraga, I. E., Wagner, N. J., & Liu, Y. (2018) · Colloids and Surfaces B Biointerfaces · doi:10.1016/j.colsurfb.2018.04.036 · Cited by 43
Convergence in parameters and predictions using computational experimental design
Hagen, D. R., White, J. K., & Tidor, B. (2013) · Interface Focus · doi:10.1098/rsfs.2013.0008 · Cited by 41
Robustifying optimal experiment design for nonlinear, dynamic (bio)chemical systems
Telen, D., Vercammen, D., Logist, F., & van Impe, J. F. M. (2014) · Computers & Chemical Engineering · doi:10.1016/j.compchemeng.2014.09.006 · Cited by 40
Optimal Quantification of Contact Inhibition in Cell Populations
Warne, D. J., Baker, R. E., & Simpson, M. J. (2017) · Biophysical Journal · doi:10.1016/j.bpj.2017.09.016 · Cited by 44
“The aim of this work is to provide guidance about how to overcome these standard experimental and theoretical limitations by taking a Bayesian approach to experimental design [22, 23, 24, 25, 26, 27].”
Deep reinforcement learning for optimal experimental design in biology
Treloar, N. J., Braniff, N., Ingalls, B., & Barnes, C. P. (2022) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1010695 · Cited by 47
“Previous Bayesian work has been limited to greedily optimising over the next time step only [7] or choosing from a limited set of experimental designs [9, 11] and recent work has focused on alleviating these issues [44].”
InfluentialInvestigating Active Learning and Meta-Learning for Iterative Peptide Design
Barrett, R., & White, A. D. (2020) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.0c00946 · Cited by 39
“[26] It is sometimes called optimal experimental design, [27] targeted experiment design, [28] sequential design of hypotheses, [29] optimal learning, [30] and artificial intelligence scientific discovery [31] depending on the goal and problem context.”
BackgroundCombining hypothesis- and data-driven neuroscience modeling in FAIR workflows
Eriksson, O., Bhalla, U. S., Blackwell, K. T., Crook, S. M., Keller, D. X., Kramer, A., Linne, M., Saudargienė, A., Wade, R. C., & Kotaleski, J. H. (2022) · eLife · doi:10.7554/elife.69013 · Cited by 41
Proteolytic dynamics of human 20S thymoproteasome
Kuckelkorn, U., Stübler, S., Textoris‐Taube, K., Kilian, C., Niewienda, A., Henklein, P., Janek, K., Stumpf, M. P. H., Mishto, M., & Liepe, J. (2019) · Journal of Biological Chemistry · doi:10.1074/jbc.ra118.007347 · Cited by 34
“Note that in some cases not all model parameters must be inferred with low uncertainty to make precise model predictions (20).”
BackgroundSelf-citationTowards Bayesian Model-Based Demography: Agency, Complexity and Uncertainty in Migration Studies
Bijak, J. (2021) · Methodos series · doi:10.1007/978-3-030-83039-7 · Cited by 47
Eriksson, O., Jauhiainen, A., Sasane, S. M., Kramer, A., Nair, A. G., Sartorius, C., & Kotaleski, J. H. (2018) · Bioinformatics · doi:10.1093/bioinformatics/bty607 · Cited by 37
“On the other hand, several similar, statistically embedded experiment design methods (e.g. Liepe et al. (2013); Weber et al. (2012)) focus on maximizing information in planned experiments, whereas this analysis workflow assigns roles to model constituents andmeasuresofimportancetoparameters.”
BackgroundCollocation based training of neural ordinary differential equations
Roesch, E., Rackauckas, C., & Stumpf, M. P. H. (2021) · Statistical Applications in Genetics and Molecular Biology · doi:10.1515/sagmb-2020-0025 · Cited by 49
“Especially if backed up by formal model selection and model checking (Kirk et al. 2013; Liepe et al. 2013, 2014), and combined with carefully designed, discriminatory experiments, mechanistic models are able to deliver insights into how natural or engineered systems work, and how we can control and…”
BackgroundSelf-citationOptimization of reflectometry experiments using information theory
Treece, B. W., Kienzle, P., Hoogerheide, D. P., Majkrzak, C. F., Lösche, M., & Heinrich, F. (2019) · Journal of Applied Crystallography · doi:10.1107/s1600576718017016 · Cited by 31
Efficient Bayesian Experimental Design for Implicit ModelsPreprint
Kleinegesse, S., & Gutmann, M. U. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.09912 · Cited by 31
“Cook et al. (2008) used moment closure to approximate the mutual information, while Liepe et al. (2013) used ABC to approximate the mutual information for a restricted class of models.”
MethodInfluentialRoss, R. J. H., Baker, R. E., Parker, A. J., Ford, M. J., Mort, R. L., & Yates, C. A. (2017) · npj Systems Biology and Applications · doi:10.1038/s41540-017-0010-7 · Cited by 36
“Other theoretical work has shown how to maximise the information content of an experiment by choosing an appropriate experimental set-up.(18) The focus of our study is to determine the experimental conditions, and experimental data, required for the accurate identification of cell motility and adhesion parameters in a…”
BackgroundOpen problems in mathematical biology
Vittadello, S. T., & Stumpf, M. P. H. (2022) · Mathematical Biosciences · doi:10.1016/j.mbs.2022.108926 · Cited by 30
“Identifying which parameter combinations can be learned [20] from prior knowledge plus data will become a crucial part of parameterising large models, including whole cell models [21].”
BackgroundSelf-citationLikelihood-free simulation-based optimal design with an application to spatial extremes
Hainy, M., Müller, W. G., & Wagner, H. (2015) · Stochastic Environmental Research and Risk Assessment · doi:10.1007/s00477-015-1067-8 · Cited by 27
An information theoretic approach to use high-fidelity codes to calibrate low-fidelity codes
Lewis, A., Smith, R. C., Williams, B. J., & Figueroa, V. (2016) · Journal of Computational Physics · doi:10.1016/j.jcp.2016.08.001 · Cited by 26
Designing optimal experiments: an application to proton Compton scattering
Melendez, J. A., Furnstahl, R. J., Grießhammer, H. W., McGovern, J. A., Phillips, D. R., & Pratola, M. T. (2021) · The European Physical Journal A · doi:10.1140/epja/s10050-021-00382-2 · Cited by 26
Reverse Engineering Under Uncertainty
Kirk, P., Silk, D., & Stumpf, M. P. H. (2015) · Studies in mechanobiology, tissue engineering and biomaterials · doi:10.1007/978-3-319-21296-8_2 · Cited by 25
“…experimental choices can be hard to foresee, e.g., which species should be measured or perturbed (illustrated in Fig.2.2 and more generally by Liepe et al. [32]), and whether longitudinal datasets or time-point data should be generated in order to reduce the uncertainty in parameter estimates [30].”
BackgroundMethodInfluentialSelf-citationNew opportunities for optimal design of dynamic experiments in systems and synthetic biology
Braniff, N., & Ingalls, B. (2018) · Current Opinion in Systems Biology · doi:10.1016/j.coisb.2018.02.005 · Cited by 30
A Bayesian active learning strategy for sequential experimental design in systems biology
Pauwels, E., Lajaunie, C., & Vert, J. (2014) · BMC Systems Biology · doi:10.1186/s12918-014-0102-6 · Cited by 35
“To overcome this difficulty at the expense of computational burden, other methods involving a sampling of the posterior distribution by Monte-Carlo Markov chain (MCMC) techniques have also been proposed [37, 38].”
MethodNöh, K., Niedenführ, S., Beyß, M., & Wiechert, W. (2018) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1006533 · Cited by 27
A large-scale stochastic spatiotemporal model for Aedes albopictus-borne chikungunya epidemiology
Erguler, K., Chandra, N. L., Proestos, Y., Lelieveld, J., Christophides, G. K., & Parham, P. E. (2017) · PLoS ONE · doi:10.1371/journal.pone.0174293 · Cited by 24
Robust Design for Coalescent Model Inference
Parag, K. V., & Pybus, O. G. (2019) · Systematic Biology · doi:10.1093/sysbio/syz008 · Cited by 22
Nimmegeers, P., Bhonsale, S. S., Telen, D., & van Impe, J. F. M. (2020) · Chemical Engineering Science · doi:10.1016/j.ces.2020.115651 · Cited by 25
Differential equations in data analysis
Dattner, I. (2020) · Wiley Interdisciplinary Reviews Computational Statistics · doi:10.1002/wics.1534 · Cited by 22
“Liepe, Filippi, Komorowski, and Stumpf (2013) focused on an experimental design that attempts to maximize information regarding model parameters.”
BackgroundNienałtowski, K., Włodarczyk, M., Lipniacki, T., & Komorowski, M. (2015) · BMC Systems Biology · doi:10.1186/s12918-015-0205-8 · Cited by 20
“It has been used to show how the information content in experimental measurements can be maximised [13–16].”
MethodSelf-citationSequential optimal positioning of mobile sensors using mutual information
Schmidt, K., Smith, R. C., Hite, J. M., Mattingly, J. K., Azmy, Y. Y., Rajan, D., & Goldhahn, R. (2019) · Statistical Analysis and Data Mining The ASA Data Science Journal · doi:10.1002/sam.11431 · Cited by 20
Parameter estimation and uncertainty quantification using information geometry
Sharp, J. A., Browning, A. P., Burrage, K., & Simpson, M. J. (2022) · Journal of The Royal Society Interface · doi:10.1098/rsif.2021.0940 · Cited by 30
“Through this process the most informative experiments are identified, facilitating design of optimal experimental protocols [38, 57, 85].”
Cho, H., Lewis, A., Storey, K. M., & Byrne, H. M. (2022) · Journal of Theoretical Biology · doi:10.1016/j.jtbi.2022.111377 · Cited by 23
“Previously, a range of techniques has been used to estimate parameter values in the LV model from experimental data [24, 27, 31, 39].”
MethodHow Much Can We Learn from a Single Chromatographic Experiment? A Bayesian Perspective
Wiczling, P., & Kaliszan, R. (2015) · Analytical Chemistry · doi:10.1021/acs.analchem.5b03859 · Cited by 17
Optimally Designed Model Selection for Synthetic Biology
Bandiera, L., Gomez-Cabeza, D., Gilman, J., Balsa‐Canto, E., & Menolascina, F. (2020) · ACS Synthetic Biology · doi:10.1021/acssynbio.0c00393 · Cited by 21
Pant, S., & Lombardi, D. (2015) · Mathematical Biosciences · doi:10.1016/j.mbs.2015.08.005 · Cited by 20
Experimental Design under the Bradley-Terry Model
Guo, Y., Tian, P., Kalpathy–Cramer, J., Ostmo, S. R., Campbell, J. P., Chiang, M. F., Erdogmus, D., Dy, J., & Ioannidis, S. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/304 · Cited by 36
Smart microscopy: current implementations and a roadmap for interoperability
Hinderling, L., Heil, H. S., Rates, A., Seidel, P., Kesavan, P. S., Gunkel, M., Diederich, B., Guilbert, T., Torro, R., Bouchareb, O., et al. (2026) · Methods in microscopy · doi:10.1515/mim-2025-0029 · Cited by 22
A layered multiple importance sampling scheme for focused optimal Bayesian experimental designPreprint
Feng, C., & Marzouk, Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.11187 · Cited by 33
“In addition, our criterion for focused experimental design introduces marginalization over nuisance parameters [25], further reducing the efficiency and accuracy of existing Monte Carlo approaches.”
BackgroundMohsenizadeh, D. N., Dehghannasiri, R., & Dougherty, E. R. (2016) · IEEE Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2016.2602873 · Cited by 15
“Since high-dimensional and nonlinear dynamical models suffer from a large number of unknown parameters and both in vitro and in vivo biological experiments are expensive and time consuming, experimental design is of high practical significance in systems biology [10], [11] and has attracted significant attention in re…”
BackgroundMulti-model and network inference based on ensemble estimates: avoiding the madness of crowds
Stumpf, M. P. H. (2020) · Journal of The Royal Society Interface · doi:10.1098/rsif.2020.0419 · Cited by 17
Self-citationApproximate Bayesian inference for complex ecosystems
Stumpf, M. P. H. (2014) · F1000Prime Reports · doi:10.12703/p6-60 · Cited by 19
“ABC has, for example, been used in experimental design [50,53] and in synthetic biology [14,54] to generate designs of molecular pathways that exhibit certain types of behavior.”
MethodSelf-citationMulti-Objective Optimization of Experiments Using Curvature and Fisher Information Matrix
Manesso, E., Sridharan, S., & Gunawan, R. (2017) · Processes · doi:10.3390/pr5040063 · Cited by 16
Liao, C., YOU, S.-H., & Cheng, Y. (2014) · Epidemiology and Infection · doi:10.1017/s0950268814000430 · Cited by 14
“Thus, the information theory-based initial analyses can be performed without detailed knowledge of the underlying complexity of the system, providing useful insights into what an information transmission system can or cannot achieve [29].”
BackgroundYu, H., Yue, H., & Halling, P. J. (2018) · Chemical Engineering Science · doi:10.1016/j.ces.2018.05.047 · Cited by 13
Optimal experimental design for mathematical models of haematopoiesis
Lomeli, L. M., Iniguez, A., Tata, P. V., Jena, N., Liu, Z., Etten, R. A. V., Lander, A. D., Shahbaba, B., Lowengrub, J. S., & Minin, V. N. (2021) · Journal of The Royal Society Interface · doi:10.1098/rsif.2020.0729 · Cited by 13
“This utility has its origin in information theory and it is equivalent to the mutual information gain [26,29].”
BackgroundExperimental design and model reduction in systems biology
Jeong, J. E., Zhuang, Q. K.-W., Transtrum, M. K., Zhou, E., & Qiu, P. (2018) · Quantitative Biology · doi:10.1007/s40484-018-0150-9 · Cited by 15
Untangling Extracellular Proteasome-Osteopontin Circuit Dynamics in Multiple Sclerosis
Dianzani, C., Vecchio, D., Clemente, N., Chiocchetti, A., Boneschi, F. M., Galimberti, D., Dianzani, U., Comi, C., Mishto, M., & Liepe, J. (2019) · Cells · doi:10.3390/cells8030262 · Cited by 14
“The development of novel model and parameter inference approaches describing the information content in experimental data [43,44] provides us with the tools to systematically integrate different data modalities.”
Self-citationComputational optimization of associative learning experiments
Melinščak, F., & Bach, D. R. (2020) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1007593 · Cited by 16
“Similar methods of optimal experimental design have been developed in various subfields of biology and cognitive science concerned with formal modeling; for example, in systems biology [13, 14], neurophysiology [15, 16], neuroimaging [17, 18], psychology [19, 20], and behavioral economics [21, 22].”
MethodData-driven model discovery and model selection for noisy biological systems
Wu, X., McDermott, M., & MacLean, A. L. (2025) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1012762 · Cited by 24
Mdluli, T., Buzzard, G. T., & Rundell, A. E. (2015) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1004488 · Cited by 13
“To consider both optimal measurements and an optimal input sequence, some strategies [16, 35] evaluate the optimality of a pre-defined set of specified inputs and measurement points.”
MethodInfluentialMaximizing information gain for the characterization of biomolecular circuits
Prangemeier, T., Wildner, C., Hanst, M., & Koeppl, H. (2018) · ACM International Conference on Nanoscale Computing and Communication (NANOCOM) · doi:10.1145/3233188.3233217 · Cited by 12
“In the context of cell biology, such an approach is discussed in [13].”
BackgroundPalgen, J., Perrillat-Mercerot, A., Ceres, N., Peyronnet, E., Coudron, M., Tixier, E., Illigens, B. M. W., Bosley, J., L’Hostis, A., & Monteiro, C. (2022) · Acta Biotheoretica · doi:10.1007/s10441-022-09445-3 · Cited by 12
Identification of gene regulation models from single-cell data
Weber, L., Raymond, W., & Munsky, B. E. (2018) · Physical Biology · doi:10.1088/1478-3975/aabc31 · Cited by 12
Using Expected Information Gain to Design Aerothermal Model Calibration Experiments
Villanueva, D. C., & Smarslok, B. P. (2015) · AIAA Non-Deterministic Approaches Conference · doi:10.2514/6.2015-0660 · Cited by 12
Small-noise approximation for Bayesian optimal experimental design with nuisance uncertainty
Bartuska, A., Espath, L., & Tempone, R. F. (2022) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2022.115320 · Cited by 14
“If the model also contains unknown parameters that are not of immediate interest, we refer to them as nuisance parameters, and the usual approach is to marginalize them [5, 11, 14, 15], leading to a second inner integral and increasing the computational burden.”
BackgroundPredictive power of non-identifiable models
Grabowski, F., Nałęcz‐Jawecki, P., & Lipniacki, T. (2023) · Scientific Reports · doi:10.1038/s41598-023-37939-8 · Cited by 13
Cho, H., Lewis, A., & Storey, K. M. (2020) · Journal of Clinical Medicine · doi:10.3390/jcm9103208 · Cited by 11
“Originally built around the concept of Shannon entropy [21], and utilizing the kth-Nearest-Neighbor (kNN) estimate of mutual information to make the procedure more computationally feasible [22], this framework was first introduced in [23, 24, 25].”
MethodModel-driven optimal experimental design for calibrating cardiac electrophysiology models
Lei, C. L., Clerx, M., Gavaghan, D. J., & Mirams, G. R. (2023) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2023.107690 · Cited by 11
Saxton, H., Schenkel, T., Halliday, I., & Xu, X. (2023) · Journal of Computational Science · doi:10.1016/j.jocs.2023.102158 · Cited by 13
Modelling Proteasome and Proteasome Regulator Activities
Liepe, J., Holzhütter, H., Kloetzel, P. M., Stumpf, M. P. H., & Mishto, M. (2014) · Biomolecules · doi:10.3390/biom4020585 · Cited by 10
“experimental setup in light of simulations of the model(s) [34–36].”
MethodSelf-citationModel of Host-Pathogen Interaction Dynamics Links In Vivo Optical Imaging and Immune Responses
Ale, A. B. F., Crepin, V. F., Collins, J. W., Constantinou, N., Habibzay, M., Babtie, A. C., Frankel, G. M., & Stumpf, M. P. H. (2016) · Infection and Immunity · doi:10.1128/iai.00606-16 · Cited by 10
“In this way, the model can serve as a tool for experimental design (25, 26) and to monitor imaging outcomes against predictions during the course of an ongoing experiment.”
Self-citationParameter inference in dynamical systems with co-dimension 1 bifurcations
Roesch, E., & Stumpf, M. P. H. (2019) · Royal Society Open Science · doi:10.1098/rsos.190747 · Cited by 17
Self-citationJovanovic, G., Sheng, X., Ale, A. B. F., Feliu, E., Harrington, H. A., Kirk, P., Wiuf, C., Buck, M., & Stumpf, M. P. H. (2015) · Molecular BioSystems · doi:10.1039/c4mb00720d · Cited by 10
Self-citationKleinegesse, S., & Gutmann, M. U. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.04379 · Cited by 42
“As far as we are aware, there has only been one work on improving future predictions in the context of BED for implicit models (Liepe et al., 2013), but there has been some older work for explicit models where the likelihood is tractable (e.”
BackgroundStrouwen, A., Nicolaï, B. M., & Goos, P. (2022) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1009610 · Cited by 10
“Selection of input profiles based on the KL-div is considered in [42], but only for a small discrete set of possible input profiles.”
MethodNearest Neighbor Density Functional Estimation From Inverse Laplace Transform
Ryu, J., Ganguly, S., Kim, Y.-H., Noh, Y., & Lee, D. D. (2022) · IEEE Transactions on Information Theory · doi:10.1109/tit.2022.3151231 · Cited by 12
Achieving Occam’s razor: Deep learning for optimal model reduction
Antal, B. B., Chesebro, A. G., Strey, H. H., Mujica-Parodi, L. R., & Weistuch, C. (2024) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1012283 · Cited by 13
Yang, J., Daily, N., Pullinger, T. K., Wakatsuki, T., & Sobie, E. A. (2024) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1011806 · Cited by 11
“Since the goal of model calibration is usually to improve the accuracy of model parameterizations and predictions, previous work has largely focused on maximizing the information content of experiments used to fit models [43–45].”
Asaadi, E., Heyns, P. S., Haftka, R. T., & Tootkaboni, M. (2018) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2018.11.021 · Cited by 9
Parametric and non-parametric gradient matching for network inference: a comparison
Dony, L., He, F., & Stumpf, M. P. H. (2019) · BMC Bioinformatics · doi:10.1186/s12859-018-2590-7 · Cited by 11
“This shows that careful consideration has to be placed on both the experimental design step prior to inference (producing data that bears maximum information about the system) [40, 41] as well as on the limiting constraints that the gradient matching approach places on the data (small errors in data fitting due to flu…”
BackgroundSelf-citationDesigning optimal behavioral experiments using machine learning
Valentin, S., Kleinegesse, S., Bramley, N. R., Seriès, P., Gutmann, M. U., & Lucas, C. G. (2024) · eLife · doi:10.7554/elife.86224 · Cited by 8
“Instead, most practical applications of BOED have been limited to simple scientific theories of nature (e.g. Liepe et al., 2013).”
BackgroundOptimal Experimental Design Based on Two-Dimensional Likelihood Profiles
Litwin, T., Timmer, J., & Kreutz, C. (2022) · Frontiers in Molecular Biosciences · doi:10.3389/fmolb.2022.800856 · Cited by 10
“Assessing whether a model is useful can be “notoriously difficult” (Liepe et al., 2013), even more so if the data obtained from experiments is insufficient to inform the model.”
BackgroundMethodInfluential
Metadata
- Authors
- Liepe, J., Filippi, S., Komorowski, M., & Stumpf, M. P. H.
- Affiliations
- Imperial College London (GB)
- Institute of Fundamental Technological Research (PL)
- Corresponding author
- Liepe, Juliane
- Filippi, Sarah
- Komorowski, Michał
- Stumpf, Michael P. H.
- Venue
- PLoS Computational Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2013-01-31
- Volume
- 9
- Issue
- 1
- Pages
- e1002888
- ISSN
- 1553-734X (ISSN-L)
- 1553-7358
- PMC
- PMC3561087
- OpenAlex
- W2092692908
- Semantic Scholar
- 58272574a816e9dc6122feae1705d7024fe1f94c
- Cited by
- 170
- References
- 63
- Citations by year
- 2026: 6 · 2025: 3 · 2024: 6 · 2023: 11 · 2022: 13 · 2021: 11 · 2020: 18 · 2019: 21 · 2018: 19 · 2017: 11 · 2016: 10 · 2015: 15 · 2014: 20 · 2013: 6
- FWCI
- 7.61
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS Computational Biology (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- MPG.PuRe (Max Planck Society) (submittedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Max Planck Digital Library (submittedVersion, cc-by)
- Figshare (submittedVersion, cc-by)
- Minerva Access (University of Melbourne) (submittedVersion, cc-by)
- Spiral (Imperial College London) (submittedVersion, other-oa)
- Funders
- Wellcome Trust
- Medical Research Council
- Biotechnology and Biological Sciences Research Council (BB/G001863/1, BB/G530268/1, BB/G020434/1, BB/G007934/1)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene Regulatory Network Analysis
- Physical Sciences › Engineering › Control and Systems Engineering › Control Systems and Identification
- Social Sciences › Decision Sciences › Management Science and Operations Research › Optimal Experimental Design Methods
- Keywords
- experimental design, information content, Bayesian inference, information theory, parameter estimation, parameter robustness, biological systems, model inference, prior information
- MeSH terms
- Bayes Theorem, Models, Theoretical, Uncertainty, Systems Biology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-05, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-05 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.