Universally Sloppy Parameter Sensitivities in Systems Biology Models
Open accessThe DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index; 24 of the 45 sources its claims cite were checked for support.
Abstract
Quantitative computational models play an increasingly important role in modern biology. Such models typically involve many free parameters, and assigning their values is often a substantial obstacle to model development. Directly measuring in vivo biochemical parameters is difficult, and collectively fitting them to other experimental data often yields large parameter uncertainties. Nevertheless, in earlier work we showed in a growth-factor-signaling model that collective fitting could yield well-constrained predictions, even when it left individual parameters very poorly constrained. We also showed that the model had a "sloppy" spectrum of parameter sensitivities, with eigenvalues roughly evenly distributed over many decades. Here we use a collection of models from the literature to test whether such sloppy spectra are common in systems biology. Strikingly, we find that every model we examine has a sloppy spectrum of sensitivities. We also test several consequences of this sloppiness for building predictive models. In particular, sloppiness suggests that collective fits to even large amounts of ideal time-series data will often leave many parameters poorly constrained. Tests over our model collection are consistent with this suggestion. This difficulty with collective fits may seem to argue for direct parameter measurements, but sloppiness also implies that such measurements must be formidably precise and complete to usefully constrain many model predictions. We confirm this implication in our growth-factor-signaling model. Our results suggest that sloppy sensitivity spectra are universal in systems biology models. The prevalence of sloppiness highlights the power of collective fits and suggests that modelers should focus on predictions rather than on parameters.
Overview
CoChat Summary
TL;DR
Across 17 systems biology models, every model examined had a “sloppy” parameter sensitivity spectrum, with eigenvalues spanning many decades roughly evenly. Sloppiness helps explain why collective fits leave individual parameters poorly constrained yet can yield tight predictions, while direct parameter measurements must be both precise and complete to constrain predictions.
Key findings
- All 17 models exhibited sloppy sensitivity spectra; all but one spanned more than 10^6 in eigenvalues, and few principal axes aligned with bare parameter axes (I/P ≈ 1 was rare).
- In idealized collective fits using 100 times as many time-series data points as parameters, each with 10% uncertainty, most models left many parameters with greater than 100% uncertainty (Σ > 1).
- In the 48-parameter Brown et al. growth-factor-signaling model, collective fitting to 14 experiments and 68 data points left all 48 parameters with 95% confidence intervals spanning more than a factor of 50, yet an ERK prediction under EGF stimulation with PI3K inhibition was tight.
- To match that prediction with direct measurements, all 24 involved parameters needed measurement within ±25%; leaving one of about 18 of the 24 involved parameters unmeasured, even bounded to a 1,000-fold range, produced a prediction with very large uncertainty.
Methods
- Collected 17 ordinary-differential-equation systems biology models from the literature and BioModels, ranging from about ten to more than 200 parameters, and quantified behavior change by average squared change in molecular species time courses.
- Analyzed the Hessian matrix Hχ2 with derivatives taken with respect to log parameters, using sensitivity equations rather than finite differences; computations used SloppyCell version 0.81.
- For parameter uncertainties, rescaled Hχ2 for Nd data points with fractional uncertainty f and computed relative 95% confidence interval size Σ; for prediction uncertainties in the Brown et al. model, generated 1,000 parameter sets consistent with stated uncertainties and calculated ERK time courses.
Limitations
- Stated: the paper focuses on parameter uncertainties, not model-structure uncertainty; sloppiness depends on the model and the data fit, and exhaustive experiments designed to decouple parameters would not yield sloppy sensitivities.
- Stated: successful fits and predictions may arise from models that are incorrect in significant ways, and potential model-refinement methods demand a complete understanding unavailable for many biological systems.
- Evident: most collected models were not systematically fit or measured in their original publications, and the sensitivity spectra rely on a local quadratic Hessian approximation, though Monte Carlo analysis in the Brown et al. model supports the nonlinear χ2 picture.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
![Figure 1 Parameter Sensitivity Spectra The quantities we calculate from H χ2 are illustrated in (A), while (B) and (C) show that all the models we examined have sloppy sensitivity spectra. (A) Analyzing H χ2 corresponds to approximating the surfaces of constant model behavior change (constant χ 2) as ellipsoids. The width of each principal axis is proportional to one over the square root of the corresponding eigenvalue. The inner ellipsoid's projection onto and intersection with the θ 1 axis are denoted by P 1 and I1, respectively. (B) Plotted are the eigenvalue spectra of H χ2 for our collection of systems biology models. The many decades generally spanned indicate that the ellipses have a very large aspect ratio. (The spectra have each been normalized by their largest eigenvalue. Not all values are visible for all models.) (C) Plotted is the spectrum of I / P for each parameter in each model in our collection. Generally very few parameters have I / P ≈ 1, suggesting that the ellipses are skewed from the bare parameter axes. (Not all values are visible for all models.) The models are plotted in order of increasing number of free parameters and are: (a) eukaryotic cell cycle [28], (b) Xenopus egg cell cycle [29], (c) eukaryotic mitosis [30], (d) generic circadian rhythm [31], (e) nicotinic acetylcholine intra-receptor dynamics [32], (f) generic kinase cascade [33], (g) Xenopus Wnt signaling [34], (h) Drosophila circadian rhythm [35], (i) rat growth-factor signaling [21], (j) Drosophila segment polarity [36], (k) Drosophila circadian rhythm [37], (l) Arabidopsis circadian rhythm [2], (m) in silico regulatory network [25], (n) human purine metabolism [38], (o) Escherichia coli carbon metabolism [39], (p) budding yeast cell cycle [40], (q) rat growth-factor signaling [41].](https://figures.cochat.ai/paper-figures/e59ef10af9fc4bcdbd3fb192663d91bb/universally-sloppy-parameter-sensitivities-in-systems-biology-models-figure-1.jpg)


![Figure 4 Parameter and Prediction Uncertainties (A) Our example prediction is for ERK activity upon EGF stimulation given PI3K inhibition in this 48-parameter model of growth-factor signaling in PC12 cells [21]. (B) Shaded regions are 95% confidence intervals calculated via exhaustive Monte Carlo for our example prediction given various scenarios for constraining parameter values. (C) Plotted is the relative size Σ of the 95% confidence interval for each parameter. The scenarios represented are: (red, squares) all model parameters individually measured to high precision, (blue, triangles) all parameters precisely measured, except one estimated to low precision, (yellow, circles) all parameters collectively fit to 14 real cell-biology experiments. Precisely measured individual parameter values enable a tight prediction, (B) middle red band; but even one poorly known parameter can destroy predictive power, (B) wide blue band. In contrast, the collective fit yields a tight prediction, (B) tightest yellow band; but only very loose parameter constraints, (C) circles. The large parameter uncertainties from the collective fit, (C) circles, calculated here by Monte Carlo are qualitatively similar to those seen in the linearized fit to idealized data (Figure 3, model (i)). (For clarity, the dashed red lines trace the boundary of the red confidence interval.)](https://figures.cochat.ai/paper-figures/a84b91b2f345405fa25712988f5e8df2/universally-sloppy-parameter-sensitivities-in-systems-biology-models-figure-4.jpg)
Verification
Claims the paper makes
20 Valid · 3 Not valid · 7 Not checked · 41 Own results and interpretations
At least one cited source doesn’t support this claim or points to a different paper, and none confirmed it — see the verdicts below.
In the paper
“but even one poorly known parameter can destroy predictive power, (B) wide blue band.”
- Also stated in: § Predictions from Direct Parameter Measurements · hedged
“The resulting prediction (blue in Figure 4B) has very large uncertainty and would likely be useless.”
§ Universally Sloppy Parameter Sensitivities in Systems Biology Models > Results > Predictions from Direct Parameter Measurements
What the sources say
- Disputedcites [21] 2004, The statistical mechanics of complex signaling networks: Nerve growth factor signaling., Phys Biol sourceExperimental — accuracy not yet measured
The paper makes the contrary point for its PC12 model: Section 3.6 (page unavailable) says it extracts precise predictions even though each rate constant varies over many orders of magnitude. Section 3.5 explains that uncertainty in individual parameters need not imply uncertainty in the combinations that determine predictions. (LLM, conf=0.85)
Checked by a reasoning model — may be wrong.
plainstates a causeSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Predictions from Direct Parameter Measurements · hedged
At least one cited source doesn’t support this claim or points to a different paper, and none confirmed it — see the verdicts below.
In the paper
“Precisely measured individual parameter values enable a tight prediction, (B) middle red band”
§ Universally Sloppy Parameter Sensitivities in Systems Biology Models > Results > Predictions from Direct Parameter Measurements
What the sources say
- Disputedcites [21] 2004, The statistical mechanics of complex signaling networks: Nerve growth factor signaling., Phys Biol sourceExperimental — accuracy not yet measured
Split into 2 atoms — 0 confirmed, 1 partially supported, 1 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
Checked by a reasoning model — may be wrong.
plainstates a causeSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Disputed
Every source the paper cites for this claim was checked and supports it.
In the paper
“(1) Fundamentally, sloppiness involves an extraordinarily singular coordinate transformation in parameter space between the bare parameters natural in biology (e.g., binding affinities and rate constants) and the eigenparameters controlling system behavior, as discussed in [23].”
§ Universally Sloppy Parameter Sensitivities in Systems Biology Models > Discussion
What the sources say
- Supportedcites [23] 2006, Sloppy-model universality class and the Vandermonde matrix., Phys Rev Lett source
The conclusion (p. 4) says that sloppiness arises because parameters natural for experimental manipulation or description are often a severe distortion of the basis natural for describing system behavior. The discussion on p. 2 identifies biochemical rate constants as biologically natural parameters and describes the transformation to unsloppy parameters as nonlinear and often not single-valued. (LLM, conf=0.92)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“They collectively fit their model's 48 parameters to 68 data points from 14 cell-biology experiments (mostly Western blots).”
§ Universally Sloppy Parameter Sensitivities in Systems Biology Models > Introduction
What the sources say
- Partly supportedcites [21] 2004, The statistical mechanics of complex signaling networks: Nerve growth factor signaling., Phys Biol sourceExperimental — accuracy not yet measured
Section 3.3 reports fitting 59 parameters to 68 data points; the model has 48 rate-constant parameters, but the fit also included additional parameters. Section 3.2 says the data comprised fourteen time series from seven experiments, not fourteen experiments. The cited passages do not establish that the fitting data were mostly Western blots. (LLM, conf=0.91)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“To usefully constrain Brown et al.'s model, direct parameter measurements would need to be both precise and complete.”
§ Universally Sloppy Parameter Sensitivities in Systems Biology Models > Results > Predictions from Direct Parameter Measurements
What the sources say
- Partly supportedcites [21] 2004, The statistical mechanics of complex signaling networks: Nerve growth factor signaling., Phys Biol sourceExperimental — accuracy not yet measured
The Introduction (page unavailable) says many model parameters have not been measured experimentally and that in-vitro measurements may differ substantially from values in cells. Section 3.2 (page unavailable) says parameter measurements can be incorporated into the model, but it does not say they must be both precise and complete to constrain it usefully; the paper also describes making predictions from time-series data despite uncertain individual parameters. (LLM, conf=0.76)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
37 more claims · 12 with their cited sources checked
Create a free account to see all 71 claims and every source verdict.
- It may state two separate claims as one. 18
- Probably not a substantial claim. 11
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“In their study, Gutenkunst et al. used published intuitively designed experimental protocols to characterize parameter identifiability in different models [6].”
From Optimal Experimental Design for Parameter Estimation of a Cell Signaling Model (2009) · cites this paper as [6]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This uncertainty, it has turned out, can play a pivotal role in the analysis of a system’s dynamics16–18.”
From A framework for parameter estimation and model selection from experimental data in systems biology using approximate Bayesian computation (2014) · cites this paper as [16]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Recently we have shown that the collective behavior of multiparameter models is most often sloppy : insensitive to changes except along a few 'stiff' combinations of parameters, with an enormous sloppy neutral subspace.”
From Sloppiness, robustness, and evolvability in systems biology (2008) · cites this paper as [32]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Strong covariance between parameters of reaction cascades, fast reversible reactions, and binding events makes it difficult to constrain single parameter values [3],[6],[10],[23].”
From Optimal Experimental Design for Parameter Estimation of a Cell Signaling Model (2009) · cites this paper as [6]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Moreover, the structure of such models was suggested to reflect natural robustness to changes in many parameter values [3],[6].”
From Optimal Experimental Design for Parameter Estimation of a Cell Signaling Model (2009) · cites this paper as [6]
Experimental — accuracy not yet measured
28 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Hucka, M., Finney, A., Sauro, H. M., Bolouri, H., Doyle, J. C., Kitano, H., Arkin, A. P., Bornstein, B. J., Bray, D., Cornish-Bowden, A., et al. (2003) · Bioinformatics · doi:10.1093/bioinformatics/btg015 · Cited by 3,060 · cited 7×
“SBML files and SloppyCell scripts to reproduce all presented calculations are in Dataset S1.”
BackgroundMethodInfluentialComputational systems biology.
Kitano, H. (2002) · Nature · doi:10.1038/nature01254 · Cited by 2,209
Causal Protein-Signaling Networks Derived from Multiparameter Single-Cell Data
Sachs, K., Perez, O., Pe'er, D., Lauffenburger, D. A., & Nolan, G. P. (2005) · Science · doi:10.1126/science.1105809 · Cited by 1,708 · cited 2×
“[7] Sachs K, Perez O, Pe’er D, Lauffenburger DA, Nolan GP”
BackgroundMinton, A. P. (2001) · Journal of Biological Chemistry · doi:10.1074/jbc.r100005200 · Cited by 1,474 · cited 2×
“[9] Minton AP (2001) The influence of macromolecular”
BackgroundMethodUnderstanding the control of metabolism
(1997) · Choice Reviews Online · doi:10.5860/choice.34-6252 · Cited by 1,231
The segment polarity network is a robust developmental module
von Dassow, G., Meir, E., Munro, E. M., & Odell, G. M. (2000) · Nature · doi:10.1038/35018085 · Cited by 1,144
Le Novere, N. (2006) · Nucleic Acids Research · doi:10.1093/nar/gkj092 · Cited by 762 · cited 3×
“Models discussed that are in the BioModels database [42] are: (a) BIOMD0000000005, (c) BIOMD0000000003, (d) BIOMD0000000035, (e) BIOMD0000000002, (f) BIOMD0000000010, (h) BIOMD0000000021, (i) BIOMD0000000033, (k) BIOMD0000000022, (l) BIOMD0000000055, (n) BIOMD0000000015, (o) BIOMD0000000051, (p) BIOMD0000000056, (q) B…”
BackgroundMethodThe Roles of APC and Axin Derived from Experimental and Theoretical Analysis of the Wnt Pathway
Lee, E., Salic, A., Krüger, R., Heinrich, R., & Kirschner, M. W. (2003) · PLoS Biology · doi:10.1371/journal.pbio.0000010 · Cited by 708
Teusink, B., Passarge, J., Reijenga, C. A., Esgalhado, E., van der Weijden, C. C., Schepper, M., Walsh, M. C., Bakker, B. M., van Dam, K., Westerhoff, H. V., et al. (2000) · European Journal of Biochemistry · doi:10.1046/j.1432-1327.2000.01527.x · Cited by 694 · cited 2×
“[10] Teusink B, Passarge J, Reijenga CA, Esgalhado E, van der Weijden CC, et al.”
BackgroundMethodMendes, P., & Kell, D. (1998) · Bioinformatics · doi:10.1093/bioinformatics/14.10.869 · Cited by 676 · cited 2×
“On the other hand, collectively fitting parameters [11, 12] by optimizing the agreement between the model and available data often yields large parameter uncertainties [13, 14, 15].”
Background
Research works printed but not linked: 1
- MehtaML 2004 Random Matrices. 3rd edition Amsterdam Academic Press 706
Cited by
Items 301–400 of 1,273
Statistical Mechanical Concepts in Immunology
Chakraborty, A. K., & Košmrlj, A. (2010) · Annual Review of Physical Chemistry · doi:10.1146/annurev.physchem.59.032607.093537 · Cited by 37
Generative models versus underlying symmetries to explain biological pattern
Frank, S. A. (2014) · Journal of Evolutionary Biology · doi:10.1111/jeb.12388 · Cited by 37
Modeling Regulatory Networks to Understand Plant Development: Small Is Beautiful
Middleton, A., Farcot, E., Owen, M. R., & Vernoux, T. (2012) · The Plant Cell · doi:10.1105/tpc.112.101840 · Cited by 37
On the identifiability of metabolic network models
Berthoumieux, S., Brilli, M., Kahn, D., de Jong, H., & Eugenio Cinquemani, B. (2012) · Journal of Mathematical Biology · doi:10.1007/s00285-012-0614-x · Cited by 42
Bode, M., Baker, C. M., Benshemesh, J., Burnard, T., Rumpff, L., Hauser, C. E., Lahoz‐Monfort, J. J., & Wintle, B. A. (2016) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.12703 · Cited by 45
Computing Bayes factors for evidence-accumulation models using Warp-III bridge sampling
Gronau, Q. F., Heathcote, A., & Matzke, D. (2019) · Behavior Research Methods · doi:10.3758/s13428-019-01290-6 · Cited by 43
Neuronal morphology enhances robustness to perturbations of channel densities
Zang, Y., & Marder, E. E. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2219049120 · Cited by 41
Providing data science support for systems pharmacology and its implications to drug discovery
Hart, T. D., & Xie, L. (2015) · Expert Opinion on Drug Discovery · doi:10.1517/17460441.2016.1135126 · Cited by 37
Personalized Models of Human Atrial Electrophysiology Derived From Endocardial Electrograms
Corrado, C., Whitaker, J., Chubb, H., Williams, S. E., Wright, M. J., Gill, J. S., O'Neill, M. D., & Niederer, S. (2016) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2016.2574619 · Cited by 34
Human inference reflects a normative balance of complexity and accuracy
Tavoni, G., Doi, T., Pizzica, C., Balasubramanian, V., & Gold, J. I. (2022) · Nature Human Behaviour · doi:10.1038/s41562-022-01357-z · Cited by 35
“In this study, the environmental parameters are the volatility h and the noise R; the error function E is the mean squared prediction error over 5,000 time steps of the process for each choice of h and R; and both adaptive Mixture models have two parameters {α1, α2} describing effective learning rates, which are relat…”
BackgroundMenolascina, F., Bellomo, D., Maiwald, T., Bevilacqua, V., Ciminelli, C., Paradiso, A., & Tommasi, S. (2009) · BMC Bioinformatics · doi:10.1186/1471-2105-10-s12-s4 · Cited by 36
Nutrition Research and the Impact of Computational Systems Biology
Auley, M. T. M. (2013) · Journal of Computer Science & Systems Biology · doi:10.4172/jcsb.1000122 · Cited by 38
Towards the Physics of Calcium Signalling in Plants
Martins, T., Evans, M., Woolfenden, H. C., & Morris, R. J. (2013) · Plants · doi:10.3390/plants2040541 · Cited by 41
Control of translation initiation: a model-based analysis from limited experimental data
Dimelow, R. J., & Wilkinson, S. J. (2008) · Journal of The Royal Society Interface · doi:10.1098/rsif.2008.0221 · Cited by 37
Bistability of an In Vitro Synthetic Autoregulatory SwitchPreprint
Subsoontorn, P., Kim, J., & Winfree, E. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1101.0723 · Cited by 38
Optimal experiment selection for parameter estimation in biological differential equation models
Transtrum, M. K., & Qiu, P. (2012) · BMC Bioinformatics · doi:10.1186/1471-2105-13-181 · Cited by 34
“For one model it was observed that inferred parameters had a relative uncertainty of several hundreds of thousands [11], suggesting that inferring parameters accurately might require unreasonable amounts of data.”
BackgroundCombining hypothesis- and data-driven neuroscience modeling in FAIR workflows
Eriksson, O., Bhalla, U. S., Blackwell, K. T., Crook, S. M., Keller, D. X., Kramer, A., Linne, M., Saudargienė, A., Wade, R. C., & Kotaleski, J. H. (2022) · eLife · doi:10.7554/elife.69013 · Cited by 41
A universal thermal performance curve arises in biology and ecology
Arnoldi, J., Jackson, A. L., Peralta‐Maraver, I., & Payne, N. L. (2025) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2513099122 · Cited by 55
Modeling Intracellular Signaling Underlying Striatal Function in Health and Disease
Nair, A. G., Gutierrez‐Arenas, O., Eriksson, O., Jauhiainen, A., Blackwell, K. T., & Kotaleski, J. H. (2014) · Progress in molecular biology and translational science · doi:10.1016/b978-0-12-397897-4.00013-9 · Cited by 36
Kanodia, J., Gadkar, K. G., Bumbaca, D., Zhang, Y., Tong, R., Luk, W., Hoyte, K., Lu, Y., Wildsmith, K., Couch, J., et al. (2016) · CPT Pharmacometrics & Systems Pharmacology · doi:10.1002/psp4.12081 · Cited by 40
Proteolytic dynamics of human 20S thymoproteasome
Kuckelkorn, U., Stübler, S., Textoris‐Taube, K., Kilian, C., Niewienda, A., Henklein, P., Janek, K., Stumpf, M. P. H., Mishto, M., & Liepe, J. (2019) · Journal of Biological Chemistry · doi:10.1074/jbc.ra118.007347 · Cited by 34
Eriksson, O., Jauhiainen, A., Sasane, S. M., Kramer, A., Nair, A. G., Sartorius, C., & Kotaleski, J. H. (2018) · Bioinformatics · doi:10.1093/bioinformatics/bty607 · Cited by 37
Global optimization for accurate determination of EBSD pattern centers
Pang, E. L., Larsen, P. M., & Schuh, C. A. (2019) · Ultramicroscopy · doi:10.1016/j.ultramic.2019.112876 · Cited by 36
What Can Causal Networks Tell Us about Metabolic Pathways?
Blair, R. H., Kliebenstein, D. J., & Churchill, G. A. (2012) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002458 · Cited by 37
Parameter Trajectory Analysis to Identify Treatment Effects of Pharmacological Interventions
Tiemann, C. A., Vanlier, J., Oosterveer, M. H., Groen, A. K., Hilbers, P. A. J., & van Riel, N. A. W. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003166 · Cited by 34
Ensemble Models of Neutrophil Trafficking in Severe Sepsis
Song, S. O., Hogg, J., Peng, Z., Parker, R. S., Kellum, J. A., & Clermont, G. (2012) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002422 · Cited by 34
The brain's best kept secret is its degenerate structure
Albantakis, L., Bernard, C., Brenner, N., Marder, E., & Narayanan, R. (2024) · The Journal of Neuroscience · doi:10.1523/jneurosci.1339-24.2024 · Cited by 34
Liepe, J., Taylor, H., Barnes, C. P., Huvet, M., Bugeon, L., Thorne, T., Lamb, J. R., Dallman, M. J., & Stumpf, M. P. H. (2012) · Integrative Biology · doi:10.1039/c2ib00175f · Cited by 33
Workflow for generating competing hypothesis from models with parameter uncertainty
Gomez-Cabrero, D., Compte, A., & Tegner, J. (2011) · Interface Focus · doi:10.1098/rsfs.2011.0015 · Cited by 33
Cause and cure of sloppiness in ordinary differential equation models
Tönsing, C., Timmer, J., & Kreutz, C. (2014) · Physical Review E · doi:10.1103/physreve.90.023303 · Cited by 33
Zhang, X., Birtwistle, M., & Gallo, J. (2014) · CPT: Pharmacometrics & Systems Pharmacology · doi:10.1038/psp.2013.65 · Cited by 33
Parameter-free model discrimination criterion based on steady-state coplanarity
Harrington, H. A., Ho, K. L., Thorne, T., & Stumpf, M. P. H. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1117073109 · Cited by 34
A new classifier-based strategy for in-silico ion-channel cardiac drug safety assessment
Mistry, H. B., Davies, M. R., & Veroli, G. Y. D. (2015) · Frontiers in Pharmacology · doi:10.3389/fphar.2015.00059 · Cited by 30
MacLean, A. L., Celso, C. L., & Stumpf, M. P. H. (2013) · Journal of The Royal Society Interface · doi:10.1098/rsif.2012.0968 · Cited by 33
A Nonquiescent “Idling” Population State in Drug-Treated, BRAF-Mutated Melanoma
Paudel, B. B., Harris, L. A., Hardeman, K. N., Abugable, A. A., Hayford, C. E., Tyson, D. R., & Quaranta, V. (2018) · Biophysical Journal · doi:10.1016/j.bpj.2018.01.016 · Cited by 33
Statistical analysis and optimality of neural systems
Młynarski, W. F., Hledík, M., Sokolowski, T. R., & Tkačik, G. (2021) · Neuron · doi:10.1016/j.neuron.2021.01.020 · Cited by 43
Towards estimating the true duration of dendritic cell interactions with T cells
Beltman, J. B., Henrickson, S. E., von Andrian, U. H., de Boer, R. J., & Marée, A. F. M. (2009) · Journal of Immunological Methods · doi:10.1016/j.jim.2009.05.013 · Cited by 34
Sloppiness and the Geometry of Parameter Space
Mannakee, B. K., Ragsdale, A. P., Transtrum, M. K., & Gutenkunst, R. N. (2015) · Studies in mechanobiology, tissue engineering and biomaterials · doi:10.1007/978-3-319-21296-8_11 · Cited by 40
Self-citationHorvath, N. M., Vilkhovoy, M., Wayman, J. A., Calhoun, K. A., Swartz, J. R., & Varner, J. D. (2019) · Metabolic Engineering Communications · doi:10.1016/j.mec.2019.e00113 · Cited by 40
Engineering TCR-controlled fuzzy logic into CAR T cells enhances therapeutic specificity
Kondo, T., Bourassa, F. X. P., Achar, S. R., DuSold, J., Céspedes, P. F., Ando, M., Dwivedi, A., Moraly, J., Chien, C. D., Majdoul, S., et al. (2025) · Cell · doi:10.1016/j.cell.2025.03.017 · Cited by 42
Using Network Biology to Bridge Pharmacokinetics and Pharmacodynamics in Oncology
Kirouac, D. C., & Onsum, M. D. (2013) · CPT Pharmacometrics & Systems Pharmacology · doi:10.1038/psp.2013.38 · Cited by 35
Harris, L. A., Beik, S. P., Ozawa, P. M. M., Jimenez, L., & Weaver, A. M. (2019) · Current Opinion in Systems Biology · doi:10.1016/j.coisb.2019.09.005 · Cited by 40
Trading bits in the readout from a genetic network
Bauer, M., Petkova, M. D., Gregor, T., Wieschaus, E. F., & Bialek, W. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2109011118 · Cited by 43
Tran, N.-H., van Maanen, L., Heathcote, A., & Matzke, D. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.608287 · Cited by 43
Tasseff, R. A., Nayak, S., Salim, S., Kaushik, P., Rizvi, N. F., & Varner, J. D. (2010) · PLoS ONE · doi:10.1371/journal.pone.0008864 · Cited by 41
Mathematical modelling of the mitochondrial apoptosis pathway
Huber, H. J., Düßmann, H., Wenus, J., Kilbride, S. M., & Prehn, J. H. M. (2010) · Biochimica et Biophysica Acta (BBA) - Molecular Cell Research · doi:10.1016/j.bbamcr.2010.10.004 · Cited by 36
Modeling Gene Expression in Time and Space
Rué, P., & García‐Ojalvo, J. (2013) · Annual Review of Biophysics · doi:10.1146/annurev-biophys-083012-130335 · Cited by 34
Information Geometry Approach to Verification of Dynamic Models in Power Systems
Transtrum, M. K., Sarić, A. T., & Stanković, A. M. (2017) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2017.2692523 · Cited by 37
Accurate action potential inference from a calcium sensor protein through biophysical modeling:Preprint
Greenberg, D. S., Wallace, D. J., Voit, K.-M., Wuertenberger, S., Czubayko, U., Monsees, A., Handa, T., Vogelstein, J. T., Seifert, R., Groemping, Y., et al. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/479055 · Cited by 34
Systematic reduction of a detailed atrial myocyte model
Lombardo, D. M., & Rappel, W. (2017) · Chaos An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/1.4999611 · Cited by 34
A divide-and-conquer approach to analyze underdetermined biochemical models
Kotte, O., & Heinemann, M. (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp004 · Cited by 31
Bae, S.-A., & Androulakis, I. P. (2017) · Gene Regulation and Systems Biology · doi:10.1177/1177625017702393 · Cited by 33
Uncoupling the roles of firing rates and spike bursts in shaping the STN-GPe beta band oscillations
Bahuguna, J., Sahasranamam, A., & Kumar, A. (2020) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1007748 · Cited by 37
Energy-efficient network activity from disparate circuit parameters
Deistler, M., Macke, J. H., & Gonçalves, P. J. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2207632119 · Cited by 45
Quantifying Global Tolerance of Biochemical Systems: Design Implications for Moiety-Transfer Cycles
Coelho, P. M. B. M., Salvador, A., & Savageau, M. A. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000319 · Cited by 36
Gemmell, P. M., Burrage, K., Rodríguez, B., & Quinn, T. A. (2016) · Progress in Biophysics and Molecular Biology · doi:10.1016/j.pbiomolbio.2016.06.003 · Cited by 27
Predicting how and when hidden neurons skew measured synaptic interactions
Brinkman, B. A. W., Rieke, F. M., Shea‐Brown, E., & Buice, M. A. (2018) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1006490 · Cited by 31
Statistical Models of Neural Activity, Criticality, and Zipf’s Law
Sorbaro, M., Herrmann, J. M., & Hennig, M. H. (2019) · Springer series on bio- and neurosystems · doi:10.1007/978-3-030-20965-0_13 · Cited by 30
Sechkar, K., Steel, H., Perrino, G., & Stan, G.-B. V. (2024) · Nature Communications · doi:10.1038/s41467-024-46410-9 · Cited by 33
How to deal with large models?
Hlavacek, W. S. (2009) · Molecular Systems Biology · doi:10.1038/msb.2008.80 · Cited by 30
Modelling Anopheles gambiae s.s. Population Dynamics with Temperature- and Age-Dependent Survival
Christiansen-Jucht, C., Erguler, K., Shek, C. Y., Basáñez, M.-G., & Parham, P. E. (2015) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph120605975 · Cited by 36
Shao, H., Peng, T., Ji, Z., Su, J., & Zhou, X. (2013) · PLoS ONE · doi:10.1371/journal.pone.0080832 · Cited by 30
Dynamic compensation, parameter identifiability, and equivariances
Sontag, E. D. (2017) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1005447 · Cited by 34
Johnson, M. E., Chen, A., Faeder, J. R., Henning, P., Moraru, I. I., Meier‐Schellersheim, M., Murphy, R. F., Prüstel, T., Theriot, J. A., & Uhrmacher, A. M. (2020) · Molecular Biology of the Cell · doi:10.1091/mbc.e20-08-0530 · Cited by 40
Qualitatively distinct phenotypes in the design space of biochemical systems
Savageau, M. A., & Fasani, R. A. (2009) · FEBS Letters · doi:10.1016/j.febslet.2009.10.073 · Cited by 30
Shuler, M. L., Foley, P., & Atlas, J. (2012) · Methods in molecular biology · doi:10.1007/978-1-61779-827-6_20 · Cited by 33
A unified approach for sparse dynamical system inference from temporal measurements
Pantazis, Y., & Tsamardinos, I. (2018) · Bioinformatics · doi:10.1093/bioinformatics/btz065 · Cited by 44
(2017) · Ecological Modelling · doi:10.1016/j.ecolmodel.2016.12.001 · Cited by 34
Blomquist, P., Devor, A., Indahl, U. G., Ulbert, I., Einevoll, G. T., & Dale, A. M. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000328 · Cited by 32
System drift and speciationPreprint
Schiffman, J., & Ralph, P. L. (2017) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/231209 · Cited by 30
Alsameen, M. H., Gong, Z., Qian, W., Kiely, M., Triebswetter, C., Bergeron, C. M., Cortina, L. E., Faulkner, M. E., Laporte, J. P., & Bouhrara, M. (2023) · Frontiers in Neurology · doi:10.3389/fneur.2023.1205426 · Cited by 29
“Parameter estimation in high dimensional problems, that is, those for which the number of parameters to be estimated is large, is complicated by the presence of local minima and saddle points (73).”
BackgroundThe core control system of intracellular iron homeostasis: A mathematical model
Chifman, J., Kniss, A., Neupane, P., Williams, I., Leung, B., Deng, Z., Mendes, P., Hower, V., Torti, F. M., Akman, S. A., et al. (2012) · Journal of Theoretical Biology · doi:10.1016/j.jtbi.2012.01.024 · Cited by 37
Pantazis, Y., Katsoulakis, M. A., & Vlachos, D. G. (2013) · BMC Bioinformatics · doi:10.1186/1471-2105-14-311 · Cited by 37
Simulating biological processes: stochastic physics from whole cells to colonies
Earnest, T. M., Cole, J. A., & Luthey-Schulten, Z. A. (2018) · Reports on Progress in Physics · doi:10.1088/1361-6633/aaae2c · Cited by 31
Implementation and acceleration of optimal control for systems biology
Sharp, J. A., Burrage, K., & Simpson, M. J. (2021) · Journal of The Royal Society Interface · doi:10.1098/rsif.2021.0241 · Cited by 35
A robust two-gene oscillator at the core of Ostreococcus tauri circadian clock
Morant, P.-E., Thommen, Q., Pfeuty, B., Vandermoëre, C., Corellou, F., Bouget, F., & Lefranc, M. (2010) · Chaos An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/1.3530118 · Cited by 32
Bayesian design strategies for synthetic biology
Barnes, C. P., Silk, D., & Stumpf, M. P. H. (2011) · Interface Focus · doi:10.1098/rsfs.2011.0056 · Cited by 33
Compartmentation of glycogen metabolism revealed from 13C isotopologue distributions
de Mas, I. M., Selivanov, V. A., Marín, S., Roca, J., Orešič, M., Agius, L., & Cascante, M. (2011) · BMC Systems Biology · doi:10.1186/1752-0509-5-175 · Cited by 32
A global parallel model based design of experiments method to minimize model output uncertainty
Bazil, J. N., Buzzard, G. T., & Rundell, A. E. (2012) · Bulletin of Mathematical Biology · doi:10.1007/s11538-011-9686-9 · Cited by 28
Hervás-Raluy, S., Wirthl, B., Guerrero, P. E., Rei, G. R., Nitzler, J., Coronado, E., de Mora, J. F., Schrefler, B. A., Gómez‐Benito, M. J., García‐Aznar, J. M., et al. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.106895 · Cited by 35
Modeling the Effect of APC Truncation on Destruction Complex Function in Colorectal Cancer Cells
Barua, D., & Hlavacek, W. S. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003217 · Cited by 33
Kügler, P. (2012) · PLoS ONE · doi:10.1371/journal.pone.0043001 · Cited by 32
Schmid, J., Düßmann, H., Boukes, G. J., Flanagan, L., Lindner, A. U., O'Connor, C. L., Rehm, M., Prehn, J. H. M., & Huber, H. J. (2012) · Journal of Biological Chemistry · doi:10.1074/jbc.m112.411827 · Cited by 30
Michele, C. D., Accatino, F., Vezzoli, R., & Scholes, R. J. (2011) · Journal of Theoretical Biology · doi:10.1016/j.jtbi.2011.08.014 · Cited by 38
The Dawn of Virtual Cell Biology
Freddolino, L., & Tavazoie, S. (2012) · Cell · doi:10.1016/j.cell.2012.07.001 · Cited by 33
Inferring Drosophila gap gene regulatory network: a parameter sensitivity and perturbation analysis
Fomekong‐Nanfack, Y., Postma, M., & Kaandorp, J. A. (2009) · BMC Systems Biology · doi:10.1186/1752-0509-3-94 · Cited by 31
A Kinetic Platform to Determine the Fate of Hydrogen Peroxide in Escherichia coli
Adolfsen, K. J., & Brynildsen, M. P. (2015) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1004562 · Cited by 28
Fox, Z., & Munsky, B. E. (2019) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1006365 · Cited by 33
Geometry of Energy Landscapes and the Optimizability of Deep Neural Networks
Becker, S., Zhang, Y., & Lee, A. A. (2020) · Physical Review Letters · doi:10.1103/physrevlett.124.108301 · Cited by 31
Designing combination therapies using multiple optimal controls
Sharp, J. A., Browning, A. P., Mapder, T., Baker, C. M., Burrage, K., & Simpson, M. J. (2019) · Journal of Theoretical Biology · doi:10.1016/j.jtbi.2020.110277 · Cited by 27
Rational thoughts in neural codes
Wu, Z., Kwon, M., Daptardar, S., Schrater, P., & Pitkow, X. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1912336117 · Cited by 27
Giampiccolo, S., Reali, F., Fochesato, A., Iacca, G., & Marchetti, L. (2024) · npj Systems Biology and Applications · doi:10.1038/s41540-024-00460-3 · Cited by 47
Is Ockham’s razor losing its edge? New perspectives on the principle of model parsimony
Dubova, M., Chandramouli, S., Gigerenzer, G., Grünwald, P., Holmes, W. R., Lombrozo, T., Marelli, M., Musslick, S., Nicenboim, B., Ross, L. N., et al. (2025) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2401230121 · Cited by 68
Altern, S. H., Welsh, J. P., Lyall, J. Y., Kocot, A. J., Burgess, S., Kumar, V., Williams, C., Lenhoff, A. M., & Cramer, S. M. (2023) · Journal of Chromatography A · doi:10.1016/j.chroma.2023.463878 · Cited by 30
Murabito, E., Verma, M., Bekker, M., Bellomo, D., Westerhoff, H. V., Teusink, B., & Steuer, R. (2014) · PLoS ONE · doi:10.1371/journal.pone.0106453 · Cited by 30
Gutierrez‐Arenas, O., Eriksson, O., & Kotaleski, J. H. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003445 · Cited by 27
Luan, D., Szlam, F., Tanaka, K. A., Barie, P. S., & Varner, J. D. (2010) · Molecular BioSystems · doi:10.1039/b920693k · Cited by 36
“Sloppy” nuclear energy density functionals: Effective model reduction
Nikšić, T., & Vretenar, D. (2016) · Physical Review C · doi:10.1103/physrevc.94.024333 · Cited by 28
New opportunities for optimal design of dynamic experiments in systems and synthetic biology
Braniff, N., & Ingalls, B. (2018) · Current Opinion in Systems Biology · doi:10.1016/j.coisb.2018.02.005 · Cited by 30
Explaining temporal differences to create useful concepts for evaluating states
Yee, R. C., Saxena, S., Utgoff, P. E., & Barto, A. G. (1990) · Cited by 26
Metadata
- Authors
- Gutenkunst, R. N., Waterfall, J. J., Casey, F. P., Brown, K. S., Myers, C. R., & Sethna, J. P.
- Affiliations
- Cornell University (US)
- University College Dublin (IE)
- Harvard University (US)
- Corresponding author
- Gutenkunst, Ryan N
- ORCID
- Venue
- PLoS Computational Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2007-10-05
- Volume
- 3
- Issue
- 10
- Pages
- e189
- ISSN
- 1553-734X (ISSN-L)
- 1553-7358
- PMC
- PMC2000971
- OpenAlex
- W2161304688
- Cited by
- 1,261
- References
- 44
- Citations by year
- 2026: 99 · 2025: 72 · 2024: 58 · 2023: 61 · 2022: 64 · 2021: 66 · 2020: 63 · 2019: 64 · 2018: 64 · 2017: 68 · 2016: 69 · 2015: 89 · 2014: 72 · 2013: 71 · 2012: 71
- FWCI
- 18.13
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS Computational Biology (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Figshare (submittedVersion, cc-by)
- arXiv (Cornell University)
- Funders
- National Science Foundation
- U.S. Department of Energy
- U.S. Department of Agriculture
- National Institutes of Health
- Agricultural Research Service
- National Institute of General Medical Sciences (T32GM008267)
- Division of Materials Research
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene Regulatory Network Analysis
- Physical Sciences › Engineering › Control and Systems Engineering › Control Systems and Identification
- Physical Sciences › Mathematics › Modeling and Simulation › Mathematical Biology Tumor Growth
- Keywords
- parameter sensitivity, parameter identifiability, growth factor signaling, systems biology models, predictive modeling, time series
- MeSH terms
- Algorithms, Computer Simulation, Half-Life, Models, Biological, Monte Carlo Method, Probability, Sensitivity and Specificity, Meta-Analysis as Topic, Models, Statistical, Nonlinear Dynamics, Systems Biology, Metabolic Networks and Pathways
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.