Practical limits for reverse engineering of dynamical systems: a statistical analysis of sensitivity and parameter inferability in systems biology models
The DOI matches its Crossref record; 38 of the 39 references it cites were found in a registry or an index, and 1 are not checked yet.
Abstract
The size and complexity of cellular systems make building predictive models an extremely difficult task. In principle dynamical time-course data can be used to elucidate the structure of the underlying molecular mechanisms, but a central and recurring problem is that many and very different models can be fitted to experimental data, especially when the latter are limited and subject to noise. Even given a model, estimating its parameters remains challenging in real-world systems. Here we present a comprehensive analysis of 180 systems biology models, which allows us to classify the parameters with respect to their contribution to the overall dynamical behaviour of the different systems. Our results reveal candidate elements of control in biochemical pathways that differentially contribute to dynamics. We introduce sensitivity profiles that concisely characterize parameter sensitivity and demonstrate how this can be connected to variability in data. Systematically linking data and model sloppiness allows us to extract features of dynamical systems that determine how well parameters can be estimated from time-course measurements, and associates the extent of data required for parameter inference with the model structure, and also with the global dynamical state of the system. The comprehensive analysis of so many systems biology models reaffirms the inability to estimate precisely most model or kinetic parameters as a generic feature of dynamical systems, and provides safe guidelines for performing better inferences and model predictions in the context of reverse engineering of mathematical models for biological systems.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This uncertainty, it has turned out, can play a pivotal role in the analysis of a system’s dynamics16–18.”
From A framework for parameter estimation and model selection from experimental data in systems biology using approximate Bayesian computation (2014) · cites this paper as [18]
In the citing paper
“In most biological systems, however, only a few reaction rates can be inferred given an observed dataset and different parameter vectors can explain the observed data (almost) equally well16,18,67.”
From A framework for parameter estimation and model selection from experimental data in systems biology using approximate Bayesian computation (2014) · cites this paper as [18]
In the citing paper
“With an optimal design we can overcome the problems of sloppy parameters [16] (which are, of course, dependent on the experimental intervention chosen [17]) and can narrow down the posterior probability intervals of parameters.”
From Maximizing the information content of experiments in systems biology (2013) · cites this paper as [17]
In the citing paper
“The Bayesian view will also help in establishing the practical limits for reverse engineering of kinetic models [236].”
From Reverse engineering and identification in systems biology: strategies, perspectives and challenges (2014) · cites this paper as [236]
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2003) · doi:10.1201/9780429258480 · Cited by 27,276
Hucka, M., Finney, A., Sauro, H. M., Bolouri, H., Doyle, J. C., Kitano, H., Arkin, A. P., Bornstein, B. J., Bray, D., Cornish-Bowden, A., et al. (2003) · Bioinformatics · doi:10.1093/bioinformatics/btg015 · Cited by 3,060
Faith, J. J., Hayete, B., Thaden, J. T., Mogno, I., Wierzbowski, J., Cottarel, G., Kasif, S., Collins, J. J., & Gardner, T. S. (2007) · PLoS Biology · doi:10.1371/journal.pbio.0050008 · Cited by 1,563
Toni, T., Welch, D., Strelkowa, N., Ipsen, A., & Stumpf, M. P. H. (2009) · Journal of The Royal Society Interface · doi:10.1098/rsif.2008.0172 · Cited by 1,498
Self-citationReverse engineering of regulatory networks in human B cells
Basso, K., Margolin, A. A., Stolovitzky, G., Klein, U., Dalla-Favera, R., & Califano, A. (2005) · Nature Genetics · doi:10.1038/ng1532 · Cited by 1,404
Universally Sloppy Parameter Sensitivities in Systems Biology Models
Gutenkunst, R. N., Waterfall, J. J., Casey, F. P., Brown, K. S., Myers, C. R., & Sethna, J. P. (2007) · PLoS Computational Biology · doi:10.1371/journal.pcbi.0030189 · Cited by 1,261
Inferring Genetic Networks and Identifying Compound Mode of Action via Expression Profiling
Gardner, T. S., di Bernardo, D., Lorenz, D., & Collins, J. J. (2003) · Science · doi:10.1126/science.1081900 · Cited by 1,117
Probabilistic Sensitivity Analysis of Complex Models: A Bayesian Approach
Oakley, J. E., & O'Hagan, A. (2004) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2004.05304.x · Cited by 1,085
Metabolic control analysis: a survey of its theoretical and experimental development
Fell, D. A. (1992) · Biochemical Journal · doi:10.1042/bj2860313 · Cited by 782
Research works printed but not linked: 7
- Garny, 2009, Wiley Interdiscip. Rev.: Syst. Biol.Med., 2, 134
- Coelho, 2009, PLoS Comput. Biol., 1
- Dayarian, 2009, PLoS Comput. Biol., 1
- Mackay, 2003, Information theory, inference and learning algorithms
- Teusink, 2000, FEBS J., 267, 5313
- Pritchard, 2002, FEBS J., 269, 3894
- Lillacci, 2010, PLoS Comput. Biol., 6, e1000696, 10.1371/journal.pcbi.1000696 · DOI · Paper page
Cited by
Perspective: Sloppiness and emergent theories in physics, biology, and beyond
Transtrum, M. K., Machta, B. B., Brown, K. S., Daniels, B. C., Myers, C. R., & Sethna, J. P. (2015) · The Journal of Chemical Physics · doi:10.1063/1.4923066 · Cited by 311
Kinetic models in industrial biotechnology – Improving cell factory performance
Almquist, J., Cvijovic, M., Hatzimanikatis, V., Nielsen, J., & Jirstrand, M. (2014) · Metabolic Engineering · doi:10.1016/j.ymben.2014.03.007 · Cited by 293
Reverse engineering and identification in systems biology: strategies, perspectives and challenges
Villaverde, A. F., & Banga, J. R. (2014) · Journal of The Royal Society Interface · doi:10.1098/rsif.2013.0505 · Cited by 229
“The Bayesian view will also help in establishing the practical limits for reverse engineering of kinetic models [236].”
BackgroundLiepe, J., Kirk, P., Filippi, S., Toni, T., Barnes, C. P., & Stumpf, M. P. H. (2014) · Nature Protocols · doi:10.1038/nprot.2014.025 · Cited by 217
“In most biological systems, however, only a few reaction rates can be inferred given an observed data set, and different parameter vectors can explain the observed data (almost) equally well 16,18,63 .”
BackgroundSelf-citationSensitivity, robustness, and identifiability in stochastic chemical kinetics models
Komorowski, M., Costa, M. J., Rand, D. A., & Stumpf, M. P. H. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1015814108 · Cited by 194
Self-citationMaximizing the information content of experiments in systems biology
Liepe, J., Filippi, S., Komorowski, M., & Stumpf, M. P. H. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002888 · Cited by 170
“Unfortunately obtaining reliable parameter estimates for dynamical systems is plagued with difficulties [16,17].”
BackgroundMethodSelf-citationBertrand, D., Chng, K. R., Sherbaf, F. G., Kiesel, A., Chia, B. K. H., Sia, Y. Y., Huang, S. K., Hoon, D. S. B., Liu, E. T., Hillmer, A., et al. (2015) · Nucleic Acids Research · doi:10.1093/nar/gku1393 · Cited by 153
On optimality of kernels for approximate Bayesian computation using sequential Monte Carlo
Filippi, S., Barnes, C. P., Cornebise, J., & Stumpf, M. P. H. (2013) · Statistical Applications in Genetics and Molecular Biology · doi:10.1515/sagmb-2012-0069 · Cited by 154
Self-citationIdentifiability analysis for stochastic differential equation models in systems biology
Browning, A. P., Warne, D. J., Burrage, K., Baker, R. E., & Simpson, M. J. (2020) · Journal of The Royal Society Interface · doi:10.1098/rsif.2020.0652 · Cited by 143
The Limitations of Model-Based Experimental Design and Parameter Estimation in Sloppy Systems
White, A., Tolman, M., Thames, H. D., Withers, H. R., Mason, K. A., & Transtrum, M. K. (2016) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1005227 · Cited by 124
Bayesian parameter estimation for dynamical models in systems biology
Linden-Santangeli, N. J., Krämer, B., & Rangamani, P. (2022) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1010651 · Cited by 113
Topological sensitivity analysis for systems biology
Babtie, A. C., Kirk, P., & Stumpf, M. P. H. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1414026112 · Cited by 97
Self-citationHow to deal with parameters for whole-cell modelling
Babtie, A. C., & Stumpf, M. P. H. (2017) · Journal of The Royal Society Interface · doi:10.1098/rsif.2017.0237 · Cited by 83
Self-citationBridging Mechanistic and Phenomenological Models of Complex Biological Systems
Transtrum, M. K., & Qiu, P. (2016) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1004915 · Cited by 95
A general moment expansion method for stochastic kinetic models
Ale, A., Kirk, P., & Stumpf, M. P. H. (2013) · The Journal of Chemical Physics · doi:10.1063/1.4802475 · Cited by 71
Self-citationErguler, K., Smith-Unna, S. E., Waldock, J., Proestos, Y., Christophides, G. K., Lelieveld, J., & Parham, P. E. (2016) · PLoS ONE · doi:10.1371/journal.pone.0149282 · Cited by 73
Self-citationModel Selection in Systems Biology Depends on Experimental Design
Silk, D., Kirk, P. D. W., Barnes, C. P., Toni, T., & Stumpf, M. P. H. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003650 · Cited by 66
Self-citationErguler, K., Pieri, M., & Deltas, C. (2013) · BMC Systems Biology · doi:10.1186/1752-0509-7-16 · Cited by 63
Self-citationModel‐based design of experiments for cellular processes
Chakrabarty, A., Buzzard, G. T., & Rundell, A. E. (2013) · WIREs Systems Biology and Medicine · doi:10.1002/wsbm.1204 · Cited by 56
Comprehensive Review of Models and Methods for Inferences in Bio-Chemical Reaction Networks
Loskot, P., Atitey, K., & Mihaylova, L. S. (2019) · Frontiers in Genetics · doi:10.3389/fgene.2019.00549 · Cited by 62
Silk, D., Filippi, S., & Stumpf, M. P. H. (2013) · Statistical Applications in Genetics and Molecular Biology · doi:10.1515/sagmb-2012-0043 · Cited by 51
Self-citationStatistical analysis of nonlinear dynamical systems using differential geometric sampling methods
Calderhead, B., & Girolami, M. (2011) · Interface Focus · doi:10.1098/rsfs.2011.0051 · Cited by 49
Bayesian Model Comparison and Parameter Inference in Systems Biology Using Nested Sampling
Pullen, N., & Morris, R. J. (2014) · PLoS ONE · doi:10.1371/journal.pone.0088419 · Cited by 51
Marucci, L., Barberis, M., Karr, J. R., Ray, O., Race, P. R., Andrade, M. D. S., Grierson, C., Hoffmann, S. A., Landon, S., Rech, E. L., et al. (2020) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2020.00942 · Cited by 51
Deep reinforcement learning for optimal experimental design in biology
Treloar, N. J., Braniff, N., Ingalls, B., & Barnes, C. P. (2022) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1010695 · Cited by 47
Sloppiness and the Geometry of Parameter Space
Mannakee, B. K., Ragsdale, A. P., Transtrum, M. K., & Gutenkunst, R. N. (2015) · Studies in mechanobiology, tissue engineering and biomaterials · doi:10.1007/978-3-319-21296-8_11 · Cited by 40
What Can Causal Networks Tell Us about Metabolic Pathways?
Blair, R. H., Kliebenstein, D. J., & Churchill, G. A. (2012) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002458 · Cited by 37
Liepe, J., Taylor, H., Barnes, C. P., Huvet, M., Bugeon, L., Thorne, T., Lamb, J. R., Dallman, M. J., & Stumpf, M. P. H. (2012) · Integrative Biology · doi:10.1039/c2ib00175f · Cited by 33
Self-citationProteolytic dynamics of human 20S thymoproteasome
Kuckelkorn, U., Stübler, S., Textoris‐Taube, K., Kilian, C., Niewienda, A., Henklein, P., Janek, K., Stumpf, M. P. H., Mishto, M., & Liepe, J. (2019) · Journal of Biological Chemistry · doi:10.1074/jbc.ra118.007347 · Cited by 34
Self-citationMacLean, A. L., Celso, C. L., & Stumpf, M. P. H. (2013) · Journal of The Royal Society Interface · doi:10.1098/rsif.2012.0968 · Cited by 33
Self-citationModelling Anopheles gambiae s.s. Population Dynamics with Temperature- and Age-Dependent Survival
Christiansen-Jucht, C., Erguler, K., Shek, C. Y., Basáñez, M.-G., & Parham, P. E. (2015) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph120605975 · Cited by 36
Self-citationParameter-free model discrimination criterion based on steady-state coplanarity
Harrington, H. A., Ho, K. L., Thorne, T., & Stumpf, M. P. H. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1117073109 · Cited by 34
Self-citationA climate-driven and field data-assimilated population dynamics model of sand flies
Erguler, K., Pontiki, I., Zittis, G., Proestos, Y., Christodoulou, V., Tsirigotakis, N., Antoniou, M., Kasap, Ö. E., Alten, B., & Lelieveld, J. (2019) · Scientific Reports · doi:10.1038/s41598-019-38994-w · Cited by 30
Self-citationMathematical and Statistical Modeling in Cancer Systems Biology
Blair, R. H., Trichler, D. L., & Gaile, D. P. (2012) · Frontiers in Physiology · doi:10.3389/fphys.2012.00227 · Cited by 33
Bayesian design strategies for synthetic biology
Barnes, C. P., Silk, D., & Stumpf, M. P. H. (2011) · Interface Focus · doi:10.1098/rsfs.2011.0056 · Cited by 33
Self-citationNew opportunities for optimal design of dynamic experiments in systems and synthetic biology
Braniff, N., & Ingalls, B. (2018) · Current Opinion in Systems Biology · doi:10.1016/j.coisb.2018.02.005 · Cited by 30
Interrogating theoretical models of neural computation with emergent property inference
Bittner, S. R., Palmigiano, A., Piet, A. T., Duan, C. A., Brody, C. D., Miller, K. D., & Cunningham, J. P. (2021) · eLife · doi:10.7554/elife.56265 · Cited by 32
Lenive, O., Kirk, P., & Stumpf, M. P. H. (2016) · BMC Systems Biology · doi:10.1186/s12918-016-0324-x · Cited by 29
Self-citationReverse Engineering Under Uncertainty
Kirk, P., Silk, D., & Stumpf, M. P. H. (2015) · Studies in mechanobiology, tissue engineering and biomaterials · doi:10.1007/978-3-319-21296-8_2 · Cited by 25
Self-citationA large-scale stochastic spatiotemporal model for Aedes albopictus-borne chikungunya epidemiology
Erguler, K., Chandra, N. L., Proestos, Y., Lelieveld, J., Christophides, G. K., & Parham, P. E. (2017) · PLoS ONE · doi:10.1371/journal.pone.0174293 · Cited by 24
Self-citationA generalised enzyme kinetic model for predicting the behaviour of complex biochemical systems
Wong, M. K. L., Krycer, J. R., Burchfield, J. G., James, D. E., & Kuncic, Z. (2015) · FEBS Open Bio · doi:10.1016/j.fob.2015.03.002 · Cited by 24
Sharma, A., Cinti, C., & Capobianco, E. (2017) · Frontiers in Immunology · doi:10.3389/fimmu.2017.00918 · Cited by 22
Erguler, K., Mendel, J., Petrić, D. V., Petrić, M., Kavran, M., Demirok, M. C., Günay, F., Georgiades, P., Alten, B., & Lelieveld, J. (2022) · Scientific Reports · doi:10.1038/s41598-022-15806-2 · Cited by 19
Self-citationNienałtowski, K., Włodarczyk, M., Lipniacki, T., & Komorowski, M. (2015) · BMC Systems Biology · doi:10.1186/s12918-015-0205-8 · Cited by 20
An evolutionary perspective on anti-tumor immunity
Klinke, D. J. (2013) · Frontiers in Oncology · doi:10.3389/fonc.2012.00202 · Cited by 20
Optimally Designed Model Selection for Synthetic Biology
Bandiera, L., Gomez-Cabeza, D., Gilman, J., Balsa‐Canto, E., & Menolascina, F. (2020) · ACS Synthetic Biology · doi:10.1021/acssynbio.0c00393 · Cited by 21
In silico model‐based inference: A contemporary approach for hypothesis testing in network biology
Klinke, D. J. (2014) · Biotechnology Progress · doi:10.1002/btpr.1982 · Cited by 16
Multi-model and network inference based on ensemble estimates: avoiding the madness of crowds
Stumpf, M. P. H. (2020) · Journal of The Royal Society Interface · doi:10.1098/rsif.2020.0419 · Cited by 17
Self-citationModel comparison via simplicial complexes and persistent homology
Vittadello, S. T., & Stumpf, M. P. H. (2021) · Royal Society Open Science · doi:10.1098/rsos.211361 · Cited by 15
Self-citationDufresne, E., Harrington, H. A., & Raman, D. V. (2018) · Journal of Algebraic Statistics · doi:10.18409/jas.v9i1.64 · Cited by 16
Accelerated Sensitivity Analysis in High-Dimensional Stochastic Reaction Networks
Arampatzis, G., Katsoulakis, M. A., & Pantazis, Y. (2015) · PLoS ONE · doi:10.1371/journal.pone.0130825 · Cited by 14
Configuration synthesis for programmable analog devices with Arco
Achour, S., Sarpeshkar, R., & Rinard, M. (2016) · ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI) · doi:10.1145/2908080.2908116 · Cited by 16
Interrogating theoretical models of neural computation with emergent property inferencePreprint
Bittner, S. R., Palmigiano, A., Piet, A. T., Duan, C. A., Brody, C. D., Miller, K. D., & Cunningham, J. P. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/837567 · Cited by 18
Configuration synthesis for programmable analog devices with Arco
Achour, S., Sarpeshkar, R., & Rinard, M. (2016) · ACM SIGPLAN Notices · doi:10.1145/2980983.2908116 · Cited by 15
Statistical and computational challenges for whole cell modelling
Stumpf, M. P. H. (2021) · Current Opinion in Systems Biology · doi:10.1016/j.coisb.2021.04.005 · Cited by 13
Self-citationMouse Hair Cycle Expression Dynamics Modeled as Coupled Mesenchymal and Epithelial Oscillators
Tasseff, R. A., Bheda-Malge, A., DiColandrea, T., Bascom, C. C., Isfort, R. J., & Gelinas, R. E. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003914 · Cited by 15
Michael, E., Sharma, S., Smith, M. E., Touloupou, P., Giardina, F., Prada, J. M., Stolk, W. A., Hollingsworth, T. D., & de Vlas, S. J. (2018) · PLoS neglected tropical diseases · doi:10.1371/journal.pntd.0006674 · Cited by 15
Information Geometry and Sequential Monte CarloPreprint
Sim, A., Filippi, S., & Stumpf, M. P. H. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1212.0764 · Cited by 12
Self-citationParameter inference in dynamical systems with co-dimension 1 bifurcations
Roesch, E., & Stumpf, M. P. H. (2019) · Royal Society Open Science · doi:10.1098/rsos.190747 · Cited by 17
Self-citationIdentification of potential COPD genes based on multi-omics data at the functional level
Liu, Z., Wan, L., Lv, J., Xie, R., Huang, H., Li, Y., He, Y., Jiang, J., Chen, B., Guo, S., et al. (2015) · Molecular BioSystems · doi:10.1039/c5mb00577a · Cited by 13
Anti-angiogenic drug scheduling optimisation with application to colorectal cancer
Sturrock, M., Miller, I. S., Kang, G., Arba’ie, N. H., O’Farrell, A. C., Barat, A., Marston, G., Coletta, P. L., Byrne, A. T., & Prehn, J. H. M. (2018) · Scientific Reports · doi:10.1038/s41598-018-29318-5 · Cited by 12
Improved Neurophysiological Process Imaging Through Optimization of Kalman Filter Initial Conditions
Zhao, Y., Luong, P., Teshuva, S., Pelentritou, A., William, W., Liley, D. T. J., Schmidt, D. F., Boley, M., & Kuhlmann, L. (2023) · International Journal of Neural Systems · doi:10.1142/s0129065723500247 · Cited by 10
Modelling Proteasome and Proteasome Regulator Activities
Liepe, J., Holzhütter, H., Kloetzel, P. M., Stumpf, M. P. H., & Mishto, M. (2014) · Biomolecules · doi:10.3390/biom4020585 · Cited by 10
Self-citationOmics Data Integration in Systems Biology
Conesa, A., & Hernández, R. (2014) · Comprehensive analytical chemistry · doi:10.1016/b978-0-444-62650-9.00016-6 · Cited by 10
Alam, M. S., Kamrujjaman, M., & Islam, M. S. (2020) · Journal of Applied Mathematics and Physics · doi:10.4236/jamp.2020.86073 · Cited by 9
Component Characterization in a Growth-Dependent Physiological Context: Optimal Experimental Design
Braniff, N., Scott, M., & Ingalls, B. (2019) · Processes · doi:10.3390/pr7010052 · Cited by 11
Optimal Experimental Design for a Bistable Gene Regulatory Network
Braniff, N., Richards, A. D. S., & Ingalls, B. (2019) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2019.12.267 · Cited by 8
A subsystems approach for parameter estimation of ODE models of hybrid systems
Georgoulas, A., Clark, A., Ocone, A., Gilmore, S., & Sanguinetti, G. (2012) · Electronic Proceedings in Theoretical Computer Science · doi:10.4204/eptcs.92.3 · Cited by 10
The Experimental Side of Parameter Estimation
Schliemann-Bullinger, M., Fey, D., Bastogne, T., Findeisen, R., Scheurich, P., & Bullinger, E. (2015) · Studies in mechanobiology, tissue engineering and biomaterials · doi:10.1007/978-3-319-21296-8_5 · Cited by 7
Control mechanisms for stochastic biochemical systems via computation of reachable sets
Lakatos, E., & Stumpf, M. P. H. (2017) · Royal Society Open Science · doi:10.1098/rsos.160790 · Cited by 7
Self-citationEnergy dependence of signalling dynamics and robustness in bacterial two component systemsPreprint
Forrest, J. B., Pan, M., Crampin, E. J., Rajagopal, V., & Stumpf, M. P. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.02.12.528212 · Cited by 7
Self-citationApproximate Bayesian computation for inferring Waddington landscapes from single-cell data
Liu, Y., Zhang, S. Y., Kleijn, I. T., & Stumpf, M. P. H. (2024) · Royal Society Open Science · doi:10.1098/rsos.231697 · Cited by 6
Self-citationCausal Drift, Robust Signaling, and Complex Disease
Wagner, A. (2015) · PLoS ONE · doi:10.1371/journal.pone.0118413 · Cited by 7
Vargas-Villamil, L. M., & Tedeschi, L. O. (2014) · Animal Production Science · doi:10.1071/an14568 · Cited by 12
Data-driven quantification of the robustness and sensitivity of cell signaling networks
Mukherjee, S., Seok, S.-C., Vieland, V. J., & Das, J. (2013) · Physical Biology · doi:10.1088/1478-3975/10/6/066002 · Cited by 5
Zen and the art of parameter estimation in systems biology
Myers, C. R. (2018) · CRC Press eBooks · doi:10.1201/9781315119847-8 · Cited by 4
Optimal experimental design for characterizing gene expression: sample scheduling
Braniff, N., Reed, M., & Ingalls, B. (2018) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2018.09.036 · Cited by 3
Lasri, A., Jurić, V., Verreault, M., Bielle, F., Idbaïh, A., Kel, A. E., Murphy, B. M., & Sturrock, M. (2020) · Royal Society Open Science · doi:10.1098/rsos.191243 · Cited by 3
Functional redundancy in the NF-κB signalling pathwayPreprint
Włodarczyk, M., Lipniacki, T., & Komorowski, M. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1303.3109 · Cited by 2
Automatic Control in Systems Biology
Balakrishnan, N., & Bagheri, N. (2023) · Springer handbooks · doi:10.1007/978-3-030-96729-1_55 · Cited by 1
Information Geometry in Underwater Acoustics: Tutorial, Case Study, and Outlook
Spendlove, J. C., Mortenson, M. C., Neilsen, T. B., & Transtrum, M. K. (2024) · Journal of Theoretical and Computational Acoustics · doi:10.1142/s2591728524500117 · Cited by 1
Kinetic Models in Life Science — Contributions to Methods and Applications
Almquist, J. O. (2017) · Chalmers Publication Library (Chalmers University of Technology) · Cited by 4
Optimal Experimental Design Applied to Models of Microbial Gene Regulation
Braniff, N. (2020) · UWSpace (University of Waterloo) · Cited by 1
Structural Analysis of Kinetic Systems with Application to Cell-free Expression Systems
Tuza, Z. A. (2015) · REAL-PhD (Hungarian Academy of Sciences)
Borrelli, F., Bemporad, A., & Morari, M. (2017) · Cambridge University Press eBooks · doi:10.1017/9781139061759.017
Kuo, S., Egertson, J. D., Merrihew, G. E., MacCoss, M. J., Pollard, D. A., & Rifkin, S. A. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/805846
Scheuer, K. S., Hanlon, B. M., Dresel, J. W., Nolan, E. D., Davis, J. C., & Loewe, L. (2017) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/099192
Coles, M. C., & Brown, L. (2018) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.733699856.793549350
Statistical Models in Cancer Management
Chandramohan, S., Mathur, P. P., & Rajagopalan, R. (2024) · Springer eBooks · doi:10.1007/978-981-99-3746-2_2
Bayesian Validation of Dynamic Systems for Biological Networks
Son, D., & Kim, J. (2025) · Journal of Computational Biology · doi:10.1177/15578666251382251
Vandvajdi, S., Mao, Y.-N., Abouali, H., Shokouhian, B., Daubon, T., Kohandel, M., & Poudineh, M. (2026) · ACS Sensors · doi:10.1021/acssensors.5c04493
Metadata
- Authors
- Erguler, K., & Stumpf, M. P. H.
- Affiliations
- Imperial College London (GB)
- Corresponding author
- Stumpf, Michael P H
- Venue
- Molecular BioSystems
- Publisher
- Oxford University Press (OUP)
- Published
- 2011-03-04
- Volume
- 7
- Issue
- 5
- Pages
- 1593-1602
- ISSN
- 1742-2051 (ISSN-L)
- 1742-206X
- OpenAlex
- W2077259222
- Semantic Scholar
- 330e8c6df2bf2adb506714cd065e9d1b21b1dc82
- Cited by
- 91
- References
- 37
- Citations by year
- 2026: 1 · 2025: 1 · 2024: 3 · 2023: 3 · 2022: 3 · 2021: 3 · 2020: 7 · 2019: 8 · 2018: 7 · 2017: 6 · 2016: 6 · 2015: 11 · 2014: 12 · 2013: 10 · 2012: 7
- FWCI
- 4.14
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Molecular BioSystems (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Wellcome Trust
- Royal Society
- Biotechnology and Biological Sciences Research Council (BB/F005210/2, BB/F005210/1, BB/G007934/1)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene Regulatory Network Analysis
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Microbial Metabolic Engineering and Bioproduction
- Physical Sciences › Engineering › Control and Systems Engineering › Control Systems and Identification
- Keywords
- reverse engineering, dynamical systems, parameter identifiability, parameter sensitivity, sensitivity profiles, parameter inference, time course data, systems biology models, data variability, model structure
- MeSH terms
- Algorithms, Animals, Bayes Theorem, Computer Simulation, Humans, Models, Biological, Reproducibility of Results, Signal Transduction, Feedback, Physiological, Systems Biology, Circadian Clocks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.