Identifiability and observability analysis for experimental design in nonlinear dynamical models
Open accessThe DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index; none of the 1 sources its claims cite is checked for support yet.
Abstract
Dynamical models of cellular processes promise to yield new insights into the underlying systems and their biological interpretation. The processes are usually nonlinear, high dimensional, and time-resolved experimental data of the processes are sparse. Therefore, parameter estimation faces the challenges of structural and practical nonidentifiability. Nonidentifiability of parameters induces nonobservability of trajectories, reducing the predictive power of the model. We will discuss a generic approach for nonlinear models that allows for identifiability and observability analysis by means of a realistic example from systems biology. The results will be utilized to design new experiments that enhance model predictiveness, illustrating the iterative cycle between modeling and experimentation in systems biology.
Overview
CoChat Summary
TL;DR
The paper presents profile-likelihood-based identifiability and observability analysis for nonlinear ODE models and applies it to an Epo/EpoR trafficking model to guide experimental design. It shows structural and practical nonidentifiability can be resolved by adding absolute-concentration information and intracellular Epo measurements, yielding a fully identifiable model.
Key findings
- In the initial setup with 16 data points and 10 free parameters, the objective function was χ²=6.55; profile likelihood identified Bmax, Epo0, kD, kon, and scale as structurally nonidentifiable, linked by functional relations.
- Adding prior information on initial Epo concentration, Epo0 ~ N(2100, 210²) pM, resolved the structural nonidentifiability, but kex remained practically nonidentifiable; its upper confidence bound was determined at θ+ = −2.230 and its lower bound was not feasible.
- Adding intracellular 125I-Epo measurements (y3) resolved the practical nonidentifiability of kex; all parameters became structurally and practically identifiable, with finite 95% confidence intervals reported in Table I.
- A simulation study with 450 datasets showed the overfitting distribution was in line with χ²_df with df=10; parameter coverage rates were expected between 93.33% and 96.66% and the paper states all parameters fulfilled this, though trajectory coverage was too low for Epo at t=20 min, Epo_EpoR at t=300 min, and Epo_EpoR_i between 150 and 250 min.
Methods
- An ODE model of Epo/EpoR binding and trafficking with six species and mass-action kinetics; observation functions were y1=scale·([Epo]+[dEpo_e]), y2=scale·[Epo_EpoR], and later y3=scale·([Epo_EpoR_i]+[dEpo_i]).
- Parameters were estimated by minimizing the weighted sum of squared residuals (χ²) using CVODES and MATLAB lsqnonlin; profile likelihood was computed for each parameter to assess structural/practical identifiability and observability.
- Data came from BaF3-EpoR cells with 125I-Epo in triplicates, initially measuring extracellular and bound Epo and later intracellular Epo; cells were treated with 2100 ± 210 pM 125I-Epo, and a simulation study generated 450 independent datasets.
Limitations
- Stated: trajectory confidence bands had too-low coverage for Epo at t=20 min, Epo_EpoR at t=300 min, and Epo_EpoR_i between 150 and 250 min; this was attributed to approximating the high-dimensional confidence region by profile likelihood rather than dense sampling.
- Stated: for nonlinear models and small samples, the distribution of χ²(θ*)−χ²(θ̂) may differ from χ²_df; it should be verified by simulation studies, and the threshold adjusted if deviations are observed.
- Evident: the analysis is demonstrated on a single Epo/EpoR case study, so generalizability to other nonlinear dynamical models is not empirically established; also, Table I lists Epo0 CR 92.44% and Scale 92.89%, below the stated expected lower bound of 93.33%, despite the text saying all parameters fulfilled the expected range.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 Valid · 0 Not valid · 1 Not checked · 20 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Nevertheless, the parameter kex re-mains practically nonidentifiable.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The results of the analysis were used to plan additional experiments to resolve nonidentifiabilities in-herent in the initial data set.”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Based on an initial data set, parameter identifiability and observ-ability was successively improved by applying the profile likelihood approach.”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The flatness of the profile likelihood reveals that param-eters Bmax, Epo0, kD, kon, and scale are structurally noniden-tifiable.”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Furthermore, the amplitude of vari-ability of the trajectories at these spots allows to assess the necessary measurement precision to provide adequate data.”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
8 more claims
Create a free account to see all 21 claims and to verify the 1 reference still open.
- It may state two separate claims as one. 7
- The quote only partly states this claim. 1
- Probably not a substantial claim. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“All parameters are positive by definition, hence the logarithmic space yields a flat metric [19].”
From Joining forces of Bayesian and frequentist methodology: a study for inference in the presence of non-identifiability (2013) · cites this paper as [19]
Experimental — accuracy not yet measured
Citations
Cites
Savitzky-Golay Smoothing Filters
Press, W. H., & Teukolsky, S. A. (1990) · Computers in Physics · doi:10.1063/1.4822961 · Cited by 11,670
Press, W. H., Teukolsky, S. L. A., Flannery, B. P., & Vetterling, W. T. (1990) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 6,980
Ziegel, E. R., Lehmann, E. L., & Casella, G. (1999) · Technometrics · doi:10.2307/1270597 · Cited by 4,203
An Interior Trust Region Approach for Nonlinear Minimization Subject to Bounds
Coleman, T. F., & Li, Y. (1996) · SIAM Journal on Optimization · doi:10.1137/0806023 · Cited by 3,320
SUNDIALS: Suite of nonlinear and differential/algebraic equation solvers
Hindmarsh, A. C., Brown, P. N., Grant, K. E., Lee, S. L., Serban, R., Shumaker, D. E., & Woodward, C. S. (2005) · ACM Transactions on Mathematical Software · doi:10.1145/1089014.1089020 · Cited by 2,556
Raue, A., Kreutz, C., Maiwald, T., Bachmann, J., Schilling, M., Klingmüller, U., & Timmer, J. (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp358 · Cited by 1,442
Self-citationMurphy, S. A., & Van Der Vaart, A. W. (2000) · Journal of the American Statistical Association · doi:10.1080/01621459.2000.10474219 · Cited by 712
A method for computing profile-likelihood-based confidence intervals
Venzon, D. J., & Moolgavkar, S. H. (1988) · Applied Statistics · doi:10.2307/2347496 · Cited by 565
Swameye, I., Müller, T. G., Timmer, J., Sandra, O., & Klingmüller, U. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0237333100 · Cited by 316
Self-citationTeaching about Approximate Confidence Regions Based on Maximum Likelihood Estimation
Meeker, W. Q., & Escobar, L. A. (1995) · The American Statistician · doi:10.1080/00031305.1995.10476112 · Cited by 279
Research works printed but not linked: 1
- 2003, Nonlinear Regression
Cited by
Observability of complex systems
Liu, Y.-Y., Slotine, J.-J., & Barabási, A.-L. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1215508110 · Cited by 516
On structural and practical identifiability
Wieland, F.-G., Hauber, A. L., Rosenblatt, M., Tönsing, C., & Timmer, J. (2021) · Current Opinion in Systems Biology · doi:10.1016/j.coisb.2021.03.005 · Cited by 325
Self-citationLessons Learned from Quantitative Dynamical Modeling in Systems Biology
Raue, A., Schilling, M., Bachmann, J., Matteson, A., Schelke, M., Kaschek, D., Hug, S., Kreutz, C., Harms, B. D., Theis, F. J., et al. (2013) · PLoS ONE · doi:10.1371/journal.pone.0074335 · Cited by 306
Self-citationKinetic models in industrial biotechnology – Improving cell factory performance
Almquist, J., Cvijovic, M., Hatzimanikatis, V., Nielsen, J., & Jirstrand, M. (2014) · Metabolic Engineering · doi:10.1016/j.ymben.2014.03.007 · Cited by 293
Data2Dynamics: a modeling environment tailored to parameter estimation in dynamical systems
Raue, A., Steiert, B., Schelker, M., Kreutz, C., Maiwald, T., Hass, H., Vanlier, J., Tönsing, C., Adlung, L., Engesser, R., et al. (2015) · Bioinformatics · doi:10.1093/bioinformatics/btv405 · Cited by 227
Self-citationProfile likelihood in systems biology
Kreutz, C., Raue, A., Kaschek, D., & Timmer, J. (2013) · The FEBS Journal · doi:10.1111/febs.12276 · Cited by 176
Self-citationComparison of approaches for parameter identifiability analysis of biological systems
Raue, A., Karlsson, J., Saccomani, M. P., Jirstrand, M., & Timmer, J. (2014) · Bioinformatics · doi:10.1093/bioinformatics/btu006 · Cited by 180
Self-citationMulti-chromatic control of mammalian gene expression and signaling
Müller, K., Engesser, R., Schulz, S., Steinberg, T., Tomakidi, P., Weber, C. C., Ulm, R., Timmer, J., Zurbriggen, M. D., & Weber, W. (2013) · Nucleic Acids Research · doi:10.1093/nar/gkt340 · Cited by 158
Self-citationKinetic modeling of methanol synthesis from renewable resources
Seidel, C. D. H.-P., Jörke, A., Vollbrecht, B., Seidel‐Morgenstern, A., & Kienle, A. (2017) · Chemical Engineering Science · doi:10.1016/j.ces.2017.09.043 · Cited by 125
Raue, A., Kreutz, C., Theis, F. J., & Timmer, J. (2013) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2011.0544 · Cited by 119
“Based on the results of the profiling approach additional experiments were suggested, see in [18] for details.”
BackgroundMethodInfluentialSelf-citationAstroza, R., Ebrahimian, H., Li, Y., & Conte, J. P. (2017) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2017.01.040 · Cited by 106
Cell-Specific Cardiac Electrophysiology Models
Groenendaal, W., Ortega, F. A., Kherlopian, A. R., Zygmunt, A. C., Krogh‐Madsen, T., & Christini, D. J. (2015) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1004242 · Cited by 105
Raue, A., Kreutz, C., Theis, F. J., & Timmer, J. (2016) · Cited by 101
Self-citationA Green-Light-Responsive System for the Control of Transgene Expression in Mammalian and Plant Cells
Chatelle, C. V., Ochoa‐Fernandez, R., Engesser, R., Schneider, N., Beyer, H. M., Jones, A. R., Timmer, J., Zurbriggen, M. D., & Weber, W. (2018) · ACS Synthetic Biology · doi:10.1021/acssynbio.7b00450 · Cited by 96
Self-citationCedersund, G. (2012) · The FEBS Journal · doi:10.1111/j.1742-4658.2012.08725.x · Cited by 81
Meyer, P., Cokelaer, T., Chandran, D., Kim, K., Loh, P.-R., Tucker, G., Lipson, M., Berger, B., Kreutz, C., Raue, A., et al. (2014) · BMC Systems Biology · doi:10.1186/1752-0509-8-13 · Cited by 73
Self-citationLam, N. N., Docherty, P. D., & Murray, R. (2022) · Mathematics and Computers in Simulation · doi:10.1016/j.matcom.2022.03.020 · Cited by 86
Windowed Granger causal inference strategy improves discovery of gene regulatory networks
Finkle, J. D., Wu, J., & Bagheri, N. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1710936115 · Cited by 78
Experimental Design for Parameter Estimation of Gene Regulatory Networks
Steiert, B., Raue, A., Timmer, J., & Kreutz, C. (2012) · PLoS ONE · doi:10.1371/journal.pone.0040052 · Cited by 66
Self-citationPredictive mathematical models of cancer signalling pathways
Bachmann, J., Raue, A., Schilling, M., Becker, V., Timmer, J., & Klingmüller, U. (2012) · Journal of Internal Medicine · doi:10.1111/j.1365-2796.2011.02492.x · Cited by 63
Self-citationComputational Strategies for a System-Level Understanding of Metabolism
Cazzaniga, P., Damiani, C., Besozzi, D., Colombo, R., Nobile, M. S., Gaglio, D., Pescini, D., Molinari, S., Mauri, G., Alberghina, L., et al. (2014) · Metabolites · doi:10.3390/metabo4041034 · Cited by 67
BioUML: an integrated environment for systems biology and collaborative analysis of biomedical data
Kolpakov, F., Akberdin, I. R., Kashapov, T. A., Kiselev, L., Kolmykov, S. K., Kondrakhin, Y. V., Kutumova, E. O., Mandrik, N., Pintus, S. S., Ryabova, A., et al. (2019) · Nucleic Acids Research · doi:10.1093/nar/gkz440 · Cited by 58
Body-Worn IMU-Based Human Hip and Knee Kinematics Estimation during Treadmill Walking
McGrath, T. M., & Stirling, L. (2022) · Sensors · doi:10.3390/s22072544 · Cited by 56
Body-Worn IMU Human Skeletal Pose Estimation Using a Factor Graph-Based Optimization Framework
McGrath, T. M., & Stirling, L. (2020) · Sensors · doi:10.3390/s20236887 · Cited by 54
Statistical inference for dynamical systems: A review
McGoff, K. A., Mukherjee, S., & Pillai, N. S. (2015) · Statistics Surveys · doi:10.1214/15-ss111 · Cited by 70
Mathematical Modeling and Forecasting of COVID-19 in Moscow and Novosibirsk Region
Игоревна, К. О., Kabanikhin, S. I., Zyatkov, N., Prikhodko, A., Prokhoshin, N., & Shishlenin, M. A. (2020) · Numerical Analysis and Applications · doi:10.1134/s1995423920040047 · Cited by 46
New types of experimental data shape the use of enzyme kinetics for dynamic network modeling
Tummler, K., Lubitz, T., Schelker, M., & Klipp, E. (2013) · FEBS Journal · doi:10.1111/febs.12525 · Cited by 53
Correction: Lessons Learned from Quantitative Dynamical Modeling in Systems Biology
Raue, A., Schilling, M., Bachmann, J., Matteson, A., Schelker, M., Kaschek, D., Hug, S., Kreutz, C., Harms, B. D., Theis, F. J., et al. (2013) · PLoS ONE · doi:10.1371/annotation/ea0193d8-1f7f-492a-b0b7-d877629fdcee · Cited by 37
Self-citationNobile, M. S., Cazzaniga, P., Besozzi, D., Pescini, D., & Mauri, G. (2014) · PLoS ONE · doi:10.1371/journal.pone.0091963 · Cited by 36
A symbolic network-based nonlinear theory for dynamical systems observability
Christophe Letellier, A., Sendiña–Nadal, I., Bianco-Martínez, E., & Baptista, M. S. (2018) · Scientific Reports · doi:10.1038/s41598-018-21967-w · Cited by 34
Cause and cure of sloppiness in ordinary differential equation models
Tönsing, C., Timmer, J., & Kreutz, C. (2014) · Physical Review E · doi:10.1103/physreve.90.023303 · Cited by 33
Self-citationDelay-differential SEIR modeling for improved modelling of infection dynamics
Kiselev, I. N., Akberdin, I. R., & Kolpakov, F. (2023) · Scientific Reports · doi:10.1038/s41598-023-40008-9 · Cited by 34
Optimal design of stimulus experiments for robust discrimination of biochemical reaction networks
Flassig, R. J., & Sundmacher, K. (2012) · Bioinformatics · doi:10.1093/bioinformatics/bts585 · Cited by 31
Fachet, M., Flassig, R., Rihko‐Struckmann, L., & Sundmacher, K. (2014) · Bioresource Technology · doi:10.1016/j.biortech.2014.08.124 · Cited by 31
Learning (from) the errors of a systems biology model
Engelhardt, B., Fröhlich, H., & Kschischo, M. (2016) · Scientific Reports · doi:10.1038/srep20772 · Cited by 36
Reconstructing Mammalian Sleep Dynamics with Data Assimilation
Sedigh-Sarvestani, M., Schiff, S. J., & Gluckman, B. J. (2012) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002788 · Cited by 30
Tummler, K., & Klipp, E. (2017) · Current Opinion in Systems Biology · doi:10.1016/j.coisb.2017.11.003 · Cited by 30
Reconstructing asynchrony for mechanical ventilation using a hysteresis loop virtual patient model
Zhou, C., Chase, J. G., Sun, Q., Knopp, J. L., Tawhai, M. H., Desaive, T., Möller, K., Shaw, G. M., Chiew, Y. S., & Benyó, B. I. (2022) · BioMedical Engineering OnLine · doi:10.1186/s12938-022-00986-9 · Cited by 27
van Mourik, S., ter Braak, C. J. F., Stigter, J. D., & Molenaar, J. (2014) · PeerJ · doi:10.7717/peerj.433 · Cited by 28
Profile likelihood-based analyses of infectious disease models
Tönsing, C., Timmer, J., & Kreutz, C. (2018) · Statistical Methods in Medical Research · doi:10.1177/0962280217746444 · Cited by 32
Self-citationEbrahimian, H., Astroza, R., Conte, J. P., & Bitmead, R. R. (2019) · Journal of Engineering Mechanics · doi:10.1061/(asce)em.1943-7889.0001590 · Cited by 29
State and parameter estimation using unconstrained optimization
Schumann-Bischoff, J., & Parlitz, U. (2011) · Physical Review E · doi:10.1103/physreve.84.056214 · Cited by 25
Rateitschak, K., Winter, F., Lange, F., Jaster, R., & Wolkenhauer, O. (2012) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002815 · Cited by 25
A unified framework for estimating parameters of kinetic biological models
Baker, S. M., Poskar, C. H., Schreiber, F., & Junker, B. H. (2015) · BMC Bioinformatics · doi:10.1186/s12859-015-0500-9 · Cited by 24
Sensitivity and identifiability analysis of COVID-19 pandemic models
Игоревна, К. О., Kabanikhin, S. I., Sosnovskaya, M. I., & Andornaya, D. V. (2021) · Vavilov Journal of Genetics and Breeding · doi:10.18699/vj21.010 · Cited by 25
Zaballa, I., & Eidemüller, M. (2016) · Radiation and Environmental Biophysics · doi:10.1007/s00411-016-0659-0 · Cited by 24
(2021) · doi:10.1016/j.celrep.2021.109507 · Cited by 21
Self-citationDifferential equations in data analysis
Dattner, I. (2020) · Wiley Interdisciplinary Reviews Computational Statistics · doi:10.1002/wics.1534 · Cited by 22
Parlitz, U., Schumann-Bischoff, J., & Luther, S. (2014) · Chaos An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/1.4884344 · Cited by 20
Pant, S. (2018) · Journal of The Royal Society Interface · doi:10.1098/rsif.2017.0871 · Cited by 24
Prediction uncertainty and optimal experimental design for learning dynamical systems
Letham, B., Letham, P. A., Rudin, C. D., & Browne, E. P. (2016) · Chaos An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/1.4953795 · Cited by 28
Stochasticity and Determinism in Models of Hematopoiesis
Kimmel, M. (2014) · Advances in experimental medicine and biology · doi:10.1007/978-1-4939-2095-2_7 · Cited by 19
Argyri, K. D., Dionysiou, D. D., Misichroni, F. D., & STAMATAKOS, G. S. (2016) · Biology Direct · doi:10.1186/s13062-016-0114-9 · Cited by 18
Inference of hidden variables in systems of differential equations with genetic programming
Cornforth, T. W., & Lipson, H. (2012) · Genetic Programming and Evolvable Machines · doi:10.1007/s10710-012-9175-4 · Cited by 18
Model calibration and uncertainty analysis in signaling networks
Heinemann, T., & Raue, A. (2016) · Current Opinion in Biotechnology · doi:10.1016/j.copbio.2016.04.004 · Cited by 17
Self-citationDetermining minimal output sets that ensure structural identifiability
Joubert, D., Stigter, J. D., & Molenaar, J. (2018) · PLoS ONE · doi:10.1371/journal.pone.0207334 · Cited by 19
Observability, Identifiability and Epidemiology -- A surveyPreprint
Cunniffe, N. J., Hamelin, F., Iggidr, A., Rapaport, A., & Sallet, G. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.12202 · Cited by 21
Parameter Identification For Continuous Fluidized Bed Spray Agglomeration
Golovin, I., Strenzke, G., Dürr, R., Palis, S., Bück, A., Tsotsas, E., & Kienle, A. (2018) · Processes · doi:10.3390/pr6120246 · Cited by 16
Estimability and dependency analysis of model parameters based on delay coordinates
Schumann-Bischoff, J., Luther, S., & Parlitz, U. (2016) · Physical review. E · doi:10.1103/physreve.94.032221 · Cited by 16
Bayesian Regression Facilitates Quantitative Modeling of Cell Metabolism
Groves, T., Cowie, N. L., & Nielsen, L. K. (2024) · ACS Synthetic Biology · doi:10.1021/acssynbio.3c00662 · Cited by 13
Tönsing, C., Steiert, B., Timmer, J., & Kreutz, C. (2023) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1011417 · Cited by 15
Self-citationJoubert, D., Stigter, J. D., & Molenaar, J. (2021) · Scientific Reports · doi:10.1038/s41598-021-96293-9 · Cited by 13
Dray, K. E., Muldoon, J. J., Mangan, N. M., Bagheri, N., & Leonard, J. N. (2022) · ACS Synthetic Biology · doi:10.1021/acssynbio.1c00528 · Cited by 14
Eberle, C., & Ament, C. (2011) · Biosystems · doi:10.1016/j.biosystems.2011.11.003 · Cited by 12
Introduction to Focus Issue: Dynamics in Systems Biology
Brackley, C. A., Ebenhöh, O., Grebogi, C., Kurths, J., de Moura, A., Romano, M. C., & Thiel, M. (2010) · Chaos An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/1.3530126 · Cited by 12
Structural vs Practical Identifiability in System Biology.
Saccomani, M. P. (2013) · Padua Research Archive (University of Padova) · Cited by 12
Parameter Estimation in Mathematical Models of Viral Infections Using R
Nguyễn, V. K., & Hernandez-Vargas, E. A. (2018) · Methods in molecular biology · doi:10.1007/978-1-4939-8678-1_25 · Cited by 11
Minimally sufficient experimental design using identifiability analysis
Gevertz, J. L., & Kareva, I. (2024) · npj Systems Biology and Applications · doi:10.1038/s41540-023-00325-1 · Cited by 16
Exploiting intrinsic fluctuations to identify model parameters
Zimmer, C., Sahle, S., & Pahle, J. (2015) · IET Systems Biology · doi:10.1049/iet-syb.2014.0010 · Cited by 11
Assessing parameter identifiability for dynamic causal modeling of fMRI data
Arand, C., Scheller, E., Seeber, B., Timmer, J., Klöppel, S., & Schelter, B. (2015) · Frontiers in Neuroscience · doi:10.3389/fnins.2015.00043 · Cited by 11
Self-citationEstimation of neuron parameters from imperfect observations
Taylor, J. D., Winnall, S., & Nogaret, A. (2020) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1008053 · Cited by 10
Игоревна, К. О., Sosnovskaia, M., & Kabanikhin, S. I. (2023) · Journal of Inverse and Ill-Posed Problems · doi:10.1515/jiip-2021-0038 · Cited by 12
Mathematical modeling and forecasting of COVID-19 in Moscow and Novosibirsk region
(2020) · Numerical Analysis and Applications · doi:10.15372/sjnm20200404 · Cited by 9
Strebel, O. (2023) · Nonlinear Dynamics · doi:10.1007/s11071-023-08242-y · Cited by 9
Least Squares Estimation in Stochastic Biochemical Networks
Rempała, G. A. (2012) · Bulletin of Mathematical Biology · doi:10.1007/s11538-012-9744-y · Cited by 9
The Experimental Side of Parameter Estimation
Schliemann-Bullinger, M., Fey, D., Bastogne, T., Findeisen, R., Scheurich, P., & Bullinger, E. (2015) · Studies in mechanobiology, tissue engineering and biomaterials · doi:10.1007/978-3-319-21296-8_5 · Cited by 7
Miroshnichenko, M. I., Kolpakov, F., & Akberdin, I. R. (2025) · Viruses · doi:10.3390/v17050589 · Cited by 7
A Priori Identifiability of Target-Mediated Drug Disposition Models and Approximations
Eudy, R. J., Riggs, M. M., & Gastonguay, M. R. (2015) · The AAPS Journal · doi:10.1208/s12248-015-9795-8 · Cited by 8
JointTracker: Real-time inertial kinematic chain tracking with joint position estimation
Taetz, B., Lorenz, M., Miezal, M., Stricker, D., & Bleser, G. (2024) · Open Research Europe · doi:10.12688/openreseurope.16939.2 · Cited by 8
Wells, S. A., Taylor, J. D., Morris, P. G., & Nogaret, A. (2024) · PRX Life · doi:10.1103/prxlife.2.023007 · Cited by 6
In silico model development and optimization of in vitro lung cell population growth
Mostofinejad, A., Romero, D. A., Brinson, D., Marin‐Araujo, A. E., Bazylak, A., Waddell, T. K., Haykal, S., Karoubi, G., & Amon, C. H. (2024) · PLoS ONE · doi:10.1371/journal.pone.0300902 · Cited by 7
An approach to mechanistic event recognition applied on monitoring organic matter depletion in SBRs
Bournazou, M. N. C., Junne, S. G., Neubauer, P. B., Barz, T., Arellano‐García, H., & Kravaris, C. (2014) · AIChE Journal · doi:10.1002/aic.14536 · Cited by 6
Schweinoch, D., Bachmann, P., Clausznitzer, D., Binder, M., & Kaderali, L. (2020) · Journal of Theoretical Biology · doi:10.1016/j.jtbi.2020.110336 · Cited by 6
Modeling Formalisms in Systems Biology of Apoptosis
Kallenberger, S. M., & Legewie, S. (2012) · Springer eBooks · doi:10.1007/978-1-4614-4009-3_1 · Cited by 7
Particle filtering of dynamical networks: Highlighting observability issues
Montanari, A. N., & Aguirre, L. A. (2019) · Chaos An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/1.5085321 · Cited by 6
Optimal experiment design for practical parameter identifiability and model discrimination
Liu, Y., Maini, P. K., & Baker, R. E. (2026) · Mathematical Biosciences · doi:10.1016/j.mbs.2026.109710 · Cited by 11
Klett, H., Rodríguez-Fernández, M., Dineen, S. M., Leon, L., Timmer, J., & Doyle, F. (2015) · Mathematical Biosciences · doi:10.1016/j.mbs.2014.07.011 · Cited by 6
Self-citationTönsing, C., Timmer, J., & Kreutz, C. (2019) · Frontiers in Physics · doi:10.3389/fphy.2019.00149 · Cited by 5
Self-citationApproaches to Parameter Estimation from Model Neurons and Biological Neurons
Nogaret, A. (2022) · Algorithms · doi:10.3390/a15050168 · Cited by 5
Babaev, D. S., Kutumova, E. O., & Kolpakov, F. (2025) · Frontiers in Systems Biology · doi:10.3389/fsysb.2025.1504077 · Cited by 5
Multi-parameter identification from scalar time series generated by a Malkus-Lorenz water wheel
Illing, L., Saunders, A. M., & Hahs, D. W. (2012) · Chaos An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/1.3689441 · Cited by 5
Biological Foundations of Signal Transduction, Systems Biology and Aberrations in Disease
Klingmüller, U., Schilling, M., Depner, S., & D’Alessandro, L. A. (2013) · Elsevier eBooks · doi:10.1016/b978-0-12-405926-9.00004-6 · Cited by 4
Self-citationIdentifiability of Patient Effort Respiratory Mechanics Model
Chee, J. Z., Chiew, Y. S., Tan, C. P., & Arunachalam, G. (2018) · IEEE-EMBS Conference on Biomedical Engineering and Sciences · doi:10.1109/iecbes.2018.8626625 · Cited by 4
Lam, N. N., Murray, R., & Docherty, P. D. (2024) · Bulletin of Mathematical Biology · doi:10.1007/s11538-024-01304-1 · Cited by 4
Identifying Bayesian optimal experiments for uncertain biochemical pathway models
Isenberg, N. M., Mertins, S. D., Yoon, B.-J., Reyes, K. G., & Urban, N. M. (2024) · Scientific Reports · doi:10.1038/s41598-024-65196-w · Cited by 6
Kim, J. H., & Lee, J. M. (2018) · Bioprocess and Biosystems Engineering · doi:10.1007/s00449-018-1999-8 · Cited by 3
Derivation and identification of a mechanistic model for a branched enzyme‐catalyzed carboligation
Ohs, R., Fischer, K., Schöpping, M., & Spieß, A. C. (2019) · Biotechnology Progress · doi:10.1002/btpr.2868 · Cited by 3
The Identifiability of Mathematical Models in Epidemiology: Tuberculosis, HIV, COVID-19
Игоревна, К. О., Kabanikhin, S. I., & Petrakova, V. (2023) · Mathematical Biology and Bioinformatics · doi:10.17537/2023.18.177 · Cited by 3
Mostofinejad, A., Romero, D. A., Brinson, D., Waddell, T. K., Karoubi, G., & Amon, C. H. (2025) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1013407 · Cited by 2
Quantitative Modeling of IgG N-Glycosylation Profiles from Population Data
Kutumova, E. O., Mandrik, N., Sharipov, R., Pučić‐Baković, M., Rapčan, B., Aulchenko, Y. S., Lauc, G., & Kolpakov, F. (2025) · International Journal of Molecular Sciences · doi:10.3390/ijms262311495 · Cited by 2
Metadata
- Authors
- Raue, A., Becker, V., Klingmüller, U., & Timmer, J.
- Affiliations
- University of Freiburg (DE)
- German Cancer Research Center (DE)
- Venue
- Chaos: An Interdisciplinary Journal of Nonlinear Science
- Publisher
- AIP Publishing
- Published
- 2010-12-01
- Volume
- 20
- Issue
- 4
- Pages
- 045105-045105
- ISSN
- 1054-1500 (ISSN-L)
- 1089-7682
- OpenAlex
- W2059246518
- Semantic Scholar
- 1f4f9ade3c0c46b90c7e40870044573fead3b29e
- Cited by
- 137
- References
- 15
- Citations by year
- 2026: 8 · 2025: 9 · 2024: 8 · 2023: 7 · 2022: 7 · 2021: 5 · 2020: 8 · 2019: 10 · 2018: 10 · 2017: 3 · 2016: 9 · 2015: 10 · 2014: 17 · 2013: 12 · 2012: 9
- FWCI
- 3.39
- Type
- journal article
- Language
- en
- Open access
- green
- zenodo.org
- Licence
- other-oa
- Locations
- Chaos An Interdisciplinary Journal of Nonlinear Science (publishedVersion)
- PubMed (publishedVersion)
- OPUS (Augsburg University) (submittedVersion)
- Zenodo (CERN European Organization for Nuclear Research) (submittedVersion, other-oa)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene Regulatory Network Analysis
- Physical Sciences › Engineering › Control and Systems Engineering › Control Systems and Identification
- Social Sciences › Decision Sciences › Management Science and Operations Research › Optimal Experimental Design Methods
- Keywords
- parameter identifiability, non-identifiability, observability, nonlinear dynamic model, experimental design, parameter estimation, systems biology, cellular processes
- MeSH terms
- Computer Simulation, Erythropoietin, Ligands, Models, Biological, Research Design, Confidence Intervals, Receptors, Erythropoietin, Nonlinear Dynamics, Intracellular Space
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-05, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-05 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.