Identifiability and observability analysis for experimental design in nonlinear dynamical models
Open accessThe DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index; none of the 1 sources its claims cite is checked for support yet.
Abstract
Dynamical models of cellular processes promise to yield new insights into the underlying systems and their biological interpretation. The processes are usually nonlinear, high dimensional, and time-resolved experimental data of the processes are sparse. Therefore, parameter estimation faces the challenges of structural and practical nonidentifiability. Nonidentifiability of parameters induces nonobservability of trajectories, reducing the predictive power of the model. We will discuss a generic approach for nonlinear models that allows for identifiability and observability analysis by means of a realistic example from systems biology. The results will be utilized to design new experiments that enhance model predictiveness, illustrating the iterative cycle between modeling and experimentation in systems biology.
Overview
CoChat Summary
TL;DR
The paper presents profile-likelihood-based identifiability and observability analysis for nonlinear ODE models and applies it to an Epo/EpoR trafficking model to guide experimental design. It shows structural and practical nonidentifiability can be resolved by adding absolute-concentration information and intracellular Epo measurements, yielding a fully identifiable model.
Key findings
- In the initial setup with 16 data points and 10 free parameters, the objective function was χ²=6.55; profile likelihood identified Bmax, Epo0, kD, kon, and scale as structurally nonidentifiable, linked by functional relations.
- Adding prior information on initial Epo concentration, Epo0 ~ N(2100, 210²) pM, resolved the structural nonidentifiability, but kex remained practically nonidentifiable; its upper confidence bound was determined at θ+ = −2.230 and its lower bound was not feasible.
- Adding intracellular 125I-Epo measurements (y3) resolved the practical nonidentifiability of kex; all parameters became structurally and practically identifiable, with finite 95% confidence intervals reported in Table I.
- A simulation study with 450 datasets showed the overfitting distribution was in line with χ²_df with df=10; parameter coverage rates were expected between 93.33% and 96.66% and the paper states all parameters fulfilled this, though trajectory coverage was too low for Epo at t=20 min, Epo_EpoR at t=300 min, and Epo_EpoR_i between 150 and 250 min.
Methods
- An ODE model of Epo/EpoR binding and trafficking with six species and mass-action kinetics; observation functions were y1=scale·([Epo]+[dEpo_e]), y2=scale·[Epo_EpoR], and later y3=scale·([Epo_EpoR_i]+[dEpo_i]).
- Parameters were estimated by minimizing the weighted sum of squared residuals (χ²) using CVODES and MATLAB lsqnonlin; profile likelihood was computed for each parameter to assess structural/practical identifiability and observability.
- Data came from BaF3-EpoR cells with 125I-Epo in triplicates, initially measuring extracellular and bound Epo and later intracellular Epo; cells were treated with 2100 ± 210 pM 125I-Epo, and a simulation study generated 450 independent datasets.
Limitations
- Stated: trajectory confidence bands had too-low coverage for Epo at t=20 min, Epo_EpoR at t=300 min, and Epo_EpoR_i between 150 and 250 min; this was attributed to approximating the high-dimensional confidence region by profile likelihood rather than dense sampling.
- Stated: for nonlinear models and small samples, the distribution of χ²(θ*)−χ²(θ̂) may differ from χ²_df; it should be verified by simulation studies, and the threshold adjusted if deviations are observed.
- Evident: the analysis is demonstrated on a single Epo/EpoR case study, so generalizability to other nonlinear dynamical models is not empirically established; also, Table I lists Epo0 CR 92.44% and Scale 92.89%, below the stated expected lower bound of 93.33%, despite the text saying all parameters fulfilled the expected range.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 Valid · 0 Not valid · 1 Not checked · 20 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Nevertheless, the parameter kex re-mains practically nonidentifiable.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The results of the analysis were used to plan additional experiments to resolve nonidentifiabilities in-herent in the initial data set.”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Based on an initial data set, parameter identifiability and observ-ability was successively improved by applying the profile likelihood approach.”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The flatness of the profile likelihood reveals that param-eters Bmax, Epo0, kD, kon, and scale are structurally noniden-tifiable.”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Furthermore, the amplitude of vari-ability of the trajectories at these spots allows to assess the necessary measurement precision to provide adequate data.”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
8 more claims
Create a free account to see all 21 claims and to verify the 1 reference still open.
- It may state two separate claims as one. 7
- The quote only partly states this claim. 1
- Probably not a substantial claim. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“All parameters are positive by definition, hence the logarithmic space yields a flat metric [19].”
From Joining forces of Bayesian and frequentist methodology: a study for inference in the presence of non-identifiability (2013) · cites this paper as [19]
Experimental — accuracy not yet measured
Citations
Cites
Savitzky-Golay Smoothing Filters
Press, W. H., & Teukolsky, S. A. (1990) · Computers in Physics · doi:10.1063/1.4822961 · Cited by 11,670
Press, W. H., Teukolsky, S. L. A., Flannery, B. P., & Vetterling, W. T. (1990) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 6,980
Ziegel, E. R., Lehmann, E. L., & Casella, G. (1999) · Technometrics · doi:10.2307/1270597 · Cited by 4,203
An Interior Trust Region Approach for Nonlinear Minimization Subject to Bounds
Coleman, T. F., & Li, Y. (1996) · SIAM Journal on Optimization · doi:10.1137/0806023 · Cited by 3,320
SUNDIALS: Suite of nonlinear and differential/algebraic equation solvers
Hindmarsh, A. C., Brown, P. N., Grant, K. E., Lee, S. L., Serban, R., Shumaker, D. E., & Woodward, C. S. (2005) · ACM Transactions on Mathematical Software · doi:10.1145/1089014.1089020 · Cited by 2,556
Raue, A., Kreutz, C., Maiwald, T., Bachmann, J., Schilling, M., Klingmüller, U., & Timmer, J. (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp358 · Cited by 1,442
Self-citationMurphy, S. A., & Van Der Vaart, A. W. (2000) · Journal of the American Statistical Association · doi:10.1080/01621459.2000.10474219 · Cited by 712
A method for computing profile-likelihood-based confidence intervals
Venzon, D. J., & Moolgavkar, S. H. (1988) · Applied Statistics · doi:10.2307/2347496 · Cited by 565
Swameye, I., Müller, T. G., Timmer, J., Sandra, O., & Klingmüller, U. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0237333100 · Cited by 316
Self-citationTeaching about Approximate Confidence Regions Based on Maximum Likelihood Estimation
Meeker, W. Q., & Escobar, L. A. (1995) · The American Statistician · doi:10.1080/00031305.1995.10476112 · Cited by 279
Research works printed but not linked: 1
- 2003, Nonlinear Regression
Cited by
Items 101–146 of 146
Corbin, S. F., & Davis, T. J. (2022) · The European Physical Journal Special Topics · doi:10.1140/epjs/s11734-022-00745-w · Cited by 2
Sharma, S., Gowda, P., Lathoria, K., Mitra, M. K., & Sen, E. (2023) · Integrative Biology · doi:10.1093/intbio/zyad008 · Cited by 2
Modeling the Differential Effect of CYP2C9 Gene Alleles on Losartan Metabolism
Babaev, D. S., Kutumova, E. O., & Kolpakov, F. (2024) · Mathematical Biology and Bioinformatics · doi:10.17537/2024.19.533 · Cited by 2
Guseo, R., & Mortarino, C. (2014) · Computational Statistics · doi:10.1007/s00180-014-0509-y · Cited by 2
Structural identifiability of large systems biology models
Joubert, D. (2020) · doi:10.18174/507603 · Cited by 2
A quantitative study of the metastatic process through mathematical modeling
Baratchart, E. (2016) · theses.fr (ABES) · doi:10.70675/87a47450z561az450czbeb4z7ed784f6f35e · Cited by 5
Efficient data collection for establishing practical identifiability via active learning
Liu, X., Wanika, L., Chappell, M. J., & Branke, J. (2025) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2025.10.058 · Cited by 1
Lagunes, M.-J., Marques, G. M., Salas-Acosta, E. R., Vásquez‐Elizondo, R. M., Thibaut, T., Robledo, D., Connan, S., Stiger‐Pouvreau, V., Berline, L., Lett, C., et al. (2026) · Ecological Modelling · doi:10.1016/j.ecolmodel.2026.111578 · Cited by 1
A unified model for radial voidage in randomly packed beds of spherical pellets
Díaz-Ulloa, P., & Cornejo, I. (2026) · Powder Technology · doi:10.1016/j.powtec.2026.122840 · Cited by 1
How to build Dynamic Energy Budget models: Practical guidelines for model development
Oliveira, D. F., Sulc, A., Moan, E. L., Donati, E., Klagkou, E., Lagunes, M.-J., Dajčman, U., & Yeuw, T. T. (2026) · Ecological Modelling · doi:10.1016/j.ecolmodel.2026.111703 · Cited by 2
Identifiability Analysis of Wall Decay Coefficients in Water Distribution Water Quality Model
Pasha, M. F. K. (2013) · World Environmental and Water Resources Congress (EWRI) · doi:10.1061/9780784412947.072 · Cited by 1
Structured Models and Their Use in Modeling Anticancer Therapies
Świerniak, A., Kimmel, M., Śmieja, J., Puszyński, K., & Psiuk-Maksymowicz, K. (2016) · Springer eBooks · doi:10.1007/978-3-319-28095-0_4 · Cited by 1
A systems toxicology paracetamol overdose framework: accounting for high-risk individuals
Mason, C. L., Leedale, J., Tasoulis, S. K., Jarman, I. H., & Webb, S. D. (2019) · Computational Toxicology · doi:10.1016/j.comtox.2019.100103 · Cited by 1
Chancen und Grenzen mathematischer Modelle in der Pandemiebewältigung
Meyer‐Hermann, M. (2022) · Springer eBooks · doi:10.1007/978-3-662-65688-4_4 · Cited by 1
Connecting sensitivity, identifiability and interpretability of a glucose minimal model
Lema-Pérez, L., Aguirre-Zapata, E., Fougner, A. L., Amicarelli, A., & Álvarez, H. (2023) · Workshop on Information Processing and Control · doi:10.1109/rpic59053.2023.10530857 · Cited by 1
Kinetic Models in Life Science — Contributions to Methods and Applications
Almquist, J. O. (2017) · Chalmers Publication Library (Chalmers University of Technology) · Cited by 4
Hauer, S. (2020) · reposiTUm (TU Wien) · doi:10.34726/hss.2020.80661 · Cited by 1
Pollution source identification and adequate design of a monitoring network in estuaries
Zeunert, S. (2021) · Digitale Bibliothek Braunschweig (Verbundzentrale Göttingen (VZG)) · doi:10.24355/dbbs.084-202103081432-0 · Cited by 1
Model Identification by Utilizing Likelihood‐Based Methods
Raue, A., & Timmer, J. (2011) · Wiley eBooks · doi:10.1002/9781119970606.ch20
Self-citationWojdyła, T., Glaubach, T., Corey, S. J., & Kimmel, M. (2014) · IFAC Proceedings Volumes · doi:10.3182/20140824-6-za-1003.02095
Golfar, B. (2014) · QSpace (Queen's University Library)
Covariance Update in Data Assimilation for State and Parameter Estimation
Hernandez, Y. C. (2015) · Cited by 1
Pasha, M. F. K., & Rentch, J. W. (2015) · World Environmental and Water Resources Congress (EWRI) · doi:10.1061/9780784479162.066
Applications in Cancer Research: Mathematical Models of Apoptosis
Kallenberger, S. M., Legewie, S., & Eils, R. (2013) · Elsevier eBooks · doi:10.1016/b978-0-12-405926-9.00019-8
Parameterschätzung und Modellevaluation für komplexe Systeme
Schumann-Bischoff, J. (2016) · eDiss (Georg-August-Universität Göttingen) · doi:10.53846/goediss-5905
Kazeroonian, A. (2018) · mediaTUM – the media and publications repository of the Technical University Munich (Technical University Munich)
Re, A., & Lecca, P. (2019) · IEEE Conference on Computational Intelligence in Bioinformatics and Computational Biology (CIBCB) · doi:10.1109/cibcb.2019.8791488
A systems toxicology framework for improving the identification of paracetamol overdose
Mason, C. L. (2019) · Liverpool John Moores University · doi:10.24377/ljmu.t.00011763
Editorial: Seismic Analysis and Retrofitting of Historical Buildings
Formisano, A., & D’Amato, M. (2020) · Frontiers in Built Environment · doi:10.3389/fbuil.2020.00096
Jeen, J. L. T., Shiong, C. Y., & Arunachalam, G. (2021) · World Congress on Medical Physics and Biomedical Engineering, September 7 - 12, 2009, Munich, Germany · doi:10.1007/978-3-030-65092-6_1
Structural and Practical Identifiability Analysis
Raue, A., & Timmer, J. (2013) · Springer eBooks · doi:10.1007/978-1-4419-9863-7_1219
Self-citationSimon, T. W., Ginsburg, B. C., Javors, M. A., Hill‐Kapturczak, N., Lopez‐Cruzan, M., Stark, H. G., Dougherty, D. M., & Roache, J. D. (2025) · Chemico-Biological Interactions · doi:10.1016/j.cbi.2025.111414
On Structural Identifiability of Decentralised SystemsPreprint
Karabutov, N. N. (2025) · Preprints.org · doi:10.20944/preprints202502.1380.v1
Babaev, D. S., Kutumova, E. O., & Kolpakov, F. (2025) · Pharmaceutics · doi:10.3390/pharmaceutics17070935
Optimization Approach to the Problem of SD-WAN Channel Selection
Borisov, A. V., Semenikhin, K. V., Smelyanskiy, R. L., & Stepanov, E. P. (2025) · Communications in computer and information science · doi:10.1007/978-3-032-04758-8_9
Simulation and modeling of metabolic networks
Klipp, E. (2025) · Elsevier eBooks · doi:10.1016/b978-0-323-99507-8.00008-1
A minimal activator-inhibitor-repressor model of the hepatic circadian clock
Delpierre, P., & Lefranc, M. (2026) · Biophysical Journal · doi:10.1016/j.bpj.2026.01.024 · Cited by 1
In silico modeling of anterior foregut endoderm differentiation towards lung epithelial progenitors
Mostofinejad, A., Romero, D. A., Brinson, D., Waddell, T. K., Karoubi, G., & Amon, C. H. (2026) · npj Systems Biology and Applications · doi:10.1038/s41540-026-00650-1
Dynamic modelling and evaluation of preclinical trials in acute leukaemiaPreprint
Wäsche, J., Ludwig, R., Jeremias, I., & Fuchs, C. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2601.22971
Erythroid differentiation in vitro under the lens of mathematical modelling
Duchesne, R. (2019) · theses.fr (ABES) · doi:10.70675/ff05850fzb60bz4e5fza98cz6059b1f59210
Frédérique, R. (2019) · theses.fr (ABES) · doi:10.70675/04ae36b0zbde1z4458z8c5bz91a9b55ac585
Balancing label resolution and computational cost in dynamical models of lipid metabolismPreprint
Jost, P. J., Thiele, C., & Hasenauer, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.13620
Zhang, S. (2026) · Advances in Differential Equations and Control Processes · doi:10.59400/adecp4304
Chahine, K., Kanj, H., Khaled, M., & Noura, H. (2026) · Energy and AI · doi:10.1016/j.egyai.2026.100937
Metadata
- Authors
- Raue, A., Becker, V., Klingmüller, U., & Timmer, J.
- Affiliations
- University of Freiburg (DE)
- German Cancer Research Center (DE)
- Venue
- Chaos: An Interdisciplinary Journal of Nonlinear Science
- Publisher
- AIP Publishing
- Published
- 2010-12-01
- Volume
- 20
- Issue
- 4
- Pages
- 045105-045105
- ISSN
- 1054-1500 (ISSN-L)
- 1089-7682
- OpenAlex
- W2059246518
- Semantic Scholar
- 1f4f9ade3c0c46b90c7e40870044573fead3b29e
- Cited by
- 137
- References
- 15
- Citations by year
- 2026: 8 · 2025: 9 · 2024: 8 · 2023: 7 · 2022: 7 · 2021: 5 · 2020: 8 · 2019: 10 · 2018: 10 · 2017: 3 · 2016: 9 · 2015: 10 · 2014: 17 · 2013: 12 · 2012: 9
- FWCI
- 3.39
- Type
- journal article
- Language
- en
- Open access
- green
- zenodo.org
- Licence
- other-oa
- Locations
- Chaos An Interdisciplinary Journal of Nonlinear Science (publishedVersion)
- PubMed (publishedVersion)
- OPUS (Augsburg University) (submittedVersion)
- Zenodo (CERN European Organization for Nuclear Research) (submittedVersion, other-oa)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene Regulatory Network Analysis
- Physical Sciences › Engineering › Control and Systems Engineering › Control Systems and Identification
- Social Sciences › Decision Sciences › Management Science and Operations Research › Optimal Experimental Design Methods
- Keywords
- parameter identifiability, non-identifiability, observability, nonlinear dynamic model, experimental design, parameter estimation, systems biology, cellular processes
- MeSH terms
- Computer Simulation, Erythropoietin, Ligands, Models, Biological, Research Design, Confidence Intervals, Receptors, Erythropoietin, Nonlinear Dynamics, Intracellular Space
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-05, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-05 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.