The DOI matches its Crossref record; 76 of the 76 references it cites were found in a registry or an index.
On structural and practical identifiability
Open accessAbstract
We discuss issues of structural and practical identifiability of partially observed differential equations, which are often applied in systems biology. The development of mathematical methods to investigate structural nonidentifiability has a long tradition. Computationally efficient methods to detect and cure it have been developed recently. Practical nonidentifiability, on the other hand, has not been investigated at the same conceptually clear level. We argue that practical identifiability is more challenging than structural identifiability when it comes to modeling experimental data. We discuss that the classical approach based on the Fisher information matrix has severe shortcomings. As an alternative, we propose using the profile likelihood, which is a powerful approach to detect and resolve practical nonidentifiability.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Robustness in the Strategy of Scientific Model Building
Box, G. E. P. (1979) · Robustness in Statistics · doi:10.1016/b978-0-12-438150-6.50018-2 · Cited by 1,562
Raue, A., Kreutz, C., Maiwald, T., Bachmann, J., Schilling, M., Klingmüller, U., & Timmer, J. (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp358 · Cited by 1,442
Self-citationOn the general theory of control systems
Kalman, R. E. (1960) · IFAC Proceedings Volumes · doi:10.1016/s1474-6670(17)70094-8 · Cited by 1,222
Identification of parametric models : from experimental data
Walter, É., & Pronzato, L. (1997) · Cited by 1,197
Sachs, L. (1984) · Springer Series in Statistics · doi:10.1007/978-1-4612-5246-7 · Cited by 973
Bellman, R., & Åström, K. J. (1970) · Mathematical Biosciences · doi:10.1016/0025-5564(70)90132-x · Cited by 871
Fundamental properties of unperturbed haematopoiesis from stem cells in vivo
Busch, K., Klapproth, K., Barile, M., Flossdorf, M., Holland-Letz, T., Schlenner, S. M., Reth, M., Höfer, T., & Rodewald, H.-R. (2015) · Nature · doi:10.1038/nature14242 · Cited by 769
Murphy, S. A., & Van Der Vaart, A. W. (2000) · Journal of the American Statistical Association · doi:10.1080/01621459.2000.10474219 · Cited by 712
On global identifiability for arbitrary model parametrizations
Ljung, L., & Glad, T. (1994) · Automatica · doi:10.1016/0005-1098(94)90029-9 · Cited by 643
On Identifiability of Nonlinear ODE Models and Applications in Viral Dynamics
Miao, H., Xia, X., Perelson, A. S., & Wu, H. (2011) · SIAM Review · doi:10.1137/090757009 · Cited by 610
(1979) · Elsevier eBooks · doi:10.1016/c2013-0-11050-1 · Cited by 454
DAISY: A new software tool to test global identifiability of biological and physiological systems
Bellu, G., Saccomani, M. P., Audoly, S., & D’Angiò, L. (2007) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2007.07.002 · Cited by 452
Structural identifiability of systems biology models: a critical comparison of methods
Chis, O.-T., Banga, J. R., & Balsa-Canto, E. (2011) · PLoS ONE · doi:10.1371/journal.pone.0027755 · Cited by 448 · cited 1×
“For reviews of some of these approaches, see [28, 30, 31].”
BackgroundSystem identifiability based on the power series expansion of the solution
Pohjanpalo, H. (1978) · Mathematical Biosciences · doi:10.1016/0025-5564(78)90063-9 · Cited by 440
On the general theory of control systems
Kalman, R. (1959) · IRE Transactions on Automatic Control · doi:10.1109/tac.1959.1104873 · Cited by 392
Sensitivity analysis approaches applied to systems biology models
Zi, Z. (2011) · IET Systems Biology · doi:10.1049/iet-syb.2011.0015 · Cited by 384
The use of likelihood-based confidence intervals in genetic models
Neale, M. C., & Miller, M. B. (1997) · Behavior Genetics · doi:10.1023/a:1025681223921 · Cited by 310
Holmberg, A. (1982) · Mathematical Biosciences · doi:10.1016/0025-5564(82)90061-x · Cited by 288
Parameter identifiability of nonlinear systems: the role of initial conditions
Pia Saccomani, M., Audoly, S., & D'Angiò, L. (2003) · Automatica · doi:10.1016/s0005-1098(02)00302-3 · Cited by 230
Exploiting the bootstrap method for quantifying parameter confidence intervals in dynamical systems
Joshi, M., Seidel-Morgenstern, A., & Kremling, A. (2006) · Metabolic Engineering · doi:10.1016/j.ymben.2006.04.003 · Cited by 190
A Probabilistic Algorithm to Test Local Algebraic Observability in Polynomial Time
Sedoglavic, A. (2002) · Journal of Symbolic Computation · doi:10.1006/jsco.2002.0532 · Cited by 187
Global approaches to identifiability testing for linear and nonlinear state space models
Walter, E., & Lecourtier, Y. (1982) · Mathematics and Computers in Simulation · doi:10.1016/0378-4754(82)90645-0 · Cited by 184
Comparison of approaches for parameter identifiability analysis of biological systems
Raue, A., Karlsson, J., Saccomani, M. P., Jirstrand, M., & Timmer, J. (2014) · Bioinformatics · doi:10.1093/bioinformatics/btu006 · Cited by 180
Self-citationObservability and Structural Identifiability of Nonlinear Biological Systems
Villaverde, A. F. (2019) · Complexity · doi:10.1155/2019/8497093 · Cited by 176
Determination of parameter identifiability in nonlinear biophysical models: A Bayesian approach
Hines, K. E., Middendorf, T. R., & Aldrich, R. W. (2014) · Journal of General Physiology · doi:10.1085/jgp.201311116 · Cited by 170
An Efficient Method for Structural Identifiability Analysis of Large Dynamic Systems
Karlsson, J., Anguelova, M., & Jirstrand, M. (2012) · IFAC Proceedings Volumes · doi:10.3182/20120711-3-be-2027.00381 · Cited by 166
Data-based identifiability analysis of non-linear dynamical models
Hengl, S., Kreutz, C., Timmer, J., & Maiwald, T. (2007) · Bioinformatics · doi:10.1093/bioinformatics/btm382 · Cited by 166
Self-citationChappell, M. J., Godfrey, K. R., & Vajda, S. (1990) · Mathematical Biosciences · doi:10.1016/0025-5564(90)90055-4 · Cited by 163
Covering a Broad Dynamic Range: Information Processing at the Erythropoietin Receptor
Becker, V., Schilling, M., Bachmann, J., Baumann, U., Raue, A., Maiwald, T., Timmer, J., & Klingmüller, U. (2010) · Science · doi:10.1126/science.1184913 · Cited by 159
Self-citationOptogenetic control of gene expression in plants in the presence of ambient white light
Ochoa‐Fernandez, R., Abel, N. B., Wieland, F.-G., Schlegel, J., Koch, L., Miller, J. B., Engesser, R., Giuriani, G., Brandl, S. M., Timmer, J., et al. (2020) · Nature Methods · doi:10.1038/s41592-020-0868-y · Cited by 148
Self-citationMeshkat, N., Kuo, C. E.-Z., & DiStefano, J. J. (2014) · PLoS ONE · doi:10.1371/journal.pone.0110261 · Cited by 141
GenSSI 2.0: multi-experiment structural identifiability analysis of SBML models
Ligon, T. S., Fröhlich, F., Chis, O., Banga, J. R., Balsa‐Canto, E., & Hasenauer, J. (2017) · Bioinformatics · doi:10.1093/bioinformatics/btx735 · Cited by 139
Identifiability and observability analysis for experimental design in nonlinear dynamical models
Raue, A., Becker, V., Klingmüller, U., & Timmer, J. (2010) · Chaos: An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/1.3528102 · Cited by 137
Self-citationLikelihood based observability analysis and confidence intervals for predictions of dynamic models
Kreutz, C., Raue, A., & Timmer, J. (2012) · BMC Systems Biology · doi:10.1186/1752-0509-6-120 · Cited by 134
Self-citationVillaverde, A. F., Tsiantis, N., & Banga, J. R. (2019) · Journal of The Royal Society Interface · doi:10.1098/rsif.2019.0043 · Cited by 130
SIAN: software for structural identifiability analysis of ODE models
Hong, H., Ovchinnikov, A., Pogudin, G., & Yap, C. K. (2018) · Bioinformatics · doi:10.1093/bioinformatics/bty1069 · Cited by 127
Schneider, N., Wieland, F.-G., Kong, D., Fischer, A., Hörner, M., Timmer, J., Ye, H., & Weber, W. (2021) · Science Advances · doi:10.1126/sciadv.abd3568 · Cited by 125
Self-citationGlobal Identifiability of Differential Models
Hong, H., Ovchinnikov, A., Pogudin, G., & Yap, C. (2020) · Communications on Pure and Applied Mathematics · doi:10.1002/cpa.21921 · Cited by 122
Raue, A., Kreutz, C., Theis, F. J., & Timmer, J. (2013) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2011.0544 · Cited by 119 · cited 2×
“Given a structurally identifiable model, MCMC sampling yields similar results as the profile likelihood analysis [38].”
BackgroundResultSelf-citationPractical parameter identifiability for spatio-temporal models of cell invasion
Simpson, M. J., Baker, R. E., Vittadello, S. T., & Maclaren, O. J. (2020) · Journal of The Royal Society Interface · doi:10.1098/rsif.2020.0055 · Cited by 104
Driving the Model to Its Limit: Profile Likelihood Based Model Reduction
Maiwald, T., Hass, H., Steiert, B., Vanlier, J., Engesser, R., Raue, A., Kipkeew, F., Bock, H. H., Kaschek, D., Kreutz, C., et al. (2016) · PLoS ONE · doi:10.1371/journal.pone.0162366 · Cited by 103
Self-citationPractical identifiability of growth and substrate consumption models
Nihtilä, M. T., & Virkkunen, J. (1977) · Biotechnology and Bioengineering · doi:10.1002/bit.260191208 · Cited by 101
Raue, A., Kreutz, C., Theis, F. J., & Timmer, J. (2016) · Cited by 101
Self-citationMCMC Can Detect Nonidentifiable Models
Siekmann, I., Sneyd, J., & Crampin, E. J. (2012) · Biophysical Journal · doi:10.1016/j.bpj.2012.10.024 · Cited by 90
A priori identifiability: An overview on definitions and approaches
Anstett-Collin, F., Denis-Vidal, L., & Millérioux, G. (2020) · Annual Reviews in Control · doi:10.1016/j.arcontrol.2020.10.006 · Cited by 75
Input-Dependent Structural Identifiability of Nonlinear Systems
Villaverde, A. F., Evans, N. D., Chappell, M. J., & Banga, J. R. (2018) · IEEE Control Systems Letters · doi:10.1109/lcsys.2018.2868608 · Cited by 68
Experimental Design for Parameter Estimation of Gene Regulatory Networks
Steiert, B., Raue, A., Timmer, J., & Kreutz, C. (2012) · PLoS ONE · doi:10.1371/journal.pone.0040052 · Cited by 67
Self-citationCucurull‐Sanchez, L., Chappell, M. J., Chelliah, V., Amy Cheung, S. Y., Derks, G., Penney, M., Phipps, A., Malik‐Sheriff, R. S., Timmis, J., Tindall, M. J., et al. (2019) · CPT: Pharmacometrics & Systems Pharmacology · doi:10.1002/psp4.12381 · Cited by 61 · cited 1×
“mixed effects models [73, 74], is of interest.”
Muñoz-Tamayo, R., Puillet, L., Daniel, J. B., Sauvant, D., Martin, O., Taghipoor, M., & Blavy, P. (2018) · animal · doi:10.1017/s1751731117002774 · Cited by 56
Higher-order Lie symmetries in identifiability and predictability analysis of dynamic models
Merkt, B., Timmer, J., & Kaschek, D. (2015) · Physical Review E · doi:10.1103/physreve.92.012920 · Cited by 56
Self-citationAn easy and efficient approach for testing identifiability
Kreutz, C. (2018) · Bioinformatics · doi:10.1093/bioinformatics/bty035 · Cited by 46
Zuo, Y., Sarkar, S., Corwin, M. T., Olson, K., Badawi, R. D., & Wang, G. (2019) · Physics in Medicine and Biology · doi:10.1088/1361-6560/ab1f29 · Cited by 44
Practical identifiability analysis of a minimal cardiovascular system model
Pironet, A., Docherty, P. D., Dauby, P. C., Chase, J. G., & Desaive, T. (2017) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2017.01.005 · Cited by 42
A Unified Model for Inclusive Inheritance in Livestock Species
David, I., & Ricard, A. (2019) · Genetics · doi:10.1534/genetics.119.302375 · Cited by 39
Structural identifiability analysis via symmetries of differential equations
Yates, J. W. T., Evans, N. D., & Chappell, M. J. (2009) · Automatica · doi:10.1016/j.automatica.2009.07.009 · Cited by 37
Massonis, G., & Villaverde, A. F. (2020) · Symmetry · doi:10.3390/sym12030469 · Cited by 36
Johnson, K. E., Howard, G. R., Morgan, D., Brenner, E. A., Gardner, A. L., Durrett, R., Mo, W., Al’Khafaji, A. M., Sontag, E. D., Jarrett, A. M., et al. (2020) · Physical Biology · doi:10.1088/1478-3975/abb09c · Cited by 35
Profile likelihood-based analyses of infectious disease models
Tönsing, C., Timmer, J., & Kreutz, C. (2018) · Statistical Methods in Medical Research · doi:10.1177/0962280217746444 · Cited by 32
Self-citationSaccomani, M. P., & Thomaseth, K. (2018) · Complexity · doi:10.1155/2018/2380650 · Cited by 31
Parameter estimation for externally simulated thermal network models
Brastein, O. M., Lie, B., Sharma, R. K., & Skeie, N. (2019) · Energy and Buildings · doi:10.1016/j.enbuild.2019.03.018 · Cited by 30
Parallel Tempering with Lasso for model reduction in systems biology
Gupta, S., Lee, R., & Faeder, J. R. (2020) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1007669 · Cited by 29
Rateitschak, K., Winter, F., Lange, F., Jaster, R., & Wolkenhauer, O. (2012) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002815 · Cited by 23
Three novel approaches to structural identifiability analysis in mixed-effects models
Janzén, D. L. I., Jirstrand, M., Chappell, M. J., & Evans, N. D. (2019) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2016.04.024 · Cited by 21
Prediction Uncertainty Estimation Despite Unidentifiability: An Overview of Recent Developments
Cedersund, G. (2015) · Studies in mechanobiology, tissue engineering and biomaterials · doi:10.1007/978-3-319-21296-8_17 · Cited by 20
Tivay, A., Jin, X., Lo, A. K.-Y., Scully, C. G., & Hahn, J. (2020) · Frontiers in Physiology · doi:10.3389/fphys.2020.00452 · Cited by 20
Optimally Designed Model Selection for Synthetic Biology
Bandiera, L., Gomez-Cabeza, D., Gilman, J., Balsa‐Canto, E., & Menolascina, F. (2020) · ACS Synthetic Biology · doi:10.1021/acssynbio.0c00393 · Cited by 20
He, Q., & Wang, J. (2020) · Processes · doi:10.3390/pr8080951 · Cited by 18
Zhou, W., Huang, R., Liu, K., & Zhang, W. (2020) · International Journal of Energy Research · doi:10.1002/er.5118 · Cited by 17
Duchesne, R., Guillemin, A., Crauste, F., & Gandrillon, O. (2019) · In Silico Biology · doi:10.3233/isb-190471 · Cited by 16
Local Identifiability Analysis of NonLinear ODE Models: How to Determine All Candidate Solutions
Thomaseth, K., & Saccomani, M. P. (2018) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2018.03.089 · Cited by 15
Identifiability of a Binomial Synapse
Gontier, C., & Pfister, J.-P. (2020) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2020.558477 · Cited by 15
Assessment of the parameter identifiability of population balance models for air jet mills
Bhonsale, S. S., Stokbroekx, B., & van Impe, J. F. M. (2020) · Computers & Chemical Engineering · doi:10.1016/j.compchemeng.2020.107056 · Cited by 14
Identifiability and experimental design in perturbation studies
Gross, T., & Blüthgen, N. (2020) · Bioinformatics · doi:10.1093/bioinformatics/btaa404 · Cited by 11
A Priori Parameter Identifiability in Complex Reaction Networks
Varghese, A., Narasimhan, S., & Bhatt, N. (2018) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2018.09.162 · Cited by 6
Experimental design for parameter estimation in steady-state linear models of metabolic networks
Frøysa, H. G., Skaug, H. J., & Alendal, G. (2019) · Mathematical Biosciences · doi:10.1016/j.mbs.2019.108291 · Cited by 3
Schmitt, T., & Ritter, B. (2020) · Technischen Universität Darmstadt · doi:10.25534/tuprints-00011713 · Cited by 1
Cited by
A practical guide for the generation of model-based virtual clinical trials
Craig, M., Gevertz, J. L., Kareva, I., & Wilkie, K. P. (2023) · Frontiers in Systems Biology · doi:10.3389/fsysb.2023.1174647 · Cited by 52
Colebank, M. J., & Chesler, N. C. (2022) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1010017 · Cited by 24
Preston, S. P., Wilkinson, R. D., Clayton, R. H., Chappell, M. J., & Mirams, G. R. (2025) · Current Opinion in Systems Biology · doi:10.1016/j.coisb.2025.100563 · Cited by 11
“Profile (log)likelihood functions can be used to assess both structural and practical identifiability (Kreutz et al., 2013; Wieland et al., 2021) of an individual parameter θ i .”
(2025) · doi:10.1093/bioinformatics/btaf581 · Cited by 6
Ramírez Mazo, C., Gómez-Echavarría, L., Lema-Pérez, L., & Röblitz, S. (2026) · Journal of Theoretical Biology · doi:10.1016/j.jtbi.2026.112518
Metadata
- Authors
- Wieland, F.-G., Hauber, A. L., Rosenblatt, M., Tönsing, C., & Timmer, J.
- Venue
- Current Opinion in Systems Biology
- Publisher
- Elsevier BV
- Published
- 2021-03
- Volume
- 25
- Pages
- 60-69
- ISSN
- 2452-3100 (ISSN-L)
- OpenAlex
- W3126293391
- Cited by
- 325
- References
- 76
- FWCI
- 7.52
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.