Cited by 1,442Gene Regulatory Network AnalysisControl Systems and IdentificationMicrobial Metabolic Engineering and Bioproduction

The DOI matches its Crossref record; 28 of the 29 references it cites were found in a registry or an index; 1 of the 12 sources its claims cite were checked for support.

Structural and practical identifiability analysis of partially observed dynamical models by exploiting the profile likelihood

Open access

Abstract

MOTIVATION: Mathematical description of biological reaction networks by differential equations leads to large models whose parameters are calibrated in order to optimally explain experimental data. Often only parts of the model can be observed directly. Given a model that sufficiently describes the measured data, it is important to infer how well model parameters are determined by the amount and quality of experimental data. This knowledge is essential for further investigation of model predictions. For this reason a major topic in modeling is identifiability analysis. RESULTS: We suggest an approach that exploits the profile likelihood. It enables to detect structural non-identifiabilities, which manifest in functionally related model parameters. Furthermore, practical non-identifiabilities are detected, that might arise due to limited amount and quality of experimental data. Last but not least confidence intervals can be derived. The results are easy to interpret and can be used for experimental planning and for model reduction. AVAILABILITY: An implementation is freely available for MATLAB and the PottersWheel modeling toolbox at http://web.me.com/andreas.raue/profile/software.html. SUPPLEMENTARY INFORMATION: Supplementary data are available at Bioinformatics online.

Overview

AI snapshot

Written from the paper’s full text.

TL;DR

The paper presents a profile-likelihood method for assessing structural and practical identifiability in partially observed dynamical models and for deriving likelihood-based confidence intervals. Applied to a JAK-STAT signaling model, it identifies four structurally non-identifiable parameters and one practically non-identifiable parameter, and shows how additional measurements can resolve these ambiguities.

Key findings

  • Profile likelihood distinguishes structural non-identifiability, seen as a flat profile, from practical non-identifiability, seen as a profile with a minimum that fails to cross the confidence threshold in one or both directions; identifiable parameters cross the threshold on both sides.
  • In the JAK-STAT application, parameters p2, x1(0), s1, and s2 were structurally non-identifiable, with functional relations p2·x1(0)=const, s1·x1(0)=const, and s2·x1(0)=const; p3 was practically non-identifiable for increasing values.
  • Table 1 reports infinite likelihood-based intervals for the structurally non-identifiable parameters, whereas Hessian-based asymptotic intervals were finite but misleadingly narrow, e.g. p2: −33 to +31, x1(0): −31 to +32, s1: −32 to +31, s2: −32 to +31; for p3, the profile-likelihood interval was −1.14 to +∞ versus −1.14 to +0.15 from the Hessian.
  • Adding hypothetical measurements of x1(0)=200±20 nM and x3/(x2+x3)=0.90±0.05 at t=20 min made p2, x1(0), s1, and s2 structurally identifiable and p3 practically identifiable, while p2 remained practically non-identifiable. Profile-likelihood computation took 54±18 s per parameter on a 1 GHz CPU with 2 GB RAM.

Methods

  • The approach uses an ODE model with weighted least-squares objective χ², computes the profile likelihood for each parameter by re-optimizing all other parameters at fixed values of the target parameter, and derives likelihood-based confidence intervals from χ² thresholds.
  • The application is a JAK-STAT signaling model inspired by Swameye et al., calibrated to experimental data; observables are phosphorylated STAT in cytoplasm (y1) and total STAT in cytoplasm (y2) measured by quantitative western blotting, with cytoplasm and nucleus volumes of 1400 µm³ and 450 µm³.
  • Parameters calibrated include p1–p4, s1, s2, and x1(0), with x2(0)–x4(0) set to zero; the model was implemented and fitted with PottersWheel, and experimental planning and model reduction were explored via profile-likelihood trajectories, Monte Carlo simulations, and likelihood-ratio thresholds.

Limitations

  • The authors state that structural non-identifiability cannot be resolved by refining existing measurements or reducing noise; it requires a qualitatively new measurement that changes the observation mapping, such as observing additional species. Practical non-identifiability can be resolved by increasing the amount or quality of data and/or selecting better measurement time points.
  • The authors note that recovering functional relations unambiguously from parameter changes along the profile likelihood is only possible when the corresponding manifold is one-dimensional; higher-dimensional manifolds require further analysis, such as the approach of Hengl et al.
  • Evident from the text: the method is demonstrated on a single JAK-STAT model and dataset, with no broad empirical comparison across many model classes; the approach also assumes a sufficiently adequate model and normally distributed measurement noise.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1093/bioinformatics/btp358

Cites

28 of 28 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

1 of 12 cited sources checked · 0 supported · 0 flagged · accuracy not yet measured

Show all 39 claims

  • It may state two separate claims as one. 14
  • Probably not a substantial claim. 13
25 of 25
  • The authors state this as an assumption.

    The measurement noise is normally distributed.

    “The measurement noise (t) is assumed to be normally distributed.”
  • The authors state this as an assumption.

    An appropriate model M that sufficiently describes the available experimental data is assumed.

    “Furthermore, an appropriate model M that sufficiently describes the available experimental data is assumed.”
  • The paper relies on this without support.

    No approach for explicit testing of practical non-identifiability is available.

    “Similar to a clear formal definition, an approach for explicit testing of practical non-identifiability is not available to our knowledge.”
  • The authors state this as an assumption.

    The initial values of species x2 to x4 are equal to zero.

    “The initial values of species x 2 to x 4 are assumed to be equal to zero.”
  • The authors state this as an assumption.

    For the model-reduction argument, a parameter θi is practically non-identifiable for decreasing parameter value.

    “Assume that a parameter θ i is practically non-indentifiable for decreasing parameter value.”
5 of 5

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Concentration unit conflicts with figure labels

    Minor

    The text says concentrations are modeled in nanometers, a unit of length, while the figure labels use nM, a unit of concentration.

1 of 1

Citations

Cites

Flagged first, then by citations

Show all 29 references

1 of the 29 references couldn’t be matched to a known paper.

Cited by

Sorted by citations

Items 1,201–1,300 of 1,414

Metadata

Authors
Raue, A., Kreutz, C., Maiwald, T., Bachmann, J., Schilling, M., Klingmüller, U., & Timmer, J.
Affiliations
University of Freiburg (DE)
Corresponding author
Raue, A.
Venue
Bioinformatics
Published
2009-06-08
Volume
25
Issue
15
Pages
1923-1929
ISSN
  • 1367-4803 (ISSN-L)
  • 1367-4811
OpenAlex
W2168648059
Cited by
1,442
References
29
Citations by year
2026: 209 · 2025: 107 · 2024: 103 · 2023: 82 · 2022: 98 · 2021: 118 · 2020: 97 · 2019: 116 · 2018: 94 · 2017: 78 · 2016: 87 · 2015: 64 · 2014: 52 · 2013: 54 · 2012: 39
FWCI
10.99
Type
journal article
Language
en
Open access
Locations
  • Bioinformatics (publishedVersion)
  • PubMed (publishedVersion)
  • OPUS (Augsburg University) (submittedVersion)
Funders
  • Deutsches Krebsforschungszentrum
  • European Commission (223188, EU-FP7, FP7 HEALTH)
  • Bundesministerium für Bildung und Forschung (FRISYS 0313921, 0313074D, 0313921)
  • FP7 Health
Topics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene Regulatory Network Analysis
  • Physical Sciences › Engineering › Control and Systems Engineering › Control Systems and Identification
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Microbial Metabolic Engineering and Bioproduction
Keywords
identifiability analysis, profile likelihood, parameter estimation, confidence intervals, experimental design, model reduction
MeSH terms
Algorithms, Models, Biological, Probability, Computational Biology

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review