CoChat

Systematic identifiability testing for unambiguous mechanistic modeling – application to JAK-STAT, MAP kinase, and NF-κ B signaling pathway models

Open access
Quaiser, Tom, Mönnigmann, Martin · 2009 · BMC Systems Biology

The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.

Abstract

Background: When creating mechanistic mathematical models for biological signaling processes it is tempting to include as many known biochemical interactions into one large model as possible. For the JAK-STAT, MAP kinase, and NF-κ B pathways a lot of biological insight is available, and as a consequence, large mathematical models have emerged. For large models the question arises whether unknown model parameters can uniquely be determined by parameter estimation from measured data. Systematic approaches to answering this question are indispensable since the uniqueness of model parameter values is essential for predictive mechanistic modeling. Results: We propose an eigenvalue based method for efficiently testing identifiability of large ordinary differential models and compare this approach to three existing ones. The methods are benchmarked by applying them to models of the signaling pathways mentioned above. In all cases the eigenvalue method proposed here and the orthogonal method find the largest set of identifiable parameters, thus clearly outperforming the other approaches. The identifiability analysis shows that the pathway models are not identifiable, even under the strong assumption that all system state variables are measurable. We demonstrate how the results of the identifiability analysis can be used for model simplification. Conclusion: While it has undoubtedly contributed to recent advances in systems biology, mechanistic modeling by itself does not guarantee unambiguous descriptions of biological processes. We show that some recent signal transduction pathway models have reached a level of detail that is not warranted. Rigorous identifiability tests reveal that even if highly idealized experiments could be carried out to measure all state variables of these signaling pathways, some unknown parameters could still not be estimated. The identifiability tests therefore show that the level of detail of the investigated models is too high in principle, not just because too little experimental information is available. We demonstrate how the proposed method can be combined with biological insight, however, to simplify these models.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/1752-0509-3-50

Cites

45 of 45 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 Results of the methods applied to the JAK-STAT model. The graph illustrates how the value of the smallest eigenvalue changes, when one parameter is fixed in each iteration. The y-axis shows the value of the smallest eigenvalue of the Hessian matrix H. Parameters are fixed until the value of the smallest eigenvalue is larger than ϵ = 10-4.
Figure 1 Results of the methods applied to the JAK-STAT model. The graph illustrates how the value of the smallest eigenvalue changes, when one parameter is fixed in each iteration. The y-axis shows the value of the smallest eigenvalue of the Hessian matrix H. Parameters are fixed until the value of the smallest eigenvalue is larger than ϵ = 10-4.CC BY · PubMed Central
Figure 2 Part of the JAK-STAT model to be simplified. The activated receptor is denoted by actR. The encircled P indicates that STAT is phosphorylated.
Figure 2 Part of the JAK-STAT model to be simplified. The activated receptor is denoted by actR. The encircled P indicates that STAT is phosphorylated.CC BY · PubMed Central
Figure 3 Results of the methods applied to the MAP kinase model. Until iteration number 17 the green curve lies below the red curve.
Figure 3 Results of the methods applied to the MAP kinase model. Until iteration number 17 the green curve lies below the red curve.CC BY · PubMed Central
Figure 4 Results of the methods applied to the NF-κB model.
Figure 4 Results of the methods applied to the NF-κB model.CC BY · PubMed Central
Figure 5 Summary of the method comparison. Since the PCA based method fails in all three cases, it is not included here.
Figure 5 Summary of the method comparison. Since the PCA based method fails in all three cases, it is not included here.CC BY · PubMed Central
Figure 6 Visualization of the concepts of the orthogonal method.
Figure 6 Visualization of the concepts of the orthogonal method.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 45 references

Research works printed but not linked: 3

  1. Asprey SP, Macchietto S: Dynamic model development: Methods, Theory and Applications. 2003, Elsevier, Amsterdam, The Netherlands
  2. Froemel C: Parameterreduktion in Stoffwechselmodellen mit Methoden der Statistik. Master's thesis. 2003, Fachhochschule Aachen, Abteilung Juelich, Fachbereich Physikalische Technik, Studienrichtung Technomathematik
  3. Quaiser T, Marquardt W, Moennigmann M: Local Identifiability Analysis of Large Signaling Pathway Models. 2nd Conference Foundation of Systems Biology in Engineering, Proceedings Plenary and Contributed Papers, ISBN 978-3-8167-7436-5. Edited by: Allgoewer F, Reuss M. 2007, 465-470. Stuttgart: Fraunhofer IRB Verlag

Cited by

See all 136

Metadata

Authors
Quaiser, T., & Mönnigmann, M.
Affiliations
  • RWTH Aachen University (DE)
  • Technische Universität Braunschweig (DE)
Corresponding author
Mönnigmann, Martin
Venue
BMC Systems Biology
Published
2009-05-09
Volume
3
Issue
1
Pages
50-50
ISSN
1752-0509 (ISSN-L)
OpenAlex
W2098649922
Cited by
114
References
45
Citations by year
2026: 3 · 2025: 4 · 2024: 10 · 2023: 6 · 2022: 8 · 2021: 6 · 2020: 10 · 2019: 14 · 2018: 6 · 2017: 4 · 2016: 6 · 2015: 10 · 2014: 4 · 2013: 9 · 2012: 5
FWCI
1.88
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • BMC Systems Biology (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
  • RWTH Publications (RWTH Aachen) (submittedVersion, cc-by)
Funders
Deutsche Forschungsgemeinschaft
Topics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene Regulatory Network Analysis
  • Physical Sciences › Engineering › Control and Systems Engineering › Control Systems and Identification
  • Physical Sciences › Mathematics › Modeling and Simulation › Mathematical Biology Tumor Growth
Keywords
identifiability analysis, parameter identifiability, JAK/STAT signaling, MAPK signaling, NF-κB signaling, model reduction, ordinary differential equation model, mechanistic modeling
MeSH terms
Models, Biological, Signal Transduction, NF-kappa B, Nonlinear Dynamics, Mitogen-Activated Protein Kinases, Principal Component Analysis, STAT Transcription Factors, Janus Kinases

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Systematic identifiability testing for unambiguous mechanistic modeling – application to JAK-STAT, MAP kinase, and NF-κ B signaling pathway models. https://app.cochat.ai/papers/10.1186/1752-0509-3-50
The paper
Quaiser, T., & Mönnigmann, M. (2009). Systematic identifiability testing for unambiguous mechanistic modeling – application to JAK-STAT, MAP kinase, and NF-κ B signaling pathway models. BMC Systems Biology. https://doi.org/10.1186/1752-0509-3-50

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.