An integrated strategy for prediction uncertainty analysis
Open accessThe DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Abstract
Motivation: To further our understanding of the mechanisms underlying biochemical pathways mathematical modelling is used. Since many parameter values are unknown they need to be estimated using experimental observations. The complexity of models necessary to describe biological pathways in combination with the limited amount of quantitative data results in large parameter uncertainty which propagates into model predictions. Therefore prediction uncertainty analysis is an important topic that needs to be addressed in Systems Biology modelling. Results: We propose a strategy for model prediction uncertainty analysis by integrating profile likelihood analysis with Bayesian estimation. Our method is illustrated with an application to a model of the JAK-STAT signalling pathway. The analysis identified predictions on unobserved variables that could be made with a high level of confidence, despite that some parameters were non-identifiable. Availability and implementation: Source code is available at: http://bmi.bmt.tue.nl/sysbio/software/pua.html. Contact: j.vanlier@tue.nl Supplementary information: Supplementary data are available at Bioinformatics online.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The second issue is practical nonidentifiability, which results from lack of information in the data and manifests itself as a flattening out of the likelihood in a certain direction [10,64].”
From Parameter uncertainty in biochemical models described by ordinary differential equations (2013) · cites this paper as [10]
In the citing paper
“Note that in order to ensure convergence, one needs to make sure that the posterior distribution is weakly identifiable, which is easily checked by computing MAP profiles [10,64].”
From Parameter uncertainty in biochemical models described by ordinary differential equations (2013) · cites this paper as [10]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Markov Chain Monte Carlo in Practice
(1995) · Chapman & Hall/CRC eBooks · doi:10.1201/b14835 · Cited by 7,757
Bayesian Inference in Statistical Analysis.
Kadane, J. B., Box, G. E. P., & Tiao, G. C. (1975) · Journal of the American Statistical Association · doi:10.2307/2285412 · Cited by 3,824
COPASI—a COmplex PAthway SImulator
Hoops, S., Sahle, S., Gauges, R., Lee, C., Pahle, J., Simus, N., Singhal, M., Xu, L., Mendes, P., & Kummer, U. (2006) · Bioinformatics · doi:10.1093/bioinformatics/btl485 · Cited by 2,618
An invariant form for the prior probability in estimation problems
Jeffreys, H. (1946) · Proceedings of the Royal Society of London. Series A. Mathematical and Physical Sciences · doi:10.1098/rspa.1946.0056 · Cited by 2,323
Markov Chain Monte Carlo Convergence Diagnostics: A Comparative Review
Cowles, M. K., & Carlin, B. P. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476956 · Cited by 2,056
Practical markov chain monte carlo
Geyer, C. J. (1992) · Statistical Science · doi:10.1214/ss/1177011137 · Cited by 2,045
Toni, T., Welch, D., Strelkowa, N., Ipsen, A., & Stumpf, M. P. H. (2009) · Journal of The Royal Society Interface · doi:10.1098/rsif.2008.0172 · Cited by 1,498
Riemann manifold langevin and hamiltonian monte carlo methods
Girolami, M., & Calderhead, B. (2011) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2010.00765.x · Cited by 1,473
Raue, A., Kreutz, C., Maiwald, T., Bachmann, J., Schilling, M., Klingmüller, U., & Timmer, J. (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp358 · Cited by 1,442
Universally Sloppy Parameter Sensitivities in Systems Biology Models
Gutenkunst, R. N., Waterfall, J. J., Casey, F. P., Brown, K. S., Myers, C. R., & Sethna, J. P. (2007) · PLoS Computational Biology · doi:10.1371/journal.pcbi.0030189 · Cited by 1,261
Bayesian Inference in Statistical Analysis
Gokhale, D. V., Box, G. E. P., & Tiao, G. C. (1974) · Biometrics · doi:10.2307/2529631 · Cited by 994
Gilks, W. R. (2005) · Encyclopedia of Biostatistics · doi:10.1002/0470011815.b2a14021 · Cited by 711
Statistical mechanical approaches to models with many poorly known parameters.
Brown, K. S., & Sethna, J. P. (2003) · Physical Review E · doi:10.1103/physreve.68.021904 · Cited by 398
Swameye, I., Müller, T. G., Timmer, J., Sandra, O., & Klingmüller, U. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0237333100 · Cited by 316
Identifiability, improper priors and Gibbs sampling for generalized linear models
Gelfand, A. E., & Sahu, S. K. (1999) · Journal of the American Statistical Association · doi:10.1080/01621459.1999.10473840 · Cited by 242
Dynamical modeling and multi-experiment fitting with PottersWheel
Maiwald, T., & Timmer, J. (2008) · Bioinformatics · doi:10.1093/bioinformatics/btn350 · Cited by 231
Identifiability of Parameters in MCMC Bayesian Inference of Phylogeny
Rannala, B. (2002) · Systematic Biology · doi:10.1080/10635150290102429 · Cited by 190
Estimating Bayes factors via thermodynamic integration and population MCMC
Calderhead, B., & Girolami, M. (2009) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2009.07.025 · Cited by 169
ABC-SysBio approximate Bayesian computation in Python with GPU support
Liepe, J., Barnes, C., Cule, E., Erguler, K., Kirk, P., Toni, T., & Stumpf, M. P. H. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btq278 · Cited by 136
Cedersund, G., & Roll, J. (2009) · The FEBS Journal · doi:10.1111/j.1742-4658.2008.06845.x · Cited by 127
An error model for protein quantification
Kreutz, C., Rodriguez, M. M. B., Maiwald, T., Seidl, M., Blum, H. E., Mohr, L., & Timmer, J. (2007) · Bioinformatics · doi:10.1093/bioinformatics/btm397 · Cited by 107
Zwickl, D. J., & Holder, M. T. (2004) · Systematic Biology · doi:10.1080/10635150490522584 · Cited by 95
Brännmark, C., Palmér, R., Glad, S. T., Cedersund, G., & Strålfors, P. (2010) · Journal of Biological Chemistry · doi:10.1074/jbc.m110.106849 · Cited by 90
Nyman, E., Brännmark, C., Palmér, R., Brugård, J., Nyström, F. H., Strålfors, P., & Cedersund, G. (2011) · Journal of Biological Chemistry · doi:10.1074/jbc.m110.188987 · Cited by 77
Hasenauer, J., Waldherr, S., Wagner, K., & Allgöwer, F. (2010) · IET Systems Biology · doi:10.1049/iet-syb.2009.0030 · Cited by 49
Workflow for generating competing hypothesis from models with parameter uncertainty
Gomez-Cabrero, D., Compte, A., & Tegner, J. (2011) · Interface Focus · doi:10.1098/rsfs.2011.0015 · Cited by 33
Biological pathway kinetic rate constants are scale-invariant
Grandison, S., & Morris, R. J. (2008) · Bioinformatics · doi:10.1093/bioinformatics/btn041 · Cited by 16
Hasenauer, J., Rumschinski, P., Waldherr, S., Borchers, S., Allgöwer, F., & Findeisen, R. (2010) · Journal of Process Control · doi:10.1016/j.jprocont.2010.06.004 · Cited by 16
Cited by
Lessons Learned from Quantitative Dynamical Modeling in Systems Biology
Raue, A., Schilling, M., Bachmann, J., Matteson, A., Schelke, M., Kaschek, D., Hug, S., Kreutz, C., Harms, B. D., Theis, F. J., et al. (2013) · PLoS ONE · doi:10.1371/journal.pone.0074335 · Cited by 306
Maximizing the information content of experiments in systems biology
Liepe, J., Filippi, S., Komorowski, M., & Stumpf, M. P. H. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002888 · Cited by 170
“Our approach improves on previous methods [25–32] in a number of ways: first we are able to incorporate but do not require preliminary experimental data; second, it is a global approach that is not limited to some neighbourhood in parameter space unlike approaches solely based on e.”
MethodParameter uncertainty in biochemical models described by ordinary differential equations
Vanlier, J., Tiemann, C. A., Hilbers, P. A. J., & van Riel, N. A. W. (2013) · Mathematical Biosciences · doi:10.1016/j.mbs.2013.03.006 · Cited by 116
Self-citationCedersund, G. (2012) · The FEBS Journal · doi:10.1111/j.1742-4658.2012.08725.x · Cited by 81
Optimal experiment selection for parameter estimation in biological differential equation models
Transtrum, M. K., & Qiu, P. (2012) · BMC Bioinformatics · doi:10.1186/1471-2105-13-181 · Cited by 34
Metadata
- Authors
- Vanlier, J., Tiemann, C. A., Hilbers, P. A. J., & van Riel, N. A. W.
- Affiliations
- Eindhoven University of Technology (NL)
- Corresponding author
- Vanlier, J.
- ORCID
- Hilbers, P.A.J.
- Venue
- Bioinformatics
- Publisher
- Oxford University Press (OUP)
- Published
- 2012-02-21
- Volume
- 28
- Issue
- 8
- Pages
- 1130-1135
- ISSN
- 1367-4803 (ISSN-L)
- 1367-4811
- PMC
- PMC3324512
- OpenAlex
- W2151389393
- Cited by
- 67
- References
- 28
- Citations by year
- 2025: 2 · 2024: 2 · 2023: 1 · 2022: 3 · 2021: 3 · 2020: 5 · 2019: 3 · 2018: 10 · 2017: 4 · 2016: 1 · 2015: 5 · 2014: 10 · 2013: 14 · 2012: 4
- FWCI
- 4.24
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Bioinformatics (publishedVersion, cc-by-nc)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- TU/e Research Portal (publishedVersion)
- TU/e Research Portal (submittedVersion)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene Regulatory Network Analysis
- Physical Sciences › Engineering › Control and Systems Engineering › Control Systems and Identification
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Microbial Metabolic Engineering and Bioproduction
- Keywords
- parameter uncertainty, profile likelihood, Bayesian parameter estimation, parameter identifiability, JAK/STAT signaling, systems biology modeling, model prediction
- MeSH terms
- Algorithms, Bayes Theorem, Markov Chains, Models, Biological, Programming Languages, Signal Transduction, Likelihood Functions, Uncertainty, Systems Biology, STAT Transcription Factors, Janus Kinase 1
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.