The DOI matches its Crossref record; 81 of the 81 references it cites were found in a registry or an index.
Sensitivity analysis approaches applied to systems biology models
Open accessAbstract
With the rising application of systems biology, sensitivity analysis methods have been widely applied to study the biological systems, including metabolic networks, signalling pathways and genetic circuits. Sensitivity analysis can provide valuable insights about how robust the biological responses are with respect to the changes of biological parameters and which model inputs are the key factors that affect the model outputs. In addition, sensitivity analysis is valuable for guiding experimental analysis, model reduction and parameter estimation. Local and global sensitivity analysis approaches are the two types of sensitivity analysis that are commonly applied in systems biology. Local sensitivity analysis is a classic method that studies the impact of small perturbations on the model outputs. On the other hand, global sensitivity analysis approaches have been applied to understand how the model outputs are affected by large variations of the model input parameters. In this review, the author introduces the basic concepts of sensitivity analysis approaches applied to systems biology models. Moreover, the author discusses the advantages and disadvantages of different sensitivity analysis methods, how to choose a proper sensitivity analysis approach, the available sensitivity analysis tools for systems biology models and the caveats in the interpretation of sensitivity analysis results.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2005) · Technometrics · doi:10.1198/tech.2005.s303 · Cited by 17,923
McKay, M. D., Beckman, R. J., & Conover, W. J. (2000) · Technometrics · doi:10.2307/1271432 · Cited by 7,415
Global Sensitivity Analysis. The Primer
Saltelli, A., Ratto, M., Andres, T., Campolongo, F., Cariboni, J., Gatelli, D., Saisana, M., & Tarantola, S. (2007) · doi:10.1002/9780470725184 · Cited by 6,430
Global sensitivity indices for nonlinear mathematical models and their monte carlo estimates
Sobol′, I. M. (2001) · Mathematics and Computers in Simulation · doi:10.1016/s0378-4754(00)00270-6 · Cited by 6,389
Factorial Sampling Plans for Preliminary Computational Experiments
Morris, M. D. (1991) · Technometrics · doi:10.1080/00401706.1991.10484804 · Cited by 4,943
McKay, M. D., Beckman, R. J., & Conover, W. J. (1979) · Technometrics · doi:10.2307/1268522 · Cited by 3,757
Hucka, M., Finney, A., Sauro, H. M., Bolouri, H., Doyle, J. C., Kitano, H., Arkin, A. P., Bornstein, B. J., Bray, D., Cornish-Bowden, A., et al. (2003) · Bioinformatics · doi:10.1093/bioinformatics/btg015 · Cited by 3,060
A methodology for performing global uncertainty and sensitivity analysis in systems biology
Marino, S., Hogue, I. B., Ray, C. J., & Kirschner, D. E. (2008) · Journal of Theoretical Biology · doi:10.1016/j.jtbi.2008.04.011 · Cited by 2,999
COPASI—a COmplex PAthway SImulator
Hoops, S., Sahle, S., Gauges, R., Lee, C., Pahle, J., Simus, N., Singhal, M., Xu, L., Mendes, P., & Kummer, U. (2006) · Bioinformatics · doi:10.1093/bioinformatics/btl485 · Cited by 2,618
SUNDIALS: Suite of nonlinear and differential/algebraic equation solvers
Hindmarsh, A. C., Brown, P. N., Grant, K. E., Lee, S. L., Serban, R., Shumaker, D. E., & Woodward, C. S. (2005) · ACM Transactions on Mathematical Software · doi:10.1145/1089014.1089020 · Cited by 2,556
A Quantitative Model-Independent Method for Global Sensitivity Analysis of Model Output
Saltelli, A., Tarantola, S., & Chan, K. P.-S. (1999) · Technometrics · doi:10.1080/00401706.1999.10485594 · Cited by 2,275
Importance measures in global sensitivity analysis of nonlinear models
Homma, T., & Saltelli, A. (1996) · Reliability Engineering & System Safety · doi:10.1016/0951-8320(96)00002-6 · Cited by 2,011
Sensitivity Analysis in Practice: A Guide to Assessing Scientific Models
Saltelli, A., Tarantola, S., Campolongo, F., & Ratto, M. (2004) · Cited by 1,797
KACSER, H., & Ja, B. (1973) · PubMed · Cited by 1,455
Heinrich, R., & Rapoport, T. A. (1974) · European Journal of Biochemistry · doi:10.1111/j.1432-1033.1974.tb03318.x · Cited by 1,386
Blower, S. M., & Dowlatabadi, H. (1994) · International Statistical Review / Revue Internationale de Statistique · doi:10.2307/1403510 · Cited by 1,358
Universally Sloppy Parameter Sensitivities in Systems Biology Models
Gutenkunst, R. N., Waterfall, J. J., Casey, F. P., Brown, K. S., Myers, C. R., & Sethna, J. P. (2007) · PLoS Computational Biology · doi:10.1371/journal.pcbi.0030189 · Cited by 1,261 · cited 1×
“They found that systems biology models exhibit sloppy sensitivity spectra because the behaviour of the models is very insensitive to many parameter changes [72].”
BackgroundThe Regulation of Cellular Systems
Heinrich, R., & Schuster, S. (1996) · Springer eBooks · doi:10.1007/978-1-4613-1161-4 · Cited by 1,193
Study of the sensitivity of coupled reaction systems to uncertainties in rate coefficients. I Theory
Cukier, R. I., Fortuin, C. M., Shuler, K. E., Petschek, A. G., & Schaibly, J. H. (1973) · The Journal of Chemical Physics · doi:10.1063/1.1680571 · Cited by 1,046
Sensitivity Analysis for Chemical Models
Saltelli, A., Ratto, M., Tarantola, S., & Campolongo, F. (2005) · Chemical Reviews · doi:10.1021/cr040659d · Cited by 639
Iman, R. L., Helton, J. C., & Campbell, J. E. (1981) · Journal of Quality Technology · doi:10.1080/00224065.1981.11978748 · Cited by 584
AN APPROACH TO THE PRELIMINARY ANALYSIS OF ENVIRONMENTAL SYSTEMS
Hornberger, G. M., & Spear, R. C. (1981) · Cited by 566
Metabolic control theory: A structural approach
Reder, C. (1988) · Journal of Theoretical Biology · doi:10.1016/s0022-5193(88)80073-0 · Cited by 552
Sensitivity Analysis in Chemical Kinetics
Rabitz, H., Kramer, M., & Dacol, D. (1983) · Annual Review of Physical Chemistry · doi:10.1146/annurev.pc.34.100183.002223 · Cited by 536
Liu, S. (2008) · International Statistical Review · doi:10.1111/j.1751-5823.2008.00062_17.x · Cited by 511
Systems biology toolbox for matlab: a computational platform for research in systems biology
Schmidt, H., & Jirstrand, M. (2006) · Bioinformatics · doi:10.1093/bioinformatics/bti799 · Cited by 473
Efficient input—output model representations
Rabitz, H., Aliş, Ö. F., Shorter, J., & Shim, K. (1999) · Computer Physics Communications · doi:10.1016/s0010-4655(98)00152-0 · Cited by 461
Untangling the wires: A strategy to trace functional interactions in signaling and gene networks
Kholodenko, B. N., Kiyatkin, A., Bruggeman, F. J., Sontag, E., Westerhoff, H. V., & Hoek, J. B. (2002) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.192442699 · Cited by 422
A Tale of Two Futures: HIV and Antiretroviral Therapy in San Francisco
Blower, S. M., Gershengorn, H. B., & Grant, R. M. (2000) · Science · doi:10.1126/science.287.5453.650 · Cited by 390
Sensitivity analysis of normative economic models: theoretical framework and practical strategies
Pannell, D. (1997) · Agricultural Economics · doi:10.1016/s0169-5150(96)01217-0 · Cited by 379
An alternative way to compute Fourier amplitude sensitivity test (FAST)
Saltelli, A., & Bolado, R. (1998) · Computational Statistics & Data Analysis · doi:10.1016/s0167-9473(97)00043-1 · Cited by 367
Mathematical modeling reveals threshold mechanism in CD95-induced apoptosis
Bentele, M., Lavrik, I., Ulrich, M., Stößer, S., Heermann, D. W., Kalthoff, H., Krammer, P. H., & Eils, R. (2004) · The Journal of Cell Biology · doi:10.1083/jcb.200404158 · Cited by 319
Swameye, I., Müller, T. G., Timmer, J., Sandra, O., & Klingmüller, U. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0237333100 · Cited by 316
FELL, D. A., & SAURO, H. M. (1985) · European Journal of Biochemistry · doi:10.1111/j.1432-1033.1985.tb08876.x · Cited by 311
Klipp, E., Liebermeister, W., Wierling, C., Kowald, A., Lehrach, H. R., & Herwig, R. (2009) · Cited by 308
Practical Approaches To Construct RS-HDMR Component Functions
Li, G., Wang, S.-W., & Rabitz, H. (2002) · The Journal of Physical Chemistry A · doi:10.1021/jp014567t · Cited by 275
Sensitivity analysis of ordinary differential equation systems—A direct method
Dickinson, R. P., & Gelinas, R. J. (1976) · Journal of Computational Physics · doi:10.1016/0021-9991(76)90007-3 · Cited by 272
Cukier, R. I., Schaibly, J. H., & Shuler, K. E. (1975) · The Journal of Chemical Physics · doi:10.1063/1.431440 · Cited by 267
Efficient Implementation of High Dimensional Model Representations
Alış, Ö. F., & Rabitz, H. (2001) · Journal of Mathematical Chemistry · doi:10.1023/a:1010979129659 · Cited by 257
Quantitative cell biology with the Virtual Cell☆
Slepchenko, B. M., Schaff, J. C., Macara, I., & Loew, L. M. (2003) · Trends in Cell Biology · doi:10.1016/j.tcb.2003.09.002 · Cited by 256
Schaibly, J. H., & Shuler, K. E. (1973) · The Journal of Chemical Physics · doi:10.1063/1.1680572 · Cited by 224
CVODES: The Sensitivity-Enabled ODE Solver in SUNDIALS
Serban, R., & Hindmarsh, A. C. (2005) · ASME International Design Engineering Technical Conferences and Computers and Information in Engineering Conference (IDETC/CIE) · doi:10.1115/detc2005-85597 · Cited by 215
Sensitivity, robustness, and identifiability in stochastic chemical kinetics models
Komorowski, M., Costa, M. J., Rand, D. A., & Stumpf, M. P. H. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1015814108 · Cited by 194
TinkerCell: modular CAD tool for synthetic biology
Chandran, D., Bergmann, F. T., & Sauro, H. M. (2009) · Journal of Biological Engineering · doi:10.1186/1754-1611-3-19 · Cited by 186
Control analysis of metabolic systems
Burns, J. A., Cornish-Bowden, A., Groen, A. K., Heinrich, R., Kacser, H., Porteous, J. W., Rapoport, S. M., Rapoport, T. A., Stucki, J. W., Tager, J. M., et al. (1985) · Trends in Biochemical Sciences · doi:10.1016/0968-0004(85)90008-8 · Cited by 185
The effect of thiamine supplementation on tumour proliferation: A metabolic control analysis study
Comín‐Anduix, B., Boren, J., Martinez, S., Moro, C., Centelles, J. J., Trebukhina, R., Petushok, N., Lee, W. P., Boros, L. G., & Cascante, M. (2001) · European Journal of Biochemistry · doi:10.1046/j.1432-1327.2001.02329.x · Cited by 181
Li, G., Hu, J., Wang, S.-W., Georgopoulos, P. G., Schoendorf, J., & Rabitz, H. (2006) · The Journal of Physical Chemistry A · doi:10.1021/jp054148m · Cited by 180
Global uncertainty assessments by high dimensional model representations (HDMR)
Li, G., Wang, S.-W., Rabitz, H., Wang, S., & Jaffé, P. (2002) · Chemical Engineering Science · doi:10.1016/s0009-2509(02)00417-7 · Cited by 179
Modern theories of metabolic control and their applications
Westerhoff, H. V., Groen, A. K., & Wanders, R. J. A. (1984) · Bioscience Reports · doi:10.1007/bf01120819 · Cited by 178
The Green’s function method of sensitivity analysis in chemical kinetics
Hwang, J.-T., Dougherty, E. P., Rabitz, S., & Rabitz, H. (1978) · The Journal of Chemical Physics · doi:10.1063/1.436465 · Cited by 178
Parameter uncertainty and interaction in complex environmental models
Spear, R. C., Grieb, T. M., & Shang, N. (1994) · Water Resources Research · doi:10.1029/94wr01732 · Cited by 174
Cho, K.-H., Shin, S.-Y., Kolch, W., & Wolkenhauer, O. (2003) · SIMULATION · doi:10.1177/0037549703040943 · Cited by 172
Global Sensitivity Analysis Challenges in Biological Systems Modeling
Kiparissides, A., Kucherenko, S. S., Mantalaris, A., & Pistikopoulos, E. N. (2009) · Industrial & Engineering Chemistry Research · doi:10.1021/ie900139x · Cited by 160
Covering a Broad Dynamic Range: Information Processing at the Erythropoietin Receptor
Becker, V., Schilling, M., Bachmann, J., Baumann, U., Raue, A., Maiwald, T., Timmer, J., & Klingmüller, U. (2010) · Science · doi:10.1126/science.1184913 · Cited by 159
Addressing parameter identifiability by model-based experimentation
Raue, A., Kreutz, C., Maiwald, T., Klingmüller, U., & Timmer, J. (2011) · IET Systems Biology · doi:10.1049/iet-syb.2010.0061 · Cited by 145 · cited 2×
“The values of the insensitive parameters might be fixed and some processes may be simplified or eliminated [5].”
BackgroundMethodIhekwaba, A., Benson, N., Kell, D. B., Broomhead, D. S., & Grimley, R. L. (2004) · Systems Biology · doi:10.1049/sb:20045009 · Cited by 144
Systems Analysis at the Molecular Scale
RABITZ, H. A. (1989) · Science · doi:10.1126/science.246.4927.221 · Cited by 143
Ingalls, B., & Sauro, H. M. (2003) · Journal of Theoretical Biology · doi:10.1016/s0022-5193(03)00011-0 · Cited by 141
Optimizing Genetic Circuits by Global Sensitivity Analysis
Feng, X., Hooshangi, S., Chen, D. D., Li, G., Weiss, R., & RABITZ, H. A. (2004) · Biophysical Journal · doi:10.1529/biophysj.104.044131 · Cited by 135
In silico identification of the key components and steps in IFN‐γ induced JAK‐STAT signaling pathway
Zi, Z., Cho, K., Sung, M., Xia, X., Zheng, J., & Sun, Z. (2005) · FEBS Letters · doi:10.1016/j.febslet.2005.01.009 · Cited by 132
Self-citationKremling, A., Fischer, S., Gadkar, K., Doyle, F. J., Sauter, T., Bullinger, E., Allgöwer, F., & Gilles, E. D. (2004) · Genome Research · doi:10.1101/gr.1226004 · Cited by 127
Comparative study of parameter sensitivity analyses of the TCR-activated Erk-MAPK signalling pathway
Zheng, Y., & Rundell, A. (2006) · IEE Proceedings - Systems Biology · doi:10.1049/ip-syb:20050088 · Cited by 121
Automatic sensitivity analysis of kinetic mechanisms
Koda, M., McRae, G. J., & Seinfeld, J. H. (1979) · International Journal of Chemical Kinetics · doi:10.1002/kin.550110408 · Cited by 121
Dougherty, E. P., Hwang, J.-T., & RABITZ, H. A. (1979) · The Journal of Chemical Physics · doi:10.1063/1.438530 · Cited by 108
Quantitative analysis of transient and sustained transforming growth factor‐β signaling dynamics
Zi, Z., Feng, Z., Chapnick, D. A., Dahl, M., Deng, D., Klipp, E., Moustakas, A., & Liu, X. (2011) · Molecular Systems Biology · doi:10.1038/msb.2011.22 · Cited by 108
Self-citationSensitivity analysis: from model parameters to system behaviour
Ingalls, B. (2008) · Essays in Biochemistry · doi:10.1042/bse0450177 · Cited by 104
Data-based mechanistic modelling, generalised sensitivity and dominant mode analysis
Young, P. C. (1999) · Computer Physics Communications · doi:10.1016/s0010-4655(98)00168-4 · Cited by 100
Enzyme‐enzyme interactions and control analysis
KACSER, H., Sauro, H. M., & Acerenza, L. (1990) · European Journal of Biochemistry · doi:10.1111/j.1432-1033.1990.tb15329.x · Cited by 89
Rand, D. A. J. (2008) · Journal of The Royal Society Interface · doi:10.1098/rsif.2008.0084.focus · Cited by 87
SBML-SAT: a systems biology markup language (SBML) based sensitivity analysis tool
Zi, Z., Zheng, Y., Rundell, A. E., & Klipp, E. (2008) · BMC Bioinformatics · doi:10.1186/1471-2105-9-342 · Cited by 85
Self-citationSensitivity analysis and robust experimental design of a signal transduction pathway system
Yue, H., Brown, M., He, F., Jia, J., & Kell, D. B. (2008) · International Journal of Chemical Kinetics · doi:10.1002/kin.20369 · Cited by 81
Network News: Innovations in 21st Century Systems Biology
Arkin, A. P., & Schaffer, D. V. (2011) · Cell · doi:10.1016/j.cell.2011.03.008 · Cited by 69
A Computational and Experimental Study of the Regulatory Mechanisms of the Complement System
Liu, B., Zhang, J., Tan, P. Y., Hsu, D., Blom, A. M., Leong, B. S. H., Sethi, S., Ho, B., Ding, J. L., & Thiagarajan, P. S. (2011) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1001059 · Cited by 58
Dresch, J. M., Liu, X., Arnosti, D. N., & Ay, A. A. (2010) · BMC Systems Biology · doi:10.1186/1752-0509-4-142 · Cited by 57
SensSB: a software toolbox for the development and sensitivity analysis of systems biology models
Rodriguez-Fernández, M., & Banga, J. R. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btq242 · Cited by 51
Understanding dynamics using sensitivity analysis: caveat and solution
Perumal, T. M., & Gunawan, R. (2011) · BMC Systems Biology · doi:10.1186/1752-0509-5-41 · Cited by 46
Hu, D., & Yuan, J. (2006) · The Journal of Physical Chemistry A · doi:10.1021/jp0561975 · Cited by 45
Systematic calibration of a cell signaling network model
Kim, K. A. E., Spencer, S. L., Albeck, J. G., Burke, J. M., Sorger, P. K., Gaudet, S., & Kim, D. H. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-202 · Cited by 44
Parameter sensitivity analysis of IL-6 signalling pathways
Chu, Y., Jayaraman, A., & Hahn, J. (2007) · IET Systems Biology · doi:10.1049/iet-syb:20060053 · Cited by 38
Klipp, E. (2009) · FEBS Letters · doi:10.1016/j.febslet.2009.11.065 · Cited by 15
Systemic Analysis of Tumor Cell-Induced Endothelial Calcium Signaling and Junction Disassembly
Peng, H., & Dong, C. (2009) · Cellular and Molecular Bioengineering · doi:10.1007/s12195-009-0067-5 · Cited by 11
Cited by
Zhang, X., Trame, M., Lesko, L., & Schmidt, S. (2015) · CPT: Pharmacometrics & Systems Pharmacology · doi:10.1002/psp4.6 · Cited by 467
On structural and practical identifiability
Wieland, F.-G., Hauber, A. L., Rosenblatt, M., Tönsing, C., & Timmer, J. (2021) · Current Opinion in Systems Biology · doi:10.1016/j.coisb.2021.03.005 · Cited by 325
Cedersund, G. (2012) · The FEBS Journal · doi:10.1111/j.1742-4658.2012.08725.x · Cited by 81
Global sensitivity analysis of biological multiscale models
Renardy, M., Hult, C., Evans, S., Linderman, J. J., & Kirschner, D. E. (2019) · Current Opinion in Biomedical Engineering · doi:10.1016/j.cobme.2019.09.012 · Cited by 63
A practical guide for the generation of model-based virtual clinical trials
Craig, M., Gevertz, J. L., Kareva, I., & Wilkie, K. P. (2023) · Frontiers in Systems Biology · doi:10.3389/fsysb.2023.1174647 · Cited by 52
Metadata
- Authors
- Zi, Z.
- Venue
- IET Systems Biology
- Published
- 2011-11-11
- Volume
- 5
- Issue
- 6
- Pages
- 336-346
- ISSN
- 1751-8849 (ISSN-L)
- 1751-8857
- OpenAlex
- W2011923356
- Cited by
- 384
- References
- 81
- FWCI
- 4.35
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.