The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Systems biology informed deep learning for inferring parameters and hidden dynamics
Open accessAbstract
Mathematical models of biological reactions at the system-level lead to a set of ordinary differential equations with many unknown parameters that need to be inferred using relatively few experimental measurements. Having a reliable and robust algorithm for parameter inference and prediction of the hidden dynamics has been one of the core subjects in systems biology, and is the focus of this study. We have developed a new systems-biology-informed deep learning algorithm that incorporates the system of ordinary differential equations into the neural networks. Enforcing these equations effectively adds constraints to the optimization procedure that manifests itself as an imposed structure on the observational data. Using few scattered and noisy measurements, we are able to infer the dynamics of unobserved species, external forcing, and the unknown model parameters. We have successfully tested the algorithm for three different benchmark problems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
A Simplex Method for Function Minimization
Nelder, J. A., & Mead, R. (1965) · The Computer Journal · doi:10.1093/comjnl/7.4.308 · Cited by 28,905
Raissi, M., Perdikaris, P., & Karniadakis, G. E. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2018.10.045 · Cited by 20,384
Self-citationSystems biology: a brief overview
Kitano, H. (2002) · Science · doi:10.1126/science.1069492 · Cited by 4,265
Distilling Free-Form Natural Laws from Experimental Data
Schmidt, M., & Lipson, H. (2009) · Science · doi:10.1126/science.1165893 · Cited by 2,890
DeepXDE: A Deep Learning Library for Solving Differential Equations
Lu, L., Meng, X., Mao, Z., & Karniadakis, G. E. (2021) · SIAM Review · doi:10.1137/19m1274067 · Cited by 2,512
Self-citationSearching for activation functions
Ramachandran, P., Zoph, B., & Le, Q. V. (2017) · arXiv · doi:10.48550/arxiv.1710.05941 · Cited by 2,335
Srinivas, M., & Patnaik, L. M. (1994) · Computer · doi:10.1109/2.294849 · Cited by 2,180
Fundamentals of Enzyme Kinetics
(1979) · Elsevier eBooks · doi:10.1016/c2013-0-04130-8 · Cited by 2,059
Understanding and Mitigating Gradient Flow Pathologies in Physics-Informed Neural Networks
Wang, S., Teng, Y., & Perdikaris, P. (2021) · SIAM Journal on Scientific Computing · doi:10.1137/20m1318043 · Cited by 2,048
Raue, A., Kreutz, C., Maiwald, T., Bachmann, J., Schilling, M., Klingmüller, U., & Timmer, J. (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp358 · Cited by 1,442 · cited 4×
“Usually, experimental data are insufficient considering the size of the model, which results in parameters that are non-identifiable [15] or only identifiable within confidence intervals (see more details in [16]).”
BackgroundMethodInfluentialUniversally Sloppy Parameter Sensitivities in Systems Biology Models
Gutenkunst, R. N., Waterfall, J. J., Casey, F. P., Brown, K. S., Myers, C. R., & Sethna, J. P. (2007) · PLoS Computational Biology · doi:10.1371/journal.pcbi.0030189 · Cited by 1,261
Parameter estimation in biochemical pathways: a comparison of global optimization methods
Moles, C. G., Mendes, P., & Banga, J. R. (2003) · Genome Research · doi:10.1101/gr.1262503 · Cited by 858
Stochastic Modelling for Systems Biology
Wilkinson, D. J. (2006) · Chapman & Hall/CRC eBooks · doi:10.1201/9781420010664 · Cited by 736
Yang, J., Huang, T., Petralia, F., Long, Q., Zhang, B., Argmann, C., Zhao, Y., Mobbs, C. V., Schadt, E. E., Zhu, J., et al. (2016) · Scientific Reports · doi:10.1038/srep19384 · Cited by 720
Mendes, P., & Kell, D. (1998) · Bioinformatics · doi:10.1093/bioinformatics/14.10.869 · Cited by 676
On global identifiability for arbitrary model parametrizations
Ljung, L., & Glad, T. (1994) · Automatica · doi:10.1016/0005-1098(94)90029-9 · Cited by 643
Structural identifiability of systems biology models: a critical comparison of methods
Chis, O.-T., Banga, J. R., & Balsa-Canto, E. (2011) · PLoS ONE · doi:10.1371/journal.pone.0027755 · Cited by 448 · cited 1×
“In the process of parameter inference, two issues accounting for system’s (non-)identifiability have to be considered: structural identifiability that is related to the model structure independent of the experimental data [18, 19]; and practical identifiability that is related to the amount and quality of measured dat…”
BackgroundSystem identifiability based on the power series expansion of the solution
Pohjanpalo, H. (1978) · Mathematical Biosciences · doi:10.1016/0025-5564(78)90063-9 · Cited by 440
Gutfreund, H. (1980) · FEBS Letters · doi:10.1016/0014-5793(80)80546-1 · Cited by 386
Parameter estimation and model selection in computational biology
Lillacci, G., & Khammash, M. (2010) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000696 · Cited by 325
A hybrid approach for efficient and robust parameter estimation in biochemical pathways
Rodriguez-Fernandez, M., Mendes, P., & Banga, J. R. (2006) · Biosystems · doi:10.1016/j.biosystems.2005.06.016 · Cited by 304
Stochastic Modelling for Systems Biology
Wilkinson, D. J. (2011) · CRC Press eBooks · doi:10.1201/b11812 · Cited by 302
Computer model for mechanisms underlying ultradian oscillations of insulin and glucose
Sturis, J., Polonsky, K. S., Mosekilde, E., & Van Cauter, E. (1991) · American Journal of Physiology-Endocrinology and Metabolism · doi:10.1152/ajpendo.1991.260.5.e801 · Cited by 251
Bayesian methods in bioinformatics and computational systems biology
Wilkinson, D. J. (2006) · Briefings in Bioinformatics · doi:10.1093/bib/bbm007 · Cited by 230
Exploiting the bootstrap method for quantifying parameter confidence intervals in dynamical systems
Joshi, M., Seidel-Morgenstern, A., & Kremling, A. (2006) · Metabolic Engineering · doi:10.1016/j.ymben.2006.04.003 · Cited by 190
Understanding and mitigating gradient pathologies in physics-informed neural networks
Wang, S., Teng, Y., & Perdikaris, P. G. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.04536 · Cited by 176
Benchmarking optimization methods for parameter estimation in large kinetic models
Villaverde, A. F., Fröhlich, F., Weindl, D., Hasenauer, J., & Banga, J. R. (2019) · Bioinformatics · doi:10.1093/bioinformatics/bty736 · Cited by 161
Quach, M., Brunel, N., & d’Alché–Buc, F. (2007) · Bioinformatics · doi:10.1093/bioinformatics/btm510 · Cited by 151
Parameter identifiability analysis and visualization in large-scale kinetic models of biosystems
Gábor, A., Villaverde, A. F., & Banga, J. R. (2017) · BMC Systems Biology · doi:10.1186/s12918-017-0428-y · Cited by 141
Coordinated regulation of acid resistance in Escherichia coli
Aquino, P., Honda, B., Jaini, S., Lyubetskaya, A., Hosur, K., Chiu, J. G., Ekladious, I., Hu, D., Lin, J., Sayeg, M. K., et al. (2017) · BMC Systems Biology · doi:10.1186/s12918-016-0376-y · Cited by 138
SIAN: software for structural identifiability analysis of ODE models
Hong, H., Ovchinnikov, A., Pogudin, G., & Yap, C. K. (2018) · Bioinformatics · doi:10.1093/bioinformatics/bty1069 · Cited by 127
Computational procedures for optimal experimental design in biological systems
Balsa-Canto, E., Alonso, A. A., & Banga, J. R. (2008) · IET Systems Biology · doi:10.1049/iet-syb:20070069 · Cited by 124
Personalized glucose forecasting for type 2 diabetes using data assimilation
Albers, D. J., Levine, M. E., Gluckman, B. J., Ginsberg, H. N., Hripcsak, G. M., & Mamykina, L. (2017) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1005232 · Cited by 124
Villaverde, A. F., Tsiantis, N., & Banga, J. R. (2019) · Journal of The Royal Society Interface · doi:10.1098/rsif.2019.0043 · Cited by 109
Daniels, B. C., & Nemenman, I. M. (2015) · PLoS ONE · doi:10.1371/journal.pone.0119821 · Cited by 95
Aldridge, B. B., Haller, G., Sorger, P. K., & Lauffenburger, D. A. (2006) · Systems Biology · doi:10.1049/ip-syb:20050065 · Cited by 72
Temperature dependency and temperature compensation in a model of yeast glycolytic oscillations
Ruoff, P., Christensen, M. K., Wolf, J., & Heinrich, R. (2003) · Biophysical Chemistry · doi:10.1016/s0301-4622(03)00191-1 · Cited by 65
Challenges in Climate Science and Contemporary Applied Mathematics
Majda, A. J. (2012) · Communications on Pure and Applied Mathematics · doi:10.1002/cpa.21401 · Cited by 64
Ensemble Kalman methods with constraints
Albers, D. J., Blancquart, P.-A., Levine, M. E., Seylabi, E., & Stuart, A. M. (2019) · Inverse Problems · doi:10.1088/1361-6420/ab1c09 · Cited by 64
Song, X., Kong, F., Fanzhe, Kong, Chesheng, Zhan, Z., Jiwei, Han, , X., & Zhang (2013) · DOAJ (DOAJ: Directory of Open Access Journals) · doi:10.3882/j.issn.1674-2370.2013.01.001 · Cited by 46
Learning (from) the errors of a systems biology model
Engelhardt, B., Fröhlich, H., & Kschischo, M. (2016) · Scientific Reports · doi:10.1038/srep20772 · Cited by 32
A simple modeling framework for prediction in the human glucose–insulin system
Sirlanci, M., Levine, M. E., Wang, C. C. L., Albers, D. J., & Stuart, A. M. (2023) · Chaos An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/5.0146808 · Cited by 25
Engelhardt, B., Kschischo, M., & Fröhlich, H. (2017) · Journal of The Royal Society Interface · doi:10.1098/rsif.2017.0332 · Cited by 20
Multi-element probabilistic collocation for sensitivity analysis in cellular signalling networks
Foo, J., Sindi, S., & Karniadakis, G. E. (2009) · IET Systems Biology · doi:10.1049/iet-syb.2008.0126 · Cited by 6
Self-citationA Simple Modeling Framework For Prediction In The Human Glucose-Insulin SystemPreprint
Sirlanci, M., Levine, M. E., Wang, C. C. L., Albers, D. J., & Stuart, A. M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.14193 · Cited by 4
Cited by
Learning nonlinear operators via DeepONet based on the universal approximation theorem of operators
Lu, L., Jin, P., Pang, G., Zhang, Z., & Karniadakis, G. E. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-021-00302-5 · Cited by 3,418
Self-citationIntegrating Scientific Knowledge with Machine Learning for Engineering and Environmental Systems
Willard, J., Jia, X., Xu, S., Steinbach, M., & Kumar, V. (2023) · ACM Computing Surveys · doi:10.1145/3514228 · Cited by 878
Physics-Informed Neural Networks with Hard Constraints for Inverse Design
Lu, L., Pestourie, R., Yao, W., Wang, Z., Verdugo, F., & Johnson, S. G. (2021) · SIAM Journal on Scientific Computing · doi:10.1137/21m1397908 · Cited by 771
Self-citationWu, C., Zhu, M., Tan, Q., Kartha, Y., & Lu, L. (2023) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2022.115671 · Cited by 723
Self-citationGradient-enhanced physics-informed neural networks for forward and inverse PDE problems
Yu, J., Lu, L., Meng, X., & Karniadakis, G. E. (2022) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2022.114823 · Cited by 722
Self-citation
Metadata
- Authors
- Yazdani, A., Lu, L., Raissi, M., & Karniadakis, G. E.
- Venue
- PLOS Computational Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2020-11-18
- Volume
- 16
- Issue
- 11
- Pages
- e1007575
- ISSN
- 1553-734X (ISSN-L)
- 1553-7358
- OpenAlex
- W3099892132
- Cited by
- 329
- References
- 46
- FWCI
- 9.75
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.