Cited by 436Gene Regulatory Network AnalysisControl Systems and IdentificationMicrobial Metabolic Engineering and Bioproduction

Inferring biological networks by sparse identification of nonlinear dynamics

Open access
Mangan, Niall M., Brunton, Steven L., Proctor, Joshua L., Kutz, J. Nathan·2016·IEEE Transactions on Molecular, Biological and Multi-Scale Communications

Abstract

Inferring the structure and dynamics of network models is critical to understanding the functionality and control of complex systems, such as metabolic and regulatory biological networks. The increasing quality and quantity of experimental data enable statistical approaches based on information theory for model selection and goodness-of-fit metrics. We propose an alternative data-driven method to infer networked nonlinear dynamical systems by using sparsity-promoting optimization to select a subset of nonlinear interactions representing dynamics on a network. In contrast to standard model selection methods-based upon information content for a finite number of heuristic models (order 10 or less), our model selection procedure discovers a parsimonious model from a combinatorially large set of models, without an exhaustive search. Our particular innovation is appropriate for many biological networks, where the governing dynamical systems have rational function nonlinearities with cross terms, thus requiring an implicit formulation and the equations to be identified in the null-space of a library of mixed nonlinearities, including the state and derivative terms. This method, implicit-SINDy, succeeds in inferring three canonical biological models: 1) Michaelis-Menten enzyme kinetics; 2) the regulatory network for competence in bacteria; and 3) the metabolic network for yeast glycolysis.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/tmbmc.2016.2633265

Cites

5 of 5 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Variational System Identification has been applied to identify governing equations for the evolution of materials, the spatiotemporal spread of COVID-19, and constitutive models of soft materials.

    “Variational System Identification has been applied to identify governing equations for the evolution of materials17,20,19, the spatiotemporal spread of COVID-1921,18, as well as constitutive models of soft materials22,23.”

    From Inference of weak-form partial differential equations describing migration and proliferation mechanisms in wound healing experiments on cancer cells (2025) · cites this paper as [20]

    The Conclusions describe implicit-SINDy applied to three biological models, while the SINDy section discusses identifying governing equations from data. Neither section addresses Variational System Identification applied to materials evolution, COVID-19 spread, or soft-material constitutive models; searches for those applications found no supporting passage in our copy. (LLM, conf=0.78)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 59

  1. S. Kullback and R. A. Leibler, "On Information and Sufficiency," The Annals of Mathematical Statistics, vol. 22, no. 1, pp. 79-86, mar 1951.
  2. H. Akaike, "Information theory and an extension of the maximum likeli- hood principle," in Petrov, B.N.; Csáki, F., 2nd International Symposium on Information Theory, Tsahkadsor, Armenia, USSR, September 2-8, 1971,. Budapest: Akadémiai Kiadó, 1973, pp. 267-281.
  3. K. Burnham and D. Anderson, Model Selection and Multi-Model Infer- ence, 2nd ed. Springer, 2002.
  4. C. M. Bishop and Others, Pattern recognition and machine learning. Springer New York, 2006, vol. 1.
  5. K. P. Murphy, Machine learning: a probabilistic perspective. MIT press, 2012.
  6. G. James, D. Witten, T. Hastie, and R. Tibshirani, An introduction to statistical learning. Springer, 2013.
  7. H. Zou and T. Hastie, "Regularization and variable selection via the elastic net," pp. 301-320, 2005.
  8. S. L. Brunton, J. L. Proctor, and J. N. Kutz, "Discovering governing equations from data: Sparse identification of nonlinear dynamical sys- tems," Proceedings of the National Academy of Sciences, 2016.
  9. U. Alon, "Network motifs: theory and experimental approaches." Nature reviews. Genetics, vol. 8, no. 6, pp. 450-61, 2007.
  10. M. G. Grigorov, "Global properties of biological networks," Drug Discovery Today, vol. 10, no. 5, pp. 365-372, 2005.
  11. M. Andrecut and S. A. Kauffman, "On the sparse reconstruction of gene networks," Journal of Computational Biology, vol. 15, no. 1, pp. 21-30, 2008.
  12. M. Öksüz, H. Sadikolu, and T. C ¸akir, "Sparsity as cellular objective to infer directed metabolic networks from steady-state metabolome data: A theoretical analysis," PLoS ONE, vol. 8, no. 12, pp. 1-7, 2013.
  13. T. E. M. Nordling and E. W. Jacobsen, "On Sparsity As a Criterion in Reconstructing Biochemical Networks," Proceedings of the 18th International Federation of Automatic Control (IFAC) World Congress, 2011, no. 2007, pp. 11 672-11 678, 2011.
  14. D. G. Spiller, C. D. Wood, D. A. Rand, and M. R. H. White, "Measurement of single-cell dynamics," Nature, vol. 465, no. June, pp. 736-745, 2010.
  15. M. Wu and A. K. Singh, "Single-cell protein analysis," Current Opinion in Biotechnology, vol. 23, no. 1, pp. 83-88, 2012.
  16. G. Schwarz, "Estimating the dimension of a model," The Annals of Statistics, no. 6, pp. 461-464, 1978.
  17. G. Claeskens and N. L. Hjorth, Model Selection and Model Averaging. Cambridge University Press, 2008.
  18. J. Wright, A. Yang, A. Ganesh, S. Sastry, and Y. Ma, "Robust Face Recognition via Sparse Representation," IEEE Trans. on Pattern Anal- ysis and Machine Intelligence, vol. 31, no. 2, pp. 210-227, 2009.
  19. Q. Qu, J. Sun, and J. Wright, "Finding a sparse vector in a subspace: Linear sparsity using alternating directions," in Advances in Neural Information Processing Systems 27, 2014, pp. 3401--3409.
  20. R. Tibshirani, T. Hastie, B. Narasimhan, and G. Chu, "Diagnosis of multiple cancer types by shrunken centroids of gene expression," Proceedings of the National Academy of the Sciences, vol. 99, no. 10, pp. 6567-6572, 2002.
  21. H. Zou, T. Hastie, and R. Tibshirani, "Sparse Principal Component Analysis," J. Comp. and Graphical Statistics, vol. 15, no. 2, pp. 262- 286, 2006.
  22. D. L. Donoho, "Compressed sensing," IEEE Transactions on Informa- tion Theory, vol. 52, no. 4, pp. 1289-1306, 2006.
  23. E. J. Candès, "Compressive Sensing," Proceedings of the International Congress of Mathematics, 2006.
  24. R. G. Baraniuk, "Compressive sensing," IEEE Signal Processing Mag- azine, vol. 24, no. 4, pp. 118-120, 2007.
  25. W. X. Wang, R. Yang, Y. C. Lai, V. Kovanis, and C. Grebogi, "Predicting catastrophes in nonlinear dynamical systems by compressive sensing," Physical Review Letters, vol. 106, no. 15, pp. 1-4, 2011.
  26. V. Ozolicnš, R. Lai, R. Caflisch, and S. Osher, "Compressed modes for variational problems in mathematics and physics," Proceedings of the National Academy of Sciences, vol. 110, no. 46, pp. 18 368-18 373, 2013.
  27. H. Schaeffer, R. Caflisch, C. D. Hauck, and S. Osher, "Sparse dynamics for partial differential equations," Proceedings of the National Academy of Sciences USA, vol. 110, no. 17, pp. 6634-6639, 2013.
  28. I. Bright, G. Lin, and J. N. Kutz, "Compressive sensing and machine learning strategies for characterizing the flow around a cylinder with limited pressure measurements," Physics of Fluids, vol. 25, pp. 127 102- 127 115, 2013.
  29. S. L. Brunton, J. H. Tu, I. Bright, and J. N. Kutz, "Compressive sensing and low-rank libraries for classification of bifurcation regimes in nonlinear dynamical systems," SIAM Journal on Applied Dynamical Systems, vol. 13, no. 4, pp. 1716-1732, 2014.
  30. A. Mackey, H. Schaeffer, and S. Osher, "On the Compressive Spectral Method," Multiscale Modeling & Simulation, vol. 12, no. 4, pp. 1800- 1827, 2014.
  31. S. L. Brunton and B. R. Noack, "Closed-loop turbulence control: Progress and challenges," Applied Mechanics Reviews, vol. 67, no. 050801, pp. 1-48, 2015.
  32. C. Line, T. Hastie, D. Witten, and B. Ersbøll, "Sparse discriminant analysis," Technometrics, vol. 53, no. 4, pp. 406-413, 2011.
  33. D. L. Donoho and X. Huo, "Uncertainty principles and ideal atomic decomposition," IEEE Trans. Info. Theory, vol. 47, no. 7, pp. 2845- 2862, 2001.
  34. D. L. Donoho and M. Elad, "Optimally sparse representation in general (nonorthogonal) dictionaries via lˆ1 minimization," Proc. Natl. Acad. Sci., vol. 5, no. 100, pp. 2197-2202, 2003.
  35. A. Tropp, A. C. Gilbert, S. Muthukrishnan, and M. J. Strauss, "Im- proved sparse approximation over quasi-incoherent dictionaries,," IEEE International conference on image processing ICIP, pp. 37-40, 2003.
  36. A. C. Gilbert, S. Muthukrishnan, and M. J. Strauss, "Approximation of Functions over Redundant Dictionaries Using Coherence," Proc. 2003 SIAM Symposium on Discrete Algorithms SODA, pp. 243-252, 2003.
  37. J. A. Tropp, "Greed is good: Algorithmic results for sparse approxima- tion," IEEE Transactions on Information Theory, vol. 50, no. 10, pp. 2231-2242, 2004.
  38. B. O. Koopman, "Hamiltonian Systems and Transformation in Hilbert Space," Proceedings of the National Academy of Sciences, vol. 17, no. 5, pp. 315-318, 1931.
  39. I. Mezic, "Analysis of fluid flows via spectral properties of the Koopman operator," Annual Review of Fluid Mechanics, vol. 45, pp. 357-378, 2013.
  40. M. Budišić, R. Mohr, and I. Mezić, "Applied Koopmanism a)," Chaos: An Interdisciplinary Journal of Nonlinear Science, vol. 22, no. 4, p. 47510, 2012.
  41. I. Mezić, "Spectral properties of dynamical systems, model reduction and decompositions," Nonlinear Dynamics, vol. 41, no. 1-3, pp. 309- 325, 2005.
  42. A. J. Majda and J. Harlim, "Physics constrained nonlinear regression models for time series," Nonlinearity, vol. 26, no. 1, p. 201, 2012.
  43. M. Schmidt and H. Lipson, "Distilling free-form natural laws from experimental data," Science, vol. 324, no. 5923, pp. 81-85, 2009.
  44. L. I. Rudin, S. Osher, and E. Fatemi, "Nonlinear total variation based noise removal algorithms," Physica D: Nonlinear Phenomena, vol. 60, no. 1, pp. 259-268, 1992.
  45. R. Chartrand, "Numerical differentiation of noisy, nonsmooth data," ISRN Applied Mathematics, vol. 2011, 2011.
  46. J. Gunawardena, "Time-scale separation -Michaelis and Menten's old idea, still bearing fruit," FEBS Journal, vol. 281, no. 2, pp. 473-488, 2014.
  47. Michaelis L & Menten M, "Die kinetik der Invertinwirkung." Biochem Z, vol. 49, pp. 333-369, 1913.
  48. K. A. Johnson and R. S. Goody, "The original Michaelis constant: Translation of the 1913 Michaelis-Menten Paper," Biochemistry, vol. 50, no. 39, pp. 8264-8269, 2011.
  49. G. E. Briggs, "A Further Note on the Kinetics of Enzyme Action." The Biochemical journal, vol. 19, no. 6, pp. 1037-1038, 1925.
  50. G. M. Süel, J. Garcia-Ojalvo, L. M. Liberman, and M. B. Elowitz, "An excitable gene regulatory circuit induces transient cellular differentia- tion." Nature, vol. 440, no. 7083, pp. 545-550, 2006.
  51. P. E. Hardin, "The circadian timekeeping system of Drosophila." Current biology : CB, vol. 15, no. 17, pp. R714-22, 2005.
  52. J.-C. Leloup and A. Goldbeter, "Toward a detailed computational model for the mammalian circadian clock." Proceedings of the National Academy of Sciences, vol. 100, no. 12, pp. 7051-6, 2003.
  53. E. Batchelor, A. Loewer, and G. Lahav, "The ups and downs of p53: understanding protein dynamics in single cells." Nature reviews. Cancer, vol. 9, no. 5, pp. 371-377, 2009.
  54. E. Racker, "From Pasteur to Mitchell: a hundred years of bioenergetics." Federation proceedings, vol. 39, no. 2, pp. 210-5, feb 1980.
  55. M. L. Yarmush and S. Banta, "Metabolic engineering: advances in modeling and intervention in health and disease." Annual review of biomedical engineering, vol. 5, pp. 349-381, 2003.
  56. D. I. Ellis and R. Goodacre, "Metabolomics-assisted synthetic biology," Current Opinion in Biotechnology, vol. 23, no. 1, pp. 22-28, 2012.
  57. D. C. Ducat, J. C. Way, and P. A. Silver, "Engineering cyanobacteria to generate high-value products." Trends in biotechnology, vol. 29, no. 2, pp. 95-103, feb 2011.
  58. J. Wolf and R. Heinrich, "Effect of cellular interaction on glycolytic os- cillations in yeast: a theoretical investigation." The Biochemical journal, vol. 345 Pt 2, pp. 321-334, 2000.
  59. M. D. Schmidt, R. R. Vallabhajosyula, J. W. Jenkins, J. E. Hood, A. S. Soni, J. P. Wikswo, and H. Lipson, "Automated refinement and inference of analytical models for metabolic networks." Physical biology, vol. 8, no. 5, p. 055011, 2011.

Cited by

Sorted by citations

Authors
Mangan, N. M., Brunton, S. L., Proctor, J. L., & Kutz, J. N.
Affiliations
  • University of Washington (US)
  • Institute for Disease Modeling (US)
Venue
IEEE Transactions on Molecular, Biological and Multi-Scale Communications
Published
2016-06
Volume
2
Issue
1
Pages
52-63
ISSN
  • 2332-7804 (ISSN-L)
  • 2372-2061
OpenAlex
W2402945115
Cited by
436
References
5
Citations by year
2026: 36 · 2025: 59 · 2024: 54 · 2023: 70 · 2022: 44 · 2021: 40 · 2020: 46 · 2019: 55 · 2018: 24 · 2017: 8
FWCI
15.08
Type
journal article
Language
en
Open access
Locations
  • IEEE Transactions on Molecular Biological and Multi-Scale Communications (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Funders
Defense Advanced Research Projects Agency (HR0011-16-C-0016)
Topics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene Regulatory Network Analysis
  • Physical Sciences › Engineering › Control and Systems Engineering › Control Systems and Identification
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Microbial Metabolic Engineering and Bioproduction
Keywords
sparse identification of nonlinear dynamics, biological network inference, nonlinear dynamical systems, yeast glycolysis, metabolic networks, model selection

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review