The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Perspective: Sloppiness and emergent theories in physics, biology, and beyond
Abstract
Large scale models of physical phenomena demand the development of new statistical and computational tools in order to be effective. Many such models are “sloppy,” i.e., exhibit behavior controlled by a relatively small number of parameter combinations. We review an information theoretic framework for analyzing sloppy models. This formalism is based on the Fisher information matrix, which is interpreted as a Riemannian metric on a parameterized space of models. Distance in this space is a measure of how distinguishable two models are based on their predictions. Sloppy model manifolds are bounded with a hierarchy of widths and extrinsic curvatures. The manifold boundary approximation can extract the simple, hidden theory from complicated sloppy models. We attribute the success of simple effective models in physics as likewise emerging from complicated processes exhibiting a low effective dimensionality. We discuss the ramifications and consequences of sloppy models for biochemistry and science more generally. We suggest that the reason our complex world is understandable is due to the same fundamental reason: simple theories of macroscopic behavior are hidden inside complicated microscopic processes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An Algorithm for Least-Squares Estimation of Nonlinear Parameters
Marquardt, D. W. (1963) · Journal of the Society for Industrial and Applied Mathematics · doi:10.1137/0111030 · Cited by 30,728
A method for the solution of certain non-linear problems in least squares
Levenberg, K. (1944) · Quarterly of Applied Mathematics · doi:10.1090/qam/10666 · Cited by 12,359
Matrix Factorization Techniques for Recommender Systems
Koren, Y., Bell, R., & Volinsky, C. (2009) · Computer · doi:10.1109/mc.2009.263 · Cited by 11,673
Extracting and composing robust features with denoising autoencoders
Vincent, P., Larochelle, H., Bengio, Y., & Manzagol, P.-A. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390294 · Cited by 7,436
Principal component analysis in linear systems: Controllability, observability, and model reduction
Moore, B. (1981) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1981.1102568 · Cited by 5,282
More Is Different: Broken symmetry and the nature of the hierarchical structure of science.
Anderson, P. W. (1972) · Science · doi:10.1126/science.177.4047.393 · Cited by 4,018
From molecular to modular cell biology.
Hartwell, L. H., Hopfield, J. J., Leibler, S., & Murray, A. W. (1999) · Nature · doi:10.1038/35011540 · Cited by 3,632
What is principal component analysis?
Ringnér, M. (2008) · Nature Biotechnology · doi:10.1038/nbt0308-303 · Cited by 2,407
More Is Different: Broken symmetry and the nature of the hierarchical structure of science.
Anderson, P. W. (1972) · Science · Cited by 1,734
Introduction to Numerical Analysis
Stoer, J., & Bulirsch, R. (2002) · Texts in Applied Mathematics · doi:10.1007/978-0-387-21738-3 · Cited by 1,562
Wigner, E. P. (1960) · Communications on Pure and Applied Mathematics · doi:10.1002/cpa.3160130102 · Cited by 1,490
Riemann manifold langevin and hamiltonian monte carlo methods
Girolami, M., & Calderhead, B. (2011) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2010.00765.x · Cited by 1,473
Universally Sloppy Parameter Sensitivities in Systems Biology Models
Gutenkunst, R. N., Waterfall, J. J., Casey, F. P., Brown, K. S., Myers, C. R., & Sethna, J. P. (2007) · PLoS Computational Biology · doi:10.1371/journal.pcbi.0030189 · Cited by 1,261
Self-citationKirschner, M., & Gerhart, J. (1998) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.95.15.8420 · Cited by 1,129
Spontaneous evolution of modularity and network motifs
Kashtan, N., & Alon, U. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0503610102 · Cited by 878
A Survey of Model Reduction by Balanced Truncation and Some New Results
Gugercin, S., & Antoulas, A. C. (2004) · International Journal of Control · doi:10.1080/00207170410001713448 · Cited by 831
A Course in Robust Control Theory
Dullerud, G. E., & Paganini, F. (2000) · Texts in Applied Mathematics · doi:10.1007/978-1-4757-3290-0 · Cited by 769
The Roles of APC and Axin Derived from Experimental and Theoretical Analysis of the Wnt Pathway
Lee, E., Salic, A., Krüger, R., Heinrich, R., & Kirschner, M. W. (2003) · PLoS Biology · doi:10.1371/journal.pbio.0000010 · Cited by 708
Relative Curvature Measures of Nonlinearity
Bates, D. M., & Watts, D. G. (1980) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1980.tb01094.x · Cited by 600
Cutler, A., & Breiman, L. (1994) · Technometrics · doi:10.1080/00401706.1994.10485840 · Cited by 551
A subspace approach to balanced truncation for model reduction of nonlinear control systems
Lall, S., Marsden, J. E., & Glavaški, S. (2002) · International Journal of Robust and Nonlinear Control · doi:10.1002/rnc.657 · Cited by 532
Confidence Regions in Non-Linear Estimation
Beale, E. M. L. (1960) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1960.tb00353.x · Cited by 478
The evolutionary origins of modularity
Clune, J., Mouret, J.-B., & Lipson, H. (2013) · Proceedings of the Royal Society B: Biological Sciences · doi:10.1098/rspb.2012.2863 · Cited by 466
Energy-minimizing kinematics in hovering insect flight
BERMAN, G. J., & WANG, Z. J. (2007) · Journal of Fluid Mechanics · doi:10.1017/s0022112007006209 · Cited by 439
Statistical mechanical approaches to models with many poorly known parameters.
Brown, K. S., & Sethna, J. P. (2003) · Physical Review E · doi:10.1103/physreve.68.021904 · Cited by 398
Self-citationDyson, F. (2004) · Nature · doi:10.1038/427297a · Cited by 318
Parameter Space Compression Underlies Emergent Theories and Predictive Models
Machta, B. B., Chachra, R., Transtrum, M. K., & Sethna, J. P. (2013) · Science · doi:10.1126/science.1238723 · Cited by 285
Self-citationThe statistical mechanics of complex signaling networks: Nerve growth factor signaling.
Brown, K. S., Hill, C. C., Calero, G. A., Myers, C. R., Lee, K. H., Sethna, J. P., & Cerione, R. A. (2004) · Physical Biology · doi:10.1088/1478-3967/1/3/006 · Cited by 265
Self-citationLumping Analysis in Monomolecular Reaction Systems. Analysis of the Exactly Lumpable System
Wei, J., & Kuo, J. C. W. (1969) · Industrial & Engineering Chemistry Fundamentals · doi:10.1021/i160029a019 · Cited by 256
Archetypal analysis for machine learning and data mining
Mørup, M., & Hansen, L. K. (2012) · Neurocomputing · doi:10.1016/j.neucom.2011.06.033 · Cited by 226
Geometry of nonlinear least squares with applications to sloppy models and optimization
Transtrum, M. K., Machta, B. B., & Sethna, J. P. (2011) · Physical Review E · doi:10.1103/physreve.83.036701 · Cited by 201
Self-citationSloppiness, robustness, and evolvability in systems biology
Daniels, B. C., Chen, Y.-J., Sethna, J. P., Gutenkunst, R. N., & Myers, C. R. (2008) · Current Opinion in Biotechnology · doi:10.1016/j.copbio.2008.06.008 · Cited by 192
Self-citationWhy are Nonlinear Fits to Data so Challenging?
Transtrum, M. K., Machta, B. B., & Sethna, J. P. (2010) · Physical Review Letters · doi:10.1103/physrevlett.104.060201 · Cited by 181
Self-citationSloppy-model universality class and the Vandermonde matrix.
Waterfall, J. J., Casey, F. P., Gutenkunst, R. N., Brown, K. S., Myers, C. R., Brouwer, P. W., Elser, V., & Sethna, J. P. (2006) · Physical Review Letters · doi:10.1103/physrevlett.97.150601 · Cited by 164
Self-citationSloppy models, parameter uncertainty, and the role of experimental design
Apgar, J. F., Witmer, D. K., White, F. M., & Tidor, B. (2010) · Molecular BioSystems · doi:10.1039/b918098b · Cited by 146
Model Reduction by Manifold Boundaries
Transtrum, M. K., & Qiu, P. (2014) · Physical Review Letters · doi:10.1103/physrevlett.113.098701 · Cited by 134
Self-citationMaximum entropy and Bayesian data analysis: Entropic prior distributions
Caticha, A., & Preuss, R. (2004) · Physical Review E · doi:10.1103/physreve.70.046127 · Cited by 117
Ivancevic, V. G., & Ivancevic, T. T. (2007) · WORLD SCIENTIFIC eBooks · doi:10.1142/6420 · Cited by 110
Parameter Transformations for Improved Approximate Confidence Regions in Nonlinear Least Squares
Bates, D. M., & Watts, D. G. (1981) · The Annals of Statistics · doi:10.1214/aos/1176345633 · Cited by 106
Daniels, B. C., & Nemenman, I. M. (2015) · PLoS ONE · doi:10.1371/journal.pone.0119821 · Cited by 95
Self-citationErguler, K., & Stumpf, M. P. H. (2011) · Molecular BioSystems · doi:10.1039/c0mb00107d · Cited by 91
Casey, F. P., Baird, D., Feng, Q., Gutenkunst, R. N., Waterfall, J. J., Myers, C. R., Brown, K. S., Cerione, R. A., & Sethna, J. P. (2007) · IET Systems Biology · doi:10.1049/iet-syb:20060065 · Cited by 77
Self-citationA multi-time-scale analysis of chemical reaction networks: I. Deterministic systems
Lee, C. H., & Othmer, H. G. (2009) · Journal of Mathematical Biology · doi:10.1007/s00285-009-0269-4 · Cited by 69
Convex Non-negative Matrix Factorization in the Wild
Thurau, C., Kersting, K., & Bauckhage, C. (2009) · Proceedings · doi:10.1109/icdm.2009.55 · Cited by 59
A Relative Off set Orthogonality Convergence Criterion for Nonlinear least Squares
Bates, D. M., & Watts, D. G. (1981) · Technometrics · doi:10.1080/00401706.1981.10486262 · Cited by 56
Identification of neutral biochemical network models from time series data
Vilela, M., Vinga, S., Maia, M. A. G. M., Voit, E. O., & Almeida, J. S. (2009) · BMC Systems Biology · doi:10.1186/1752-0509-3-47 · Cited by 46
Calculation of intrinsic and parameter-effects curvatures for nonlinear regression models
Bates, D. M., Hamilton, D. C., & Watts, D. G. (1983) · Communications in Statistics - Simulation and Computation · doi:10.1080/03610918308812333 · Cited by 43
Optimal experiment selection for parameter estimation in biological differential equation models
Transtrum, M. K., & Qiu, P. (2012) · BMC Bioinformatics · doi:10.1186/1471-2105-13-181 · Cited by 34
Self-citationSloppiness, Modeling, and Evolution in Biochemical Networks
Gutenkunst, R. N. (2007) · eCommons (Cornell University) · Cited by 28
Ditlev, J. A., Mayer, B. J., & Loew, L. M. (2013) · Biophysical Journal · doi:10.1016/j.bpj.2012.12.044 · Cited by 26
Comment on “Sloppy models, parameter uncertainty, and the role of experimental design”
Chachra, R., Transtrum, M. K., & Sethna, J. P. (2011) · Molecular BioSystems · doi:10.1039/c1mb05046j · Cited by 21
Self-citation
Cited by
The application of principal component analysis to drug discovery and biomedical data
Giuliani, A. (2017) · Drug Discovery Today · doi:10.1016/j.drudis.2017.01.005 · Cited by 287
On the role of theory and modeling in neuroscience
Levenstein, D., Alvarez, V. A., Amarasingham, A., Azab, H., Chen, Z. S., Gerkin, R. C., Hasenstaub, A., Iyer, R., Jolivet, R. B., Marzen, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2003.13825 · Cited by 93
On the relationship between sloppiness and identifiability
Chis, O.-T., Villaverde, A. F., Banga, J. R., & Balsa-Canto, E. (2016) · Mathematical Biosciences · doi:10.1016/j.mbs.2016.10.009 · Cited by 84
A biophysical perspective on the resilience of neuronal excitability across timescales
Marom, S., & Marder, E. (2023) · Nature Reviews Neuroscience · doi:10.1038/s41583-023-00730-9 · Cited by 59
Criss, E. M., & Hofmeister, A. M. (2017) · International Journal of Modern Physics B · doi:10.1142/s0217979217502058 · Cited by 17
Metadata
- Authors
- Transtrum, M. K., Machta, B. B., Brown, K. S., Daniels, B. C., Myers, C. R., & Sethna, J. P.
- Venue
- The Journal of Chemical Physics
- Publisher
- AIP Publishing
- Published
- 2015-07-01
- Volume
- 143
- Issue
- 1
- Pages
- 010901-010901
- ISSN
- 0021-9606 (ISSN-L)
- 1089-7690
- OpenAlex
- W1862800359
- Cited by
- 311
- References
- 51
- FWCI
- 11.45
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.