Methods and Techniques of Complex Systems Science: An Overview
Open accessThe DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Abstract
In this chapter, I review the main methods and techniques of complex systems science. As a first step, I distinguish among the broad patterns which recur across complex systems, the topics complex systems science commonly studies, the tools employed, and the foundational science of complex systems. The focus of this chapter is overwhelmingly on the third heading, that of tools. These in turn divide, roughly, into tools for analyzing data, tools for constructing and evaluating models, and tools for measuring complexity. I discuss the principles of statistical learning and model selection; time series analysis; cellular automata; agent-based models; the evaluation of complex-systems models; information theory; and ways of measuring complexity. Throughout, I give only rough outlines of techniques, so that readers, confronted with new problems, will have a sense of which ones might be suitable, and which ones definitely are not.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A New Approach to Linear Filtering and Prediction Problems
Kalman, R. E. (1960) · Journal of Basic Engineering · doi:10.1115/1.3662552 · Cited by 31,751
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
Numerical recipes in C: the art of scientific computing
(1993) · Choice Reviews Online · doi:10.5860/choice.30-5638 · Cited by 17,933
An Introduction to Support Vector Machines and Other Kernel-based Learning Methods
Cristianini, N., & Shawe-Taylor, J. (2000) · doi:10.1017/cbo9780511801389 · Cited by 13,855
The chemical basis of morphogenesis
Turing, A. M. (1952) · Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences · doi:10.1098/rstb.1952.0012 · Cited by 11,733 · cited 1×
“There are many other such patterns in complex systems science: “stability through hierarchically structured interactions” [4], “positive feedback leading to highly skewed outcomes” [5], “local inhibition and long-rate activation create spatial patterns” [6], and so forth.”
BackgroundCausality: Models, Reasoning, and Inference
Pearl, J. (2009) · doi:10.1017/cbo9780511803161 · Cited by 11,653
Classification And Regression Trees
Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (2017) · doi:10.1201/9781315139470 · Cited by 11,417
An Introduction to Genetic Algorithms
Mitchell, M. (1996) · doi:10.7551/mitpress/3927.001.0001 · Cited by 11,340
Detecting strange attractors in turbulence
Takens, F. (1981) · Lecture Notes in Mathematics · doi:10.1007/bfb0091924 · Cited by 10,459
Pattern formation outside of equilibrium
Cross, M. C., & Hohenberg, P. C. (1993) · Reviews of Modern Physics · doi:10.1103/revmodphys.65.851 · Cited by 7,859
Causation, Prediction, and Search
Spirtes, P., Glymour, C., & Scheines, R. (2001) · doi:10.7551/mitpress/1754.001.0001 · Cited by 4,521
Spline Models for Observational Data
Wahba, G. (1990) · doi:10.1137/1.9781611970128 · Cited by 4,184
Cybernetics. Or Control and Communication in the Animal and the Machine
N., E., & Wiener, N. (1949) · The Journal of Philosophy · doi:10.2307/2020260 · Cited by 3,590
Time Series Analysis by State Space Methods: Second Edition
Durbin, J., & Koopman, S. J. (2012) · doi:10.1093/acprof:oso/9780199641178.001.0001 · Cited by 3,301
Self-Organization in Biological Systems
Sneyd, J., Theraula, G., Bonabeau, E., Deneubourg, J.-L., & Franks, N. R. (2001) · doi:10.1515/9780691212920 · Cited by 2,949
Lattice-gas automata for the Navier-Stokes equation
Frisch, U., Hasslacher, B., & Pomeau, Y. (1986) · Physical Review Letters · doi:10.1103/physrevlett.56.1505 · Cited by 2,788
A View of the Em Algorithm that Justifies Incremental, Sparse, and other Variants
Neal, R. M., & Hinton, G. E. (1998) · Learning in Graphical Models · doi:10.1007/978-94-011-5014-9_12 · Cited by 2,187
Autopoiesis: The organization of living systems, its characterization and a model
Varela, F. G., Maturana, H. R., & Uribe, R. (1974) · Biosystems · doi:10.1016/0303-2647(74)90031-8 · Cited by 1,899
A formal theory of inductive inference. Part II
Solomonoff, R. J. (1964) · Information and Control · doi:10.1016/s0019-9958(64)90131-7 · Cited by 1,758
Churchland, P. S., & Sejnowski, T. J. (1992) · doi:10.7551/mitpress/2010.001.0001 · Cited by 1,757
An Introduction to Computational Learning Theory
Kearns, M. J., & Vazirani, U. (1994) · doi:10.7551/mitpress/3897.001.0001 · Cited by 1,697
Error and the Growth of Experimental Knowledge
Mayo, D. G. (1996) · doi:10.7208/chicago/9780226511993.001.0001 · Cited by 1,325
A formal theory of inductive inference. Part I
Solomonoff, R. J. (1964) · Information and Control · doi:10.1016/s0019-9958(64)90223-2 · Cited by 1,192
Ultimate physical limits to computation
Lloyd, S. (2000) · Nature · doi:10.1038/35023282 · Cited by 1,120
Cybernetics, or control and communication in the animal and the machine (2nd ed.).
Wiener, N. (1961) · doi:10.1037/13140-000 · Cited by 1,068
Time Series Analysis and Its Applications
Shumway, R. H., & Stoffer, D. S. (2000) · Springer Texts in Statistics · doi:10.1007/978-1-4757-3261-0 · Cited by 1,039
Statistical Explanation and Statistical Relevance
Salmon, W. C. (1971) · doi:10.2307/j.ctt6wrd9p · Cited by 543
Computational Mechanics: Pattern and Prediction, Structure and Simplicity
Shalizi, C. R., & Crutchfield, J. P. (2001) · Journal of Statistical Physics · doi:10.1023/a:1010388907793 · Cited by 471
Self-citationThe Role of Occam's Razor in Knowledge Discovery
Domingos, P. (1999) · Data Mining and Knowledge Discovery · doi:10.1023/a:1009868929893 · Cited by 459
Cited by
Baggio, R., Scott, N., & Cooper, C. (2010) · Annals of Tourism Research · doi:10.1016/j.annals.2010.02.008 · Cited by 366
Complex Systems Research in Educational Psychology: Aligning Theory and Method
Hilpert, J. C., & Marchand, G. C. (2018) · Educational Psychologist · doi:10.1080/00461520.2018.1469411 · Cited by 325
Understanding and managing the food-energy-water nexus – opportunities for water resources research
Cai, X., Wallington, K., Shafiee-Jood, M., & Marston, L. (2018) · Advances in Water Resources · doi:10.1016/j.advwatres.2017.11.014 · Cited by 307
Quantifying the Rise and Fall of Complexity in Closed Systems: The Coffee Automaton
Aaronson, S., Carroll, S. M., & Ouellette, L. (2014) · arXiv · doi:10.48550/arxiv.1405.6903 · Cited by 16
“Shalizi [8] objects to the use of such compression programs, claiming that they do not provide consistently accurate entropy estimates and that they are too slow.”
Background
Metadata
- Authors
- Shalizi, C. R.
- Venue
- Topics in Biomedical Engineering International Book Series
- Publisher
- Springer US
- Published
- 2007-06-12
- Pages
- 33-114
- OpenAlex
- W1643957516
- Cited by
- 211
- References
- 29
- FWCI
- 47.88
- Type
- book chapter
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.