The DOI matches its Crossref record; 69 of the 69 references it cites were found in a registry or an index.
The discovery of structural form
Open accessAbstract
Algorithms for finding structure in data have become increasingly important both as tools for scientific data analysis and as models of human learning, yet they suffer from a critical limitation. Scientists discover qualitatively new forms of structure in observed data: For instance, Linnaeus recognized the hierarchical organization of biological species, and Mendeleev recognized the periodic structure of the chemical elements. Analogous insights play a pivotal role in cognitive development: Children discover that object category labels can be organized into hierarchies, friendship networks are organized into cliques, and comparative relations (e.g., “bigger than” or “better than”) respect a transitive order. Standard algorithms, however, can only learn structures of a single form that must be specified in advance: For instance, algorithms for hierarchical clustering create tree structures, whereas algorithms for dimensionality-reduction create low-dimensional spaces. Here, we present a computational model that learns structures of many different forms and that discovers which form is best for a given dataset. The model makes probabilistic inferences over a space of graph grammars representing trees, linear orders, multidimensional spaces, rings, dominance hierarchies, cliques, and other forms and successfully discovers the underlying structure of a variety of physical, biological, and social domains. Our approach brings structure learning methods closer to human abilities and may lead to a deeper computational understanding of cognitive development.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Structure of Scientific Revolutions
Kuhn, T. S., & Schlegel, R. (1963) · Physics Today · doi:10.1063/1.3050879 · Cited by 35,538
Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2003) · doi:10.1201/9780429258480 · Cited by 27,276
MRBAYES: Bayesian inference of phylogenetic trees.
Huelsenbeck, J. P., & Ronquist, F. (2001) · Bioinformatics · doi:10.1093/bioinformatics/17.8.754 · Cited by 21,937
(2012) · Encyclopedia of the Sciences of Learning · doi:10.1007/978-1-4419-1428-6_5195 · Cited by 19,370
Kohonen, T. (2001) · Springer Series in Information Sciences · doi:10.1007/978-3-642-56927-2 · Cited by 16,019
Parallel Distributed Processing: Explorations in the Microstructure of Cognition: Foundations
Rumelhart, D. E., McClelland, J. L., & AU (1986) · doi:10.7551/mitpress/5236.001.0001 · Cited by 15,686
Community structure in social and biological networks
Girvan, M., & Newman, M. E. J. (2002) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.122653799 · Cited by 15,502
ASPECTS OF THE THEORY OF SYNTAX
Chomsky, N. (1964) · doi:10.21236/ad0616323 · Cited by 13,587
LIII. On lines and planes of closest fit to systems of points in space
Pearson, K. (1901) · The London, Edinburgh, and Dublin Philosophical Magazine and Journal of Science · doi:10.1080/14786440109462720 · Cited by 11,934
Rescorla, R. A. (1972) · Medical Entomology and Zoology · Cited by 9,461
Cited by
How to grow a mind: Statistics, structure, and abstraction
Tenenbaum, J. B., Kemp, C., Griffiths, T. L., & Goodman, N. D. (2011) · Science · doi:10.1126/science.1192788 · Cited by 1,815
Self-citationComorbidity: a network perspective
Cramer, A. O. J., Waldorp, L. J., van der Maas, H. L. J., & Borsboom, D. (2010) · Behavioral and Brain Sciences · doi:10.1017/s0140525x09991567 · Cited by 1,575
A simple neural network module for relational reasoning
Santoro, A., Raposo, D., Barrett, D. G. T., Malinowski, M., Pascanu, R., Battaglia, P., & Lillicrap, T. (2017) · arXiv · doi:10.48550/arxiv.1706.01427 · Cited by 1,281
“The ability to reason about the relations between entities and their properties is central to generally intelligent behavior (Figure 1) [10, 7].”
BackgroundWhat Is a Cognitive Map? Organizing Knowledge for Flexible Behavior
Behrens, T. E. J., Muller, T. H., Whittington, J. C. R., Mark, S., Baram, A. B., Stachenfeld, K. L., & Kurth-Nelson, Z. (2018) · Neuron · doi:10.1016/j.neuron.2018.10.002 · Cited by 1,055
What do we mean by prediction in language comprehension?
Kuperberg, G. R., & Jaeger, T. F. (2016) · Language, Cognition and Neuroscience · doi:10.1080/23273798.2015.1102299 · Cited by 1,087
“…et al., 2009; Kleinschmidt & Jaeger, 2015; Kleinschmidt, Raizada, & Jaeger, 2015; Sonderegger & Yu, 2010; Toscano & McMurray, 2010), while semantic categories (Kemp & Tenenbaum, 2008) or topics (Griffiths, Steyvers, & Tenenbaum, 2007; Qian & Jaeger, 2011) can be understood as generating words.”
Probabilistic brains: knowns and unknowns
Pouget, A., Beck, J. M., Ma, W. J., & Latham, P. E. (2013) · Nature Neuroscience · doi:10.1038/nn.3495 · Cited by 615
“Structural learning—learning the structure of a task given data 73,74 — is a difficult problem: it is based on an impoverished feedback signal (typically only a positive reward for correct answers) and the reward does not explicitly specify which sensory variables or which motor actions matter.”
BackgroundStatistically optimal perception and learning: from behavior to neural representations
Fiser, J., Berkes, P., Orbán, G., & Lengyel, M. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.01.003 · Cited by 672
Whittington, J. C. R., Muller, T. H., Mark, S., Chen, G., Barry, C., Burgess, N., & Behrens, T. E. J. (2020) · Cell · doi:10.1016/j.cell.2020.10.024 · Cited by 660
Probabilistic models of cognition: exploring representations and inductive biases
Griffiths, T. L., Chater, N., Kemp, C., Perfors, A., & Tenenbaum, J. B. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.05.004 · Cited by 568
Self-citationJones, M., & Love, B. C. (2011) · Behavioral and Brain Sciences · doi:10.1017/s0140525x10003134 · Cited by 533
A sensorimotor paradigm for Bayesian model selection
Genewein, T., & Braun, D. A. (2012) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2012.00291 · Cited by 485
A map of the inorganic ternary metal nitrides
Sun, W., Bartel, C. J., Arca, E., Bauers, S. R., Matthews, B., Orvañanos, B., Chen, B.-R., Toney, M. F., Schelhas, L. T., Tumas, W., et al. (2019) · Nature Materials · doi:10.1038/s41563-019-0396-2 · Cited by 430
Context, learning, and extinction
Gershman, S. J., Blei, D. M., & Niv, Y. (2010) · Psychological Review · doi:10.1037/a0017808 · Cited by 386
Graph Learning From Data Under Laplacian and Structural Constraints
Egilmez, H. E., Pavez, E., & Ortega, A. (2017) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2017.2726975 · Cited by 364
Structure Discovery in Nonparametric Regression through Compositional Kernel Search
Duvenaud, D., Lloyd, J. R., Grosse, R., Tenenbaum, J. B., & Ghahramani, Z. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1302.4922 · Cited by 340
Self-citationPrécis of Bayesian Rationality: The Probabilistic Approach to Human Reasoning
Oaksford, M., & Chater, N. (2009) · Behavioral and Brain Sciences · doi:10.1017/s0140525x09000284 · Cited by 335
Machine Translation: Mining Text for Social Theory
Evans, J. A., & Aceves, P. (2016) · Annual Review of Sociology · doi:10.1146/annurev-soc-081715-074206 · Cited by 333
Visual perception of materials and their properties
Fleming, R. W. (2014) · Vision Research · doi:10.1016/j.visres.2013.11.004 · Cited by 331
Brady, T. F., Konkle, T., & Alvarez, G. A. (2009) · Journal of Experimental Psychology: General · doi:10.1037/a0016797 · Cited by 323
How cognitive modeling can benefit from hierarchical Bayesian models
Lee, M. D. (2011) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2010.08.013 · Cited by 307
Costa, F. F. (2014) · Drug Discovery Today · doi:10.1016/j.drudis.2013.10.012 · Cited by 302
Neural Coding of Uncertainty and Probability
Ma, W. J., & Jazayeri, M. (2014) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-071013-014017 · Cited by 290
“A higher-order form of inference that has barely been studied at the neural level is structure learning (Tenenbaum & Griffiths 2001, Kemp & Tenenbaum 2008, Braun et al. 2010, Pouget et al. 2013), the process of learning generalizable rules for categorizing stimuli or performing actions.”
BackgroundThe learnability of abstract syntactic principles
Perfors, A., Tenenbaum, J. B., & Regier, T. (2011) · Cognition · doi:10.1016/j.cognition.2010.11.001 · Cited by 285
Self-citationA mathematical theory of semantic development in deep neural networks
Saxe, A. M., McClelland, J. L., & Ganguli, S. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1820226116 · Cited by 284
Structuring knowledge with cognitive maps and cognitive graphs
Peer, M., Brunec, I. K., Newcombe, N. S., & Epstein, R. A. (2021) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2020.10.004 · Cited by 283
Structured statistical models of inductive reasoning
Kemp, C., & Tenenbaum, J. B. (2009) · Psychological Review · doi:10.1037/a0014282 · Cited by 259
Self-citationFu, K., Chan, J., Cagan, J., Kotovsky, K., Schunn, C., & Wood, K. (2013) · Journal of Mechanical Design · doi:10.1115/1.4023158 · Cited by 254
Braun, D. A., Mehring, C., & Wolpert, D. M. (2010) · Behavioural Brain Research · doi:10.1016/j.bbr.2009.08.031 · Cited by 210
“00 5.”
Quilty-Dunn, J., Porot, N., & Mandelbaum, E. (2023) · Behavioral and Brain Sciences · doi:10.1017/s0140525x22002849 · Cited by 205
Structured Event Memory: A neuro-symbolic model of event cognition.
Franklin, N. T., Norman, K. A., Ranganath, C., Zacks, J. M., & Gershman, S. J. (2020) · Psychological Review · doi:10.1037/rev0000177 · Cited by 177
Word meaning in minds and machines.
Lake, B. M., & Murphy, G. L. (2023) · Psychological Review · doi:10.1037/rev0000297 · Cited by 131
Model averaging, optimal inference, and habit formation
FitzGerald, T. H. B., Dolan, R. J., & Friston, K. J. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00457 · Cited by 121
Generalization of value in reinforcement learning by humans
Wimmer, G. E., Daw, N. D., & Shohamy, D. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.08017.x · Cited by 111
“Accounts of such learning are reasonably well understood (at least in the abstract, it can be accomplished by Bayesian model comparison; Griffiths & Tenenbaum, 2005; Courville et al., 2006; Kemp & Tenenbaum, 2008); however, the present experimental design is not well suited to testing them.”
BackgroundBayesian intractability is not an ailment that approximation can cure
Kwisthout, J., Wareham, T., & van Rooij, I. (2011) · Cognitive Science · doi:10.1111/j.1551-6709.2011.01182.x · Cited by 122
Hyperparameter ensembles for robustness and uncertainty quantification
Wenzel, F., Snoek, J., Tran, D., & Jenatton, R. (2020) · arXiv · doi:10.48550/arxiv.2006.13570 · Cited by 122
Gershman, S. J., Pesaran, B., & Daw, N. D. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.2469-09.2009 · Cited by 118
“…generally, future experimental and computational work should address how structure learning, which has often been studied in the context of Bayesian models of inference (Griffiths and Tenenbaum, 2005; Courville et al., 2006; Kemp and Tenenbaum, 2008) can be integrated with reinforcement learning.”
BackgroundOn the Binding Problem in Artificial Neural Networks
Greff, K., van Steenkiste, S., & Schmidhuber, J. (2020) · arXiv · doi:10.48550/arxiv.2012.05208 · Cited by 102
“Their corresponding rules for entailment give rise to different structural forms (Kemp and Tenenbaum, 2008) among their relations, such as trees, chains, rings, and cliques (see Figure 19).”
BackgroundInfluentialChallenges of human—machine collaboration in risky decision-making
Xiong, W., Fan, H., Ma, L., & Wang, C. (2022) · Frontiers of Engineering Management · doi:10.1007/s42524-021-0182-0 · Cited by 95
Production of Supra-regular Spatial Sequences by Macaque Monkeys
Jiang, X., Long, T., Cao, W., Li, J., Dehaene, S., & Wang, L. (2018) · Current Biology · doi:10.1016/j.cub.2018.04.047 · Cited by 89
Types of approximation for probabilistic cognition: Sampling and variational.
Sanborn, A. N. (2017) · Brain and Cognition · doi:10.1016/j.bandc.2015.06.008 · Cited by 45
“…their perceptual uncertainty and combine it appropriately with prior knowledge (Körding & Wolpert, 2004; Tassinari, Hudson, & Landy, 2006), and explaining how people can learn to represent an ambiguous environment in cognitive tasks (Griffiths, Steyvers, & Tenenbaum, 2007; Kemp & Tenenbaum, 2008).”
Human biases limit cumulative innovation
Thompson, B., & Griffiths, T. L. (2021) · Proceedings of the Royal Society B: Biological Sciences · doi:10.1098/rspb.2020.2752 · Cited by 40
“More structured or domain-specific priors can result from conceptual or semantic knowledge, such as intuitive physics [61], or inductive biases for particular structural forms [62].”
BackgroundA model of conceptual bootstrapping in human cognition
Zhao, B., Lucas, C. G., & Bramley, N. R. (2023) · Nature Human Behaviour · doi:10.1038/s41562-023-01719-1 · Cited by 30
Metadata
- Authors
- Kemp, C., & Tenenbaum, J. B.
- Venue
- Proceedings of the National Academy of Sciences
- Published
- 2008-08-05
- Volume
- 105
- Issue
- 31
- Pages
- 10687-10692
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- OpenAlex
- W2136445846
- Cited by
- 650
- References
- 69
- FWCI
- 54.59
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.