The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Bayesian learning of visual chunks by human observers
Open accessAbstract
Efficient and versatile processing of any hierarchically structured information requires a learning mechanism that combines lower-level features into higher-level chunks. We investigated this chunking mechanism in humans with a visual pattern-learning paradigm. We developed an ideal learner based on Bayesian model comparison that extracts and stores only those chunks of information that are minimally sufficient to encode a set of visual scenes. Our ideal Bayesian chunk learner not only reproduced the results of a large set of previous empirical findings in the domain of human pattern learning but also made a key prediction that we confirmed experimentally. In accordance with Bayesian learning but contrary to associative learning, human performance was well above chance when pair-wise statistics in the exemplars contained no relevant information. Thus, humans extract chunks from complex visual patterns by generating accurate yet economical representations and not by encoding the full correlational structure of the input.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Brainard, D. H. (1997) · Spatial Vision · doi:10.1163/156856897x00357 · Cited by 19,702
The magical number seven, plus or minus two: Some limits on our capacity for processing information.
Miller, G. A. (1956) · Psychological Review · doi:10.1037/h0043158 · Cited by 17,812
The magical number seven, plus or minus two: Some limits on our capacity for processing information.
Miller, G. A. (1994) · Psychological Review · doi:10.1037/0033-295x.101.2.343 · Cited by 17,161
Advances in Neural Information Processing Systems 19
(2007) · The MIT Press eBooks · doi:10.52202/085713 · Cited by 15,539
Learning the parts of objects by non-negative matrix factorization
Lee, D. D., & Seung, H. S. (1999) · Nature · doi:10.1038/44565 · Cited by 13,868
Hebb, D. O. (2005) · doi:10.4324/9781410612403 · Cited by 9,825
indicated, N. A. (1950) · Journal of Consulting Psychology · doi:10.1037/h0049612 · Cited by 6,923
Information theory, inference, and learning algorithms
(2004) · Choice Reviews Online · doi:10.5860/choice.41-5949 · Cited by 6,362
Chomsky, N., & Halle, M. (1968) · Cited by 5,162
Information Theory, Inference, and Learning Algorithms
(2004) · Kybernetes · doi:10.1108/03684920410534506 · Cited by 4,937
Humans integrate visual and haptic information in a statistically optimal fashion
Ernst, M. O., & Banks, M. S. (2002) · Nature · doi:10.1038/415429a · Cited by 4,844
Hierarchical models of object recognition in cortex
Riesenhuber, M., & Poggio, T. (1999) · Nature Neuroscience · doi:10.1038/14819 · Cited by 3,309 · cited 1×
“At the core of this problem lies the task of discovering how the building blocks of a hierarchy at one level, such as words or visual chunks, are constructed from lower-level features, such as syllables or line segments (3, 4).”
BackgroundGallistel, C. R. (1990) · Cited by 2,571
Implicit learning of artificial grammars
Reber, A. S. (1967) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(67)80149-x · Cited by 2,026
Bayesian integration in sensorimotor learning
Körding, K. P., & Wolpert, D. M. (2004) · Nature · doi:10.1038/nature02169 · Cited by 2,004
Barlow, H. B. (1989) · Neural Computation · doi:10.1162/neco.1989.1.3.295 · Cited by 1,650
Word Segmentation: The Role of Distributional Cues
Saffran, J. R., Newport, E. L., & Aslin, R. N. (1996) · Journal of Memory and Language · doi:10.1006/jmla.1996.0032 · Cited by 1,405 · cited 2×
“Past attempts to study the learning of statistics and rules have been conducted in domains such as artificial grammar learning (12, 13), serial reaction times (14, 15), word segmentation from fluent speech (16, 17), and pattern abstraction from strings of words (18, 19).”
BackgroundSelf-citationObject perception as Bayesian inference
Kersten, D., Mamassian, P., & Yuille, A. (2004) · Annual Review of Psychology · doi:10.1146/annurev.psych.55.090902.142005 · Cited by 1,269 · cited 1×
“Discussion The present series of computational analyses and empirical findings extend previous Bayesian ideal observer analyses (29, 30) that have provided valuable insights into sensory and perceptual processing, to the domain of learning at the level of perception.”
ResultRule Learning by Seven-Month-Old Infants
Marcus, G. F., Vijayan, S., Bandi Rao, S., & Vishton, P. M. (1999) · Science · doi:10.1126/science.283.5398.77 · Cited by 1,244
Topics in semantic representation
Griffiths, T. L., Steyvers, M., & Tenenbaum, J. B. (2007) · Psychological Review · doi:10.1037/0033-295x.114.2.211 · Cited by 1,122
Motion illusions as optimal percepts
Weiss, Y., Simoncelli, E. P., & Adelson, E. H. (2002) · Nature Neuroscience · doi:10.1038/nn0602-858 · Cited by 1,076
Chklovskii, D. (2002) · Neuron · doi:10.1016/s0896-6273(02)00703-1 · Cited by 1,064
Word learning as Bayesian inference.
Xu, F., & Tenenbaum, J. B. (2007) · Psychological Review · doi:10.1037/0033-295x.114.2.245 · Cited by 1,033
Optimal eye movement strategies in visual search
Najemnik, J., & Geisler, W. S. (2005) · Nature · doi:10.1038/nature03390 · Cited by 848
Implicit learning and statistical learning: one phenomenon, two approaches
Perruchet, P., & Pacton, S. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.03.006 · Cited by 830
Learning at a distance I. Statistical learning of non-adjacent dependencies
Newport, E. L., & Aslin, R. N. (2004) · Cognitive Psychology · doi:10.1016/s0010-0285(03)00128-2 · Cited by 807
Self-citationUnsupervised Statistical Learning of Higher-Order Spatial Structures from Visual Scenes
Fiser, J., & Aslin, R. N. (2001) · Psychological Science · doi:10.1111/1467-9280.00392 · Cited by 805
Self-citationArtificial grammar learning by 1-year-olds leads to specific and abstract knowledge
Gomez, R. L., & Gerken, L. (1999) · Cognition · doi:10.1016/s0010-0277(99)00003-7 · Cited by 801
Noise characteristics and prior expectations in human visual speed perception
Stocker, A. A., & Simoncelli, E. P. (2006) · Nature Neuroscience · doi:10.1038/nn1669 · Cited by 797
Schenk, F. (1991) · Trends in Neurosciences · doi:10.1016/0166-2236(91)90036-t · Cited by 776
Information processing with population codes
Pouget, A., Dayan, P., & Zemel, R. (2000) · Nature Reviews Neuroscience · doi:10.1038/35039062 · Cited by 752
Statistical learning of higher-order temporal structure from visual shape sequences.
Fiser, J., & Aslin, R. Ν. (2002) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037//0278-7393.28.3.458 · Cited by 670
Self-citationStatistical learning of new visual feature combinations by infants
Fiser, J., & Aslin, R. N. (2002) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.232472899 · Cited by 637
Self-citationStructure and strength in causal induction☆
Griffiths, T. L., & Tenenbaum, J. B. (2005) · Cognitive Psychology · doi:10.1016/j.cogpsych.2005.05.004 · Cited by 612
Visual features of intermediate complexity and their use in classification
Ullman, S., Vidal-Naquet, M., & Sali, E. (2002) · Nature Neuroscience · doi:10.1038/nn870 · Cited by 600
D.O. Hebb: The Organization of Behavior, Wiley: New York; 1949
Morris, R. G. M. (1999) · Brain Research Bulletin · doi:10.1016/s0361-9230(99)00182-3 · Cited by 507
Learning the structure of event sequences.
Cleeremans, A., & McClelland, J. L. (1991) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.120.3.235 · Cited by 504
Stadler, M. A., & Frensch, P. A. (1998) · Sage eBooks · Cited by 495
Bayesian theories of conditioning in a changing world
Courville, A. C., Daw, N. D., & Touretzky, D. S. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.05.004 · Cited by 457
Signal-Driven Computations in Speech Processing
Peña, M., Bonatti, L. L., Nespor, M., & Mehler, J. (2002) · Science · doi:10.1126/science.1072901 · Cited by 451
Learning to Segment Speech Using Multiple Cues: A Connectionist Model
Christiansen, M. H., Allen, J., & Seidenberg, M. S. (1998) · Language and Cognitive Processes · doi:10.1080/016909698386528 · Cited by 356
Separating cognitive capacity from knowledge: a new hypothesis
Halford, G. S., Cowan, N., & Andrews, G. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.04.001 · Cited by 324 · cited 1×
“Classic studies of chunking in human long-term memory revealed a variety of explicit strategies, such as verbal cue formation with highly familiar facts in a given domain (8, 9), to reduce the amount of newly stored information.”
BackgroundIBA, Y. (2001) · International Journal of Modern Physics C · doi:10.1142/s0129183101001912 · Cited by 233
Encoding Multielement Scenes: Statistical Learning of Visual Feature Hierarchies.
Fiser, J., & Aslin, R. N. (2005) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.134.4.521 · Cited by 209
Self-citationVisual Object Recognition: Do We Know More Now Than We Did 20 Years Ago?
Peissig, J. J., & Tarr, M. J. (2006) · Annual Review of Psychology · doi:10.1146/annurev.psych.58.102904.190114 · Cited by 175
Ashworth, P. (1998) · Physiotherapy · doi:10.1016/s0031-9406(05)65559-9 · Cited by 165
Does Grammar Start Where Statistics Stop?
Seidenberg, M. S., MacDonald, M. C., & Saffran, J. R. (2002) · Science · doi:10.1126/science.1078094 · Cited by 142
Firth, J. R. (1955) · Transactions of the Philological Society · doi:10.1111/j.1467-968x.1955.tb00290.x · Cited by 91
Tunney, R. J., & Altmann, G. T. M. (1999) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037//0278-7393.25.5.1322 · Cited by 66
Statistical Learning of Visual Feature Hierarchies
Scalzo, F., & Piater, J. (2006) · 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvpr.2005.532 · Cited by 22
Cited by
Statistically optimal perception and learning: from behavior to neural representations
Fiser, J., Berkes, P., Orbán, G., & Lengyel, M. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.01.003 · Cited by 672
Self-citationExercising your brain: A review of human brain plasticity and training-induced learning.
Green, C. S., & Bavelier, D. (2008) · Psychology and Aging · doi:10.1037/a0014345 · Cited by 660
A Bayesian foundation for individual learning under uncertainty
Mathys, C. (2011) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2011.00039 · Cited by 655
Domain generality versus modality specificity: the paradox of statistical learning
Frost, R., Armstrong, B. C., Siegelman, N., & Christiansen, M. H. (2015) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.12.010 · Cited by 564
A review of visual memory capacity: Beyond individual items and toward structured representations
Brady, T. F., Konkle, T., & Alvarez, G. A. (2011) · Journal of Vision · doi:10.1167/11.5.4 · Cited by 556
Metadata
- Authors
- Orbán, G., Fiser, J., Aslin, R. N., & Lengyel, M.
- Venue
- Proceedings of the National Academy of Sciences
- Published
- 2008-02-19
- Volume
- 105
- Issue
- 7
- Pages
- 2745-2750
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- OpenAlex
- W2149356016
- Cited by
- 257
- References
- 50
- FWCI
- 7.47
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.