Bayesian Filtering with Multiple Internal Models: Toward a Theory of Social Intelligence
The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Abstract
To exhibit social intelligence, animals have to recognize whom they are communicating with. One way to make this inference is to select among internal generative models of each conspecific who may be encountered. However, these models also have to be learned via some form of Bayesian belief updating. This induces an interesting problem: When receiving sensory input generated by a particular conspecific, how does an animal know which internal model to update? We consider a theoretical and neurobiologically plausible solution that enables inference and learning of the processes that generate sensory inputs (e.g., listening and understanding) and reproduction of those inputs (e.g., talking or singing), under multiple generative models. This is based on recent advances in theoretical neurobiology—namely, active inference and post hoc (online) Bayesian model selection. In brief, this scheme fits sensory inputs under each generative model. Model parameters are then updated in proportion to the probability that each model could have generated the input (i.e., model evidence). The proposed scheme is demonstrated using a series of (real zebra finch) birdsongs, where each song is generated by several different birds. The scheme is implemented using physiologically plausible models of birdsong production. We show that generalized Bayesian filtering, combined with model selection, leads to successful learning across generative models, each possessing different parameters. These results highlight the utility of having multiple internal models when making inferences in social environments with multiple sources of sensory information.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
The free-energy principle: a unified brain theory?
Friston, K. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2787 · Cited by 8,120 · cited 2×
“…in the context of predictive coding and usually implicate synchronous gain mechanisms via the action of inhibitory interneurons and the current connections with pyramidal cells (Fries, 2005; Womelsdorf & Fries, 2006; Saalmann & Kastner, 2009; Feldman & Friston, 2010; Buschman & Kastner, 2015).”
BackgroundMethodSelf-citationOvercoming catastrophic forgetting in neural networks
Kirkpatrick, J., Pascanu, R., Rabinowitz, N., Veness, J., Desjardins, G., Rusu, A. A., Milan, K., Quan, J., Ramalho, T., Grabska-Barwinska, A., et al. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1611835114 · Cited by 7,899
Rao, R. P. N., & Ballard, D. H. (1999) · Nature Neuroscience · doi:10.1038/4580 · Cited by 5,483 · cited 1×
“Organisms continuously infer the causes of their sensations (unconscious inference and the Bayesian brain hypothesis: Helmholtz, 1925; Knill & Pouget, 2004) and thereby predict what will happen in the immediate future (e.g., predictive coding) (Rao & Ballard, 1999; Friston, 2005).”
BackgroundHarnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication
Jaeger, H., & Haas, H. (2004) · Science · doi:10.1126/science.1091277 · Cited by 3,811
The Bayesian brain: The role of uncertainty in neural coding and computation
Knill, D. C., & Pouget, A. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.10.007 · Cited by 2,588 · cited 1×
“Organisms continuously infer the causes of their sensations (unconscious inference and the Bayesian brain hypothesis: Helmholtz, 1925; Knill & Pouget, 2004) and thereby predict what will happen in the immediate future (e.g., predictive coding) (Rao & Ballard, 1999; Friston, 2005).”
BackgroundAction video game modifies visual selective attention
Green, C. S., & Bavelier, D. (2003) · Nature · doi:10.1038/nature01647 · Cited by 2,540 · cited 2×
“In essence, the gating or selection of top-down predictions complements the gating or selection of ascending prediction errors usually associated with attention (Luck, Woodman, & Vogel, 2000; Green & Bavelier, 2003; Awh, Belopolsky, & Theeuwes, 2012).”
BackgroundCanonical Microcircuits for Predictive Coding
Bastos, A. M., Usrey, W. M., Adams, R. A., Mangun, G. R., Fries, P., & Friston, K. J. (2012) · Neuron · doi:10.1016/j.neuron.2012.10.038 · Cited by 2,421 · cited 2×
“A review of the evidence for the basic architecture and ideas can be found in several papers (Bastos et al., 2012; Adams, Shipp, & Friston, 2013; Shipp, 2016).”
BackgroundSelf-citationContinual Learning Through Synaptic Intelligence
Zenke, F., Poole, B., & Ganguli, S. (2017) · arXiv · doi:10.48550/arxiv.1703.04200 · Cited by 1,784
Uncertainty, Neuromodulation, and Attention
Yu, A. J., & Dayan, P. (2005) · Neuron · doi:10.1016/j.neuron.2005.04.026 · Cited by 1,774 · cited 1×
“…targeting cholinergic and 5HT receptors (Everitt & Robbins, 1997; Collerton, Perry, & McKeith, 2005; Vossel, Bauer, Bauer, & Mathys, 2014; Hedrick & Waters, 2015; Doya, 2002; Yu & Dayan, 2005; Dayan, 2012)—on inhibitory interneurons in superficial layers and deep pyramidal cells in deep layers.”
Neuroscience-Inspired Artificial Intelligence
Hassabis, D., Kumaran, D., Summerfield, C., & Botvinick, M. (2017) · Neuron · doi:10.1016/j.neuron.2017.06.011 · Cited by 1,557
Top-down versus bottom-up attentional control: a failed theoretical dichotomy
Awh, E., Belopolsky, A. V., & Theeuwes, J. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2012.06.010 · Cited by 1,557 · cited 2×
“) The posterior distribution of the switch Q (γ ) can be considered an attentional filter (Luck et al., 2000; Green & Bavelier, 2003; Awh et al., 2012).”
BackgroundA free energy principle for the brain
Friston, K., Kilner, J., & Harrison, L. (2006) · Journal of Physiology-Paris · doi:10.1016/j.jphysparis.2006.10.001 · Cited by 1,369
Self-citationAttention, uncertainty, and free-energy
Feldman, H., & Friston, K. J. (2010) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2010.00215 · Cited by 1,365
Self-citationCENTRAL CHOLINERGIC SYSTEMS AND COGNITION
Everitt, B. J., & Robbins, T. W. (1997) · Annual Review of Psychology · doi:10.1146/annurev.psych.48.1.649 · Cited by 1,348 · cited 1×
“…of this selection process— for example, appealing to the neuromodulatory effects of neurotransmitter systems targeting cholinergic and 5HT receptors (Everitt & Robbins, 1997; Collerton, Perry, & McKeith, 2005; Vossel, Bauer, Bauer, & Mathys, 2014; Hedrick & Waters, 2015; Doya, 2002; Yu & Dayan,…”
Active inference: a process theory
Friston, K., FitzGerald, T., Rigoli, F., Schwartenbeck, P., & Pezzulo, G. (2017) · Neural Computation · doi:10.1162/neco_a_00912 · Cited by 1,156
Self-citationPredictive coding: an account of the mirror neuron system
Kilner, J. M., Friston, K. J., & Frith, C. D. (2007) · Cognitive Processing · doi:10.1007/s10339-007-0170-2 · Cited by 1,134
Self-citationSocial intelligence, innovation, and enhanced brain size in primates
Reader, S. M., & Laland, K. N. (2002) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.062041299 · Cited by 1,126 · cited 2×
“…have shown that the volumes of certain brain structures (e.g., the hippocampus) are correlated with the performance of cognitive and social tasks (Reader & Laland, 2002; Shultz & Dunbar, 2010) and that the ability to infer another’s intentions increases with brain volume (Devaine et al., 2017).”
BackgroundThe functional logic of cortical connections
Zeki, S., & Shipp, S. (1988) · Nature · doi:10.1038/335311a0 · Cited by 1,067 · cited 1×
“This brings an interesting and complementary perspective on the divergent neuroanatomy of descending backward connections in cortical hierarchies in the brain (Zeki & Shipp, 1988; Angelucci & Bressloff, 2006).”
BackgroundDemystifying cognitive flexibility: Implications for clinical and developmental neuroscience
Dajani, D. R., & Uddin, L. Q. (2015) · Trends in Neurosciences · doi:10.1016/j.tins.2015.07.003 · Cited by 1,046 · cited 1×
“One of the most notable abilities of biological creatures is their capacity to adapt their behavior to different contexts and environments (i.e., cognitive flexibility) (Mante, Sussillo, Shenoy, & Newsome, 2013; Dajani & Uddin, 2015) through learning.”
BackgroundHierarchical Models in the Brain
Friston, K. (2008) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000211 · Cited by 952 · cited 5×
“When u(i) has been optimized, the path of the mode u̇(i) should be equal to the mode of the path Du(i), u̇(i) = Du(i), in addition to minimizing Ui(s̃, u(i),θ(i) ) (see Friston, 2008, and Friston et al., 2008, for details).”
BackgroundMethodInfluentialSelf-citationA cellular mechanism of reward-related learning
Reynolds, J. N. J., Hyland, B. I., & Wickens, J. R. (2001) · Nature · doi:10.1038/35092560 · Cited by 879
Predictions not commands: Active inference in the motor system
Adams, R. A., Shipp, S., & Friston, K. J. (2013) · Brain Structure and Function · doi:10.1007/s00429-012-0475-5 · Cited by 765
Self-citationAttentional stimulus selection through selective synchronization between monkey visual areas
Bosman, C. A., Schoffelen, J.-M., Brunet, N., Oostenveld, R., Bastos, A. M., Womelsdorf, T., Rubehn, B., Stieglitz, T., De Weerd, P., & Fries, P. (2012) · Neuron · doi:10.1016/j.neuron.2012.06.037 · Cited by 720
A Hierarchy of Time-Scales and the Brain
Kiebel, S. J., Daunizeau, J., & Friston, K. J. (2008) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000209 · Cited by 694 · cited 2×
“A generative model for birdsong generation is defined as a two-layer hierarchical generative model as mentioned in previous studies (Kiebel et al., 2008; Friston & Kiebel, 2009), in which each layer has three or four hidden states that express biological neural circuits for birdsong generation.”
BackgroundMethodSelf-citationAction understanding and active inference
Friston, K., Mattout, J., & Kilner, J. (2011) · Biological Cybernetics · doi:10.1007/s00422-011-0424-z · Cited by 665
Self-citationMind Blindness and the Brain in Autism
Frith, U. (2001) · Neuron · doi:10.1016/s0896-6273(01)00552-9 · Cited by 637
Expert Gate: Lifelong Learning with a Network of Experts
Aljundi, R., Chakravarty, P., & Tuytelaars, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.753 · Cited by 619
A critical time window for dopamine actions on the structural plasticity of dendritic spines
Yagishita, S., Hayashi-Takagi, A., Ellis-Davies, G. C. R., Urakubo, H., Ishii, S., & Kasai, H. (2014) · Science · doi:10.1126/science.1255514 · Cited by 614
Perceptions as Hypotheses: Saccades as Experiments
Friston, K., Adams, R. A., Perrinet, L., & Breakspear, M. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00151 · Cited by 462
Self-citationRobust timing and motor patterns by taming chaos in recurrent neural networks
Laje, R., & Buonomano, D. V. (2013) · Nature Neuroscience · doi:10.1038/nn.3405 · Cited by 454
Attention reverses the effect of prediction in silencing sensory signals
Kok, P., Rahnev, D., Jehee, J. F. M., Lau, H. C., & de Lange, F. P. (2012) · Cerebral Cortex · doi:10.1093/cercor/bhr310 · Cited by 430
Neuromodulators control the polarity of spike-timing-dependent synaptic plasticity
Seol, G. H., Ziburkus, J., Huang, S., Song, L., Kim, I. T., Takamiya, K., Huganir, R. L., Lee, H.-K., & Kirkwood, A. (2007) · Neuron · doi:10.1016/j.neuron.2007.08.013 · Cited by 429
Great Expectations: Is there Evidence for Predictive Coding in Auditory Cortex?
Heilbron, M., & Chait, M. (2018) · Neuroscience · doi:10.1016/j.neuroscience.2017.07.061 · Cited by 428
Social competence: an evolutionary approach
Taborsky, B., & Oliveira, R. F. (2012) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2012.09.003 · Cited by 419
The graphical brain: Belief propagation and active inference
Friston, K. J., Parr, T., & de Vries, B. (2017) · Network Neuroscience · doi:10.1162/netn_a_00018 · Cited by 415
Self-citationTowards a mathematical theory of cortical micro-circuits
George, D., & Hawkins, J. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000532 · Cited by 404 · cited 1×
“We assume that the same generative structure is used by the brain as an internal generative model; however the brain needs to learn underlying model parameters to infer the values of hidden states (Dayan, Hinton, Neal, & Zemel, 1995; Friston, Kilner, & Harrison, 2006; George & Hawkins, 2009).”
BackgroundFriston, K., & Frith, C. (2015) · Consciousness and Cognition · doi:10.1016/j.concog.2014.12.003 · Cited by 359 · cited 2×
“Previous studies have modeled communication between agents in analogy with the mirror neuron system (Kilner, Friston, & Frith, 2007; Friston, Mattout, & Kilner, 2011; Friston & Frith, 2015a, 2015b).”
MethodSelf-citationNeural elements for predictive coding
Shipp, S. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.01792 · Cited by 340
DEM: A variational treatment of dynamic systems
Friston, K. J., Trujillo-Barreto, N., & Daunizeau, J. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.02.054 · Cited by 278 · cited 1×
“When u(i) has been optimized, the path of the mode u̇(i) should be equal to the mode of the path Du(i), u̇(i) = Du(i), in addition to minimizing Ui(s̃, u(i),θ(i) ) (see Friston, 2008, and Friston et al., 2008, for details).”
MethodWhittington, J. C. R., & Bogacz, R. (2017) · Neural Computation · doi:10.1162/neco_a_00949 · Cited by 278 · cited 1×
“A theoretical comparison also supports a close link between learning mechanisms in predictive coding and backpropagation (Whittington & Bogacz, 2017).”
BackgroundActive inference, communication and hermeneutics
Friston, K. J., & Frith, C. D. (2015) · Cortex · doi:10.1016/j.cortex.2015.03.025 · Cited by 266 · cited 2×
“Previous studies have modeled communication between agents in analogy with the mirror neuron system (Kilner, Friston, & Frith, 2007; Friston, Mattout, & Kilner, 2011; Friston & Frith, 2015a, 2015b).”
MethodSelf-citationTani, J., & Nolfi, S. (1999) · Neural Networks · doi:10.1016/s0893-6080(99)00060-x · Cited by 259
Knowing one's place: a free-energy approach to pattern regulation
Friston, K., Levin, M., Sengupta, B., & Pezzulo, G. (2015) · Journal of The Royal Society Interface · doi:10.1098/rsif.2014.1383 · Cited by 234
Self-citationGABA promotes the competitive selection of dendritic spines by controlling local Ca2+ signaling
Hayama, T., Noguchi, J., Watanabe, S., Takahashi, N., Hayashi-Takagi, A., Ellis-Davies, G. C. R., Matsuzaki, M., & Kasai, H. (2013) · Nature Neuroscience · doi:10.1038/nn.3496 · Cited by 193
Twenty-Five Lessons from Computational Neuromodulation
Dayan, P. (2012) · Neuron · doi:10.1016/j.neuron.2012.09.027 · Cited by 190
Hierarchical MOSAIC for movement generation.
Haruno, M., Wolpert, D. M., & Kawato, M. (2003) · International Congress Series · doi:10.1016/s0531-5131(03)00190-0 · Cited by 132 · cited 2×
“From the perspective of optimal control theory and machine learning, this has clear homologues with selection from mixtures of experts in motor control (Tani & Nolfi, 1999; Haruno et al., 2003) and, indeed, any selective process that involves mutual or lateral inhibition leading to a winner-takes-alll-ike behavior (Ze…”
Background
Cited by
Vuust, P., Heggli, O. A., Friston, K. J., & Kringelbach, M. L. (2022) · Nature Reviews Neuroscience · doi:10.1038/s41583-022-00578-5 · Cited by 388
Self-citationMental Time Travel? A Neurocognitive Model of Event Simulation.
Addis, D. R. (2020) · Review of Philosophy and Psychology · doi:10.1007/s13164-020-00470-0 · Cited by 225
Predictive coding and stochastic resonance as fundamental principles of auditory phantom perception.
Schilling, A., Sedley, W., Gerum, R., Metzner, C., Tziridis, K., Maier, A., Schulze, H., Zeng, F.-G., Friston, K. J., & Krauss, P. (2023) · Brain · doi:10.1093/brain/awad255 · Cited by 70
Self-citationFederated inference and belief sharing
Friston, K. J., Parr, T., Heins, C., Constant, A., Friedman, D., Isomura, T., Fields, C., Verbelen, T., Ramstead, M., Clippinger, J., et al. (2024) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105500 · Cited by 30
“We will associate the implicit exchange of sufficient statistics with communication in general, and language in particular (Isomura et al., 2019).”
BackgroundSelf-citationEmbodied object representation learning and recognition
Van de Maele, T., Verbelen, T., Çatal, O., & Dhoedt, B. (2022) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2022.840658 · Cited by 9
“For example, the representation of multiple internal models, or hypothesis for the sources of sensory information, has been explored in the context of birdsong and social exchange in the auditory domain (Isomura et al., 2019).”
Background
Metadata
- Authors
- Isomura, T., Parr, T., & Friston, K.
- Venue
- Neural Computation
- Publisher
- MIT Press - Journals
- Published
- 2019-12
- Volume
- 31
- Issue
- 12
- Pages
- 2390-2431
- ISSN
- 0899-7667 (ISSN-L)
- 1530-888X
- OpenAlex
- W2980655938
- Cited by
- 38
- References
- 47
- FWCI
- 2.16
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.