Charles Bonnet Syndrome: Evidence for a Generative Model in the Cortex?
Open accessThe DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Abstract
Several theories propose that the cortex implements an internal model to explain, predict, and learn about sensory data, but the nature of this model is unclear. One condition that could be highly informative here is Charles Bonnet syndrome (CBS), where loss of vision leads to complex, vivid visual hallucinations of objects, people, and whole scenes. CBS could be taken as indication that there is a generative model in the brain, specifically one that can synthesise rich, consistent visual representations even in the absence of actual visual input. The processes that lead to CBS are poorly understood. Here, we argue that a model recently introduced in machine learning, the deep Boltzmann machine (DBM), could capture the relevant aspects of (hypothetical) generative processing in the cortex. The DBM carries both the semantics of a probabilistic generative model and of a neural network. The latter allows us to model a concrete neural mechanism that could underlie CBS, namely, homeostatic regulation of neuronal activity. We show that homeostatic plasticity could serve to make the learnt internal model robust against e.g. degradation of sensory input, but overcompensate in the case of CBS, leading to hallucinations. We demonstrate how a wide range of features of CBS can be explained in the model and suggest a potential role for the neuromodulator acetylcholine. This work constitutes the first concrete computational model of CBS and the first application of the DBM as a model in computational neuroscience. Our results lend further credence to the hypothesis of a generative model in the brain.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Neural networks and physical systems with emergent collective computational abilities.
Hopfield, J. J. (1982) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.79.8.2554 · Cited by 19,270
Rao, R. P. N., & Ballard, D. H. (1999) · Nature Neuroscience · doi:10.1038/4580 · Cited by 5,483 · cited 1×
“For example, the predictive coding model of [18] and the”
MethodTraining Products of Experts by Minimizing Contrastive Divergence
Hinton, G. E. (2002) · Neural Computation · doi:10.1162/089976602760128018 · Cited by 4,879 · cited 1×
“Second, making use of the simplified inference in such models, more effective approximate learning algorithms were developed, such as the Contrastive Divergence algorithm [60].”
MethodSparse coding with an overcomplete basis set: A strategy employed by V1?
Olshausen, B. A., & Field, D. J. (1997) · Vision Research · doi:10.1016/s0042-6989(97)00169-7 · Cited by 3,642
A learning algorithm for Boltzmann machines
Ackley, D. H., Hinton, G. E., & Sejnowski, T. J. (1985) · Cognitive Science · doi:10.1207/s15516709cog0901_7 · Cited by 3,402
Hierarchical models of object recognition in cortex
Riesenhuber, M., & Poggio, T. (1999) · Nature Neuroscience · doi:10.1038/14819 · Cited by 3,309 · cited 1×
“[94]).”
A Practical Guide to Training Restricted Boltzmann Machines
Hinton, G. E. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_32 · Cited by 2,852 · cited 1×
“the representations [61,63] (weight decay during training [64]”
BackgroundThe Bayesian brain: The role of uncertainty in neural coding and computation
Knill, D. C., & Pouget, A. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.10.007 · Cited by 2,588 · cited 1×
“Generally speaking, Bayesian approaches theoretically describe how inferences about aspects of the environment are to be made from observations under uncertainty (for reviews and introductions, see [24–26]).”
BackgroundA massively parallel architecture for a self-organizing neural pattern recognition machine
Carpenter, G. A., & Grossberg, S. (1987) · Computer Vision, Graphics, and Image Processing · doi:10.1016/s0734-189x(87)80014-2 · Cited by 2,525
An introduction to MCMC for machine learning.
Andrieu, C., de Freitas, N., Doucet, A., & Jordan, M. I. (2003) · Machine Learning · doi:10.1023/a:1020281327116 · Cited by 2,451
Lee, H., Grosse, R., Ranganath, R., & Ng, A. Y. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553453 · Cited by 2,412
Predictive coding under the free-energy principle
Friston, K., & Kiebel, S. (2009) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2008.0300 · Cited by 1,579
Consciousness as integrated information: a provisional manifesto
Tononi, G. (2008) · The Biological Bulletin · doi:10.2307/25470707 · Cited by 1,529
Hierarchical Bayesian inference in the visual cortex
Lee, T. S., & Mumford, D. (2003) · Journal of the Optical Society of America A · doi:10.1364/josaa.20.001434 · Cited by 1,473 · cited 2×
“For example, inference in a hierarchical model could describe hierarchical processing [21].”
BackgroundHinton, G. E., Krizhevsky, A., & Wang, S. D. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-21735-7_6 · Cited by 1,360 · cited 1×
“learn transformations of the content [83].”
Variability, compensation and homeostasis in neuron and network function
Marder, E., & Goaillard, J.-M. (2006) · Nature Reviews Neuroscience · doi:10.1038/nrn1949 · Cited by 1,212
Towards a true neural stance on consciousness
Lamme, V. A. F. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.09.001 · Cited by 1,149 · cited 2×
“Either could explain why the generation of conscious experience might be related to re-entrant top-down processing [92].”
BackgroundMotion illusions as optimal percepts
Weiss, Y., Simoncelli, E. P., & Adelson, E. H. (2002) · Nature Neuroscience · doi:10.1038/nn0602-858 · Cited by 1,076
The "Wake-Sleep" Algorithm for Unsupervised Neural Networks
Hinton, G. E., Dayan, P., Frey, B. J., & Neal, R. M. (1995) · Science · doi:10.1126/science.7761831 · Cited by 1,070
Crick, F., & Mitchison, G. (1983) · Nature · doi:10.1038/304111a0 · Cited by 865
Vision as Bayesian inference: analysis by synthesis?
Yuille, A., & Kersten, D. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.05.002 · Cited by 849
Statistically optimal perception and learning: from behavior to neural representations
Fiser, J., Berkes, P., Orbán, G., & Lengyel, M. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.01.003 · Cited by 672 · cited 1×
“MCMC and similar samplingbased methods have been suggested to relate to cortical probabilistic inference [26,46–51], and it is focus of our work on modelling bistable perception within the DBM framework [35,52].”
Sarter, M., Hasselmo, M. E., Bruno, J. P., & Givens, B. (2005) · Brain Research Reviews · doi:10.1016/j.brainresrev.2004.08.006 · Cited by 667
Vul (2014) · doi:10.1111/cogs.12101 · Cited by 502
Bayesian just-so stories in psychology and neuroscience.
Bowers, J. S., & Davis, C. J. (2012) · Psychological Bulletin · doi:10.1037/a0026450 · Cited by 436 · cited 1×
“We make a clarification here in light of a current debate concerned with the merit and meaning of approaches to cognition termed ‘Bayesian’ [54–58].”
BackgroundRational approximations to rational models: alternative algorithms for category learning
Sanborn, A. N., Griffiths, T. L., & Navarro, D. J. (2010) · Psychological Review · doi:10.1037/a0020511 · Cited by 369 · cited 1×
“MCMC and similar samplingbased methods have been suggested to relate to cortical probabilistic inference [26,46–51], and it is focus of our work on modelling bistable perception within the DBM framework [35,52].”
From drugs to deprivation: A Bayesian framework for understanding models of psychosis
Corlett, P. R., Frith, C. D., & Fletcher, P. C. (2009) · Psychopharmacology · doi:10.1007/s00213-009-1561-0 · Cited by 367 · cited 3×
“There is indeed evidence that sensory deprivation (in terms of general impoverishment, not just complete lack of sensory input) can cause hallucinations in healthy individuals [4,29], but there seems to have been little experimental work along that direction since the nineteen sixties [73].”
BackgroundResultDynamic Model of Visual Recognition Predicts Neural Response Properties in the Visual Cortex
Rao, R. P. N., & Ballard, D. H. (1997) · Neural Computation · doi:10.1162/neco.1997.9.4.721 · Cited by 290 · cited 1×
“purely generatively, synthesise structured images or anything akin to objects (although [82] demonstrate that memorised images can be recalled).”
BackgroundOn deep generative models with applications to recognition
Ranzato, M., Susskind, J., Mnih, V., & Hinton, G. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995710 · Cited by 237
Hallucinations and perceptual inference
Friston, K. J. (2005) · Behavioral and Brain Sciences · doi:10.1017/s0140525x05290131 · Cited by 196 · cited 2×
“A generative model moreover relates to other approaches discussed in the context of hallucinations (Bayesian inference, predictive coding, adaptive resonance; [27–29,79]).”
BackgroundGriffiths, T. L., Chater, N., Norris, D., & Pouget, A. (2012) · Psychological Bulletin · doi:10.1037/a0026884 · Cited by 192
Different glutamate receptors convey feedforward and recurrent processing in macaque V1
Self, M. W., Kooijmans, R. N., Supèr, H., Lamme, V. A., & Roelfsema, P. R. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1119527109 · Cited by 184 · cited 1×
“[87]) into simple symmetrical connections.”
The Shape Boltzmann Machine: A strong model of object shape
Eslami, S. M. A., Heess, N., & Winn, J. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247702 · Cited by 61
Is that what Bayesians believe? Reply to Griffiths, Chater, Norris, and Pouget (2012).
Bowers, J. S., & Davis, C. J. (2012) · Psychological Bulletin · doi:10.1037/a0027750 · Cited by 38
Computational Models of Hallucinations
Jardri, R., & Denève, S. (2013) · The Neuroscience of Hallucinations · doi:10.1007/978-1-4614-4121-2_16 · Cited by 16
Cited by
Hallucinations and strong priors
Corlett, P. R., Horga, G., Fletcher, P. C., Alderson-Day, B., Schmack, K., & Powers, A. R. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2018.12.001 · Cited by 534
“Indeed, a DBM to model the genesis of visual hallucinations in Charles Bonnet syndrome [106], an illness characterized by vision loss accompanied by visual hallucinations.”
A Bayesian perspective on magnitude estimation
Petzschner, F. H., Glasauer, S., & Stephan, K. E. (2015) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2015.03.002 · Cited by 327
Learning what to expect (in visual perception)
Seriès, P., & Seitz, A. R. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00668 · Cited by 194
“For example, Reichert et al. (2010, 2011, 2013) have recently proposed that the deep Boltzmann machine (DBM) offered a promising (even if idealized) description of a generative model that learns to synthesize representations of sensory data.”
BackgroundSelf-citationDeep Learning Intervention for Health Care Challenges: Some Biomedical Domain Considerations
Tobore, I., Li, J., Yuhang, L., Al-Handarish, Y., Kandwal, A., Nie, Z., & Wang, L. (2019) · JMIR mHealth and uHealth · doi:10.2196/11966 · Cited by 180
Forms of prediction in the nervous system
Teufel, C., & Fletcher, P. C. (2020) · Nature Reviews Neuroscience · doi:10.1038/s41583-020-0275-5 · Cited by 155
Metadata
- Authors
- Reichert, D. P., Seriès, P., & Storkey, A. J.
- Venue
- PLoS Computational Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2013-07-18
- Volume
- 9
- Issue
- 7
- Pages
- e1003134
- ISSN
- 1553-734X (ISSN-L)
- 1553-7358
- OpenAlex
- W1969806998
- Cited by
- 61
- References
- 36
- FWCI
- 2.36
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.