The "Wake-Sleep" Algorithm for Unsupervised Neural Networks
The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
An unsupervised learning algorithm for a multilayer network of stochastic neurons is described. Bottom-up "recognition" connections convert the input into representations in successive hidden layers, and top-down "generative" connections reconstruct the representation in one layer from the representation in the layer above. In the "wake" phase, neurons are driven by recognition connections, and generative connections are adapted to increase the probability that they would reconstruct the correct activity vector in the layer below. In the "sleep" phase, neurons are driven by generative connections, and recognition connections are adapted to increase the probability that they would produce the correct activity vector in the layer above.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“A first meta-structure pops up when considering the classical Wake-Sleep algorithm [52], described above as a model for NREM sleep (that we extended by random perturbations in the replay).”
From How Adversarial REM Dreams May Facilitate Creativity, and Why We Become Aware of Them (2024) · cites this paper as [52]
In the citing paper
“In this algorithm, the FF recognition pathway is trained during the Sleep phase so that it inverts the FB generative pathway. The generative FB pathway is itself trained during the Wake phase so that it learns to reproduce the sensory activity from the internal representation generated by the FF pathway.”
From How Adversarial REM Dreams May Facilitate Creativity, and Why We Become Aware of Them (2024) · cites this paper as [52]
In the citing paper
“Bayesian inference and related theories have been proposed as a more appropriate theoretical framework for reasoning about top-down visual processing in the brain. 1,2,4,6,26,27”
From Hierarchical Bayesian inference in the visual cortex (2003) · cites this paper as [2]
In the citing paper
“In one common form of unsupervised learning, higher brain areas attempt to produce samples that are statistically similar to those actually seen in lower layers.”
From Toward an integration of deep learning and neuroscience (2016) · cites this paper as Hinton et al., 1995
In the citing paper
“For example, the wake-sleep algorithm (Hinton et al., 1995) requires the sleep mode to sample potential data points whose distribution should then match the observed distribution.”
From Toward an integration of deep learning and neuroscience (2016) · cites this paper as Hinton et al., 1995
Citations
Cites
Ballard, D. H., & Brown, C. M. (1982) · Cited by 5,303
A massively parallel architecture for a self-organizing neural pattern recognition machine
Carpenter, G. A., & Grossberg, S. (1987) · Computer Vision, Graphics, and Image Processing · doi:10.1016/s0734-189x(87)80014-2 · Cited by 2,525
Barlow, H. B. (1989) · Neural Computation · doi:10.1162/neco.1989.1.3.295 · Cited by 1,650
Stochastic Complexity in Statistical Inquiry
Rissanen, J. (1998) · WORLD SCIENTIFIC eBooks · doi:10.1142/0822 · Cited by 1,539
Forward models: supervised learning with a distal teacher
Jordan, M. I., & Rumelhart, D. E. (1992) · Cognitive Science · doi:10.1207/s15516709cog1603_1 · Cited by 1,451
Dayan, P., Hinton, G. E., Neal, R. M., & Zemel, R. S. (1995) · Neural Computation · doi:10.1162/neco.1995.7.5.889 · Cited by 1,207
Self-citationHasselmo, M. E., & Bower, J. M. (1993) · Trends in Neurosciences · doi:10.1016/0166-2236(93)90159-j · Cited by 427
A forward-inverse optics model of reciprocal connections between visual cortical areas
Kawato, M., Hayakawa, H., & Inui, T. (1993) · Network: Computation in Neural Systems · doi:10.1088/0954-898x_4_4_001 · Cited by 151
Grenander, U. (1978) · Springer eBooks · Cited by 89
Research works printed but not linked: 3
- Hinton, G. E., Advances in Neural Information Processing Systems 6: 3 (1994).
- Mumford, D., Large-Scale Theories of the Cortex: 125 (1994).
- Ullman, S., Large-Scale Theories of the Cortex: 257 (1994).
Cited by
Items 801–900 of 1,002
‘Backpropagation and the brain’ realized in cortical error neuron microcircuits
Max, K., Jaras, I., Granier, A., Wilmes, K. A., & Petrovici, M. A. (2026) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1014164 · Cited by 4
FedEFM: Federated Endovascular Foundation Model with Unseen Data
Do, T., Vu, N., Jianu, T., Huang, B., Vu, M. N., Su, J., Tjiputra, E., Tran, Q. D., Chiu, T.-C., & Nguyen, A. (2025) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra55743.2025.11127787 · Cited by 4
Auletta, G. (2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199608485.003.0023 · Cited by 4
Cognitive Intelligence: Deep Learning, Thinking, and Reasoning by Brain-Inspired Systems
Wang, Y., Widrow, B. C., Zadeh, L. A., Howard, N., Wood, S. L., Bhavsar, V. C., Budin, G., Chan, C. W., Fiorini, R. A., Gavrilova, M. L., et al. (2019) · IGI Global eBooks · doi:10.4018/978-1-7998-0414-7.ch084 · Cited by 4
Helmholtz machine with differential privacy
Hu, J., Sun, K., & Zhang, H. F. (2022) · Information Sciences · doi:10.1016/j.ins.2022.08.105 · Cited by 4
Deep Architectures for Baby AI
Bengio, Y. (2007) · Cited by 4
Back to the Cradle: Mechanism Schemata from Piaget to DNA
Stinson, C. (2017) · The Western Ontario series in philosophy of science · doi:10.1007/978-3-319-52768-0_13 · Cited by 4
Research Summary of Convolution Neural Network in Image Recognition
Wei, Q., Shao, F., & Liu, J. (2018) · doi:10.1145/3224207.3224219 · Cited by 4
Adversarial Variational Bayes Methods for Tweedie Compound Poisson Mixed Models
Yang, Y., Luo, R., & Liu, Y. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8682184 · Cited by 4
Várady, C., Volpi, R., Malagò, L., & Ay, N. (2022) · Neural Networks · doi:10.1016/j.neunet.2022.09.006 · Cited by 4
Unsupervised Learning in Accordance With New Aspects of Artificial Intelligence
Sharma, R., Saxena, K., & Rana, A. (2021) · Wiley eBooks · doi:10.1002/9781119785873.ch17 · Cited by 4
Grinin, L. E., Леонидович, Г. А., & Леонидович, Г. И. (2023) · Философия и общество · doi:10.30884/jfio/2023.04.01 · Cited by 4
NAS-X: Neural Adaptive Smoothing via Twisting
Lawson, D., Li, M., & Linderman, S. W. (2023) · neural information processing systems · doi:10.52202/075280-0376 · Cited by 4
Natural Language Acquisition: State Inferring and Thinking
Wang, D., & Duan, Y. (2016) · International Journal of Artificial Intelligence Tools · doi:10.1142/s0218213016500226 · Cited by 4
Hu, J., Zhang, J., Ji, N., & Zhang, C. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.03.001 · Cited by 4
Attention to distinguishing features in object recognition: An interactive-iterative framework
Baruch, O., Kimchi, R., & Goldsmith, M. (2017) · Cognition · doi:10.1016/j.cognition.2017.10.007 · Cited by 4
QUANTUM MECHANICS AND PATTERN RECOGNITION
Chapline, G. (2004) · International Journal of Quantum Information · doi:10.1142/s0219749904000328 · Cited by 4
Modeling neuronal dynamics-transition during sleep
Nakao, M., & Yamamoto, M. (1999) · IEEE Engineering in Medicine and Biology Magazine · doi:10.1109/51.765195 · Cited by 4
A hybrid learning network for shift, orientation, and scaling invariant pattern recognition
Wang, R. (2001) · Network Computation in Neural Systems · doi:10.1088/0954-898x/12/4/305 · Cited by 4
Types, Locations, and Scales from Cluttered Natural Video and Actions
Song, X., Zhang, W., & Weng, J. (2015) · IEEE Transactions on Autonomous Mental Development · doi:10.1109/tamd.2015.2478377 · Cited by 4
Buzsáki, G. (2019) · Oxford University Press eBooks · doi:10.1093/oso/9780190905385.003.0001 · Cited by 4
Input Multiplexing in Artificial Neurons Employing Stochastic Arithmetic
CARD, H. C. (2002) · Neural Processing Letters · doi:10.1023/a:1013805129793 · Cited by 4
On theorists and data in computational neuroscience
Hopfield, J. J. (2000) · Nature Neuroscience · doi:10.1038/81484 · Cited by 4
Modularity and Specialized Learning: Reexamining Behavior-Based Artificial Intelligence
Bryson, J. J., Triesch, J., & Jebara, T. (2004) · IEEE International Conference on Development and Learning (ICDL) · Cited by 4
Learning Generative ConvNet with Continuous Latent Factors by Alternating Back-Propagation.Preprint
Han, T., Lu, Y., Zhu, S. C., & Wu, Y. N. (2016) · arXiv (Cornell University) · Cited by 4
Learning a Representation Map for Robot Navigation using Deep Variational AutoencoderPreprint
Hu, K., & O'Connor, P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.02401 · Cited by 4
Towards Self-constructive Artificial Intelligence: Algorithmic basis (Part I)Preprint
Corbacho, F. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.01989 · Cited by 4
Learning to Infer Shape Programs Using Latent Execution Self Training.Preprint
Walke, H., Jones, R. K., & Ritchie, D. (2020) · arXiv (Cornell University) · Cited by 4
Learning Evolved Combinatorial Symbols with a Neuro-symbolic Generative ModelPreprint
Hofer, M., Le, T. A., Lévy, R., & Tenenbaum, J. B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.08274 · Cited by 4
Continuous time causal structure induction with prevention and generationPreprint
Gong, T., & Bramley, N. R. (2022) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/z586q · Cited by 4
Deep Probabilistic Graphical ModelingPreprint
Dieng, A. B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.12053 · Cited by 4
ProtIR: Iterative Refinement between Retrievers and Predictors for Protein Function AnnotationPreprint
Zhang, Z., Lu, J., Chenthamarakshan, V., Lozano, A. C., Das, P., & Tang, J. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2402.07955 · Cited by 4
Predictive coding inspires effective alternatives to backpropagation
Song, Y. (2021) · Oxford University Research Archive (ORA) (University of Oxford) · doi:10.5287/ora-x52aoxdjx · Cited by 4
Learning generative models of mid-level structure in natural images
Heess, N. (2012) · ERA · Cited by 4
Some investigations into energy-based models
Tieleman, T. (2007) · TSpace (University of Toronto) · Cited by 4
How Adversarial REM Dreams May Facilitate Creativity, and Why We Become Aware of Them
Deperrois, N., Petrovici, M., Jordan, J., Huber, L., & Senn, W. (2024) · Clinical and Translational Neuroscience · doi:10.3390/ctn8020021 · Cited by 3
“A first meta-structure pops up when considering the classical Wake–Sleep algorithm [52], described above as a model for NREM sleep (that we extended by random perturbations in the replay).”
MethodChapter 13 An introduction to stochastic neural networks
Kappen, H. J. (2001) · Handbook of biological physics · doi:10.1016/s1383-8121(01)80016-6 · Cited by 3
Bredenberg, C., Normandin, F., Richards, B. A., & Lajoie, G. (2026) · eLife · doi:10.7554/elife.105968 · Cited by 3
Davey, C. G., & Badcock, P. B. (2025) · Entropy · doi:10.3390/e27090970 · Cited by 3
Variational Elliptical Processes
Bånkestad, M., Sjölund, J., Taghia, J., & Schöon, T. B. (2023) · Transactions on machine learning research · doi:10.48550/arxiv.2311.12566 · Cited by 3
Two-factor synaptic plasticity enables memory consolidation during neuronal burst firing
Jacquerie, K., Tyulmankov, D., Sacré, P., & Drion, G. (2026) · PNAS Nexus · doi:10.1093/pnasnexus/pgag213 · Cited by 3
The hippocampus as a generative model
Nalluru, S., Glitz, L., Przygodda, X., Mancini, V., & Barron, H. C. (2026) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2025.0247 · Cited by 3
Parallel nonlinear neuromorphic computing with temporal encoding
You, G., Qian, C., Wu, O., & Chen, H. (2026) · Science Advances · doi:10.1126/sciadv.aea1114 · Cited by 3
Max-margin learning with the Bayes factor
Krishnan, R. G., Khandelwal, A., Ranganath, R., & Sontag, D. A. (2018) · Uncertainty in Artificial Intelligence · Cited by 3
Brain Rhythms Provide a Framework for Neural Syntax
Buzsáki, G. (2019) · Oxford University Press eBooks · doi:10.1093/oso/9780190905385.003.0006 · Cited by 3
HiABP: Hierarchical Initialized ABP for Unsupervised Representation Learning
Sun, J., Liu, R. Z. Z., & Zhou, B. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i11.17172 · Cited by 3
Asynchronous Perception Machine for Efficient Test Time Training
Modi, R., & Rawat, Y. S. (2024) · neural information processing systems · doi:10.52202/079017-3364 · Cited by 3
Reduction of neural network models in intelligent computer systems of a new generation
Kroshchanka, A. (2023) · Репозиторий БГУИР (BSUIR Repository) · Cited by 3
Variational Bayes on Monte Carlo Steroids
Grover, A., & Ermon, S. (2016) · neural information processing systems · Cited by 3
The Latest Progress of Deep Learning
陈, 一. (2018) · Computer Science and Application · doi:10.12677/csa.2018.84064 · Cited by 3
Draft: Deep Learning in Neural Networks: An Overview
Idsia, L. (2014) · Cited by 3
Artificial Intelligence in Microbiology
Juhas, M. (2023) · Springer eBooks · doi:10.1007/978-3-031-29544-7_8 · Cited by 3
Delta-AI: Local objectives for amortized inference in sparse graphical models
Falet, J.-P. R., Lee, H. B., Whitammer, E. S., Sun, C., Secrieru, D., Jiralerspong, T., Zhang, D., Lajoie, G., & Bengio, Y. (2023) · International Conference on Learning Representations · doi:10.48550/arxiv.2310.02423 · Cited by 3
Xu, L. (2000) · Lecture notes in computer science · doi:10.1007/3-540-44491-2_18 · Cited by 3
Variable module graphs: a framework for inference and learning in modular vision systems
Sethi, A., Rahurkar, M. A., & Huang, T. S. (2005) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2005.1530308 · Cited by 3
Design features of language emerge from general-purpose learning mechanisms
Monaghan, P. (2011) · eScholarship (California Digital Library) · Cited by 3
Evaluating the Impact of Encoding Schemes on Deep Auto-Encoders for DNA Annotation
Yu, N., Zeng, Y., Gu, F., & Pan, Y. F. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-59575-7_40 · Cited by 3
Nakao, M., Karashima, A., Iwasaki, N., Katayama, N., & Yamamoto, M. (2006) · Sleep and Biological Rhythms · doi:10.1111/j.1479-8425.2006.00206.x · Cited by 3
Intelligent Systems Approaches to Product Sound Quality Analysis
Pietila, G. (2013) · OhioLink ETD Center (Ohio Library and Information Network) · Cited by 3
Replicating Neuroscience Observations on ML/MF and AM Face Patches by Deep Generative Model
Han, T., Xing, X., Wu, J., & Wu, Y. N. (2019) · Neural Computation · doi:10.1162/neco_a_01236 · Cited by 3
Minimum Energy Information Fusion in Sensor NetworksPreprint
Chapline, G. (1999) · arXiv (Cornell University) · doi:10.48550/arxiv.adap-org/9906002 · Cited by 3
Pulse-based circuits and methods for probabilistic neural computation
Astaras, A., Dalzell, R. W. H., Murray, A., & Reekie, M. (2003) · International Conference on Microelectronics for Neural, Fuzzy and Bio-Inspired Systems (MicroNeuro) · doi:10.1109/mn.1999.758851 · Cited by 3
Kairiss, E. W., & Miranker, W. L. (1998) · Biological Cybernetics · doi:10.1007/s004220050433 · Cited by 3
Consensus Message Passing for Layered Graphical ModelsPreprint
Jampani, V., Eslami, S. M. A., Tarlow, D., Kohli, P., & Winn, J. M. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1410.7452 · Cited by 3
Weber, C., & Obermayer, K. (2000) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2000.860838 · Cited by 3
Implementación en hardware de sistemas de alta fiabilidad basados en metodologías estocásticas
Guinand, C., & Vicente, J. (2012) · Biblioteca Digital de les Illes Balears (Universitat de les Illes Balears) · Cited by 3
Introspective Generative Modeling: Decide DiscriminativelyPreprint
Lazarow, J., Jin, L., & Tu, Z. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1704.07820 · Cited by 3
Learning Inference Models for Computer VisionPreprint
Jampani, V. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.00069 · Cited by 3
Recursive Variational Bayesian Dual Estimation for Nonlinear Dynamics and Non-Gaussian ObservationsPreprint
Zhao, Y., & Park, I. M. (2017) · arXiv (Cornell University) · Cited by 3
Markovian inference in belief networks
Frey, B. J., Lawrence, N. D., & Bishop, C. (1998) · Cited by 3
Self-citationLearning the joint distribution of two sequences using little or no paired dataPreprint
Mariooryad, S., Shannon, M., Ma, S., Bagby, T., Kao, D., Stanton, D., Battenberg, E., & Skerry-Ryan, R. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2212.03232 · Cited by 3
On Broken Symmetry in CognitionPreprint
Li, X. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2303.06047 · Cited by 3
Symmetric Equilibrium Learning of VAEsPreprint
Flach, B., Schlesinger, D., & Shekhovtsov, A. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2307.09883 · Cited by 3
Learning beyond sensations: how dreams organize neuronal representationsPreprint
Deperrois, N., Petrovici, M. A., Senn, W., & Jordan, J. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2308.01830 · Cited by 3
Machine Learning for Scientific Visualization: Ensemble Data Analysis
Gadirov, H. (2025) · University of Groningen research database (University of Groningen / Centre for Information Technology) · doi:10.33612/diss.1402847307 · Cited by 3
Energy-based models for inverse imaging problemsPreprint
Habring, A., Höller, M., Pock, T., & Zach, M. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2507.12432 · Cited by 3
An agent-independent task learning framework
Wood, M. A. (2008) · The University of Bath Online Publications Store (The University of Bath) · Cited by 3
Advances in Probabilistic Meta-Learning and the Neural Process Family
Gordon, J. (2021) · Cambridge University Engineering Department Publications Database · doi:10.17863/cam.72831 · Cited by 3
Algorithms for learning to induce programs
Ellis, K. (2020) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 3
Understanding deep architectures and the effect of unsupervised pre-training
Erhan, D. (2010) · Papyrus : Institutional Repository (Université de Montréal) · doi:10.71781/9805 · Cited by 3
Discovering Abstractions from Language via Neurosymbolic Program Synthesis
Grand, G. (2023) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 3
A hitchhiker's guide to Poisson gradient estimationPreprint
Ibrahim, M., Zhao, H., Sennesh, E., Li, Z., Wu, A., Yates, J. L., Li, C., & Vafaii, H. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.03896 · Cited by 3
Form Follows Function: Recursive Stem ModelPreprint
Hakimi, N. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2603.15641 · Cited by 3
Do Language Models Need Sleep? Offline Recurrence for Improved Online InferencePreprint
Lee, S., McLeish, S., Goldstein, T., & Fanti, G. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.26099 · Cited by 3
Lorenz, R., Brunner, E., & Benedetti, M. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.00372 · Cited by 3
Hierarchical neural circuit theory of normalization and inter-areal communication
Pal, A., Rawat, S., Heeger, D. J., & Martiniani, S. (2026) · eLife · doi:10.1101/2025.07.15.664935 · Cited by 2
DREAM: A Dual Variational Framework for Unsupervised Graph Domain Adaptation
Yin, N., Shen, L., Wang, M., Liu, X., Chen, C., & Hua, X. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3596054 · Cited by 2
Robust inference via top-down feedback and neural variability in recurrent vision models
Greco, A., D’Alessandro, M., Friston, K. J., Pezzulo, G., & Siegel, M. (2026) · Patterns · doi:10.1016/j.patter.2026.101693 · Cited by 2
Investigating the intrinsic top-down dynamics of deep generative models
Tausani, L., Testolin, A., & Zorzi, M. (2025) · Scientific Reports · doi:10.1038/s41598-024-85055-y · Cited by 2
Sheaf Cohomology of Rectangular-Matrix Chains to Develop Deep-Machine-Learning Multiple Sequencing
Lecian, O. M. (2024) · International Journal of Topology · doi:10.3390/ijt1010005 · Cited by 2
Gradient Expectations: Structure, Origins, and Synthesis of Predictive Neural Networks
Downing, K. L. (2023) · The MIT Press eBooks · doi:10.7551/mitpress/14723.001.0001 · Cited by 2
A Novel Dynamic Edge-Adjusted Graph Attention Network for Fire Alarm Data Mining and Prediction
Ding, Y., Xie, Z., & Jiang, S. (2025) · Mathematics · doi:10.3390/math13193111 · Cited by 2
Page, M. P. A. (2000) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00533354 · Cited by 2
Tajima, S., & Watanabe, M. (2010) · Neural Networks · doi:10.1016/j.neunet.2010.10.004 · Cited by 2
Bimodal Projection-based Features for Pattern Classification
Deodhare, D., Vidyasagar, M., & Murty, M. N. (2006) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2006.247126 · Cited by 2
Learning Paired-Associate Images with an Unsupervised Deep Learning Architecture
Wang, T., & Silver, D. L. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-18356-5_22 · Cited by 2
Models of MT and MST areas using wake–sleep algorithm
Katayama, K., Ando, M., & Horiguchi, T. (2003) · Neural Networks · doi:10.1016/j.neunet.2003.07.004 · Cited by 2
Fragment Completion in Humans and Machines
Jacobs, D. W., Rokers, B., Rudra, A., & Liu, Z. (2002) · The MIT Press eBooks · doi:10.7551/mitpress/1120.003.0008 · Cited by 2
Learning Deep Generative Models With Discrete Latent Variables
Hu, H., & Salakhutdinov, R. (2018) · Cited by 2
Metadata
- Authors
- Hinton, G. E., Dayan, P., Frey, B. J., & Neal, R. M.
- Affiliations
- University of Toronto (CA)
- ORCID
- Dayan, Peter
- Venue
- Science
- Published
- 1995-05-26
- Volume
- 268
- Issue
- 5214
- Pages
- 1158-1161
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W1993845689
- Cited by
- 1,070
- References
- 9
- Citations by year
- 2026: 18 · 2025: 33 · 2024: 36 · 2023: 57 · 2022: 57 · 2021: 68 · 2020: 63 · 2019: 79 · 2018: 79 · 2017: 64 · 2016: 52 · 2015: 42 · 2014: 37 · 2013: 19 · 2012: 18
- FWCI
- 28.04
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- UCL Discovery (University College London) (submittedVersion)
- MPG.PuRe (Max Planck Society) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- unsupervised learning, stochastic neurons, multilayer neural networks, top-down connections, representation learning, generative models, neural network adaptation
- MeSH terms
- Algorithms, Probability, Stochastic Processes, Neural Networks, Computer
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.