The "Wake-Sleep" Algorithm for Unsupervised Neural Networks
The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
An unsupervised learning algorithm for a multilayer network of stochastic neurons is described. Bottom-up "recognition" connections convert the input into representations in successive hidden layers, and top-down "generative" connections reconstruct the representation in one layer from the representation in the layer above. In the "wake" phase, neurons are driven by recognition connections, and generative connections are adapted to increase the probability that they would reconstruct the correct activity vector in the layer below. In the "sleep" phase, neurons are driven by generative connections, and recognition connections are adapted to increase the probability that they would produce the correct activity vector in the layer above.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“A first meta-structure pops up when considering the classical Wake-Sleep algorithm [52], described above as a model for NREM sleep (that we extended by random perturbations in the replay).”
From How Adversarial REM Dreams May Facilitate Creativity, and Why We Become Aware of Them (2024) · cites this paper as [52]
In the citing paper
“In this algorithm, the FF recognition pathway is trained during the Sleep phase so that it inverts the FB generative pathway. The generative FB pathway is itself trained during the Wake phase so that it learns to reproduce the sensory activity from the internal representation generated by the FF pathway.”
From How Adversarial REM Dreams May Facilitate Creativity, and Why We Become Aware of Them (2024) · cites this paper as [52]
In the citing paper
“Bayesian inference and related theories have been proposed as a more appropriate theoretical framework for reasoning about top-down visual processing in the brain. 1,2,4,6,26,27”
From Hierarchical Bayesian inference in the visual cortex (2003) · cites this paper as [2]
In the citing paper
“In one common form of unsupervised learning, higher brain areas attempt to produce samples that are statistically similar to those actually seen in lower layers.”
From Toward an integration of deep learning and neuroscience (2016) · cites this paper as Hinton et al., 1995
In the citing paper
“For example, the wake-sleep algorithm (Hinton et al., 1995) requires the sleep mode to sample potential data points whose distribution should then match the observed distribution.”
From Toward an integration of deep learning and neuroscience (2016) · cites this paper as Hinton et al., 1995
Citations
Cites
Ballard, D. H., & Brown, C. M. (1982) · Cited by 5,303
A massively parallel architecture for a self-organizing neural pattern recognition machine
Carpenter, G. A., & Grossberg, S. (1987) · Computer Vision, Graphics, and Image Processing · doi:10.1016/s0734-189x(87)80014-2 · Cited by 2,525
Barlow, H. B. (1989) · Neural Computation · doi:10.1162/neco.1989.1.3.295 · Cited by 1,650
Stochastic Complexity in Statistical Inquiry
Rissanen, J. (1998) · WORLD SCIENTIFIC eBooks · doi:10.1142/0822 · Cited by 1,539
Forward models: supervised learning with a distal teacher
Jordan, M. I., & Rumelhart, D. E. (1992) · Cognitive Science · doi:10.1207/s15516709cog1603_1 · Cited by 1,451
Dayan, P., Hinton, G. E., Neal, R. M., & Zemel, R. S. (1995) · Neural Computation · doi:10.1162/neco.1995.7.5.889 · Cited by 1,207
Self-citationHasselmo, M. E., & Bower, J. M. (1993) · Trends in Neurosciences · doi:10.1016/0166-2236(93)90159-j · Cited by 427
A forward-inverse optics model of reciprocal connections between visual cortical areas
Kawato, M., Hayakawa, H., & Inui, T. (1993) · Network: Computation in Neural Systems · doi:10.1088/0954-898x_4_4_001 · Cited by 151
Grenander, U. (1978) · Springer eBooks · Cited by 89
Research works printed but not linked: 3
- Hinton, G. E., Advances in Neural Information Processing Systems 6: 3 (1994).
- Mumford, D., Large-Scale Theories of the Cortex: 125 (1994).
- Ullman, S., Large-Scale Theories of the Cortex: 257 (1994).
Cited by
Items 701–800 of 1,002
Cavender-Bares, J. M., Reich, P. B., Townsend, P. A., Banerjee, A., Butler, E. E., Desai, A. R., Gevens, A. J., Hobbie, S. E., Isbell, F., Laliberté, É., et al. (2021) · Research Ideas and Outcomes · doi:10.3897/rio.7.e63850 · Cited by 8
Kasabov, N. K. (2009) · Studies in computational intelligence · doi:10.1007/978-3-642-05179-1_19 · Cited by 8
A Unified Bayesian Framework for Evolutionary Learning and Optimization
Zhang, B. (2003) · Natural computing series · doi:10.1007/978-3-642-18965-4_15 · Cited by 8
Low resolution face recognition with pose variations using deep belief networks
Lin, M., & Fan, X. (2011) · International Congress on Image and Signal Processing (CISP) · doi:10.1109/cisp.2011.6100469 · Cited by 8
Kasabov, N. K. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-02490-0_1 · Cited by 8
Optical imaging and manipulation of sleeping-brain dynamics in memory processing
Miyamoto, D. (2022) · Neuroscience Research · doi:10.1016/j.neures.2022.04.005 · Cited by 8
Emergent componential coding of a handwritten image database by neural self-organisation
Webber, C. J. S. (1998) · Network Computation in Neural Systems · doi:10.1088/0954-898x_9_4_003 · Cited by 8
Robot Docking with Neural Vision and Reinforcement
Weber, C., Wermter, S., & Zochios, A. (2004) · Springer eBooks · doi:10.1007/978-1-4471-0643-2_15 · Cited by 8
Truncated Variational Sampling for ‘Black Box’ Optimization of Generative Models
Lücke, J., Dai, Z., & Exarchakis, G. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-93764-9_43 · Cited by 8
Hah, J., Lee, W., Lee, J., & Park, S. (2018) · Computational Intelligence and Neuroscience · doi:10.1155/2018/6465949 · Cited by 8
Incremental Bayesian networks for structure prediction
Titov, I., & Henderson, J. (2007) · International Conference on Machine Learning · doi:10.1145/1273496.1273608 · Cited by 8
Compound binomial processes in neural integration
CARD, H. C. (2001) · IEEE Transactions on Neural Networks · doi:10.1109/72.963787 · Cited by 8
Factored Temporal Sigmoid Belief Networks for Sequence LearningPreprint
Song, J., Gan, Z., & Carin, L. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.06715 · Cited by 8
Jaskari, J., & Kivinen, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.07352 · Cited by 8
Deep generative models for natural language processing
Miao, Y. (2017) · Oxford University Research Archive (ORA) (University of Oxford) · doi:10.5287/ora-qymxwo9jg · Cited by 8
InfoNCE is a variational autoencoder.Preprint
Aitchison, L. (2021) · arXiv (Cornell University) · Cited by 8
Your Autoregressive Generative Model Can be Better If You Treat It as an Energy-Based OnePreprint
Wang, Y., Che, T., Li, B., Song, K., Pei, H., Bengio, Y., & Li, D. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2206.12840 · Cited by 8
A Message Passing Perspective on Learning Dynamics of Contrastive LearningPreprint
Wang, Y., Zhang, Q., Du, T., Jian-sheng, Y., Lin, Z., & Wang, Y. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2303.04435 · Cited by 8
Su, G., Zhu, Y., Zhang, W., Wang, H., & Zhang, Y. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2410.12096 · Cited by 8
In-Context Parametric Inference: Point or Distribution Estimators?Preprint
Mittal, S., Bengio, Y., Malkin, N., & Lajoie, G. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2502.11617 · Cited by 8
DreamProver: Evolving Transferable Lemma Libraries via a Wake-Sleep Theorem-Proving AgentPreprint
Zhang, Y., Sun, J., Bi, H., Geng, C., Ma, W., Li, Z., & Si, X. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2604.26311 · Cited by 8
Critique of Agent ModelPreprint
Xing, E., Deng, M., & Hou, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.23991 · Cited by 8
The Evolution of Autonomy: From Reactive AI to Agentic AI
Jakjoud, W. (2025) · Springer eBooks · doi:10.1007/978-3-031-89424-4_1 · Cited by 7
Continuous time causal structure induction with prevention and generation
Gong, T., & Bramley, N. R. (2023) · Cognition · doi:10.1016/j.cognition.2023.105530 · Cited by 7
Application of deep belief nets for collaborative filtering
Zhao, C. K., Shi, J., Jiang, T., Zhao, J., & Chen, J. (2016) · International Symposium on Communications and Information Technologies · doi:10.1109/iscit.2016.7751621 · Cited by 7
Yao, Y., Zhang, J., Luo, W., & Dai, Y. (2021) · Processes · doi:10.3390/pr9081266 · Cited by 7
Learning Oculomotor Behaviors from Scanpath
Li, B., Nuechterlein, N., Barney, E. C., Foster, C. E., Kim, M., Mahony, M., Atyabi, A., Li, F., Wang, Q., Ventola, P. E., et al. (2021) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3462244.3479923 · Cited by 7
Variational learning of quantum ground states on spiking neuromorphic hardware
Klassert, R., Baumbach, A., Petrovici, M. A., & Gärttner, M. (2022) · iScience · doi:10.1016/j.isci.2022.104707 · Cited by 7
Sedano, M. G. (2022) · H-ART Revista de historia teoría y crítica de arte · doi:10.25025/hart12.2022.04 · Cited by 7
Computational models of Idling brain activity for memory processing
Fukai, T. (2022) · Neuroscience Research · doi:10.1016/j.neures.2022.12.024 · Cited by 7
Unsupervised Learning of Particles Dispersion
Christakis, N., & Drikakis, D. (2023) · Mathematics · doi:10.3390/math11173637 · Cited by 7
Emergence of Modularity within One Sheet of Neurons: A Model Comparison
Weber, C., & Obermayer, K. (2001) · Lecture notes in computer science · doi:10.1007/3-540-44597-8_4 · Cited by 7
Lörincz, A. (2009) · Artificial General Intelligence · doi:10.2991/agi.2009.36 · Cited by 7
Model of MT and MST areas using an autoencoder
Katayama, K., Ando, M., & Horiguchi, T. (2003) · Physica A Statistical Mechanics and its Applications · doi:10.1016/s0378-4371(02)01803-4 · Cited by 7
Partridge, D. (2016) · Elsevier eBooks · doi:10.1016/b978-0-12-809324-5.02995-3 · Cited by 7
Function Optimization with Latent Variable Models
Shin, S.-Y., & Cho, D.-Y. (2012) · Cited by 7
Topic Extraction from Text Documents Using Multiple-Cause Networks
Chang, J.-H., Lee, J., Kim, Y., & Zhang, B. (2002) · Lecture notes in computer science · doi:10.1007/3-540-45683-x_47 · Cited by 7
Where is the classic interference theory for sleep and memory?
Coenen, A. M. L. (2005) · Behavioral and Brain Sciences · doi:10.1017/s0140525x05250021 · Cited by 7
Probabilistic Models for Unsupervised Learning
Ghahramani, Z., & Roweis, S. T. (1999) · Cited by 7
Larochelle, H. (2008) · doi:10.71781/10523 · Cited by 7
Data mining, unsupervised learning and Bayesian ying-yang theory
Xu, L. (2003) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.1999.833469 · Cited by 7
Interactions, Computations, and Experience: Interleaved Springboards of Cognitive Emergence
Δημητρίου, Α., Raftopoulos, A., & Kargopoulos, P. V. (1999) · Developmental Review · doi:10.1006/drev.1999.0491 · Cited by 7
Xu, L. (2006) · International Conference on Neural Networks and Brain · doi:10.1109/icnnb.2005.1614547 · Cited by 7
Vision-based Human Action Recognition using Machine Learning Techniques
Bux, A. (2017) · Lancaster EPrints (Lancaster University) · doi:10.17635/lancaster/thesis/186 · Cited by 7
Alzahrani, H. M. (2018) · Wolverhampton Intellectual Repository and E-Theses (University of Wolverhampton) · Cited by 7
Resolving label uncertainty with implicit posterior modelsPreprint
Rolf, E., Malkin, N., Graikos, A., Jojic, A., Robinson, C., & Jojić, N. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2202.14000 · Cited by 7
Improved Anomaly Detection through Conditional Latent Space VAE EnsemblesPreprint
Åström, O., & Sopasakis, A. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2410.12328 · Cited by 7
Frank, M. G. (2012) · Cited by 7
KINNTREX: a neural network to unveil protein mechanisms from time-resolved X-ray crystallography
Biener, G., Malla, T. N., Schwander, P., & Schmidt, M. (2024) · IUCrJ · doi:10.1107/s2052252524002392 · Cited by 6
DustNet (v1): skilful neural network predictions of dust aerosols over the Saharan desert
Nowak, T., Augousti, A. T., Simmons, B. I., & Siegert, S. (2025) · Geoscientific model development · doi:10.5194/gmd-18-3509-2025 · Cited by 6
Wiest, M. C., & Puniani, A. S. (2025) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2025.09.017 · Cited by 6
Tavazoie, S. (2013) · PLoS ONE · doi:10.1371/journal.pone.0072865 · Cited by 6
Deep learning for SDN-enabled campus networks: proposed solutions, challenges and future directions
Chanhemo, W. C., Mohsini, M. H., Mjahidi, M. M., & Rashidi, F. (2023) · International Journal of Intelligent Computing and Cybernetics · doi:10.1108/ijicc-12-2022-0312 · Cited by 6
Multi-Sample Training for Neural Image Compression
Xu, T., Wang, Y., He, D., Gao, C., Gao, H., Liu, K., & Qin, H. (2022) · neural information processing systems · doi:10.52202/068431-0110 · Cited by 6
Quantum mechanics as self-organized information fusion
Chapline, G. (2001) · Philosophical Magazine B · doi:10.1080/13642810108225449 · Cited by 6
Source Separation as a By-Product of Regularization
Hochreiter, S., & Schmidhuber, J. (1998) · neural information processing systems · Cited by 6
Sleep and Memory Consolidation in Audition
Margoliash, D., & Fenn, K. M. (2008) · Elsevier eBooks · doi:10.1016/b978-012370880-9.00062-1 · Cited by 6
Behavioral and neural constraints on hierarchical representations
Schwartz, O., & Giraldo, L. G. S. (2017) · Journal of Vision · doi:10.1167/17.3.13 · Cited by 6
Latent regression Bayesian network for data representation
Nie, S., Zhao, Y. L., & Ji, Q. (2016) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2016.7900175 · Cited by 6
Deep Learning for Regression and Classification
Liu, W. K., Gan, Z., & Fleming, M. (2021) · Springer eBooks · doi:10.1007/978-3-030-87832-0_6 · Cited by 6
Margoliash, D., & Brawn, T. P. (2012) · Elsevier eBooks · doi:10.1016/b978-0-12-384995-3.00006-x · Cited by 6
Style Memory: Making a Classifier Network Generative
Wiyatno, R. R., & Orchard, J. (2018) · IEEE International Conference on Cognitive Informatics & Cognitive Computing (ICCI*CC) · doi:10.1109/icci-cc.2018.8482059 · Cited by 6
Deep IA-BI and Five Actions in Circling
Xu, L. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-36189-1_1 · Cited by 6
Using Helmholtz Machines to analyze multi-channel neuronal recordings
de Sa, V. R., deCharms, R. C., & Merzenich, M. M. (n.d.) · Cited by 6
Automatic inference for higher-order probabilistic programs
Paige, B. (2016) · Oxford University Research Archive (ORA) (University of Oxford) · doi:10.5287/ora-yjo45bmkd · Cited by 6
Active inference : building a new bridge between control theory and embodied cognitive science
Baltieri, M. (2019) · Sussex Research Online (University of Sussex) · Cited by 6
A neurally plausible model for online recognition and postdiction in a dynamical environmentPreprint
Wenliang, L. K., & Sahani, M. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/672089 · Cited by 6
Amortised Learning by Wake-SleepPreprint
Wenliang, L. K., Moskovitz, T., Kanagawa, H., & Sahani, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.09737 · Cited by 6
How to Tell Deep Neural Networks What We Know.Preprint
Dash, T., Chitlangia, S., Ahuja, A., & Srinivasan, A. (2021) · arXiv (Cornell University) · Cited by 6
Deep Latent-Variable Models for Text GenerationPreprint
Shen, X. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2203.02055 · Cited by 6
Bayesian Matrix Decomposition and ApplicationsPreprint
Lu, J. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2302.11337 · Cited by 6
Probabilistic Graphical Models: A Concise TutorialPreprint
Maasch, J. R. M. A., Neiswanger, W., Ermon, S., & Kuleshov, V. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2507.17116 · Cited by 6
Uncovering mesa-optimization algorithms in Transformers
von Oswald, J., Schlegel, M., Meulemans, A., Kobayashi, S., Niklasson, E., Zucchet, N., Scherrer, N., Miller, N., Sandler, M., Arcas, B. A. Y., et al. (2023) · arXiv · doi:10.48550/arxiv.2309.05858 · Cited by 5
“A number of influential predictive processing models have adopted a Bayesian approach, starting from the assumption that the world obeys a certain generative model, and then hand-designing approximate inference algorithms for the assumed model [85–89].”
MethodArtificial Intelligence in Pediatric Ultrasound: An Update and Future Applications
Kuang, C., Jiang, Z., Wang, Y., Fang, A., Zhang, H., Liu, H., & Ye, Z. (2025) · BIO Integration · doi:10.15212/bioi-2025-0130 · Cited by 5
An introduction to neural networks and deep learning
Mulyadi, A. W., Yoon, J. S., Jeon, E., Ko, W., & Suk, H. (2024) · Elsevier eBooks · doi:10.1016/b978-0-32-385124-4.00009-x · Cited by 5
Dynamic systems: brain, body, and imitation
Schaal, S. (2006) · Cambridge University Press eBooks · doi:10.1017/cbo9780511541599.007 · Cited by 5
Learning from All Types of Experiences: A Unifying Machine Learning Perspective
Hu, Z., & Xing, E. P. (2020) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3394486.3406462 · Cited by 5
The Reduction of Fully Connected Neural Network Parameters Using the Pre-training Technique
Kroshchanka, A., & Golovko, V. A. (2021) · IEEE International Conference on Intelligent Data Acquisition and Advanced Computing Systems: Technology and Applications (IDAACS) · doi:10.1109/idaacs53288.2021.9661015 · Cited by 5
Deep ganitrus algorithm for speech emotion recognition
Shukla, S., & Jain, M. (2022) · Journal of Intelligent & Fuzzy Systems · doi:10.3233/jifs-201491 · Cited by 5
CNN Model with Transfer learning and Data Augmentation for Obstacle Detection in Rail Systems
Drizi, H. K., & Boukadoum, M. (2024) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas58744.2024.10558372 · Cited by 5
Peng, Z., Xu, L., Lian, J., An, X., Chen, S., Shao, Y., Jiao, F., & Lv, J. (2024) · Cognitive Neurodynamics · doi:10.1007/s11571-024-10171-4 · Cited by 5
A Scalable Unsupervised Deep Multimodal Learning System.
Iqbal, M. S., & Silver, D. L. (2016) · The Florida AI Research Society · Cited by 5
Method for Reducing Neural-Network Models of Computer Vision
Kroshchanka, A., Golovko, V. A., & Chodyka, M. (2022) · Pattern Recognition and Image Analysis · doi:10.1134/s1054661822020146 · Cited by 5
Learning to Flip the Sentiment of Reviews from Non-Parallel Corpora
Kruengkrai, C. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1659 · Cited by 5
Balancing Active Inference and Active Learning with Deep Variational Predictive Coding for EEG
Ofner, A., & Stober, S. (2020) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc42975.2020.9283147 · Cited by 5
Automatic analysis method of audit data based on neural network mapping
Neskorodieva, T., & Fedorov, E. (2021) · Cherkasy State Technological University repository · doi:10.5281/zenodo.21080518 · Cited by 5
A neural wake-sleep learning architecture for associating robotic facial emotions
Yau, C.-Y., Burn, K., & Wermter, S. (2008) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2008.4634179 · Cited by 5
A Hierarchical Model of Visual Rivalry
Dayan, P. (1996) · UCL Discovery (University College London) · Cited by 5
Self-citationA Graphical Model Formulation of the DNA Base-Calling Problem
Andrade-Cetto, L., & Manolakos, E. S. (2006) · Machine learning for signal processing ... · doi:10.1109/mlsp.2005.1532931 · Cited by 5
Hochreiter, S., & Schmidhuber, J. (1998) · Perspectives in neural computing · doi:10.1007/978-1-4471-1599-1_102 · Cited by 5
Localist representation can improve efficiency for detection and counting
Barlow, H. B., & Gardner-Medwin, A. R. (2000) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00223352 · Cited by 5
Lamination and Within-Area Integration in the Neocortex
Robert, A., Callaway, E. M., Churchland, P. S., Movellan, J. R., & Zipser, D. (1999) · Cited by 5
A discrete firing event analysis of the adaptive cluster expansion network
Luttrell, S. P. (1996) · Network Computation in Neural Systems · doi:10.1088/0954-898x_7_2_008 · Cited by 5
Modeling Cognition with Probabilistic Programs: Representations and Algorithms
Stuhlmüller, A. (2015) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 5
Visual object recognition using generative models of images
Nair, V. B. (2010) · TSpace (University of Toronto) · Cited by 5
On the Transformation of Latent Space in AutoencodersPreprint
Cha, J., Kim, K. S., & Lee, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.08479 · Cited by 5
Deep Boltzmann Machines as Hierarchical Generative Models of Perceptual Inference in the Cortex
Reichert, D. (2012) · ERA · Cited by 5
Variational Learning of Quantum Ground States on Spiking Neuromorphic HardwarePreprint
Klassert, R., Baumbach, A., Petrovici, M. A., & Gärttner, M. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4012184 · Cited by 5
The overfitted brain hypothesis
Prince, L. Y., & Richards, B. A. (2021) · Patterns · doi:10.1016/j.patter.2021.100268 · Cited by 4
“2 3–6 Many of these were motivated by the challenges of training probabilistic generative models.”
BackgroundActive inference and artificial reasoning
Friston, K. J., Costa, L. D., Tschantz, A., Heins, C., Buckley, C., Verbelen, T., & Parr, T. (2026) · Nature Communications · doi:10.1038/s41467-026-77209-5 · Cited by 4
Metadata
- Authors
- Hinton, G. E., Dayan, P., Frey, B. J., & Neal, R. M.
- Affiliations
- University of Toronto (CA)
- ORCID
- Dayan, Peter
- Venue
- Science
- Published
- 1995-05-26
- Volume
- 268
- Issue
- 5214
- Pages
- 1158-1161
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W1993845689
- Cited by
- 1,070
- References
- 9
- Citations by year
- 2026: 18 · 2025: 33 · 2024: 36 · 2023: 57 · 2022: 57 · 2021: 68 · 2020: 63 · 2019: 79 · 2018: 79 · 2017: 64 · 2016: 52 · 2015: 42 · 2014: 37 · 2013: 19 · 2012: 18
- FWCI
- 28.04
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- UCL Discovery (University College London) (submittedVersion)
- MPG.PuRe (Max Planck Society) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- unsupervised learning, stochastic neurons, multilayer neural networks, top-down connections, representation learning, generative models, neural network adaptation
- MeSH terms
- Algorithms, Probability, Stochastic Processes, Neural Networks, Computer
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.