The "Wake-Sleep" Algorithm for Unsupervised Neural Networks
The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
An unsupervised learning algorithm for a multilayer network of stochastic neurons is described. Bottom-up "recognition" connections convert the input into representations in successive hidden layers, and top-down "generative" connections reconstruct the representation in one layer from the representation in the layer above. In the "wake" phase, neurons are driven by recognition connections, and generative connections are adapted to increase the probability that they would reconstruct the correct activity vector in the layer below. In the "sleep" phase, neurons are driven by generative connections, and recognition connections are adapted to increase the probability that they would produce the correct activity vector in the layer above.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“A first meta-structure pops up when considering the classical Wake-Sleep algorithm [52], described above as a model for NREM sleep (that we extended by random perturbations in the replay).”
From How Adversarial REM Dreams May Facilitate Creativity, and Why We Become Aware of Them (2024) · cites this paper as [52]
In the citing paper
“In this algorithm, the FF recognition pathway is trained during the Sleep phase so that it inverts the FB generative pathway. The generative FB pathway is itself trained during the Wake phase so that it learns to reproduce the sensory activity from the internal representation generated by the FF pathway.”
From How Adversarial REM Dreams May Facilitate Creativity, and Why We Become Aware of Them (2024) · cites this paper as [52]
In the citing paper
“Bayesian inference and related theories have been proposed as a more appropriate theoretical framework for reasoning about top-down visual processing in the brain. 1,2,4,6,26,27”
From Hierarchical Bayesian inference in the visual cortex (2003) · cites this paper as [2]
In the citing paper
“In one common form of unsupervised learning, higher brain areas attempt to produce samples that are statistically similar to those actually seen in lower layers.”
From Toward an integration of deep learning and neuroscience (2016) · cites this paper as Hinton et al., 1995
In the citing paper
“For example, the wake-sleep algorithm (Hinton et al., 1995) requires the sleep mode to sample potential data points whose distribution should then match the observed distribution.”
From Toward an integration of deep learning and neuroscience (2016) · cites this paper as Hinton et al., 1995
Citations
Cites
Ballard, D. H., & Brown, C. M. (1982) · Cited by 5,303
A massively parallel architecture for a self-organizing neural pattern recognition machine
Carpenter, G. A., & Grossberg, S. (1987) · Computer Vision, Graphics, and Image Processing · doi:10.1016/s0734-189x(87)80014-2 · Cited by 2,525
Barlow, H. B. (1989) · Neural Computation · doi:10.1162/neco.1989.1.3.295 · Cited by 1,650
Stochastic Complexity in Statistical Inquiry
Rissanen, J. (1998) · WORLD SCIENTIFIC eBooks · doi:10.1142/0822 · Cited by 1,539
Forward models: supervised learning with a distal teacher
Jordan, M. I., & Rumelhart, D. E. (1992) · Cognitive Science · doi:10.1207/s15516709cog1603_1 · Cited by 1,451
Dayan, P., Hinton, G. E., Neal, R. M., & Zemel, R. S. (1995) · Neural Computation · doi:10.1162/neco.1995.7.5.889 · Cited by 1,207
Self-citationHasselmo, M. E., & Bower, J. M. (1993) · Trends in Neurosciences · doi:10.1016/0166-2236(93)90159-j · Cited by 427
A forward-inverse optics model of reciprocal connections between visual cortical areas
Kawato, M., Hayakawa, H., & Inui, T. (1993) · Network: Computation in Neural Systems · doi:10.1088/0954-898x_4_4_001 · Cited by 151
Grenander, U. (1978) · Springer eBooks · Cited by 89
Research works printed but not linked: 3
- Hinton, G. E., Advances in Neural Information Processing Systems 6: 3 (1994).
- Mumford, D., Large-Scale Theories of the Cortex: 125 (1994).
- Ullman, S., Large-Scale Theories of the Cortex: 257 (1994).
Cited by
Items 301–400 of 1,002
Kim, H., Moon, J., Hong, D., Cha, E.-Y., & Yun, B. (2020) · Nuclear Engineering and Technology · doi:10.1016/j.net.2020.12.007 · Cited by 61
Representations of uncertainty: where art thou?
Koblinger, Á., Fiser, J., & Lengyel, M. (2021) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2021.03.009 · Cited by 61
Active inference models do not contradict folk psychology
Smith, R. S., Ramstead, M. J. D., & Kiefer, A. B. (2022) · Synthese · doi:10.1007/s11229-022-03480-w · Cited by 61
Attention in a Bayesian Framework
Whiteley, L., & Sahani, M. (2012) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2012.00100 · Cited by 52
Yessou, H., Sümbül, G., & Demir, B. (2020) · IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss39084.2020.9323583 · Cited by 60
Wittkuhn, L., Chien, S., Hall-McMaster, S., & Schuck, N. W. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2021.08.002 · Cited by 60
GSNs: generative stochastic networks
Alain, G., Bengio, Y., Yao, L., Yosinski, J., Thibodeau-Laufer, É., Zhang, S., & Vincent, P. (2016) · Information and Inference A Journal of the IMA · doi:10.1093/imaiai/iaw003 · Cited by 59
Testolin, A., & Zorzi, M. (2016) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2016.00073 · Cited by 59
Verstraete, D., Droguett, E. L., & Modarres, M. (2019) · Sensors · doi:10.3390/s20010176 · Cited by 59
An atomic Boltzmann machine capable of self-adaption
Kiraly, B., Knol, E. J., van Weerdenburg, W. M. J., Kappen, H. J., & Khajetoorians, A. A. (2021) · Nature Nanotechnology · doi:10.1038/s41565-020-00838-4 · Cited by 59
Deep Generative Models for Therapeutic Peptide Discovery: A Comprehensive Review
Lai, L., Liu, Y., Song, B., Li, K., & Zeng, X. (2025) · ACM Computing Surveys · doi:10.1145/3714455 · Cited by 58
Learning linear, sparse, factorial codes
Olshausen, B. A. (1996) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 58
Unifying Generative Models with GFlowNets and BeyondPreprint
Zhang, D., Chen, R. T. Q., Malkin, N., & Bengio, Y. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2209.02606 · Cited by 58
GTM: the generative topographic mapping
Svénsen, J. F. M. (1998) · Aston Publications Explorer (Aston University) · doi:10.48780/publications.aston.ac.uk.00001245 · Cited by 58
Expectation Truncation and the Benefits of Preselection In Training Generative Models
Lücke, J., & Eggert, J. P. (2010) · Journal of Machine Learning Research · doi:10.5555/1756006.1953025 · Cited by 57
Generalizing Back-Translation in Neural Machine Translation
Graça, M., Kim, Y., Schamper, J., Khadivi, S., & Ney, H. (2019) · Conference on Machine Translation (WMT) · doi:10.18653/v1/w19-5205 · Cited by 57
Computing Upper and Lower Bounds on Likelihoods in Intractable NetworksPreprint
Jaakkola, T., & Jordan, M. I. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1302.3586 · Cited by 57
High Fidelity Image Counterfactuals with Probabilistic Causal ModelsPreprint
Ribeiro, F. D. S., Xia, T., Monteiro, M., Pawlowski, N., & Glocker, B. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2306.15764 · Cited by 57
Joint Training of Variational Auto-Encoder and Latent Energy-Based Model
Han, T., Nijkamp, E., Zhou, L., Pang, B., Zhu, S. C., & Wu, Y. N. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00800 · Cited by 56
Recall Traces: Backtracking Models for Efficient Reinforcement LearningPreprint
Goyal, A., Brakel, P., Fedus, W., Singhal, S., Lillicrap, T., Levine, S., Larochelle, H., & Bengio, Y. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.00379 · Cited by 56
Niknazar, H., Malerba, P., & Mednick, S. C. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2122515119 · Cited by 55
Singh, S. K., Tiwari, A. K., & Paliwal, H. K. (2023) · Engineering Analysis with Boundary Elements · doi:10.1016/j.enganabound.2023.06.003 · Cited by 55
Combining Induction and Transduction for Abstract Reasoning
Li, W.-D., Hu, K., Larsen, C., Wu, Y., Alford, S., Woo, C., Dunn, S. M., Tang, H., Naim, M., Nguyen, D., et al. (2024) · International Conference on Learning Representations · doi:10.48550/arxiv.2411.02272 · Cited by 55
Predictive coding as a model of the V1 saliency map hypothesis
Spratling, M. (2011) · Neural Networks · doi:10.1016/j.neunet.2011.10.002 · Cited by 55
A modular CNN-based building detector for remote sensing images
Konstantinidis, D., Argyriou, V., Stathaki, T., & Grammalidis, N. (2019) · Computer Networks · doi:10.1016/j.comnet.2019.107034 · Cited by 55
Rapid Processing and Unsupervised Learning in a Model of the Cortical Macrocolumn
Lücke, J., & von der Malsburg, C. (2004) · Neural Computation · doi:10.1162/089976604772744893 · Cited by 55
GFlowNets and variational inferencePreprint
Whitammer, E. S., Lahlou, S., Deleu, T., Xu, J., Hu, E., Everett, K., Zhang, D., & Bengio, Y. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2210.00580 · Cited by 55
Bayesian Unsupervised Learning of Higher Order Structure
Lewicki, M. S., & B, T. J. S. A. (1996) · neural information processing systems · Cited by 54
AUTONOMOUS ROBOTIC INSPECTION IN TUNNELS
Protopapadakis, E. E., Stentoumis, C., Doulamis, N. D., Doulamis, A. D., Loupos, K., Makantasis, K., Kopsiaftis, G., & Amditis, A. (2016) · ISPRS annals of the photogrammetry, remote sensing and spatial information sciences · doi:10.5194/isprsannals-iii-5-167-2016 · Cited by 54
A Computational Theory of Surprise
Baldi, P. (2002) · Springer eBooks · doi:10.1007/978-1-4757-3585-7_1 · Cited by 54
Integrating representation learning and skill learning in a human-like intelligent agent
Li, N., Matsuda, N., Cohen, W. W., & Koedinger, K. R. (2014) · Artificial Intelligence · doi:10.1016/j.artint.2014.11.002 · Cited by 54
Lim, H., Kornijčuk, V., Seok, J. Y., Kim, S. K., Kim, I., Hwang, C. S., & Jeong, D. S. (2015) · Scientific Reports · doi:10.1038/srep09776 · Cited by 54
Computational Models of Object Recognition in Cortex: A Review
Riesenhuber, M., & Poggio, T. (2000) · Defense Technical Information Center (DTIC) · doi:10.21236/ada458109 · Cited by 54
Accelerated Physical Emulation of Bayesian Inference in Spiking Neural Networks
Kungl, Á. F., Schmitt, S., Klähn, J., Müller, P. F., Baumbach, A., Dold, D., Kugele, A., Müller, E., Koke, C., Kleider, M., et al. (2019) · Frontiers in Neuroscience · doi:10.3389/fnins.2019.01201 · Cited by 53
Fast Sampling-Based Inference in Balanced Neuronal Networks
Hennequin, G., Aitchison, L., & Lengyel, M. (2014) · Bristol Research (University of Bristol) · Cited by 53
Network intrusion detection for cyber security on neuromorphic computing system
Alom, M. Z., & Taha, T. M. (2017) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2017.7966339 · Cited by 52
Cortical Circuitry Implementing Graphical Models
Litvak, S., & Ullman, S. (2009) · Neural Computation · doi:10.1162/neco.2009.05-08-783 · Cited by 48
Head Automata and Bilingual Tiling: Translation with Minimal RepresentationsPreprint
Alshawi, H. (1996) · arXiv (Cornell University) · doi:10.48550/arxiv.cmp-lg/9607005 · Cited by 52
Bayesian Ying-Yang system, best harmony learning, and five action circling
Xu, L. (2010) · Frontiers of Electrical and Electronic Engineering in China · doi:10.1007/s11460-010-0108-9 · Cited by 51
Clark, A. (2014) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199832798.003.0002 · Cited by 51
Head automata and bilingual tiling: translation with minimal representations
Alshawi, H. (1996) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/981863.981886 · Cited by 51
Preintegration Lateral Inhibition Enhances Unsupervised Learning
Spratling, M., & Johnson, M. H. (2002) · Neural Computation · doi:10.1162/089976602320264033 · Cited by 51
Review of Algorithms for Artificial Intelligence on Low Memory Devices
Radanliev, P., & Roure, D. D. (2021) · IEEE Access · doi:10.1109/access.2021.3101579 · Cited by 50
Li, X. (2004) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.828767 · Cited by 50
A Tutorial on Deep Latent Variable Models of Natural LanguagePreprint
Kim, Y., Wiseman, S., & Rush, A. M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.06834 · Cited by 50
ARM: Augment-REINFORCE-Merge Gradient for Stochastic Binary NetworksPreprint
Yin, M., & Zhou, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.11143 · Cited by 50
Degeneracy and Redundancy in Active Inference
Sajid, N., Parr, T., Hope, T. M., Price, C. J., & Friston, K. J. (2020) · Cerebral Cortex · doi:10.1093/cercor/bhaa148 · Cited by 49
Introspective Neural Networks for Generative Modeling
Lazarow, J., Jin, L., & Tu, Z. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.302 · Cited by 49
Revisiting Reweighted Wake-Sleep for Models with Stochastic Control Flow
Le, T. A., Kosiorek, A. R., Siddharth, N., Teh, Y. W., & Wood, F. (2018) · Oxford University Research Archive (ORA) (University of Oxford) · doi:10.48550/arxiv.1805.10469 · Cited by 49
Nijkamp, E., Pang, B., Han, T., Zhou, L., Zhu, S. C., & Wu, Y. N. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58539-6_22 · Cited by 49
Lewandowski, B. C., Vyssotski, A. L., Hahnloser, R. H. R., & Schmidt, M. F. (2013) · Journal of Physiology-Paris · doi:10.1016/j.jphysparis.2013.04.001 · Cited by 49
COVI White PaperPreprint
Alsdurf, H., Belliveau, E., Bengio, Y., Deleu, T., Gupta, P., Ippolito, D., Janda, R., Jarvie, M., Kolody, T., Krastev, S., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.08502 · Cited by 49
Helpless infants are learning a foundation model
Cusack, R., Ranzato, M., & Charvet, C. J. (2024) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2024.05.001 · Cited by 48
Deep neural architectures for large scale android malware analysis
Nauman, M., Tanveer, T. A., Khan, S. R., & Syed, T. A. (2017) · Cluster Computing · doi:10.1007/s10586-017-0944-y · Cited by 48
Neural Variational Correlated Topic Modeling
Liu, L., Huang, H., Gao, Y., Zhang, Y., & Wei, X. (2019) · International World Wide Web Conference (WWW) · doi:10.1145/3308558.3313561 · Cited by 48
Stochastic inference with deterministic spiking neuronsPreprint
Petrovici, M. A., Bill, J., Bytschok, I., Schemmel, J., & Meier, K. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1311.3211 · Cited by 48
Flexible and accurate inference and learning for deep generative modelsPreprint
Vértes, E., & Sahani, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.11051 · Cited by 48
Dayan, P., Hinton, G. E., Neal, R. M., & Zemel, R. S. (1999) · Unsupervised Learning · doi:10.7551/mitpress/7011.003.0017 · Cited by 49
Self-citationGFlowNet-EM for learning compositional latent variable modelsPreprint
Hu, E. J., Malkin, N., Jain, M., Everett, K., Graikos, A., & Bengio, Y. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2302.06576 · Cited by 47
Is Programming by Example Solved by LLMs?
Ellis, K., & Ellis, K. (2024) · neural information processing systems · doi:10.52202/079017-1422 · Cited by 46
Constituent Parsing with Incremental Sigmoid Belief Networks
Titov, I., & Henderson, J. (2007) · Cited by 46
Jordan, M. I., & Bishop, C. (1996) · ACM Computing Surveys · doi:10.1145/234313.234348 · Cited by 46
Learning Sequence Representations
Bayer, J. (2015) · mediaTUM – the media and publications repository of the Technical University Munich (Technical University Munich) · Cited by 46
A deep learning method for lincRNA detection using auto-encoder algorithm
Yu, N., Yu, Z., & Pan, Y. (2017) · BMC Bioinformatics · doi:10.1186/s12859-017-1922-3 · Cited by 45
Stringer, S. M., & Rolls, E. T. (2008) · Neural Networks · doi:10.1016/j.neunet.2007.11.004 · Cited by 45
Xu, L. (2002) · IEEE International Conference on Neural Networks/IEEE ... International Conference on Neural Networks · doi:10.1109/icnn.1996.549130 · Cited by 45
Nadal, J., & Parga, N. (1997) · Neural Computation · doi:10.1162/neco.1997.9.7.1421 · Cited by 45
Fast Second-Order Stochastic Backpropagation for Variational InferencePreprint
Fan, K., Wang, Z., Beck, J. M., Kwok, J. T.-Y., & Heller, K. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1509.02866 · Cited by 45
A neurally plausible model learns successor representations in partially observable environmentsPreprint
Vértes, E., & Sahani, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.09480 · Cited by 45
An extensive dataset of spiking activity to reveal the syntax of the ventral stream
Papale, P., Wang, F., Self, M. W., & Roelfsema, P. R. (2025) · Neuron · doi:10.1016/j.neuron.2024.12.003 · Cited by 44
A New Hypothesis for Sleep: Tuning for Criticality
Pearlmutter, B. A., & Houghton, C. J. (2009) · Neural Computation · doi:10.1162/neco.2009.05-08-787 · Cited by 38
Unsupervised pretraining in biological neural networks
Zhong, L., Baptista, S., Gattoni, R., Arnold, J., Flickinger, D., Stringer, C., & Pachitariu, M. (2025) · Nature · doi:10.1038/s41586-025-09180-y · Cited by 43
Variational Online Learning of Neural Dynamics
Zhao, Y., & Park, I. M. (2020) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2020.00071 · Cited by 43
New trends in quantum machine learning (a)
Buffoni, L., & Caruso, F. (2020) · Europhysics Letters (EPL) · doi:10.1209/0295-5075/132/60004 · Cited by 43
A study of the generalizability of self-supervised representations
Tendle, A., & Hasan, M. R. (2021) · Machine Learning with Applications · doi:10.1016/j.mlwa.2021.100124 · Cited by 43
Neural circuits and symbolic processing
Do, Q. H., & Hasselmo, M. E. (2021) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2021.107552 · Cited by 42
The Genetic Convolutional Neural Network Model Based on Random Sample
You, Z., & Pu, Y. (2015) · International Journal of u- and e- Service Science and Technology · doi:10.14257/ijunesst.2015.8.11.31 · Cited by 42
Hochberg, J. E. (1998) · Elsevier eBooks · doi:10.1016/b978-012301160-2/50011-3 · Cited by 42
Cramer-Wold AutoEncoderPreprint
Knop, S., Tabor, J., Spurek, P., Podolak, I. T., Mazur, M., & Jastrzȩbski, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.09235 · Cited by 42
Stable Target Field for Reduced Variance Score Estimation in Diffusion ModelsPreprint
Xu, Y., Tong, S., & Jaakkola, T. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2302.00670 · Cited by 42
Context as Supervisory Signal: Discovering Objects with Predictable Context
Doersch, C., Gupta, A., & Efros, A. A. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10578-9_24 · Cited by 38
Free Energy Score Spaces: Using Generative Information in Discriminative Classifiers
Perina, A., Cristani, M., Castellani, U., Murino, V., & Jojić, N. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.241 · Cited by 41
Sleep and Dreaming in the Predictive Processing Framework
Bucci, A., & Grasso, M. (2017) · Gutenberg Open Science · doi:10.15502/9783958573079 · Cited by 41
Explaining and Generalizing Back-Translation through Wake-SleepPreprint
Cotterell, R., & Kreutzer, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.04402 · Cited by 41
MAE: Mutual Posterior-Divergence Regularization for Variational AutoEncodersPreprint
Ma, X., Zhou, C., & Hovy, E. H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.01498 · Cited by 41
EM-like Learning Chaotic Dynamics from Noisy and Partial ObservationsPreprint
Nguyen, D., Ouala, S., Drumetz, L., & Fablet, R. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.10335 · Cited by 41
Auto-Encoding Variational Neural Machine Translation
Eikema, B., & Aziz, W. F. (2019) · Workshop on Representation Learning for NLP (RepL4NLP) · doi:10.18653/v1/w19-4315 · Cited by 40
Factor Analysis Using Delta-Rule Wake-Sleep Learning
Neal, R. M., & Dayan, P. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1781 · Cited by 40
Self-citationNeural characterization in partially observed populations of spiking neurons
Pillow, J. W., & Latham, P. E. (2007) · UCL Discovery (University College London) · Cited by 40
PLAD: Learning to Infer Shape Programs with Pseudo-Labels and Approximate Distributions
Jones, R. K., Walke, H., & Ritchie, D. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00964 · Cited by 39
FlowRL: Matching Reward Distributions for LLM Reasoning
Zhu, X., Cheng, D., Zhang, D., Li, H., Zhang, K., Jiang, C., Sun, Y., Hua, E., Zuo, Y., Lv, X., et al. (2025) · International Conference on Learning Representations · doi:10.48550/arxiv.2509.15207 · Cited by 38
Psychophysical identity and free energy
Kiefer, A. B. (2020) · Journal of The Royal Society Interface · doi:10.1098/rsif.2020.0370 · Cited by 39
Machine learning on knowledge graphs for context-aware security monitoring
Garrido, J. S., Dold, D., & Frank, J. (2021) · IEEE International Conference on Cyber Security and Resilience (CSR) · doi:10.1109/csr51186.2021.9527927 · Cited by 38
Oversampled and undersolved: Depressive rumination from an active inference perspective
Berg, M., Feldmann, M., Kirchner, L., & Κube, T. (2022) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2022.104873 · Cited by 38
Human-like Few-Shot Learning via Bayesian Reasoning over Natural Language
Ellis, K. (2023) · neural information processing systems · doi:10.52202/075280-0577 · Cited by 38
Deep Learning vs. Wise Learning: A Critical and Challenging Overview
Groumpos, P. P. (2016) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2016.11.099 · Cited by 38
Robot docking with neural vision and reinforcement
Weber, C., Wermter, S., & Zochios, A. (2004) · Knowledge-Based Systems · doi:10.1016/j.knosys.2004.03.012 · Cited by 38
Miyashita, Y. (2022) · Proceedings of the Japan Academy Series B · doi:10.2183/pjab.98.007 · Cited by 37
A Mean Field Learning Algorithm for Unsupervised Neural Networks
Saul, L. K., & Jordan, M. I. (1998) · Springer eBooks · doi:10.1007/978-94-011-5014-9_20 · Cited by 37
Bullier, J. (2006) · 23 Problems in Systems Neuroscience · doi:10.1093/acprof:oso/9780195148220.003.0006 · Cited by 33
Metadata
- Authors
- Hinton, G. E., Dayan, P., Frey, B. J., & Neal, R. M.
- Affiliations
- University of Toronto (CA)
- ORCID
- Dayan, Peter
- Venue
- Science
- Published
- 1995-05-26
- Volume
- 268
- Issue
- 5214
- Pages
- 1158-1161
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W1993845689
- Cited by
- 1,070
- References
- 9
- Citations by year
- 2026: 18 · 2025: 33 · 2024: 36 · 2023: 57 · 2022: 57 · 2021: 68 · 2020: 63 · 2019: 79 · 2018: 79 · 2017: 64 · 2016: 52 · 2015: 42 · 2014: 37 · 2013: 19 · 2012: 18
- FWCI
- 28.04
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- UCL Discovery (University College London) (submittedVersion)
- MPG.PuRe (Max Planck Society) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- unsupervised learning, stochastic neurons, multilayer neural networks, top-down connections, representation learning, generative models, neural network adaptation
- MeSH terms
- Algorithms, Probability, Stochastic Processes, Neural Networks, Computer
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.