The "Wake-Sleep" Algorithm for Unsupervised Neural Networks
The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
An unsupervised learning algorithm for a multilayer network of stochastic neurons is described. Bottom-up "recognition" connections convert the input into representations in successive hidden layers, and top-down "generative" connections reconstruct the representation in one layer from the representation in the layer above. In the "wake" phase, neurons are driven by recognition connections, and generative connections are adapted to increase the probability that they would reconstruct the correct activity vector in the layer below. In the "sleep" phase, neurons are driven by generative connections, and recognition connections are adapted to increase the probability that they would produce the correct activity vector in the layer above.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“A first meta-structure pops up when considering the classical Wake-Sleep algorithm [52], described above as a model for NREM sleep (that we extended by random perturbations in the replay).”
From How Adversarial REM Dreams May Facilitate Creativity, and Why We Become Aware of Them (2024) · cites this paper as [52]
In the citing paper
“In this algorithm, the FF recognition pathway is trained during the Sleep phase so that it inverts the FB generative pathway. The generative FB pathway is itself trained during the Wake phase so that it learns to reproduce the sensory activity from the internal representation generated by the FF pathway.”
From How Adversarial REM Dreams May Facilitate Creativity, and Why We Become Aware of Them (2024) · cites this paper as [52]
In the citing paper
“Bayesian inference and related theories have been proposed as a more appropriate theoretical framework for reasoning about top-down visual processing in the brain. 1,2,4,6,26,27”
From Hierarchical Bayesian inference in the visual cortex (2003) · cites this paper as [2]
In the citing paper
“In one common form of unsupervised learning, higher brain areas attempt to produce samples that are statistically similar to those actually seen in lower layers.”
From Toward an integration of deep learning and neuroscience (2016) · cites this paper as Hinton et al., 1995
In the citing paper
“For example, the wake-sleep algorithm (Hinton et al., 1995) requires the sleep mode to sample potential data points whose distribution should then match the observed distribution.”
From Toward an integration of deep learning and neuroscience (2016) · cites this paper as Hinton et al., 1995
Citations
Cites
Ballard, D. H., & Brown, C. M. (1982) · Cited by 5,303
A massively parallel architecture for a self-organizing neural pattern recognition machine
Carpenter, G. A., & Grossberg, S. (1987) · Computer Vision, Graphics, and Image Processing · doi:10.1016/s0734-189x(87)80014-2 · Cited by 2,525
Barlow, H. B. (1989) · Neural Computation · doi:10.1162/neco.1989.1.3.295 · Cited by 1,650
Stochastic Complexity in Statistical Inquiry
Rissanen, J. (1998) · WORLD SCIENTIFIC eBooks · doi:10.1142/0822 · Cited by 1,539
Forward models: supervised learning with a distal teacher
Jordan, M. I., & Rumelhart, D. E. (1992) · Cognitive Science · doi:10.1207/s15516709cog1603_1 · Cited by 1,451
Dayan, P., Hinton, G. E., Neal, R. M., & Zemel, R. S. (1995) · Neural Computation · doi:10.1162/neco.1995.7.5.889 · Cited by 1,207
Self-citationHasselmo, M. E., & Bower, J. M. (1993) · Trends in Neurosciences · doi:10.1016/0166-2236(93)90159-j · Cited by 427
A forward-inverse optics model of reciprocal connections between visual cortical areas
Kawato, M., Hayakawa, H., & Inui, T. (1993) · Network: Computation in Neural Systems · doi:10.1088/0954-898x_4_4_001 · Cited by 151
Grenander, U. (1978) · Springer eBooks · Cited by 89
Research works printed but not linked: 3
- Hinton, G. E., Advances in Neural Information Processing Systems 6: 3 (1994).
- Mumford, D., Large-Scale Theories of the Cortex: 125 (1994).
- Ullman, S., Large-Scale Theories of the Cortex: 257 (1994).
Cited by
Items 601–700 of 1,002
Experiment Improvement of Restricted Boltzmann Machine Methods for Image Classification
Dewi, C., Chen, R.-C., Hendry, H., & Hung, H.-T. (2021) · Vietnam Journal of Computer Science · doi:10.1142/s2196888821500184 · Cited by 13
Probabilistic Programming with Programmable Variational Inference
Becker, M. R., Lew, A. K., Wang, X., Ghavami, M., Huot, M., Rinard, M., & Mansinghka, V. K. (2024) · Proceedings of the ACM on Programming Languages · doi:10.1145/3656463 · Cited by 13
A Comprehensive Review of Emerging Computational Methods for Gene Identification
Yu, N., Zeng, Y., Li, B., Gu, F., & Pan, Y. F. (2016) · Journal of Information Processing Systems · doi:10.3745/jips.04.0023 · Cited by 13
A Survey and Formal Analyses on Sequence Learning Methodologies and Deep Neural Networks
Wang, Y., Leung, H., Gavrilova, M. L., Zatarain, O. A., Graves, D., Lü, J., Howard, N., Kwong, S., Sheu, P. C. ‐., & Patel, S. (2018) · IEEE International Conference on Cognitive Informatics & Cognitive Computing (ICCI*CC) · doi:10.1109/icci-cc.2018.8482022 · Cited by 13
Convolutional restricted boltzmann machines for feature learning
Norouzi, M. (2009) · Summit (Simon Fraser University) · Cited by 13
Spiking neuron network Helmholtz machine
Sountsov, P., & Miller, P. C. (2015) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2015.00046 · Cited by 13
Combining probabilistic population codes
Zemel, R. S., & Dayan, P. (1997) · UCL Discovery (University College London) · Cited by 13
Self-citationComputational models of memory consolidation and long-term synaptic plasticity during sleep
Rennó‐Costa, C., da Silva, A. C. C., Blanco, W., & Ribeiro, S. T. G. (2018) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2018.10.003 · Cited by 13
Helmholtz machines and wake-sleep learning
Dayan, P. (2003) · MPG.PuRe (Max Planck Society) · Cited by 13
Self-citationDeep Learning: A key of Stepping into the Era of Big Data
Yu, B., Li, S., Xu, S., & Ji, R. (2014) · JOURNAL OF ENGINEERING STUDIES · doi:10.3724/sp.j.1224.2014.00233 · Cited by 13
Feedback Decoding of Spatially Structured Population Activity in Cortical Maps
Swindale, N. V. (2007) · Neural Computation · doi:10.1162/neco.2008.20.1.176 · Cited by 13
Analysis, Synthesis, and Retargeting of Facial Expressions
Bregler, C., & Chuang, E. S. (2004) · Cited by 13
Learning Algorithms for RBF Functions and Subspace Based Functions
Xu, L. (2011) · IGI Global eBooks · doi:10.4018/978-1-60960-818-7.ch416 · Cited by 13
Advances in Algorithms for Inference and Learning in Complex Probability Models
Frey, B. J., & Jojić, N. (2003) · Cited by 13
Self-citationSTOCHASTIC RADIAL BASIS FUNCTIONS
CARD, H. C. (2001) · International Journal of Neural Systems · doi:10.1142/s0129065701000552 · Cited by 13
Bayesian Ying Yang System, Best Harmony Learning, and Gaussian Manifold Based Family
Xu, L. (2008) · Springer eBooks · doi:10.1007/978-3-540-68860-0_3 · Cited by 13
Scaling Factorial Hidden Markov Models: Stochastic Variational Inference without MessagesPreprint
Ng, Y. C., Chilinski, P. M., & Silva, R. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1608.03817 · Cited by 13
Context Aware Machine LearningPreprint
Zeng, Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.03415 · Cited by 13
(2024) · doi:10.1109/icra57147.2024.10611448 · Cited by 12
Computational role of sleep in memory reorganization
Yoshida, K., & Toyoizumi, T. (2023) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2023.102799 · Cited by 12
Antonov, G. K., & Dayan, P. (2025) · Nature Communications · doi:10.1038/s41467-025-56731-y · Cited by 12
Self-citationQuantum density peak clustering
Magano, D., Buffoni, L., & Omar, Y. (2023) · Quantum Machine Intelligence · doi:10.1007/s42484-022-00090-0 · Cited by 12
Prathima Chilukuri, J. R. A. K., Kumar, J. R. A., Anusuya, R., & Prabhu, M. R. (2022) · Journal of Pharmaceutical Negative Results · doi:10.47750/pnr.2022.13.04.142 · Cited by 12
Optimal Encoding in Stochastic Latent-Variable Models
Rule, M. E., Sorbaro, M., & Hennig, M. H. (2020) · Entropy · doi:10.3390/e22070714 · Cited by 12
Attention for Inference Compilation
Harvey, W., Munk, A., Baydin, A. G., Bergholm, A., & Wood, F. (2022) · International Conference on Simulation and Modeling Methodologies, Technologies and Applications · doi:10.5220/0011277700003274 · Cited by 12
Comparative Analysis of Restricted Boltzmann Machine Models for Image Classification
Dewi, C., Chen, R.-C., Hendry, H., & Hung, H.-T. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-42058-1_24 · Cited by 12
Zhang, Q., Wang, T., Pei, Y., & Shi, X. (2021) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2021.3105703 · Cited by 12
Topographic Maps for Clustering and Data Visualization
Fyfe, C. (2008) · Studies in computational intelligence · doi:10.1007/978-3-540-78293-3_3 · Cited by 12
Brain-Like Emergent Temporal Processing: Emergent Open States
Weng, J., Luciw, M., & Zhang, Q. (2013) · IEEE Transactions on Autonomous Mental Development · doi:10.1109/tamd.2013.2258398 · Cited by 12
Deep learning in pharmacy: The prediction of aqueous solubility based on deep belief network
Li, H., Yu, L., Tian, S., Li, L., Wang, M., & Lu, X. (2017) · Automatic Control and Computer Sciences · doi:10.3103/s0146411617020043 · Cited by 12
Learning in intelligent embedded systems
Lee, D. D., & Seung, H. S. (1999) · Cited by 12
A simple algorithm that discovers efficient perceptual codes
Frey, B. J., Dayan, P., & Hinton, G. E. (1997) · MPG.PuRe (Max Planck Society) · Cited by 12
Self-citationComplex text processing by the temporal context machines
Weng, J., Zhang, Q., Chi, M., & Xue, X. (2009) · IEEE International Conference on Development and Learning (ICDL) · doi:10.1109/devlrn.2009.5175540 · Cited by 12
Bottleneck Conditional Density EstimationPreprint
Shu, R., Bui, H., & Ghavamzadeh, M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.08568 · Cited by 12
Iterative Refinement of the Approximate Posterior for Directed Belief NetworksPreprint
Hjelm, R. D., Cho, K., Chung, J., Salakhutdinov, R. R., Calhoun, V. D., & Jojić, N. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.06382 · Cited by 12
Learning Energy-based Model with Flow-based Backbone by Neural Transport MCMCPreprint
Nijkamp, E., Gao, R., Sountsov, P., Srinivas, V., Pang, B., Zhu, S. C., & Wu, Y. N. (2020) · arXiv (Cornell University) · Cited by 12
Learning Proposals for Probabilistic Programs with Inference CombinatorsPreprint
Stites, S., Zimmermann, H., Wu, H., Sennesh, E., & van de Meent, J.-W. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.00668 · Cited by 12
Computational Morphology with Neural Network ApproachesPreprint
Liu, L. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.09404 · Cited by 12
A hierarchical community of experts
Sallans, B., Hinton, G. E., Ghahramani, Z., et al. (1998) · TSpace (University of Toronto) · Cited by 12
Self-citationPiecewise Latent Variables for Neural Variational Text ProcessingPreprint
Serban, I. V., Ororbia, A. G., Pineau, J., & Courville, A. C. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.00377 · Cited by 12
Nearest Neighbour Score Estimators for Diffusion Generative ModelsPreprint
Niedoba, M., Green, D., Naderiparizi, S., Lioutas, V., Lavington, J. W., Liang, X.-X., Liu, Y.-P., Zhang, K., Dabiri, S., Scibior, A., et al. (2024) · International Conference on Machine Learning · doi:10.48550/arxiv.2402.08018 · Cited by 12
Exploration and preference satisfaction trade-off in reward-free learning
Sajid, N., Tigas, P., Zakharov, A., Fountas, Z., & Friston, K. (2021) · arXiv · doi:10.48550/arxiv.2106.04316 · Cited by 11
Zhang, T., Wang, Q., & Xu, B. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3286458 · Cited by 11
Energy-Based Models with Applications to Speech and Language Processing
Ou, Z. (2024) · Foundations and Trends® in Signal Processing · doi:10.1561/2000000117 · Cited by 11
Camera-based Sudoku recognition with deep belief network
Wicht, B., & Hennebert, J. (2014) · International Conference of Soft Computing and Pattern Recognition (SoCPaR) · doi:10.1109/socpar.2014.7007986 · Cited by 11
A Tutorial on Helmholtz Machines
Kirby, K. G. (2006) · Cited by 11
PHND: Pashtu Handwritten Numerals Database and deep learning benchmark
Khan, K., Roh, B., Ali, J., Khan, R. U., Uddin, M. I., Hassan, S., Riaz, R., & Ahmad, N. (2020) · PLoS ONE · doi:10.1371/journal.pone.0238423 · Cited by 11
On the locality of the natural gradient for learning in deep Bayesian networks
Ay, N. (2020) · Information Geometry · doi:10.1007/s41884-020-00038-y · Cited by 11
The Neural Representation of Events Is Dominated by Elements that Are Most Reliably Present
Bromis, K., Raykov, P., Wickens, L., Roseboom, W., & Bird, C. M. (2022) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01802 · Cited by 11
Recent advances in uncertainty quantification methods for engineering problems
Kumar, D., Ahmed, F., Usman, S., Alajo, A. B., & Alam, S. B. (2023) · Elsevier eBooks · doi:10.1016/b978-0-32-391919-7.00027-5 · Cited by 11
Generalization Gap in Amortized Inference
Zhang, M., Hayes, P., & Barber, D. (2022) · neural information processing systems · doi:10.52202/068431-1942 · Cited by 11
Multi-modal Variational Encoder-Decoders
Serban, I. V., Ororbia, A. G., Pineau, J., & Courville, A. C. (2017) · Cited by 11
Adaptation and Unsupervised Learning
Dayan, P., Sahani, M., & Deback, G. (2002) · UCL Discovery (University College London) · Cited by 11
Self-citationRevisiting Reweighted Wake-SleepPreprint
Lê, T. A., Kosiorek, A. R., Siddharth, N., Teh, Y. W., & Wood, F. (2018) · arXiv (Cornell University) · Cited by 11
A structured observation distribution for generative biological sequence prediction and forecastingPreprint
Weinstein, E. N., & Marks, D. S. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.07.31.231381 · Cited by 11
A wake-sleep algorithm for recurrent, spiking neural networks
Thiele, J., Diehl, P., & Cook, M. (2017) · arXiv · doi:10.48550/arxiv.1703.06290 · Cited by 10
Causal representation learning through higher-level information extraction
Silva, F., Oliveira, H. P., & Pereira, T. (2024) · ACM Computing Surveys · doi:10.1145/3696412 · Cited by 10
Wake-Sleep Consolidated Learning
Sorrenti, A., Bellitto, G., Salanitri, F. P., Pennisi, M., Palazzo, S., & Spampinato, C. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3458440 · Cited by 10
DeepMapping: Learned Data Mapping for Lossless Compression and Efficient Lookup
Zhou, L., Candan, K. S., & Zou, J. (2024) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde60146.2024.00008 · Cited by 10
Deep Discriminative and Generative Models for Pattern Recognition
Deng, L., & Jaitly, N. (2015) · Cited by 10
Self-Knowledge in a Predictive Processing Framework
Schwengerer, L. (2018) · Review of Philosophy and Psychology · doi:10.1007/s13164-018-0416-1 · Cited by 10
Hybrid Helmholtz machines: a gate-based quantum circuit implementation
van Dam, T. J., Neumann, N. M. P., Phillipson, F., & van den Berg, H. (2020) · Quantum Information Processing · doi:10.1007/s11128-020-02660-2 · Cited by 10
Li, J., Aniva, L., Shi, P., & Zhang, Y. (2023) · Proceedings of the ACM on Programming Languages · doi:10.1145/3571243 · Cited by 10
Building 3D Generative Models from Minimal Data
Sutherland, S., Egger, B., & Tenenbaum, J. B. (2023) · International Journal of Computer Vision · doi:10.1007/s11263-023-01870-2 · Cited by 10
Learning in a Unitary Coherent Hippocampus
Fox, C., & Prescott, T. J. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15819-3_52 · Cited by 10
Tag-aware image classification via Nested Deep Belief nets
Yuan, Z., Sang, J., & Xu, C. (2013) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2013.6607503 · Cited by 10
Factorized Convolutional Networks: Unsupervised Fine-Tuning for Image Clustering
Gui, L.-Y., Gui, L., Wang, Y.-X., Morency, L., & Moura, J. M. F. (2018) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2018.00137 · Cited by 10
Aggarwal, C. C. (2018) · Springer eBooks · doi:10.1007/978-3-319-94463-0_6 · Cited by 10
Anomaly Detection of Railway Catenary Based on Deep Convolutional Generative Adversarial Networks
Yang, P., Jin, W., & Tang, P. (2018) · IEEE Advanced Information Technology, Electronic and Automation Control Conference (IAEAC) · doi:10.1109/iaeac.2018.8577821 · Cited by 10
Posed and Spontaneous Expression Distinction Using Latent Regression Bayesian Networks
Wang, S., Hao, L., & Ji, Q. (2020) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3391290 · Cited by 10
Inference and Learning in a Latent Variable Model for Beta Distributed Interval Data
Mousavi, H., Buhl, M., Guiraud, E., Drefs, J., & Lücke, J. (2021) · Entropy · doi:10.3390/e23050552 · Cited by 10
Recognition in Hierarchical Models
Dayan, P. (1997) · Springer eBooks · doi:10.1007/978-3-642-60539-0_4 · Cited by 10
Self-citationNeuronal integration of dynamic sources: Bayesian learning and Bayesian inference
Siegelmann, H. T., & Holzman, L. E. (2010) · Chaos An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/1.3491237 · Cited by 10
Systems and molecular genetic approaches converge to tackle learning and memory
Gasic, G. P. (1995) · Neuron · doi:10.1016/0896-6273(95)90140-x · Cited by 10
Joint Stochastic Approximation learning of Helmholtz MachinesPreprint
Xu, H., & Ou, Z. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.06170 · Cited by 10
Waking and Dreaming Consciousness: Neurobiological and Functional Considerations
Hobson, J. A., & Friston, K. J. (2018) · Elsevier eBooks · doi:10.1016/b978-0-12-809324-5.21972-x · Cited by 10
Learning beyond sensations: How dreams organize neuronal representations
Deperrois, N., Petrovici, M. A., Senn, W., & Jordan, J. (2024) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105508 · Cited by 9
Deep Learning Algorithm Design for Discovery and Dysfunction of Landmines
Leelavathy, S., Balakrishnan, S., Manikandan, M., Palanimeera, J., Prabha, K. M., & Vidhya, R. (2024) · International Journal of Computational and Experimental Science and Engineering · doi:10.22399/ijcesen.686 · Cited by 9
Denoising Diffusion Variational Inference: Diffusion Models as Expressive Variational Posteriors
Piriyakulkij, W. T., Wang, Y., & Kuleshov, V. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i19.34194 · Cited by 9
Hierarchical Novelty-Familiarity Representation in the Visual System by Modular Predictive Coding
Vladimirskiy, B., Urbanczik, R., & Senn, W. (2015) · PLoS ONE · doi:10.1371/journal.pone.0144636 · Cited by 9
Neuronal Firing Rate As Code Length: a Hypothesis
Qian, N., & Zhang, J. (2019) · Computational Brain & Behavior · doi:10.1007/s42113-019-00028-z · Cited by 9
Deep Learning in Smart Health: Methodologies, Applications, Challenges
Şimşek, M., Obinikpo, A. A., & Kantarcı, B. (2019) · Springer eBooks · doi:10.1007/978-3-030-27844-1_3 · Cited by 9
Frontal Cortex Neuron Type Classification with Deep Learning and Recurrence Plot
Özcan, F., & Alkan, A. (2021) · Traitement du signal · doi:10.18280/ts.380327 · Cited by 9
Zhang, W., Zhang, Y., She, Y., & Shao, J. (2021) · IEEE Signal Processing Letters · doi:10.1109/lsp.2021.3099073 · Cited by 9
Locating Hidden Exoplanets in ALMA Data Using Machine Learning
Terry, J. P., Hall, C., Abreau, S. A., & Gleyzer, S. V. (2022) · The Astrophysical Journal · doi:10.3847/1538-4357/aca477 · Cited by 9
Li, J., Zhang, C., Wang, L., Ding, P., Hu, L., Yan, B., & Tong, L. (2021) · Brain Sciences · doi:10.3390/brainsci11081004 · Cited by 9
Razzaq, M., Goumidi, L., Iglesias, M. J., Munsch, G., Bruzelius, M., Ibrahim‐Kosta, M., Butler, L. M., Odeberg, J., Morange, P., & Trégouët, D. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-85633-5_7 · Cited by 9
Reinforcement Learning Embedded in Brains and Robots
Weber, C., Elshaw, M., Wermter, S., Triesch, J., & Willmot, C. (2008) · doi:10.5772/5278 · Cited by 9
ASSOCIATIVE NEURAL MODELS FOR BIOMIMETIC MULTI-MODAL LEARNING IN A MIRROR NEURON-BASED ROBOT
Wermter, S., Weber, C., & Elshaw, M. (2005) · Neural Computation and Psychology Workshop (NCPW) · doi:10.1142/9789812701886_0003 · Cited by 9
Mean Field Methods for a Special Class of Belief Networks
Bhattacharyya, C., & Keerthi, S. S. (2001) · Journal of Artificial Intelligence Research · doi:10.1613/jair.734 · Cited by 9
Xu, L. (2002) · IEEE International Conference on Neural Networks/IEEE ... International Conference on Neural Networks · doi:10.1109/icnn.1997.614196 · Cited by 9
Metastable associative network models of dream sleep
Nakao, M., Honda, I., Musila, M., & Yamamoto, M. (1997) · Neural Networks · doi:10.1016/s0893-6080(97)00061-0 · Cited by 9
Inference in Multilayer Networks via Large Deviation Bounds
Kearns, M. J., & Saul, L. K. (1998) · neural information processing systems · Cited by 9
The Neural Marketplace: I. General Formalism and Linear TheoryPreprint
Lewis, S. N., & Harris, K. D. (2014) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/013185 · Cited by 9
Multimodal emotion recognition using deep learning techniques
Nguyen, T. D. (2020) · Queensland University of Technology · doi:10.5204/thesis.eprints.180753 · Cited by 9
Generating Meaning: Active Inference and the Scope and Limits of Passive AI
Pezzulo, G., Parr, T., Cisek, P., Clark, A., & Friston, K. (2023) · doi:10.31234/osf.io/8xgzv · Cited by 8
Modeling lane changes using parallel learning
Han, Y., Li, Y., Yu, S., Peng, J., Bai, L., & Liu, P. (2024) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2024.104841 · Cited by 8
Anomaly detection in aeronautics data with quantum-compatible discrete deep generative model
Templin, T., Memarzadeh, M., Vinci, W., Lott, P. A., Asanjan, A. A., Armenakas, A. A., & Rieffel, E. G. (2023) · Machine Learning Science and Technology · doi:10.1088/2632-2153/ace756 · Cited by 8
Learning Generator Networks for Dynamic Patterns
Han, T., Lü, Y., Wu, J., Xing, X., & Wu, Y. N. (2019) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2019.00091 · Cited by 8
Metadata
- Authors
- Hinton, G. E., Dayan, P., Frey, B. J., & Neal, R. M.
- Affiliations
- University of Toronto (CA)
- ORCID
- Dayan, Peter
- Venue
- Science
- Published
- 1995-05-26
- Volume
- 268
- Issue
- 5214
- Pages
- 1158-1161
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W1993845689
- Cited by
- 1,070
- References
- 9
- Citations by year
- 2026: 18 · 2025: 33 · 2024: 36 · 2023: 57 · 2022: 57 · 2021: 68 · 2020: 63 · 2019: 79 · 2018: 79 · 2017: 64 · 2016: 52 · 2015: 42 · 2014: 37 · 2013: 19 · 2012: 18
- FWCI
- 28.04
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- UCL Discovery (University College London) (submittedVersion)
- MPG.PuRe (Max Planck Society) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- unsupervised learning, stochastic neurons, multilayer neural networks, top-down connections, representation learning, generative models, neural network adaptation
- MeSH terms
- Algorithms, Probability, Stochastic Processes, Neural Networks, Computer
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.