The "Wake-Sleep" Algorithm for Unsupervised Neural Networks
The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
An unsupervised learning algorithm for a multilayer network of stochastic neurons is described. Bottom-up "recognition" connections convert the input into representations in successive hidden layers, and top-down "generative" connections reconstruct the representation in one layer from the representation in the layer above. In the "wake" phase, neurons are driven by recognition connections, and generative connections are adapted to increase the probability that they would reconstruct the correct activity vector in the layer below. In the "sleep" phase, neurons are driven by generative connections, and recognition connections are adapted to increase the probability that they would produce the correct activity vector in the layer above.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“A first meta-structure pops up when considering the classical Wake-Sleep algorithm [52], described above as a model for NREM sleep (that we extended by random perturbations in the replay).”
From How Adversarial REM Dreams May Facilitate Creativity, and Why We Become Aware of Them (2024) · cites this paper as [52]
In the citing paper
“In this algorithm, the FF recognition pathway is trained during the Sleep phase so that it inverts the FB generative pathway. The generative FB pathway is itself trained during the Wake phase so that it learns to reproduce the sensory activity from the internal representation generated by the FF pathway.”
From How Adversarial REM Dreams May Facilitate Creativity, and Why We Become Aware of Them (2024) · cites this paper as [52]
In the citing paper
“Bayesian inference and related theories have been proposed as a more appropriate theoretical framework for reasoning about top-down visual processing in the brain. 1,2,4,6,26,27”
From Hierarchical Bayesian inference in the visual cortex (2003) · cites this paper as [2]
In the citing paper
“In one common form of unsupervised learning, higher brain areas attempt to produce samples that are statistically similar to those actually seen in lower layers.”
From Toward an integration of deep learning and neuroscience (2016) · cites this paper as Hinton et al., 1995
In the citing paper
“For example, the wake-sleep algorithm (Hinton et al., 1995) requires the sleep mode to sample potential data points whose distribution should then match the observed distribution.”
From Toward an integration of deep learning and neuroscience (2016) · cites this paper as Hinton et al., 1995
Citations
Cites
Ballard, D. H., & Brown, C. M. (1982) · Cited by 5,303
A massively parallel architecture for a self-organizing neural pattern recognition machine
Carpenter, G. A., & Grossberg, S. (1987) · Computer Vision, Graphics, and Image Processing · doi:10.1016/s0734-189x(87)80014-2 · Cited by 2,525
Barlow, H. B. (1989) · Neural Computation · doi:10.1162/neco.1989.1.3.295 · Cited by 1,650
Stochastic Complexity in Statistical Inquiry
Rissanen, J. (1998) · WORLD SCIENTIFIC eBooks · doi:10.1142/0822 · Cited by 1,539
Forward models: supervised learning with a distal teacher
Jordan, M. I., & Rumelhart, D. E. (1992) · Cognitive Science · doi:10.1207/s15516709cog1603_1 · Cited by 1,451
Dayan, P., Hinton, G. E., Neal, R. M., & Zemel, R. S. (1995) · Neural Computation · doi:10.1162/neco.1995.7.5.889 · Cited by 1,207
Self-citationHasselmo, M. E., & Bower, J. M. (1993) · Trends in Neurosciences · doi:10.1016/0166-2236(93)90159-j · Cited by 427
A forward-inverse optics model of reciprocal connections between visual cortical areas
Kawato, M., Hayakawa, H., & Inui, T. (1993) · Network: Computation in Neural Systems · doi:10.1088/0954-898x_4_4_001 · Cited by 151
Grenander, U. (1978) · Springer eBooks · Cited by 89
Research works printed but not linked: 3
- Hinton, G. E., Advances in Neural Information Processing Systems 6: 3 (1994).
- Mumford, D., Large-Scale Theories of the Cortex: 125 (1994).
- Ullman, S., Large-Scale Theories of the Cortex: 257 (1994).
Cited by
Items 401–500 of 1,002
Wang, H., & Raj, B. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1510.04781 · Cited by 37
Optimizing Neural Networks that Generate Iimages
Tieleman, T. (2014) · TSpace (University of Toronto) · Cited by 37
Overdispersed Black-Box Variational InferencePreprint
Ruiz, F. J. R., Titsias, M. K., & Blei, D. M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.01140 · Cited by 37
Introspective Classification with Convolutional NetsPreprint
Jin, L., Lazarow, J., & Tu, Z. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1704.07816 · Cited by 37
Partridge, D. (2002) · Elsevier eBooks · doi:10.1016/b0-12-227210-2/00038-8 · Cited by 37
Cunningham, R. J., & Loram, I. D. (2020) · Journal of The Royal Society Interface · doi:10.1098/rsif.2019.0715 · Cited by 36
“Even without many (or any) labels (which may often be the case with respect to deep muscles) features can be extracted using generative models such as restricted Boltzmann machines [44,55], deep belief networks [56], deep (variational) autoencoders/autoassociators royalsocietying.”
BackgroundWong, L., Grand, G., Lew, A. K., Goodman, N. D., Mansinghka, V. K., Andreas, J., & Tenenbaum, J. B. (2023) · arXiv · doi:10.48550/arxiv.2306.12672 · Cited by 36
Meta-Amortized Variational Inference and Learning
Wu, M., Choi, K., Goodman, N. D., & Ermon, S. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.6111 · Cited by 36
Testing a computational theory of brain functioning with virtual reality
Vasser, M. (2020) · DSpace repository (University of Tartu) · Cited by 36
Brain-Inspired Machine Intelligence: A Survey of Neurobiologically-Plausible Credit AssignmentPreprint
Ororbia, A. G. (2023) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/xukqf · Cited by 36
Survey of deep learning in face recognition
Fu, Z., Yan-Ning, Z., & Hai-Yan, H. (2014) · International Conference on Orange Technologies · doi:10.1109/icot.2014.6954663 · Cited by 35
Deep learning systems as complex networks
Testolin, A., Piccolini, M., & Suweis, S. S. (2019) · Journal of Complex Networks · doi:10.1093/comnet/cnz018 · Cited by 35
Piecewise Latent Variables for Neural Variational Text Processing
Serban, I. V., Ororbia, A. G., Pineau, J., & Courville, A. C. (2017) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d17-1043 · Cited by 35
Neural Variational Inference and Learning in Undirected Graphical ModelsPreprint
Kuleshov, V., & Ermon, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.02679 · Cited by 35
Elucidating the Theoretical Underpinnings of Surrogate Gradient Learning in Spiking Neural Networks
Gygax, J., & Zenke, F. (2025) · Neural Computation · doi:10.1162/neco_a_01752 · Cited by 34
Neural Networks and Deep Learning
Theodoridis, S. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-818803-3.00030-1 · Cited by 34
Psychoanalysis, representation, and neuroscience: The Freudian unconscious and the Bayesian brain
Hopkins, J. (2012) · Oxford University Press eBooks · doi:10.1093/med/9780199600526.003.0014 · Cited by 34
A Hierarchical Community of Experts
Hinton, G. E., Sallans, B., & Ghahramani, Z. (1998) · Springer eBooks · doi:10.1007/978-94-011-5014-9_17 · Cited by 34
Self-citationOnline Semi-Supervised Learning with Deep Hybrid Boltzmann Machines and Denoising AutoencodersPreprint
Ororbia, A. G., Giles, C. L., & Reitter, D. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.06964 · Cited by 34
Liu, C.-Y., & Yin, B. (2024) · Computers in Human Behavior · doi:10.1016/j.chb.2024.108406 · Cited by 33
Kiefer, A. B. (2017) · PhilPapers (PhilPapers Foundation) · doi:10.15502/9783958573185 · Cited by 33
Friston, K. J. (2019) · Oxford University Press eBooks · doi:10.1093/oso/9780190662813.003.0014 · Cited by 33
An Active Inference Account of Touch and Verbal Communication in Therapy
Kim, J., Esteves, J. E., Cerritelli, F., & Friston, K. J. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.828952 · Cited by 33
Continuous Sigmoidal Belief Networks Trained using Slice Sampling
Frey, B. J. (1996) · neural information processing systems · Cited by 33
Self-citationUnsupervised search-based structured prediction
Daumé, H. (2009) · International Conference on Machine Learning · doi:10.1145/1553374.1553401 · Cited by 33
Perspective: Uniform switching of artificial synapses for large-scale neuromorphic arrays
Tan, S. H., Lin, P., Yeon, H., Choi, S., Park, Y., & Kim, J. (2018) · APL Materials · doi:10.1063/1.5049137 · Cited by 33
Classification of Skin Lesions in Dermatoscopic Images with Deep Convolution Network
Çevik, E., & Zengin, K. (2019) · European Journal of Science and Technology · doi:10.31590/ejosat.638247 · Cited by 33
Xu, L. (2003) · Cited by 33
Deriving Differential Target Propagation from Iterating Approximate InversesPreprint
Bengio, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.15139 · Cited by 33
Motive control of unconscious inference: The limbic base of adaptive Bayes
Tucker, D. M., & Luu, P. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2021.05.029 · Cited by 32
Xu, L. (2019) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2019.1911603 · Cited by 32
Temporal consistency two-stream CNN for human motion prediction
Tang, J. H., Zhang, J., & Yin, J. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.10.011 · Cited by 31
Rao, J., Xie, J., Yuan, Q., Liu, D., Wang, Z., Lu, Y., Zheng, S., & Yang, Y. (2024) · Nature Communications · doi:10.1038/s41467-024-48801-4 · Cited by 31
Moustafa, A. A., Wufong, E., Servatius, R. J., Pang, K. C. H., Gluck, M. A., & Myers, C. E. (2012) · Brain Research · doi:10.1016/j.brainres.2012.11.020 · Cited by 31
Oscillations, neural computations and learning during wake and sleep
Penagos, H., Varela, C., & Wilson, M. A. (2017) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2017.05.009 · Cited by 31
Receptive Field Self-Organization in a Model of the Fine Structure in V1 Cortical Columns
Lücke, J. (2009) · Neural Computation · doi:10.1162/neco.2009.07-07-584 · Cited by 30
Malik, S., Tyagi, A. K., & Mahajan, S. (2022) · Internet of things · doi:10.1007/978-3-030-87059-1_9 · Cited by 30
A Unified Framework of Latent Feature Learning in Social Media
Yuan, Z., Sang, J., Xu, C., & Liu, Y. (2014) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2014.2322338 · Cited by 30
Learning Deep Generative Models With Doubly Stochastic Gradient MCMC
Du, C., Zhu, J., & Zhang, B. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2688499 · Cited by 30
Error-Gated Hebbian Rule: A Local Learning Rule for Principal and Independent Component Analysis
Isomura, T., & Toyoizumi, T. (2018) · Scientific Reports · doi:10.1038/s41598-018-20082-0 · Cited by 30
Green Internet of Vehicles: Architecture, Enabling Technologies, and Applications
Chen, H., Zhao, T., Li, C., & Guo, Y. (2019) · IEEE Access · doi:10.1109/access.2019.2958175 · Cited by 30
In All Likelihood, Deep Belief Is Not EnoughPreprint
TheisLucas, GerwinnSebastian, SinzFabian, & BethgeMatthias (2010) · Journal of Machine Learning Research · doi:10.48550/arxiv.1011.6086 · Cited by 30
Object recognition using cellular simultaneous recurrent networks and convolutional neural network
Alom, M. Z., Alam, M., Taha, T. M., & Iftekharuddin, K. M. (2017) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2017.7966211 · Cited by 29
Tracking the eyes to obtain insight into insight problem solving
Knoblich, G., Öllinger, M., & Spivey, M. J. (2005) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780198566816.003.0015 · Cited by 29
Functional Integration in the Brain
Friston, K. J. (2004) · Elsevier eBooks · doi:10.1016/b978-012264841-0/50050-0 · Cited by 29
On the Duality Between Belief Networks and Feed-Forward Neural Networks
Baggenstoss, P. M. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2836662 · Cited by 29
Learning Causally Linked Markov Random Fields.
Hinton, G. E., Osindero, S., & Bao, K. (2005) · International Conference on Artificial Intelligence and Statistics · Cited by 29
Self-citationThe Thermodynamic Variational ObjectivePreprint
Masrani, V., Le, T. A., & Wood, F. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.00031 · Cited by 29
Learning Discrete Energy-based Models via Auxiliary-variable Local ExplorationPreprint
Dai, H., Singh, R., Dai, B., Sutton, C. A., & Schuurmans, D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.05363 · Cited by 29
Learning cortical representations through perturbed and adversarial dreaming
Deperrois, N., Petrovici, M. A., Senn, W., & Jordan, J. (2022) · eLife · doi:10.7554/elife.76384 · Cited by 28
PointSSC: A Cooperative Vehicle-Infrastructure Point Cloud Benchmark for Semantic Scene Completion
Yan, Y., Liu, B., Ai, J., Li, Q., Wan, R., & Pu, J. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610043 · Cited by 28
Sharma, D., Dhiman, C., & Kumar, D. (2024) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2024.3405573 · Cited by 28
Learning with hidden variables
Roudi, Y., & Taylor, G. (2015) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2015.07.006 · Cited by 23
Attention is more than prediction precision
Bowman, H., Filetti, M., Wyble, B., & Olivers, C. N. L. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12002324 · Cited by 28
Implicit AutoencodersPreprint
Makhzani, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.09804 · Cited by 28
Probabilistic Meta-Representations Of Neural NetworksPreprint
Karaletsos, T., Dayan, P., & Ghahramani, Z. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.00555 · Cited by 28
Self-citationA Tour of Unsupervised Deep Learning for Medical Image AnalysisPreprint
Raza, K., & Singh, N. K. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.07715 · Cited by 28
Sleep strengthens predictive sequence coding
Lutz, N. D., Wolf, I., Hübner, S., Born, J., & Rauss, K. (2018) · The Journal of Neuroscience · doi:10.1523/jneurosci.1352-18.2018 · Cited by 27
Bai, R., Huang, R., Qin, Y., Chen, Y., & Lin, C. (2022) · Information Sciences · doi:10.1016/j.ins.2022.10.052 · Cited by 27
Structure learning enhances concept formation in synthetic Active Inference agents
Neacsu, V., Mirza, M. B., Adams, R. A., & Friston, K. J. (2022) · PLoS ONE · doi:10.1371/journal.pone.0277199 · Cited by 27
Library learning for neurally-guided Bayesian program induction
Ellis, K., Morales, L., Sablé-Meyer, M., Solar-Lezama, A., & Tenenbaum, J. B. (2018) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 27
Razzaq, M., Iglesias, M. J., Ibrahim‐Kosta, M., Goumidi, L., Soukarieh, O., Proust, C., Roux, M., Suchon, P., Boland, A., Daiain, D., et al. (2021) · Scientific Reports · doi:10.1038/s41598-021-93390-7 · Cited by 27
Neural Models of Bayesian Belief Propagation
Rao, R. P. N. (2006) · The MIT Press eBooks · doi:10.7551/mitpress/1535.003.0017 · Cited by 27
Fast Learning by Bounding Likelihoods in Sigmoid Type Belief Networks
Jaakkola, T., Saul, L. K., & Jordan, M. I. (1995) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 27
Populations of Spiking Neurons
Gerstner, W. (1998) · The MIT Press eBooks · doi:10.7551/mitpress/5704.003.0016 · Cited by 27
Learning to Adapt by Minimizing DiscrepancyPreprint
Ororbia, A. G., Haffner, P., Reitter, D., & Giles, C. L. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.11542 · Cited by 27
Learning Neural Random Fields with Inclusive Auxiliary GeneratorsPreprint
Song, Y., & Ou, Z. (2018) · arXiv (Cornell University) · Cited by 27
Improving GAN Training with Probability Ratio Clipping and Sample ReweightingPreprint
Wu, Y., Zhou, P., Wilson, A. G., Xing, E. P., & Hu, Z. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.06900 · Cited by 27
Biological credit assignment through dynamic inversion of feedforward networksPreprint
Podlaski, B., & Machens, C. K. (2020) · arXiv (Cornell University) · doi:10.12751/nncn.bc2020.0169 · Cited by 27
Proceedings of the 4th Workshop on Representation Learning for NLP (RepL4NLP-2019)
Augenstein, I., Gella, S., Ruder, S., Kann, K., Can, B., Conneau, A., Welbl, J., Ren, X., & Rei, M. (2019) · doi:10.18653/v1/w19-43 · Cited by 27
NeuroAI for AI SafetyPreprint
Mineault, P., Zanichelli, N., Peng, J. Z., Arkhipov, A., Bingham, E., Jara‐Ettinger, J., Mackevicius, E. L., Marblestone, A. H., Mattar, M. G., Payne, A. C., et al. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2411.18526 · Cited by 27
Scholl, C., Rule, M. E., & Hennig, M. H. (2021) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1009458 · Cited by 26
Model-based learning retrospectively updates model-free values
Doody, M., van Swieten, M. M. H., & Manohar, S. (2022) · Scientific Reports · doi:10.1038/s41598-022-05567-3 · Cited by 26
Artificial intelligence and its applications in digital hematopathology
Hu, Y., Luo, Y., Tang, G., Huang, Y., Kang, J., & Wang, D. (2022) · Blood Science · doi:10.1097/bs9.0000000000000130 · Cited by 26
Nazir, A., Assad, A., Hussain, A. B., & Singh, M. (2024) · International Journal of Systems Assurance Engineering and Management · doi:10.1007/s13198-024-02441-5 · Cited by 26
Select and Sample - A Model of Efficient Neural Inference and Learning
Shelton, J. A., Sheikh, A.-S., Berkes, P., Bornschein, J., & Luecke, J. (2011) · neural information processing systems · Cited by 26
Anticipations, Brains, Individual and Social Behavior: An Introduction to Anticipatory Systems
Butz, M. V., Sigaud, O., Pezzulo, G., & Baldassarre, G. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-74262-3_1 · Cited by 26
A Multimodal Deep Regression Bayesian Network for Affective Video Content Analyses
Gan, Q., Wang, S., Hao, L., & Ji, Q. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.547 · Cited by 26
Computation by neural networks
Hinton, G. E. (2000) · Nature Neuroscience · doi:10.1038/81442 · Cited by 26
Self-citationEfficient Stochastic Source Coding and an Application to a Bayesian Network Source Model
Frey, B. J. (1997) · The Computer Journal · doi:10.1093/comjnl/40.2_and_3.157 · Cited by 26
Self-citationDNA Hypernetworks for Information Storage and Retrieval
Zhang, B., & Kim, J.-K. (2006) · Lecture notes in computer science · doi:10.1007/11925903_23 · Cited by 26
A Variational Approach to Bayesian Phylogenetic InferencePreprint
Zhang, C., & Matsen, F. A., IV (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2204.07747 · Cited by 26
Plate, T. A. (2005) · Wiley eBooks · doi:10.1002/0470018860.s00059 · Cited by 26
Hippocampus as unitary coherent particle filter
Fox, C., & Prescott, T. J. (2010) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2010.5596681 · Cited by 25
Event-coupled hidden Markov models
Kristjansson, T. T., Frey, B. J., & Huang, T. S. (2002) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2000.869621 · Cited by 25
Self-citationRobust Reinforcement Learning Under Minimax Regret for Green SecurityPreprint
Xu, L., Perrault, A., Fang, F., Chen, H., & Tambe, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.08413 · Cited by 25
A Variational Perspective on Generative Flow NetworksPreprint
Zimmermann, H., Lindsten, F., van de Meent, J.-W., & Naesseth, C. A. (2022) · UvA-DARE (University of Amsterdam) · doi:10.48550/arxiv.2210.07992 · Cited by 25
Biologically inspired sleep algorithm for artificial neural networksPreprint
Krishnan, G. P., Tadros, T., Ramyaa, R., & Bazhenov, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.02240 · Cited by 25
A tale of three probabilistic families: Discriminative, descriptive, and generative models
Wu, Y. N., Gao, R., Han, T., & Zhu, S. C. (2018) · Quarterly of Applied Mathematics · doi:10.1090/qam/1528 · Cited by 24
Hameed, K., Chai, D., & Rassau, A. (2021) · Information Processing in Agriculture · doi:10.1016/j.inpa.2021.09.003 · Cited by 24
Balancing Prediction and Surprise: A Role for Active Sleep at the Dawn of Consciousness?
Poll, M. N. V. D., & van Swinderen, B. (2021) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2021.768762 · Cited by 24
Prospects for cardiovascular medicine using artificial intelligence
Kodera, S., Akazawa, H., Morita, H., & Komuro, I. (2021) · Journal of Cardiology · doi:10.1016/j.jjcc.2021.10.016 · Cited by 24
Learning cortical representations through perturbed and adversarial dreaming.
Deperrois, N., Petrovici, M. A., Senn, W., & Jordan, J. (2022) · doi:10.48350/169088 · Cited by 23
Learning Probabilistic Inference through Spike-Timing-Dependent Plasticity
Pecevski, D., & Maass, W. (2016) · eNeuro · doi:10.1523/eneuro.0048-15.2016 · Cited by 24
Deep Belief Networks Based Toponym Recognition for Chinese Text
Wang, S., Zhang, X., Ye, P., & Du, M. (2018) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi7060217 · Cited by 24
Representation Learning: A Statistical Perspective
Xie, J., Gao, R., Nijkamp, E., Zhu, S. C., & Wu, Y. N. (2019) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-031219-041131 · Cited by 24
Bodies and Other Objects: The Sensorimotor Foundations of Cognition
Ellis, R. (2018) · Cambridge University Press eBooks · doi:10.1017/9781107446809 · Cited by 24
Timing of repetition suppression of event‐related potentials to unattended objects
Stefanics, G., Heinzle, J., Czigler, I., Valentini, E., & Stephan, K. E. (2018) · European Journal of Neuroscience · doi:10.1111/ejn.13972 · Cited by 24
Bidirectional Helmholtz MachinesPreprint
Bornschein, J., Shabanian, S., Fischer, A., & Bengio, Y. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.03877 · Cited by 24
Latent space conditioning for improved classification and anomaly detectionPreprint
Norlander, E., & Sopasakis, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.10599 · Cited by 24
Metadata
- Authors
- Hinton, G. E., Dayan, P., Frey, B. J., & Neal, R. M.
- Affiliations
- University of Toronto (CA)
- ORCID
- Dayan, Peter
- Venue
- Science
- Published
- 1995-05-26
- Volume
- 268
- Issue
- 5214
- Pages
- 1158-1161
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W1993845689
- Cited by
- 1,070
- References
- 9
- Citations by year
- 2026: 18 · 2025: 33 · 2024: 36 · 2023: 57 · 2022: 57 · 2021: 68 · 2020: 63 · 2019: 79 · 2018: 79 · 2017: 64 · 2016: 52 · 2015: 42 · 2014: 37 · 2013: 19 · 2012: 18
- FWCI
- 28.04
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- UCL Discovery (University College London) (submittedVersion)
- MPG.PuRe (Max Planck Society) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- unsupervised learning, stochastic neurons, multilayer neural networks, top-down connections, representation learning, generative models, neural network adaptation
- MeSH terms
- Algorithms, Probability, Stochastic Processes, Neural Networks, Computer
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.