The "Wake-Sleep" Algorithm for Unsupervised Neural Networks
The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
An unsupervised learning algorithm for a multilayer network of stochastic neurons is described. Bottom-up "recognition" connections convert the input into representations in successive hidden layers, and top-down "generative" connections reconstruct the representation in one layer from the representation in the layer above. In the "wake" phase, neurons are driven by recognition connections, and generative connections are adapted to increase the probability that they would reconstruct the correct activity vector in the layer below. In the "sleep" phase, neurons are driven by generative connections, and recognition connections are adapted to increase the probability that they would produce the correct activity vector in the layer above.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“A first meta-structure pops up when considering the classical Wake-Sleep algorithm [52], described above as a model for NREM sleep (that we extended by random perturbations in the replay).”
From How Adversarial REM Dreams May Facilitate Creativity, and Why We Become Aware of Them (2024) · cites this paper as [52]
In the citing paper
“In this algorithm, the FF recognition pathway is trained during the Sleep phase so that it inverts the FB generative pathway. The generative FB pathway is itself trained during the Wake phase so that it learns to reproduce the sensory activity from the internal representation generated by the FF pathway.”
From How Adversarial REM Dreams May Facilitate Creativity, and Why We Become Aware of Them (2024) · cites this paper as [52]
In the citing paper
“Bayesian inference and related theories have been proposed as a more appropriate theoretical framework for reasoning about top-down visual processing in the brain. 1,2,4,6,26,27”
From Hierarchical Bayesian inference in the visual cortex (2003) · cites this paper as [2]
In the citing paper
“In one common form of unsupervised learning, higher brain areas attempt to produce samples that are statistically similar to those actually seen in lower layers.”
From Toward an integration of deep learning and neuroscience (2016) · cites this paper as Hinton et al., 1995
In the citing paper
“For example, the wake-sleep algorithm (Hinton et al., 1995) requires the sleep mode to sample potential data points whose distribution should then match the observed distribution.”
From Toward an integration of deep learning and neuroscience (2016) · cites this paper as Hinton et al., 1995
Citations
Cites
Ballard, D. H., & Brown, C. M. (1982) · Cited by 5,303
A massively parallel architecture for a self-organizing neural pattern recognition machine
Carpenter, G. A., & Grossberg, S. (1987) · Computer Vision, Graphics, and Image Processing · doi:10.1016/s0734-189x(87)80014-2 · Cited by 2,525
Barlow, H. B. (1989) · Neural Computation · doi:10.1162/neco.1989.1.3.295 · Cited by 1,650
Stochastic Complexity in Statistical Inquiry
Rissanen, J. (1998) · WORLD SCIENTIFIC eBooks · doi:10.1142/0822 · Cited by 1,539
Forward models: supervised learning with a distal teacher
Jordan, M. I., & Rumelhart, D. E. (1992) · Cognitive Science · doi:10.1207/s15516709cog1603_1 · Cited by 1,451
Dayan, P., Hinton, G. E., Neal, R. M., & Zemel, R. S. (1995) · Neural Computation · doi:10.1162/neco.1995.7.5.889 · Cited by 1,207
Self-citationHasselmo, M. E., & Bower, J. M. (1993) · Trends in Neurosciences · doi:10.1016/0166-2236(93)90159-j · Cited by 427
A forward-inverse optics model of reciprocal connections between visual cortical areas
Kawato, M., Hayakawa, H., & Inui, T. (1993) · Network: Computation in Neural Systems · doi:10.1088/0954-898x_4_4_001 · Cited by 151
Grenander, U. (1978) · Springer eBooks · Cited by 89
Research works printed but not linked: 3
- Hinton, G. E., Advances in Neural Information Processing Systems 6: 3 (1994).
- Mumford, D., Large-Scale Theories of the Cortex: 125 (1994).
- Ullman, S., Large-Scale Theories of the Cortex: 257 (1994).
Cited by
Items 501–600 of 1,002
A Tour of Unsupervised Deep Learning for Medical Image Analysis
(2021) · Current Medical Imaging Formerly Current Medical Imaging Reviews · doi:10.2174/15734056mtez4nzmc0 · Cited by 23
Tucker, D. M., Luu, P., & Friston, K. J. (2025) · Entropy · doi:10.3390/e27080829 · Cited by 23
Xu, L. (2012) · Frontiers of Electrical and Electronic Engineering in China · doi:10.1007/s11460-012-0190-2 · Cited by 23
Softky, W. R. (1995) · neural information processing systems · Cited by 23
The Shape of Sight: A Homological Framework for Unifying Visual PerceptionPreprint
Li, X. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.04723 · Cited by 23
A Review of Learning with Deep Generative Models from Perspective of Graphical ModelingPreprint
Ou, Z. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.01630 · Cited by 23
Learning to learn generative programs with Memoised Wake-SleepPreprint
Hewitt, L., Le, T., & Tenenbaum, J. B. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.03132 · Cited by 23
Rolls, E. T. (2001) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780198524885.003.0004 · Cited by 22
The Convallis Rule for Unsupervised Learning in Cortical Networks
Yger, P., & Harris, K. D. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003272 · Cited by 22
Neural abstractive summarization fusing by global generative topics
Gao, Y., Wang, Y., Liu, L., Guo, Y., & Huang, H. (2019) · Neural Computing and Applications · doi:10.1007/s00521-018-3946-7 · Cited by 22
A hybrid generative and predictive model of the motor cortex
Weber, C., Wermter, S., & Elshaw, M. (2005) · Neural Networks · doi:10.1016/j.neunet.2005.10.004 · Cited by 22
Foundations and Advances in Deep Learning
Cho, K. (2014) · Aaltodoc (Aalto University) · Cited by 22
Speed and steering angle prediction for intelligent vehicles based on deep belief network
Zhao, C., Gong, J., Lu, C., Xiong, G., & Mei, W. (2017) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2017.8317929 · Cited by 21
Reducing Uncertainty and Increasing Confidence in Unsupervised Learning
Christakis, N., & Drikakis, D. (2023) · Mathematics · doi:10.3390/math11143063 · Cited by 21
A probabilistic generative model for tracking multi-knowledge concept mastery probability
Liu, H., Zhang, T., Li, F., Yu, M., & Yu, G. (2024) · Frontiers of Computer Science · doi:10.1007/s11704-023-3008-x · Cited by 21
Spike Correlations in a Songbird Agree with a Simple Markov Population Model
Weber, A. P., & Hahnloser, R. H. R. (2005) · PLoS Computational Biology · doi:10.1371/journal.pcbi.0030249 · Cited by 21
Chinese text categorization based on deep belief networks
Song, J., Qin, S., & Zhang, P. (2016) · IEEE/ACIS International Conference on Computer and Information Science (ICIS) · doi:10.1109/icis.2016.7550914 · Cited by 21
Data Science: A New Paradigm in the Age of Big-Data Science and Analytics
Concolato, C., & Chen, L. M. (2017) · New Mathematics and Natural Computation · doi:10.1142/s1793005717400038 · Cited by 21
Generative user models for adaptive information retrieval
Motomura, Y., Yoshida, K., & Fujimoto, K. (2002) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2000.885071 · Cited by 21
Bayesian Evolutionary Optimization Using Helmholtz Machines
Zhang, B., & Shin, S.-Y. (2000) · Lecture notes in computer science · doi:10.1007/3-540-45356-3_81 · Cited by 21
Optimism and pessimism in optimised replay
Antonov, G. K., Gagne, C., Eldar, E., & Dayan, P. (2022) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1009634 · Cited by 20
Self-citationImproving neural topic modeling via Sinkhorn divergence
Liu, L., Huang, H., Gao, Y., & Zhang, Y. (2022) · Information Processing & Management · doi:10.1016/j.ipm.2021.102864 · Cited by 20
Scene Level Image Classification: A Literature Review
Chavda, S., & Goyani, M. M. (2022) · Neural Processing Letters · doi:10.1007/s11063-022-11072-5 · Cited by 20
Images with harder-to-reconstruct visual representations leave stronger memory traces
Lin, Q., Li, Z., Lafferty, J., & Yildirim, I. (2024) · Nature Human Behaviour · doi:10.1038/s41562-024-01870-3 · Cited by 20
Ahmadi, N., Nilashi, M., Bidgoli, B. M., Farooque, M. M. J., Samad, S., Aljehane, N. O., Zogaan, W. A., & Ahmadi, H. (2022) · Scientific Programming · doi:10.1155/2022/4439189 · Cited by 20
GP-Select: Accelerating EM Using Adaptive Subspace Preselection
Shelton, J. A., Gasthaus, J. A., Dai, Z., Lücke, J., & Gretton, A. (2017) · Neural Computation · doi:10.1162/neco_a_00982 · Cited by 20
Noise, uncertainty, and interest: Predictive coding and cognitive penetration
Vance, J., & Stokes, D. (2016) · Consciousness and Cognition · doi:10.1016/j.concog.2016.06.007 · Cited by 20
Convergence of the Wake-Sleep Algorithm
Ikeda, S., Амари, Ш.-И., & Nakahara, H. (1998) · Institutional Repositories DataBase (IRDB) · Cited by 20
Bayesian Ying Yang Learning (I): A Unified Perspective for Statistical Modeling
Xu, L. (2004) · Springer eBooks · doi:10.1007/978-3-662-07952-2_22 · Cited by 20
Navarro, H., & Bennun, L. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1404.5598 · Cited by 20
Comprehensive application of artificial intelligence in colorectal cancer: A review
Sun, K., Wang, Y., Qu, R., Yang, Q., Luo, R., Jiang, Z., Wang, H., & Fu, W. (2025) · iScience · doi:10.1016/j.isci.2025.112980 · Cited by 19
A generative model of the hippocampal formation trained with theta driven local learning rules
George, T. M., Barry, C., Stachenfeld, K., Clopath, C., & Fukai, T. (2023) · neural information processing systems · doi:10.52202/075280-0082 · Cited by 19
Cognitive Sensor Technology for Structural Health Monitoring
Serov, A. (2017) · Procedia Structural Integrity · doi:10.1016/j.prostr.2017.07.027 · Cited by 19
Deep Learning-Based Detection of Fake Task Injection in Mobile Crowdsensing
Sood, A., Şimşek, M., Zhang, Y., & Kantarcı, B. (2019) · IEEE Global Conference on Signal and Information Processing · doi:10.1109/globalsip45357.2019.8969416 · Cited by 19
Solving Image Processing Critical Problems Using Machine Learning
Sharma, A. K., Gupta, A. R., & Jaiswal, V. (2021) · Studies in big data · doi:10.1007/978-981-15-9492-2_11 · Cited by 19
Variational Open-Domain Question Answering
Liévin, V., Motzfeldt, A. G., Jensen, I. R., & Winther, O. (2022) · Research at the University of Copenhagen (University of Copenhagen) · doi:10.48550/arxiv.2210.06345 · Cited by 19
Modern Artificial Neural Networks: Is Evolution Cleverer?
Bahmer, A., Gupta, D. S., & Effenberger, F. (2023) · Neural Computation · doi:10.1162/neco_a_01575 · Cited by 19
Key challenges for developing a Socially Assistive Robotic (SAR) solution for the health sector
Kearney, K. T., Presenza, D., Saccà, F., & Wright, P. (2018) · IEEE International Workshop on Computer Aided Modeling and Design of Communication Links and Networks (CAMAD) · doi:10.1109/camad.2018.8515005 · Cited by 19
Bayesian Ying Yang Learning (II): A New Mechanism for Model Selection and Regularization
Xu, L. (2004) · Springer eBooks · doi:10.1007/978-3-662-07952-2_23 · Cited by 19
Uninformative memories will prevail: The storage of correlated representations and its consequences
Kropff, E., & Treves, A. (2007) · HFSP journal · doi:10.2976/1.2793335 · Cited by 19
An Overview on Unsupervised Learning from Data Mining Perspective
Xu, L. (2001) · Springer eBooks · doi:10.1007/978-1-4471-0715-6_26 · Cited by 19
Reweighted Expectation MaximizationPreprint
Dieng, A. B., & Paisley, J. W. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.05850 · Cited by 19
Variational Inference for Deblending Crowded StarfieldsPreprint
Liu, R., McAuliffe, J., & Regier, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.02409 · Cited by 19
The secret life of predictive brains: what's spontaneous activity for?Preprint
Pezzulo, G., Zorzi, M., & Corbetta, M. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/qus3h · Cited by 19
Change-based population coding
Moazzezi, R. (2011) · UCL Discovery (University College London) · Cited by 19
Artificial Intelligence: Issues, Challenges, Opportunities and Threats
Groumpos, P. P. (2019) · Communications in computer and information science · doi:10.1007/978-3-030-29743-5_2 · Cited by 18
Spiking neuromorphic chip learns entangled quantum states
Czischek, S., Baumbach, A., Billaudelle, S., Cramer, B., Kades, L., Pawlowski, J. M., Oberthaler, M. K., Schemmel, J., Petrovici, M. A., Gasenzer, T., et al. (2022) · SciPost Physics · doi:10.21468/scipostphys.12.1.039 · Cited by 18
Pre-synaptic lateral inhibition provides a better architecture for self-organizing neural networks
Spratling, M. (1999) · Network Computation in Neural Systems · doi:10.1088/0954-898x_10_4_301 · Cited by 18
Learning Generative Models with the Up Propagation Algorithm
Oh, J., & Seung, H. S. (1997) · neural information processing systems · Cited by 18
A Sparse Generative Model of V1 Simple Cells with Intrinsic Plasticity
Weber, C., & Triesch, J. (2008) · Neural Computation · doi:10.1162/neco.2007.02-07-472 · Cited by 18
One-Shot Learning using Mixture of Variational Autoencoders: a Generalization Learning approach
Mocanu, D. C., & Mocanu, E. (2018) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/ptts1734 · Cited by 18
Neural Models of Bayesian Belief Propagation
Rao, R. P. N. (2006) · The MIT Press eBooks · doi:10.7551/mitpress/9780262042383.003.0011 · Cited by 18
Hierarchical self-organization of minicolumnar receptive fields
Lücke, J. (2004) · Neural Networks · doi:10.1016/j.neunet.2004.07.008 · Cited by 18
Neural Clustering ProcessesPreprint
Pakman, A., Wang, Y., Mitelut, C., Lee, J., & Paninski, L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.00409 · Cited by 18
Convolutional Neural Generative Coding: Scaling Predictive Coding to Natural ImagesPreprint
Ororbia, A. G., & Mali, A. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2211.12047 · Cited by 18
Qian, D., & Cheung, W. K. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3160509 · Cited by 17
Recurrent Sampling Models for the Helmholtz Machine
Dayan, P. (1999) · Neural Computation · doi:10.1162/089976699300016610 · Cited by 17
Self-citationNeural Networks: Sleep and memory
B, T. J. S. A. (1995) · Current Biology · doi:10.1016/s0960-9822(95)00165-5 · Cited by 17
Recognition Networks for Approximate Inference in BN20 NetworksPreprint
Morris, Q. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1301.2295 · Cited by 17
Williams, D. G. (2018) · Apollo (University of Cambridge) · doi:10.17863/cam.33386 · Cited by 17
All in the Exponential Family: Bregman Duality in Thermodynamic Variational InferencePreprint
Brekelmans, R., Masrani, V., Wood, F., Steeg, G. V., & Galstyan, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.00642 · Cited by 17
Song, Y., & Ou, Z. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.00271 · Cited by 17
AI-driven Innovations in Assessing Stress, Anxiety, and Mental Health
Inamdar, A., Gurupadayya, B., Gautam, M., Sharma, A., Pathak, R., & Sharma, H. (2025) · Current Psychiatry Research and Reviews · doi:10.2174/0126660822334997241216062002 · Cited by 16
Tucker, D. M., Luu, P., & Friston, K. J. (2025) · Cerebral Cortex · doi:10.1093/cercor/bhaf122 · Cited by 16
Exploration from Generalization Mediated by Multiple Controllers
Dayan, P. (2012) · Springer eBooks · doi:10.1007/978-3-642-32375-1_4 · Cited by 16
Self-citationOptimal Variance Control of the Score Function Gradient Estimator for Importance Weighted Bounds
Liévin, V., Dittadi, A., Christensen, A. C., & Winther, O. (2020) · Research at the University of Copenhagen (University of Copenhagen) · doi:10.48550/arxiv.2008.01998 · Cited by 16
Matsuoka, D. (2021) · Progress in Earth and Planetary Science · doi:10.1186/s40645-021-00459-y · Cited by 16
Ising granularity image analysis on VAE–GAN
Chen, G., Long, S., Yuan, Z., Zhu, W., Chen, Q., & Wu, Y. (2022) · Machine Vision and Applications · doi:10.1007/s00138-022-01338-2 · Cited by 16
Toward a 'Standard Model' of Machine Learning
Hu, Z., & Xing, E. P. (2022) · Harvard Data Science Review · doi:10.1162/99608f92.1d34757b · Cited by 16
Application and risk prediction of thrombolytic therapy in cardio-cerebrovascular diseases: a review
Zhang, K., Jiang, Y., Zeng, H., & Zhu, H. (2023) · Thrombosis Journal · doi:10.1186/s12959-023-00532-0 · Cited by 16
Data-Driven Granular Cognitive Computing
Wang, G. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-60837-2_2 · Cited by 16
Xu, L. (2007) · Studies in computational intelligence · doi:10.1007/978-3-540-71984-7_14 · Cited by 16
STATISTICAL MODEL-BASED SENSOR DIAGNOSTICS FOR AUTOMATION SYSTEMS
Sallans, B., Bruckner, D., & Russ, G. (2005) · IFAC Proceedings Volumes · doi:10.3182/20051114-2-mx-3901.00033 · Cited by 16
Attractor Dynamics in Feedforward Neural Networks
Saul, L. K., & Jordan, M. I. (2000) · Neural Computation · doi:10.1162/089976600300015385 · Cited by 16
Friston, K. J. (2007) · Elsevier eBooks · doi:10.1016/b978-012372560-8/50036-x · Cited by 16
Bayesian evolutionary algorithms for continuous function optimization
Shin, S.-Y., & Zhang, B.-T. (2002) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2001.934434 · Cited by 16
Undirected Graphical Models as Approximate PosteriorsPreprint
Vahdat, A., Andriyash, E., & Macready, W. G. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.03440 · Cited by 16
Mind the Gap when Conditioning Amortised Inference in Sequential Latent-Variable ModelsPreprint
Bayer, J., Soelch, M., Mirchev, A., Kayalibay, B., & van der Smagt, P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.07046 · Cited by 16
Neurogenesis Deep Learning: Extending deep networks to accommodate new classes
Sandia National Laboratories (SNL), A., Draelos, T. J., Administration, U. A. S. F. H. R. A., Miner, N. E., Lamb, C., Vineyard, C. M., Carlson, K. D., James, C. D., & Aimone, J. B. (2016) · OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) · doi:10.2172/1505351 · Cited by 16
Luu, P., & Tucker, D. M. (2023) · Developmental Psychobiology · doi:10.1002/dev.22439 · Cited by 15
A Role of Sleep in Forming Predictive Codes
Rauss, K. S., & Born, J. (2017) · Studies in neuroscience, psychology and behavioral economics · doi:10.1007/978-3-319-45066-7_8 · Cited by 15
Differentiating Between Posed and Spontaneous Expressions with Latent Regression Bayesian Network
Gan, Q., Nie, S., Wang, S., & Ji, Q. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11225 · Cited by 15
A Structured Variational Autoencoder for Contextual Morphological Inflection
Wolf-Sonkin, L., Naradowsky, J., Mielke, S. J., & Cotterell, R. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-1245 · Cited by 15
Information bottleneck and selective noise supervision for zero-shot learning
Zhou, L., Liu, Y., Zhang, P., Bai, X. P., Gu, L., Zhou, J. W., Yao, Y., Harada, T., Zheng, J. Y., & Hancock, E. R. (2022) · Machine Learning · doi:10.1007/s10994-022-06196-7 · Cited by 15
Piecewise Latent Variables for Neural Variational Text Processing
Serban, I. V., Ororbia, A. G., Pineau, J., & Courville, A. C. (2017) · doi:10.18653/v1/w17-4308 · Cited by 15
The Architectures of Geoffrey Hinton
Stanko, I. (2020) · Springer eBooks · doi:10.1007/978-3-030-37591-1_8 · Cited by 15
Mean field approach to learning in Boltzmann Machines
Kappen, H. J., & Rodríguez, F. B. (1997) · Pattern Recognition Letters · doi:10.1016/s0167-8655(97)00096-2 · Cited by 15
Neural Models for Part-Whole Hierarchies
Riesenhuber, M., & Dayan, P. (1996) · UCL Discovery (University College London) · Cited by 15
Self-citationCunningham, R. J., Harding, P., & Loram, I. D. (2017) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/157479 · Cited by 15
Variational Learning in Mixed-State Dynamic Graphical ModelsPreprint
Pavlović, V., Frey, B. J., & Huang, T. S. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1301.6731 · Cited by 15
Self-citationMaterial Practice as a Form of Critique
Stubbe, J. (2016) · Interaction design & architecture(s)/ID&A Interaction design & architecture(s) · doi:10.55612/s-5002-030-002 · Cited by 14
Desiderata for Normative Models of Synaptic Plasticity
Bredenberg, C., & Savin, C. (2024) · Neural Computation · doi:10.1162/neco_a_01671 · Cited by 14
Incremental Sigmoid Belief Networks for Grammar Learning
Henderson, J., & Titov, I. (2010) · Journal of Machine Learning Research · Cited by 14
Wang, W. J., Hoffer, B., Greenberg-Toledo, T., Li, Y., Zou, M., Herbelin, E., Ronen, R., Xu, X., Zhao, Y., Yang, J., et al. (2022) · Advanced Intelligent Systems · doi:10.1002/aisy.202100249 · Cited by 14
Local Probability Propagation for Factor Analysis
Frey, B. J. (1999) · neural information processing systems · Cited by 14
Self-citationToward a cognitive neuroscience of sleep
Stickgold, R. (2001) · Sleep Medicine Reviews · doi:10.1053/smrv.2001.0221 · Cited by 14
Learning the parts of objects by auto-association
Ge, X., & Iwata, S. (2002) · Neural Networks · doi:10.1016/s0893-6080(01)00145-9 · Cited by 14
Interlocking Backpropagation: Improving depthwise model-parallelismPreprint
Gomez, A. N., Key, O., Perlin, K., Gou, S., Frosst, N., Dean, J., & Gal, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.04116 · Cited by 14
Generating Synthetic Data with Formal Privacy Guarantees: State of the Art and the Road AheadPreprint
Schlegel, V., Bharath, A. A., Zhao, Z., & Yee, K. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2503.20846 · Cited by 14
Cosmos World Foundation Model Platform for Physical AI
NVIDIA, :, Agarwal, N., Ali, A., Bala, M., Balaji, Y., Barker, E., Cai, T., Chattopadhyay, P., Chen, Y., et al. (2025) · arXiv · doi:10.48550/arxiv.2501.03575 · Cited by 13
Metadata
- Authors
- Hinton, G. E., Dayan, P., Frey, B. J., & Neal, R. M.
- Affiliations
- University of Toronto (CA)
- ORCID
- Dayan, Peter
- Venue
- Science
- Published
- 1995-05-26
- Volume
- 268
- Issue
- 5214
- Pages
- 1158-1161
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W1993845689
- Cited by
- 1,070
- References
- 9
- Citations by year
- 2026: 18 · 2025: 33 · 2024: 36 · 2023: 57 · 2022: 57 · 2021: 68 · 2020: 63 · 2019: 79 · 2018: 79 · 2017: 64 · 2016: 52 · 2015: 42 · 2014: 37 · 2013: 19 · 2012: 18
- FWCI
- 28.04
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- UCL Discovery (University College London) (submittedVersion)
- MPG.PuRe (Max Planck Society) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- unsupervised learning, stochastic neurons, multilayer neural networks, top-down connections, representation learning, generative models, neural network adaptation
- MeSH terms
- Algorithms, Probability, Stochastic Processes, Neural Networks, Computer
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.