A Practical Guide to Training Restricted Boltzmann Machines
The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The attacker often uses techniques such as spoofing real User Datagram Protocol (UDP) [54] and Internet Control Message Protocol (ICMP) [97] to induce flooding.”
From Comparative Analysis of Intrusion Detection Systems and Machine Learning Based Model Analysis through Decision Tree (2023) · cites this paper as [97]
Citations
Cites
Neural networks and physical systems with emergent collective computational abilities.
Hopfield, J. J. (1982) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.79.8.2554 · Cited by 19,270 · cited 2×
“A joint configuration, (v, h) of the visible and hidden units has an energy (Hopfield, 1982) given by: E(v, h) = − i∈visible a i v i − j∈hidden b j h j − i,j v i h j w ij (1) where v i , h j are the binary states of visible unit i and hidden unit j, a i , b j are their biases and w ij is the weight…”
BackgroundA fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336 · cited 3×
“Their most important use is as learning modules that are composed to form deep belief nets (Hinton et al., 2006a).”
BackgroundMethodSelf-citationParallel Distributed Processing: Explorations in the Microstructure of Cognition: Foundations
Rumelhart, D. E., McClelland, J. L., & AU (1986) · doi:10.7551/mitpress/5236.001.0001 · Cited by 15,686
(2010) · International Conference on Machine Learning · Cited by 13,995
Self-citationProceedings of the 25th international conference on Machine learning
Cohen, W. W., McCallum, A., & Roweis, S. T. (2008) · Cited by 5,691
Training Products of Experts by Minimizing Contrastive Divergence
Hinton, G. E. (2002) · Neural Computation · doi:10.1162/089976602760128018 · Cited by 4,879 · cited 8×
“How to collect statistics when using Contrastive Divergence To begin with, we shall assume that all of the visible and hidden units are binary.”
BackgroundMethodInfluentialSelf-citationParallel & distributed processing
Slusallek, P., Shirley, P., Mark, W., Stoll, G., & Wald, I. (2005) · ACM SIGGRAPH 2005 Courses on - SIGGRAPH '05 · doi:10.1145/1198555.1198750 · Cited by 2,568
Information processing in dynamical systems: foundations of harmony theory
Smolensky, P. (1986) · The MIT Press eBooks · Cited by 2,252
Advances in Neural Information Processing Systems 18
Murray, I., Mackay, D., Zoubin Ghahramani, A., & Skilling, J. (2006) · Cited by 1,927
Advances in Neural Information Processing Systems 5
Zemel, R. S., Williams, C. K. I., & Mozer, M. C. (1993) · Cited by 1,896
Restricted Boltzmann machines for collaborative filtering
Salakhutdinov, R., Mnih, A., & Hinton, G. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273596 · Cited by 1,885 · cited 3×
“As the weights grow, the mixing gets worse and it makes sense to gradually increase the n in CDn (Carreira-Perpignan and Hinton, 2005; Salakhutdinov et al., 2007).”
BackgroundSelf-citationArtificial intelligence and statistics
Wiggins, L. L. (1989) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(89)90027-6 · Cited by 1,117
Training restricted Boltzmann machines using approximations to the likelihood gradient
Tieleman, T. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390290 · Cited by 837 · cited 2×
“A more radical departure from CD1 is called “persistent contrastive divergence” (Tieleman, 2008).”
BackgroundMethodModeling Human Motion Using Binary Latent Variables
Taylor, G. W., Hinton, G. E., & Roweis, S. T. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0173 · Cited by 689 · cited 1×
“In their conditional form they can be used to model high-dimensional temporal sequences such as video or motion capture data (Taylor et al., 2006) or speech (Mohamed and Hinton, 2010).”
BackgroundSelf-citationOn Contrastive Divergence Learning.
Carreira-Perpiñán, M. Á., & Hinton, G. E. (2005) · Cited by 630
Self-citationThe EM algorithm for mixtures of factor analyzers
Ghahramani, Z., & Hinton, G. E. (1996) · Cambridge University Engineering Department Publications Database · Cited by 629
Self-citationReplicated Softmax: an Undirected Topic Model
Hinton, G. E., & Salakhutdinov, R. (2009) · neural information processing systems · Cited by 538
Self-citationExponential Family Harmoniums with an Application to Information Retrieval
Welling, M., Rosen‐Zvi, M., & Hinton, G. E. (2004) · neural information processing systems · Cited by 486
Self-citationOn the quantitative analysis of deep belief networks
Salakhutdinov, R., & Murray, I. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390266 · Cited by 411
3D Object Recognition with Deep Belief Nets
Nair, V. B., & Hinton, G. E. (2009) · neural information processing systems · Cited by 358
Self-citationTo recognize shapes, first learn to generate images
Hinton, G. E. (2007) · Progress in Brain Research · doi:10.1016/s0079-6123(06)65034-6 · Cited by 309 · cited 1×
“Again, it is possible to combine discriminiative and generative training of the joint RBM by using discriminative gradients that are the derivatives of the log probability of the correct class (Hinton, 2007):”
BackgroundSelf-citationUnsupervised learning of distributions on binary vectors using two layer networks
Freund, Y., & Haussler, D. H. (1991) · neural information processing systems · Cited by 297
Using fast weights to improve persistent contrastive divergence
Tieleman, T., & Hinton, G. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553506 · Cited by 274 · cited 2×
“The persistent chains mix surprisingly fast because the weight-updates repel each chain from its current state by raising the energy of that state (Tieleman and Hinton, 2009).”
BackgroundSelf-citationRate-coded Restricted Boltzmann Machines for Face Recognition
Teh, Y. W., & Hinton, G. E. (2000) · UCL Discovery (University College London) · Cited by 162
Self-citationOn the Convergence Properties of Contrastive Divergence
Sutskever, I., & Tieleman, T. (2010) · International Conference on Artificial Intelligence and Statistics · Cited by 132
Unsupervised Discovery of Nonlinear Structure Using Contrastive Backpropagation
Hinton, G., Osindero, S., Welling, M., & Teh, Y. (2006) · Cognitive Science · doi:10.1207/s15516709cog0000_76 · Cited by 132 · cited 2×
“Their most important use is as learning modules that are composed to form deep belief nets (Hinton et al., 2006a).”
BackgroundMethodSelf-citationPhone recognition using Restricted Boltzmann Machines
Mohamed, A.-R., & Hinton, G. (2010) · 2010 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2010.5495651 · Cited by 106 · cited 2×
“In their conditional form they can be used to model high-dimensional temporal sequences such as video or motion capture data (Taylor et al., 2006) or speech (Mohamed and Hinton, 2010).”
BackgroundSelf-citationRelaxation and its Role in Vision
Hinton, G. E. (1977) · ERA · Cited by 64
Self-citationComputational Neuroscience: Theoretical Insights into Brain Function
Cisek, P., Drew, T., Kalaska, J. F., central, G. D. R. S. L. S. N., & Montréal, U. D. (2007) · Progress in brain research · doi:10.1016/s0079-6123(06)x6500-7 · Cited by 46
Diffusion Networks, Products of Experts, and Factor Analysis
Marks, T. K., & Movellan, J. R. (2001) · Cited by 24
Research works printed but not linked: 1
- Mohamed, A.R., Dahl, G., Hinton, G.E.: Deep belief networks for phone recognition. In: NIPS 22 Workshop on Deep Learning for Speech Recognition (2009)
Cited by
A survey on deep learning in medical image analysis
Litjens, G., Kooi, T., Bejnordi, B. E., Setio, A. A. A., Ciompi, F., Ghafoorian, M., van der Laak, J. A. W. M., van Ginneken, B., & Sánchez, C. I. (2017) · Medical Image Analysis · doi:10.1016/j.media.2017.07.005 · Cited by 15,332
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001
“(Ranzato and Hinton, 2010) introduced the mean and covariance RBM (mcRBM).”
BackgroundMethodResultInfluentialHinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260
“Learning the standard deviations of a GRBM is problematic for reasons described in [21], so for pretraining using CD 1 , the data are normalized so that each coefficient has zero mean and unit variance, the standard deviations are set to one when computing ( ) v h p ; , and no noise is added to the…”
Self-citation(2012) · Cited by 8,009
Machine learning: Algorithms, real-world applications and research directions
Sarker, I. H. (2021) · SN Computer Science · doi:10.1007/s42979-021-00592-x · Cited by 5,583
“Restricted Boltzmann machines (RBM) [46] can be used for dimensionality reduction, classification, regression, collaborative filter-ing, feature learning, and topic modeling.”
Metadata
- Authors
- Hinton, G. E.
- Affiliations
- University of Toronto (CA)
- Corresponding author
- Hinton, Geoffrey E.
- Venue
- Lecture Notes in Computer Science
- Publisher
- Springer Berlin Heidelberg
- Published
- 2012
- Pages
- 599-619
- ISSN
- 0302-9743 (ISSN-L)
- 1611-3349
- OpenAlex
- W44815768
- Cited by
- 2,852
- References
- 30
- Citations by year
- 2026: 19 · 2025: 67 · 2024: 104 · 2023: 146 · 2022: 149 · 2021: 229 · 2020: 299 · 2019: 290 · 2018: 307 · 2017: 315 · 2016: 291 · 2015: 260 · 2014: 192 · 2013: 99 · 2012: 51
- FWCI
- 147.68
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Lecture notes in computer science (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- Keywords
- restricted Boltzmann machine, contrastive divergence, generative models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.