The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Learning multiple layers of representation
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Self-citationBook Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
Self-citationA fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
Self-citationProceedings of the 24th international conference on Machine learning
(2007) · doi:10.1145/1273496 · Cited by 11,630
An Information-Maximization Approach to Blind Separation and Blind Deconvolution
Bell, A. J., & Sejnowski, T. J. (1995) · Neural Computation · doi:10.1162/neco.1995.7.6.1129 · Cited by 8,986
Independent Component Analysis
(2004) · Independent Component Analysis · doi:10.7551/mitpress/3717.003.0014 · Cited by 7,903
Distributed hierarchical processing in the primate cerebral cortex
Felleman, D. J., & Van Essen, D. C. (1991) · Cerebral Cortex · doi:10.1093/cercor/1.1.1 · Cited by 7,783
Emergence of simple-cell receptive field properties by learning a sparse code for natural images
Olshausen, B. A., & Field, D. J. (1996) · Nature · doi:10.1038/381607a0 · Cited by 5,694
Training Products of Experts by Minimizing Contrastive Divergence
Hinton, G. E. (2002) · Neural Computation · doi:10.1162/089976602760128018 · Cited by 4,879
Self-citation
Cited by
A fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
Self-citationPlaying Atari with Deep Reinforcement Learning
Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013) · arXiv · doi:10.48550/arxiv.1312.5602 · Cited by 9,471
Whatever next? Predictive brains, situated agents, and the future of cognitive science
Clark, A. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12000477 · Cited by 5,924
Deep neural networks are easily fooled: High confidence predictions for unrecognizable images
Nguyen, A., Yosinski, J., & Clune, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298640 · Cited by 3,258
Learning and Transferring Mid-level Image Representations Using Convolutional Neural Networks
Oquab, M., Bottou, L., Laptev, I., & Sivic, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.222 · Cited by 3,150
Data-intensive applications, challenges, techniques and technologies: A survey on Big Data
Philip Chen, C. L., & Zhang, C.-Y. (2014) · Information Sciences · doi:10.1016/j.ins.2014.01.015 · Cited by 3,047
Distillation as a Defense to Adversarial Perturbations Against Deep Neural Networks
Papernot, N., McDaniel, P., Wu, X., Jha, S., & Swami, A. (2016) · 2016 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2016.41 · Cited by 2,982
Deep learning and its applications to machine health monitoring
Zhao, R., Yan, R., Chen, Z., Mao, K., Wang, P., & Gao, R. X. (2019) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2018.05.050 · Cited by 2,894
Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art
Zhang, L., Zhang, L., & Du, B. (2016) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2016.2540798 · Cited by 2,208
Review of Deep Learning Algorithms and Architectures
Shrestha, A., & Mahmood, A. (2019) · IEEE Access · doi:10.1109/access.2019.2912200 · Cited by 1,883
“Here is the equation [66] for adjusting the recognition weights rij.”
BackgroundMethodInfluentialMarketing Analytics for Data-Rich Environments
Wedel, M., & Kannan, P. K. (2016) · Journal of Marketing · doi:10.1509/jm.15.0413 · Cited by 1,261
NIPS 2016 Tutorial: Generative Adversarial Networks
Goodfellow, I. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1701.00160 · Cited by 1,229
Deep Learning for Single Image Super-Resolution: A Brief Review
Yang, W., Zhang, X., Tian, Y., Wang, W., Xue, J.-H., & Liao, Q. (2019) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2919431 · Cited by 1,154
Toward Scalable Systems for Big Data Analytics: A Technology Tutorial
Hu, H., Wen, Y., Chua, T.-S., & Li, X. (2014) · IEEE Access · doi:10.1109/access.2014.2332453 · Cited by 1,099
What do we mean by prediction in language comprehension?
Kuperberg, G. R., & Jaeger, T. F. (2016) · Language, Cognition and Neuroscience · doi:10.1080/23273798.2015.1102299 · Cited by 1,087
Guclu, U., & van Gerven, M. A. J. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.5023-14.2015 · Cited by 961
Neural Networks and Deep Learning
Theodoridis, S. (2015) · Machine Learning · doi:10.1016/b978-0-12-801522-3.00018-5 · Cited by 900
AgeDB: The First Manually Collected, In-the-Wild Age Database
Moschoglou, S., Papaioannou, A., Sagonas, C., Deng, J., Kotsia, I., & Zafeiriou, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.250 · Cited by 800
El Naqa, I., & Murphy, M. J. (2015) · Machine Learning in Radiation Oncology · doi:10.1007/978-3-319-18305-3_1 · Cited by 772
Learning to Monitor Machine Health with Convolutional Bi-Directional LSTM Networks
Zhao, R., Yan, R., Wang, J., & Mao, K. (2017) · Sensors · doi:10.3390/s17020273 · Cited by 741
Deep Learning in Drug Discovery
Gawehn, E., Hiss, J. A., & Schneider, G. (2016) · Molecular Informatics · doi:10.1002/minf.201501008 · Cited by 723
The Interactive Account of ventral occipitotemporal contributions to reading
Price, C. J., & Devlin, J. T. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.04.001 · Cited by 720
Understanding Random Forests: From Theory to Practice
Louppe, G. (2014) · arXiv · doi:10.48550/arxiv.1407.7502 · Cited by 693
Statistically optimal perception and learning: from behavior to neural representations
Fiser, J., Berkes, P., Orbán, G., & Lengyel, M. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.01.003 · Cited by 672
Andreu-Perez, J., Poon, C. C. Y., Merrifield, R. D., Wong, S. T. C., & Yang, G.-Z. (2015) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2015.2450362 · Cited by 670
Robust speech perception: Recognize the familiar, generalize to the similar, and adapt to the novel.
Kleinschmidt, D. F., & Jaeger, T. F. (2015) · Psychological Review · doi:10.1037/a0038695 · Cited by 635
Mirror neurons: from origin to function
Cook, R., Bird, G., Catmur, C., Press, C., & Heyes, C. (2014) · Behavioral and Brain Sciences · doi:10.1017/s0140525x13000903 · Cited by 647
Probabilistic models of cognition: exploring representations and inductive biases
Griffiths, T. L., Chater, N., Kemp, C., Perfors, A., & Tenenbaum, J. B. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.05.004 · Cited by 568
An Introduction to Restricted Boltzmann Machines
Fischer, A., & Igel, C. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33275-3_2 · Cited by 569
Understanding Random Forests: From Theory to Practice
Louppe, G. (2014) · arXiv (Cornell University) · doi:10.13140/2.1.1570.5928 · Cited by 563
Brain plasticity through the life span: Learning to learn and action video games
Bavelier, D., Green, C. S., Pouget, A., & Schrater, P. (2012) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-060909-152832 · Cited by 541
Deep Learning With Spatiotemporal Attention-Based LSTM for Industrial Soft Sensor Model Development
Yuan, X., Li, L., Shardt, Y. A. W., Wang, Y., & Yang, C. (2021) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2020.2984443 · Cited by 524
Training restricted Boltzmann machines: An introduction
Fischer, A., & Igel, C. (2014) · Pattern Recognition · doi:10.1016/j.patcog.2013.05.025 · Cited by 504
Long short-term memory for machine remaining life prediction
Zhang, J., Wang, P., Yan, R., & Gao, R. X. (2018) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2018.05.011 · Cited by 463
Application of Deep Belief Networks for Natural Language Understanding
Sarikaya, R., Hinton, G. E., & Deoras, A. (2014) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2014.2303296 · Cited by 460
Self-citationDeep Neural Networks as Scientific Models
Cichy, R. M., & Kaiser, D. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2019.01.009 · Cited by 454
Unsupervised Deep Learning Applied to Breast Density Segmentation and Mammographic Risk Scoring
Kallenberg, M., Petersen, K., Nielsen, M., Ng, A. Y., Diao, P., Igel, C., Vachon, C. M., Holland, K., Winkel, R. R., Karssemeijer, N., et al. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2532122 · Cited by 439
A tutorial on task-parameterized movement learning and retrieval
Calinon, S. (2016) · Intelligent Service Robotics · doi:10.1007/s11370-015-0187-9 · Cited by 422
Mandera, P., Keuleers, E., & Brysbaert, M. (2017) · Journal of Memory and Language · doi:10.1016/j.jml.2016.04.001 · Cited by 428
Memristors for Energy‐Efficient New Computing Paradigms
Jeong, D. S., Kim, K. M., Kim, S., Choi, B. J., & Hwang, C. S. (2016) · Advanced Electronic Materials · doi:10.1002/aelm.201600090 · Cited by 413
UX Design Innovation: Challenges for Working with Machine Learning as a Design Material
Dove, G., Halskov, K., Forlizzi, J., & Zimmerman, J. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025739 · Cited by 391
Independent component analysis: recent advances
Hyvärinen, A. (2013) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2011.0534 · Cited by 390
Words and the World: Predictive Coding and the Language-Perception-Cognition Interface
Lupyan, G., & Clark, A. (2015) · Current Directions in Psychological Science · doi:10.1177/0963721415570732 · Cited by 380
Radiomics: from qualitative to quantitative imaging
Rogers, W., Thulasi Seetha, S., Refaee, T. A. G., Lieverse, R. I. Y., Granzier, R. W. Y., Ibrahim, A., Keek, S. A., Sanduleanu, S., Primakov, S. P., Beuque, M. P. L., et al. (2020) · The British Journal of Radiology · doi:10.1259/bjr.20190948 · Cited by 372
Self-supervised speech representation learning: A review
Mohamed, A., Lee, H.-Y., Borgholt, L., Havtorn, J. D., Edin, J., Igel, C., Kirchhoff, K., Li, S.-W., Livescu, K., Maaløe, L., et al. (2022) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2022.3207050 · Cited by 372
“target downstream applications requiring a minimal number of labeled data [7], [8], [9].”
BackgroundArtificial intelligence, machine learning and deep learning
Ongsulee, P. (2017) · 2017 15th International Conference on ICT and Knowledge Engineering (ICT&KE) · doi:10.1109/ictke.2017.8259629 · Cited by 367
A Bayesian perspective on magnitude estimation
Petzschner, F. H., Glasauer, S., & Stephan, K. E. (2015) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2015.03.002 · Cited by 327
The free energy principle for action and perception: A mathematical review
Buckley, C. L., Kim, C. S., McGregor, S., & Seth, A. K. (2017) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2017.09.004 · Cited by 363
Bozkurt, A., Karadeniz, A., Baneres, D., Guerrero-Roldán, A. E., & Rodríguez, M. E. (2021) · Sustainability · doi:10.3390/su13020800 · Cited by 362
Deep Learning for Just-in-Time Defect Prediction
Yang, X., Lo, D., Xia, X., Zhang, Y., & Sun, J. (2015) · 2015 IEEE International Conference on Software Quality, Reliability and Security · doi:10.1109/qrs.2015.14 · Cited by 352
Heffernan, R., Paliwal, K., Lyons, J., Dehzangi, A., Sharma, A., Wang, J., Sattar, A., Yang, Y., & Zhou, Y. (2015) · Scientific Reports · doi:10.1038/srep11476 · Cited by 350
A survey on deep learning in medicine: Why, how and when?
Piccialli, F., Somma, V. D., Giampaolo, F., Cuomo, S., & Fortino, G. (2021) · Information Fusion · doi:10.1016/j.inffus.2020.09.006 · Cited by 348
Watson, R. A., & Szathmáry, E. (2016) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2015.11.009 · Cited by 324
Load Forecasting Techniques for Power System: Research Challenges and Survey
Ahmad, N., Ghadi, Y., Adnan, M., & Ali, M. (2022) · IEEE Access · doi:10.1109/access.2022.3187839 · Cited by 323
Learning enhances the relative impact of top-down processing in the visual cortex
Makino, H., & Komiyama, T. (2015) · Nature Neuroscience · doi:10.1038/nn.4061 · Cited by 321
Hao, X., Zhang, G., & Ma, S. (2016) · International Journal of Semantic Computing · doi:10.1142/s1793351x16500045 · Cited by 317
A survey of deep learning methods and software tools for image classification and object detection
Druzhkov, P. N., & Kustikova, V. D. (2016) · Pattern Recognition and Image Analysis · doi:10.1134/s1054661816010065 · Cited by 311
Emergence of a 'visual number sense' in hierarchical generative models
Stoianov, I., & Zorzi, M. (2012) · Nature Neuroscience · doi:10.1038/nn.2996 · Cited by 300
A Novel Machine Learning Model for Estimation of Sale Prices of Real Estate Units
Rafiei, M. H., & Adeli, H. (2016) · Journal of Construction Engineering and Management · doi:10.1061/(asce)co.1943-7862.0001047 · Cited by 287
Deep learning methods and applications for electrical power systems: A comprehensive review
Ozcanli, A. K., Yaprakdal, F., & Baysal, M. (2020) · International Journal of Energy Research · doi:10.1002/er.5331 · Cited by 270
Apple flower detection using deep convolutional networks
Dias, P. A., Tabb, A., & Medeiros, H. (2018) · Computers in Industry · doi:10.1016/j.compind.2018.03.010 · Cited by 265
Li, X., Ning, S., Liu, Z., Yan, Z., Luo, C., & Zhuang, Z. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2019.112737 · Cited by 256
Detecting spammers on social networks
Zheng, X., Zeng, Z., Chen, Z., Yu, Y., & Rong, C. (2015) · Neurocomputing · doi:10.1016/j.neucom.2015.02.047 · Cited by 256
Trends and Future Perspective Challenges in Big Data
Naeem, M., Jamal, T., Diaz-Martinez, J., Butt, S. A., Montesano, N., Tariq, M. I., De-la-Hoz-Franco, E., & De-La-Hoz-Valdiris, E. (2022) · Smart Innovation, Systems and Technologies · doi:10.1007/978-981-16-5036-9_30 · Cited by 255
Knowing one's place: a free-energy approach to pattern regulation
Friston, K., Levin, M., Sengupta, B., & Pezzulo, G. (2015) · Journal of The Royal Society Interface · doi:10.1098/rsif.2014.1383 · Cited by 234
Smart farming: Agriculture's shift from a labor intensive to technology native industry
Charania, I., & Li, X. (2020) · Internet of Things · doi:10.1016/j.iot.2019.100142 · Cited by 218
Bayesian sampling in visual perception
Moreno-Bote, R., Knill, D. C., & Pouget, A. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1101430108 · Cited by 182
A deep learning approach for fault diagnosis of induction motors in manufacturing
Shao, S.-Y., Sun, W.-J., Yan, R.-Q., Wang, P., & Gao, R. X. (2017) · Chinese Journal of Mechanical Engineering · doi:10.1007/s10033-017-0189-y · Cited by 167
Linearly programmable two-dimensional halide perovskite memristor arrays for neuromorphic computing
Kim, S. J., Im, I. H., Baek, J. H., Choi, S., Park, S. H., Lee, D. E., Kim, J. Y., Kim, S. Y., Park, N.-G., Lee, D., et al. (2025) · Nature Nanotechnology · doi:10.1038/s41565-024-01790-3 · Cited by 157
Sha, Y., Gagne II, D. J., West, G., & Stull, R. (2020) · Journal of Applied Meteorology and Climatology · doi:10.1175/jamc-d-20-0057.1 · Cited by 141
Precision education with statistical learning and deep learning: a case study in Taiwan.
Tsai, S.-C., Chen, C.-H., Shiao, Y.-T., Ciou, J.-S., & Wu, T.-N. (2020) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-020-00186-2 · Cited by 139
Why do you fear the bogeyman? An embodied predictive coding model of perceptual inference
Pezzulo, G. (2014) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-013-0227-x · Cited by 128
Kanarachos, S., Christopoulos, S.-R. G., Chroneos, A., & Fitzpatrick, M. E. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.04.028 · Cited by 120
Happily entangled: prediction, emotion, and the embodied mind
Miller, M., & Clark, A. (2018) · Synthese · doi:10.1007/s11229-017-1399-7 · Cited by 114
Artificial intelligence in food science and nutrition: A narrative review
Miyazawa, T., Hiratsuka, Y., Toda, M., Hatakeyama, N., Ozawa, H., Abe, C., Cheng, T.-Y., Matsushima, Y., Miyawaki, Y., Ashida, K., et al. (2022) · Nutrition Reviews · doi:10.1093/nutrit/nuac033 · Cited by 91
From simple innate biases to complex visual concepts
Ullman, S., Harari, D., & Dorfman, N. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1207690109 · Cited by 77
Deep learning framework for detection of hypoglycemic episodes in children with type 1 diabetes
San, P. P., Ling, S. H., & Nguyen, H. T. (2016) · 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2016.7591483 · Cited by 42
A Deep Learning Method Combined Sparse Autoencoder with SVM
Ju, Y., Guo, J., & Liu, S. (2015) · 2015 International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery · doi:10.1109/cyberc.2015.39 · Cited by 37
Deep Predictive Learning: A Comprehensive Model of Three Visual Streams
O'Reilly, R. C., Wyatte, D. R., & Rohrlich, J. (2017) · arXiv · doi:10.48550/arxiv.1709.04654 · Cited by 26
Tikochinski, R., Goldstein, A., Yeshurun, Y., Hasson, U., & Reichart, R. (2023) · Cerebral Cortex · doi:10.1093/cercor/bhad082 · Cited by 14
The myth of the Bayesian brain
Mangalam, M. (2025) · European Journal of Applied Physiology · doi:10.1007/s00421-025-05855-6 · Cited by 14
“Generative models: Perhaps most fundamentally, it assumes the brain maintains internal generative models of the world that can simulate expected sensory inputs (Hinton 2007; Clark 2013).”
Kang, J., Patton, K., & Gardiner-Walsh, S. (2024) · Journal of Special Education Preparation · doi:10.33043/4a6kfo46 · Cited by 9
Human-inspired Perspectives: A Survey on AI Long-term Memory
He, Z., Lin, W., Zheng, H., Zhang, F., Jones, M. W., Aitchison, L., Xu, X., Liu, M., Kristensson, P. O., & Shen, J. (2024) · arXiv · doi:10.48550/arxiv.2411.00489 · Cited by 3
“Restricted Boltzmann Machines [275, 276, 277] create parametric memory by fine-tuning connection weights between the input and hidden layers, reducing the difference between reconstructed and original inputs to capture and replicate key data features.”
A Gradient-Based Algorithm to Deceive Deep Neural Networks
Xie, T., & Li, Y. (2019) · Communications in Computer and Information Science · doi:10.1007/978-3-030-36808-1_7 · Cited by 3
Metadata
- Authors
- Hinton, G. E.
- Venue
- Trends in Cognitive Sciences
- Publisher
- Elsevier BV
- Published
- 2007-10
- Volume
- 11
- Issue
- 10
- Pages
- 428-434
- ISSN
- 1364-6613 (ISSN-L)
- OpenAlex
- W2124537004
- Cited by
- 1,011
- References
- 53
- FWCI
- 4.37
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.