Deep Predictive Coding Network for Object Recognition
Open accessThe DOI matches its OpenAlex record; 25 of the 25 references it cites were found in a registry or an index.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Learning Transferable Architectures for Scalable Image Recognition
Zoph, B., Vasudevan, V., Shlens, J., & Le, Q. V. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00907 · Cited by 7,831
Whatever next? Predictive brains, situated agents, and the future of cognitive science
Clark, A. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12000477 · Cited by 5,924
Rao, R. P. N., & Ballard, D. H. (1999) · Nature Neuroscience · doi:10.1038/4580 · Cited by 5,483 · cited 3×
“An optional constraint to PCN was to use the same set of weights for both feedforward and feedback connections as in some prior studies (Rao and Ballard, 1999; Spratling, 2008, 2017).”
MethodDeep Convolutional Neural Networks for Image Classification: A Comprehensive Review
Rawat, W., & Wang, Z. (2017) · Neural Computation · doi:10.1162/neco_a_00990 · Cited by 3,503
FitNets: Hints for Thin Deep Nets
Romero, A., Ballas, N., Kahou, S. E., Chassang, A., Gatta, C., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.6550 · Cited by 2,859
A Practical Guide to Training Restricted Boltzmann Machines
Hinton, G. E. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_32 · Cited by 2,852 · cited 1×
“…also used a feedback network to reconstruct the visual input in unsupervised learning like autoencoders (Hinton and Salakhutdinov, 2006; Vincent et al., 2010; Masci et al., 2011), deconvolutional networks (Zeiler et al., 2010) and generative models (Hinton, 2012; Canziani and Culurciello, 2017).”
MethodCanonical Microcircuits for Predictive Coding
Bastos, A. M., Usrey, W. M., Adams, R. A., Mangun, G. R., Fries, P., & Friston, K. J. (2012) · Neuron · doi:10.1016/j.neuron.2012.10.038 · Cited by 2,421 · cited 2×
“In neuroscience, the interplay between feedforward and feedback processes is described by hierarchical predictive coding (Rao & Ballard, 1999; Friston & Kiebel, 2009; Bastos et al., 2012; Clark, 2013).”
MethodHohwy, J. (2013) · doi:10.1093/acprof:oso/9780199682737.001.0001 · Cited by 1,914
How does the brain solve visual object recognition?
DiCarlo, J. J., Zoccolan, D., & Rust, N. C. (2012) · Neuron · doi:10.1016/j.neuron.2012.01.010 · Cited by 1,790 · cited 2×
“For human vision, feedforward processing is essential to rapid recognition (Serre et al., 2007; DiCarlo et al., 2012), e.”
BackgroundPredictive coding under the free-energy principle
Friston, K., & Kiebel, S. (2009) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2008.0300 · Cited by 1,579
Visual areas exert feedforward and feedback influences through distinct frequency channels
Bastos, A. M., Vezoli, J., Bosman, C. A., Schoffelen, J.-M., Oostenveld, R., Dowdall, J. R., De Weerd, P., Kennedy, H., & Fries, P. (2015) · Neuron · doi:10.1016/j.neuron.2014.12.018 · Cited by 1,320
Guclu, U., & van Gerven, M. A. J. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.5023-14.2015 · Cited by 961
Cichy, R. M., Khosla, A., Pantazis, D., Torralba, A., & Oliva, A. (2016) · Scientific Reports · doi:10.1038/srep27755 · Cited by 716 · cited 2×
“Recent studies demonstrate that deep convolutional neural networks use representations similar to those in the brain (Khaligh-Razavi and Kriegeskorte, 2014; Yamins et al., 2014; Güçlü and van Gerven, 2015; Cichy et al., 2016; Eickenberg et al., 2017; Wen et al., 2017).”
BackgroundMichalareas, G., Vezoli, J., van Pelt, S., Schoffelen, J.-M., Kennedy, H., & Fries, P. (2016) · Neuron · doi:10.1016/j.neuron.2015.12.018 · Cited by 696 · cited 1×
“Predictive coding is an influential theory of neural processing in vision and beyond (Huang and Rao, 2011; Clark, 2013; Hohwy, 2013) as supported by empirical evidence (Gómez et al., 2014; Bastos et al., 2015; Michalareas et al., 2016; Sedley et al., 2016; van Pelt et al., 2016).”
BackgroundHuang, Y., & Rao, R. P. N. (2011) · WIREs Cognitive Science · doi:10.1002/wcs.142 · Cited by 470
Towards a mathematical theory of cortical micro-circuits
George, D., & Hawkins, J. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000532 · Cited by 404 · cited 1×
“In neuroscience, the interplay between feedforward and feedback processes is described by hierarchical predictive coding (Rao and Ballard, 1999; Friston and Kiebel, 2009; George and Hawkins, 2009; Bastos et al., 2012; Clark, 2013; Hohwy, 2013).”
Seeing it all: Convolutional network layers map the function of the human visual system
Eickenberg, M., Gramfort, A., Varoquaux, G., & Thirion, B. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2016.10.001 · Cited by 338 · cited 2×
“Recent studies demonstrate that deep convolutional neural networks use representations similar to those in the brain (Khaligh-Razavi and Kriegeskorte, 2014; Yamins et al., 2014; Güçlü and van Gerven, 2015; Cichy et al., 2016; Eickenberg et al., 2017; Wen et al., 2017).”
BackgroundDynamic Model of Visual Recognition Predicts Neural Response Properties in the Visual Cortex
Rao, R. P. N., & Ballard, D. H. (1997) · Neural Computation · doi:10.1162/neco.1997.9.4.721 · Cited by 290 · cited 1×
“In a seminal paper (Rao and Ballard, 1997), Rao and Ballard postulated that the brain learns a hierarchical internal model of the visual world.”
BackgroundNeural signatures of perceptual inference
Sedley, W., Gander, P. E., Kumar, S., Kovach, C. K., Oya, H., Kawasaki, H., Howard, M. A., & Griffiths, T. D. (2016) · eLife · doi:10.7554/elife.11476 · Cited by 194
Reduced predictable information in brain signals in autism spectrum disorder
Gómez, C., Lizier, J. T., Schaum, M., Wollstadt, P., Grützner, C., Uhlhaas, P., Freitag, C. M., Schlitt, S., Bölte, S., Hornero, R., et al. (2014) · Frontiers in Neuroinformatics · doi:10.3389/fninf.2014.00009 · Cited by 59 · cited 2×
“Predictive coding is an influential theory of neural processing in vision and beyond (Huang & Rao, 2011) as supported by empirical evidence (Gómez et al., 2014; van Pelt et al., 2016).”
Background
Cited by
A neural network trained for prediction mimics diverse features of biological neurons and perception
Lotter, W., Kreiman, G., & Cox, D. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-0170-9 · Cited by 128
Predictive Coding: a Theoretical and Experimental Review
Millidge, B., Seth, A., & Buckley, C. L. (2021) · arXiv · doi:10.48550/arxiv.2107.12979 · Cited by 106
“The original work showed that this approach worked well for learning informative representations of audio and visual datasets, while later work has demonstrated its benefits in video (Elsayed, Maida, & Bayoumi, 2019; Wen et al., 2018).”
Predictive coding feedback results in perceived illusory contours in a recurrent neural network
Pang, Z., O’May, C. B., Choksi, B., & VanRullen, R. (2021) · Neural Networks · doi:10.1016/j.neunet.2021.08.024 · Cited by 44
Predictive coding with spiking neurons and feedforward gist signaling
Lee, K., Dora, S., Mejias, J. F., Bohte, S. M., & Pennartz, C. M. A. (2024) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2024.1338280 · Cited by 14
“…capabilities but lack the biological plausibility due to their reliance on supervised learning, convolutional filters, and backpropagation of errors (Whittington and Bogacz, 2017; Sacramento et al., 2018; Van den Oord et al., 2018; Wen et al., 2018; Han et al., 2019; Lotter et al., 2020).”
BackgroundDoes Machine Understanding Require Consciousness?
Pepperell, R. (2022) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2022.788486 · Cited by 11
“In the case of natural language processing, as (Wen et al., 2018).”
Background
Metadata
- Authors
- Wen, H., Han, K., Shi, J., Zhang, Y., Culurciello, E., & Liu, Z.
- Venue
- arXiv (Cornell University)
- Publisher
- Cornell University
- Published
- 2018-02-13
- Pages
- 5266-5275
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1802.04762
- OpenAlex
- W2787636496
- Cited by
- 47
- References
- 25
- Type
- posted content
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.