High-Level Prediction Signals in a Low-Level Area of the Macaque Face-Processing Hierarchy
Open accessAbstract
Theories like predictive coding propose that lower-order brain areas compare their inputs to predictions derived from higher-order representations and signal their deviation as a prediction error. Here, we investigate whether the macaque face-processing system, a three-level hierarchy in the ventral stream, employs such a coding strategy. We show that after statistical learning of specific face sequences, the lower-level face area ML computes the deviation of actual from predicted stimuli. But these signals do not reflect the tuning characteristic of ML. Rather, they exhibit identity specificity and view invariance, the tuning properties of higher-level face areas AL and AM. Thus, learning appears to endow lower-level areas with the capability to test predictions at a higher level of abstraction than what is afforded by the feedforward sweep. These results provide evidence for computational architectures like predictive coding and suggest a new quality of functional organization of information-processing hierarchies beyond pure feedforward schemes.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The neural response to identical sensory input is markedly reduced when the input is predicted, putatively owing to a reduced response of the error units to predictable input, as well as to improved selection of units encoding the relevant causes of the input.
“Second, the neural response to identical sensory input is markedly reduced when the input is predicted [67,74], putatively owing to a reduced response of the error units to predictable input, as well as to improved selection of units encoding the relevant causes of the input.”
From How Do Expectations Shape Perception? (2018) · cites this paper as [74]
Split into 2 atoms — 1 confirmed, 1 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
Experimental — accuracy not yet measuredExpectation suppression is observed in non-invasive fMRI BOLD and EEG/MEG signals, and in spike rates in non-human primates and rodents.
“Moreover, expectation suppression is observed not only in non-invasive fMRI blood oxygen level-dependent (BOLD) [65,72,73] and electroencephalography (EEG)/magnetoencephalography (MEG) signals [68,69,77], but also in spike rates in non-human primates [66,67,74,76] and rodents [70,75,78].”
From How Do Expectations Shape Perception? (2018) · cites this paper as [74]
The authors found that mirror-symmetric view violations produced smaller responses in ML than nonmirror-symmetric violations in the late phase of the response.
“In addition, the authors found that mirror‐symmetric view violations produced smaller responses in ML than nonmirror‐symmetric violations in the late phase of the response.”
From Evaluating the neurophysiological evidence for predictive processing as a model of perception (2020) · cites this paper as [92]
Schwiedrzik and Freiwald found that ML responses to simple violations of head orientation diminished more quickly than more complex stimulus violations involving discrepant facial identities.
“Indeed, the results showed that ML responses to simple violations of head orientation diminished more quickly than more complex stimulus violations involving discrepant facial identities”
From Evaluating the neurophysiological evidence for predictive processing as a model of perception (2020) · cites this paper as [92]
An important detail of this study is that the deviant stimulus pairings were not coded according to the departure of the second face from the expected second face but as the departure of the first face from the normal predictor of the second face.
“However, an important detail of this study is that the deviant stimulus pairings were not coded according to the departure of the second face from the expected second face but as the departure of the first face from the normal predictor of the second face.”
From Evaluating the neurophysiological evidence for predictive processing as a model of perception (2020) · cites this paper as [92]
There was a positive relationship between expectation suppression and stimulus preference in the macaque face patch system and macaque inferior temporal cortex.
“and that there was a positive relationship between expectation suppression and stimulus preference in the macaque face patch system [74] and macaque IT [67].”
From How Do Expectations Shape Perception? (2018) · cites this paper as [74]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Fischl, B. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.01.021 · Cited by 9,526 · see citing works
Rao, R. P. N., & Ballard, D. H. (1999) · Nature Neuroscience · doi:10.1038/4580 · Cited by 5,483 · see citing works
Parkhi, O. M., Vedaldi, A., & Zisserman, A. (2015) · Procedings of the British Machine Vision Conference 2015 · doi:10.5244/c.29.41 · Cited by 5,479 · see citing works
SMITH, S., & NICHOLS, T. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.03.061 · Cited by 5,250 · see citing works
Permutation inference for the general linear model
Winkler, A. M., Ridgway, G. R., Webster, M. A., Smith, S. M., & Nichols, T. E. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.01.060 · Cited by 3,563 · see citing works
Unsupervised spike detection and sorting with wavelets and superparamagnetic clustering
Quiroga, R. Q., Nadasdy, Z., & Ben-Shaul, Y. (2004) · Neural Computation · doi:10.1162/089976604774201631 · Cited by 2,119 · see citing works
Introduction to Robust Estimation and Hypothesis Testing
Wilcox, R. R. (2012) · Elsevier eBooks · doi:10.1016/c2010-0-67044-1 · Cited by 2,086 · see citing works
The free-energy principle: a rough guide to the brain?
Friston, K. (2009) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2009.04.005 · Cited by 1,831 · see citing works
How does the brain solve visual object recognition?
DiCarlo, J. J., Zoccolan, D., & Rust, N. C. (2012) · Neuron · doi:10.1016/j.neuron.2012.01.010 · Cited by 1,790 · see citing works
Using goal-driven deep learning models to understand sensory cortex
Yamins, D. L. K., & DiCarlo, J. J. (2016) · Nature Neuroscience · doi:10.1038/nn.4244 · Cited by 1,621 · see citing works
Feature-based attention influences motion processing gain in macaque visual cortex
Treue, S., & Trujillo, J. C. M. (1999) · Nature · doi:10.1038/21176 · Cited by 1,465 · see citing works
Controlling low-level image properties: The SHINE toolbox
Willenbockel, V., Sadr, J., Fiset, D., Horne, G. O., Gosselin, F., & Tanaka, J. W. (2010) · Behavior Research Methods · doi:10.3758/brm.42.3.671 · Cited by 1,166 · see citing works
The cost of cortical computation.
Lennie, P. (2003) · Current Biology · doi:10.1016/s0960-9822(03)00135-0 · Cited by 1,134 · see citing works
A Cortical Region Consisting Entirely of Face-Selective Cells
Tsao, D. Y., Freiwald, W. A., Tootell, R. B. H., & Livingstone, M. S. (2006) · Science · doi:10.1126/science.1119983 · Cited by 1,131 · see citing works
Self-citationHawkins, J., & Blakeslee, S. (2004) · Cited by 1,012 · see citing works
Corrections for extreme proportions and their biasing effects on estimated values ofd′
Hautus, M. J. (1995) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03203619 · Cited by 941 · see citing works
Cortical feedback improves discrimination between figure and background by V1, V2 and V3 neurons
Hupé, J. M., James, A. C., Payne, B. R., Lomber, S. G., Girard, P., & Bullier, J. (1998) · Nature · doi:10.1038/29537 · Cited by 864 · see citing works
Expectation in perceptual decision making: neural and computational mechanisms
Summerfield, C., & de Lange, F. P. (2014) · Nature Reviews Neuroscience · doi:10.1038/nrn3838 · Cited by 832 · see citing works
Freiwald, W. A., & Tsao, D. Y. (2010) · Science · doi:10.1126/science.1194908 · Cited by 678 · see citing works
Self-citationSimple adaptive testing with the weighted up-down method
Kaernbach, C. (1991) · Perception & Psychophysics · doi:10.3758/bf03214307 · Cited by 678 · see citing works
Sparseness of the neuronal representation of stimuli in the primate temporal visual cortex
Rolls, E. T., & Tovée, M. J. (1995) · Journal of Neurophysiology · doi:10.1152/jn.1995.73.2.713 · Cited by 500 · see citing works
A Nonstochastic Interpretation of Reported Significance Levels
Freedman, D. A., & Lane, D. A. (1983) · Journal of Business and Economic Statistics · doi:10.1080/07350015.1983.10509354 · Cited by 499 · see citing works
eulerAPE: Drawing Area-Proportional 3-Venn Diagrams Using Ellipses
Micallef, L., & Rodgers, P. J. (2014) · PLoS ONE · doi:10.1371/journal.pone.0101717 · Cited by 493 · see citing works
Human face recognition ability is specific and highly heritable
Wilmer, J. B., Germine, L. T., Chabris, C. F., Chatterjee, G., Williams, M., Loken, E., Nakayama, K., & Duchaine, B. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0913053107 · Cited by 489 · see citing works
Multivariate Permutation Tests : With Applications in Biostatistics
Pesarin, F. (2001) · Cited by 477 · see citing works
Huang, Y., & Rao, R. P. N. (2011) · WIREs Cognitive Science · doi:10.1002/wcs.142 · Cited by 470 · see citing works
Eliaš, P. (1955) · IEEE Transactions on Information Theory · doi:10.1109/tit.1955.1055126 · Cited by 436 · see citing works
Patches with Links: A Unified System for Processing Faces in the Macaque Temporal Lobe
Moeller, S., Freiwald, W. A., & Tsao, D. Y. (2008) · Science · doi:10.1126/science.1157436 · Cited by 402 · see citing works
Self-citationStatistical Learning: From Acquiring Specific Items to Forming General Rules
Aslin, R. N., & Newport, E. L. (2012) · Current Directions in Psychological Science · doi:10.1177/0963721412436806 · Cited by 348 · see citing works
Statistical learning of visual transitions in monkey inferotemporal cortex
Meyer, T., & Olson, C. R. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1112895108 · Cited by 325 · see citing works
Non‐parametric combination and related permutation tests for neuroimaging
Winkler, A. M., Webster, M., Brooks, J. C. W., Tracey, I., Smith, S. M., & Nichols, T. E. (2016) · Human Brain Mapping · doi:10.1002/hbm.23115 · Cited by 237 · see citing works
A quantitative theory of immediate visual recognition
Serre, T., Kreiman, G., Kouh, M., Cadieu, C. F., Knoblich, U., & Poggio, T. (2007) · Progress in brain research · doi:10.1016/s0079-6123(06)65004-8 · Cited by 217 · see citing works
Tippett, L. H. C. (1931) · Cited by 212 · see citing works
Adjusting the effect of nonstationarity in cluster-based and TFCE inference
Salimi‐Khorshidi, G., Smith, S. M., & Nichols, T. E. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.09.088 · Cited by 150 · see citing works
Perceptual grouping and the interactions between visual cortical areas
Murray, S. O., Schrater, P., & Kersten, D. (2004) · Neural Networks · doi:10.1016/j.neunet.2004.03.010 · Cited by 149 · see citing works
Anatomical Connections of the Functionally Defined “Face Patches” in the Macaque Monkey
Grimaldi, P., Saleem, K. S., & Tsao, D. Y. (2016) · Neuron · doi:10.1016/j.neuron.2016.05.009 · Cited by 140 · see citing works
Bayesian quantile regression methods
Lancaster, T., & Jun, S. J. (2009) · Journal of Applied Econometrics · doi:10.1002/jae.1069 · Cited by 105 · see citing works
An LCD monitor with sufficiently precise timing for research in vision
Wang, P. (2011) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2011.00085 · Cited by 101 · see citing works
Poort, J., Self, M. W., van Vugt, B., Malkki, H. A. I., & Roelfsema, P. R. (2016) · Cerebral Cortex · doi:10.1093/cercor/bhw235 · Cited by 84 · see citing works
Meyers, E. M., Borzello, M., Freiwald, W. A., & Tsao, D. Y. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.3086-14.2015 · Cited by 74 · see citing works
Self-citationContrasting Specializations for Facial Motion within the Macaque Face-Processing System
Fisher, C., & Freiwald, W. A. (2015) · Current Biology · doi:10.1016/j.cub.2014.11.038 · Cited by 74 · see citing works
Self-citationStatistical learning and its consequences.
Turk-Browne, N. (2012) · Nebraska Symposium on Motivation. Nebraska Symposium on Motivation · doi:10.1007/978-1-4614-4794-8_6 · Cited by 63 · see citing works
Face Patch Resting State Networks Link Face Processing to Social Cognition
Schwiedrzik, C. M., Zarco, W., Everling, S., & Freiwald, W. A. (2015) · PLoS Biology · doi:10.1371/journal.pbio.1002245 · Cited by 55 · see citing works
Self-citationMR-guided stereotactic navigation
Ohayon, S., & Tsao, D. Y. (2011) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2011.11.031 · Cited by 50 · see citing works
Causal Inference and Explaining Away in a Spiking Network
Moreno‐Bote, R., & Drugowitsch, J. (2015) · Scientific Reports · doi:10.1038/srep17531 · Cited by 40 · see citing works
An Approximate Test for Homogeneity of Correlated Correlation Coefficients
Raghunathan, T. E. (2003) · Quality & Quantity · doi:10.1023/a:1022567712647 · Cited by 19 · see citing works
Sample Skewness as a Statistical Measurement of Neuronal Tuning Sharpness
Samonds, J. M., Potetz, B. R., & Lee, T. S. (2014) · Neural Computation · doi:10.1162/neco_a_00582 · Cited by 10 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
How Do Expectations Shape Perception?
de Lange, F. P., Heilbron, M., & Kok, P. (2018) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2018.06.002 · Cited by 975 · see citing works
A hierarchy of linguistic predictions during natural language comprehension
Heilbron, M., Armeni, K., Schoffelen, J.-M., Hagoort, P., & de Lange, F. P. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2201968119 · Cited by 343 · see citing works
Evaluating the neurophysiological evidence for predictive processing as a model of perception
Walsh, K. S., McGovern, D. P., Clark, A., & O'Connell, R. G. (2020) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.14321 · Cited by 333 · see citing works
Layer and rhythm specificity for predictive routing
Bastos, A. M., Lundqvist, M., Waite, A. S., Kopell, N., & Miller, E. K. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2014868117 · Cited by 268 · see citing works
Forms of prediction in the nervous system
Teufel, C., & Fletcher, P. C. (2020) · Nature Reviews Neuroscience · doi:10.1038/s41583-020-0275-5 · Cited by 155 · see citing works
Neocortical Layer 1: an elegant solution to top-down and bottom-up integration
Schuman, B., Dellal, S., Prönneke, A., Machold, R., & Rudy, B. (2021) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-100520-012117 · Cited by 148 · see citing works
Towards a Unified View on Pathways and Functions of Neural Recurrent Processing
Pennartz, C. M. A., Dora, S., Muckli, L., & Lorteije, J. A. M. (2019) · Trends in Neurosciences · doi:10.1016/j.tins.2019.07.005 · Cited by 73 · see citing works
“Evidence for PP has been found in rodents [52,53], humans (Box 3), and nonhuman primates [54].”
BackgroundIssa, E. B., Cadieu, C. F., & DiCarlo, J. J. (2018) · eLife · doi:10.7554/elife.42870 · Cited by 76 · see citing works
How deep is the brain? The shallow brain hypothesis
Suzuki, M., Pennartz, C. M. A., & Aru, J. (2023) · Nature Reviews Neuroscience · doi:10.1038/s41583-023-00756-z · Cited by 79 · see citing works
Face Repetition Probability Does Not Affect Repetition Suppression in Macaque Inferotemporal Cortex
Vinken, K., Op de Beeck, H. P., & Vogels, R. (2018) · The Journal of Neuroscience · doi:10.1523/jneurosci.0462-18.2018 · Cited by 49 · see citing works
Feature-specific prediction errors for visual mismatch
Stefanics, G., Stephan, K. E., & Heinzle, J. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2019.04.020 · Cited by 26 · see citing works
Dora, S., Bohte, S. M., & Pennartz, C. M. A. (2021) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2021.666131 · Cited by 24 · see citing works
Brucklacher, M., Bohté, S. M., Mejias, J. F., & Pennartz, C. M. A. (2023) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2023.1207361 · Cited by 15 · see citing works
“time, repetition suppression that requires explicit expectations (6,7), encoding of deviation from temporal expectations in macaque’s inferotemporal and prefrontal cortex (8,9) and encoding of expected movement outcomes in mouse V1 (10) show that the brain constantly tries to predict future inputs.”
Background
- Authors
- Schwiedrzik, C. M., & Freiwald, W. A.
- Affiliations
- German Primate Center (DE)
- Rockefeller University (US)
- Corresponding author
- Schwiedrzik, Caspar M.
- Freiwald, Winrich A.
- Venue
- Neuron
- Publisher
- Elsevier BV
- Published
- 2017-09
- Volume
- 96
- Issue
- 1
- Pages
- 89-97.e4
- ISSN
- 0896-6273 (ISSN-L)
- PMC
- PMC5757317
- OpenAlex
- W2757870059
- Cited by
- 136
- References
- 47
- Citations by year
- 2026: 4 · 2025: 21 · 2024: 26 · 2023: 18 · 2022: 10 · 2021: 18 · 2020: 19 · 2019: 12 · 2018: 6 · 2017: 1 · 2016: 1
- FWCI
- 5.97
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
- www.elsevier.com/open-access/userlicense/1.0/ (vor, 391 d)
- doi.org/10.15223/policy-017 (stm-asf)
- doi.org/10.15223/policy-037 (stm-asf)
- doi.org/10.15223/policy-012 (stm-asf)
- doi.org/10.15223/policy-029 (stm-asf)
- doi.org/10.15223/policy-004 (stm-asf)
- Locations
- Neuron (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- Human Frontier Science Program Long-Term Fellowship (LT001118/2012-L)
- Irma T. Hirschl
- Monique Weill-Caulier Trusts Award
- Pew Scholar Award in the Biomedical Sciences
- McKnight Scholars Award
- New York Stem Cell Foundation
- National Eye Institute (R01 EY021594)
- National Center for Advancing Translational Sciences (CTSA UL1 TR001866)
- NSF Science and Technology Center for Brains, Minds, and Machines (CCF-1231216/5710003506)
- National Science Foundation (DBI-1343174)
- New York Stem Cell Foundation-Robertson Investigator
- European Union’s Horizon 2020 research and innovation programme
- Marie Skłodowska-Curie (706519)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Face Recognition and Perception
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Keywords
- predictive coding, face processing, ventral stream, prediction error, statistical learning, viewpoint invariance, hierarchical processing, macaque, feedforward processing
- MeSH terms
- Facial Recognition, Adult, Animals, Brain Mapping, Face, Female, Humans, Learning, Macaca, Magnetic Resonance Imaging, Male, Neural Pathways, Photic Stimulation, Temporal Lobe, Visual Pathways
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
