Cited by 496Visual perception and processing mechanismsFace Recognition and PerceptionAdvanced Neural Network Applications

Evidence that recurrent circuits are critical to the ventral stream’s execution of core object recognition behavior

Open access
Kar, Kohitij, Kubilius, Jonas, Schmidt, Kailyn, Issa, Elias B., DiCarlo, James J.·2019·Nature Neuroscience

Published version of a preprint

Abstract

Non-recurrent deep convolutional neural networks (CNNs) are currently the best at modeling core object recognition, a behavior that is supported by the densely recurrent primate ventral stream, culminating in the inferior temporal (IT) cortex. If recurrence is critical to this behavior, then primates should outperform feedforward-only deep CNNs for images that require additional recurrent processing beyond the feedforward IT response. Here we first used behavioral methods to discover hundreds of these 'challenge' images. Second, using large-scale electrophysiology, we observed that behaviorally sufficient object identity solutions emerged ~30 ms later in the IT cortex for challenge images compared with primate performance-matched 'control' images. Third, these behaviorally critical late-phase IT response patterns were poorly predicted by feedforward deep CNN activations. Notably, very-deep CNNs and shallower recurrent CNNs better predicted these late IT responses, suggesting that there is a functional equivalence between additional nonlinear transformations and recurrence. Beyond arguing that recurrent circuits are critical for rapid object identification, our results provide strong constraints for future recurrent model development.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1038/s41593-019-0392-5

Cites

63 of 63 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Analogous approaches have proven successful in relating the structure of neural activity to computational functions in other domains, including vision, audition, olfaction, thermosensation, perceptual discrimination, facial perception, and navigation.

    “Analogous approaches have proven successful in relating the structure of neural activity to computational functions in other domains, including vision 17–19, audition 20, olfaction 21,22, thermosensation 23, perceptual discrimination 24, facial perception 25, and navigation 26,27.”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Kar, K., Kubilius, J., Schmidt, K., Issa, E. B., & DiCarlo, J. J.
Affiliations
McGovern Institute for Brain Research (US)
Corresponding author
Kar, Kohitij
Venue
Nature Neuroscience
Published
2019-04-29
Volume
22
Issue
6
Pages
974-983
ISSN
  • 1097-6256 (ISSN-L)
  • 1546-1726
OpenAlex
W2949512190
Cited by
496
References
63
Citations by year
2026: 54 · 2025: 58 · 2024: 55 · 2023: 72 · 2022: 86 · 2021: 77 · 2020: 58 · 2019: 33 · 2018: 3
FWCI
36.92
Type
journal article
Language
en
Open access
Licence
Locations
  • Nature Neuroscience (publishedVersion)
  • bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by-nc-nd)
  • PubMed (publishedVersion)
  • PubMed Central (acceptedVersion)
  • Lirias (KU Leuven) (submittedVersion, other-oa)
  • DSpace@MIT (Massachusetts Institute of Technology) (submittedVersion, cc-by-nc)
  • Zenodo (CERN European Organization for Nuclear Research) (submittedVersion, cc-by)
Funders
  • National Science Foundation (1231216)
  • European Commission (705498, HORIZON2020)
  • Companhia Brasileira de Metalurgia e Mineração (CCF-1231216)
  • Multidisciplinary University Research Initiative
  • Office of Naval Research (MURI-114407)
  • National Eye Institute (K99EY022671, R00EY022671, R01EY014970)
Topics
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Face Recognition and Perception
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
Keywords
recurrent circuits, ventral stream, object recognition, inferior temporal cortex, recurrent convolutional neural network, primate visual cortex
MeSH terms
Animals, Humans, Macaca mulatta, Temporal Lobe, Visual Perception, Neural Networks, Computer, Recognition, Psychology

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review