Cited by 1,667Advanced Image and Video Retrieval TechniquesAdvanced Neural Network ApplicationsImage Retrieval and Classification Techniques

Robust Object Recognition with Cortex-Like Mechanisms

Serre, Thomas, Wolf, Lior, Bileschi, Stanley, Riesenhuber, Maximilian, Poggio, Tomaso·2007·IEEE Transactions on Pattern Analysis and Machine Intelligence

Abstract

We introduce a new general framework for the recognition of complex visual scenes, which is motivated by biology: We describe a hierarchical system that closely follows the organization of visual cortex and builds an increasingly complex and invariant feature representation by alternating between a template matching and a maximum pooling operation. We demonstrate the strength of the approach on a range of recognition tasks: From invariant single object recognition in clutter to multiclass categorization problems and complex scene understanding tasks that rely on the recognition of both shape-based as well as texture-based objects. Given the biological constraints that the system had to satisfy, the approach performs surprisingly well: It has the capability of learning from only a few training examples and competes with state-of-the-art systems. We also discuss the existence of a universal, redundant dictionary of features that could handle the recognition of most object categories. In addition to its relevance for computer vision, the success of this approach suggests a plausibility proof for a class of feedforward models of object recognition in cortex.

Integrity signals

Registry

Crossref · 10.1109/tpami.2007.56

Cites

76 of 76 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • This class of feedforward models can duplicate the tuning properties of at least some cortical cells when probed with artificial stimuli and can handle the recognition of objects in the real world where objects may undergo drastic changes in appearance.

    “Not only does this class of feedforward models seem to be able to duplicate the tuning properties of at least some cortical cells when probed with artificial stimuli, but it can also handle the recognition of objects in the real world (39, 40) where objects may undergo drastic changes in appearance (e.g., clutter, shape, illumination).”

    From A feedforward architecture accounts for rapid categorization (2007) · cites this paper as [39]

  • In agreement with the human data, the model is able to recognize objects with limited clutter.

    “In agreement with the human data, the model is able to recognize objects with limited clutter (see ref. 39 for results on a large database of 101 object categories).”

    From A feedforward architecture accounts for rapid categorization (2007) · cites this paper as [39]

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Serre, T., Wolf, L., Bileschi, S., Riesenhuber, M., & Poggio, T.
Affiliations
  • McGovern Institute for Brain Research (US)
  • Georgetown University Medical Center (US)
Venue
IEEE Transactions on Pattern Analysis and Machine Intelligence
Published
2007-03
Volume
29
Issue
3
Pages
411-426
ISSN
  • 0162-8828 (ISSN-L)
  • 2160-9292
OpenAlex
W2144982973
Cited by
1,667
References
76
Citations by year
2026: 12 · 2025: 31 · 2024: 43 · 2023: 38 · 2022: 41 · 2021: 63 · 2020: 65 · 2019: 70 · 2018: 69 · 2017: 74 · 2016: 114 · 2015: 129 · 2014: 161 · 2013: 123 · 2012: 134
FWCI
152.23
Type
journal article
Language
en
Open access
closed
Locations
  • IEEE Transactions on Pattern Analysis and Machine Intelligence (publishedVersion)
  • PubMed (publishedVersion)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Retrieval and Classification Techniques
Keywords
object recognition, hierarchical feature representation, template matching, maximum pooling, biological plausibility, feature dictionary, feedforward models, invariance
MeSH terms
Algorithms, Artificial Intelligence, Computer Simulation, Humans, Image Enhancement, Image Interpretation, Computer-Assisted, Models, Biological, Pattern Recognition, Automated, Pattern Recognition, Visual, Sensitivity and Specificity, Visual Cortex, Reproducibility of Results, Biomimetics

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review