CoChat
Sign Up
PreprintCited by 522Advanced Neural Network ApplicationsDomain Adaptation and Few-Shot LearningAdvanced Image and Video Retrieval Techniques

Visualizing and Understanding Convolutional Networks

Open access
Zeiler, Matthew D, Fergus, Rob·2013·arXiv
DOI 10.48550/arxiv.1311.2901arXiv 1311.2901
Open this paper in CoChat — free accountOpen PDF

Abstract

Large Convolutional Network models have recently demonstrated impressive classification performance on the ImageNet benchmark. However there is no clear understanding of why they perform so well, or how they might be improved. In this paper we address both issues. We introduce a novel visualization technique that gives insight into the function of intermediate feature layers and the operation of the classifier. We also perform an ablation study to discover the performance contribution from different model layers. This enables us to find model architectures that outperform Krizhevsky \etal on the ImageNet classification benchmark. We show our ImageNet model generalizes well to other datasets: when the softmax classifier is retrained, it convincingly beats the current state-of-the-art results on Caltech-101 and Caltech-256 datasets.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.1311.2901

Cites

4 of 4 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Combining outputs of several models by averaging softmax posteriors improves performance due to complementarity of the models.

    “This improves the performance due to complementarity of the models, and was used in the top ILSVRC submissions in 2012 (Krizhevsky et al., 2012) and 2013 (Zeiler & Fergus, 2013; Sermanet et al., 2014).”

    From Very Deep Convolutional Networks for Large-Scale Image Recognition (2014) · cites this paper as Zeiler & Fergus, 2013

    In §5.1 (ImageNet 2012), the paper reports lower classification error when it combines multiple models, and Table 2 compares the combined result with single-model results. Our copy does not say that the models’ softmax posteriors were averaged or attribute the improvement to their complementarity. (LLM, conf=0.84)

    Experimental — accuracy not yet measured

  • Interpretability by mathematical structures unifies interpretabilities that reveal the mechanisms behind deeper layers of neural network algorithms.

    “Interpretability by mathematical structures unifies all the interpretabilities that reveal the mechanisms behind deeper layers (which store all the complex information) of NN algorithms [46].”

    From Interpreting Black-Box Models: A Review on Explainable Artificial Intelligence (2024) · cites this paper as [46]

    The Abstract and Figure 2 discussion describe a visualization method that provides insight into intermediate and higher convolutional-network layers. The Discussion (§6) says it reveals properties such as compositionality and increasing invariance. The paper does not claim that an approach called ‘interpretability by mathematical structures’ unifies all such interpretabilities, or that deeper layers store all complex information. (LLM, conf=0.84)

    Experimental — accuracy not yet measured

  • Deep image representations learnt on ILSVRC generalise well to other datasets, where they have outperformed hand-crafted representations by a large margin.

    “as it turns out that deep image representations, learnt on ILSVRC, generalise well to other datasets, where they have outperformed hand-crafted representations by a large margin.”

    From Very Deep Convolutional Networks for Large-Scale Image Recognition (2014) · cites this paper as Zeiler & Fergus, 2013

  • When applied to images of arbitrary sizes, current methods mostly fit the input image to a fixed size, either via cropping or via warping.

    “When applied to images of arbitrary sizes, current methods mostly fit the input image to the fixed size, either via cropping [3], [4] or via warping [13], [7], as shown in Figure 1 (top).”

    From Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition (2015) · cites this paper as [4]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 1

  1. Bo, L., Ren, X., and Fox, D. Multipath sparse coding using hierarchical matching pursuit. In CVPR, 2013.

Cited by

Sorted by citations

Authors
Zeiler, M. D., & Fergus, R.
Affiliations
New York University (US)
ORCID
Fergus, Rob
Venue
arXiv
Publisher
arXiv
Published
2013
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.1311.2901
arXiv
1311.2901
OpenAlex
W2952186574
Cited by
522
References
4
Citations by year
2026: 14 · 2025: 24 · 2024: 21 · 2023: 17 · 2022: 18 · 2021: 63 · 2020: 67 · 2019: 68 · 2018: 61 · 2017: 62 · 2016: 29 · 2015: 35 · 2014: 35 · 2013: 8
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
Keywords
convolutional neural networks, network visualization, ablation study, ImageNet classification, model architecture design, softmax classifier, transfer learning, Caltech-101, Caltech-256

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review