Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat
Cited by 345

The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.

Deep convolutional networks do not classify based on global object shape

Open access
Baker, Nicholas, Lu, Hongjing, Erlikhman, Gennady, Kellman, Philip J. · 2018 · PLOS Computational Biology

Abstract

Deep convolutional networks (DCNNs) are achieving previously unseen performance in object classification, raising questions about whether DCNNs operate similarly to human vision.In biological vision, shape is arguably the most important cue for recognition.We tested the role of shape information in DCNNs trained to recognize objects.In Experiment 1, we presented a trained DCNN with object silhouettes that preserved overall shape but were filled with surface texture taken from other objects.Shape cues appeared to play some role in the classification of artifacts, but little or none for animals.In Experiments 2-4, DCNNs showed no ability to classify glass figurines or outlines but correctly classified some silhouettes.Aspects of these results led us to hypothesize that DCNNs do not distinguish object's bounding contours from other edges, and that DCNNs access some local shape features, but not global shape.In Experiment 5, we tested this hypothesis with displays that preserved local features but disrupted global shape, and vice versa.With disrupted global shape, which reduced human accuracy to 28%, DCNNs gave the same classification labels as with ordinary shapes.Conversely, local contour changes eliminated accurate DCNN classification but caused no difficulty for human observers.These results provide evidence that DCNNs have access to some local shape information in the form of local edge relations, but they have no access to global object shapes. Author summary"Deep learning" systems-specifically, deep convolutional neural networks (DCNNs)have recently achieved near human levels of performance in object recognition tasks.It has been suggested that the processing in these systems may model or explain object perception abilities in biological vision.For humans, shape is the most important cue for recognizing objects.We tested whether deep convolutional neural networks trained to recognize objects make use of object shape.Our findings indicate that other cues, such as surface texture, play a larger role in deep network classification than in human recognition.Most crucially, we show that deep learning systems have no sensitivity to the overall shape of an object.Whereas deep learning systems can access some local shape features,

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1371/journal.pcbi.1006613

Cites

39 of 39 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Cited by

See all 345

Metadata

Authors
Baker, N., Lu, H., Erlikhman, G., & Kellman, P. J.
Venue
PLOS Computational Biology
Published
2018-12-07
Volume
14
Issue
12
Pages
e1006613
ISSN
  • 1553-734X (ISSN-L)
  • 1553-7358
OpenAlex
W2903867357
Cited by
345
References
39
FWCI
14.46
Type
journal article
Language
en
Open access
gold

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.