CoChat
Sign Up
PreprintCited by 738Advanced Image and Video Retrieval TechniquesAdvanced Neural Network ApplicationsImage Retrieval and Classification Techniques

CNN Features off-the-shelf: an Astounding Baseline for Recognition

Open access
Razavian, Ali Sharif, Azizpour, Hossein, Sullivan, Josephine, Carlsson, Stefan·2014·arXiv
DOI 10.48550/arxiv.1403.6382arXiv 1403.6382
Open this paper in CoChat — free accountOpen PDF

Abstract

Recent results indicate that the generic descriptors extracted from the convolutional neural networks are very powerful. This paper adds to the mounting evidence that this is indeed the case. We report on a series of experiments conducted for different recognition tasks using the publicly available code and model of the \overfeat network which was trained to perform object classification on ILSVRC13. We use features extracted from the \overfeat network as a generic image representation to tackle the diverse range of recognition tasks of object image classification, scene recognition, fine grained recognition, attribute detection and image retrieval applied to a diverse set of datasets. We selected these tasks and datasets as they gradually move further away from the original task and data the \overfeat network was trained to solve. Astonishingly, we report consistent superior results compared to the highly tuned state-of-the-art systems in all the visual classification tasks on various datasets. For instance retrieval it consistently outperforms low memory footprint methods except for sculptures dataset. The results are achieved using a linear SVM classifier (or $L2$ distance in case of retrieval) applied to a feature representation of size 4096 extracted from a layer in the net. The representations are further modified using simple augmentation techniques e.g. jittering. The results strongly suggest that features obtained from deep learning with convolutional nets should be the primary candidate in most visual recognition tasks.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.1403.6382

Cites

34 of 34 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Deep image representations learnt on ILSVRC generalise well to other datasets, where they have outperformed hand-crafted representations by a large margin.

    “as it turns out that deep image representations, learnt on ILSVRC, generalise well to other datasets, where they have outperformed hand-crafted representations by a large margin.”

    From Very Deep Convolutional Networks for Large-Scale Image Recognition (2014) · cites this paper as Razavian et al., 2014

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

1 of the 35 references couldn’t be matched to a known paper.

Research works printed but not linked: 19

  1. [5][5] T. Berg and P. N. Belhumeur. Poof: Part-based one-vs.-one features for fine-grained categorization, face verification, and attribute estimation. In CVPR , 2013. -
  2. [6][6] L. D. Bourdev, S. Maji, and J. Malik. Describing people: A poselet-based approach to attribute classification. In ICCV , 2011. -
  3. [7][7] Y. Chai, V. S. Lempitsky, and A. Zisserman. Bicos: A bilevel co-segmentation method for image classification. In ICCV , 2011. -
  4. [8][8] Q. Chen, Z. Song, Y. Hua, Z. Huang, and S. Yan. Hierarchical matching with side information for image classification. In CVPR , 2012. -
  5. [11][11] J. Dong, W. Xia, Q. Chen, J. Feng, Z. Huang, and S. Yan. Subcategory-aware object classification. In CVPR , 2013. -
  6. [12][12] M. Everingham, L. Van Gool, C. K. I. Williams, J. Winn, and A. Zisserman. The PASCAL Visual Object Classes Challenge 2012 (VOC2012) Results. http://www.pascalnetwork.org/challenges/VOC/voc2012/workshop/index.html. -
  7. [14][14] B. Fernando, E. Fromont, and T. Tuytelaars. Mining midlevel features for image classification. International Journal of Computer Vision , 2014. -
  8. [21][21] M. Juneja, A. Vedaldi, C. V. Jawahar, and A. Zisserman. Blocks that shout: Distinctive parts for scene classification. In CVPR , 2013. -
  9. [22][22] A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In NIPS , 2012. -
  10. [23][23] C. H. Lampert, H. Nickisch, and S. Harmeling. Attributebased classification for zero-shot visual object categorization. IEEE Transactions on Pattern Analysis and Machine Intelligence , 36(3), 2014. -
  11. [26][26] A. Mikul´ ık, M. Perdoch, O. Chum, and J. Matas. Learning a fine vocabulary. In ECCV , pages 1-14, 2010. -
  12. [27][27] M.-E. Nilsback and A. Zisserman. Automated flower classification over a large number of classes. In Proceedings of the Indian Conference on Computer Vision, Graphics and Image Processing , Dec 2008. -
  13. [31][31] S. N. Parizi, J. G. Oberlin, and P. F. Felzenszwalb. Reconfigurable models for scene recognition. In CVPR , 2012. -
  14. [33][33] F. Perronnin, Y. Liu, J. S´ anchez, and H. Poirier. Large-scale image retrieval with compressed fisher vectors. In CVPR , 2010. -
  15. [37][37] M. Rohrbach, S. Amin, M. Andriluka, and B. Schiele. A database for fine grained activity detection of cooking activities. In CVPR , 2012. -
  16. [38][38] P. Sermanet, D. Eigen, X. Zhang, M. Mathieu, R. Fergus, and Y. LeCun. Overfeat: Integrated recognition, localization and detection using convolutional networks. In ICLR , 2014. -
  17. [39][39] Z. Song, Q. Chen, Z. Huang, Y. Hua, and S. Yan. Contextualizing object detection and classification. In CVPR , 2011. -
  18. [40][40] J. Sun and J. Ponce. Learning discriminative part detectors for image classification and cosegmentation. In ICCV , 2013. -
  19. [50][50] N. Zhang, R. Farrell, F. Iandola, and T. Darrell. Deformable part descriptors for fine-grained recognition and attribute prediction. In ICCV , 2013. -

Cited by

Sorted by citations

Related

Authors
Razavian, A. S., Azizpour, H., Sullivan, J., & Carlsson, S.
Affiliations
KTH Royal Institute of Technology (SE)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2014
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.1403.6382
arXiv
1403.6382
OpenAlex
W2953391683
Cited by
607
References
35
Citations by year
2025: 3 · 2024: 2 · 2023: 1 · 2022: 3 · 2021: 69 · 2020: 75 · 2019: 90 · 2018: 124 · 2017: 131 · 2016: 58 · 2015: 34 · 2014: 17
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Funders
Nvidia
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Retrieval and Classification Techniques
Keywords
convolutional neural network features, scene classification, fine-grained classification, image retrieval, transfer learning, feature augmentation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review