ImageNet Large Scale Visual Recognition Challenge
The DOI matches its Crossref record; 100 of the 103 references it cites were found in a registry or an index.
Abstract
The ImageNet Large Scale Visual Recognition Challenge is a benchmark in object category classification and detection on hundreds of object categories and millions of images. The challenge has been run annually from 2010 to present, attracting participation from more than fifty institutions. This paper describes the creation of this benchmark dataset and the advances in object recognition that have been possible as a result. We discuss the challenges of collecting large-scale ground truth annotation, highlight key breakthroughs in categorical object recognition, provide a detailed analysis of the current state of the field of large-scale image classification and object detection, and compare the state-of-the-art computer vision accuracy with human accuracy. We conclude with lessons learned in the 5 years of the challenge, and propose future directions and improvements.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“A major limitation of the DL approach is the need for a large volume of training data that captures the full breadth of inputs on which the model is likely to be subsequently used.”
From Federated learning improves site performance in multicenter deep learning without data sharing (2021) · cites this paper as [13]
In the citing paper
“categories in the ImageNet-S dataset show a tree-like structure as they are extracted from the Word-Tree [21].”
From Large-Scale Unsupervised Semantic Segmentation (2023) · cites this paper as [21]
In the citing paper
“Several applied ML fields, such as engineering applications and modeling contests, have adopted practices such as standardized train-test splits, evaluation metrics, and modeling tasks to ensure the validity of the modeling and evaluation process.95,96”
From Leakage and the reproducibility crisis in machine-learning-based science (2023) · cites this paper as [95]
In the citing paper
“a class of artificial neural networks that has been a dominant method in computer vision tasks since the astonishing results were shared on the object recognition competition known as the ImageNet Large Scale Visual Recognition Competition (ILSVRC) in 2012 [2, 3].”
From Convolutional neural networks: an overview and application in radiology (2018) · cites this paper as [2]
In the citing paper
“the smallest model (ViT-B/32) shows limited improvements when pretraining on JFT-300M [40] vs. the ImageNet Large Scale Visual Recognition Challenge 2012 dataset [12, 37]”
From Do Vision Transformers See Like Convolutional Neural Networks? (2021) · cites this paper as [37]
25 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148 · cited 1×
“3 – – – University of Oxford Karen Simonyan, Andrew Zisserman (Simonyan and Zisserman 2014) XYZ 11.”
BackgroundImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · cited 27×
“1 8 O lg a R u ssa k o v sk y * et a l. ILSVRC 2013 Codename CLS LOC DET Insitutions Contributors and references Adobe 15.2 - - Adobe†, University of Illinois at Urbana-Champaign‡ Hailin Jin†, Zhe Lin†, Jianchao Yang†, Tom Paine‡ (Krizhevsky et al., 2012) AHoward 13.6 - - Andrew Howard Consulting Andrew Howard BUPT 25…”
BackgroundMethodInfluentialImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Self-citationDistinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589 · cited 5×
“Section 5.1 documents the progress, starting from coded SIFT features and evolving to large-scale convolutional neural networks dominating at all three tasks of image clas-sification, single-object localization, and object detection.”
MethodInfluentialGoing deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568 · cited 1×
“0 - - Brno University of Technology Martin Kolář, Michal Hradǐs, Pavel Svoboda (Krizhevsky et al., 2012; Mikolov et al., 2013; Jia, 2013)”
BackgroundThe pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839 · cited 5×
“The network architectures were chosen using the visualization technique of (Zeiler and Fergus, 2013), and they were trained on the GPU following (Zeiler et al., 2011) using the dropout technique (Krizhevsky et al., 2012).”
BackgroundMethodInfluentialWordNet: a lexical database for English
Miller, G. A. (1995) · Communications of the ACM · doi:10.1145/219717.219748 · Cited by 14,015 · cited 1×
“By us-ing WordNet as a backbone (Miller, 1995), ImageNet already takes care of disambiguating word meanings and of combining together synonyms into the same object category.”
BackgroundCaffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Vision meets robotics: The KITTI dataset
Geiger, A., Lenz, P., Stiller, C., & Urtasun, R. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913491297 · Cited by 9,913 · cited 2×
“…the aforementioned PASCAL VOC (Everingham et al., 2012), Labeled Faces in the Wild (Huang et al., 2007) for unconstrained face recognition, Reconstruction meets Recognition (Urtasun et al., 2014) for 3D reconstruction and KITTI (Geiger et al., 2013) for computer vision in autonomous driving.”
BackgroundObject Detection with Discriminatively Trained Part-Based Models
Felzenszwalb, P. F., Girshick, R. B., McAllester, D., & Ramanan, D. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.167 · Cited by 9,853 · cited 11×
“1 8 O lg a R u ssa k o v sk y * et a l. ILSVRC 2013 Codename CLS LOC DET Insitutions Contributors and references Adobe 15.2 - - Adobe†, University of Illinois at Urbana-Champaign‡ Hailin Jin†, Zhe Lin†, Jianchao Yang†, Tom Paine‡ (Krizhevsky et al., 2012) AHoward 13.6 - - Andrew Howard Consulting Andrew Howard BUPT 25…”
BackgroundMethodInfluentialBeyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories
Lazebnik, S., Schmid, C., & Ponce, J. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.68 · Cited by 7,916 · cited 3×
“…by dense sampling and vector quantization of several color SIFT features (van de Sande et al., 2010), pooling with spatial pyramid matching (Lazebnik et al., 2006), and classifying with a histogram intersection kernel SVM (Maji and Malik, 2009) trained on a GPU (van de Sande et al., 2011a).”
BackgroundMethodThe Pascal Visual Object Classes Challenge: A Retrospective
Everingham, M., Eslami, S. M. A., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-014-0733-5 · Cited by 7,139
Improving neural networks by preventing co-adaptation of feature detectors
Hinton, G. E., Srivastava, N., Krizhevsky, A., Sutskever, I., & Salakhutdinov, R. R. (2012) · arXiv · doi:10.48550/arxiv.1207.0580 · Cited by 6,382 · cited 1×
“They trained a large, deep convolutional neural network on RGB values, with 60 million parameters using an efficient GPU implementation and a novel hidden-unit dropout trick (Krizhevsky et al., 2012; Hinton et al., 2012).”
MethodModeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope
Oliva, A., & Torralba, A. (2001) · International Journal of Computer Vision · doi:10.1023/a:1011139631724 · Cited by 6,319 · cited 1×
“sets in WordNet (Miller, 1995) as queries. However, since this data has not been manually veried, there are many errors, making it less suitable for algorithm evaluation. Datasets such as 15 Scenes (Oliva and Torralba, 2001; Fei-Fei and Perona, 2005; Lazebnik et al., 2006) or recent Places (Zhou et al., 2014) provide…”
MethodSelective Search for Object Recognition
Uijlings, J. R. R., van de Sande, K. E. A., Gevers, T., & Smeulders, A. W. M. (2013) · International Journal of Computer Vision · doi:10.1007/s11263-013-0620-5 · Cited by 5,980
Face Description with Local Binary Patterns: Application to Face Recognition
Ahonen, T., Hadid, A., & Pietikainen, M. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.244 · Cited by 5,584
Contour Detection and Hierarchical Image Segmentation
Arbeláez, P., Maire, M., Fowlkes, C., & Malik, J. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.161 · Cited by 5,454
Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments
Huang, G. B., Mattar, M., Berg, T. L., & Miller, E. G. (2008) · HAL · Cited by 4,822
LabelMe: A Database and Web-Based Tool for Image Annotation
Russell, B. C., Torralba, A., Murphy, K. P., & Freeman, W. T. (2008) · International Journal of Computer Vision · doi:10.1007/s11263-007-0090-8 · Cited by 4,210 · cited 1×
“LabelMe (Russell et al., 2007) contains general photographs with multiple objects per image.”
BackgroundDeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition
Donahue, J., Jia, Y., Vinyals, O., Hoffman, J., Zhang, N., Tzeng, E., & Darrell, T. (2013) · arXiv · doi:10.48550/arxiv.1310.1531 · Cited by 4,019
Multi-column deep neural networks for image classification
Ciresan, D., Meier, U., & Schmidhuber, J. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248110 · Cited by 3,720
A Bayesian Hierarchical Model for Learning Natural Scene Categories
Li, F.-F., & Perona, P. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.16 · Cited by 3,613
Self-citationSpeed of processing in the human visual system
Thorpe, S., Fize, D., & Marlot, C. (1996) · Nature · doi:10.1038/381520a0 · Cited by 3,538
Harel, J., Koch, C., & Perona, P. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0073 · Cited by 3,439 · cited 1×
“4 - ◦ - - Fengjun Lv Consulting Fengjun Lv (Krizhevsky et al., 2012; Harel et al., 2007)”
BackgroundReturn of the Devil in the Details: Delving Deep into Convolutional Nets
Chatfield, K., Simonyan, K., Vedaldi, A., & Zisserman, A. (2014) · Proceedings of the British Machine Vision Conference 2014 · doi:10.5244/c.28.6 · Cited by 3,335
SUN database: Large-scale scene recognition from abbey to zoo
Xiao, J., Hays, J., Ehinger, K. A., Oliva, A., & Torralba, A. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539970 · Cited by 3,283 · cited 2×
“The SUN2012 (Xiao et al., 2010) dataset contains 16,873 manually cleaned up and fully annotated images suitable for object detection.”
MethodDeViSE: A Deep Visual-Semantic Embedding Model
Frome, A., Corrado, G. S., Shlens, J., Bengio, S., Dean, J., Ranzato, M., & Mikolov, T. (2013) · neural information processing systems · Cited by 3,134
Locality-constrained Linear Coding for image classification
Wang, J., Yang, J., Yu, K., Lv, F., Huang, T., & Gong, Y. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540018 · Cited by 3,100 · cited 1×
“2006) features with two non-linear coding representations (Zhou et al. 2010; Wang et al. 2010) and a stochastic SVM.”
MethodSpatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10578-9_23 · Cited by 3,034 · cited 1×
“of China∓ Kaiming He†, Xiangyu Zhang‡, Shaoqing Ren∓, Jian Sun†(He et al., 2014)”
Linear spatial pyramid matching using sparse coding for image classification
Yang, J., Yu, K., Gong, Y., & Huang, T. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206757 · Cited by 2,828 · cited 1×
“5 - ◦ - - University of Isfahan Fatemeh Shafizadegan, Elham Shabaninia (Yang et al., 2009)”
BackgroundOverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks
Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R., & LeCun, Y. (2013) · arXiv · doi:10.48550/arxiv.1312.6229 · Cited by 2,680 · cited 9×
“1 8 O lg a R u ssa k o v sk y * et a l. ILSVRC 2013 Codename CLS LOC DET Insitutions Contributors and references Adobe 15.2 - - Adobe†, University of Illinois at Urbana-Champaign‡ Hailin Jin†, Zhe Lin†, Jianchao Yang†, Tom Paine‡ (Krizhevsky et al., 2012) AHoward 13.6 - - Andrew Howard Consulting Andrew Howard BUPT 25…”
BackgroundMethodInfluentialImproving the Fisher Kernel for Large-Scale Image Classification
Perronnin, F., Sánchez, J., & Mensink, T. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15561-1_11 · Cited by 2,588 · cited 9×
“Im a g eN et L a rg e S ca le V isu a l R eco g n itio n C h a llen g e 1 7 ILSVRC 2010 Codename CLS LOC Insitutions Contributors and references Hminmax 54.4 Massachusetts Institute of Technology Jim Mutch, Sharat Chikkerur, Hristo Paskov, Ruslan Salakhutdinov, Stan Bileschi, Hueihan Jhuang IBM 70.1 IBM research†, Geo…”
BackgroundMethodInfluential(2014) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 2,534
Fei-Fei, L., Fergus, R., & Perona, P. (2005) · 2004 Conference on Computer Vision and Pattern Recognition Workshop · doi:10.1109/cvpr.2004.383 · Cited by 2,502
Self-citationTorralba, A., & Efros, A. A. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995347 · Cited by 2,440 · cited 1×
“reconstruction and KITTI (Geiger et al., 2013) for computer vision in autonomous driving. These datasets along with ILSVRC help benchmark progress in dierent areas of computer vision. Works such as (Torralba and Efros, 2011) emphasize the importance of examining the bias inherent in any standardized dataset. 1.2 Paper…”
BackgroundInfluentialInternational Journal of Computer Vision
(2013) · International Journal of Computer Vision · doi:10.1007/11263.1573-1405 · Cited by 2,340
(2007) · CaltechAUTHORS (California Institute of Technology) · Cited by 2,274
(2013) · Cited by 2,056
80 Million Tiny Images: A Large Data Set for Nonparametric Object and Scene Recognition
Torralba, A., Fergus, R., & Freeman, W. T. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.128 · Cited by 1,921
Evaluating Color Descriptors for Object and Scene Recognition
van de Sande, K. E. A., Gevers, T., & Snoek, C. G. M. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.154 · Cited by 1,783
Online Passive-Aggressive Algorithms
Crammer, K., Dekel, O., Keshet, J., Shalev‐Shwartz, S., & Singer, Y. (2003) · Cited by 1,665
Fisher Kernels on Visual Vocabularies for Image Categorization
Perronnin, F., & Dance, C. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383266 · Cited by 1,641 · cited 1×
“The honorable mention XRCE team (Perronnin et al., 2010) used an improved Fisher vector representation (Perronnin and Dance, 2007) along with PCA dimensionality reduction and data compression followed by a linear SVM. Fisher vector-based methods have evolved over five years of the challenge and…”
MethodGoing Deeper with Convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2014) · arXiv · doi:10.48550/arxiv.1409.4842 · Cited by 1,461 · cited 1×
“9 Google Christian Szegedy, Wei Liu, Yangqing Jia, Pierre Sermanet, Scott Reed, Drago Anguelov, Dumitru Erhan, Andrew Rabinovich (Szegedy et al., 2014)”
BackgroundThree things everyone should know to improve object retrieval
Arandjelovic, R., & Zisserman, A. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248018 · Cited by 1,383 · cited 2×
“…Thomas Mensink†‡, Jakob Verbeek†, Florent Perronnin‡, Gabriela Csurka‡ (Mensink et al., 2012) VGG 27.0 50.0 University of Oxford Karen Simonyan, Yusuf Aytar, Andrea Vedaldi, Andrew Zisserman (Arandjelovic and Zisserman, 2012; Sanchez et al., 2012) SuperVision 16.4 34.2 University of Toronto…”
BackgroundMethodInfluentialAdaptive deconvolutional networks for mid and high level feature learning
Zeiler, M. D., Taylor, G. W., & Fergus, R. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126474 · Cited by 1,217 · cited 1×
“The network architectures were chosen using the visualization technique of (Zeiler and Fergus, 2013), and they were trained on the GPU following (Zeiler et al., 2011) using the dropout technique (Krizhevsky et al., 2012).”
MethodMeasuring the Objectness of Image Windows
Alexe, B., Deselaers, T., & Ferrari, V. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.28 · Cited by 1,186 · cited 1×
“To quantify clutter we employ the objectness measure of (Alexe et al., 2012), which is a class-generic object detector evaluating how likely a window in the image contains a coherent object (of any class) as opposed to background (sky, water, grass).”
MethodGet another label? improving data quality and data mining using multiple, noisy labelers
Sheng, V. S., Provost, F., & Ipeirotis, P. G. (2008) · Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1401890.1401965 · Cited by 1,165 · cited 1×
“Works such as (Welinder et al., 2010; Sheng et al., 2008; Vittayakorn and Hays, 2011) describe quality control mechanisms for this marketplace.”
BackgroundMultiscale Combinatorial Grouping
Arbelaez, P., Pont-Tuset, J., Barron, J., Marques, F., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.49 · Cited by 1,155
(2014) · arXiv (Cornell University) · Cited by 942
The multidimensional wisdom of crowds
Welinder, P., Branson, S., Belongie, S., & Perona, P. (2011) · CaltechAUTHORS (California Institute of Technology) · Cited by 808
Segmentation as selective search for object recognition
van de Sande, K. E. A., Uijlings, J. R. R., Gevers, T., & Smeulders, A. W. M. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126456 · Cited by 739
Decomposing a scene into geometric and semantically consistent regions
Gould, S., Fulton, R., & Koller, D. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459211 · Cited by 672 · cited 3×
“, but it is not available for free. Several datasets provide pixel-level segmentations: for example, MSRC dataset (Criminisi, 2004) with 591 images and 23 object classes, Stanford Background Dataset (Gould et al., 2009) with 715 images and 8 classes, and the Berkeley Segmentation dataset (Arbelaez et al., 2011) with 5…”
BackgroundMethodInfluentialJoint Deep Learning for Pedestrian Detection
Ouyang, W., & Wang, X. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.257 · Cited by 660 · cited 1×
“7 The Chinese University of Hong Kong Wanli Ouyang, Ping Luo, Xingyu Zeng, Shi Qiu, Yonglong Tian, Hongsheng Li, Shuo Yang, Zhe Wang, Yuanjun Xiong, Chen Qian, Zhenyao Zhu, Ruohui Wang, Chen-Change Loy, Xiaogang Wang, Xiaoou Tang (Ouyang et al., 2014; Ouyang and Wang, 2013) DeepCNet 17.”
BackgroundDenseNet: Implementing Efficient ConvNet Descriptor Pyramids
Iandola, F., Moskewicz, M. W., Karayev, S., Girshick, R., Darrell, T. J., & Keutzer, K. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1404.1869 · Cited by 629 · cited 1×
“3 - - Toyota Technological Institute at Chicago†, Ecole Centrale Paris‡ George Papandreou†, Iasonas Kokkinos‡(Papandreou, 2014; Papandreou et al., 2014; Jojic et al., 2003; Krizhevsky et al., 2012; Sermanet et al., 2013; Dubout and Fleuret, 2012; Iandola et al., 2014)”
Utility data annotation with Amazon Mechanical Turk
Sorokin, A., & Forsyth, D. (2008) · 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2008.4562953 · Cited by 616 · cited 1×
“ILSVRC makes extensive use of Amazon Mechanical Turk to obtain accurate annotations (Sorokin and Forsyth, 2008).”
MethodSegmentation Propagation in ImageNet
Kuettel, D., Guillaumin, M., & Ferrari, V. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33786-4_34 · Cited by 597 · cited 1×
“Additionally, several influential lines of research have emerged, such as large-scale weakly supervised localization work of (Kuettel et al., 2012) which was awarded the best paper award in ECCV 2012 and large-scale zero-shot learning, e.g., (Frome et al., 2013).”
BackgroundVisualizing and Understanding Convolutional Networks
Zeiler, M. D., & Fergus, R. (2013) · arXiv · doi:10.48550/arxiv.1311.2901 · Cited by 522 · cited 5×
“The network architectures were chosen using the visualization technique of (Zeiler and Fergus, 2013), and they were trained on the GPU following (Zeiler et al., 2011) using the dropout technique (Krizhevsky et al., 2012).”
BackgroundMethodInfluentialDiagnosing Error in Object Detectors
Hoiem, D., Chodpathumwan, Y., & Dai, Q. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33712-3_25 · Cited by 520 · cited 1×
“As described in (Hoiem et al., 2012), smaller objects tend to be significantly more difficult to local-ImageNet ize.”
BackgroundImage Classification Using Super-Vector Coding of Local Image Descriptors
Zhou, X., Yu, K., Zhang, T., & Huang, T. S. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15555-0_11 · Cited by 499 · cited 2×
“linear coding representations (Zhou et al., 2010; Wang et al., 2010) and a stochastic SVM.”
BackgroundMethodVondrick, C., Patterson, D., & Ramanan, D. (2013) · International Journal of Computer Vision · doi:10.1007/s11263-012-0564-1 · Cited by 448 · cited 1×
“(Vondrick et al., 2012) provides a detailed overview of crowdsourcing video annotation.”
BackgroundLarge-scale image classification: Fast feature extraction and SVM training
Lin, Y., Lv, F., Zhu, S., Yang, M., Cour, T., Yu, K., Cao, L., & Huang, T. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995477 · Cited by 382 · cited 5×
“Im a g eN et L a rg e S ca le V isu a l R eco g n itio n C h a llen g e 1 7 ILSVRC 2010 Codename CLS LOC Insitutions Contributors and references Hminmax 54.4 Massachusetts Institute of Technology Jim Mutch, Sharat Chikkerur, Hristo Paskov, Ruslan Salakhutdinov, Stan Bileschi, Hueihan Jhuang IBM 70.1 IBM research†, Geo…”
MethodInfluentialNonparametric Scene Parsing via Label Transfer
Liu, C., Yuen, J., & Torralba, A. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.131 · Cited by 368 · cited 1×
“ame each object. The SUN2012 (Xiao et al., 2010) dataset contains 16,873 manually cleaned up and fully annotated images more suitable for standard object detection training and evaluation. SIFT Flow (Liu et al., 2011) contains 2,688 images labeled using the LabelMe system. The LotusHill dataset (Yao et al., 2007) cont…”
MethodSome Improvements on Deep Convolutional Neural Network Based Image Classification
Howard, A. G. (2013) · arXiv · doi:10.48550/arxiv.1312.5402 · Cited by 356 · cited 5×
“, 2014a) incorporating improvements of (Howard, 2014).”
BackgroundMethodInfluentialCrowdsourcing annotations for visual object detection
Su, H., Deng, J., & Fei-Fei, L. (2012) · National Conference on Artificial Intelligence · Cited by 328
Self-citationRegionlets for Generic Object Detection
Wang, X., Yang, M., Zhu, S., & Lin, Y. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.10 · Cited by 316 · cited 2×
“…Kuiyuan Yang‡, Chuntao Hong‡, Zheng Zhang‡ (Wang et al., 2014) NEC - - 19.6 NEC Labs America†, University of Missouri ‡ Xiaoyu Wang†, Miao Sun‡, Tianbao Yang†, Yuanqing Lin†, Tony X. Han‡, Shenghuo Zhu† (Wang et al., 2013) NUS 13.0 National University of Singapore Min Lin*, Qiang Chen*, Jian…”
InfluentialFast, Accurate Detection of 100,000 Object Classes on a Single Machine
Dean, T., Ruzon, M. A., Segal, M., Shlens, J., Vijayanarasimhan, S., & Yagnik, J. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.237 · Cited by 305 · cited 2×
“Best paper awards at top vision conferences in 2013 were awarded to large-scale recognition methods: at CVPR 2013 to ”Fast, Accurate Detection of 100,000 Object Classes on a Single Machine” (Dean et al., 2013) and at ICCV 2013 to ”From Large Scale Image Cate-gorization to Entry-Level Categories” (Ordonez et al., 2013).”
MethodObject detection using a max-margin Hough transform
Maji, S., & Malik, J. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206693 · Cited by 297 · cited 6×
“The winning entry from NEC team (Lin et al., 2011) used SIFT (Lowe, 2004) and LBP (Ahonen et al., 2006) features with two non-linear coding representations (Zhou et al., 2010; Wang et al., 2010) and a stochastic SVM.”
MethodInfluentialCombining randomization and discrimination for fine-grained image categorization
Yao, B., Khosla, A., & Fei-Fei, L. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995368 · Cited by 288
Self-citationMetric Learning for Large Scale Image Classification: Generalizing to New Classes at Near-Zero Cost
Mensink, T., Verbeek, J., Perronnin, F., & Csurka, G. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33709-3_35 · Cited by 281 · cited 3×
“…Tatsuya Harada†‡, Yasuo Kuniyoshi† (Harada and Kuniyoshi, 2012) LEAR 34.5 - LEAR INRIA Grenoble†, TVPA Xerox Research Centre Europe‡ Thomas Mensink†‡, Jakob Verbeek†, Florent Perronnin‡, Gabriela Csurka‡ (Mensink et al., 2012) VGG 27.0 50.0 University of Oxford Karen Simonyan, Yusuf Aytar,…”
BackgroundInfluentialPrime Object Proposals with Randomized Prim's Algorithm
Manen, S., Guillaumin, M., & Gool, L. V. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.315 · Cited by 278 · cited 1×
“7 The Third Research Institute of the Ministry of Public Security Jie Shao, Xiaoteng Zhang, JianYing Zhou, Jian Wang, Jian Chen, Yanfeng Shang, Wenfei Wang, Lin Mei, Chuanping Hu (Girshick et al. 2014; Manen et al. 2013; Howard 2014)”
BackgroundHigh-dimensional signature compression for large-scale image classification
Sanchez, J., & Perronnin, F. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995504 · Cited by 272 · cited 7×
“Im a g eN et L a rg e S ca le V isu a l R eco g n itio n C h a llen g e 1 7 ILSVRC 2010 Codename CLS LOC Insitutions Contributors and references Hminmax 54.4 Massachusetts Institute of Technology Jim Mutch, Sharat Chikkerur, Hristo Paskov, Ruslan Salakhutdinov, Stan Bileschi, Hueihan Jhuang IBM 70.1 IBM research†, Geo…”
BackgroundMethodInfluentialEpitomic analysis of appearance and shape
Jojic, Frey, & Kannan (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238311 · Cited by 218 · cited 1×
“3 - - Toyota Technological Institute at Chicago†, Ecole Centrale Paris‡ George Papandreou†, Iasonas Kokkinos‡(Papandreou, 2014; Papandreou et al., 2014; Jojic et al., 2003; Krizhevsky et al., 2012; Sermanet et al., 2013; Dubout and Fleuret, 2012; Iandola et al., 2014)”
BackgroundDeep Fisher Networks for Large-Scale Image Classification
Simonyan, K., Vedaldi, A., & Zisserman, A. (2013) · Oxford University Research Archive (ORA) (University of Oxford) · Cited by 207
Deep Learning using Support Vector MachinesPreprint
Tang, Y. (2013) · arXiv (Cornell University) · Cited by 202
Bell (2013) · doi:10.1145/2461912.2462002 · Cited by 200 · cited 1×
“images annotated with object boundaries. OpenSurfaces segments surfaces from consumer photographs and annotates them with surface properties, including material, texture, and contextual information (Bell et al., 2013) . The closest to ILSVRC is the PASCAL VOC dataset (Everingham et al., 2010, 2014), which provides a s…”
BackgroundYao, B., Yang, X., & Zhu, S.-C. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-74198-5_14 · Cited by 188 · cited 1×
“The LotusHill dataset (Yao et al., 2007) contains very detailed annotations of objects in 636,748 images and video frames, but it is not available for free.”
BackgroundMulti-attribute spaces: Calibration for attribute fusion and similarity search
Scheirer, W. J., Kumar, N., Belhumeur, P. N., & Boult, T. E. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248021 · Cited by 169
Scalable multi-label annotation
Deng, J., Russakovsky, O., Krause, J., Bernstein, M. S., Berg, A., & Fei-Fei, L. (2014) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2557011 · Cited by 152
Self-citationExact Acceleration of Linear Object Detectors
Dubout, C., & Fleuret, F. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33712-3_22 · Cited by 131 · cited 1×
“3 - - Toyota Technological Institute at Chicago†, Ecole Centrale Paris‡ George Papandreou†, Iasonas Kokkinos‡(Papandreou, 2014; Papandreou et al., 2014; Jojic et al., 2003; Krizhevsky et al., 2012; Sermanet et al., 2013; Dubout and Fleuret, 2012; Iandola et al., 2014)”
BackgroundSparse arrays of signatures for online character recognitionPreprint
Graham, B. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1308.0371 · Cited by 131 · cited 1×
“5 - ◦ - - University of Warwick Ben Graham (Graham, 2013; Schmidhuber, 2012)”
DeepID-Net: multi-stage and deformable deep convolutional neural networks for object detection
Ouyang, W., Luo, P., Zeng, X., Qiu, S., Tian, Y., Li, H., Yang, S., Wang, Z., Xiong, Y., Qian, C., et al. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1409.3505 · Cited by 126 · cited 1×
“7 The Chinese University of Hong Kong Wanli Ouyang, Ping Luo, Xingyu Zeng, Shi Qiu, Yonglong Tian, Hongsheng Li, Shuo Yang, Zhe Wang, Yuanjun Xiong, Chen Qian, Zhenyao Zhu, Ruohui Wang, Chen-Change Loy, Xiaogang Wang, Xiaoou Tang (Ouyang et al. 2014; Ouyang and Wang 2013) DeepCNet 17.”
BackgroundModeling the spatial layout of images beyond spatial pyramids
Sánchez, J., Perronnin, F., & de Campos, T. E. (2012) · Pattern Recognition Letters · doi:10.1016/j.patrec.2012.07.019 · Cited by 120 · cited 3×
“…Jakob Verbeek†, Florent Perronnin‡, Gabriela Csurka‡ (Mensink et al., 2012) VGG 27.0 50.0 University of Oxford Karen Simonyan, Yusuf Aytar, Andrea Vedaldi, Andrew Zisserman (Arandjelovic and Zisserman, 2012; Sanchez et al., 2012) SuperVision 16.4 34.2 University of Toronto Alex Krizhevsky,…”
BackgroundMethodInfluentialContextualizing Object Detection and Classification
Chen, Q., Song, Z., Dong, J., Huang, Z., Hua, Y., & Yan, S. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2343217 · Cited by 101 · cited 2×
“2 – National University of Singapore†, IBM Research Australia‡ Jian Dong†, Yunchao Wei†, Min Lin†, Qiang Chen‡, Wei Xia†, Shuicheng Yan†(Lin et al. 2014a; Chen et al. 2014) NUS-BST 9.”
Self-citationTowards good practice in large-scale learning for image classification
Perronnin, F., Akata, Z., Harchaoui, Z., & Schmid, C. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248090 · Cited by 101 · cited 3×
“…Sande, Amir Habibian, Cees G. M. Snoek (Sanchez and Perronnin, 2011; Scheirer et al., 2012) XRCE 27.1 - Xerox Research Centre Europe†, LEAR INRIA ‡ Florent Perronnin†, Zeynep Akata†‡, Zaid Harchaoui‡, Cordelia Schmid‡ (Perronnin et al., 2012) Table 5 Teams participating in ILSVRC2010-2012,…”
BackgroundInfluentialFrom Large Scale Image Categorization to Entry-Level Categories
Ordonez, V., Deng, J., Choi, Y., Berg, A. C., & Berg, T. L. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.344 · Cited by 97 · cited 2×
“Best paper awards at top vision conferences in 2013 were awarded to large-scale recognition methods: at CVPR 2013 to ”Fast, Accurate Detection of 100,000 Object Classes on a Single Machine” (Dean et al., 2013) and at ICCV 2013 to ”From Large Scale Image Cate-gorization to Entry-Level Categories” (Ordonez et al., 2013).”
MethodSelf-citationEmpowering Visual Categorization With the GPU
van de Sande, K. E. A., Gevers, T., & Snoek, C. G. M. (2011) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2010.2091400 · Cited by 91 · cited 4×
“…by dense sampling and vector quantization of several color SIFT features (van de Sande et al., 2010), pooling with spatial pyramid matching (Lazebnik et al., 2006), and classifying with a histogram intersection kernel SVM (Maji and Malik, 2009) trained on a GPU (van de Sande et al., 2011a).”
MethodInfluentialDetecting Avocados to Zucchinis: What Have We Done, and Where Are We Going?
Russakovsky, O., Deng, J., Huang, Z., Berg, A. C., & Fei-Fei, L. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.258 · Cited by 82
Self-citationVan De Sande, K. E. A., Snoek, C. G. M., & Smeulders, A. W. M. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.304 · Cited by 55 · cited 2×
“…Euvision Technologies Koen E. A. van de Sande, Daniel H. F. Fontijne, Cees G. M. Snoek, Harro M. G. Stokman, Arnold W. M. Smeulders (van de Sande et al., 2014) VGG 15.2 46.4 - Visual Geometry Group, University of Oxford Karen Simonyan, Andrea Vedaldi, Andrew Zisserman (Simonyan et al.,…”
BackgroundMethodInfluentialCloudCV: Large-Scale Distributed Computer Vision as a Cloud Service
Agrawal, H., Mathialagan, C. S., Goyal, Y., Chavali, N., Banik, P., Mohapatra, A., Osman, A., & Batra, D. (2015) · Mobile Cloud Visual Media Computing · doi:10.1007/978-3-319-24702-1_11 · Cited by 38
Quality Assessment for Crowdsourced Object Annotations
Vittayakorn, S., & Hays, J. H. (2011) · British Machine Vision Conference (BMVC) · doi:10.5244/c.25.109 · Cited by 29 · cited 1×
“Works such as (Welinder et al., 2010; Sheng et al., 2008; Vittayakorn and Hays, 2011) describe quality control mechanisms for this marketplace.”
BackgroundESP: Labeling Images with a Computer Game.
von Ahn, L., & Dabbish, L. (2005) · Cited by 28
Modeling Image Patches with a Generic Dictionary of Mini-epitomes
Papandreou, G., Chen, L.-C., & Yuille, A. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.264 · Cited by 21 · cited 1×
“3 - - Toyota Technological Institute at Chicago†, Ecole Centrale Paris‡ George Papandreou†, Iasonas Kokkinos‡(Papandreou, 2014; Papandreou et al., 2014; Jojic et al., 2003; Krizhevsky et al., 2012; Sermanet et al., 2013; Dubout and Fleuret, 2012; Iandola et al., 2014)”
BackgroundMinerva: A Scalable and Highly Efficient Training Platform for Deep Learning
Wang, M., Xiao, T., Li, J., Zhang, J., Hong, C., & Zhang, Z. (2014) · neural information processing systems · Cited by 18
Deep Epitomic Convolutional Neural NetworksPreprint
Papandreou, G. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1406.2732 · Cited by 9 · cited 1×
“3 - - Toyota Technological Institute at Chicago†, Ecole Centrale Paris‡ George Papandreou†, Iasonas Kokkinos‡(Papandreou, 2014; Papandreou et al., 2014; Jojic et al., 2003; Krizhevsky et al., 2012; Sermanet et al., 2013; Dubout and Fleuret, 2012; Iandola et al., 2014)”
BackgroundGraphical Gaussian Vector for Image Categorization
Harada, T., & Kuniyoshi, Y. (2012) · Cited by 6
Hard negative classes for multiple object detection
Kanezaki, A., Inaba, S., Ushiku, Y., Yamashita, Y., Muraoka, H., Kuniyoshi, Y., & Harada, T. (2014) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2014.6907300 · Cited by 2 · cited 1×
“4 The University of Tokyo†, IIT Guwahati‡ Senthil Purushwalkam†‡, Yuichiro Tsuchiya†, Atsushi Kanehira†, Asako Kanezaki†, Tatsuya Harada†(Kanezaki et al., 2014; Girshick et al., 2013) MPG UT - - - - - 26.”
Research works printed but not linked: 4
- Criminisi, A. (2004). Microsoft Research Cambridge (MSRC) object recognition image database (version 2.0). http://research.microsoft.com/vision/cambridge/recognition .
- Everingham, M., Gool, L. V., Williams, C., Winn, J., & Zisserman, A. (2005–2012). PASCAL Visual Object Classes Challenge (VOC). http://www.pascal-network.org/challenges/VOC/voc2012/workshop/index.html .
- Girshick, R. B., Donahue, J., Darrell, T., & Malik, J. (2013). Rich feature hierarchies for accurate object detection and semantic segmentation (v4). CoRR.
- Khosla, A., Jayadevaprakash, N., Yao, B., & Fei-Fei, L. (2011). Novel dataset for fine-grained image categorization. In First workshop on fine-grained visual categorization, CVPR.
Cited by
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
“, the shared convolutional layers) are initialized by pre-training a model for ImageNet classification [36], as is standard practice [5].”
MethodFaster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
“, the shared convolutional layers) are initialized by pre-training a model for ImageNet classification [36], as is standard practice [5].”
MethodYou Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
“We pretrain our convolutional layers on the ImageNet 1000-class competition dataset [29].”
MethodDensely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Metadata
- Authors
- Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., Berg, A. C., & Fei-Fei, L.
- Affiliations
- Stanford University (US)
- University of Michigan (US)
- Massachusetts Institute of Technology (US)
- University of North Carolina at Chapel Hill (US)
- Corresponding author
- Russakovsky, Olga
- ORCID
- Venue
- International Journal of Computer Vision
- Published
- 2015-04-11
- Volume
- 115
- Issue
- 3
- Pages
- 211-252
- ISSN
- 0920-5691 (ISSN-L)
- 1573-1405
- OpenAlex
- W2117539524
- Semantic Scholar
- e74f9b7f8eec6ba4704c206b93bc8079af3da4bd
- Cited by
- 39,380
- References
- 103
- Citations by year
- 2026: 1548 · 2025: 2934 · 2024: 3932 · 2023: 4479 · 2022: 4660 · 2021: 5598 · 2020: 4743 · 2019: 4473 · 2018: 3318 · 2017: 2089 · 2016: 1111 · 2015: 436
- FWCI
- 1997.75
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- International Journal of Computer Vision (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- ImageNet, object category classification, object detection, benchmark dataset, ground truth annotation, image classification, computer vision benchmarks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.