Object class detection: A survey
The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Abstract
Object class detection, also known as category-level object detection, has become one of the most focused areas in computer vision in the new century. This article attempts to provide a comprehensive survey of the recent technical achievements in this area of research. More than 270 major publications are included in this survey covering different aspects of the research, which include: (i) problem description: key tasks and challenges; (ii) core techniques: appearance modeling, localization strategies, and supervised classification methods; (iii) evaluation issues: approaches, metrics, standard datasets, and state-of-the-art results; and (iv) new development: particularly new approaches and applications motivated by the recent boom of social images. Finally, in retrospect of what has been achieved so far, the survey also discusses what the future may hold for object class detection research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
Rapid object detection using a boosted cascade of simple features
Viola, P., & Jones, M. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990517 · Cited by 18,300
Multiresolution gray-scale and rotation invariant texture classification with local binary patterns
Ojala, T., Pietikainen, M., & Maenpaa, T. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1017623 · Cited by 15,398
SURF: Speeded Up Robust Features
Bay, H., Tuytelaars, T., & Van Gool, L. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744023_32 · Cited by 14,955
Speeded-Up Robust Features (SURF)
Bay, H., Ess, A., Tuytelaars, T., & Van Gool, L. (2008) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2007.09.014 · Cited by 13,557
Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories
Lazebnik, S., Schmid, C., & Ponce, J. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.68 · Cited by 7,916
A performance evaluation of local descriptors
Mikolajczyk, K., & Schmid, C. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.188 · Cited by 6,723 · cited 3×
“The idea underlying PCA-SIFT is to use Principal Component Analysis (PCA), a dimensionality reduction technique, to make the descriptor more compact and hence more ef.cient for matching, while GLOH extends SIFT by computing the descriptor on a log-polar location grid.”
MethodVideo Google: a text retrieval approach to object matching in videos
Sivic, & Zisserman (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238663 · Cited by 6,367
Shape matching and object recognition using shape contexts
Belongie, S., Malik, J., & Puzicha, J. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.993558 · Cited by 6,306 · cited 3×
“2007b, 2005], or shape features such as shape context [Belongie et al. 2002] or shapelets [Sabzmeydani and Mori 2007].”
BackgroundMethodGrabCut: Interactive foreground extraction using iterated graph cuts
Rother, C., Kolmogorov, V., & Blake, A. (2004) · ACM Transactions on Graphics · doi:10.1145/1015706.1015720 · Cited by 5,703
LabelMe: A Database and Web-Based Tool for Image Annotation
Russell, B. C., Torralba, A., Murphy, K. P., & Freeman, W. T. (2008) · International Journal of Computer Vision · doi:10.1007/s11263-007-0090-8 · Cited by 4,210
Hierarchical models of object recognition in cortex
Riesenhuber, M., & Poggio, T. (1999) · Nature Neuroscience · doi:10.1038/14819 · Cited by 3,309 · cited 2×
“Some researchers have pursued along this direction and proposed a family of bio-motivated representations, which commonly follow a theory that accounts for the first 100–200 milliseconds of processing along the feedforward ventral stream in the primate visual cortex [Riesenhuber and Poggio 1999].”
BackgroundPCA-SIFT: a more distinctive representation for local image descriptors
Ke, Y., & Sukthankar, R. (2004) · Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. · doi:10.1109/cvpr.2004.1315206 · Cited by 3,237
Locality-constrained Linear Coding for image classification
Wang, J., Yang, J., Yu, K., Lv, F., Huang, T., & Gong, Y. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540018 · Cited by 3,100 · cited 2×
“… of different objects [Rabinovich et al. 2007] or object parts [Karlinsky et al. 2010] in the same scene, or even the social relations among them [Wang et al. 2010a], which can be captured using the object-graph descriptor [Lee and Grauman 2010], pairwise or high-order potentials in CRF…”
MethodFei-Fei, L., Fergus, R., & Perona, P. (2007) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2005.09.012 · Cited by 2,359
80 Million Tiny Images: A Large Data Set for Nonparametric Object and Scene Recognition
Torralba, A., Fergus, R., & Freeman, W. T. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.128 · Cited by 1,921
Robust Object Recognition with Cortex-Like Mechanisms
Serre, T., Wolf, L., Bileschi, S., Riesenhuber, M., & Poggio, T. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.56 · Cited by 1,667
Jones, J. P., & Palmer, L. A. (1987) · Journal of Neurophysiology · doi:10.1152/jn.1987.58.6.1233 · Cited by 1,658 · cited 2×
“In addition, as they are shown to provide a good model of cortical simple cell receptive fields [Jones and Palmer 1987], Gabor filter banks are widely used in biologically motivated representations [Huang et al.”
BackgroundFast Human Detection Using a Cascade of Histograms of Oriented Gradients
Zhu, Q., Yeh, M.-C., Cheng, K.-T., & Avidan, S. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.119 · Cited by 1,399
Hochstein (2002) · doi:10.1016/s0896-6273(02)01091-7 · Cited by 1,397
The Representation and Matching of Pictorial Structures
Fischler, M. A., & Elschlager, R. A. (1973) · IEEE Transactions on Computers · doi:10.1109/t-c.1973.223602 · Cited by 1,322
Dollar, P., Tu, Z., Perona, P., & Belongie, S. (2009) · Procedings of the British Machine Vision Conference 2009 · doi:10.5244/c.23.91 · Cited by 1,237
The role of context in object recognition
Oliva, A., & Torralba, A. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.09.009 · Cited by 1,063
Sampling Strategies for Bag-of-Features Image Classification
Nowak, E., Jurie, F., & Triggs, B. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744085_38 · Cited by 927
On feature combination for multiclass object classification
Gehler, P., & Nowozin, S. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459169 · Cited by 797 · cited 2×
“2009] mainly use Multiple Kernel Learning (MKL), while boosting has been shown to be even more powerful recently [Gehler and Nowozin 2009].”
MethodSegmentation as selective search for object recognition
van de Sande, K. E. A., Uijlings, J. R. R., Gevers, T., & Smeulders, A. W. M. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126456 · Cited by 739 · cited 1×
“The third way of improving ef.ciency is to reduce the search range using some object-hypothesis-generating approaches, namely to perform a selective search [Van de Sande et al. 2011] instead of an exhaustive search.”
MethodIntegral histogram: a fast way to extract histograms in Cartesian spaces
Porikli, F. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.188 · Cited by 701 · cited 2×
“Besides reducing the search space, the integral image [Viola and Jones 2001] or the integral histogram [Porikli 2005] can be further used to significantly speed up the feature computation over rectangular subwindows, for example, in Lampert et al.”
MethodContext based object categorization: A critical survey
Galleguillos, C., & Belongie, S. (2010) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2010.02.004 · Cited by 351 · cited 2×
“How to efficiently incorporate multisource, multilevel, and even multidomain contextual information is still left to be explored [Galleguillos and Belongie 2010].”
Multi-cue onboard pedestrian detection
Wojek, C., Walk, S., & Schiele, B. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206638 · Cited by 350 · cited 2×
“2006], and improved the performance of onboard pedestrian detection [Wojek et al. 2009].”
BackgroundMethodRecovering Occlusion Boundaries from a Single Image
Hoiem, D., Stein, A. N., Efros, A. A., & Hebert, M. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4408985 · Cited by 206 · cited 12×
“… models, including the Bayesian framework [Alexe et al. 2010; Fei-Fei and Perona 2005; Lin 2009], the MRF [Bray et al. 2006; Kumar et al. 2005, 2010], the Hidden Markov Mode (HMM) [Ji et al. 2010], the CRF [Hoiem et al. 2007a; Levin and Weiss 2006; Rabinovich et al. 2007; Xiang et al. 2010], etc.”
BackgroundMethodInfluentialGrauman, K., & Leibe, B. (2011) · Synthesis Lectures on Artificial Intelligence and Machine Learning · doi:10.2200/s00332ed1v01y201103aim011 · Cited by 126
Object Categorization: Computer and Human Vision Perspectives
(2009) · doi:10.1017/cbo9780511635465 · Cited by 110
Cited by
Deep Learning for Generic Object Detection: A Survey
Liu, L., Ouyang, W., Wang, X., Fieguth, P., Chen, J., Liu, X., & Pietikäinen, M. (2018) · arXiv · doi:10.48550/arxiv.1809.02165 · Cited by 2,965
Deep Learning for Generic Object Detection: A Survey
Liu, L., Ouyang, W., Wang, X., Fieguth, P., Chen, J., Liu, X., & Pietikäinen, M. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-019-01247-4 · Cited by 2,965
“gmentation, (d) Instance level semantic segmentation. 2 Generic Object Detection 2.1 The Problem Generic object detection (i.e., generic object category detection), also called object class detection [302] or object category detection, is defined as follows. Given an image, the goal of generic object detection is to de…”
BackgroundMethodInfluentialA comprehensive review of object detection with deep learning
Kaur, R., & Singh, S. (2023) · Digital Signal Processing · doi:10.1016/j.dsp.2022.103812 · Cited by 539
Automatic moth detection from trap images for pest management
Ding, W., & Taylor, G. (2016) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2016.02.003 · Cited by 367
Sridar, P., Kumar, A., Quinton, A., Nanan, R., Kim, J., & Krishnakumar, R. (2019) · Ultrasound in Medicine & Biology · doi:10.1016/j.ultrasmedbio.2018.11.016 · Cited by 70
Metadata
- Authors
- Zhang, X., Yang, Y.-H., Han, Z., Wang, H., & Gao, C.
- Venue
- ACM Computing Surveys
- Published
- 2013-07-11
- Volume
- 46
- Issue
- 1
- Pages
- 1-53
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W2071821890
- Cited by
- 107
- References
- 33
- FWCI
- 8.92
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.