The DOI matches its Crossref record; 178 of the 178 references it cites were found in a registry or an index.
SIFT Meets CNN: A Decade Survey of Instance Retrieval
Open accessAbstract
In the early days, content-based image retrieval (CBIR) was studied with global features. Since 2003, image retrieval based on local descriptors (de facto SIFT) has been extensively studied for over a decade due to the advantage of SIFT in dealing with image transformations. Recently, image representations based on the convolutional neural network (CNN) have attracted increasing interest in the community and demonstrated impressive performance. Given this time of rapid evolution, this article provides a comprehensive survey of instance retrieval over the last decade. Two broad categories, SIFT-based and CNN-based methods, are presented. For the former, according to the codebook size, we organize the literature into using large/medium-sized/small codebooks. For the latter, we discuss three lines of methods, i.e., using pre-trained or fine-tuned CNN models, and hybrid methods. The first two perform a single-pass of an image to the network, while the last category employs a patch-based feature extraction scheme. This survey presents milestones in modern instance retrieval, reviews a broad selection of previous works in different categories, and provides insights on the connection between SIFT and CNN-based methods. After analyzing and comparing retrieval performance of different categories on several datasets, we discuss promising directions towards generic and specialized instance retrieval.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Cited by
Re-ranking Person Re-identification with k-Reciprocal Encoding
Zhong, Z., Zheng, L., Cao, D., & Li, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.389 · Cited by 1,583
Self-citationDeep Learning vs. Traditional Computer Vision
O’Mahony, N., Campbell, S., Carvalho, A., Harapanahalli, S., Hernandez, G. V., Krpalkova, L., Riordan, D., & Walsh, J. (2020) · Advances in Intelligent Systems and Computing · doi:10.1007/978-3-030-17795-9_10 · Cited by 1,025
Image Matching from Handcrafted to Deep Features: A Survey
Ma, J., Jiang, X., Fan, A., Jiang, J., & Yan, J. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-020-01359-2 · Cited by 990
Person Re-identification: Past, Present and Future
Zheng, L., Yang, Y. P., & Hauptmann, A. G. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.02984 · Cited by 922
Self-citationA Discriminatively Learned CNN Embedding for Person Reidentification
Zheng, Z., Zheng, L., & Yang, Y. (2018) · ACM Transactions on Multimedia Computing, Communications, and Applications · doi:10.1145/3159171 · Cited by 874
Self-citationLarge-Scale Image Retrieval with Attentive Deep Local Features
Noh, H., Araujo, A., Sim, J., Weyand, T., & Han, B. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.374 · Cited by 847
Cut, Paste and Learn: Surprisingly Easy Synthesis for Instance Detection
Dwibedi, D., Misra, I., & Hebert, M. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.146 · Cited by 651
Unsupervised Person Re-identification: Clustering and Fine-tuning
Fan, H., Zheng, L., Yan, C., & Yang, Y. (2018) · ACM Transactions on Multimedia Computing, Communications, and Applications · doi:10.1145/3243316 · Cited by 636
Self-citationHierarchical Discriminative Learning for Visible Thermal Person Re-Identification
Ye, M., Lan, X., Li, J., & Yuen, P. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12293 · Cited by 405
From BoW to CNN: Two Decades of Texture Representation for Texture Classification
Liu, L., Chen, J., Fieguth, P., Zhao, G., Chellappa, R., & Pietikäinen, M. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-018-1125-z · Cited by 375
Deep learning for smart fish farming: applications, opportunities and challenges
Yang, X., Zhang, S., Liu, J., Gao, Q., Dong, S., & Zhou, C. (2021) · Reviews in Aquaculture · doi:10.1111/raq.12464 · Cited by 364
A Decade Survey of Content Based Image Retrieval Using Deep Learning
Dubey, S. R. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3080920 · Cited by 356
Bi-Directional Center-Constrained Top-Ranking for Visible Thermal Person Re-Identification
Ye, M., Lan, X., Wang, Z., & Yuen, P. C. (2020) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2019.2921454 · Cited by 331
A Survey of Open-World Person Re-Identification
Leng, Q., Ye, M., & Tian, Q. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2019.2898940 · Cited by 318
Self-citationCrack and Noncrack Classification from Concrete Surface Images Using Machine Learning
Kim, H., Ahn, E., Shin, M., & Sim, S.-H. (2019) · Structural Health Monitoring · doi:10.1177/1475921718768747 · Cited by 315
CamStyle: A Novel Data Augmentation Method for Person Re-Identification
Zhong, Z., Zheng, L., Zheng, Z., Li, S., & Yang, Y. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2874313 · Cited by 303
Self-citationRançon, F., Bombrun, L., Keresztes, B., & Germain, C. (2018) · Remote Sensing · doi:10.3390/rs11010001 · Cited by 287
Efficient structure from motion for large-scale UAV images: A review and a comparison of SfM tools
Jiang, S., Jiang, C., & Jiang, W. (2020) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2020.04.016 · Cited by 286
Visual place recognition: A survey from deep learning perspective
Zhang, X., Wang, L., & Su, Y. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2020.107760 · Cited by 261
Image Security Retrieval Based on Chaotic Algorithm and Deep Learning
Zhang, Q., Yan, Y., Lin, Y., & Li, Y. (2022) · IEEE Access · doi:10.1109/access.2022.3185421 · Cited by 9
MARs: Multi-view Attention Regularizations for Patch-based Feature Recognition of Space Terrain
Chase, T., & Dantu, K. (2024) · arXiv · doi:10.48550/arxiv.2410.05182 · Cited by 5
Metadata
- Authors
- Zheng, L., Yang, Y., & Tian, Q.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2018-05-01
- Volume
- 40
- Issue
- 5
- Pages
- 1224-1244
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W2499468060
- Cited by
- 752
- References
- 178
- FWCI
- 40.21
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.