The DOI matches its Crossref record; 78 of the 78 references it cites were found in a registry or an index.
Content‐Based Image Retrieval and Feature Extraction: A Comprehensive Review
Open accessAbstract
Multimedia content analysis is applied in different real‐world computer vision applications, and digital images constitute a major part of multimedia data. In last few years, the complexity of multimedia contents, especially the images, has grown exponentially, and on daily basis, more than millions of images are uploaded at different archives such as Twitter, Facebook, and Instagram. To search for a relevant image from an archive is a challenging research problem for computer vision research community. Most of the search engines retrieve images on the basis of traditional text‐based approaches that rely on captions and metadata. In the last two decades, extensive research is reported for content‐based image retrieval (CBIR), image classification, and analysis. In CBIR and image classification‐based models, high‐level image visuals are represented in the form of feature vectors that consists of numerical values. The research shows that there is a significant gap between image feature representation and human visual understanding. Due to this reason, the research presented in this area is focused to reduce the semantic gap between the image feature representation and human visual understanding. In this paper, we aim to present a comprehensive review of the recent development in the area of CBIR and image representation. We analyzed the main aspects of various image retrieval and image representation models from low‐level feature extraction to recent semantic deep‐learning approaches. The important concepts and major research studies based on CBIR and image representation are discussed in detail, and future research directions are concluded to inspire further research in this area.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
LIBSVM: A library for support vector machines
Chang, C.-C., & Lin, C.-J. (2011) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/1961189.1961199 · Cited by 40,918
Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories
Lazebnik, S., Schmid, C., & Ponce, J. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.68 · Cited by 7,916
Deep visual-semantic alignments for generating image descriptions
Karpathy, A., & Fei-Fei, L. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298932 · Cited by 4,902
(2007) · CaltechAUTHORS (California Institute of Technology) · Cited by 2,274
Deep Learning Face Representation from Predicting 10,000 Classes
Sun, Y., Wang, X., & Tang, X. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.244 · Cited by 1,997
Review of shape representation and description techniques
Zhang, D., & Lu, G. (2004) · Pattern Recognition · doi:10.1016/j.patcog.2003.07.008 · Cited by 1,867
A survey of content-based image retrieval with high-level semantics
Liu, Y., Zhang, D., Lu, G., & Ma, W.-Y. (2007) · Pattern Recognition · doi:10.1016/j.patcog.2006.04.045 · Cited by 1,696 · cited 1×
“)e image feature vector can be used as an input for machine learning algorithms through training and test models and it can improve the performance of CBIR [1, 2].”
MethodIntroduction to MPEG-7: Multimedia Content Description Interface
Salembier, P., Sikora, T., & Manjunath, B. S. (2002) · John Wiley & Sons, Inc. eBooks · Cited by 1,170
A review on automatic image annotation techniques
Zhang, D., Islam, M. M., & Lu, G. (2012) · Pattern Recognition · doi:10.1016/j.patcog.2011.05.013 · Cited by 479
Content-based image retrieval: approaches and trends of the new age
Datta, R., Li, J., & Wang, J. Z. (2005) · Proceedings of the 7th ACM SIGMM international workshop on Multimedia information retrieval · doi:10.1145/1101826.1101866 · Cited by 435
Deep Collaborative Embedding for Social Image Understanding
Li, Z., Tang, J., & Mei, T. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2852750 · Cited by 404
Image retrieval based on micro-structure descriptor
Liu, G.-H., Li, Z.-Y., Zhang, L., & Xu, Y. (2011) · Pattern Recognition · doi:10.1016/j.patcog.2011.02.003 · Cited by 323
Supervised Learning of Semantics-Preserving Hash via Deep Convolutional Neural Networks
Yang, H.-F., Lin, K., & Chen, C.-S. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2666812 · Cited by 314
A Review on Image Feature Extraction and Representation Techniques
Tian, D. (2013) · Cited by 297
Semantic content-based image retrieval: A comprehensive study
Alzu’bi, A., Amira, A., & Ramzan, N. (2015) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2015.07.012 · Cited by 220
Context-Aware Local Binary Feature Learning for Face Recognition
Duan, Y., Lu, J., Feng, J., & Zhou, J. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2710183 · Cited by 205
Real-time computerized annotation of pictures
Li, J., & Wang, J. Z. (2006) · Proceedings of the 14th ACM international conference on Multimedia · doi:10.1145/1180639.1180841 · Cited by 196
Unsupervised Visual Hashing with Semantic Assistant for Content-Based Image Retrieval
Zhu, L., Shen, J., Xie, L., & Cheng, Z. (2017) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2016.2562624 · Cited by 186
Fusion of color histogram and LBP-based features for texture image retrieval and classification
Liu, P., Guo, J.-M., Chamnongthai, K., & Prasetyo, H. (2017) · Information Sciences · doi:10.1016/j.ins.2017.01.025 · Cited by 170
A novel method for image retrieval based on structure elements’ descriptor
Wang, X., & Wang, Z. (2012) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2012.10.003 · Cited by 150
Region-based image retrieval with high-level semantics using decision tree learning
Liu, Y., Zhang, D., & Lu, G. (2007) · Pattern Recognition · doi:10.1016/j.patcog.2007.12.003 · Cited by 150
Information fusion in content based image retrieval: A comprehensive overview
Piras, L., & Giacinto, G. (2017) · Information Fusion · doi:10.1016/j.inffus.2017.01.003 · Cited by 149
Content-based image retrieval with compact deep convolutional features
Alzu’bi, A., Amira, A., & Ramzan, N. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.03.072 · Cited by 146
A Novel Image Retrieval Based on Visual Words Integration of SIFT and SURF
Ali, N., Bajwa, K. B., Sablatnig, R., Chatzichristofis, S. A., Iqbal, Z., Rashid, M., & Habib, H. A. (2016) · PLoS ONE · doi:10.1371/journal.pone.0157428 · Cited by 122
Self-citationNazir, A., Ashraf, R., Hamdani, S. T. A., & Ali, N. (2018) · International Conference on Computing, Mathematics and Engineering Technologies (iCoMET) · doi:10.1109/icomet.2018.8346343 · Cited by 110
Self-citationGaussian Copula Multivariate Modeling for Texture Image Retrieval Using Wavelet Transforms
Lasmar, N.-E., & Berthoumieu, Y. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2313232 · Cited by 102
Pairwise based deep ranking hashing for histopathology image classification and retrieval
Shi, X., Sapkota, M., Xing, F., Liu, F., Cui, L., & Yang, L. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2018.03.015 · Cited by 99
Content-Based Image Retrieval Using Error Diffusion Block Truncation Coding Features
Guo, J.-M., Prasetyo, H., & Chen, J.-H. (2014) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2014.2358011 · Cited by 95
Color texture image retrieval based on Gaussian copula models of Gabor wavelets
Li, C., Huang, Y., & Zhu, L. (2016) · Pattern Recognition · doi:10.1016/j.patcog.2016.10.030 · Cited by 86
Content Based Image Retrieval Using Embedded Neural Networks with Bandletized Regions
Ashraf, R., Bashir, K., Irtaza, A., & Mahmood, M. T. (2015) · Entropy · doi:10.3390/e17063552 · Cited by 85
Image retrieval by addition of spatial information based on histograms of triangular regions
Ali, N., Bajwa, K. B., Sablatnig, R., & Mehmood, Z. (2016) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2016.04.002 · Cited by 82
Self-citationFeature-Based Sparse Representation for Image Similarity Assessment
Kang, L., Hsu, C.-Y., Chen, H., Lu, C.-S., Lin, C., & Pei, S. (2011) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2011.2159197 · Cited by 74
Celik, C., & Bılge, H. Ş. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2017.03.006 · Cited by 73
Zhang, C., Liang, C., Li, L., Liu, J., Huang, Q., & Tian, Q. (2016) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2545112 · Cited by 72
A Hybrid Geometric Spatial Image Representation for scene classification
Ali, N., Zafar, B., Riaz, F., Dar, S. H., Ratyal, N. I., Bajwa, K. B., Iqbal, M. K., & Sajid, M. (2018) · PLoS ONE · doi:10.1371/journal.pone.0203339 · Cited by 65
Self-citationA Novel Discriminating and Relative Global Spatial Image Representation with Applications in CBIR
Zafar, B., Ashraf, R., Ali, N., Iqbal, M. K., Sajid, M., Dar, S. H., & Ratyal, N. I. (2018) · Applied Sciences · doi:10.3390/app8112242 · Cited by 63
Self-citationUnsupervised and Semi-Supervised Image Classification With Weak Semantic Consistency
Zhang, C., Cheng, J., & Tian, Q. (2019) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2903628 · Cited by 62
Retrieval-Based Face Annotation by Weak Label Regularized Local Coordinate Coding
Wang, D., Hoi, S. C. H., He, Y., Zhu, J., Mei, T., & Luo, J. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.145 · Cited by 61
Cooperative Sparse Representation in Two Opposite Directions for Semi-Supervised Image Annotation
Zhao, Z., Glotin, H., Xie, Z., Gao, J., & Wu, X. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2197631 · Cited by 58
A Novel Image Retrieval Based on a Combination of Local and Global Histograms of Visual Words
Mehmood, Z., Anwar, S. M., Ali, N., Habib, H. A., & Rashid, M. (2016) · Mathematical Problems in Engineering · doi:10.1155/2016/8217250 · Cited by 58
Self-citationLocal derivative radial patterns: A new texture descriptor for content-based image retrieval
Fadaei, S., Amirfattahi, R., & Ahmadzadeh, M. R. (2017) · Signal Processing · doi:10.1016/j.sigpro.2017.02.013 · Cited by 57
Collaborative Index Embedding for Image Retrieval
Zhou, W., Li, H., Sun, J., & Tian, Q. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2676779 · Cited by 55
Yang, S., Li, L., Wang, S., Zhang, W., Huang, Q., & Tian, Q. (2019) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2912735 · Cited by 55
Automatic Grading of Palsy Using Asymmetrical Facial Features: A Study Complemented by New Solutions
Sajid, M., Shafique, T., Baig, M. J. A., Riaz, I., Amin, S., & Manzoor, S. (2018) · Symmetry · doi:10.3390/sym10070242 · Cited by 54
Self-citationData Augmentation-Assisted Makeup-Invariant Face Recognition
Sajid, M., Ali, N., Dar, S. H., Ratyal, N. I., Butt, A. R., Zafar, B., Shafique, T., Baig, M. J. A., Riaz, I., & Baig, S. (2018) · Mathematical Problems in Engineering · doi:10.1155/2018/2850632 · Cited by 54
Self-citationA collision avoidance scheme for autonomous vehicles inspired by human social norms
Riaz, F., Jabbar, S., Sajid, M., Ahmad, M., Naseer, K., & Ali, N. (2018) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2018.02.011 · Cited by 51
Self-citationMultiview Label Sharing for Visual Representations and Classifications
Zhang, C., Cheng, J., & Tian, Q. (2017) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2017.2759500 · Cited by 48
Image classification by addition of spatial information based on histograms of orthogonal vectors
Zafar, B., Ashraf, R., Ali, N., Ahmed, M., Jabbar, S., & Chatzichristofis, S. A. (2018) · PLoS ONE · doi:10.1371/journal.pone.0198175 · Cited by 47
Self-citationSpatial orientations of visual word pairs to improve Bag-of-Visual-Words model
Khan, R., Barat, C., Muselet, D., & Ducottet, C. (2012) · British Machine Vision Conference (BMVC) · doi:10.5244/c.26.89 · Cited by 46
New shape descriptor in the context of edge continuity
Susan, S., Agrawal, P., Mittal, M., & Bansal, S. (2019) · CAAI Transactions on Intelligence Technology · doi:10.1049/trit.2019.0002 · Cited by 46
Spatial histograms of soft pairwise similar patches to improve the bag-of-visual-words model
Khan, R., Barat, C., Muselet, D., & Ducottet, C. (2014) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2014.09.005 · Cited by 44
Deeply Learned Pose Invariant Image Analysis with Applications in 3D Face Recognition
Ratyal, N. I., Taj, I. A., Sajid, M., Mahmood, A., Razzaq, S., Dar, S. H., Ali, N., Usman, M., Baig, M. J. A., & Mussadiq, U. (2019) · Mathematical Problems in Engineering · doi:10.1155/2019/3547416 · Cited by 39
Self-citationStructured Weak Semantic Space Construction for Visual Categorization
Zhang, C., Cheng, J., & Tian, Q. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2728060 · Cited by 38
Intelligent image classification-based on spatial weighted histograms of concentric circles
Zafar, B., Ashraf, R., Ali, N., Ahmed, M., Jabbar, S., Naseer, K., Ahmad, A., & Jeon, G. (2018) · Computer Science and Information Systems · doi:10.2298/csis180105025z · Cited by 37
Self-citationThe Impact of Asymmetric Left and Asymmetric Right Face Images on Accurate Age Estimation
Sajid, M., Ratyal, N. I., Ali, N., Zafar, B., Dar, S. H., Mahmood, M. T., & Joo, Y. B. (2019) · Mathematical Problems in Engineering · doi:10.1155/2019/8041413 · Cited by 34
Self-citationHong, C., & Zhu, J. (2012) · Neurocomputing · doi:10.1016/j.neucom.2012.09.001 · Cited by 31
Ali, N., Zafar, B., Iqbal, M. K., Sajid, M., Younis, M. Y., Dar, S. H., Mahmood, M. T., & Lee, I. H. (2019) · PLoS ONE · doi:10.1371/journal.pone.0219833 · Cited by 31
Self-citationBeyond Explicit Codebook Generation: Visual Representation Using Implicitly Transferred Codebooks
Zhang, C., Cheng, J., Liu, J., Pang, J., Huang, Q., & Tian, Q. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2485783 · Cited by 29
Multiview, Few-Labeled Object Categorization by Predicting Labels With View Consistency
Zhang, C., Cheng, J., & Tian, Q. (2018) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2018.2845912 · Cited by 27
Exploiting tf-idf in deep Convolutional Neural Networks for Content Based Image Retrieval
Kondylidis, N., Tzelepi, M., & Tefas, A. (2018) · Multimedia Tools and Applications · doi:10.1007/s11042-018-6212-1 · Cited by 26
Content‐based image retrieval system via sparse representation
Mohamadzadeh, S., & Farsi, H. (2015) · IET Computer Vision · doi:10.1049/iet-cvi.2015.0165 · Cited by 23
Multiview Semantic Representation for Visual Recognition
Zhang, C., Cheng, J., & Tian, Q. (2018) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2018.2875728 · Cited by 23
Ratyal, N. I., Taj, I. A., Sajid, M., Ali, N., Mahmood, A., & Razzaq, S. (2019) · International Journal of Advanced Robotic Systems · doi:10.1177/1729881419851716 · Cited by 22
Self-citationSupervised local sparse coding of sub-image features for image retrieval
Thiagarajan, J. J., Ramamurthy, K. N., Sattigeri, P., & Spanias, A. (2012) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2012.6467560 · Cited by 21
Semantically Modeling of Object and Context for Categorization
Zhang, C., Cheng, J., & Tian, Q. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2856096 · Cited by 21
Facial Asymmetry-Based Anthropometric Differences between Gender and Ethnicity
Sajid, M., Shafique, T., Riaz, I., et al. (2018) · Symmetry · doi:10.3390/sym10070232 · Cited by 20
Self-citationDeep Learning—A New Era in Bridging the Semantic Gap
Markowska–Kaczmar, U., & Kwaśnicka, H. (2018) · Intelligent systems reference library · doi:10.1007/978-3-319-73891-8_7 · Cited by 17
Learning DALTS for cross‐modal retrieval
Zheng, Y., & Wang, W. (2019) · CAAI Transactions on Intelligence Technology · doi:10.1049/trit.2018.1051 · Cited by 17
3D face recognition based on pose and expression invariant alignment
Ratyal, N. I., Taj, I. A., Bajwa, U. I., & Sajid, M. (2015) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2015.06.007 · Cited by 16
Self-citationA rotation-invariant bag of visual words model for symbols based ancient coin classification
Anwar, H., Zambanini, S., & Kampel, M. (2014) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2014.7026064 · Cited by 16
Classification Methods in Image Analysis with a Special Focus on Medical Analytics
Amelio, L., & Amelio, A. (2018) · Intelligent systems reference library · doi:10.1007/978-3-319-94030-4_3 · Cited by 16
Pose and Expression Invariant Alignment based Multi-View 3D Face Recognition
Ratyal, N. I., Taj, I. A., Bajwa, U. I., & Sajid, M. (2018) · KSII Transactions on Internet and Information Systems · doi:10.3837/tiis.2018.10.016 · Cited by 15
Self-citationA new axiomatic methodology for the image similarity
Amelio, A. (2019) · Applied Soft Computing · doi:10.1016/j.asoc.2019.04.043 · Cited by 12
Content-Based Image Retrieval Based on Late Fusion of Binary and Local DescriptorsPreprint
Ali, N., Mazhar, D. A., Iqbal, Z., Ashraf, R., Ahmed, J., & Khan, F. Z. (2017) · Preprints.org · doi:10.20944/preprints201703.0156.v1 · Cited by 11
Self-citationEfficient Scale- and Rotation-Invariant Encoding of Visual Words for Image Classification
Anwar, H., Zambanini, S., & Kampel, M. (2015) · IEEE Signal Processing Letters · doi:10.1109/lsp.2015.2432851 · Cited by 8
Hybrid generative–discriminative approach to age-invariant face recognition
Sajid, M., & Shafique, T. (2018) · Journal of Electronic Imaging · doi:10.1117/1.jei.27.2.023029 · Cited by 8
Self-citationSparse coding based few learning instances for image retrieval
Wu, H., Bie, R., Guo, J., et al. (2018) · Multimedia Tools and Applications · doi:10.1007/s11042-018-6301-1 · Cited by 3
Cited by
Facial emotion recognition using convolutional neural networks (FERC)
Mehendale, N. (2020) · SN Applied Sciences · doi:10.1007/s42452-020-2234-1 · Cited by 413
A Comprehensive Review of Deep Learning: Architectures, Recent Advances, and Applications
Mienye, I. D., & Swart, T. G. (2024) · Information · doi:10.3390/info15120755 · Cited by 330
Content-Based Image Retrieval Using Deep Learning
Karur, D. J. C., Hebbal, A., & Pujari, D. J. (2022) · International Journal of Scientific Research in Computer Science Engineering and Information Technology · doi:10.32628/cseit228418 · Cited by 1
Metadata
- Authors
- Latif, A., Rasheed, A., Sajid, U., Ahmed, J., Ali, N., Ratyal, N. I., Zafar, B., Dar, S. H., Sajid, M., & Khalil, T.
- Venue
- Mathematical Problems in Engineering
- Publisher
- Wiley
- Published
- 2019-01
- Volume
- 2019
- Issue
- 1
- ISSN
- 1024-123X (ISSN-L)
- 1563-5147
- OpenAlex
- W2970982005
- Cited by
- 347
- References
- 78
- FWCI
- 18.32
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.