The DOI matches its Crossref record; 85 of the 85 references it cites were found in a registry or an index.
Content-based image retrieval: approaches and trends of the new age
Abstract
The last decade has witnessed great interest in research on content-based image retrieval. This has paved the way for a large number of new techniques and systems, and a growing interest in associated fields to support such systems. Likewise, digital imagery has expanded its horizon in many directions, resulting in an explosion in the volume of image data required to be organized. In this paper, we discuss some of the key contributions in the current decade related to image retrieval and automated image annotation, spanning 120 references. We also discuss some of the key challenges involved in the adaptation of existing image retrieval techniques to build useful systems that can handle real-world data. We conclude with a study on the trends in volume and impact of publications in the field with respect to venues/journals and sub-topics.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Normalized cuts and image segmentation
Shi, J., & Malik, J. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.868688 · Cited by 15,502
Mean shift: a robust approach toward feature space analysis
Comaniciu, D., & Meer, P. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.1000236 · Cited by 11,305
An introduction to variable and feature selection
GuyonIsabelle, & ElisseeffAndré (2003) · Journal of Machine Learning Research · doi:10.5555/944919.944968 · Cited by 7,715
Zhang, Y., Brady, M., & Smith, S. (2001) · IEEE Transactions on Medical Imaging · doi:10.1109/42.906424 · Cited by 6,982
Shape matching and object recognition using shape contexts
Belongie, S., Malik, J., & Puzicha, J. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.993558 · Cited by 6,306
Content-based image retrieval at the end of the early years
Smeulders, A. W. M., Worring, M., Santini, S., Gupta, A., & Jain, R. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.895972 · Cited by 6,056
2008 IEEE Conference on Computer Vision and Pattern Recognition
(2008) · doi:10.1109/cvpr12618.2008 · Cited by 4,212
Neural Information Processing Systems
(2018) · The Deep Learning Revolution · doi:10.7551/mitpress/11474.003.0014 · Cited by 3,730
Scale & Affine Invariant Interest Point Detectors
Mikolajczyk, K., & Schmid, C. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000027790.02288.f2 · Cited by 3,436
Labeling images with a computer game
von Ahn, L., & Dabbish, L. (2004) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/985692.985733 · Cited by 2,204
SIMPLIcity: semantics-sensitive integrated matching for picture libraries
Wang, J. Z., Li, J., & Wiederhold, G. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.955109 · Cited by 2,196
Self-citationRelevance feedback: a power tool for interactive content-based image retrieval
Rui, Y., Huang, T. S., Ortega, M., & Mehrotra, S. (1998) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/76.718510 · Cited by 1,764
Manjunath, B. S., Ohm, J.-R., Vasudevan, V. V., & Yamada, A. (2001) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/76.927424 · Cited by 1,666
Object Recognition as Machine Translation: Learning a Lexicon for a Fixed Image Vocabulary
Duygulu, P., Barnard, K., de Freitas, J. F. G., & Forsyth, D. A. (2002) · Lecture Notes in Computer Science · doi:10.1007/3-540-47979-1_7 · Cited by 1,608
Image Retrieval: Current Techniques, Promising Directions, and Open Issues
Rui, Y., Huang, T. S., & Chang, S.-F. (1999) · Journal of Visual Communication and Image Representation · doi:10.1006/jvci.1999.0413 · Cited by 1,601
Müller, H., Michoux, N., Bandon, D., & Geissbuhler, A. (2004) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2003.11.024 · Cited by 1,489
Unsupervised feature selection using feature similarity
Mitra, P., Murthy, C. A., & Pal, S. K. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.990133 · Cited by 1,460
Blobworld: image segmentation using expectation-maximization and its application to image querying
Carson, C., Belongie, S., Greenspan, H., & Malik, J. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1023800 · Cited by 1,410
Support vector machine active learning for image retrieval
Tong, S., & Chang, E. (2001) · Proceedings of the ninth ACM international conference on Multimedia · doi:10.1145/500141.500159 · Cited by 1,328
Wavelet-based texture retrieval using generalized Gaussian density and Kullback-Leibler distance
Do, M. N., & Vetterli, M. (2002) · IEEE Transactions on Image Processing · doi:10.1109/83.982822 · Cited by 1,147
Automatic image annotation and retrieval using cross-media relevance models
Jeon, J., Lavrenko, V., & Manmatha, R. (2003) · Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval · doi:10.1145/860435.860459 · Cited by 1,139
Contour and Texture Analysis for Image Segmentation
Malik, J., Belongie, S., Leung, T., & Shi, J. (2001) · International Journal of Computer Vision · doi:10.1023/a:1011174803800 · Cited by 1,089
Automatic linguistic indexing of pictures by a statistical modeling approach
Li, J., & Wang, J. Z. (2003) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2003.1227984 · Cited by 1,087
Self-citationBlei, D. M., & Jordan, M. I. (2003) · Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval · doi:10.1145/860435.860460 · Cited by 1,054
Weston, J., Mukherjee, S., Chapelle, O., Pontil, M., Poggio, T., & Vapnik, V. N. (2000) · Cited by 988
A performance evaluation of local descriptors
Mikolajczyk, K., & Schmid, C. (2003) · 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings. · doi:10.1109/cvpr.2003.1211478 · Cited by 955
Faceted metadata for image search and browsing
Yee, K.-P., Swearingen, K., Li, K., & Hearst, M. (2003) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/642611.642681 · Cited by 898
Böhm, C., Berchtold, S., & Keim, D. A. (2001) · ACM Computing Surveys · doi:10.1145/502807.502809 · Cited by 827
Relevance feedback in image retrieval: A comprehensive review
Zhou, X. S., & Huang, T. S. (2003) · Multimedia Systems · doi:10.1007/s00530-002-0070-3 · Cited by 826
International Conference on Pattern Recognition
(1971) · Computer · doi:10.1109/c-m.1971.216793 · Cited by 814
Image classification for content-based indexing
Vailaya, A., Figueiredo, M. A. T., Jain, A. K., & Zhang, H.-J. (2001) · IEEE Transactions on Image Processing · doi:10.1109/83.892448 · Cited by 762
Cox, I. J., Miller, M. L., Minka, T. P., Papathomas, T. V., & Yianilos, P. N. (2000) · IEEE Transactions on Image Processing · doi:10.1109/83.817596 · Cited by 751
A Model for Learning the Semantics of Pictures
Lavrenko, V. P., Manmatha, R., & Jeon, J. (2003) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 680
Image Categorization by Learning and Reasoning with Regions
Chen, Y., & Wang, J. Z. (2004) · doi:10.5555/1005332.1016789 · Cited by 621
Self-citationImage segmentation by data-driven markov chain monte carlo
Tu, Z., & Zhu, S.-C. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.1000239 · Cited by 565
Performance evaluation in content-based image retrieval: overview and proposals
Müller, H., Müller, W., Squire, D. M., Marchand-Maillet, S., & Pun, T. (2001) · Pattern Recognition Letters · doi:10.1016/s0167-8655(00)00118-5 · Cited by 552
Eakins, J., & Graham, M. E. (2000) · OpenGrey (Institut de l'Information Scientifique et Technique) · Cited by 472
Shape similarity measure based on correspondence of visual parts
Latecki, L. J., & Lakamper, R. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.879802 · Cited by 461
CBSA: content-based soft annotation for multimodal image retrieval using bayes point machines
Chang, E., Goh, K., Sychay, G., & Wu, G. (2003) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2002.808079 · Cited by 450
A region-based fuzzy feature matching approach to content-based image retrieval
Chen, Y., & Wang, J. Z. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1033216 · Cited by 432
Self-citationHow do people manage their digital photographs?
Rodden, K., & Wood, K. R. (2003) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/642611.642682 · Cited by 408
Optimizing learning in image retrieval
Rui, Y., & Huang, T. (2002) · Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662) · doi:10.1109/cvpr.2000.855825 · Cited by 373
Retrieval of subpixel snow-covered area and grain size from imaging spectrometer data
Painter, T. H., Dozier, J., Roberts, D. A., Davis, R. E., & Green, R. O. (2003) · Remote Sensing of Environment · doi:10.1016/s0034-4257(02)00187-6 · Cited by 359
CLUE: cluster-based retrieval of images by unsupervised learning
Chen, Y., Wang, J. Z., & Krovetz, R. (2005) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.849770 · Cited by 322
Self-citationAn efficient color representation for image retrieval
Deng, Y., Manjunath, B. S., Kenney, C., Moore, M. S., & Shin, H. (2001) · IEEE Transactions on Image Processing · doi:10.1109/83.892450 · Cited by 314
Feature selection in unsupervised learning via evolutionary search
Kim, Y., Street, W. N., & Menczer, F. (2000) · Proceedings of the sixth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/347090.347169 · Cited by 288
Tieu, K., & Viola, P. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000004830.93820.78 · Cited by 280
Multiresolution histograms and their use for recognition
Hadjidemetriou, E., Grossberg, M. D., & Nayar, S. K. (2004) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2004.32 · Cited by 253
Segmentation given partial grouping constraints
Yu, S. X., & Shi, J. (2004) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2004.1262179 · Cited by 248
Content-Based Image Retrieval Using Multiple-Instance Learning
Zhang, Q., Goldman, S. A., Yu, W., & Fritts, J. E. (2002) · Cited by 243
A unified framework for semantics and feature based relevance feedback in image retrieval systems
Lu, Y., Hu, C., Zhu, X., Zhang, H., & Yang, Q. (2000) · Proceedings of the eighth ACM international conference on Multimedia · doi:10.1145/354384.354403 · Cited by 236
On image auto-annotation with latent space models
Monay, F., & Gática-Pérez, D. (2003) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/957013.957070 · Cited by 235
Su, Z., Zhang, H., Li, S., & Ma, S. (2003) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.815254 · Cited by 216
Does organisation by similarity assist image browsing?
Rodden, K., Basalaj, W., Sinclair, D., & Wood, K. (2001) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/365024.365097 · Cited by 215
An Efficient and Effective Region-Based Image Retrieval Framework
Jing, F., Li, M., Zhang, H.-J., & Zhang, B. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2004.826125 · Cited by 212
WARP: accurate retrieval of shapes using phase of Fourier descriptors and time warping distance
Bartolini, I., Ciaccia, P., & Patella, M. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.21 · Cited by 201
PicSOM-self-organizing image retrieval with MPEG-7 content descriptors
Laaksonen, J., Koskela, M., & Oja, E. (2002) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2002.1021885 · Cited by 193
Discriminant-EM algorithm with application to image retrieval
Wu, Y. N., Tian, Q., & Huang, T. S. (2002) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2000.855823 · Cited by 181
Learning an image manifold for retrieval
He, X., Ma, W.-Y., & Zhang, H.-J. (2004) · Proceedings of the 12th annual ACM international conference on Multimedia · doi:10.1145/1027527.1027532 · Cited by 179
WALRUS: a similarity retrieval algorithm for image databases
Natsev, A., Rastogi, R., & Shim, K. (2004) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2003.1262183 · Cited by 159
2007 IEEE International Conference on Image Processing
(2007) · 2007 IEEE International Conference on Image Processing · doi:10.1109/icip.2007.4379929 · Cited by 158
Unsupervised multiresolution segmentation for images with low depth of field
Wang, J. Z., Li, J., Gray, R. M., & Wiederhold, G. C. M. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.899949 · Cited by 153
Self-citationSketch-Based Image Matching Using Angular Partitioning
Chalechale, A., Naghdy, G. A., & Mertins, A. (2004) · IEEE Transactions on Systems Man and Cybernetics - Part A Systems and Humans · doi:10.1109/tsmca.2004.838464 · Cited by 148
Learning from User Feedback in Image Retrieval Systems
Vasconcelos, N. M., & Lippman, A. (1999) · Cited by 138
Image retrieval using wavelet-based salient points
Tian, Q., Sebe, N., S., L. M., Loupias, E., & Huang, T. S. (2001) · Journal of Electronic Imaging · doi:10.1117/1.1406945 · Cited by 129
Interactive learning and probabilistic retrieval in remote sensing image archives
Schroder, M., Rehrauer, H., Seidel, K., & Datcu, M. P. (2000) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/36.868886 · Cited by 127
Li, J., Gray, R. M., & Olshen, R. A. (2000) · IEEE Transactions on Information Theory · doi:10.1109/18.857794 · Cited by 120
Self-citationA memory learning framework for effective image retrieval
Han, J., Ngan, K. N., Li, M., & Zhang, H.-J. (2005) · IEEE Transactions on Image Processing · doi:10.1109/tip.2004.841205 · Cited by 118
A probabilistic architecture for content-based image retrieval
Vasconcelos, N. M., & Lippman, A. (2002) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2000.855822 · Cited by 116
Image retrieval using color histograms generated by Gauss mixture vector quantization
Jeong, S., Won, C. S., & Gray, R. M. (2003) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2003.10.015 · Cited by 115
Relevance Feedback in Region-Based Image Retrieval
Jing, F., Li, M., Zhang, H.-J., & Zhang, B. (2004) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2004.826775 · Cited by 105
Comparing discriminating transformations and SVM for learning during multimedia retrieval
Zhou, X. S., & Huang, T. S. (2001) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/500141.500163 · Cited by 101
A novel log-based relevance feedback technique in content-based image retrieval
Hoi, C.-H., & Lyu, M. R.-T. (2004) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/1027527.1027533 · Cited by 99
On the Efficient Evaluation of Probabilistic Similarity Functions for Image Retrieval
Vasconcelos, N. M. (2004) · IEEE Transactions on Information Theory · doi:10.1109/tit.2004.830760 · Cited by 90
Locality preserving clustering for image database
Zheng, X., Cai, D., He, X., Ma, W., & Lin, X. (2004) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/1027527.1027731 · Cited by 85
Huynh, D. F., Drucker, S. M., Baudisch, P., & Wong, C. (2005) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/1056808.1057061 · Cited by 81
Multimodal concept-dependent active learning for image retrieval
Goh, K.-S., Chang, E. Y., & Lai, W.-C. (2004) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/1027527.1027664 · Cited by 81
Object-based image retrieval using the statistical structure of images
Hoiem, D., Sukthankar, R., Schneiderman, H., & Huston, L. (2004) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2004.1315204 · Cited by 79
Keyblock: an approach for content-based image retrieval
Zhu, L., Zhang, A., Rao, A., & Srihari, R. K. (2000) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/354384.354455 · Cited by 69
How people describe their image information needs
Cunningham, S. J., Bainbridge, D., & Masoodian, M. (2004) · ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL) · doi:10.1145/996350.996362 · Cited by 49
A multiresolution manifold distance for invariant image similarity
Vasconcelos, N. M., & Lippman, A. (2005) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2004.840596 · Cited by 46
Fuzzy integral for leaf image retrieval
Wang, Z., Chi, Z., & Feng, D. D. (2003) · IEEE International Conference on Fuzzy Systems (FUZZ-IEEE) · doi:10.1109/fuzz.2002.1005019 · Cited by 45
Joshi, D., Wang, J. Z., & Li, J. (2004) · doi:10.1145/1026711.1026732 · Cited by 41
Self-citationActive concept learning for image retrieval in dynamic databases
Dong, & Bhanu, B. (2003) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2003.1238318 · Cited by 21
Three-dimensional interfaces for querying by example in content-based image retrieval
Assfalg, J., Bimbo, A. D., & Pala, P. (2002) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2002.1044517 · Cited by 21
Cited by
Every Picture Tells a Story: Generating Sentences from Images
Farhadi, A., Hejrati, M., Sadeghi, M. A., Young, P., Rashtchian, C., Hockenmaier, J., & Forsyth, D. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15561-1_2 · Cited by 1,204
Features for image retrieval: an experimental comparison
Deselaers, T., Keysers, D., & Ney, H. (2008) · Information Retrieval · doi:10.1007/s10791-007-9039-3 · Cited by 585
PatternNet: A benchmark dataset for performance evaluation of remote sensing image retrieval
Zhou, W., Newsam, S., Li, C., & Shao, Z. (2018) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2018.01.004 · Cited by 571
“…resulted in the significant challenge of how to efficiently manage the large data collections, particularly so that the data of interest can be accessed quickly Content based image retrieval (CBIR) is a useful technique for the fast retrieval of images of interest from a large-scale dataset [1–4].”
MethodDescribable Visual Attributes for Face Verification and Image Search
Kumar, N., Berg, A., Belhumeur, P. N., & Nayar, S. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.48 · Cited by 434
FaceTracer: A Search Engine for Large Collections of Images with Faces
Kumar, N., Belhumeur, P., & Nayar, S. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88693-8_25 · Cited by 368
Metadata
- Authors
- Datta, R., Li, J., & Wang, J. Z.
- Venue
- Proceedings of the 7th ACM SIGMM international workshop on Multimedia information retrieval
- Publisher
- ACM
- Published
- 2005-11-10
- Pages
- 253-262
- OpenAlex
- W2167407098
- Cited by
- 435
- References
- 85
- FWCI
- 25.79
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.