The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
A Discriminative Kernel-Based Approach to Rank Images from Text Queries
Open accessAbstract
This paper introduces a discriminative model for the retrieval of images from text queries. Our approach formalizes the retrieval task as a ranking problem, and introduces a learning procedure optimizing a criterion related to the ranking performance. The proposed model hence addresses the retrieval problem directly and does not rely on an intermediate image annotation task, which contrasts with previous research. Moreover, our learning procedure builds upon recent work on the online learning of kernel-based classifiers. This yields an efficient, scalable algorithm, which can benefit from recent kernels developed for image comparison. The experiments performed over stock photography data show the advantage of our discriminative ranking approach over state-of-the-art alternatives (e.g. our model yields 26.3% average precision over the Corel dataset, which should be compared to 22.0%, for the best alternative model evaluated). Further analysis of the results shows that our model is especially advantageous over difficult queries such as queries with few relevant pictures or multiple-word queries.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
The Nature of Statistical Learning Theory
Vapnik, V. N. (1995) · doi:10.1007/978-1-4757-2440-0 · Cited by 39,138
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
Multiresolution gray-scale and rotation invariant texture classification with local binary patterns
Ojala, T., Pietikainen, M., & Maenpaa, T. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1017623 · Cited by 15,398
Baeza-Yates, R. A., & Ribeiro-Neto, B. A. (1999) · Cited by 11,505
Optimizing search engines using clickthrough data
Joachims, T. (2002) · Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/775047.775067 · Cited by 3,873
Mathematical Statistics and Data Analysis
Rabinowitz, L. (1989) · Technometrics · doi:10.1080/00401706.1989.10488573 · Cited by 3,116
(2000) · CrossRef Listing of Deleted DOIs · doi:10.1162/jmlr.2003.3.4-5.993 · Cited by 3,024
Learning to rank using gradient descent
Burges, C., Shaked, T., Renshaw, E., Lazier, A., Deeds, M., Hamilton, N., & Hullender, G. (2005) · Proceedings of the 22nd international conference on Machine learning - ICML '05 · doi:10.1145/1102351.1102363 · Cited by 2,836
Unsupervised Learning by Probabilistic Latent Semantic Analysis
Hofmann, T. (2001) · Machine Learning · doi:10.1023/a:1007617005950 · Cited by 2,456
Advances in Large-Margin Classifiers
(2000) · The MIT Press eBooks · doi:10.7551/mitpress/1113.001.0001 · Cited by 1,869
Online Passive-Aggressive Algorithms
Crammer, K., Dekel, O., Keshet, J., Shalev‐Shwartz, S., & Singer, Y. (2003) · Cited by 1,682
Making Large-Scale Support Vector Machine Learning Practical
Joachims, T. (1998) · Advances in Kernel Methods · doi:10.7551/mitpress/1130.003.0015 · Cited by 1,613
Object Recognition as Machine Translation: Learning a Lexicon for a Fixed Image Vocabulary
Duygulu, P., Barnard, K., de Freitas, J. F. G., & Forsyth, D. A. (2002) · Lecture Notes in Computer Science · doi:10.1007/3-540-47979-1_7 · Cited by 1,608
The pyramid match kernel: discriminative classification with sets of image features
Grauman, K., & Darrell, T. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.239 · Cited by 1,481
Evaluation campaigns and TRECVid
Smeaton, A. F., Over, P., & Kraaij, W. (2006) · Proceedings of the 8th ACM international workshop on Multimedia information retrieval · doi:10.1145/1178677.1178722 · Cited by 1,224
Automatic image annotation and retrieval using cross-media relevance models
Jeon, J., Lavrenko, V., & Manmatha, R. (2003) · Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval · doi:10.1145/860435.860459 · Cited by 1,139
Large Margin Rank Boundaries for Ordinal Regression
Herbrich, R., Graepel, T., & Obermayer, K. (2000) · Advances in Large-Margin Classifiers · doi:10.7551/mitpress/1113.003.0010 · Cited by 1,074
Discovering objects and their location in images
Sivic, J., Russell, B. C., Efros, A. A., Zisserman, A., & Freeman, W. T. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.77 · Cited by 975
Online Passive-Aggressive Algorithms
CrammerKoby, DekelOfer, KeshetJoseph, Shalev-ShwartzShai, & SingerYoram (2006) · Journal of Machine Learning Research · doi:10.5555/1248547.1248566 · Cited by 894
A support vector method for multivariate performance measures
Joachims, T. (2005) · Proceedings of the 22nd international conference on Machine learning - ICML '05 · doi:10.1145/1102351.1102399 · Cited by 786
Indoor-outdoor image classification
Szummer, M., & Picard, R. W. (2002) · Proceedings 1998 IEEE International Workshop on Content-Based Access of Image and Video Database · doi:10.1109/caivd.1998.646032 · Cited by 639
(2000) · CrossRef Listing of Deleted DOIs · doi:10.1162/153244303322533214 · Cited by 615
Learning the semantics of words and pictures
Barnard, K., & Forsyth, D. (2002) · Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001 · doi:10.1109/iccv.2001.937654 · Cited by 524
Barnard, K., Duygulu, P., Forsyth, D. A., de Freitas, N., Blei, D. M., Jordan, M. I., Jaz, K., Hofmann, T., Poggio, T., & Shawe-Taylor, J. S. (2003) · Cited by 459
Automatic image annotation and retrieval using cross-media relevance models
Jeon, J., Lavrenko, V. P., & Manmatha, R. (2003) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/860458.860459 · Cited by 417
Recognition with local features: the kernel recipe
Wallraven, Caputo, & Graf (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238351 · Cited by 347
Modeling scenes with local descriptors and latent aspects
Quelhas, P., Monay, F., Odobez, J.-M., Gatica-Perez, D., Tuytelaars, T., & Van Gool, L. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.152 · Cited by 343
Links between perceptrons, MLPs and SVMs
Collobert, R., & Bengio, S. (2004) · Twenty-first international conference on Machine learning - ICML '04 · doi:10.1145/1015330.1015415 · Cited by 302
Self-citationTieu, K., & Viola, P. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000004830.93820.78 · Cited by 280
Evaluation by highly relevant documents
Voorhees, E. M. (2001) · Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/383952.383963 · Cited by 230
Block-Based Methods for Image Retrieval Using Local Binary Patterns
Takala, V., Ahonen, T., & Pietikäinen, M. (2005) · Lecture Notes in Computer Science · doi:10.1007/11499145_89 · Cited by 213
Cross-lingual relevance models
Lavrenko, V., Choquette, M., & Croft, W. B. (2002) · Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/564376.564408 · Cited by 212
On image classification: city vs. landscape
Vailaya, A., Jain, A., & Zhang, H. J. (2002) · Proceedings. IEEE Workshop on Content-Based Access of Image and Video Libraries (Cat. No.98EX173) · doi:10.1109/ivl.1998.694464 · Cited by 163
The Truth about Corel - Evaluation in Image Retrieval
Müller, H., Marchand-Maillet, S., & Pun, T. (2002) · Lecture Notes in Computer Science · doi:10.1007/3-540-45479-9_5 · Cited by 161
Using Maximum Entropy for Automatic Image Annotation
Jeon, J., & Manmatha, R. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-27814-6_7 · Cited by 139
Bhattacharyya and Expected Likelihood Kernels
Jebara, T., & Kondor, R. (2003) · Lecture notes in computer science · doi:10.1007/978-3-540-45167-9_6 · Cited by 131
Pan, J.-Y., Yang, H.-J., Duygulu, P., & Faloutsos, C. (2005) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2004.1394652 · Cited by 113
IBM Research TRECVID 2004 Video Retrieval System.
Amir, A., Argillander, J., Berg, M., Chang, S., Franz, M., Hsu, W. H., Iyengar, G., Kender, J. R., Kennedy, L. S., Lin, C., et al. (2003) · Cited by 113
Natural Scene Retrieval Based on a Semantic Modeling Step
Vogel, J., & Schiele, B. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-27814-6_27 · Cited by 106
Object categorization with SVM: kernels for local features
Eichhorn, J., & Chapelle, O. (2004) · Cited by 51
A Kernel Between Unordered Sets of Data: The Gaussian Mixture Approach
Lyu, S. (2005) · Lecture notes in computer science · doi:10.1007/11564096_27 · Cited by 18
Learning to Retrieve Images from Text Queries with a Discriminative Model
Grangier, D., Monay, F., & Bengio, S. (2007) · Springer eBooks · doi:10.1007/978-3-540-71545-0_4 · Cited by 2
Self-citation
Cited by
(2010) · Cited by 8,261
Framing Image Description as a Ranking Task: Data, Models and Evaluation Metrics
Hodosh, M., Young, P., & Hockenmaier, J. (2013) · Journal of Artificial Intelligence Research · doi:10.1613/jair.3994 · Cited by 1,314
Local Binary Patterns and Its Application to Facial Image Analysis: A Survey
Huang, D., Shan, C., Ardabilian, M., Wang, Y., & Chen, L. (2011) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2011.2118750 · Cited by 905
Large Scale Online Learning of Image Similarity through Ranking
Chechik, G., Sharma, V., Shalit, U., & Bengio, S. (2009) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-02172-5_2 · Cited by 722
Self-citationTagProp: Discriminative metric learning in nearest neighbor models for image auto-annotation
Guillaumin, M., Mensink, T., Verbeek, J., & Schmid, C. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459266 · Cited by 673
Metadata
- Authors
- Grangier, D., & Bengio, S.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2008-08
- Volume
- 30
- Issue
- 8
- Pages
- 1371-1384
- ISSN
- 0162-8828 (ISSN-L)
- OpenAlex
- W2162867699
- Cited by
- 318
- References
- 43
- FWCI
- 31.98
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.