The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Learning to Rank Using User Clicks and Visual Features for Image Retrieval
Abstract
The inconsistency between textual features and visual contents can cause poor image search results. To solve this problem, click features, which are more reliable than textual information in justifying the relevance between a query and clicked images, are adopted in image ranking model. However, the existing ranking model cannot integrate visual features, which are efficient in refining the click-based search results. In this paper, we propose a novel ranking model based on the learning to rank framework. Visual features and click features are simultaneously utilized to obtain the ranking model. Specifically, the proposed approach is based on large margin structured output learning and the visual consistency is integrated with the click features through a hypergraph regularizer term. In accordance with the fast alternating linearization method, we design a novel algorithm to optimize the objective function. This algorithm alternately minimizes two different approximations of the original objective function by keeping one function unchanged and linearizing the other. We conduct experiments on a large-scale dataset collected from the Microsoft Bing image search engine, and the results demonstrate that the proposed learning to rank models based on visual features and user clicks outperforms state-of-the-art algorithms.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Fast Training of Support Vector Machines Using Sequential Minimal Optimization
Platt, J. C. (1998) · Advances in Kernel Methods · doi:10.7551/mitpress/1130.003.0016 · Cited by 5,437
Cumulated gain-based evaluation of IR techniques
Järvelin, K., & Kekäläinen, J. (2002) · ACM Transactions on Information Systems · doi:10.1145/582415.582418 · Cited by 4,841
The Art of Computer Programming: Volume 3: Sorting and Searching
Knuth, D. E. (1973) · Cited by 3,955
Learning with Local and Global Consistency
Zhou, D., Bousquet, O., Lal, T. N., Weston, J., & Schölkopf, B. (2003) · MPG.PuRe (Max Planck Society) · Cited by 3,864
Large Margin Methods for Structured and Interdependent Output Variables
Tsochantaridis, I., Joachims, T., Hofmann, T., & Altün, Y. (2005) · Journal of Machine Learning Research · doi:10.5555/1046920.1088722 · Cited by 2,225
Learning to rank: from pairwise approach to listwise approach
Cao, Z., Qin, T., Liu, T.-Y., Tsai, M.-F., & Li, H. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273513 · Cited by 1,960 · cited 8×
“The learning to rank methods of RankSVM and ListNet are conducted with click features to show their performance, and the reranking methods [29] are conducted on the basis of the results of RankSVM and ListNet.”
BackgroundMethodInfluentialTraining linear SVMs in linear time
Joachims, T. (2006) · Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1150402.1150429 · Cited by 1,920
Learning to rank for information retrieval
Liu, T.-Y. (2010) · Proceedings of the 33rd international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1835449.1835676 · Cited by 1,856
On the Implementation of a Primal-Dual Interior Point Method
Mehrotra, S. (1992) · SIAM Journal on Optimization · doi:10.1137/0802028 · Cited by 1,613
Learning to Rank for Information Retrieval
Liu, T.-Y. (2009) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000016 · Cited by 1,568
Some Simple Effective Approximations to the 2-Poisson Model for Probabilistic Weighted Retrieval
Robertson, S. E., & Walker, S. (1994) · SIGIR ’94 · doi:10.1007/978-1-4471-2099-5_24 · Cited by 1,477
Learning with Hypergraphs: Clustering, Classification, and Embedding
Zhou, D., Huang, J., & Schölkopf, B. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0205 · Cited by 1,283
Support vector machine learning for interdependent and structured output spaces
Tsochantaridis, I., Hofmann, T., Joachims, T., & Altun, Y. (2004) · Twenty-first international conference on Machine learning - ICML '04 · doi:10.1145/1015330.1015341 · Cited by 1,243
Large Margin Rank Boundaries for Ordinal Regression
Herbrich, R., Graepel, T., & Obermayer, K. (2000) · Advances in Large-Margin Classifiers · doi:10.7551/mitpress/1113.003.0010 · Cited by 1,074
From RankNet to LambdaRank to LambdaMART: An Overview
Burges, C. J. C. (2010) · Cited by 1,011
Transfer Learning for Visual Categorization: A Survey
Shao, L., Zhu, F., & Li, X. (2015) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2014.2330900 · Cited by 895
AdaRank: a boosting algorithm for information retrieval
Xu, J., & Li, H. (2007) · Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1277741.1277809 · Cited by 775
The Art of Computer Programming, Volume 3, Sorting and Searching
Wilkes, M. V. (1974) · The Computer Journal · doi:10.1093/comjnl/17.4.324 · Cited by 707
Listwise approach to learning to rank: theory and algorithm
Xia, F., Liu, T.-Y., Wang, J., Zhang, W., & Li, H. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390306 · Cited by 702
Adapting ranking SVM to document retrieval
Cao, Y., Xu, J., Liu, T.-Y., Li, H., Huang, Y., & Hon, H.-W. (2006) · Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1148170.1148205 · Cited by 569
Click Prediction for Web Image Reranking Using Multimodal Sparse Coding
Yu, J., Rui, Y., & Tao, D. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2311377 · Cited by 550
Self-citationXia, T., Tao, D., Mei, T., & Zhang, Y. (2010) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2009.2039566 · Cited by 508
Self-citationVisual-Textual Joint Relevance Learning for Tag-Based Social Image Search
Gao, Y., Wang, M., Zha, Z.-J., Shen, J., Li, X., & Wu, X. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2202676 · Cited by 438
Self-citationAdaptive Hypergraph Learning and its Application in Image Classification
Yu, J., Tao, D., & Wang, M. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2190083 · Cited by 405
Self-citationMultimodal Graph-Based Reranking for Web Image Search
Wang, M., Li, H., Tao, D., Lu, K., & Wu, X. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2207397 · Cited by 344
Self-citationStochastic gradient boosted distributed decision trees
Ye, J., Chow, J.-H., Chen, J., & Zheng, Z. (2009) · Proceedings of the 18th ACM conference on Information and knowledge management · doi:10.1145/1645953.1646301 · Cited by 324
Feature Learning for Image Classification Via Multiobjective Genetic Programming
Shao, L., Liu, L., & Li, X. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2293418 · Cited by 324
High-Order Distance-Based Multiview Stochastic Learning in Image Classification
Yu, J., Rui, Y., Tang, Y. Y., & Tao, D. (2014) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2014.2307862 · Cited by 260
Self-citationMultiview Hessian Regularization for Image Annotation
Liu, W., & Tao, D. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2255302 · Cited by 254
Self-citationLearning to Rank for Information Retrieval and Natural Language Processing
Li, H. (2011) · Synthesis lectures on human language technologies · doi:10.2200/s00348ed1v01y201104hlt012 · Cited by 249
Fast alternating linearization methods for minimizing the sum of two convex functions
Goldfarb, D., Ma, S., & Scheinberg, K. (2013) · Mathematical Programming · doi:10.1007/s10107-012-0530-2 · Cited by 246
Video search reranking through random walk over document-level context graph
Hsu, W. H., Kennedy, L. S., & Chang, S.-F. (2007) · Proceedings of the 15th ACM international conference on Multimedia · doi:10.1145/1291233.1291446 · Cited by 226
Video search reranking via information bottleneck principle
Hsu, W. H., Kennedy, L. S., & Chang, S.-F. (2006) · Proceedings of the 14th ACM international conference on Multimedia · doi:10.1145/1180639.1180654 · Cited by 215
Multiview Hessian discriminative sparse coding for image annotation
Liu, W., Tao, D., Cheng, J., & Tang, Y. (2014) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2013.03.007 · Cited by 212
Self-citationWeakly-Supervised Cross-Domain Dictionary Learning for Visual Recognition
Zhu, F., & Shao, L. (2014) · International Journal of Computer Vision · doi:10.1007/s11263-014-0703-y · Cited by 210
Exploiting Click Constraints and Multi-view Features for Image Re-ranking
Yu, J., Rui, Y., & Chen, B. (2014) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2013.2284755 · Cited by 170
Self-citationStatistical Analysis of Bayes Optimal Subset Ranking
Cossock, D., & Zhang, T. (2008) · IEEE Transactions on Information Theory · doi:10.1109/tit.2008.929939 · Cited by 160
A model to estimate intrinsic document relevance from the clickthrough logs of a web search engine
Dupret, G., & Liao, C. Y. (2010) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/1718487.1718510 · Cited by 146
Spectral Hashing With Semantically Consistent Graph for Image Indexing
Li, P., Wang, M., Cheng, J., Xu, C., & Lu, H. (2012) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2012.2199970 · Cited by 138
Self-citationBayesian video search reranking
Tian, X., Yang, L., Wang, J., Yang, Y., Wu, X., & Hua, X. (2008) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/1459359.1459378 · Cited by 134
Movie2Comics: Towards a Lively Video Content Presentation
Wang, M., Hong, R., Yuan, X., Yan, S., & Chua, T. (2012) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2012.2187181 · Cited by 127
Self-citationEvaluating Search Engines by Modeling the Relationship Between Relevance and Clicks
Carterette, B., & Jones, R. (2007) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 122
Learning Object-to-Class Kernels for Scene Classification
Zhang, L., Zhen, X., & Shao, L. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2328894 · Cited by 115
Noise resistant graph ranking for improved web image search
Liu, W., Jiang, Y., Luo, J., & Chang, S. (2011) · doi:10.1109/cvpr.2011.5995315 · Cited by 78
Sampling and Ontologically Pooling Web Images for Visual Concept Learning
Zhu, S., Ngo, C., & Jiang, Y. (2012) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2012.2190387 · Cited by 37
Hong, C., & Zhu, J. (2012) · Neurocomputing · doi:10.1016/j.neucom.2012.09.001 · Cited by 31
Multi-view hypergraph learning by patch alignment framework
Hong, C., Yu, J., Li, J., & Chen, X. (2013) · Neurocomputing · doi:10.1016/j.neucom.2013.02.017 · Cited by 31
Self-citation
Cited by
Elharrouss, O., Almaadeed, N., Al-Maadeed, S., & Akbari, Y. (2020) · Neural Processing Letters · doi:10.1007/s11063-019-10163-0 · Cited by 341
Multi-Objective Workflow Scheduling With Deep-Q-Network-Based Multi-Agent Reinforcement Learning
Wang, Y., Liu, H., Zheng, W., Xia, Y., Li, Y., Chen, P., Guo, K., & Xie, H. (2019) · IEEE Access · doi:10.1109/access.2019.2902846 · Cited by 288
Towards DeepFake video forensics based on facial textural disparities in multi-color channels
Xia, Z., Qiao, T., Xu, M., Zheng, N., & Xie, S. (2022) · Information Sciences · doi:10.1016/j.ins.2022.06.003 · Cited by 47
Metadata
- Authors
- Yu, J., Tao, D., Wang, M., & Rui, Y.
- Venue
- IEEE Transactions on Cybernetics
- Published
- 2015-04
- Volume
- 45
- Issue
- 4
- Pages
- 767-779
- ISSN
- 2168-2267 (ISSN-L)
- 2168-2275
- OpenAlex
- W2123432324
- Cited by
- 445
- References
- 47
- FWCI
- 105.40
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.