The DOI matches its Crossref record; 146 of the 146 references it cites were found in a registry or an index.
Learning to rank for information retrieval
Abstract
This tutorial is concerned with a comprehensive introduction to the research area of learning to rank for information retrieval. In the first part of the tutorial, we will introduce three major approaches to learning to rank, i.e., the pointwise, pairwise, and listwise approaches, analyze the relationship between the loss functions used in these approaches and the widely-used IR evaluation measures, evaluate the performance of these approaches on the LETOR benchmark datasets, and demonstrate how to use these approaches to solve real ranking applications. In the second part of the tutorial, we will discuss some advanced topics regarding learning to rank, such as relational ranking, diverse ranking, semi-supervised ranking, transfer ranking, query-dependent ranking, and training data preprocessing. In the third part, we will briefly mention the recent advances on statistical learning theory for ranking, which explain the generalization ability and statistical consistency of different ranking methods. In the last part, we will conclude the tutorial and show several future research directions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Nature of Statistical Learning Theory
Vapnik, V. N. (1995) · doi:10.1007/978-1-4757-2440-0 · Cited by 39,138
Wu, Y. (1999) · Technometrics · doi:10.1080/00401706.1999.10485951 · Cited by 27,221
Modern Applied Statistics with S
Venables, W. N., & Ripley, B. D. (2002) · Statistics and Computing · doi:10.1007/978-0-387-21706-2 · Cited by 24,305
A decision-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. E. (1997) · Journal of Computer and System Sciences · doi:10.1006/jcss.1997.1504 · Cited by 20,466
(2005) · Statistics for Biology and Health · doi:10.1007/0-387-27255-0_9 · Cited by 20,133
(1999) · Cited by 12,854
Indexing by latent semantic analysis
Deerwester, S., Dumais, S. T., Furnas, G. W., Landauer, T. K., & Harshman, R. (1990) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(199009)41:6<391::aid-asi1>3.0.co;2-9 · Cited by 12,751
Baeza-Yates, R. A., & Ribeiro-Neto, B. A. (1999) · Cited by 11,505
Authoritative sources in a hyperlinked environment
Kleinberg, J. M. (1999) · Journal of the ACM · doi:10.1145/324133.324140 · Cited by 8,959
A NEW MEASURE OF RANK CORRELATION
KENDALL, M. G. (1938) · Biometrika · doi:10.1093/biomet/30.1-2.81 · Cited by 7,269
Kernel Methods for Pattern Analysis
Shawe-Taylor, J., & Cristianini, N. (2004) · Cambridge University Press eBooks · doi:10.1017/cbo9780511809682 · Cited by 6,587
Cumulated gain-based evaluation of IR techniques
Järvelin, K., & Kekäläinen, J. (2002) · ACM Transactions on Information Systems · doi:10.1145/582415.582418 · Cited by 4,841
Optimizing search engines using clickthrough data
Joachims, T. (2002) · Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/775047.775067 · Cited by 3,873
Learning to rank using gradient descent
Burges, C., Shaked, T., Renshaw, E., Lazier, A., Deeds, M., Hamilton, N., & Hullender, G. (2005) · Proceedings of the 22nd international conference on Machine learning - ICML '05 · doi:10.1145/1102351.1102363 · Cited by 2,836
Relevance feedback in information retrieval
Rocchio, J. J. (1971) · Medical Entomology and Zoology · Cited by 2,680
A Language Modeling Approach to Information Retrieval
Ponte, J. M., & Croft, W. B. (2017) · ACM SIGIR Forum · doi:10.1145/3130348.3130368 · Cited by 2,503
Pfanzagl, J., & Luce, R. D. (1962) · Econometrica · doi:10.2307/1911299 · Cited by 2,469
Robertson, S. E., Walker, S., Jones, S., Hancock‐Beaulieu, M., & Gatford, M. (1994) · Text REtrieval Conference · Cited by 2,212
Pang, B., & Lee, L. (2005) · Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics - ACL '05 · doi:10.3115/1219840.1219855 · Cited by 2,129
Learning to rank: from pairwise approach to listwise approach
Cao, Z., Qin, T., Liu, T.-Y., Tsai, M.-F., & Li, H. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273513 · Cited by 1,960
Self-citationRademacher and Gaussian Complexities: Risk Bounds and Structural Results
Bartlett, P. L., & Mendelson, S. (2001) · Lecture Notes in Computer Science · doi:10.1007/3-540-44581-1_15 · Cited by 1,949
Mining the peanut gallery: opinion extraction and semantic classification of product reviews
Dave, K., Lawrence, S., & Pennock, D. M. (2003) · Proceedings of the twelfth international conference on World Wide Web - WWW '03 · doi:10.1145/775152.775226 · Cited by 1,916
Large Margin Methods for Structured and Interdependent Output Variables
Tsochantaridis, I., Joachims, T., Hofmann, T., & Altün, Y. (2005) · MPG.PuRe (Max Planck Society) · Cited by 1,879
Learning to Rank for Information Retrieval
Liu, T.-Y. (2009) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000016 · Cited by 1,568
Self-citationModern Information Retrieval : A Brief Overview
Singhal, A. (2001) · IEEE Data(base) Engineering Bulletin · Cited by 1,556
A Study of Smoothing Methods for Language Models Applied to Ad Hoc Information Retrieval
Zhai, C., & Lafferty, J. (2017) · ACM SIGIR Forum · doi:10.1145/3130348.3130377 · Cited by 1,537
IR evaluation methods for retrieving highly relevant documents
Järvelin, K., & Kekäläinen, J. (2017) · ACM SIGIR Forum · doi:10.1145/3130348.3130374 · Cited by 1,444
Support Vector Machines for Multiple-Instance Learning
Andrews, S. J., Tsochantaridis, I., & Hofmann, T. (2002) · neural information processing systems · Cited by 1,401
Support vector machine learning for interdependent and structured output spaces
Tsochantaridis, I., Hofmann, T., Joachims, T., & Altun, Y. (2004) · Twenty-first international conference on Machine learning - ICML '04 · doi:10.1145/1015330.1015341 · Cited by 1,243
A study of smoothing methods for language models applied to information retrieval
Zhai, C., & Lafferty, J. (2004) · ACM Transactions on Information Systems · doi:10.1145/984321.984322 · Cited by 1,201
THE PROBABILITY RANKING PRINCIPLE IN IR
ROBERTSON, S. E. (1977) · Journal of Documentation · doi:10.1108/eb026647 · Cited by 1,103
Combating Web Spam with TrustRank
Gyöngyi, Z., Garcia-Molina, H., & Pedersen, J. (2004) · Proceedings 2004 VLDB Conference · doi:10.1016/b978-012088469-8.50052-8 · Cited by 1,085
Large Margin Rank Boundaries for Ordinal Regression
Herbrich, R., Graepel, T., & Obermayer, K. (2000) · Advances in Large-Margin Classifiers · doi:10.7551/mitpress/1113.003.0010 · Cited by 1,074
Improving web search ranking by incorporating user behavior information
Agichtein, E., Brill, E., & Dumais, S. (2006) · Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1148170.1148177 · Cited by 1,041
On Relevance, Probabilistic Indexing and Information Retrieval
Maron, M. E., & Kuhns, J. L. (1960) · Journal of the ACM · doi:10.1145/321033.321035 · Cited by 907
A Markov random field model for term dependencies
Metzler, D., & Croft, W. B. (2005) · Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1076034.1076115 · Cited by 843
MALLOWS, C. L. (1957) · Biometrika · doi:10.1093/biomet/44.1-2.114 · Cited by 820
Model-based feedback in the language modeling approach to information retrieval
Zhai, C., & Lafferty, J. (2001) · Proceedings of the tenth international conference on Information and knowledge management · doi:10.1145/502585.502654 · Cited by 787
A support vector method for multivariate performance measures
Joachims, T. (2005) · Proceedings of the 22nd international conference on Machine learning - ICML '05 · doi:10.1145/1102351.1102399 · Cited by 786
AdaRank: a boosting algorithm for information retrieval
Xu, J., & Li, H. (2007) · Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1277741.1277809 · Cited by 775
Document Language Models, Query Models, and Risk Minimization for Information Retrieval
Lafferty, J., & Zhai, C. (2017) · ACM SIGIR Forum · doi:10.1145/3130348.3130375 · Cited by 754
(2006) · doi:10.7551/mitpress/7503.003.0029 · Cited by 753
Plackett, R. L. (1975) · Applied Statistics · doi:10.2307/2346567 · Cited by 731
Cox, I. J., Miller, M. L., Minka, T. P., Papathomas, T. V., & Yianilos, P. N. (2000) · IEEE Transactions on Image Processing · doi:10.1109/83.817596 · Cited by 712
A support vector method for optimizing average precision
Yue, Y., Finley, T., Radlinski, F., & Joachims, T. (2007) · Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1277741.1277790 · Cited by 704
Listwise approach to learning to rank: theory and algorithm
Xia, F., Liu, T.-Y., Wang, J., Zhang, W., & Li, H. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390306 · Cited by 702
Self-citationAslam, J. A., & Montague, M. (2001) · Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/383952.384007 · Cited by 684
Adapting ranking SVM to document retrieval
Cao, Y., Xu, J., Liu, T.-Y., Li, H., Huang, Y., & Hon, H.-W. (2006) · Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1148170.1148205 · Cited by 569
Self-citationBeyond Independent Relevance: Methods and Evaluation Metrics for Subtopic Retrieval
Zhai, C., Cohen, W. W., & Lafferty, J. (2015) · ACM SIGIR Forum · doi:10.1145/2795403.2795405 · Cited by 558
Crammer, K., & Singer, Y. (2002) · Advances in Neural Information Processing Systems 14 · doi:10.7551/mitpress/1120.003.0087 · Cited by 538
Analyzing and Modeling Rank Data
Groggel, D. J. (1996) · Technometrics · doi:10.1080/00401706.1996.10484555 · Cited by 521
Gaussian Processes for Ordinal Regression
Chu, W., & Ghahramani, Z. (2005) · Journal of Machine Learning Research · Cited by 514
Learning diverse rankings with multi-armed bandits
Radlinski, F., Kleinberg, R., & Joachims, T. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390255 · Cited by 503
Introduction to Statistical Learning Theory
Bousquet, O., Boucheron, S., & Lugosi, G. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-28650-9_8 · Cited by 503
Query chains: learning to rank from implicit feedback
Radlinski, F., & Joachims, T. (2005) · Proceedings of the eleventh ACM SIGKDD international conference on Knowledge discovery in data mining · doi:10.1145/1081870.1081899 · Cited by 476
Learning user interaction models for predicting web search result preferences
Agichtein, E., Brill, E., Dumais, S., & Ragno, R. (2006) · Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1148170.1148175 · Cited by 462
Support vector learning for ordinal regression
Herbrich, R. (1999) · 9th International Conference on Artificial Neural Networks: ICANN '99 · doi:10.1049/cp:19991091 · Cited by 448
McRank: Learning to Rank Using Multiple Classification and Gradient Boosting
Li, P., Burges, C. J. C., & Wu, Q. (2007) · Cited by 442
LETOR: Benchmark Dataset for Research on Learning to Rank for Information Retrieval
Liu, T., Xu, J., Qin, T., Xiong, W., & Li, H. (2007) · Cited by 419
Self-citationPreference learning with Gaussian processes
Chu, W., & Ghahramani, Z. (2005) · Proceedings of the 22nd international conference on Machine learning - ICML '05 · doi:10.1145/1102351.1102369 · Cited by 361
SoftRank: optimizing non-smooth rank metrics
Taylor, M., Guiver, J., Robertson, S., & Minka, T. (2008) · Proceedings of the international conference on Web search and web data mining - WSDM '08 · doi:10.1145/1341531.1341544 · Cited by 322
Discriminative models for information retrieval
Nallapati, R. (2004) · Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1008992.1009006 · Cited by 285
New approaches to support vector ordinal regression
Chu, W., & Keerthi, S. S. (2005) · Proceedings of the 22nd international conference on Machine learning - ICML '05 · doi:10.1145/1102351.1102370 · Cited by 277
The principle of maximum entropy
Guiasu, S., & Shenitzer, A. (1985) · The Mathematical Intelligencer · doi:10.1007/bf03023004 · Cited by 259
Geng, X., Liu, T.-Y., Qin, T., & Li, H. (2007) · Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1277741.1277811 · Cited by 255
Self-citationQuery type classification for web document retrieval
Kang, I.-H., & Kim, G. (2003) · Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval · doi:10.1145/860435.860449 · Cited by 250
An exploration of proximity measures in information retrieval
Tao, T., & Zhai, C. (2007) · Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1277741.1277794 · Cited by 238
Subset Ranking Using Regression
Cossock, D., & Zhang, T. (2006) · Lecture Notes in Computer Science · doi:10.1007/11776420_44 · Cited by 236
Generalization Bounds for the Area Under the ROC Curve
Agarwal, S., Graepel, T., Herbrich, R., Har-Peled, S., & Roth, D. (2005) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign) · Cited by 235
Ranking algorithms for named-entity extraction: boosting and the voted perceptron
Collins, M. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073165 · Cited by 233
FRank: a ranking method with fidelity loss
Tsai, M.-F., Liu, T.-Y., Qin, T., Chen, H.-H., & Ma, W.-Y. (2007) · Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1277741.1277808 · Cited by 228
Self-citationAdditive versus exponentiated gradient updates for linear prediction
Kivinen, J., & Warmuth, M. K. (1995) · Proceedings of the twenty-seventh annual ACM symposium on Theory of computing - STOC '95 · doi:10.1145/225058.225121 · Cited by 223
A general approximation framework for direct optimization of information retrieval measures
Qin, T., Liu, T.-Y., & Li, H. (2010) · Information Retrieval · doi:10.1007/s10791-009-9124-x · Cited by 213
Self-citationA regression framework for learning ranking functions using relative relevance judgments
Zheng, Z., Chen, K., Sun, G., & Zha, H. (2007) · Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1277741.1277792 · Cited by 204
Evaluating Retrieval Performance Using Clickthrough Data.
Joachims, T. (2003) · Cited by 193
A General Boosting Method and its Application to Learning Ranking Functions for Web Search
Zheng, Z., Hongyuan Zha, B., Zhang, T., Chapelle, O., Chen, K., & Sun, G. (2007) · CORE Scholar (Wright State University) · Cited by 184
Overview of the Okapi projects
Robertson, S. E. (1997) · Journal of Documentation · doi:10.1108/eum0000000007186 · Cited by 182
Cranking: Combining Rankings Using Conditional Probability Models on Permutations
Lebanon, G., & Lafferty, J. (2002) · Cited by 173
Fast generation of result snippets in web search
Turpin, A., Tsegay, Y., Hawking, D., & Williams, H. E. (2007) · Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1277741.1277766 · Cited by 167
Probabilistic retrieval based on staged logistic regression
Cooper, W. S., Gey, F. C., & Dabney, D. P. (1992) · Proceedings of the 15th annual international ACM SIGIR conference on Research and development in information retrieval - SIGIR '92 · doi:10.1145/133160.133199 · Cited by 167
Predicting diverse subsets using structural SVMs
Yue, Y., & Joachims, T. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390310 · Cited by 166
Query dependent ranking using K-nearest neighbor
Geng, X., Liu, T.-Y., Qin, T., Arnold, A., Li, H., & Shum, H.-Y. (2008) · Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1390334.1390356 · Cited by 165
Self-citationLiu, Y.-T., Liu, T.-Y., Qin, T., Ma, Z.-M., & Li, H. (2007) · Proceedings of the 16th international conference on World Wide Web · doi:10.1145/1242572.1242638 · Cited by 164
Self-citationChirita, P., Diederich, J., & Nejdl, W. (2005) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/1099554.1099671 · Cited by 156
Active exploration for learning rankings from clickthrough data
Radlinski, F., & Joachims, T. (2007) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/1281192.1281254 · Cited by 156
A risk minimization framework for information retrieval
Zhai, C., & Lafferty, J. (2005) · Information Processing & Management · doi:10.1016/j.ipm.2004.11.003 · Cited by 154
Overview of the TREC 2003 Web Track.
Craswell, N., Hawking, D., Wilkinson, R. G., & Wu, M. (2002) · Text REtrieval Conference · Cited by 153
Ranking and empirical minimization of U-statisticsPreprint
Clémençon, S., Lugosi, G., & Vayatis, N. (2006) · arXiv (Cornell University) · Cited by 152
Optimum polynomial retrieval functions based on the probability ranking principle
Fuhr, N. (1989) · ACM Transactions on Information Systems · doi:10.1145/65943.65944 · Cited by 145
Query-level loss functions for information retrieval
Qin, T., Zhang, X., Tsai, M.-F., Wang, D., Liu, T., & Li, H. (2007) · Information Processing & Management · doi:10.1016/j.ipm.2007.07.016 · Cited by 144
Self-citationDirectly optimizing evaluation measures in learning to rank
Xu, J., Liu, T., Lu, M., Li, H., & Ma, W. (2008) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/1390334.1390355 · Cited by 134
Self-citationHigh accuracy retrieval with multiple nested ranker
Matveeva, I. V., Burges, C. J. C., Burkard, T., Laucius, A., & Wong, L. (2006) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/1148170.1148246 · Cited by 133
Prediction of Ordinal Classes Using Regression Trees
Krämer, S., Widmer, G., Pfahringer, B., & de Groeve, M. (2000) · Lecture notes in computer science · doi:10.1007/3-540-39963-1_45 · Cited by 128
The effects of fitness functions on genetic programming‐based ranking discovery for Web search
Fan, W., Fox, E. A., Pathak, P., & Wu, H. (2004) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20009 · Cited by 126
Optimisation methods for ranking functions with multiple parameters
Taylor, M. J. H., Zaragoza, H., Craswell, N., Robertson, S. E., & Burges, C. J. C. (2006) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/1183614.1183698 · Cited by 122
Global Ranking Using Continuous Conditional Random Fields
Qin, T., Liu, T., Zhang, X., Wang, D., & Li, H. (2008) · Cited by 122
Self-citationTopical link analysis for web search
Nie, L., Davison, B. D., & Qi, X. (2006) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/1148170.1148189 · Cited by 121
SVM selective sampling for ranking with application to data retrieval
Yu, H. (2005) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/1081870.1081911 · Cited by 120
A generic ranking function discovery framework by genetic programming for information retrieval
Fan, W., Gordon, M. D., & Pathak, P. (2003) · Information Processing & Management · doi:10.1016/j.ipm.2003.08.001 · Cited by 119
Magnitude-preserving ranking algorithms
Cortes, C., Mohri, M., & Rastogi, A. K. (2007) · International Conference on Machine Learning · doi:10.1145/1273496.1273518 · Cited by 119
Structured learning for non-smooth ranking losses
Chakrabarti, S., Khanna, R., Sawant, U., & Bhattacharyya, C. (2008) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/1401890.1401906 · Cited by 119
Ranking with multiple hyperplanes
Qin, T., Zhang, X., Wang, D., Liu, T., Lai, W., & Li, H. (2007) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/1277741.1277791 · Cited by 112
Self-citationTrotman, A. (2005) · Information Retrieval · doi:10.1007/s10791-005-6991-7 · Cited by 111
Learning to Rank for Information Retrieval Using Genetic Programming
Yeh, J. Y., Lin, J. Y., Ke, H., & Yang, W. (2007) · Cited by 110
Inferring probability of relevance using the method of logistic regression
Gey, F. C. (1994) · doi:10.5555/188490.188560 · Cited by 108
Learning to rank with partially-labeled data
Duh, K., & Kirchhoff, K. (2008) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/1390334.1390379 · Cited by 108
Evaluation over thousands of queries
Carterette, B., Pavlu, V., Kanoulas, E., Aslam, J. A., & Allan, J. (2008) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/1390334.1390445 · Cited by 104
A study of relevance propagation for web search
Qin, T., Liu, T., Zhang, X., Chen, Z., & Ma, W. (2005) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/1076034.1076105 · Cited by 104
Self-citationLinear discriminant model for information retrieval
Gao, J., Qi, H., Xia, X., & Nie, J. (2005) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/1076034.1076085 · Cited by 96
Exploiting the hierarchical structure for link analysis
Xue, G.-R., Yang, Q., Zeng, H.-J., Yu, Y., & Chen, Z. (2005) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/1076034.1076068 · Cited by 89
Online ranking/collaborative filtering using the perceptron algorithm
Harrington, E. (2003) · Cited by 89
Unsupervised rank aggregation with distance-based models
Klementiev, A., Roth, D., & Small, K. (2008) · International Conference on Machine Learning · doi:10.1145/1390156.1390216 · Cited by 89
Fan, W., Gordon, M. D., & Pathak, P. (2004) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2004.1269663 · Cited by 88
Learning to rank at query-time using association rules
Veloso, A., de Almeida, H. M., Gonçalves, M. A., & Meira, W. (2008) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/1390334.1390381 · Cited by 81
Genetic Programming-Based Discovery of Ranking Functions for Effective Web Search
Fan, W., Gordon, M. D., Pathak, P., & Pathak, P. (2005) · Journal of Management Information Systems · doi:10.1080/07421222.2005.11045828 · Cited by 78
Ranking the best instancesPreprint
Clémençon, S., & Vayatis, N. (2006) · arXiv (Cornell University) · doi:10.48550/arxiv.math/0611133 · Cited by 78
Stability and Generalization of Bipartite Ranking Algorithms
Agarwal, S., & Niyogi, P. (2005) · Lecture notes in computer science · doi:10.1007/11503415_3 · Cited by 77
Learning to rank relational objects and its application to web search
Qin, T., Liu, T., Zhang, X., Wang, D., Xiong, W., & Li, H. (2008) · International World Wide Web Conference (WWW) · doi:10.1145/1367497.1367553 · Cited by 77
Self-citationde Almeida, H. M., Gonçalves, M. A., de Cristo, M. A. P., & Calado, P. P. (2007) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/1277741.1277810 · Cited by 76
An Unsupervised Learning Algorithm for Rank Aggregation
Klementiev, A., Roth, D., & Small, K. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-74958-5_60 · Cited by 75
Learning to rank with SoftRank and Gaussian processes
Guiver, J., & Snelson, E. (2008) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/1390334.1390380 · Cited by 65
A boosting algorithm for learning bipartite ranking functions with partially labeled data
Amini, M.-R., Truong, T. V., & Goutte, C. (2008) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/1390334.1390354 · Cited by 64
A study of parameter tuning for term frequency normalization
He, B., & Ounis, I. (2003) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/956863.956867 · Cited by 64
Generalization analysis of listwise learning-to-rank algorithms
Lan, Y., Liu, T., Ma, Z.-M., & Li, H. (2009) · International Conference on Machine Learning · doi:10.1145/1553374.1553449 · Cited by 57
Self-citationLearning effective ranking functions for newsgroup search
Xi, W., Lind, J., & Brill, E. (2004) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/1008992.1009060 · Cited by 53
Relevance Propagation for Topic Distillation UIUC TREC 2003 Web Track Experiments.
Shakery, A., & Zhai, C. (2003) · Text REtrieval Conference · Cited by 51
Learning to Rank Using Classification and Gradient Boosting
Li, P., Burges, C. J. C., & Wu, Q. (2008) · Cited by 51
Learning query-biased web page summarization
Wang, C., Jing, F., Zhang, L., & Zhang, H.-J. (2007) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/1321440.1321518 · Cited by 50
On rank-based effectiveness measures and optimization
Robertson, S. E., & Zaragoza, H. (2007) · Information Retrieval · doi:10.1007/s10791-007-9025-9 · Cited by 43
Fast learning of document ranking functions with the committee perceptron
Elsas, J. L., Carvalho, V. R., & Carbonell, J. (2008) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/1341531.1341542 · Cited by 42
Zhou, K., Xue, G.-R., Hongyuan Zha, B., & Yu, Y. H. (2008) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/1390334.1390382 · Cited by 41
Query-level stability and generalization in learning to rank
Lan, Y., Liu, T., Qin, T., Ma, Z.-M., & Li, H. (2008) · International Conference on Machine Learning · doi:10.1145/1390156.1390221 · Cited by 38
Self-citationRanking refinement and its application to information retrieval
Jin, R., Valizadegan, H., & Li, H. (2008) · International World Wide Web Conference (WWW) · doi:10.1145/1367497.1367552 · Cited by 36
Cohen, W. W., Schapire, R. E., & Singer, Y. (2011) · doi:10.48550/arxiv.1105.5464 · Cited by 35
Cost-Sensitive Learning of SVM for Ranking
Xu, J., Cao, Y., Li, H., & Huang, Y. (2006) · Lecture notes in computer science · doi:10.1007/11871842_86 · Cited by 33
Generalization error bounds for classifiers trained with interdependent data
Usunier, N., Amini, M.-R., & Gallinari, P. (2005) · Cited by 33
Ranking function optimization for effective Web search by genetic programming: an empirical study
Fan, W., Gordon, M. D., Pathak, P., Xi, W., & Fox, E. A. (2004) · Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.2004.1265279 · Cited by 33
Learning Rankings via Convex Hull Separation
Fung, G., Rosales, R., & Krishnapuram, B. (2005) · Cited by 31
On linear mixture of expert approaches to information retrieval
Fan, W., Gordon, M., & Pathak, P. (2004) · Decision Support Systems · doi:10.1016/j.dss.2004.11.014 · Cited by 29
Selection Bias in the LETOR Datasets
Minka, T. (2008) · Cited by 25
Query-level learning to rank using isotonic regression
Zheng, Z., Hongyuan Zha, B., & Sun, G. (2008) · Allerton Conference on Communication, Control, and Computing · doi:10.1109/allerton.2008.4797684 · Cited by 24
Direct Maximization of Rank-Based Metrics for Information Retrieval
Metzler, D., Croft, W. B., & McCallum, A. (2005) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 20
Learning to Search Web Pages with Query-Level Loss Functions
Qin, T., Liu, T., Tsai, M.-F., Zhang, X., & Li, H. (2006) · Cited by 16
Self-citationHow to Make LETOR More Useful and Reliable
Qin, T., Liu, T., Xu, J., & Li, H. (2008) · Cited by 14
Self-citationA Decision Theoretic Framework for Ranking using Implicit Feedback
Zoeter, O. R., Taylor, M. J. H., Snelson, E., Guiver, J., Craswell, N., & Szummer, M. (2008) · Cited by 8
Learning to Rank Documents for Ad-Hoc Retrieval with Regularized Models
Cao, G., Nie, J., Si, L., & Bai, J. (2007) · Cited by 7
Cited by
Survey on deep learning with class imbalance
Johnson, J. M., & Khoshgoftaar, T. M. (2019) · Journal of Big Data · doi:10.1186/s40537-019-0192-5 · Cited by 3,032
Deep Learning for Anomaly Detection: A Review
Pang, G., Shen, C., Cao, L., & Hengel, A. V. D. (2022) · ACM Computing Surveys · doi:10.1145/3439950 · Cited by 2,837
Learning to rank: from pairwise approach to listwise approach
Cao, Z., Qin, T., Liu, T.-Y., Tsai, M.-F., & Li, H. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273513 · Cited by 1,960
Self-citationHeterogeneous Graph Transformer
Hu, Z., Dong, Y., Wang, K., & Sun, Y. (2020) · Proceedings of The Web Conference 2020 · doi:10.1145/3366423.3380027 · Cited by 1,646
Interactive machine learning for health informatics: when do we need the human-in-the-loop?
Holzinger, A. (2016) · Brain Informatics · doi:10.1007/s40708-016-0042-6 · Cited by 906
Metadata
- Authors
- Liu, T.-Y.
- Venue
- Proceedings of the 33rd international ACM SIGIR conference on Research and development in information retrieval
- Publisher
- ACM
- Published
- 2010-07-19
- Pages
- 904-904
- OpenAlex
- W1973435495
- Cited by
- 1,856
- References
- 146
- FWCI
- 88.60
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.