The DOI matches its Crossref record; 189 of the 189 references it cites were found in a registry or an index.
A Deep Look into neural ranking models for information retrieval
Open accessAbstract
Abstract Ranking models lie at the heart of research on information retrieval (IR). During the past decades, different techniques have been proposed for constructing ranking models, from traditional heuristic methods, probabilistic methods, to modern machine learning methods. Recently, with the advance of deep learning technology, we have witnessed a growing body of work in applying shallow or deep neural networks to the ranking problem in IR, referred to as neural ranking models in this paper. The power of neural ranking models lies in the ability to learn from the raw text inputs for the ranking problem to avoid many limitations of hand-crafted features. Neural networks have sufficient capacity to model complicated tasks, which is needed to handle the complexity of relevance estimation in ranking. Since there have been a large variety of neural ranking models proposed, we believe it is the right time to summarize the current status, learn from existing methodologies, and gain some insights for future development. In contrast to existing reviews, in this survey, we will take a deep look into the neural ranking models from different dimensions to analyze their underlying assumptions, major design principles, and learning strategies. We compare these models through benchmark tasks to obtain a comprehensive empirical understanding of the existing techniques. We will also discuss what is missing in the current literature and what are the promising and desired future directions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213
Advances in Neural Information Processing Systems 25
Zhang, Y., Sutton, C. A., Storkey, A., & Zoubin Ghahramani, A. (2012) · Cited by 12,653
Baeza-Yates, R. A., & Ribeiro-Neto, B. A. (1999) · Cited by 11,505
Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260
A vector space model for automatic indexing
Salton, G., Wong, A., & Yang, C. S. (1975) · Communications of the ACM · doi:10.1145/361219.361220 · Cited by 7,521 · cited 1×
“Many different ranking models have been proposed over the past decades, including vector space models [1], probabilistic models [2], and learning to rank (LTR) models [3, 4].”
BackgroundSQuAD: 100,000+ Questions for Machine Comprehension of Text
Rajpurkar, P., Zhang, J., Lopyrev, K., & Liang, P. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1264 · Cited by 6,208 · cited 1×
“data (e.g., documents or Web pages) [51]. There have been a variety of task formats for QA, including multiple-choice selection [52], answer passage/sentence retrieval [53, 37], answer span locating [54], and answer synthesizing from multiple sources [55]. In this survey, we focus on answer passage/sentence retrieval…”
MethodProceedings of the 19th International Joint Conference on Artificial Intelligence
Pujol, J. M., Delgado, J., Ramon Sangüesa, A., & Flache, A. (2005) · International Joint Conference on Artificial Intelligence · Cited by 5,771
Proceedings of the 25th international conference on Machine learning
Cohen, W. W., McCallum, A., & Roweis, S. T. (2008) · Cited by 5,691
Optimizing search engines using clickthrough data
Joachims, T. (2002) · Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/775047.775067 · Cited by 3,873
Advances in Neural Information Processing Systems 20
Bonilla, E. V., Chai, K. M. A., & Williams, C. K. I. (2008) · neural information processing systems · Cited by 2,846
Learning to rank using gradient descent
Burges, C., Shaked, T., Renshaw, E., Lazier, A., Deeds, M., Hamilton, N., & Hullender, G. (2005) · Proceedings of the 22nd international conference on Machine learning - ICML '05 · doi:10.1145/1102351.1102363 · Cited by 2,836
MS MARCO: A Human Generated MAchine Reading COmprehension Dataset
Bajaj, P., Campos, D., Craswell, N., Deng, L., Gao, J., Liu, X., Majumder, R., McNamara, A., Mitra, B., Nguyen, T., et al. (2016) · arXiv · doi:10.48550/arxiv.1611.09268 · Cited by 2,473
Deep Neural Networks for Acoustic Modeling in Speech Recognition
Hinton, G. E., Deng, L., Yu, D., Dahl, G. E., Mohamed, A., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T. N., et al. (2012) · IEEE Signal Processing Magazine · Cited by 2,115
Relevance weighting of search terms
Robertson, S. E., & Jones, K. S. (1976) · Journal of the American Society for Information Science · doi:10.1002/asi.4630270302 · Cited by 2,081
Learning deep structured semantic models for web search using clickthrough data
Huang, P.-S., He, X., Gao, J., Deng, L., Acero, A., & Heck, L. (2013) · Proceedings of the 22nd ACM international conference on Information & Knowledge Management · doi:10.1145/2505515.2505665 · Cited by 2,009
Learning to rank for information retrieval
Liu, T.-Y. (2010) · Proceedings of the 33rd international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1835449.1835676 · Cited by 1,856
Proceedings for the 5th International Conference on Learning Representations
Srivastava, A., & Sutton, C. A. (2017) · Cited by 1,837
A language modeling approach to information retrieval
Ponte, J. M., & Croft, W. B. (1998) · Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/290941.291008 · Cited by 1,821
Self-citationLearning to Rank for Information Retrieval
Liu, T.-Y. (2009) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000016 · Cited by 1,568
The vocabulary problem in human-system communication
Furnas, G. W., Landauer, T. K., Gomez, L. M., & Dumais, S. T. (1987) · Communications of the ACM · doi:10.1145/32206.32212 · Cited by 1,504
Some Simple Effective Approximations to the 2-Poisson Model for Probabilistic Weighted Retrieval
Robertson, S. E., & Walker, S. (1994) · SIGIR ’94 · doi:10.1007/978-1-4471-2099-5_24 · Cited by 1,477
Relevance-Based Language Models
Lavrenko, V., & Croft, W. B. (2017) · ACM SIGIR Forum · doi:10.1145/3130348.3130376 · Cited by 1,422
Self-citationSalakhutdinov, R., & Hinton, G. (2009) · International Journal of Approximate Reasoning · doi:10.1016/j.ijar.2008.11.006 · Cited by 1,246 · cited 1×
“Note that at the same time or even before this work, there were a number of studies focused on learning low-dimensional representations of texts with neural models [15, 16] and using them either within traditional IR models or with some new similarity metrics for ranking tasks.”
BackgroundConvolutional Neural Network Architectures for Matching Natural Language Sentences
Hu, B., Lu, Z., Li, H., & Chen, Q. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1503.03244 · Cited by 1,098
From RankNet to LambdaRank to LambdaMART: An Overview
Burges, C. J. C. (2010) · Cited by 1,011
The Case for Learned Index Structures
Kraska, T., Beutel, A., Chi, E. H., Dean, J., & Polyzotis, N. (2018) · Proceedings of the 2018 International Conference on Management of Data · doi:10.1145/3183713.3196909 · Cited by 956
WikiQA: A Challenge Dataset for Open-Domain Question Answering
Yang, Y., Yih, W.-T., & Meek, C. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1237 · Cited by 829
Neural Network Methods for Natural Language Processing
Goldberg, Y. (2017) · Synthesis Lectures on Human Language Technologies · doi:10.1007/978-3-031-02165-7 · Cited by 821
Deep Learning for Content-Based Image Retrieval: A Comprehensive Study
Wan, J., Wang, D., Hoi, S. C. H., Wu, P., Zhu, J., Zhang, Y., & Li, J. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654948 · Cited by 811
A Deep Relevance Matching Model for Ad-hoc Retrieval
Guo, J., Fan, Y., Ai, Q., & Croft, W. B. (2016) · Proceedings of the 25th ACM International on Conference on Information and Knowledge Management · doi:10.1145/2983323.2983769 · Cited by 806
Self-citationThe Ubuntu Dialogue Corpus: A Large Dataset for Research in Unstructured Multi-Turn Dialogue Systems
Lowe, R., Pow, N., Serban, I., & Pineau, J. (2015) · Proceedings of the 16th Annual Meeting of the Special Interest Group on Discourse and Dialogue · doi:10.18653/v1/w15-4640 · Cited by 748
Bilateral Multi-Perspective Matching for Natural Language Sentences
Wang, Z., Hamza, W., & Florian, R. (2017) · Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/579 · Cited by 739
Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics
Heafield, K. (2016) · The Association for Computational Linguistics · Cited by 731
Proceedings of the 22nd ACM international conference on Multimedia
(2014) · doi:10.1145/2647868 · Cited by 725
Learning to Rank Short Text Pairs with Convolutional Deep Neural Networks
Severyn, A., & Moschitti, A. (2015) · Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/2766462.2767738 · Cited by 722
Listwise approach to learning to rank: theory and algorithm
Xia, F., Liu, T.-Y., Wang, J., Zhang, W., & Li, H. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390306 · Cited by 702
Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence
Chen, Y., Diethe, T., & Flach, P. A. (2016) · National Conference on Artificial Intelligence · Cited by 680
SQuAD: 100,000+ Questions for Machine Comprehension of Text
Rajpurkar, P., Zhang, J., Lopyrev, K., & Liang, P. (2016) · arXiv · doi:10.48550/arxiv.1606.05250 · Cited by 678
Koehn, P., & Hoang, H. T. (2007) · The Association for Computational Linguistics · Cited by 673
A Latent Semantic Model with Convolutional-Pooling Structure for Information Retrieval
Shen, Y., He, X., Gao, J., Deng, L., & Mesnil, G. (2014) · Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management · doi:10.1145/2661829.2661935 · Cited by 661
Proceedings of the 24th International Conference on Artificial Intelligence
Yang, Q., & Wooldridge, M. (2015) · International Conference on Artificial Intelligence · Cited by 661
Proceedings of the 25th International Conference on World Wide Web
Jacqueline Bourdeau, B., Hendler, J., Nkambou, R., Horrocks, I. R., & Zhao, B. Y. (2016) · Cited by 635
Palangi, H., Deng, L., Shen, Y., Gao, J., He, X., Chen, J., Song, X., & Ward, R. (2016) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2016.2520371 · Cited by 618
MCTest: A Challenge Dataset for the Open-Domain Machine Comprehension of Text
Richardson, M., Burges, C. J. C., & Renshaw, E. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1020 · Cited by 610
Data-Driven Response Generation in Social Media
Ritter, A., Cherry, C., & Dolan, W. B. (2011) · NPARC · Cited by 565
End-to-End Neural Ad-hoc Ranking with Kernel Pooling
Xiong, C., Dai, Z., Callan, J., Liu, Z., & Power, R. (2017) · Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3077136.3080809 · Cited by 546
Text Matching as Image Recognition
Pang, L., Lan, Y., Guo, J., Xu, J., Wan, S., & Cheng, X. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10341 · Cited by 526
Self-citationWu, Y., Wu, W., Xing, C., Zhou, M., & Li, Z. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1046 · Cited by 506
Proceedings of the 21st International Conference on World Wide Web
Mille, A., Gandon, F. L., Misselis, J., Rabinovich, M., & Staab, S. (2012) · Cited by 484
Proceedings of The 12th International Workshop on Semantic Evaluation
(2018) · doi:10.18653/v1/2026.semeval-1 · Cited by 452
Context-sensitive information retrieval using implicit feedback
Shen, X., Tan, B., & Zhai, C. (2005) · Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1076034.1076045 · Cited by 436
Building a question answering test collection
Voorhees, E. M., & Tice, D. M. (2000) · Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/345508.345577 · Cited by 435
Learning to Match using Local and Distributed Representations of Text for Web Search
Mitra, B., Diaz, F., & Craswell, N. (2017) · Proceedings of the 26th International Conference on World Wide Web · doi:10.1145/3038912.3052579 · Cited by 426
A Knowledge-Grounded Neural Conversation Model
Ghazvininejad, M., Brockett, C., Chang, M.-W., Dolan, B., Gao, J., Yih, W.-T., & Galley, M. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11977 · Cited by 422
What is the Jeopardy Model? A Quasi-Synchronous Grammar for QA
Wang, M., Smith, N. A., & Mitamura, T. (2007) · Cited by 396
Liu, X., Gao, J., He, X., Deng, L., Duh, K., & Wang, Y.-Y. (2015) · Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.3115/v1/n15-1092 · Cited by 395
Proceedings of the 2019 International Conference on Management of Data
(2019) · doi:10.1145/3299869 · Cited by 392
Applying deep learning to answer selection: A study and an open task
Feng, M., Xiang, B., Glass, M. R., Wang, L., & Zhou, B. (2015) · 2015 IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru.2015.7404872 · Cited by 357
A Long Short-Term Memory Model for Answer Sentence Selection in Question Answering
Wang, D., & Nyberg, E. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 2: Short Papers) · doi:10.3115/v1/p15-2116 · Cited by 353
Convolutional Neural Networks for Soft-Matching N-Grams in Ad-hoc Search
Dai, Z., Xiong, C., Callan, J., & Liu, Z. (2018) · Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining · doi:10.1145/3159652.3159659 · Cited by 341
Deep Learning for Answer Sentence Selection
Yu, L., Hermann, K. M., Blunsom, P., & Pulman, S. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.1632 · Cited by 340
Learning to Respond with Deep Neural Networks for Retrieval-Based Human-Computer Conversation System
Yan, R., Song, Y., & Wu, H. (2016) · Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval · doi:10.1145/2911451.2911542 · Cited by 338
SoftRank: optimizing non-smooth rank metrics
Taylor, M., Guiver, J., Robertson, S., & Minka, T. (2008) · Proceedings of the international conference on Web search and web data mining - WSDM '08 · doi:10.1145/1341531.1341544 · Cited by 322
A Deep Architecture for Semantic Matching with Multiple Positional Sentence Representations
Wan, S., Lan, Y., Guo, J., Xu, J., Pang, L., & Cheng, X. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10342 · Cited by 322
Self-citationModeling the impact of short- and long-term behavior on search personalization
Bennett, P. N., White, R. W., Chu, W., Dumais, S. T., Bailey, P., Borisyuk, F., & Cui, X. (2012) · Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/2348283.2348312 · Cited by 300
Järvelin, K., Beaulieu, M., Baeza-Yates, R. A., & Myaeng, S. H. (2002) · Cited by 287
Convolutional neural tensor network architecture for community-based question answering
Qiu, X., & Huang, X. (2015) · International Conference on Artificial Intelligence · Cited by 284
Proceedings of the 22nd ACM international conference on Information & Knowledge Management
He, Q., Iyengar, A., Nejdl, W., Pei, J., & Rastogi, R. R. (2013) · Cited by 281
An Information Retrieval Approach to Short Text ConversationPreprint
Ji, Z., Lu, Z., & Li, H. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1408.6988 · Cited by 277
Zhao, Z., Du, L., Börschinger, B., Pate, J. K., Ciaramita, M., Steedman, M. J., & Johnson, M. (2015) · The Association for Computational Linguistics · Cited by 275
Question Answering Using Enhanced Lexical Semantic Models
Yih, W.-T., Chang, M., Meek, C., & Pastusiak, A. (2013) · Cited by 270
Learning to Rank for Information Retrieval and Natural Language Processing
Li, H. (2011) · Synthesis lectures on human language technologies · doi:10.2200/s00348ed1v01y201104hlt012 · Cited by 249
A Deep Architecture for Matching Short Texts
Lu, Z., & Li, H. (2013) · Cited by 225
Multi-view Response Selection for Human-Computer Conversation
Zhou, X., Dong, D., Wu, H., Zhao, S., Yu, D., Tian, H., Liu, X., & Yan, R. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1036 · Cited by 224
Neural Models for Information RetrievalPreprint
Mitra, B., & Craswell, N. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.01509 · Cited by 215
Personalizing web search using long term browsing history
Matthijs, N., & Radlinski, F. (2011) · Proceedings of the fourth ACM international conference on Web search and data mining · doi:10.1145/1935826.1935840 · Cited by 200
Question Answering in Restricted Domains: An Overview
Mollá, D., & Vicedo, J. L. (2007) · Computational Linguistics · doi:10.1162/coli.2007.33.1.41 · Cited by 197
DeepRank: A New Deep Architecture for Relevance Ranking in Information Retrieval
Pang, L., Lan, Y., Guo, J., Xu, J., Xu, J., & Cheng, X. (2017) · Proceedings of the 2017 ACM on Conference on Information and Knowledge Management · doi:10.1145/3132847.3132914 · Cited by 197
Self-citationInner Attention based Recurrent Neural Networks for Answer Selection
Wang, B., Liu, K., & Zhao, J. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1122 · Cited by 194
SemEval-2017 Task 3: Community Question Answering
Nakov, P., Hoogeveen, D., Màrquez, L., Moschitti, A., Mubarak, H., Baldwin, T., & Verspoor, K. (2017) · Proceedings of the 11th International Workshop on Semantic Evaluation (SemEval-2017) · doi:10.18653/v1/s17-2003 · Cited by 188
CQArank: jointly model topics and expertise in community question answering
Yang, L., Qiu, M., Gottipati, S., Zhu, F., Jiang, J., Sun, H., & Chen, Z. (2013) · Proceedings of the 22nd ACM international conference on Information & Knowledge Management · doi:10.1145/2505515.2505720 · Cited by 186
Self-citationFrom Neural Re-Ranking to Neural Ranking: Learning a Sparse Representation for Inverted Indexing
Zamani, H., Dehghani, M., Croft, W. B., Learned-Miller, E., & Kamps, J. (2018) · Proceedings of the 27th ACM International Conference on Information and Knowledge Management · doi:10.1145/3269206.3271800 · Cited by 185
Self-citationLiu, Z., Xiong, C., Sun, M., & Liu, Z. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-1223 · Cited by 178
aNMM: Ranking Short Answer Texts with Attention-Based Neural Matching Model
Yang, L., Ai, Q., Guo, J., & Croft, W. B. (2016) · Proceedings of the 25th ACM International on Conference on Information and Knowledge Management · doi:10.1145/2983323.2983818 · Cited by 176
Self-citationSimple Applications of BERT for Ad Hoc Document RetrievalPreprint
Yang, W., Zhang, H., & Lin, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.10972 · Cited by 176
A Dataset for Research on Short-Text Conversations
Wang, H., Lu, Z., Li, H., & Chen, E. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1096 · Cited by 173
Neural information retrieval: at the end of the early years
Onal, K. D., Zhang, Y., Altıngövde, İ. S., Rahman, M. M., Karagöz, P., Braylan, A., Dang, B., Chang, H.-L., Kim, H., McNamara, Q., et al. (2017) · Information Retrieval · doi:10.1007/s10791-017-9321-y · Cited by 165
PACRR: A Position-Aware Neural IR Model for Relevance Matching
Hui, K., Yates, A., Berberich, K., & de Melo, G. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1110 · Cited by 164
Neural Compatibility Modeling with Attentive Knowledge Distillation
Song, X., Feng, F., Han, X., Yang, X., Liu, W., & Nie, L. (2018) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3209978.3209996 · Cited by 163
Context-aware ranking in web search
Xiang, B., Jiang, D., Pei, J., Sun, X., Chen, E., & Li, H. (2010) · Proceedings of the 33rd international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1835449.1835525 · Cited by 162
Match-SRNN: Modeling the Recursive Matching Structure with Spatial RNNPreprint
Wan, S., Lan, Y., Xu, J., Guo, J., Pang, L., & Cheng, X. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1604.04378 · Cited by 162
Self-citationNoise-Contrastive Estimation for Answer Selection with Deep Neural Networks
Rao, J., He, H., & Lin, J. (2016) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/2983323.2983872 · Cited by 158
Ranking Measures and Loss Functions in Learning to Rank
Chen, W., Liu, T., Lan, Y., Ma, Z.-M., & Li, H. (2009) · Cited by 151
Yang, L., Qiu, M., Qu, C., Guo, J., Zhang, Y., Croft, W. B., Huang, J., & Chen, H. (2018) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3209978.3210011 · Cited by 151
Self-citationWord-Entity Duet Representations for Document Ranking
Xiong, C., Callan, J., & Liu, T. (2017) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3077136.3080768 · Cited by 149
Embedding-based Query Language Models
Zamani, H., & Croft, W. B. (2016) · ACM SIGIR International Conference on Theory of Information Retrieval (ICTIR) · doi:10.1145/2970398.2970405 · Cited by 148
Self-citationInferring and using location metadata to personalize web search
Bennett, P. N., Radlinski, F., White, R. W., & Yılmaz, E. (2011) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/2009916.2009938 · Cited by 137
Context- and Content-aware Embeddings for Query Rewriting in Sponsored Search
Grbovic, M., Djuric, N., Radosavljević, V., Silvestri, F., & Bhamidipati, N. L. (2015) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/2766462.2767709 · Cited by 131
Neural Approaches to Conversational AI
Gao, J., Galley, M., & Li, L. (2019) · now publishers, Inc. eBooks · doi:10.1561/9781680835533 · Cited by 130
Learning from the past: answering new questions with past answers
Shtok, A., Dror, G., Maarek, Y., & Szpektor, I. (2012) · International World Wide Web Conference (WWW) · doi:10.1145/2187836.2187939 · Cited by 126
Hui, K., Yates, A., Berberich, K., & de Melo, G. (2018) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3159652.3159689 · Cited by 124
Deep learning for content-based image retrieval: A comprehensive study
Wan, J., Wang, D., Hoi, S. C. H., Wu, P., Zhu, J., Zhang, Y., & Li, J. (2014) · Cited by 117
Yannakoudakis, E. J., Greece, S. 2. A. I. S. C. O. R. A. D. I. I. R. 2. A., Association for Computing Machinery-Digital Library, ACM Special Interest Group on Information Retrieval, & SIGs, A. (2000) · Cited by 115
Multi-task learning for boosting with application to web search ranking
Chapelle, O., Shivaswamy, P. K., Vadrevu, S., Weinberger, K. Q., Zhang, Y., & Tseng, B. L. (2010) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/1835804.1835953 · Cited by 113
Modeling Diverse Relevance Patterns in Ad-hoc Retrieval
Fan, Y., Guo, J., Lan, Y., Xu, J., Zhai, C., & Cheng, X. (2018) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3209978.3209980 · Cited by 109
Self-citationLearning to rank with partially-labeled data
Duh, K., & Kirchhoff, K. (2008) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/1390334.1390379 · Cited by 108
Neural Vector Spaces for Unsupervised Information Retrieval
Gysel, C. V., de Rijke, M., & Kanoulas, E. (2018) · ACM Transactions on Information Systems · doi:10.1145/3196826 · Cited by 107
Analyzing and Characterizing User Intent in Information-seeking Conversations
Qu, C., Yang, L., Croft, W. B., Trippas, J. R., Zhang, Y., & Qiu, M. (2018) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3209978.3210124 · Cited by 106
Self-citationNeural Query Performance Prediction using Weak Supervision from Multiple Signals
Zamani, H., Croft, W. B., & Culpepper, J. S. (2018) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3209978.3210041 · Cited by 99
Self-citationUser Intent Prediction in Information-seeking Conversations
(343012), C. Q., (23752), L. Y., (18370806), W. B. C., Zhang, Y., Trippas, J. R., & Qiu, M. (2024) · Figshare · Cited by 93
Learning to Rank for Information Retrieval and Natural Language Processing
Li, H. (2011) · Synthesis lectures on human language technologies · doi:10.1007/978-3-031-02141-1 · Cited by 91
CQADupStack: A Benchmark Data Set for Community Question-Answering Research
Hoogeveen, D., Verspoor, K. M., & Baldwin, T. (2015) · Australasian Document Computing Symposium · doi:10.1145/2838931.2838934 · Cited by 85
TREC Complex Answer Retrieval Overview.
Dietz, L., Verma, M., Radlinski, F., & Craswell, N. (2017) · Text REtrieval Conference · Cited by 84
A Study of MatchPyramid Models on Ad-hoc RetrievalPreprint
Pang, L., Lan, Y., Guo, J., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.04648 · Cited by 83
Self-citationZhao, L., & Callan, J. (2010) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/1871437.1871474 · Cited by 80
MultiGranCNN: An Architecture for General Matching of Text Chunks on Multiple Levels of Granularity
Yin, W., & Schütze, H. (2015) · doi:10.3115/v1/p15-1007 · Cited by 76
NPRF: A Neural Pseudo Relevance Feedback Framework for Ad-hoc Information Retrieval
Li, C., Sun, Y., He, B., Wang, L., Hui, K., Yates, A., Sun, L., & Xu, J. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1478 · Cited by 73
Knowledge-aware Attentive Neural Network for Ranking Question Answer Pairs
Shen, Y., Deng, Y., Yang, M., Li, Y., Du, N., Fan, W., & Lei, K. (2018) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3209978.3210081 · Cited by 67
Situational Context for Ranking in Personal Search
Zamani, H., Bendersky, M., Wang, X., & Zhang, M. (2017) · International World Wide Web Conference (WWW) · doi:10.1145/3038912.3052648 · Cited by 66
Self-citationWikiPassageQA: A Benchmark Collection for Research on Non-factoid Answer Passage Retrieval
Cohen, D., Yang, L., & Croft, W. B. (2018) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3209978.3210118 · Cited by 58
Self-citationAttention-based Hierarchical Neural Query Suggestion
Chen, W., Cai, F., Chen, H., & de Rijke, M. (2018) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3209978.3210079 · Cited by 56
Pseudo-Relevance Feedback Based on Matrix Factorization
Zamani, H., Dadashkarimi, J., Shakery, A., & Croft, W. B. (2016) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/2983323.2983844 · Cited by 55
Self-citationOff the Beaten Path: Let's Replace Term-Based Retrieval with k-NN Search
Boytsov, L., Novak, D., Malkov, Y., & Nyberg, E. (2016) · Proceedings of the 25th ACM International on Conference on Information and Knowledge Management · doi:10.1145/2983323.2983815 · Cited by 50
Proceedings of the 25th European conference on IR research
Sebastiani, F. (2003) · Cited by 49
Incorporating Loose-Structured Knowledge into LSTM with Recall Gate for Conversation Modeling.
Xu, Z. X., Liu, B., Wang, B., Sun, C., & Wang, X. (2016) · Cited by 47
Overview of the NTCIR-12 Short Text Conversation Task.
Shang, L., Sakai, T., Lu, Z., Li, H., Higashinaka, R., & Miyao, Y. (2016) · NTCIR · Cited by 47
Semi-supervised learning to rank with preference regularization
Szummer, M., & Yılmaz, E. (2011) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/2063576.2063620 · Cited by 45
Proceedings of the 20th Australasian Document Computing Symposium
Park, L. A. F., Park, L. A. F., Karimi, S., Australia, A. '. T. 2. A. D. C. S. 2. P. N., Association for Computing Machinery-Digital Library, ACM Special Interest Group on Information Retrieval, & SIGs, A. (2015) · doi:10.1145/2838931 · Cited by 45
Neural Matching Models for Question Retrieval and Next Question Prediction in ConversationPreprint
Yang, L., Zamani, H., Zhang, Y., Guo, J., & Croft, W. B. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.05409 · Cited by 44
Self-citationMIX: Multi-Channel Information Crossing for Text Matching
Chen, H., Han, F. X., Niu, D., Liu, D., Lai, K., Wu, C., & Xu, Y. (2018) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3219819.3219928 · Cited by 43
Self-citationMulti-Task Learning for Document Ranking and Query Suggestion
Ahmad, W. U., Chang, K.-W., & Wang, H. (2018) · International Conference on Learning Representations · Cited by 41
Knowledge Enhanced Hybrid Neural Network for Text Matching
Wu, Y., Wu, W., Xu, C., & Li, Z. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11949 · Cited by 41
Pseudo test collections for learning web search ranking functions
Asadi, N., Metzler, D., Elsayed, T., & Lin, J. (2011) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/2009916.2010058 · Cited by 40
Evaluating answer passages using summarization measures
Keikha, M., Park, J. H., & Croft, W. B. (2014) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/2600428.2609485 · Cited by 40
Self-citationAvoiding Your Teacher's Mistakes: Training Neural Networks with Controlled Weak SupervisionPreprint
Dehghani, M., Severyn, A., Rothe, S., & Kamps, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.00313 · Cited by 39
MatchZoo: A Toolkit for Deep Text MatchingPreprint
Fan, Y., Pang, L., Hou, J., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.07270 · Cited by 38
Self-citationCross Domain Regularization for Neural Ranking Models using Adversarial Learning
Cohen, D., Mitra, B., Hofmann, K., & Croft, W. B. (2018) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3209978.3210141 · Cited by 37
Self-citationMulti-Perspective Relevance Matching with Hierarchical ConvNets for Social Media Search
Rao, J., Yang, W., Zhang, Y., Türe, F., & Lin, J. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.3301232 · Cited by 36
ComQA: A Community-sourced Dataset for Complex Factoid Question Answering with Paraphrase Clusters
Abujabal, A., Roy, R. S., Yahya, M., & Weikum, G. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1027 · Cited by 34
Sogou-QCL: A New Dataset with Click Relevance Label
Zheng, Y., Fan, Z., Liu, Y., Luo, C., Zhang, M., & Ma, S. (2018) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3209978.3210092 · Cited by 32
ViTOR: Learning to Rank Webpages Based on Visual Features
van den Akker, B., Markov, I., & de Rijke, M. (2019) · International World Wide Web Conference (WWW) · doi:10.1145/3308558.3313419 · Cited by 31
"Shall I Be Your Chat Companion?"
Yan, R., Song, Y., Zhou, X., & Wu, H. R. (2016) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/2983323.2983360 · Cited by 25
Empirical Study of Multi-level Convolution Models for IR Based on Representations and Interactions
Nie, Y., Li, Y., & Nie, J. (2018) · ACM SIGIR International Conference on Theory of Information Retrieval (ICTIR) · doi:10.1145/3234944.3234954 · Cited by 23
Relevance-based Word EmbeddingPreprint
Zamani, H., & Croft, W. B. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.03556 · Cited by 22
Self-citationMulti-Granularity Neural Sentence Model for Measuring Short Text Similarity
Huang, J., Yao, S., Lyu, C., & Ji, D. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-55753-3_28 · Cited by 19
Unbiased Learning to Rank: Theory and Practice
Ai, Q., Mao, J., Liu, Y., & Croft, W. B. (2018) · ACM SIGIR International Conference on Theory of Information Retrieval (ICTIR) · doi:10.1145/3234944.3234980 · Cited by 18
Self-citationRelevance Estimation with Multiple Information Sources on Search Engine Result Pages
Zhang, J., Liu, Y., Ma, S., & Tian, Q. (2018) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3269206.3271673 · Cited by 18
Learning Groupwise Scoring Functions Using Deep Neural NetworksPreprint
Ai, Q., Wang, X., Golbandi, N., Bendersky, M., & Najork, M. (2019) · arXiv (Cornell University) · Cited by 15
Self-citationCohen, D., Foley, J., Zamani, H., Allan, J., & Croft, W. B. (2018) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3209978.3210137 · Cited by 14
Self-citationReport on the SIGIR 2016 Workshop on Neural Information Retrieval (Neu-IR)
Craswell, N., Croft, W. B., Guo, J., Mitra, B., & de Rijke, M. (2017) · ACM SIGIR Forum · doi:10.1145/3053408.3053425 · Cited by 13
Self-citationDeepTileBars: Visualizing Term Distribution for Neural Information Retrieval
Tang, Z., & Yang, G. H. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.3301289 · Cited by 13
Training query filtering for semi-supervised learning to rank with pseudo labels
Zhang, X., He, B., & Luo, T. (2015) · World Wide Web · doi:10.1007/s11280-015-0363-z · Cited by 12
Neu-IR: The SIGIR 2016 Workshop on Neural Information Retrieval
Luukkonen, P., Koskela, M., & Floréen, P. (2016) · Cited by 12
Learning Visual Features from Snapshots for Web Search
Fan, Y., Guo, J., Lan, Y., Xu, J., Pang, L., & Cheng, X. (2017) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3132847.3132943 · Cited by 12
Self-citationSIGIR 2018 Workshop on Learning from Limited or Noisy Data for Information Retrieval
Zamani, H., Dehghani, M., Díaz, F., Li, H., & Craswell, N. (2018) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3209978.3210200 · Cited by 12
Self-citationUnderstanding the Representational Power of Neural Retrieval Models Using NLP Tasks
Cohen, D., O'Connor, B., & Croft, W. B. (2018) · ACM SIGIR International Conference on Theory of Information Retrieval (ICTIR) · doi:10.1145/3234944.3234959 · Cited by 11
Self-citationLiu, X., Wang, C., Leng, Y., & Zhai, C. (2018) · doi:10.1145/3283812.3283815 · Cited by 11
Brenner, E., Zhao, J., Kutiyanawala, A., & Yan, Z. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.07296 · Cited by 6
Joint Learning from Labeled and Unlabeled Data for Information Retrieval
Li, B., Cheng, P., & Jia, L. (2018) · International Conference on Computational Linguistics · Cited by 5
Cited by
Generative artificial intelligence as a new context for management theories: analysis of ChatGPT
Korzynski, P., Mazurek, G., Altmann, A., Ejdys, J., Kazlauskaite, R., Paliszkiewicz, J., Wach, K., & Ziemba, E. (2023) · Central European Management Journal · doi:10.1108/cemj-02-2023-0091 · Cited by 357
Dense Text Retrieval Based on Pretrained Language Models: A Survey
Zhao, W. X., Liu, J., Ren, R., & Wen, J.-R. (2024) · ACM Transactions on Information Systems · doi:10.1145/3637870 · Cited by 211
“We are aware of several closely related surveys or books on dense retrieval [24]–[26], [29], [35].”
BackgroundThe Threat of Offensive AI to Organizations
Mirsky, Y., Demontis, A., Kotak, J., Shankar, R., Gelei, D., Yang, L., Zhang, X., Pintor, M., Lee, W., Elovici, Y., et al. (2023) · Computers & Security · doi:10.1016/j.cose.2022.103006 · Cited by 97
Self-citationNeural Retrievers are Biased Towards LLM-Generated Content
Dai, S., Zhou, Y., Pang, L., Liu, W., Hu, X., Liu, Y., Zhang, X., Wang, G., & Xu, J. (2024) · Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining · doi:10.1145/3637528.3671882 · Cited by 35
Self-citationRecent Advances in Generative Information Retrieval
Tang, Y., Zhang, R., Guo, J., & de Rijke, M. (2023) · Proceedings of the Annual International ACM SIGIR Conference on Research and Development in Information Retrieval in the Asia Pacific Region · doi:10.1145/3624918.3629547 · Cited by 22
Self-citation
Metadata
- Authors
- Guo, J., Fan, Y., Pang, L., Yang, L., Ai, Q., Zamani, H., Wu, C., Croft, W. B., & Cheng, X.
- Venue
- Information Processing & Management
- Publisher
- Elsevier BV
- Published
- 2020-11
- Volume
- 57
- Issue
- 6
- Pages
- 102067
- ISSN
- 0020-0271 (ISSN-L)
- 0306-4573
- OpenAlex
- W2922386288
- Cited by
- 349
- References
- 189
- FWCI
- 55.92
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.