Multi-Stage Conversational Passage Retrieval: An Approach to Fusing Term Importance Estimation and Neural Query Rewriting
Open accessAbstract
Conversational search plays a vital role in conversational information seeking. As queries in information seeking dialogues are ambiguous for traditional ad-hoc information retrieval (IR) systems due to the coreference and omission resolution problems inherent in natural language dialogue, resolving these ambiguities is crucial. In this paper, we tackle conversational passage retrieval (ConvPR), an important component of conversational search, by addressing query ambiguities with query reformulation integrated into a multi-stage ad-hoc IR system. Specifically, we propose two conversational query reformulation (CQR) methods: (1) term importance estimation and (2) neural query rewriting. For the former, we expand conversational queries using important terms extracted from the conversational context with frequency-based signals. For the latter, we reformulate conversational queries into natural, standalone, human-understandable queries with a pretrained sequence-tosequence model. Detailed analyses of the two CQR methods are provided quantitatively and qualitatively, explaining their advantages, disadvantages, and distinct behaviors. Moreover, to leverage the strengths of both CQR methods, we propose combining their output with reciprocal rank fusion, yielding state-of-the-art retrieval effectiveness, 30% improvement in terms of NDCG@3 compared to the best submission of TREC CAsT 2019.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The normalised discounted cumulative gain (NDCG) retrieval metric may provide a solution for ranking subject descriptors in an automated subject indexing system.
“The normalised discounted cumulative gain (NDCG) retrieval metric may provide a solution for ranking subject descriptors in an automated subject indexing system 23 .”
From Automated Knowledge Organization AI ML based Subject Indexing System for Libraries (2023) · cites this paper as [23]
Section 6.1 (page unavailable) reports NDCG@3 as an evaluation metric for ranked conversational-search passages. The passages found when searching for subject descriptors and automated subject indexing do not address whether NDCG could rank descriptors in such a system. (LLM, conf=0.75)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
(2008) · Journal of Machine Learning Research · Cited by 33,051 · see citing works
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545 · see citing works
Pan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387 · see citing works
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929 · see citing works
Relevance based language models
Lavrenko, V. P., & Croft, W. B. (2001) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/383952.383972 · Cited by 1,042 · see citing works
Query expansion using local and global document analysis
Xu, J., & Croft, W. B. (1996) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/243199.243202 · Cited by 832 · see citing works
Reciprocal rank fusion outperforms condorcet and individual rank learning methods
Cormack, G. V., Clarke, C. L. A., & Buettcher, S. (2009) · Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1571941.1572114 · Cited by 797 · see citing works
QuAC: Question Answering in Context
Choi, E., He, H., Iyyer, M., Yatskar, M., Yih, W.-T., Choi, Y., Liang, P., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1241 · Cited by 714 · cited 3× · see citing works
“Most QA research [26, 40, 50, 56, 59], including conversational QA studies [10, 41], focuses on a restricted version of the open-domain QA problem posed in [8, 18, 20]: returning answers from a finite set of relevant documents—a relevant article [40, 56] or multi-hop hyperlinked documents [58].”
BackgroundCronen-Townsend, S., Zhou, Y., & Croft, W. B. (2002) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/564376.564429 · Cited by 670 · see citing works
Using Pre-Training Can Improve Model Robustness and UncertaintyPreprint
Hendrycks, D., Lee, K., & Mazeika, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.09960 · Cited by 531 · see citing works
Open Domain Question Answering Using Early Fusion of Knowledge Bases and Text
Sun, H., Dhingra, B., Zaheer, M., Mazaitis, K., Salakhutdinov, R., & Cohen, W. W. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1455 · Cited by 510 · see citing works
A Hierarchical Recurrent Encoder-Decoder for Generative Context-Aware Query Suggestion
Sordoni, A., Bengio, Y., Vahabi, H., Lioma, C., Simonsen, J. G., & Nie, J. (2015) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/2806416.2806493 · Cited by 482 · see citing works
A Theoretical Framework for Conversational Search
Radlinski, F., & Craswell, N. (2017) · Conference on Human Information Interaction and Retrieval · doi:10.1145/3020165.3020183 · Cited by 473 · see citing works
Deeper Text Understanding for IR with Contextual Neural Language Modeling
Dai, Z., & Callan, J. (2019) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3331184.3331303 · Cited by 423 · see citing works
Asking Clarifying Questions in Open-Domain Information-Seeking Conversations
Aliannejadi, M., Zamani, H., Crestani, F., & Croft, W. B. (2019) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3331184.3331265 · Cited by 317 · see citing works
Nematus: a Toolkit for Neural Machine Translation
Sennrich, R., Fırat, O., Cho, K., Birch, A., Haddow, B., Hitschler, J., Junczys-Dowmunt, M., Läubli, S., Barone, A. V. M., Mokry, J., et al. (2017) · doi:10.18653/v1/e17-3017 · Cited by 291 · see citing works
Query performance prediction in web search environments
Zhou, Y., & Croft, W. B. (2007) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/1277741.1277835 · Cited by 269 · see citing works
Yang, P., Fang, H., & Lin, J. (2018) · Journal of Data and Information Quality · doi:10.1145/3239571 · Cited by 222 · see citing works
Self-citationA comparative study of methods for estimating query language models with pseudo feedback
Lv, Y., & Zhai, C. (2009) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/1645953.1646259 · Cited by 209 · see citing works
Research Frontiers in Information Retrieval
Culpepper, J. S., Díaz, F., & Smucker, M. D. (2018) · ACM SIGIR Forum · doi:10.1145/3274784.3274788 · Cited by 182 · see citing works
The effect multiple query representations on information retrieval system performance
Belkin, N. J., Cool, C., Croft, W. B., & Callan, J. P. (1993) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/160688.160760 · Cited by 170 · see citing works
Predicting Query Performance by Query-Drift Estimation
Shtok, A., Kurland, O., Carmel, D., Raiber, F., & Markovits, G. (2012) · ACM Transactions on Information Systems · doi:10.1145/2180868.2180873 · Cited by 170 · see citing works
Can You Unpack That? Learning to Rewrite Questions-in-Context
Elgohary, A., Peskov, D., & Boyd-Graber, J. L. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1605 · Cited by 159 · see citing works
Few-Shot Generative Conversational Query Rewriting
Shi, Y., Liu, J., Yang, J., Xiong, C., Bennett, P. N., Gao, J., & Liu, Z. (2020) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3397271.3401323 · Cited by 143 · see citing works
Self-citationContext-Aware Term Weighting For First Stage Passage Retrieval
Dai, Z., & Callan, J. (2020) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3397271.3401204 · Cited by 131 · see citing works
Task-Oriented Query Reformulation with Reinforcement Learning
Nogueira, R., & Cho, K. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1061 · Cited by 120 · cited 1× · see citing works
“For example, Xu and Croft [54] expand a query with terms from retrieved documents; Nogueira and Cho [32] further improve IR systems using reinforcement learning to reformulate the query.”
Self-citationQuery Resolution for Conversational Search with Limited Supervision
Voskarides, N., Li, D., Ren, P., Kanoulas, E., & de Rijke, M. (2020) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3397271.3401130 · Cited by 113 · see citing works
Context Attentive Document Ranking and Query Suggestion
Ahmad, W. U., Chang, K.-W., & Wang, H. (2019) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3331184.3331246 · Cited by 97 · see citing works
Effectiveness/efficiency tradeoffs for candidate generation in multi-stage retrieval architectures
Asadi, N., & Lin, J. (2013) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/2484028.2484132 · Cited by 96 · see citing works
Self-citationEfficient and effective retrieval using selective pruning
Tonellotto, N., Macdonald, C., & Ounis, I. (2013) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/2433396.2433407 · Cited by 76 · see citing works
Noreault, T., McGill, M. J., & Koll, M. B. (1980) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.5555/636669.636674 · Cited by 67 · see citing works
Introducing MANtIS: a novel Multi-Domain Information Seeking Dialogues DatasetPreprint
Penha, G., Bălan, A. O., & Hauff, C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.04639 · Cited by 60 · see citing works
Conversational Query Understanding Using Sequence to Sequence Modeling
Ren, G., Ni, X., Malik, M., & Ke, Q. (2018) · Proceedings of the 2018 World Wide Web Conference on World Wide Web - WWW '18 · doi:10.1145/3178876.3186083 · Cited by 55 · see citing works
Dynamic Cutoff Prediction in Multi-Stage Retrieval Systems
Culpepper, J. S., Clarke, C. L. A., & Lin, J. (2016) · Australasian Document Computing Symposium · doi:10.1145/3015022.3015026 · Cited by 46 · see citing works
Self-citationJoint Optimization of Cascade Ranking Models
Gallagher, L., Chen, R.-C., Blanco, R., & Culpepper, J. S. (2019) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3289600.3290986 · Cited by 46 · see citing works
Harnessing Evolution of Multi-Turn Conversations for Effective Answer Retrieval
Aliannejadi, M., Chakraborty, M., Ríssola, E. A., & Crestani, F. (2020) · Conference on Human Information Interaction and Retrieval · doi:10.1145/3343413.3377968 · Cited by 42 · see citing works
Lin, S.-C., Yang, J.-H., Nogueira, R. F., Tsai, M.-F., Wang, C., & Lin, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.01909 · Cited by 37 · see citing works
Self-citationQuestion Rewriting for Conversational Question Answering
Vakulenko, S., Longpre, S., Tu, Z., & Anantha, R. (2021) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3437963.3441748 · Cited by 37 · see citing works
Clarke, C. L. A., Culpepper, J. S., & Moffat, A. (2016) · Information Retrieval · doi:10.1007/s10791-016-9279-1 · Cited by 34 · see citing works
Information Needs, Queries, and Query Performance Prediction
Zendel, O., Shtok, A., Raiber, F., Kurland, O., & Culpepper, J. S. (2019) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3331184.3331253 · Cited by 33 · see citing works
Boosting search performance using query variations
Benham, R., Mackenzie, J., Moffat, A., & Culpepper, J. S. (2024) · Figshare · Cited by 29 · see citing works
Boosting Search Performance Using Query Variations
Benham, R., Mackenzie, J., Moffat, A., & Culpepper, J. S. (2019) · ACM Transactions on Information Systems · doi:10.1145/3345001 · Cited by 28 · see citing works
Document vector representations for feature extraction in multi-stage document ranking
Asadi, N., & Lin, J. (2012) · Information Retrieval · doi:10.1007/s10791-012-9217-9 · Cited by 26 · see citing works
Self-citationYang, G. H., Guan, D., & Zhang, S. (2015) · ACM Transactions on Information Systems · doi:10.1145/2747874 · Cited by 25 · see citing works
Dynamic Shard Cutoff Prediction for Selective Search
Mohammad, H. R., Xu, K., Callan, J., & Culpepper, J. S. (2018) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3209978.3210005 · Cited by 22 · see citing works
Incomplete Follow-up Question Resolution using Retrieval based Sequence to Sequence Learning
Kumar, V., & Joshi, S. (2017) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3077136.3080801 · Cited by 22 · see citing works
An Extended Relevance Model for Session Search
Levine, N., Roitman, H., & Cohen, D. (2017) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3077136.3080664 · Cited by 15 · see citing works
Normalized Query Commitment Revisited
Roitman, H. (2019) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3331184.3331334 · Cited by 11 · see citing works
A Factored Relevance Model for Contextual Point-of-Interest Recommendation
Chakraborty, A., Ganguly, D., Caputo, A., & Lawless, S. (2019) · ACM SIGIR International Conference on Theory of Information Retrieval (ICTIR) · doi:10.1145/3341981.3344230 · Cited by 5 · see citing works
Tu, Z., Crane, M., Sequiera, R. D., Zhang, J., & Lin, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.08275 · Cited by 5 · see citing works
Self-citationOn the Equilibrium of Query Reformulation and Document Retrieval
Zou, S., Tao, G., Wang, Y.-X., Zhang, W., & Zhang, D. (2018) · ACM SIGIR International Conference on Theory of Information Retrieval (ICTIR) · doi:10.1145/3234944.3234962 · Cited by 4 · see citing works
Flagged first, then by citations
2 of the 53 references couldn’t be matched to a known paper.
Research works printed but not linked: 20
- Wasi Uddin Ahmad, Kai-Wei Chang, and Hongning Wang. 2018. Multi-Task Learning for Document Ranking and Query Suggestion. In Proc. ICLR.
- Zeynep Akkalyoncu Yilmaz, Shengjin Wang, Wei Yang, Haotian Zhang, and Jimmy Lin. 2019. Applying BERT to Document Retrieval with Birch. In Proc. EMNLP: System Demonstrations. 19-24.
- Payal Bajaj, Daniel Campos, Nick Craswell, Li Deng, Jianfeng Gao, Xiaodong Liu, Rangan Majumder, Andrew McNamara, Bhaskar Mitra, Tri Nguyen, et al. 2016. MS MARCO: A human generated MAchine Reading COmprehension dataset. arXiv:1611.09268 (2016). · arXiv
- Jeffrey Dalton, Chenyan Xiong, and Jamie Callan. 2019. CAsT 2019: The Conversational Assistance Track Overview. In Proc. TREC.
- Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proc. NAACL. 4171-4186.
- Laura Dietz and Nick Craswell. 2018. TREC Complex Answer Retrieval Overview. Proc. TREC.
- Li Dong, Nan Yang, Wenhui Wang, Furu Wei, Xiaodong Liu, Yu Wang, Jianfeng Gao, Ming Zhou, and Hsiao-Wuen Hon. 2019. Unified Language Model Pre-training for Natural Language Understanding and Generation. In Proc. NIPS.
- Tom Kwiatkowski, Jennimaria Palomaki, Olivia Redfield, Michael Collins, Ankur Parikh, Chris Alberti, Danielle Epstein, Illia Polosukhin, Matthew Kelcey, Jacob Devlin, Kenton Lee, Kristina N. Toutanova, Llion Jones, Ming-Wei Chang, Andrew Dai, Jakob Uszkoreit, Quoc Le, and Slav Petrov. 2019. Natural Questions: a Benchmark for Question Answering Research. Trans. of ACL (2019).
- Rodrigo Nogueira and Kyunghyun Cho. 2019. Passage Re-ranking with BERT. arXiv:1901.04085 (2019). · arXiv
- Rodrigo Nogueira, Wei Yang, Kyunghyun Cho, and Jimmy Lin. 2019. Multi-stage Document Ranking with BERT. arXiv:1910.14424 (2019). · arXiv
- Stephen E. Robertson, Steve Walker, Susan Jones, Micheline Hancock-Beaulieu, and Mike Gatford. 1994. Okapi at TREC-3. In Proc. TREC.
- Sandeep Subramanian, Raymond Li, Jonathan Pilault, and Christopher Pal. 2019. On Extractive and Abstractive Neural Document Summarization with Transformer Language Models. arXiv:1909.03186 (2019). · arXiv
- Ilya Sutskever, Oriol Vinyals, and Quoc V. Le. 2014. Sequence to Sequence Learning with Neural Networks. In Proc. NIPS. 3104-3112.
- Stephen Tomlinson. 2004. Robust, Web and Terabyte Retrieval with Hummingbird SearchServer at TREC 2004. In Proc. TREC.
- Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention Is All You Need. In Proc. NIPS. 5998-6008.
- Ellen M Voorhees. 2004. Overview of the TREC 2004 Robust Retrieval Track. Proc. TREC.
- Nikos Voskarides, Dan Li, Andreas Panteli, and Pengjie Ren. 2019. ILPS at TREC 2019 Conversational Assistant Track. In Proc. TREC.
- Shuohang Wang, Mo Yu, Jing Jiang, Wei Zhang, Xiaoxiao Guo, Shiyu Chang, Zhiguo Wang, Tim Klinger, Gerald Tesauro, and Murray Campbell. 2018. Evidence Aggregation for Answer Re-Ranking in Open-Domain Question Answering. In Proc. ICLR.
- Jheng-Hong Yang, Sheng-Chieh Lin, Chuan-Ju Wang, Jimmy Lin, and Ming-Feng Tsai. 2019. Query and Answer Expansion from Conversation History. In Proc. TREC.
- Peilin Yang, Hui Fang, and Jimmy Lin. 2018. Anserini: Reproducible Ranking Baselines Using Lucene. JDIQ 10, 4 (2018), 16.
Cited by
Sorted by citations
Conversational Information Seeking
Zamani, H., Trippas, J. R., Dalton, J., & Radlinski, F. (2023) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000081 · Cited by 124 · see citing works
Mao, K., Dou, Z., Mo, F., Hou, J., Chen, H., & Qian, H. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.86 · Cited by 83 · see citing works
A Survey of Conversational Search
Mo, F., Mao, K., Zhao, Z., Qian, H., Chen, H., Cheng, Y., Li, X., Zhu, Y., Dou, Z., & Nie, J. (2025) · ACM Transactions on Information Systems · doi:10.1145/3759453 · Cited by 51 · see citing works
Contextualized Query Embeddings for Conversational Search
Lin, S.-C., Yang, J.-H., & Lin, J. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.77 · Cited by 47 · see citing works
Self-citationCurriculum Contrastive Context Denoising for Few-shot Conversational Dense Retrieval
Mao, K., Dou, Z., & Qian, H. (2022) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3477495.3531961 · Cited by 40 · see citing works
Query Performance Prediction: From Ad-hoc to Conversational Search
Meng, C., Arabzadeh, N., Aliannejadi, M., & de Rijke, M. (2023) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3539618.3591919 · Cited by 35 · see citing works
Enhancing Conversational Search: Large Language Model-Aided Informative Query Rewriting
Ye, F., Fang, M., Li, S., & Yılmaz, E. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.398 · Cited by 51 · see citing works
A Systematic Review of Fairness, Accountability, Transparency, and Ethics in Information Retrieval
Bernard, N., & Balog, K. (2023) · ACM Computing Surveys · doi:10.1145/3637211 · Cited by 43 · see citing works
Exploiting Simulated User Feedback for Conversational Search: Ranking, Rewriting, and Beyond
Owoicho, P., Sekulić, I., Aliannejadi, M., Dalton, J., & Crestani, F. (2023) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3539618.3591683 · Cited by 31 · see citing works
Generation-Augmented Retrieval for Open-domain Question Answering
Mao, Y., He, P., Liu, X., Shen, Y., Gao, J., Han, J., & Chen, W. (2020) · arXiv · doi:10.48550/arxiv.2009.08553 · Cited by 31 · see citing works
A Geometric Framework for Query Performance Prediction in Conversational Search
Faggioli, G., Ferro, N., Muntean, C. I., Perego, R., & Tonellotto, N. (2023) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3539618.3591625 · Cited by 28 · see citing works
Automated Knowledge Organization AI ML based Subject Indexing System for Libraries
Ahmed, M., Mukhopadhyay, M., & Mukhopadhyay, P. (2023) · DESIDOC Journal of Library & Information Technology · doi:10.14429/djlit.43.01.18619 · Cited by 20 · see citing works
MG-ShopDial: A Multi-Goal Conversational Dataset for e-Commerce
Bernard, N., & Balog, K. (2023) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3539618.3591883 · Cited by 18 · see citing works
Explicit Query Rewriting for Conversational Dense Retrieval
Qian, H., & Dou, Z. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.311 · Cited by 18 · see citing works
Relevance Feedback with Brain Signals
Ye, Z., Xie, X., Ai, Q., Liu, Y., Wang, Z., Su, W., & Zhang, M. (2023) · ACM Transactions on Information Systems · doi:10.1145/3637874 · Cited by 17 · see citing works
Learning Denoised and Interpretable Session Representation for Conversational Search
Mao, K., Qian, H., Mo, F., Dou, Z., Liu, B., Cheng, X., & Cao, Z. (2023) · International World Wide Web Conference (WWW) · doi:10.1145/3543507.3583265 · Cited by 16 · see citing works
Zero-shot Query Contextualization for Conversational Search
Krasakis, A. M., Yates, A., & Kanoulas, E. (2022) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3477495.3531769 · Cited by 17 · see citing works
Search-Oriented Conversational Query Editing
Mao, K., Dou, Z., Liu, B., Qian, H., Mo, F., Wu, X., Cheng, X., & Cao, Z. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.256 · Cited by 15 · see citing works
Vakulenko, S., Longpre, S., Tu, Z., & Anantha, R. (2020) · Proceedings of the 5th International Workshop on Search-Oriented Conversational AI (SCAI) · doi:10.18653/v1/2020.scai-1.2 · Cited by 14 · see citing works
Saving Dense Retriever from Shortcut Dependency in Conversational Search
Kim, S., & Kim, G. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.701 · Cited by 17 · see citing works
Caching Historical Embeddings in Conversational Search
Frieder, O., Mele, I., Muntean, C. I., Nardini, F. M., Perego, R., & Tonellotto, N. (2022) · ACM Transactions on the Web · doi:10.1145/3578519 · Cited by 13 · see citing works
Kostric, I., & Balog, K. (2024) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3626772.3657933 · Cited by 12 · see citing works
Łajewska, W., & Balog, K. (2023) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3583780.3615132 · Cited by 10 · see citing works
Conversational Search and Recommendation: Introduction to the Special Issue
Hauff, C., Kiseleva, J., Sanderson, M., Zamani, H., & Zhang, Y. (2021) · ACM Transactions on Information Systems · doi:10.1145/3465272 · Cited by 9 · see citing works
Data Fusion of Synthetic Query Variants With Generative Large Language Models
Breuer, T. (2024) · Annual International ACM SIGIR Conference on Research and Development in Information Retrieval in the Asia Pacific Region (SIGIR-AP) · doi:10.1145/3673791.3698423 · Cited by 8 · see citing works
Conversational Search: From Fundamentals to Frontiers in the LLM Era
Mo, F., Meng, C., Aliannejadi, M., & Nie, J. (2025) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3726302.3731686 · Cited by 8 · see citing works
Zero-shot Query Reformulation for Conversational Search
Yang, D., Zhang, Y., & Fang, H. (2023) · ACM SIGIR International Conference on Theory of Information Retrieval (ICTIR) · doi:10.1145/3578337.3605143 · Cited by 6 · see citing works
Improving conversational search with query reformulation using selective contextual history
Al-Thani, H., Elsayed, T., & Jansen, B. J. J. (2022) · Data and Information Management · doi:10.1016/j.dim.2022.100025 · Cited by 6 · see citing works
Łajewska, W., & Balog, K. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-28241-6_12 · Cited by 6 · see citing works
Question Rewriting for Open-Domain Conversational QA
Tredici, M. D., Barlacchi, G., Shen, X., Cheng, W., & de Gispert, A. (2021) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3459637.3482164 · Cited by 6 · see citing works
Automatic Indexing for Agriculture: Designing a Framework by Deploying Agrovoc, Agris and Annif
Ahmed, M. (2023) · Journal of Information and Knowledge · doi:10.17821/srels/2023/v60i2/170966 · Cited by 5 · see citing works
ConvSDG: Session Data Generation for Conversational Search
Mo, F., Yi, B., Mao, K., Qu, C., Huang, K., & Nie, J. (2024) · International World Wide Web Conference (WWW) · doi:10.1145/3589335.3651940 · Cited by 7 · see citing works
DECAF: A Modular and Extensible Conversational Search Framework
Alessio, M., Faggioli, G., & Ferro, N. (2023) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3539618.3591913 · Cited by 5 · see citing works
Improving Conversational Passage Re-ranking with View Ensemble
Ju, J.-H., Lin, S.-C., Tsai, M.-F., & Wang, C. (2023) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3539618.3592002 · Cited by 4 · see citing works
Self-citationChatty Goose: A Python Framework for Conversational Search
Zhang, E., Lin, S.-C., Yang, J.-H., Pradeep, R., Nogueira, R. F., & Lin, J. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3462782 · Cited by 5 · see citing works
Self-citationA Survey on Conversational Search and Applications in Biomedicine
Adatrao, N. S. K., Gadireddy, G. R., & Noh, J. (2023) · ACM Southeast Regional Conference (ACMSE) · doi:10.1145/3564746.3587001 · Cited by 4 · see citing works
Toward Conversational Query Reformulation.
Kiesel, J., Cai, X., Baff, R. E., Stein, B., & Hagen, M. (2021) · Cited by 4 · see citing works
Acharya, P. (2023) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3583780.3616005 · Cited by 2 · see citing works
Chifu, A.-G., Dejean, S., Garouani, M., Mothe, J., Ortiz, D., & Ullah, M. Z. (2025) · ACM Transactions on Information Systems · doi:10.1145/3774427 · Cited by 3 · see citing works
Conversational generative retrieval with contextual denoising
Zhang, W., Wang, Y., Bai, Y., Zhang, M., Ren, Z., Chen, Z., & Ren, P. (2026) · Information Processing & Management · doi:10.1016/j.ipm.2026.104642 · Cited by 2 · see citing works
The 1st Workshop on User Modelling in Conversational Information Retrieval (UM-CIR)
Acharya, P., Jones, G. J. F., Fu, X., Lipani, A., Crestani, F., & Kando, N. (2024) · Annual International ACM SIGIR Conference on Research and Development in Information Retrieval in the Asia Pacific Region (SIGIR-AP) · doi:10.1145/3673791.3698436 · Cited by 2 · see citing works
Zero-Shot Response-Aware Query Expansion Method for Conversational Retrieval
Wang, J., Chen, X., He, P., Zhang, F., Wang, L., & Sheng, J. (2024) · IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT) · doi:10.1109/wi-iat62293.2024.00101 · Cited by 2 · see citing works
Cooking with context: Leveraging context for procedural question answering
Frummet, A., Elsweiler, D., & Kruschwitz, U. (2025) · Information Processing & Management · doi:10.1016/j.ipm.2025.104212 · Cited by 2 · see citing works
Commonsense Injection in Conversational Systems: An Adaptable Framework for Query Expansion
Rocchietti, G., Frieder, O., Muntean, C. I., Nardini, F. M., & Perego, R. (2023) · IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT) · doi:10.1109/wi-iat59888.2023.00013 · Cited by 2 · see citing works
MultiLTR: Text Ranking with a Multi-Stage Learning-to-Rank Approach
Yang, H., & Gonçalves, T. (2025) · Information · doi:10.3390/info16040308 · Cited by 1 · see citing works
Enhancing Retrieval-Augmented Generation for Text Completion Through Query Selection
Pogrebinsky, I., Carmel, D., & Kurland, O. (2025) · ACM SIGIR International Conference on Theory of Information Retrieval (ICTIR) · doi:10.1145/3731120.3744610 · Cited by 2 · see citing works
COMEX: A Multi-task Benchmark for Knowledge-grounded COnversational Media EXploration
Tun, Z. Y., Speggiorin, A., Dalton, J., & Stamper, M. (2022) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3543829.3543830 · Cited by 1 · see citing works
SSP: Self-Supervised Post-training for Conversational Search
Tu, Q., Gao, S., Wu, X., Cao, Z., Wen, J.-R., & Yan, R. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.837 · Cited by 1 · see citing works
Contextualizing and Expanding Conversational Queries without Supervision
Krasakis, A. M., Yates, A., & Kanoulas, E. (2023) · ACM Transactions on Information Systems · doi:10.1145/3632622 · Cited by 1 · see citing works
Conversational Information Retrieval and Recommender Systems
Faggioli, G., Ferro, N., & Merlo, S. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-88720-8_44 · Cited by 1 · see citing works
Wang, J., Zhang, F., Chen, X., He, P., Huang, E. A., & Huang, J. X. (2025) · ACM Transactions on Information Systems · doi:10.1145/3742423 · Cited by 1 · see citing works
Learning to Ask Conversational Questions by Optimizing Levenshtein DistancePreprint
Liu, Z., Ren, P., Chen, Z., Ren, Z., de Rijke, M., & Zhou, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.15903
SocialSift: Target Query Discovery on Online Social Media With Deep Reinforcement Learning
Wang, C., Wang, P., Qin, T., Wang, C., Kumar, S., Guan, X., Liu, J., & Chang, K. C. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3130587
Self-citationGao, J., Xiong, C., Bennett, P. N., & Craswell, N. (2023) · The information retrieval series · doi:10.1007/978-3-031-23080-6_3
A Noise-enhanced Fuse Model for Passage Ranking
Huang, Y. (2022) · IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT) · doi:10.1109/wi-iat55865.2022.00118
Evolving Graph-Based Context Modeling for Multi-Turn Conversational Retrieval-Augmented Generation
Cheng, Y., Qian, H., Mo, F., Wu, Y., Li, Z., Ye, Q., Wen, J.-R., & Dou, Z. (2025) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3746252.3761355
Fu, S., & Jiang, T. (2025) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.70035
Torres, A. D. P. N., Mogollón-Benavides, A. L., Rúa, S., Villa, D. S., & Tejada, J. C. (2025) · Mexican International Conference on Computer Science · doi:10.1109/enc68268.2025.11311944
Enhancing Chatbot Performance with Retrival-Augmented Generation and Query Expansion
Id, I. D., Aminuddin, A., Mahdiyah, E., Hidayat, R. S. A., Sy, Y. S., & Okmayura, F. (2025) · Beyond Technology Summit on Informatics International Conference (BTS-I2C) · doi:10.1109/bts-i2c67944.2025.11399515
Attention-Driven Keyword Extraction for Conversational Retrieval-Augmented Generation
Zhao, L., & Huang, D. (2026) · International Conference on Computer, Artificial Intelligence and Control Engineering (CAICE) · doi:10.1145/3804601.3804655
Conversational Search: From Fundamentals to Frontiers in the Age of Agents
Meng, C., Mo, F., Aliannejadi, M., Dalton, D. J., & Nie, J. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774905.3793917
- Authors
- Lin, S.-C., Yang, J.-H., Nogueira, R., Tsai, M.-F., Wang, C.-J., & Lin, J.
- Affiliations
- Research Center for Information Technology Innovation, Academia Sinica (TW)
- University of Waterloo (CA)
- National Chengchi University (TW)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2020
- Volume
- 39
- Issue
- 4
- Pages
- 1-29
- ISSN
- 1046-8188 (ISSN-L)
- arXiv
- 2005.02230
- OpenAlex
- W3198536471
- Cited by
- 62
- References
- 53
- Citations by year
- 2026: 3 · 2025: 12 · 2024: 5 · 2023: 25 · 2022: 8 · 2021: 7 · 2020: 2
- FWCI
- 10.17
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- ACM Transactions on Information Systems (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Ministry of Science and Technology, Taiwan (MOST107-2218-E002-061)
- Canada First Research Excellence Fund
- Natural Sciences and Engineering Research Council of Canada
- Topics
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Information Systems › Recommender Systems and Techniques
- Keywords
- reciprocal rank fusion, query ambiguity, coreference resolution, multi-stage retrieval, conversational search, sequence-to-sequence models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
