The DOI matches its Crossref record; 36 of the 39 references it cites were found in a registry or an index.
Is ChatGPT Good at Search? Investigating Large Language Models as Re-Ranking Agents
Open accessAbstract
Large Language Models (LLMs) have demonstrated remarkable zero-shot generalization across various language-related tasks, including search engines.However, existing work utilizes the generative ability of LLMs for Information Retrieval (IR) rather than direct passage ranking.The discrepancy between the pretraining objectives of LLMs and the ranking objective poses another challenge.In this paper, we first investigate generative LLMs such as ChatGPT and GPT-4 for relevance ranking in IR.Surprisingly, our experiments reveal that properly instructed LLMs can deliver competitive, even superior results to state-of-the-art supervised methods on popular IR benchmarks.Furthermore, to address concerns about data contamination of LLMs, we collect a new test set called NovelEval, based on the latest knowledge and aiming to verify the model's ability to rank unknown knowledge.Finally, to improve efficiency in real-world applications, we delve into the potential for distilling the ranking capabilities of ChatGPT into small specialized models using a permutation distillation scheme.Our evaluation results turn out that a distilled 440M model outperforms a 3B supervised model on the BEIR benchmark.The code to reproduce our results is available at www.github.com/sunnweiwei/RankGPT.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Rank-biased overlap (RBO)foot_6 is a widely used metric for evaluating the similarity between two ranked lists and is particularly relevant for tasks in information retrieval (Oh et al., 2022;Sun et al., 2023).”
From Benchmarking Cognitive Biases in Large Language Models as Evaluators (2024) · cites this paper as Sun et al., 2023
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“A representative empirical anchor is Sun et al. (2023), who show that LLMs can match or exceed strong supervised re-rankers on standard IR benchmarks, validating the 'generative engine as LLM re-ranker' abstraction we build on.”
From E-GEO: A Testbed for Generative Engine Optimization in E-Commerce (2025) · cites this paper as Sun et al., 2023
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
LLaMA: Open and Efficient Foundation Language Models
Touvron, H., Lavril, T., Izacard, G., Martinet, X., Lachaux, M.-A., Lacroix, T., Rozière, B., Goyal, N., Hambro, E., Azhar, F., et al. (2023) · arXiv · doi:10.48550/arxiv.2302.13971 · Cited by 4,602
Training language models to follow instructions with human feedback
Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C. L., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., et al. (2022) · arXiv · doi:10.48550/arxiv.2203.02155 · Cited by 4,208
Dense passage retrieval for open-domain question answering
Karpukhin, V., Oguz, B., Min, S., Lewis, P., Wu, L., Edunov, S., Chen, D., & Yih, W.-T. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.550 · Cited by 3,575
Learning to rank using gradient descent
Burges, C., Shaked, T., Renshaw, E., Lazier, A., Deeds, M., Hamilton, N., & Hullender, G. (2005) · Proceedings of the 22nd international conference on Machine learning - ICML '05 · doi:10.1145/1102351.1102363 · Cited by 2,836
MS MARCO: A Human Generated MAchine Reading COmprehension Dataset
Bajaj, P., Campos, D., Craswell, N., Deng, L., Gao, J., Liu, X., Majumder, R., McNamara, A., Mitra, B., Nguyen, T., et al. (2016) · arXiv · doi:10.48550/arxiv.1611.09268 · Cited by 2,473
Scaling Instruction-Finetuned Language Models
Chung, H. W., Hou, L., Longpre, S., Zoph, B., Tay, Y., Fedus, W., Li, Y., Wang, X., Dehghani, M., Brahma, S., et al. (2022) · arXiv · doi:10.48550/arxiv.2210.11416 · Cited by 1,441
Document Ranking with a Pretrained Sequence-to-Sequence Model
Nogueira, R. F., Jiang, Z., Pradeep, R., & Lin, J. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.63 · Cited by 686
Nogueira, R., & Cho, K. (2019) · arXiv · doi:10.48550/arxiv.1901.04085 · Cited by 615
Holistic Evaluation of Language Models
Bommasani, R., Liang, P., & Lee, T. (2023) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.15007 · Cited by 480
Research works printed but not linked: 5
- TMLR.
- Gautier Izacard, Patrick Lewis, Maria Lomeli, Lucas Hosseini, Fabio Petroni, Timo Schick, Jane A. Yu, Armand Joulin, Sebastian Riedel, and Edouard Grave. 2023. Few-shot learning with retrieval augmented language models. Journal of Machine Learning Re- search, 24(251):1-43.
- Nandan Thakur, Nils Reimers, Andreas Ruckl'e, Ab- hishek Srivastava, and Iryna Gurevych. 2021. Beir: A heterogenous benchmark for zero-shot evaluation of information retrieval models. In NeurIPS 2021.
- Yizhong Wang, Yeganeh Kordi, Swaroop Mishra, Alisa Liu, Noah A. Smith, Daniel Khashabi, and Hannaneh Hajishirzi. 2023b. Self-instruct: Aligning language model with self generated instructions. In ACL 2023.
- Lixin Zou, Shengqiang Zhang, Hengyi Cai, Dehong Ma, Suqi Cheng, Daiting Shi, Shuaiqiang Wang, Zhicong Cheng, and Dawei Yin. 2021. Pre-trained language model based ranking in baidu search. In KDD 2021. Method DL19 DL20 Covid NFCorpus Touche DBPedia SciFact Signal News Robust04 BEIR (Avg) BM25 50.58 47.96 59.47 30.75 44.22 31.80 67.89 33.05 39.52 40.70 43.42 Supervised train on MS MRACO monoBERT (340M) 70.50 67.28 70.01 36.88 31.75 41.87 71.36 31.44 44.62 49.35 47.16 monoT5 (220M) 71.48 66.99 78.34 37.38 30.82 42.42 73.40 31.67 46.83 51.72 49.07 monoT5 (3B) 71.83 68.89 80.71 38.97 32.41 44.45 76.57 32.55 48.49 56.71 51.36 Cohere Rerank-v2 73.22 67.08 81.81 36.36 32.51 42.51 74.44 29.60 47.59 50.78 49.45 Unsupervised instructional permutation generation ChatGPT 65.80 62.91 76.67 35.62 36.18 44.47 70.43 32.12 48.85 50.62 49.37 GPT-4 75.59 70.56 85.51 38.47 38.57 47.12 74.95 34.40 52.89 57.55 53.68 Specialized Models train on MARCO labels or ChatGPT predicted permutations MARCO Pointwise BCE 65.57 56.72 70.82 33.10 17.08 32.28 55.37 19.30 41.52 46.00 39.43 MARCO Listwise CE 65.99 57.97 66.31 32.61 20.15 30.79 37.57 18.09 38.11 39.93 35.45 MARCO RankNet 66.34 58.51 70.29 34.23 20.27 29.62 49.01 23.22 39.82 43.87 38.79 MARCO LambdaLoss 64.82 56.16 72.86 34.20 19.51 32.55 51.88 26.22 42.47 45.28 40.62 ChatGPT Listwise CE 65.39 58.80 76.29 35.73 38.19 40.24 64.49 31.37 47.61 48.00 47.74 ChatGPT RankNet 65.75 59.34 81.26 36.57 39.03 42.10 68.77 31.55 52.54 52.44 50.53 ChatGPT LambdaLoss 67.17 60.56 80.63 36.74 36.73 43.75 68.21 32.58 49.00 50.51 49.77 deberta-v3-xsmall (70M) 64.75 55.07 78.21 35.95 35.42 41.37 67.86 30.04 47.68 49.91 48.31 deberta-v3-small (142M) 67.85 58.84 78.88 36.55 36.16 40.99 66.66 30.29 49.17 49.73 48.55 deberta-v3-base (184M) 70.28 62.52 80.81 36.15 37.25 44.06 71.70 32.45 50.84 51.33 50.57 deberta-v3-large (435M) 70.66 67.15 84.64 38.48 39.27 47.36 74.18 32.53 51.19 56.55 53.03 deberta-v3-large 5K 70.93 64.32 84.43 38.66 40.72 46.28 73.88 31.93 52.24 55.89 53.00 deberta-v3-large 3K 70.79 63.91 84.21 38.73 39.83 45.74 74.41 31.92 52.29 57.42 53.07 deberta-v3-large 1K 69.90 64.81 83.38 38.94 36.65 44.46 71.96 30.19 50.73 53.74 51.26 deberta-v3-large 500 69.71 62.00 83.54 37.23 33.68 44.56 70.48 28.70 45.64 42.67 48.31 deberta-v3-large label 10K 66.61 57.26 74.36 33.94 18.09 34.95 35.35 21.38 39.00 44.94 37.75 deberta-v3-large label 5K 68.98 61.38 80.73 35.68 20.48 37.34 54.63 24.25 36.94 51.13 42.64 deberta-v3-large label 3K 67.41 60.42 79.82 35.49 24.54 37.39 47.31 23.29 39.87 50.65 42.29 deberta-v3-large label 1K 65.55 60.93 77.70 33.29 23.36 36.38 31.10 21.71 34.28 38.31 37.01 deberta-v3-large label 500 60.59 54.45 76.20 32.93 19.66 31.54 45.66 13.99 33.48 44.49 37.24 deberta-v3-large monoT5-3B 73.05 68.82 84.78 38.55 34.43 43.61 75.45 30.75 49.85 56.80 51.78 deberta-v3-large chatgpt+label 72.42 67.30 85.96 38.75 35.06 45.43 71.81 28.52 45.91 55.57 50.88 deberta-v3-base label 10k 65.66 59.84 71.63 34.65 16.53 32.59 34.65 22.64 37.60 44.02 36.79 deberta-v3-small label 10k 63.63 52.83 68.17 30.48 18.12 31.72 33.62 18.02 34.57 36.09 33.85 deberta-v3-xsmall label 10k 60.89 51.15 63.58 28.67 14.87 27.12 20.60 18.97 32.61 32.67 29.89 llama-7b 71.33 66.06 78.23 37.60 34.87 45.46 76.13 34.17 51.79 55.22 51.68 vicuna-7b 71.80 66.89 78.32 36.87 31.81 45.40 74.23 34.28 51.13 52.91 50.62 llama-7b 10k label 65.22 56.85 75.36 36.24 20.88 37.34 69.04 25.22 41.21 49.21 44.31 llama-7b 5k label 69.24 58.97 80.49 37.55 28.23 39.66 71.79 26.04 44.09 53.83 47.71
Cited by
Sorted by citations
Items 201–282 of 282
LegalMALR: multi-agent query understanding and LLM-based reranking for Chinese statute retrieval
Li, Y., Xie, M., Kang, G., Gong, Z., Wu, G., & Yang, M. (2026) · Artificial Intelligence and Law · doi:10.1007/s10506-026-09541-6
RankPilot: An LLM-Enhanced Visual System for Interpretable Multi-Attribute Ranking
Pan, S., & Tao, J. (2025) · International Conference on Artificial Intelligence, Virtual Reality and Visualization (AIVRV) · doi:10.1109/aivrv67401.2025.11349738
Neural reranking for UK statutory retrieval: Provision-level evaluation and an open distilled model
Alshehri, A. S., Eken, C., Bencomo, N., & Atapour–Abarghouei, A. (2026) · Artificial Intelligence and Law · doi:10.1007/s10506-025-09501-6
Food Recognition with Visual Language Models: Search Re-ranking or Retrieval-Augmented Generation?
Gan, K.-Y., Nguyen, P. A., & Ngo, C. (2026) · Lecture notes in computer science · doi:10.1007/978-981-95-6960-1_29
Enhancing Session-based Recommendation with Large Language Models: A Counterfactual MethodPreprint
Wu, X., Yin, S., Yu, T., He, H. X., Zhang, W., & Fang, X. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6206971
Calibrated Query Augmentation and Dual Preference Alignment for Retrieval-Augmented Generation
Wu, J., Xue, Z., Ou, S., Yu, L., Shao, Y., & Ye, G. (2026) · IEEE International Conference on Big Data and Smart Computing (BigComp) · doi:10.1109/bigcomp68355.2026.00028
V-RAG: Competitive Tree Reranking and Static Distillation for Answer-Source Alignment
Zhao, H., Lin, W., Cai, S., Duo, F., & Yang, J. (2025) · IEEE International Conference on Network Infrastructure and Digital Content (IC-NIDC) · doi:10.1109/ic-nidc67200.2025.11390266
Retrieval-Reranker: A Two-Stage Pipeline for Knowledge Graph Completion
Gergin, B., & Chelmis, C. (2025) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata66926.2025.11401469
How Role-Play Shapes Relevance Judgment in Zero-Shot LLM Rankers
Wang, Y., Qi, J., Chen, C., Eustratiadis, P., & Verberne, S. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-21289-4_15 · Cited by 4
Iterative Reranking as a Compute-Scaling Method for LLM-Based Rankers
Czinczoll, T., Liu, D., & Betello, F. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-21321-1_16
LLM-Based Listwise Reranking Under the Effect of Positional Bias
Qiao, J., Huang, J., Ma, X., Wang, S., Yin, D., Kanoulas, E., & Yates, A. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-21289-4_9
Self-citationAnalyzing AI Evaluation Benchmarks Through Information Retrieval and Network Science
Simeoni, G., Soprano, M., Lunardi, R., Roitero, K., & Mizzaro, S. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-21300-6_25
LANCER: LLM Reranking for Nugget Coverage
Ju, J.-H., Landry, F.-G., Yang, E., Verberne, S., & Yates, A. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-21300-6_12 · Cited by 2
A Self-Reflective Multi-Agent Physician Recommendation Framework
Mao, S., & Yang, Y. (2026) · International Conference on Communication Networks and Machine Learning (CNML) · doi:10.1109/cnml68938.2026.11452303
FreeRanker: A Latent Planning Framework for Zero-Shot Re-ranking
Thai, H. P., Pham, L. P. C., Le, T. A. N., & Le, N. H. T. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-21625-0_15
Wang, Z., Fan, Z., Li, Y., Zhang, X., Dai, P., & Tian, Z. (2026) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2026.3682468
Scaling Collaborative Filtering with Multimodal Contrastive Fine-tuning
Jin, L., Luo, D., Zou, L., Li, C., Luo, X., Lin, X., Dong, L., & Zhang, Y. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774904.3792523
ProRank: Progressive Context Refinement for Reliable Retrieval-Augmented Generation
Yang, Y., Ma, J., An, X., Zhang, Z., Pan, M., Wang, W., & Ding, H. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11462863
A Reference Architecture for Agentic Hybrid Retrieval in Dataset Search
Terrenzi, R., Konrad, P. M., Adam, T. L., & Ayvaz, S. (2026) · IEEE International Conference on Software Architecture Companion (ICSA-C) · doi:10.1109/icsa-c68850.2026.00098 · Cited by 2
End-To-End LLM Systems: Data, Training, Evaluation, and Deployment
Dhanasekar, S. (2026) · International Conference on Machine Learning and Autonomous Systems (ICMLAS) · doi:10.1109/icmlas67792.2026.11483701
Code Language Models for Security Patch Management: How Far are We?
Lin, X., Cao, S., Yu, L., Sun, X., Xiao, F., Xue, L., Wu, C., Ren, K., & Lo, D. (2026) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2026.3690594
Miyaji, R. O., & Corrêa, P. L. P. (2026) · Journal of the Brazilian Computer Society · doi:10.5753/jbcs.2026.5659
Lan, J., Li, F., & Zhang, L. N. (2026) · International Conference on Communications, Information System and Computer Engineering (CISCE) · doi:10.1109/cisce69494.2026.11504788
Radensky, M., Shahid, S., Fok, R., Siangliulue, P., Hope, T., & Weld, D. S. (2026) · ACM Conference on AI and Agentic Systems (CAIS) · doi:10.1145/3786335.3813161 · Cited by 4
Kansara, S. K. (2026) · ACM Conference on AI and Agentic Systems (CAIS) · doi:10.1145/3786335.3813178
Ma, L., Li, X., Fan, Z., Zhao, K., Xu, J., Cho, J. H. D., Kanumala, P., Nag, K., Körpeoğlu, E., Kumar, S., et al. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774905.3795725
Kieu, H.-D., Nguyen, M.-D., Buntine, W., Nguyen, T.-S., & Le, D. D. (2026) · Machine Learning · doi:10.1007/s10994-026-07066-2
Nakata, Y., Sekiguchi, K., & Ohsawa, Y. (2026) · Expert systems with applications · doi:10.1016/j.eswa.2026.133274
InScribe: Intelligent Augmentation of Natural-Language Statements with Data Facts
Chen, C., Liu, Y., Shi, D., Cao, S., & Cao, N. (2026) · IEEE Pacific Visualization Conference (PacificVis) · doi:10.1109/pacificvis68791.2026.00021
VISA-Agent: A Visual Symbolic Agent for Reasoning-Intensive Multimodal Retrieval
Abdalla, M. I., Kasem, M. S., Mahmoud, M., Senussi, M. F., Abdallah, A., & Kang, H. (2026) · Mathematics · doi:10.3390/math14122197
ExpaRank: A Multi-dimensional Contribution-Aware Method for Passage Re-ranking
Sun, H., Li, T., Tang, Z., & Yang, Z. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-1947-6_22
A Cybersecurity Incident Response Model Based on Knowledge Adaptation for Large Language Models
Zhang, D., Chang, D., Liu, X., & Meng, H. (2025) · doi:10.1109/ccat68690.2025.00023
Version-Aware Knowledge-Graph-Enhanced Retrieval for Multi-Version Legal Question Answering
陈, 晓. (2026) · Computer Science and Application · doi:10.12677/csa.2026.166218
Beyond Semantics: Exploring Context Ranking Under Knowledge Conflicts
Cho, S., Lee, M., Heo, J., Shin, J.-H., Lee, K., & Lim, S. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-1926-1_16
Cloze Your Gaps: Improving Knowledge Extraction via Query Rewriting
Cho, S., Lee, M., Heo, J., Shin, J.-H., Lee, K., & Lim, S. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-1926-1_17
Reproducibility in Information Retrieval
Maistro, M., Breuer, T., & Ferro, N. (2026) · Foundations and Trends® in Information Retrieval · doi:10.1108/ftinr-05-2025-0087 · Cited by 1
Developing an Explainable Paper Retrieval System with Less Reliance on LLMs
Yamamoto, Y., Kikuchi, M., & Ozono, T. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-20897-2_48
WeSEAL: We ll-calibrated S earch for E liminating A ttention-sink L eakage
Wang, J., Wang, C., Li, A., Hu, H., Fang, Y., Wu, H., Xu, J., & Liao, D. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3808406
Retrieve, Rerank, Answer, Experiment: Hands-On IR Research with PyTerrier
Macdonald, C., MacAvaney, S., Tonellotto, N., & Wang, X. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3808640
CRED: Calibrated Relational Enhanced Distillation for LLM-Based Pointwise Reranking
Yang, Q., Zhang, W., Wang, Y., Li, X., & Nie, L. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3809850
Diagnosing LLM Reranker Behavior Under Fixed Evidence Pools
Arat, B., & Sefer, E. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3809852 · Cited by 1
Towards a Relevance Posterior in Neural Information Access
Parry, A., Lionis, E. G., Ganguly, D., & MacAvaney, S. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3808541
MCP Servers for Pyserini and RankLLM: Enabling Agentic Retrieval-Augmented Generation
Ge, Y., Guo, Z., Sharifymoghaddam, S., & Lin, J. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3808376
rerankers: A Lightweight Unified Toolkit for Reranking Approaches
Clavié, B. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3808630
BANANA: Bounded Adaptive Navigation Architecture for Nested Archives
Roy, A., Upadhyay, R., Panara, A. R., Millar, A. P., Murray, L., & Mills, R. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3809841
RULER: Robust Unified LLM-based Efficient Retrieval for Legal Information
Hou, C., Wang, Z. B., Cao, B., Wang, J., Zhang, T., & Li, T. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3809698
Omnia: Efficient RAG Serving through Speculative Scheduling
Fu, R., Li, S., Xu, Y., Wu, T., Ma, Z., & Shi, J. (2026) · ACM International Symposium on High-Performance Parallel and Distributed Computing (HPDC) · doi:10.1145/3806645.3807814
Does Form Affect Function? An Extended Study of LLM Re-Ranking Behavior
Goli, R., & Moffat, A. (2026) · ACM SIGIR International Conference on Theory of Information Retrieval (ICTIR) · doi:10.1145/3805713.3820410
From Noise to Order: Learning to Rank via Denoising Diffusion
Ebrahimi, S., Mitra, B., Arabzadeh, N., Yuan, Y., Wu, H., Zarrinkalam, F., & Ebrahim Bagheri, A. (2026) · ACM SIGIR International Conference on Theory of Information Retrieval (ICTIR) · doi:10.1145/3805713.3820437
Scaling Search Relevance: Augmenting App Store Ranking with LLM-Generated Judgments
Christakopoulou, E., Patel, V., Velaga, H., & Gaikwad, S. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3808460
Good Ranks Follow Good Answers: Unsupervised Answer-Driven Reranking for Multimodal Document QA
Zhu, K., Shen, S., Wang, X., Zhang, K., Wang, S., Liu, Q., & Huang, Z. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3809664
Self-citationOne Pass, Any Order: Position-Invariant Listwise Reranking for LLM-Based Recommendation
Bito, E., Ren, Y., & He, E. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3809952 · Cited by 9
Consensus-Anchored Expansion for Noise-Resilient Re-ranking
Subedi, N., & Shen, C. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3809634
Learning to Route Queries to Heads for Attention-based Re-ranking with Large Language Models
Tian, Y., Mo, F., Huang, Z., Zhang, W., & Nie, J. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3809945
Think When Needed: Model-Aware Reasoning Routing for LLM-based Ranking
Guo, H., Wei, T., Wang, D., Du, Y., Wang, Z., Zhang, J., & Sun, Z. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3809709 · Cited by 5
On the Robustness of LLM Re-Rankings
Goli, R., & Moffat, A. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3809883
LLM-Oriented Information Retrieval: A Denoising-First Perspective
Dai, L., Sun, L., Cao, F., Rao, Z., Yang, C., Liu, H., & Xiong, H. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3808544 · Cited by 2
CoFiLoc: A Coarse-to-fine LLM-based framework for method-level bug localization
Cao, N., Nguyen, N. T., & Nguyen, T. B. (2026) · Automated Software Engineering · doi:10.1007/s10515-026-00649-2
Beyond the Window: Scaling Listwise LLM Reranking via Candidate Filtering
Remy, L., Bringay, S., Pascal Poncelet, B., & Servajean, M. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-34374-1_13
CiteFuncRanker: an LLM-based pairwise ranking framework for multi-functional citation analysis
Wang, Y., Ruan, X., Lyu, D., & Cheng, Y. (2026) · Scientometrics · doi:10.1007/s11192-026-05764-1
The Evolution of SEO in the Era of Generative AI: A Business Intelligence Perspective
Roumeliotis, K. I., Margaris, D., Spiliotopoulos, D., & Vassilakis, C. (2026) · Electronics · doi:10.3390/electronics15163541
A Zero-Shot Explainable Doctor Ranking Framework with Large Language Models
Zeng, Z., Li, D., & Yang, Y. (2026) · Big Data Mining and Analytics · doi:10.26599/bdma.2025.9020098 · Cited by 2
CN-PDS: Facilitating Dataset Search with LLMs and its Application to China’s Public Data
Chen, Q., Chen, J., Xu, C., Feng, Y., Shan, B., Li, H., Zhou, X., Shi, Q., & Cheng, G. (2026) · Data Science and Engineering · doi:10.1007/s41019-026-00355-9
Associated Personas: Linking Stakeholders to Traceable Requirements
Tanahashi, R., Washizaki, H., Ubayashi, N., Sugiyama, R., Okuda, S., & Toriumi, K. (2026) · IEEE International Requirements Engineering Conference (RE) · doi:10.1109/re68928.2026.00049
ENTRE PROMPTS E RESPOSTAS: UMA ANÁLISE COMPARATIVA DO DESEMPENHO DE CHATGPT E META AI
de Oliveira, A. M., Garcia, J. V. G., Abreu, J. G., Grando, J. V. P., & Garcia, E. M. (2026) · Revista Tecnologias Educacionais em Rede (ReTER) · doi:10.5902/2675995096937
Alhwikem, F., Khan, A. R., & Jaskani, F. H. (2026) · Symmetry · doi:10.3390/sym18091572
ỨNG DỤNG ĐỒ THỊ TRI THỨC CHO TÁI XẾP HẠNG CÁC ĐOẠN VĂN BẢN TRONG TRUY XUẤT TĂNG CƯỜNG TẠO SINH
Trần, Q. H. (2026) · Journal of Science & Technology University of Economics - Technology for Industries · doi:10.67074/uneti.jst.2026.54.07
Teaching Recommenders to Listen: Bidirectional Natural-Language Control for Personalized News
Hasan, M. (2026) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/3773078.3831940
Doan, N. N., Elen, B., Sun, C., Dumontier, M., & Ertaylan, G. (2026) · doi:10.2196/preprints.112384
Wilson, C., & Purwanto, E. S. (2026) · International Conference on Information Management and Technology (ICIMTech) · doi:10.1109/icimtech202671078.2026.11698989
Distilling Reasoning from Language Models for Ranking Evaluation
da Silva, R. A. M., & Luciano, B. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-39895-6_25
Bekmirzaev, D., Yuldoshev, R. R., Kosimov, E. A., Ismoilov, A. M., & Shaumarov, S. S. (2026) · Mathematical Models in Engineering · doi:10.21595/mme.2026.26583
Pavićević, M., Popović, T., Krčo, S., & Vujkovic, M. (2026) · IEEE Access · doi:10.1109/access.2026.3740779
Lin, P., Xu, H., & Yang, J. (2026) · Research Square · doi:10.21203/rs.3.rs-11009751/v2
Enhancing session-based recommendation via large language models: A counterfactual method
Wu, X., Yin, S., Tai, Y., He, H., Zhang, W., & Fang, X. (2026) · Knowledge-Based Systems · doi:10.1016/j.knosys.2026.117166
Enterprise–Patent Matching Through Multi-Source Profiles and LLM Reranking
Xu, J., Zhou, J., Zhao, Z., Lyu, L., & Zhao, Y. (2026) · Systems · doi:10.3390/systems14101284
Salami, M. O. (2026) · ACM/IEEE Joint Conference on Digital Libraries · doi:10.1145/3805696.3847129
Enhancing Tool Orchestration and Planning for Agentic RAG Systems: A Case Study
Miyaji, R. O., Bedin, V., Moulin, R., & Machado, L. (2026) · Simpósio Brasileiro de Bancos de Dados (SBBD) · doi:10.5753/sbbd.2026.249641
Context Selection as a Partial Order: A Blackwell Framework and Verified LLM Evidence
Bilous, A., Lytvyn, V., Pukach, P. Y., & Rybchak, Z. (2026) · Machine Learning and Knowledge Extraction · doi:10.3390/make8100336
A Pointwise Method for Search Result Diversification via Intent Matching
Li, C., Huang, Z., & Qin, X. (2026) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn69854.2026.11730024
User-adaptive LLM prompt template engineering for enhancing cross-domain sequential recommendation
Boka, T. F., Niu, Z., & Yadetie, A. D. (2026) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-026-09450-y
Enrich-Retrieve-Rank: Scaling Capability Discovery Beyond In-Context Routing
Sorathiya, N., Zhang, D., & Akhbari, B. (2026) · arXiv · doi:10.48550/arxiv.2608.22695 · Cited by 1
Metadata
- Authors
- Sun, W., Yan, L., Ma, X., Wang, S., Ren, P., Chen, Z., Yin, D., & Ren, Z.
- Affiliations
- Shandong University (CN)
- Baidu (China) (CN)
- Leiden University (NL)
- Venue
- Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing
- Published
- 2023
- Pages
- 14918-14937
- OpenAlex
- W4389523765
- Cited by
- 270
- References
- 39
- Citations by year
- 2026: 94 · 2025: 104 · 2024: 56 · 2023: 16
- FWCI
- 69.39
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Conference on Empirical Methods in Natural Language Processing (EMNLP) (publishedVersion, cc-by)
- Leiden Repository (Leiden University) (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- Leiden Repository (Leiden University) (submittedVersion, cc-by)
- arXiv (Cornell University)
- Funders
- Shandong University
- National Natural Science Foundation of China (61972234, 62102234, 62272274, 62202271, 62072279)
- China Scholarship Council
- Natural Science Foundation of Shandong Province (ZR2021QF129)
- Topics
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Information Systems › Recommender Systems and Techniques
- Keywords
- large language models, ChatGPT, GPT-4, re-ranking, information retrieval, passage ranking, relevance ranking, contaminated data, knowledge distillation, BEIR benchmark
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
