Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 31

The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.

Stochastic RAG: End-to-End Retrieval-Augmented Generation through Expected Utility Maximization

Zamani, Hamed, Bendersky, Michael·2024·Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3626772.3657923

Cites

14 of 14 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 14 references

Research works printed but not linked: 41

  1. 10.1145/3583780.3614901 · DOI
  2. Payal Bajaj Daniel Campos Nick Craswell Li Deng Jianfeng Gao Xiaodong Liu Rangan Majumder Andrew McNamara Bhaskar Mitra Tri Nguyen et al. 2016. Ms marco: A human generated machine reading comprehension dataset. arXiv preprint arXiv:1611.09268 (2016). · arXiv
  3. 10.18653/v1/2022.findings-aacl.10 · DOI
  4. Emily Dinan, Stephen Roller, Kurt Shuster, Angela Fan, Michael Auli, and Jason Weston. 2018. Wizard of wikipedia: Knowledge-powered conversational agents. arXiv preprint arXiv:1811.01241 (2018). · arXiv
  5. Emily Dinan, Stephen Roller, Kurt Shuster, Angela Fan, Michael Auli, and Jason Weston. 2019. Wizard of Wikipedia: Knowledge-Powered Conversational Agents. In International Conference on Learning Representations. https://openreview.net/forum?id=r1l73iRqKm
  6. Hady Elsahar, Pavlos Vougiouklis, Arslen Remaci, Christophe Gravier, Jonathon Hare, Frederique Laforest, and Elena Simperl. 2018. T-rex: A large scale alignment of natural language with knowledge base triples. In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018).
  7. Michael Glass, Gaetano Rossiello, Md Faisal Mahbub Chowdhury, and Alfio Gliozzo. 2021. Robust retrieval augmented generation for zero-shot slot filling. arXiv preprint arXiv:2108.13934 (2021). · arXiv
  8. 10.18653/v1/2022.naacl-main.194 · DOI · Paper page
  9. Michael Glass, Gaetano Rossiello, Md Faisal Mahbub Chowdhury, Ankita Rajaram Naik, Pengshan Cai, and Alfio Gliozzo. 2022b. Re2G: Retrieve, Rerank, Generate. arXiv preprint arXiv:2207.06300 (2022). · arXiv
  10. Sebastian Hofst"atter, Jiecao Chen, Karthik Raman, and Hamed Zamani. 2022. Multi-Task Retrieval-Augmented Text Generation with Relevance Sampling. In ICML 2022 Workshop on Knowledge Retrieval and Language Models.
  11. 10.1145/3539618.3591687 · DOI · Paper page
  12. Eric Jang, Shixiang Gu, and Ben Poole. 2017. Categorical Reparameterization with Gumbel-Softmax. In International Conference on Learning Representations (ICLR '17).
  13. Wouter Kool, Herke Van Hoof, and Max Welling. 2019. Stochastic beams and where to find them: The gumbel-top-k trick for sampling sequences without replacement. In International Conference on Machine Learning. PMLR, 3499--3508.
  14. Wouter Kool, Herke van Hoof, and Max Welling. 2020. Ancestral Gumbel-Top-k Sampling for Sampling Without Replacement. J. Mach. Learn. Res. , Vol. 21 (2020), 47--1.
  15. Huayang Li Yixuan Su Deng Cai Yan Wang and Lemao Liu. 2022. A Survey on Retrieval-Augmented Text Generation. arxiv: 2202.01110 [cs.CL] · arXiv
  16. Chin-Yew Lin. 2004. ROUGE: A Package for Automatic Evaluation of Summaries. In Text Summarization Branches Out. Association for Computational Linguistics, Barcelona, Spain, 74--81. https://aclanthology.org/W04--1013
  17. Chris J. Maddison, Andriy Mnih, and Yee Whye Teh. 2017. The Concrete Distribution: A Continuous Relaxation of Discrete Random Variables. In 5th International Conference on Learning Representations, ICLR 2017, Toulon, France, April 24--26, 2017, Conference Track Proceedings. OpenReview.net. https://openreview.net/forum?id=S1jE5L5gl
  18. Reiichiro Nakano Jacob Hilton Suchir Balaji Jeff Wu Long Ouyang Christina Kim Christopher Hesse Shantanu Jain Vineet Kosaraju William Saunders Xu Jiang Karl Cobbe Tyna Eloundou Gretchen Krueger Kevin Button Matthew Knight Benjamin Chess and John Schulman. 2022. WebGPT: Browser-assisted question-answering with human feedback. arxiv: 2112.09332 [cs.CL] · arXiv
  19. 10.3115/1073083.1073135 · DOI · Paper page
  20. Ashwin Paranjape, Omar Khattab, Christopher Potts, Matei Zaharia, and Christopher D Manning. 2021. Hindsight: Posterior-guided training of retrievers for improved open-ended generation. arXiv preprint arXiv:2110.07752 (2021). · arXiv
  21. Max B Paulus, Chris J. Maddison, and Andreas Krause. 2021. Rao-Blackwellizing the Straight-Through Gumbel-Softmax Gradient Estimator. In International Conference on Learning Representations (ICLR '21).
  22. 10.18653/v1/2021.naacl-main.200 · DOI · Paper page
  23. Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Dmytro Okhonko, Samuel Broscheit, Gautier Izacard, Patrick Lewis, Barlas Oug uz, Edouard Grave, Wen-tau Yih, et al. 2021. The Web Is Your Oyster--Knowledge-Intensive NLP against a Very Large Web Corpus. arXiv preprint arXiv:2112.09924 (2021). · arXiv
  24. 10.1145/3404835.3463106 · DOI
  25. Adam Roberts Hyung Won Chung Anselm Levskaya Gaurav Mishra James Bradbury Daniel Andor Sharan Narang Brian Lester Colin Gaffney Afroz Mohiuddin Curtis Hawthorne Aitor Lewkowycz Alex Salcianu Marc van Zee Jacob Austin Sebastian Goodman Livio Baldini Soares Haitang Hu Sasha Tsvyashchenko Aakanksha Chowdhery Jasmijn Bastings Jannis Bulian Xavier Garcia Jianmo Ni Andrew Chen Kathleen Kenealy Jonathan H. Clark Stephan Lee Dan Garrette James Lee-Thorp Colin Raffel Noam Shazeer Marvin Ritter Maarten Bosma Alexandre Passos Jeremy Maitin-Shepard Noah Fiedel Mark Omernick Brennan Saeta Ryan Sepassi Alexander Spiridonov Joshua Newlan and Andrea Gesmundo. 2022. Scaling Up Models and Data with $textttt5x$ and $textttseqio$. arXiv preprint arXiv:2203.17189 (2022). · arXiv
  26. Stephen E. Robertson, Steve Walker, Susan Jones, Micheline Hancock-Beaulieu, and Mike Gatford. 1994. Okapi at TREC-3. In Text Retrieval Conference. https://api.semanticscholar.org/CorpusID:3946054
  27. 10.18653/v1/2021.acl-long.519 · DOI
  28. Alireza Salemi, Sheshera Mysore, Michael Bendersky, and Hamed Zamani. 2024 b. LaMP: When Large Language Models Meet Personalization. arxiv: 2304.11406 [cs.CL] · arXiv
  29. 10.1145/3626772.3657957 · DOI
  30. Noam Shazeer and Mitchell Stern. 2018. Adafactor: Adaptive learning rates with sublinear memory cost. In International Conference on Machine Learning. PMLR, 4596--4604.
  31. Weijia Shi, Sewon Min, Michihiro Yasunaga, Minjoon Seo, Rich James, Mike Lewis, Luke Zettlemoyer, and Wen-tau Yih. 2023. REPLUG: Retrieval-Augmented Black-Box Language Models. arxiv: 2301.12652 [cs.CL] · arXiv
  32. EuiYul Song Sangryul Kim Haeju Lee Joonkee Kim and James Thorne. 2024. Re3val: Reinforced and Reranked Generative Retrieval. arxiv: 2401.16979 [cs.IR] · arXiv
  33. 10.24963/ijcai.2018/609 · DOI
  34. Ilya Sutskever, Oriol Vinyals, and Quoc V Le. 2014. Sequence to Sequence Learning with Neural Networks. In Advances in Neural Information Processing Systems (NeurIPS '14, Vol. 27). Curran Associates, Inc.
  35. James Thorne, Andreas Vlachos, Christos Christodoulopoulos, and Arpit Mittal. 2018a. Fever: a large-scale dataset for fact extraction and verification. arXiv preprint arXiv:1803.05355 (2018). · arXiv
  36. Karthik Valmeekam, Matthew Marquez, Sarath Sreedharan, and Subbarao Kambhampati. 2023. On the Planning Abilities of Large Language Models - A Critical Investigation. arXiv 2305.15771 (2023). · arXiv
  37. Lee Xiong, Chenyan Xiong, Ye Li, Kwok-Fung Tang, Jialin Liu, Paul N. Bennett, Junaid Ahmed, and Arnold Overwijk. 2021. Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrieval. In International Conference on Learning Representations (ICLR '21).
  38. 10.18653/v1/D18--1259 · doi:10.18653/v1/d18--1259
  39. 10.1145/3539813.3545141 · DOI
  40. 10.1145/3477495.3531722 · DOI
  41. Fengbin Zhu Wenqiang Lei Chao Wang Jianming Zheng Soujanya Poria and Tat-Seng Chua. 2021. Retrieving and Reading: A Comprehensive Survey on Open-domain Question Answering. arxiv: 2101.00774 [cs.AI] · arXiv

Cited by

See all 31

Metadata

Authors
Zamani, H., & Bendersky, M.
Affiliations
  • University of Massachusetts Amherst, Amherst, MA, USA
  • Google, Mountain View, CA, USA
Venue
Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval
Publisher
ACM
Published
2024-07-10
Pages
2641-2646
Cited by
31
References
14

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Stochastic RAG: End-to-End Retrieval-Augmented Generation through Expected Utility Maximization. https://app.cochat.ai/papers/10.1145/3626772.3657923
The paper
Zamani, H., & Bendersky, M. (2024). Stochastic RAG: End-to-End Retrieval-Augmented Generation through Expected Utility Maximization. Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval. https://doi.org/10.1145/3626772.3657923

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.