CoChat
Sign Up
Cited by 23

The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.

Search Engines in the AI Era: A Qualitative Understanding to the False Promise of Factual and Verifiable Source-Cited Responses in LLM-based Search

Narayanan Venkit, Pranav, Laban, Philippe, Zhou, Yilun, Mao, Yixin, Wu, Chien-Sheng·2025·Proceedings of the 2025 ACM Conference on Fairness, Accountability, and Transparency
DOI 10.1145/3715275.3732089
Open this paper in CoChat — free account

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3715275.3732089

Cites

8 of 8 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Flagged first, then by citations

Show all 8 references

Research works printed but not linked: 54

  1. Sabira Arefin. 2024. AI Revolutionizing Healthcare: Innovations Challenges and Ethical Considerations. MZ Journal of Artificial Intelligence 1 2 (2024) 1–17.
  2. Carl Auerbach and Louise B Silverstein. 2003. Qualitative data: An introduction to coding and analysis. Vol. 21. NYU press.
  3. 10.1145/3531146.3533157 · DOI
  4. Valerio Capraro Austin Lentsch Daron Acemoglu Selin Akgun Aisel Akhmedova Ennio Bilancini Jean-François Bonnefon Pablo Brañas-Garza Luigi Butera Karen M Douglas et al. 2024. The impact of generative artificial intelligence on socioeconomic inequalities and policy making. PNAS nexus 3 6 (2024). · DOI · Paper page
  5. Kathy Charmaz. 2006. Constructing grounded theory: A practical guide through qualitative analysis. sage.
  6. Kathy Charmaz. 2017. Constructivist grounded theory. The Journal of Positive Psychology 12 3 (2017) 299–300. · DOI · Paper page
  7. Robert Cooper and Michael Foster. 1971. Sociotechnical systems. American Psychologist 26 5 (1971) 467. · DOI
  8. 10.1145/3584931.3608920 · DOI
  9. Dipto Das, Shion Guha, Jed R Brubaker, and Bryan Semaan. 2024. The“Colonial Impulse" of Natural Language Processing: An Audit of Bengali Sentiment Analysis Tools and Their Identity-based Biases. In Proceedings of the CHI Conference on Human Factors in Computing Systems. 1–18.
  10. 10.1145/3593013.3594046 · DOI
  11. Sarah Dean Thomas Krendl Gilbert Nathan Lambert and Tom Zick. 2021. Axes for sociotechnical inquiry in AI research. IEEE Transactions on Technology and Society 2 2 (2021) 62–70. · DOI
  12. 10.1007/978-3-030-60117-1_33 · DOI · Paper page
  13. 10.1145/3613905.3636311 · DOI
  14. Shahul Es Jithin James Luis Espinosa-Anke and Steven Schockaert. 2023. Ragas: Automated evaluation of retrieval augmented generation. arXiv preprint arXiv:https://arXiv.org/abs/2309.15217 (2023). · arXiv
  15. Emilio Ferrara. 2024. GenAI against humanity: Nefarious applications of generative artificial intelligence and large language models. Journal of Computational Social Science (2024) 1–21. · DOI
  16. 10.1145/3593013.3593989 · DOI · Paper page
  17. Sanjana Gautam Pranav Narayanan Venkit and Sourojit Ghosh. 2024. From melting pots to misrepresentations: Exploring harms in generative ai. arXiv preprint arXiv:https://arXiv.org/abs/2403.10776 (2024). · arXiv
  18. Sourojit Ghosh Pranav Narayanan Venkit Sanjana Gautam Shomir Wilson and Aylin Caliskan. 2024. Do Generative AI Models Output Harm while Representing Non-Western Cultures: Evidence from A Community-Centered Approach. arXiv preprint arXiv:https://arXiv.org/abs/2407.14779 (2024). · DOI
  19. 10.1145/3630106.3658912 · DOI
  20. David Grant. 2025. Populism, Artificial Intelligence and Law: A New Understanding of the Dynamics of the Present. Taylor & Francis.
  21. 10.4324/9780429448546 · DOI
  22. Donna Haraway. 2013. Situated knowledges: The science question in feminism and the privilege of partial perspective 1. In Women, science, and technology. Routledge, 455–472.
  23. Carol Mullins Hayes. 2023. Generative artificial intelligence and copyright: Both sides of the Black Box. Available at SSRN 4517799 (2023).
  24. Lei Huang Weijiang Yu Weitao Ma Weihong Zhong Zhangyin Feng Haotian Wang Qianglong Chen Weihua Peng Xiaocheng Feng Bing Qin et al. 2023. A survey on hallucination in large language models: Principles taxonomy challenges and open questions. arXiv preprint arXiv:https://arXiv.org/abs/2311.05232 (2023). · arXiv
  25. 10.1145/1753326.1753386 · DOI
  26. 10.18653/v1/2024.findings-acl.850 · DOI
  27. Philippe Laban Alexander R Fabbri Caiming Xiong and Chien-Sheng Wu. 2024. Summary of a Haystack: A Challenge to Long-Context LLMs and RAG Systems. arXiv preprint arXiv:https://arXiv.org/abs/2407.01370 (2024). · DOI
  28. 10.1145/3593013.3594062 · DOI
  29. Alice Li and Luanne Sinnamon. 2024. Generative AI Search Engines as Arbiters of Public Knowledge: An Audit of Bias and Authority. arXiv preprint arXiv:https://arXiv.org/abs/2405.14034 (2024). · arXiv
  30. Nora Freya Lindemann. 2024. Chatbots search engines and the sealing of knowledges. AI & SOCIETY (2024) 1–14. · DOI
  31. Sebastian Lins Konstantin D Pandl Heiner Teigeler Scott Thiebes Calvin Bayer and Ali Sunyaev. 2021. Artificial intelligence as a service: classification and research directions. Business & Information Systems Engineering 63 (2021) 441–456. · DOI
  32. Patrick Maillé Gwen Maudet Mathieu Simon and Bruno Tuffin. 2022. Are search engines biased? Detecting and reducing bias using meta search engines. Electronic Commerce Research and Applications (2022) 101132. · DOI
  33. Sharon McDonald Helen M Edwards and Tingting Zhao. 2012. Exploring think-alouds in usability testing: An international survey. IEEE Transactions on Professional Communication 55 1 (2012) 2–19. · DOI
  34. 10.1145/3593013.3594109 · DOI · Paper page
  35. Shahan Ali Memon and Jevin D West. 2024. Search engines post-ChatGPT: How generative artificial intelligence could make search less reliable. arXiv preprint arXiv:https://arXiv.org/abs/2402.11707 (2024). · arXiv
  36. Abbe Mowshowitz and Akira Kawaguchi. 2005. Measuring search engine bias. Information processing & management 41 5 (2005) 1193–1205. · DOI · Paper page
  37. Rainer Mühlhoff. 2018. Digitale Entmündigung und User Experience Design. Leviathan 46 4 (2018) 551–574. · DOI
  38. Tarek Naous, Michael Joseph Ryan, and Wei Xu. 2023. Having Beer after Prayer? Measuring Cultural Bias in Large Language Models. In Annual Meeting of the Association for Computational Linguistics. https://api.semanticscholar.org/CorpusID:258865272
  39. 10.1145/3600211.3604754 · DOI
  40. 10.1145/3600211.3604667 · DOI
  41. 10.1145/1142405.1142439 · DOI
  42. Cathy O’neil. 2017. Weapons of math destruction: How big data increases inequality and threatens democracy. Crown.
  43. 10.1145/3630106.3658916 · DOI
  44. 10.1007/979-8-8688-0473-1_2 · DOI
  45. 10.1145/3630106.3658942 · DOI · Paper page
  46. Eryk Salvaggio. 2024. Challenging the myths of Generative AI. https://www.techpolicy.press/challenging-the-myths-of-generative-ai/
  47. Chirag Shah and Emily M Bender. 2024. Envisioning information access systems: What makes for good tools and a healthy Web? ACM Transactions on the Web 18 3 (2024) 1–24. · DOI
  48. 10.1145/3593013.3594112 · DOI
  49. Elizabeth A St. Pierre and Alecia Y Jackson. 2014. Qualitative data analysis after coding. 715–719 pages. · DOI
  50. 10.18653/v1/2023.emnlp-main.848 · DOI
  51. Pranav Narayanan Venkit Tatiana Chakravorti Vipul Gupta Heidi Biggs Mukund Srinath Koustava Goswami Sarah Rajtmajer and Shomir Wilson. 2024. " Confidently Nonsensical?”: A Critical Survey on the Perspectives and Challenges of’Hallucinations’ in NLP. arXiv preprint arXiv:https://arXiv.org/abs/2404.07461 (2024). · DOI
  52. 10.18653/v1/2024.emnlp-main.375 · DOI
  53. 10.18653/v1/2023.eacl-main.9 · DOI
  54. 10.18653/v1/2023.trustnlp-1.3 · DOI

Cited by

Sorted by citations

See all 23

Metadata

Authors
Narayanan Venkit, P., Laban, P., Zhou, Y., Mao, Y., & Wu, C.-S.
Affiliations
  • Pennsylvania State University, University Park, USA
  • Salesforce AI Research, Palo Alto, USA
ORCID
Venue
Proceedings of the 2025 ACM Conference on Fairness, Accountability, and Transparency
Publisher
ACM
Published
2025-06-23
Pages
1325-1340
DOI
10.1145/3715275.3732089
Cited by
23
References
8

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review