Cited by 38Speech and dialogue systemsTopic ModelingMultimodal Machine Learning Applications

RHO: Reducing Hallucination in Open-domain Dialogues with Knowledge Grounding

Open access
Ji, Ziwei, Liu, Zihan, Lee, Nayeon, Yu, Tiezheng, Wilie, Bryan, Zeng, Min, Fung, Pascale·2023·Findings of the Association for Computational Linguistics: ACL 2023

Abstract

Dialogue systems can leverage large pretrained language models and knowledge to generate fluent and informative responses.However, these models are still prone to produce hallucinated responses not supported by the input source, which greatly hinders their application.The heterogeneity between external knowledge and dialogue context challenges representation learning and source integration, which further contributes to unfaithfulness.To handle this challenge and generate more faithful responses, this paper presents RHO (ρ) utilizing the representations of linked entities and relation predicates from a knowledge graph (KG).We propose (1) local knowledge grounding to combine textual embeddings with the corresponding KG embeddings; and (2) global knowledge grounding to equip RHO with multi-hop reasoning abilities via the attention mechanism.In addition, we devise a response re-ranking technique based on walks over KG sub-graphs for better conversational reasoning.Experimental results on OpenDialKG (Moon et al., 2019) show that our approach significantly outperforms stateof-the-art methods on both automatic and human evaluation by a large margin, especially in hallucination reduction (17.54% in FeQA (Durmus et al., 2020)). 1

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.18653/v1/2023.findings-acl.275

Cites

55 of 55 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • RHO has been empirically shown to tackle hallucinations in open-domain dialogues.

    “RHO [108] is a framework that uses three mechanisms to tackle hallucinations, namely, local knowledge grounding, global knowledge grounding, and response re-ranking to tackle hallucinations in open-domain dialogues, and has been empirically shown to perform this.”

    From Survey of Hallucination in Natural Language Generation (2023) · cites this paper as [108]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 3

  1. Alan Akbik, Tanja Bergmann, Duncan Blythe, Kashif Rasul, Stefan Schweter, and Roland Vollgraf. 2019. FLAIR: An easy-to-use framework for state-of-the- art NLP. In NAACL 2019, 2019 Annual Conference of the North American Chapter of the Association for Computational Linguistics (Demonstrations), pages 54-59.
  2. Nouha Dziri, Sivan Milton, Mo Yu, Osmar Zaiane, and Siva Reddy. 2022. On the origin of hallucinations in conversational models: Is it the datasets or the models? NAACL.
  3. Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, et al. 2019. Language models are unsupervised multitask learners. OpenAI blog, 1(8):9.

Cited by

Sorted by citations

Authors
Ji, Z., Liu, Z., Lee, N., Yu, T., Wilie, B., Zeng, M., & Fung, P.
Affiliations
Hong Kong University of Science and Technology (HK)
Corresponding author
Fung, Pascale
Venue
Findings of the Association for Computational Linguistics: ACL 2023
Published
2023
Pages
4504-4522
OpenAlex
W4385570284
Cited by
37
References
54
Citations by year
2026: 11 · 2025: 10 · 2024: 11 · 2023: 5
FWCI
6.56
Type
conference paper
Language
en
Open access
Licence
cc-by
Locations
  • Findings of the Association for Computational Linguistics: ACL (Findings of ACL) (publishedVersion, cc-by)
  • arXiv (Cornell University) (submittedVersion)
  • Rare & Special e-Zone (The Hong Kong University of Science and Technology) (submittedVersion)
  • arXiv (Cornell University) (cc-by)
Funders
National Natural Science Foundation of China
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
Keywords
hallucination mitigation, open-domain dialogue systems, knowledge grounding, knowledge graphs, entity and relation embeddings, multi-hop reasoning

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review