Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.

Towards Coherent and Engaging Spoken Dialog Response Generation Using Automatic Conversation Evaluators

Open access
Yi, Sanghyun, Goel, Rahul, Khatri, Chandra, Cervone, Alessandra, Chung, Tagyoung, Hedayatnia, Behnam, Venkatesh, Anu, Gabriel, Raefer, Hakkani-Tur, Dilek · 2019 · Proceedings of the 12th International Conference on Natural Language Generation

Abstract

Sanghyun Yi, Rahul Goel, Chandra Khatri, Alessandra Cervone, Tagyoung Chung, Behnam Hedayatnia, Anu Venkatesh, Raefer Gabriel, Dilek Hakkani-Tur. Proceedings of the 12th International Conference on Natural Language Generation. 2019.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.18653/v1/w19-8608

Cites

59 of 59 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 Conversation Evaluators
Figure 1 Conversation EvaluatorsCC-BY · From the PDF
Image 2
CC-BY · From the PDF
(b) Reranking Using Evaluators. Top 15 candidates from beam search are passed to the evaluators. The candidate that maximizes the reranker score is chosen as the output. Encoderdecoder remain unchanged.
(b) Reranking Using Evaluators. Top 15 candidates from beam search are passed to the evaluators. The candidate that maximizes the reranker score is chosen as the output. Encoderdecoder remain unchanged.CC-BY · From the PDF
(c) Fine-tuning Using Evaluators. We minimize cross entropy loss and maximize discriminator loss. The output of softmax, i.e., likelihood over vocabulary for the length of output is passed to the evaluator along with the input ( x and context). Evaluator generates the discriminative score over | V |× len generator output, which is subtracted from the loss. The updated loss is back-propagated to update encoder-decoder.
(c) Fine-tuning Using Evaluators. We minimize cross entropy loss and maximize discriminator loss. The output of softmax, i.e., likelihood over vocabulary for the length of output is passed to the evaluator along with the input ( x and context). Evaluator generates the discriminative score over | V |× len generator output, which is subtracted from the loss. The updated loss is back-propagated to update encoder-decoder.CC-BY · From the PDF

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 53 references

Research works printed but not linked: 3

  1. ACL.
  2. Iulian V Serban, Alessandro Sordoni, Yoshua Bengio, Aaron Courville, and Joelle Pineau. 2016b. Build- ing end-to-end dialogue systems using generative hi- erarchical neural network models. In AAAI.
  3. Ellen M Voorhees and Hoa Trang Dang. 2003. Overview of the trec 2003 question answering track. In TREC, volume 2003, pages 54-68.

Cited by

See all 27

Metadata

Authors
Yi, S., Goel, R., Khatri, C., Cervone, A., Chung, T., Hedayatnia, B., Venkatesh, A., Gabriel, R., & Hakkani-Tur, D.
Affiliations
  • California Institute of Technology (US)
  • Google (United States) (US)
  • Uber AI (United States) (US)
  • University of Trento (IT)
  • Amazon (United States) (US)
Venue
Proceedings of the 12th International Conference on Natural Language Generation
Published
2019
Pages
65-75
OpenAlex
W2996044589
Cited by
26
References
53
Citations by year
2026: 2 · 2025: 1 · 2024: 5 · 2023: 6 · 2022: 2 · 2021: 4 · 2020: 6
FWCI
1.15
Type
conference paper
Language
en
Open access
Licence
cc-by
Locations
International Conference on Natural Language Generation (publishedVersion, cc-by)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
  • Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
Keywords
dialogue coherence, chatbots

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Towards Coherent and Engaging Spoken Dialog Response Generation Using Automatic Conversation Evaluators. https://app.cochat.ai/papers/10.18653/v1/w19-8608
The paper
Yi, S., Goel, R., Khatri, C., Cervone, A., Chung, T., Hedayatnia, B., Venkatesh, A., Gabriel, R., & Hakkani-Tur, D. (2019). Towards Coherent and Engaging Spoken Dialog Response Generation Using Automatic Conversation Evaluators. Proceedings of the 12th International Conference on Natural Language Generation. https://doi.org/10.18653/v1/w19-8608

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.