CoChat

Challenges in Building Intelligent Open-domain Dialog Systems

Open access
Huang, Minlie, Zhu, Xiaoyan, Gao, Jianfeng · 2020 · ACM Transactions on Information Systems

The DOI matches its Crossref record; 149 of the 149 references it cites were found in a registry or an index.

Abstract

There is a resurgent interest in developing intelligent open-domain dialog systems due to the availability of large amounts of conversational data and the recent progress on neural approaches to conversational AI [33]. Unlike traditional task-oriented bots, an open-domain dialog system aims to establish long-term connections with users by satisfying the human need for communication, affection, and social belonging. This article reviews the recent work on neural approaches that are devoted to addressing three challenges in developing such systems: semantics , consistency , and interactiveness . Semantics requires a dialog system to not only understand the content of the dialog but also identify users’ emotional and social needs during the conversation. Consistency requires the system to demonstrate a consistent personality to win users’ trust and gain their long-term confidence. Interactiveness refers to the system’s ability to generate interpersonal responses to achieve particular social goals such as entertainment and conforming. The studies we select to present in this survey are based on our unique views and are by no means complete. Nevertheless, we hope that the discussion will inspire new research in developing more intelligent open-domain dialog systems.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3383123

Cites

149 of 149 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 149 references

Research works printed but not linked: 65

  1. Albrecht Joshua, 2007, Proceedings of the ACL. 880--887
  2. Bahdanau Dzmitry, 2015, Proceedings of the ICLR.
  3. Bordes Antoine, 2017, Proceedings of the ICLR.
  4. Casanueva Iñigo, Proceedings of the SIGDIAL. 12--21
  5. Chun-Yen Chen Dian Yu Weiming Wen Yi Mang Yang Jiaping Zhang Mingyang Zhou Kevin Jesse Austin Chau Antara Bhowmick Shreenath Iyer Giritheja Sreenivasulu Sam Davidson Ashwin Bhandare and Zhou Yu. 2018. Gunrock: Building a human-like social bot by leveraging large scale real user data. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP): System Demonstration. Association for Computational Linguistics 79--84. DOI:10.18653/v1/D19-3014 · DOI
  6. Tuan Yun-Nung Chen Yi-Lin, 2019, Proceedings of the EMNLP.
  7. Dagan Ido, 2005, Proceedings of the MLCW. Springer, 177--190
  8. Devlin Jacob, 2019, Proceedings of the NAACL. 4171--4186
  9. Dziri Nouha, Proceedings of the NAACL. 3806--3812
  10. Fang Hao, 2017, Alexa Prize Proceedings
  11. Galley Michel, 2019, Proceedings of the AAAI Dialog System Technology Challenges Workshop.
  12. Ghazvininejad Marjan, 2018, Proceedings of the AAAI. 5110--5117
  13. Gu Jiatao, Proceedings of the ACL.
  14. Henderson Matthew, Proceedings of the SIGDIAL. 467--471
  15. Higashinaka Ryuichiro, 2014, Proceedings of the COLING. 928--939
  16. Hu Baotian, 2014, Proceedings of the NIPS. 2042--2050
  17. Huang Po-Sen, Proceedings of the CIKM. 2333--2338
  18. Kim Yonghee, 2014, Acquisition and use of long-term memory for personalized dialog systems. In MA3HMI, Held in Conjunction with INTERSPEECH, 8757, 78
  19. Kulesza Alex, Proceedings of the TMI.
  20. Li Jiwei, Proceedings of the ACL.
  21. Li Xiang, 2016, Proceedings of the IJCAI. 2845--2851
  22. Li Yanran, 2017, Proceedings of the IJCNLP (Volume 1: Long Papers). 986--995
  23. Lin Chin-Yew, 2004, Rouge: A package for automatic evaluation of summaries. In Text Summarization Branches Out
  24. Lipton Zachary C., 2018, Proceedings of the AAAI. 5237--5244
  25. Lu Zhengdong, 2013, Proceedings of the NIPS. 1367--1375
  26. Luan Yi, 2017, Proceedings of the IJCNLP (Volume 1: Long Papers). 605--614
  27. Mo Kaixiang, 2018, Proceedings of the AAAI. 5317--5324
  28. Moghe Nikita, Proceedings of the EMNLP. 2322--2332
  29. Mostafazadeh Nasrin, 2017, Proceedings of the IJCNLP. 462--472
  30. Mrksic Nikola, Proceedings of the ACL. 1777--1788
  31. Nothdurft Florian, 2015, Proceedings of the NSMMC. 73--80
  32. Oraby Shereen, Proceedings of the SIGDIAL. 180--190
  33. Pang Liang, 2016, Proceedings of the AAAI. 2793--2799
  34. Papineni Kishore, 2002, Proceedings of the ACL. 311--318
  35. Pennebaker James W., 2001, Linguistic inquiry and word count: LIWC 2001. Mahway, Lawrence Erlbaum Associates, 71, 2001
  36. Ritter Alan, Proceedings of the EMNLP. 583--593
  37. Rojas-Barahona Lina Maria, 2017, Proceedings of the EACL. 438--449
  38. Sai Ananya, 2019, Proceedings of the AAAI.
  39. Liu Peter J., Proceedings of the ACL (Volume 1: Long Papers). 1073--1083
  40. Roller Stephen, 2019, Proceedings of the ACL (Vol. 1 Long and Short Papers). 1702--1723
  41. Serban Iulian Vlad, 2016, Proceedings of the AAAI. 3776--3784
  42. Serban Iulian Vlad, 2017, Proceedings of the AAAI. 3295--3301
  43. Shen Xiaoyu, 2018, Proceedings of the AAAI. 5456--5463
  44. Sohn Kihyuk, 2015, Proceedings of the NIPS. 3483--3491
  45. Speer Robyn, 2017, Proceedings of the AAAI. 4444--4451
  46. Su Pei-Hao, Proceedings of the ACL.
  47. Sutskever Ilya, Proceedings of the NIPS. 3104--3112
  48. Tao Chongyang, 2018, Proceedings of the AAAI. 722--729
  49. Vaswani Ashish, 2017, Proceedings of the NIPS. 5998--6008
  50. Vijayakumar Ashwin K., 2018, Proceedings of the AAAI. 7371--7379
  51. Wallace Richard S., Parsing the Turing Test
  52. Wang Jianan, 2017, Proceedings of the SIGHAN@IJCNLP. 1--10
  53. Weston Jason, Proceedings of the EMNLP. 87
  54. Winata Genta Indra, 2017, Proceedings of the INTERSPEECH. 3437--3438
  55. Wolf Thomas, 2018, Proceedings of the NIPS’18 CAI Workshop.
  56. Xing Chen, 2017, Proceedings of the AAAI. 3351--3357
  57. Young Tom, 2018, Proceedings of the AAAI. 4970--4977
  58. Yu Zhou, Proceedings of the SIGDIAL. 404--412
  59. Zhang Rui, Proceedings of the AAAI. 5690--5697
  60. Zhang Wei-Nan, 2017, Proceedings of the WWW. 1--20
  61. Zhang Zhuosheng, 2018, Proceedings of the COLING. 3740--3752
  62. Zhou Ganbin, 2017, Proceedings of the AAAI. 3400--3407
  63. Zhou Ganbin, 2018, Proceedings of the AAAI. 5730--5737
  64. Zhou Hao, 2018, Proceedings of the AAAI. 730--739
  65. Zhou Kangyan, Proceedings of the EMNLP. 708--713

Cited by

Items 301–400 of 424

Metadata

Authors
Huang, M., Zhu, X., & Gao, J.
Affiliations
  • Beijing National Research Center for Information Science and Technology (CN)
  • Microsoft (United States) (US)
Venue
ACM Transactions on Information Systems
Published
2020-04-09
Volume
38
Issue
3
Pages
1-32
ISSN
  • 1046-8188 (ISSN-L)
  • 1558-2868
OpenAlex
W3015322406
Cited by
288
References
124
Citations by year
2026: 12 · 2025: 29 · 2024: 36 · 2023: 63 · 2022: 53 · 2021: 66 · 2020: 26
FWCI
20.43
Type
journal article
Language
en
Open access
Locations
  • ACM Transactions on Information Systems (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Funders
  • National Key R&D Program of China (2018YFC0830200)
  • National Natural Science Foundation of China (61936010/61876096)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
  • Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
  • Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
Keywords
conversational AI, personality consistency, user trust, social-emotional needs

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.