CoChat
Sign Up
Cited by 46Speech and dialogue systemsAI in Service InteractionsTopic Modeling

Learning towards conversational AI: A survey

Open access
Fu, Tingchen, Gao, Shen, Zhao, Xueliang, Wen, Ji-rong, Yan, Rui·2022·AI Open
DOI 10.1016/j.aiopen.2022.02.001
Open this paper in CoChat — free accountOpen PDF

Abstract

Recent years have witnessed a surge of interest in the field of open-domain dialogue. Thanks to the rapid development of social media, large dialogue corpus from the Internet builds up a fundamental premise for data-driven dialogue model. The breakthrough in neural network also brings new ideas to researchers in AI and NLP. A great number of new techniques and methods therefore came into being. In this paper, we review some of the most representative works in recent years and divide existing prevailing frameworks for a dialogue model into three categories. We further analyze the trend of development for open-domain dialogue and summarize the goal of an open-domain dialogue system in two aspects, informative and controllable. The methods we review in this paper are selected according to our unique perspectives and by no means complete. Rather, we hope this servery could benefit NLP community for future research in open-domain dialogue.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/j.aiopen.2022.02.001

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

The citation lists haven’t been fetched yet

References 195 · Cited by 46

Research works printed but not linked: 39

  1. Akama, R., Inada, K., Inoue, N., Kobayashi, S., Inui, K., 2017. Generating stylistically consistent dialog responses with transfer learning. In: Proceedings of the Eighth International Joint Conference on Natural Language Processing, ume 2, pp. 408-412. Short Papers).
  2. Alamri, H., Cartillier, V., Das, A., Wang, J., Cherian, A., Essa, I., Batra, D., Marks, T.K., Hori, C., Anderson, P., et al., 2019. Audio visual scene-aware dialog. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 7558-7567.
  3. Asghar, N., Poupart, P., Hoey, J., Jiang, X., Mou, L., 2018. Affective neural response generation. In: European Conference on Information Retrieval. Springer, pp. 154-166.
  4. Denkowski, M., Lavie, A., 2014. Meteor universal: language specific translation evaluation for any target language. In: Proceedings of the EACL 2014 Workshop on Statistical Machine Translation.
  5. Feng, S., Chen, H., Li, K., Yin, D., 2020. Posterior-gan: towards informative and coherent response generation with posterior generative adversarial network. In: Proceedings of the AAAI Conference on Artificial Intelligence, pp. 7708-7715.
  6. Gao, J., Bi, W., Liu, X., Li, J., Shi, S., 2019a. Generating multiple diverse responses for short-text conversation. In: Proceedings of the AAAI Conference on Artificial Intelligence, pp. 6383-6390.
  7. Hu, Z., Yang, Z., Liang, X., Salakhutdinov, R., Xing, E.P., 2017. Toward controlled generation of text. In: International Conference on Machine Learning. PMLR, pp. 1587-1596.
  8. Kaiser, L., Bengio, S., Roy, A., Vaswani, A., Parmar, N., Uszkoreit, J., Shazeer, N., 2018. Fast decoding in sequence models using discrete latent variables. In: International Conference on Machine Learning. PMLR, pp. 2390-2399.
  9. Kang, L., Hu, B., Wu, X., Chen, Q., He, Y., 2014. A short texts matching method using shallow features and deep features. In: CCF International Conference on Natural Language Processing and Chinese Computing. Springer, pp. 150-159.
  10. Lample, G., Subramanian, S., Smith, E., Denoyer, L., Ranzato, M., Boureau, Y.L., 2018. Multiple-attribute text rewriting. In: International Conference on Learning Representations.
  11. Lewin, I., Lane, M., 2000. A formal model of conversational game theory. In: Proceedings of the 4th Workshop on the Semantics and Pragmatics of Dialogue (Gotalog).
  12. Lin, C.Y., 2004. Rouge: a package for automatic evaluation of summaries. In: Text Summarization Branches Out, pp. 74-81.
  13. Lin, T.Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., Zitnick, C. L., 2014. Microsoft coco: common objects in context. In: European Conference on Computer Vision. Springer, pp. 740-755.
  14. Liu, S., Chen, H., Ren, Z., Feng, Y., Liu, Q., Yin, D., 2018. Knowledge diffusion for neural dialogue generation. In: Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, vol 1, pp. 1489-1498. Long Papers).
  15. Miller, A., Fisch, A., Dodge, J., Karimi, A.H., Bordes, A., Weston, J., 2016. Key-value Memory Networks for Directly Reading Documents arXiv preprint arXiv: 1606.03126. · arXiv
  16. Mohammad, S., 2018. Obtaining reliable human ratings of valence, arousal, and dominance for 20,000 English words. In: Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, ume 1, pp. 174-184. Long Papers).
  17. Niu, T., Bansal, M., 2018. Polite dialogue generation without parallel data. In: Transactions of the Association for Computational Linguistics, 6, pp. 373-389.
  18. Pandey, G., Contractor, D., Kumar, V., Joshi, S., 2018. Exemplar encoder-decoder for neural conversation generation. In: Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, ume 1, pp. 1329-1338. Long Papers).
  19. Saleh, A., Jaques, N., Ghandeharioun, A., Shen, J., Picard, R., 2020. Hierarchical reinforcement learning for open-domain dialog. In: Proceedings of the AAAI Conference on Artificial Intelligence, pp. 8741-8748.
  20. Shuster, K., Humeau, S., Bordes, A., Weston, J., 2018. Image Chat: Engaging Grounded Conversations arXiv preprint arXiv:1811.00945. · arXiv
  21. Tao, C., Feng, J., Yan, R., Wu, W., Jiang, D., 2021. January). A survey on response selection for retrieval-based dialogues (Vol. 21,, 4619-4626.
  22. Tao, C., Mou, L., Zhao, D., Yan, R., 2018. Ruber: an unsupervised method for automatic evaluation of open-domain dialog systems. In: Thirty-Second AAAI Conference on Artificial Intelligence.
  23. Tuan, Y.L., Chen, Y.N., Lee, H.y., 2019. Dykgchat: benchmarking dialogue generation grounding on dynamic knowledge graphs. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing. EMNLP-IJCNLP), pp. 1855-1865.
  24. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł., Polosukhin, I., 2017. In: Attention Is All You Need. NIPS, pp. 5998-6008.
  25. Whang, T., Lee, D., Oh, D., Lee, C., Han, K., Lee, D.h., Lee, S., 2021. Do response selection models really know what's next? utterance manipulation strategies for multi-turn response selection. In: Proceedings of the AAAI Conference on Artificial Intelligence, pp. 14041-14049.
  26. Wu, S., Li, Y., Zhang, D., Zhou, Y., Wu, Z., 2020a. Diverse and informative dialogue generation with context-specific commonsense knowledge awareness. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 5811-5820.
  27. Wu, Y., Wang, Y., Liu, S., 2020b. A dataset for low-resource stylized sequence-to- sequence generation. In: Proceedings of the AAAI Conference on Artificial Intelligence, pp. 9290-9297.
  28. Wu, Y., Wei, F., Huang, S., Wang, Y., Li, Z., Zhou, M., 2019. Response generation by context-aware prototype editing. In: Proceedings of the AAAI Conference on Artificial Intelligence, pp. 7281-7288.
  29. Xu, J., Wang, H., Niu, Z.Y., Wu, H., Che, W., Liu, T., 2020b. Conversational graph grounded policy learning for open-domain conversation generation. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 1835-1845.
  30. Xu, Y., Zhao, H., Zhang, Z., 2021. Topic-aware multi-turn dialogue modeling. In: The Thirty-Fifth AAAI Conference on Artificial Intelligence (AAAI-21).
  31. Xu, Z., Liu, B., Wang, B., Sun, C.J., Wang, X., Wang, Z., Qi, C., 2017. Neural response generation via gan with an approximate embedding layer. In: Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, pp. 617-626.
  32. Yang, L., Qiu, M., Qu, C., Guo, J., Zhang, Y., Croft, W.B., Huang, J., Chen, H., 2018a. Response ranking with deep matching networks and external knowledge in information-seeking conversation systems. In: The 41st International Acm Sigir Conference on Research & Development in Information Retrieval, pp. 245-254.
  33. Young, T., Cambria, E., Chaturvedi, I., Zhou, H., Biswas, S., Huang, M., 2018. Augmenting end-to-end dialogue systems with commonsense knowledge. In: Thirty- Second AAAI Conference on Artificial Intelligence.
  34. Yuan, C., Zhou, W., Li, M., Lv, S., Zhu, F., Han, J., Hu, S., 2019. Multi-hop selector network for multi-turn response selection in retrieval-based chatbots. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing. EMNLP-IJCNLP), pp. 111-120.
  35. Zhai, K., Williams, J.D., 2014. Discovering latent structure in task-oriented dialogues. In: Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, vol 1, pp. 36-46. Long Papers).
  36. Zhang, H., Lan, Y., Pang, L., Guo, J., Cheng, X., 2019a. Recosa: detecting the relevant contexts with self-attention for multi-turn dialogue generation. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp. 3721-3730.
  37. Zhang, Z., Li, J., Zhu, P., Zhao, H., Liu, G., 2018d. Modeling Multi-Turn Conversation with Deep Utterance Aggregation. ACL, pp. 3740-3752.
  38. Zheng, Y., Chen, Z., Zhang, R., Huang, S., Mao, X., Huang, M., 2021. Stylized dialogue response generation using stylized unpaired texts. In: Proceedings of the AAAI Conference on Artificial Intelligence, pp. 14558-14567.
  39. Zheng, Y., Zhang, R., Huang, M., Mao, X., 2020. A pre-training based personalized dialogue generation model with persona-sparse data. In: Proceedings of the AAAI Conference on Artificial Intelligence, pp. 9693-9700.

Authors
Fu, T., Gao, S., Zhao, X., Wen, J.-R., & Yan, R.
Affiliations
  • Renmin University of China (CN)
  • Peking University (CN)
Corresponding author
Yan, Rui
ORCID
Venue
AI Open
Publisher
Elsevier BV
Published
2022
Volume
3
Pages
14-28
ISSN
2666-6510 (ISSN-L)
DOI
10.1016/j.aiopen.2022.02.001
OpenAlex
W4214663417
Cited by
46
References
195
Citations by year
2026: 7 · 2025: 8 · 2024: 14 · 2023: 10 · 2022: 7
FWCI
3.21
Type
journal article
Language
en
Open access
Licence
Locations
  • AI Open (publishedVersion, cc-by-nc-nd)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
  • Physical Sciences › Computer Science › Artificial Intelligence › AI in Service Interactions
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
Keywords
open-domain dialogue, conversational AI, dialogue systems, dialogue model, dialogue corpus, controllability, informativeness

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review