Challenges in Building Intelligent Open-domain Dialog Systems
Open accessThe DOI matches its Crossref record; 149 of the 149 references it cites were found in a registry or an index.
Abstract
There is a resurgent interest in developing intelligent open-domain dialog systems due to the availability of large amounts of conversational data and the recent progress on neural approaches to conversational AI [33]. Unlike traditional task-oriented bots, an open-domain dialog system aims to establish long-term connections with users by satisfying the human need for communication, affection, and social belonging. This article reviews the recent work on neural approaches that are devoted to addressing three challenges in developing such systems: semantics , consistency , and interactiveness . Semantics requires a dialog system to not only understand the content of the dialog but also identify users’ emotional and social needs during the conversation. Consistency requires the system to demonstrate a consistent personality to win users’ trust and gain their long-term confidence. Interactiveness refers to the system’s ability to generate interpersonal responses to achieve particular social goals such as entertainment and conforming. The studies we select to present in this survey are based on our unique views and are by no means complete. Nevertheless, we hope that the discussion will inspire new research in developing more intelligent open-domain dialog systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“More importantly, they tend to produce factual inaccuracies and errors (Lin et al., 2022;Maynez et al., 2020;Huang et al., 2020).”
From In-Context Retrieval-Augmented Language Models (2023) · cites this paper as Huang et al., 2020
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
Introduction to information retrieval
(2009) · Choice Reviews Online · doi:10.5860/choice.46-2715 · Cited by 12,278
Introduction to Information Retrieval
Manning, C. D., Raghavan, P., & Schütze, H. (2008) · doi:10.1017/cbo9780511809071 · Cited by 11,288
I.—COMPUTING MACHINERY AND INTELLIGENCE
TURING, A. M. (1950) · Mind · doi:10.1093/mind/lix.236.433 · Cited by 10,290
A very brief measure of the Big-Five personality domains
Gosling, S. D., Rentfrow, P. J., & Swann, W. B. (2003) · Journal of Research in Personality · doi:10.1016/s0092-6566(03)00046-1 · Cited by 8,307
Intriguing properties of neural networks
Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., & Fergus, R. (2013) · arXiv · doi:10.48550/arxiv.1312.6199 · Cited by 8,143
ELIZA—a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1966) · Communications of the ACM · doi:10.1145/365153.365168 · Cited by 4,452 · cited 1×
“Early dialog systems such as Eliza [103], Parry [8], and Alice [95], despite being instrumental to significantly advancing machine intelligence, worked well only in constrained environments.”
BackgroundGet To The Point: Summarization with Pointer-Generator Networks
See, A., Liu, P. J., & Manning, C. D. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1099 · Cited by 3,775
Norman, W. T. (1963) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0040291 · Cited by 2,485
Norms of valence, arousal, and dominance for 13,915 English lemmas
Warriner, A. B., Kuperman, V., & Brysbaert, M. (2013) · Behavior Research Methods · doi:10.3758/s13428-012-0314-x · Cited by 1,959
Research works printed but not linked: 65
- Albrecht Joshua, 2007, Proceedings of the ACL. 880--887
- Bahdanau Dzmitry, 2015, Proceedings of the ICLR.
- Bordes Antoine, 2017, Proceedings of the ICLR.
- Casanueva Iñigo, Proceedings of the SIGDIAL. 12--21
- Chun-Yen Chen Dian Yu Weiming Wen Yi Mang Yang Jiaping Zhang Mingyang Zhou Kevin Jesse Austin Chau Antara Bhowmick Shreenath Iyer Giritheja Sreenivasulu Sam Davidson Ashwin Bhandare and Zhou Yu. 2018. Gunrock: Building a human-like social bot by leveraging large scale real user data. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP): System Demonstration. Association for Computational Linguistics 79--84. DOI:10.18653/v1/D19-3014 · DOI
- Tuan Yun-Nung Chen Yi-Lin, 2019, Proceedings of the EMNLP.
- Dagan Ido, 2005, Proceedings of the MLCW. Springer, 177--190
- Devlin Jacob, 2019, Proceedings of the NAACL. 4171--4186
- Dziri Nouha, Proceedings of the NAACL. 3806--3812
- Fang Hao, 2017, Alexa Prize Proceedings
- Galley Michel, 2019, Proceedings of the AAAI Dialog System Technology Challenges Workshop.
- Ghazvininejad Marjan, 2018, Proceedings of the AAAI. 5110--5117
- Gu Jiatao, Proceedings of the ACL.
- Henderson Matthew, Proceedings of the SIGDIAL. 467--471
- Higashinaka Ryuichiro, 2014, Proceedings of the COLING. 928--939
- Hu Baotian, 2014, Proceedings of the NIPS. 2042--2050
- Huang Po-Sen, Proceedings of the CIKM. 2333--2338
- Kim Yonghee, 2014, Acquisition and use of long-term memory for personalized dialog systems. In MA3HMI, Held in Conjunction with INTERSPEECH, 8757, 78
- Kulesza Alex, Proceedings of the TMI.
- Li Jiwei, Proceedings of the ACL.
- Li Xiang, 2016, Proceedings of the IJCAI. 2845--2851
- Li Yanran, 2017, Proceedings of the IJCNLP (Volume 1: Long Papers). 986--995
- Lin Chin-Yew, 2004, Rouge: A package for automatic evaluation of summaries. In Text Summarization Branches Out
- Lipton Zachary C., 2018, Proceedings of the AAAI. 5237--5244
- Lu Zhengdong, 2013, Proceedings of the NIPS. 1367--1375
- Luan Yi, 2017, Proceedings of the IJCNLP (Volume 1: Long Papers). 605--614
- Mo Kaixiang, 2018, Proceedings of the AAAI. 5317--5324
- Moghe Nikita, Proceedings of the EMNLP. 2322--2332
- Mostafazadeh Nasrin, 2017, Proceedings of the IJCNLP. 462--472
- Mrksic Nikola, Proceedings of the ACL. 1777--1788
- Nothdurft Florian, 2015, Proceedings of the NSMMC. 73--80
- Oraby Shereen, Proceedings of the SIGDIAL. 180--190
- Pang Liang, 2016, Proceedings of the AAAI. 2793--2799
- Papineni Kishore, 2002, Proceedings of the ACL. 311--318
- Pennebaker James W., 2001, Linguistic inquiry and word count: LIWC 2001. Mahway, Lawrence Erlbaum Associates, 71, 2001
- Ritter Alan, Proceedings of the EMNLP. 583--593
- Rojas-Barahona Lina Maria, 2017, Proceedings of the EACL. 438--449
- Sai Ananya, 2019, Proceedings of the AAAI.
- Liu Peter J., Proceedings of the ACL (Volume 1: Long Papers). 1073--1083
- Roller Stephen, 2019, Proceedings of the ACL (Vol. 1 Long and Short Papers). 1702--1723
- Serban Iulian Vlad, 2016, Proceedings of the AAAI. 3776--3784
- Serban Iulian Vlad, 2017, Proceedings of the AAAI. 3295--3301
- Shen Xiaoyu, 2018, Proceedings of the AAAI. 5456--5463
- Sohn Kihyuk, 2015, Proceedings of the NIPS. 3483--3491
- Speer Robyn, 2017, Proceedings of the AAAI. 4444--4451
- Su Pei-Hao, Proceedings of the ACL.
- Sutskever Ilya, Proceedings of the NIPS. 3104--3112
- Tao Chongyang, 2018, Proceedings of the AAAI. 722--729
- Vaswani Ashish, 2017, Proceedings of the NIPS. 5998--6008
- Vijayakumar Ashwin K., 2018, Proceedings of the AAAI. 7371--7379
- Wallace Richard S., Parsing the Turing Test
- Wang Jianan, 2017, Proceedings of the SIGHAN@IJCNLP. 1--10
- Weston Jason, Proceedings of the EMNLP. 87
- Winata Genta Indra, 2017, Proceedings of the INTERSPEECH. 3437--3438
- Wolf Thomas, 2018, Proceedings of the NIPS’18 CAI Workshop.
- Xing Chen, 2017, Proceedings of the AAAI. 3351--3357
- Young Tom, 2018, Proceedings of the AAAI. 4970--4977
- Yu Zhou, Proceedings of the SIGDIAL. 404--412
- Zhang Rui, Proceedings of the AAAI. 5690--5697
- Zhang Wei-Nan, 2017, Proceedings of the WWW. 1--20
- Zhang Zhuosheng, 2018, Proceedings of the COLING. 3740--3752
- Zhou Ganbin, 2017, Proceedings of the AAAI. 3400--3407
- Zhou Ganbin, 2018, Proceedings of the AAAI. 5730--5737
- Zhou Hao, 2018, Proceedings of the AAAI. 730--739
- Zhou Kangyan, Proceedings of the EMNLP. 708--713
Cited by
Survey of Hallucination in Natural Language Generation
Ji, Z., Lee, N., Frieske, R., Yu, T., Su, D., Xu, Y., Ishii, E., Bang, Y. J., Madotto, A., & Fung, P. (2023) · ACM Computing Surveys · doi:10.1145/3571730 · Cited by 5,025
“In contrast, the tolerance is relatively higher in dialogue systems because the desired characteristics are not only faithfulness but also user engagement, especially in open-domain dialogue systems [73].”
BackgroundChatbots applications in education: A systematic review
Okonkwo, C. W., & Ade-Ibijola, A. (2021) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2021.100033 · Cited by 879
The design and implementation of Xiaoice, an empathetic social chatbot
Zhou, L., Gao, J., Li, D., & Shum, H.-Y. (2020) · Computational Linguistics · doi:10.1162/coli_a_00368 · Cited by 777
Self-citationThe Design and Implementation of XiaoIce, an Empathetic Social Chatbot
Zhou, L., Gao, J., Li, D., & Shum, H.-Y. (2018) · arXiv · doi:10.48550/arxiv.1812.08989 · Cited by 777
Self-citationMarked Personas: Using Natural Language Prompts to Measure Stereotypes in Language Models
Cheng, M., Durmus, E., & Jurafsky, D. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2023.acl-long.84 · Cited by 115
In-Context Retrieval-Augmented Language Models
Ram, O., Levine, Y., Dalmedigos, I., Muhlgay, D., Shashua, A., Leyton-Brown, K., & Shoham, Y. (2023) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00605 · Cited by 449
“More importantly, they tend to produce factual inac-curacies and errors (Lin et al., 2022; Maynez et al., 2020; Huang et al., 2020).”
BackgroundBeyond Functional Correctness: Exploring Hallucinations in LLM-Generated Code
Liu, F., Liu, Y., Shi, L., Yang, Z., Zhang, L., Lian, X., Li, Z., & Ma, Y. (2026) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2026.3657432 · Cited by 408
A Survey of Controllable Text Generation Using Transformer-based Pre-trained Language Models
Zhang, H., Song, H., Li, S., Zhou, M., & Song, D. (2024) · ACM Computing Surveys · doi:10.1145/3617680 · Cited by 317
Generative Adversarial Networks for face generation: A survey
Kammoun, A., Slama, R., Tabia, H., Ouni, T., & Abid, M. (2022) · ACM Computing Surveys · doi:10.1145/1122445.1122456 · Cited by 311
Alexa, what do we know about conversational commerce? Insights from a systematic literature review.
Lim, W. M., Kumar, S., Verma, S., & Chaturvedi, R. (2022) · Psychology & Marketing · doi:10.1002/mar.21654 · Cited by 293
A Computational Approach to Understanding Empathy Expressed in Text-Based Mental Health Support
Sharma, A., Miner, A., Atkins, D., & Althoff, T. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.425 · Cited by 268
Large language models hallucination: A comprehensive survey
Alansari, A., & Luqman, H. (2026) · Computer Science Review · doi:10.1016/j.cosrev.2026.100970 · Cited by 257
MindfulDiary: Harnessing Large Language Model to Support Psychiatric Patients' Journaling
Kim, T., Bae, S., Kim, H. A., Lee, S. H., Hong, H., Yang, C.-M., & Kim, Y. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642937 · Cited by 222
A Pre-Training Based Personalized Dialogue Generation Model with Persona-Sparse Data
Zheng, Y., Zhang, R., Huang, M., & Mao, X. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i05.6518 · Cited by 219
Self-citationTowards Emotional Support Dialog Systems
Liu, S., Zheng, C., Demasi, O., Sabour, S., Li, Y., Yu, Z., Jiang, Y., & Huang, M. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.269 · Cited by 216
Self-citationLong Time No See! Open-Domain Conversation with Long-Term Persona Memory
Xu, X., Gou, Z., Wu, W., Niu, Z.-Y., Wu, H., Wang, H., & Wang, S. (2022) · Findings of the Association for Computational Linguistics: ACL 2022 · doi:10.18653/v1/2022.findings-acl.207 · Cited by 63
Pre-Trained Language Models for Text Generation: A Survey
Li, J., Tang, T., Zhao, W. X., Nie, J.-Y., & Wen, J.-R. (2024) · ACM Computing Surveys · doi:10.1145/3649449 · Cited by 195
Internet-Augmented Dialogue Generation
Komeili, M., Shuster, K., & Weston, J. (2022) · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2022.acl-long.579 · Cited by 192
Beyond Goldfish Memory: Long-Term Open-Domain Conversation
Xu, J., Szlam, A., & Weston, J. (2022) · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2022.acl-long.356 · Cited by 188
Beyond Functional Correctness: Exploring Hallucinations in LLM-Generated Code
Liu, F., Liu, Y., Shi, L., Yang, Z., Zhang, L., Lian, X., Li, Z., & Ma, Y. (2024) · arXiv · doi:10.48550/arxiv.2404.00971 · Cited by 188
Wang, H., Wu, W., Dou, Z., He, L., & Yang, L. (2023) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2023.105173 · Cited by 176
Recent advances and challenges in task-oriented dialog systems
Zhang, Z., Takanobu, R., Zhu, Q., Huang, M., & Zhu, X. (2020) · Science China Technological Sciences · doi:10.1007/s11431-020-1692-3 · Cited by 175
Self-citationJo, E., Epstein, D. A., Jung, H., & Kim, Y.-H. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581503 · Cited by 174
“suggest that open-dialog systems should aim to (1) understand the semantics of what the user said, (2) behave consistently with their predefned persona, conversation history, and speaking style, and (3) interact with the user emotionally [23].”
BackgroundInfluentialThe Moral Integrity Corpus: A Benchmark for Ethical Dialogue Systems
Ziems, C., Yu, J., Wang, Y.-C., Halevy, A., & Yang, D. (2022) · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2022.acl-long.261 · Cited by 58
A Large-Scale Chinese Short-Text Conversation Dataset
Wang, Y., Ke, P., Zheng, Y., Huang, K., Jiang, Y., Zhu, X., & Huang, M. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-60450-9_8 · Cited by 167
Self-citationSharma, A., Lin, I. W., Miner, A. S., Atkins, D. C., & Althoff, T. (2021) · Proceedings of the Web Conference 2021 · doi:10.1145/3442381.3450097 · Cited by 163
Building and Evaluating Open-Domain Dialogue Corpora with Clarifying Questions
Aliannejadi, M., Kiseleva, J., Chuklin, A., Dalton, J., & Burtsev, M. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.367 · Cited by 157
Beyond Goldfish Memory: Long-Term Open-Domain Conversation
Xu, J., Szlam, A., & Weston, J. (2021) · arXiv · doi:10.48550/arxiv.2107.07567 · Cited by 148
Peng, W., Hu, Y. H., Xing, L., Xie, Y., Sun, Y., & Li, Y. (2022) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/600 · Cited by 148
A Survey on Proactive Dialogue Systems: Problems, Methods, and Prospects
Deng, Y., Lei, W., Lam, W. P., & Chua, T. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/738 · Cited by 147
Ma, Z., Mei, Y., Long, Y., Su, Z., & Gajos, K. Z. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642482 · Cited by 129
Building Emotional Support Chatbots in the Era of LLMsPreprint
Zheng, Z., Liao, L., Deng, Y., & Nie, L. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2308.11584 · Cited by 127
Conversing by Reading: Contentful Neural Conversation with On-demand Machine Reading
Qin, L., Galley, M., Brockett, C., Liu, X., Gao, X., Dolan, B., Choi, Y., & Gao, J. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1539 · Cited by 89
Self-citationSeo, W., Yang, C., & Kim, Y.-H. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642152 · Cited by 66
Proactive Conversational AI: A Comprehensive Survey of Advancements and Opportunities
Deng, Y., Liao, L., Lei, W., Yang, G. H., Lam, W. P., & Chua, T. (2025) · ACM Transactions on Information Systems · doi:10.1145/3715097 · Cited by 116
Han, A., Zhou, X., Cai, Z., Han, S., Ko, R., Corrigan, S., & Peppler, K. A. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642438 · Cited by 114
“The recent LLMs have brought breakthroughs of open-ended conversational systems, which perform open-domain dialog with any topics [51] and it ofers the capability to be fne-tuned [82], enhancing its performance to align with specifc domains and instructional objectives [112, 129].”
BackgroundTowards Unified Dialogue System Evaluation: A Comprehensive Analysis of Current Evaluation Protocols
Finch, S. E., & Choi, J. D. (2020) · Proceedings of the 21th Annual Meeting of the Special Interest Group on Discourse and Dialogue · doi:10.18653/v1/2020.sigdial-1.29 · Cited by 59
RA-ISF: Learning to Answer and Understand from Retrieval Augmentation via Iterative Self-Feedback
Liu, Y., Peng, X., Zhang, X., Liu, W., Yin, J., Cao, J., & Du, T. (2024) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2024.findings-acl.281 · Cited by 98
Irfan, B., Kuoppamäki, S., & Skantze, G. (2024) · Frontiers in Robotics and AI · doi:10.3389/frobt.2024.1363713 · Cited by 97
BlenderBot 3: a deployed conversational agent that continually learns to responsibly engage
Shuster, K., Xu, J., Komeili, M., Ju, D., Smith, E. M., Roller, S., Ung, M., Chen, M., Arora, K., Lane, J., et al. (2022) · arXiv · doi:10.48550/arxiv.2208.03188 · Cited by 95
Wang, J., Hwang, G.-H., & Chang, C.-Y. (2021) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2021.100023 · Cited by 67
Generating Benchmarks for Factuality Evaluation of Language Models
Muhlgay, D., Ram, O., Magar, I., Levine, Y., Ratner, N., Belinkov, Y., Abend, O., Leyton‐Brown, K., Shashua, A., & Shoham, Y. (2024) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2024.eacl-long.4 · Cited by 95
A Sequence-to-Sequence Approach to Dialogue State Tracking
Feng, Y., Wang, Y., & Li, H. (2021) · doi:10.18653/v1/2021.acl-long.135 · Cited by 93
PAL: Persona-Augmented Emotional Support Conversation Generation
Cheng, J., Sabour, S., Sun, H., Chen, Z., & Huang, M. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.34 · Cited by 90
Self-citationUniMS-RAG: A Unified Multi-source Retrieval-Augmented Generation for Personalized Dialogue SystemsPreprint
Wang, H., Huang, W., Deng, Y., Wang, R., Wang, Z., Wang, Y., Mi, F., Pan, J. Z., & Wong, K.-F. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2401.13256 · Cited by 86
Leveraging Transferable Knowledge Concept Graph Embedding for Cold-Start Cognitive Diagnosis
Gao, W., Wang, H., Liu, Q., Wang, F., Lin, X., Yue, L., Zhang, Z., Lv, R., & Wang, S. (2023) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3539618.3591774 · Cited by 84
Neural Path Hunter: Reducing Hallucination in Dialogue Systems via Path Grounding
Dziri, N., Madotto, A., Zaïane, O., & Bose, A. J. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.168 · Cited by 81
DialogBench: Evaluating LLMs as Human-like Dialogue Systems
Ou, J., Lu, J., Liu, C., Tang, Y., Zhang, F., Zhang, D., & Gai, K. (2024) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2024.naacl-long.341 · Cited by 76
Kopp, S., & Krämer, N. C. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.580955 · Cited by 74
Kacupaj, E., Plepi, J., Singh, K., Thakkar, H., Lehmann, J., & Maleshkova, M. (2021) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2021.eacl-main.72 · Cited by 74
“Do you follow me?”: A Survey of Recent Approaches in Dialogue State Tracking
Jacqmin, L., Rojas-Barahona, L. M., & Favre, B. (2022) · Annual Meeting of the Special Interest Group on Discourse and Dialogue · doi:10.18653/v1/2022.sigdial-1.33 · Cited by 74
CASE: Aligning Coarse-to-Fine Cognition and Affection for Empathetic Response Generation
Zhou, J., Zheng, C., Wang, B., Zhang, Z., & Huang, M. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.457 · Cited by 72
Self-citationContrastive Learning Reduces Hallucination in Conversations
Sun, W., Shi, Z., Gao, S., Ren, P., De Rijke, M., & Ren, Z. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i11.26596 · Cited by 69
Xu, Z., Xu, H., Lu, Z., Zhao, Y., Zhu, R., Wang, Y., Dong, M., Chang, Y., Lv, Q., Dick, R. P., et al. (2024) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3659600 · Cited by 69
NaturalConv: A Chinese Dialogue Dataset Towards Multi-turn Topic-driven Conversation
Wang, X., Li, C., Zhao, J., & Yu, D. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i16.17649 · Cited by 68
Chang, J., Park, J., & Park, J. (2023) · Asia-Pacific Science Education · doi:10.1163/23641177-bja10062 · Cited by 47
Towards Multimodal Emotional Support Conversation Systems
Chu, Y., Liao, L., Zhou, Z., Ngo, C.-W., & Hong, R. (2025) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2025.3604951 · Cited by 25
DukeNet: A Dual Knowledge Interaction Network for Knowledge-Grounded Conversation
Meng, C., Ren, P., Chen, Z., Sun, W., Ren, Z., Tu, Z., & de Rijke, M. (2020) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3397271.3401097 · Cited by 67
RefNet: A Reference-Aware Network for Background Based Conversation
Meng, C., Ren, P., Chen, Z., Monz, C., Ma, J., & de Rijke, M. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i05.6370 · Cited by 66
Long Time No See! Open-Domain Conversation with Long-Term Persona Memory
Xu, X., Gou, Z., Wu, W., Niu, Z.-Y., Wu, H., Wang, H., & Wang, S. (2022) · arXiv · doi:10.48550/arxiv.2203.05797 · Cited by 65
FADO: Feedback-Aware Double COntrolling Network for Emotional Support Conversation
Peng, W., Qin, Z., Hu, Y., Xie, Y., & Li, Y. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.110340 · Cited by 65
Understanding Client Reactions in Online Mental Health Counseling
Li, A., Ma, L., Mei, Y., He, H., Zhang, S., Qiu, H., & Lan, Z. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.577 · Cited by 65
Debate and Dilemmas Regarding Generative AI in Mental Health Care: Scoping Review
Xian, X., Chang, A., Xiang, Y., & Liu, M. T. (2024) · Interactive Journal of Medical Research · doi:10.2196/53672 · Cited by 64
A Survey of the Evolution of Language Model-Based Dialogue Systems: Data, Task and ModelsPreprint
Wang, H., Wang, L., Du, Y., Liang, C., Zhou, J., Wang, Y., & Wong, K. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2311.16789 · Cited by 64
Kiuchi, K., Otsu, K., & Hayashi, Y. (2023) · Behaviour and Information Technology · doi:10.1080/0144929x.2023.2286528 · Cited by 62
Evaluating Human-Language Model Interaction
Lee, M., Srivastava, M., Hardy, A., Thickstun, J., Durmus, E., Paranjape, A., Gerard-Ursin, I., Li, X. L., Ladhak, F., Rong, F., et al. (2022) · arXiv · doi:10.48550/arxiv.2212.09746 · Cited by 61
A review of dialogue systems: current trends and future directions
Algherairy, A. S., & Ahmed, M. (2023) · Neural Computing and Applications · doi:10.1007/s00521-023-09322-1 · Cited by 59
A Practical Guide to Conversation Research: How to Study What People Say to Each Other
Yeomans, M., Boland, F. K., Collins, H. K., Abi-Esber, N., & Brooks, A. W. (2023) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459231183919 · Cited by 58
Dynamic Schema Graph Fusion Network for Multi-Domain Dialogue State Tracking
Feng, Y., Lipani, A., Ye, F., Zhang, Q., & Yılmaz, E. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.10 · Cited by 56
PONE: A Novel Automatic Evaluation Metric for Open-domain Generative Dialogue Systems
Lan, T., Mao, X.-L., Wei, W., Gao, X., & Huang, H. (2020) · ACM Transactions on Information Systems · doi:10.1145/3423168 · Cited by 56
Who Says What to Whom: A Survey of Multi-Party Conversations
Gu, J.-C., Tao, C., & Ling, Z.-H. (2022) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/768 · Cited by 56
LexRAG: Benchmarking Retrieval-Augmented Generation in Multi-Turn Legal Consultation Conversation
Li, H., Chen, Y., Hu, Y., Ai, Q., Chen, J., Yang, X., Yang, J., Wu, Y., Liu, Z., & Liu, Y. (2025) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3726302.3730340 · Cited by 52
Boosting Conversational Question Answering with Fine-Grained Retrieval-Augmentation and Self-Check
Ye, L., Lei, Z., Yin, J., Chen, Q., Zhou, J., & He, L. (2024) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3626772.3657980 · Cited by 51
Xu, K., Zhang, K., Li, J., Huang, W. D., & Wang, Y. (2024) · Electronics · doi:10.3390/electronics14010047 · Cited by 51
LiveChat: A Large-Scale Personalized Dialogue Dataset Automatically Constructed from Live Streaming
Gao, J., Lian, Y., Zhou, Z., Fu, Y., & Wang, B. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.858 · Cited by 50
Self-citationGarofalo, S. G., & Farenga, S. J. (2024) · Science & Education · doi:10.1007/s11191-024-00534-y · Cited by 50
Exploring Prompt-based Few-shot Learning for Grounded Dialog GenerationPreprint
Zheng, C., & Huang, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.06513 · Cited by 50
Self-citationDialogue History Matters! Personalized Response Selection in Multi-Turn Retrieval-Based Chatbots
Li, J., Liu, C., Tao, C., Chan, Z., Zhao, D., Zhang, M., & Yan, R. (2021) · ACM Transactions on Information Systems · doi:10.1145/3453183 · Cited by 49
Multimodal Dialog System: Relational Graph-based Context-aware Question Understanding
Zhang, H., Liu, M., Gao, Z., Lei, X., Wang, Y., & Nie, L. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3475234 · Cited by 49
Difference-aware Knowledge Selection for Knowledge-grounded Conversation Generation
Zheng, C., Cao, Y., Jiang, D., & Huang, M. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.11 · Cited by 48
Self-citationIntelligent Chatbot for Admission in Higher Education
Aloqayli, A., & Abdelhafez, H. A. (2023) · International Journal of Information and Education Technology · doi:10.18178/ijiet.2023.13.9.1937 · Cited by 47
Learning towards conversational AI: A survey
Fu, T., Gao, S., Zhao, X., Wen, J.-R., & Yan, R. (2022) · AI Open · doi:10.1016/j.aiopen.2022.02.001 · Cited by 46
“There exist several surveys for the open-domain dialogue (Yan, 2018; Huang et al., 2020; Sun and Li, 2021; Tao et al., 2021).”
BackgroundMethodInfluentialAutomatically Select Emotion for Response via Personality-affected Emotion Transition
Wen, Z., Cao, J., Yang, R., Liu, S., & Shen, J. (2021) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2021.findings-acl.444 · Cited by 45
Automatic Skill-Oriented Question Generation and Recommendation for Intelligent Job Interviews
Qin, C., Zhu, H., Shen, D., Sun, Y., Yao, K., Wang, P., & Xiong, H. (2023) · ACM Transactions on Information Systems · doi:10.1145/3604552 · Cited by 45
OpenViDial: A Large-Scale, Open-Domain Dialogue Dataset with Visual ContextsPreprint
Meng, Y., Wang, S., Han, Q., Sun, X., Wu, F. Q., Yan, R., & Li, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.15015 · Cited by 45
Initiative-Aware Self-Supervised Learning for Knowledge-Grounded Conversations
Meng, C., Ren, P., Chen, Z., Ren, Z., Xi, T., & de Rijke, M. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3462824 · Cited by 44
Attention Satisfies: A Constraint-Satisfaction Lens on Factual Errors of Language ModelsPreprint
Yüksekgönül, M., Chandrasekaran, V., Jones, E., Gunasekar, S., Naik, R., Palangi, H., Kamar, E. S., & Nushi, B. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2309.15098 · Cited by 44
Large Language Models as Source Planner for Personalized Knowledge-grounded Dialogues
Wang, H., Hu, M., Deng, Y., Wang, R., Mi, F., Wang, W., Wang, Y., Kwan, W.-C., King, I., & Wong, K. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.641 · Cited by 43
Text Generation: A Systematic Literature Review of Tasks, Evaluation, and Challenges
Becker, J., Wahle, J. P., Gipp, B., & Ruas, T. (2026) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.22258 · Cited by 43
Beyond one-shot explanations: a systematic literature review of dialogue-based xAI approaches
Mindlin, D., Beer, F., Sieger, L. N., Heindorf, S., Esposito, E., Ngomo, A.-C. N., & Cimiano, P. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-024-11007-7 · Cited by 42
Group-wise Contrastive Learning for Neural Dialogue Generation
Cai, H., Chen, H., Song, Y., Ding, Z., Bao, Y., Yan, W., & Zhao, X. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.70 · Cited by 42
Open-domain Dialogue Generation: What We Can Do, Cannot Do, And Should Do Next
Kann, K., Ebrahimi, A., Koh, J. J., Dudy, S., & Roncone, A. (2022) · Workshop on NLP for Conversational AI (NLP4ConvAI) · doi:10.18653/v1/2022.nlp4convai-1.13 · Cited by 42
Stylized Dialogue Response Generation Using Stylized Unpaired Texts
Zheng, Y., Chen, Z., Zhang, R., Huang, S., Mao, X., & Huang, M. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i16.17711 · Cited by 41
Self-citationGrounding Conversations with Improvised Dialogues
Cho, H., & May, J. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.218 · Cited by 25
Smith, E., Hsu, O., Qian, R., Roller, S., Boureau, Y.-L., & Weston, J. (2022) · Proceedings of the 4th Workshop on NLP for Conversational AI · doi:10.18653/v1/2022.nlp4convai-1.8 · Cited by 40
Ma, Z., Mei, Y., & Su, Z. (2023) · arXiv · doi:10.48550/arxiv.2307.15810 · Cited by 40
Granular Privacy Control for Geolocation with Vision Language Models
Mendes, E., Chen, Y., Hays, J. H., Das, S., Xu, W. H., & Ritter, A. (2024) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2024.emnlp-main.957 · Cited by 40
Alabbas, A., & Alomar, K. (2024) · Applied Sciences · doi:10.3390/app14062547 · Cited by 39
TODSum: Task-Oriented Dialogue Summarization with State TrackingPreprint
Zhao, L., Zheng, F., He, K., Zeng, W., Lei, Y., Jiang, H., Wu, W., Xu, W., Guo, J. Q., & Meng, F. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.12680 · Cited by 39
Open-Domain Conversational Agents: Current Progress, Open Problems, and Future Directions
Roller, S., Boureau, Y.-L., Weston, J., Bordes, A., Dinan, E., Fan, A., Gunning, D., Ju, D., Li, M., Poff, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2006.12442 · Cited by 38
Metadata
- Authors
- Huang, M., Zhu, X., & Gao, J.
- Affiliations
- Beijing National Research Center for Information Science and Technology (CN)
- Microsoft (United States) (US)
- Venue
- ACM Transactions on Information Systems
- Published
- 2020-04-09
- Volume
- 38
- Issue
- 3
- Pages
- 1-32
- ISSN
- 1046-8188 (ISSN-L)
- 1558-2868
- OpenAlex
- W3015322406
- Cited by
- 288
- References
- 124
- Citations by year
- 2026: 12 · 2025: 29 · 2024: 36 · 2023: 63 · 2022: 53 · 2021: 66 · 2020: 26
- FWCI
- 20.43
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- ACM Transactions on Information Systems (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Key R&D Program of China (2018YFC0830200)
- National Natural Science Foundation of China (61936010/61876096)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Keywords
- conversational AI, personality consistency, user trust, social-emotional needs
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.