The DOI matches its DataCite record; 52 of the 56 references it cites were found in a registry or an index.
Towards a Human-like Open-Domain Chatbot
Open accessAbstract
We present Meena, a multi-turn open-domain chatbot trained end-to-end on data mined and filtered from public domain social media conversations. This 2.6B parameter neural network is simply trained to minimize perplexity of the next token. We also propose a human evaluation metric called Sensibleness and Specificity Average (SSA), which captures key elements of a human-like multi-turn conversation. Our experiments show strong correlation between perplexity and SSA. The fact that the best perplexity end-to-end trained Meena scores high on SSA (72% on multi-turn evaluation) suggests that a human-level SSA of 86% is potentially within reach if we can better optimize perplexity. Additionally, the full version of Meena (with a filtering mechanism and tuned decoding) scores 79% SSA, 23% higher in absolute SSA than the existing chatbots we evaluated.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The broad range of capabilities in generative conversational AI and its human-likeness in conversation style substantially exceeds that of previous conversational technologies.”
From Why do people use ChatGPT? Exploring user motivations for generative conversational AI (2024) · cites this paper as Adiwardana, et al., 2020
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
BLEU: a method for automatic evaluation of machine translation
Papineni, K., Roukos, S., Ward, T., & Zhu, W.-J. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073135 · Cited by 21,344
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Self-citationDistilling the Knowledge in a Neural Network
Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204
(2004) · Cited by 9,718
Computing Machinery and Intelligence (1950)
Turing, A. M. (2004) · doi:10.1093/oso/9780198250791.003.0017 · Cited by 6,120
A Diversity-Promoting Objective Function for Neural Conversation Models
Li, J., Galley, M., Brockett, C., Gao, J., & Dolan, B. (2016) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n16-1014 · Cited by 2,459
Building End-To-End Dialogue Systems Using Generative Hierarchical Neural Network Models
Serban, I. V., Sordoni, A., Bengio, Y., Courville, A. C., & Pineau, J. (2016) · AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · doi:10.1609/aaai.v30i1.9883 · Cited by 1,645
Large-Scale Evolution of Image ClassifiersPreprint
Real, E., Moore, S., Selle, A. P., Saxena, S., Suematsu, Y. I. L., Tan, J., Le, Q. V., & Kurakin, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.01041 · Cited by 1,431
Self-citationVinyals, O., & Le, Q. (2015) · arXiv · doi:10.48550/arxiv.1506.05869 · Cited by 1,400
Self-citation
Research works printed but not linked: 7
- Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2015. Neural machine translation by jointly learning to align and translate. In ICLR .
- Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019. Language models are unsupervised multitask learners. OpenAI Blog , 1(8):9.
- Rico Sennrich, Barry Haddow, and Alexandra Birch. 2016. Neural Machine Translation of Rare Words with Subword Units. ACL .
- Noam Shazeer and Mitchell Stern. 2018. Adafactor: Adaptive Learning Rates with Sublinear Memory Cost. ICML .
- Ashish Vaswani, Samy Bengio, Eugene Brevdo, Francois Chollet, Aidan N. Gomez, Stephan Gouws, Llion Jones, Łukasz Kaiser, Nal Kalchbrenner, Niki Parmar, Ryan Sepassi, Noam Shazeer, and Jakob Uszkoreit. 2018. Tensor2tensor for neural machine translation. CoRR , abs/1803.07416. · arXiv
- Anu Venkatesh, Chandra Khatri, Ashwin Ram, Fenfei Guo, Raefer Gabriel, Ashish Nagar, Rohit Prasad, Ming Cheng, Behnam Hedayatnia, Angeliki Metallinou, Rahul Goel, Shaohua Yang, and Anirudh Raju. 2018. On evaluating and comparing conversational agents. CoRR , abs/1801.03625. · arXiv
- Yizhe Zhang, Siqi Sun, Michel Galley, Yen-Chun Chen, Chris Brockett, Xiang Gao, Jianfeng Gao, Jingjing Liu, and Bill Dolan. 2019. Dialogpt: Largescale generative pre-training for conversational response generation. CoRR , abs/1911.00536. · arXiv
Cited by
Sorted by citations
Items 101–200 of 636
Deng, Y., Liao, L., Chen, L., Wang, H., Lei, W., & Chua, T. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.711 · Cited by 113
Fusing Task-Oriented and Open-Domain Dialogues in Conversational Agents
Young, T., Xing, F., Pandelea, V., Ni, J., & Cambria, E. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i10.21416 · Cited by 57
XPersona: Evaluating Multilingual Personalized Chatbot
Lin, Z., Liu, Z., Winata, G. I., Cahyawijaya, S., Madotto, A., Bang, Y., Ishii, E., & Fung, P. (2021) · Workshop on NLP for Conversational AI (NLP4ConvAI) · doi:10.18653/v1/2021.nlp4convai-1.10 · Cited by 66
Evaluating the Evaluation of Diversity in Natural Language Generation
Tevet, G., & Berant, J. (2021) · Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume · doi:10.18653/v1/2021.eacl-main.25 · Cited by 52
BiasAsker: Measuring the Bias in Conversational AI System
Wan, Y., Wang, W., He, P., Gu, J., Bai, H., & Lyu, M. R. (2023) · Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3611643.3616310 · Cited by 54
An In-Depth Review of ChatGPT’s Pros and Cons for Learning and Teaching in Education
Samala, A. D., Zhaı, X., Aoki, K., Bojić, L., & Žikić, S. (2024) · International Journal of Interactive Mobile Technologies (iJIM) · doi:10.3991/ijim.v18i02.46509 · Cited by 89
Towards Zero-Label Language LearningPreprint
Wang, Z.-R., Yu, A. W., Fırat, O., & Cao, Y. J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.09193 · Cited by 94
On the Safety of Conversational Models: Taxonomy, Dataset, and Benchmark
Sun, H., Xu, G., Deng, J., Cheng, J., Zheng, C., Zhou, H., Peng, N., Zhu, X., & Huang, M. (2022) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2022.findings-acl.308 · Cited by 71
I like fish, especially dolphins: Addressing Contradictions in Dialogue Modeling
Nie, Y., Williamson, M., Bansal, M., Kiela, D., & Weston, J. (2021) · Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2021.acl-long.134 · Cited by 66
DialFact: A Benchmark for Fact-Checking in Dialogue
Gupta, P., Wu, C.-S., Liu, W., & Xiong, C. (2022) · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2022.acl-long.263 · Cited by 48
A full-stack search technique for domain optimized deep learning accelerators
Zhang, D., Huda, S., Songhori, E. M., Prabhu, K., Le, Q. V., Goldie, A., & Mirhoseini, A. (2022) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/3503222.3507767 · Cited by 59
Self-citationEvaluating Attribution in Dialogue Systems: The BEGIN Benchmark
Dziri, N., Rashkin, H., Linzen, T., & Reitter, D. (2022) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00506 · Cited by 79
Learning towards conversational AI: A survey
Fu, T., Gao, S., Zhao, X., Wen, J.-R., & Yan, R. (2022) · AI Open · doi:10.1016/j.aiopen.2022.02.001 · Cited by 46
Plug-and-Play Conversational Models
Madotto, A., Ishii, E., Lin, Z., Dathathri, S., & Fung, P. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.219 · Cited by 51
DynaEval: Unifying Turn and Dialogue Level Evaluation
Zhang, C., Chen, Y., D’Haro, L. F., Zhang, Y., Friedrichs, T., Lee, G., & Li, H. (2021) · Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2021.acl-long.441 · Cited by 62
Learning Neural Templates for Recommender Dialogue System
Liang, Z., Hu, H., Xu, C., Miao, J., He, Y., Chen, Y., Geng, X., Liang, F., & Jiang, D. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.617 · Cited by 46
Long, C., Subburam, D., Lowe, K., dos Santos, A., Zhang, J. J., Hwang, S. W., Saduka, N., Horev, Y., Su, T., Côté, D. W. J., et al. (2024) · Otolaryngology · doi:10.1002/ohn.864 · Cited by 47
Few-Shot Bot: Prompt-Based Learning for Dialogue SystemsPreprint
Madotto, A., Lin, Z., Winata, G. I., & Fung, P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.08118 · Cited by 96
Sentiment Analysis for Personalized Chatbots in E-Commerce Applications
El-Ansari, A., & Beni‐Hssane, A. (2023) · Wireless Personal Communications · doi:10.1007/s11277-023-10199-5 · Cited by 51
Understanding and predicting user dissatisfaction in a neural generative chatbot
See, A., & Manning, C. D. (2021) · Annual Meeting of the Special Interest Group on Discourse and Dialogue · doi:10.18653/v1/2021.sigdial-1.1 · Cited by 44
Designing PairBuddy—A Conversational Agent for Pair Programming
Robe, P., & Kuttal, S. K. (2022) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3498326 · Cited by 51
Trading Off Diversity and Quality in Natural Language GenerationPreprint
Zhang, H., Duckworth, D., Ippolito, D., & Neelakantan, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.10450 · Cited by 68
Hutchins, D., Schlag, I., Wu, Y., Dyer, E., & Neyshabur, B. (2022) · arXiv · doi:10.48550/arxiv.2203.07852 · Cited by 43
Balancing innovation and regulation in the age of generative artificial intelligence
Wang, X., & Wu, Y. C. (2024) · Journal of Information Policy · doi:10.5325/jinfopoli.14.2024.0012 · Cited by 42
The Adapter-Bot: All-In-One Controllable Conversational Model
Lin, Z., Madotto, A., Bang, Y., & Fung, P. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i18.18018 · Cited by 42
Human-centric dialog training via offline reinforcement learning
Jaques, N., Shen, J. H., Ghandeharioun, A., Ferguson, C., Lapedriza, À., Jones, N. C., Gu, S., & Picard, R. W. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.327 · Cited by 81
AVA: A Financial Service Chatbot Based on Deep Bidirectional Transformers
Yu, S., Chen, Y., & Zaidi, H. A. (2021) · Frontiers in Applied Mathematics and Statistics · doi:10.3389/fams.2021.604842 · Cited by 56
Adding Chit-Chat to Enhance Task-Oriented Dialogues
Sun, K., Moon, S., Crook, P., Roller, S., Silvert, B., Liu, B., Wang, Z., Liu, H., Cho, E., & Cardie, C. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.124 · Cited by 55
Smith, E., Hsu, O., Qian, R., Roller, S., Boureau, Y.-L., & Weston, J. (2022) · Proceedings of the 4th Workshop on NLP for Conversational AI · doi:10.18653/v1/2022.nlp4convai-1.8 · Cited by 40
PromptInfuser: Bringing User Interface Mock-ups to Life with Large Language Models
Petridis, S., Terry, M. A., & Cai, C. J. (2023) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3544549.3585628 · Cited by 40
ToD4IR: A Humanised Task-Oriented Dialogue System for Industrial Robots
Li, C., Zhang, X., Chrysostomou, D., & Yang, H. (2022) · IEEE Access · doi:10.1109/access.2022.3202554 · Cited by 40
Towards Ecologically Valid Research on Language User InterfacesPreprint
de Vries, H., Bahdanau, D., & Manning, C. D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.14435 · Cited by 49
Deconstruct to Reconstruct a Configurable Evaluation Metric for Open-Domain Dialogue Systems
Phy, V., Zhao, Y., & Aizawa, A. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.368 · Cited by 50
Knowledge-Grounded Dialogue Generation with a Unified Knowledge Representation
Li, Y., Peng, B., Shen, Y., Mao, Y., Lidén, L., Yu, Z., & Gao, J. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.15 · Cited by 46
Use of chatbots for customer service in MSMEs
Cordero, J., Barba-Guamán, L., & Guamán, F. (2022) · Applied Computing and Informatics · doi:10.1108/aci-06-2022-0148 · Cited by 39
Primer: Searching for Efficient Transformers for Language ModelingPreprint
So, D. R., Mańke, W., Liu, H., Dai, Z., Shazeer, N., & Le, Q. V. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.08668 · Cited by 91
Self-citationHuang, X., Liu, Z. Y., Zhang, M., 桂, 韬., 韩, 先., 户, 保., 黄, 民., 黄, 萱., 刘, 康., 刘, 挺., et al. (2023) · Scientia Sinica Informationis · doi:10.1360/ssi-2023-0113 · Cited by 42
(2023) · doi:10.18653/v1/2023.emnlp-main.364 · Cited by 38
Conversations Are Not Flat: Modeling the Dynamic Information Flow across Dialogue Utterances
Li, Z., Zhang, J., Fei, Z., Feng, Y., & Zhou, J. (2021) · doi:10.18653/v1/2021.acl-long.11 · Cited by 51
Language Generation Models Can Cause Harm: So What Can We Do About It? An Actionable Survey
Kumar, S., Balachandran, V., Njoo, L., Anastasopoulos, A., & Tsvetkov, Y. (2023) · Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2023.eacl-main.241 · Cited by 38
Countering Language Drift with Seeded Iterated LearningPreprint
Lu, Y., Singhal, S., Strub, F., Pietquin, O., & Courville, A. C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.12694 · Cited by 39
Self-citationOpen-Domain Conversational Agents: Current Progress, Open Problems, and Future Directions
Roller, S., Boureau, Y.-L., Weston, J., Bordes, A., Dinan, E., Fan, A., Gunning, D., Ju, D., Li, M., Poff, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2006.12442 · Cited by 38
Answering Questions by Meta-Reasoning over Multiple Chains of Thought
Yoran, O., Wolfson, T., Bogin, B., Katz, U., Deutch, D., & Berant, J. (2023) · arXiv · doi:10.48550/arxiv.2304.13007 · Cited by 38
Scoping review of the neural evidence on the uncanny valley
Vaitonyté, J., Alimardani, M., & Louwerse, M. M. (2022) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2022.100263 · Cited by 41
Najafali, D., Reiche, E., Camacho, J. M., Morrison, S. D., & Dorafshar, A. H. (2023) · Aesthetic Surgery Journal · doi:10.1093/asj/sjad056 · Cited by 38
Razumovskaia, E., Glavaš, G., Majewska, O., Ponti, E. M., Korhonen, A., & Vulić, I. (2022) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.13083 · Cited by 65
Knowledge-Grounded Dialogue Flow Management for Social Robots and Conversational Agents
Grassi, L., Recchiuto, C. T., & Sgorbissa, A. (2022) · International Journal of Social Robotics · doi:10.1007/s12369-022-00868-z · Cited by 42
EVA2.0: Investigating Open-domain Chinese Dialogue Systems with Large-scale Pre-training
Gu, Y., Wen, J., Sun, H., Song, Y., Ke, P., Zheng, C., Zhang, Z., Yao, J., Liu, L., Zhu, X., et al. (2023) · Machine Intelligence Research · doi:10.1007/s11633-022-1387-3 · Cited by 44
PromptInfuser: How Tightly Coupling AI and UI Design Impacts Designers’ Workflows
Petridis, S., Terry, M. A., & Cai, C. J. (2024) · Designing Interactive Systems Conference · doi:10.1145/3643834.3661613 · Cited by 56
Retrieval Augmentation Reduces Hallucination in ConversationPreprint
Shuster, K., Poff, S., Chen, M., Kiela, D., & Weston, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.07567 · Cited by 403
Can ChatGPT reduce human financial analysts’ optimistic biases?
Li, X., Feng, H., Yang, H., & Huang, J. (2023) · Economic and Political Studies · doi:10.1080/20954816.2023.2276965 · Cited by 34
Multi-Modal Open-Domain Dialogue
Shuster, K., Smith, E. M., Ju, D., & Weston, J. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.398 · Cited by 44
“I’d rather just go to bed”: Understanding Indirect Answers
Louis, A. P., Roth, D., & Radlinski, F. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.601 · Cited by 46
NaturalConv: A Chinese Dialogue Dataset Towards Multi-turn Topic-driven Conversation
Wang, X., Li, C., Zhao, J., & Yu, D. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i16.17649 · Cited by 36
Multimodal Conversational AI: A Survey of Datasets and Approaches
Sundar, A., & Heck, L. P. (2022) · Workshop on NLP for Conversational AI (NLP4ConvAI) · doi:10.18653/v1/2022.nlp4convai-1.12 · Cited by 42
Controlling Style in Generated DialoguePreprint
Smith, E. M., Gonzalez-Rico, D., Dinan, E., & Boureau, Y.-L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.10855 · Cited by 53
SafetyKit: First Aid for Measuring Safety in Open-domain Conversational Systems
Dinan, E., Abercrombie, G., Bergman, A., Spruit, S., Hovy, D., Boureau, Y.-L., & Rieser, V. (2022) · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2022.acl-long.284 · Cited by 32
Infusing behavior science into large language models for activity coaching
Hegde, N., Vardhan, M., Nathani, D., Rosenzweig, E., Speed, C., Karthikesalingam, A., & Seneviratne, M. G. (2024) · PLOS Digital Health · doi:10.1371/journal.pdig.0000431 · Cited by 36
Controlling Dialogue Generation with Semantic Exemplars
Gupta, P., Bigham, J. P., Tsvetkov, Y., & Pavel, A. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.240 · Cited by 42
Call for Customized Conversation: Customized Conversation Grounding Persona and Knowledge
Jang, Y., Lim, J., Hur, Y., Oh, D., Son, S., Lee, Y., Shin, D., Kim, S., & Lim, H. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i10.21326 · Cited by 39
Exploring ChatGPT’s Empathic Abilities
Schaaff, K., Reinig, C., & Schlippe, T. (2023) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii59096.2023.10388208 · Cited by 46
The Evolution of Large Language Model: Models, Applications and Challenges
Sindhu, B., Prathamesh, R. P., Sameera, M. B., & Kumaraswamy, S. (2024) · International Conference on Current Trends in Advanced Computing (ICCTAC) · doi:10.1109/icctac61556.2024.10581180 · Cited by 41
TextGAIL: Generative Adversarial Imitation Learning for Text Generation
Wu, Q., Li, L., & Yu, Z. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i16.17656 · Cited by 31
Multimodal Dialogue Response Generation
Sun, Q., Wang, Y., Xu, C., Zheng, K., Yang, Y., Hu, H., Xu, F., Zhang, J., Geng, X., & Jiang, D. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.204 · Cited by 34
Zhang, L., & Ren, J. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-05014-5_25 · Cited by 33
Towards Identifying Social Bias in Dialog Systems: Framework, Dataset, and Benchmark
Zhou, J., Deng, J., Mi, F., Li, Y., Wang, Y., Huang, M., Jiang, X., Liu, Q., & Meng, H. M. L. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.262 · Cited by 34
Free-form Conversation with Human and Symbolic Avatars in Mixed Reality
Zhu, J., Kumaran, R., Xu, C., & Höllerer, T. (2023) · Proceedings - International Symposium on Mixed and Augmented Reality, ISMAR · doi:10.1109/ismar59233.2023.00090 · Cited by 33
On future power system digital twins: A vision towards a standard architecture
Zomerdijk, W., Pálenský, P., AlSkaif, T. A., & Vergara, P. P. (2024) · Digital twins and applications. · doi:10.1049/dgt2.12020 · Cited by 35
Spot The Bot: A Robust and Efficient Framework for the Evaluation of Conversational Dialogue Systems
Deriu, J., Tuggener, D., von Däniken, P., Campos, J. A., Rodrigo, Á., Belkacem, T., Soroa, A., Agirre, E., & Cieliebak, M. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.326 · Cited by 30
Volum, R., Rao, S., Xu, M., DesGarennes, G., Brockett, C., Van Durme, B., Deng, O., Malhotra, A., & Dolan, B. (2022) · Proceedings of the 3rd Wordplay: When Language Meets Games Workshop (Wordplay 2022) · doi:10.18653/v1/2022.wordplay-1.3 · Cited by 30
Keep Me Updated! Memory Management in Long-term Conversations
Bae, S., Kwak, D., Kang, S., Lee, M. Y., Kim, S., Jeong, Y., Kim, H., Lee, S.-W., Park, W., & Sung, N. (2022) · Findings of the Association for Computational Linguistics: EMNLP 2022 · doi:10.18653/v1/2022.findings-emnlp.276 · Cited by 29
Piracy Resistant Watermarks for Deep Neural NetworksPreprint
Li, H., Wenger, E., Shan, S., Zhao, B. Y., & Zheng, H.-T. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.01226 · Cited by 62
EVA: An Open-Domain Chinese Dialogue System with Large-Scale Generative Pre-TrainingPreprint
Zhou, H., Ke, P., Zhang, Z., Gu, Y., Zheng, Y., Zheng, C., Wang, Y., Wu, C., Sun, H., Yang, X., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.01547 · Cited by 39
Overview of the Ninth Dialog System Technology Challenge: DSTC9
Gunasekara, C., Kim, S., D’Haro, L. F., Rastogi, A., Chen, Y.-N., Eric, M., Hedayatnia, B., Gopalakrishnan, K., Liu, Y., Huang, C.-W., et al. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3426331 · Cited by 80
Testing the Capability of AI Art Tools for Urban Design
Phillips, C., Jiao, J., & Clubb, E. (2024) · IEEE Computer Graphics and Applications · doi:10.1109/mcg.2024.3356169 · Cited by 31
Mozafari, N., Weiger, W. H., & Hammerschmidt, M. (2021) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2021.355 · Cited by 27
Interpreting Deep Learning Models in Natural Language Processing: A ReviewPreprint
Sun, X., Yang, D., Li, X., Zhang, T., Meng, Y., Qiu, H., Wang, G., Hovy, E. H., & Li, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.10470 · Cited by 64
Wingate, D., Shoeybi, M., & Sorensen, T. (2022) · Findings of the Association for Computational Linguistics: EMNLP 2022 · doi:10.18653/v1/2022.findings-emnlp.412 · Cited by 26
Recent Developments in Arabic Conversational AI: A Literature Review
Fuad, A., & Al-Yahya, M. M. (2022) · IEEE Access · doi:10.1109/access.2022.3155521 · Cited by 30
Building a Role Specified Open-Domain Dialogue System Leveraging Large-Scale Language Models
Bae, S., Kwak, D., Kim, S., Ham, D., Kang, S., Lee, S., & Park, W. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.155 · Cited by 31
MMDialog: A Large-scale Multi-turn Dialogue Dataset Towards Multi-modal Open-domain Conversation
Feng, J., Sun, Q., Xu, C., Zhao, P., Yang, Y., Tao, C., Zhao, D., & Lin, Q. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2023.acl-long.405 · Cited by 26
Dungeons and Dragons as a Dialog Challenge for Artificial Intelligence
Callison-Burch, C., Tomar, G. S., Martin, L. J., Ippolito, D., Bailis, S., & Reitter, D. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.637 · Cited by 43
A Design Space for Writing Support Tools Using a Cognitive Process Model of Writing
Gero, K., Calderwood, A., Li, C., & Chilton, L. (2022) · Proceedings of the First Workshop on Intelligent and Interactive Writing Assistants (In2Writing 2022) · doi:10.18653/v1/2022.in2writing-1.2 · Cited by 25
SalesBot: Transitioning from Chit-Chat to Task-Oriented Dialogues
Chiu, S., Li, M., Lin, Y.-T. R., & Chen, Y.-N. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.425 · Cited by 28
Short text classification with Soft Knowledgeable Prompt-tuning
Zhu, Y. Q., Wang, Y., Mu, J., Li, Y., Qiang, J., Yuan, Y., & Wu, X. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.123248 · Cited by 27
Twenty Years Beyond the Turing Test: Moving Beyond the Human Judges Too
Hernández‐Orallo, J. (2020) · Minds and Machines · doi:10.1007/s11023-020-09549-0 · Cited by 28
Degree Planning with PLAN-BERT: Multi-Semester Recommendation Using Future Courses of Interest
Shao, E., Guo, S., & Pardos, Z. A. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i17.17751 · Cited by 31
Reason first, then respond: Modular Generation for Knowledge-infused Dialogue
Adolphs, L., Shuster, K., Urbanek, J., Szlam, A., & Weston, J. (2022) · Findings of the Association for Computational Linguistics: EMNLP 2022 · doi:10.18653/v1/2022.findings-emnlp.527 · Cited by 25
Open-domain Dialogue Generation: What We Can Do, Cannot Do, And Should Do Next
Kann, K., Ebrahimi, A., Koh, J. J., Dudy, S., & Roncone, A. (2022) · Workshop on NLP for Conversational AI (NLP4ConvAI) · doi:10.18653/v1/2022.nlp4convai-1.13 · Cited by 28
Conversation Analytic Perspectives to Digital Interaction. Practices, Resources, and Affordances
Koivisto, A., Vepsäläinen, H., & Virtanen, M. T. (2023) · doi:10.21435/sflin.22 · Cited by 36
Opportunities and Challenges in Neural Dialog Tutoring
Mačina, J., Daheim, N., Wang, L., Sinha, T., Kapur, M., Gurevych, I., & Sachan, M. (2023) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2023.eacl-main.173 · Cited by 37
Integrated taxonomy of errors in chat-oriented dialogue systems
Higashinaka, R., Araki, M., Tsukahara, H., & Mizukami, M. (2021) · Annual Meeting of the Special Interest Group on Discourse and Dialogue · doi:10.18653/v1/2021.sigdial-1.10 · Cited by 24
STAR: A Schema-Guided Dialog Dataset for Transfer LearningPreprint
Mosig, J. E. M., Mehri, S., & Kober, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.11853 · Cited by 56
MovieChats: Chat like Humans in a Closed Domain
Su, H., Shen, X., Zhou, X., Zhang, Z., Chang, E., Zhang, C., Niu, C., & Zhou, J. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.535 · Cited by 25
Context-Aware Abbreviation Expansion Using Large Language Models
Cai, S., Venugopalan, S., Tomanek, K., Narayanan, A., Morris, M. R., & Brenner, M. P. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.91 · Cited by 26
Zhang, Q., Naradowsky, J., & Miyao, Y. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.417 · Cited by 36
SaFeRDialogues: Taking Feedback Gracefully after Conversational Safety Failures
Ung, M., Xu, J., & Boureau, Y.-L. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.447 · Cited by 31
Large scale multi-actor generative dialog modeling,
Boyd, A., Puri, R., Shoeybi, M., Patwary, M., & Catanzaro, B. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.8 · Cited by 22
Deep Transformers with Latent DepthPreprint
Li, X., Stickland, A. C., Tang, Y., & Kong, X. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.13102 · Cited by 27
Goldstein, A., Ham, E., Nastase, S. A., Zada, Z., Grinstein-Dabush, A., Aubrey, B., Schain, M., Gazula, H., Feder, A., Doyle, W., et al. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.07.11.499562 · Cited by 22
Metadata
- Authors
- Adiwardana, D., Luong, M.-T., So, D. R., Hall, J., Fiedel, N., Thoppilan, R., Yang, Z., Kulshreshtha, A., Nemade, G., Lu, Y., & Le, Q. V.
- Affiliations
- Google (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2020
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2001.09977
- OpenAlex
- W3000779003
- Cited by
- 614
- References
- 56
- Citations by year
- 2026: 6 · 2025: 21 · 2024: 66 · 2023: 137 · 2022: 145 · 2021: 154 · 2020: 82
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- TIB Data Manager
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- open-domain chatbots, multi-turn dialogue, end-to-end learning, social media discourse, large language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review