From Eliza to XiaoIce: challenges and opportunities with social chatbots
Open accessThe DOI matches its Crossref record; 81 of the 94 references it cites were found in a registry or an index.
Abstract
Conversational systems have come a long way since their inception in the 1960s. After decades of research and development, we have seen progress from Eliza and Parry in the 1960s and 1970s, to task-completion systems as in the Defense Advanced Research Projects Agency (DARPA) communicator program in the 2000s, to intelligent personal assistants such as Siri, in the 2010s, to today’s social chatbots like XiaoIce. Social chatbots’ appeal lies not only in their ability to respond to users’ diverse requests, but also in being able to establish an emotional connection with users. The latter is done by satisfying users’ need for communication, affection, as well as social belonging. To further the advancement and adoption of social chatbots, their design must focus on user engagement and take both intellectual quotient (IQ) and emotional quotient (EQ) into account. Users should want to engage with a social chatbot; as such, we define the success metric for social chatbots as conversation-turns per session (CPS). Using XiaoIce as an illustrative example, we discuss key technologies in building social chatbots from core chat to visual awareness to skills. We also show how XiaoIce can dynamically recognize emotion and engage the user throughout long conversations with appropriate interpersonal responses. As we become the first generation of humans ever living with artificial intelligenc (AI), we have a responsibility to design social chatbots to be both useful and empathetic, so they will become ubiquitous and help society as a whole.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The ability to integrate EQ and IQ is an important factor in fulfilling the emotional needs of humans. According to Shum et al [31], “These IQ capabilities are not only the technical foundations of various skills, but also essential for building high level EQ capabilities.””
From User Experiences of Social Support From Companion Chatbots in Everyday Contexts: Thematic Analysis (2020) · cites this paper as [31]
In the citing paper
“behaviors that have been historically very difficult to accurately capture in AI, but are essential if AI is to serve as effective companions for humans [31]”
From User Experiences of Social Support From Companion Chatbots in Everyday Contexts: Thematic Analysis (2020) · cites this paper as [31]
In the citing paper
“Studies of social chatbots such as XiaoIce (Shum et al., 2018) and Replika (Ta et al., 2020) and the mental health chatbots Woebot (Fitzpatrick et al., 2017) and Tess (Fulmer et al., 2018) demonstrate that chatbots may induce a sense of a relationship in users.”
From My Chatbot Companion - a Study of Human-Chatbot Relationships (2021) · cites this paper as Shum et al., 2018
In the citing paper
“From the emergence of the first chatbot, ELIZA, developed by Joseph Weizenbaum (1966), chatbots have been trying to ‘mimic human behaviour in a text-based conversation’ (Shum et al. 2018, p. 10; Abd-Alrazaq et al. 2020).”
From Chatbot breakthrough in the 2020s? An ethical reflection on the trend of automated consultations in health care (2022) · cites this paper as Shum et al. 2018
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · cited 2×
“, 2016), computer vision (Krizhevsky et al., 2012; He et al., 2016), information retrieval (Huang et al.”
BackgroundImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · cited 2×
“, 2016), computer vision (Krizhevsky et al., 2012; He et al., 2016), information retrieval (Huang et al.”
BackgroundHochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · cited 3×
“These representation vectors are then fed into a decoder, usually another LSTM, to generate the response word-by-word (Vinyals and Le, 2015).”
BackgroundMaslow, A. H. (1943) · Psychological Review · doi:10.1037/h0054346 · Cited by 21,563 · cited 2×
“Unlike early chatbots designed for chitchat, social chatbots are created to serve users’ needs for communication, affection, and social belonging (Maslow, 1943) rather than for passing the Turing Test.”
BackgroundSequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213 · cited 3×
“…perceptual and cognitive AI technologies, e.g., natural language understanding (Bengio et al., 2001; Mikolov et al., 2013; Sutskever et al., 2014; Bahdanau et al., 2015; Mesnil et al., 2015), speech recognition and synthesis (Hinton et al., 2012; Deng et al., 2013; Xiong et al., 2016; Qian et…”
BackgroundMethodFrames of Mind: The Theory of Multiple Intelligences
Klitgaard, R., & Gardner, H. (1984) · Journal of Policy Analysis and Management · doi:10.2307/3324560 · Cited by 13,636
(2017) · Defining and Classifying Children in Need · doi:10.4324/9781315258324-16 · Cited by 11,320
I.—COMPUTING MACHINERY AND INTELLIGENCE
TURING, A. M. (1950) · Mind · doi:10.1093/mind/lix.236.433 · Cited by 10,290 · cited 4×
“Unlike early chatbots designed for chitchat, social chatbots are created to serve users’ needs for communication, affection, and social belonging (Maslow, 1943) rather than for passing the Turing Test.”
BackgroundMethodInfluentialHinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260 · cited 2×
“, 2013, 2015), speech recognition and synthesis (Hinton et al., 2012; Deng et al., 2013; Qian et al., 2014; van den Oord et al., 2016; Xiong et al., 2016), computer vision (Krizhevsky et al.”
Background(1995) · Medical Entomology and Zoology · Cited by 7,217
Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank
Socher, R., Perelygin, A., Wu, J., Chuang, J., Manning, C. D., Ng, A., & Potts, C. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1170 · Cited by 6,878 · cited 1×
“It also detects the sentiment reflected in the input message and infers the user’s emotion status (Tokuhisa et al., 2008; Mower et al., 2011; Socher et al., 2013; Yang et al., 2016; Chen et al., 2016).”
BackgroundShow and tell: A neural image caption generator
Vinyals, O., Toshev, A., Bengio, S., & Erhan, D. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298935 · Cited by 6,318 · cited 2×
“…(Krizhevsky et al., 2012; He et al., 2016), information retrieval (Huang et al., 2013; Elkahky et al., 2015), multimodal intelligence (Fang et al., 2015; Vinyals et al., 2015; Karpathy and Fei-fei, 2015; He and Deng, 2017), and empathic conversational systems (Fung et al., 2016; Alam et al., 2017).”
BackgroundWorking with Emotional Intelligence
Goleman, D. (1999) · ETC: A Review of General Semantics · doi:10.66774/etc_5601_103 · Cited by 6,254
Computing Machinery and Intelligence (1950)
Turing, A. (2004) · The Essential Turing · doi:10.1093/oso/9780198250791.003.0017 · Cited by 6,118
WaveNet: a generative model for raw audio
Oord, A. V. D., Dieleman, S., Zen, H., Simonyan, K., Vinyals, O., Graves, A., Kalchbrenner, N., Senior, A., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1609.03499 · Cited by 4,911 · cited 1×
“…2015; Mesnil et al., 2015), speech recognition and synthesis (Hinton et al., 2012; Deng et al., 2013; Xiong et al., 2016; Qian et al., 2014; van den Oord et al., 2016), computer vision (Krizhevsky et al., 2012; He et al., 2016), information retrieval (Huang et al., 2013; Elkahky et al., 2015),…”
BackgroundDeep visual-semantic alignments for generating image descriptions
Karpathy, A., & Fei-Fei, L. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298932 · Cited by 4,902
Hierarchical Attention Networks for Document Classification
Yang, Z., Yang, D., Dyer, C., He, X., Smola, A., & Hovy, E. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1174 · Cited by 4,712 · cited 1×
“It also detects the sentiment reflected in the input message and infers the user’s emotion status (Tokuhisa et al., 2008; Mower et al., 2011; Socher et al., 2013; Yang et al., 2016; Chen et al., 2016).”
BackgroundSelf-citationELIZA—a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1966) · Communications of the ACM · doi:10.1145/365153.365168 · Cited by 4,452 · cited 11×
“Nevertheless, many users believed they were talking to a real person when Eliza first came out.”
BackgroundMethodInfluentialELIZA — a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1983) · Communications of the ACM · doi:10.1145/357980.357991 · Cited by 2,738
Learning deep structured semantic models for web search using clickthrough data
Huang, P.-S., He, X., Gao, J., Deng, L., Acero, A., & Heck, L. (2013) · Proceedings of the 22nd ACM international conference on Information & Knowledge Management · doi:10.1145/2505515.2505665 · Cited by 2,009 · cited 2×
“…et al., 2016; Qian et al., 2014; van den Oord et al., 2016), computer vision (Krizhevsky et al., 2012; He et al., 2016), information retrieval (Huang et al., 2013; Elkahky et al., 2015), multimodal intelligence (Fang et al., 2015; Vinyals et al., 2015; Karpathy and Fei-fei, 2015; He and Deng,…”
BackgroundSelf-citationStacked Attention Networks for Image Question Answering
Yang, Z., He, X., Gao, J., Deng, L., & Smola, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.10 · Cited by 1,998 · cited 2×
“It also detects the sentiment reflected in the input message and infers the user’s emotion status (Tokuhisa et al., 2008; Mower et al., 2011; Socher et al., 2013; Yang et al., 2016; Chen et al., 2016).”
BackgroundSelf-citationVinyals, O., & Le, Q. (2015) · arXiv · doi:10.48550/arxiv.1506.05869 · Cited by 1,400 · cited 3×
“These representation vectors are then fed into a decoder, usually another LSTM, to generate the response word-by-word (Vinyals and Le, 2015).”
BackgroundMethodFrom captions to visual concepts and back
Fang, H., Gupta, S., Iandola, F., Srivastava, R. K., Deng, L., Dollar, P., Gao, J., He, X., Mitchell, M., Platt, J. C., et al. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298754 · Cited by 1,287
Self-citation(2017) · Effective Library and Information Centre Management · doi:10.4324/9781315256894-38 · Cited by 1,119
Partially observable Markov decision processes for spoken dialog systems
Williams, J. D., & Young, S. (2007) · Computer Speech & Language · doi:10.1016/j.csl.2006.06.008 · Cited by 853 · cited 1×
“The DM also includes dialog state tracking and policy selection, so that the dialog agent can make more robust decisions (Williams and Young, 2007).”
BackgroundRecent advances in deep learning for speech research at Microsoft
Deng, L., Li, J., Huang, J.-T., Yao, K., Yu, D., Seide, F., Seltzer, M., Zweig, G., He, X., Williams, J., et al. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6639345 · Cited by 801 · cited 2×
“, 2013, 2015), speech recognition and synthesis (Hinton et al., 2012; Deng et al., 2013; Xiong et al., 2016; Qian et al., 2014; van den Oord et al., 2016), computer vision (Krizhevsky et al.”
BackgroundSelf-citationThe ATIS spoken language systems pilot corpus
Hemphill, C. T., Godfrey, J. J., & Doddington, G. R. (1990) · Proceedings of the workshop on Speech and Natural Language - HLT '90 · doi:10.3115/116580.116613 · Cited by 790 · cited 1×
“Since the 1990s, a lot of research has been done on task-completion conversational systems (Price, 1990; Hemphill et al., 1990; Dahl et al., 1994; Walk et al., 2001).”
BackgroundA Neural Network Approach to Context-Sensitive Generation of Conversational Responses
Sordoni, A., Galley, M., Auli, M., Brockett, C., Ji, Y., Mitchell, M., Nie, J.-Y., Gao, J., & Dolan, B. (2015) · Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.3115/v1/n15-1020 · Cited by 764 · cited 1×
“The response candidates are typically generated by two approaches: retrieval-based (Lu and Li, 2013; Li et al., 2016; Yan et al., 2016) or generation-based (Vinyals and Le, 2015; Sordoni et al., 2015; Li et al., 2016).”
MethodA Multi-View Deep Learning Approach for Cross Domain User Modeling in Recommendation Systems
Elkahky, A. M., Song, Y., & He, X. (2015) · Proceedings of the 24th International Conference on World Wide Web · doi:10.1145/2736277.2741667 · Cited by 704 · cited 2×
“…et al., 2014; van den Oord et al., 2016), computer vision (Krizhevsky et al., 2012; He et al., 2016), information retrieval (Huang et al., 2013; Elkahky et al., 2015), multimodal intelligence (Fang et al., 2015; Vinyals et al., 2015; Karpathy and Fei-fei, 2015; He and Deng, 2017), and empathic…”
BackgroundSelf-citation(1964) · Medical Entomology and Zoology · Cited by 559
Spoken Language Understanding: Systems for Extracting Semantic Information from Speech
Tür, G., & Mori, R. D. (2011) · Cited by 510
Using Recurrent Neural Networks for Slot Filling in Spoken Language Understanding
Mesnil, G., Dauphin, Y., Yao, K., Bengio, Y., Deng, L., Hakkani-Tur, D., He, X., Heck, L., Tur, G., Yu, D., et al. (2015) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2014.2383614 · Cited by 461 · cited 1×
“…AI technologies, e.g., natural language understanding (Bengio et al., 2001; Mikolov et al., 2013; Sutskever et al., 2014; Bahdanau et al., 2015; Mesnil et al., 2015), speech recognition and synthesis (Hinton et al., 2012; Deng et al., 2013; Xiong et al., 2016; Qian et al., 2014; van den Oord…”
BackgroundSelf-citationAchieving Human Parity in Conversational Speech Recognition
Xiong, W., Droppo, J., Huang, X., Seide, F. T. B., Seltzer, M., Stolcke, A., Yu, D., & Zweig, G. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.05256 · Cited by 451 · cited 2×
“, 2013, 2015), speech recognition and synthesis (Hinton et al., 2012; Deng et al., 2013; Xiong et al., 2016; Qian et al., 2014; van den Oord et al., 2016), computer vision (Krizhevsky et al.”
BackgroundMesnil, G., He, X., Deng, L., & Bengio, Y. (2013) · Interspeech 2013 · doi:10.21437/interspeech.2013-596 · Cited by 413
Self-citationLiu, X., Gao, J., He, X., Deng, L., Duh, K., & Wang, Y.-Y. (2015) · Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.3115/v1/n15-1092 · Cited by 395 · cited 1×
“First, the user’s input is sent to a user understanding component, where semantic encoding and intent understanding is performed (Tur and Deng 2011; Liu et al., 2015; Vinyals and Le, 2015).”
BackgroundSelf-citationEvaluation of spoken language systems: the ATIS domain
Price, P. J. (1990) · Proceedings of the workshop on Speech and Natural Language - HLT '90 · doi:10.3115/116580.116612 · Cited by 385 · cited 1×
“Since the 1990s, a lot of research has been done on task-completion conversational systems (Price, 1990; Hemphill et al., 1990; Dahl et al., 1994; Walk et al., 2001).”
BackgroundAccelerated proximal stochastic dual coordinate ascent for regularized loss minimization
Shalev-Shwartz, S., & Zhang, T. (2016) · Mathematical Programming · doi:10.1007/s10107-014-0839-0 · Cited by 360
Neural Sentiment Classification with User and Product Attention
Chen, H., Sun, M., Tu, C., Lin, Y., & Liu, Z. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1171 · Cited by 339 · cited 1×
“It also detects the sentiment reflected in the input message and infers the user’s emotion status (Tokuhisa et al., 2008; Mower et al., 2011; Socher et al., 2013; Yang et al., 2016; Chen et al., 2016).”
BackgroundLearning to Respond with Deep Neural Networks for Retrieval-Based Human-Computer Conversation System
Yan, R., Song, Y., & Wu, H. (2016) · Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval · doi:10.1145/2911451.2911542 · Cited by 338 · cited 2×
“generated by two approaches: retrieval-based (Lu and Li, 2013; Li et al., 2016; Yan et al., 2016) or generation-based (Vinyals and Le, 2015; Sordoni”
MethodWallace, R. S. (2009) · Parsing the Turing Test · doi:10.1007/978-1-4020-6710-5_13 · Cited by 334 · cited 8×
“Inspired by the Turing test proposed in 1950 (Turing, 1950), researchers and engineers have developed multiple conversational systems for chitchat (Weizenbaum, 1966; Colby, 1975, Shieber, 1994; Wallace 2009).”
BackgroundMethodInfluentialExpanding the scope of the ATIS task: the ATIS-3 corpus
Dahl, D. A., Bates, M., Brown, M., Fisher, W., Hunicke-Smith, K., Pallett, D., Pao, C., Rudnicky, A., & Shriberg, E. (1994) · Proceedings of the workshop on Human Language Technology - HLT '94 · doi:10.3115/1075812.1075823 · Cited by 306 · cited 1×
“Since the 1990s, a lot of research has been done on task-completion conversational systems (Price, 1990; Hemphill et al., 1990; Dahl et al., 1994; Walk et al., 2001).”
BackgroundSpoken Language Understanding: Systems for Extracting Semantic Information from Speech
(2011) · Wiley eBooks · doi:10.1002/9781119992691 · Cited by 291
StyleNet: Generating Attractive Visual Captions with Styles
Gan, C., Gan, Z., He, X., Gao, J., & Deng, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.108 · Cited by 283 · cited 1×
“The generation-based approach treats image commenting as an image-to-language generation task (He and Deng 2017) but will have more flexibility for controlling high-level sentiment or style factors in comment generation (Mathews et al., 2015; Gan et al., 2017).”
BackgroundSelf-citationGALAXY-II: a reference architecture for conversational system development
Seneff, S., Hurley, E., Lau, R., Pao, C., Schmid, P., & Zue, V. (1998) · 5th International Conference on Spoken Language Processing (ICSLP 1998) · doi:10.21437/icslp.1998-478 · Cited by 259 · cited 1×
“These systems usually operate on constrained domains (Glass et al., 1995; Seneff et al., 1998; Rudnicky et al., 1999; Levin et al., 2000; Walk et al., 2001, 2002; Raux et al., 2005; Andreani et al., 2006; Wang et al., 2011; Tur and Mori, 2011).”
BackgroundToward Human Parity in Conversational Speech Recognition
Xiong, W., Droppo, J., Huang, X., Seide, F., Seltzer, M. L., Stolcke, A., Yu, D., & Zweig, G. (2017) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2017.2756440 · Cited by 245
Let's go public! taking a spoken dialog system to the real world
Raux, A., Langner, B., Bohus, D., Black, A. W., & Eskenazi, M. (2005) · Interspeech 2005 · doi:10.21437/interspeech.2005-399 · Cited by 226
A Deep Architecture for Matching Short Texts
Lu, Z., & Li, H. (2013) · Cited by 225
Lessons from a Restricted Turing Test
Shieber, S. M. (1994) · arXiv · doi:10.48550/arxiv.cmp-lg/9404002 · Cited by 222 · cited 7×
“In the past, the Turing test and its extensions have been used to evaluate chitchat performance (Shieber, 1994).”
BackgroundMethodInfluentialLessons from a restricted Turing test
Shieber, S. M. (1994) · Communications of the ACM · doi:10.1145/175208.175217 · Cited by 220 · cited 7×
“In the past, the Turing test and its extensions have been used to evaluate chitchat performance (Shieber, 1994).”
BackgroundMethodInfluentialOn the training aspects of Deep Neural Network (DNN) for parametric TTS synthesis
Qian, Y., Fan, Y., Hu, W., & Soong, F. K. (2014) · 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2014.6854318 · Cited by 216 · cited 2×
“, 2013, 2015), speech recognition and synthesis (Hinton et al., 2012; Deng et al., 2013; Xiong et al., 2016; Qian et al., 2014; van den Oord et al., 2016), computer vision (Krizhevsky et al.”
BackgroundA Framework for Automatic Human Emotion Classification Using Emotion Profiles
Mower, E., Mataric, M. J., & Narayanan, S. (2011) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2010.2076804 · Cited by 215 · cited 1×
“It also detects the sentiment reflected in the input message and infers the user’s emotion status (Tokuhisa et al., 2008; Mower et al., 2011; Socher et al., 2013; Yang et al., 2016; Chen et al., 2016).”
BackgroundSentiCap: Generating Image Descriptions with Sentiments
Mathews, A., Xie, L., & He, X. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10475 · Cited by 213 · cited 1×
“Similarly, models that learn to control the style and sentiment in language generation have been also proposed (Mathews et al., 2016).”
BackgroundSelf-citationSarikaya, R. (2017) · IEEE Signal Processing Magazine · doi:10.1109/msp.2016.2617341 · Cited by 198 · cited 2×
“IPAs provide reactive and proactive assistance to users to accomplish a variety of tasks (Sarikaya 2017).”
BackgroundEmotion classification using massive examples extracted from the web
Tokuhisa, R., Inui, K., & Matsumoto, Y. (2008) · Proceedings of the 22nd International Conference on Computational Linguistics - COLING '08 · doi:10.3115/1599081.1599192 · Cited by 196
Multiresolution Recurrent Neural Networks: An Application to Dialogue Response Generation
Serban, I., Klinger, T., Tesauro, G., Talamadupula, K., Zhou, B., Bengio, Y., & Courville, A. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10984 · Cited by 177
Artificial paranoia: A computer simulation of paranoid processes
(1976) · Behavior Therapy · doi:10.1016/s0005-7894(76)80257-2 · Cited by 172 · cited 4×
“For example, Parry will respond with hostility if the anger level is high.”
BackgroundMethodInfluentialCreating natural dialogs in the carnegie mellon communicator system
Rudnicky, A. I., Thayer, E. H., Constantinides, P. C., Tchou, C., Shern, R., Lenzo, K., Xu, W. H., & Oh, A. H. (1999) · European Conference on Speech Communication and Technology (Eurospeech) · doi:10.21437/eurospeech.1999-344 · Cited by 158
Different measurements metrics to evaluate a chatbot system
Shawar, B. A., & Atwell, E. (2007) · doi:10.3115/1556328.1556341 · Cited by 151
A Critique of Emotional Intelligence: What Are the Problems and How Can They Be Fixed?
(2007) · Personnel Psychology · doi:10.1111/j.1744-6570.2007.00071_2.x · Cited by 151
A Persona-Based Neural Conversation ModelPreprint
Li, J., Galley, M., Brockett, C., Spithourakis, G., Gao, J., & Dolan, B. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.06155 · Cited by 148 · cited 4×
“generated by two approaches: retrieval-based (Lu and Li, 2013; Li et al., 2016; Yan et al., 2016) or generation-based (Vinyals and Le, 2015; Sordoni”
MethodInfluentialA Network-based End-to-End Trainable Task-oriented Dialogue SystemPreprint
Wen, T.-H., Vandyke, D., Mrkšić, N., Gašić, M., Rojas-Barahona, L. M., Su, P.-H., Ultes, S., & Young, S. J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1604.04562 · Cited by 146 · cited 2×
“More recent work focuses on building end-to-end systems where multiple components are jointly optimized to cope with the large variability occurring in dialog systems (He and Deng, 2013; Wen et al., 2016; Sarikaya et al., 2016).”
BackgroundDeep Learning for Image-to-Text Generation: A Technical Overview
He, X., & Deng, L. (2017) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2741510 · Cited by 143 · cited 3×
“…(Krizhevsky et al., 2012; He et al., 2016), information retrieval (Huang et al., 2013; Elkahky et al., 2015), multimodal intelligence (Fang et al., 2015; Vinyals et al., 2015; Karpathy and Fei-fei, 2015; He and Deng, 2017), and empathic conversational systems (Fung et al., 2016; Alam et al., 2017).”
BackgroundSelf-citationFrames of the Mind: The Theory of Multiple Intelligences
Tropman, J. E., & Gardner, H. (1985) · Journal of Policy Analysis and Management · doi:10.2307/3324261 · Cited by 134
A Critique of Emotional Intelligence
Chiseyeng’I, J., Mwange, A., Matoka, W., Manda, R., Mutambo, N., Mashiri, G., & Bwalya, J. (2014) · Psychology Press eBooks · doi:10.4324/9781315820927 · Cited by 120 · cited 1×
“To fulfill these needs, a social chatbot must demonstrate a sufficient EQ (Beldoch 1964; Gardner 1983; Goleman 1995; Goleman 1998; Murphy 2014).”
BackgroundDARPA communicator dialog travel planning systems: the june 2000 data collection
Walker, M. A., Aberdeen, J. S., Boland, J., Bratt, E. O., Garofolo, J. S., Hirschman, L., Le, A., Lee, S. C., Narayanan, S. S., Papineni, K., et al. (2001) · European Conference on Speech Communication and Technology (Eurospeech) · doi:10.21437/eurospeech.2001-355 · Cited by 109
Multilingual spoken-language understanding in the MIT Voyager system
Glass, J. R., Flammia, G., Goodine, D., Phillips, M., Polifroni, J. H., Sakai, S., Seneff, S., & Zue, V. W. (1995) · Speech Communication · doi:10.1016/0167-6393(95)00008-c · Cited by 105 · cited 3×
“These systems usually operate on constrained domains (Glass et al., 1995; Walk et al., 2001; Raux et al., 2005; Andreani et al., 2006; Wang et al., 2011; Tur and Mori, 2011).”
BackgroundSarikaya, R., Crook, P. A., Marin, A., Jeong, M., Robichaud, J. P., Çelikyılmaz, A., Kim, Y. B., Rochette, A., Khan, O., Liu, X., et al. (2016) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt.2016.7846294 · Cited by 87 · cited 2×
“components are jointly optimized to cope with the large variability occurring in dialog systems (He and Deng, 2013; Sarikaya et al., 2016; Wen et al., 2016).”
BackgroundAnnotating and modeling empathy in spoken conversations
Alam, F., Danieli, M., & Riccardi, G. (2017) · Computer Speech & Language · doi:10.1016/j.csl.2017.12.003 · Cited by 81 · cited 2×
“…(Krizhevsky et al., 2012; He et al., 2016), information retrieval (Huang et al., 2013; Elkahky et al., 2015), multimodal intelligence (Fang et al., 2015; Vinyals et al., 2015; Karpathy and Fei-fei, 2015; He and Deng, 2017), and empathic conversational systems (Fung et al., 2016; Alam et al., 2017).”
BackgroundTowards Empathetic Human-Robot Interactions
Fung, P., Bertero, D., Wan, Y., Dey, A., Chan, R. H. Y., Siddique, F. B., Yang, Y., Wu, C.-S., & Lin, R. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-75487-1_14 · Cited by 78 · cited 1×
“…(Krizhevsky et al., 2012; He et al., 2016), information retrieval (Huang et al., 2013; Elkahky et al., 2015), multimodal intelligence (Fang et al., 2015; Vinyals et al., 2015; Karpathy and Fei-fei, 2015; He and Deng, 2017), and empathic conversational systems (Fung et al., 2016; Alam et al., 2017).”
BackgroundPersonalized ranking model adaptation for web search
Wang, H., He, X., Chang, M.-W., Song, Y., White, R. W., & Chu, W. (2013) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/2484028.2484068 · Cited by 76 · cited 1×
“These response candidates will be further ranked by a personalization ranker according to their match to the user’s general interests and preferences (Wang et al., 2013; Elkahky et al., 2015).”
BackgroundSelf-citationAn Inference Approach to Basic Level of Categorization
Wang, Z., Wang, H., Wen, J.-R., & Xiao, Y. (2015) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/2806416.2806533 · Cited by 71 · cited 2×
“To more precisely understand the user intent, knowledge bases such as Freebase 10 and the Microsoft Concept Graph (Wang et al., 2015) can be used.”
Method9th ISCA Speech Synthesis Workshop
Ronanki, S., Reddy, S., Bollepalli, B., & King, S. (2016) · Cited by 67
Semantic Frame‐Based Spoken Language Understanding
Wang, Y., Deng, L., & Acero, A. (2011) · Wiley eBooks · doi:10.1002/9781119992691.ch3 · Cited by 49 · cited 2×
“These systems usually operate on constrained domains (Glass et al., 1995; Walk et al., 2001; Raux et al., 2005; Andreani et al., 2006; Wang et al., 2011; Tur and Mori, 2011).”
BackgroundDARPA communicator evaluation: progress from 2000 to 2001
Walker, M. A., Rudnicky, A. I., Aberdeen, J. S., Bratt, E. O., Garofolo, J. S., Hastie, H. W., Le, A. N., Pellom, B. L., Potamianos, A., Passonneau, R. J., et al. (2002) · International Conference on Spoken Language Processing (ICSLP) · doi:10.21437/icslp.2002-133 · Cited by 47
Speech-Centric Information Processing: An Optimization-Oriented Approach
He, X., & Deng, L. (2013) · Proceedings of the IEEE · doi:10.1109/jproc.2012.2236631 · Cited by 44 · cited 2×
“components are jointly optimized to cope with the large variability occurring in dialog systems (He and Deng, 2013; Sarikaya et al., 2016; Wen et al., 2016).”
BackgroundSelf-citationStalemateBreaker: A Proactive Content-Introducing Approach to Automatic Human-Computer ConversationPreprint
Li, X., Mou, L., Yan, R., & Zhang, M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1604.04358 · Cited by 43 · cited 2×
“A persona-based model has been recently proposed (Li et al., 2016), which can be used to effectively integrate personality information in conversation generation.”
MethodDialogues with colorful personalities of early AI
Güzeldere, G., & Franchi, S. (1995) · doi:10.5555/212154.212175 · Cited by 42
SentiCap: Generating Image Descriptions with SentimentsPreprint
Mathews, A., Xie, L., & He, X. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1510.01431 · Cited by 32 · cited 1×
“Similarly, models that learn to control the style and sentiment in language generation have been also proposed (Mathews et al., 2016).”
BackgroundSelf-citationIntent Determination and Spoken Utterance Classification
Tür, G., & Deng, L. (2011) · doi:10.1002/9781119992691.ch4 · Cited by 31 · cited 1×
“First, the user’s input is sent to a user understanding component, where semantic encoding and intent understanding is performed (Tur and Deng 2011; Liu et al., 2015; Vinyals and Le, 2015).”
BackgroundAndreani, G., Fabbrizio, G. D., Gilbert, M., Gillick, D., Hakkani-Tür, D. Z., & Lemon, O. (2006) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt.2006.326794 · Cited by 18 · cited 2×
“These systems usually operate on constrained domains (Glass et al., 1995; Walk et al., 2001; Raux et al., 2005; Andreani et al., 2006; Wang et al., 2011; Tur and Mori, 2011).”
Background
Research works printed but not linked: 8
- Bengio, 2003, A neural probabilistic language model, 1137
- 10.1016/0004-3702(71)90002-6 · DOI · Paper page
- 10.21437/icslp.2000-224 · DOI
- 10.18653/v1/P16-1094 · DOI · Paper page
- Mikolov, 2013, Distributed representations of words and phrases and their compositionality, 3111
- 10.21437/Eurospeech.1999-389 · doi:10.21437/eurospeech.1999-389
- 10.18653/v1/e17-1042 · DOI · Paper page
- Yu, 2016, Chatbot evaluation and database expansion via crowdsourcing
Cited by
Chatbots: History, technology, and applications
Adamopoulou, E., & Moussiades, L. (2020) · Machine Learning with Applications · doi:10.1016/j.mlwa.2020.100006 · Cited by 1,090
My Chatbot Companion - a Study of Human-Chatbot Relationships
Skjuve, M., Følstad, A., Fostervold, K. I., & Brandtzaeg, P. B. (2021) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2021.102601 · Cited by 797
“XiaoIce, launched in 2014, is designed for long-term affective engagement with users and has reached 660 million active users (Zhou et al., 2018).”
BackgroundRecipes for Building an Open-Domain Chatbot
Roller, S., Dinan, E., Goyal, N., Ju, D., Williamson, M., Liu, Y., Xu, J., Ott, M., Smith, E. M., Boureau, Y.-L., et al. (2021) · Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume · doi:10.18653/v1/2021.eacl-main.24 · Cited by 784
Recipes for building an open-domain chatbot
Roller, S., Dinan, E., Goyal, N., Ju, D., Williamson, M., Liu, Y., Xu, J., Ott, M., Shuster, K., Smith, E. M., et al. (2020) · arXiv · doi:10.48550/arxiv.2004.13637 · Cited by 784
“, 2019), Mitsuku5, Cleverbot6, and XiaoIce (Shum et al., 2018; Zhou et al., 2020).”
MethodThe design and implementation of Xiaoice, an empathetic social chatbot
Zhou, L., Gao, J., Li, D., & Shum, H.-Y. (2020) · Computational Linguistics · doi:10.1162/coli_a_00368 · Cited by 777
“Systems BLEU-4 ROUGE-L CIDEr-D METEOR SPICE LSTM-XE Vinyals et al. [2015] 2.”
BackgroundSelf-citation
Metadata
- Authors
- Shum, H.-Y., He, X.-D., & Li, D.
- Affiliations
- Microsoft (United States) (US)
- Corresponding author
- Shum, Heung-yeung
- Venue
- Frontiers of Information Technology & Electronic Engineering
- Publisher
- Zhejiang University Press
- Published
- 2018-01
- Volume
- 19
- Issue
- 1
- Pages
- 10-26
- ISSN
- 2095-9184 (ISSN-L)
- 2095-9230
- OpenAlex
- W2964309167
- Cited by
- 749
- References
- 94
- Citations by year
- 2026: 60 · 2025: 96 · 2024: 83 · 2023: 118 · 2022: 103 · 2021: 109 · 2020: 103 · 2019: 56 · 2018: 21
- FWCI
- 40.13
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Frontiers of Information Technology & Electronic Engineering (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Rare & Special e-Zone (The Hong Kong University of Science and Technology) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Microsoft Research
- Microsoft Research Asia
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Keywords
- social chatbots, Eliza, emotional connection, user engagement, emotional quotient, emotion recognition, visual awareness, dialogue systems, human-AI interaction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.