The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Learning to Respond with Deep Neural Networks for Retrieval-Based Human-Computer Conversation System
Abstract
To establish an automatic conversation system between humans and computers is regarded as one of the most hardcore problems in computer science, which involves interdisciplinary techniques in information retrieval, natural language processing, artificial intelligence, etc. The challenges lie in how to respond so as to maintain a relevant and continuous conversation with humans. Along with the prosperity of Web 2.0, we are now able to collect extremely massive conversational data, which are publicly available. It casts a great opportunity to launch automatic conversation systems. Owing to the diversity of Web resources, a retrieval-based conversation system will be able to find at least some responses from the massive repository for any user inputs. Given a human issued message, i.e., query, our system would provide a reply after adequate training and learning of how to respond. In this paper, we propose a retrieval-based conversation system with the deep learning-to-respond schema through a deep neural network framework driven by web data. The proposed model is general and unified for different conversation scenarios in open domain. We incorporate the impact of multiple data inputs, and formulate various features and factors with optimization into the deep learning framework. In the experiments, we investigate the effectiveness of the proposed deep neural network structures with better combinations of all different evidence. We demonstrate significant performance improvement against a series of standard and state-of-art baselines in terms of [email protected], MAP, nDCG, and MRR for conversational purposes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Introduction to information retrieval
(2009) · Choice Reviews Online · doi:10.5860/choice.46-2715 · Cited by 12,278
Learning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239
Speech recognition with deep recurrent neural networks
Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893 · cited 1×
“The variant Bi-LSTM [4] is proposed to utilize both previous and future words by two separate RNNs, propagating forward and backward, and generating two independent hidden state vectors −→ h t and ←− h t , respectively.”
MethodLearning Deep Architectures for AI
Bengio, Y. (2009) · now publishers, Inc. eBooks · doi:10.1561/9781601982957 · Cited by 4,941
Cumulated gain-based evaluation of IR techniques
Järvelin, K., & Kekäläinen, J. (2002) · ACM Transactions on Information Systems · doi:10.1145/582415.582418 · Cited by 4,841
A Convolutional Neural Network for Modelling Sentences
Kalchbrenner, N., Grefenstette, E., & Blunsom, P. (2014) · Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.3115/v1/p14-1062 · Cited by 3,601
Semi-Supervised Recursive Autoencoders for Predicting Sentiment Distributions
Socher, R., Pennington, J., Huang, E., Ng, A. Y., & Manning, C. D. (2011) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · Cited by 1,431
Convolutional Neural Network Architectures for Matching Natural Language Sentences
Hu, B., Lu, Z., Li, H., & Chen, Q. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1503.03244 · Cited by 1,098
Neural Responding Machine for Short-Text Conversation
Shang, L., Lu, Z., & Li, H. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.3115/v1/p15-1152 · Cited by 978
Learning to Rank Short Text Pairs with Convolutional Deep Neural Networks
Severyn, A., & Moschitti, A. (2015) · Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/2766462.2767738 · Cited by 722
Convolutional Neural Networks over Tree Structures for Programming Language Processing
Mou, L., Li, G., Zhang, L., Wang, T., & Jin, Z. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10139 · Cited by 675
Classifying Relations via Long Short Term Memory Networks along Shortest Dependency Paths
Xu, Y., Mou, L., Li, G., Chen, Y., Peng, H., & Jin, Z. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1206 · Cited by 653
Reasoning about Entailment with Neural Attention
Rocktäschel, T., Grefenstette, E., Hermann, K. M., Kočiský, T., & Blunsom, P. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1509.06664 · Cited by 582
Data-Driven Response Generation in Social Media
Ritter, A., Cherry, C., & Dolan, W. B. (2011) · NPARC · Cited by 565
Multi-Perspective Sentence Similarity Modeling with Convolutional Neural Networks
He, H., Gimpel, K., & Lin, J. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1181 · Cited by 378
The Dialog State Tracking Challenge
Williams, J. D., Raux, A., Ramachandran, D., & Black, A. W. (2013) · Cited by 317
Finding question-answer pairs from online forums
Cong, G., Wang, L., Lin, C.-Y., Song, Y.-I., & Sun, Y. (2008) · Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1390334.1390415 · Cited by 278
Self-citationAn Information Retrieval Approach to Short Text ConversationPreprint
Ji, Z., Lu, Z., & Li, H. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1408.6988 · Cited by 277
Li, H., & Xu, J. (2014) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000035 · Cited by 235
Towards an open-domain conversational system fully based on natural language processing
Higashinaka, R., Imamura, K., Meguro, T., Miyazaki, C., Kobayashi, N., Sugiyama, H., Hirano, T., Makino, T., & Matsuo, Y. (2014) · International Conference on Computational Linguistics · Cited by 234
A Deep Architecture for Matching Short Texts
Lu, Z., & Li, H. (2013) · Cited by 225
Quantitative and qualitative evaluation of Darpa Communicator spoken dialogue systems
Walker, M. A., Passonneau, R., & Boland, J. E. (2001) · Proceedings of the 39th Annual Meeting on Association for Computational Linguistics - ACL '01 · doi:10.3115/1073012.1073078 · Cited by 201
Evolutionary timeline summarization: a balanced optimization framework via iterative substitution
Yan, R., Wan, X., Otterbacher, J., Kong, L., Li, X., & Zhang, Y. (2011) · Proceedings of the 34th international ACM SIGIR conference on Research and development in Information Retrieval · doi:10.1145/2009916.2010016 · Cited by 177
Self-citationA Dataset for Research on Short-Text Conversations
Wang, H., Lu, Z., Li, H., & Chen, E. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1096 · Cited by 173
Discriminative Neural Sentence Modeling by Tree-Based Convolution
Mou, L., Peng, H., Li, G., Xu, Y., Zhang, L., & Jin, Z. G. (2015) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d15-1279 · Cited by 142
Li, H., & Xu, J. (2014) · now publishers, Inc. eBooks · doi:10.1561/9781601988058 · Cited by 117
NPCEditor: Creating Virtual Human Dialogue Using Information Retrieval Techniques
Leuski, A., & Traum, D. R. (2011) · AI Magazine · doi:10.1609/aimag.v32i2.2347 · Cited by 116
Building effective question answering characters
Leuski, A., Patel, R., Traum, D. R., & Kennedy, B. (2006) · Annual Meeting of the Special Interest Group on Discourse and Dialogue · doi:10.3115/1654595.1654600 · Cited by 110
Tweet Recommendation with Graph Co-Ranking
Yan, R., Lapata, M., & Li, X. (2012) · Edinburgh Research Explorer (University of Edinburgh) · Cited by 108
Self-citationYan, R. (2016) · International Joint Conference on Artificial Intelligence · Cited by 74
Self-citationDiscovering Latent Structure in Task-Oriented Dialogues
Zhai, K., & Williams, J. D. (2014) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/v1/p14-1004 · Cited by 57
Dialog System Using Real-Time Crowdsourcing and Twitter Large-Scale Corpus
Bessho, F., Harada, T., & Kuniyoshi, Y. (2012) · Cited by 53
StalemateBreaker: A Proactive Content-Introducing Approach to Automatic Human-Computer ConversationPreprint
Li, X., Mou, L., Yan, R., & Zhang, M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1604.04358 · Cited by 47
Self-citationSugiyama, H., Meguro, T., Higashinaka, R., & Minami, Y. (2013) · Annual Meeting of the Special Interest Group on Discourse and Dialogue · Cited by 33
An Optimization Framework for Merging Multiple Result Lists
Lee, C.-J., Ai, Q., Croft, W. B., & Sheldon, D. R. (2015) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/2806416.2806489 · Cited by 22
Tackling the Achilles Heel of Social Networks: Influence Propagation based Language Model Smoothing
Yan, R., Yen, I. E.-H., Li, C., Zhao, S., & Hu, X. T. (2015) · International World Wide Web Conference (WWW) · doi:10.1145/2736277.2741673 · Cited by 12
Self-citationSocialized Language Model Smoothing via Bi-directional Influence Propagation on Social Networks
Yan, R., Li, C., Hsieh, H.-P., Hu, P., Hu, X., & He, T. (2016) · International World Wide Web Conference (WWW) · doi:10.1145/2872427.2874811 · Cited by 7
Self-citation
Cited by
From Eliza to XiaoIce: Challenges and opportunities with social chatbots
Shum, H.-Y., He, X.-D., & Li, D. (2018) · Frontiers of Information Technology & Electronic Engineering · doi:10.1631/fitee.1700826 · Cited by 749
“generated by two approaches: retrieval-based (Lu and Li, 2013; Li et al., 2016; Yan et al., 2016) or generation-based (Vinyals and Le, 2015; Sordoni”
MethodA Survey on Dialogue Systems: Recent Advances and New Frontiers
Chen, H., Liu, X., Yin, D., & Tang, J. (2017) · ACM SIGKDD Explorations Newsletter · doi:10.1145/3166054.3166058 · Cited by 579
What Makes Good In-Context Examples for GPT-3?
Liu, J., Shen, D., Zhang, Y., Dolan, B., Carin, L., & Chen, W. (2022) · Proceedings of Deep Learning Inside Out (DeeLIO 2022): The 3rd Workshop on Knowledge Extraction and Integration for Deep Learning Architectures · doi:10.18653/v1/2022.deelio-1.10 · Cited by 563
Temporal Relational Ranking for Stock Prediction
Feng, F., He, X., Wang, X., Luo, C., Liu, Y., & Chua, T.-S. (2019) · ACM Transactions on Information Systems · doi:10.1145/3309547 · Cited by 553
“Since RNN has achieved significant performance to process sequential data [16, 42, 47] and demonstrated to be effective in recent stock prediction research [4, 49], we opt for RNN to learn the sequential embeddings.”
MethodWu, Y., Wu, W., Xing, C., Zhou, M., & Li, Z. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1046 · Cited by 506
Metadata
- Authors
- Yan, R., Song, Y., & Wu, H.
- Venue
- Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval
- Publisher
- ACM
- Published
- 2016-07-07
- Pages
- 55-64
- OpenAlex
- W2339852062
- Cited by
- 338
- References
- 39
- FWCI
- 24.69
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.