The DOI matches its DataCite record.
Towards Deep Conversational Recommendations
Open accessAbstract
There has been growing interest in using neural networks and deep learning techniques to create dialogue systems. Conversational recommendation is an interesting setting for the scientific exploration of dialogue with natural language as the associated discourse involves goal-driven dialogue that often transforms naturally into more free-form chat. This paper provides two contributions. First, until now there has been no publicly available large-scale dataset consisting of real-world dialogues centered around recommendations. To address this issue and to facilitate our exploration here, we have collected ReDial, a dataset consisting of over 10,000 conversations centered around the theme of providing movie recommendations. We make this data available to the community for further research. Second, we use this dataset to explore multiple facets of conversational recommendations. In particular we explore new neural architectures, mechanisms, and methods suitable for composing conversational recommendation systems. Our dataset allows us to systematically probe model sub-components addressing different parts of the overall problem domain ranging from: sentiment analysis and cold-start recommendation generation to detailed aspects of how natural language is used in this setting in the real world. We combine such sub-components into a full-blown dialogue system and examine its behavior.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Based on the classification of dialogue systems, common approaches in conversational recommender systems can also be divided into two categories: attribute-based QA (questionanswering) and generative methods.”
From When large language models meet personalization: perspectives of challenges and opportunities (2024) · cites this paper as [219]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“However, they require a large amount of supervised training data.”
From When large language models meet personalization: perspectives of challenges and opportunities (2024) · cites this paper as [219]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Compared to attribute-based QA methods, generative methods [219-222] appear to be simpler and more scalable.”
From When large language models meet personalization: perspectives of challenges and opportunities (2024) · cites this paper as [219]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Still being checked.
Research works printed but not linked: 28
- [1][1] Suvash Sedhain, Aditya Krishna Menon, Scott Sanner, and Lexing Xie. Autorec: Autoencoders meet collaborative filtering. In International Conference on World Wide Web , pages 111-112, 2015. -
- [2][2] Alessandro Sordoni, Yoshua Bengio, Hossein Vahabi, Christina Lioma, Jakob Grue Simonsen, and Jian-Yun Nie. A hierarchical recurrent encoder-decoder for generative context-aware query suggestion. In International on Conference on Information and Knowledge Management , pages 553-562, 2015. -
- [3][3] Caglar Gulcehre, Sungjin Ahn, Ramesh Nallapati, Bowen Zhou, and Yoshua Bengio. Pointing the unknown words. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , pages 140-149, Berlin, Germany, August 2016. Association for Computational Linguistics. -
- [4][4] Jesse Dodge, Andreea Gane, Xiang Zhang, Antoine Bordes, Sumit Chopra, Alexander Miller, Arthur Szlam, and Jason Weston. Evaluating prerequisite qualities for learning end-to-end dialog systems. arXiv:1511.06931 [cs.CL] , 2015. - · arXiv
- [5][5] F Maxwell Harper and Joseph A Konstan. The movielens datasets: History and context. Transactions on Interactive Intelligent Systems (TiiS) , 5(4):19, 2016. -
- [6][6] Alessandro Suglia, Claudio Greco, Pierpaolo Basile, Giovanni Semeraro, and Annalina Caputo. An automatic procedure for generating datasets for conversational recommender systems. In Proceedings of Dynamic Search for Complex Tasks-8th International Conference of the CLEF Association, CLEF , 2017. -
- [7][7] Ben Krause, Marco Damonte, Mihai Dobre, Daniel Duma, Joachim Fainberg, Federico Fancellu, Emmanuel Kahembwe, Jianpeng Cheng, and Bonnie Webber. Edina: Building an open domain socialbot with self-dialogues. arXiv:1709.09816 [cs.CL] , 2017. - · arXiv
- [8][8] Pontus Johansson. Design and Development of Recommender Dialogue Systems . PhD thesis, Institutionen för datavetenskap, 2004. -
- [9][9] Iulian Vlad Serban, Ryan Lowe, Peter Henderson, Laurent Charlin, and Joelle Pineau. A survey of available corpora for building data-driven dialogue systems. arXiv:1512.05742 [cs.CL] , 2015. - · arXiv
- [10][10] Mehmet H. Göker, Pat Langley, and Cynthia A. Thompson. A personalized system for conversational recommendations. arXiv:1107.0029 [cs.IR] , 2011. - · arXiv
- [11][11] Claudio Greco, Alessandro Suglia, Pierpaolo Basile, and Giovanni Semeraro. Converse-etimpera: Exploiting deep learning and hierarchical reinforcement learning for conversational recommender systems. In Conference of the Italian Association for Artificial Intelligence , pages 372-386. Springer, 2017. -
- [12][12] Dwi H Widyantoro and Z.K.A. Baizal. A framework of conversational recommender system based on user functional requirements. In Information and Communication Technology (ICoICT), 2nd International Conference on , pages 160-165, 2014. -
- [13][13] Pontus Wärnestål, Lars Degerstedt, and Arne Jönsson. Emergent conversational recommendations: A dialogue behavior approach. In SIGDIAL Workshop on Discourse and Dialogue , 2007. -
- [14][14] Konstantina Christakopoulou, Filip Radlinski, and Katja Hofmann. Towards conversational recommender systems. In SIGKDD International Conference on Knowledge Discovery and Data Mining , pages 815-824, 2016. -
- [15][15] Ji He, Jianshu Chen, Xiaodong He, Jianfeng Gao, Lihong Li, Li Deng, and Mari Ostendorf. Deep reinforcement learning with a natural language action space. arXiv preprint arXiv:1511.04636 , 2015. - · arXiv
- [16][16] Abhishek Das, Satwik Kottur, José MF Moura, Stefan Lee, and Dhruv Batra. Learning cooperative visual dialog agents with deep reinforcement learning. arXiv:1703.06585 [cs.CV] , 2017. - · arXiv
- [17][17] Xiujun Li, Yun-Nung Chen, Lihong Li, Jianfeng Gao, and Asli Celikyilmaz. End-to-end task-completion neural dialogue systems. arXiv preprint arXiv:1703.01008 , 2017. - · arXiv
- [18][18] Yueming Sun and Yi Zhang. Conversational recommender system. arXiv preprint arXiv:1806.03277 , 2018. - · arXiv
- [19][19] Abhishek Das, Satwik Kottur, Khushi Gupta, Avi Singh, Deshraj Yadav, José MF Moura, Devi Parikh, and Dhruv Batra. Visual dialog. In Conference on Computer Vision and Pattern Recognition , volume 2, 2017. -
- [20][20] Benjamin M. Marlin, Richard S. Zemel, Sam T. Roweis, and Malcolm Slaney. Collaborative filtering and the missing at random assumption. In UAI , pages 267-275, 2007. -
- [21][21] Sandeep Subramanian, Adam Trischler, Yoshua Bengio, and Christopher J Pal. Learning general purpose distributed sentence representations via large scale multi-task learning. In ICLR , 2018. -
- [22][22] Iulian Vlad Serban, Alessandro Sordoni, Yoshua Bengio, Aaron C Courville, and Joelle Pineau. Building end-to-end dialogue systems using generative hierarchical neural network models. In AAAI , volume 16, pages 3776-3784, 2016. -
- [23][23] Kyunghyun Cho, Bart Van Merriënboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. Learning phrase representations using rnn encoderdecoder for statistical machine translation. arXiv preprint arXiv:1406.1078 , 2014. - · arXiv
- [24][24] Pascal Vincent, Hugo Larochelle, Yoshua Bengio, and Pierre-Antoine Manzagol. Extracting and composing robust features with denoising autoencoders. In ICML , pages 1096-1103, 2008. -
- [25][25] Chia-Wei Liu, Ryan Lowe, Iulian V Serban, Michael Noseworthy, Laurent Charlin, and Joelle Pineau. How not to evaluate your dialogue system: An empirical study of unsupervised evaluation metrics for dialogue response generation. arXiv preprint arXiv:1603.08023 , 2016. - · arXiv
- [26][26] Jacob Cohen. A coefficient of agreement for nominal scales. Educational and psychological measurement , 20(1):37-46, 1960. -
- [27][27] Diederik P Kingma and Jimmy Ba. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 , 2014. - · arXiv
- [28][28] Mathieu Jacomy, Tommaso Venturini, Sebastien Heymann, and Mathieu Bastian. ForceAtlas2, a continuous graph layout algorithm for handy network visualization designed for the gephi software. PloS ONE , 9(6), 2014.
Cited by
Sorted by citations
When large language models meet personalization: perspectives of challenges and opportunities
Chen, J., Liu, Z., Huang, X., Wu, C., Liu, Q., Jiang, G., Pu, Y., Lei, Y., Chen, X., Wang, X., et al. (2024) · World Wide Web · doi:10.1007/s11280-024-01276-1 · Cited by 367
Advances and challenges in conversational recommender systems: A survey
Gao, C., Lei, W., He, X., de Rijke, M., & Chua, T. (2021) · AI Open · doi:10.1016/j.aiopen.2021.06.002 · Cited by 390
Fashion IQ: A New Dataset Towards Retrieving Images by Natural Language Feedback
Wu, H., Gao, Y., Guo, X., Al-Halah, Z., Rennie, S. J., Grauman, K. L., & Feris, R. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01115 · Cited by 297
Lei, W., He, X., Miao, Y., Wu, Q., Hong, R., Kan, M.-Y., & Chua, T.-S. (2020) · Proceedings of the 13th International Conference on Web Search and Data Mining · doi:10.1145/3336191.3371769 · Cited by 253
Towards Knowledge-Based Recommender Dialog System
Chen, Q., Lin, J., Zhang, Y., Ding, M., Cen, Y., Yang, H., & Tang, J. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1189 · Cited by 317
Metadata
- Authors
- Li, R., Kahou, S., Schulz, H., Michalski, V., Charlin, L., & Pal, C.
- Affiliations
- Microsoft (United States) (US)
- Université de Montréal (CA)
- HEC Montréal (CA)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2018
- Volume
- 31
- Pages
- 9725-9735
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1812.07617
- OpenAlex
- W2891389695
- Cited by
- 242
- References
- 0
- Citations by year
- 2026: 2 · 2025: 19 · 2024: 23 · 2023: 60 · 2022: 42 · 2021: 47 · 2020: 32 · 2019: 17
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- PolyPublie (École Polytechnique de Montréal) (submittedVersion)
- arXiv (Cornell University)
- neural information processing systems
- Topics
- Physical Sciences › Computer Science › Information Systems › Recommender Systems and Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
- Keywords
- conversational recommendation, dialogue systems, movie recommendation, chatbots, sentiment analysis, cold-start recommendation, natural language dialogue, neural architecture
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review