PreprintCited by 243Recommender Systems and TechniquesSpeech and dialogue systemsAI in Service Interactions

The DOI matches its DataCite record.

Towards Deep Conversational Recommendations

Open access
Li, Raymond, Kahou, Samira, Schulz, Hannes, Michalski, Vincent, Charlin, Laurent, Pal, Chris·2018·arXiv

Abstract

There has been growing interest in using neural networks and deep learning techniques to create dialogue systems. Conversational recommendation is an interesting setting for the scientific exploration of dialogue with natural language as the associated discourse involves goal-driven dialogue that often transforms naturally into more free-form chat. This paper provides two contributions. First, until now there has been no publicly available large-scale dataset consisting of real-world dialogues centered around recommendations. To address this issue and to facilitate our exploration here, we have collected ReDial, a dataset consisting of over 10,000 conversations centered around the theme of providing movie recommendations. We make this data available to the community for further research. Second, we use this dataset to explore multiple facets of conversational recommendations. In particular we explore new neural architectures, mechanisms, and methods suitable for composing conversational recommendation systems. Our dataset allows us to systematically probe model sub-components addressing different parts of the overall problem domain ranging from: sentiment analysis and cold-start recommendation generation to detailed aspects of how natural language is used in this setting in the real world. We combine such sub-components into a full-blown dialogue system and examine its behavior.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.1812.07617

Cites

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Still being checked.

Research works printed but not linked: 28

  1. [1][1] Suvash Sedhain, Aditya Krishna Menon, Scott Sanner, and Lexing Xie. Autorec: Autoencoders meet collaborative filtering. In International Conference on World Wide Web , pages 111-112, 2015. -
  2. [2][2] Alessandro Sordoni, Yoshua Bengio, Hossein Vahabi, Christina Lioma, Jakob Grue Simonsen, and Jian-Yun Nie. A hierarchical recurrent encoder-decoder for generative context-aware query suggestion. In International on Conference on Information and Knowledge Management , pages 553-562, 2015. -
  3. [3][3] Caglar Gulcehre, Sungjin Ahn, Ramesh Nallapati, Bowen Zhou, and Yoshua Bengio. Pointing the unknown words. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , pages 140-149, Berlin, Germany, August 2016. Association for Computational Linguistics. -
  4. [4][4] Jesse Dodge, Andreea Gane, Xiang Zhang, Antoine Bordes, Sumit Chopra, Alexander Miller, Arthur Szlam, and Jason Weston. Evaluating prerequisite qualities for learning end-to-end dialog systems. arXiv:1511.06931 [cs.CL] , 2015. - · arXiv
  5. [5][5] F Maxwell Harper and Joseph A Konstan. The movielens datasets: History and context. Transactions on Interactive Intelligent Systems (TiiS) , 5(4):19, 2016. -
  6. [6][6] Alessandro Suglia, Claudio Greco, Pierpaolo Basile, Giovanni Semeraro, and Annalina Caputo. An automatic procedure for generating datasets for conversational recommender systems. In Proceedings of Dynamic Search for Complex Tasks-8th International Conference of the CLEF Association, CLEF , 2017. -
  7. [7][7] Ben Krause, Marco Damonte, Mihai Dobre, Daniel Duma, Joachim Fainberg, Federico Fancellu, Emmanuel Kahembwe, Jianpeng Cheng, and Bonnie Webber. Edina: Building an open domain socialbot with self-dialogues. arXiv:1709.09816 [cs.CL] , 2017. - · arXiv
  8. [8][8] Pontus Johansson. Design and Development of Recommender Dialogue Systems . PhD thesis, Institutionen för datavetenskap, 2004. -
  9. [9][9] Iulian Vlad Serban, Ryan Lowe, Peter Henderson, Laurent Charlin, and Joelle Pineau. A survey of available corpora for building data-driven dialogue systems. arXiv:1512.05742 [cs.CL] , 2015. - · arXiv
  10. [10][10] Mehmet H. Göker, Pat Langley, and Cynthia A. Thompson. A personalized system for conversational recommendations. arXiv:1107.0029 [cs.IR] , 2011. - · arXiv
  11. [11][11] Claudio Greco, Alessandro Suglia, Pierpaolo Basile, and Giovanni Semeraro. Converse-etimpera: Exploiting deep learning and hierarchical reinforcement learning for conversational recommender systems. In Conference of the Italian Association for Artificial Intelligence , pages 372-386. Springer, 2017. -
  12. [12][12] Dwi H Widyantoro and Z.K.A. Baizal. A framework of conversational recommender system based on user functional requirements. In Information and Communication Technology (ICoICT), 2nd International Conference on , pages 160-165, 2014. -
  13. [13][13] Pontus Wärnestål, Lars Degerstedt, and Arne Jönsson. Emergent conversational recommendations: A dialogue behavior approach. In SIGDIAL Workshop on Discourse and Dialogue , 2007. -
  14. [14][14] Konstantina Christakopoulou, Filip Radlinski, and Katja Hofmann. Towards conversational recommender systems. In SIGKDD International Conference on Knowledge Discovery and Data Mining , pages 815-824, 2016. -
  15. [15][15] Ji He, Jianshu Chen, Xiaodong He, Jianfeng Gao, Lihong Li, Li Deng, and Mari Ostendorf. Deep reinforcement learning with a natural language action space. arXiv preprint arXiv:1511.04636 , 2015. - · arXiv
  16. [16][16] Abhishek Das, Satwik Kottur, José MF Moura, Stefan Lee, and Dhruv Batra. Learning cooperative visual dialog agents with deep reinforcement learning. arXiv:1703.06585 [cs.CV] , 2017. - · arXiv
  17. [17][17] Xiujun Li, Yun-Nung Chen, Lihong Li, Jianfeng Gao, and Asli Celikyilmaz. End-to-end task-completion neural dialogue systems. arXiv preprint arXiv:1703.01008 , 2017. - · arXiv
  18. [18][18] Yueming Sun and Yi Zhang. Conversational recommender system. arXiv preprint arXiv:1806.03277 , 2018. - · arXiv
  19. [19][19] Abhishek Das, Satwik Kottur, Khushi Gupta, Avi Singh, Deshraj Yadav, José MF Moura, Devi Parikh, and Dhruv Batra. Visual dialog. In Conference on Computer Vision and Pattern Recognition , volume 2, 2017. -
  20. [20][20] Benjamin M. Marlin, Richard S. Zemel, Sam T. Roweis, and Malcolm Slaney. Collaborative filtering and the missing at random assumption. In UAI , pages 267-275, 2007. -
  21. [21][21] Sandeep Subramanian, Adam Trischler, Yoshua Bengio, and Christopher J Pal. Learning general purpose distributed sentence representations via large scale multi-task learning. In ICLR , 2018. -
  22. [22][22] Iulian Vlad Serban, Alessandro Sordoni, Yoshua Bengio, Aaron C Courville, and Joelle Pineau. Building end-to-end dialogue systems using generative hierarchical neural network models. In AAAI , volume 16, pages 3776-3784, 2016. -
  23. [23][23] Kyunghyun Cho, Bart Van Merriënboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. Learning phrase representations using rnn encoderdecoder for statistical machine translation. arXiv preprint arXiv:1406.1078 , 2014. - · arXiv
  24. [24][24] Pascal Vincent, Hugo Larochelle, Yoshua Bengio, and Pierre-Antoine Manzagol. Extracting and composing robust features with denoising autoencoders. In ICML , pages 1096-1103, 2008. -
  25. [25][25] Chia-Wei Liu, Ryan Lowe, Iulian V Serban, Michael Noseworthy, Laurent Charlin, and Joelle Pineau. How not to evaluate your dialogue system: An empirical study of unsupervised evaluation metrics for dialogue response generation. arXiv preprint arXiv:1603.08023 , 2016. - · arXiv
  26. [26][26] Jacob Cohen. A coefficient of agreement for nominal scales. Educational and psychological measurement , 20(1):37-46, 1960. -
  27. [27][27] Diederik P Kingma and Jimmy Ba. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 , 2014. - · arXiv
  28. [28][28] Mathieu Jacomy, Tommaso Venturini, Sebastien Heymann, and Mathieu Bastian. ForceAtlas2, a continuous graph layout algorithm for handy network visualization designed for the gephi software. PloS ONE , 9(6), 2014.

Cited by

Sorted by citations

Items 101–200 of 243

Metadata

Authors
Li, R., Kahou, S., Schulz, H., Michalski, V., Charlin, L., & Pal, C.
Affiliations
  • Microsoft (United States) (US)
  • Université de Montréal (CA)
  • HEC Montréal (CA)
Venue
arXiv
Publisher
arXiv
Published
2018
Volume
31
Pages
9725-9735
ISSN
2331-8422 (ISSN-L)
OpenAlex
W2891389695
Cited by
242
References
0
Citations by year
2026: 2 · 2025: 19 · 2024: 23 · 2023: 60 · 2022: 42 · 2021: 47 · 2020: 32 · 2019: 17
Type
posted content
Language
en
Open access
Locations
  • arXiv (Cornell University) (submittedVersion)
  • PolyPublie (École Polytechnique de Montréal) (submittedVersion)
  • arXiv (Cornell University)
  • neural information processing systems
Topics
  • Physical Sciences › Computer Science › Information Systems › Recommender Systems and Techniques
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
  • Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
Keywords
conversational recommendation, dialogue systems, movie recommendation, chatbots, sentiment analysis, cold-start recommendation, natural language dialogue, neural architecture

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review