The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Deep reinforcement learning for page-wise recommendations
Open accessAbstract
Recommender systems can mitigate the information overload problem by suggesting users' personalized items. In real-world recommendations such as e-commerce, a typical interaction between the system and its users is - users are recommended a page of items and provide feedback; and then the system recommends a new page of items. To effectively capture such interaction for recommendations, we need to solve two key problems - (1) how to update recommending strategy according to user's real-time feedback, and 2) how to generate a page of items with proper display, which pose tremendous challenges to traditional recommender systems. In this paper, we study the problem of page-wise recommendations aiming to address aforementioned two challenges simultaneously. In particular, we propose a principled approach to jointly generate a set of complementary items and the corresponding strategy to display them in a 2-D page; and propose a novel page-wise recommendation framework based on deep reinforcement learning, DeepPage, which can optimize a page of items with proper display based on real-time feedback from users. The experimental results based on a real-world e-commerce dataset demonstrate the effectiveness of the proposed framework.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213
Bellman, R. E. (2010) · doi:10.1515/9781400835386 · Cited by 14,588
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782
Playing Atari with Deep Reinforcement Learning
Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013) · arXiv · doi:10.48550/arxiv.1312.5602 · Cited by 9,471
Effective Approaches to Attention-based Neural Machine Translation
Luong, T., Pham, H., & Manning, C. D. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1166 · Cited by 8,382
Introduction to Reinforcement Learning
Sutton, R. S., & Barto, A. G. (1998) · The MIT Press eBooks · Cited by 6,855
Amazon.com recommendations: item-to-item collaborative filtering
Linden, G., Smith, B., & York, J. (2003) · IEEE Internet Computing · doi:10.1109/mic.2003.1167344 · Cited by 5,403
Cumulated gain-based evaluation of IR techniques
Järvelin, K., & Kekäläinen, J. (2002) · ACM Transactions on Information Systems · doi:10.1145/582415.582418 · Cited by 4,841
Empirical Analysis of Predictive Algorithms for Collaborative Filtering
Breese, J. S., Heckerman, D. E., & Kadie, C. M. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1301.7363 · Cited by 4,772
Resnick, P., & Varian, H. R. (1997) · Communications of the ACM · doi:10.1145/245108.245121 · Cited by 3,772
(2011) · Springer eBooks · doi:10.1007/978-0-387-85820-3 · Cited by 3,761
Deep Learning Based Recommender System: A Survey and New Perspectives
Zhang, S., Yao, L., Sun, A., & Tay, Y. (2020) · ACM Computing Surveys · doi:10.1145/3285029 · Cited by 3,485
Rendle, S. (2010) · 2010 IEEE International Conference on Data Mining · doi:10.1109/icdm.2010.127 · Cited by 3,189
Introduction to Recommender Systems Handbook
Ricci, F., Rokach, L., & Shapira, B. (2011) · Recommender Systems Handbook · doi:10.1007/978-0-387-85820-3_1 · Cited by 2,378
Neural Word Embedding as Implicit Matrix Factorization
Levy, O., & Goldberg, Y. (2014) · neural information processing systems · Cited by 1,582
Reinforcement Learning: An Introduction
(1998) · Kybernetes · doi:10.1108/k.1998.27.9.1093.3 · Cited by 1,472
Content-based book recommending using learning for text categorization
Mooney, R. J., & Roy, L. (2000) · Proceedings of the fifth ACM conference on Digital libraries · doi:10.1145/336597.336662 · Cited by 1,328
Deep Convolutional Neural Network for Image Deconvolution
Li, X., Ren, J., Liu, C., & Jia, J. (2014) · neural information processing systems · Cited by 1,044
Reinforcement learning for robots using neural networks
Lin, L.-J. (1992) · Defense Technical Information Center (DTIC) · Cited by 1,042
Prioritized sweeping: Reinforcement learning with less data and less time
Moore, A. W., & Atkeson, C. G. (1993) · Machine Learning · doi:10.1007/bf00993104 · Cited by 823
Deep Learning based Recommender System: A Survey and New Perspectives
Zhang, S., Yao, L., Sun, A., & Tay, Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.07435 · Cited by 635
DRN: A Deep Reinforcement Learning Framework for News Recommendation
Zheng, G., Zhang, F., Zheng, Z., Xiang, Y., Yuan, N. J., Xie, X., & Li, Z. (2018) · Proceedings of the 2018 World Wide Web Conference on World Wide Web - WWW '18 · doi:10.1145/3178876.3185994 · Cited by 630
Recommendations in location-based social networks: a survey
Bao, J., Zheng, Y., Wilkie, D., & Mokbel, M. (2015) · GeoInformatica · doi:10.1007/s10707-014-0220-8 · Cited by 570
Session-based Recommendations with Recurrent Neural Networks
Hidasi, B., Karatzoglou, A., Baltrunas, L., & Tikk, D. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.06939 · Cited by 509
A Sparse Sampling Algorithm for Near-Optimal Planning in Large Markov Decision Processes
Kearns, M., Mansour, Y., & Ng, A. Y. (2002) · Machine Learning · doi:10.1023/a:1017932429737 · Cited by 488
Recommending friends and locations based on individual location history
Zheng, Y., Zhang, L., Ma, Z., Xie, X., & Ma, W.-Y. (2011) · ACM Transactions on the Web · doi:10.1145/1921591.1921596 · Cited by 479
Self-citationUser performance versus precision measures for simple search tasks
Turpin, A., & Scholer, F. (2006) · Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1148170.1148176 · Cited by 389
Recommendations with Negative Feedback via Pairwise Deep Reinforcement Learning
Zhao, X., Zhang, L., Ding, Z., Xia, L., Tang, J., & Yin, D. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3219886 · Cited by 387
Self-citationPEGASUS: A Policy Search Method for Large MDPs and POMDPs
Ng, A. Y., & Jordan, M. I. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1301.3878 · Cited by 360
A Survey of Accuracy Evaluation Metrics of Recommendation Tasks
GunawardanaAsela, & ShaniGuy (2009) · Journal of Machine Learning Research · doi:10.5555/1577069.1755883 · Cited by 314
Content-Aware Point of Interest Recommendation on Location-Based Social Networks
Gao, H., Tang, J., Hu, X., & Liu, H. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9462 · Cited by 306
Self-citationReinforcement Learning in Large Discrete Action Spaces.Preprint
Dulac-Arnold, G., Evans, R., Sunehag, P., & Coppin, B. (2015) · arXiv (Cornell University) · Cited by 292
Deep Reinforcement Learning in Large Discrete Action Spaces
Dulac-Arnold, G., Evans, R., van Hasselt, H., Sunehag, P., Lillicrap, T., Hunt, J., Mann, T., Weber, T., Degris, T., & Coppin, B. (2015) · arXiv · doi:10.48550/arxiv.1512.07679 · Cited by 290
Improving recommender systems with adaptive conversational strategies
Mahmood, T., & Ricci, F. (2009) · Proceedings of the 20th ACM conference on Hypertext and hypermedia · doi:10.1145/1557914.1557930 · Cited by 259
What Your Images Reveal: Exploiting Visual Contents for Point-of-Interest Recommendation
Wang, S., Wang, Y., Tang, J., Shu, K., Ranganath, S., & Liu, H. (2017) · Proceedings of the 26th International Conference on World Wide Web · doi:10.1145/3038912.3052638 · Cited by 229
Self-citationDeep Reinforcement Learning for List-wise RecommendationsPreprint
Zhao, X., Zhang, L., Xia, L., Ding, Z., Yin, D., & Tang, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.00209 · Cited by 224
Self-citationLinear Submodular Bandits and their Application to Diversified Retrieval
Yue, Y., & Guestrin, C. (2011) · CaltechAUTHORS (California Institute of Technology) · Cited by 168
Personal recommendation using deep recurrent neural networks in NetEase
Wu, S., Ren, W., Yu, C., Chen, G., Zhang, D., & Jing-Bo, Z. H. U. (2016) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde.2016.7498326 · Cited by 145
Stabilizing Reinforcement Learning in Dynamic Environment with Application to Online Recommendation
Chen, S., Yu, Y., Da, Q., Tan, J. Z., Huang, H., & Tang, H.-H. (2018) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3219819.3220122 · Cited by 140
Usage-based web recommendations
Taghipour, N., Kardan, A. A., & Ghidary, S. S. (2007) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/1297231.1297250 · Cited by 84
Reinforcement Mechanism Design for e-commerce
Cai, Q., Filos-Ratsikas, A., Tang, P., & Zhang, Y. (2018) · International World Wide Web Conference (WWW) · doi:10.1145/3178876.3186039 · Cited by 84
A hybrid web recommender system based on Q-learning
Taghipour, N., & Kardan, A. A. (2008) · ACM Symposium on Applied Computing · doi:10.1145/1363686.1363954 · Cited by 79
Personalized Deep Learning for Tag Recommendation
Nguyen, H. T. H., Wistuba, M., Grabocka, J., Drumond, L. R., & Schmidt-Thieme, L. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-57454-7_15 · Cited by 79
Learning to Collaborate: Multi-Scenario Ranking via Multi-Agent Reinforcement Learning
Feng, J., Li, H., Huang, M., Liu, S., Ou, W., Wang, Z., & Zhu, X. (2018) · International World Wide Web Conference (WWW) · doi:10.1145/3178876.3186165 · Cited by 71
Incremental methods for computing bounds in partially observable Markov decision processes
Hauskrecht, M. (1997) · Cited by 63
Sunehag, P., Evans, R., Dulac-Arnold, G., Zwólš, Y., Visentin, D., & Coppin, B. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1512.01124 · Cited by 61
User browsing models: relevance versus examination
Srikant, R., Basu, S., Wang, N., & Pregibon, D. (2010) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/1835804.1835835 · Cited by 51
Reinforcement Mechanism Design for Fraudulent Behaviour in e-Commerce
Cai, Q., Filos-Ratsikas, A., Tang, P., & Zhang, Y. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11452 · Cited by 36
Exploring the Choice Under Conflict for Social Event Participation
Zhao, X., Xu, T., Liu, Q., & Guo, H. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-32025-0_25 · Cited by 21
Self-citationGuo, H., Li, X., He, M. X., Zhao, X., Liu, G., & Xu, G. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-47650-6_48 · Cited by 16
Self-citation
Cited by
Deep Learning Based Recommender System: A Survey and New Perspectives
Zhang, S., Yao, L., Sun, A., & Tay, Y. (2020) · ACM Computing Surveys · doi:10.1145/3285029 · Cited by 3,485
Bias and Debias in Recommender System: A Survey and Future Directions
Chen, J., Dong, H., Wang, X., Feng, F., Wang, M., & He, X. (2023) · ACM Transactions on Information Systems · doi:10.1145/3564284 · Cited by 741
“Reinforcement learning [13], [144], [145], [146], [147], [148], [149], [150], [151], [152], [153], [154], [155], [156], [156], [157], [158], [159], [160] Others [161], [162]”
BackgroundDeep Learning based Recommender System: A Survey and New Perspectives
Zhang, S., Yao, L., Sun, A., & Tay, Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.07435 · Cited by 635
A Survey on Session-based Recommender Systems
Wang, S., Cao, L., Wang, Y., Sheng, Q. Z., Orgun, M. A., & Lian, D. (2022) · ACM Computing Surveys · doi:10.1145/3465401 · Cited by 570
Reinforcement Learning based Recommender Systems: A Survey
Afsar, M. M., Crump, T., & Far, B. (2023) · ACM Computing Surveys · doi:10.1145/3543846 · Cited by 502
Metadata
- Authors
- Zhao, X., Xia, L., Zhang, L., Ding, Z., Yin, D., & Tang, J.
- Venue
- Proceedings of the 12th ACM Conference on Recommender Systems
- Publisher
- ACM
- Published
- 2018-09-27
- Pages
- 95-103
- OpenAlex
- W2799544270
- Cited by
- 418
- References
- 52
- FWCI
- 31.69
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.