The DOI matches its Crossref record; 199 of the 199 references it cites were found in a registry or an index.
Reinforcement Learning based Recommender Systems: A Survey
Open accessAbstract
Recommender systems (RSs) have become an inseparable part of our everyday lives. They help us find our favorite items to purchase, our friends on social networks, and our favorite movies to watch. Traditionally, the recommendation problem was considered to be a classification or prediction problem, but it is now widely agreed that formulating it as a sequential decision problem can better reflect the user-system interaction. Therefore, it can be formulated as a Markov decision process (MDP) and be solved by reinforcement learning (RL) algorithms. Unlike traditional recommendation methods, including collaborative filtering and content-based filtering, RL is able to handle the sequential, dynamic user-system interaction and to take into account the long-term user engagement. Although the idea of using RL for recommendation is not new and has been around for about two decades, it was not very practical, mainly because of scalability problems of traditional RL algorithms. However, a new trend has emerged in the field since the introduction of deep reinforcement learning (DRL) , which made it possible to apply RL to the recommendation problem with large state and action spaces. In this paper, a survey on reinforcement learning based recommender systems (RLRSs) is presented. Our aim is to present an outlook on the field and to provide the reader with a fairly complete knowledge of key concepts of the field. We first recognize and illustrate that RLRSs can be generally classified into RL- and DRL-based methods. Then, we propose an RLRS framework with four components, i.e., state representation, policy optimization, reward formulation, and environment building, and survey RLRS algorithms accordingly. We highlight emerging topics and depict important trends using various graphs and tables. Finally, we discuss important aspects and challenges that can be addressed in the future.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
The Nature of Statistical Learning Theory
Vapnik, V. N. (1995) · doi:10.1007/978-1-4757-2440-0 · Cited by 39,138
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
Statistical Analysis With Missing Data
Lahiff, M., Little, R. J. A., & Rubin, D. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289883 · Cited by 17,265
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.3555 · Cited by 11,008
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782
Proximal Policy Optimization Algorithms
Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017) · arXiv · doi:10.48550/arxiv.1707.06347 · Cited by 10,625
Playing Atari with Deep Reinforcement Learning
Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013) · arXiv · doi:10.48550/arxiv.1312.5602 · Cited by 9,471
MIMIC-III, a freely accessible critical care database
Johnson, A. E. W., Pollard, T. J., Shen, L., Lehman, L.-W. H., Feng, M., Ghassemi, M., Moody, B., Szolovits, P., Anthony Celi, L., & Mark, R. G. (2016) · Scientific Data · doi:10.1038/sdata.2016.35 · Cited by 8,141
Introduction to Reinforcement Learning
Sutton, R. S., & Barto, A. G. (1998) · The MIT Press eBooks · Cited by 6,855
Finite-time Analysis of the Multiarmed Bandit Problem
Auer, P., Cesa-Bianchi, N., & Fischer, P. (2002) · Machine Learning · doi:10.1023/a:1013689704352 · Cited by 6,033
Lipton, Z. C. (2018) · Queue · doi:10.1145/3236386.3241340 · Cited by 5,427
Watkins, C. (1989) · OpenGrey (Institut de l'Information Scientifique et Technique) · doi:10.17863/cam.132164 · Cited by 5,297
WaveNet: a generative model for raw audio
Oord, A. V. D., Dieleman, S., Zen, H., Simonyan, K., Vinyals, O., Graves, A., Kalchbrenner, N., Senior, A., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1609.03499 · Cited by 4,911
Progressive Growing of GANs for Improved Quality, Stability, and Variation
Karras, T., Aila, T., Laine, S., & Lehtinen, J. (2017) · arXiv · doi:10.48550/arxiv.1710.10196 · Cited by 4,727
On the Theory of the Brownian Motion
Uhlenbeck, G. E., & Ornstein, L. S. (1930) · Physical Review · doi:10.1103/physrev.36.823 · Cited by 4,482
Using collaborative filtering to weave an information tapestry
Goldberg, D., Nichols, D., Oki, B. M., & Terry, D. (1992) · Communications of the ACM · doi:10.1145/138859.138867 · Cited by 4,066
The MovieLens Datasets: History and Context
Harper, F. M., & Konstan, J. A. (2016) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/2827872 · Cited by 3,907
Hybrid Recommender Systems: Survey and Experiments
Burke, R. (2002) · User Modeling and User-Adapted Interaction · doi:10.1023/a:1021240730564 · Cited by 3,871
Resnick, P., & Varian, H. R. (1997) · Communications of the ACM · doi:10.1145/245108.245121 · Cited by 3,772
A Survey of Collaborative Filtering Techniques
Su, X., & Khoshgoftaar, T. M. (2009) · Advances in Artificial Intelligence · doi:10.1155/2009/421425 · Cited by 3,602
Deep Learning Based Recommender System: A Survey and New Perspectives
Zhang, S., Yao, L., Sun, A., & Tay, Y. (2020) · ACM Computing Surveys · doi:10.1145/3285029 · Cited by 3,485
Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning
Williams, R. J. (1992) · Machine Learning · doi:10.1007/bf00992696 · Cited by 3,416
Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environments
Lowe, R., Wu, Y., Tamar, A., Harb, J., Abbeel, P., & Mordatch, I. (2017) · arXiv · doi:10.48550/arxiv.1706.02275 · Cited by 3,377
Deep Reinforcement Learning with Double Q-Learning
Van Hasselt, H., Guez, A., & Silver, D. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10295 · Cited by 3,318
Dueling Network Architectures for Deep Reinforcement Learning
Wang, Z., Schaul, T., Hessel, M., van Hasselt, H., Lanctot, M., & de Freitas, N. (2015) · arXiv · doi:10.48550/arxiv.1511.06581 · Cited by 3,300
Deterministic Policy Gradient Algorithms
Silver, D., Lever, G., Heess, N., Degris, T., Wierstra, D., & Riedmiller, M. (2014) · HAL · Cited by 3,275
Neuronlike adaptive elements that can solve difficult learning control problems
Barto, A. G., Sutton, R. S., & Anderson, C. W. (1983) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1983.6313077 · Cited by 3,233
Collaborative Filtering for Implicit Feedback Datasets
Hu, Y., Koren, Y., & Volinsky, C. (2008) · 2008 Eighth IEEE International Conference on Data Mining · doi:10.1109/icdm.2008.22 · Cited by 3,170
Reinforcement learning in robotics: A survey
Kober, J., Bagnell, J. A., & Peters, J. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913495721 · Cited by 3,160
Bobadilla, J., Ortega, F., Hernando, A., & Gutiérrez, A. (2013) · Knowledge-Based Systems · doi:10.1016/j.knosys.2013.03.012 · Cited by 3,158
Schaul, T., Quan, J., Antonoglou, I., & Silver, D. (2015) · arXiv · doi:10.48550/arxiv.1511.05952 · Cited by 3,120
Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforcement learning
Sutton, R. S., Precup, D., & Singh, S. (1999) · Artificial Intelligence · doi:10.1016/s0004-3702(99)00052-1 · Cited by 3,119
A Survey of Monte Carlo Tree Search Methods
Browne, C. B., Powley, E., Whitehouse, D., Lucas, S. M., Cowling, P. I., Rohlfshagen, P., Tavener, S., Perez, D., Samothrakis, S., & Colton, S. (2012) · IEEE Transactions on Computational Intelligence and AI in Games · doi:10.1109/tciaig.2012.2186810 · Cited by 2,970
Content-Based Recommendation Systems
Pazzani, M. J., & Billsus, D. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-72079-9_10 · Cited by 2,600
A contextual-bandit approach to personalized news article recommendation
Li, L., Chu, W., Langford, J., & Schapire, R. E. (2010) · Proceedings of the 19th international conference on World wide web · doi:10.1145/1772690.1772758 · Cited by 2,562
Introduction to Recommender Systems Handbook
Ricci, F., Rokach, L., & Shapira, B. (2011) · Recommender Systems Handbook · doi:10.1007/978-0-387-85820-3_1 · Cited by 2,378
Generative adversarial imitation learning
Ho, J., & Ermon, S. (2016) · arXiv · doi:10.48550/arxiv.1606.03476 · Cited by 1,942
Content-based Recommender Systems: State of the Art and Trends
Lops, P., de Gemmis, M., & Semeraro, G. (2011) · Recommender Systems Handbook · doi:10.1007/978-0-387-85820-3_3 · Cited by 1,898
Recommender systems in e-commerce
Schafer, J. B., Konstan, J., & Riedl, J. (1999) · Proceedings of the 1st ACM conference on Electronic commerce · doi:10.1145/336992.337035 · Cited by 1,684
Subjectivity and Correlation in Randomized Strategies
Aumann, R. J. (1974) · Journal of Mathematical Economics · doi:10.1016/0304-4068(74)90037-8 · Cited by 1,630
Self-improving reactive agents based on reinforcement learning, planning and teaching
Lin, L.-J. (1992) · Machine Learning · doi:10.1007/bf00992699 · Cited by 1,564
On-line Q-learning Using Connectionist Systems
Rummery, G. A. (1994) · Cited by 1,477
Multi-Agent Reinforcement Learning: A Selective Overview of Theories and Algorithms
Zhang, K., Yang, Z., & Başar, T. (2021) · Studies in Systems, Decision and Control · doi:10.1007/978-3-030-60990-0_12 · Cited by 1,264
Facial Expression Analysis under Partial Occlusion: A Survey
Zhang, L., Verma, B., Tjondronegoro, D., & Chandran, V. (2019) · ACM Computing Surveys · doi:10.1145/3158369 · Cited by 1,258
Automatic personalization based on Web usage mining
Mobasher, B., Cooley, R., & Srivastava, J. (2000) · Communications of the ACM · doi:10.1145/345124.345169 · Cited by 1,223
Learning to Communicate with Deep Multi-Agent Reinforcement Learning
Foerster, J. N., Assael, Y. M., de Freitas, N., & Whiteson, S. (2016) · arXiv · doi:10.48550/arxiv.1605.06676 · Cited by 1,217
Saeed, M., Villarroel, M., Reisner, A. T., Clifford, G., Lehman, L.-W., Moody, G., Heldt, T., Kyaw, T. H., Moody, B., & Mark, R. G. (2011) · Critical Care Medicine · doi:10.1097/ccm.0b013e31820a92c6 · Cited by 1,162
(2015) · Journal of Machine Learning Research · Cited by 1,119
Imitation Learning: A Survey of Learning Methods
Hussein, A., Gaber, M. M., Elyan, E., & Jayne, C. (2018) · ACM Computing Surveys · doi:10.1145/3054912 · Cited by 1,060
Deep Reinforcement Learning framework for Autonomous Driving
Sallab, A. E., Abdou, M., Perot, E., & Yogamani, S. (2017) · Electronic Imaging · doi:10.2352/issn.2470-1173.2017.19.avm-023 · Cited by 1,045
Evolution Strategies as a Scalable Alternative to Reinforcement Learning
Salimans, T., Ho, J., Chen, X., Sidor, S., & Sutskever, I. (2017) · arXiv · doi:10.48550/arxiv.1703.03864 · Cited by 1,027 · cited 1×
“[145] uses evolution strategies [146] to optimize the recommendation policy.”
MethodRecent Advances in Hierarchical Reinforcement Learning
Barto, A. G., & Mahadevan, S. (2003) · Discrete Event Dynamic Systems · doi:10.1023/a:1022140919877 · Cited by 1,024
Bertin-Mahieux, T., Ellis, D. P. W., Whitman, B., & Lamere, P. (2011) · Columbia University · doi:10.7916/d8nz8j07 · Cited by 944
Aggarwal, C. C. (2016) · Springer eBooks · doi:10.1007/978-3-319-29659-3 · Cited by 931
Matrix capsules with EM routing
Hinton, G. E., Sabour, S., & Frosst, N. (2018) · International Conference on Learning Representations · Cited by 918
A systematic comparison and evaluation of biclustering methods for gene expression data
Prelić, A., Bleuler, S., Zimmermann, P., Wille, A., Bühlmann, P., Gruissem, W., Hennig, L., Thiele, L., & Zitzler, E. (2006) · Bioinformatics · doi:10.1093/bioinformatics/btl060 · Cited by 910
Recommender Systems: An Introduction
Jannach, D., Zanker, M., Felfernig, A., & Friedrich, G. (2010) · doi:10.1017/cbo9780511763113 · Cited by 886
Tree-Based Batch Mode Reinforcement Learning
Ernst, D., Geurts, P., & Wehenkel, L. A. (2005) · doi:10.5555/1046920.1088690 · Cited by 854
Research-paper recommender systems: a literature survey
Beel, J., Gipp, B., Langer, S., & Breitinger, C. (2016) · International Journal on Digital Libraries · doi:10.1007/s00799-015-0156-0 · Cited by 823
Shi, Y., Larson, M., & Hanjalic, A. (2014) · ACM Computing Surveys · doi:10.1145/2556270 · Cited by 806
Hierarchical Deep Reinforcement Learning: Integrating Temporal Abstraction and Intrinsic Motivation
Kulkarni, T. D., Narasimhan, K., Saeedi, A., & Tenenbaum, J. B. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1604.06057 · Cited by 770
Deep Reinforcement Learning: An Overview
Li, Y. (2017) · arXiv · doi:10.48550/arxiv.1701.07274 · Cited by 762
Explainable Recommendation: A Survey and New Perspectives
Zhang, Y., & Chen, X. (2020) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000066 · Cited by 755
Explainable Recommendation a survey and new perspectives
Zhang, Y., & Chen, X. (2020) · Cited by 689
Web Watcher: A Tour Guide for the World Wide Web.
Joachims, T., Freitag, D., & Mitchell, T. M. (1997) · Cited by 685
Shapley, L. S. (1953) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.39.10.1953 · Cited by 677
DRN: A Deep Reinforcement Learning Framework for News Recommendation
Zheng, G., Zhang, F., Zheng, Z., Xiang, Y., Yuan, N. J., Xie, X., & Li, Z. (2018) · Proceedings of the 2018 World Wide Web Conference on World Wide Web - WWW '18 · doi:10.1145/3178876.3185994 · Cited by 630
A Survey on Session-based Recommender Systems
Wang, S., Cao, L., Wang, Y., Sheng, Q. Z., Orgun, M. A., & Lian, D. (2022) · ACM Computing Surveys · doi:10.1145/3465401 · Cited by 570
Sequence-Aware Recommender Systems
Quadrana, M., Cremonesi, P., & Jannach, D. (2019) · ACM Computing Surveys · doi:10.1145/3190616 · Cited by 504
Is seeing believing?: how recommender system interfaces affect users' opinions
Cosley, D., Lam, S. K., Albert, I., Konstan, J. A., & Riedl, J. (2003) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/642611.642713 · Cited by 467
Fine-Grained Visual Comparisons with Local Learning
Yu, A., & Grauman, K. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.32 · Cited by 454
Data-efficient hierarchical reinforcement learning
Nachum, O., Gu, S., Lee, H., & Levine, S. (2018) · arXiv · doi:10.48550/arxiv.1805.08296 · Cited by 446
Deep reinforcement learning for page-wise recommendations
Zhao, X., Xia, L., Zhang, L., Ding, Z., Yin, D., & Tang, J. (2018) · Proceedings of the 12th ACM Conference on Recommender Systems · doi:10.1145/3240323.3240374 · Cited by 418
Guidelines for reinforcement learning in healthcare
Gottesman, O., Johansson, F., Komorowski, M., Faisal, A., Sontag, D., Doshi-Velez, F., & Celi, L. A. (2019) · Nature Medicine · doi:10.1038/s41591-018-0310-5 · Cited by 395
Top-K Off-Policy Correction for a REINFORCE Recommender System
Chen, M., Beutel, A., Covington, P., Jain, S., Belletti, F., & Chi, E. H. (2019) · Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining · doi:10.1145/3289600.3290999 · Cited by 393
Recommendations with Negative Feedback via Pairwise Deep Reinforcement Learning
Zhao, X., Zhang, L., Ding, Z., Xia, L., Tang, J., & Yin, D. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3219886 · Cited by 387
Conversational Recommender System
Sun, Y., & Zhang, Y. (2018) · The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval · doi:10.1145/3209978.3210002 · Cited by 378
News recommender systems – Survey and roads ahead
Karimi, M., Jannach, D., & Jugovac, M. (2018) · Information Processing & Management · doi:10.1016/j.ipm.2018.04.008 · Cited by 336
A Deep Reinforcement Learning Framework for the Financial Portfolio Management Problem
Jiang, Z., Xu, D., & Liang, J. (2017) · arXiv · doi:10.48550/arxiv.1706.10059 · Cited by 321 · cited 1×
“This made it possible to apply RL in problems with enormous state and action spaces, including self-driving cars [9, 10], robotics [11], industry automation [12], finance [13], healthcare [14, 15], and RSs.”
BackgroundMonte-Carlo Tree Search: A New Framework for Game AI
Chaslot, G., Bakkes, S., Szita, I., & Spronck, P. (2008) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v4i1.18700 · Cited by 312
Issues in Using Function Approximation for Reinforcement Learning
Thrun, S., & Schwartz, A. (1999) · Cited by 311
Reinforcement Learning in Large Discrete Action Spaces.Preprint
Dulac-Arnold, G., Evans, R., Sunehag, P., & Coppin, B. (2015) · arXiv (Cornell University) · Cited by 292
You, C., Lu, J., Filev, D., & Tsiotras, P. (2019) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2019.01.003 · Cited by 290
Deep Reinforcement Learning in Large Discrete Action Spaces
Dulac-Arnold, G., Evans, R., van Hasselt, H., Sunehag, P., Lillicrap, T., Hunt, J., Mann, T., Weber, T., Degris, T., & Coppin, B. (2015) · arXiv · doi:10.48550/arxiv.1512.07679 · Cited by 290
Collaborative Filtering Bandits
Li, S., Karatzoglou, A., & Gentile, C. (2016) · Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval · doi:10.1145/2911451.2911548 · Cited by 287
Towards End-to-End Reinforcement Learning of Dialogue Agents for Information Access
Dhingra, B., Li, L., Li, X., Gao, J., Chen, Y.-N., Ahmed, F., & Deng, L. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1045 · Cited by 272
Interactively optimizing information retrieval systems as a dueling bandits problem
Yue, Y., & Joachims, T. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553527 · Cited by 268
Improving recommender systems with adaptive conversational strategies
Mahmood, T., & Ricci, F. (2009) · Proceedings of the 20th ACM conference on Hypertext and hypermedia · doi:10.1145/1557914.1557930 · Cited by 259
Recommender Systems Leveraging Multimedia Content
Deldjoo, Y., Schedl, M., Cremonesi, P., & Pasi, G. (2021) · ACM Computing Surveys · doi:10.1145/3407190 · Cited by 258
Lei, W., He, X., Miao, Y., Wu, Q., Hong, R., Kan, M.-Y., & Chua, T.-S. (2020) · Proceedings of the 13th International Conference on Web Search and Data Mining · doi:10.1145/3336191.3371769 · Cited by 253
Reinforcement Learning to Optimize Long-term User Engagement in Recommender Systems
Zou, L., Xia, L., Ding, Z., Song, J., Liu, W., & Yin, D. (2019) · Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3292500.3330668 · Cited by 247
Virtual-Taobao: Virtualizing Real-World Online Retail Environment for Reinforcement Learning
Shi, J.-C., Yu, Y., Da, Q., Chen, S., & Zeng, A. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33014902 · Cited by 237
Deep Reinforcement Learning for List-wise RecommendationsPreprint
Zhao, X., Zhang, L., Xia, L., Ding, Z., Yin, D., & Tang, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.00209 · Cited by 224
Supervised Reinforcement Learning with Recurrent Neural Network for Dynamic Treatment Recommendation
Wang, L., Zhang, W., He, X., & Zha, H. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3219961 · Cited by 223
Reinforcement Learning for Spoken Dialogue Systems
Singh, S. P., Kearns, M. J., Litman, D. J., & Walker, M. A. (1999) · Cited by 222
Self-Supervised Reinforcement Learning for Recommender Systems
Xin, X., Karatzoglou, A., Arapakis, I., & Jose, J. M. (2020) · Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3397271.3401147 · Cited by 219
Deep Reinforcement Learning for Sepsis TreatmentPreprint
Raghu, A., Komorowski, M., Ahmed, I., Celi, L. A., Szolovits, P., & Ghassemi, M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.09602 · Cited by 217
RecSim: A Configurable Simulation Platform for Recommender SystemsPreprint
Ie, E., Hsu, C., Mladenov, M., Jain, V., Narvekar, S., Wang, J., Wu, R., & Boutilier, C. E. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.04847 · Cited by 217
Reinforcement Learning Strategies for Clinical Trials in Nonsmall Cell Lung Cancer
Zhao, Y., Zeng, D., Socinski, M. A., & Kosorok, M. R. (2011) · Biometrics · doi:10.1111/j.1541-0420.2011.01572.x · Cited by 208
Informing sequential clinical decision-making through reinforcement learning: an empirical study
Shortreed, S. M., Laber, E., Lizotte, D. J., Stroup, T. S., Pineau, J., & Murphy, S. A. (2011) · Machine Learning · doi:10.1007/s10994-010-5229-0 · Cited by 196
Optimal medication dosing from suboptimal clinical examples: a deep reinforcement learning approach
Nemati, S., Ghassemi, M. M., & Clifford, G. D. (2016) · 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2016.7591355 · Cited by 195
Towards Long-term Fairness in Recommendation
Ge, Y., Liu, S., Gao, R., Xian, Y., Li, Y., Zhao, X., Pei, C., Sun, F., Ge, J., Ou, W., et al. (2021) · Proceedings of the 14th ACM International Conference on Web Search and Data Mining · doi:10.1145/3437963.3441824 · Cited by 190
Ionides, E. L. (2008) · Journal of Computational and Graphical Statistics · doi:10.1198/106186008x320456 · Cited by 188
High-Confidence Off-Policy Evaluation
Thomas, P. S., Theocharous, G., & Ghavamzadeh, M. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9541 · Cited by 177
A hybrid approach for movie recommendation
Lekakos, G., & Caravelas, P. (2008) · Multimedia Tools and Applications · doi:10.1007/s11042-006-0082-7 · Cited by 176
Klašnja-Milićević, A., Ivanović, M., & Nanopoulos, A. (2015) · Artificial Intelligence Review · doi:10.1007/s10462-015-9440-z · Cited by 173
Large-Scale Interactive Recommendation with Tree-Structured Policy Gradient
Chen, H., Dai, X., Cai, H., Zhang, W., Wang, X., Tang, R., Zhang, Y., & Yu, Y. H. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33013312 · Cited by 171
Rohde, D., Bonner, S., Dunlop, T., Vasile, F., & Karatzoglou, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.00720 · Cited by 167
Interactive Recommender System via Knowledge Graph-enhanced Reinforcement Learning
Zhou, S., Dai, X., Chen, H., Zhang, W., Ren, K., Tang, R., He, X., & Yu, Y. (2020) · Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3397271.3401174 · Cited by 166
Zhao, X., Xia, L., Tang, J., & Yin, D. (2019) · ACM SIGWEB Newsletter · doi:10.1145/3320496.3320500 · Cited by 165
A Reinforcement Learning Framework for Explainable Recommendation
Wang, X., Chen, Y., Yang, J., Wu, L., Wu, Z., & Xie, X. (2018) · 2018 IEEE International Conference on Data Mining (ICDM) · doi:10.1109/icdm.2018.00074 · Cited by 163
Effective explanations of recommendations: user-centered design
Tintarev, N., & Masthoff, J. (2007) · Proceedings of the 2007 ACM conference on Recommender systems · doi:10.1145/1297231.1297259 · Cited by 161
Jing, H., & Smola, A. J. (2017) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3018661.3018719 · Cited by 161
Reinforced Negative Sampling over Knowledge Graph for Recommendation
Wang, X., Xu, Y., He, X., Cao, Y., Wang, M., & Chua, T.-S. (2020) · Proceedings of The Web Conference 2020 · doi:10.1145/3366423.3380098 · Cited by 160
Horizon: Facebook's Open Source Applied Reinforcement Learning PlatformPreprint
Gauci, J., Conti, E., Liang, Y., Virochsiri, K., He, Y., Kaden, Z., Narayanan, V., Ye, X., Chen, Z., & Fujimoto, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.00260 · Cited by 157
Reinforced negative sampling over knowledge graph for recommendation
Wang, X., XU, Y., He, X., Cao, Y., Wang, M., & Chua, T. (2020) · Singapore Management University Institutional Knowledge (InK) (Singapore Management University) · Cited by 154
Deep Reinforcement Learning based Recommendation with Explicit User-Item Interactions ModelingPreprint
Liu, F., Tang, R., Li, X., Zhang, W., Ye, Y., Chen, H., Guo, H., & Zhang, Y. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.12027 · Cited by 143
Pseudo Dyna-Q: A Reinforcement Learning Framework for Interactive Recommendation
Zou, L., Xia, L., Du, P., Zhang, Z., Bai, T., Liu, W., Nie, J., & Yin, D. (2020) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3336191.3371801 · Cited by 142
Stabilizing Reinforcement Learning in Dynamic Environment with Application to Online Recommendation
Chen, S., Yu, Y., Da, Q., Tan, J. Z., Huang, H., & Tang, H.-H. (2018) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3219819.3220122 · Cited by 140
Unified Conversational Recommendation Policy Learning via Graph-based Reinforcement Learning
Deng, Y., Li, Y., Sun, F., Ding, B., & Lam, W. (2021) · Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3404835.3462913 · Cited by 136
KERL: A Knowledge-Guided Reinforcement Learning Model for Sequential Recommendation
Wang, P., Yu, F., Xia, L., Zhao, W. X., Niu, S., & Huang, J. X. (2020) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3397271.3401134 · Cited by 125
MovieTweetings: a movie rating dataset collected from twitter
Dooms, S., Pessemier, T. D., & Martens, L. (2013) · Ghent University Academic Bibliography (Ghent University) · Cited by 119
Using Temporal Data for Making RecommendationsPreprint
Zimdars, A. L., Chickering, D. M., & Meek, C. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1301.2320 · Cited by 116
Leveraging Demonstrations for Reinforcement Recommendation Reasoning over Knowledge Graphs
Zhao, K., Wang, X., Zhang, Y., Li, Z., Liu, Z., Xing, C., & Xie, X. (2020) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3397271.3401171 · Cited by 114
Intelligent Electric Vehicle Charging Recommendation Based on Multi-Agent Reinforcement Learning
Zhang, W., Liu, H., Wang, F., Xu, T., Xin, H., Dou, D., & Xiong, H. (2021) · International World Wide Web Conference (WWW) · doi:10.1145/3442381.3449934 · Cited by 110
Learning and adaptivity in interactive recommender systems
Mahmood, T., & Ricci⋆, F. (2007) · International Conference on Electronic Commerce · doi:10.1145/1282100.1282114 · Cited by 105
Jointly Learning to Recommend and Advertise
Zhao, X., Zheng, X., Yang, X., Liu, X., & Tang, J. (2020) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3394486.3403384 · Cited by 97
FEXIPRO: Fast and Exact Inner Product Retrieval in Recommender Systems
Li, H., Chan, T. N., Yiu, M. L., & Mamoulis, N. (2017) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/3035918.3064009 · Cited by 96
Ie, E., Jain, V., Wang, J., Narvekar, S., Agarwal, R., Wu, R., Cheng, H.-T., Lustman, M., Gatto, V., Covington, P., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.12767 · Cited by 96
Value-aware Recommendation based on Reinforcement Profit Maximization
Pei, C., Yang, X., Cui, Q., Lin, X., Sun, F., Jiang, P., Ou, W., & Zhang, Y. (2019) · International World Wide Web Conference (WWW) · doi:10.1145/3308558.3313404 · Cited by 94
Adaptive course recommendation in MOOCs
Lin, Y., Feng, S., Lin, F., Zeng, W., Liu, Y., & Wu, P. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.107085 · Cited by 91
Zhao, X., Xia, L., Zou, L., Liu, H., Yin, D., & Tang, J. (2020) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3340531.3412044 · Cited by 90
Off-policy Learning in Two-stage Recommender Systems
Ma, J., Zhao, Z., Yi, X., Yang, J. H., Chen, M., Tang, J., Hong, L., & Ed, H. (2020) · International World Wide Web Conference (WWW) · doi:10.1145/3366423.3380130 · Cited by 85
Usage-based web recommendations
Taghipour, N., Kardan, A. A., & Ghidary, S. S. (2007) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/1297231.1297250 · Cited by 84
Motion Planning for Industrial Robots using Reinforcement Learning
Meyes, R., Tercan, H., Roggendorf, S., Thiele, T., Büscher, C., Obdenbusch, M., Brecher, C., Jeschke, S., & Meisen, T. (2017) · Procedia CIRP · doi:10.1016/j.procir.2017.03.095 · Cited by 84
A systematic literature review on Health Recommender Systems
Sezgın, E., & Özkan, S. (2013) · E-Health and Bioengineering Conference (EHB) · doi:10.1109/ehb.2013.6707249 · Cited by 81
State representation modeling for deep reinforcement learning based recommendation
Liu, F., Tang, R., Li, X., Zhang, W., Ye, Y., Chen, H., Guo, H., Zhang, Y., & He, X. (2020) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.106170 · Cited by 80
A hybrid web recommender system based on Q-learning
Taghipour, N., & Kardan, A. A. (2008) · ACM Symposium on Applied Computing · doi:10.1145/1363686.1363954 · Cited by 79
Wei, P., Xia, S., Chen, R., Qian, J., Li, C., & Jiang, X. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2974848 · Cited by 78
Adaptive treatment of epilepsy via batch-mode reinforcement learning
Guez, A., Vincent, R. D., Avoli, M., & Pineau, J. (2008) · Cited by 76
Personalized ad recommendation systems for life-time value optimization with guarantees
Theocharous, G., Thomas, P. S., & Ghavamzadeh, M. (2015) · International Conference on Artificial Intelligence · Cited by 74
Enhancing Navigation on Wikipedia with Social TagsPreprint
Zubiaga, A. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1202.5469 · Cited by 73
DJ-MC: A Reinforcement-Learning Agent for Music Playlist RecommendationPreprint
Liebman, E., Saar‐Tsechansky, M., & Stone, P. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1401.1880 · Cited by 72
Supervised Actor-Critic Reinforcement Learning
Rosenstein, M. T., Barto, A. G., Si, J., Barto, A., Powell, W. B., & Wunsch, D. C. (2012) · doi:10.1002/9780470544785.ch14 · Cited by 67
Trust Building in Recommender Agents
Chen, L., & Pu, P. (2005) · doi:10.5220/0001422901350145 · Cited by 67
Demand-Aware Career Path Recommendations: A Reinforcement Learning Approach
Kokkodis, M., & Ipeirotis, P. G. (2020) · Management Science · doi:10.1287/mnsc.2020.3727 · Cited by 67
Multi-modal Knowledge-aware Reinforcement Learning Network for Explainable Recommendation
Tao, S., Qiu, R., Ping, Y., & Ma, H. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.107217 · Cited by 66
Model-Based Reinforcement Learning with Adversarial Training for Online RecommendationPreprint
Bai, X., Guan, J., & Wang, H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.03845 · Cited by 65
Spatio-temporal feature fusion for dynamic taxi route recommendation via deep reinforcement learning
Ji, S., Wang, Z., Li, T., & Zheng, Y. (2020) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.106302 · Cited by 65
Huang, J., Oosterhuis, H., de Rijke, M., & van Hoof, H. (2020) · Fourteenth ACM Conference on Recommender Systems · doi:10.1145/3383313.3412252 · Cited by 64
Mobile Multimedia Recommendation in Smart Communities: A Survey
Xia, F., Asabere, N. Y., Ahmed, A. M., Li, J., & Kong, X. (2013) · IEEE Access · doi:10.1109/access.2013.2281156 · Cited by 61
Personalized web-document filtering using reinforcement learning
Zhang, B., & Seo, Y. (2001) · Applied Artificial Intelligence · doi:10.1080/088395101750363993 · Cited by 60
CRSAL: Conversational Recommender Systems with Adversarial Learning
Ren, X., Yin, H., Chen, T., Wang, H., Nguyen, Q. V. H., Huang, Z. H., & Zhang, X. (2020) · ACM Transactions on Information Systems · doi:10.1145/3394592 · Cited by 58
A Benchmarking Environment for Reinforcement Learning Based Task Oriented Dialogue ManagementPreprint
Casanueva, I., Budzianowski, P., Su, P.-H., Mrkšić, N., Wen, T.-H., Ultes, S., Rojas-Barahona, L. M., Young, S. J., & Gašić, M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.11023 · Cited by 57
User Response Models to Improve a REINFORCE Recommender System
Chen, M., Chang, B., Xu, C., & Ed, H. (2021) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3437963.3441764 · Cited by 56
Towards Smart Educational Recommendations with Reinforcement Learning in Classroom
Su, L., Chen, Y., Huang, H., Xiao, L., & Hei, X. (2018) · IEEE International Conference on Teaching, Assessment, and Learning for Engineering · doi:10.1109/tale.2018.8615217 · Cited by 55
Sunehag, P., Evans, R., Dulac-Arnold, G., Zwólš, Y., Visentin, D., & Coppin, B. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1512.01124 · Cited by 53
Deep Reinforcement Learning Framework for Category-Based Item Recommendation
Fu, M., Agrawal, A., Irissappane, A. A., Zhang, J., Huang, L., & Qu, H. (2021) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2021.3089941 · Cited by 52
Liu, D., & Yang, C. (2019) · IEEE Access · doi:10.1109/access.2019.2925019 · Cited by 50
Interactive Recommendation with User-Specific Deep Reinforcement Learning
Lei, Y., & Li, W. (2019) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3359554 · Cited by 47
Reinforcement learning architecture for Web recommendations
Golovin, N., & Rahm, E. (2004) · International Conference on Information Technology: Coding and Computing (ITCC) · doi:10.1109/itcc.2004.1286487 · Cited by 46
End-to-End Deep Reinforcement Learning based Recommendation with Supervised Embedding
Liu, F., Guo, H., Li, X., Tang, R., Ye, Y., & He, X. (2020) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3336191.3371858 · Cited by 44
MaHRL: Multi-goals Abstraction Based Deep Hierarchical Reinforcement Learning for Recommendations
Zhao, D., Zhang, L., Zhang, B., Zheng, L., Bao, Y., & Yan, W. (2020) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3397271.3401170 · Cited by 43
Reinforcement Learning based Recommendation with Graph Convolutional Q-network
Lei, Y., Pei, H., Yan, H., & Li, W. (2020) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3397271.3401237 · Cited by 42
Learning more effective dialogue strategies using limited dialogue move features
Frampton, M., & Lemon, O. (2006) · doi:10.3115/1220175.1220199 · Cited by 41
Dynamic Scholarly Collaborator Recommendation via Competitive Multi-Agent Reinforcement Learning
Zhang, Y., Zhang, C., & Liu, X. (2017) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/3109859.3109914 · Cited by 38
Deep reinforcement learning for recommender systems
Munemasa, I., Tomomatsu, Y., Hayashi, K., & Takagi, T. (2018) · International Conference on Information and Communications Technology (ICOIACT) · doi:10.1109/icoiact.2018.8350761 · Cited by 37
REINFORCEMENT LEARNING AND DYNAMIC PROGRAMMING
Barto, A. G. (1995) · IFAC Proceedings Volumes · doi:10.1016/s1474-6670(17)45266-9 · Cited by 36
Learning users' interests by quality classification in market-based recommender systems
Wei, Y. Z., Moreau, L., & Jennings, N. R. (2005) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2005.200 · Cited by 35
Balancing Between Accuracy and Fairness for Interactive Recommendation with Reinforcement Learning
Liu, W., Liu, F., Tang, R., Liao, B., Chen, G., & Heng, P. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-47426-3_13 · Cited by 32
He, X. D., An, B., Li, Y., Chen, H., Wang, R., Wang, X., Yu, R., Li, X., & Wang, Z. (2020) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/3383313.3412233 · Cited by 32
Dynamic personalization in conversational recommender systems
Mahmood, T., Mujtaba, G., & Venturini, A. (2013) · Information Systems and e-Business Management · doi:10.1007/s10257-013-0222-3 · Cited by 31
Vision-Language Recommendation via Attribute Augmented Multimodal Reinforcement Learning
Yu, T., Shen, Y., Zhang, R., Zeng, X., & Jin, H. (2019) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3343031.3350935 · Cited by 30
A Reinforcement Learning Approach to Emotion-based Automatic Playlist Generation
Chi, C.-Y., Tsai, R. T., Lai, J.-Y., & Hsu, J. Y.-J. (2010) · Conference on Technologies and Applications of Artificial Intelligence (TAAI) · doi:10.1109/taai.2010.21 · Cited by 29
Reinforcement Learning to Diversify Top-N Recommendation
Zou, L., Xia, L., Ding, Z., Yin, D., Song, J., & Liu, W. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-18579-4_7 · Cited by 28
Toward Simulating Environments in Reinforcement Learning Based RecommendationsPreprint
Zhao, X., Xia, L., Zou, L., Yin, D., & Tang, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.11462 · Cited by 28
Reinforcement Learning with a Disentangled Universal Value Function for Item Recommendation
Wang, K., Zou, Z., Deng, Q., Tao, J., Wu, R., Fan, C., Chen, L., & Cui, P. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i5.16569 · Cited by 27
Shi, B., Özsoy, M. G., Hurley, N., Smyth, B., Τράγος, Η., Geraci, J. R., & Lawlor, A. (2019) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/3298689.3346981 · Cited by 26
Social Attentive Deep Q-Networks for Recommender Systems
Lei, Y., Wang, Z., Li, W., Pei, H., & Dai, Q. (2020) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.3012346 · Cited by 25
Top-aware reinforcement learning based recommendation
Liu, F., Tang, R., Guo, H., Li, X., Ye, Y., & He, X. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.07.057 · Cited by 24
A Hybrid Recommendation for Music Based on Reinforcement Learning
Wang, Y. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-47426-3_8 · Cited by 23
Liang, H. (2020) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.2998695 · Cited by 23
Value Penalized Q-Learning for Recommender Systems
Gao, C., Xu, K., Zhou, K., Li, L., Wang, X., Yuan, B., & Zhao, P. (2022) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3477495.3531796 · Cited by 22
Reinforcement Learning for Online Learning Recommendation System
Intayoad, W., Kamyod, C., & Temdee, P. (2018) · Global Wireless Summit (GWS) · doi:10.1109/gws.2018.8686513 · Cited by 16
Reinforcement Learning for Personalized Dialogue Management
den Hengst, F., Hoogendoorn, M., van Harmelen, F., & Bosman, J. (2019) · IEEE/WIC/ACM International Conference on Web Intelligence · doi:10.1145/3350546.3352501 · Cited by 15
Fotopoulou, E., Zafeiropoulos, A., Feidakis, M., Metafas, D., & Papavassiliou, S. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-49663-0_29 · Cited by 15
The power of words: Enhancing music mood estimation with textual input of lyrics
Chi, C.-Y., Wu, Y.-S., Chu, W. R., Wu, D. C., Hsu, J. Y.-J., & Tsai, R. T. (2009) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2009.5349591 · Cited by 13
Optimizing Ranking Algorithm in Recommender System via Deep Reinforcement Learning
Han, J., Yu, Y. H., Liu, F., Tang, R., & Zhang, Y. (2019) · International Conference on Artificial Intelligence and Advanced Manufacture (AIAM) · doi:10.1109/aiam48774.2019.00011 · Cited by 11
Personalized project recommendations: using reinforcement learning
Faxin, Q., Tong, X., Lei, Y., & Wang, Y. (2019) · EURASIP Journal on Wireless Communications and Networking · doi:10.1186/s13638-019-1619-6 · Cited by 10
Analysis, Design and Evaluation of Man–Machine Systems 1995
(1995) · Elsevier eBooks · doi:10.1016/c2009-0-00265-7 · Cited by 9
Deep Reinforcement Learning for Personalized Search Story RecommendationPreprint
Jason, J., Zhang, Yin, J., Lee, D., & Zhu, L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.11754 · Cited by 3
A Load Balanced Recommendation ApproachPreprint
Afsar, M., Crump, T., & Far, B. H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.09981 · Cited by 2
Self-citationSample Efficiency in Deep Reinforcement Learning based Recommender Systems with Imitation Learning
Afsar, M. M., Crump, T., & Far, B. H. (2022) · doi:10.21428/594757db.6a36bb36 · Cited by 2
Self-citationGenerative Adversarial User Model for Reinforcement Learning Based Recommendation System
Chen, X., Li, S., Li, H., Jiang, S., Qi, Y., & Song, L. (2018) · arXiv · doi:10.48550/arxiv.1812.10613
Cited by
Reinforcement learning algorithms: A brief survey
Shakya, A. K., Pillai, G., & Chakrabarty, S. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.120495 · Cited by 656
Recommender Systems in the Era of Large Language Models (LLMs)
Zhao, Z., Fan, W., Li, J., Liu, Y., Mei, X., Wang, Y., Wen, Z., Wang, F., Zhao, X., Tang, J., et al. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3392335 · Cited by 481
Advances and challenges in conversational recommender systems: A survey
Gao, C., Lei, W., He, X., de Rijke, M., & Chua, T.-S. (2021) · AI Open · doi:10.1016/j.aiopen.2021.06.002 · Cited by 337
Harms from Increasingly Agentic Algorithmic Systems
Chan, A., Salganik, R., Markelius, A., Pang, C., Rajkumar, N., Krasheninnikov, D., Langosco, L., He, Z., Duan, Y., Carroll, M., et al. (2023) · 2023 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3593013.3594033 · Cited by 149
“Additionally, there has been an increasing amount of research in recommender systems to optimize long-term metrics such as engagement via reinforcement learning [Afsar et al. 2022].”
BackgroundA multifaceted vision of the human-AI collaboration: a comprehensive review
Puerta-Beldarrain, M., Gómez-Carmona, O., Sánchez-Corcuera, R., Casado-Mansilla, D., López-de-Ipiña, D., & Chen, L. (2025) · IEEE Access · doi:10.1109/access.2025.3536095 · Cited by 73
Metadata
- Authors
- Afsar, M. M., Crump, T., & Far, B.
- Venue
- ACM Computing Surveys
- Published
- 2022-12-15
- Volume
- 55
- Issue
- 7
- Pages
- 1-38
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W3123348991
- Cited by
- 502
- References
- 199
- FWCI
- 101.42
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.