The DOI matches its DataCite record; 19 of the 19 references it cites were found in a registry or an index.
Thinking Fast and Slow with Deep Learning and Tree Search
Open accessAbstract
Sequential decision making problems, such as structured prediction, robotic control, and game playing, require a combination of planning policies and generalisation of those plans. In this paper, we present Expert Iteration (ExIt), a novel reinforcement learning algorithm which decomposes the problem into separate planning and generalisation tasks. Planning new policies is performed by tree search, while a deep neural network generalises those plans. Subsequently, tree search is improved by using the neural network policy to guide search, increasing the strength of new plans. In contrast, standard deep Reinforcement Learning algorithms rely on a neural network not only to generalise plans, but to discover them too. We show that ExIt outperforms REINFORCE for training a neural network to play the board game Hex, and our final tree search agent, trained tabula rasa, defeats MoHex 1.0, the most recent Olympiad Champion player to be publicly released.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Generational methods that do exist, such as iterated policy distillation [Schmitt et al., 2018, Stooke et al., 2022] and expert iteration [Anthony et al., 2017], explicitly optimise new generations with hand-crafted and explicit imitation learning techniques, as opposed to learning accumulation implicitly, which should ultimately enable greater flexibility.”
From Artificial Generational Intelligence: Cultural Accumulation in Reinforcement Learning (2024) · cites this paper as Anthony et al., 2017
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Mastering the game of Go without human knowledge
Silver, D., Schrittwieser, J., Simonyan, K., Antonoglou, I., Huang, A., Guez, A., Hubert, T., Baker, L., Lai, M., Bolton, A., et al. (2017) · Nature · doi:10.1038/nature24270 · Cited by 9,084
Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning
Williams, R. J. (1992) · Machine Learning · doi:10.1007/bf00992696 · Cited by 8,608
Maps of Bounded Rationality: Psychology for Behavioral Economics
Kahneman, D. (2003) · American Economic Review · doi:10.1257/000282803322655392 · Cited by 5,377
Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)
Clevert, D.-A., Unterthiner, T., & Hochreiter, S. (2015) · arXiv · doi:10.48550/arxiv.1511.07289 · Cited by 4,513
Bandit Based Monte-Carlo Planning
Kocsis, L., & Szepesvari, C. (2006) · European Conference on Machine Learning · doi:10.1007/11871842_29 · Cited by 4,144
A Reduction of Imitation Learning and Structured Prediction to No-Regret Online Learning
Ross, S., Gordon, G. J., & Bagnell, J. A. (2018) · Carnegie Mellon University · doi:10.1184/r1/6550949 · Cited by 1,941
Heuristic and analytic processes in reasoning*
Evans, J. S. B. T. (1984) · British Journal of Psychology · doi:10.1111/j.2044-8295.1984.tb01915.x · Cited by 619
Research works printed but not linked: 2
- [11][11] X. Guo, S. Singh, H. Lee, R. L. Lewis, and X. Wang. Deep Learning for Real-Time Atari Game Play Using Offline Monte-Carlo Rree Search Planning. In Advances in Neural Information Processing Systems , pages 3338-3346, 2014. -
- [15][15] S. Ross and J. A. Bagnell. Reinforcement and Imitation Learning via Interactive No-Regret Learning. ArXiv e-prints , 2014. -
Cited by
Sorted by citations
Items 101–200 of 200
Monte-Carlo Planning and Learning with Language Action Value Estimates
Jang, Y., Seo, S., Lee, J., & Kim, K.-E. (2021) · Cited by 8
A Neural-Symbolic Approach to Natural Language Understanding
Liu, Z., Wang, Z., Lin, Y., & Li, H. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.158 · Cited by 15
Re-determinizing MCTS in Hanabi
Goodman, J. (2019) · IEEE Conference on Games (CoG) · doi:10.1109/cig.2019.8848097 · Cited by 8
Value targets in off-policy AlphaZero: a new greedy backup
Willemsen, D., Baier, H., & Kaisers, M. (2021) · Neural Computing and Applications · doi:10.1007/s00521-021-05928-5 · Cited by 7
Adaptive Online Planning for Continual Lifelong LearningPreprint
Lu, K., Mordatch, I., & Abbeel, P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.01188 · Cited by 10
Plan2Vec: Unsupervised Representation Learning by Latent PlansPreprint
Yang, G., Zhang, A., Morcos, A. S., Pineau, J., Abbeel, P., & Calandra, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.03648 · Cited by 8
Human-Agent Cooperation in Bridge BiddingPreprint
Lockhart, E., BURCH, N. R., Bard, N., Borgeaud, S., Eccles, T., Smaira, L., & Smith, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.14124 · Cited by 8
Blending MPC & Value Function Approximation for Efficient Reinforcement LearningPreprint
Bhardwaj, M., Choudhury, S., & Boots, B. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.05909 · Cited by 21
Synergising Human-like Responses and Machine Intelligence for Planning in Disaster Response
Papaioannou, S., Kolios, P., Panayiotou, C. G., & Polycarpou, M. M. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10651466 · Cited by 7
Scalable Online Planning for Multi-Agent MDPs
Choudhury, S., Gupta, J. K., Morales, P., & Kochenderfer, M. J. (2022) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.13261 · Cited by 7
A selected review of reinforcement learning-based control for autonomous underwater vehicles
You, K., Wu, H., Hsu, Y.-C., & Song, S. (2020) · Scientia Sinica Informationis · doi:10.1360/ssi-2020-0065 · Cited by 8
The Role of Entropy in Guiding a Connection Prover
Zombori, Z., Urban, J., & Olšák, M. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-86059-2_13 · Cited by 7
Robots Thinking Fast and Slow: On Dual Process Theory and Metacognition in Embodied AI
Posner, I. (2020) · Cited by 7
Evolutionarily-Curated Curriculum Learning for Deep Reinforcement Learning AgentsPreprint
Green, M. C., Sergent, B., Shandilya, P., & Kumar, V. (2019) · arXiv.org · doi:10.48550/arxiv.1901.05431 · Cited by 8
Think Too Fast Nor Too Slow: The Computational Trade-off Between Planning And Reinforcement LearningPreprint
Moerland, T. M., Deichler, A., Baldi, S., Broekens, J., & Jonker, C. M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.07404 · Cited by 7
Scaling Scaling Laws with Board Games
Jones, A. L. (2021) · arXiv · doi:10.48550/arxiv.2104.03113 · Cited by 7
Artificial Generational Intelligence: Cultural Accumulation in Reinforcement Learning
Cook, J., Lu, C., Hughes, E., Leibo, J. Z., & Foerster, J. (2024) · arXiv · doi:10.48550/arxiv.2406.00392 · Cited by 6
“Generational methods that do exist, such as iterated policy distillation [Schmitt et al., 2018, Stooke et al., 2022] and expert iteration [Anthony et al., 2017], explicitly optimise new generations with hand-crafted and explicit imitation learning techniques, as opposed to learning accumulation…”
MethodValue-based Search in Execution Space for Mapping Instructions to Programs
Muhlgay, D., Herzig, J., & Berant, J. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1193 · Cited by 6
Towered Actor Critic For Handling Multiple Action Types In Reinforcement Learning For Drug Discovery
Gottipati, S. K., Pathak, Y., Sattarov, B., Sahir, Nuttall, R., Amini, M., Taylor, M. E., & Chandar, S. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i1.16087 · Cited by 7
Solving the capacitated vehicle routing problem with timing windows using rollouts and MAX-SAT
Khadilkar, H. (2022) · Indian Control Conference · doi:10.1109/icc56513.2022.10093678 · Cited by 6
Learning Policies from Self-Play with Policy Gradients and MCTS Value Estimates
Soemers, D. J. N. J., Piette, É., Stephenson, M., & Browne, C. (2019) · IEEE Conference on Games (CoG) · doi:10.1109/cig.2019.8848037 · Cited by 8
Solving PBQP-Based Register Allocation using Deep Reinforcement Learning
Kim, M., Park, J.-K., & Moon, S. (2022) · Proceedings of the CGO/Proceedings of the ... CGO · doi:10.1109/cgo53902.2022.9741272 · Cited by 7
Active Reinforcement Learning with Monte-Carlo Tree SearchPreprint
Schulze, S., & Evans, O. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.04926 · Cited by 17
Uncertainty-sensitive Learning and Planning with EnsemblesPreprint
Miłoś, P., Kuciński, Ł., Czechowski, K., Kozakowski, P., & Klimek, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.09996 · Cited by 6
Local Search for Policy Iteration in Continuous ControlPreprint
Springenberg, J. T., Heess, N., Mankowitz, D. J., Merel, J., Byravan, A., Abdolmaleki, A., Kay, J., Degrave, J., Schrittwieser, J., Tassa, Y., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.05545 · Cited by 6
Self-Improved Retrosynthetic PlanningPreprint
Kim, J., Ahn, S. S., Lee, H., & Shin, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.04880 · Cited by 15
Lizarraga, A., Honig, E., & Wu, Y. N. (2025) · Wiley Interdisciplinary Reviews Computational Statistics · doi:10.1002/wics.70035 · Cited by 10
A Neural Divide-and-Conquer Reasoning Framework for Image Retrieval from Linguistically Complex Text
Li, Y., Hu, B., Ding, Y., Ma, L., & Zhang, M. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.909 · Cited by 7
Interleaving Fast and Slow Decision Making
Gulati, A., Soni, S., & Rao, S. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9561562 · Cited by 5
Project Thyia: A Forever Gameplayer
Gaina, R. D., Lucas, S. M., & Pérez-Liébana, D. (2019) · IEEE Conference on Games (CoG) · doi:10.1109/cig.2019.8848047 · Cited by 7
Exploiting Bias for Cooperative Planning in Multi-Agent Tree Search
Ma, A., Ouimet, M., & Cortés, J. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.2969937 · Cited by 5
Sampling Algorithms Combination with Machine Learning for Efficient Safe Trajectory Planning
Chaulwar, A. T. (2021) · International Journal of Machine Learning and Computing · doi:10.18178/ijmlc.2021.11.1.1007 · Cited by 5
Safer Deep RL with Shallow MCTS: A Case Study in PommermanPreprint
Kartal, B., Hernández-Leal, P., Gao, C., & Taylor, M. E. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.05759 · Cited by 7
First-Order Problem Solving through Neural MCTS based Reinforcement LearningPreprint
Xu, R., Kadam, P., & Lieberherr, K. J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.04167 · Cited by 7
Transfer of Fully Convolutional Policy-Value Networks Between Games and Game VariantsPreprint
Soemers, D. J. N. J., Mella, V., Piette, É., Stephenson, M., Browne, C., & Teytaud, O. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.12375 · Cited by 11
Integrating symbolic reasoning into neural generative models for design generation
Jacobson, M. J., & Xue, Y. (2024) · Artificial Intelligence · doi:10.1016/j.artint.2024.104257 · Cited by 10
The Sharer’s Dilemma in Collective Adaptive Systems of Self-interested Agents
Belzner, L., Schmid, K., Phan, T., Gabor, T., & Wirsing, M. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-03424-5_16 · Cited by 4
Extracting tactics learned from self-play in general games
Soemers, D. J. N. J., Samothrakis, S., Piette, É., & Stephenson, M. (2022) · Information Sciences · doi:10.1016/j.ins.2022.12.080 · Cited by 6
Sun, Z., Zhou, Y., Hao, J., Fan, X., Lu, Y., Ma, C., Shen, W., & Guo, C. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-industry.41 · Cited by 4
Climbing the Ladder: How Agents Reach Counterfactual Thinking
Moruzzi, C. (2022) · International Conference on Agents and Artificial Intelligence · doi:10.5220/0010857900003116 · Cited by 3
Learning to Play Two-Player Perfect-Information Games without KnowledgePreprint
Cohen-Solal, Q. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.01188 · Cited by 17
Hedging of financial derivative contracts via Monte Carlo tree search
Szehr, O. (2023) · The Journal of Computational Finance · doi:10.21314/jcf.2023.009 · Cited by 3
Model-Based Reinforcement Learning
Plaat, A. (2022) · Springer eBooks · doi:10.1007/978-981-19-0638-1_5 · Cited by 3
Answering, Fast and Slow: Strategy enhancement of visual understanding guided by causality
Wang, C., Wang, Z., & Zhou, Y. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128735 · Cited by 3
Ullah, M. A., Zia, T., Kim, J.-E., & Kadry, S. (2024) · PLoS ONE · doi:10.1371/journal.pone.0311879 · Cited by 3
RetractedFew-Shot System Identification for Reinforcement Learning
Farid, K., & Sakr, N. (2021) · Asia-Pacific Conference on Intelligent Robot Systems (ACIRS) · doi:10.1109/acirs52449.2021.9519314 · Cited by 3
Multi-Agent Tree Search with Dynamic Reward Shaping
Velasquez, A., Bissey, B., Barak, L., Melcer, D., Beckus, A., Alkhouri, I., & Atia, G. (2022) · Proceedings of the International Conference on Automated Planning and Scheduling · doi:10.1609/icaps.v32i1.19854 · Cited by 3
Baier, H., & Kaisers, M. (2021) · Data Archiving and Networked Services (DANS) · Cited by 3
Structure and Randomness in Planning and Reinforcement Learning
Czechowski, K., Januszewski, P., Kozakowski, P., Kuciński, Ł., & Miłoś, P. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9533317 · Cited by 3
Self-play Learning Strategies for Resource Assignment in Open-RAN NetworksPreprint
Wang, X.-Y., Thomas, J. D., Piechocki, R., Kapoor, S., Santos-Rodríguez, R., & Parekh, A. (2021) · Comput. Networks · doi:10.48550/arxiv.2103.02649 · Cited by 30
Deep Reinforcement Learning Based on Link Prediction Method in Social Network Analysis
(2019) · International Journal of Innovative Technology and Exploring Engineering · doi:10.35940/ijitee.b1127.1292s219 · Cited by 2
Multi-Lingual Semantic-Based Sentiment Analysis Using Generative AI
Biswas, P., Arockiam, D., Neogi, S. G., Sengupta, S., Saraswat, S., & Chanda, R. (2024) · International Conference on Computer, Electronics & Electrical Engineering & their Applications (IC2E3) · doi:10.1109/ic2e362166.2024.10827103 · Cited by 2
A Deep Reinforcement Learning Approach to First-Order Logic Theorem Proving
Crouse, M., Abdelaziz, I., Makni, B., Whitehead, S., Cornelio, C., Kapanipathi, P., Srinivas, K., Thost, V., Witbrock, M., & Fokoue, A. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i7.16780 · Cited by 6
Hex game system based on P-MCTS
Wang, S., Ding, M., & Li, S. (2018) · Chinese Control and Decision Conference (CCDC) · doi:10.1109/ccdc.2018.8408299 · Cited by 2
Generation of Reference Trajectories for Safe Trajectory Planning
Chaulwar, A. T., Botsch, M., & Utschick, W. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01418-6_42 · Cited by 2
Self-Play or Group Practice: Learning to Play Alternating Markov Game in Multi-Agent System
Leung, C.-W., Hu, S., & Leung, H.-F. (2021) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr48806.2021.9412176 · Cited by 2
Spatial state-action features for general games
Soemers, D. J. N. J., Piette, É., Stephenson, M., & Browne, C. (2023) · Artificial Intelligence · doi:10.1016/j.artint.2023.103937 · Cited by 4
Automating Workflow/Pipeline Design
Brazdil, P., van Rijn, J. N., Soares, C., & Vanschoren, J. (2022) · Cognitive technologies · doi:10.1007/978-3-030-67024-5_7 · Cited by 2
Prolog Technology Reinforcement Learning Prover
Zombori, Z., Urban, J., & Brown, C. E. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-51054-1_33 · Cited by 5
Verification-Guided Tree Search
Velasquez, A., & Melcer, D. (2020) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/ywcv8115 · Cited by 2
Single-Agent Optimization Through Policy Iteration Using Monte-Carlo Tree SearchPreprint
Seify, A., & Buro, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.11335 · Cited by 2
Mobile Networks for Computer GoPreprint
Cazenave, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.10080 · Cited by 2
Single-Agent Optimization with Monte-Carlo Tree Search and Deep Reinforcement Learning
Seify, A. (2020) · ERA: Education and Research Archive (University of Alberta) · doi:10.7939/r3-ydsv-6d91 · Cited by 2
Learning state-action features for general game playing
Soemers, D. J. N. J. (2023) · Research Publications (Maastricht University) · doi:10.26481/dis.20230425ds · Cited by 1
BRExIt: On Opponent Modelling in Expert Iteration
Hernandez, D., Baier, H., & Kaisers, M. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/422 · Cited by 2
Realization and discussion of selected artificial intelligence algorithms in computer games
Tyshchenko, Y. (2025) · Journal of Computer Sciences Institute · doi:10.35784/jcsi.6723 · Cited by 1
Measures of type-2 fuzzy numbers: Balancing fast and slow thinking in decision analysis
Zhu, B., Xu, Y., Yu, X., Yu, K., & Yu, K. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.129197 · Cited by 1
Wang, W. (2024) · Springer eBooks · doi:10.1007/978-981-97-5333-8_6 · Cited by 1
An Advanced Actor-Critic Algorithm for Training Video Game AI
Zha, Z., Tang, X., & Wang, B. Y. (2020) · Communications in computer and information science · doi:10.1007/978-981-15-7670-6_31 · Cited by 1
Towards Visual Concept Learning and Reasoning: On Insights into Representative Approaches
Saranti, A., Streit, S., Müller, H., Singh, D., & Holzinger, A. (2021) · Studies in computational intelligence · doi:10.1007/978-3-030-67148-8_5 · Cited by 1
Learning Deep Policies for Physics-Based Manipulation in Clutter.Preprint
Bejjani, W., Papallas, R., Leonetti, M., & Doğar, M. R. (2018) · arXiv (Cornell University) · Cited by 1
Deep Pepper: Expert Iteration based Chess agent in the Reinforcement Learning SettingPreprint
V., S. K. G., Goyette, K., Chamseddine, A., & Considine, B. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.00683 · Cited by 1
On the potential for open-endedness in neural networksPreprint
Guttenberg, N., Virgo, N., & Penn, A. S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.04907 · Cited by 1
A selected review on reinforcement learning based control for autonomous underwater vehiclesPreprint
Hsu, Y.-C., Wu, H., You, K., & Song, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.11991 · Cited by 1
Visualizing MuZero ModelsPreprint
de Vries, J. A., Voskuil, K. S., Moerland, T. M., & Plaat, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.12924 · Cited by 1
ExpIt-OOS: Towards Learning from Planning in Imperfect Information Games.Preprint
Kitchen, A., & Benedetti, M. (2018) · arXiv (Cornell University)
EXIT Analysis for Community DetectionPreprint
Saad, H., & Nosratinia, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.09656
Sidekick Policy Learning for Active Visual ExplorationPreprint
Ramakrishnan, S. K., & Grauman, K. L. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.11010
Solving QSAT problems with neural MCTSPreprint
Xu, R., & Lieberherr, K. J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.06619
Alpha-T: Learning to Traverse over Graphs with An AlphaZero-inspired Self-Play FrameworkPreprint
Wang, Q. (2021) · Research Square · doi:10.21203/rs.3.rs-415344/v1
Searching with Opponent-AwarenessPreprint
Phan, T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.10508
Solving Graph-based Public Good Games with Tree Search and Imitation LearningPreprint
Darvariu, V.-A., Hailes, S. M. V., & Musolesi, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.06762 · Cited by 5
Temporal sampling annealing schemes for receding horizon multi-agent planning
Ma, A., Ouimet, M., & Cortés, J. (2021) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2021.103823
Planning Spatial Networks.Preprint
Darvariu, V.-A., Hailes, S. M. V., & Musolesi, M. (2021) · arXiv (Cornell University)
Plaat, A. (2022) · Springer eBooks · doi:10.1007/978-981-19-0638-1_6
Monte Carlo Tree Search as an Offline Training Data Generator for Decision-Tree Based Game AgentsPreprint
Świechowski, M., & Ślȩzak, D. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4152772 · Cited by 1
Hawkins, P. N. (2022) · Queensland University of Technology · doi:10.5204/thesis.eprints.236966
Boot and Switch: Alternating Distillation for Zero-Shot Dense Retrieval
Jiang, F., Xu, Q., Drummond, T. W., & Cohn, T. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.65 · Cited by 3
Zhang, Z., Storks, S., Hu, F., Sohn, S., Lee, M., Lee, H., & Chai, J. Y. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.456 · Cited by 3
Application And Challenges of Alphazero Algorithm in Chinese Chess
Li, X. (2024) · Highlights in Science Engineering and Technology · doi:10.54097/e6373366
Road to AGI: The Importance of Clear Objectives and Reward FunctionsPreprint
Rasoolinejad, M. (2024) · Preprints.org · doi:10.20944/preprints202407.0687.v1
RNA Generative Modeling With Tree Search
Obonyo, S., Jouandeau, N., & Owuor, D. O. (2024) · IEEE Conference on Computational Intelligence in Bioinformatics and Computational Biology (CIBCB) · doi:10.1109/cibcb58642.2024.10702167
Research on Real-Time Multi-Robot Task Allocation Method Based on Monte Carlo Tree Search
Zhang, H., Sun, Y., & Zheng, F. (2024) · Electronics · doi:10.3390/electronics13244943 · Cited by 1
Wang, Z., Wang, H., & Liang, W. G. (2024) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros58592.2024.10802526
Iterative Deepening Chess Engine with Alpha Beta Pruning
Kodhai, E., Bhuvaneswari, E., Devi, V. A., & Preethi, S. T. (2024) · International Conference on Smart Technologies for Sustainable Development Goals (ICSTSDG) · doi:10.1109/icstsdg61998.2024.11026648
Generative Language Modeling for Automated Theorem Proving
Polu, S., & Sutskever, I. (2020) · arXiv · doi:10.48550/arxiv.2009.03393 · Cited by 82
Recursively Summarizing Books with Human Feedback
Wu, J., Ouyang, L., Ziegler, D. M., Stiennon, N., Lowe, R., Leike, J., & Christiano, P. (2021) · arXiv · doi:10.48550/arxiv.2109.10862 · Cited by 76
Supervising strong learners by amplifying weak experts
Christiano, P., Shlegeris, B., & Amodei, D. (2018) · arXiv · doi:10.48550/arxiv.1810.08575 · Cited by 39
Metadata
- Authors
- Anthony, T., Tian, Z., & Barber, D.
- ORCID
- Barber, David
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2017
- Volume
- 30
- Pages
- 5360-5370
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1705.08439
- OpenAlex
- W2618097077
- Cited by
- 198
- References
- 15
- Citations by year
- 2025: 6 · 2024: 14 · 2023: 15 · 2022: 24 · 2021: 37 · 2020: 39 · 2019: 36 · 2018: 25 · 2017: 2
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- UCL Discovery (University College London) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence in Games
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › AI-based Problem Solving and Planning
- Keywords
- tree search, deep reinforcement learning, sequential decision making, Hex, structured prediction, game-playing agents
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
