Cited by 27,225Reinforcement Learning in RoboticsMachine Learning and AlgorithmsAdvanced Bandit Algorithms Research

The DOI matches its Crossref record.

Reinforcement Learning: An Introduction

Sutton, R.S., Barto, A.G.·1998·IEEE Transactions on Neural Networks

DOI 10.1109/tnn.1998.712192

Open this paper in CoChat — free account

Integrity signals

Registry

Crossref · 10.1109/tnn.1998.712192

Cites

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Sorted by citations

Items 1,201–1,274 of 1,274

Sensitivity to value-driven attention is predicted by how we learn from value
Jahfari, S., & Theeuwes, J. (2017) · Psychonomic Bulletin & Review · doi:10.3758/s13423-016-1106-6 · Cited by 28
Computational psychopharmacology: a translational and pragmatic approach
Robbins, T. W., & Cardinal, R. N. (2019) · Psychopharmacology · doi:10.1007/s00213-019-05302-3 · Cited by 25
Differential reinforcement learning responses to positive and negative information in unmedicated individuals with depression
Reinen, J. M., Whitton, A. E., Pizzagalli, D. A., Slifstein, M., Abi-Dargham, A., McGrath, P. J., Iosifescu, D. V., & Schneier, F. R. (2021) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2021.08.002 · Cited by 27
Deep learning approaches for similarity computation: A survey
Yang, P., Wang, H., Yang, J., Qian, Z., Zhang, Y., & Lin, X. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3422484 · Cited by 28
Facilitating Multi-turn Emotional Support Conversation with Positive Emotion Elicitation: A Reinforcement Learning Approach
Zhou, J., Chen, Z., Wang, B., & Huang, M. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2023.acl-long.96 · Cited by 25
Optimal location of PEVCSs using MAS and ER approach
Jiang, C., Jing, Z., Ji, T., & Wu, Q. (2018) · IET Generation, Transmission & Distribution · doi:10.1049/iet-gtd.2017.1907 · Cited by 24
Using artificial intelligence to optimize delivery of weight loss treatment: protocol for an efficacy and cost-effectiveness trial
Forman, E. M., Berry, M. P., Butryn, M. L., Hagerman, C. J., Huang, Z., Juarascio, A. S., LaFata, E. M., Ontañón, S., Tilford, J. M., & Zhang, F. (2023) · Contemporary Clinical Trials · doi:10.1016/j.cct.2022.107029 · Cited by 24
Retro Drug Design: From Target Properties to Molecular Structures
Wang, Y., Michael, S., Yang, S.-M., Huang, R., Cruz-Gutierrez, K., Zhang, Y., Zhao, J., Xia, M., Shinn, P., & Sun, H. (2022) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.2c00123 · Cited by 24
Intentionality in frontal asymmetry research
Hewig, J. (2018) · Psychophysiology · doi:10.1111/psyp.12852 · Cited by 23
Surprise beyond prediction error
Chumbley, J. R., Burke, C. J., Stephan, K. E., Friston, K. J., Tobler, P. N., & Fehr, E. (2014) · Human Brain Mapping · doi:10.1002/hbm.22513 · Cited by 23
Benchmark Data Contamination of Large Language Models: A Survey
Xu, C., Guan, S., Greene, D., & Kechadi, M.-T. (2024) · arXiv · doi:10.48550/arxiv.2406.04244 · Cited by 22
Pattern recognition of human arm movement using deep reinforcement learning
Seok, W., Kim, Y., & Park, C. (2018) · 2018 International Conference on Information Networking (ICOIN) · doi:10.1109/icoin.2018.8343257 · Cited by 25
Opportunities and Risks of LLMs for Scalable Deliberation with Polis
Small, C. T., Vendrov, I., Durmus, E., Homaei, H., Barry, E., Cornebise, J., Suzman, T., Ganguli, D., & Megill, C. (2023) · arXiv · doi:10.48550/arxiv.2306.11932 · Cited by 20
“…routing is rooted in the fields of Active Learning (Cohn et al., 1996), also known as Sequential Design of Experiment in statistics, Bayesian Optimisation using Gaussian Processes (Rasmussen, 2006), Exploration/Exploitation in Reinforcement Learning and Bandits Algorithms Sutton and Barto (1998).”
Method
Mobile-kube: mobility-aware and energy-efficient service orchestration on kubernetes edge servers
Ghafouri, S., Karami, A., Bakhtiarvan, D. B., Bigdeli, A. S., Gill, S. S., & Doyle, J. (2022) · 2022 IEEE/ACM 15th International Conference on Utility and Cloud Computing (UCC) · doi:10.1109/ucc56403.2022.00019 · Cited by 20
Multi-agent deep reinforcement learning based resource management in heterogeneous V2X networks
Zhao, J., Hu, F., Li, J., & Nie, Y. (2025) · Digital Communications and Networks · doi:10.1016/j.dcan.2023.06.003 · Cited by 21
What's to Know? Uncertainty as a Guide to Asking Goal-Oriented Questions
Abbasnejad, E., Wu, Q., Shi, Q., & van den Hengel, A. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00428 · Cited by 16
Expectation violation and cognitive dissonance theory: Proposal for an epistemic inconsistency management model
Aubert‐Teillaud, B., Bran, A., & Vaidis, D. C. (2023) · European Journal of Social Psychology · doi:10.1002/ejsp.2981 · Cited by 19
Deep Blue: A Fuzzy Q-Learning Enhanced Active Queue Management Scheme
Masoumzadeh, S. S., Taghizadeh, G., Meshgi, K., & Shiry, S. (2009) · 2009 International Conference on Adaptive and Intelligent Systems · doi:10.1109/icais.2009.17 · Cited by 17
An adaptive AQM algorithm based on neuron reinforcement learning
Zhou, C., Di, D., Chen, Q., & Guo, J. (2009) · 2009 IEEE International Conference on Control and Automation · doi:10.1109/icca.2009.5410198 · Cited by 17
General intelligence requires rethinking exploration
Jiang, M., Rocktäschel, T., & Grefenstette, E. (2022) · arXiv · doi:10.48550/arxiv.2211.07819 · Cited by 17
A hybrid trust model using reinforcement learning and fuzzy logic
Aref, A., & Tran, T. (2018) · Computational Intelligence · doi:10.1111/coin.12155 · Cited by 16
Secure and Efficient Coded Multi-Access Edge Computing With Generalized Graph Neural Networks
Asheralieva, A., & Niyato, D. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2022.3172117 · Cited by 15
From reinforcement learning to agency: Frameworks for understanding basal cognition
Seifert, G., Sealander, A., Marzen, S., & Levin, M. (2024) · BioSystems · doi:10.1016/j.biosystems.2023.105107 · Cited by 16
The Role of Restoration and Key Ecological Invasion Mechanisms in Optimal Spatial-Dynamic Management of Invasive Species
Albers, H. J., Hall, K. M., Lee, K. D., Taleghan, M. A., & Dietterich, T. G. (2018) · Ecological Economics · doi:10.1016/j.ecolecon.2018.03.031 · Cited by 14
Multidimensional Deformable Object Manipulation Based on DN-Transporter Networks
Teng, Y., Lu, H., Li, Y., Kamiya, T., Nakatoh, Y., Serikawa, S., & Gao, P. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3168303 · Cited by 15
Hierarchical control using networks trained with higher-level forward models
Wayne, G., & Abbott, L. F. (2014) · Neural Computation · doi:10.1162/neco_a_00639 · Cited by 14
A reinforcement-learning approach to efficient communication
Kågebäck, M., Carlsson, E., Dubhashi, D., & Sayeed, A. (2020) · PLOS ONE · doi:10.1371/journal.pone.0234894 · Cited by 13
Finite Time Lyapunov Exponent Analysis of Model Predictive Control and Reinforcement Learning
Krishna, K., Brunton, S. L., & Song, Z. (2023) · IEEE Access · doi:10.1109/access.2023.3326424 · Cited by 12
A probabilistic successor representation for context-dependent learning
Geerts, J. P., Gershman, S. J., Burgess, N., & Stachenfeld, K. L. (2024) · Psychological Review · doi:10.1037/rev0000414 · Cited by 14
Fuel- and noise-minimal departure trajectory using deep reinforcement learning with aircraft dynamics and topography constraints
Nguyen, C. H., Shihua, J. M., & Liem, R. P. (2025) · Communications in Transportation Research · doi:10.1016/j.commtr.2025.100165 · Cited by 12
Initial Uncertainty Impacts Statistical Learning in Sound Sequence Processing
Todd, J., Provost, A., Whitson, L., & Mullens, D. (2018) · Neuroscience · doi:10.1016/j.neuroscience.2018.05.011 · Cited by 10
Retroformer: Retrospective Large Language Agents with Policy Gradient Optimization
Yao, W., Heinecke, S., Niebles, J. C., Liu, Z., Feng, Y., Xue, L., Murthy, R., Chen, Z., Zhang, J., Arpit, D., et al. (2023) · arXiv · doi:10.48550/arxiv.2308.02151 · Cited by 10
“1, since it requires the LLM to have a good understanding of where the agent made mistakes in a specific environment, i.e., the credit assignment problem (Sutton & Barto, 2018), as well as the ability to generate a summary containing actionable insights for improvement.”
Background
Using dialogue acts to learn better repair strategies for spoken dialogue systems
Frampton, M., & Lemon, O. (2008) · 2008 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2008.4518792 · Cited by 9
Recommendations to Create Programming Exercises to Overcome ChatGPT
Berrezueta-Guzman, J., & Krusche, S. (2023) · doi:10.35542/osf.io/expuq · Cited by 27
Automated Design of Agentic Systems
Hu, S., Lu, C., & Clune, J. (2024) · arXiv · doi:10.48550/arxiv.2408.08435 · Cited by 10
“One could also include more classic approaches to balance exploration and exploitation (Sutton & Barto, 2018; Liu et al., 2024).”
Playtesting: What is Beyond Personas
Ariyurek, S., Surer, E., & Betin-Can, A. (2023) · IEEE Transactions on Games · doi:10.1109/tg.2022.3165882 · Cited by 7
“MDP formulates the interaction between an actor and the environment [27].”
Computing Education Research Today
Fincher, S. A., Tenenberg, J., Dorn, B., Hundhausen, C., McCartney, R., & Murphy, L. (2019) · The Cambridge Handbook of Computing Education Research · doi:10.1017/9781108654555.003 · Cited by 7
Dynamic server selection strategy for multi-server HTTP adaptive streaming services
Bouten, N., Claeys, M., Van Poecke, B., Latre, S., & De Turck, F. (2016) · 2016 12th International Conference on Network and Service Management (CNSM) · doi:10.1109/cnsm.2016.7818403 · Cited by 6
Active reinforcement learning versus action bias and hysteresis: control with a mixture of experts and nonexperts
Colas, J. T., O’Doherty, J. P., & Grafton, S. T. (2024) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1011950 · Cited by 6
How Far is Video Generation from World Model: A Physical Law Perspective
Kang, B., Yue, Y., Lu, R., Lin, Z., Zhao, Y., Wang, K., Huang, G., & Feng, J. (2024) · arXiv · doi:10.48550/arxiv.2411.02385 · Cited by 7
“Previously, they often operated in an abstracted space and were used in reinforcement learning (Sutton, 2018) to enable planning (Silver et al., 2016; Schrittwieser et al., 2020) or facilitate policy learning through virtual interactions (Hafner et al., 2019; 2020; Yue et al., 2023).”
V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planning
Assran, M., Bardes, A., Fan, D., Garrido, Q., Howes, R., Mojtaba, Komeili, Muckley, M., Rizvi, A., Roberts, C., et al. (2025) · arXiv · doi:10.48550/arxiv.2506.09985 · Cited by 8
Generalizable Causal Reinforcement Learning for Out-of-Distribution Environments
Huang, S., Hu, J., Chen, H., Cui, P., Piao, H., Sun, L., & Yang, B. (2025) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2025.3556029 · Cited by 4
The Neurochemical Modulation of Prefrontal Control Processes
Robbins, T. W., & Kehagia, A. A. (2017) · The Wiley Handbook of Cognitive Control · doi:10.1002/9781118920497.ch19 · Cited by 4
Deconstructing Deep Active Inference: A Contrarian Information Gatherer
Champion, T., Grześ, M., Bonheme, L., & Bowman, H. (2024) · Neural Computation · doi:10.1162/neco_a_01697 · Cited by 5
Role of Artificial Intelligence in Cognitive Radio Networks
Singhal, S., Gupta, S., & Sinha, A. (2019) · Advances in Wireless Technologies and Telecommunication · doi:10.4018/978-1-5225-5354-0.ch014 · Cited by 3
Survey of Computerized Adaptive Testing: A Machine Learning Perspective
Zhuang, Y., Liu, Q., Bi, H., Huang, Z., Huang, W., Li, J., Yu, J., Liu, Z., Hu, Z., Hong, Y., et al. (2026) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2026.3672850 · Cited by 9
“Reinforcement learning (RL), a subﬁeld of machine learning, is a powerful approach that enables an agent to learn how to make optimal decisions automatically [135].”
Model-free decision making resists improved instructions and is enhanced by stimulus-response associations
Luna, R., Vadillo, M. A., & Luque, D. (2023) · Cortex · doi:10.1016/j.cortex.2023.06.009 · Cited by 3
Neuro-Symbolic World Models for Adapting to Open World Novelty
Balloch, J., Lin, Z., Wright, R., Peng, X., Hussain, M., Srinivas, A., Kim, J., & Riedl, M. O. (2023) · arXiv · doi:10.48550/arxiv.2301.06294 · Cited by 8
“Reinforcement learning can be broadly categorized as model-based and model-free [32].”
Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?
Yue, Y., Chen, Z., Lu, R., Zhao, A., Wang, Z., Yue, Y., Song, S., & Huang, G. (2025) · arXiv · doi:10.48550/arxiv.2504.13837 · Cited by 804
Adaptive Information Modulation: Designing Governance Mechanisms for Multi-Agent Artificial Intelligence Systems
Chen, Q., Ilami, S., Lore, N., & Heydari, B. (2026) · Journal of Mechanical Design · doi:10.1115/1.4070755 · Cited by 3
Altered Reward Processing in Obsessive-Compulsive Disorder: Insights from Active and Observational Learning
Vahedi, J., Bahic, A., Chaliani, I., Schilbach, L., Ciupka‐Schön, B., Bellebaum, C., Pietrowsky, R., & Peterburs, J. (2025) · Psychophysiology · doi:10.1111/psyp.70142 · Cited by 3
“To obtain single-trial estimates of participants' reward expectations and PEs, we fitted different reinforcement learning (RL) models to each participant's choice sequence and reinforcement history (Sutton and Barto 2018; Watkins and Dayan 1992).”
Towards Human-Like Emergent Communication via Utility, Informativeness, and Complexity
Tucker, M., Shah, J., Levy, R., & Zaslavsky, N. (2025) · Open Mind · doi:10.1162/opmi_a_00188 · Cited by 2
Roadmap of AlphaGo to AlphaStar: Problems and challenges
Rong, Y. (2022) · 2nd International Conference on Artificial Intelligence, Automation, and High-Performance Computing (AIAHPC 2022) · doi:10.1117/12.2641824 · Cited by 2
Feedback Loops With Language Models Drive In-Context Reward Hacking
Pan, A., Jones, E., Jagadeesan, M., & Steinhardt, J. (2024) · arXiv · doi:10.48550/arxiv.2402.06627 · Cited by 3
“RL environments also induce feedback effects (Sutton & Barto, 2018).”
Background
When Can AI Models Explain Learning? Validity Criteria for AI as Cognitive Models in Education
Wang, P., Viberg, O., Law, E. L.-C., & Greiff, S. (2026) · Educational Psychology Review · doi:10.1007/s10648-026-10202-y · Cited by 3
AlphaMut: A Deep Reinforcement Learning Model to Suggest Helix-Disrupting Mutations
Bhargav, P., & Mukherjee, A. (2025) · Journal of Chemical Theory and Computation · doi:10.1021/acs.jctc.4c01387 · Cited by 2
Two prefrontal-subcortical circuits estimate controllability and reflect its impact on learning
Liu, Y., Spiering, L., Luo, S., Kingston, N., Grohn, J., & Rushworth, M. F. S. (2026) · Neuron · doi:10.1016/j.neuron.2026.07.029 · Cited by 1
XLand-MiniGrid: Scalable Meta-Reinforcement Learning Environments in JAX
Nikulin, A., Kurenkov, V., Zisman, I., Agarkov, A., Sinii, V., & Kolesnikov, S. (2024) · Advances in Neural Information Processing Systems 37 · doi:10.52202/079017-1390 · Cited by 3
“Grid world environments have a long history in RL research Sutton & Barto (2018), as they offer a number of attractive properties.”
Background
A Study of Global and Episodic Bonuses for Exploration in Contextual MDPs
Henaff, M., Jiang, M., & Raileanu, R. (2023) · arXiv · doi:10.48550/arxiv.2306.03236 · Cited by 1
“A large body of research has studied this problem within the Markov Decision Process (MDP) framework (Sutton & Barto, 2018), both from a theoretical standpoint (Kearns & Singh, 2002; Brafman & Tennenholtz, 2002; Agarwal et al., 2020) and an empirical one.”
Background
Nested Learning: The Illusion of Deep Learning Architectures
Behrouz, A., Razaviyayn, M., Zhong, P., & Mirrokni, V. (2025) · arXiv · doi:10.48550/arxiv.2512.24695 · Cited by 37
Reward magnitude determines reinforcement learning efficiency
Gong, S., Martell, A., Dudman, J. T., & Coddington, L. T. (2026) · Science · doi:10.1126/science.aeb0813 · Cited by 2
Calibrating Conservatism for Scalable Oversight
Overman, W., & Bayati, M. (2026) · arXiv · doi:10.48550/arxiv.2605.28807
“We model interaction with the environment as a controlled Markov process (cMP), a standard Markov decision process without a fixed reward function (Sutton & Barto, 2018).”
A Perspective on Open Challenges in Deformable Object Manipulation
McKennaa, R. P., & Oyekan, J. (2026) · arXiv · doi:10.48550/arxiv.2602.22998 · Cited by 1
Predictive Coding Enhances Meta-RL To Achieve Interpretable Bayes-Optimal Belief Representation Under Partial Observability
Kuo, P.-C., Hou, H., Dabney, W., & Walker, E. Y. (2025) · arXiv
“This issue is known in reinforcement learning (RL) as partial observability [1, 2, 3], and is a major challenge in the deployment of real-world RL systems [4].”
Influential
HiveMind: Contribution-Guided Online Prompt Optimization of LLM Multi-Agent Systems
Xia, Y., Wang, T., Zhang, S., Weng, Z., Cao, B., & Liew, S. C. (2025) · arXiv · doi:10.48550/arxiv.2512.06432
“The problem of fairly attributing a collective outcome to individual contributors is a central theme in both reinforcement learning (Sutton and Barto 2018) and cooperative game theory.”
MAPLE-Guard: Memory-Aware Link Enforcement Against Memory-Link Poisoning in Multi-Agent Systems
Xiong, W., Zhou, Y., Wang, J., Gu, S., Tang, B., Li, Z., Xiong, F., Wen, Y., & Wen, M. (2026) · arXiv · doi:10.48550/arxiv.2608.00426 · Cited by 2
“In addition, a parallel line treats memory value as a learnable quantity: reinforcement-learning memory managers score which items are worth keeping and reusing [39, 46, 58], which is the substrate our guard governs.”
MEM1: Learning to Synergize Memory and Reasoning for Efficient Long-Horizon Agents
Zhou, Z., Qu, A., Wu, Z., Kim, S., Prakash, A., Rus, D., Zhao, J., Low, B. K. H., & Liang, P. P. (2025) · arXiv · doi:10.48550/arxiv.2506.15841 · Cited by 218
“We train this behavior end-to-end with reinforcement learning (RL) [48, 71], optimizing for task success via verifiable rewards [43].”
Leveraging Sequentiality in Reinforcement Learning from a Single Demonstration
Chenu, A., Serris, O., Sigaud, O., & Perrin-Gilbert, N. (2022) · arXiv · doi:10.48550/arxiv.2211.04786
“A discount factor γ describes the importance of long-term rewards in this sequence of interactions [11].”
Huxley-Gödel Machine: Human-Level Coding Agent Development by an Approximation of the Optimal Self-Improving Machine
Wang, W., Piękos, P., Nanbo, L., Laakom, F., Chen, Y., Ostaszewski, M., Zhuge, M., & Schmidhuber, J. (2025) · arXiv · doi:10.48550/arxiv.2510.21614 · Cited by 40
Reflect-RL: Two-Player Online RL Fine-Tuning for LMs
Zhou, R., Du, S. S., & Li, B. (2024) · arXiv · doi:10.48550/arxiv.2402.12621
Toward smarter lean practices: a systematic review of machine learning applications in lean manufacturing
Serevan, B., & Kuşakçı, A. O. (2026) · International Journal of Lean Six Sigma · doi:10.1108/ijlss-02-2026-0094
A connectome of the Drosophila central complex reveals network motifs suitable for flexible navigation and context-dependent action selection
Hulse, B. K., Haberkern, H., Franconville, R., Turner-Evans, D. B., Takemura, S., Wolff, T., Noorman, M., Dreher, M., Dan, C., Parekh, R., et al. (2020) · doi:10.1101/2020.12.08.413955 · Cited by 392
TTRL: Test-Time Reinforcement Learning
Zuo, Y., Zhang, K., Sheng, L., Qu, S., Cui, G., Zhu, X., Li, H., Zhang, Y., Long, X., Hua, E., et al. (2025) · arXiv · Cited by 7
DORA Explorer: Improving the Exploration Ability of LLMs Without Training
Gurjar, P., Ishmam, M. F., & Marino, K. (2026) · arXiv · doi:10.48550/arxiv.2604.17244

Authors: Sutton, R. S., & Barto, A. G.
Affiliations: MIT Press
ORCID: Sutton, R.S.
Venue: IEEE Transactions on Neural Networks
Publisher: Institute of Electrical and Electronics Engineers (IEEE)
Published: 1998-09
Volume: 9
Issue: 5
Pages: 1054-1054
ISSN: 1045-9227 (ISSN-L)
1941-0093
DOI: 10.1109/tnn.1998.712192
OpenAlex: W4214717370
Cited by: 27,225
References: 0
Citations by year: 2026: 818 · 2025: 2403 · 2024: 2277 · 2023: 2382 · 2022: 2316 · 2021: 2022 · 2020: 1875 · 2019: 1731 · 2018: 1444 · 2017: 1058 · 2016: 852 · 2015: 782 · 2014: 892 · 2013: 817 · 2012: 816
FWCI: 95.54
Type: journal article
Language: en
Open access: closed
Licence: ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html (vor)
doi.org/10.15223/policy-029 (stm-asf)
doi.org/10.15223/policy-037 (stm-asf)
Locations: IEEE Transactions on Neural Networks (publishedVersion)
Topics: Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
Social Sciences › Decision Sciences › Management Science and Operations Research › Advanced Bandit Algorithms Research
Keywords: reinforcement learning, learning from interaction, optimal control, Markov decision process, policy optimization

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Reinforcement Learning: An Introduction

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cited by

Related

Metadata

Record

About these checks