CoChat

Reinforcement learning: Computational theory and biological mechanisms

Open access
Doya, Kenji · 2007 · HFSP journal

The DOI matches its Crossref record; 76 of the 76 references it cites were found in a registry or an index.

Abstract

Reinforcement learning is a computational framework for an active agent to learn behaviors on the basis of a scalar reward signal. The agent can be an animal, a human, or an artificial system such as a robot or a computer program. The reward can be food, water, money, or whatever measure of the performance of the agent. The theory of reinforcement learning, which was developed in an artificial intelligence community with intuitions from animal learning theory, is now giving a coherent account on the function of the basal ganglia. It now serves as the "common language" in which biologists, engineers, and social scientists can exchange their problems and findings. This article reviews the basic theoretical framework of reinforcement learning and discusses its recent and future contributions toward the understanding of animal behaviors and human decision making.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.2976/1.2732246/10.2976/1

Cites

76 of 76 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 76 references

Research works printed but not linked: 4

  1. Dayan P, 1996, Mach. Learn., 25, 5
  2. Houk JC, 1995, Models of Information Processing, 249
  3. Sutton R S, 1988, Mach. Learn., 3, 9
  4. Thorndike E L, 1898, Psychol. Rev., 2, 1

Cited by

See all 150

Metadata

Authors
Doya, K.
Affiliations
Okinawa Institute of Science and Technology Graduate University (JP)
Corresponding author
Doya, Kenji
Venue
HFSP journal
Published
2007-05
Volume
1
Issue
1
Pages
30-40
ISSN
  • 1955-205X (ISSN-L)
  • 1955-2068
OpenAlex
W2091789872
Cited by
150
References
76
Citations by year
2026: 7 · 2025: 11 · 2024: 8 · 2023: 7 · 2022: 6 · 2021: 9 · 2020: 6 · 2019: 6 · 2018: 10 · 2017: 4 · 2016: 12 · 2015: 5 · 2014: 13 · 2013: 6 · 2012: 12
FWCI
7.06
Type
journal article
Language
en
Open access
Locations
  • HFSP journal (publishedVersion)
  • PubMed Central (publishedVersion)
  • PubMed (publishedVersion)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
  • Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
Keywords
reinforcement learning, basal ganglia, reward signals, animal learning, human decision-making, theory of computation, biological mechanisms, artificial intelligence

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Reinforcement learning: Computational theory and biological mechanisms. https://app.cochat.ai/papers/10.2976/1.2732246
The paper
Doya, K. (2007). Reinforcement learning: Computational theory and biological mechanisms. HFSP journal. https://doi.org/10.2976/1.2732246

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.