A Biophysically Based Neural Model of Matching Law Behavior: Melioration by Stochastic Synapses
Open accessThe DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
In experiments designed to uncover the neural basis of adaptive decision making in a foraging environment, neuroscientists have reported single-cell activities in the lateral intraparietal cortex (LIP) that are correlated with choice options and their subjective values. To investigate the underlying synaptic mechanism, we considered a spiking neuron model of decision making endowed with synaptic plasticity that follows a reward-dependent stochastic Hebbian learning rule. This general model is tested in a matching task in which rewards on two targets are scheduled randomly with different rates. Our main results are threefold. First, we show that plastic synapses provide a natural way to integrate past rewards and estimate the local (in time) “return” of a choice. Second, our model reproduces the matching behavior (i.e., the proportional allocation of choices matches the relative reinforcement obtained on those choices, which is achieved through melioration in individual trials). Our model also explains the observed “undermatching” phenomenon and points to biophysical constraints (such as finite learning rate and stochastic neuronal firing) that set the limits to matching behavior. Third, although our decision model is an attractor network exhibiting winner-take-all competition, it captures graded neural spiking activities observed in LIP, when the latter were sorted according to the choices and the difference in the returns for the two targets. These results suggest that neurons in LIP are involved in selecting the oculomotor responses, whereas rewards are integrated and stored elsewhere, possibly by plastic synapses and in the form of the return rather than income of choice options.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Long-Term Potentiation--A Decade of Progress?
Malenka, R. C., & Nicoll, A. R. A. (1999) · Science · doi:10.1126/science.285.5435.1870 · Cited by 2,729
RELATIVE AND ABSOLUTE STRENGTH OF RESPONSE AS A FUNCTION OF FREQUENCY OF REINFORCEMENT 1, 2
Herrnstein, R. J. (1961) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1961.4-267 · Cited by 2,281
Neural Basis of a Perceptual Decision in the Parietal Cortex (Area LIP) of the Rhesus Monkey
Shadlen, M. N., & Newsome, W. T. (2001) · Journal of Neurophysiology · doi:10.1152/jn.2001.86.4.1916 · Cited by 1,755
Neural correlates of decision variables in parietal cortex
Platt, M. L., & Glimcher, P. W. (1999) · Nature · doi:10.1038/22268 · Cited by 1,721 · cited 8×
“, 1998 ; Leon and Shadlen , 1999 ; Platt and Glimcher , 1999 ; Lauwereyns et al .”
BackgroundResultInfluentialSoftky, W., & Koch, C. (1993) · The Journal of Neuroscience · doi:10.1523/jneurosci.13-01-00334.1993 · Cited by 1,689 · cited 2×
“This stochasticity is attributable to irregular spike discharges , a characteristic feature of cortical neurons ( Softky and Koch , 1993 ; Shadlen and Newsome , 1994 ; van Vreeswijk and Sompolinsky , 1996 ; Compte et al .”
BackgroundBehavioral Theories and the Neurophysiology of Reward
Schultz, W. (2006) · Annual Review of Psychology · doi:10.1146/annurev.psych.56.091103.070229 · Cited by 1,637 · cited 1×
“Evidence suggests that dopamine in the brain acts as a common currency for a reward signal ( Schultz , 2000 , 2006 ) , and modulates synaptic plasticity ( Jay , 2003 ) .”
BackgroundRoitman, J. D., & Shadlen, M. N. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-21-09475.2002 · Cited by 1,589 · cited 3×
“( 2004a ) , were also found in a visual motion direction discrimination task in which the differentiating factor is motion coherence ( sensory information ) rather than rewarding value ( Shadlen and Newsome , 2001 ; Roitman and Shadlen , 2002 ) .”
BackgroundON TWO TYPES OF DEVIATION FROM THE MATCHING LAW: BIAS AND UNDERMATCHING 1
Baum, W. M. (1974) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1974.22-231 · Cited by 1,460
Multiple reward signals in the brain
Schultz, W. (2000) · Nature Reviews Neuroscience · doi:10.1038/35044563 · Cited by 1,303 · cited 2×
“In addition to LIP , other candidate sites include corticostriatal synapses in basal ganglia , or synaptic connections in the orbitofrontal cortex ( Schultz , 2000 ) .”
BackgroundProbabilistic decision making by slow reverberation in cortical circuits
Wang, X.-J. (2002) · Neuron · doi:10.1016/s0896-6273(02)01092-9 · Cited by 1,242
Self-citation
Cited by
Decision Making in Recurrent Neuronal Circuits
Wang, X.-J. (2008) · Neuron · doi:10.1016/j.neuron.2008.09.034 · Cited by 679
“(A) is reproduced with permission from Sugrue et al. (2004), (B) and (C) from Corrado et al. (2005), and (D)–(G) from Soltani and Wang (2006). of fluctuating network dynamics (Soltani and Wang, 2006).”
BackgroundInfluentialSelf-citationNeuroeconomics: Decision Making and the Brain
Rushworth, M. F. S., & Walton, M. E. (2009) · Neuron · doi:10.1016/j.neuron.2009.07.005 · Cited by 658
An Integrative Model of the Maturation of Cognitive Control
Luna, B., Marek, S., Larsen, B., Tervo-Clemmens, B., & Chahal, R. (2015) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-071714-034054 · Cited by 550
Neural Basis of Reinforcement Learning and Decision Making
Lee, D., Seo, H., & Jung, M. W. (2012) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-062111-150512 · Cited by 546
Cortico–basal ganglia circuit mechanism for a decision threshold in reaction time tasks
Lo, C.-C., & Wang, X.-J. (2006) · Nature Neuroscience · doi:10.1038/nn1722 · Cited by 505
“Therefore, a mechanism for tunable threshold can be implemented by the cortico-striatal synaptic plasticity that follows a reward-dependent Hebbian-like learning rul”
BackgroundSelf-citation
Metadata
- Authors
- Soltani, A., & Wang, X.-J.
- Venue
- The Journal of Neuroscience
- Publisher
- Society for Neuroscience
- Published
- 2006-04-05
- Volume
- 26
- Issue
- 14
- Pages
- 3731-3744
- ISSN
- 0270-6474 (ISSN-L)
- 1529-2401
- OpenAlex
- W2062444449
- Cited by
- 127
- References
- 31
- FWCI
- 3.53
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A Biophysically Based Neural Model of Matching Law Behavior: Melioration by Stochastic Synapses. https://app.cochat.ai/papers/10.1523/jneurosci.5159-05.2006
- The paper
- Soltani, A., & Wang, X.-J. (2006). A Biophysically Based Neural Model of Matching Law Behavior: Melioration by Stochastic Synapses. The Journal of Neuroscience. https://doi.org/10.1523/jneurosci.5159-05.2006
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.