Pavlovian-Instrumental Interaction in ‘Observing Behavior’
Open accessThe DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
Subjects typically choose to be presented with stimuli that predict the existence of future reinforcements. This so-called 'observing behavior' is evident in many species under various experimental conditions, including if the choice is expensive, or if there is nothing that subjects can do to improve their lot with the information gained. A recent study showed that the activities of putative midbrain dopamine neurons reflect this preference for observation in a way that appears to challenge the common prediction-error interpretation of these neurons. In this paper, we provide an alternative account according to which observing behavior arises from a small, possibly Pavlovian, bias associated with the operation of working memory.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
WIDROW, B., & HOFF, M. E. (1960) · doi:10.21236/ad0241531 · Cited by 4,009
A theory of attention: Variations in the associability of stimuli with reinforcement
Mackintosh, N. J. (1975) · Psychological Review · doi:10.1037/h0076778 · Cited by 2,733
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533 · cited 1×
“Such failures and irrationalities have been important sources of theory revision and refinement, for instance leading to suggestions about the competition and cooperation of multiple systems of control [5–7], some instrumental and adaptive; others Pavlovian and hard-wired.”
BackgroundSelf-citationDiscrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085 · cited 1×
“Figure 4b shows modelled dopamine activity in the variable engagement temporal difference model (here, negative prediction errors have been compressed compared with positive ones, see methods; [33,34]).”
MethodA framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066 · cited 4×
“is the phasic dopamine signal associated with prediction errors for reward [19] or a more tonic dopamine signal associated with a”
BackgroundMethodInfluentialSelf-citationModulation of memory fields by dopamine Dl receptors in prefrontal cortex
Williams, G. V., & Goldman-Rakic, P. S. (1995) · Nature · doi:10.1038/376572a0 · Cited by 1,593 · cited 2×
“dopamine itself over working memory [31]; however, whether this”
BackgroundMidbrain dopamine neurons encode a quantitative reward prediction error signal
Bayer, H. M., & Glimcher, P. W. (2005) · Neuron · doi:10.1016/j.neuron.2005.05.020 · Cited by 1,304 · cited 1×
“Figure 4b shows modelled dopamine activity in the variable engagement temporal difference model (here, negative prediction errors have been compressed compared with positive ones, see methods; [33,34]).”
MethodAdaptive Coding of Reward Value by Dopamine Neurons
Tobler, P. N., Fiorillo, C. D., & Schultz, W. (2005) · Science · doi:10.1126/science.1105370 · Cited by 1,276 · cited 2×
“There is a report that phasic dopamine itself scales in an adaptive manner [39,51], and this would be a natural substrate.”
BackgroundThe neural basis of temporal processing
Mauk, M. D., & Buonomano, D. V. (2004) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.27.070203.144247 · Cited by 976 · cited 1×
“, [23–28]).”
Interactions between frontal cortex and basal ganglia in working memory: A computational model
FRANK, M. J., LOUGHRY, B., & O'REILLY, R. C. (2001) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/cabn.1.2.137 · Cited by 879 · cited 2×
“gating process [29,30] associated with the basal ganglia, treating internally- and externally directed action in a uniform manner.”
BackgroundResult
Cited by
Lateral habenula neurons signal errors in the prediction of reward information
Bromberg-Martin, E. S., & Hikosaka, O. (2011) · Nature Neuroscience · doi:10.1038/nn.2902 · Cited by 275
Attention, learning, and the value of information
Gottlieb, J. (2012) · Neuron · doi:10.1016/j.neuron.2012.09.034 · Cited by 241
“It remains therefore possible that by selecting the informative cue the monkeys did not specifically seek information but simply sought to minimize their effort (by avoiding having to lick for or look at a low-reward pattern) or perhaps to bring about the motivationally salient, high-reward pattern (Beierholm and Daya…”
BackgroundNeural circuitry of information seeking
Bromberg-Martin, E. S., & Monosov, I. E. (2020) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2020.07.006 · Cited by 89
A neural mechanism for conserved value computations integrating information and rewards
Bromberg-Martin, E. S., Feng, Y.-Y., Ogasawara, T., White, J. K., Zhang, K., & Monosov, I. E. (2024) · Nature Neuroscience · doi:10.1038/s41593-023-01511-4 · Cited by 43
Metadata
- Authors
- Beierholm, U. R., & Dayan, P.
- Venue
- PLoS Computational Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2010-09-09
- Volume
- 6
- Issue
- 9
- Pages
- e1000903
- ISSN
- 1553-734X (ISSN-L)
- 1553-7358
- OpenAlex
- W2013683512
- Cited by
- 35
- References
- 17
- FWCI
- 0.54
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Pavlovian-Instrumental Interaction in ‘Observing Behavior’. https://app.cochat.ai/papers/10.1371/journal.pcbi.1000903
- The paper
- Beierholm, U. R., & Dayan, P. (2010). Pavlovian-Instrumental Interaction in ‘Observing Behavior’. PLoS Computational Biology. https://doi.org/10.1371/journal.pcbi.1000903
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.