The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Neural Coding of Reward-Prediction Error Signals During Classical Conditioning With Attractive Faces
Abstract
Attractive faces can be considered to be a form of visual reward. Previous imaging studies have reported activity in reward structures including orbitofrontal cortex and nucleus accumbens during presentation of attractive faces. Given that these stimuli appear to act as rewards, we set out to explore whether it was possible to establish conditioning in human subjects by pairing presentation of arbitrary affectively neutral stimuli with subsequent presentation of attractive and unattractive faces. Furthermore, we scanned human subjects with functional magnetic resonance imaging (fMRI) while they underwent this conditioning procedure to determine whether a reward-prediction error signal is engaged during learning with attractive faces as is known to be the case for learning with other types of reward such as juice and money. Subjects showed changes in behavioral ratings to the conditioned stimuli (CS) when comparing post- to preconditioning evaluations, notably for those CSs paired with attractive female faces. We used a simple Rescorla-Wagner learning model to generate a reward-prediction error signal and entered this into a regression analysis with the fMRI data. We found significant prediction error-related activity in the ventral striatum during conditioning with attractive compared with unattractive faces. These findings suggest that an arbitrary stimulus can acquire conditioned value by being paired with pleasant visual stimuli just as with other types of reward such as money or juice. This learning process elicits a reward-prediction error signal in a main target structure of dopamine neurons: the ventral striatum. The findings we describe here may provide insights into the neural mechanisms tapped into by advertisers seeking to influence behavioral preferences by repeatedly exposing consumers to simple associations between products and rewarding visual stimuli such as pretty faces.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The fusiform face area: a module in human extrastriate cortex specialized for face perception
Kanwisher, N., McDermott, J., & Chun, M. M. (1997) · The Journal of Neuroscience · doi:10.1523/jneurosci.17-11-04302.1997 · Cited by 7,738
Learning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148
Dion, K., Berscheid, E., & Walster, E. (1972) · Journal of Personality and Social Psychology · doi:10.1037/h0033731 · Cited by 3,865
Whalen, P. J., Rauch, S. L., Etcoff, N. L., McInerney, S. C., Lee, M. B., & Jenike, M. A. (1998) · The Journal of Neuroscience · doi:10.1523/jneurosci.18-01-00411.1998 · Cited by 2,205
Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088
Self-citationThe Orbitofrontal Cortex and Reward
Rolls, E. T. (2000) · Cerebral Cortex · doi:10.1093/cercor/10.3.284 · Cited by 1,595
Temporal difference models and reward-related learning in the human brain
O'Doherty, J. P., Dayan, P., Friston, K., Critchley, H., & Dolan, R. J. (2003) · Neuron · doi:10.1016/s0896-6273(03)00169-7 · Cited by 1,522
Self-citationThe neurobiology of social cognition
Adolphs, R. (2001) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(00)00202-6 · Cited by 1,432
Encoding Predictive Reward Value in Human Amygdala and Orbitofrontal Cortex
Gottfried, J. A., O'Doherty, J., & Dolan, R. J. (2003) · Science · doi:10.1126/science.1087919 · Cited by 1,165
Self-citationTracking the Hemodynamic Responses to Reward and Punishment in the Striatum
Delgado, M. R., Nystrom, L. E., Fissell, C., Noll, D. C., & Fiez, J. A. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.84.6.3072 · Cited by 1,116
Cited by
The reward circuit: linking primate anatomy and human imaging
Haber, S. N., & Knutson, B. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2009.129 · Cited by 3,718
Sescousse, G., Caldú, X., Segura, B., & Dreher, J.-C. (2013) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.02.002 · Cited by 782
Hare, T. A., O'Doherty, J., Camerer, C. F., Schultz, W., & Rangel, A. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.1309-08.2008 · Cited by 792
Self-citationHow prediction errors shape perception, attention, and motivation
den Ouden, H. E. M., Kok, P., & de Lange, F. P. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00548 · Cited by 512
Scott‐Van Zeeland, A. A., Dapretto, M., Ghahremani, D. G., Poldrack, R. A., & Bookheimer, S. Y. (2010) · Autism Research · doi:10.1002/aur.122 · Cited by 458
Neural mechanisms of observational learning
Burke, C. J., Tobler, P. N., Baddeley, M., & Schultz, W. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1003111107 · Cited by 367
The Architecture of Reward Value Coding in the Human Orbitofrontal Cortex
Sescousse, G., Redouté, J., & Dreher, J.-C. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.3501-10.2010 · Cited by 353
Oxytocin enhances the encoding of positive social memories in humans.
Guastella, A. J., Mitchell, P. B., & Mathews, F. (2008) · Biological Psychiatry · doi:10.1016/j.biopsych.2008.02.008 · Cited by 352
The role of the striatum in aversive learning and aversive prediction errors
Delgado, M. R., Li, J., Schiller, D., & Phelps, E. A. (2008) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2008.0161 · Cited by 328
Diekhof, E. K., Kaps, L., Falkai, P., & Gruber, O. (2012) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2012.02.007 · Cited by 331
Nucleus accumbens and impulsivity
Basar, K., Sesia, T., Groenewegen, H., Steinbusch, H. W. M., Visser-Vandewalle, V., & Temel, Y. (2010) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2010.08.007 · Cited by 280
Prestimulus alpha and mu activity predicts failure to inhibit motor responses
Mazaheri, A., Nieuwenhuis, I. L. C., van Dijk, H., & Jensen, O. (2009) · Human Brain Mapping · doi:10.1002/hbm.20763 · Cited by 262
Individual Attachment Style Modulates Human Amygdala and Striatum Activation during Social Appraisal
Vrtička, P., Andersson, F., Grandjean, D., Sander, D., & Vuilleumier, P. (2008) · PLoS ONE · doi:10.1371/journal.pone.0002868 · Cited by 260
The social evaluation of faces: a meta-analysis of functional neuroimaging studies
Mende-Siedlecki, P., Said, C. P., & Todorov, A. (2013) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsr090 · Cited by 193
Behavioral and Neural Properties of Social Reinforcement Learning
Jones, R. M., Somerville, L. H., Li, J., Ruberry, E. J., Libby, V., Glover, G., Voss, H. U., Ballon, D. J., & Casey, B. J. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.2972-11.2011 · Cited by 191
ALE meta-analysis on facial judgments of trustworthiness and attractiveness
Bzdok, D., Langner, R., Caspers, S., Kurth, F., Habel, U., Zilles, K., Laird, A., & Eickhoff, S. B. (2011) · Brain Structure and Function · doi:10.1007/s00429-010-0287-4 · Cited by 183
Cheetham, M. (2011) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2011.00126 · Cited by 176
The intrinsic value of visual information affects saccade velocities
Xu-Wilson, M., Zee, D. S., & Shadmehr, R. (2009) · Experimental Brain Research · doi:10.1007/s00221-009-1879-1 · Cited by 160
Neural and behavioral responses to attractiveness in adult and infant faces
Hahn, A. C., & Perrett, D. I. (2014) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2014.08.015 · Cited by 167
Appetitive motivation predicts the neural response to facial signals of aggression.
Beaver, J. D., Lawrence, A. D., Passamonti, L., & Calder, A. J. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.0033-08.2008 · Cited by 152
Adolescent-specific patterns of behavior and neural activity during social reinforcement learning
Jones, R. M., Somerville, L. H., Li, J., Ruberry, E. J., Powers, A., Mehta, N., Dyke, J., & Casey, B. J. (2014) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-014-0257-z · Cited by 127
Cerebral Correlates of Salient Prediction Error for Different Rewards and Punishments
Metereau, E., & Dreher, J.-C. (2013) · Cerebral Cortex · doi:10.1093/cercor/bhs037 · Cited by 114
Cooper, J. C., Dunne, S., Furey, T., & O'Doherty, J. P. (2012) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00114 · Cited by 101
Self-citationKagan, J. (2007) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2007.00049.x · Cited by 84
Evidence for model-based computations in the human amygdala during Pavlovian conditioning
Prévost, C., McNamee, D., Jessup, R. K., Bossaerts, P., & O'Doherty, J. P. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002918 · Cited by 79
“Many previous studies have shown that changes in RTs to a Pavlovian cue are correlated with changes in associative encoding between cues and behaviorally significant outcomes [13,34,36,42].”
BackgroundStriepens, N., Matusch, A., Kendrick, K. M., Mihov, Y., Elmenhorst, D., Becker, B., Lang, M., Coenen, H. H., Maier, W., Hurlemann, R., et al. (2014) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2013.09.026 · Cited by 71
Cooper, J. C., Dunne, S., Furey, T., & O'Doherty, J. P. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.2558-12.2012 · Cited by 45
Self-citation
Metadata
- Authors
- Bray, S., & O'Doherty, J.
- Venue
- Journal of Neurophysiology
- Publisher
- American Physiological Society
- Published
- 2007-04
- Volume
- 97
- Issue
- 4
- Pages
- 3036-3045
- ISSN
- 0022-3077 (ISSN-L)
- 1522-1598
- OpenAlex
- W2134368213
- Cited by
- 172
- References
- 21
- FWCI
- 5.08
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.