Feedback-Driven Trial-by-Trial Learning in Autism Spectrum Disorders
Open accessThe DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: Impairments in learning are central to autism spectrum disorders. The authors investigated the cognitive and neural basis of these deficits in young adults with autism spectrum disorders using a well-characterized probabilistic reinforcement learning paradigm. METHOD: The probabilistic selection task was implemented among matched participants with autism spectrum disorders (N=22) and with typical development (N=25), aged 18-40 years, using rapid event-related functional MRI. Participants were trained to choose the correct stimulus in high-probability (AB), medium-probability (CD), and low-probability (EF) pairs, presented with valid feedback 80%, 70%, and 60% of the time, respectively. Whole-brain voxel-wise and parametric modulator analyses examined early and late learning during the stimulus and feedback epochs of the task. RESULTS: The groups exhibited comparable performance on medium- and low-probability pairs. Typically developing persons showed higher accuracy on the high-probability pair, better win-stay performance (selection of the previously rewarded stimulus on the next trial of that type), and more robust recruitment of the anterior and medial prefrontal cortex during the stimulus epoch, suggesting development of an intact reward-based working memory for recent stimulus values. Throughout the feedback epoch, individuals with autism spectrum disorders exhibited greater recruitment of the anterior cingulate and orbito-frontal cortices compared with individuals with typical development, indicating continuing trial-by-trial activity related to feedback processing. CONCLUSIONS: Individuals with autism spectrum disorders exhibit learning deficits reflecting impaired ability to develop an effective reward-based working memory to guide stimulus selection. Instead, they continue to rely on trial-by-trial feedback processing to support learning dependent upon engagement of the anterior cingulate and orbito-frontal cortices.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Power failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641
AN IMPLICIT TECHNOLOGY OF GENERALIZATION 1
Stokes, T. F., & Baer, D. M. (1977) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.1977.10-349 · Cited by 3,351 · cited 1×
“However, they are impaired in goal-directed learning (3), rapid processing of ambiguous stimulus feedback contingencies (4, 5), and generalization of learning to new contexts (6).”
Emotional processing in anterior cingulate and medial prefrontal cortex
Etkin, A., Egner, T., & Kalisch, R. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.11.004 · Cited by 3,059 · cited 1×
“However, sustained anterior cingulate activation has been associated with anxiety disorders (39), poorer emotion regulation (40), and developmental immaturity (41–43).”
Dawson, G., Rogers, S., Munson, J., Smith, M., Winter, J., Greenson, J., Donaldson, A., & Varley, J. (2010) · Pediatrics · doi:10.1542/peds.2009-0958 · Cited by 2,835
The variable nature of cognitive control: a dual mechanisms framework
Braver, T. S. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.12.010 · Cited by 2,482 · cited 1×
“To the extent the prefrontal cortex cannot be brought online “proactively” to sustain task- or reward-based working memories, the learner may engage in a less efficient, slower strategy whereby rules and task memories are retrieved from the hippocampus and, to the extent possible, the prefrontal cortex “reactively” on…”
The social motivation theory of autism
Chevallier, C., Kohls, G., Troiani, V., Brodkin, E. S., & Schultz, R. T. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2012.02.007 · Cited by 2,072 · cited 1×
“Most other studies of learning and reward have examined aspects of the social motivation theory (28), which proposes that individuals with autism spectrum disorders exhibit early impairments in learning from social rewards provided by caregivers, leading to a cascade of atypical cognitive, social, and language develop…”
By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism
Frank, M. J., Seeberger, L. C., & O'Reilly, R. C. (2004) · Science · doi:10.1126/science.1102941 · Cited by 1,964
Self-citationDetecting activations in PET and fMRI: levels of inference and power
Friston, K. J., Holmes, A., Poline, J.-B., Price, C. J., & Frith, C. D. (1996) · NeuroImage · doi:10.1006/nimg.1996.0074 · Cited by 1,148 · cited 1×
“01 (27) and report clusters that are family-wise error-corrected at a p value ,0.”
The Role of Emotion Regulation in Autism Spectrum Disorder
Mazefsky, C. A., Herrington, J., Siegel, M., Scarpa, A., Maddox, B. B., Scahill, L., & White, S. W. (2013) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2013.05.006 · Cited by 881
Estimating sample size in functional MRI (fMRI) neuroimaging studies: Statistical power analyses
Desmond, J. E., & Glover, G. H. (2002) · Journal of Neuroscience Methods · doi:10.1016/s0165-0270(02)00121-8 · Cited by 716 · cited 2×
“Additional confidence in power estimates was provided by a simulation analysis described by Desmond and Glover (21), in which power curves were derived with an alpha of 0.002 (two-tailed) for a fixed signal change of 50% and fixed inter-and intrasubject variability showing that 24 subjects per group in a two-group stu…”
InfluentialNeuropsychologic functioning in autism: Profile of a complex information processing disorder.
MINSHEW, N. J., GOLDSTEIN, G., & SIEGEL, D. J. (1997) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617797003032 · Cited by 572 · cited 2×
“First, we examined the results in light of the widely held neurocognitive view that autism spectrum disorders involve intact simple versus complex information processing (1).”
Scott‐Van Zeeland, A. A., Dapretto, M., Ghahremani, D. G., Poldrack, R. A., & Bookheimer, S. Y. (2010) · Autism Research · doi:10.1002/aur.122 · Cited by 458 · cited 1×
“Second, studies of social motivation theory demonstrate that persons with autism anticipate and seek social (29, 30), and even nonsocial (5, 31, 32), rewards less than persons with typical development and show decreased recruitment of striatal brain regions.”
Autism: Many Genes, Common Pathways?
Geschwind, D. H. (2008) · Cell · doi:10.1016/j.cell.2008.10.016 · Cited by 328 · cited 1×
“This may lead to larger, more replicable studies (20) and to sufficiently large samples to permit subgroup analyses of the heterogeneous autism spectrum disorders phenotype (46).”
Reward circuitry function in autism spectrum disorders
Dichter, G. S., Felder, J. N., Green, S. R., Rittenberg, A. M., Sasson, N. J., & Bodfish, J. W. (2012) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsq095 · Cited by 296
Mumford, J. A., & Nichols, T. E. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2007.07.061 · Cited by 252
Reward circuitry function in autism during face anticipation and outcomes
Dichter, G. S., Richey, J. A., Rittenberg, A. M., Sabatino, A., & Bodfish, J. W. (2012) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-011-1221-1 · Cited by 222
Neural correlates of reward in autism
Schmitz, N., Rubia, K., van Amelsvoort, T., Daly, E., Smith, A., & Murphy, D. G. M. (2008) · British Journal of Psychiatry · doi:10.1192/bjp.bp.107.036921 · Cited by 153
Self-citationNeural correlates of developmental differences in risk estimation and feedback processing
van Leijenhorst, L., Crone, E. A., & Bunge, S. A. (2006) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2006.02.002 · Cited by 146
Cognitive control in autism spectrum disorders
Solomon, M., Ozonoff, S. J., Cummings, N., & Carter, C. S. (2008) · International Journal of Developmental Neuroscience · doi:10.1016/j.ijdevneu.2007.11.001 · Cited by 124
Self-citationProbabilistic reinforcement learning in adults with autism spectrum disorders
Solomon, M., Smith, A. C., Frank, M. J., Ly, S., & Carter, C. S. (2011) · Autism Research · doi:10.1002/aur.177 · Cited by 97 · cited 5×
“Given past findings that early and late learning can be discriminated in this task because reward-based working memory takes time to develop (5, 25), we delineated runs 1 and 2 as the early learning stage and runs 3 and 4 as the later learning stage of the task.”
InfluentialSelf-citationSolomon, M., Yoon, J. H., Ragland, J. D., Niendam, T. A., Lesh, T. A., Fairbrother, W., & Carter, C. S. (2014) · Biological Psychiatry · doi:10.1016/j.biopsych.2013.08.036 · Cited by 78 · cited 1×
“Finally, given their impairments in reward-based working memory and dysregulated positive feedback processing, we predicted that the autism spectrum disorders group, compared with the typically developing group, would exhibit amore reactive pattern of task performance involving less proactive cognitive control and neu…”
Self-citationIMAGEN consortium, Tzschoppe, J., Nees, F., Banaschewski, T., Barker, G. J., Büchel, C., Conrod, P. J., Garavan, H., Heinz, A., Loth, E., et al. (2014) · Neuropsychopharmacology · doi:10.1038/npp.2013.287 · Cited by 49
Transitive inference in adults with autism spectrum disorders
Solomon, M., Frank, M. J., Smith, A. C., Ly, S., & Carter, C. S. (2011) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-011-0040-3 · Cited by 29
Self-citation
Cited by
Evaluation of the Social Motivation Hypothesis of Autism: A Systematic Review and Meta-analysis
Clements, C. C., Zoltowski, A. R., Yankowitz, L. D., Yerys, B. E., Schultz, R. T., & Herrington, J. D. (2018) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2018.1100 · Cited by 316
The drift diffusion model as the choice rule in reinforcement learning
Pedersen, M. L., Frank, M. J., & Biele, G. (2017) · Psychonomic Bulletin & Review · doi:10.3758/s13423-016-1199-y · Cited by 283
Self-citationUddin, L. Q. (2021) · Biological Psychiatry · doi:10.1016/j.biopsych.2020.05.010 · Cited by 116
“According to these models, inflexibility results from dysregulation of dopamine circuits leading to rigid behavior that is not informed by learning (34,35).”
BackgroundHartman, C. A., Geurts, H. M., Franke, B., Buitelaar, J. K., & Rommelse, N. N. J. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.09.003 · Cited by 111
Children on the autism spectrum update their behaviour in response to a volatile environment
Manning, C., Kilner, J., Neil, L., Karaminis, T., & Pellicano, E. (2017) · Developmental Science · doi:10.1111/desc.12435 · Cited by 103
“The participants involved in the current study differed substantially from those tested by Robic et al. (2015) and Solomon et al. (2011, 2015), who tested adult participants, and D’Cruz et al. (2013), who tested participants of a wide age range (between 8 and 44 years).”
Result
Metadata
- Authors
- Solomon, M., Frank, M. J., Ragland, J. D., Smith, A. C., Niendam, T. A., Lesh, T. A., Grayson, D. S., Beck, J. S., Matter, J. C., & Carter, C. S.
- Venue
- American Journal of Psychiatry
- Published
- 2015-02-01
- Volume
- 172
- Issue
- 2
- Pages
- 173-181
- ISSN
- 0002-953X (ISSN-L)
- 1535-7228
- OpenAlex
- W2116364570
- Cited by
- 57
- References
- 23
- FWCI
- 2.55
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.