Neural Computations Underlying Causal Structure Learning
Open accessThe DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Abstract
Abstract Behavioral evidence suggests that beliefs about causal structure constrain associative learning, determining which stimuli can enter into association, as well as the functional form of that association. Bayesian learning theory provides one mechanism by which structural beliefs can be acquired from experience, but the neural basis of this mechanism is unknown. A recent study (Gershman, 2017) proposed a unified account of the elusive role of “context” in animal learning based on Bayesian updating of beliefs about the structure of causal relationships between contexts and cues in the environment. The model predicts that the computations which arbitrate between these abstract causal structures are distinct from the computations which learn the associations between particular stimuli under a given structure. In this study, we used fMRI with male and female human subjects to interrogate the neural correlates of these two distinct forms of learning. We show that structure learning signals are encoded in rostrolateral prefrontal cortex and the angular gyrus, anatomically distinct from correlates of associative learning. Within-subject variability in the encoding of these learning signals predicted variability in behavioral performance. Moreover, representational similarity analysis suggests that some regions involved in both forms of learning, such as parts of the inferior frontal gyrus, may also encode the full probability distribution over causal structures. These results provide evidence for a neural architecture in which structure learning guides the formation of associations. Significance Statement Animals are able to infer the hidden structure behind causal relations between stimuli in the environment, allowing them to generalize this knowledge to stimuli they have never experienced before. A recently published computational model based on this idea provided a parsimonious account of a wide range of phenomena reported in the animal learning literature, suggesting that the neural mechanisms dedicated to learning this hidden structure are distinct from those dedicated to acquiring particular associations between stimuli. Here we validate this model by measuring brain activity during a task which dissociates structure learning from associative learning. We show that different brain networks underlie the two forms of learning and that the neural signal corresponding to structure learning predicts future behavioral performance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Representational similarity analysis-connecting the branches of systems neuroscience
Kriegeskorte, N. (2008) · Frontiers in Systems Neuroscience · doi:10.3389/neuro.06.004.2008 · Cited by 3,355
A theory of attention: Variations in the associability of stimuli with reinforcement
Mackintosh, N. J. (1975) · Psychological Review · doi:10.1037/h0076778 · Cited by 2,733
Evidence for a Frontoparietal Control System Revealed by Intrinsic Functional Connectivity
Vincent, J. L., Kahn, I., Snyder, A. Z., Raichle, M. E., & Buckner, R. L. (2008) · Journal of Neurophysiology · doi:10.1152/jn.90355.2008 · Cited by 1,869 · cited 1×
“One candidate region where such top-down predictions might originate is lateral prefrontal cortex, an area with strong functional connectivity with the inferior parietal lobule (IPL, which includes AG) (Vincent et al., 2008; Boorman et al., 2009).”
BackgroundMoeller, S., Yacoub, E., Olman, C. A., Auerbach, E., Strupp, J., Harel, N., & Uğurbil, K. (2010) · Magnetic Resonance in Medicine · doi:10.1002/mrm.22361 · Cited by 1,586 · cited 2×
“Functional images were acquired using a T2*-weighted echo-planar imaging (EPI) pulse sequence that employed multiband RF pulses and Simultaneous Multi-Slice (SMS) acquisition (Moeller et al., 2010; Feinberg et al., 2010; Xu et al., 2013).”
MethodThe Angular Gyrus: Multiple Functions and Multiple Subdivisions
Seghier, M. L. (2013) · The Neuroscientist · doi:10.1177/1073858412440596 · Cited by 1,585
Temporal difference models and reward-related learning in the human brain
O'Doherty, J. P., Dayan, P., Friston, K., Critchley, H., & Dolan, R. J. (2003) · Neuron · doi:10.1016/s0896-6273(03)00169-7 · Cited by 1,522 · cited 1×
“We found activations related to weight updating in regions commonly linked to reinforcement learning, such as the ventral striatum, an area that has been associated with the prediction error signal in temporal difference reinforcement learning (O’Doherty et al., 2003; Gläscher et al., 2010).”
BackgroundMultiplexed echo planar imaging for sub-second whole brain FMRI and fast diffusion imaging
Feinberg, D. A., Moeller, S., Smith, S. M., Auerbach, E., Ramanna, S., Glasser, M. F., Miller, K. L., Ugurbil, K., & Yacoub, E. (2010) · PLoS ONE · doi:10.1371/journal.pone.0015710 · Cited by 1,296
An information theoretical approach to prefrontal executive function
Koechlin, E., & Summerfield, C. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.04.005 · Cited by 1,183
Gläscher, J., Daw, N., Dayan, P., & O'Doherty, J. P. (2010) · Neuron · doi:10.1016/j.neuron.2010.04.016 · Cited by 1,166
Dorsal anterior cingulate cortex: A role in reward-based decision making
Bush, G., Vogt, B. A., Holmes, J., Dale, A. M., Greve, D., Jenike, M. A., & Rosen, B. R. (2002) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.012470999 · Cited by 1,096
Cited by
The neural dynamics of hierarchical Bayesian causal inference in multisensory perception
Rohe, T., Ehlis, A.-C., & Noppeney, U. (2019) · Nature Communications · doi:10.1038/s41467-019-09664-2 · Cited by 187
Dopaminergic basis for signaling belief updates, but not surprise, and the link to paranoia
Nour, M. M., Dahoun, T., Schwartenbeck, P., Adams, R. A., FitzGerald, T. H. B., Coello, C., Wall, M. B., Dolan, R. J., & Howes, O. D. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1809298115 · Cited by 101
Radulescu, A., Shin, Y. S., & Niv, Y. (2021) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-092920-120559 · Cited by 63
A model of conceptual bootstrapping in human cognition
Zhao, B., Lucas, C. G., & Bramley, N. R. (2023) · Nature Human Behaviour · doi:10.1038/s41562-023-01719-1 · Cited by 30
Mahmoodi, A., Luo, S., Harbison, C., Piray, P., & Rushworth, M. F. S. (2024) · Neuron · doi:10.1016/j.neuron.2024.09.001 · Cited by 17
Metadata
- Authors
- Tomov, M. S., Dorfman, H. M., & Gershman, S. J.
- Venue
- The Journal of Neuroscience
- Publisher
- Society for Neuroscience
- Published
- 2018-06-29
- Volume
- 38
- Issue
- 32
- Pages
- 7143-7157
- ISSN
- 0270-6474 (ISSN-L)
- 1529-2401
- OpenAlex
- W2953170694
- Cited by
- 60
- References
- 37
- FWCI
- 4.10
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Neural Computations Underlying Causal Structure Learning. https://app.cochat.ai/papers/10.1523/jneurosci.3336-17.2018
- The paper
- Tomov, M. S., Dorfman, H. M., & Gershman, S. J. (2018). Neural Computations Underlying Causal Structure Learning. The Journal of Neuroscience. https://doi.org/10.1523/jneurosci.3336-17.2018
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.