Closed-Loop Theta Stimulation in the Orbitofrontal Cortex Prevents Reward-Based Learning
Open accessThe DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Abstract
SUMMARY Neuronal oscillations in the frontal cortex have been hypothesized to play a role in the organization of high-level cognition. Within the orbitofrontal cortex (OFC), there is a prominent oscillation in the theta frequency (4–8 Hz) during reward-guided behavior, but it is unclear whether this oscillation has causal significance. One methodological challenge is that it is difficult to manipulate theta without affecting other neural signals, such as single-neuron firing rates. A potential solution is to use closed-loop control to record theta in real time and use this signal to control the application of electrical microstimulation to the OFC. Using this method, we show that theta oscillations in the OFC are critically important for reward-guided learning and that they are driven by theta oscillations in the hippocampus (HPC). The ability to disrupt OFC computations via spatially localized and temporally precise stimulation could lead to novel treatment strategies for neuropsychiatric disorders involving OFC dysfunction.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Theta oscillations in the hippocampus
Buzsáki, G. (2002) · Neuron · doi:10.1016/s0896-6273(02)00586-x · Cited by 3,332
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533
Common regions of the human frontal lobe recruited by diverse cognitive demands
Duncan, J., & Owen, A. M. (2000) · Trends in Neurosciences · doi:10.1016/s0166-2236(00)01633-7 · Cited by 2,498
Neurons in the orbitofrontal cortex encode economic value
Padoa-Schioppa, C., & Assad, J. A. (2006) · Nature · doi:10.1038/nature04676 · Cited by 1,598
Limbic connections of the orbital and medial prefrontal cortex in macaque monkeys
Carmichael, S. T., & Price, J. L. (1995) · Journal of Comparative Neurology · doi:10.1002/cne.903630408 · Cited by 1,197
Theta rhythms coordinate hippocampal-prefrontal interactions in a spatial memory task
Jones, M. W., & Wilson, M. A. (2005) · PLoS Biology · doi:10.1371/journal.pbio.0030402 · Cited by 1,036 · cited 1×
“In rats, single neurons in the medial prefrontal cortex (PFC) have been shown to phase-lock to hippocampal theta (Jones and Wilson, 2005).”
BackgroundComputational psychiatry as a bridge from neuroscience to clinical applications
Huys, Q. J. M., Maia, T. V., & Frank, M. J. (2016) · Nature Neuroscience · doi:10.1038/nn.4238 · Cited by 1,002
Dolan, R. J., & Dayan, P. (2013) · Neuron · doi:10.1016/j.neuron.2013.09.007 · Cited by 977
Awake hippocampal sharp-wave ripples support spatial memory
Jadhav, S. P., Kemere, C., German, P. W., & Frank, L. M. (2012) · Science · doi:10.1126/science.1217230 · Cited by 924 · cited 1×
“A potential solution to this problem is to use closed-loop control (Jadhav et al., 2012; Siegle and Wilson, 2014), where the theta oscillation is recorded in real time and used to control the application of electrical microstimulation.”
BackgroundScaling Brain Size, Keeping Timing: Evolutionary Preservation of Brain Rhythms
Buzsáki, G., Logothetis, N., & Singer, W. (2013) · Neuron · doi:10.1016/j.neuron.2013.10.002 · Cited by 886 · cited 2×
“Such oscillations could facilitate spike timing-dependent plasticity (Buzsáki et al., 2013) and ensure synchronization of neuronal populations responsible for processing different aspects of taskrelevant events (van Atteveldt et al.”
BackgroundOrbitofrontal Cortex as a Cognitive Map of Task Space
Wilson, R. C., Takahashi, Y. K., Schoenbaum, G., & Niv, Y. (2014) · Neuron · doi:10.1016/j.neuron.2013.11.005 · Cited by 885
Benchenane, K., Peyrache, A., Khamassi, M., Tierney, P. L., Gioanni, Y., Battaglia, F. P., & Wiener, S. I. (2010) · Neuron · doi:10.1016/j.neuron.2010.05.013 · Cited by 872 · cited 1×
“Increased theta coherence between the medial PFC and HPC has also been observed at the choice point of T mazes during learning (Benchenane et al., 2010) and can predict working memory performance (Hyman et al.”
BackgroundGremel, C. M., & Costa, R. M. (2013) · Nature Communications · doi:10.1038/ncomms3264 · Cited by 618 · cited 1×
“, 2015), and optogenetic activation of the OFC can shift behavior away from habitual behavior toward goal-directed behavior (Gremel and Costa, 2013), supporting the notion of using OFC closed-loop microstimulation as a treatment strategy.”
BackgroundThe ubiquity of model-based reinforcement learning
Doll, B. B., Simon, D. A., & Daw, N. D. (2012) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.08.003 · Cited by 380
McKenzie, S., Frank, A. J., Kinsky, N. R., Porter, B., Rivière, P. D., & Eichenbaum, H. (2014) · Neuron · doi:10.1016/j.neuron.2014.05.019 · Cited by 373 · cited 1×
“This contrasts with the HPC, where neurons encode sensorimotor contingencies in addition to spatial and temporal contexts, precisely the kind of information that is essential for building task models (Howard et al., 2014; McKenzie et al., 2014).”
BackgroundGamma and beta bursts during working memory readout suggest roles in its volitional control
Lundqvist, M., Herman, P., Warden, M. R., Brincat, S. L., & Miller, E. K. (2018) · Nature Communications · doi:10.1038/s41467-017-02791-8 · Cited by 299 · cited 1×
“Oscillations may be important for organizing cognitive processes (Canolty et al., 2006, 2010; Loonis et al., 2017; Lundqvist et al., 2018).”
BackgroundOscillatory phase coupling coordinates anatomically dispersed functional cell assemblies
Canolty, R. T., Ganguly, K., Kennerley, S. W., Cadieu, C. F., Koepsell, K., Wallis, J. D., & Carmena, J. M. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1008306107 · Cited by 292
Self-citationRefining deep brain stimulation to emulate optogenetic treatment of synaptic pathology
Creed, M., Pascoli, V. J., & Lüscher, C. (2015) · Science · doi:10.1126/science.1260776 · Cited by 280
Triple dissociation of attention and decision computations across prefrontal cortex
Hunt, L. T., Malalasekera, W. M. N., de Berker, A. O., Miranda, B., Farmer, S. F., Behrens, T. E. J., & Kennerley, S. W. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0239-5 · Cited by 222
Rudebeck, P. H., Saunders, R. C., Lundgren, D. A., & Murray, E. A. (2017) · Neuron · doi:10.1016/j.neuron.2017.07.042 · Cited by 170
Schema cells in the macaque hippocampus
Baraduc, P., Duhamel, J.-R., & Wirth, S. (2019) · Science · doi:10.1126/science.aav5404 · Cited by 123
Cited by
Post-error recruitment of frontal sensory cortical projections promotes attention in mice
Norman, K. J., Riceberg, J. S., Koike, H., Bateh, J., McCraney, S. E., Caro, K., Kato, D., Liang, A., Yamamuro, K., Flanigan, M. E., et al. (2021) · Neuron · doi:10.1016/j.neuron.2021.02.001 · Cited by 66
Is the core function of orbitofrontal cortex to signal values or make predictions?
Zhou, J., Gardner, M. P., & Schoenbaum, G. (2021) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2021.02.011 · Cited by 57
Causal manipulation of self-other mergence in the dorsomedial prefrontal cortex
Wittmann, M. K., Trudel, N., Trier, H. A., Klein-Flügge, M. C., Sel, A., Verhagen, L., & Rushworth, M. F. S. (2021) · Neuron · doi:10.1016/j.neuron.2021.05.027 · Cited by 55
Large-scale, closed-loop interrogation of neural circuits underlying cognition.
Khodagholy, D., Ferrero, J. J., Park, J., Zhao, Z., & Gelinas, J. N. (2022) · Trends in Neurosciences · doi:10.1016/j.tins.2022.10.003 · Cited by 27
“Disruption of theta synchronization and the locking of neural spiking to particular phases of the theta oscillation by closed-loop microstimulation impaired response to changing value contingencies and resulted in decreased reward obtained by the animal [29].”
BackgroundTemporally resolved neural dynamics underlying handwriting
Pei, L., Longcamp, M., Leung, F. K.-S., & Ouyang, G. (2021) · NeuroImage · doi:10.1016/j.neuroimage.2021.118578 · Cited by 23
Metadata
- Authors
- Knudsen, E. B., & Wallis, J. D.
- Venue
- Neuron
- Publisher
- Elsevier BV
- Published
- 2020-05
- Volume
- 106
- Issue
- 3
- Pages
- 537-547.e4
- ISSN
- 0896-6273 (ISSN-L)
- OpenAlex
- W3010979822
- Cited by
- 111
- References
- 21
- FWCI
- 7.51
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.