Operant Reward Learning in Aplysia : Neuronal Correlates and Mechanisms

Brembs, Björn; Lorenzetti, Fred D.; Reyes, Fredy D.; Baxter, Douglas A.; Byrne, John H.

doi:10.1126/science.1069434

Cited by 338Memory and Neural MechanismsNeuroscience and Neuropharmacology ResearchNeurobiology and Insect Physiology Research

Operant Reward Learning in Aplysia : Neuronal Correlates and Mechanisms

Open access

Brembs, Björn, Lorenzetti, Fred D., Reyes, Fredy D., Baxter, Douglas A., Byrne, John H.·2002·Science

DOI 10.1126/science.1069434

Open this paper in CoChat — free account

Abstract

Operant conditioning is a form of associative learning through which an animal learns about the consequences of its behavior. Here, we report an appetitive operant conditioning procedure in Aplysia that induces long-term memory. Biophysical changes that accompanied the memory were found in an identified neuron (cell B51) that is considered critical for the expression of behavior that was rewarded. Similar cellular changes in B51 were produced by contingent reinforcement of B51 with dopamine in a single-cell analog of the operant procedure. These findings allow for the detailed analysis of the cellular and molecular processes underlying operant conditioning.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1126/science.1069434

Cites

22 of 22 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Aplysia californica is only capable of modifying the strength of preexisting associations between reflex-eliciting stimuli, and thus its mode of associative learning does not meet UAL condition ii.
“For example, Aplysia californica is only capable of modifying the strength of preexisting associations between reflex-eliciting stimuli, and thus its mode of AL does not meet condition ii (see Carew et al., 1981; Hawkins et al., 1983; Brembs et al., 2002; Hawkins and Byrne, 2015 provide a review).”
From The Transition to Minimal Consciousness through the Evolution of Associative Learning (2016) · cites this paper as Brembs et al., 2002
The paper distinguishes learning about relations between stimuli from operant learning about the consequences of behavior (main text, p. 1). It reports that Aplysia acquired an operant memory when reinforcement was contingent on biting (main text, p. 2), contrary to the claim that it can only modify preexisting associations between reflex-eliciting stimuli. The paper does not assess UAL condition ii. (LLM, conf=0.88)
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Multiple reward signals in the brain
Schultz, W. (2000) · Nature Reviews Neuroscience · doi:10.1038/35044563 · Cited by 1,303 · see citing works
Dopamine responses comply with basic assumptions of formal learning theory
Waelti, P., Dickinson, A., & Schultz, W. (2001) · Nature · doi:10.1038/35083500 · Cited by 1,018 · see citing works
A cellular mechanism of reward-related learning
Reynolds, J. N. J., Hyland, B. I., & Wickens, J. R. (2001) · Nature · doi:10.1038/35092560 · Cited by 879 · see citing works
An identified neuron mediates the unconditioned stimulus in associative olfactory learning in honeybees
Hammer, M. (1993) · Nature · doi:10.1038/366059a0 · Cited by 692 · see citing works
A Cellular Mechanism of Classical Conditioning in Aplysia : Activity-Dependent Amplification of Presynaptic Facilitation
Hawkins, R. D., Abrams, T. W., Carew, T. J., & Kandel, E. R. (1983) · Science · doi:10.1126/science.6294833 · Cited by 617 · see citing works
Localization of a Short-Term Memory in Drosophila
Zars, T. D., Fischer, M., Schulz, R. A., & Heisenberg, M. (2000) · Science · doi:10.1126/science.288.5466.672 · Cited by 600 · see citing works
Associative Conditioning of Single Sensory Neurons Suggests a Cellular Mechanism for Learning
Walters, E. T., & Byrne, J. H. (1983) · Science · doi:10.1126/science.6294834 · Cited by 390 · see citing works
Inhibitory Cerebello-Olivary Projections and Blocking Effect in Classical Conditioning
Kim, J. J., Krupa, D. J., & Thompson, R. F. (1998) · Science · doi:10.1126/science.279.5350.570 · Cited by 211 · see citing works
In vivo buccal nerve activity that distinguishes ingestion from rejection can be used to predict behavioral transitions in Aplysia
Morton, D. W., & Chiel, H. J. (1993) · Journal of Comparative Physiology A · doi:10.1007/bf00214712 · Cited by 190 · see citing works
A Systems Approach to the Cellular Analysis of Associative Learning in the Pond Snail LymnaeaPreprint
Benjamin, P. R., Staras, K., & Kemenes, G. (2000) · Learning & Memory · doi:10.1101/lm.7.3.124 · Cited by 167 · see citing works
Contingent-Dependent Enhancement of Rhythmic Motor Patterns: AnIn VitroAnalog of Operant Conditioning
Nargeot, R., Baxter, D. A., & Byrne, J. H. (1997) · Journal of Neuroscience · doi:10.1523/jneurosci.17-21-08093.1997 · Cited by 124 · see citing works
In Vitro Analog of Operant Conditioning in Aplysia . I. Contingent Reinforcement Modifies the Functional Dynamics of an Identified Neuron
Nargeot, R., Baxter, D. A., & Byrne, J. H. (1999) · Journal of Neuroscience · doi:10.1523/jneurosci.19-06-02247.1999 · Cited by 122 · see citing works
In VitroAnalog of Operant Conditioning inAplysia. II. Modifications of the Functional Dynamics of an Identified Neuron Contribute to Motor Pattern Selection
Nargeot, R., Baxter, D. A., & Byrne, J. H. (1999) · Journal of Neuroscience · doi:10.1523/jneurosci.19-06-02261.1999 · Cited by 112 · see citing works
Identification and Characterization of Catecholaminergic Neuron B65, Which Initiates and Modifies Patterned Activity in the Buccal Ganglia of Aplysia
Kabotyanski, E. A., Baxter, D. A., & Byrne, J. H. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.79.2.605 · Cited by 107 · see citing works
Dopaminergic Synapses Mediate Neuronal Changes in an Analogue of Operant Conditioning
Nargeot, R., Baxter, D. A., Patterson, G. W., & Byrne, J. H. (1999) · Journal of Neurophysiology · doi:10.1152/jn.1999.81.4.1983 · Cited by 104 · see citing works
Classical Conditioning of Feeding inAplysia: I. Behavioral Analysis
Lechner, H., Baxter, D. A., & Byrne, J. H. (2000) · Journal of Neuroscience · doi:10.1523/jneurosci.20-09-03369.2000 · Cited by 90 · see citing works
Multiple Memory Processes Following Training That a Food Is Inedible in AplysiaPreprint
Botzer, D., Markovich, S., & Susswein, A. J. (1998) · Learning & Memory · doi:10.1101/lm.5.3.204 · Cited by 66 · see citing works
Classical Conditioning of Feeding inAplysia: II. Neurophysiological Correlates
Lechner, H., Baxter, D. A., & Byrne, J. H. (2000) · Journal of Neuroscience · doi:10.1523/jneurosci.20-09-03377.2000 · Cited by 57 · see citing works
Identification of the neural pathway for reinforcement of feeding when Aplysia learn that food is inedible
Schwarz, M., & Susswein, A. J. (1986) · Journal of Neuroscience · doi:10.1523/jneurosci.06-05-01528.1986 · Cited by 49 · see citing works
Mechanisms of simple motor learning
Hoyle, G. (1979) · Trends in Neurosciences · doi:10.1016/0166-2236(79)90060-2 · Cited by 39 · see citing works
Operant conditioning of head-waving in Aplysia. III. Cellular analysis of possible reinforcement pathways
Cook, D., & Carew, T. (1989) · Journal of Neuroscience · doi:10.1523/jneurosci.09-09-03115.1989 · Cited by 32 · see citing works
Synaptic mechanisms in invertebrate pattern generation
Cropper, E. C., & Weiss, K. R. (1996) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(96)80035-3 · Cited by 15 · see citing works

Flagged first, then by citations

Sorted by citations

Getting formal with dopamine and reward
Schultz, W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00967-4 · Cited by 2,574 · see citing works
The Molecular and Systems Biology of Memory
Kandel, E. R., Dudai, Y., & Mayford, M. R. (2014) · Cell · doi:10.1016/j.cell.2014.03.001 · Cited by 1,134 · see citing works
Memory and Addiction
Kelley, A. E. (2004) · Neuron · doi:10.1016/j.neuron.2004.09.016 · Cited by 773 · see citing works
Updating dopamine reward signals
Schultz, W. (2013) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.11.012 · Cited by 651 · see citing works
The Restless Engram: Consolidations Never End
Dudai, Y. (2012) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-062111-150500 · Cited by 644 · see citing works
Behavioral functions of the mesolimbic dopaminergic system: An affective neuroethological perspective
Alcaro, A., Huber, R., & Panksepp, J. (2007) · Brain Research Reviews · doi:10.1016/j.brainresrev.2007.07.014 · Cited by 614 · see citing works
Long-Term Plasticity of Intrinsic Excitability: Learning Rules and MechanismsPreprint
Daoudal, G., & Debanne, D. (2003) · Learning & Memory · doi:10.1101/lm.64103 · Cited by 537 · see citing works
Writing Memories with Light-Addressable Reinforcement Circuitry
Claridge-Chang, A., Roorda, R. D., Vrontou, E., Sjulson, L., Li, H., Hirsh, J., & Miesenböck, G. (2009) · Cell · doi:10.1016/j.cell.2009.08.034 · Cited by 484 · see citing works
Neuronal control of leech behavior
Kristan, W. B., Calabrese, R. L., & Friesen, W. O. (2005) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2005.09.004 · Cited by 401 · see citing works
Serotonin in Affective Control
Dayan, P., & Huys, Q. J. M. (2009) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.051508.135607 · Cited by 381 · see citing works
Introduction to spiking neural networks: Information processing, learning and applications
Ponulak, F., & Kasiński, A. (2011) · Acta Neurobiologiae Experimentalis · doi:10.55782/ane-2011-1862 · Cited by 369 · see citing works
Neural mechanisms of reward-related motor learning
Wickens, J. R., Reynolds, J. N., & Hyland, B. I. (2003) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2003.10.013 · Cited by 284 · see citing works
Order in Spontaneous Behavior
Maÿe, A., Hsieh, C., Sugihara, G., & Brembs, B. (2007) · PLoS ONE · doi:10.1371/journal.pone.0000443 · Cited by 274 · see citing works
More than synaptic plasticity: role of nonsynaptic plasticity in learning and memory
Mozzachiodi, R., & Byrne, J. H. (2009) · Trends in Neurosciences · doi:10.1016/j.tins.2009.10.001 · Cited by 273 · see citing works
Towards a scientific concept of free will as a biological trait: spontaneous actions and decision-making in invertebrates
Brembs, B. (2010) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2010.2325 · Cited by 254 · see citing works
Dopaminergic stimulation of local protein synthesis enhances surface expression of GluR1 and synaptic transmission in hippocampal neurons
Smith, W. B., Starck, S. R., Roberts, R. W., & Schuman, E. M. (2005) · Neuron · doi:10.1016/j.neuron.2005.01.015 · Cited by 252 · see citing works
The Roles of Dopamine and Related Compounds in Reward-Seeking Behavior Across Animal Phyla
Barron, A. B., Søvik, E., & Cornish, J. L. (2010) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2010.00163 · Cited by 228 · see citing works
Human neural learning depends on reward prediction errors in the blocking paradigm.
Tobler, P. N., O’Doherty, J. P., Dolan, R. J., & Schultz, W. (2006) · Journal of Neurophysiology · doi:10.1152/jn.00762.2005 · Cited by 209 · see citing works
Associative Learning in Invertebrates
Hawkins, R. D., & Byrne, J. H. (2015) · Cold Spring Harbor Perspectives in Biology · doi:10.1101/cshperspect.a021709 · Cited by 199 · see citing works
The Edge of Sentience: Risk and Precaution in Humans, Other Animals, and AI
Birch, J. (2024) · doi:10.1093/9780191966729.001.0001 · Cited by 236 · see citing works
Learning in Aplysia: looking at synaptic plasticity from both sides
Roberts, A. C., & Glanzman, D. L. (2003) · Trends in Neurosciences · doi:10.1016/j.tins.2003.09.014 · Cited by 157 · see citing works
Donald O. Hebb's synapse and learning rule: a history and commentary
Cooper, S. J. (2004) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2004.09.009 · Cited by 159 · see citing works
Dopamine Dysfunction in Borderline Personality Disorder: A Hypothesis
Friedel, R. O. (2004) · Neuropsychopharmacology · doi:10.1038/sj.npp.1300424 · Cited by 148 · see citing works
Invertebrate learning and cognition: relating phenomena to neural substrate
Perry, C. J., Barron, A. B., & Cheng, K. (2013) · Wiley Interdisciplinary Reviews Cognitive Science · doi:10.1002/wcs.1248 · Cited by 145 · see citing works
Adaptivity: From Metabolism to Behavior
Barandiaran, X. E., & Moreno, Á. (2008) · Adaptive Behavior · doi:10.1177/1059712308093868 · Cited by 142 · see citing works
Plasticity of dendritic excitability
Frick, A., & Johnston, D. (2005) · Journal of Neurobiology · doi:10.1002/neu.20148 · Cited by 138 · see citing works
The Transition to Minimal Consciousness through the Evolution of Associative Learning
Bronfman, Z. Z., Ginsburg, S., & Jablonka, E. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.01954 · Cited by 133 · see citing works
“For example, Aplysia californica is only capable of modifying the strength of preexisting associations between reflex-eliciting stimuli, and thus its mode of AL does not meet condition ii (see Carew et al., 1981; Hawkins et al., 1983; Brembs et al., 2002; Hawkins and Byrne, 2015 provide a review).”
BackgroundMethod
Farnesoid X Receptor: From Structure to Potential Clinical Applications
Pellicciari, R., Costantino, G., & Fiorucci, S. (2005) · Journal of Medicinal Chemistry · doi:10.1021/jm0582221 · Cited by 130 · see citing works
Evolutionary Advantages of Neuromodulated Plasticity in Dynamic, Reward-based Scenarios
Soltoggio, A., Bullinaria, J. A., Mattiussi, C., Dürr, P., & Floreano, D. (2008) · Loughborough University Institutional Repository (Loughborough University) · Cited by 123 · see citing works
Role of Delayed Nonsynaptic Neuronal Plasticity in Long-Term Associative Memory
Kemenes, I., Straub, V. A., Nikitin, E. S., Staras, K., O’Shea, M., Kemenes, G., & Benjamin, P. R. (2006) · Current Biology · doi:10.1016/j.cub.2006.05.049 · Cited by 116 · see citing works
Feeding Neural Networks in the Mollusc Aplysia
Cropper, E. C., Evans, C. G., Hurwitz, I., Jing, J., Proekt, A., Romero, A., & Rosen, S. C. (2004) · Neurosignals · doi:10.1159/000076159 · Cited by 114 · see citing works
Multiple Serotonergic Mechanisms Contributing to Sensitization in Aplysia : Evidence of Diverse Serotonin Receptor SubtypesPreprint
Barbas, D., DesGroseillers, L., Castellucci, V. F., Carew, T. J., & Marinesco, S. (2003) · Learning & Memory · doi:10.1101/lm.66103 · Cited by 112 · see citing works
Complexity and Integrated Resources Management
Pahl‐Wostl, C., Schmidt, S., Rizzoli, A. E., & Jakeman, A. J. (2004) · Cited by 105 · see citing works
Feeding behavior of Aplysia: A model system for comparing cellular mechanisms of classical and operant conditioningPreprint
Baxter, D. A., & Byrne, J. H. (2006) · Learning & Memory · doi:10.1101/lm.339206 · Cited by 105 · see citing works
Operant conditioning in invertebrates
Brembs, B. (2003) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2003.10.002 · Cited by 102 · see citing works
Evolutionary transitions in learning and cognition
Ginsburg, S., & Jablonka, E. (2021) · Philosophical Transactions of the Royal Society B · doi:10.1098/rstb.2019.0766 · Cited by 98 · see citing works
Knockout crickets for the study of learning and memory: Dopamine receptor Dop1 mediates aversive but not appetitive reinforcement in crickets
Awata, H., Watanabe, T., Hamanaka, Y., Mito, T., Noji, S., & Mizunami, M. (2015) · Scientific Reports · doi:10.1038/srep15885 · Cited by 98 · see citing works
Multiple Systems for Value Learning
Daw, N. D., & O’Doherty, J. P. (2013) · Elsevier eBooks · doi:10.1016/b978-0-12-416008-8.00021-8 · Cited by 98 · see citing works
Cephalopod complex cognition
Mather, J. A., & Dickel, L. (2017) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2017.06.008 · Cited by 94 · see citing works
Nitric Oxide Is Necessary for Multiple Memory Processes after Learning That a Food Is Inedible inAplysia
Katzoff, A., Ben‐Gedalya, T., & Susswein, A. J. (2002) · Journal of Neuroscience · doi:10.1523/jneurosci.22-21-09581.2002 · Cited by 92 · see citing works
Changes in neuronal excitability serve as a mechanism of long-term memory for operant conditioning
Mozzachiodi, R., Lorenzetti, F. D., Baxter, D. A., & Byrne, J. H. (2008) · Nature Neuroscience · doi:10.1038/nn.2184 · Cited by 89 · see citing works
Supervised Learning in Adaptive DNA Strand Displacement Networks
Lakin, M. R., & Stefanović, D. (2016) · ACS Synthetic Biology · doi:10.1021/acssynbio.6b00009 · Cited by 86 · see citing works
Classical and operant conditioning differentially modify the intrinsic properties of an identified neuron
Lorenzetti, F. D., Mozzachiodi, R., Baxter, D., & Byrne, J. (2006) · Nature Neuroscience · doi:10.1038/nn1593 · Cited by 87 · see citing works
Molecular Mechanisms Underlying a Cellular Analog of Operant Reward Learning
Lorenzetti, F. D., Baxter, D. A., & Byrne, J. H. (2008) · Neuron · doi:10.1016/j.neuron.2008.07.019 · Cited by 82 · see citing works
Transcriptional regulation of long-term memory in the marine snail Aplysia
Lee, Y., Bailey, C. H., Kandel, E. R., & Kaang, B. (2008) · Molecular Brain · doi:10.1186/1756-6606-1-3 · Cited by 84 · see citing works
The yin and yang of sleep and attention
Kirszenblat, L., & van Swinderen, B. (2015) · Trends in Neurosciences · doi:10.1016/j.tins.2015.10.001 · Cited by 81 · see citing works
A bidirectional network for appetite control in larval zebrafish
Wee, C. L., Song, E. Y., Johnson, R. E., Ailani, D., Randlett, O., Kim, J.-Y., Nikitchenko, M., Bahl, A., Yang, C.-T., Ahrens, M. B., et al. (2019) · eLife · doi:10.7554/elife.43775 · Cited by 73 · see citing works
Associative Learning: The Instructive Function of Biogenic Amines
Giurfa, M. (2006) · Current Biology · doi:10.1016/j.cub.2006.09.021 · Cited by 74 · see citing works
Measuring habit formation through goal-directed response switching.
Luque, D., Molinero, S., Watson, P., López, F. J., & Pelley, M. E. L. (2019) · Journal of Experimental Psychology General · doi:10.1037/xge0000722 · Cited by 75 · see citing works
Learning and Memory
Byrne, J. H., LaBar, K. S., LeDoux, J. E., Schafe, G. E., & Thompson, R. F. (2014) · Elsevier eBooks · doi:10.1016/b978-0-12-397179-1.00020-8 · Cited by 74 · see citing works
Cognition in Invertebrates
Menzel, R., Brembs, B., & Giurfa, M. (2007) · Elsevier eBooks · doi:10.1016/b0-12-370878-8/00183-x · Cited by 71 · see citing works
Neural mechanisms of operant conditioning and learning-induced behavioral plasticity in Aplysia
Nargeot, R., & Simmers, J. (2010) · Cellular and Molecular Life Sciences · doi:10.1007/s00018-010-0570-9 · Cited by 69 · see citing works
Cognitive Biology
Auletta, G. (2011) · doi:10.1093/acprof:oso/9780199608485.001.0001 · Cited by 90 · see citing works
Parallel processing in an identified neural circuit: the Aplysia californica gill‐withdrawal response model system
Leonard, J. L., & Edstrom, J. P. (2004) · Biological reviews/Biological reviews of the Cambridge Philosophical Society · doi:10.1017/s1464793103006183 · Cited by 68 · see citing works
Transient Mitogen-Activated Protein Kinase Activation Is Confined to a Narrow Temporal Window Required for the Induction of Two-Trial Long-Term Memory inAplysia
Philips, G. T., Tzvetkova, E. I., & Carew, T. J. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.4262-07.2007 · Cited by 67 · see citing works
Double Dissociation of PKC and AC Manipulations on Operant and Classical Learning in Drosophila
Brembs, B., & Plendl, W. (2008) · Current Biology · doi:10.1016/j.cub.2008.07.041 · Cited by 67 · see citing works
Effects of the chronic restraint stress induced depression on reward-related learning in rats.
Xu, P., Wang, K., Lu, C., Dong, L., Chen, Y., Wang, Q., Shi, Z., Yang, Y., Chen, S., & Liu, X. (2017) · Behavioural Brain Research · doi:10.1016/j.bbr.2016.12.045 · Cited by 61 · see citing works
Context and occasion setting in Drosophila visual learningPreprint
Brembs, B., & Wiener, J. M. (2006) · Learning & Memory · doi:10.1101/lm.318606 · Cited by 62 · see citing works
Ethological analyses of crayfish behavior: a new invertebrate system for measuring the rewarding properties of psychostimulants
Panksepp, J. B., & Huber, R. (2004) · Behavioural Brain Research · doi:10.1016/j.bbr.2003.11.014 · Cited by 55 · see citing works
A Persistent Cellular Change in a Single Modulatory Neuron Contributes to Associative Long-Term Memory
Jones, N. G., Kemenes, I., Kemenes, G., & Benjamin, P. R. (2003) · Current Biology · doi:10.1016/s0960-9822(03)00380-4 · Cited by 53 · see citing works
Behavioral and In Vitro Correlates of Compulsive-Like Food Seeking Induced by Operant Conditioning in Aplysia
Nargeot, R., Petrissans, C., & Simmers, J. (2007) · Journal of Neuroscience · doi:10.1523/jneurosci.1950-07.2007 · Cited by 52 · see citing works
Incentives and motivation.
Silverman, K., Jarvis, B. P., Jessel, J., & Lopez, A. A. (2016) · Translational Issues in Psychological Science · doi:10.1037/tps0000073 · Cited by 52 · see citing works
Cellular and Network Mechanisms of Operant Learning-Induced Compulsive Behavior in Aplysia
Nargeot, R., Bon-Jégo, M. L., & Simmers, J. (2009) · Current Biology · doi:10.1016/j.cub.2009.05.030 · Cited by 51 · see citing works
Associative learning in the box jellyfish Tripedalia cystophora
Bielecki, J., Nielsen, S. K. D., Nachman, G., & Garm, A. L. (2023) · Current Biology · doi:10.1016/j.cub.2023.08.056 · Cited by 52 · see citing works
Understanding the consequences
Carew, T. J. (2002) · Nature · doi:10.1038/417803a · Cited by 48 · see citing works
Roles of Octopamine and Dopamine Neurons for Mediating Appetitive and Aversive Signals in Pavlovian Conditioning in Crickets
Mizunami, M., & Matsumoto, Y. (2017) · Frontiers in Physiology · doi:10.3389/fphys.2017.01027 · Cited by 48 · see citing works
Differential Roles of Nonsynaptic and Synaptic Plasticity in Operant Reward Learning-Induced Compulsive Behavior
Sieling, F. H., Bédécarrats, A., Simmers, J., Prinz, A. A., & Nargeot, R. (2014) · Current Biology · doi:10.1016/j.cub.2014.03.004 · Cited by 46 · see citing works
Spontaneous decisions and operant conditioning in fruit flies.
Brembs, B. (2011) · Behavioural Processes · doi:10.1016/j.beproc.2011.02.005 · Cited by 53 · see citing works
Learning and Memory: Basic Mechanisms
Brown, T. H., Byrne, J. H., LaBar, K. S., LeDoux, J. E., Lindquist, D. H., Thompson, R. F., & Teyler, T. J. (2004) · Elsevier eBooks · doi:10.1016/b978-012148660-0/50019-6 · Cited by 46 · see citing works
Composite Modulatory Feedforward Loop Contributes to the Establishment of a Network State
Wu, J.-S., Vilim, F. S., Hatcher, N. G., Due, M. R., Sweedler, J. V., Weiss, K. R., & Jing, J. (2010) · Journal of Neurophysiology · doi:10.1152/jn.01054.2009 · Cited by 44 · see citing works
A Salience Theory of Learning and Behavior: With Perspectives on Neurobiology and Cognition
Rumbaugh, D. M., King, J. E., Beran, M. J., Washburn, D. A., & Gould, K. L. (2007) · International Journal of Primatology · doi:10.1007/s10764-007-9179-8 · Cited by 42 · see citing works
Functional Organization and Adaptability of a Decision-Making Network in Aplysia
Nargeot, R., & Simmers, J. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00113 · Cited by 43 · see citing works
Roles of OA1 octopamine receptor and Dop1 dopamine receptor in mediating appetitive and aversive reinforcement revealed by RNAi studies
Awata, H., Wakuda, R., Ishimaru, Y., Matsuoka, Y., Terao, K., Katata, S., Matsumoto, Y., Hamanaka, Y., Noji, S., Mito, T., et al. (2016) · Scientific Reports · doi:10.1038/srep29696 · Cited by 42 · see citing works
Operant Conditioning of Gill Withdrawal inAplysia
Hawkins, R. D., Clark, G. A., & Kandel, E. R. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.3294-05.2006 · Cited by 41 · see citing works
Operant conditioning of an in vitro CNS-pneumostome preparation of Lymnaea
McComb, C., Rosenegger, D. G., Varshney, N., Kwok, H. Y., & Lukowiak, K. (2005) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2005.02.002 · Cited by 41 · see citing works
Viewpoint: Pavlovian Materials—Functional Biomimetics Inspired by Classical Conditioning
Zhang, H., Zeng, H., Priimägi, A., & Ikkala, O. T. (2020) · Advanced Materials · doi:10.1002/adma.201906619 · Cited by 40 · see citing works
Structure and function of haemocytes in two marine gastropods, Megathura crenulata and Aplysia californica
Martin, G. G., Oakes, C. T., Tousignant, H. R., Crabtree, H., & Yamakawa, R. (2007) · Journal of Molluscan Studies · doi:10.1093/mollus/eym032 · Cited by 40 · see citing works
Neural effects of environmental advertising: An fMRI analysis of voice age and temporal framing
Casado‐Aranda, L., Martínez‐Fiestas, M., & Sánchez‐Fernández, J. (2017) · Journal of Environmental Management · doi:10.1016/j.jenvman.2017.10.006 · Cited by 39 · see citing works
The neurogenetics and evolution of food-related behaviour
Douglas, S. J., Dawson-Scully, K. D., & Sokolowski, M. B. (2005) · Trends in Neurosciences · doi:10.1016/j.tins.2005.09.006 · Cited by 39 · see citing works
The 5-HT- and FMRFa-activated signaling pathways interact at the level of the Erk MAPK cascade: Potential inhibitory constraints on memory formation
Fioravante, D., Smolen, P. D., & Byrne, J. H. (2005) · Neuroscience Letters · doi:10.1016/j.neulet.2005.11.036 · Cited by 36 · see citing works
Brain-Friendly Strategies for the Inclusion Classroom
Willis, J. (2007) · Cited by 38 · see citing works
Rapid Dopaminergic Signaling by Interneurons That Contain Markers for Catecholamines and GABA in the Feeding Circuitry of Aplysia
Díaz‐Ríos, M., & Miller, M. W. (2004) · Journal of Neurophysiology · doi:10.1152/jn.00003.2004 · Cited by 39 · see citing works
Nitric Oxide Signals ThatAplysiaHave Attempted to Eat, a Necessary Component of Memory Formation After Learning That Food Is Inedible
Katzoff, A., Ben‐Gedalya, T., Hurwitz, I., Miller, N., Susswein, Y. Z., & Susswein, A. J. (2006) · Journal of Neurophysiology · doi:10.1152/jn.00056.2006 · Cited by 37 · see citing works
In Vitro Analog of Classical Conditioning of Feeding Behavior in AplysiaPreprint
Mozzachiodi, R., Lechner, H. A., Baxter, D. A., & Byrne, J. H. (2003) · Learning & Memory · doi:10.1101/lm.65303 · Cited by 37 · see citing works
Functional magnetic resonance microscopy at single-cell resolution in Aplysia californica
Radecki, G., Nargeot, R., Jelescu, I., Bihan, D. L., & Ciobanu, L. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1403739111 · Cited by 36 · see citing works
A Newly Identified Buccal Interneuron Initiates and Modulates Feeding Motor Programs inAplysia
Dembrow, N. C., Jing, J., Proekt, A., Romero, A., Vilim, F. S., Cropper, E. C., & Weiss, K. R. (2003) · Journal of Neurophysiology · doi:10.1152/jn.00173.2003 · Cited by 36 · see citing works
Is Antagonism of E/Z-Guggulsterone at the Farnesoid X Receptor Mediated by a Noncanonical Binding Site? A Molecular Modeling Study
Meyer, U., Costantino, G., Macchiarulo, A., & Pellicciari, R. (2005) · Journal of Medicinal Chemistry · doi:10.1021/jm0505056 · Cited by 35 · see citing works
What Can Different Brains Do with Reward?
Gottfried, J. A. (2011) · CRC Press eBooks · doi:10.1201/b10776-10 · Cited by 33 · see citing works
Neuromodulatory adaptive combination of correlation-based learning in cerebellum and reward-based learning in basal ganglia for goal-directed behavior control
Dasgupta, S., Wörgötter, F., & Manoonpong, P. (2014) · Front. Neural Circuits · doi:10.3389/fncir.2014.00126 · Cited by 38 · see citing works
Individual differences in dopamine efflux in nucleus accumbens shell and core during instrumental learningPreprint
Cheng, J., & Feenstra, M. G. P. (2006) · Learning & Memory · doi:10.1101/lm.1806 · Cited by 34 · see citing works
Extending in vitro conditioning in Aplysia to analyze operant and classical processes in the same preparationPreprint
Brembs, B., Baxter, D., & Byrne, J. H. (2004) · Learning & Memory · doi:10.1101/lm.74404
What Associative Learning in Insects Tells Us about the Evolution of Learned and Fixed Behavior
Hollis, K. L., & Guillette, L. M. (2015) · International Journal of Comparative Psychology · doi:10.46867/ijcp.2015.28.01.07 · Cited by 32 · see citing works
An aplysia dopamine1‐like receptor: molecular and functional characterization
Barbas, D., Zappulla, J. P., Angers, S., Bouvier, M., Mohamed, H. A., Byrne, J. H., Castellucci, V. F., & DesGroseillers, L. (2005) · Journal of Neurochemistry · doi:10.1111/j.1471-4159.2005.03561.x · Cited by 31 · see citing works
Chronic scopolamine-injection-induced cognitive deficit on reward-directed instrumental learning in rat is associated with CREB signaling activity in the cerebral cortex and dorsal hippocampus
Shi, Z., Chen, L., Li, S., Chen, S., Sun, X., Sun, L., Li, Y., Zeng, J., He, Y., & Liu, X. (2013) · Psychopharmacology · doi:10.1007/s00213-013-3149-y · Cited by 30 · see citing works
From modulated Hebbian plasticity to simple behavior learning through noise and weight saturation
Soltoggio, A., & Stanley, K. O. (2012) · Neural Networks · doi:10.1016/j.neunet.2012.06.005 · Cited by 31 · see citing works
Chronic cocaine disrupts mesocortical learning mechanisms
Buchta, W. C., & Riegel, A. C. (2015) · Brain Research · doi:10.1016/j.brainres.2015.02.003 · Cited by 29 · see citing works
Gamifying the foreign language classroom for brain‐friendly learning
Rueckert, D., Pico, K., Kim, D., & Sánchez, X. A. C. (2020) · Foreign Language Annals · doi:10.1111/flan.12490 · Cited by 34 · see citing works
Nitric oxide as a regulator of behavior: New ideas from Aplysia feeding
Susswein, A. J., & Chiel, H. J. (2012) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2012.03.004 · Cited by 28 · see citing works
Reinforcement in an in vitro analog of appetitive classical conditioning of feeding behavior in Aplysia: Blockade by a dopamine antagonistPreprint
Reyes, F. D., Mozzachiodi, R., Baxter, D. A., & Byrne, J. H. (2005) · Learning & Memory · doi:10.1101/lm.92905 · Cited by 29 · see citing works
Rapid Adaptation to Changing Mechanical Load by Ordered Recruitment of Identified Motor Neurons
Gill, J. P., & Chiel, H. J. (2020) · eNeuro · doi:10.1523/eneuro.0016-20.2020 · Cited by 27 · see citing works

Feeding behavior of Aplysia: A model system for comparing cellular mechanisms of classical and operant conditioningPreprint
Baxter, D. A., & Byrne, J. H. (2006) · Learning & Memory · doi:10.1101/lm.339206 · Cited by 105 · see citing works
Operant Reward Learning in Aplysia
Brembs, B. (2003) · Current Directions in Psychological Science · doi:10.1046/j.0963-7214.2003.01265.x · Cited by 15 · see citing works
Neural mechanisms of operant conditioning and learning-induced behavioral plasticity in Aplysia
Nargeot, R., & Simmers, J. (2010) · Cellular and Molecular Life Sciences · doi:10.1007/s00018-010-0570-9 · Cited by 69 · see citing works
Comparison of Operant and Classical Conditioning of Feeding Behavior in Aplysia
Mozzachiodi, R., Baxter, D., & Byrne, J. (2013) · Handbook of behavioral neuroscience · doi:10.1016/b978-0-12-415823-8.00015-0 · Cited by 7 · see citing works
Cellular Mechanisms of Associative Learning in Aplysia
Lorenzetti, F. D., & Byrne, J. H. (2008) · Elsevier eBooks · doi:10.1016/b978-012370509-9.00012-7 · Cited by 2 · see citing works

Authors: Brembs, B., Lorenzetti, F. D., Reyes, F. D., Baxter, D. A., & Byrne, J. H.
Affiliations: Department of Neurobiology and Anatomy, W. M. Keck Center for the Neurobiology of Learning and Memory, The University of Texas–Houston Medical School, Houston, TX 77030, USA.
Corresponding author: Lorenzetti, Fred D.
Byrne, John H.
ORCID: Byrne, John H.
Venue: Science
Publisher: American Association for the Advancement of Science (AAAS)
Published: 2002-05-31
Volume: 296
Issue: 5573
Pages: 1706-1709
ISSN: 0036-8075 (ISSN-L)
1095-9203
DOI: 10.1126/science.1069434
OpenAlex: W2055848231
Cited by: 338
References: 22
Citations by year: 2026: 5 · 2025: 5 · 2024: 32 · 2023: 5 · 2022: 8 · 2021: 8 · 2020: 10 · 2019: 9 · 2018: 6 · 2017: 24 · 2016: 13 · 2015: 14 · 2014: 18 · 2013: 12 · 2012: 13
FWCI: 7.34
Type: journal article
Language: en
Open access: green
doi.org
Locations: Science (publishedVersion)
PubMed (publishedVersion)
University of Regensburg Publication Server (University of Regensburg) (acceptedVersion)
University of Regensburg Publication Server (University of Regensburg)
Funders: National Institute of Mental Health (R01MH058321, MH58321)
Topics: Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neuroscience and Neuropharmacology Research
Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurobiology and Insect Physiology Research
Keywords: operant conditioning, Aplysia, appetitive learning, long-term memory, dopamine, contingent reinforcement, associative learning
MeSH terms: Animals, Aplysia, Cells, Cultured, Conditioning, Operant, Dopamine, Eating, Electric Stimulation, Electrophysiology, Esophagus, Feeding Behavior, Food, Iontophoresis, Membrane Potentials, Memory, Nerve Net, Neuronal Plasticity, Neurons, Reinforcement, Psychology, Reward, Ganglia, Invertebrate, Patch-Clamp Techniques

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Operant Reward Learning in Aplysia : Neuronal Correlates and Mechanisms

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Self-check

Cites

Cited by

Related

Record

About these checks