AUTO‐MAINTENANCE IN THE PIGEON: SUSTAINED PECKING DESPITE CONTINGENT NON‐REINFORCEMENT2
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
If a response key is regularly illuminated for several seconds before food is presented, pigeons will peck it after a moderate number of pairings; this “auto‐shaping” procedure of Brown and Jenkins (1968) was explored further in the present series of four experiments. The first showed that pecking was maintained even when pecks turned off the key and prevented reinforcement (auto‐maintenance); the second controlled for possible effects of generalization and stimulus change. Two other experiments explored procedures that manipulated the tendency to peck the negatively correlated key by introducing alternative response keys which had no scheduled consequences. The results indicate that pecking can be established and maintained by certain stimulus‐reinforcer relationships, independent of explicit or adventitious contingencies between response and reinforcer.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Ferster, C. B., & Skinner, B. F. (1957) · doi:10.1037/10627-000 · Cited by 4,894
Operant Behavior: Areas of Research and Application,
Honig, W. K. (1966) · Medical Entomology and Zoology · Cited by 2,663
AUTO‐SHAPING OF THE PIGEON'S KEY‐PECK1
Brown, P. L., & Jenkins, H. M. (1968) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1968.11-1 · Cited by 1,537
Breland, K., & Breland, M. (1961) · American Psychologist · doi:10.1037/h0040090 · Cited by 1,181
The operant conditioning of fighting behavior in rats
Ulrich, R., Johnston, M., Richardson, J. T. E., & Wolff, P. (1963) · The Psychological Record · doi:10.1007/bf03393549 · Cited by 38
Classical conditioning: An introduction
Lachnit, H., & Kimmel, H. D. (1991) · Integrative Psychological and Behavioral Science · doi:10.1007/bf02691033 · Cited by 35
Cited by
Bardo, M. T., & Hammer, R. P. (1991) · Neuroscience · doi:10.1016/0306-4522(91)90226-e · Cited by 3,219
Specious reward: A behavioral theory of impulsiveness and impulse control.
Ainslie, G. (1975) · Psychological Bulletin · doi:10.1037/h0076860 · Cited by 2,708
The role of the basal ganglia in habit formation
Yin, H. H., & Knowlton, B. J. (2006) · Nature Reviews Neuroscience · doi:10.1038/nrn1919 · Cited by 2,402
Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex
Cardinal, R. N., Parkinson, J. A., Hall, J., & Everitt, B. J. (2002) · Neuroscience & Biobehavioral Reviews · doi:10.1016/s0149-7634(02)00007-6 · Cited by 2,129
“Autoshaping has been shown to be a Pavlovian CR (Williams & Williams, 1969; Jenkins & Moore, 1973; Mackintosh, 1974; Browne, 1976; Bussey et al., 1997a).”
BackgroundOn the generality of the laws of learning.
Seligman, M. E. (1970) · Psychological Review · doi:10.1037/h0029790 · Cited by 1,744
“Williams and Williams (1969) reported that autoshaped key-pecking responses persist even when they actually "cost" the pigeon reinforcement.”
BackgroundSeligman, M. E. P. (1971) · Behavior Therapy · doi:10.1016/s0005-7894(71)80064-3 · Cited by 1,606
Ikemoto, S. (2007) · Brain Research Reviews · doi:10.1016/j.brainresrev.2007.05.004 · Cited by 1,477
Motivation concepts in behavioral neuroscience
Berridge, K. C. (2004) · Physiology & Behavior · doi:10.1016/j.physbeh.2004.02.004 · Cited by 1,302
Classical conditioning of proboscis extension in honeybees (Apis mellifera).
Bitterman, M. E., Menzel, R., Fietz, A., & Sch?fer, S. (1983) · Journal of Comparative Psychology · doi:10.1037//0735-7036.97.2.107 · Cited by 1,083
Staddon, J. E., & Simmelhag, V. L. (1971) · Psychological Review · doi:10.1037/h0030305 · Cited by 1,060
Reinforcement, expectancy, and learning.
Bolles, R. C. (1972) · Psychological Review · doi:10.1037/h0033120 · Cited by 1,057
Intentional systems in cognitive ethology: The “Panglossian paradigm” defended
Dennett, D. C. (1983) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00016393 · Cited by 1,046
Nucleus accumbens shell and core dopamine: differential role in behavior and addiction
Di Chiara, G. (2002) · Behavioural Brain Research · doi:10.1016/s0166-4328(02)00286-3 · Cited by 996
Dolan, R. J., & Dayan, P. (2013) · Neuron · doi:10.1016/j.neuron.2013.09.007 · Cited by 977
The neuropsychological basis of addictive behaviour
Everitt, B. J., Dickinson, A., & Robbins, T. W. (2001) · Brain Research Reviews · doi:10.1016/s0165-0173(01)00088-1 · Cited by 808
Ainslie, G. W. (1974) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1974.21-485 · Cited by 759
Associative processes in addiction and reward. The role of amygdala-ventral striatal subsystems
EVERITT, B. J., PARKINSON, J. A., OLMSTEAD, M. C., ARROYO, M., ROBLEDO, P., & ROBBINS, T. W. (1999) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.1999.tb09280.x · Cited by 708
A motivational view of learning, performance, and behavior modification.
Bindra, D. (1974) · Psychological Review · doi:10.1037/h0036330 · Cited by 569
Flagel, S. B., Akil, H., & Robinson, T. E. (2009) · Neuropharmacology · doi:10.1016/j.neuropharm.2008.06.027 · Cited by 561
“…1974; Tomie et al., 1989) and there are many examples where reward-related cues become so irresistibly attractive that they engender seemingly maladaptive and arguably compulsive behavior (Boakes et al., 1978; Breland and Breland, 1961; Hearst and Jenkins, 1974; Williams and Williams, 1969).”
BackgroundChudasama, Y., & Robbins, T. W. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-25-08771.2003 · Cited by 543
“A tendency to approach to the CS during this test indicates that learning during acquisition of autoshaping was attributable to pavlovian mechanisms rather than other forms of learning (Williams and Williams, 1969; Bussey et al., 1997).”
BackgroundThe Comparative Analysis of Learning: Are the laws of learning the same in all animals?
Bitterman, M. E. (1975) · Science · doi:10.1126/science.188.4189.699 · Cited by 492
THE FORM OF THE AUTO‐SHAPED RESPONSE WITH FOOD OR WATER REINFORCERS1
Jenkins, H. M., & Moore, B. R. (1973) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1973.20-163 · Cited by 485
Behavioral momentum and the Law of Effect
Nevin, J. A., & Grace, R. C. (2000) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00002405 · Cited by 471
Opponency revisited: competition and cooperation between dopamine and serotonin
Boureau, Y.-L., & Dayan, P. (2011) · Neuropsychopharmacology · doi:10.1038/npp.2010.151 · Cited by 456
Huys, Q. J. M., Eshel, N., O'Nions, E., Sheridan, L., Dayan, P., & Roiser, J. P. (2012) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002410 · Cited by 439
The touchscreen operant platform for testing learning and memory in rats and mice
Horner, A. E., Heath, C. J., Hvoslef-Eide, M., Kent, B. A., Kim, C. H., Nilsson, S. R. O., Alsiö, J., Oomen, C. A., Holmes, A., Saksida, L. M., et al. (2013) · Nature Protocols · doi:10.1038/nprot.2013.122 · Cited by 424
Go and no-go learning in reward and punishment: Interactions between affect and effect
Guitart-Masip, M., Huys, Q. J. M., Fuentemilla, L., Dayan, P., Duzel, E., & Dolan, R. J. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.04.024 · Cited by 421
Yin, H. H., Ostlund, S. B., & Balleine, B. W. (2008) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2008.06422.x · Cited by 416
“A similar conclusion was reached by others in studies with humans (Pithers, 1985) and other animals (Brown & Jenkins, 1968; Williams & Williams, 1969; Holland, 1979); in all cases it appears that, despite their great variety, Pavlovian responses are not controlled by their relationship to the…”
BackgroundResultDisentangling the Roles of Approach, Activation and Valence in Instrumental and Pavlovian Responding
Huys, Q. J. M., Cools, R., Gölzer, M., Friedel, E., Heinz, A., Dolan, R. J., & Dayan, P. (2011) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002028 · Cited by 416
Précis of The Intentional Stance
Dennett, D. C. (1988) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00058611 · Cited by 398
The misbehavior of value and the discipline of the will
Dayan, P., Niv, Y., Seymour, B., & D. Daw, N. (2006) · Neural Networks · doi:10.1016/j.neunet.2006.03.002 · Cited by 388
Shettleworth, S. J. (1972) · Advances in the Study of Behavior · doi:10.1016/s0065-3454(08)60006-6 · Cited by 385
Winstanley, C. A., Dalley, J. W., Theobald, D. E., & Robbins, T. W. (2004) · Neuropsychopharmacology · doi:10.1038/sj.npp.1300434 · Cited by 371
“In a subsequent testing stage known as the negative automaintenance schedule, or omission phase, subjects continue to approach the CS þ even though these responses are now punished by cancellation of the scheduled reward (Browne, 1976; Jenkins and Moore, 1973; Williams and Williams, 1969).”
Serotonin in Affective Control
Dayan, P., & Huys, Q. J. M. (2009) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.051508.135607 · Cited by 381
“Importantly, subjects generate responses to Pavlovian predictors, such as approaching and engaging with stimuli predicting food, without having to learn that approach is appropriate (Brown and Jenkins, 1968), and will emit such responses even when they are instrumentally deleterious, resulting in lower rewards than ot…”
Beyond discounting: possible experimental models of impulse control
Monterosso, J., & Ainslie, G. (1999) · Psychopharmacology · doi:10.1007/pl00005480 · Cited by 369
Response deprivation: An empirical approach to instrumental performance.
Timberlake, W., & Allison, J. (1974) · Psychological Review · doi:10.1037/h0036101 · Cited by 355
Di Ciano, P., Cardinal, R. N., Cowell, R. A., Little, S. J., & Everitt, B. J. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-23-09471.2001 · Cited by 354
Emotion, decision making, and the amygdala.
Seymour, B., & Dolan, R. (2008) · Neuron · doi:10.1016/j.neuron.2008.05.020 · Cited by 324
“This may be an important mediator of the Pavlovian impulsivity seen in paradigms such as negative automaintenance (Dayan et al., 2006; Williams and Williams, 1969).”
BackgroundReward learning: reinforcement, incentives, and expectations
Berridge, K. C. (2000) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(00)80022-5 · Cited by 318
Parkinson, J. A., Willoughby, P. J., Robbins, T. W., & Everitt, B. J. (2000) · Behavioral Neuroscience · doi:10.1037/0735-7044.114.1.42 · Cited by 314
Appetitive Behavior: Impact of Amygdala‐Dependent Mechanisms of Emotional Learning
EVERITT, B. J., CARDINAL, R. N., PARKINSON, J. A., & ROBBINS, T. W. (2003) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.2003.tb07085.x · Cited by 306
Quantifying Individual Variation in the Propensity to Attribute Incentive Salience to Reward Cues
Meyer, P. J., Lovic, V., Saunders, B. T., Yager, L. M., Flagel, S. B., Morrow, J. D., & Robinson, T. E. (2012) · PLoS ONE · doi:10.1371/journal.pone.0038987 · Cited by 304
Parkinson, J. A., Dalley, J. W., Cardinal, R. N., Bamford, A., Fehnert, B., Lachenal, G., Rudarakanchana, N., Halkerston, K. M., Robbins, T. W., & Everitt, B. J. (2002) · Behavioural Brain Research · doi:10.1016/s0166-4328(02)00291-7 · Cited by 288
Flagel, S. B., Watson, S. J., Robinson, T. E., & Akil, H. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0535-8 · Cited by 289
Story, G. W., Vlaev, I., Seymour, B., Darzi, A., & Dolan, R. J. (2014) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2014.00076 · Cited by 286
Dissociable roles of the central and basolateral amygdala in appetitive emotional learning
Parkinson, J. A., Robbins, T. W., & Everitt, B. J. (2000) · European Journal of Neuroscience · doi:10.1046/j.1460-9568.2000.00960.x · Cited by 268
CONTINGENCY SPACES AND MEASURES IN CLASSICAL AND INSTRUMENTAL CONDITIONING1
Gibbon, J., Berryman, R., & Thompson, R. L. (1974) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1974.21-585 · Cited by 259
Cooperation experiments: coordination through communication versus acting apart together
Noë, R. (2006) · Animal Behaviour · doi:10.1016/j.anbehav.2005.03.037 · Cited by 255
Hollis, K. L. (1982) · Advances in the Study of Behavior · doi:10.1016/s0065-3454(08)60045-5 · Cited by 253
Is the avian hippocampus a functional homologue of the mammalian hippocampus?
Colombo, M., & Broadbent, N. (2000) · Neuroscience & Biobehavioral Reviews · doi:10.1016/s0149-7634(00)00016-6 · Cited by 237
The free food (contrafreeloading) phenomenon: A review and analysis
Osborne, S. R. (1977) · Animal Learning & Behavior · doi:10.3758/bf03209232 · Cited by 237
“…Experimentally naive animals "autoshape" to stimuli that signal response-independent reinforcement (e.g., Brown & Jenkins, 1968; Peterson, Ackil, Frommer, & Hearst, 1972) and still respond when responses prevent the delivery of reinforcement (Stiers & Silberberg, 1974; Williams & Williams, 1969).”
BackgroundDalley, J. W., Lääne, K., Theobald, D. E. H., Armstrong, H. C., Corlett, P. R., Chudasama, Y., & Robbins, T. W. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0502080102 · Cited by 214
Cardinal, R. N., Parkinson, J. A., Lachenal, G., Halkerston, K. M., Rudarakanchana, N., Hall, J., Morrison, C. H., Howes, S. R., Robbins, T. W., & Everitt, B. J. (2002) · Behavioral Neuroscience · doi:10.1037/0735-7044.116.4.553 · Cited by 201
“…approach response is generally held to be under the control of Pavlovian, not instrumental, contingencies (Browne, 1976; Jenkins & Moore, 1973; Mackintosh, 1974; Williams & Williams, 1969), and this has been confirmed for the rat autoshaping task described (Bussey, Everitt, & Robbins, 1997).”
BackgroundA SELECTIONIST APPROACH TO REINFORCEMENT
Donahoe, J. W., Burgos, J. E., & Palmer, D. C. (1993) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1993.60-17 · Cited by 198
Twenty-Five Lessons from Computational Neuromodulation
Dayan, P. (2012) · Neuron · doi:10.1016/j.neuron.2012.09.027 · Cited by 190
Tomie, A., Grimes, K. L., & Pohorecky, L. A. (2008) · Brain Research Reviews · doi:10.1016/j.brainresrev.2007.12.003 · Cited by 177
Differential involvement of amygdala subsystems in appetitive conditioning and drug addiction
Everitt, B. J., Cardinal, R. N., Hall, J., Parkinson, J. A., & Robbins, T. W. (2000) · The Amygdala · doi:10.1093/oso/9780198505013.003.0010 · Cited by 164
Limbic cortical-ventral striatal systems underlying appetitive conditioning
Parkinson, J. A., Cardinal, R. N., & Everitt, B. J. (2000) · Progress in Brain Research · doi:10.1016/s0079-6123(00)26019-6 · Cited by 149
“Further, autoshaping can actually be 6 acquired using an omission procedure which explicitly prevents any instrumental contingency between response and reinforcement (Williams and Williams, 1969).”
BackgroundMethodNucleus accumbens neurons encode Pavlovian approach behaviors: evidence from an autoshaping paradigm
Day, J. J., Wheeler, R. A., Roitman, M. F., & Carelli, R. M. (2006) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2006.04654.x · Cited by 140
Using fMRI to study reward processing in humans: past, present, and future
Wang, K. S., Smith, D. V., & Delgado, M. R. (2016) · Journal of Neurophysiology · doi:10.1152/jn.00333.2015 · Cited by 105
“In non - human animals , this 153 was initially characterized in studies where presentation of a conditioned stimulus that 154 predicted a reward elicited a conditioned approach response in pigeons ( Brown and 155 Jenkins 1968 ; Williams and Williams 1969 ) and rats ( Locurto et al .”
BackgroundGoal-directed control and its antipodes
Dayan, P. (2009) · Neural Networks · doi:10.1016/j.neunet.2009.03.004 · Cited by 93
“…outcomes (such as future rewards) lead to behavioral choices (such as approach) that are not only irrelevant to the delivery of those outcomes (by experimental design), but can actually be detrimental to that delivery (as in omission schedules or negative automaintenance Williams & Williams, 1969).”
Approach-Induced Biases in Human Information Sampling
Hunt, L. T., Rutledge, R. B., Malalasekera, W. M. N., Kennerley, S. W., & Dolan, R. J. (2016) · PLOS Biology · doi:10.1371/journal.pbio.2000638 · Cited by 60
“Animals show greater efficacy in learning approach, as opposed to avoidance, actions that will lead to the delivery of reward (20, 21).”
BackgroundDennett's realisation theory of the relation between folk and scientific psychology
Cussins, A. (1988) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00058659 · Cited by 4
Metadata
- Authors
- Williams, D. R., & Williams, H.
- Venue
- Journal of the Experimental Analysis of Behavior
- Publisher
- Wiley
- Published
- 1969-07
- Volume
- 12
- Issue
- 4
- Pages
- 511-520
- ISSN
- 0022-5002 (ISSN-L)
- 1938-3711
- OpenAlex
- W2044391780
- Cited by
- 712
- References
- 6
- FWCI
- 20.19
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.