The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
RETHINKING REINFORCEMENT: ALLOCATION, INDUCTION, AND CONTINGENCY
Open accessAbstract
The concept of reinforcement is at least incomplete and almost certainly incorrect. An alternative way of organizing our understanding of behavior may be built around three concepts: allocation, induction, and correlation. Allocation is the measure of behavior and captures the centrality of choice: All behavior entails choice and consists of choice. Allocation changes as a result of induction and correlation. The term induction covers phenomena such as adjunctive, interim, and terminal behavior—behavior induced in a situation by occurrence of food or another Phylogenetically Important Event (PIE) in that situation. Induction resembles stimulus control in that no one‐to‐one relation exists between induced behavior and the inducing event. If one allowed that some stimulus control were the result of phylogeny, then induction and stimulus control would be identical, and a PIE would resemble a discriminative stimulus. Much evidence supports the idea that a PIE induces all PIE‐related activities. Research also supports the idea that stimuli correlated with PIEs become PIE‐related conditional inducers. Contingencies create correlations between “operant” activity (e.g., lever pressing) and PIEs (e.g., food). Once an activity has become PIE‐related, the PIE induces it along with other PIE‐related activities. Contingencies also constrain possible performances. These constraints specify feedback functions, which explain phenomena such as the higher response rates on ratio schedules in comparison with interval schedules. Allocations that include a lot of operant activity are “selected” only in the sense that they generate more frequent occurrence of the PIE within the constraints of the situation; contingency and induction do the “selecting.”
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Ferster, C. B., & Skinner, B. F. (1957) · doi:10.1037/10627-000 · Cited by 4,894
Not By Genes Alone: How Culture Transformed Human Evolution
Richerson, P. J., & Boyd, R. (2004) · doi:10.7208/chicago/9780226712130.001.0001 · Cited by 2,793
On the generality of the laws of learning.
Seligman, M. E. (1970) · Psychological Review · doi:10.1037/h0029790 · Cited by 1,744
Pavlovian conditioning: it's not what you think it is
Rescorla, R. A. (1988) · American Psychologist · doi:10.1037/0003-066x.43.3.151 · Cited by 1,542
ON TWO TYPES OF DEVIATION FROM THE MATCHING LAW: BIAS AND UNDERMATCHING 1
Baum, W. M. (1974) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1974.22-231 · Cited by 1,460
Self-citationSkinner, B. F. (1948) · Journal of Experimental Psychology · doi:10.1037/h0055873 · Cited by 1,456
Probability of shock in the presence and absence of cs in fear conditioning.
Rescorla, R. A. (1968) · Journal of Comparative and Physiological Psychology · doi:10.1037/h0025984 · Cited by 1,067 · cited 1×
“Rescorla (1968; 1988) may have been the first to point out that contiguity alone cannot suffice to specify a contingency, because contingency requires a comparison between at least two different occasions.”
BackgroundArbitrarily applicable comparative relations: Experimental evidence for a relational operant
Berens, N. M., & Hayes, S. C. (2007) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.2007.7-06 · Cited by 172 · cited 1×
“For example, experiments with relational contexts inspired by Relational Frame Theory require long time spans to specify the complex context for a simple activity like a child’s pointing at a card (e.g., Berens & Hayes, 2007).”
Method
Cited by
Behavioral and neurobiological mechanisms of pavlovian and instrumental extinction learning
Bouton, M. E., Maren, S., & McNally, G. P. (2021) · Physiological Reviews · doi:10.1152/physrev.00016.2020 · Cited by 395
Metadata
- Authors
- Baum, W. M.
- Venue
- Journal of the Experimental Analysis of Behavior
- Publisher
- Wiley
- Published
- 2012-01
- Volume
- 97
- Issue
- 1
- Pages
- 101-124
- ISSN
- 0022-5002 (ISSN-L)
- 1938-3711
- OpenAlex
- W2075175732
- Cited by
- 209
- References
- 8
- FWCI
- 31.52
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.