A MARKOV MODEL DESCRIPTION OF CHANGEOVER PROBABILITIES ON CONCURRENT VARIABLE‐INTERVAL SCHEDULES1
Open accessAbstract
The primary data were peck-by-peck sequential records of four pigeons responding on several different concurrent variable-interval schedules. According to the hypothesis that the subject chooses the alternative with the highest probability of reinforcement at the moment, response-by-response performance in concurrent schedules should show sequential dependencies. However, such dependencies were not found, and it was possible to describe molecular-level performance with simple Markov chain models. The Markov model description implies that the momentary changeover probabilities were proportional to the overall relative reinforcement frequencies, and that changeover probabilities did not change as a function of previous responding. A second finding was that although a changeover-delay procedure was omitted, relative response frequencies closely approximated relative reinforcement frequencies.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Behavior generally represents some combination of effects due to reinforcers and intrinsic response-by-response patterning of behavior.
“Although it is conceptually useful to separate the effects of reinforcers and the potentially intrinsic response-by-response patterning of behavior (e.g., tendencies to generate particular sequences of behavior), behavior generally represents some combination of these two (Davison, 2004; Heyman, 1979; Palya, 1992).”
From DYNAMIC RESPONSE-BY-RESPONSE MODELS OF MATCHING BEHAVIOR IN RHESUS MONKEYS (2005) · cites this paper as Heyman, 1979
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Some Methods for Strengthening the Common χ 2 Tests
Cochran, W. G. (1954) · Biometrics · doi:10.2307/3001616 · Cited by 3,718 · see citing works
ON THE LAW OF EFFECT <sup>1</sup>
Herrnstein, R. J. (1970) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1970.13-243 · Cited by 2,611 · see citing works
Herrnstein, R. J. (1961) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1961.4-267 · Cited by 2,281 · see citing works
The psychology of animal learning
Lea, S. E. G. (1975) · Animal Behaviour · doi:10.1016/0003-3472(75)90150-5 · Cited by 2,067 · see citing works
AUTO‐SHAPING OF THE PIGEON'S KEY‐PECK1
Brown, P. L., & Jenkins, H. M. (1968) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1968.11-1 · Cited by 1,544 · see citing works
Discrete Multivariate Analysis.
Gokhale, D. V., Bishop, Y. M. M., Fienberg, S. E., & Holland, P. W. (1976) · Biometrics · doi:10.2307/2529528 · Cited by 1,287 · see citing works
Handbook of Learning and Cognitive Processes
(1982) · Psychology Press eBooks · doi:10.4324/9781315802855 · Cited by 1,110 · see citing works
A PROGRESSION FOR GENERATING VARIABLE‐INTERVAL SCHEDULES 1
Fleshler, M., & Hoffman, H. S. (1962) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1962.5-529 · Cited by 1,095 · see citing works
Baum, W. M., & Rachlin, H. C. (1969) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1969.12-861 · Cited by 737 · see citing works
CONCURRENT RESPONDING WITH FIXED RELATIVE RATE OF REINFORCEMENT1
Stubbs, D. A., & Pliskoff, S. S. (1969) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1969.12-887 · Cited by 391 · see citing works
PREFERENCE AND SWITCHING UNDER CONCURRENT SCHEDULING 1
Findley, J. D. (1958) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1958.1-123 · Cited by 364 · see citing works
Toward a law of response strength.
de Villiers, P. A., & Herrnstein, R. J. (1976) · Psychological Bulletin · doi:10.1037/0033-2909.83.6.1131 · Cited by 279 · see citing works
Optimal behavior in free-operant experiments.
Shimp, C. P. (1969) · Psychological Review · doi:10.1037/h0027311 · Cited by 219 · see citing works
Choice in Free-Ranging Wild Pigeons
Baum, W. M. (1974) · Science · doi:10.1126/science.185.4145.78 · Cited by 174 · see citing works
BEHAVIOR OF HUMANS IN VARIABLE‐INTERVAL SCHEDULES OF REINFORCEMENT
Bradshaw, C. M., Szabadi, E., & Bevan, P. (1976) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1976.26-135 · Cited by 151 · see citing works
THE REINFORCEMENT OF LEAST‐FREQUENT INTERRESPONSE TIMES1
Blough, D. S. (1966) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1966.9-581 · Cited by 136 · see citing works
INTERVAL REINFORCEMENT OF CHOICE BEHAVIOR IN DISCRETE TRIALS1
Nevin, J. A. (1969) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1969.12-875 · Cited by 123 · see citing works
TIME ALLOCATION IN HUMAN VIGILANCE 1
Baum, W. M. (1975) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1975.23-45 · Cited by 122 · see citing works
Ferguson, G. A. (1965) · McGill-Queen's University Press eBooks · doi:10.2307/j.ctt1w6t8v5 · Cited by 110 · see citing works
Herrnstein, R. J. (1971) · Journal of Psychiatric Research · doi:10.1016/0022-3956(71)90033-1 · Cited by 89 · see citing works
TIME ALLOCATION AND NEGATIVE REINFORCEMENT1
Baum, W. M. (1973) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1973.20-313 · Cited by 70 · see citing works
Probability with Statistical Applications
Kitagawa, T., Mosteller, F. C., Rourke, R. E. K., & Thomas, G. B. (1962) · Revue de l Institut International de Statistique / Review of the International Statistical Institute · doi:10.2307/1401910 · Cited by 57 · see citing works
CHOICE BEHAVIOR ON DISCRETE TRIALS: A DEMONSTRATION OF THE OCCURRENCE OF A RESPONSE STRATEGY1
Silberberg, A. M., & Williams, D. R. (1974) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1974.21-315 · Cited by 26 · see citing works
Flagged first, then by citations
Research works printed but not linked: 8
- Baum, W. M. and Rachlin, H. C. Choice as time allo- cation. Journal of the Experimental Analysis of Be- havior, 1969, 12, 861-874.
- Bishop, Y., Fienberg, S., and Holland, P. Discrete mul- tivariate analysis. Cambridge: MIT Press, 1975.
- Blough, D. S. The reinforcement of least-frequent in- terresponse times. Journal of the Experimental Analysis of Behavior, 1966, 9, 581-591.
- de Villiers, P. A. Choice in concurrent schedules and quantitative formulations of the law of effect. In W. K. Honig and J. Staddon (Eds), Operant behav- ior II. New York: Prentice-Hall, 1977. Pp. 233-287.
- Herrnstein, R. J. Relative and absolute strength of response as a function of frequency of reinforce- ment. Journal of the Experimental Analysis of Be- havior, 1961, 4, 267-272.
- Herrnstein, R. J. On the law of effect. Journal of the Experimental Analysis of Behavior, 1970, 13, 243-266.
- Heyman, G. M. Matching and maximizing on concur- rent schedules. Unpublished thesis, Harvard Uni- versity, 1977.
- Stubbs, D. A. and Pliskoff, S. S. Concurrent respond- ing with fixed relative rate of reinforcement. Jour- nal of the Experimental Analysis of Behavior, 1969, 12, 887-895.
Cited by
Sorted by citations
Matching Behavior and the Representation of Value in the Parietal Cortex
Sugrue, L. P., Corrado, G. S., & Newsome, W. T. (2004) · Science · doi:10.1126/science.1094765 · Cited by 1,030 · see citing works
Choosing the greater of two goods: neural currencies for valuation and decision making
Sugrue, L. P., Corrado, G. S., & Newsome, W. T. (2005) · Nature Reviews Neuroscience · doi:10.1038/nrn1666 · Cited by 536 · see citing works
DYNAMIC RESPONSE-BY-RESPONSE MODELS OF MATCHING BEHAVIOR IN RHESUS MONKEYS
Lau, B., & Glimcher, P. W. (2005) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.2005.110-04 · Cited by 485 · see citing works
LINEAR-NONLINEAR-POISSON MODELS OF PRIMATE CHOICE DYNAMICS
Corrado, G. S., Sugrue, L. P., Seung, H. S., & Newsome, W. T. (2005) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.2005.23-05 · Cited by 206 · see citing works
- Authors
- Heyman, G. M.
- Affiliations
- Harvard University (US)
- Corresponding author
- Heyman, Gene M.
- ORCID
- Heyman, Gene M.
- Venue
- Journal of the Experimental Analysis of Behavior
- Publisher
- Wiley
- Published
- 1979-01
- Volume
- 31
- Issue
- 1
- Pages
- 41-51
- ISSN
- 0022-5002 (ISSN-L)
- 1938-3711
- PMC
- PMC1332788
- OpenAlex
- W2096211278
- Cited by
- 122
- References
- 23
- Citations by year
- 2025: 3 · 2024: 3 · 2023: 1 · 2022: 2 · 2021: 2 · 2020: 1 · 2019: 2 · 2018: 1 · 2016: 1 · 2015: 1 · 2014: 2 · 2013: 1 · 2012: 1
- FWCI
- 11.20
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Journal of the Experimental Analysis of Behavior (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Harvard University
- National Institute of Mental Health
- Topics
- Social Sciences › Psychology › Developmental and Educational Psychology › Behavioral and Psychological Studies
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Keywords
- concurrent schedules, variable-interval schedules, Markov chain model, sequential dependencies, reinforcement frequency, response frequency, pigeons, choice behavior, changeover delay
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
