Cited by 101Behavioral and Psychological StudiesDecision-Making and Behavioral EconomicsNeural and Behavioral Psychology Studies

Optimal choice

Open access
Staddon, J. E. R., Hinson, John M., Kram, Richard·1981·Journal of the Experimental Analysis of Behavior

Abstract

We present a classification and theoretical analysis of discrete-trial and free-operant choice procedures in which reinforcement is assigned to one alternative only, or independently to both, is either always available or conditionally available, and is either "held" or not from trial to trial. Momentary-maximizing and (globally) optimal choice sequences are defined in terms of initializing and marker events. Free-operant choice is analyzed in terms of a clock space whose axes are the times since the last A and B choices. The analysis shows that most molar matching data are derivable from momentary maximizing, and that the momentary-maximizing hypothesis has not been adequately tested in either discrete-trial or free-operant situations.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1901/jeab.1981.35-397

Cites

21 of 21 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • For tasks like ours, maximizing reinforcer rate is closely approximated when subjects match the proportion of choices allocated to an alternative to the proportion of reinforcers received from choosing it.

    “In fact, for tasks like ours, maximizing reinforcer rate is closely approximated when subjects match the proportion of choices allocated to an alternative to the proportion of reinforcers received from choosing it (Houston & McNamara, 1981; Staddon et al., 1981).”

    From DYNAMIC RESPONSE-BY-RESPONSE MODELS OF MATCHING BEHAVIOR IN RHESUS MONKEYS (2005) · cites this paper as Staddon et al., 1981

  • Houston and McNamara (1981) prove that reinforcer rate is maximized by repeating a deterministic sequence; an optimal subject would choose the rich alternative a fixed number of times followed by a single choice of the lean alternative.

    “Houston and McNamara (1981) prove that reinforcer rate is maximized by repeating a deterministic sequence; an optimal subject would choose the rich alternative a fixed number of times (dictated by the particular schedules) followed by a single choice of the lean alternative (see also Staddon et al., 1981).”

    From DYNAMIC RESPONSE-BY-RESPONSE MODELS OF MATCHING BEHAVIOR IN RHESUS MONKEYS (2005) · cites this paper as Staddon et al., 1981

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 4

  1. Herrnstein, R. J. Relative and absolute strength of response as a function of frequency of reinforce- ment. Journal of the Experimental Analysis of Be- havior, 1961, 4, 267-272.
  2. Herrnstein, R. J., & Heyman, G. M. Is matching com- patible with reinforcement maximization on con- current variable interval, variable ratio? Journal of the Experimental Analysis of Behavior, 1979, 31, 209-223.
  3. Hinson, J. M., & Staddon, J. E. R. Maximizing on interval schedules. In C. M. Bradshaw, E. Szabadi & F. Lowe (Eds.), Recent developments in the quantifi- cation of steady-state operant behavior. Amsterdam: Elsevier/North-Holland, 1981.
  4. Shimp, C. P. Probabilistically reinforced choice be- havior in pigeons. Journal of the Experimental Analysis of Behavior, 1966, 9, 443-455.

Cited by

Sorted by citations

Authors
Staddon, J. E. R., Hinson, J. M., & Kram, R.
Affiliations
Duke University (US)
Corresponding author
Staddon, J. E. R.
Venue
Journal of the Experimental Analysis of Behavior
Publisher
Wiley
Published
1981-05
Volume
35
Issue
3
Pages
397-412
ISSN
  • 0022-5002 (ISSN-L)
  • 1938-3711
OpenAlex
W4238929533
Cited by
101
References
18
Citations by year
2025: 1 · 2024: 1 · 2021: 4 · 2017: 2 · 2015: 1
FWCI
21.41
Type
journal article
Language
en
Open access
Locations
  • Journal of the Experimental Analysis of Behavior (publishedVersion)
  • PubMed Central (publishedVersion)
  • PubMed (publishedVersion)
Funders
National Science Foundation
Topics
  • Social Sciences › Psychology › Developmental and Educational Psychology › Behavioral and Psychological Studies
  • Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
Keywords
optimal choice, reinforcement schedules, choice sequences

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review