The DOI matches its Crossref record; 77 of the 77 references it cites were found in a registry or an index.
The "supersitition" experiment: A reexamination of its implications for the principles of adaptive behavior.
Abstract
Replication and extension of Skinner's superstition experiment showed the development of two kinds of behavior at asymptote: interim activities (related to adjunctive behavior) occurred just after food delivery; the terminal response (a discriminated operant) occurred toward the end of the interval and continued until food delivery. These data suggest a view of operant conditioning (the terminal response) in terms of two sets of principles: principles of behavioral variation that describe the origins of behavior appropriate to a situation, in advance of reinforcement; and principles of reinforcement that describe the selective elimination of behavior so produced. This approach was supported by (a) an account of the parallels between the Law of Effect and evolution by means of natural selection, (fc) its ability to shed light on persistent problems in (e.g., continuity vs. noncontinuity, variability associated with extinction, the relationship between classical and instrumental conditioning, the controversy between behaviorist and cognitive approaches to learning), and (c) its ability to deal with a number of recent anomalies in the literature (instinctive drift, auto-shaping, and auto-maintenance). The interim activities were interpreted in terms of interactions among motivational systems, and this view was supported by a review of the literature on adjunctive behavior and by comparison with similar phenomena in ethology (displacement, redirection, and vacuum activities). The proposed theoretical scheme represents a shift away from hypothetical laws of learning toward an interpretation of behavioral change in terms of interaction and competition among tendencies to action according to principles evolved in phylogeny.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The genetical theory of natural selection
Fisher, R. A. (1930) · doi:10.5962/bhl.title.27468 · Cited by 17,617
Mayr, E. (1963) · doi:10.4159/harvard.9780674865327 · Cited by 10,175
Kilzer, E., & Skinner, B. F. (1953) · The American Catholic Sociological Review · doi:10.2307/3707860 · Cited by 8,943
EVOLUTION IN MENDELIAN POPULATIONS
Wright, S. (1931) · Genetics · doi:10.1093/genetics/16.2.97 · Cited by 8,916
Ferster, C. B., & Skinner, B. F. (1957) · doi:10.1037/10627-000 · Cited by 4,894
Skinner, B. F. (1938) · Cited by 3,571
Operant Behavior: Areas of Research and Application,
Honig, W. K. (1966) · Medical Entomology and Zoology · Cited by 2,663
Herrnstein, R. J. (1970) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1970.13-243 · Cited by 2,611
THE MAJOR FEATURES OF EVOLUTION
Olson, E. C. (1954) · Evolution · doi:10.1111/j.1558-5646.1954.tb00114.x · Cited by 2,026
Logic, Methodology and Philosophy of Science.
Black, M., Nagel, E., Suppes, P., & Tarski, A. (1963) · The Philosophical Review · doi:10.2307/2183047 · Cited by 1,949
The variation of animals and plants under domestication /
Darwin, C. (1905) · J. Murray eBooks · doi:10.5962/bhl.title.84435 · Cited by 1,707
Steps toward Artificial Intelligence
Minsky, M. (1961) · Proceedings of the IRE · doi:10.1109/jrproc.1961.287775 · Cited by 1,675
Species-specific defense reactions and avoidance learning
Bolles, R. C. (1970) · Psychological Review · doi:10.1037/h0028589 · Cited by 1,610
AUTO‐SHAPING OF THE PIGEON'S KEY‐PECK1
Brown, P. L., & Jenkins, H. M. (1968) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1968.11-1 · Cited by 1,537
Skinner, B. F. (1948) · Journal of Experimental Psychology · doi:10.1037/h0055873 · Cited by 1,456
Pavlovian conditioning and its proper control procedures.
Rescorla, R. A. (1967) · Psychological Review · doi:10.1037/h0024109 · Cited by 1,368
Hilgard and Marquis' Conditioning and learning
Hilgard, E. R., MARQUIS, D. G., & Kimble, G. A. (1961) · Medical Entomology and Zoology · Cited by 1,293
Breland, K., & Breland, M. (1961) · American Psychologist · doi:10.1037/h0040090 · Cited by 1,181
Tinbergen, N. (1952) · The Quarterly Review of Biology · doi:10.1086/398642 · Cited by 855
The nature and determinants of adjunctive behavior
Falk, J. L. (1971) · Physiology & Behavior · doi:10.1016/0031-9384(71)90209-5 · Cited by 811
A QUANTITATIVE ANALYSIS OF THE RESPONDING MAINTAINED BY INTERVAL SCHEDULES OF REINFORCEMENT1
Catania, A. C., & Reynolds, G. S. (1968) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1968.11-s327 · Cited by 793
Learning with prolonged delay of reinforcement
Garcia, J., Ervin, F. R., & Koelling, R. A. (1966) · Psychonomic Science · doi:10.3758/bf03328311 · Cited by 748
Contingencies of Reinforcement
(2012) · Encyclopedia of the Sciences of Learning · doi:10.1007/978-1-4419-1428-6_3625 · Cited by 717
Miller, N. E. (1969) · Science · doi:10.1126/science.163.3866.434 · Cited by 713
AUTO‐MAINTENANCE IN THE PIGEON: SUSTAINED PECKING DESPITE CONTINGENT NON‐REINFORCEMENT2
Williams, D. R., & Williams, H. (1969) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1969.12-511 · Cited by 712
APPETITES AND AVERSIONS AS CONSTITUENTS OF INSTINCTS
CRAIG, W. (1918) · The Biological Bulletin · doi:10.2307/1536346 · Cited by 702
(2014) · Fundamentals of Psychology · doi:10.4324/9781315736945-15 · Cited by 694
Discriminability and stimulus generalization.
Guttman, N., & Kalish, H. I. (1956) · Journal of Experimental Psychology · doi:10.1037/h0046219 · Cited by 651
Animal Behavior: A Synthesis of Ethology and Comparative Psychology
Stokes, A. W., & Hinde, R. A. (1967) · The Journal of Wildlife Management · doi:10.2307/3798339 · Cited by 591
Behavior of Nonhuman Primates.
Southwick, C. H. (1966) · PubMed Central · Cited by 567
Skinner, B. F. (1966) · Science · doi:10.1126/science.153.3741.1205 · Cited by 546
EXTINCTION‐INDUCED AGGRESSION1
Azrin, N. H., Hutchinson, R. R., & Hake, D. F. (1966) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1966.9-191 · Cited by 511
Classical conditioning : a symposium
Black, A. H., & Prokasy, W. F. (1965) · Medical Entomology and Zoology · Cited by 510
Direct adrenergic and cholinergic stimulation of hypothalamic mechanisms
Grossman, S. P. (1962) · American Journal of Physiology-Legacy Content · doi:10.1152/ajplegacy.1962.202.5.872 · Cited by 501
A biological theory of reinforcement.
Glickman, S. E., & Schiff, B. B. (1967) · Psychological Review · doi:10.1037/h0024290 · Cited by 465
Reexamination of the role of the hypothalamus in motivation.
Valenstein, E. S., Cox, V. C., & Kakolewski, J. W. (1970) · Psychological Review · doi:10.1037/h0028581 · Cited by 390
Tulving, E., & Madigan, S. A. (1970) · Annual Review of Psychology · doi:10.1146/annurev.ps.21.020170.002253 · Cited by 384
THE CREATIVE PORPOISE: TRAINING FOR NOVEL BEHAVIOR1
Pryor, K. W., Haag, R., & O'Reilly, J. (1969) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1969.12-653 · Cited by 380
CONDITIONS PRODUCING PSYCHOGENIC POLYDIPSIA IN ANIMALS*
Falk, J. L. (1969) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.1969.tb12908.x · Cited by 379
Association of Illness with Prior Ingestion of Novel Foods
Revusky, S. H., & Bedarf, E. W. (1967) · Science · doi:10.1126/science.155.3759.219 · Cited by 376
NEGATIVE REINFORCEMENT AS SHOCK‐FREQUENCY REDUCTION1
Herrnstein, R. J., & Hineline, P. N. (1966) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1966.9-421 · Cited by 319
The rat's rate of drinking as a function of water deprivation.
Stellar, E., & Hill, J. H. (1952) · Journal of Comparative and Physiological Psychology · doi:10.1037/h0062150 · Cited by 312
On the Parallel Between Learning and Evolution
Pringle, J. W. S. (1951) · Behaviour · doi:10.1163/156853951x00269 · Cited by 286
Response variability in the white rat during conditioning, extinction, and reconditioning.
Antonitis, J. J. (1951) · Journal of Experimental Psychology · doi:10.1037/h0060407 · Cited by 281
Robbins, D., Neimark, E. D., & Estes, W. K. (1972) · The American Journal of Psychology · doi:10.2307/1420675 · Cited by 278
Morris, D. (1954) · Behaviour · doi:10.1163/156853954x00130 · Cited by 272
Glickman, S. E., & Sroges, R. W. (1966) · Behaviour · doi:10.1163/156853966x00074 · Cited by 263
Zener, K. (1937) · The American Journal of Psychology · doi:10.2307/1416644 · Cited by 240
Time-out from Positive Reinforcement
Azrin, N. H. (1961) · Science · doi:10.1126/science.133.3450.382 · Cited by 235
Optimal behavior in free-operant experiments.
Shimp, C. P. (1969) · Psychological Review · doi:10.1037/h0027311 · Cited by 219
Beach, F. A. (1955) · Psychological Review · doi:10.1037/h0049138 · Cited by 217
SCHEDULE‐INDUCED POLYDIPSIA AS A FUNCTION OF FIXED INTERVAL LENGTH1
Falk, J. L. (1966) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1966.9-37 · Cited by 204
On the functional organisation of drives
Holst, E. V., & Paul, U. V. S. (1963) · Animal Behaviour · doi:10.1016/0003-3472(63)90002-2 · Cited by 156
ESCAPE FROM SD ASSOCIATED WITH FIXED‐RATIO REINFORCEMENT1
Thompson, D. M. (1964) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1964.7-1 · Cited by 131
Central or peripheral mediation of learning with long CS-US intervals in the feeding system.
Rozin, P. N. (1969) · Journal of Comparative and Physiological Psychology · doi:10.1037/h0027299 · Cited by 129
SOME PROPERTIES OF SPACED RESPONDING IN PIGEONS1
Staddon, J. E. R. (1965) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1965.8-19 · Cited by 127
Self-citationOn the causal and functional significance of displacement activities
McFarland, D. J. (2010) · Zeitschrift für Tierpsychologie · doi:10.1111/j.1439-0310.1966.tb01600.x · Cited by 119
A DEMONSTRATION OF AUTO‐SHAPING WITH MONKEYS
Sidman, M., & Fletcher, F. G. (1968) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1968.11-307 · Cited by 115
Explanatory Models in Linguistics
Chomsky, N. (1966) · Studies in logic and the foundations of mathematics · doi:10.1016/s0049-237x(09)70617-2 · Cited by 106
Displacement grooming in the chaffinch
Rowell, C. H. F. (1961) · Animal Behaviour · doi:10.1016/0003-3472(61)90049-5 · Cited by 100
ATTACK BEHAVIOR AS A FUNCTION OF MINIMUM INTER‐FOOD INTERVAL1
Flory, R. K. (1969) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1969.12-825 · Cited by 92
SUPERSTITIOUS KEY PECKING AFTER THREE PECK‐PRODUCED REINFORCEMENTS1
Neuringer, A. J. (1970) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1970.13-127 · Cited by 86
B. F. SKINNER'S VERBAL BEHAVIOR: A RETROSPECTIVE APPRECIATION1
MacCorquodale, K. (1969) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1969.12-831 · Cited by 83
CONCURRENT PERFORMANCES: INHIBITION OF ONE RESPONSE BY REINFORCEMENT OF ANOTHER1
Catania, A. C. (1969) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1969.12-731 · Cited by 74
Reversal Learning and Forgetting in Bird and Fish
Gonzalez, R. C., Behrend, E. R., & Bitterman, M. E. (1967) · Science · doi:10.1126/science.158.3800.519 · Cited by 73
Akerman, B., Andersson, B., Fabricius, E., & Svensson, L. (1960) · Acta Physiologica Scandinavica · doi:10.1111/j.1748-1716.1960.tb00187.x · Cited by 70
Many Responses per Food Reward with Free Food Present
Neuringer, A. J. (1970) · Science · doi:10.1126/science.169.3944.503 · Cited by 65
Magnitude of Reinforcement and Consummatory Behavior
Davis, J. D., & Keehn, J. D. (1959) · Science · doi:10.1126/science.130.3370.269 · Cited by 62
FIXED‐INTERVAL REINFORCEMENT OF RUNNING IN A WHEEL1
Skinner, B. F., & Morse, W. H. (1958) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1958.1-371 · Cited by 53
The Auditory Sensitivity of Guinea Pigs
Upton, M. (1929) · The American Journal of Psychology · doi:10.2307/1414681 · Cited by 51
Licking Rates in Infant Albino Rats
Schaeffer, R. W., & Premack, D. (1961) · Science · doi:10.1126/science.134.3494.1980 · Cited by 50
Temporal effects of reinforcement: A negative “frustration” effect
Staddon, J. E. R. (1970) · Learning and Motivation · doi:10.1016/0023-9690(70)90148-7 · Cited by 50
Self-citationAUTOSHAPING OF KEY PECKING IN PIGEONS WITH NEGATIVE REINFORCEMENT2
Rachlin, H. C. (1969) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1969.12-521 · Cited by 44
SCHEDULE‐INDUCED POLYDIPSIA: ARE RESPONSE‐DEPENDENT SCHEDULES A LIMITING CONDITION?1
Burks, C. D. (1970) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1970.13-351 · Cited by 33
Theories of language acquisition
Vetter, H. J., & Howell, R. W. (1971) · Journal of Psycholinguistic Research · doi:10.1007/bf01066935 · Cited by 30
Since learned behavior is innate, and vice versa, what now?
Verplanck, W. S. (1955) · Psychological Review · doi:10.1037/h0044788 · Cited by 24
Black, A. H., & Young, G. A. (1972) · Elsevier eBooks · doi:10.1016/b978-0-12-283150-8.50007-1 · Cited by 23
Cited by
Smith, T. L., & Chomsky, N. (1982) · The Philosophical Review · doi:10.2307/2184681 · Cited by 2,808
Chomsky, N. (1980) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00001515 · Cited by 2,650
Scalar expectancy theory and Weber's law in animal timing.
Gibbon, J. (1977) · Psychological Review · doi:10.1037//0033-295x.84.3.279 · Cited by 2,221
Judgment of contingency in depressed and nondepressed students: Sadder but wiser?
Alloy, L. B., & Abramson, L. Y. (1979) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.108.4.441 · Cited by 1,692
Behavioral Decision Theory: Processes of Judgement and Choice
Einhorn, H. J., & Hogarth, R. M. (1981) · Annual Review of Psychology · doi:10.1146/annurev.ps.32.020181.000413 · Cited by 1,691
Metadata
- Authors
- Staddon, J. E., & Simmelhag, V. L.
- Venue
- Psychological Review
- Published
- 1971-01
- Volume
- 78
- Issue
- 1
- Pages
- 3-43
- ISSN
- 0033-295X (ISSN-L)
- 1939-1471
- OpenAlex
- W2162733293
- Cited by
- 1,060
- References
- 77
- FWCI
- 55.06
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.