The DOI matches its OpenAlex record; 254 of the 254 references it cites were found in a registry or an index.
Mathematical principles of reinforcement
Abstract
Abstract Effective conditioning requires a correlation between the experimenter's definition of a response and an organism's, but an animal's perception of its behavior differs from ours. These experiments explore various definitions of the response, using the slopes of learning curves to infer which comes closest to the organism's definition. The resulting exponentially weighted moving average provides a model of memory that is used to ground a quantitative theory of reinforcement. The theory assumes that: incentives excite behavior and focus the excitement on responses that are contemporaneous in memory. The correlation between the organism's memory and the behavior measured by the experimenter is given by coupling coefficients, which are derived for various schedules of reinforcement. The coupling coefficients for simple schedules may be concatenated to predict the effects of complex schedules. The coefficients are inserted into a generic model of arousal and temporal constraint to predict response rates under any scheduling arrangement. The theory posits a response-indexed decay of memory, not a time-indexed one. It requires that incentives displace memory for the responses that occur before them, and may truncate the representation of the response that brings them about. As a contiguity-weighted correlation model, it bridges opposing views of the reinforcement process. By placing the short-term memory of behavior in so central a role, it provides a behavioral account of a key cognitive process.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Learning Internal Representations by Error Propagation
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1985) · doi:10.21236/ada164453 · Cited by 16,172
The genetical evolution of social behaviour. I
Hamilton, W. D. (1964) · Journal of Theoretical Biology · doi:10.1016/0022-5193(64)90038-4 · Cited by 15,725
Rescorla, R. A. (1972) · Medical Entomology and Zoology · Cited by 9,461
Human Memory: A Proposed System and its Control Processes
Atkinson, R. C., & Shiffrin, R. M. (1968) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(08)60422-3 · Cited by 7,216
Cognitive maps in rats and men
Tolman, E. C. (1948) · Psychological Review · doi:10.1037/h0061626 · Cited by 6,641
The Psychology of Learning and Motivation: Advances in Research and Theory
(2010) · Psychology of Learning and Motivation · doi:10.1016/c2009-0-62209-1 · Cited by 5,994
Skinner, B. F. (1957) · doi:10.1037/11256-000 · Cited by 5,759
The Psychology of Learning and Motivation
(2021) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(21)x0002-3 · Cited by 5,027
Ferster, C. B., & Skinner, B. F. (1957) · doi:10.1037/10627-000 · Cited by 4,894
Classical conditioning II: Current research and theory.
Black, A. H., & Prokasy, W. F. (1972) · Appleton-Century-Crofts eBooks · Cited by 4,449
Skinner, B. F., & Hull, C. L. (1944) · The American Journal of Psychology · doi:10.2307/1416955 · Cited by 4,051
Falsification and the Methodology of Scientific Research Programmes
Lakatos, I. (1976) · Can Theories be Refuted? · doi:10.1007/978-94-010-1863-0_14 · Cited by 3,915
The Evolution of Social Behavior
Alexander, R. D. (1974) · Annual Review of Ecology and Systematics · doi:10.1146/annurev.es.05.110174.001545 · Cited by 3,854
Skinner, B. F. (1938) · Cited by 3,571
Jacob, M. (1989) · Health Education Journal · doi:10.1177/001789698904800401 · Cited by 3,090
Context theory of classification learning
Medin, D. L., & Schaffer, M. M. (1978) · Psychological Review · doi:10.1037/0033-295x.85.3.207 · Cited by 3,061
The Methodology of Scientific Research Programmes: Philosophical Papers
Lakatos, I. (1978) · doi:10.1017/cbo9780511621123 · Cited by 3,045
Implicit memory: History and current status.
Schacter, D. L. (1987) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.13.3.501 · Cited by 2,983
Short-term retention of individual verbal items.
Peterson, L., & Peterson, M. J. (1959) · Journal of Experimental Psychology · doi:10.1037/h0049234 · Cited by 2,939
Mathematical Bioeconomics: The Optimal Management of Renewable Resources.
Clark, C. (1993) · Biometrics · doi:10.2307/2532591 · Cited by 2,668
Herrnstein, R. J. (1970) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1970.13-243 · Cited by 2,611
Gallistel, C. R. (1990) · Cited by 2,571
Purposive Behavior in Animals and Men
Rodhom, C., & Tolman, E. C. (1950) · The American Journal of Psychology · doi:10.2307/1418946 · Cited by 2,455
Turner, R. M. (1978) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/0005-7916(78)90073-3 · Cited by 2,265
Scalar expectancy theory and Weber's law in animal timing.
Gibbon, J. (1977) · Psychological Review · doi:10.1037//0033-295x.84.3.279 · Cited by 2,221
Applied Probability Models with Optimization Applications.
Gani, J., & Ross, S. M. (1971) · Journal of the American Statistical Association · doi:10.2307/2284258 · Cited by 2,195
Laudan, L. (1977) · Cited by 2,048
Remembrance of places passed: Spatial memory in rats.
Olton, D. S., & Samuelson, R. J. (1976) · Journal of Experimental Psychology: Animal Behavior Processes · doi:10.1037//0097-7403.2.2.97 · Cited by 1,998
"Schema abstraction" in a multiple-trace memory model.
Hintzman, D. L. (1986) · Psychological Review · doi:10.1037//0033-295x.93.4.411 · Cited by 1,926
Feynman, R. (2017) · The MIT Press eBooks · doi:10.7551/mitpress/11068.001.0001 · Cited by 1,881
Are theories of learning necessary?
Skinner, B. F. (1950) · Psychological Review · doi:10.1037/h0054367 · Cited by 1,804
On the generality of the laws of learning.
Seligman, M. E. (1970) · Psychological Review · doi:10.1037/h0029790 · Cited by 1,744
Steps toward Artificial Intelligence
Minsky, M. (1961) · Proceedings of the IRE · doi:10.1109/jrproc.1961.287775 · Cited by 1,675
On the economy of the human-processing system.
Navon, D., & Gopher, D. (1979) · Psychological Review · doi:10.1037//0033-295x.86.3.214 · Cited by 1,669
Stevens' Handbook of Experimental Psychology
(2002) · Wiley eBooks · doi:10.1002/0471214426 · Cited by 1,632
Species-specific defense reactions and avoidance learning
Bolles, R. C. (1970) · Psychological Review · doi:10.1037/h0028589 · Cited by 1,610
Cognitive Processes in Animal Behavior
Hill, W. F., Hulse, S. H., Fowler, H., & Honig, W. K. (1979) · The American Journal of Psychology · doi:10.2307/1421585 · Cited by 1,595
Contingencies of reinforcement : a theoretical analysis
Skinner, B. F. (1969) · Medical Entomology and Zoology · Cited by 1,560
Two-process learning theory: Relationships between Pavlovian conditioning and instrumental learning.
Rescorla, R. A., & Solomon, R. L. (1967) · Psychological Review · doi:10.1037/h0024475 · Cited by 1,487
ON TWO TYPES OF DEVIATION FROM THE MATCHING LAW: BIAS AND UNDERMATCHING 1
Baum, W. M. (1974) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1974.22-231 · Cited by 1,460
Some Tests of the Decay Theory of Immediate Memory
Brown, J. (1958) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470215808416249 · Cited by 1,442
Lecture Notes in Pure and Applied Mathematics
(2010) · Lecture notes in pure and applied mathematics · doi:10.1201/chlenopuamt · Cited by 1,439
Contingencies of reinforcement: A theoretical analysis
Eysenck, H. J. (1970) · Behavior Therapy · doi:10.1016/s0005-7894(70)80039-9 · Cited by 1,358
SUBJECTIVE PROBABILITY AND DELAY
Rachlin, H., Raineri, A., & Cross, D. (1991) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1991.55-233 · Cited by 1,341
The operational analysis of psychological terms.
Skinner, B. F. (1945) · Psychological Review · doi:10.1037/h0062535 · Cited by 1,262
Actions and habits: The development of behavioural autonomy
Dickinson, A. (1985) · Philosophical Transactions of the Royal Society of London. B, Biological Sciences · doi:10.1098/rstb.1985.0010 · Cited by 1,217
Concepts and Conceptual Development: Ecological and Intellectual Factors in Categorization
Neisser, U. (1989) · Medical Entomology and Zoology · Cited by 1,206
Akaike Information Criterion Statistics.
Grove, D., Sakamoto, Y., Ishiguro, M., & Kitagawa, G. (1988) · The Statistician · doi:10.2307/2348776 · Cited by 1,184
Breland, K., & Breland, M. (1961) · American Psychologist · doi:10.1037/h0040090 · Cited by 1,181
DAOUD, G. (1965) · Archives of Pediatrics & Adolescent Medicine · doi:10.1001/archpedi.1965.02090030355030 · Cited by 1,171
Judgments of frequency and recognition memory in a multiple-trace memory model.
Hintzman, D. L. (1988) · Psychological Review · doi:10.1037//0033-295x.95.4.528 · Cited by 1,134
Cognitive Processes in Animal Behavior
(2018) · Routledge eBooks · doi:10.4324/9780203710029 · Cited by 1,107
Akaike information criterion statistics
(1987) · Mathematics and Computers in Simulation · doi:10.1016/0378-4754(87)90094-2 · Cited by 1,097
The Nature of Selection: Evolutionary Theory in Philosophical Focus.
Brandon, R. N., & Sober, E. (1986) · The Philosophical Review · doi:10.2307/2185056 · Cited by 1,090
A model for stimulus generalization in Pavlovian conditioning.
Pearce, J. M. (1987) · Psychological Review · doi:10.1037//0033-295x.94.1.61 · Cited by 1,046
Toward a statistical theory of learning.
Estes, W. K. (1950) · Psychological Review · doi:10.1037/h0058559 · Cited by 994
Honig, W. K., & Staddon, J. E. R. (2022) · Routledge eBooks · doi:10.4324/9781003256670 · Cited by 965
Mathematical Bio-Economics: The Optimal Management of Renewable Resources
Hartwick, J. M., & Clark, C. W. (1977) · The Canadian Journal of Economics · doi:10.2307/134310 · Cited by 922
Eysenck, H. J., & Hull, C. L. (1954) · The British Journal of Sociology · doi:10.2307/587674 · Cited by 909
Information Processing in Animals
(2014) · Psychology Press eBooks · doi:10.4324/9781315798820 · Cited by 893
Autoshaping and Conditioning Theory
Perkins, C. C., Locurto, C. W., Terrace, H. S., & Gibbon, J. (1982) · The American Journal of Psychology · doi:10.2307/1422674 · Cited by 864
Separating conscious and unconscious influences of memory: Measuring recollection.
Jacoby, L. L., Toth, J. P., & Yonelinas, A. P. (1993) · Journal of Experimental Psychology: General · doi:10.1037//0096-3445.122.2.139 · Cited by 801
A QUANTITATIVE ANALYSIS OF THE RESPONDING MAINTAINED BY INTERVAL SCHEDULES OF REINFORCEMENT1
Catania, A. C., & Reynolds, G. S. (1968) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1968.11-s327 · Cited by 793
Animal intelligence: An experimental study of the associative processes in animals.
Thorndike, E. L. (1898) · The Psychological Review: Monograph Supplements · doi:10.1037/h0092987 · Cited by 778
Schenk, F. (1991) · Trends in Neurosciences · doi:10.1016/0166-2236(91)90036-t · Cited by 776
Kononowicz, T. W., van Rijn, H., & Meck, W. H. (2018) · Stevens' Handbook of Experimental Psychology and Cognitive Neuroscience · doi:10.1002/9781119170174.epcn114 · Cited by 756
Elements of the theory of Markov processes and their applications
(1960) · Journal of the Franklin Institute · doi:10.1016/0016-0032(60)90686-4 · Cited by 731
Contingencies of Reinforcement
(2012) · Encyclopedia of the Sciences of Learning · doi:10.1007/978-1-4419-1428-6_3625 · Cited by 717
A behavioral theory of timing.
Killeen, P. R., & Fetterman, J. G. (1988) · Psychological Review · doi:10.1037//0033-295x.95.2.274 · Cited by 713
Self-citationStimulants : neurochemical, behavioral, and clinical perspectives
Creese, I. (1983) · Raven Press eBooks · Cited by 698
MATCHING, UNDERMATCHING, AND OVERMATCHING IN STUDIES OF CHOICE
William, B. M. (1979) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1979.32-269 · Cited by 698
THE CORRELATION‐BASED LAW OF EFFECT1
Baum, W. M. (1973) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1973.20-137 · Cited by 672
The Matching Law: A Research Review
Davison, M., & McCarthy, D. (2016) · Medical Entomology and Zoology · Cited by 650
Norman, D. A., & Bernbach, H. A. (1970) · Cited by 609
The Generic Nature of the Concepts of Stimulus and Response
Skinner, B. F. (1935) · The Journal of General Psychology · doi:10.1080/00221309.1935.9920087 · Cited by 601
Pais, A. (1982) · Cited by 596
Associations across time: The hippocampus as a temporary memory store
Rawlins, J. N. P. (1985) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00001291 · Cited by 561
Limits to Action: The Allocation of Individual Behavior
Baum, W. E., & Staddon, J. E. R. (1982) · The American Journal of Psychology · doi:10.2307/1422478 · Cited by 555
Analysis and Integration of Behavioral Units
Zeiler, M. D. (2016) · Routledge eBooks · doi:10.4324/9781315620060 · Cited by 539
Olton, D. S. (1979) · American Psychologist · doi:10.1037//0003-066x.34.7.583 · Cited by 510
Numerical competence in animals: Definitional issues, current evidence, and a new research agenda
Davis, H., & Pérusse, R. (1988) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00053437 · Cited by 508
Method and theory in the study of avoidance.
Herrnstein, R. J. (1969) · Psychological Review · doi:10.1037/h0026786 · Cited by 490
Deutsch, D., Deutsch, J. A., & Barondes, S. H. (1975) · Medical Entomology and Zoology · Cited by 474
FORMAL PROPERTIES OF THE MATCHING LAW1
Herrnstein, R. J. (1974) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1974.21-159 · Cited by 467
Learned Associations Over Long Delays
Revusky, S., & Garcia, J. (1970) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(08)60429-6 · Cited by 462
The neuropharmacological basis of reward
(1991) · General Pharmacology: The Vascular System · doi:10.1016/0306-3623(91)90364-c · Cited by 454
Choice, optimal foraging, and the delay-reduction hypothesis
Fantino, E., & Abarca, N. (1985) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00020847 · Cited by 436
A Primer of Operant Conditioning
Reynolds, G. S. (1975) · Medical Entomology and Zoology · Cited by 430
RULE‐GOVERNED BEHAVIOR AND SENSITIVITY TO CHANGING CONSEQUENCES OF RESPONDING
Hayes, S. C., Brownstein, A. J., Zettle, R. D., Rosenfarb, I., & Korn, Z. (1986) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1986.45-237 · Cited by 410
Tests of an equivalence rule for fixed and variable reinforcer delays.
Mazur, J. E. (1984) · Journal of Experimental Psychology: Animal Behavior Processes · doi:10.1037//0097-7403.10.4.426 · Cited by 404
Two modes of learning for interactive tasks
Hayes, N. A., & Broadbent, D. E. (1988) · Cognition · doi:10.1016/0010-0277(88)90015-7 · Cited by 386
Behaviorism: a Conceptual Reconstruction
Zuriff, G. E. (1985) · Columbia University Press eBooks · doi:10.7312/zuri90466 · Cited by 377
INSTRUCTED VERSUS SHAPED HUMAN VERBAL BEHAVIOR: INTERACTIONS WITH NONVERBAL RESPONDING
Catania, A. C., Matthews, B. A., & Shimoff, E. (1982) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1982.38-233 · Cited by 374
A Neural Model of Attention, Reinforcement and Discrimination Learning
Grossberg, S. (1975) · International Review of Neurobiology · doi:10.1016/s0074-7742(08)60037-9 · Cited by 355
Elements of the Theory of Markov Processes and their Applications.
Morán, P. A. P., & Bharucha-Reid, A. T. (1961) · Journal of the Royal Statistical Society Series A (General) · doi:10.2307/2343157 · Cited by 349
Functions of dopamine in the dorsal and ventral striatum
Robbins, T. W., & Everitt, B. J. (1992) · Seminars in Neuroscience · doi:10.1016/1044-5765(92)90010-y · Cited by 348
Modeling games in the Newtonian World
Hestenes, D. (1992) · American Journal of Physics · doi:10.1119/1.17080 · Cited by 348
Anger, D. (1956) · Journal of Experimental Psychology · doi:10.1037/h0041255 · Cited by 336
Evolution of a Structured Connectionist Model of Pavlovian Conditioning (AESOP)
(2014) · Contemporary Learning Theories · doi:10.4324/9781315801896-13 · Cited by 326
NEGATIVE REINFORCEMENT AS SHOCK‐FREQUENCY REDUCTION1
Herrnstein, R. J., & Hineline, P. N. (1966) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1966.9-421 · Cited by 319
Page, S., & Neuringer, A. (1985) · Journal of Experimental Psychology: Animal Behavior Processes · doi:10.1037//0097-7403.11.3.429 · Cited by 318
AN INTEGRATIVE MODEL FOR THE STUDY OF BEHAVIORAL MOMENTUM
Nevin, J. A. (1992) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1992.57-301 · Cited by 306
Intelligence as Adaptive Behavior: An Experiment in Computational Neuroethology
Sterling, L., Pao, Y., & Beer, R. D. (1990) · Medical Entomology and Zoology · Cited by 284
How marsh tits find their hoards: The roles of site preference and spatial memory.
Shettleworth, S. J., & Krebs, J. R. (1982) · Journal of Experimental Psychology: Animal Behavior Processes · doi:10.1037//0097-7403.8.4.354 · Cited by 283
PROBABILITY RELATIONS WITHIN RESPONSE SEQUENCES UNDER RATIO REINFORCEMENT1
Mechner, F. (1958) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1958.1-109 · Cited by 283
Robbins, D., Neimark, E. D., & Estes, W. K. (1972) · The American Journal of Psychology · doi:10.2307/1420675 · Cited by 278
Cognitive Aspects of Stimulus Control
(2018) · Psychology Press eBooks · doi:10.4324/9781315789101 · Cited by 271
Shettleworth, S. J. (1975) · Journal of Experimental Psychology: Animal Behavior Processes · doi:10.1037//0097-7403.1.1.56 · Cited by 271
Unconscious influences revealed: Attention, awareness, and control.
Jacoby, L. L., Lindsay, D. S., & Toth, J. P. (1992) · American Psychologist · doi:10.1037//0003-066x.47.6.802 · Cited by 267
The Experimental Analysis of Behavior.
Skinner, B. F. (2007) · Cumulative record (enlarged ed.). · doi:10.1037/11324-008 · Cited by 266
The concept of the habit-family hierarchy and maze learning: Part II.
Hull, C. L. (1934) · Psychological Review · doi:10.1037/h0072855 · Cited by 259
Purposive Behavior in Animals and Man
Young, P. T., & Tolman, E. C. (1933) · The American Journal of Psychology · doi:10.2307/1414208 · Cited by 247
Memory and the efficient use of information
McNamara, J. M., & Houston, A. I. (1987) · Journal of Theoretical Biology · doi:10.1016/s0022-5193(87)80209-6 · Cited by 242
Arousal: Its genesis and manifestation as response rate.
Killeen, P. R., Hanson, S. J., & Osborne, S. R. (1978) · Psychological Review · doi:10.1037//0033-295x.85.6.571 · Cited by 240
Self-citationVerbal relations and the evolution of behavior analysis.
Hayes, S. C., & Hayes, L. J. (1992) · American Psychologist · doi:10.1037/0003-066x.47.11.1383 · Cited by 239
The Neuropharmacological Basis of Reward
ALTAMURA, A. C. (1992) · American Journal of Psychiatry · doi:10.1176/ajp.149.7.976 · Cited by 234
Information processing in animals: Memory mechanisms
Hall, G. (1983) · Biological Psychology · doi:10.1016/0301-0511(83)90021-2 · Cited by 223
Rating causal relations: Role of probability in judgments of response^outcome contingency.
Wasserman, E. A., Elek, S. M., Chatlosh, D. L., & Baker, A. G. (1993) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037//0278-7393.19.1.174 · Cited by 216
Instrumental judgment and performance under variations in action-outcome contingency and contiguity
Shanks, D. R., & Dickinson, A. (1991) · Memory & Cognition · doi:10.3758/bf03197139 · Cited by 211
Whittlesea, B. W., & Dorken, M. D. (1993) · Journal of Experimental Psychology: General · doi:10.1037//0096-3445.122.2.227 · Cited by 210
BEHAVIOR SYSTEMS AND REINFORCEMENT: AN INTEGRATIVE APPROACH
Timberlake, W. (1993) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1993.60-105 · Cited by 208
Essays in neobehaviorism: A memorial volume to Kenneth W. Spence
(1972) · Behavior Therapy · doi:10.1016/s0005-7894(72)80119-9 · Cited by 204
Pavlovian conditioned stimulus effects upon instrumental choice behavior are reinforcer specific
Kruse, J. M., Overmier, J. B., Konz, W. A., & Rokke, E. (1983) · Learning and Motivation · doi:10.1016/0023-9690(83)90004-8 · Cited by 203
Whittlesea, B. W., & Dorken, M. D. (1993) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.122.2.227 · Cited by 200
Verbal Relations and the Evolution of Behavior Analysis
(2015) · The Act in Context · doi:10.4324/9781315745138-18 · Cited by 198
Introduction to Neural and Cognitive Modeling
Levine, D. S. (2000) · Psychology Press eBooks · doi:10.4324/9781410605504 · Cited by 193
Essentialism and selectionism in cognitive science and behavior analysis.
Palmer, D. C., & Donahoe, J. W. (1992) · American Psychologist · doi:10.1037//0003-066x.47.11.1344 · Cited by 188
Response acquisition with delayed reinforcement.
Lattal, K. A., & Gleeson, S. (1990) · Journal of Experimental Psychology: Animal Behavior Processes · doi:10.1037//0097-7403.16.1.27 · Cited by 187
Mediationism and the obfuscation of memory.
Watkins, M. J. (1990) · American Psychologist · doi:10.1037/0003-066x.45.3.328 · Cited by 187
ORGANIZATION IN MEMORY AND BEHAVIOR1
Shimp, C. P. (1976) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1976.26-113 · Cited by 186
Behavior Systems and Learning: From Misbehavior to General Principles
Timberlake, W., & Lucas, G. A. (2019) · Contemporary Learning Theories · doi:10.4324/9781315788982-12 · Cited by 184
The concept of the habit-family hierarchy, and maze learning. Part I.
Hull, C. L. (1934) · Psychological Review · doi:10.1037/h0070758 · Cited by 183
What connectionist models learn: Learning and representation in connectionist networks
Hanson, S. J., & Burr, D. J. (1990) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00079760 · Cited by 175
Preservation of specific experiences in the representation of general knowledge.
Whittlesea, B. W. (1987) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037//0278-7393.13.1.3 · Cited by 170
Prediction and Theory Evaluation: The Case of Light Bending
Brush, S. G. (1989) · Science · doi:10.1126/science.246.4934.1124 · Cited by 162
Stimulus discriminability, contingency discriminability, and schedule performance
Davison, M., & Jenkins, P. E. (1985) · Animal Learning & Behavior · doi:10.3758/bf03213368 · Cited by 159
Behavior of hypertensive and hyperactive rat strains: Hyperactivity is not unitarily determined
Sagvolden, T., Hendley, E. D., & Knardahl, S. (1992) · Physiology & Behavior · doi:10.1016/0031-9384(92)90432-2 · Cited by 157
Mediationism and the obfuscation of memory.
Watkins, M. J. (1990) · American Psychologist · doi:10.1037//0003-066x.45.3.328 · Cited by 155
STIMULUS CONTROL OF BEHAVIORAL HISTORY
Freeman, T. J., & Lattal, K. A. (1992) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1992.57-5 · Cited by 147
NEGATIVE REINFORCEMENT WITHOUT SHOCK REDUCTION1
Hineline, P. N. (1970) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1970.14-259 · Cited by 144
Illusory correlation in a simulated exemplar-based memory
Smith, E. R. (1991) · Journal of Experimental Social Psychology · doi:10.1016/0022-1031(91)90017-z · Cited by 144
THE EFFECT OF SMALL SEQUENTIAL CHANGES IN FIXED‐RATIO SIZE UPON THE POST‐REINFORCEMENT PAUSE1
Powell, R. W. (1968) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1968.11-589 · Cited by 143
SHORT‐TERM MEMORY IN THE PIGEON: RELATIVE RECENCY1
Shimp, C. P. (1976) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1976.25-55 · Cited by 142
EXPERIMENTAL CONTROL OF SUPERSTITIOUS RESPONDING IN HUMANS 1
Catania, A. C., & Cutts, D. (1963) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1963.6-203 · Cited by 139
ON THE ROLE OF “MEMORY” IN THE ANALYSIS OF BEHAVIOR
Branch, M. N. (1977) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1977.28-171 · Cited by 137
The role of contingency in classical conditioning.
Papini, M. R., & Bitterman, M. E. (1990) · Psychological Review · doi:10.1037/0033-295x.97.3.396 · Cited by 135
Herrnstein, R. J. (1979) · Psychological Review · doi:10.1037//0033-295x.86.5.486 · Cited by 133
A COMPARISON OF SIGNALED AND UNSIGNALED DELAY OF REINFORCEMENT
Richards, R. W. (1981) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1981.35-145 · Cited by 131
THE EFFECTS OF UNSIGNALLED DELAYED REINFORCEMENT1
Williams, B. A. (1976) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1976.26-441 · Cited by 130
REINFORCEMENT SCHEDULES: THE ROLE OF RESPONSES PRECEDING THE ONE THAT PRODUCES THE REINFORCER1
Catania, A. C. (1971) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1971.15-271 · Cited by 130
Experimental and theoretical studies of consciousness
Bock, G. (1993) · Wiley eBooks · Cited by 129
Starlings exploiting patches: the effect of recent experience on foraging decisions
Cuthill, I. C., Kacelnik, A., Krebs, J. R., Haccou, P., & Iwasa, Y. (1990) · Animal Behaviour · doi:10.1016/s0003-3472(05)80692-x · Cited by 127
UNSIGNALLED DELAY OF REINFORCEMENT IN VARIABLE‐INTERVAL SCHEDULES
Sizemore, O. J., & Lattal, K. A. (1978) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1978.30-169 · Cited by 127
Signal Location and Positive Versus Negative Conditioned Suppression in the Rat.
Karpicke, J., Christoph, G., Peterson, G., & Hearst, E. (1977) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/0097-7403.3.2.105 · Cited by 125
A PARAMETRIC EVALUATION OF THE HEDONIC AND MOTORIC EFFECTS OF DRUGS: PIMOZIDE AND AMPHETAMINE
Heyman, G. M. (1983) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1983.40-113 · Cited by 125
B.F.Skinner: Consensus and Controversy
(2005) · Routledge eBooks · doi:10.4324/9780203974957-6 · Cited by 122
Shimp, C. P. (1983) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1983.39-61 · Cited by 121
Spear, N. E., Ekstrand, B. R., & Underwood, B. J. (1964) · Journal of Experimental Psychology · doi:10.1037/h0047886 · Cited by 120
van Hest, A., van Haaren, F., & van de Poll, N. E. (1987) · Physiology & Behavior · doi:10.1016/0031-9384(87)90018-7 · Cited by 118
Flow of information within the organism
Broadbent, D. E. (1963) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(63)80065-1 · Cited by 115
INCENTIVE THEORY: IV. MAGNITUDE OF REWARD
Killeen, P. R. (1985) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1985.43-407 · Cited by 114
Self-citationRate of reinforcement and session duration as determinants of within-session patterns of responding
McSweeney, F. K. (1992) · Animal Learning & Behavior · doi:10.3758/bf03200413 · Cited by 114
ON HERRNSTEIN'S EQUATION AND RELATED FORMS
Staddon, J. E. R. (1977) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1977.28-163 · Cited by 114
REINFORCEMENT FREQUENCY AND CONTINGENCY AS FACTORS IN FIXED‐RATIO BEHAVIOR1
Killeen, P. R. (1969) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1969.12-391 · Cited by 114
Self-citationREINFORCEMENT CONTINGENCIES AS DISCRIMINATIVE STIMULI1
Lattal, K. A. (1975) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1975.23-241 · Cited by 113
Ciba Foundation Symposium 174 ‐ Experimental and Theoretical Studies of Consciousness
(2007) · Novartis Foundation symposium · doi:10.1002/9780470514412 · Cited by 113
On metaknowledge in the pigeon: An organism’s knowledge about its own behavior
Shimp, C. P. (1982) · Animal Learning & Behavior · doi:10.3758/bf03213722 · Cited by 112
Behavioral contrast and behavioral momentum.
Nevin, J. A. (1992) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/0097-7403.18.2.126 · Cited by 111
Applied Mathematics: A Contemporary Approach
Logan, J. D. (1987) · Medical Entomology and Zoology · Cited by 108
A COMPARISON OF VARIABLE‐RATIO AND VARIABLE‐INTERVAL SCHEDULES OF REINFORCEMENT1
Zuriff, G. E. (1970) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1970.13-369 · Cited by 106
Neuringer, A. J. (1992) · Psychological Science · doi:10.1111/j.1467-9280.1992.tb00037.x · Cited by 105
Wilkenfield, J., Nickel, M. K., Blakely, E. Q., & Poling, A. D. (1992) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1992.58-431 · Cited by 104
McDowell, J. J., & Wood, H. M. (1984) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1984.41-183 · Cited by 102
Introduction: Models of Human Memory
Norman, D. A. (1970) · Elsevier eBooks · doi:10.1016/b978-0-12-521350-9.50006-1 · Cited by 101
Impulsiveness in pigeons living in the experimental chamber
Logue, A. W., Chavarro, A., Rachlin, H. C., & Reeder, R. (1988) · Animal Learning & Behavior · doi:10.3758/bf03209040 · Cited by 100
Bradshaw, C. M., Ruddle, H. V., & Szabadi, E. (1981) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1981.35-263 · Cited by 96
STEADY‐STATE PERFORMANCE ON FIXED‐, MIXED‐, AND RANDOM‐RATIO SCHEDULES
Mazur, J. (1983) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1983.39-293 · Cited by 95
ON THE DISTINCTION BETWEEN OPEN AND CLOSED ECONOMIES
Timberlake, W. D., & Peden, B. F. (1987) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1987.48-35 · Cited by 92
Dynamics in the fine structure of schedule-controlled behavior
Palya, W. L. (1992) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1992.57-267 · Cited by 91
SPATIOTEMPORAL PATTERNS OF BEHAVIOR PRODUCED BY VARIABLE‐INTERVAL SCHEDULES OF REINFORCEMENT
Pear, J. J. (1985) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1985.44-217 · Cited by 89
HUMANS' CHOICES IN SITUATIONS OF TIME‐BASED DIMINISHING RETURNS
Hackenberg, T. D., & Axtell, S. A. M. (1993) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1993.59-445 · Cited by 89
On prediction and control: B. F. Skinner and the technological ideal of science.
Smith, L. D. (1992) · American Psychologist · doi:10.1037/0003-066x.47.2.216 · Cited by 88
Species and individual differences in communication based on private states
Lubinski, D., & Thompson, T. I. (1993) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00032039 · Cited by 88
The process of recurrent choice.
Davis, D. G., Staddon, J. E. R., Machado, A. D., et al. (1993) · Psychological Review · doi:10.1037/0033-295x.100.2.320 · Cited by 88
Heyman, G. M., & Monaghan, M. M. (1987) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/0097-7403.13.4.384 · Cited by 87
THE BLOCKING OF REINFORCEMENT CONTROL1
Williams, B. A. (1975) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1975.24-215 · Cited by 86
A MULTIVARIATE RATE EQUATION FOR VARIABLE‐INTERVAL PERFORMANCE
McDowell, J. J., & Kessel, R. (1979) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1979.31-267 · Cited by 85
Killeen, P. R. (1992) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1992.57-429 · Cited by 84
Self-citationChaos, Fractals, and Dynamics.
G., W., Fischer, P., & Smith, W. R. (1986) · Mathematics of Computation · doi:10.2307/2008026 · Cited by 84
INTERRESPONSE‐TIME SHAPING BY VARIABLE‐INTERVAL‐LIKE INTERRESPONSE‐TIME REINFORCEMENT CONTINGENCIES1
Platt, J. R. (1979) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1979.31-3 · Cited by 83
Rescorla, R. A. (1990) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/0097-7403.16.4.326 · Cited by 83
Svartdal, F. (1992) · Learning and Motivation · doi:10.1016/0023-9690(92)90003-5 · Cited by 82
QUASI‐REINFORCEMENT: CONTROL OF RESPONDING BY A PERCENTAGE‐REINFORCEMENT SCHEDULE1
Neuringer, A. J., & Chung, S. (1967) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1967.10-45 · Cited by 82
Killeen, P. R., & Smith, J. P. (1984) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037//0097-7403.10.3.333 · Cited by 81
Self-citationPavlovian Conditioning and the Mediation of behavior
Overmier, J. B., & Lawry, J. A. (1979) · The Psychology of learning and motivation/The psychology of learning and motivation · doi:10.1016/s0079-7421(08)60080-8 · Cited by 80
Operant modulation of low-level attributes of rule-governed behavior by nonverbal contingencies
Svartdal, F. (1991) · Learning and Motivation · doi:10.1016/0023-9690(91)90004-r · Cited by 79
Optimality Analyses of Operant Behavior and Their Relation to Optimal Foraging
Staddon, J. E. R. (1980) · Elsevier eBooks · doi:10.1016/b978-0-12-662650-6.50010-6 · Cited by 78
IN SEARCH OF THE FEEDBACK FUNCTION FOR VARIABLE‐INTERVAL SCHEDULES
Baum, W. M. (1992) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1992.57-365 · Cited by 77
Food motivated behavior in genetically obese and hypothalamic-hyperphagic rats and mice
Greenwood, M. R. C., Quartermain, D., Johnson, P. R., Cruce, J. A. F., & Hirsch, J. (1974) · Physiology & Behavior · doi:10.1016/0031-9384(74)90241-8 · Cited by 77
Cited by
sagvolden, T., johansen, E. B., aase, H., & russell, V. A. (2005) · Behavioral and Brain Sciences · doi:10.1017/s0140525x05000075 · Cited by 1,035
DYNAMIC RESPONSE-BY-RESPONSE MODELS OF MATCHING BEHAVIOR IN RHESUS MONKEYS
Lau, B., & Glimcher, P. W. (2005) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.2005.110-04 · Cited by 485
Learning the temporal dynamics of behavior.
Machado, A. (1997) · Psychological Review · doi:10.1037//0033-295x.104.2.241 · Cited by 381
Neuroscience and approach/avoidance personality traits: A two stage (valuation–motivation) approach
Corr, P. J., & McNaughton, N. (2012) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2012.09.013 · Cited by 308
LINEAR-NONLINEAR-POISSON MODELS OF PRIMATE CHOICE DYNAMICS
Corrado, G. S., Sugrue, L. P., Seung, H. S., & Newsome, W. T. (2005) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.2005.23-05 · Cited by 206
Metadata
- Authors
- Killeen, P. R.
- Venue
- Springer eBooks
- Publisher
- Springer Nature
- Published
- 1994-03-01
- Volume
- 17
- Issue
- 1
- Pages
- 105-135
- OpenAlex
- W2121904373
- Cited by
- 264
- References
- 254
- FWCI
- 9.91
- Type
- book chapter
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.