The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
A mathematical model for simple learning.
Abstract
A mathematical model for simple learning is presented. Changes in the probability of occurrence of a response in a small time h are described with the aid of mathematical operators. The parameters which appear in the operator equations are related to experimental variables such as the amount of reward and work. Relations between the probability and empirical measures of rate of responding and latent time are defined. Acquisition and extinction of behavior habits are discussed for the simple runway and for the Skinner box. Equations of mean latent time as a function of trial number are derived for the runway problem; equations for the mean rate of responding and cumulative numbers of responses versus time are derived for the Skinner box experiments. An attempt is made to analyze the learning process with various schedules of partial reinforcement in the Skinner type experiment. Wherever possible, the correspondence between the present model and the work of Estes [2] is pointed out.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Skinner, B. F., & Hull, C. L. (1944) · The American Journal of Psychology · doi:10.2307/1416955 · Cited by 4,051
Skinner, B. F. (1938) · Cited by 3,571
Toward a statistical theory of learning.
Estes, W. K. (1950) · Psychological Review · doi:10.1037/h0058559 · Cited by 994
Quantitative Variation of Incentive and Performance in the White Rat
Crespi, L. P. (1942) · The American Journal of Psychology · doi:10.2307/1417120 · Cited by 891
(2014) · Fundamentals of Psychology · doi:10.4324/9781315736945-15 · Cited by 694
Partial reinforcement: a review and critique.
Jenkins, W. O., & Stanley, J. C. (1950) · Psychological Bulletin · doi:10.1037/h0060772 · Cited by 278
Statistical behavioristics and sequences of responses.
Miller, G. A., & Frick, F. C. (1949) · Psychological Review · doi:10.1037/h0060413 · Cited by 192
The influence of work on behavior.
Solomon, R. L. (1948) · Psychological Bulletin · doi:10.1037/h0055527 · Cited by 156
Resistance to extinction as a function of the number of reinforcements.
Williams, S. B. (1938) · Journal of Experimental Psychology · doi:10.1037/h0053675 · Cited by 146
The acquisition, extinction, and spontaneous recovery of a conditioned operant response.
Graham, C. H., & Gagné, R. M. (1940) · Journal of Experimental Psychology · doi:10.1037/h0060674 · Cited by 87
Cited by
The theory of decision making.
Edwards, W. (1954) · Psychological Bulletin · doi:10.1037/h0053870 · Cited by 2,697
The Stag Hunt and the Evolution of Social Structure
Skyrms, B. (2003) · Cambridge University Press eBooks · doi:10.1017/cbo9781139165228 · Cited by 1,524
The theory of dynamic programming
Bellman, R. (1954) · Bulletin of the American Mathematical Society · doi:10.1090/s0002-9904-1954-09848-8 · Cited by 1,459
What do we mean by prediction in language comprehension?
Kuperberg, G. R., & Jaeger, T. F. (2016) · Language, Cognition and Neuroscience · doi:10.1080/23273798.2015.1102299 · Cited by 1,087
Amsel, A. (1962) · Psychological Review · doi:10.1037/h0046200 · Cited by 968
Understanding dopamine and reinforcement learning: the dopamine reward prediction error hypothesis
Glimcher, P. W. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1014269108 · Cited by 955
Interactive machine learning for health informatics: when do we need the human-in-the-loop?
Holzinger, A. (2016) · Brain Informatics · doi:10.1007/s40708-016-0042-6 · Cited by 906
Modulation of aggressive behaviour by fighting experience: mechanisms and contest outcomes
Hsu, Y., Earley, R. L., & Wolf, L. L. (2005) · Biological Reviews · doi:10.1017/s146479310500686x · Cited by 765
Learning Through Reinforcement and Replicator Dynamics
Börgers, T., & Sarin, R. (1997) · Journal of Economic Theory · doi:10.1006/jeth.1997.2319 · Cited by 737
Reinforcement learning in the brain
Niv, Y. (2009) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2008.12.005 · Cited by 717
Universal Grammar, statistics or both?
Yang, C. D. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.08.006 · Cited by 582
Learning theory and the symbolic processes.
Mowrer, O. H. (1960) · John Wiley & Sons, Inc. eBooks · doi:10.1037/10772-000 · Cited by 569
The role of observing responses in discrimination learning. Part I.
Wyckoff, L. B. (1952) · Psychological Review · doi:10.1037/h0053932 · Cited by 504
Neural Circuitry of Reward Prediction Error
Watabe-Uchida, M., Eshel, N., & Uchida, N. (2017) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-072116-031109 · Cited by 437
Handbook of multimethod measurement in psychology.
(2006) · American Psychological Association eBooks · doi:10.1037/11383-000 · Cited by 481
Knowledge and Learning in Natural Language
Yang, C. (2012) · Encyclopedia of the Sciences of Learning · doi:10.1007/978-1-4419-1428-6_837 · Cited by 479
Behavioral momentum and the Law of Effect
Nevin, J. A., & Grace, R. C. (2000) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00002405 · Cited by 471
An elemental model of associative learning: I. Latent inhibition and perceptual learning
McLaren, I. P. L., & Mackintosh, N. J. (2000) · Animal Learning & Behavior · doi:10.3758/bf03200258 · Cited by 439
Prediction error in reinforcement learning: A meta-analysis of neuroimaging studies
Garrison, J., Erdeniz, B., & Done, J. (2013) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.03.023 · Cited by 438
Assessment of the Rescorla-Wagner model.
Miller, R. R., Barnet, R. C., & Grahame, N. J. (1995) · Psychological Bulletin · doi:10.1037//0033-2909.117.3.363 · Cited by 426
Arithmetic and local circuitry underlying dopamine prediction errors
Eshel, N., Bukwich, M., Rao, V., Hemmelder, V., Tian, J., & Uchida, N. (2015) · Nature · doi:10.1038/nature14855 · Cited by 392
A connectome of a learning and memory center in the adult Drosophila brain
Takemura, S.-Y., Aso, Y., Hige, T., Wong, A., Lu, Z., Xu, C. S., Rivlin, P. K., Hess, H., Zhao, T., Parag, T., et al. (2017) · eLife · doi:10.7554/elife.26975 · Cited by 367
Le Pelley, M. E. (2004) · The Quarterly Journal of Experimental Psychology Section B · doi:10.1080/02724990344000141 · Cited by 360
An assessment of fixed-capacity models of visual working memory
Rouder, J. N., Morey, R. D., Cowan, N., Zwilling, C. E., Morey, C. C., & Pratte, M. S. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0711295105 · Cited by 352
Morphosyntactic Learning and the Development of Tense
Legate, J. A., & Yang, C. (2007) · Language Acquisition · doi:10.1080/10489220701471081 · Cited by 300
Associative learning and elemental representation: II. Generalization and discrimination
Mclaren, I. P. L., & Mackintosh, N. J. (2002) · Animal Learning & Behavior · doi:10.3758/bf03192828 · Cited by 289
The drift diffusion model as the choice rule in reinforcement learning
Pedersen, M. L., Frank, M. J., & Biele, G. (2017) · Psychonomic Bulletin & Review · doi:10.3758/s13423-016-1199-y · Cited by 283
THE LEGACY OF GUTTMAN AND KALISH (1956): 25 YEARS OF RESEARCH ON STIMULUS GENERALIZATION
Honig, W. K., & Urcuioli, P. J. (1981) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1981.36-405 · Cited by 282
WHAT'S ELEMENTARY ABOUT ASSOCIATIVE LEARNING?
Wasserman, E. A., & Miller, R. R. (1997) · Annual Review of Psychology · doi:10.1146/annurev.psych.48.1.573 · Cited by 276
Statistical theory of distributional phenomena in learning
Estes, W. K. (1955) · Psychological Review · doi:10.1037/h0046888 · Cited by 246
A Shared Vision for Machine Learning in Neuroscience
Vu, M.-A. T., Adalı, T., Ba, D., Buzsáki, G., Carlson, D., Heller, K., Liston, C., Rudin, C., Sohal, V. S., Widge, A. S., et al. (2018) · The Journal of Neuroscience · doi:10.1523/jneurosci.0508-17.2018 · Cited by 191
Early History of Machine Learning
Fradkov, A. L. (2020) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2020.12.1888 · Cited by 190
Schultz, W. (2017) · Current Biology · doi:10.1016/j.cub.2017.02.064 · Cited by 177
Ziegler, S., Pedersen, M. L., Mowinckel, A. M., & Biele, G. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.09.002 · Cited by 110
Focusing on the Long-term: It's Good for Users and Business
Hohnhold, H., O'Brien, D., & Tang, D. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2788583 · Cited by 112
Couvillon, P. A., & Bitterman, M. E. (1988) · Animal Learning & Behavior · doi:10.3758/bf03209045 · Cited by 56
Corticostriatothalamic reward prediction error signals and executive control in late-life depression
Dombrovski, A. Y., Szanto, K., Clark, L., Aizenstein, H. J., Chase, H. W., Reynolds, C. F., & Siegle, G. J. (2015) · Psychological Medicine · doi:10.1017/s0033291714002517 · Cited by 41
Colas, J. T., O’Doherty, J. P., & Grafton, S. T. (2024) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1011950 · Cited by 6
Metadata
- Authors
- Bush, R. R., & Mosteller, F.
- Venue
- Psychological Review
- Published
- 1951
- Volume
- 58
- Issue
- 5
- Pages
- 313-323
- ISSN
- 0033-295X (ISSN-L)
- 1939-1471
- OpenAlex
- W2088247534
- Cited by
- 586
- References
- 10
- FWCI
- 11.96
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.