The DOI matches its Crossref record; 86 of the 86 references it cites were found in a registry or an index.
A survey of random processes with reinforcement
Open accessAbstract
The models surveyed include generalized Pólya urns, reinforced random walks, interacting urn models, and continuous reinforced processes. Emphasis is on methods and results, with sketches provided of some proofs. Applications are discussed in statistics, biology, economics and a number of other areas.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Collective dynamics of ‘small-world’ networks
Watts, D. J., & Strogatz, S. H. (1998) · Nature · doi:10.1038/30918 · Cited by 43,060
Emergence of Scaling in Random Networks
Barabási, A.-L., & Albert, R. (1999) · Science · doi:10.1126/science.286.5439.509 · Cited by 36,135
An introduction to probability theory and its applications
(1958) · Journal of the Franklin Institute · doi:10.1016/0016-0032(58)90688-4 · Cited by 29,269
A Stochastic Approximation Method
Robbins, H., & Monro, S. (1951) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729586 · Cited by 9,643
Evolution and the Theory of Games
Smith, J. M. (1988) · Did Darwin Get It Right? · doi:10.1007/978-1-4684-7862-4_22 · Cited by 7,906
Evolution and the Theory of Games
Smith, J. M. (1982) · Cambridge University Press eBooks · doi:10.1017/cbo9780511806292 · Cited by 6,922
An Introduction to Probability Theory and Its Applications.
Bharucha-Reid, A. T., & Feller, W. (1967) · The American Mathematical Monthly · doi:10.2307/2314609 · Cited by 6,066
Evolutionary Games and Population Dynamics
Hofbauer, J., & Sigmund, K. (1998) · doi:10.1017/cbo9781139173179 · Cited by 5,502
SMITH, J. M., & PRICE, G. R. (1973) · Nature · doi:10.1038/246015a0 · Cited by 5,089
An Introduction to Probability Theory and its Applications.
Kingman, J. F. C., & Feller, W. (1972) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2344620 · Cited by 4,938
Agent-based modeling: Methods and techniques for simulating human systems
Bonabeau, E. (2002) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.082080899 · Cited by 4,500
Evolutionary stable strategies and game dynamics
Taylor, P. D., & Jonker, L. B. (1978) · Mathematical Biosciences · doi:10.1016/0025-5564(78)90077-9 · Cited by 3,450
Probability: Theory and Examples.
Prewitt, K., & Durrett, R. (1992) · Journal of the American Statistical Association · doi:10.2307/2290301 · Cited by 3,085
Herrnstein, R. J. (1970) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1970.13-243 · Cited by 2,611
The theory of games and the evolution of animal conflicts
Maynard Smith, J. (1974) · Journal of Theoretical Biology · doi:10.1016/0022-5193(74)90110-6 · Cited by 2,410
Some aspects of the sequential design of experiments
Robbins, H. (1952) · Bulletin of the American Mathematical Society · doi:10.1090/s0002-9904-1952-09620-8 · Cited by 2,184
Learning, Mutation, and Long Run Equilibria in Games
Kandori, M., Mailath, G. J., & Rob, R. (1993) · Econometrica · doi:10.2307/2951777 · Cited by 2,044
Rationalizability, Learning, and Equilibrium in Games with Strategic Complementarities
Milgrom, P., & Roberts, J. (1990) · Econometrica · doi:10.2307/2938316 · Cited by 1,804
Roth, A. E., & Erev, I. (1995) · Games and Economic Behavior · doi:10.1016/s0899-8256(05)80020-x · Cited by 1,678
Isolated Invariant Sets and the Morse Index
Conley, C. (1978) · CBMS Regional Conference Series in Mathematics · doi:10.1090/cbms/038 · Cited by 1,591
The rock–paper–scissors game and the evolution of alternative male strategies
Sinervo, B., & Lively, C. M. (1996) · Nature · doi:10.1038/380240a0 · Cited by 1,554
The Stag Hunt and the Evolution of Social Structure
Skyrms, B. (2003) · Cambridge University Press eBooks · doi:10.1017/cbo9781139165228 · Cited by 1,524
Stochastic models for learning.
Bush, R. R., & Mosteller, F. (1955) · John Wiley & Sons, Inc. eBooks · doi:10.1037/14496-000 · Cited by 1,511
Analysis of recursive stochastic algorithms
Ljung, L. (1977) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1977.1101561 · Cited by 1,467
Positive Feedbacks in the Economy
Arthur, W. B. (1990) · Scientific American · doi:10.1038/scientificamerican0290-92 · Cited by 1,362
Ferguson Distributions Via Polya Urn Schemes
Blackwell, D., & MacQueen, J. B. (1973) · The Annals of Statistics · doi:10.1214/aos/1176342372 · Cited by 1,329
The theory of evolution and dynamical systems
Hofbauer, J. (1988) · Cited by 1,301
A Brief History of Generative Models for Power Law and Lognormal Distributions
Mitzenmacher, M. (2004) · Internet Mathematics · doi:10.1080/15427951.2004.10129088 · Cited by 1,188
An Introduction to Probability Theory and Its Applications. Vol. II
B., H. L., & Feller, W. (1968) · Population (French Edition) · doi:10.2307/1527528 · Cited by 1,154
Learning, Local Interaction, and Coordination
Ellison, G. (1993) · Econometrica · doi:10.2307/2951493 · Cited by 1,106
Animal Intelligence: An Experimental Study of the Associative Processes in Animals
Kline, L. W., & Thorndike, E. L. (1898) · The American Journal of Psychology · doi:10.2307/1412682 · Cited by 1,092
The theory of evolution and dynamical systems
Fontana, W. (1989) · Mathematical Biosciences · doi:10.1016/0025-5564(89)90089-8 · Cited by 890
Games with randomly disturbed payoffs: A new rationale for mixed-strategy equilibrium points
Harsanyi, J. C. (1973) · International Journal of Game Theory · doi:10.1007/bf01737554 · Cited by 887
The average distances in random graphs with given expected degrees
Chung, F., & Lu, L. (2002) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.252631999 · Cited by 885
An Iterative Method of Solving a Game
Robinson, J. (1951) · The Annals of Mathematics · doi:10.2307/1969530 · Cited by 868
Probability: Theory and Examples.
Durrett, R. (1993) · Biometrics · doi:10.2307/2532227 · Cited by 857
Greenwood, M., & Yule, G. U. (1920) · Journal of the Royal Statistical Society · doi:10.2307/2341080 · Cited by 833
The degree sequence of a scale‐free random graph process
Bollobás, B., Riordan, O., Spencer, J., & Tusnády, G. (2001) · Random Structures & Algorithms · doi:10.1002/rsa.1009 · Cited by 804
Aggregation, Blowup, and Collapse: The ABC's of Taxis in Reinforced Random Walks
Stevens, A., & Othmer, H. G. (1997) · SIAM Journal on Applied Mathematics · doi:10.1137/s0036139995288976 · Cited by 704
Chung, F., & Lu, L. (2006) · CBMS Regional Conference Series in Mathematics · doi:10.1090/cbms/107 · Cited by 700
Madras, N., & Slade, G. (1996) · Birkhäuser Boston eBooks · doi:10.1007/978-1-4612-4132-4 · Cited by 663
A dynamic model of social network formation
Skyrms, B., & Pemantle, R. (2000) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.97.16.9340 · Cited by 553
Self-citation1. Some Topics in Two-Person Games
Shapley, L. S. (1964) · Advances in Game Theory. (AM-52) · doi:10.1515/9781400882014-002 · Cited by 539
Path-dependent processes and the emergence of macro-structure
Brian Arthur, W., Ermoliev, Y. M., & Kaniovski, Y. M. (1987) · European Journal of Operational Research · doi:10.1016/0377-2217(87)90074-9 · Cited by 488
Fudenberg, D., & Kreps, D. M. (1993) · Games and Economic Behavior · doi:10.1006/game.1993.1021 · Cited by 485
Busemeyer, J. R., & Stout, J. C. (2002) · Psychological Assessment · doi:10.1037//1040-3590.14.3.253 · Cited by 484
The Randomized Play-the-Winner Rule in Medical Trials
Wei, L. J., & Durham, S. (1978) · Journal of the American Statistical Association · doi:10.1080/01621459.1978.10480109 · Cited by 481
Fictitious Play Property for Games with Identical Interests
Monderer, D., & Shapley, L. S. (1996) · Journal of Economic Theory · doi:10.1006/jeth.1996.0014 · Cited by 442
Dynamics of stochastic approximation algorithms
Benaïm, M. (1999) · Lecture Notes in Mathematics · doi:10.1007/bfb0096509 · Cited by 413
On the Global Convergence of Stochastic Fictitious Play
Hofbauer, J., & Sandholm, W. H. (2002) · Econometrica · doi:10.1111/1468-0262.00376 · Cited by 404
The Estimation of Probabilities: An Essay on Modern Bayesian Methods
Hill, B. M., & Good, I. J. (1965) · Journal of the American Statistical Association · doi:10.2307/2283422 · Cited by 337
The Random Walk Construction of Uniform Spanning Trees and Uniform Labelled Trees
Aldous, D. J. (1990) · SIAM Journal on Discrete Mathematics · doi:10.1137/0403039 · Cited by 319
Davis, B. (1990) · Probability Theory and Related Fields · doi:10.1007/bf01197845 · Cited by 312
Stochastic Approximations and Differential Inclusions
Benaïm, M., Hofbauer, J., & Sorin, S. (2005) · SIAM Journal on Control and Optimization · doi:10.1137/s0363012904439301 · Cited by 308
Nonconvergence to Unstable Points in Urn Models and Stochastic Approximations
Pemantle, R. (1990) · The Annals of Probability · doi:10.1214/aop/1176990853 · Cited by 263
Self-citationA System of Reaction Diffusion Equations Arising in the Theory of Reinforced Random Walks
Sleeman, B. D., & Levine, H. A. (1997) · SIAM Journal on Applied Mathematics · doi:10.1137/s0036139995291106 · Cited by 262
Embedding of Urn Schemes into Continuous Time Markov Branching Processes and Related Limit Theorems
Athreya, K. B., & Karlin, S. (1968) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177698013 · Cited by 229
Polya Trees and Random Distributions
Mauldin, R. D., Sudderth, W. D., & Williams, S. C. (1992) · The Annals of Statistics · doi:10.1214/aos/1176348766 · Cited by 216
De Finetti's Theorem for Markov Chains
Diaconis, P. W., & Freedman, D. (1980) · The Annals of Probability · doi:10.1214/aop/1176994828 · Cited by 214
An Introduction to Probability Theory and Its Applications, Vol. 1
Samuels, S. M., & Feller, W. (1969) · Technometrics · doi:10.2307/1267275 · Cited by 210
Friedman, B. (1949) · Communications on Pure and Applied Mathematics · doi:10.1002/cpa.3160020103 · Cited by 180
A Strong Law for Some Generalized Urn Processes
Hill, B. M., Lane, D., & Sudderth, W. (1980) · The Annals of Probability · doi:10.1214/aop/1176994772 · Cited by 174
Freedman, D. A. (1965) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177700068 · Cited by 174
Some Aspects of the Sequential Design of Experiments
Robbins, H. E. (1985) · Springer eBooks · doi:10.1007/978-1-4612-5110-1_13 · Cited by 168
Contributions to the "Two-Armed Bandit" Problem
Feldman, D. (1962) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177704454 · Cited by 128
An Asymptotic Minimax Theorem for the Two Armed Bandit Problem
Vogel, W. (1960) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177705907 · Cited by 127
A generalized URN problem and its applications
Artur, B., Ermol’ev, Y. M., & Kaniovskii, Y. M. (1983) · Cybernetics and Systems Analysis · doi:10.1007/bf01070110 · Cited by 116
Asymptotic pseudotrajectories and chain recurrent flows, with applications
Benaïm, M., & Hirsch, M. W. (1996) · Journal of Dynamics and Differential Equations · doi:10.1007/bf02218617 · Cited by 110
Urn Models, Replicator Processes, and Random Genetic Drift
Schreiber, S. J. (2001) · SIAM Journal on Applied Mathematics · doi:10.1137/s0036139999352857 · Cited by 110
Greenberg, D. F. (1991) · Criminology · doi:10.1111/j.1745-9125.1991.tb01057.x · Cited by 110
New directions in adaptive designs
Rosenberger, W. F. (1996) · Statistical Science · doi:10.1214/ss/1038425657 · Cited by 107
“Machiavellian” Intelligence as a Basis for the Evolution of Cooperative Dispositions
Orbell, J. M., Morikawa, T., Hartwig, J., Hanley, J. E., & Allen, N. B. (2004) · American Political Science Review · doi:10.1017/s0003055404000966 · Cited by 106
Bagchi, A., & Pal, A. K. (1985) · SIAM Journal on Algebraic and Discrete Methods · doi:10.1137/0606041 · Cited by 100
A SEQUENTIAL DECISION PROBLEM WITH A FINITE MEMORY
Robbins, H. E. (1956) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.42.12.920 · Cited by 86
Vertex-Reinforced Random Walk on Z Has Finite Range
Pemantle, R., & Volkov, S. (1999) · The Annals of Probability · doi:10.1214/aop/1022677452 · Cited by 77
Self-citationFlache, A., & Macy, M. W. (2002) · Journal of Conflict Resolution · doi:10.1177/002200202236167 · Cited by 75
Bayesian analysis for reversible Markov chains
Diaconis, P. W., & Rolles, S. W. W. (2006) · The Annals of Statistics · doi:10.1214/009053606000000290 · Cited by 68
Economic Properties of Social Networks
Kakade, S. M., Kearns, M. J., Ortiz, L. E., Pemantle, R., & Suri, S. (2004) · ScholarlyCommons (University of Pennsylvania) · Cited by 68
Self-citationSome Pathological Traps for Stochastic Approximation
Brandière, O. (1998) · SIAM Journal on Control and Optimization · doi:10.1137/s036301299630759x · Cited by 40
Polya Urn Models and Connections to Ran- dom Trees: A Review
Mahmoud, H. M. (2003) · Cited by 38
A probabilistic model for the establishment of neuron polarity
Khanin, K., & Khanin, R. (2001) · Journal of Mathematical Biology · doi:10.1007/pl00000071 · Cited by 36
Some Remarks on the Two-Armed Bandit
Fabius, J., & van Zwet, W. R. (2011) · Springer eBooks · doi:10.1007/978-1-4614-1314-1_2 · Cited by 33
A Sequential Design for the Two Armed Bandit
Vogel, W. (1960) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177705906 · Cited by 32
Self-testing algorithms for self-avoiding walks
Randall, D., & Sinclair, A. (2000) · Journal of Mathematical Physics · doi:10.1063/1.533197 · Cited by 15
An analysis of the spontaneous mutation rate measurement in filamentous fungi
Baracho, M. D. S., & Baracho, I. R. (2003) · Genetics and Molecular Biology · doi:10.1590/s1415-47572003000100014 · Cited by 8
USING URN MODELS FOR THE DESIGN OF CLINICAL TRIALS
DiRienzo, A. G. (2016) · Cited by 3
Cited by
Random walks and diffusion on networks
Masuda, N., Porter, M. A., & Lambiotte, R. (2017) · Physics Reports · doi:10.1016/j.physrep.2017.07.007 · Cited by 657
Metadata
- Authors
- Pemantle, R.
- Venue
- Probability Surveys
- Publisher
- Institute of Mathematical Statistics
- Published
- 2007-01-01
- Volume
- 4
- Issue
- none
- Pages
- 1-79
- ISSN
- 1549-5787 (ISSN-L)
- OpenAlex
- W2145037371
- Cited by
- 578
- References
- 86
- FWCI
- 39.50
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.