A simple introduction to Markov Chain Monte–Carlo sampling
Open accessThe DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Abstract
Markov Chain Monte-Carlo (MCMC) is an increasingly popular method for obtaining information about distributions, especially for estimating posterior distributions in Bayesian inference. This article provides a very basic introduction to MCMC sampling. It describes what MCMC is, and what it can be used for, with simple illustrative examples. Highlighted are some of the benefits and limitations of MCMC sampling, as well as different approaches to circumventing the limitations most likely to trouble cognitive scientists.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Inference from iterative simulation using multiple sequences
Gelman, A., & Rubin, D. B. (1992) · Statistical Science · doi:10.1214/ss/1177011136 · Cited by 16,627
(1966) · Medical Entomology and Zoology · Cited by 10,293
Signal detection theory and psychophysics
Ingleby, J. D. (1967) · Journal of Sound and Vibration · doi:10.1016/0022-460x(67)90197-6 · Cited by 8,509
Markov Chain Monte Carlo in Practice
(1995) · Chapman & Hall/CRC eBooks · doi:10.1201/b14835 · Cited by 7,757
Ratcliff, R. (1978) · Psychological Review · doi:10.1037/0033-295x.85.2.59 · Cited by 4,513 · cited 2×
“An example of cognitive models that deal with correlated parameters in practice is the class of response time modeling of decision making (e.g. Brown & Heathcote, 2008; Ratcliff, 1978; Usher & McClelland, 2001).”
MethodThe time course of perceptual choice: The leaky, competing accumulator model.
Usher, M., & McClelland, J. L. (2001) · Psychological Review · doi:10.1037/0033-295x.108.3.550 · Cited by 2,152 · cited 1×
“An example of cognitive models that deal with correlated parameters in practice is the class of response time modeling of decision making (e.g. Brown & Heathcote, 2008; Ratcliff, 1978; Usher & McClelland, 2001).”
MethodMarkov Chain Monte Carlo: Stochastic Simulation for Bayesian Inference
Strawderman, R. L., & Gamerman, D. (2000) · Journal of the American Statistical Association · doi:10.2307/2669581 · Cited by 1,909
(2014) · Thammasat University Digital Collections · Cited by 1,732
Bayesian computation via the Gibbs sampler and related Markov chain Monte Carlo methods
Smith, A. F. M., & Roberts, G. O. (1993) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1993.tb01466.x · Cited by 1,713 · cited 3×
“The following illustrates MCMC with a very simple approach called the Metropolis algorithm (Smith and Roberts, 1993): 1.”
MethodInfluential(2013) · Cited by 1,351
The simplest complete model of choice response time: Linear ballistic accumulation
Brown, S. D., & Heathcote, A. (2008) · Cognitive Psychology · doi:10.1016/j.cogpsych.2007.12.002 · Cited by 1,123
Self-citationMarkov Chain Monte Carlo: Stochastic Simulation for Bayesian Inference, Second Edition
Gamerman, D., & Lopes, H. F. (2006) · doi:10.1201/9781482296426 · Cited by 1,097
An Agenda for Purely Confirmatory Research
Wagenmakers, E.-J., Wetzels, R., Borsboom, D., van der Maas, H. L. J., & Kievit, R. A. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612463078 · Cited by 1,042 · cited 2×
“…comparison (Scheibehenne et al., 2013), memory retention (Shiffrin et al., 2008), signal detection theory (Lee, 2008), extrasensory perception (Wagenmakers et al., 2012), multinomial processing trees (Matzke et al., 2015), risk taking (van Ravenzwaaij et al., 2011), heuristic decision making…”
BackgroundRoberts, G. O., & Rosenthal, J. S. (2009) · Journal of Computational and Graphical Statistics · doi:10.1198/jcgs.2009.06134 · Cited by 1,028
Braak, C. J. F. T. (2006) · Statistics and Computing · doi:10.1007/s11222-006-8769-1 · Cited by 937
A model for recognition memory: REM—retrieving effectively from memory
Shiffrin, R. M., & Steyvers, M. (1997) · Psychonomic Bulletin & Review · doi:10.3758/bf03209391 · Cited by 928
Perspectives on Psychological Science
Blase, A. E. K. A. S. L. (2011) · APS observer · Cited by 628
(2015) · Elsevier eBooks · doi:10.1016/c2012-0-00477-2 · Cited by 416
Updating Schemes, Correlation Structure, Blocking and Parameterization for the Gibbs Sampler
Roberts, G. O., & Sahu, S. K. (1997) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00070 · Cited by 409
A Survey of Model Evaluation Approaches With a Tutorial on Hierarchical Bayesian Methods
Shiffrin, R. M., Lee, M. D., Kim, W., & Wagenmakers, E. (2008) · Cognitive Science · doi:10.1080/03640210802414826 · Cited by 348
Hierarchical diffusion models for two-choice response times.
Vandekerckhove, J., Tuerlinckx, F., & Lee, M. D. (2011) · Psychological Methods · doi:10.1037/a0021765 · Cited by 323
A method for efficiently sampling from distributions with correlated dimensions.
Turner, B. M., Sederberg, P. B., Brown, S. D., & Steyvers, M. (2013) · Psychological Methods · doi:10.1037/a0032222 · Cited by 282
Self-citationThree case studies in the Bayesian analysis of cognitive models
LEE, M. D. (2008) · Psychonomic Bulletin & Review · doi:10.3758/pbr.15.1.1 · Cited by 177
A Bayesian Account of Reconstructive Memory
Hemmer, P., & Steyvers, M. (2009) · Topics in Cognitive Science · doi:10.1111/j.1756-8765.2008.01010.x · Cited by 148
Testing adaptive toolbox models: A Bayesian hierarchical approach.
Scheibehenne, B., Rieskamp, J., & Wagenmakers, E. (2012) · Psychological Review · doi:10.1037/a0030777 · Cited by 127
Matzke, D., Dolan, C. V., Batchelder, W. H., & Wagenmakers, E. (2013) · Psychometrika · doi:10.1007/s11336-013-9374-9 · Cited by 114
Cognitive model decomposition of the BART: Assessment and application
van Ravenzwaaij, D., Dutilh, G., & Wagenmakers, E. (2010) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2010.08.010 · Cited by 106
Brain and Behavior in Decision-Making
Cassey, P., Heathcote, A., & Brown, S. D. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003700 · Cited by 47
Self-citationA Hierarchical Bayesian Modeling Approach to Searching and Stopping in Multi‐Attribute Judgment
van Ravenzwaaij, D., Moore, C. P., Lee, M. D., & Newell, B. R. (2014) · Cognitive Science · doi:10.1111/cogs.12119 · Cited by 24
Cited by
Bayesian inference for psychology. Part I: Theoretical advantages and practical ramifications
Wagenmakers, E.-J., Marsman, M., Jamil, T., Ly, A., Verhagen, J., Love, J., Selker, R., Gronau, Q. F., Šmíra, M., Epskamp, S., et al. (2018) · Psychonomic Bulletin & Review · doi:10.3758/s13423-017-1343-3 · Cited by 1,627
Ordinal Regression Models in Psychology: A Tutorial
Bürkner, P.-C., & Vuorre, M. (2019) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245918823199 · Cited by 689
Uncertainty models for stochastic optimization in renewable energy applications
Zakaria, A., Ismail, F. B., Lipu, M. S. H., & Hannan, M. A. (2020) · Renewable Energy · doi:10.1016/j.renene.2019.07.081 · Cited by 483
Bayesian Analysis Reporting Guidelines
Kruschke, J. K. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01177-7 · Cited by 440
Li, Y., He, X., Li, Q., Lai, H., Zhang, H., Hu, Z., Li, Y., & Huang, S. (2020) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2020.10.002 · Cited by 197
Metadata
- Authors
- van Ravenzwaaij, D., Cassey, P., & Brown, S. D.
- Venue
- Psychonomic Bulletin & Review
- Published
- 2016-03-11
- Volume
- 25
- Issue
- 1
- Pages
- 143-154
- ISSN
- 1069-9384 (ISSN-L)
- 1531-5320
- OpenAlex
- W2295803031
- Cited by
- 621
- References
- 29
- FWCI
- 26.94
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.