Inference from Iterative Simulation Using Multiple Sequences
Open accessThe DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Abstract
The Gibbs sampler, the algorithm of Metropolis and similar iterative simulation methods are potentially very helpful for summarizing multivariate distributions. Used naively, however, iterative simulation can give misleading answers. Our methods are simple and generally applicable to the output of any iterative simulation; they are designed for researchers primarily interested in the science underlying the data and models they are analyzing, rather than for researchers interested in the probability theory underlying the iterative simulations themselves. Our recommended strategy is to use several independent sequences, with starting points sampled from an overdispersed distribution. At each step of the iterative simulation, we obtain, for each univariate estimand of interest, a distributional estimate and an estimate of how much sharper the distributional estimate might become if the simulations were continued indefinitely. Because our focus is on applied inference for Bayesian posterior distributions in real problems, which often tend toward normality after transformations and marginalization, we derive our results as normal-theory approximations to exact Bayesian inference, conditional on the observed simulations. The methods are illustrated on a random-effects mixture model applied to experimental measurements of reaction times of normal and schizophrenic patients.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Convergence and uni-modality of the distributions for all parameters were assessed visually and were checked for R< 1.1 [38].”
From Interacting Agricultural Pests and Their Effect on Crop Yield: Application of a Bayesian Decision Theory Approach to the Joint Management of Bromus tectorum and Cephus cinctus (2015) · cites this paper as [38]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Convergence of Bayesian meta-analysis models was verified by evaluating the upper confidence limits of the potential scale reduction factor (values ≤1.05 were considered as converged).60”
From A framework for meta-analysis of prediction model studies with binary and time-to-event outcomes (2019) · cites this paper as [60]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Model inference was performed by Hamiltonian Monte Carlo with the NUTS sampler using PyStan 69 , the Python implementation of Stan.”
From Measuring the impact of COVID-19 vaccine misinformation on vaccination intent in the UK and USA (2021) · cites this paper as [70]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Model convergence was evaluated by the potential scale reduction factor (PSRF) via the gelman.diag function in GeMTC, where a PSRF value below 1.05 was interpreted as evidence of successful convergence.”
From Efficacy and Safety of Acupuncture and Acupuncture-Combined Therapies in the Treatment of Sciatica Caused by Lumbar Disc Herniation: A Network Meta-Analysis (2025) · cites this paper as [14]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Chain convergence was assessed using Rhat values < 1.1 and posterior predictive checks (Gelman and Rubin 1992, Gabry et al. 2019).”
From Mild traumatic brain injury alters function in the dorsolateral prefrontal cortex: a TMS-EEG study (2025) · cites this paper as Gelman and Rubin 1992
Experimental — accuracy not yet measured
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Equation of State Calculations by Fast Computing Machines
Metropolis, N., Rosenbluth, A. W., Rosenbluth, M. N., Teller, A. H., & Teller, E. (1953) · The Journal of Chemical Physics · doi:10.1063/1.1699114 · Cited by 37,192
Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701
Self-citationStochastic relaxation, gibbs distributions, and the bayesian restoration of images.
Geman, S., & Geman, D. (1984) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1984.4767596 · Cited by 17,949
Monte Carlo sampling methods using Markov chains and their applications.
Hastings, W. K. (1970) · Biometrika · doi:10.1093/biomet/57.1.97 · Cited by 15,195 · cited 1×
“…the Gibbs sam- Iterative simulation has tremendous potential for aidpler (Metropolis and Ulam, 1949; Metropolis et al., ing applied Bayesian inference by summarizing awk- 1953; Hastings, 1970; Geman and Geman, 1984; and ward posterior distributions, but it has its pitfalls; Gelfand et al., 1990).”
BackgroundSampling-based approaches to calculating marginal densities
Gelfand, A. E., & Smith, A. F. M. (1990) · Journal of the American Statistical Association · doi:10.1080/01621459.1990.10476213 · Cited by 6,606
Metropolis, N., & Ulam, S. (1949) · Journal of the American Statistical Association · doi:10.1080/01621459.1949.10483310 · Cited by 6,474
Fisher, R. A. (1936) · BMJ · doi:10.1136/bmj.1.3923.554-a · Cited by 4,980
An Approximate Distribution of Estimates of Variance Components
Satterthwaite, F. E. (1946) · Biometrics Bulletin · doi:10.2307/3002019 · Cited by 4,373
The Calculation of Posterior Distributions by Data Augmentation
Tanner, M. A., & Wong, W. H. (1987) · Journal of the American Statistical Association · doi:10.1080/01621459.1987.10478458 · Cited by 3,928
Evaluating the Accuracy of Sampling-Based Approaches to the Calculation of Posterior Moments
Geweke, J. (1992) · Bayesian Statistics 4 · doi:10.1093/oso/9780198522669.003.0010 · Cited by 3,307
Evaluating the Accuracy of Sampling-Based Approaches to the Calculation of Posterior MomentsPreprint
Geweke, J. F. (1991) · doi:10.21034/sr.148 · Cited by 2,521
Ripley, B. D. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316726 · Cited by 2,241
Accurate Approximations for Posterior Moments and Marginal Densities
Tierney, L., & Kadane, J. B. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478240 · Cited by 2,129
Maximum likelihood estimation via the ECM algorithm: A general framework
MENG, X.-L., & RUBIN, D. B. (1993) · Biometrika · doi:10.1093/biomet/80.2.267 · Cited by 1,861
Self-citationBayesian computation via the Gibbs sampler and related Markov chain Monte Carlo methods
Smith, A. F. M., & Roberts, G. O. (1993) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1993.tb01466.x · Cited by 1,713 · cited 1×
“…review the problems of inference from iterative simulation, we do not discuss the vast and expanding variety of simulation methods themselves , which have been described in several recent review articles (e.g., Tierney, 1991; Gelman, 1992; Besag and Green, 1993; and Smith and Roberts, 1993).”
MethodBayesianly Justifiable and Relevant Frequency Calculations for the Applied Statistician
Rubin, D. B. (1984) · The Annals of Statistics · doi:10.1214/aos/1176346785 · Cited by 1,343
Self-citationMarkov Random Fields and Their Applications
Kindermann, R., & Snell, J. L. (1980) · Contemporary Mathematics · doi:10.1090/conm/001 · Cited by 1,290
Smith, J. Q., Bernardo, J. M., Berger, J. O., Dawid, A. P., & Smith, A. F. M. (1993) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2982740 · Cited by 1,097
Generalized Linear Models with Random Effects; a Gibbs Sampling Approach
Zeger, S. L., & Karim, M. R. (1991) · Journal of the American Statistical Association · doi:10.1080/01621459.1991.10475006 · Cited by 987
Illustration of Bayesian Inference in Normal Data Models Using Gibbs Sampling
Gelfand, A. E., Hills, S. E., Racine-Poon, A., & Smith, A. F. M. (1990) · Journal of the American Statistical Association · doi:10.1080/01621459.1990.10474968 · Cited by 969
How Many Iterations in the Gibbs Sampler?
Raftery, A. E., & Lewis, S. (1991) · doi:10.21236/ada640705 · Cited by 937
Using EM to Obtain Asymptotic Variance-Covariance Matrices: The SEM Algorithm
Meng, X.-L., & Rubin, D. B. (1991) · Journal of the American Statistical Association · doi:10.1080/01621459.1991.10475130 · Cited by 559
Self-citationRubin, D. B. (1987) · Journal of the American Statistical Association · doi:10.2307/2289460 · Cited by 432
Self-citationModelling Complexity: Applications of Gibbs Sampling in Medicine
Gilks, W. R., Clayton, D. G., Spiegelhalter, D. J., Best, N. G., McNeil, A. J., Sharples, L. D., & Kirby, A. J. (1993) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1993.tb01468.x · Cited by 199
Clogg, C. C., Rubin, D. B., Schenker, N., Schultz, B., & Weidman, L. (1991) · Journal of the American Statistical Association · doi:10.1080/01621459.1991.10475005 · Cited by 189
Self-citationBayesian Interpretation of Standard Inference Statements
Pratt, J. W. (1965) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1965.tb01486.x · Cited by 176
Metropolis Methods, Gaussian Proposals and Antithetic Variables
Green, P. J., & Han, X.-L. (1992) · Lecture notes in statistics · doi:10.1007/978-1-4612-2920-9_10 · Cited by 134
Calculation of Order Parameters in a Binary Alloy by the Monte Carlo Method
Fosdick, L. D. (1959) · Physical Review · doi:10.1103/physrev.116.565 · Cited by 118
Rubin, D. B. (1987) · Journal of the American Statistical Association · doi:10.1080/01621459.1987.10478461 · Cited by 111
Self-citationExploring Posterior Distributions Using Markov Chains
Tierney, L. (1992) · Cited by 70
Research works printed but not linked: 5
- BELIN, T. R. and RuBIN, D. B. (1990). Analysis of a finite mixture model with variance components. Proceedings of the Social Statistics Section 211-215. ASA, Alexandria, Va.
- GELMAN, A. (1992). Iterative and non-iterative simulation algorithms. In Computing Science and Statistics: Proceedings of the 24th Symposium on the Interface. To appear.
- HILLs, S. E. and SmITH, A. F. M. (1992). Parameterization issues in Bayesian inference. In Bayesian Statistics 4 (J. M. Bernardo, J. O. Berger, A. P. Dawid and A. F. M. Smith, eds.)
- MorRis, C. N. (1988). Apprxomating posterior distributions and posterior moments. In Bayesian Statistics 3 (J. M. Bernardo, M. H. DeGroot, D. V. Lindley and A. F. M. Smith, eds.) 327-344. Oxford Univ. Press. distributions and 3 (J. M. Bernardo, . M. Smith, eds.)
- RuBIN, D. B. (1988). Using the SIR algorithm to simulate posterior distributions. In Bayesian Statistics 3 (J. M. Bernardo, M. H. DeGroot, D. V. Lindley and A. F. M. Smith, eds.) 395-402. Oxford Univ. Press.
Cited by
MrBayes 3.2: Efficient Bayesian Phylogenetic Inference and Model Choice Across a Large Model Space
Ronquist, F., Teslenko, M., van der Mark, P., Ayres, D. L., Darling, A., Höhna, S., Larget, B., Liu, L., Suchard, M. A., & Huelsenbeck, J. P. (2012) · Systematic Biology · doi:10.1093/sysbio/sys029 · Cited by 27,843
Posterior summarization in Bayesian phylogenetics using tracer 1.7
Rambaut, A., Drummond, A. J., Xie, D., Baele, G., & Suchard, M. A. (2018) · Systematic Biology · doi:10.1093/sysbio/syy032 · Cited by 11,159
“, Gelman–Rubin diagnostics (Gelman and Rubin 1992) that Tracer currently does not provide.”
Backgroundbrms : An R Package for Bayesian Multilevel Models Using Stan
Bürkner, P.-C. (2017) · Journal of Statistical Software · doi:10.18637/jss.v080.i01 · Cited by 9,476
“The Rhat value provides information on the convergence of the algorithm (cf., Gelman and Rubin, 1992).”
BackgroundDiscrete Choice Methods with Simulation
Train, K. E. (2001) · doi:10.1017/cbo9780511805271 · Cited by 7,784
Stan : A Probabilistic Programming Language
Carpenter, B., Gelman, A., Hoffman, M. D., Lee, D., Goodrich, B., Betancourt, M., Brubaker, M., Guo, J., Li, P., & Riddell, A. (2017) · Journal of Statistical Software · doi:10.18637/jss.v076.i01 · Cited by 7,754
“Before performing output analysis, we recommend generating multiple independent chains in order to more effectively monitor convergence; see (Gelman and Rubin 1992) for more analysis.”
MethodSelf-citation
Metadata
- Authors
- Gelman, A., & Rubin, D. B.
- Venue
- Statistical Science
- Publisher
- Institute of Mathematical Statistics
- Published
- 1992-11-01
- Volume
- 7
- Issue
- 4
- Pages
- 457-472
- ISSN
- 0883-4237 (ISSN-L)
- 2168-8745
- OpenAlex
- W2148534890
- Cited by
- 16,627
- References
- 29
- Citations by year
- 2026: 1004 · 2025: 1146 · 2024: 1209 · 2023: 1031 · 2022: 1155 · 2021: 1295 · 2020: 1243 · 2019: 1045 · 2018: 927 · 2017: 784 · 2016: 698 · 2015: 651 · 2014: 624 · 2013: 500 · 2012: 537
- FWCI
- 44.60
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Statistical Science (publishedVersion)
- UC Berkeley (submittedVersion)
- Digital Access to Scholarship at Harvard (DASH) (Harvard University) (submittedVersion, cc-by)
- Project Euclid (Cornell University) (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Markov Chains and Monte Carlo Methods
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Physical Sciences › Computer Science › Artificial Intelligence › Bayesian Methods and Mixture Models
- Keywords
- iterative simulation, Gibbs sampling, Metropolis algorithm, posterior distribution estimation, Bayesian inference, reaction time, schizophrenia
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.