Markov chain Monte Carlo without likelihoods
Open accessThe DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Abstract
Many stochastic simulation approaches for generating observations from a posterior distribution depend on knowing a likelihood function. However, for many complex probability models, such likelihoods are either impossible or computationally prohibitive to obtain. Here we present a Markov chain Monte Carlo method for generating observations from a posterior distribution without the use of likelihoods. It can also be used in frequentist applications, in particular for maximum-likelihood estimation. The approach is illustrated by an example of ancestral inference in population genetics. A number of open problems are highlighted in the discussion.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The greatest computational advantage of the original ABC rejection algorithm over Monte Carlo based ABC methods is that it generates independent samples and therefore readily lends itself to ‘embarrassingly’ parallel computation [86]. The computation time thus scales linearly to the number of processors available.”
From Integrating Crop Growth Models with Whole Genome Prediction through Approximate Bayesian Computation (2015) · cites this paper as [86]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“If ϵ is sufficiently small then this distribution will be a good approximation for the ‘true’ posterior distribution, P(θ|D0).”
From Simulation-based model selection for dynamical systems in systems and population biology (2010) · cites this paper as Marjoram et al., 2003
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Moreover, related ideas are already applied in the context of generalized linear mixed models [16], unobserved data points [17].”
From Likelihood based observability analysis and confidence intervals for predictions of dynamic models (2012) · cites this paper as [17]
Experimental — accuracy not yet measuredIn the citing paper
“The price to pay is the generation of dependent outcomes, and the risk of getting stuck in regions of low probability of the state space for long periods of time.”
From Reverse engineering and identification in systems biology: strategies, perspectives and challenges (2014) · cites this paper as [193]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Equation of State Calculations by Fast Computing Machines
Metropolis, N., Rosenbluth, A. W., Rosenbluth, M. N., Teller, A. H., & Teller, E. (1953) · The Journal of Chemical Physics · doi:10.1063/1.1699114 · Cited by 37,192
Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2003) · doi:10.1201/9780429258480 · Cited by 27,276
Monte Carlo sampling methods using Markov chains and their applications.
Hastings, W. K. (1970) · Biometrika · doi:10.1093/biomet/57.1.97 · Cited by 15,195
Markov Chain Monte Carlo in Practice
(1995) · Chapman & Hall/CRC eBooks · doi:10.1201/b14835 · Cited by 7,757
Approximate Bayesian computation in population genetics
Beaumont, M. A., Zhang, W., & Balding, D. J. (2002) · Genetics · doi:10.1093/genetics/162.4.2025 · Cited by 2,932
Ripley, B. D. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316726 · Cited by 2,241
Bayes and Empirical Bayes Methods for Data Analysis
(2001) · Technometrics · doi:10.1198/tech.2001.s608 · Cited by 2,098
On the genealogy of large populations
Kingmán, J. F. C. (1982) · Journal of Applied Probability · doi:10.1017/s0021900200034446 · Cited by 1,628
Population growth of human Y chromosomes: a study of Y chromosome microsatellites
Pritchard, J. K., Seielstad, M. T., Perez-Lezaun, A., & Feldman, M. W. (1999) · Molecular Biology and Evolution · doi:10.1093/oxfordjournals.molbev.a026091 · Cited by 1,080
Bayes and Empirical Bayes Methods for Data Analysis, Second Edition
Carlin, B., & Louis, T. (2000) · Chapman & Hall/CRC Texts in Statistical Science · doi:10.1201/9781420057669 · Cited by 959
Research works printed but not linked: 4
- Kingman, J. F. C. (1982) J. Appl. Prob. 19A, 27–43. [Google Scholar] · doi:10.2307/3213548 · Paper page
- Stephens, M. (2001) in Handbook of Statistical Genetics, eds. Balding, D. J., Bishop, M. J. & Cannings, C. (Wiley, New York), pp. 213–238.
- Plagnol, V. & Tavaré, S. (2004) in Proceedings of the 5th International Conference on Monte Carlo and Quasi-Monte Carlo Methods in Scientific Computing, ed. Niederreiter, H. (Springer, Heidelberg).
- Cabrera, J. & Yohai, V. J. (1999) A New Computational Approach for Bayesian and Robust Bayesian Statistical Analysis, www.rci.rutgers.edu/~cabrera/pap/vic.pdf, preprint.
Cited by
Items 101–200 of 1,000
Approximate Bayesian Computation using Markov Chain Monte Carlo simulation: DREAM(ABC)
Sadegh, M., & Vrugt, J. A. (2014) · Water Resources Research · doi:10.1002/2014wr015386 · Cited by 143
Kernel Bayes' rule: Bayesian inference with positive definite kernels
Fukumizu, K., Song, L., & Gretton, A. (2013) · Journal of Machine Learning Research · doi:10.5555/2567709.2627677 · Cited by 211
“In this case, Approximate Bayesian Computation (ABC) is a popular method for Bayesian inference.”
BackgroundMethodInfluentialCalibration and evaluation of individual-based models using Approximate Bayesian Computation
van der Vaart, E., Beaumont, M., Johnston, A. S. A., & Sibly, R. M. (2015) · Ecological Modelling · doi:10.1016/j.ecolmodel.2015.05.020 · Cited by 142
RAMAKRISHNAN, U., & HADLY, E. A. (2009) · Molecular Ecology · doi:10.1111/j.1365-294x.2009.04092.x · Cited by 117
“Recent statistical advances of the rejection algorithm, or ABC, use enhanced methods for sampling the prior parameter space (Marjoram et al. 2003) and rejection criteria (Beaumont et al.”
MethodResolving Evolutionary Relationships in Closely Related Species with Whole-Genome Sequencing Data
Nater, A., Burri, R., Kawakami, T., Smeds, L., & Ellegren, H. (2015) · Systematic Biology · doi:10.1093/sysbio/syv045 · Cited by 118
“However, recent advances in approximate methods like approximate Bayesian computation (ABC) offer an elegant way around the problem of solving a likelihood function (Beaumont et al. 2002; Marjoram et al. 2003; Excoffier et al. 2013).”
MethodABC likelihood-free methods for model choice in Gibbs random fields
Grelaud, A., Marin, J.-M., Robert, C. P., Rodolphe, F., & Taly, J.-F. (2009) · Bayesian Analysis · doi:10.1214/09-ba412 · Cited by 119
“The algorithm on which the ABC method [introduced by Pritchard et al. (1999) and expanded in Beaumont et al. (2002) and Marjoram et al. (2003)] is based can be briefly described as follows: given a dataset x 0 = ( x 1 , · · · , x n ) associated with the sampling distribution f ( ·| θ ), and under a…”
MethodModel selection in systems and synthetic biology
Kirk, P., Thorne, T., & Stumpf, M. P. (2013) · Current Opinion in Biotechnology · doi:10.1016/j.copbio.2013.03.012 · Cited by 118
Analysing, completing, and generating influent data for WWTP modelling: A critical review
Martín, C., & Vanrolleghem, P. A. (2014) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2014.05.008 · Cited by 136
“(2011) that calibrates a stochastic model describing wastewater micropollutant loads by using three Approximate Bayesian Computation (ABC) methods (Beaumont et al., 2002; Marjoram et al., 2003).”
MethodBayesian Inference of the Demographic History of Chimpanzees
Wegmann, D., & Excoffier, L. (2010) · Molecular Biology and Evolution · doi:10.1093/molbev/msq028 · Cited by 116
“W egm an n an d Exco ffi er · d o i:10.1093/m o lbev/m sq028 M B E 1428 Downloaded from https://academic.oup.com/mbe/article-abstract/27/6/1425/1116277 by guest on 29 July 2018 sampler introduced recently (Marjoram et al. 2003).”
BackgroundInfluentialEpidemiological models of Mycobacterium tuberculosis complex infections
Ozcaglar, C., Shabbeer, A., Vandenberg, S. L., Yener, B., & Bennett, K. P. (2012) · Mathematical Biosciences · doi:10.1016/j.mbs.2012.02.003 · Cited by 136
“Markov Chain Monte Carlo methods and Approximate Bayesian Computation are commonly used methods to estimate transmission rate [45, 46, 47, 48, 49, 50].”
MethodLearning Summary Statistic for Approximate Bayesian Computation via Deep Neural Network
Wong, W. H., Jiang, B., Wu, T.-Y., & Zheng, C. (2018) · Statistica Sinica · doi:10.5705/ss.202015.0340 · Cited by 185
“In future work, we plan to use our approach for constructing summary statistics alongside more sophisticated variants of ABC methods, such as those which combine ABC with Markov chain Monte Carlo or sequential techniques (Marjoram et al. (2003); Sisson, Fan and Tanaka (2007)).”
MethodRay, N., Currat, M., Berthier, P., & Excoffier, L. (2005) · Genome Research · doi:10.1101/gr.3708505 · Cited by 118
“A possible next step would consist of integrating our simulations into an Approximate Bayesian Computation (ABC) (Beaumont et al. 2002; Marjoram et al. 2003) framework, which would enable us to actually estimate parameters that were presently considered as fixed (such as the timing of the…”
MethodApproximate Bayesian computation for forward modeling in cosmology
Akeret, J., Refregier, A. R., Amara, A., Seehars, S., & Hasner, C. (2015) · Journal of Cosmology and Astroparticle Physics · doi:10.1088/1475-7516/2015/08/043 · Cited by 133
“In 2003, ABC methods based on Markov Chain Monte Carlo (MCMC) were proposed [36], which improved the sampling efficiency.”
MethodApproximate Bayesian Computation Without Summary Statistics: The Case of Admixture
Sousa, V. C., Fritz, M., Beaumont, M. A., & Chikhi, L. (2009) · Genetics · doi:10.1534/genetics.108.098129 · Cited by 110
“…has led to the development of methods that try to approximate the likelihood, such as approximate Bayesian computation (ABC) (Beaumont et al. 2002; Marjoram et al. 2003), composite likelihood (Hudson 2001; Nielsen et al. 2005), and product of approximate conditionals (PAC) (Li and Stephens 2003;…”
BackgroundMethodInfluentialWeyant, A., Schafer, C., & Wood‐Vasey, W. M. (2013) · The Astrophysical Journal · doi:10.1088/0004-637x/764/2/116 · Cited by 126
“As is proved in Marjoram et al. (2003), the posterior distribution of interest π(θ | x) is the stationary distribution of the chain.”
BackgroundMethodA Novel Approach for Choosing Summary Statistics in Approximate Bayesian Computation
Aeschbacher, S., Beaumont, M., & Futschik, A. (2012) · Genetics · doi:10.1534/genetics.112.143164 · Cited by 121
“ABC may be viewed as a class of rejection algorithms (Marjoram et al. 2003, Marjoram and Tavaré 2006), where the full data are projected to a lower-dimensional set of summary 64 statistics.”
MethodEasy ABC : performing efficient approximate B ayesian computation sampling schemes using R
Jabot, F., Faure, T., & Dumoulin, N. (2013) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.12050 · Cited by 131
“(2003) in which the tolerance and the proposal range are determined by the algorithm via an initial calibration step, following the modifications of Wegmann, Leuenberger & Excof-fier (2009).”
MethodExtinction cascades and catastrophe in ancient food webs
Roopnarine, P. D. (2006) · Paleobiology · doi:10.1666/05008.1 · Cited by 109
Approximate Bayesian Computation by Subset Simulation
Chiachío, M., Beck, J. L., Chiachío, J., & Rus, G. (2014) · SIAM Journal on Scientific Computing · doi:10.1137/130932831 · Cited by 126
“In those cases where the probability content of the posterior is concentrated over a small region in relation to a diffuse prior, the use of Markov chain Monte Carlo methods (MCMC) [17, 25, 16] has been demonstrated to be efficient [24].”
MethodBayesian Indirect Inference Using a Parametric Auxiliary Model
Drovandi, C., Pettitt, A. N., & Lee, A. (2015) · Statistical Science · doi:10.1214/14-sts498 · Cited by 127
“Algorithm 1 MCMC ABC algorithm of Marjoram et al. (2003). 1: Set θ 2: for i = 1 to T do 3: Draw θ ∼ q(·|θ) 4: Simulate x∗ ∼ p(·|θ) 5: Compute r = p(θ )q(θ|θ)Kǫ(ρ(s(x),s(y))) p(θ)q(θ|θ)Kǫ(ρ(s(x),s(y))) 6: if uniform(0, 1) < r then 7: θ = θ and xi = x∗ 8: else 9: θ = θ and xi = xi−1 10: end if 11: end for”
MethodInfluentialLikelihood-free estimation of model evidence
Didelot, X., Everitt, R. G., Johansen, A. M., & Lawson, D. J. (2011) · Bayesian Analysis · doi:10.1214/11-ba602 · Cited by 109
“This is analogous to the necessity to use non-sufficient statistic in standard ABC (where sampling of parameters is the aim) when complex model and data are involved (Beaumont et al., 2002; Marjoram et al., 2003).”
BackgroundMethodInfluentialNott, D. J., Marshall, L. A., & Brown, J. L. (2012) · Water Resources Research · doi:10.1029/2011wr011128 · Cited by 115
“The probability distributed model (PDM) [Moore, 2007] simulates catchment streamflow based on saturation excess runoff processes by conceptualizing the spatial distribution of soil moisture storage as a probability density function. Our version of the model is adapted from Smith and Marshall [2010] and contains six un…”
MethodVialet‐Chabrand, S., Dreyer, E., & BRENDEL, O. (2013) · Plant Cell & Environment · doi:10.1111/pce.12086 · Cited by 105
Kypraios, T., Neal, P. J., & Prangle, D. (2016) · Mathematical Biosciences · doi:10.1016/j.mbs.2016.07.001 · Cited by 125
“To overcome issues caused by a low acceptance probability when the prior and posterior distributions are rather different Marjoram et al. (2003) developed an algorithm that embeds the simulation steps into a standard Metropolis–Hastings (M-H) Markov Chain Monte Carlo (MCMC) algorithm (henceforth,…”
MethodEckert, A. J., Wegrzyn, J., Pande, B., Jermstad, K. D., Lee, J. M., Liechty, J. D., Tearse, B. R., Krutovsky, K. V., & Neale, D. B. (2009) · Genetics · doi:10.1534/genetics.109.103895 · Cited by 103
An Approximate Bayesian Estimator Suggests Strong, Recurrent Selective Sweeps in Drosophila
Jensen, J. D., Thornton, K., & Andolfatto, P. (2008) · PLoS Genetics · doi:10.1371/journal.pgen.1000198 · Cited by 114
“We take an approximate Bayesian (ABC) approach [41–44] to obtain marginal posterior distributions (estimation is also possible using joint posterior distributions, an example of this is discussed in the Results and given as a Supplement).”
MethodRatmann, O., Jørgensen, O., Hinkley, T., Stumpf, M., Richardson, S., & Wiuf, C. (2007) · PLoS Computational Biology · doi:10.1371/journal.pcbi.0030230 · Cited by 98
“Although ABC-MCMC failed on network data, algorithm LFI enabled efficient and consistent inference.”
BackgroundMethodInfluentialApproximate Bayesian Computation Using Indirect Inference
Drovandi, C. C., Pettitt, A. N., & Faddy, M. J. (2011) · Journal of the Royal Statistical Society Series C: Applied Statistics · doi:10.1111/j.1467-9876.2010.00747.x · Cited by 100
“This usually occurs when the model that is used to describe the data is complex, e.g. in Markov process models (Tanaka et al. , 2006) and population genetic models (Marjoram et al. , 2003).”
BackgroundMethodFiltering via approximate Bayesian computation
Jasra, A., Singh, S. S., Martin, J. S., & McCoy, E. J. (2010) · Statistics and Computing · doi:10.1007/s11222-010-9185-0 · Cited by 100
“1999), Markov chain Monte Carlo (MCMC) (Majoram et al. 2003) or SMC methods (Beaumont et al.”
Likelihood-free Bayesian estimation of multivariate quantile distributions
Drovandi, C., & Pettitt, A. N. (2011) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2011.03.019 · Cited by 125
Warne, D. J., Baker, R. E., & Simpson, M. J. (2019) · Journal of The Royal Society Interface · doi:10.1098/rsif.2018.0943 · Cited by 83
“The challenge of constructing effective proposal kernels is equally non-trivial for ABCMCMC as for the Metropolis–Hastings method.”
BackgroundMethodInfluentialLives saved with vaccination for 10 pathogens across 112 countries in a pre-COVID-19 world
Toor, J., Echeverria-Londono, S., Li, X., Abbas, K., Carter, E. D., Clapham, H. E., Clark, A., de Villiers, M. J., Eilertson, K., Ferrari, M., et al. (2021) · eLife · doi:10.7554/elife.67635 · Cited by 97
Bazin, É., Dawson, K. J., & Beaumont, M. (2010) · Genetics · doi:10.1534/genetics.109.112391 · Cited by 113
“Many approaches to ABC (Pritchard et al. 1999; Marjoram et al. 2003; Sisson et al. 2007) are based on the idea of ‘‘rejection’’ (of observations falling outside a small acceptance region centered on the observed data), giving P(F j r(S(X), S(x)) , ¼ e) for some metric r( ).”
BackgroundAsymptotic properties of approximate Bayesian computation
Frazier, D. T., Martin, G. M., Robert, C. P., & Rousseau, J. (2018) · Biometrika · doi:10.1093/biomet/asy027 · Cited by 135
Hamilton, G., Stoneking, M., & Excoffier, L. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0409253102 · Cited by 95
Colwell, R. K., Gotelli, N. J., Ashton, L. A., Beck, J., Brehm, G., Fayle, T. M., Fiedler, K., Forister, M. L., Kessler, M. R., Kitching, R. L., et al. (2016) · Ecology Letters · doi:10.1111/ele.12640 · Cited by 102
Fenicia, F., Kavetski, D., Reichert, P., & Albert, C. (2018) · Water Resources Research · doi:10.1002/2017wr021616 · Cited by 94
“…(Albert et al., 2014), which combines two algorithmic enhancements: (i) sampling h values in Step 1 from a Markov chain rather than from the prior (Marjoram et al., 2003); and (ii) tightening the ABC tolerance sq as the sampling progresses (Toni et al., 2009), similar to Simulated Annealing in…”
BackgroundJohnston, I. G., Burgstaller, J. P., Havlíček, V., Kolbe, T., Rülicke, T., Brem, G., Poulton, J., & Jones, N. S. (2015) · eLife · doi:10.7554/elife.07464 · Cited by 106
“Using experimental data on mtDNA statistics through development [16, 11, 12, 18], we use approximate Bayesian computation [27, 28, 29, 30] to rigorously explore the statistical support for each mechanism, showing that random mtDNA turnover coupled with binomial partitioning of mtDNAs at cell divisions is highly likely…”
BackgroundMethodInfluentialBayesian inference, Monte Carlo sampling and operational risk
Peters, G. W., & Sisson, S. A. (2006) · The Journal of Operational Risk · doi:10.21314/jop.2006.014 · Cited by 107
Foll, M., Beaumont, M., & Gaggiotti, O. E. (2008) · Genetics · doi:10.1534/genetics.107.084541 · Cited by 105
“Unfortunately, we have not been able to calculate the analytical expression (presented in the Appendix) for this biologically more realistic ascertainment model, but demonstrate that this is possible using likelihood-free inference (Beaumont et al., 2002; Marjoram et al., 2003).”
BackgroundPopABC: a program to infer historical demographic parameters
Lopes, J. S., Balding, D. J., & Beaumont, M. (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp487 · Cited by 108
Expectation Propagation for Likelihood-Free Inference
Barthelmé, S., & Chopin, N. (2014) · Journal of the American Statistical Association · doi:10.1080/01621459.2013.864178 · Cited by 104
“The ABC algorithm we implement is a Gaussian random walk version of the MCMC-ABC algorithm of Marjoram et al. (2003).”
MethodPhylogenetic Inference via Sequential Monte Carlo
Bouchard‐Côté, A., Sankararaman, S., & Jordan, M. I. (2012) · Systematic Biology · doi:10.1093/sysbio/syr131 · Cited by 104
“, importance sampling and approximate Bayesian computation) to problems in population genetics, but this work also focuses on coalescent models (Griffiths and Tavaré 1996; Beaumont et al. 2002; Marjoram et al. 2002; Iorio and Griffiths 2004; Paul et al. 2011).”
BackgroundBridging the gap between GLUE and formal statistical approaches: approximate Bayesian computation
Sadegh, M., & Vrugt, J. A. (2013) · Hydrology and earth system sciences · doi:10.5194/hess-17-4831-2013 · Cited by 98
“So rather than considering the data, ˜ Y , itself we consider a summary statistic of the data, S( ˜ Y ) , and use a distance function (Marjoram et al., 2003; Sisson et al., 2007) ρ S( ˜ Y ),S( Y ( θ )) ≤ (5) to decide whether to accept the parameter values, θ , or not.”
MethodMcKinley, T. J., Vernon, I., Andrianakis, I., McCreesh, N., Oakley, J. E., Nsubuga, R. N., Goldstein, M., & White, R. G. (2018) · Statistical Science · doi:10.1214/17-sts618 · Cited by 102
“…be readily incorporated into existing numerical algorithms, such as rejection sampling [e.g. Tavar´e et al., 1997, Beaumont et al., 2002]; MCMC [e.g. Marjoram et al., 2003, Ratmann et al., 2009, Wood, 2010]; or sequential Monte Carlo [SMC] [e.g. Sisson et al., 2007, Toni et al., 2009, Beaumont et…”
MethodInfluentialcosmoabc: Likelihood-free inference via Population Monte Carlo Approximate Bayesian Computation
Ishida, É. E. O., Vitenti, S. D. P., Penna-Lima, M., Cisewski-Kehe, J., de Souza, R. S., Trindade, A. M. M., Cameron, E., & Busti, V. C. (2015) · Astronomy and Computing · doi:10.1016/j.ascom.2015.09.001 · Cited by 95
“One of such examples is the work of Marjoram et al. (2003), who proposes a merger between the standard MCMC algorithm and the ABC rejection sampling.”
BackgroundApproximate Bayesian computation with differential evolution
Turner, B. M., & Sederberg, P. B. (2012) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2012.06.004 · Cited by 104
“This is an added benefit of ABCDE over sequential Monte Carlo methods, which do not converge to the true joint posterior distribution when used in a Gibbs sampling framework unless proper precautions are taken.”
MethodInfluentialStorytelling and story testing in domestication
Gerbault, P., Allaby, R. G., Boivin, N., Rudzinski, A., Grimaldi, I. M., Pires, J. C., Climer Vigueira, C., Dobney, K., Gremillion, K. J., Barton, L., et al. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1400425111 · Cited by 85
Neural Density Estimation and Likelihood-free InferencePreprint
Papamakarios, G. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.13233 · Cited by 102
“MCMC-ABC was proposed by Marjoram et al. (2003) prior to the introduction of pseudo-marginal MCMC by Andrieu and Roberts (2009).”
BackgroundMethodResultInfluentialAdaptive approximate Bayesian computation for complex models
Lenormand, M., Jabot, F., & Deffuant, G. (2012) · HAL · Cited by 92
Pereyra, M., Dobigeon, N., Batatia, H., & Tourneret, J. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2249076 · Cited by 95
“6: end for”
MethodFour key challenges in infectious disease modelling using data from multiple sources
Angelis, D. D., Presanis, A. M., Birrell, P., Tomba, G. S., & House, T. (2014) · Epidemics · doi:10.1016/j.epidem.2014.09.004 · Cited by 97
Ben Abdessalem, A., Dervilis, N., Wagg, D., & Worden, K. (2018) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2017.06.017 · Cited by 83
“In [24], the authors show that the combination of the ABC principle with the subset simulation concept [25], introduced to estimate rare events, decreases the computational time and provides the same precision as other variants of the ABC algorithm proposed in the literature such as ABC sequential Monte Carlo (SMC) an…”
MethodHsiao, V., Swaminathan, A., & Murray, R. M. (2018) · IEEE Control Systems · doi:10.1109/mcs.2018.2810459 · Cited by 98
“By selecting parameter sets and simulating a data set for each set of parameters, it is possible to perform Bayesian inference using MCMC without having to explicitly compute likelihoods [70].”
MethodBayesian computation via empirical likelihood
Mengersen, K. L., Pudlo, P., & Robert, C. P. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1208827110 · Cited by 108
“For instance, a whole new area of population genetic modeling (8, 10) has been explored thanks to the availability of such methods.”
BackgroundMethodHeritability of Extinction Rates Links Diversification Patterns in Molecular Phylogenies and Fossils
Rabosky, D. L. (2009) · Systematic Biology · doi:10.1093/sysbio/syp069 · Cited by 94
“Analysis of 10 independent MCMC chains (Table S1) with the Gelman–Rubin statistic (Gelman et al. 2003) suggested that all chains converged on the same target distribution (Table S2).”
MethodInfluentialSlater, G. J., Harmon, L. J., Wegmann, D., Joyce, P., Revell, L. J., & Alfaro, M. E. (2012) · Evolution · doi:10.1111/j.1558-5646.2011.01474.x · Cited by 85
“variation in the distribution of continuous phenotypic traits among clades arises under constant or differing rates or patterns of evolution (McPeek 1995; Butler and King 2004; O’Meara et al. 2006; Thomas et al. 2006, 2009; Revell 2008; Revell and Collar A wealth of phenotypic data exist in the…”
BackgroundConstruction of feasible and accurate kinetic models of metabolism: A Bayesian approach
Saa, P. A., & Nielsen, L. K. (2016) · Scientific Reports · doi:10.1038/srep29635 · Cited by 80
“There are more efficient ABC implementations displaying accelerated convergence 61–63 .”
BackgroundSimulation-based Bayesian inference for epidemic models
McKinley, T. J., Ross, J. V., Deardon, R., & Cook, A. R. (2013) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2012.12.012 · Cited by 95
“This basic idea can be incorporated into rejection sampling (e.g. Tavaré et al., 1997; Beaumont et al., 2002), MCMC (e.g. Marjoram et al., 2003; Wilkinson, submitted for publication) or SMC routines (e.g. Sisson et al., 2007; Toni et al., 2009; Beaumont et al., 2009; Erhardt and Smith, 2012).”
Ensemble ecosystem modeling for predicting ecosystem response to predator reintroduction
Baker, C. M., Gordon, A., & Bode, M. (2016) · Conservation Biology · doi:10.1111/cobi.12798 · Cited by 81
“Our EEM approach builds on methods from Bayesian computation (Marjoram et al. 2003), qualitative modeling (Dambacher et al. 2003; Raymond et al. 2011) and ensemble methods in systems biology (Battogtokh et al. 2002).”
BackgroundMethodVrugt, J. A., & Beven, K. J. (2018) · Journal of Hydrology · doi:10.1016/j.jhydrol.2018.02.026 · Cited by 87
“This class of methods is also referred to as approximate Bayesian computation (ABC) and is currently receiving a surge of interest in statistics (Marjoram et al., 2003; Sisson et al., 2007; Joyce and Marjoram, 2008; Grelaud et al., 2009; Del Moral et al., 2012) with common applications in genetics…”
Field-level simulation-based inference of galaxy clustering with convolutional neural networks
Lemos, P., Parker, L., Hahn, C., Ho, S., Eickenberg, M., Hou, J., Massara, E., Modi, C., Dizgah, A. M., Blancard, B. R.-S., et al. (2024) · Physical review. D/Physical review. D. · doi:10.1103/physrevd.109.083536 · Cited by 86
Henderson, D. A., Boys, R. J., Krishnan, K. J., Lawless, C., & Wilkinson, D. J. (2009) · Journal of the American Statistical Association · doi:10.1198/jasa.2009.0005 · Cited by 86
“Given the training data { D * , W } and the observed data { z , x }, we can in theory fit an integrated Bayesian model for joint emulation and calibration using an MCMC scheme.”
MethodInfluentialInferring epidemiological parameters from phylogenies using regression-ABC: A comparative study
Saulnier, E., Gascuel, O., & Alizon, S. (2017) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1005416 · Cited by 89
“ABC-MCMC consists in searching in the prior parameter space more efficiently by using MCMC-like approaches [34].”
MethodFantin, N., Côté, P., McConnachie, A. W., Bergeron, P., Cuillandre, J., Gwyn, S., Ibata, R., Thomas, G. F., Carlberg, R. G., Fabbro, S., et al. (2019) · The Astrophysical Journal · doi:10.3847/1538-4357/ab5521 · Cited by 89
“As described in Marjoram et al. (2003), ABC methods typically require lower-dimensional summary statistics, S(D), which are representative of the whole data set in order to reduce computational costs.”
BackgroundMethodInfluentialABC: A useful Bayesian tool for the analysis of population data
Lopes, J. S., & Beaumont, M. (2009) · Infection Genetics and Evolution · doi:10.1016/j.meegid.2009.10.010 · Cited by 83
Warne, D. J., Baker, R. E., & Simpson, M. J. (2019) · Bulletin of Mathematical Biology · doi:10.1007/s11538-019-00589-x · Cited by 87
“As a result, we apply an ABC variant of a Markov chain Monte Carlo (MCMC) sampler (Marjoram et al., 2003) (see Appendix C).”
BackgroundMethodBayesian Parameter Estimation for Latent Markov Random Fields and Social Networks
Everitt, R. G. (2012) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.2012.687493 · Cited by 95
“MCMC (Marjoram et al., 2003) and SMC samplers (Sisson et al.”
InfluentialGennaro, M., Tchernyshyov, K., Brown, T. M., Geha, M., Avila, R. J., Guhathakurta, P., Kalirai, J. S., Kirby, E. N., Renzini, A., Simon, J. D., et al. (2018) · The Astrophysical Journal · doi:10.3847/1538-4357/aaa973 · Cited by 83
“To propose ~θi values more efficiently, we use ABC within Markov-Chain Monte Carlo (MCMC, see e.g. Marjoram et al. 2003).”
MethodAdvances in Markov chain Monte Carlo methods
Murray, I. (2007) · OpenGrey (Institut de l'Information Scientifique et Technique) · Cited by 110
Post-GWAS: where next? More samples, more SNPs or more biology?
Marjoram, P., Zubair, A., & Nuzhdin, S. V. (2014) · Heredity · doi:10.1038/hdy.2013.52 · Cited by 74
“This is often challenging, but a commonly used approach is Metropolis-Hastings Markov chain Monte Carlo methods (MH-MCMC) (Metropolis et al., 1953; Hastings, 1970).”
BackgroundSelf-citationNEUENSCHWANDER, S., LARGIADÈR, C. R., RAY, N., CURRAT, M., VONLANTHEN, P., & EXCOFFIER, L. (2008) · Molecular Ecology · doi:10.1111/j.1365-294x.2007.03621.x · Cited by 73
“Because likelihood-based methods are sometimes extremely challenging or even impossible to compute for complex models (Wilson & Balding 1998; Beaumont 1999), a new Bayesian approach, the approximate Bayesian computation framework (ABC, Beaumont et al. 2002; Marjoram et al. 2003 ) has been developed.”
MethodModel Misspecification in Approximate Bayesian Computation: Consequences and Diagnostics
Frazier, D. T., Robert, C. P., & Rousseau, J. (2020) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/rssb.12356 · Cited by 116
“…1 in Table 1 details the common accept–reject implementation of ABC, which can be augmented with additional steps to increase sampling efficiency; see, for example the Markov chain Monte Carlo–ABC approach of Marjoram et al. (2003), or the sequential Monte Carlo–ABC approach of Sisson et al. (2007).”
BackgroundPiou, C., & Prévost, É. (2012) · Ecological Modelling · doi:10.1016/j.ecolmodel.2012.01.025 · Cited by 72
A simulated annealing approach to approximate Bayes computations
Albert, C., Künsch, H. R., & Scheidegger, A. (2014) · Statistics and Computing · doi:10.1007/s11222-014-9507-8 · Cited by 78
“Numerical methods such as the Metropolis algorithm Metropolis et al. (1953) require many evaluations of the likelihood function to generate such a sample.”
BackgroundMethodInfluentialFasiolo, M., Pya, N., & Wood, S. N. (2016) · Statistical Science · doi:10.1214/15-sts534 · Cited by 82
Generative inference for cultural evolution
Kandler, A., & Powell, A. (2018) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2017.0056 · Cited by 79
Recent developments in genetic data analysis: what can they tell us about human demographic history?
Beaumont, M. (2004) · Heredity · doi:10.1038/sj.hdy.6800447 · Cited by 81
“However, this is essentially a problem of density estimation and other methods are available (Beaumont et al, 2002; see also Marjoram et al, 2003).”
MethodOn sequential Monte Carlo, partial rejection control and approximate Bayesian computation
Peters, G. W., Fan, Y., & Sisson, S. A. (2012) · Statistics and Computing · doi:10.1007/s11222-012-9315-y · Cited by 69
“A particular motivation for this approach stems from the recent developments in “likelihood-free” (or approximate Bayesian) computation (Beaumont et al. 2002; Marjoram et al. 2003; Sisson et al. 2007), where particle weights depend on how well simulated data (for each particle) match observed data—an infrequent event.”
InfluentialEstoup, A., Baird, S. J. E., Ray, N., Currat, M., Cornuet, J., Santos, F. M. P., Beaumont, M., & Excoffier, L. (2010) · Molecular Ecology Resources · doi:10.1111/j.1755-0998.2010.02882.x · Cited by 78
“The approximate Bayesian computation (ABC) method has been developed to circumvent this difficulty (Tavaré et al. 1997; Pritchard et al. 1999; Beaumont et al. 2002; Marjoram et al., 2003; Wegmann et al., 2009; Beaumont et al. 2010; Blum & François 2010).”
MethodAbdessalem, A. B., Dervilis, N., Wagg, D., & Worden, K. (2017) · Frontiers in Built Environment · doi:10.3389/fbuil.2017.00052 · Cited by 69
Potential impact of tuberculosis vaccines in China, South Africa, and India
Harris, R. C., Sumner, T., Knight, G. M., Zhang, H., & White, R. G. (2020) · Science Translational Medicine · doi:10.1126/scitranslmed.aax4607 · Cited by 69
Approximate Models and Robust Decisions
Watson, J. A., & Holmes, C. C. (2016) · Statistical Science · doi:10.1214/16-sts592 · Cited by 98
“…(ABC), all start with the premise of misspecification; see, for example, Beaumont, Zhang and Balding (2002), Fearnhead and Prangle (2012), Marjoram et al. (2003), Marin et al. (2012), Minka (2001), Ratmann et al. (2009), Rue, Martino and Chopin (2009), Varin, Reid and Firth (2011), and…”
EMBEDDED MODEL ERROR REPRESENTATION FOR BAYESIAN MODEL CALIBRATION
Sargsyan, K., Huan, X., & Najm, H. N. (2019) · International Journal for Uncertainty Quantification · doi:10.1615/int.j.uncertaintyquantification.2019027384 · Cited by 95
“…approximation: To avoid computing expensive likelihoods, and in order to build constraints driven by the purposes of the modeler, one can construct other forms of approximate likelihoods, inspired by Approximate Bayesian Computation (ABC), otherwise called likelihood-free methods [7, 46, 61].”
MethodA Bayesian Framework for Parameter Estimation in Dynamical ModelsPreprint
Coelho, F. C., Codeço, C. T., & Gomes, M. G. M. (2009) · Nature Precedings · doi:10.1371/journal.pone.0019616 · Cited by 69
Conditioning of stochastic 3-D fracture networks to hydrological and geophysical data
Dorn, C., Linde, N., Borgne, T. L., Bour, O., & de Dreuzy, J. (2013) · Advances in Water Resources · doi:10.1016/j.advwatres.2013.10.005 · Cited by 66
“The l∞ norm is applicable if the error bounds are strict (Marjoram et al., 2003).”
BackgroundThe rate of convergence for approximate Bayesian computation
Barber, S., Voß, J., & Webster, M. (2015) · Electronic Journal of Statistics · doi:10.1214/15-ejs988 · Cited by 88
“Newer developments and extensions of the method include placing ABC in an MCMC context (Marjoram et al., 2003), sequential ABC (Sisson et al.”
MethodBayesian estimation of quantile distributions
Allingham, D., King, R., & Mengersen, K. L. (2008) · Statistics and Computing · doi:10.1007/s11222-008-9083-x · Cited by 73
Planktonic larval mortality rates are lower than widely expected
White, J. W., Morgan, S. G., & Fisher, J. L. (2014) · Ecology · doi:10.1890/13-2248.1 · Cited by 70
“Therefore, we took a Bayesian approach to the problem and estimated the joint posterior distribution Pr(h, k j ni,t, niþ1,t) using Markov chain Monte Carlo (MCMC) and an implicit likelihood calculation (Diggle and Graton 1984, Marjoram et al. 2003), which proved to be much more effective.”
MethodSequential Monte Carlo with Adaptive Weights for Approximate Bayesian Computation
Bonassi, F. V., & West, M. (2015) · Bayesian Analysis · doi:10.1214/14-ba891 · Cited by 88
“Methods of approximate Bayesian computation (ABC) are becoming increasing exploited, especially for problems in which the likelihood function is analytically intractable or very expensive to compute (Pritchard et al., 1999; Marjoram et al., 2003).”
BackgroundMethodInfluentialMicrobial sequence typing in the genomic era
Pérez‐Losada, M., Arenas, M., & Castro‐Nallar, E. (2017) · Infection Genetics and Evolution · doi:10.1016/j.meegid.2017.09.022 · Cited by 72
“leading to inefficient or intractable ML functions (Marjoram et al., 2003; Wegmann et al., 2009).”
BackgroundSchmallenberg virus: State of Art
Authority, E. F. S. (2014) · EFSA Journal · doi:10.2903/j.efsa.2014.3681 · Cited by 76
Kavetski, D., Fenicia, F., Reichert, P., & Albert, C. (2018) · Water Resources Research · doi:10.1002/2017wr020528 · Cited by 66
“…the ABC samples according to the distance metric (Beaumont et al., 2002; Blum & François, 2010), using ‘‘MCMC-within-ABC’’ (Albert et al., 2015; Marjoram et al., 2003), using differential evolution and continuous acceptance kernels (Sadegh & Vrugt, 2014), and others, in order to reduce…”
MethodInfluentialApproximate Bayesian Image Interpretation using Generative Probabilistic Graphics Programs
Mansinghka, V. K., Kulkarni, T. D., Perov, Y., & Tenenbaum, J. B. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1307.0060 · Cited by 49
“For example, in our text application, the Sis include binary indicators for the presence or absence of each glyph, along with its identity (“A“ through ”Z”, plus digits 0-9), and parameters including location,”
MethodThe N-Glycosylation Processing Potential of the Mammalian Golgi Apparatus
Fisher, P., THOMAS‐OATES, J. E., Wood, A. J., & Ungár, D. (2019) · Frontiers in Cell and Developmental Biology · doi:10.3389/fcell.2019.00157 · Cited by 66
Fernández, J., Chiachío, M., Chiachío, J., Muñoz, R., & Herrera, F. (2021) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2021.104511 · Cited by 67
Microsimulation model calibration using incremental mixture approximate Bayesian computation
Rutter, C. M., Ozik, J., DeYoreo, M., & Collier, N. T. (2019) · The Annals of Applied Statistics · doi:10.1214/19-aoas1279 · Cited by 62
“ABC-MCMC involves an initial rejection-based ABC step, but then generates new samples of θ from a Markov kernel q(θ | θ(t−1)) instead of the prior π(θ).”
van der Vaart, E., Johnston, A. S. A., & Sibly, R. M. (2015) · Ecological Modelling · doi:10.1016/j.ecolmodel.2015.08.012 · Cited by 64
“First, it may be possible to sample a model’s priors more efficiently in Step 3, using either MCMC-ABC (Marjoram et al., 2003) or SMC-ABC (Sisson et al., 2007; Toni et al., 2009) MCMC-ABC bases each subsequent run of the model on the previous one, and gradually moves towards an estimate of the full posterior distributi…”
Geometric Variational Inference
Frank, P., Leike, R., & Enßlin, T. A. (2021) · Entropy · doi:10.3390/e23070853 · Cited by 76
“…been two distinct approaches towards this problem: the direct construction of posterior samples based on Markov Chain Monte-Carlo (MCMC) methods [1–3], and the attempt to approximate the probability distribution with a different one, chosen from a family of simpler distributions, known as…”
Model Based Aircraft Trajectory Prediction During Takeoff
Lymperopoulos, I., Lygeros, J., & Lecchini, A. (2006) · AIAA Guidance, Navigation, and Control Conference and Exhibit · doi:10.2514/6.2006-6098 · Cited by 60
Metadata
- Authors
- Marjoram, P., Molitor, J., Plagnol, V., & Tavaré, S.
- Affiliations
- University of Southern California (US)
- Venue
- Proceedings of the National Academy of Sciences
- Publisher
- National Academy of Sciences
- Published
- 2003-12-08
- Volume
- 100
- Issue
- 26
- Pages
- 15324-15328
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- PMC
- PMC307566
- OpenAlex
- W2045973738
- Cited by
- 1,199
- References
- 20
- Citations by year
- 2026: 26 · 2025: 38 · 2024: 54 · 2023: 54 · 2022: 57 · 2021: 72 · 2020: 83 · 2019: 79 · 2018: 88 · 2017: 68 · 2016: 76 · 2015: 79 · 2014: 86 · 2013: 64 · 2012: 60
- FWCI
- 12.01
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Proceedings of the National Academy of Sciences (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Funders
- National Institutes of Health (5r01gm058897-03, GM58897)
- National Institute of General Medical Sciences (GM 58897)
- Division of Mathematical Sciences
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Markov Chains and Monte Carlo Methods
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic diversity and population structure
- Keywords
- Markov chain Monte Carlo, simulation-based inference, posterior sampling, maximum likelihood estimation, population genetics
- MeSH terms
- Algorithms, Computer Simulation, DNA, DNA, Mitochondrial, Biological Evolution, Genetics, Population, Humans, Markov Chains, Models, Biological, Monte Carlo Method, Stochastic Processes, Likelihood Functions
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.