Markov chain Monte Carlo without likelihoods
Open accessThe DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Abstract
Many stochastic simulation approaches for generating observations from a posterior distribution depend on knowing a likelihood function. However, for many complex probability models, such likelihoods are either impossible or computationally prohibitive to obtain. Here we present a Markov chain Monte Carlo method for generating observations from a posterior distribution without the use of likelihoods. It can also be used in frequentist applications, in particular for maximum-likelihood estimation. The approach is illustrated by an example of ancestral inference in population genetics. A number of open problems are highlighted in the discussion.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The greatest computational advantage of the original ABC rejection algorithm over Monte Carlo based ABC methods is that it generates independent samples and therefore readily lends itself to ‘embarrassingly’ parallel computation [86]. The computation time thus scales linearly to the number of processors available.”
From Integrating Crop Growth Models with Whole Genome Prediction through Approximate Bayesian Computation (2015) · cites this paper as [86]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“If ϵ is sufficiently small then this distribution will be a good approximation for the ‘true’ posterior distribution, P(θ|D0).”
From Simulation-based model selection for dynamical systems in systems and population biology (2010) · cites this paper as Marjoram et al., 2003
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Moreover, related ideas are already applied in the context of generalized linear mixed models [16], unobserved data points [17].”
From Likelihood based observability analysis and confidence intervals for predictions of dynamic models (2012) · cites this paper as [17]
Experimental — accuracy not yet measuredIn the citing paper
“The price to pay is the generation of dependent outcomes, and the risk of getting stuck in regions of low probability of the state space for long periods of time.”
From Reverse engineering and identification in systems biology: strategies, perspectives and challenges (2014) · cites this paper as [193]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Equation of State Calculations by Fast Computing Machines
Metropolis, N., Rosenbluth, A. W., Rosenbluth, M. N., Teller, A. H., & Teller, E. (1953) · The Journal of Chemical Physics · doi:10.1063/1.1699114 · Cited by 37,192
Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2003) · doi:10.1201/9780429258480 · Cited by 27,276
Monte Carlo sampling methods using Markov chains and their applications.
Hastings, W. K. (1970) · Biometrika · doi:10.1093/biomet/57.1.97 · Cited by 15,195
Markov Chain Monte Carlo in Practice
(1995) · Chapman & Hall/CRC eBooks · doi:10.1201/b14835 · Cited by 7,757
Approximate Bayesian computation in population genetics
Beaumont, M. A., Zhang, W., & Balding, D. J. (2002) · Genetics · doi:10.1093/genetics/162.4.2025 · Cited by 2,932
Ripley, B. D. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316726 · Cited by 2,241
Bayes and Empirical Bayes Methods for Data Analysis
(2001) · Technometrics · doi:10.1198/tech.2001.s608 · Cited by 2,098
On the genealogy of large populations
Kingmán, J. F. C. (1982) · Journal of Applied Probability · doi:10.1017/s0021900200034446 · Cited by 1,628
Population growth of human Y chromosomes: a study of Y chromosome microsatellites
Pritchard, J. K., Seielstad, M. T., Perez-Lezaun, A., & Feldman, M. W. (1999) · Molecular Biology and Evolution · doi:10.1093/oxfordjournals.molbev.a026091 · Cited by 1,080
Bayes and Empirical Bayes Methods for Data Analysis, Second Edition
Carlin, B., & Louis, T. (2000) · Chapman & Hall/CRC Texts in Statistical Science · doi:10.1201/9781420057669 · Cited by 959
Research works printed but not linked: 4
- Kingman, J. F. C. (1982) J. Appl. Prob. 19A, 27–43. [Google Scholar] · doi:10.2307/3213548 · Paper page
- Stephens, M. (2001) in Handbook of Statistical Genetics, eds. Balding, D. J., Bishop, M. J. & Cannings, C. (Wiley, New York), pp. 213–238.
- Plagnol, V. & Tavaré, S. (2004) in Proceedings of the 5th International Conference on Monte Carlo and Quasi-Monte Carlo Methods in Scientific Computing, ed. Niederreiter, H. (Springer, Heidelberg).
- Cabrera, J. & Yohai, V. J. (1999) A New Computational Approach for Bayesian and Robust Bayesian Statistical Analysis, www.rci.rutgers.edu/~cabrera/pap/vic.pdf, preprint.
Cited by
Items 201–300 of 1,000
Vo, B. N., Drovandi, C., Pettitt, A. N., & Simpson, M. J. (2015) · Mathematical Biosciences · doi:10.1016/j.mbs.2015.02.010 · Cited by 67
Inference for SDE Models via Approximate Bayesian Computation
Picchini, U. (2014) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.2013.866048 · Cited by 70
“We consider as a basic building block for the subsequent developments an ABCMCMC algorithm discussed in Sisson and Fan (2011) (there denoted “LF-MCMC”), which is a generalization of the algorithm proposed in Marjoram et al. (2003).”
MethodHarris, R. C., Sumner, T., Knight, G. M., Evans, T., Cárdenas, V., Chen, C., & White, R. G. (2019) · The Lancet Global Health · doi:10.1016/s2214-109x(18)30452-2 · Cited by 59
On the asymptotic efficiency of approximate Bayesian computation estimators
Li, W., & Fearnhead, P. (2018) · Biometrika · doi:10.1093/biomet/asx078 · Cited by 82
“cluding stereology [9], stochastic dierential equations [34] and nance [33]. The basic rejection scheme is limited due to the low acceptance probability when the posterior is far away from the prior [31] or the dimension of summary statistic is high [4]. Importance sampling can improve upon rejection sampling by propo…”
BackgroundBayesian Experimental Design for Models with Intractable Likelihoods
Drovandi, C., & Pettitt, A. N. (2013) · Biometrics · doi:10.1111/biom.12081 · Cited by 65
“Furthermore, the algorithm of Müller (1999) is difficult to use in high dimensions due to the increased complexity of sampling from the joint distribution of design, data and parameter.”
MethodInfluentialabctools: An R Package for Tuning Approximate Bayesian Computation Analyses
Matthew, A. N., & Prangle, D. (2015) · The R Journal · doi:10.32614/rj-2015-030 · Cited by 66
“For example, if one had written a function likefreemcmc to perform likelihood-free Markov chain Monte Carlo, one could use this in combination with a minimal criterion computed on the resulting (MCMC) posterior samples using the code: > mcmcabc - mincrit(obsstats, param, simstats, abcmethod = likefreemcmc) To use abct…”
MethodRodríguez, W., Mazet, O., Grusea, S., Arredondo, A., Corujo, J. M., Boitard, S., & Chikhi, L. (2018) · Heredity · doi:10.1038/s41437-018-0148-0 · Cited by 65
Bayesian Inference for the Spatio-Temporal Invasion of Alien Species
Cook, A. R., Marion, G., Butler, A., & Gibson, G. J. (2007) · Bulletin of Mathematical Biology · doi:10.1007/s11538-007-9202-4 · Cited by 66
“This computational complexity may potentially be overcome by adapting the technique of Approximate Bayesian Computation, which has previously been applied to problems in genetics by Marjoram et al. (2003) , Beaumont et al. (2002), Pritchard et al. (1999) and Tavare et al. (1997).”
MethodInterpreting scratch assays using pair density dynamics and approximate Bayesian computation
Johnston, S. T., Simpson, M. J., McElwain, D. L. S., Binder, B. J., & Ross, J. V. (2014) · Open Biology · doi:10.1098/rsob.140097 · Cited by 57
Jagiella, N., Rickert, D., Theis, F. J., & Hasenauer, J. (2017) · Cell Systems · doi:10.1016/j.cels.2016.12.002 · Cited by 70
Sharrock, L., Simons, J., Liu, S., & Beaumont, M. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2210.04872 · Cited by 76
“Traditional methods for performing SBI include approximate Bayesian computation (ABC) (Beaumont et al., 2002; Sisson et al., 2018), whose variants include rejection ABC (Tavar´e et al., 1997; Pritchard et al., 1999), MCMC ABC (Marjoram et al., 2003), and sequential Monte Carlo (SMC) ABC (Beaumont et al., 2009; Bonassi…”
MethodDemenou, B. B., Doucet, J., & Hardy, O. J. (2017) · Heredity · doi:10.1038/s41437-017-0035-0 · Cited by 64
“The most likely evolutionary scenario is identified as the one with the highest PP (Beaumont et al. 2002; Marjoram et al. 2003; Beaumont 2010).”
BackgroundNeural Approximate Sufficient Statistics for Implicit Models
Chen, Y., Zhang, D., Gutmann, M. U., Courville, A. C., & Zhu, Z. (2020) · ePrints Soton (University of Southampton) · doi:10.48550/arxiv.2010.10079 · Cited by 64
“Naive ABC performs simulation with the prior, whereas advanced variants like MCMC-ABC (Marjoram et al., 2003; Meeds et al., 2015) and SMC-ABC (Beaumont et al., 2009; Sisson et al., 2007) perform simulation with informed proposals.”
MethodLikelihood-free Bayesian inference for -stable models
Peters, G. W., Sisson, S. A., & Fan, Y. (2010) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2010.10.004 · Cited by 66
The Effect of Gene Flow on the Coalescent Time in the Human-Chimpanzee Ancestral Population
Innan, H., & Watanabe, H. (2006) · Molecular Biology and Evolution · doi:10.1093/molbev/msj109 · Cited by 61
Abdessalem, A. B., Dervilis, N., Wagg, D., & Worden, K. (2018) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2018.12.048 · Cited by 58
“[34]), which has proven to be more efficient than [33].”
BackgroundMethodApproximate Bayesian Computation and Bayes’ Linear Analysis: Toward High-Dimensional ABC
Nott, D. J., Fan, Y., Marshall, L. A., & Sisson, S. A. (2014) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.2012.751874 · Cited by 65
“The form of (1) allows sampler-based ABC algorithms (e.g., Marjoram et al. 2003; Bortot, Coles, and Sisson 2007; Sisson, Fan, and Tanaka 2007; Beaumont et al. 2009; Toni et al. 2009; Drovandi and Pettitt 2011) to sample from p(θ, s∗|s) without direct evaluation of the likelihood.”
MethodPopulation divergence with or without admixture: selecting models using an ABC approach
Sousa, V. C., Beaumont, M., Fernandes, P., Coelho, M. M., & Chikhi, L. (2011) · Heredity · doi:10.1038/hdy.2011.116 · Cited by 59
“ABC methods are very flexible as they can be applied to demographic models for which there are no explicit likelihood functions (Marjoram and Tavaré, 2006).”
MethodFuture requirements for and supply of ophthalmologists for an aging population in Singapore
Ansah, J. P., de Korne, D. F., Bayer, S., Pan, C., Jayabaskar, T., Matchar, D. B., Lew, N., Phua, A., Koh, V., Lamoureux, E. L., et al. (2015) · Human Resources for Health · doi:10.1186/s12960-015-0085-4 · Cited by 54
“Using MCMC, accepted points (after the optimal burn-in period) from the MCMC calibration were used as input to the sensitivity runs so as to explore the response of variables of interest in the model subject to the posterior probabilities from the calibration.”
MethodInfluentialLikelihood-free MCMC with Amortized Approximate Ratio EstimatorsPreprint
Hermans, J., Begy, V., & Louppe, G. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.04057 · Cited by 125
“In recent years variants of ABC have been proposed to improve the acceptance rate by guiding simulations based on previously accepted states [20, 33, 34, 35].”
BackgroundMethodSadegh, M., Vrugt, J. A., Xu, C., & Volpi, E. (2015) · Water Resources Research · doi:10.1002/2014wr016805 · Cited by 56
“…vector h should be a sample of the posterior distribution if the distance between observed and simulated summary metrics, qðSðYðh ÞÞ; Sð~YÞÞ of the data ~Y, is less than some nominal positive threshold, [Beaumont et al., 2002; Marjoram et al., 2003; Sisson et al., 2007; Del Moral et al., 2012].”
BackgroundA Structural Model of Homophily and Clustering in Social Networks
Mele, A. (2017) · Journal of Business and Economic Statistics · doi:10.1080/07350015.2021.1930013 · Cited by 58
“34An alternative to assumptions 1-3 is to use the spatial GMM (Conley (1999), Conley and Topa (2007)) or the Approximate Bayesian Computation (ABC) that do not require to know the likelihood in closed-form (Marjoram et al. (2003), König (2016)). 35See also Mele and Zhu (2017), Butts (2009), Badev (2013), Hsieh and Lee…”
BackgroundMethodInfluentialConstructing Summary Statistics for Approximate Bayesian Computation: Semi-automatic ABCPreprint
Fearnhead, P., & Prangle, D. (2010) · arXiv (Cornell University) · doi:10.48550/arxiv.1004.1112 · Cited by 64
“The integral comes from averaging over the current and proposed values for the MCMC algorithm, with the average acceptance probability for a given proposed value θ ′ being p ( θ ′ | s obs ).”
MethodInfluentialPiou, C., Berger, U., & Grimm, V. (2009) · Ecological Modelling · doi:10.1016/j.ecolmodel.2009.05.003 · Cited by 59
Establishing some order amongst exact approximations of MCMCs
Andrieu, C., & Vihola, M. (2016) · The Annals of Applied Probability · doi:10.1214/15-aap1158 · Cited by 64
“polis-Hastings [5] and has proved useful in the context of inference in phylogenetic trees. Other important instances of pseudo-marginal algorithms include approximate Bayesian computation (ABC) MCMC [33] (see also Section 6.2), the particle marginal MH [4] and algorithms for inference in diffusions [8]. Note that Algo…”
MethodInfluentialSilk, D., Filippi, S., & Stumpf, M. P. H. (2013) · Statistical Applications in Genetics and Molecular Biology · doi:10.1515/sagmb-2012-0043 · Cited by 51
“, 2007; Blum and Françcois, 2010), Markov chain Monte Carlo ABC schemes (Marjoram and Molitor, 2003; Ratmann et al., 2007), and ABC implementing variants of sequential importance sampling (SIS) or sequential Monte Carlo (SMC) (Sisson et al.”
BackgroundMethodQuantifying the effect of experimental design choices for in vitro scratch assays
Johnston, S. T., Ross, J. V., Binder, B. J., McElwain, D. L. S., Haridas, P., & Simpson, M. J. (2016) · Journal of Theoretical Biology · doi:10.1016/j.jtbi.2016.04.012 · Cited by 54
Efficient Acquisition Rules for Model-Based Approximate Bayesian Computation
Järvenpää, M., Gutmann, M. U., Pleska, A., Vehtari, A., & Marttinen, P. (2018) · Bayesian Analysis · doi:10.1214/18-ba1121 · Cited by 85
“Using the law of total expectation yields where the grid points and the corresponding weights are φ i and ω i , respectively, and where a ( θ , (cid:7) If Monte Carlo sampling is used, then ω i = 1 /s for all i = 1 , . . . , s , where s is the number of samples.”
MethodInfluentialMonte Carlo profile confidence intervals for dynamic systems
Ionides, E. L., Bretó, C., Park, J. H., Smith, R. A., & King, A. A. (2017) · Journal of The Royal Society Interface · doi:10.1098/rsif.2017.0126 · Cited by 51
“Another approach is to combine MCMC computations on subsets of the data, as in the posterior interval estimation (PIE) method of Li et al. [43].”
MethodInfluentialEmulating a Gravity Model to Infer the Spatiotemporal Dynamics of an Infectious Disease
Jandarov, R., Haran, M., Bjørnstad, O. N., & Grenfell, B. T. (2013) · Journal of the Royal Statistical Society Series C (Applied Statistics) · doi:10.1111/rssc.12042 · Cited by 65
“We note that the computational cost of forward simulations for our model makes approaches based on approximate Bayesian computation (ABC) (cf. Beaumont et al., 2002; Marjoram et al., 2003; Pritchard et al., 1999) infeasible.”
MethodExtending approximate Bayesian computation methods to high dimensions via a Gaussian copula model
Li, J., Nott, D. J., Fan, Y., & Sisson, S. A. (2016) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2016.07.005 · Cited by 60
Kwon, D., & Reis, I. M. (2015) · BMC Medical Research Methodology · doi:10.1186/s12874-015-0055-5 · Cited by 49
“[7]) and sequential Monte Carlo (ABC-SMC; Toni et al.”
Inferences about the transmission of Schmallenberg virus within and between farms
Gubbins, S., Turner, J., Baylis, M., der Stede, Y. V., Schaik, G. V., Abrahantes, J. C., & Wilson, A. J. (2014) · Preventive Veterinary Medicine · doi:10.1016/j.prevetmed.2014.04.011 · Cited by 49
“In the present study we have used approximate Bayesian computation (Marjoram et al., 2003; Toni et al., 2009; Sunnaker et al., 2013) to estimate epidemiological parameters for SBV.”
MethodTradeoffs between the strength of conformity and number of conformists in variable environments
Kandler, A., & Laland, K. N. (2013) · Journal of Theoretical Biology · doi:10.1016/j.jtbi.2013.04.023 · Cited by 52
“unknown parameters if the likelihood function is either impossible or computationally prohibitive to obtain [22].”
Computing Bayes: From Then ‘Til Now
Martin, G. M., Frazier, D. T., & Robert, C. P. (2023) · Statistical Science · doi:10.1214/22-sts876 · Cited by 60
Spatial mutation patterns as markers of early colorectal tumor cell mobility
Ryser, M. D., Min, B., Siegmund, K. D., & Shibata, D. K. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1716552115 · Cited by 48
“First, we fit the model to multiregional sequencing data from 19 human colorectal tumor specimens using approximate Bayesian computation (ABC).”
MethodRatmann, O., Donker, G., Meijer, A., Fraser, C., & Koelle, K. (2012) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002835 · Cited by 55
“[34] have converged, the magnitude of the summary errors can be used to diagnose goodness-of-fit with respect to each of the summaries Sk.”
A simple approach to maximum intractable likelihood estimation
Rubio, F. J., & Johansen, A. M. (2013) · Electronic Journal of Statistics · doi:10.1214/13-ejs819 · Cited by 55
“Although Marjoram et al. (2003) noted that “It [ABC] can also be used in frequentist applications, in particular for maximum-likelihood estimation” this idea does not seem to have been developed.”
BackgroundMethodThe ABC of reverse engineering biological signalling systems
Secrier, M., Toni, T., & Stumpf, M. P. H. (2009) · Molecular BioSystems · doi:10.1039/b908951a · Cited by 47
Breast Cancer Dormancy Can Be Maintained by Small Numbers of Micrometastases
Willis, L., Alarcón, T., Elia, G., Jones, J. L., Wright, N. A., Tomlinson, I. P. M., Graham, T. A., & Page, K. M. (2010) · Cancer Research · doi:10.1158/0008-5472.can-09-3144 · Cited by 49
Fukumizu, K., Song, L., & Gretton, A. (2011) · neural information processing systems · Cited by 54
Host shift and cospeciation rate estimation from co‐phylogenies
Alcala, N., Jenkins, T., Christe, P., & Vuilleumier, S. (2017) · Ecology Letters · doi:10.1111/ele.12799 · Cited by 50
Modeling epidemics: A primer and Numerus Model Builder implementation
Getz, W. M., Salter, R. M., Muellerklein, O., Yoon, H. S., & Tallam, K. (2018) · Epidemics · doi:10.1016/j.epidem.2018.06.001 · Cited by 54
Manifold learning for parameter reduction
Holiday, A., Kooshkbaghi, M., Bello‐Rivas, J. M., Gear, C. W., Zagaris, A., & Kevrekidis, I. G. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.04.015 · Cited by 54
“Our parameter set is the triplet p = (ε, σ, κ), with (s0, c0) = (1, 0) fixed as in the original experimental setting [16].”
BackgroundSukumaran, J., Economo, E. P., & Knowles, L. L. (2015) · Systematic Biology · doi:10.1093/sysbio/syv121 · Cited by 49
Brunetti, C., Linde, N., & Vrugt, J. A. (2017) · Advances in Water Resources · doi:10.1016/j.advwatres.2017.02.006 · Cited by 49
A Structural Model of Segregation in Social NetworksPreprint
Mele, A. (2010) · SSRN Electronic Journal · doi:10.2139/ssrn.1694387 · Cited by 46
Martínez, I., Wiegand, T., Camarero, J. J., Batllori, E., & Gutiérrez, E. (2011) · The American Naturalist · doi:10.1086/659623 · Cited by 52
Li, S., & Jakobsson, M. (2012) · BMC Genetics · doi:10.1186/1471-2156-13-22 · Cited by 49
“95% CI [499, 2,460] [1195, 4,227] [7,253, 9,884] [796, 3,402] [1,186, 4,390] [2,738, 6,790]”
BackgroundMethodInfluentialThe multiplicity distribution of Kepler’s exoplanets
Sandford, E., Kipping, D., & Collins, M. (2019) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stz2350 · Cited by 50
“A variety of sampling techniques are suitable for ABC inference (Beaumont 2019), and in this work we elect to use the Markov Chain Monte Carlo (MCMC) approach (Marjoram et al. 2003; Marin et al. 2012).”
MethodJanzen, T., Höhna, S., & Etienne, R. S. (2015) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.12350 · Cited by 49
“∞ , where N is the number of ABC-samples, the Approximate posterior distribution converges to the true posterior distribution (Marjoram et al. 2003), if the summary statistic is sufficient.”
BackgroundInferring Past Demography Using Spatially Explicit Population Genetic Models
Ray, N., & Excoffier, L. (2009) · Human Biology · doi:10.1353/hub.2009.a362932 · Cited by 54
Bayesian Spatial Modeling of Haplotype Associations
Thomas, D. C., Stram, D. O., Conti, D. V., Molitor, J., & Marjoram, P. (2003) · Human Heredity · doi:10.1159/000073730 · Cited by 51
Self-citationSaa, P., & Nielsen, L. K. (2015) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1004195 · Cited by 41
“There are other more efficient samplers implemented within the ABC setting to compute the parameters’ distributions [62,63]; however we opted for the simplest as a-proof-of-principle to demonstrate our strategy.”
MethodUse of pathway information in molecular epidemiology
Thomas, D. C., Conti, D. V., Baurley, J. W., Nijhout, H. F., Reed, M. C., & Ulrich, C. M. (2009) · Human Genomics · doi:10.1186/1479-7364-4-1-21 · Cited by 46
Data-Driven Modelling of Biological Multi-Scale Processes
Hasenauer, J., Jagiella, N., Hroß, S., & Theis, F. J. (2015) · Journal of Coupled Systems and Multiscale Dynamics · doi:10.1166/jcsmd.2015.1069 · Cited by 48
“.4 Approximate Bayesian Computing The evaluation of likelihood functions, the statistical distance of model and data, is for many models dicult. Therefore, likelihood-free methods have been proposed [158], also known as Approximate Bayesian Computing (ABC) methods. ABC methods circumvent the evaluation of the likeliho…”
MethodInfluentialApproximate Bayesian Computation by Subset Simulation using hierarchical state-space models
Vakilzadeh, M. K., Huang, Y., Beck, J. L., & Abrahamsson, T. J. S. (2016) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2016.02.024 · Cited by 47
A novel adaptive approximate Bayesian computation method for inverse heat conduction problem
Zeng, Y., Wang, H., Zhang, S., Cai, Y., & Li, E. (2019) · International Journal of Heat and Mass Transfer · doi:10.1016/j.ijheatmasstransfer.2019.01.002 · Cited by 47
The ABC of simulation estimation with auxiliary statistics
Forneron, J.-J., & Ng, S. (2018) · Journal of Econometrics · doi:10.1016/j.jeconom.2018.03.007 · Cited by 48
“The MCMC implementation of ABC proposed in Marjoram et al. (2003) is as follows.”
MethodRecombination and the Properties of Tajima's D in the Context of Approximate-Likelihood Calculation
Thornton, K. (2005) · Genetics · doi:10.1534/genetics.105.043786 · Cited by 46
Potential Benefits of Cattle Vaccination as a Supplementary Control for Bovine Tuberculosis
Conlan, A. J. K., Brooks‐Pollock, E., McKinley, T. J., Mitchell, A. P., Jones, G. J., Vordermeier, M. H., & Wood, J. L. N. (2015) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1004038 · Cited by 52
“ABC is a systematic framework for parameter inference when the likelihood function is intractable or computationally expensive [31].”
BackgroundThommes, E. W., Ismaila, A., Chit, A., Meier, G., & Bauch, C. T. (2015) · BMC Infectious Diseases · doi:10.1186/s12879-015-1193-4 · Cited by 43
“Model parameters were fit using an approximately Bayesian computation (ABC) parameter fitting scheme [29], similar to those used previously for fitting human Thommes et al.”
MethodReconstructing the demographic history of orang‐utans using Approximate B ayesian Computation
Nater, A., Greminger, M. P., Arora, N., van Schaik, C. P., Goossens, B., Singleton, I., Verschoor, E. J., Warren, K. S., & Krützen, M. (2015) · Molecular Ecology · doi:10.1111/mec.13027 · Cited by 48
“This restriction is mainly caused by the fact that the computation of the likelihood function of complex demographic models with many parameters is either intractable or computationally too expensive, especially for large data sets (Marjoram et al. 2003).”
Inference of the Properties of the Recombination Process from Whole Bacterial Genomes
Ansari, M. A., & Didelot, X. (2014) · Genetics · doi:10.1534/genetics.113.157172 · Cited by 45
“2010) and we have implemented and tested both ABC-MCMC (Marjoram et al., 2003) and ABC-SMC (Beaumont et al.”
MethodFakih, M. A., Chiachío, M., Chiachío, J., & Mustapha, S. (2022) · NDT & E International · doi:10.1016/j.ndteint.2022.102626 · Cited by 43
EVOLUTION OF INTRAHOST HIV - 1 GENETIC DIVERSITY DURING CHRONIC INFECTION
Shriner, D., Liu, Y., Nickle, D. C., & Mullins, J. I. (2006) · Evolution · doi:10.1554/05-473.1 · Cited by 49
Deviance Information Criteria for Model Selection in Approximate Bayesian Computation
François, O., & Laval, G. (2011) · Statistical Applications in Genetics and Molecular Biology · doi:10.2202/1544-6115.1678 · Cited by 47
Adversarial Variational Optimization of Non-Differentiable SimulatorsPreprint
Louppe, G., Hermans, J., & Cranmer, K. S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.07113 · Cited by 57
“The prevalence and significance of this problem has motivated an active research effort in so-called likelihood-free inference algorithms such as Approximate Bayesian Computation (ABC) and density estimation-by-comparison algorithms (Beaumont et al., 2002; Marjoram et al., 2003; Sisson et al., 2007; Sisson and Fan, 20…”
MethodLee, A., & ski, K. A. (2014) · Biometrika · doi:10.1093/biomet/asu027 · Cited by 42
Genomic signatures of environmental selection despite near‐panmixia in summer flounder
Hoey, J. A., & Pinsky, M. L. (2018) · Evolutionary Applications · doi:10.1111/eva.12676 · Cited by 49
Padrón, R. S., Gudmundsson, L., & Seneviratne, S. I. (2018) · Geophysical Research Letters · doi:10.1029/2018gl080521 · Cited by 42
“useMarkov ChainMonte Carlo (MCMC) to generate samples from a posterior distribution without knowing the likelihood function (Marjoram et al., 2003).”
MethodHazra, I., Pandey, M. D., & Manzana, N. (2020) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2019.106780 · Cited by 44
Gradient-free Hamiltonian Monte Carlo with Efficient Kernel Exponential FamiliesPreprint
Strathmann, H., Sejdinović, D., Livingstone, S., Szabó, Z., & Gretton, A. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.02564 · Cited by 42
“ABC-MCMC [5] targets an approximate posterior by constructing an unbiased Monte Carlo estimator of the approximate likelihood.”
MethodInfluentialKattwinkel, M., & Reichert, P. (2016) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2016.11.001 · Cited by 47
“…to deal with analytically intractable likelihoods: Approximate Bayesian Computation (ABC) techniques sample from the posterior by using approximate conditioning of simulations on the data (Albert et al., 2014; Beaumont, 2010; Csillery et al., 2010; Hartig et al., 2011; Marjoram et al., 2003).”
BackgroundMethodWeiss, A. J., Möstl, C., Amerstorfer, T., Bailey, R., Reiss, M. A., Hinterreiter, J., Amerstorfer, U., & Bauer, M. (2021) · The Astrophysical Journal Supplement Series · doi:10.3847/1538-4365/abc9bd · Cited by 43
“Various more sophisticated ABC 8 algorithms have been proposed such as those based on Markov chain Monte Carlo chains (MCMC, Marjoram et al. 2003) or particle filters (SMC, Sisson et al. 2007; Beaumont et al. 2008) (sequential Monte Carlo).”
MethodKoskinen, J. H., Caimo, A., & Lomi, A. (2015) · Network Science · doi:10.1017/nws.2015.3 · Cited by 45
“Here we propose to replace the acceptance probabilities in updating step (b) by the ABC-MCMC equivalent (Bortot et al. , 2007; Marjoram et al. , 2003) ii. generate x ∗ ( m ) from the LERGM defined by p ( ·| x ( m − 1) , θ ∗ ( m ) ) iii. if δ ( x ∗ ( m ) , x ( m ) ) (cid:2) m , accept θ ∗ ( m ) with…”
MethodAgent-Based Models and Microsimulation
Heard, D., Dent, G. L., Schifeling, T. A., & Banks, D. L. (2014) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-010814-020218 · Cited by 41
Palero, F., Lopes, J. S., Abelló, P., Macpherson, E., Pascual, M., & Beaumont, M. (2009) · BMC Evolutionary Biology · doi:10.1186/1471-2148-9-263 · Cited by 50
“Indeed, the likelihood function for complex demographic scenarios can be very difficult, and practically impossible, to solve analytically [47].”
BackgroundDevilbiss, D. M., Jenison, R. L., & Berridge, C. W. (2012) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002681 · Cited by 39
“To fit the conditional intensity function to PFC neuron discharge, a Poisson generalized linear model (GLM) framework was used [42– 44,55,88–92].”
MethodReconstructing signaling pathways from RNAi data using probabilistic Boolean threshold networks
Kaderali, L., Dazert, E., Zeuge, U., Frese, M., & Bartenschlager, R. F. W. (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp375 · Cited by 45
“This approximation of the likelihood can be combined with the Metropolis Hastings algorithm, compare Marjoram et al. (2003):”
MethodSpicknall, I. H., Mayer, K. H., Aral, S. O., & Romero-Severson, E. O. (2018) · Sexually Transmitted Diseases · doi:10.1097/olq.0000000000000953 · Cited by 40
“We fit the model using approximate Bayesian computation based on Markov chain Monte Carlo methods.(22) All parameters values were fixed to empirical values except the per act transmission probabilities, whichwere estimated.”
Physics‐constrained non‐Gaussian probabilistic learning on manifolds
Soize, C., & Ghanem, R. (2019) · International Journal for Numerical Methods in Engineering · doi:10.1002/nme.6202 · Cited by 42
“Bayesian updating (see for instance [1, 2, 3, 4, 5]) provides a rational framework for integrating data into predictive models and has been successfully adapted to situations where likelihoods are not readily available either because of expense or because of the nature of available information [6, 7].”
BackgroundAABC: Approximate approximate Bayesian computation for inference in population-genetic models
Buzbas, E. O., & Rosenberg, N. A. (2014) · Theoretical Population Biology · doi:10.1016/j.tpb.2014.09.002 · Cited by 47
“ABC methods have been based on rejection algorithms (Tavaré et al., 1997; Beaumont et al., 2002; Blum and François, 2010), Markov chain Monte Carlo (Beaumont, 2003; Marjoram et al., 2003; Wegmann et al., 2009), and sequential Monte Carlo (Sisson et al., 2007, 2009; Beaumont et al., 2009).”
InfluentialEstimating primate divergence times by using conditioned birth-and-death processes
Wilkinson, R., & Tavaré, S. (2009) · Theoretical Population Biology · doi:10.1016/j.tpb.2009.02.003 · Cited by 65
“This structure has been observed previously in size-biased trees, but under different types of conditioning (Chauvin et al., 1991; Lyons et al., 1995 ).”
BackgroundSelf-citationEstimating the Rate of Gene Conversion on Human Chromosome 21
Padhukasahasram, B., Marjoram, P., & Nordborg, M. (2004) · The American Journal of Human Genetics · doi:10.1086/423451 · Cited by 42
Self-citationLinkage Disequilibrium, Recombination and Haplotype Structure
McVean, G., & Kelleher, J. (2019) · Wiley eBooks · doi:10.1002/9781119487845.ch2 · Cited by 39
Auxiliary Likelihood-Based Approximate Bayesian Computation in State Space Models
Martin, G. M., McCabe, B. P. M., Frazier, D. T., Maneesoonthorn, W. O., & Robert, C. P. (2019) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.2018.1552154 · Cited by 49
“TARCH-N-ABC-MCMC 3.7154 5.4578 2.2127 18 13.”
BackgroundMethodInfluentialNormal and pathological dynamics of platelets in humans
Langlois, G. P., Craig, M., Humphries, A. R., Mackey, M. C., Mahaffy, J. M., Bélair, J., Moulin, T., Sinclair, S. R., & Wang, L. (2017) · Journal of Mathematical Biology · doi:10.1007/s00285-017-1125-6 · Cited by 39
“We chose to analyze data sets of untreated CT patients only , as treatments may have altered platelet and/or TPO dynamics and is thus outside the scope of this model We first introduce some notation before describing the fittin g procedure using the ABC-MCMC algorithm [47].”
MethodLeon, M., Woods, M. L., Fedorec, A. J. H., & Barnes, C. P. (2016) · BMC Systems Biology · doi:10.1186/s12918-016-0375-z · Cited by 42
“The method used here is based on sequential Monte Carlo, which avoids both issues faced by the rejection and MCMC methods.”
Methodda Rocha, H. L., Godet, I., Kurtoglu, F., Metzcar, J., Konstantinopoulos, K., Bhoyar, S., Gilkes, D. M., & Macklin, P. (2021) · iScience · doi:10.1016/j.isci.2021.102935 · Cited by 40
“By applying Bayesian inference with ABC methodology, in particular, the likelihood-free Markov chain Monte Carlo (LF-MCMC) method (Marjoram et al., 2003), we obtained the posterior distribution of ( b, s ) conditioned to the experimental data y o for the simulated displacement of the DsRed+ and…”
MethodAutomating approximate Bayesian computation by local linear regression
Thornton, K. (2009) · BMC Genetics · doi:10.1186/1471-2156-10-35 · Cited by 44
“The three Bayesian schemes described above are the simplest form of ABC, and the approach has been extended to use Markov Chain Monte Carlo techniques to explore the parameter space [13] and sequential Monte Carlo [14].”
MethodApproximate Bayesian Computation and MCMC
Plagnol, V., & Tavaré, S. (2004) · Springer eBooks · doi:10.1007/978-3-642-18743-8_5 · Cited by 48
“For reasons of space the description is kept brief; further details may be found in (6).”
BackgroundSelf-citationInference of Transmission Network Structure from HIV Phylogenetic Trees
Giardina, F., Romero-Severson, E. O., Albert, J., Britton, T., & Leitner, T. (2017) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1005316 · Cited by 45
Modified Hudson–Kreitman–Aguadé Test and Two-Dimensional Evaluation of Neutrality Tests
Innan, H. (2006) · Genetics · doi:10.1534/genetics.106.056242 · Cited by 42
“For step I, a rejection-sampling method (e.g., Tavaré et al. 1997; Pritchard et al. 1999; Beaumont et al. 2002; Marjoram et al. 2003) can be useful, which produces a sample from the posterior distribution of T conditional on rave.”
MethodConvergence of regression-adjusted approximate Bayesian computation
Li, W., & Fearnhead, P. (2018) · Biometrika · doi:10.1093/biomet/asx081 · Cited by 48
Development of a N asonia vitripennis outbred laboratory population for genetic analysis
van de Zande, L., Ferber, S., de Haan, A., Beukeboom, L. W., van Heerwaarden, J., & Pannebakker, B. A. (2013) · Molecular Ecology Resources · doi:10.1111/1755-0998.12201 · Cited by 38
“Empirical estimation of effective population size Weused approximate Bayesian computation (ABC, Tavare et al. 1997; Marjoram et al. 2003) to obtain estimates of the posterior distribution of realized Ne over the past 32 generations from the microsatellite data.”
MethodSloppiness and the Geometry of Parameter Space
Mannakee, B. K., Ragsdale, A. P., Transtrum, M. K., & Gutenkunst, R. N. (2015) · Studies in mechanobiology, tissue engineering and biomaterials · doi:10.1007/978-3-319-21296-8_11 · Cited by 40
“The information geometry perspective also suggests improved algorithms for optimization and Markov-chain Monte Carlo that account for the anisotropic and curved model and parameter spaces common in sloppy models.”
BackgroundEstimating Recombination Rates From Single-Nucleotide Polymorphisms Using Summary Statistics
Padhukasahasram, B., Wall, J. D., Marjoram, P., & Nordborg, M. (2006) · Genetics · doi:10.1534/genetics.106.060723 · Cited by 39
“Likelihood for a parameter value is approximated as the fraction of data sets (simulated at that value) that are accepted (for more details about rejection methods see Weiss and von Haeseler 1998 and Marjoram et al. 2003).”
BackgroundSelf-citationLikelihood-Free Bayesian Inference for α-Stable ModelsPreprint
Peters, G. W., Sisson, S. A., & Fan, Y. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.2980440 · Cited by 38
Ramsey, D. S. L., Forsyth, D. M., Veltman, C. J., Nicol, S., Todd, C. R., Allen, R. B., Allen, W. J., Bellingham, P. J., Richardson, S. J., Jacobson, C. L., et al. (2012) · Ecological Modelling · doi:10.1016/j.ecolmodel.2012.04.022 · Cited by 39
Metadata
- Authors
- Marjoram, P., Molitor, J., Plagnol, V., & Tavaré, S.
- Affiliations
- University of Southern California (US)
- Venue
- Proceedings of the National Academy of Sciences
- Publisher
- National Academy of Sciences
- Published
- 2003-12-08
- Volume
- 100
- Issue
- 26
- Pages
- 15324-15328
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- PMC
- PMC307566
- OpenAlex
- W2045973738
- Cited by
- 1,199
- References
- 20
- Citations by year
- 2026: 26 · 2025: 38 · 2024: 54 · 2023: 54 · 2022: 57 · 2021: 72 · 2020: 83 · 2019: 79 · 2018: 88 · 2017: 68 · 2016: 76 · 2015: 79 · 2014: 86 · 2013: 64 · 2012: 60
- FWCI
- 12.01
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Proceedings of the National Academy of Sciences (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Funders
- National Institutes of Health (5r01gm058897-03, GM58897)
- National Institute of General Medical Sciences (GM 58897)
- Division of Mathematical Sciences
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Markov Chains and Monte Carlo Methods
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic diversity and population structure
- Keywords
- Markov chain Monte Carlo, simulation-based inference, posterior sampling, maximum likelihood estimation, population genetics
- MeSH terms
- Algorithms, Computer Simulation, DNA, DNA, Mitochondrial, Biological Evolution, Genetics, Population, Humans, Markov Chains, Models, Biological, Monte Carlo Method, Stochastic Processes, Likelihood Functions
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.