Markov chain Monte Carlo without likelihoods
Open accessThe DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Abstract
Many stochastic simulation approaches for generating observations from a posterior distribution depend on knowing a likelihood function. However, for many complex probability models, such likelihoods are either impossible or computationally prohibitive to obtain. Here we present a Markov chain Monte Carlo method for generating observations from a posterior distribution without the use of likelihoods. It can also be used in frequentist applications, in particular for maximum-likelihood estimation. The approach is illustrated by an example of ancestral inference in population genetics. A number of open problems are highlighted in the discussion.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The greatest computational advantage of the original ABC rejection algorithm over Monte Carlo based ABC methods is that it generates independent samples and therefore readily lends itself to ‘embarrassingly’ parallel computation [86]. The computation time thus scales linearly to the number of processors available.”
From Integrating Crop Growth Models with Whole Genome Prediction through Approximate Bayesian Computation (2015) · cites this paper as [86]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“If ϵ is sufficiently small then this distribution will be a good approximation for the ‘true’ posterior distribution, P(θ|D0).”
From Simulation-based model selection for dynamical systems in systems and population biology (2010) · cites this paper as Marjoram et al., 2003
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Moreover, related ideas are already applied in the context of generalized linear mixed models [16], unobserved data points [17].”
From Likelihood based observability analysis and confidence intervals for predictions of dynamic models (2012) · cites this paper as [17]
Experimental — accuracy not yet measuredIn the citing paper
“The price to pay is the generation of dependent outcomes, and the risk of getting stuck in regions of low probability of the state space for long periods of time.”
From Reverse engineering and identification in systems biology: strategies, perspectives and challenges (2014) · cites this paper as [193]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Equation of State Calculations by Fast Computing Machines
Metropolis, N., Rosenbluth, A. W., Rosenbluth, M. N., Teller, A. H., & Teller, E. (1953) · The Journal of Chemical Physics · doi:10.1063/1.1699114 · Cited by 37,192
Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2003) · doi:10.1201/9780429258480 · Cited by 27,276
Monte Carlo sampling methods using Markov chains and their applications.
Hastings, W. K. (1970) · Biometrika · doi:10.1093/biomet/57.1.97 · Cited by 15,195
Markov Chain Monte Carlo in Practice
(1995) · Chapman & Hall/CRC eBooks · doi:10.1201/b14835 · Cited by 7,757
Approximate Bayesian computation in population genetics
Beaumont, M. A., Zhang, W., & Balding, D. J. (2002) · Genetics · doi:10.1093/genetics/162.4.2025 · Cited by 2,932
Ripley, B. D. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316726 · Cited by 2,241
Bayes and Empirical Bayes Methods for Data Analysis
(2001) · Technometrics · doi:10.1198/tech.2001.s608 · Cited by 2,098
On the genealogy of large populations
Kingmán, J. F. C. (1982) · Journal of Applied Probability · doi:10.1017/s0021900200034446 · Cited by 1,628
Population growth of human Y chromosomes: a study of Y chromosome microsatellites
Pritchard, J. K., Seielstad, M. T., Perez-Lezaun, A., & Feldman, M. W. (1999) · Molecular Biology and Evolution · doi:10.1093/oxfordjournals.molbev.a026091 · Cited by 1,080
Bayes and Empirical Bayes Methods for Data Analysis, Second Edition
Carlin, B., & Louis, T. (2000) · Chapman & Hall/CRC Texts in Statistical Science · doi:10.1201/9781420057669 · Cited by 959
Research works printed but not linked: 4
- Kingman, J. F. C. (1982) J. Appl. Prob. 19A, 27–43. [Google Scholar] · doi:10.2307/3213548 · Paper page
- Stephens, M. (2001) in Handbook of Statistical Genetics, eds. Balding, D. J., Bishop, M. J. & Cannings, C. (Wiley, New York), pp. 213–238.
- Plagnol, V. & Tavaré, S. (2004) in Proceedings of the 5th International Conference on Monte Carlo and Quasi-Monte Carlo Methods in Scientific Computing, ed. Niederreiter, H. (Springer, Heidelberg).
- Cabrera, J. & Yohai, V. J. (1999) A New Computational Approach for Bayesian and Robust Bayesian Statistical Analysis, www.rci.rutgers.edu/~cabrera/pap/vic.pdf, preprint.
Cited by
Items 501–600 of 1,000
A Bayesian framework for the analysis of systems biology models of the brain
Russell-Buckland, J., Barnes, C. P., & Tachtsidis, I. (2019) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1006631 · Cited by 16
“An approach based on MCMC is more efficient than ABC REJ but the chain may become stuck in regions of low probability for long periods of time [41].”
ABC-EP: expectation propagation for likelihood-free Bayesian computation
Barthelmé, S., & Chopin, N. (2011) · Cited by 15
Bayesian epidemiological modeling over high-resolution network data
Engblom, S., Eriksson, R., & Widgrén, S. (2020) · Epidemics · doi:10.1016/j.epidem.2020.100399 · Cited by 15
Loiola, B. R., Orlande, H. R. B., & Dulikravich, G. S. (2020) · International Journal of Thermal Sciences · doi:10.1016/j.ijthermalsci.2019.106243 · Cited by 15
Awine, T., & Silal, S. P. (2020) · Malaria Journal · doi:10.1186/s12936-020-03496-y · Cited by 16
Adaptive approximate Bayesian computation by subset simulation for structural model calibration
Barros, J., Chiachío, M., Chiachío, J., & Cabanilla, F. (2021) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12762 · Cited by 15
“However, there are situations where the likelihood function is unknown or analytically intractable, for which the ABC methods (Marjoram et al., 2003), also known as likelihood-free computation algorithms, provide an efficient alternative.”
BackgroundMethodA systematic analysis of climate model precipitation in southern Brazil
Pereima, M. F. R., Chaffe, P. L. B., de Amorim, P. B., & Rodrigues, R. R. (2021) · International Journal of Climatology · doi:10.1002/joc.7460 · Cited by 17
Pettitt, A. N., & Hincksman, C. (2012) · Wiley series in probability and statistics · doi:10.1002/9781118394472.ch2 · Cited by 15
Forward Simulation Markov Chain Monte Carlo with Applications to Stochastic Epidemic Models
Neal, P. J., & Huang, C. L. (2014) · Scandinavian Journal of Statistics · doi:10.1111/sjos.12111 · Cited by 15
“((Marjoram et al., 2003)), and grouped independence Metropolis–Hastings (GIMH), Beaumont ((Beaumont, 2003)), can similarly be obtained by allowing to be drawn from a proposal distribution depending upon the current value of and independent realizations of Y at each iteration.”
BackgroundMethodInfluentialAssessing Wastewater Micropollutant Loads with Approximate Bayesian Computations
Rieckermann, J., Anta, J., Scheidegger, A., & Ort, C. (2011) · Environmental Science & Technology · doi:10.1021/es1030432 · Cited by 15
Liechty, M. W., Liechty, J., & Müller, P. (2009) · Journal of Computational and Graphical Statistics · doi:10.1198/jcgs.2009.07072 · Cited by 15
“These approaches significantly extend the work of Marjoram et al. (2003) and Møller et al. (2006).”
MethodSlavković, A., Zhu, X., & Petrović, S. (2014) · Annals of the Institute of Statistical Mathematics · doi:10.1007/s10463-014-0471-z · Cited by 17
“These are linked to the general problem of inference in tables for which only partial information is available (e.g., see Dobra et al. 2006; Thibaudeau 2003; Marjoram et al. 2003).”
BackgroundDong, F., Zou, F., Lei, F., Liang, W., Li, S., & Yang, X. (2014) · Molecular Ecology · doi:10.1111/mec.12981 · Cited by 18
Price, D. J., Bean, N. G., Ross, J. V., & Tuke, J. (2016) · Journal of Statistical Planning and Inference · doi:10.1016/j.jspi.2015.12.008 · Cited by 20
“…of Müller (1999), Drovandi and Pettitt (2013) looked to avoid likelihood evaluations by using only model simulations to evaluate the posterior distribution, and thus the utility, using Approximate Bayesian Computation (ABC) methods (for an introduction to ABC methods, see Marjoram et al. (2003)).”
MethodVakilzadeh, M. K., Beck, J. L., & Abrahamsson, T. J. S. (2018) · SIAM Journal on Scientific Computing · doi:10.1137/16m1090466 · Cited by 18
Ansah, J. P., Koh, V., de Korne, D. F., Jayabaskar, T., Matchar, D. B., & Quek, D. T.-L. (2019) · Health Policy and Technology · doi:10.1016/j.hlpt.2019.08.004 · Cited by 16
Joyce, P., Abdo, Z., Ponciano, J. M., Gelder, L. D., Forney, L. J., & Top, E. M. (2004) · Journal of Mathematical Biology · doi:10.1007/s00285-004-0300-8 · Cited by 15
“(In fact, in the area of statistical genetics, where complex likelihood approaches are common, there is a growing body of literature [13],[2], that suggests that estimates based on simple summaries work as well as a full maximum likelihood approach, yet are more readily implementable in complex situations where full m…”
BackgroundAsymptotically exact inference in differentiable generative models
Graham, M. M., & Storkey, A. (2017) · Electronic Journal of Statistics · doi:10.1214/17-ejs1340si · Cited by 24
“Alternatively a MCMC scheme can be used to estimate the ABC posterior expectation in (3) [21].”
MethodA note on target distribution ambiguity of likelihood-free samplersPreprint
Sisson, S. A., Peters, G. W., Briers, M., & Fan, Y. (2010) · arXiv (Cornell University) · doi:10.48550/arxiv.1005.5201 · Cited by 16
“Marjoram et al. (2003) and Wegmann et al. (2009) (for S = 1) present variations on proofs of detailed balance under this assumption.”
BackgroundMethodInfluentialMarkov Chain Monte Carlo Methods, Survey with Some Frequent Misunderstandings
Robert, C. P., & Wu, C. (2021) · Wiley eBooks · doi:10.1002/9781118445112.stat08285 · Cited by 20
“For instance, the proposal distribution on θ can be modified towards increase the frequency of x’s within the vicinity of xobs (Bortot et al., 2007; Li and Fearnhead, 2018; Marjoram et al., 2003).”
BackgroundInfluentialNguyen, K., Jameson, C. D., Baldwin, S. A., Nardini, J. T., Smith, R. C., Haugh, J. M., & Flores, K. (2024) · Mathematical Biosciences · doi:10.1016/j.mbs.2024.109158 · Cited by 14
Uncertainty Quantification for Digital Twins in Smart Manufacturing and Robotics: A Review
Battula, S. S. K., Alla, S. N., Ramana, E. V., Namala, K. K., & Murthy, S. B. (2024) · Journal of Physics Conference Series · doi:10.1088/1742-6596/2837/1/012059 · Cited by 14
“Techniques such as Bootstrapping reduce noise in data [29] while Markov Chain Monte Carlo methods sample outputs of stochastic simulators, thus supporting probabilistic forecasting [30].”
A preferential attachment model for the stellar initial mass function
Cisewski-Kehe, J., Weller, G. B., & Schafer, C. (2019) · Electronic Journal of Statistics · doi:10.1214/19-ejs1556 · Cited by 14
“Hence, important adaptations of the basic ABC algorithm incorporate ideas of sequential sampling in order to improve the sampling efficiency (Marjoram et al., 2003; Sisson, Fan and Tanaka, 2007; Beaumont et al., 2009; Del Moral, Doucet and Jasra, 2011).”
Carr, M. J., Simpson, M. J., & Drovandi, C. (2021) · Journal of The Royal Society Interface · doi:10.1098/rsif.2021.0362 · Cited by 17
“In our application we found MCMC-ABC to take a considerable effort to tune the proposal distribution while still being computationally cumbersome.”
MethodInfluentialApproximate maximum likelihood estimation using data-cloning ABC
Picchini, U., & Anderson, R. (2016) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2016.08.006 · Cited by 14
“We present a methodology for approximate maximum likelihood estimation that uses approximate Bayesian computation (ABC, Tavar´e et al., 1997, Pritchard et al., 1999, Marjoram et al., 2003).”
MethodGalvañ, A., Boughalleb-M’Hamdi, N., Benfradj, N., Mannai, S., Lázaro, E., & Civera, A. V. (2022) · Scientific Reports · doi:10.1038/s41598-022-22775-z · Cited by 14
Koblents, E., Míguez, J., Rodríguez, M. A., & Schmidt, A. M. (2015) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2015.09.007 · Cited by 14
“The MCMC and ABC approaches can be combined into MCMCABC methods [17], that explore the parameter space iteratively using Markov chains with the desired stationary distribution.”
MethodMCMC in the Analysis of Genetic Data on Related Individuals
Thompson, E. A. (2011) · Chapman & Hall/CRC eBooks · doi:10.1201/b10905-14 · Cited by 14
Bayesian parameter estimation for the Wnt pathway: an infinite mixture models approach
Koutroumpas, K., Ballarini, P., Votsi, I., & Cournède, P.-H. (2016) · Bioinformatics · doi:10.1093/bioinformatics/btw471 · Cited by 15
“Marjoram et al. (2003) proposed an ABC method based on Markov Chain Monte Carlo (ABC–MCMC) to overcome the low acceptance rate problem.”
BackgroundMethodLikelihood-free nested sampling for parameter inference of biochemical reaction networks
Mikelson, J., & Khammash, M. (2020) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1008264 · Cited by 14
Bayesian model selection for high-dimensional Ising models, with applications to educational data
Park, J., Jin, I. H., & Schweinberger, M. (2021) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2021.107325 · Cited by 15
“More sophisticated versions of ABC exist (e.g., Marjoram et al., 2003; Sisson et al., 2007; Toni et al., 2009; Marin et al., 2012; Yin and Butts, 2020).”
Sandoval‐Castellanos, E., Palkopoulou, E., & Dalén, L. (2014) · PLoS ONE · doi:10.1371/journal.pone.0098011 · Cited by 15
“al [14] and performs a pre-run of 10,000 simulations to estimate a threshold that accepts 1% of the simulations and then use that threshold to reject on-the-go the simulations with probability equivalent to the ratio of the transition kernel evaluated in the”
BackgroundMethodInfluentialBayesian analysis for exponential random graph models using the adaptive exchange sampler
Jin, I. H., Liang, F., & Yuan, Y. (2013) · Statistics and Its Interface · doi:10.4310/sii.2013.v6.n4.a13 · Cited by 15
“To address the model degeneracy problem, we propose to use the approximate Bayesian computation (ABC) algorithm ([5], [33]) to select some auxiliary parameter points on which the auxiliary Markov chain is running.”
MethodHierarchical Nonlinear Spatio-temporal Agent-Based Models for Collective Animal Movement
McDermott, P. L., Wikle, C. K., & Millspaugh, J. J. (2017) · Journal of Agricultural Biological and Environmental Statistics · doi:10.1007/s13253-017-0289-2 · Cited by 14
“The methodology developed here, in part, utilizes the ABC–MCMC method first introduced in Marjoram et al. (2003).”
MethodA comparison of emulation methods for Approximate Bayesian ComputationPreprint
Jabot, F., Lagarrigues, G., Courbaud, B., & Dumoulin, N. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.7560 · Cited by 14
Interrogating theoretical models of neural computation with emergent property inferencePreprint
Bittner, S. R., Palmigiano, A., Piet, A. T., Duan, C. A., Brody, C. D., Miller, K. D., & Cunningham, J. P. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/837567 · Cited by 18
Modelling Extremes Using Approximate Bayesian Computation
Erhardt, R. J., & Sisson, S. A. (2016) · Chapman & Hall/CRC eBooks · doi:10.1201/b19721-18 · Cited by 18
Wang, X., Zeng, Y., Wang, H., Cai, Y., Li, E., & Li, G. (2022) · Structural and Multidisciplinary Optimization · doi:10.1007/s00158-022-03185-1 · Cited by 14
“However, for many complex probability models, the likelihood function is either intractable or not available even in a closed-form (Marjoram et al.”
BackgroundMethodInfluentialDynamic calibration with approximate Bayesian computation for a microsimulation of disease spread
Asher, M., Lomax, N., Morrissey, K., Spooner, F. E. B., & Malleson, N. (2023) · Scientific Reports · doi:10.1038/s41598-023-35580-z · Cited by 13
“ABC is a form of Bayesian inference, initially defined and applied in the biological sciences 40–43 .”
BackgroundAnalyzing allele specific RNA expression using mixture models
Lü, R., Smith, R. M., Seweryn, M. T., Wang, D., Hartmann, K., Webb, A., Sadée, W., & Rempała, G. A. (2015) · BMC Genomics · doi:10.1186/s12864-015-1749-0 · Cited by 17
“For fitting the folded Skellam, we used a likelihood-free Markov chain Monte Carlo (MCMC) method [36], which can be also viewed as an Approximate Bayesian Computation (ABC) type of method [37].”
MethodInferring the photometric and size evolution of galaxies from image simulations
Carassou, S., de Lapparent, V., Bertin, E., & Borgne, D. L. (2017) · Springer Link (Chiba Institute of Technology) · doi:10.1051/0004-6361/201730587/pdf · Cited by 13
Cohesion and Repulsion in Bayesian Distance Clustering
Natarajan, A., Iorio, M. D., Heinecke, A., Mayer, E., & Glenn, S. (2023) · Journal of the American Statistical Association · doi:10.1080/01621459.2023.2191821 · Cited by 28
“Both these ideas underlie approximate Bayesian computation (Marjoram et al., 2003).”
BackgroundEngebretsen, S., Rø, G., & de Blasio, B. F. (2022) · BMC Medical Research Methodology · doi:10.1186/s12874-022-01565-1 · Cited by 13
“2 Estimating from the data-generation-model using ABC We investigate whether a simple rejection Markov Chain Monte Carlo approximate Bayesian computation algorithm (ABC-MCMC) [2] can estimate the true effect of ethnicity in the case 3 setting with four sub-groups and a = 1.”
InfluentialGuided Sequential ABC Schemes for Intractable Bayesian Models
Picchini, U., & Tamborrino, M. (2024) · Bayesian Analysis · doi:10.1214/24-ba1451 · Cited by 20
“The most important alternative samplers are Markov chain Monte Carlo (MCMC) ABC (Marjoram et al., 2003; Sisson and Fan, 2011) and sequential Monte Carlo ABC (SMC-ABC, Sisson et al.”
Agrawal, A. K., Tamsen, E., Unger, J. F., & Koutsourelakis, P. (2024) · Data-Centric Engineering · doi:10.1017/dce.2024.18 · Cited by 15
“This lack of dif-ferentiability has been recognized as a significant roadblock by several researchers in recent years (Cranmer et al, 2020; Louppe et al, 2019; Beau-mont et al, 2002; Marjoram et al, 2003; Agrawal and Koutsourelakis, 2023; Shirobokov et al, 2020; Lucor et al, 2022).”
Lee, X. J., Drovandi, C., & Pettitt, A. N. (2014) · Biometrics · doi:10.1111/biom.12249 · Cited by 15
Approximation Bayesian computation
Marjoram, P. (2013) · OA Genetics · doi:10.13172/2054-197x-1-1-853 · Cited by 18
Self-citationExamining Ontario's universal influenza immunization program with a multi-strain dynamic model
Thommes, E. W., Chit, A., Meier, G., & Bauch, C. T. (2014) · Vaccine · doi:10.1016/j.vaccine.2014.06.005 · Cited by 13
“We adopted an approximate Bayesian computation (ABC) scheme [8] analogous to one used previously for fitting human papillomavirus models [13,14]:”
BackgroundMethodInfluentialApproximate Inference for Observation-Driven Time Series Models with Intractable Likelihoods
Jasra, A., Kantas, N., & Ehrlich, E. (2014) · ACM Transactions on Modeling and Computer Simulation · doi:10.1145/2592254 · Cited by 13
“Due to the nature of the ABC approximation it is easily seen that vanilla MCMC algorithms such as [16] will have an acceptance probability that will fall at an exponential rate in n.”
Learning Functions and Approximate Bayesian Computation Design: ABCD
Hainy, M., Müller, W. G., & Wynn, H. P. (2014) · Entropy · doi:10.3390/e16084353 · Cited by 15
“[28]) to obtain an approximate sample from π(θ|XD) that allows us to estimate the functional φ(π(θ|XD)).”
BackgroundApproximate Bayesian Computation for Source Term Estimation
Lane, R. O., Briers, M., & Copsey, K. D. (2009) · Cited by 13
A Function Emulation Approach for Doubly Intractable Distributions
Park, J., & Haran, M. (2019) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.2019.1629941 · Cited by 13
“ABC and its MCMC variant (Marjoram et al., 2003) are broadly applicable.”
Ross, R. J. H., Yates, C. A., & Baker, R. E. (2015) · Mathematical Biosciences · doi:10.1016/j.mbs.2015.04.002 · Cited by 13
Inference on high-dimensional implicit dynamic models using a guided intermediate resampling filter
Park, J. H., & Ionides, E. L. (2020) · Statistics and Computing · doi:10.1007/s11222-020-09957-3 · Cited by 13
Sequentially Guided MCMC Proposals for Synthetic Likelihoods and Correlated Synthetic Likelihoods
Picchini, U., Simola, U., & Corander, J. (2022) · Bayesian Analysis · doi:10.1214/22-ba1305 · Cited by 13
The cultural correlates of learning poverty: The roles of long-term orientation and power distance
King, R. B., Li, J., & Leung, S. O. (2023) · International Journal of Intercultural Relations · doi:10.1016/j.ijintrel.2023.101816 · Cited by 14
Foley, B. R., Saltz, J. B., Nuzhdin, S. V., & Marjoram, P. (2015) · The American Naturalist · doi:10.1086/681084 · Cited by 13
Self-citationAeschbacher, S., Futschik, A., & Beaumont, M. (2013) · Molecular Ecology · doi:10.1111/mec.12165 · Cited by 14
“In ABC, the data are usually compressed to summary statistics to increase the acceptance rate (Pritchard et al. 1999; Marjoram et al. 2003; Sisson et al. 2007).”
MethodOnline BayesSim for Combined Simulator Parameter Inference and Policy Improvement
Possas, R., Barcelos, L., Oliveira, R., Fox, D., & Ramos, F. T. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341401 · Cited by 13
“Improvements over this method such as Rejection ABC [12], Markov Chain Monte Carlo ABC (MCMC-ABC) [13], Sequential Monte Carlo ABC (SMC-ABC) [14] and finally the -free approach [15] have enabled Bayesian inference on a wide range of problems.”
Experiments with the Site Frequency Spectrum
Sainudiin, R., Thornton, K., Harlow, J., Booth, J. G., Stillman, M., Yoshida, R., Griffiths, R., McVean, G., & Donnelly, P. (2010) · Bulletin of Mathematical Biology · doi:10.1007/s11538-010-9605-5 · Cited by 13
“2002) or (2) making use of local Monte Carlo samplers (Marjoram et al. 2003) or (3) finding the right sequence of ε’s under the appropriate metric m (Sisson et al.”
Transport maps for accelerated Bayesian computation
Parno, M. D. (2015) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 27
Model choice versus model criticism
Robert, C. P., Mengersen, K. L., & Chen, C. C. M. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0911260107 · Cited by 13
Statistical methods to identify mechanisms in studies of eco-evolutionary dynamics
Pantel, J. H., & Becks, L. (2023) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2023.03.011 · Cited by 14
Wang, X., Jiang, X., Wang, H., & Li, G. (2024) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-024-02343-0 · Cited by 12
“To improve the efficiency, Marjoram et al. (2003) proposed a novel ABC variant based on the Markov Chain Monte Carlo framework that involved the likelihood-free simulation approach.”
Taking error into account when fitting models using Approximate Bayesian Computation
van der Vaart, E., Prangle, D., & Sibly, R. M. (2017) · Ecological Applications · doi:10.1002/eap.1656 · Cited by 14
“These include techniques for ‘correcting’ accepted parameter values on the basis of the resulting model fit, for example using regression (Beaumont et al. 2002), by estimating the error simultaneously with a model’s parameters, as in ABC 𝜇 (Ratmann et al. 2009), by analysing time series data sequentially (Jasra 2015),…”
Bayesian inference of root architectural model parameters from synthetic field data
Morandage, S., Laloy, E., Schnepf, A., Vereecken, H., & Vanderborght, J. (2021) · Plant and Soil · doi:10.1007/s11104-021-05026-4 · Cited by 12
“Such averaging of the log-likelihood falls within the so-called likelihood ratio approximation method (Diggle and Graton 1984) which in a probabilistic setting is a form of ABC (Marjoram et al.”
MethodInfluentialEnsemble Kalman inversion for general likelihoods
Duffield, S., & Singh, S. S. (2022) · Statistics & Probability Letters · doi:10.1016/j.spl.2022.109523 · Cited by 12
“With ABC, we have the further restriction that the likelihood function cannot be evaluated pointwise and therefore the likelihood is said to be intractable - this rules out classical techniques such as Markov chain Monte Carlo (MCMC) or importance sampling.”
MethodInfluentialBayesian approach for validation of runaway electron simulations
Järvinen, A., Fülöp, T., Hirvijoki, E., Hoppe, M., Kit, A., Åström, J. A., & Contributors, J. (2022) · Journal of Plasma Physics · doi:10.1017/s0022377822001210 · Cited by 12
“For completeness, MCMC sampling was conducted for the approximate posterior and the resulting distributions for T e and ln( τ wall ) show the global optimum, also visible in (Fig.”
InfluentialNayek, R., Abdessalem, A. B., Dervilis, N., Cross, E. J., & Worden, K. (2023) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2023.110300 · Cited by 12
Kutsukake, N., & Innan, H. (2014) · Springer eBooks · doi:10.1007/978-3-662-43550-2_17 · Cited by 12
Adaptive ABC model choice and geometric summary statistics for hidden Gibbs random fields
Stoehr, J., Pudlo, P., & Cucala, L. (2014) · Statistics and Computing · doi:10.1007/s11222-014-9514-9 · Cited by 15
“total number of simulations via the recourse to Markov chain Monte Carlo (Marjoram et al. 2003) or sequential Monte Carlo methods (Beaumont et al.”
MethodInfluentialKiani, N. A., & Kaderali, L. (2014) · BMC Bioinformatics · doi:10.1186/1471-2105-15-250 · Cited by 12
Kim, K.-Y., Omori, R., & Ito, K. (2017) · Epidemics · doi:10.1016/j.epidem.2017.04.004 · Cited by 12
Stuart, R. M., Kerr, C. C., Haghparast‐Bidgoli, H., Estill, J. A. M., Grobicki, L., Barańczuk, Z., Prieto, L., Montañez, V., Reporter, I., Gray, R. T., et al. (2017) · PLoS ONE · doi:10.1371/journal.pone.0185077 · Cited by 12
“Uncertainty estimates were generated around the model projections using an Approximate Bayesian Computation (ABC) algorithm [30], with prior distributions defined over two types of parameters: HIV prevalence in each population in the year 2000, and a population-specific scalar that applies to the time-varying and data…”
MethodA Guide to General-Purpose ABC Software
Kousathanas, A., Duchen, P., & Wegmann, D. (2018) · Chapman & Hall/CRC eBooks · doi:10.1201/9781315117195-13 · Cited by 12
Knight, G. M., Zimic, M., Funk, S., Gilman, R. H., Friedland, J. S., & Grandjean, L. (2018) · Journal of The Royal Society Interface · doi:10.1098/rsif.2018.0025 · Cited by 13
“Model fitting Approximate Bayesian computation (ABC) was paired with Markov chain Monte Carlo (MCMC) methods to estimate the four unknown parameters [41].”
MethodRobust approximate Bayesian inference
Ruli, E., Sartori, N., & Ventura, L. (2019) · Journal of Statistical Planning and Inference · doi:10.1016/j.jspi.2019.05.006 · Cited by 12
Estimation of Flow-Accelerated Corrosion Rate in Nuclear Piping System
Hazra, I., Pandey, M. D., & Jyrkama, M. I. (2019) · Journal of Nuclear Engineering and Radiation Science · doi:10.1115/1.4044407 · Cited by 14
Topological approximate Bayesian computation for parameter inference of an angiogenesis model
Thorne, T., Kirk, P., & Harrington, H. A. (2022) · Bioinformatics · doi:10.1093/bioinformatics/btac118 · Cited by 14
Likelihood-free inference with deep Gaussian processes
Aushev, A., Pesonen, H., Heinonen, M., Corander, J., & Kaski, S. (2022) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2022.107529 · Cited by 13
Improving ABC for quantile distributions
McVinish, R. (2010) · Statistics and Computing · doi:10.1007/s11222-010-9209-9 · Cited by 13
“The feature that distinguishes the Mod-ABC algorithm from the ABC-MCMC algorithm of Marjoram et al. (2003) is the way new data are simulated.”
BackgroundMethodInfluentialTutorial on ABC rejection and ABC SMC for parameter estimation and model selectionPreprint
Toni, T., & Stumpf, M. P. H. (2009) · arXiv (Cornell University) · doi:10.48550/arxiv.0910.4472 · Cited by 15
“ABC rejection for parameter estimation [1, 2], 2.”
Chain Ladder Method: Bayesian Bootstrap Versus Classical BootstrapPreprint
Peters, G. W., Wüthrich, M. V., & Shevchenko, P. V. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.2980411 · Cited by 12
Ritto, T. G., Beregi, S., & Barton, D. A. W. (2023) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2023.110458 · Cited by 11
No Country for Old Frameworks? Vertex Models and Their Ongoing Reinvention to Study Tissue Dynamics
Briñas-Pascual, N., Cornwall-Scoones, J., O’Hanlon, D. P., Guerrero, P., & Perez‐Carrasco, R. (2024) · Biophysica · doi:10.3390/biophysica4040039 · Cited by 11
Pérez, D. D. L., Salazar-Galán, S., & Francés, F. (2025) · Water · doi:10.3390/w17202932 · Cited by 16
Estimating genealogies from linked marker data: a Bayesian approach
Gasbarra, D., Pirinen, M., Sillanpää, M. J., & Arjas, E. (2007) · BMC Bioinformatics · doi:10.1186/1471-2105-8-411 · Cited by 13
Efficient parametric inference for stochastic biological systems with measured variability
Johnston, I. G. (2014) · Statistical Applications in Genetics and Molecular Biology · doi:10.1515/sagmb-2013-0061 · Cited by 11
“A framework that has been shown to be more efficient involves embedding the ABC process in a Markov chain Monte Carlo (MCMC) framework [22].”
MethodMcKinley, T. J., Neal, P. J., Spencer, S. E. F., Conlan, A. J. K., & Tiley, L. S. (2019) · Bayesian Analysis · doi:10.1214/19-ba1174 · Cited by 13
“These latter approaches come under a generic suite of methods known as Approximate Bayesian Computation (ABC; e.g. Tavaré et al., 1997; Marjoram et al., 2003; Toni et al., 2009; McKinley et al., 2009, 2018), which aim to improve the efficiency of numerical estimation algorithms through both dimension reduction techniq…”
MethodInfluentialGhirotto, S., Vizzari, M. T., Tassi, F., Barbujani, G., & Benazzo, A. (2020) · Molecular Ecology Resources · doi:10.1111/1755-0998.13263 · Cited by 12
“In addition, there is no accepted standard as for the choice of the summary statistics describing both observed and simulated data, as recognized since the first formal introduction of ABC (Beaumont et al., 2002; Marjoram et al., 2003).”
BackgroundMultiscale Modeling in Systems Biology: Methods and Perspectives
Coulier, A. (2021) · Digital comprehensive summaries of Uppsala dissertations from the Faculty of Science and Technology · doi:10.33063/diva-442412 · Cited by 13
Approximate Bayesian Computation by Modelling Summary Statistics in a Quasi-likelihood Framework
Cabras, S., Castellanos, M. E., & Ruli, E. (2015) · Bayesian Analysis · doi:10.1214/14-ba921 · Cited by 11
“The ABC-MCMC algorithm, proposed in Marjoram et al. (2003), summarized in Algorithm 1, evaluates LN (θ) indirectly via the indicator function Iρ< , and uses the proposal density q(θ | θ(t−1)).”
BackgroundMethodInfluentialTurning Simulation into Estimation: Generalized Exchange Algorithms for Exponential Family Models
Marsman, M., Maris, G., Bechger, T. M., & Glas, C. A. W. (2017) · PLoS ONE · doi:10.1371/journal.pone.0169787 · Cited by 11
Evidence synthesis from aggregate recurrent event data for clinical trial design and analysis
Holzhauer, B., Wang, C., & Schmidli, H. (2017) · Statistics in Medicine · doi:10.1002/sim.7549 · Cited by 12
Xu, J., Koelle, S., Guttorp, P. M., Wu, C., Dunbar, C. E., Abkowitz, J. L., & Minin, V. N. (2019) · The Annals of Applied Statistics · doi:10.1214/19-aoas1272 · Cited by 13
“While such extensions are mathematically challenging, they are straightforward to simulate, and various forward simulation approaches or approximate methods such as approximate Bayesian computation (ABC) [Marjoram et al., 2003, Toni et al., 2009] may provide a viable alternative.”
MethodBayesian inference for a flexible class of bivariate beta distributions
Crackel, R. C., & Flegal, J. M. (2016) · Journal of Statistical Computation and Simulation · doi:10.1080/00949655.2016.1208202 · Cited by 11
“[15] proposed implementing the Metropolis–Hastings algorithm into the ABC algorithm (ABC-MH).”
MethodInfluentialAutomatic Variational ABCPreprint
Moreno, A., Adel, T., Meeds, E., Rehg, J. M., & Welling, M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.08549 · Cited by 15
“Sampling methods are widely used in the likelihood-free and ABC literature: rejection sampling [17], Markov Chain Monte Carlo (MCMC) via a modified Metropolis Hastings algorithm [9], and population-based sampling [2, 3, 16].”
MethodABC Learning of Hawkes Processes with Missing or Noisy Event TimesPreprint
Deutsch, I., & Ross, G. J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.09015 · Cited by 11
“ABC is a widely studied learning algorithm for Bayesian inference in models with intractable likelihood functions (Beaumont et al., 2002; Marjoram et al., 2003; Marin et al., 2012).”
BackgroundNing, N., & Ionides, E. L. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.10745 · Cited by 11
“…approaches that are applicable on implicitly defined models are said to possess the plug-and-play property (Bretó et al. (2009); He et al. (2010)), or alternatively called equation-free (Kevrekidis et al. (2004); Xiu et al. (2005)) or likelihoodfree (Marjoram et al. (2003); Sisson et al. (2007)).”
BackgroundEfficient learning in ABC algorithmsPreprint
Sedki, M., Pudlo, P., Marin, J., Robert, C. P., & Cornuet, J. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1210.1388 · Cited by 11
“(3), see Marjoram et al (2003).”
BackgroundMethodInfluential
Metadata
- Authors
- Marjoram, P., Molitor, J., Plagnol, V., & Tavaré, S.
- Affiliations
- University of Southern California (US)
- Venue
- Proceedings of the National Academy of Sciences
- Publisher
- National Academy of Sciences
- Published
- 2003-12-08
- Volume
- 100
- Issue
- 26
- Pages
- 15324-15328
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- PMC
- PMC307566
- OpenAlex
- W2045973738
- Cited by
- 1,199
- References
- 20
- Citations by year
- 2026: 26 · 2025: 38 · 2024: 54 · 2023: 54 · 2022: 57 · 2021: 72 · 2020: 83 · 2019: 79 · 2018: 88 · 2017: 68 · 2016: 76 · 2015: 79 · 2014: 86 · 2013: 64 · 2012: 60
- FWCI
- 12.01
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Proceedings of the National Academy of Sciences (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Funders
- National Institutes of Health (5r01gm058897-03, GM58897)
- National Institute of General Medical Sciences (GM 58897)
- Division of Mathematical Sciences
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Markov Chains and Monte Carlo Methods
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic diversity and population structure
- Keywords
- Markov chain Monte Carlo, simulation-based inference, posterior sampling, maximum likelihood estimation, population genetics
- MeSH terms
- Algorithms, Computer Simulation, DNA, DNA, Mitochondrial, Biological Evolution, Genetics, Population, Humans, Markov Chains, Models, Biological, Monte Carlo Method, Stochastic Processes, Likelihood Functions
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.