Approximate Bayesian computation (ABC) gives exact results under the assumption of model error
Open accessThe DOI matches its Crossref record; 40 of the 41 references it cites were found in a registry or an index.
Abstract
Approximate Bayesian computation (ABC) or likelihood-free inference algorithms are used to find approximations to posterior distributions without making explicit use of the likelihood function, depending instead on simulation of sample data sets from the model. In this paper we show that under the assumption of the existence of a uniform additive model error term, ABC algorithms give exact results when sufficient summaries are used. This interpretation allows the approximation made in many previous application papers to be understood, and should guide the choice of metric and tolerance in future work. ABC algorithms can be generalized by replacing the 0-1 cut-off with an acceptance probability that varies with the distance of the simulated data from the observed data. The acceptance density gives the distribution of the error term, enabling the uniform error usually used to be replaced by a general distribution. This generalization can also be applied to approximate Markov chain Monte Carlo algorithms. In light of this work, ABC algorithms can be seen as calibration techniques for implicit stochastic models, inferring parameter values in light of the computer model, data, prior beliefs about the parameter values, and any measurement or model errors.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The key strength of ABC approaches is that they can be applied to problems with intractable likelihoods35,36 (for example, complex stochastic models).”
From A framework for parameter estimation and model selection from experimental data in systems biology using approximate Bayesian computation (2014) · cites this paper as [35]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Kass, R. E., & Raftery, A. E. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476572 · Cited by 12,558
Approximate Bayesian computation in population genetics
Beaumont, M. A., Zhang, W., & Balding, D. J. (2002) · Genetics · doi:10.1093/genetics/162.4.2025 · Cited by 2,932
Monte Carlo Strategies in Scientific Computing
Liu, J. S. (2004) · Springer Series in Statistics · doi:10.1007/978-0-387-76371-2 · Cited by 2,690
Toni, T., Welch, D., Strelkowa, N., Ipsen, A., & Stumpf, M. P. H. (2009) · Journal of The Royal Society Interface · doi:10.1098/rsif.2008.0172 · Cited by 1,498
Monte Carlo Strategies in Scientific Computing
Hesterberg, T. (2002) · Technometrics · doi:10.1198/tech.2002.s85 · Cited by 1,409
Markov chain Monte Carlo without likelihoods
Marjoram, P., Molitor, J., Plagnol, V., & Tavaré, S. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0306899100 · Cited by 1,199
Population growth of human Y chromosomes: a study of Y chromosome microsatellites
Pritchard, J. K., Seielstad, M. T., Perez-Lezaun, A., & Feldman, M. W. (1999) · Molecular Biology and Evolution · doi:10.1093/oxfordjournals.molbev.a026091 · Cited by 1,080
Computer Model Calibration Using High-Dimensional Output
Higdon, D., Gattiker, J., Williams, B., & Rightley, M. (2008) · Journal of the American Statistical Association · doi:10.1198/016214507000000888 · Cited by 867
Sequential Monte Carlo without likelihoods
Sisson, S. A., Fan, Y., & Tanaka, M. M. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0607208104 · Cited by 856
Cornuet, J.-M., Santos, F., Beaumont, M. A., Robert, C. P., Marin, J.-M., Balding, D. J., Guillemaud, T., & Estoup, A. (2008) · Bioinformatics · doi:10.1093/bioinformatics/btn514 · Cited by 690
Research works printed but not linked: 33
- Wilkinson, 2007, Bayesian inference of primate divergence times Ph thesis University of
- Nunes, M. A., Balding, D. J., 2010. On optimal selection of summary statistics for approximate Bayesian computation. Stat. Appl. Genet. Mo. B. 9, Article 34. · DOI · Paper page
- Blum, M., Tran, V., 2010. HIV with contact tracing: a case study in approximate Bayesian computation. Biostatistics 11 (4), 644-660. · DOI
- Shibata, 2008, Siegmund Marjoram Modeling DNA methylation in apopulation of cancer cells article, Stat Appl Genet Mo B, 18
- Plagnol, 2004, Approximate Bayesian computation and In Proceedings of Monte Carlo and Quasi - Monte Carlo Verlag, Methods, 99
- Ratmann, 2007, Using likelihood - free inference to compare evolutionary dynamics of the protein networks ofH pyloriandP falciparum, Comput Biol, 2266
- Fearnhead, P., Prangle, D., 2012. Constructing summary statistics for approximate Bayesian computation: semi-automatic approximate Bayesian computation. J. Roy. Stat. Soc. Ser. B 74, 419-474. · DOI · Paper page
- Kennedy, M., O'Hagan, A., 2001. Bayesian calibration of computer models (with discussion). J. R. Statist. Soc. Ser. B 63, 425-464.
- Robert, C. P., Cornuet, J. M., Marin, J. M., Pillai, N. S., 2011. Lack of confidence in approximate Bayesian computation model choice. P. Natl. Acad. Sci. USA 108, 15112-15117.
- Toni, T., Welch, D., Strelkowa, N., Ipsen, A., Stumpf, M. P. H., 2009. Approximate Bayesian Computation scheme for parameter inference and model selection in dynamical systems. J. R. Soc. Interface 6 (31), 187-202. · DOI · Paper page
- Campbell, 2006, Statistical calibration of computer simulations, Eng Syst Safe, 1358, 10.1016/j.ress.2005.11.032 · DOI
- Sunnaker, M., Busetto, A. G., Numminen, E., Corander, J., Foll, M., Dessimoz, C., 2013. Approximate bayesian computation. PLoS Comput Biol 9, e1002803.
- Cornuet, 2008, Inferring population history with DIY ABC a user - friendly approach to approximate Bayesian computation, Bioinformatics, 24, 2713, 10.1093/bioinformatics/btn514 · DOI · Paper page
- Beaumont, 2002, Balding Approximate Bayesian computatation in population genetics, Genetics, 162
- Barnes, 2012, Considerate approaches to constructing summary statistics for ABC model selection, Stat Comput, 22, 1181, 10.1007/s11222-012-9335-7 · DOI · Paper page
- Murray, I., Ghahramani, Z., MacKay, D. J. C., 2006. MCMC for doublyintractable distributions. In: Proceedings of the 22nd Annual Conference on Uncertainty in Artificial Intelligence. UAI.
- Marjoram, P., Molitor, J., Plagnol, V ., Tavar´ e, S., 2003. Markov chain Monte Carlo without likelihoods. P. Natl. Acad. Sci. USA 100 (26), 15324-15328.
- Pritchard, J. K., Seielstad, M. T., Perez-Lezaun, A., Feldman, M. W., 1999. Population growth of human Y chromosomes: a study of Y chromosome microsatellites. Mol. Biol. Evol. 16 (12), 1791-1798. · DOI · Paper page
- Goldstein, 2009, Bayesian modelling and inference for physical systems, Stat Plan Infer, 139
- Sisson, S. A., Fan, Y., Tanaka, M. M., 2007. Sequential Monte Carlo without likelihoods. Proc. Natl. Acad. Sci. USA 104 (6), 1760-1765. · DOI · Paper page
- Wilkinson, R. D., 2007. Bayesian inference of primate divergence times. Ph.D. thesis, University of Cambridge.
- Higdon, 2008, model calibration using high - dimensional output, Computer Am Assoc, 103
- Peters, 2012, On sequential Monte Carlo partial rejection control and approximate Bayesian computation, Stat Comput, 22, 1209, 10.1007/s11222-012-9315-y · DOI · Paper page
- Hamilton, 2005, Bayesian estimation of recent migration rates after a spatial expansion, Genetics, 170
- Doucet, 2012, Del Moral An adaptive sequential Monte Carlo method for approximate Bayesian computation, Stat Comput, 22, 1009, 10.1007/s11222-011-9271-y · DOI · Paper page
- Foll, 2008, An approximate Bayesian computation approach to overcome biases that arise when using amplifed fragment length polymorphism markers to study population structure, Genetics, 179
- Kass, 1995, factors, Am Assoc, 773, 10.1080/01621459.1995.10476572 · DOI · Paper page
- Joyce, 2008, Marjoram Approximately sufficient Bayesian computation article, statistics Stat Appl Genet Mo B, 26
- Kennedy, 2001, Bayesian calibration of computer models with discussion, Statist, 425
- Tanaka, M. M., Francis, A. R., Luciani, F., Sisson, S. A., 2006. Using approximate Bayesian computation to estimate tuberculosis transmission parameters from genotype data. Genetics 173, 1511-1520.
- Beaumont, 2009, for ABC algorithms the ABC, Biometrika, 983, 10.1093/biomet/asp052 · DOI · Paper page
- Wilkinson, R. D., Tavar´ e, S., 2009. Estimating primate divergence times by using conditioned birth-and-death processes. Theor. Popul. Biol. 75, 278-285. · DOI
- Drovandi, 2011, Faddy Approximate Bayesian computation using indirect inference, Stat Soc, 317
Cited by
Approximate Bayesian computational methods
Marin, J.-M., Pudlo, P., Robert, C. P., & Ryder, R. J. (2012) · Statistics and Computing · doi:10.1007/s11222-011-9288-2 · Cited by 818
“Wilkinson (2008) makes the valuable point that if the model includes an error term, then taking the distribution of that error term to be K ε leads to an ABC algorithm which simulates exactly from the error-in-variables posterior.”
BackgroundInfluentialAnalyzing Inverse Problems with Invertible Neural Networks
Ardizzone, L., Kruse, J., Wirkert, S., Rahner, D., Pellegrini, E. W., Klessen, R. S., Maier‐Hein, L., Rother, C., & Köthe, U. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.04730 · Cited by 142
“Lastly, we also compare to Approximate Bayesian Computation (ABC), using the method presented in [46], which is summarized in the supplementary material.”
MethodApproximate Bayesian Computation
Sunnåker, M., Busetto, A. G., Numminen, E., Corander, J., Foll, M., & Dessimoz, C. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002803 · Cited by 623
“Finally, statistical inference using ABC with a non-zero tolerance e is not inherently flawed: under the assumption of measurement errors, the optimal e can in fact be shown to be not zero [25,28].”
MethodFearnhead, P., & Prangle, D. (2012) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2011.01010.x · Cited by 567
“A related idea was used by Wilkinson (2008) who showed that the ABC posterior is equivalent to the true posterior under an assumption of appropriate model error.”
MethodNon-linear regression models for Approximate Bayesian Computation
Blum, M. G. B., & François, O. (2010) · Statistics and Computing · doi:10.1007/s11222-009-9116-0 · Cited by 453
Statistical inference for stochastic simulation models - theory and application
Hartig, F., Calabrese, J. M., Reineking, B., Wiegand, T., & Huth, A. (2011) · Ecology Letters · doi:10.1111/j.1461-0248.2011.01640.x · Cited by 384
“In principle, however, it would also be possible to combine the likelihood approximations discussed in the previous sections with an external error model (see, e.g. Wilkinson 2008).”
BackgroundReliable ABC model choice via random forests
Pudlo, P., Marin, J.-M., Estoup, A., Cornuet, J.-M., Gautier, M., & Robert, C. P. (2016) · Bioinformatics · doi:10.1093/bioinformatics/btv684 · Cited by 384
Lack of confidence in approximate Bayesian computation model choice
Robert, C. P., Cornuet, J.-M., Marin, J.-M., & Pillai, N. S. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1102900108 · Cited by 317
A tutorial on approximate Bayesian computation
Turner, B. M., & Van Zandt, T. (2012) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2012.02.005 · Cited by 293
Gen: a general-purpose probabilistic programming system with programmable inference
Cusumano-Towner, M., Saad, F. A., Lew, A. K., & Mansinghka, V. K. (2019) · ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI) · doi:10.1145/3314221.3314642 · Cited by 242
“Many Bayesian statistical models used in the natural sciences are based on stochastic simulators that are not amenable to analytic inference approaches [65].”
BackgroundApproximate Bayesian Computation: A Nonparametric Perspective
Blum, M. G. B. (2010) · Journal of the American Statistical Association · doi:10.1198/jasa.2010.tm09448 · Cited by 239
Liepe, J., Kirk, P., Filippi, S., Toni, T., Barnes, C. P., & Stumpf, M. P. H. (2014) · Nature Protocols · doi:10.1038/nprot.2014.025 · Cited by 217
“The key strength of ABC approaches is that they can be applied to problems with intractable likelihoods 35,36 (for example, com plex stochastic models).”
BackgroundPicture: A probabilistic programming language for scene perception
Kulkarni, T. D., Kohli, P., Tenenbaum, J. B., & Mansinghka, V. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299068 · Cited by 133
“Comparator: During inference, I R and I D can be compared using a likelihood function or a distance metric λ (as in Approximate Bayesian Computation [44]).”
BackgroundMethodInfluentialBayesian computation: a summary of the current state, and samples backwards and forwards
Green, P. J., Łatuszyński, K., Pereyra, M., & Robert, C. P. (2015) · Statistics and Computing · doi:10.1007/s11222-015-9574-5 · Cited by 199
“It seems important to discuss ABC in this partial tour of Bayesian computational techniques as (a) they provide the only approach to their model for some Bayesians, (b) they deliver samples in the parameter space that are exact simulations from a posterior of some kind (Wilkinson 2013), πABC(θ |y0) if not the original…”
BackgroundMethodInfluentialApproximate Bayesian Computation
Beaumont, M. A. (2019) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-030718-105212 · Cited by 183
A generalized, likelihood-free method for posterior estimation
Turner, B. M., & Sederberg, P. B. (2013) · Psychonomic Bulletin & Review · doi:10.3758/s13423-013-0530-0 · Cited by 180
“Our method improves upon kernel-based ABC approaches (Turner & Sederberg, 2012; Wilkinson, 2008) and synthetic likelihood approaches (Wood, 2010) because it does not require the use of summary statistics.”
Model criticism based on likelihood-free inference, with an application to protein network evolution
Ratmann, O., Andrieu, C., Wiuf, C., & Richardson, S. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0807882106 · Cited by 139
Sisson, S. A., & Fan, Y. (2011) · Chapman & Hall/CRC eBooks · doi:10.1201/b10905-13 · Cited by 168
Robust Bayesian Inference via Coarsening
Miller, J. W., & Dunson, D. B. (2019) · Journal of the American Statistical Association · doi:10.1080/01621459.2018.1469995 · Cited by 159
“The c-posterior is mathematically equivalent to the type of posterior approximation resulting from approximate Bayesian computation (ABC) (Tavaré et al., 1997; Marjoram et al., 2003; Beaumont et al., 2002; Wilkinson, 2013)—indeed, ABC provided part of our inspiration for considering this form of posterior.”
MethodIdentifiability analysis for stochastic differential equation models in systems biology
Browning, A. P., Warne, D. J., Burrage, K., Baker, R. E., & Simpson, M. J. (2020) · Journal of The Royal Society Interface · doi:10.1098/rsif.2020.0652 · Cited by 143
“Techniques based on approximations, such as a linear-noise approximation [85] or approximate Bayesian computation [20,86–90], are available for SDEs but are, naturally, approximations.”
MethodCalibration and evaluation of individual-based models using Approximate Bayesian Computation
van der Vaart, E., Beaumont, M., Johnston, A. S. A., & Sibly, R. M. (2015) · Ecological Modelling · doi:10.1016/j.ecolmodel.2015.05.020 · Cited by 142
“The suggestion is that such errors be modelled in such a way that the extended model can in principle fit the empirical data perfectly (Ratmann et al., 2009; Wilkinson, 2013).”
BackgroundLikelihood-free estimation of model evidence
Didelot, X., Everitt, R. G., Johansen, A. M., & Lawson, D. J. (2011) · Bayesian Analysis · doi:10.1214/11-ba602 · Cited by 109
“It is interesting to note that the use of such an approximate kernel π † in the ABC Algorithm 2 can be interpreted as exact sampling under a model where uniform additive error terms exist (Wilkinson, 2008).”
New insights into Approximate Bayesian Computation
Biau, G., Cérou, F., & Guyader, A. (2015) · Annales de l Institut Henri Poincaré Probabilités et Statistiques · doi:10.1214/13-aihp590 · Cited by 132
“In fact, despite a growing number of practical applications, theoretical results guaranteeing the validity of the approach are still lacking (see [6,16,54], for results in this direction).”
BackgroundUsing synthetic data to train neural networks is model-based reasoning
Le, T., Baydin, A. G., Zinkov, R., & Wood, F. (2017) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2017.7966298 · Cited by 127
A Novel Approach for Choosing Summary Statistics in Approximate Bayesian Computation
Aeschbacher, S., Beaumont, M., & Futschik, A. (2012) · Genetics · doi:10.1534/genetics.112.143164 · Cited by 121
ABC likelihood-free methods for model choice in Gibbs random fields
Grelaud, A., Marin, J.-M., Robert, C. P., Rodolphe, F., & Taly, J.-F. (2009) · Bayesian Analysis · doi:10.1214/09-ba412 · Cited by 119
Warne, D. J., Baker, R. E., & Simpson, M. J. (2019) · Journal of The Royal Society Interface · doi:10.1098/rsif.2018.0943 · Cited by 83
“The discrepancy threshold determines the level of approximation, however, under the assumption of model and observation error, Equation (31) can be treated as exact [151].”
BackgroundExpectation Propagation for Likelihood-Free Inference
Barthelmé, S., & Chopin, N. (2014) · Journal of the American Statistical Association · doi:10.1080/01621459.2013.864178 · Cited by 104
“Wilkinson (2008) showed that a standard ABC posterior such as (1.1) can be interpreted as the posterior distribution of a new model, where the summary statistics are corrupted with a uniformly distributed noise (assuming these summary statistics are sufficient).”
BackgroundInfluentialPractical parameter identifiability for spatio-temporal models of cell invasion
Simpson, M. J., Baker, R. E., Vittadello, S. T., & Maclaren, O. J. (2020) · Journal of The Royal Society Interface · doi:10.1098/rsif.2020.0055 · Cited by 104
“[38] Wilkinson RD.”
BackgroundNeural Density Estimation and Likelihood-free InferencePreprint
Papamakarios, G. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.13233 · Cited by 102
Approximate Bayesian computation with differential evolution
Turner, B. M., & Sederberg, P. B. (2012) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2012.06.004 · Cited by 104
Approximate Bayesian Image Interpretation using Generative Probabilistic Graphics Programs
Mansinghka, V. K., Kulkarni, T. D., Perov, Y., & Tenenbaum, J. B. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1307.0060 · Cited by 49
“For example, in our text application, the Sis include binary indicators for the presence or absence of each glyph, along with its identity (“A“ through ”Z”, plus digits 0-9), and parameters including location,”
MethodMcKinley, T. J., Vernon, I., Andrianakis, I., McCreesh, N., Oakley, J. E., Nsubuga, R. N., Goldstein, M., & White, R. G. (2018) · Statistical Science · doi:10.1214/17-sts618 · Cited by 102
“Wilkinson [2013] cites two possibilites for the interpretation of the error term: observation error or model discrepancy.”
BackgroundRobust Neural Posterior Estimation and Statistical Model Criticism
Ward, D., Cannon, P. W., Beaumont, M., Fasiolo, M., & Schmon, S. M. (2022) · neural information processing systems · doi:10.52202/068431-2453 · Cited by 102
Analyzing Stochastic Computer Models: A Review with Opportunities
Baker, E., Barbillon, P., Fadikar, A., Gramacy, R. B., Herbei, R., Higdon, D., Huang, J., Johnson, L. R., Ma, P., Mondal, A., et al. (2022) · Statistical Science · doi:10.1214/21-sts822 · Cited by 98
“For calibration, τ can be interpreted as a bound on the observational error and model discrepancy, leading to a “correct” posterior rather than an approximation (Wilkinson, 2013).”
BackgroundParameter Estimation for Hidden Markov Models with Intractable Likelihoods
Dean, T. A., Singh, S. S., Jasra, A., & Peters, G. W. (2014) · Scandinavian Journal of Statistics · doi:10.1111/sjos.12077 · Cited by 91
“We note that our observations (5) and (6) are similar in spirit to those made in Wilkinson (2008).”
ResultVernon, I., Liu, J., Goldstein, M., Rowe, J. H., Topping, J., & Lindsey, K. (2018) · BMC Systems Biology · doi:10.1186/s12918-017-0484-3 · Cited by 94
“We have directly compared and contrasted the two approaches in [58], where we demonstrated that a powerful version of ABC failed to find any part of parameter space that matched the observed data for a 22-dimensional stochastic epidemiology model, while history matching found the correct part of input space and many g…”
MethodInfluentialSimulation-based Bayesian inference for epidemic models
McKinley, T. J., Ross, J. V., Deardon, R., & Cook, A. R. (2013) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2012.12.012 · Cited by 95
Sisson, S. A., Fan, Y., & Beaumont, M. (2018) · Chapman & Hall/CRC eBooks · doi:10.1201/9781315117195-1 · Cited by 99
An Integrated Computational Model of the Bone Microenvironment in Bone-Metastatic Prostate Cancer
Araujo, A., Cook, L. M., Lynch, C. C., & Basanta, D. (2014) · Cancer Research · doi:10.1158/0008-5472.can-13-2652 · Cited by 91
Bayesian design of synthetic biological systems
Barnes, C. P., Silk, D., Sheng, X., & Stumpf, M. P. H. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1017972108 · Cited by 90
Black-box Bayesian inference for agent-based models
Dyer, J., Cannon, P. W., Farmer, J. D., & Schmon, S. M. (2024) · Journal of Economic Dynamics and Control · doi:10.1016/j.jedc.2024.104827 · Cited by 92
“(Similarly, abc can be seen as exact if K ε describes the observational error, see e.g. Wilkinson 2013.)”
BackgroundThe rate of convergence for approximate Bayesian computation
Barber, S., Voß, J., & Webster, M. (2015) · Electronic Journal of Statistics · doi:10.1214/15-ejs988 · Cited by 88
Investigating the Impact of Model Misspecification in Neural Simulation-based InferencePreprint
Cannon, P. W., Ward, D., & Schmon, S. M. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2209.01845 · Cited by 88
Vrugt, J. A., & Beven, K. J. (2018) · Journal of Hydrology · doi:10.1016/j.jhydrol.2018.02.026 · Cited by 87
“The tolerance, (cid:2) , can therefore be considered a trade-off between computational tractability and accuracy (Wilkinson, 2013).”
Warne, D. J., Baker, R. E., & Simpson, M. J. (2019) · Bulletin of Mathematical Biology · doi:10.1007/s11538-019-00589-x · Cited by 87
A Unified Bayesian Inference Framework for Generalized Linear Models
Meng, X., Wu, S., & Zhu, J. (2018) · IEEE Signal Processing Letters · doi:10.1109/lsp.2017.2789163 · Cited by 83
Accelerating ABC methods using Gaussian processesPreprint
Wilkinson, R. D. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1401.1436 · Cited by 82
“Wilkinson (2013) showed that any ABC algorithm gives Monte Carlo exact inference, but for a different model to the one intended.”
BackgroundSelf-citationABC: A useful Bayesian tool for the analysis of population data
Lopes, J. S., & Beaumont, M. (2009) · Infection Genetics and Evolution · doi:10.1016/j.meegid.2009.10.010 · Cited by 83
Efficient Acquisition Rules for Model-Based Approximate Bayesian Computation
Järvenpää, M., Gutmann, M. U., Pleska, A., Vehtari, A., & Marttinen, P. (2018) · Bayesian Analysis · doi:10.1214/18-ba1121 · Cited by 85
A simulated annealing approach to approximate Bayes computations
Albert, C., Künsch, H. R., & Scheidegger, A. (2014) · Statistics and Computing · doi:10.1007/s11222-014-9507-8 · Cited by 78
“The effect of kernels different from the Heaviside function has been considered, e.g. in Wilkinson (2013).”
BackgroundZhu, C., Tian, W., Yin, B., Li, Z., & Shi, J. (2020) · Applied Energy · doi:10.1016/j.apenergy.2020.115025 · Cited by 78
Challenges in estimation, uncertainty quantification and elicitation for pandemic modelling
Swallow, B., Birrell, P., Blake, J., Burgman, M. A., Challenor, P., Coffeng, L. E., Dawid, A. P., Angelis, D. D., Goldstein, M., Hemming, V., et al. (2022) · Epidemics · doi:10.1016/j.epidem.2022.100547 · Cited by 73
“The interpretation of these approximations is discussed in more detail in Wilkinson (2013).”
BackgroundStatistical inference for dynamical systems: A review
McGoff, K. A., Mukherjee, S., & Pillai, N. S. (2015) · Statistics Surveys · doi:10.1214/15-ss111 · Cited by 71
“A partial list of references include [23, 25, 80, 96, 101, 103, 111, 119, 125].”
Inference for SDE Models via Approximate Bayesian Computation
Picchini, U. (2014) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.2013.866048 · Cited by 70
On sequential Monte Carlo, partial rejection control and approximate Bayesian computation
Peters, G. W., Fan, Y., & Sisson, S. A. (2012) · Statistics and Computing · doi:10.1007/s11222-012-9315-y · Cited by 69
pyABC: Efficient and robust easy-to-use approximate Bayesian computation
Schälte, Y., Klinger, E., Alamoudi, E., & Hasenauer, J. (2022) · The Journal of Open Source Software · doi:10.21105/joss.04304 · Cited by 70
Considering discrepancy when calibrating a mechanistic electrophysiology model
Lei, C. L., Ghosh, S., Whittaker, D. J., Aboelkassem, Y., Beattie, K. A., Cantwell, C. D., Delhaas, T., Houston, C., Novaes, G. M., Panfilov, A. V., et al. (2020) · Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences · doi:10.1098/rsta.2019.0349 · Cited by 65
“This change, from a fully specified statistical model for δ to instead only giving an upper bound for δ, is a conservative inferential approach where the aim is not to find the best parameter values, but instead rule out only obviously implausible values [71,72].”
BackgroundSelf-citationHierarchical Approximate Bayesian Computation
Turner, B. M., & Zandt, T. V. (2013) · Psychometrika · doi:10.1007/s11336-013-9381-x · Cited by 64
How can a glacial inception be predicted?
Crucifix, M. C. (2011) · The Holocene · doi:10.1177/0959683610394883 · Cited by 63
Considerate approaches to constructing summary statistics for ABC model selection
Barnes, C. P., Filippi, S., Stumpf, M. P. H., & Thorne, T. (2012) · Statistics and Computing · doi:10.1007/s11222-012-9335-7 · Cited by 61
“…inferences not as approximations to the full Bayesian (and thus likelihood-based) apparatus but as inference procedures in their own right (Wilkinson 2008; Fearnhead and Prangle 2011; Drovandi et al. 2011; Dean et al. 2011; Dean and Singh 2011), potentially systematically biased or for…”
BackgroundMethodInfluentialComputing Bayes: From Then ‘Til Now
Martin, G. M., Frazier, D. T., & Robert, C. P. (2023) · Statistical Science · doi:10.1214/22-sts876 · Cited by 60
A simple approach to maximum intractable likelihood estimation
Rubio, F. J., & Johansen, A. M. (2013) · Electronic Journal of Statistics · doi:10.1214/13-ejs819 · Cited by 55
“The quality of the approximation to the posterior and theoretical properties of the estimators obtained with ABC have been studied in Wilkinson (2008); Blum (2010); Marin et al. (2011); Dean et al. (2011); and Fearnhead and Prangle (2012).”
BackgroundCellular costs underpin micronutrient limitation in phytoplankton
McCain, J. S. P., Tagliabue, A., Susko, E., Achterberg, E. P., Allen, A. E., & Bertrand, E. M. (2021) · Science Advances · doi:10.1126/sciadv.abg6501 · Cited by 52
“We used an ABC algorithm to approximate the exact posterior (39, 103).”
MethodConstructing Summary Statistics for Approximate Bayesian Computation: Semi-automatic ABCPreprint
Fearnhead, P., & Prangle, D. (2010) · arXiv (Cornell University) · doi:10.48550/arxiv.1004.1112 · Cited by 64
Handbook of Approximate Bayesian Computation.
Franks, J. (2020) · Journal of the American Statistical Association · doi:10.1080/01621459.2020.1846973 · Cited by 51
Likelihood-based parameter estimation and comparison of dynamical cognitive models.
Schütt, H. H., Rothkegel, L. O. M., Trukenbrod, H. A., Reich, S., Wichmann, F. A., & Engbert, R. (2017) · Psychological Review · doi:10.1037/rev0000068 · Cited by 52
“Moreover, Approximate Bayesian Computation (ABC) allows an approximation to full Bayesian inference without a likelihood (Barthelmé & Chopin, 2011, 2014; Turner & Van Zandt, 2012; Wilkinson, 2013).”
MethodThe use of a single pseudo-sample in approximate Bayesian computation
Bornn, L., Pillai, N. S., Smith, A. D., & Woodard, D. B. (2016) · Statistics and Computing · doi:10.1007/s11222-016-9640-7 · Cited by 47
“A generalized version of this method (Wilkinson, 2013) is given in Algorithm 1, where K ( η ) is an unnormalized probability density function, M is an arbitrary number of pseudo-samples, and c is a constant satisfying c ≥ sup η K ( η ) . for t = 1 to n do repeat Generate θ (cid:48) ∼ π ( θ ) , y i,…”
BackgroundMethodResultInfluentialApproximate Bayesian Computation by Subset Simulation using hierarchical state-space models
Vakilzadeh, M. K., Huang, Y., Beck, J. L., & Abrahamsson, T. J. S. (2016) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2016.02.024 · Cited by 47
AABC: Approximate approximate Bayesian computation for inference in population-genetic models
Buzbas, E. O., & Rosenberg, N. A. (2014) · Theoretical Population Biology · doi:10.1016/j.tpb.2014.09.002 · Cited by 47
“…when the likelihood is based on summaries instead of the full data (Joyce and Marjoram, 2008; Nunes and Balding , 2010; Fearnhead and Prangle, 2012), and the equivalence of posterior distributions targeted in different ABC methods (Wilkinson , 2008; Sisson et al., 2010) have also been investigated.”
Likelihood-free Bayesian analysis of memory models.
Turner, B. M., Dennis, S. J., & Zandt, T. V. (2013) · Psychological Review · doi:10.1037/a0032458 · Cited by 45
Deviance Information Criteria for Model Selection in Approximate Bayesian Computation
François, O., & Laval, G. (2011) · Statistical Applications in Genetics and Molecular Biology · doi:10.2202/1544-6115.1678 · Cited by 47
Hazra, I., Pandey, M. D., & Manzana, N. (2020) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2019.106780 · Cited by 44
Yıldırım, S., Singh, S. S., Dean, T., & Jasra, A. (2014) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.2014.938811 · Cited by 43
“(2014) can be interpreted as the frequentist equivalence of Wilkinson’s observation that the ABC posterior distribution is exact under the assumption of model error (Wilkinson 2013).”
BackgroundResultAsymptotically Exact Data Augmentation: Models, Properties, and Algorithms
Vono, M., Dobigeon, N., & Chainais, P. (2020) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.2020.1826954 · Cited by 46
“Among a huge literature on ABC (also called likelihood-free) methods, noisy ABC approaches proposed and motivated by Fearnhead and Prangle (2012) and Wilkinson (2013) are strongly related to AXDA.”
Mohammad-Djafari, A. (2015) · Entropy · doi:10.3390/e17063989 · Cited by 43
Approximating Bayes in the 21st Century
Martin, G. M., Frazier, D. T., & Robert, C. P. (2023) · Statistical Science · doi:10.1214/22-sts875 · Cited by 44
An approximate likelihood perspective on ABC methods
Karabatsos, G., & Leisen, F. (2018) · Statistics Surveys · doi:10.1214/18-ss120 · Cited by 43
“In R-ABC, the tolerance represents model approximation error [280] and controls the trade-off between computational speed and estimation accuracy.”
BackgroundMethodJoining and Splitting Models with Markov Melding
Goudie, R. J. B., Presanis, A. M., Lunn, D. J., Angelis, D. D., & Wernisch, L. (2018) · Bayesian Analysis · doi:10.1214/18-ba1104 · Cited by 41
“ABC can thus be seen as very similar to standard posterior inference but with a widening of the δ function (Wilkinson, 2013; Miller and Dunson, 2015).”
BackgroundApproximating Bayesian Inference through Model Simulation
Turner, B. M., & Zandt, T. V. (2018) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2018.06.003 · Cited by 42
Lewis, J. R., MacEachern, S. N., & Lee, Y. (2021) · Bayesian Analysis · doi:10.1214/21-ba1257 · Cited by 43
“This method makes use of kernel-based ABC (Wilkinson, 2013).”
MethodParameter uncertainty of a dynamic multispecies size spectrum model
Spence, M. A., Blackwell, P. G., & Blanchard, J. L. (2015) · Canadian Journal of Fisheries and Aquatic Sciences · doi:10.1139/cjfas-2015-0022 · Cited by 40
“…se o nl y. abundance baselines of marine communities and their responses to the potential effects of fishing and climate change (Benoît and Rochet 2004; Blanchard et al. 2009, 2012; Law et al. 2009; Jacobsen et al. 2013; Maury and Poggiale 2013; Woodworth-Jefcoats et al. 2013; Law et al. 2015).”
BackgroundBayesian model comparison with un-normalised likelihoods
Everitt, R. G., Johansen, A. M., Rowing, E., & Evdemon-Hogan, M. (2016) · Statistics and Computing · doi:10.1007/s11222-016-9629-2 · Cited by 39
“…“simulation based” methods such as approximate Bayesian computation (ABC) (Grelaud et al. 2009) do not depend upon such a decomposition and can be applied more generally: to situation 1 in Picchini and Forman (2013); situations 2 and 3 [e.g. Everitt (2012)] and situation 4 [e.g. Wilkinson (2013)].”
Rasmussen, R., & Hamilton, G. S. (2011) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2011.10.005 · Cited by 40
“The solution given by Algorithm 1 is exact in that the probability of θ will have the posterior density p(θ | Do); however, the practical success of this algorithm will depend on the probability of the data (Wilkinson, 2008; Beaumont et al., 2009).”
MethodWilkinson, D. J. (2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199694587.003.0023 · Cited by 41
Gaussin prosessi -surrogaattimenetelmiä likimääräiseen Bayesilaiseen päättelyyn
Järvenpää, M. (2020) · Aaltodoc (Aalto University) · Cited by 36
ABC for Climate: Dealing with Expensive Simulators
Holden, P. B., Edwards, N. R., Hensman, J. J., & Wilkinson, R. (2018) · Chapman & Hall/CRC eBooks · doi:10.1201/9781315117195-19 · Cited by 35
“roximatingthedistribution ˇ ABC(jC obs) / Z I(ˆ(C obs;C sim) )ˇ(C simj)dC simˇ(): (2) TheacceptancekernelI(ˆ(C sim;C obs) ) implicitlyimpliesauniformdistribution for the simulator discrepancy (Wilkinson, 2013), but this is usually viewedasapragmaticcompromise,ratherthanamodellingdecision. An alternative to a probabili…”
BackgroundInfluentialSelf-citationExact Inference with Approximate Computation for Differentially Private Data via Perturbations
Gong, R. (2022) · Journal of Privacy and Confidentiality · doi:10.29012/jpc.797 · Cited by 35
Alahmadi, A. A., Flegg, J. A., Cochrane, D. G., Drovandi, C., & Keith, J. M. (2020) · Royal Society Open Science · doi:10.1098/rsos.191315 · Cited by 34
“Wilkinson RD. 2013 Approximate Bayesian computation (ABC) gives exact results under the assumption of model error.”
MethodInfluentialGrazian, C., & Fan, Y. (2019) · Wiley Interdisciplinary Reviews Computational Statistics · doi:10.1002/wics.1486 · Cited by 33
“Therefore, the parameter is studied through a likelihood function conditional on observed summary statistics, instead of data (Wilkinson, 2013) and consequently the target likelihood function is L θð Þ≈p η y0ð Þjθð Þ, ð1Þ for some choice of summary statistics η( ).”
Simulation-based Bayesian inference under model misspecificationPreprint
Kelly, R. P., Warne, D. J., Frazier, D. T., Nott, D. J., Gutmann, M. U., & Drovandi, C. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2503.12315 · Cited by 34
“…3.1) may be less sensitive to outliers than using the full dataset, tolerance thresholds effectively act as implicit error models (Miller and Dunson, 2019; Wilkinson, 2013), and choosing a robust distance (Section 3.2) can reduce the influence of outliers compared to standard Bayesian inference.”
InfluentialApproximate Bayesian Computation for a Class of Time Series Models
Jasra, A. (2015) · International Statistical Review · doi:10.1111/insr.12089 · Cited by 32
“An interesting idea, developed in [37, 77] is the notion of noisy ABC, a term apparently coined in [37], see also [22].”
BackgroundMethodHutton, C., Kapelan, Z. S., Vamvakeridou-Lyroudia, L., & Savic, D. A. (2013) · Journal of Water Resources Planning and Management · doi:10.1061/(asce)wr.1943-5452.0000412 · Cited by 32
Approximate Bayesian Computation: A Survey on Recent Results
Robert, C. P. (2016) · Springer proceedings in mathematics & statistics · doi:10.1007/978-3-319-33507-0_7 · Cited by 32
Efficient Probabilistic Inference in the Quest for Physics Beyond the Standard ModelPreprint
Baydin, A. G., Heinrich, L., Bhimji, W., Shao, L., Naderiparizi, S., Munk, A., Liu, J., Gram-Hansen, B., Louppe, G., Meadows, L., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.07706 · Cited by 32
“in traditional inference algorithms, for example approaches based on conditional density estimation [6– 9] and density ratio estimation [10, 11]. Alternatively, approximate Bayesian computation (ABC) [12, 13] refers to a large class of approaches for sampling from the posterior distribution of these likelihood-free mo…”
MethodParameter estimation and uncertainty quantification using information geometry
Sharp, J. A., Browning, A. P., Burrage, K., & Simpson, M. J. (2022) · Journal of The Royal Society Interface · doi:10.1098/rsif.2021.0940 · Cited by 30
“Popular approaches include ABC rejection sampling [35,39 – 42], ABC MCMC [43 – 45] and ABC SMC [11,34]; we do not focus on ABC methods here, as the approaches we explore in this work are applied to problems with tractable likelihoods.”
MethodSequentially Constrained Monte Carlo
Golchi, S., & Campbell, D. A. (2015) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2015.11.013 · Cited by 30
White, S. R., Kypraios, T., & Preston, S. (2013) · Statistics and Computing · doi:10.1007/s11222-013-9432-2 · Cited by 30
“For ABC with distance d( · , · ) taken to be the L p -norm of the difference between its arguments, the implied ABC approximation to the likelihood (Wilkinson 2013) is the convolution Hence ABC replaces the true likelihood with an approximate version averaged over an L p -ball of radius ε centred…”
MethodSchälte, Y., & Hasenauer, J. (2020) · Bioinformatics · doi:10.1093/bioinformatics/btaa397 · Cited by 31
Inference of random walk models to describe leukocyte migration
Jones, P. J. M., Sim, A., Taylor, H. B., Bugeon, L., Dallman, M. J., Pereira, B., Stumpf, M. P. H., & Liepe, J. (2015) · Physical Biology · doi:10.1088/1478-3975/12/6/066001 · Cited by 31
“© 2015 IOPPublishing Ltd framework (Toni et al 2009, Turner and van Zandt 2012, Wilkinson 2013).”
Method
Metadata
- Authors
- Wilkinson, R. D.
- Affiliations
- University of Nottingham (GB)
- Corresponding author
- Wilkinson, Richard David
- Venue
- Statistical Applications in Genetics and Molecular Biology
- Publisher
- Walter de Gruyter GmbH
- Published
- 2013-01-06
- Volume
- 12
- Issue
- 2
- Pages
- 129-41
- ISSN
- 1544-6115 (ISSN-L)
- 2194-6302
- OpenAlex
- W2053332694
- Cited by
- 247
- References
- 41
- Citations by year
- 2026: 6 · 2025: 9 · 2024: 8 · 2023: 8 · 2022: 9 · 2021: 13 · 2020: 30 · 2019: 16 · 2018: 26 · 2017: 13 · 2016: 17 · 2015: 24 · 2014: 17 · 2013: 16
- FWCI
- 21.70
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Statistical Applications in Genetics and Molecular Biology (publishedVersion)
- PubMed (publishedVersion)
- White Rose Research Online (University of Leeds, The University of Sheffield, University of York) (acceptedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Markov Chains and Monte Carlo Methods
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Physical Sciences › Computer Science › Artificial Intelligence › Gaussian Processes and Bayesian Inference
- Keywords
- approximate Bayesian computation, model error, simulation-based inference, acceptance probability, model calibration
- MeSH terms
- Algorithms, Bayes Theorem, Computer Simulation, Markov Chains, Monte Carlo Method, Models, Statistical, Likelihood Functions
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.