The DOI matches its Crossref record; 66 of the 66 references it cites were found in a registry or an index.
A Comparative Review of Dimension Reduction Methods in Approximate Bayesian Computation
Open accessAbstract
Approximate Bayesian computation (ABC) methods make use of comparisons between simulated and observed summary statistics to overcome the problem of computationally intractable likelihood functions. As the practical implementation of ABC requires computations based on vectors of summary statistics, rather than full data sets, a central question is how to derive low-dimensional summary statistics from the observed data with minimal loss of information. In this article we provide a comprehensive review and comparison of the performance of the principal methods of dimension reduction proposed in the ABC literature. The methods are split into three nonmutually exclusive classes consisting of best subset selection methods, projection techniques and regularization. In addition, we introduce two new methods of dimension reduction. The first is a best subset selection method based on Akaike and Bayesian information criteria, and the second uses ridge regression as a regularization procedure. We illustrate the performance of these dimension reduction techniques through the analysis of three challenging models and data sets.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486
A new look at the statistical model identification
Akaike, H. (1974) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1974.1100705 · Cited by 51,879
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb00917.x · Cited by 48,949
Estimating the Dimension of a Model
Schwarz, G. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344136 · Cited by 47,033
Ridge regression: Biased estimation for nonorthogonal problems
Hoerl, A. E., & Kennard, R. W. (1970) · Technometrics · doi:10.1080/00401706.1970.10488634 · Cited by 9,648
An Introduction to Statistical Modeling of Extreme Values
Coles, S. (2001) · Springer Series in Statistics · doi:10.1007/978-1-4471-3675-0 · Cited by 7,352
Regression and time series model selection in small samples
HURVICH, C. M., & TSAI, C.-L. (1989) · Biometrika · doi:10.1093/biomet/76.2.297 · Cited by 6,586
Generalized Cross-Validation as a Method for Choosing a Good Ridge Parameter
Golub, G. H., Heath, M., & Wahba, G. (1979) · Technometrics · doi:10.1080/00401706.1979.10489751 · Cited by 3,934
Neural Networks and the Bias/Variance Dilemma
Geman, S., Bienenstock, E., & Doursat, R. (1992) · Neural Computation · doi:10.1162/neco.1992.4.1.1 · Cited by 3,578 · cited 2×
“This effect can be especially acute for high-dimensional regression (Geman et al. 1992).”
BackgroundMethodApproximate Bayesian computation in population genetics
Beaumont, M. A., Zhang, W., & Balding, D. J. (2002) · Genetics · doi:10.1093/genetics/162.4.2025 · Cited by 2,932
Handbook of Partial Least Squares: Concepts, Methods and Applications
(2010) · Springer eBooks · doi:10.1007/978-3-540-32827-8 · Cited by 2,605
Generating samples under a Wright–Fisher neutral model of genetic variation
Hudson, R. R. (2002) · Bioinformatics · doi:10.1093/bioinformatics/18.2.337 · Cited by 2,364
Ridge Regression: Biased Estimation for Nonorthogonal Problems
Hoerl, A. E., & Kennard, R. W. (1970) · Technometrics · doi:10.2307/1267351 · Cited by 1,955
The pls Package: Principal Component and Partial Least Squares Regression in R
Mevik, B.-H., & Wehrens, R. (2007) · Journal of Statistical Software · doi:10.18637/jss.v018.i02 · Cited by 1,782
Toni, T., Welch, D., Strelkowa, N., Ipsen, A., & Stumpf, M. P. H. (2009) · Journal of The Royal Society Interface · doi:10.1098/rsif.2008.0172 · Cited by 1,498
Partial least squares regression and projection on latent structure regression (PLS Regression)
Abdi, H. (2010) · WIREs Computational Statistics · doi:10.1002/wics.51 · Cited by 1,440
Expectation Propagation for approximate Bayesian inference
Minka, T. P. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1301.2294 · Cited by 1,392
Approximate Bayesian Computation (ABC) in practice
Csilléry, K., Blum, M. G. B., Gaggiotti, O. E., & François, O. (2010) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2010.04.001 · Cited by 1,302
Self-citationHurvich, C. M., Simonoff, J. S., & Tsai, C.-L. (1998) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00125 · Cited by 1,241
Markov chain Monte Carlo without likelihoods
Marjoram, P., Molitor, J., Plagnol, V., & Tavaré, S. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0306899100 · Cited by 1,199
Approximate Bayesian Computation in Evolution and Ecology
Beaumont, M. A. (2010) · Annual Review of Ecology, Evolution, and Systematics · doi:10.1146/annurev-ecolsys-102209-144621 · Cited by 1,114
Population growth of human Y chromosomes: a study of Y chromosome microsatellites
Pritchard, J. K., Seielstad, M. T., Perez-Lezaun, A., & Feldman, M. W. (1999) · Molecular Biology and Evolution · doi:10.1093/oxfordjournals.molbev.a026091 · Cited by 1,080
Sequential Monte Carlo without likelihoods
Sisson, S. A., Fan, Y., & Tanaka, M. M. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0607208104 · Cited by 856
Self-citationRidge Regression: Biased Estimation for Nonorthogonal Problems
Hoerl, A. E., & Kennard, R. W. (2000) · Technometrics · doi:10.1080/00401706.2000.10485983 · Cited by 808
Partial least squares: a versatile tool for the analysis of high-dimensional genomic data
Boulesteix, A.-L., & Strimmer, K. (2006) · Briefings in Bioinformatics · doi:10.1093/bib/bbl016 · Cited by 802
abc: an R package for approximate Bayesian computation (ABC)
Csilléry, K., François, O., & Blum, M. G. B. (2012) · Methods in Ecology and Evolution · doi:10.1111/j.2041-210x.2011.00179.x · Cited by 707
Self-citationNeural Networks and Related Methods for Classification
Ripley, B. D. (1994) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1994.tb01990.x · Cited by 627
Approximate Bayesian Computation
Sunnåker, M., Busetto, A. G., Numminen, E., Corander, J., Foll, M., & Dessimoz, C. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002803 · Cited by 623
Adaptive approximate Bayesian computation
Beaumont, M. A., Cornuet, J.-M., Marin, J.-M., & Robert, C. P. (2009) · Biometrika · doi:10.1093/biomet/asp052 · Cited by 614
Fearnhead, P., & Prangle, D. (2012) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2011.01010.x · Cited by 567
Self-citationAn adaptive sequential Monte Carlo method for approximate Bayesian computation
Del Moral, P., Doucet, A., & Jasra, A. (2012) · Statistics and Computing · doi:10.1007/s11222-011-9271-y · Cited by 505
ABC as a flexible framework to estimate demography over space and time: some cons, many pros
BERTORELLE, G., BENAZZO, A., & MONA, S. (2010) · Molecular Ecology · doi:10.1111/j.1365-294x.2010.04690.x · Cited by 464
Non-linear regression models for Approximate Bayesian Computation
Blum, M. G. B., & François, O. (2010) · Statistics and Computing · doi:10.1007/s11222-009-9116-0 · Cited by 453
Self-citationEfficient Approximate Bayesian Computation Coupled With Markov Chain Monte Carlo Without Likelihood
Wegmann, D., Leuenberger, C., & Excoffier, L. (2009) · Genetics · doi:10.1534/genetics.109.102509 · Cited by 348
Mevik, B., & Cederkvist, H. R. (2004) · Journal of Chemometrics · doi:10.1002/cem.887 · Cited by 249
Approximate Bayesian Computation: A Nonparametric Perspective
Blum, M. G. B. (2010) · Journal of the American Statistical Association · doi:10.1198/jasa.2010.tm09448 · Cited by 239
Self-citationDrovandi, C. C., & Pettitt, A. N. (2011) · Biometrics · doi:10.1111/j.1541-0420.2010.01410.x · Cited by 230
Approximately Sufficient Statistics and Bayesian Computation
Joyce, P., & Marjoram, P. (2008) · Statistical Applications in Genetics and Molecular Biology · doi:10.2202/1544-6115.1389 · Cited by 212
(2005) · Technometrics · doi:10.1198/tech.2005.s344 · Cited by 201
Nearest Neighbor Estimates of Entropy
Singh, H., Misra, N., Hnizdo, V., Fedorowicz, A., & Demchuk, E. (2003) · American Journal of Mathematical and Management Sciences · doi:10.1080/01966324.2003.10737616 · Cited by 200
Baddeley, A., & Jensen, E. B. V. (2004) · Chapman & Hall/CRC eBooks · doi:10.1201/9780203496817 · Cited by 178
Bayesian Computation and Model Selection Without Likelihoods
Leuenberger, C., & Wegmann, D. (2010) · Genetics · doi:10.1534/genetics.109.109058 · Cited by 175
On Optimal Selection of Summary Statistics for Approximate Bayesian Computation
Nunes, M. A., & Balding, D. J. (2010) · Statistical Applications in Genetics and Molecular Biology · doi:10.2202/1544-6115.1576 · Cited by 157
Self-citationThe epidemiological fitness cost of drug resistance in Mycobacterium tuberculosis
Luciani, F., Sisson, S. A., Jiang, H., Francis, A. R., & Tanaka, M. M. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0902437106 · Cited by 152
Self-citationSisson, S. A., & Fan, Y. (2011) · Chapman & Hall/CRC eBooks · doi:10.1201/b10905-13 · Cited by 148
Self-citationInference for Stereological Extremes
Bortot, P., Coles, S., & Sisson, S. A. (2007) · Journal of the American Statistical Association · doi:10.1198/016214506000000988 · Cited by 135
Self-citationBayesian information criteria and smoothing parameter selection in radial basis function networks
Konishi, S. (2004) · Biometrika · doi:10.1093/biomet/91.1.27 · Cited by 130
Estoup, A., Lombaert, É., Marin, J., Guillemaud, T., Pudlo, P., Robert, C. P., & Cornuet, J. (2012) · Molecular Ecology Resources · doi:10.1111/j.1755-0998.2012.03153.x · Cited by 118
A Novel Approach for Choosing Summary Statistics in Approximate Bayesian Computation
Aeschbacher, S., Beaumont, M., & Futschik, A. (2012) · Genetics · doi:10.1534/genetics.112.143164 · Cited by 111
Approximate Bayesian Computation Using Indirect Inference
Drovandi, C. C., Pettitt, A. N., & Faddy, M. J. (2011) · Journal of the Royal Statistical Society Series C: Applied Statistics · doi:10.1111/j.1467-9876.2010.00747.x · Cited by 100
Filtering via approximate Bayesian computation
Jasra, A., Singh, S. S., Martin, J. S., & McCoy, E. J. (2010) · Statistics and Computing · doi:10.1007/s11222-010-9185-0 · Cited by 100
Estimating Functions in Indirect Inference
Heggland, K., & Frigessi, A. (2004) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.1369-7412.2003.05341.x · Cited by 93
The Indirect Method: Inference Based on Intermediate Statistics—A Synthesis and Examples
Jiang, W., & Turnbull, B. W. (2004) · Statistical Science · doi:10.1214/088342304000000152 · Cited by 86
Likelihood-free Markov chain Monte CarloPreprint
Sisson, S. A., & Fan, Y. (2010) · arXiv (Cornell University) · doi:10.48550/arxiv.1001.2058 · Cited by 83
Self-citationABC: A useful Bayesian tool for the analysis of population data
Lopes, J. S., & Beaumont, M. (2009) · Infection Genetics and Evolution · doi:10.1016/j.meegid.2009.10.010 · Cited by 78
On sequential Monte Carlo, partial rejection control and approximate Bayesian computation
Peters, G. W., Fan, Y., & Sisson, S. A. (2012) · Statistics and Computing · doi:10.1007/s11222-012-9315-y · Cited by 69
Self-citationAveraging Regularized Estimators
Taniguchi, M., & Tresp, V. (1997) · Neural Computation · doi:10.1162/neco.1997.9.5.1163 · Cited by 66
Bayesian estimation of quantile distributions
Allingham, D., King, R., & Mengersen, K. L. (2008) · Statistics and Computing · doi:10.1007/s11222-008-9083-x · Cited by 65
Considerate approaches to constructing summary statistics for ABC model selection
Barnes, C. P., Filippi, S., Stumpf, M. P. H., & Thorne, T. (2012) · Statistics and Computing · doi:10.1007/s11222-012-9335-7 · Cited by 61 · cited 2×
“s, evaluation of such a performance diagnostic is entirely practicable, as no further model simulations are required. This idea is also relevant to methods of dimension reduction for model selection (Barnes et al. (2012); Estoup et al. (2012)) where a misclassification rate based on a leave-one-out procedure can serve…”
BackgroundMethodFearnhead, P., & Prangle, D. (2012) · Lancaster EPrints (Lancaster University) · Cited by 58
Self-citationKernel approximate Bayesian computation in population genetic inferences
Nakagome, S., Fukumizu, K., & Mano, S. (2013) · Statistical Applications in Genetics and Molecular Biology · doi:10.1515/sagmb-2012-0050 · Cited by 57
Approximate Bayesian Computation and Bayes’ Linear Analysis: Toward High-Dimensional ABC
Nott, D. J., Fan, Y., Marshall, L. A., & Sisson, S. A. (2012) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.2012.751874 · Cited by 54
Self-citationAdaptivity for ABC algorithms: the ABC-PMC scheme
Robert, C. P., Beaumont, M., Marin, J., & Cornuet, J. (2008) · Cited by 37
Bayesian Learning from Marginal Data in Bionetwork Models
Bonassi, F. V., You, L., & West, M. (2011) · Statistical Applications in Genetics and Molecular Biology · doi:10.2202/1544-6115.1684 · Cited by 35
Choosing the Summary Statistics and the Acceptance Rate in Approximate Bayesian Computation
Blum, M. G. B. (2010) · Physica-Verlag eBooks · doi:10.1007/978-3-7908-2604-3_4 · Cited by 25
Self-citationChoice of Summary Statistic Weights in Approximate Bayesian Computation
Jung, H., & Marjoram, P. (2011) · Statistical Applications in Genetics and Molecular Biology · doi:10.2202/1544-6115.1586 · Cited by 21
Cited by
Approximate Bayesian Computation
Sunnåker, M., Busetto, A. G., Numminen, E., Corander, J., Foll, M., & Dessimoz, C. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002803 · Cited by 623
Fearnhead, P., & Prangle, D. (2012) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2011.01010.x · Cited by 567
Self-citationSupervised Machine Learning for Population Genetics: A New Paradigm
Schrider, D. R., & Kern, A. D. (2018) · Trends in Genetics · doi:10.1016/j.tig.2017.12.005 · Cited by 453
Reliable ABC model choice via random forests
Pudlo, P., Marin, J.-M., Estoup, A., Cornuet, J.-M., Gautier, M., & Robert, C. P. (2016) · Bioinformatics · doi:10.1093/bioinformatics/btv684 · Cited by 384
Smolyanskaya, O. A., Chernomyrdin, N. V., Konovko, A. A., Zaytsev, K. I., Ozheredov, I. A., Cherkasova, O. P., Nazarov, M. M., Guillet, J.-P., Kozlov, S. A., Kistenev, Y. V., et al. (2018) · Progress in Quantum Electronics · doi:10.1016/j.pquantelec.2018.10.001 · Cited by 292
Metadata
- Authors
- Blum, M. G. B., Nunes, M. A., Prangle, D., & Sisson, S. A.
- Venue
- Statistical Science
- Publisher
- Institute of Mathematical Statistics
- Published
- 2013-05-01
- Volume
- 28
- Issue
- 2
- Pages
- 189-208
- ISSN
- 0883-4237 (ISSN-L)
- OpenAlex
- W2123368367
- Cited by
- 353
- References
- 66
- FWCI
- 26.38
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.