The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Reliable ABC model choice via random forests
Open accessAbstract
Motivation: Approximate Bayesian computation (ABC) methods provide an elaborate approach to Bayesian inference on complex models, including model choice. Both theoretical arguments and simulation experiments indicate, however, that model posterior probabilities may be poorly evaluated by standard ABC techniques. Results: We propose a novel approach based on a machine learning tool named random forests (RF) to conduct selection among the highly complex models covered by ABC algorithms. We thus modify the way Bayesian model selection is both understood and operated, in that we rephrase the inferential goal as a classification problem, first predicting the model that best fits the data with RF and postponing the approximation of the posterior probability of the selected model for a second stage also relying on RF. Compared with earlier implementations of ABC model choice, the ABC RF approach offers several potential improvements: (i) it often has a larger discriminative power among the competing models, (ii) it is more robust against the number and choice of statistics summarizing the data, (iii) the computing effort is drastically reduced (with a gain in computation efficiency of at least 50) and (iv) it includes an approximation of the posterior probability of the selected model. The call to RF will undoubtedly extend the range of size of datasets and complexity of models that ABC can handle. We illustrate the power of this novel methodology by analyzing controlled experiments as well as genuine population genetics datasets. Availability and implementation: The proposed methodology is implemented in the R package abcrf available on the CRAN. Contact: jean-michel.marin@umontpellier.fr Supplementary information: Supplementary data are available at Bioinformatics online.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325
The Elements of Statistical Learning: Data Mining, Inference, and Prediction
John Lu, Z. Q. (2010) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2010.00646_6.x · Cited by 12,390
Statistical Decision Theory and Bayesian Analysis
Berger, J. O. (1985) · Springer Series in Statistics · doi:10.1007/978-1-4757-4286-2 · Cited by 7,722
An integrated map of genetic variation from 1,092 human genomes
The 1000 Genomes Project Consortium (2012) · Nature · doi:10.1038/nature11632 · Cited by 7,711
A Probabilistic Theory of Pattern Recognition
Devroye, L., Györfi, L., & Lugosi, G. (1996) · Stochastic Modelling and Applied Probability · doi:10.1007/978-1-4612-0711-5 · Cited by 3,274
Mitochondrial DNA and human evolution
Cann, R. L., Stoneking, M., & Wilson, A. C. (1987) · Nature · doi:10.1038/325031a0 · Cited by 3,100
Approximate Bayesian computation in population genetics
Beaumont, M. A., Zhang, W., & Balding, D. J. (2002) · Genetics · doi:10.1093/genetics/162.4.2025 · Cited by 2,932
Stastical Decision Theory and Bayesian Analysis.
Ghosh, M., & Berger, J. (1988) · Journal of the American Statistical Association · doi:10.2307/2288950 · Cited by 2,905
Toni, T., Welch, D., Strelkowa, N., Ipsen, A., & Stumpf, M. P. H. (2009) · Journal of The Royal Society Interface · doi:10.1098/rsif.2008.0172 · Cited by 1,498
Robust Demographic Inference from Genomic and SNP Data
Excoffier, L., Dupanloup, I., Huerta-Sánchez, E., Sousa, V. C., & Foll, M. (2013) · PLoS Genetics · doi:10.1371/journal.pgen.1003905 · Cited by 1,466
Bayesianly Justifiable and Relevant Frequency Calculations for the Applied Statistician
Rubin, D. B. (1984) · The Annals of Statistics · doi:10.1214/aos/1176346785 · Cited by 1,343
Approximate Bayesian Computation (ABC) in practice
Csilléry, K., Blum, M. G. B., Gaggiotti, O. E., & François, O. (2010) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2010.04.001 · Cited by 1,302 · cited 2×
“…1999; Tavaré et al., 1997), the method has found an ever increasing range of applications covering diverse types of complex models in various scientific fields (see, e.g. Arenas et al., 2015; Beaumont, 2008, 2010; Chan et al., 2014; Csillèry et al., 2010; Theunert et al., 2012; Toni et al., 2009).”
BackgroundMethodApproximate Bayesian Computation in Evolution and Ecology
Beaumont, M. A. (2010) · Annual Review of Ecology, Evolution, and Systematics · doi:10.1146/annurev-ecolsys-102209-144621 · Cited by 1,114
Population growth of human Y chromosomes: a study of Y chromosome microsatellites
Pritchard, J. K., Seielstad, M. T., Perez-Lezaun, A., & Feldman, M. W. (1999) · Molecular Biology and Evolution · doi:10.1093/oxfordjournals.molbev.a026091 · Cited by 1,080
Cornuet, J.-M., Pudlo, P., Veyssier, J., Dehne-Garcia, A., Gautier, M., Leblois, R., Marin, J.-M., & Estoup, A. (2014) · Bioinformatics · doi:10.1093/bioinformatics/btt763 · Cited by 1,039
Self-citationInferring Coalescence Times From DNA Sequence Data
Tavaré, S., Balding, D. J., Griffiths, R. C., & Donnelly, P. (1997) · Genetics · doi:10.1093/genetics/145.2.505 · Cited by 940
Approximate Bayesian computational methods
Marin, J.-M., Pudlo, P., Robert, C. P., & Ryder, R. J. (2012) · Statistics and Computing · doi:10.1007/s11222-011-9288-2 · Cited by 818
Self-citationCornuet, J.-M., Santos, F., Beaumont, M. A., Robert, C. P., Marin, J.-M., Balding, D. J., Guillemaud, T., & Estoup, A. (2008) · Bioinformatics · doi:10.1093/bioinformatics/btn514 · Cited by 690
Self-citationScornet, E., Biau, G., & Vert, J.-P. (2015) · The Annals of Statistics · doi:10.1214/15-aos1321 · Cited by 612
Fearnhead, P., & Prangle, D. (2012) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2011.01010.x · Cited by 567
Cornuet, J.-M., Ravigné, V., & Estoup, A. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-401 · Cited by 479
Self-citationABC as a flexible framework to estimate demography over space and time: some cons, many pros
BERTORELLE, G., BENAZZO, A., & MONA, S. (2010) · Molecular Ecology · doi:10.1111/j.1365-294x.2010.04690.x · Cited by 464
A Comparative Review of Dimension Reduction Methods in Approximate Bayesian Computation
Blum, M. G. B., Nunes, M. A., Prangle, D., & Sisson, S. A. (2013) · Statistical Science · doi:10.1214/12-sts406 · Cited by 353
Lack of confidence in approximate Bayesian computation model choice
Robert, C. P., Cornuet, J.-M., Marin, J.-M., & Pillai, N. S. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1102900108 · Cited by 317
Self-citationLombaert, É., Guillemaud, T., Thomas, C. E., Handley, L. L., Li, J., WANG, S., Pang, H., Goryacheva, I. I., Zakharov, I. A., Jousselin, E., et al. (2011) · Molecular Ecology · doi:10.1111/j.1365-294x.2011.05322.x · Cited by 173
Self-citationNew insights into Approximate Bayesian Computation
Gérard Biau, A., Cérou, F., & Guyader, A. (2015) · Annales de l Institut Henri Poincaré Probabilités et Statistiques · doi:10.1214/13-aihp590 · Cited by 130
Relevant Statistics for Bayesian Model Choice
Marin, J., Pillai, N. S., Robert, C. P., & Rousseau, J. (2013) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/rssb.12056 · Cited by 128
Self-citationABC likelihood-free methods for model choice in Gibbs random fields
Grelaud, A., Marin, J.-M., Robert, C. P., Rodolphe, F., & Taly, J.-F. (2009) · Bayesian Analysis · doi:10.1214/09-ba412 · Cited by 119
Self-citationEstoup, A., Lombaert, É., Marin, J., Guillemaud, T., Pudlo, P., Robert, C. P., & Cornuet, J. (2012) · Molecular Ecology Resources · doi:10.1111/j.1755-0998.2012.03153.x · Cited by 118
Self-citationA Novel Approach for Choosing Summary Statistics in Approximate Bayesian Computation
Aeschbacher, S., Beaumont, M., & Futschik, A. (2012) · Genetics · doi:10.1534/genetics.112.143164 · Cited by 111
Likelihood-free estimation of model evidence
Didelot, X., Everitt, R. G., Johansen, A. M., & Lawson, D. J. (2011) · Bayesian Analysis · doi:10.1214/11-ba602 · Cited by 108
Simulations, Genetics and Human Prehistory
Matsumura, S., Forster, P., & Renfrew, C. (2008) · Cited by 77
Estimating admixture proportions with microsatellites: comparison of methods based on simulated data
Choisy, M., Franck, P., & Cornuet, J. (2004) · Molecular Ecology · doi:10.1111/j.1365-294x.2004.02107.x · Cited by 72
Self-citationChan, Y. L., Schanzenbach, D., & Hickerson, M. J. (2014) · Molecular Biology and Evolution · doi:10.1093/molbev/msu187 · Cited by 69
Considerate approaches to constructing summary statistics for ABC model selection
Barnes, C. P., Filippi, S., Stumpf, M. P. H., & Thorne, T. (2012) · Statistics and Computing · doi:10.1007/s11222-012-9335-7 · Cited by 61 · cited 4×
“Barnes et al. (2012) developed an interesting methodology to select the summary statistics but with the requirement to aggregate estimation and model pseudo-sufficient statistics for all models. This induces a deeply inefficient dimension inflation and can be very time consuming. It may seem tempting to collect the la…”
BackgroundMethodInfluentialSemi-automatic selection of summary statistics for ABC model choice
Prangle, D., Fearnhead, P., Cox, M. P., Biggs, P. J., & French, N. P. (2013) · Statistical Applications in Genetics and Molecular Biology · doi:10.1515/sagmb-2013-0012 · Cited by 56
Inferring the History of Population Size Change from Genome-Wide SNP Data
Theunert, C., Tang, K., Lachmann, M., Hu, S., & Stoneking, M. (2012) · Molecular Biology and Evolution · doi:10.1093/molbev/mss175 · Cited by 25
Arenas, M., Lopes, J. S., Beaumont, M., & Posada, D. (2015) · Molecular Biology and Evolution · doi:10.1093/molbev/msu411 · Cited by 22
Adaptive ABC model choice and geometric summary statistics for hidden Gibbs random fields
Stoehr, J., Pudlo, P., & Cucala, L. (2014) · Statistics and Computing · doi:10.1007/s11222-014-9514-9 · Cited by 12
Self-citationAdaptive ABC model choice and geometric summary statistics for hidden Gibbs random fields
Cucala, L., Stoehr, J., & Pudlo, P. (2015) · HAL · Cited by 11
Self-citation
Cited by
Supervised Machine Learning for Population Genetics: A New Paradigm
Schrider, D. R., & Kern, A. D. (2018) · Trends in Genetics · doi:10.1016/j.tig.2017.12.005 · Cited by 453
Efficient ancestry and mutation simulation with msprime 1.0
Baumdicker, F., Bisschop, G., Goldstein, D., Gower, G., Ragsdale, A. P., Tsambos, G., Zhu, S., Eldon, B., Ellerman, E. C., Galloway, J. G., et al. (2022) · Genetics · doi:10.1093/genetics/iyab229 · Cited by 442
Is There a Genetic Paradox of Biological Invasion?
Estoup, A., Ravigné, V., Hufbauer, R., Vitalis, R., Gautier, M., & Facon, B. (2016) · Annual Review of Ecology, Evolution, and Systematics · doi:10.1146/annurev-ecolsys-121415-032116 · Cited by 394
Self-citationGenomic insights into population history and biological adaptation in Oceania
Choin, J., Mendoza-Revilla, J., Arauna, L. R., Cuadros-Espinoza, S., Cassar, O., Larena, M., Ko, A. M.-S., Harmant, C., Laurent, R., Verdu, P., et al. (2021) · Nature · doi:10.1038/s41586-021-03236-5 · Cited by 208
Analytical Biases Associated with GC-Content in Molecular Evolution
Romiguier, J., & Roux, C. (2017) · Frontiers in Genetics · doi:10.3389/fgene.2017.00016 · Cited by 87
Metadata
- Authors
- Pudlo, P., Marin, J.-M., Estoup, A., Cornuet, J.-M., Gautier, M., & Robert, C. P.
- Venue
- Bioinformatics
- Publisher
- Oxford University Press (OUP)
- Published
- 2015-11-20
- Volume
- 32
- Issue
- 6
- Pages
- 859-866
- ISSN
- 1367-4803 (ISSN-L)
- 1367-4811
- OpenAlex
- W1946356339
- Cited by
- 384
- References
- 42
- FWCI
- 21.32
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.