Considerate approaches to constructing summary statistics for ABC model selection
The DOI matches its Crossref record; 52 of the 55 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The limitations that have been highlighted in the literature are pertinent for cases where inferences are based on summary statistics of the data instead of the data themselves, an approach conventionally adopted in population genetics applications. In these cases model selection is notoriously dependent on arbitrary choices made in the set-up of the ABC inference, and can swing in favor of any Pl”
From A framework for parameter estimation and model selection from experimental data in systems biology using approximate Bayesian computation (2014) · cites this paper as [33]
Citations
Cites
Model selection and multimodel inference: a practical information-theoretic approach.
Guthery, F. S., Burnham, K. P., & Anderson, D. R. (2003) · The Journal of Wildlife Management · doi:10.2307/3802723 · Cited by 41,495
Elements of Information Theory
Cover, T. M., & Thomas, J. A. (2001) · Wiley eBooks · doi:10.1002/0471200611 · Cited by 36,808
Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2003) · doi:10.1201/9780429258480 · Cited by 27,276
Elements of Information Theory
Cover, T. M., & Thomas, J. A. (2005) · doi:10.1002/047174882x · Cited by 13,791
Information theory, inference, and learning algorithms
(2004) · Choice Reviews Online · doi:10.5860/choice.41-5949 · Cited by 6,362
Information Theory, Inference, and Learning Algorithms
(2004) · Kybernetes · doi:10.1108/03684920410534506 · Cited by 4,937
Ziegel, E. R., Lehmann, E. L., & Casella, G. (1999) · Technometrics · doi:10.2307/1270597 · Cited by 4,203
ASH, R. B. (1966) · Cited by 3,990
Cox, D. R., & Hinkley, D. V. (1974) · doi:10.1007/978-1-4899-2887-0 · Cited by 3,089
Approximate Bayesian computation in population genetics
Beaumont, M. A., Zhang, W., & Balding, D. J. (2002) · Genetics · doi:10.1093/genetics/162.4.2025 · Cited by 2,932
Information, Physics, and Computation
Mézard, M., & Montanari, A. (2009) · doi:10.1093/acprof:oso/9780198570837.001.0001 · Cited by 1,913
Gene genealogies and the coalescent process.
Hudson, R. R. (1990) · Medical Entomology and Zoology · Cited by 1,838
Bayesian Data Analysis, 2nd edn
Brix, A. (2005) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2004.00347_4.x · Cited by 1,767
Mathematical Population Genetics
Baake, E., Ewens, W. J., & Wakolbinger, A. (2006) · Oberwolfach Reports · doi:10.4171/owr/2005/40 · Cited by 1,624
Toni, T., Welch, D., Strelkowa, N., Ipsen, A., & Stumpf, M. P. H. (2009) · Journal of The Royal Society Interface · doi:10.1098/rsif.2008.0172 · Cited by 1,498
Self-citationMathematical Population Genetics
Ewens, W. J. (2004) · Interdisciplinary Applied Mathematics · doi:10.1007/978-0-387-21822-9 · Cited by 1,229
Population growth of human Y chromosomes: a study of Y chromosome microsatellites
Pritchard, J. K., Seielstad, M. T., Perez-Lezaun, A., & Feldman, M. W. (1999) · Molecular Biology and Evolution · doi:10.1093/oxfordjournals.molbev.a026091 · Cited by 1,080
Shao, J. (2003) · Springer Texts in Statistics · doi:10.1007/b97553 · Cited by 799
Robert, C. P. (1994) · Springer Texts in Statistics · doi:10.1007/978-1-4757-4314-2 · Cited by 744
Principles of Statistical Inference
Cox, D. R. (2006) · doi:10.1017/cbo9780511813559 · Cited by 670
Statistical evaluation of alternative models of human evolution
Fagundes, N. J. R., Ray, N., Beaumont, M., Neuenschwander, S., Salzano, F. M., Bonatto, S. L., & Excoffier, L. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0708280104 · Cited by 589
Fearnhead, P., & Prangle, D. (2012) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2011.01010.x · Cited by 567
Gene Genealogies, Variation and Evolution: A Primer in Coalescent Theory
Hein, J., Schierup, M. H., & Wiuf, C. (2005) · Cited by 483
Uses and Abuses of Mathematics in Biology
May, R. M. (2004) · Science · doi:10.1126/science.1094442 · Cited by 456
Kullback-Leibler divergence estimation of continuous distributions
Perez-Cruz, F. (2008) · 2008 IEEE International Symposium on Information Theory · doi:10.1109/isit.2008.4595271 · Cited by 400
Lack of confidence in approximate Bayesian computation model choice
Robert, C. P., Cornuet, J.-M., Marin, J.-M., & Pillai, N. S. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1102900108 · Cited by 317
Simulation-based model selection for dynamical systems in systems and population biology
Toni, T., & Stumpf, M. P. H. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btp619 · Cited by 260 · cited 2×
“Here we show how a natural extension of the methodology introduced above can also be employed in order to construct sets of statistics that are suitable for ABC-based model selection, when it is impractical to use the raw data (Toni and Stumpf 2010; Thorne and Stumpf 2012).”
MethodSelf-citationApproximate Bayesian computation (ABC) gives exact results under the assumption of model error
Wilkinson, R. D. (2013) · Statistical Applications in Genetics and Molecular Biology · doi:10.1515/sagmb-2013-0010 · Cited by 247 · cited 4×
“…inferences not as approximations to the full Bayesian (and thus likelihood-based) apparatus but as inference procedures in their own right (Wilkinson 2008; Fearnhead and Prangle 2011; Drovandi et al. 2011; Dean et al. 2011; Dean and Singh 2011), potentially systematically biased or for…”
BackgroundMethodInfluentialGene Genealogies, Variation and Evolution: A Primer in Coalescent Theory
Hein, J., Schierup, M. H., & Wiuf, C. (2004) · doi:10.1093/oso/9780198529958.001.0001 · Cited by 224
Dating primate divergences through an integrated analysis of palaeontological and molecular data
Wilkinson, R. D., Steiper, M. E., Soligo, C., Martin, R. D., Yang, Z., & Tavaré, S. (2011) · Systematic Biology · doi:10.1093/sysbio/syq054 · Cited by 218 · cited 1×
“…demanding areas have fuelled the development of powerful ABC approaches, notably population genetics (Fagundes et al. 2007), evolutionary biology (Wilkinson et al. 2011), systems biology (Liepe et al. 2010), dynamical systems theory (Toni et al. 2009), and epidemiology (Blum and Tran 2010), a…”
BackgroundApproximately Sufficient Statistics and Bayesian Computation
Joyce, P., & Marjoram, P. (2008) · Statistical Applications in Genetics and Molecular Biology · doi:10.2202/1544-6115.1389 · Cited by 212
Berger, J. O., & Lehmann, E. L. (1984) · Journal of the American Statistical Association · doi:10.2307/2288729 · Cited by 180
Toffoli, T. (1982) · International Journal of Theoretical Physics · doi:10.1007/bf01857724 · Cited by 166
Tanaka, M. M., Francis, A. R., Luciani, F., & Sisson, S. A. (2006) · Genetics · doi:10.1534/genetics.106.055574 · Cited by 152
On Optimal Selection of Summary Statistics for Approximate Bayesian Computation
Nunes, M. A., & Balding, D. J. (2010) · Statistical Applications in Genetics and Molecular Biology · doi:10.2202/1544-6115.1576 · Cited by 147
ABC-SysBio approximate Bayesian computation in Python with GPU support
Liepe, J., Barnes, C., Cule, E., Erguler, K., Kirk, P., Toni, T., & Stumpf, M. P. H. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btq278 · Cited by 136
Self-citationRelevant Statistics for Bayesian Model Choice
Marin, J.-M., Pillai, N. S., Robert, C. P., & Rousseau, J. (2014) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/rssb.12056 · Cited by 127
2007 IEEE International Symposium on Information Theory
(2007) · IEEE Transactions on Information Theory · doi:10.1109/tit.2006.889787 · Cited by 114
Likelihood-free estimation of model evidence
Didelot, X., Everitt, R. G., Johansen, A. M., & Lawson, D. J. (2011) · Bayesian Analysis · doi:10.1214/11-ba602 · Cited by 109
Approximate Bayesian Computation Using Indirect Inference
Drovandi, C. C., Pettitt, A. N., & Faddy, M. J. (2011) · Journal of the Royal Statistical Society Series C: Applied Statistics · doi:10.1111/j.1467-9876.2010.00747.x · Cited by 100
Ratmann, O., Jørgensen, O., Hinkley, T., Stumpf, M., Richardson, S., & Wiuf, C. (2007) · PLoS Computational Biology · doi:10.1371/journal.pcbi.0030230 · Cited by 98
Self-citationBayesian design of synthetic biological systems
Barnes, C. P., Silk, D., Sheng, X., & Stumpf, M. P. H. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1017972108 · Cited by 90 · cited 2×
“Quite generally, the choice of the summary statistic is important: without sufficiency the whole inference will only map the parameter regimes that will lead to model behaviour which embodies the constraints implied by specified sum-mary statistic (Barnes et al. 2011).”
BackgroundMethodSelf-citationA Nearest-Neighbor Approach to Estimating Divergence between Continuous Random Vectors
Wang, Q., Kulkarni, S. R., & Verdú, S. (2006) · IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit.2006.261842 · Cited by 88
HIV with contact tracing: a case study in approximate Bayesian computation
Blum, M. G. B., & Tran, V. C. (2010) · Biostatistics · doi:10.1093/biostatistics/kxq022 · Cited by 80
The ABC of reverse engineering biological signalling systems
Secrier, M., Toni, T., & Stumpf, M. P. H. (2009) · Molecular BioSystems · doi:10.1039/b908951a · Cited by 47
Self-citationGraph spectral analysis of protein interaction network evolution
Thorne, T., & Stumpf, M. P. H. (2012) · Journal of The Royal Society Interface · doi:10.1098/rsif.2012.0220 · Cited by 30 · cited 1×
“Here we show how a natural extension of the methodology introduced above can also be employed in order to construct sets of statistics that are suitable for ABC-based model selection, when it is impractical to use the raw data (Toni and Stumpf 2010; Thorne and Stumpf 2012).”
MethodSelf-citationAsymptotic Behaviour of Approximate Bayesian Estimators
Ta, D., & Singh, S. S. (2011) · Cambridge University Engineering Department Publications Database · doi:10.48550/arxiv.1105.3655 · Cited by 17
Relevant statistics for Bayesian model choicePreprint
Marin, J., Pillai, N. S., Robert, C. P., et al. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1110.4700 · Cited by 13
Why approximate Bayesian computational (ABC) methods cannot handle model choice problemsPreprint
Robert, C. P., Marin, J., & Pillai, N. S. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1101.5091 · Cited by 12
Constructing ABC summary statistics: semi-automatic ABCPreprint
Fearnhead, P., & Prangle, D. (2011) · Nature Precedings · doi:10.1038/npre.2011.5959 · Cited by 5
2006 IEEE International Symposium on Information Theory
(2005) · IEEE Transactions on Information Theory · doi:10.1109/tit.2005.845275 · Cited by 5
Kusama, T. (1976) · Osaka City University (Osaka City University) · doi:10.18910/4140 · Cited by 1
Research works printed but not linked: 3
- Dean, T.A., Singh, S.S., Jasra, A., Peters, G.W.: Parameter estimation for hidden Markov models with intractable likelihoods (2011). arXiv: 1103.5399 · arXiv
- Hein, J., Schierup, M., Wiuf, C.: Gene Genealogies, Variation and Evolution. Oxford University Press, London (2005)
- Rudnick, J., Gaspari, G.: Elements of the Random Walk. Cambridge University Press, Cambridge (2010)
Cited by
Fearnhead, P., & Prangle, D. (2012) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2011.01010.x · Cited by 567
Reliable ABC model choice via random forests
Pudlo, P., Marin, J.-M., Estoup, A., Cornuet, J.-M., Gautier, M., & Robert, C. P. (2016) · Bioinformatics · doi:10.1093/bioinformatics/btv684 · Cited by 384
“Barnes et al. (2012) developed an interesting methodology to select the summary statistics but with the requirement to aggregate estimation and model pseudo-sufficient statistics for all models. This induces a deeply inefficient dimension inflation and can be very time consuming. It may seem tempting to collect the la…”
BackgroundMethodInfluentialA Comparative Review of Dimension Reduction Methods in Approximate Bayesian Computation
Blum, M. G. B., Nunes, M. A., Prangle, D., & Sisson, S. A. (2013) · Statistical Science · doi:10.1214/12-sts406 · Cited by 353
“s, evaluation of such a performance diagnostic is entirely practicable, as no further model simulations are required. This idea is also relevant to methods of dimension reduction for model selection (Barnes et al. (2012); Estoup et al. (2012)) where a misclassification rate based on a leave-one-out procedure can serve…”
BackgroundMethodQuantification of subclonal selection in cancer from bulk sequencing data
Williams, M. J., Werner, B., Heide, T., Curtis, C., Barnes, C. P., Sottoriva, A., & Graham, T. A. (2018) · Nature Genetics · doi:10.1038/s41588-018-0128-6 · Cited by 261
“In contrast to many applications of ABC that use summary statistics, we use the full data distribution, thus avoiding issues of inconsistent Bayes factors due to loss of information54,55.”
Self-citationApproximate Bayesian computation (ABC) gives exact results under the assumption of model error
Wilkinson, R. D. (2013) · Statistical Applications in Genetics and Molecular Biology · doi:10.1515/sagmb-2013-0010 · Cited by 247
Metadata
- Authors
- Barnes, C. P., Filippi, S., Stumpf, M. P. H., & Thorne, T.
- Affiliations
- Imperial College London (GB)
- Corresponding author
- Stumpf, Michael P. H.
- Venue
- Statistics and Computing
- Published
- 2012-06-09
- Volume
- 22
- Issue
- 6
- Pages
- 1181-1197
- ISSN
- 0960-3174 (ISSN-L)
- 1573-1375
- OpenAlex
- W2066999504
- Cited by
- 61
- References
- 55
- Citations by year
- 2026: 3 · 2025: 2 · 2023: 3 · 2022: 3 · 2021: 6 · 2020: 2 · 2019: 6 · 2018: 7 · 2017: 3 · 2016: 3 · 2015: 7 · 2014: 5 · 2013: 9 · 2012: 2
- FWCI
- 6.70
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Statistics and Computing (publishedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Spiral (Imperial College London) (submittedVersion)
- Funders
- Biotechnology and Biological Sciences Research Council (BB/G007934/1)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Markov Chains and Monte Carlo Methods
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic diversity and population structure
- Keywords
- approximate Bayesian computation, model selection, summary statistics, sufficient statistics, information-theoretic approach, information loss, parameter estimation, simulation-based inference
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.