Model criticism based on likelihood-free inference, with an application to protein network evolution
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
Mathematical models are an important tool to explain and comprehend complex phenomena, and unparalleled computational advances enable us to easily explore them without any or little understanding of their global properties. In fact, the likelihood of the data under complex stochastic models is often analytically or numerically intractable in many areas of sciences. This makes it even more important to simultaneously investigate the adequacy of these models—in absolute terms, against the data, rather than relative to the performance of other models—but no such procedure has been formally discussed when the likelihood is intractable. We provide a statistical interpretation to current developments in likelihood-free Bayesian inference that explicitly accounts for discrepancies between the model and the data, termed A pproximate B ayesian C omputation under m odel u ncertainty (ABCμ). We augment the likelihood of the data with unknown error terms that correspond to freely chosen checking functions, and provide Monte Carlo strategies for sampling from the associated joint posterior distribution without the need of evaluating the likelihood. We discuss the benefit of incorporating model diagnostics within an ABC framework, and demonstrate how this method diagnoses model mismatch and guides model refinement by contrasting three qualitative models of protein network evolution to the protein interaction datasets of Helicobacter pylori and Treponema pallidum. Our results make a number of model deficiencies explicit, and suggest that the T. pallidum network topology is inconsistent with evolution dominated by link turnover or lateral gene transfer alone.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Bernardo, J. M., & Smith, A. F. M. (1994) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316870 · Cited by 2,178
Toni, T., Welch, D., Strelkowa, N., Ipsen, A., & Stumpf, M. P. H. (2009) · Journal of The Royal Society Interface · doi:10.1098/rsif.2008.0172 · Cited by 1,498
Gene Regulatory Networks and the Evolution of Animal Body Plans
Davidson, E. H., & Erwin, D. H. (2006) · Science · doi:10.1126/science.1113832 · Cited by 1,207 · cited 1×
“) Necessarily, all models remain conceptually limited and must be cautiously interpreted; for example, the assumption that the network as a whole evolves at homogeneous rates has been questioned (32).”
BackgroundMarkov chain Monte Carlo without likelihoods
Marjoram, P., Molitor, J., Plagnol, V., & Tavaré, S. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0306899100 · Cited by 1,199 · cited 1×
“With respect to ( i ) , we compared ABC μ with ABC-MCMC (26), zoomABC-MCMC (12), and AUX-ABC (27) on the H. pylori PIN dataset ( SI Appendix , S1.”
MethodModular networks and cumulative impact of lateral transfer in prokaryote genome evolution
Dagan, T., Artzy-Randrup, Y., & Martin, W. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0800679105 · Cited by 409
Approximate Bayesian computation (ABC) gives exact results under the assumption of model error
Wilkinson, R. D. (2013) · Statistical Applications in Genetics and Molecular Biology · doi:10.1515/sagmb-2013-0010 · Cited by 247
Protein-protein interaction networks and biology—what's the connection?
Hakes, L., Pinney, J. W., Robertson, D. L., & Lovell, S. C. (2008) · Nature Biotechnology · doi:10.1038/nbt0108-69 · Cited by 200 · cited 1×
“12, 20, and 21), despite being noisy, incomplete, and static descriptions of the real, transient protein network (22).”
Background
Cited by
Approximate Bayesian Computation (ABC) in practice
Csilléry, K., Blum, M. G. B., Gaggiotti, O. E., & François, O. (2010) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2010.04.001 · Cited by 1,302
Approximate Bayesian Computation in Evolution and Ecology
Beaumont, M. A. (2010) · Annual Review of Ecology, Evolution, and Systematics · doi:10.1146/annurev-ecolsys-102209-144621 · Cited by 1,114
Approximate Bayesian computational methods
Marin, J.-M., Pudlo, P., Robert, C. P., & Ryder, R. J. (2012) · Statistics and Computing · doi:10.1007/s11222-011-9288-2 · Cited by 818
Reconstructing routes of invasion using genetic data: why, how and so what?
ESTOUP, A., & GUILLEMAUD, T. (2010) · Molecular Ecology · doi:10.1111/j.1365-294x.2010.04773.x · Cited by 649
Approximate Bayesian Computation
Sunnåker, M., Busetto, A. G., Numminen, E., Corander, J., Foll, M., & Dessimoz, C. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002803 · Cited by 623
Metadata
- Authors
- Ratmann, O., Andrieu, C., Wiuf, C., & Richardson, S.
- Venue
- Proceedings of the National Academy of Sciences
- Published
- 2009-06-30
- Volume
- 106
- Issue
- 26
- Pages
- 10576-10581
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- OpenAlex
- W2052195764
- Cited by
- 139
- References
- 7
- FWCI
- 13.39
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.