Does Choice in Model Selection Affect Maximum Likelihood Analysis?
Open accessThe DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
In order to have confidence in model-based phylogenetic analysis, the model of nucleotide substitution adopted must be selected in a statistically rigorous manner. Several model-selection methods are applicable to maximum likelihood (ML) analysis, including the hierarchical likelihood-ratio test (hLRT), Akaike information criterion (AIC), Bayesian information criterion (BIC), and decision theory (DT), but their performance relative to empirical data has not been investigated thoroughly. In this study, we use 250 phylogenetic data sets obtained from TreeBASE to examine the effects that choice in model selection has on ML estimation of phylogeny, with an emphasis on optimal topology, bootstrap support, and hypothesis testing. We show that the use of different methods leads to the selection of two or more models for approximately 80% of the data sets and that the AIC typically selects more complex models than alternative approaches. Although ML estimation with different best-fit models results in incongruent tree topologies approximately 50% of the time, these differences are primarily attributable to alternative resolutions of poorly supported nodes. Furthermore, topologies and bootstrap values estimated with ML using alternative statistically supported models are more similar to each other than to topologies and bootstrap values estimated with ML under the Kimura two-parameter (K2P) model or maximum parsimony (MP). In addition, Swofford-Olsen-Waddell-Hillis (SOWH) tests indicate that ML trees estimated with alternative best-fit models are usually not significantly different from each other when evaluated with the same model. However, ML trees estimated with statistically supported models are often significantly suboptimal to ML trees made with the K2P model when both are evaluated with K2P, indicating that not all models perform in an equivalent manner. Nevertheless, the use of alternative statistically supported models generally does not affect tests of monophyletic relationships under either the Shimodaira-Hasegawa (S-H) or SOWH methods. Our results suggest that although choice in model selection has a strong impact on optimal tree topology, it rarely affects evolutionary inferences drawn from the data because differences are mainly confined to poorly supported nodes. Moreover, since ML with alternative best-fit models tends to produce more similar estimates of phylogeny than ML under the K2P model or MP, the use of any statistically based model-selection method is vastly preferable to forgoing the model-selection process altogether.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Multimodel Inference: Understanding AIC and BIC in Model Selection
Burnham, K. P., & Anderson, D. R. (2004) · Sociological Methods & Research · doi:10.1177/0049124104268644 · Cited by 11,648
Regression and time series model selection in small samples
HURVICH, C. M., & TSAI, C.-L. (1989) · Biometrika · doi:10.1093/biomet/76.2.297 · Cited by 6,586
Multiple Comparisons of Log-Likelihoods with Applications to Phylogenetic Inference
Shimodaira, H., & Hasegawa, M. (1999) · Molecular Biology and Evolution · doi:10.1093/oxfordjournals.molbev.a026201 · Cited by 4,237 · cited 2×
“Consequently, we conducted tests of monophyletic relationships in PAUP* using the Shimodaira-Hasegawa (S-H; Shimodaira and Hasegawa, 1999) and SOWH methods under alternative models to determine whether choice in model selection influenced the outcome of these”
MethodModel selection in ecology and evolution
Johnson, J. B., & Omland, K. S. (2004) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2003.10.013 · Cited by 3,838
Bayesian Inference of Phylogeny and Its Impact on Evolutionary Biology
Huelsenbeck, J. P., Ronquist, F., Nielsen, R., & Bollback, J. P. (2001) · Science · doi:10.1126/science.1065889 · Cited by 2,737
Phylogeny Estimation and Hypothesis Testing Using Maximum Likelihood
Huelsenbeck, J. P., & Crandall, K. A. (1997) · Annual Review of Ecology and Systematics · doi:10.1146/annurev.ecolsys.28.1.437 · Cited by 1,018
Statistical tests of models of DNA substitution
Goldman, N. (1993) · Journal of Molecular Evolution · doi:10.1007/bf00166252 · Cited by 736 · cited 2×
“There are currently two methods that evaluate the absolute fit between the model and data: the Goldman-Cox test (Goldman, 1993; Whelan et al., 2001) and posterior predictive simulations (Huelsenbeck et al., 2001; Bollback, 2002).”
MethodModeling compositional heterogeneity
Foster, P. G. (2004) · Systematic Biology · doi:10.1080/10635150490445779 · Cited by 474 · cited 3×
“…2016 http://sysbio.oxfordjournals.org/ D ow nloaded from because of their computational complexity but have been used to assess the absolute fit of models selected by other methods (e.g., Sullivan et al. 2000; Althoff et al., 2006; Bos and Posada, 2005; Carstens et al., 2004, 2005; Foster, 2004).”
MethodResultModel Selection in Phylogenetics
Sullivan, J., & Joyce, P. (2005) · Annual Review of Ecology, Evolution, and Systematics · doi:10.1146/annurev.ecolsys.36.102003.152633 · Cited by 412
Self-citationThe importance of proper model assumption in bayesian phylogenetics.
Lemmon, A. R., & Moriarty, E. C. (2004) · Systematic Biology · doi:10.1080/10635150490423520 · Cited by 356 · cited 1×
“Conversely, if an overly complex model is used, the additional parameters will largely capture stochastic signal and the decreased amount of information available for each calculation will lead to increased variation in parameter estimates and, in extreme cases, to nonidentifiable parameters (Rannala, 2002; Lemmon and…”
Background
Cited by
Tamura, K., Peterson, D., Peterson, N., Stecher, G., Nei, M., & Kumar, S. (2011) · Molecular Biology and Evolution · doi:10.1093/molbev/msr121 · Cited by 39,969
A Rapid Bootstrap Algorithm for the RAxML Web Servers
Stamatakis, A., Hoover, P., & Rougemont, J. (2008) · Systematic Biology · doi:10.1080/10635150802429642 · Cited by 7,028
TANABE, A. S. (2011) · Molecular Ecology Resources · doi:10.1111/j.1755-0998.2011.03021.x · Cited by 749
Alanjary, M., Steinke, K., & Ziemert, N. (2019) · Nucleic Acids Research · doi:10.1093/nar/gkz282 · Cited by 468
Model selection may not be a mandatory step for phylogeny reconstruction
Abadi, S., Azouri, D., Pupko, T., & Mayrose, I. (2019) · Nature Communications · doi:10.1038/s41467-019-08822-w · Cited by 406
Metadata
- Authors
- Ripplinger, J., & Sullivan, J.
- Venue
- Systematic Biology
- Publisher
- Oxford University Press (OUP)
- Published
- 2008-02-01
- Volume
- 57
- Issue
- 1
- Pages
- 76-85
- ISSN
- 1063-5157 (ISSN-L)
- 1076-836X
- OpenAlex
- W2116210362
- Cited by
- 144
- References
- 12
- FWCI
- 4.84
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Does Choice in Model Selection Affect Maximum Likelihood Analysis? https://app.cochat.ai/papers/10.1080/10635150801898920
- The paper
- Ripplinger, J., & Sullivan, J. (2008). Does Choice in Model Selection Affect Maximum Likelihood Analysis? Systematic Biology. https://doi.org/10.1080/10635150801898920
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.