Why Concatenation Fails Near the Anomaly Zone
Open accessThe DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
Genome-scale sequencing has been of great benefit in recovering species trees but has not provided final answers. Despite the rapid accumulation of molecular sequences, resolving short and deep branches of the tree of life has remained a challenge and has prompted the development of new strategies that can make the best use of available data. One such strategy-the concatenation of gene alignments-can be successful when coupled with many tree estimation methods, but has also been shown to fail when there are high levels of incomplete lineage sorting. Here, we focus on the failure of likelihood-based methods in retrieving a rooted, asymmetric four-taxon species tree from concatenated data when the species tree is in or near the anomaly zone-a region of parameter space where the most common gene tree does not match the species tree because of incomplete lineage sorting. First, we use coalescent theory to prove that most informative sites will support the species tree in the anomaly zone, and that as a consequence maximum-parsimony succeeds in recovering the species tree from concatenated data. We further show that maximum-likelihood tree estimation from concatenated data fails both inside and outside the anomaly zone, and that this failure cannot be easily predicted from the topology of the most common gene tree. We demonstrate that likelihood-based methods often fail in a region partially overlapping the anomaly zone, likely because of the lower relative cost of substitutions on discordant gene tree branches that are absent from the species tree. Our results confirm and extend previous reports on the performance of these methods applied to concatenated data from a rooted, asymmetric four-taxon species tree, and highlight avenues for future work improving the performance of methods aimed at recovering species tree.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Bayesian inference of species trees from multilocus data
Heled, J., & Drummond, A. J. (2010) · Molecular Biology and Evolution · doi:10.1093/molbev/msp274 · Cited by 2,453 · cited 2×
“Indeed, the term “anomaly zone” appears in many papers proposing new tools for inferring species trees, with successful inference within the AZ being showcased as an attractive attribute (e.g., Liu and Pearl 2007; Liu et al. 2009, 2010; Heled and Drummond 2010; Larget et al. 2010; Mirarab and Warnow 2015).”
BackgroundCases in which parsimony or compatibility methods will be positively misleading.
Felsenstein, J. (1978) · Systematic Zoology · doi:10.2307/2412923 · Cited by 2,230
Genome-scale approaches to resolving incongruence in molecular phylogenies.
Rokas, A., Williams, B. L., King, N., & Carroll, S. B. (2003) · Nature · doi:10.1038/nature02053 · Cited by 1,512 · cited 1×
“Initial studies using concatenation yielded highconfidence phylogenies from genes whose individual trees were often discordant (e.g., Soltis et al. 1999; Murphy et al. 2001; Rokas et al. 2003).”
MethodComparative genomics reveals insights into avian genome evolution and adaptation
Zhang, G., Li, C., Li, Q., Li, B., Larkin, D. M., Lee, C., Storz, J. F., Antunes, A., Greenwold, M. J., Meredith, R. W., et al. (2014) · Science · doi:10.1126/science.1251385 · Cited by 1,055
A maximum pseudo-likelihood approach for estimating species trees under the coalescent model
Liu, L., Yu, L., & Edwards, S. V. (2010) · BMC Evolutionary Biology · doi:10.1186/1471-2148-10-302 · Cited by 607
Phylogenomics reveals three sources of adaptive variation during a rapid radiation
Pease, J. B., Haak, D. C., Hahn, M. W., & Moyle, L. C. (2016) · PLOS Biology · doi:10.1371/journal.pbio.1002379 · Cited by 432 · cited 2×
“ILS is relevant to all phylogenetic analyses because it results from an inherent property of natural populations, and has accordingly been shown to be pervasive across the tree of life (e.g., Pollard et al. 2006; White et al. 2009; Hobolth et al. 2011; Brawand et al. 2014; Zhang et al. 2014; Suh et al. 2015; Pease et…”
BackgroundSelf-citationPhilippe, H., Delsuc, F., Brinkmann, H., & Lartillot, N. (2005) · Annual Review of Ecology, Evolution, and Systematics · doi:10.1146/annurev.ecolsys.35.112202.130205 · Cited by 306
Evolutionary inferences from phylogenies: a review of methods
O'Meara, B. C. (2012) · Annual Review of Ecology, Evolution, and Systematics · doi:10.1146/annurev-ecolsys-110411-160331 · Cited by 268 · cited 1×
“Comparative analyses can include inferences about trait evolution, the dynamics of extinction and speciation, and species divergence times (O’Meara 2012; Hahn and Nakhleh 2016).”
BackgroundGene tree discordance causes apparent substitution rate variation
Mendes, F. K., & Hahn, M. W. (2016) · Systematic Biology · doi:10.1093/sysbio/syw018 · Cited by 189
Self-citationIrrational exuberance for resolved species trees: COMMENTARY
Hahn, M. W., & Nakhleh, L. (2016) · Evolution · doi:10.1111/evo.12832 · Cited by 187 · cited 2×
“Comparative analyses can include inferences about trait evolution, the dynamics of extinction and speciation, a and species divergence times (O’Meara 2012; Hahn and Nakhleh 2016).”
BackgroundSelf-citationWu, Y.-C., Rasmussen, M. D., Bansal, M. S., & Kellis, M. (2014) · Genome Research · doi:10.1101/gr.161968.113 · Cited by 77
Cited by
BEAST 2.5: An advanced software platform for Bayesian evolutionary analysis
Bouckaert, R., Vaughan, T. G., Barido-Sottani, J., Duchêne, S., Fourment, M., Gavryushkina, A., Heled, J., Jones, G., Kühnert, D., De Maio, N., et al. (2019) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1006650 · Cited by 4,556
“More specifically, in the anomaly zone, gene tree topological discordance can result in incorrect estimates of the species tree topology [84, 85], and systematic bias in branch length estimates [86].”
BackgroundSelf-citationNew Methods to Calculate Concordance Factors for Phylogenomic Datasets
Minh, B. Q., Hahn, M. W., & Lanfear, R. (2020) · Molecular Biology and Evolution · doi:10.1093/molbev/msaa106 · Cited by 708
Self-citationWhole-genome microsynteny-based phylogeny of angiosperms
Zhao, T., Zwaenepoel, A., Xue, J.-Y., Kao, S.-M., Li, Z., Schranz, M. E., & Van de Peer, Y. (2021) · Nature Communications · doi:10.1038/s41467-021-23665-0 · Cited by 117
The perils of intralocus recombination for inferences of molecular convergence
Mendes, F. K., Livera, A. P., & Hahn, M. W. (2019) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2018.0244 · Cited by 42
Self-citationRevised evolutionary relationships within Brachycera and the early origin of bicoid in flies
Mulhair, P. O., Pennati, A., Herrera-Ubeda, C., & Holland, P. W. H. (2025) · Current Biology · doi:10.1016/j.cub.2025.09.051 · Cited by 2
Metadata
- Authors
- Mendes, F. K., & Hahn, M. W.
- Venue
- Systematic Biology
- Publisher
- Oxford University Press (OUP)
- Published
- 2017-07-11
- Volume
- 67
- Issue
- 1
- Pages
- 158-169
- ISSN
- 1063-5157 (ISSN-L)
- 1076-836X
- OpenAlex
- W2949247626
- Cited by
- 127
- References
- 11
- FWCI
- 4.37
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.