Cited by 315Evolution and Paleontology StudiesMorphological variations and asymmetryGenomics and Phylogenetic Studies

Rethinking phylogenetic comparative methods

Open access
Uyeda, Josef C, Zenil-Ferguson, Rosana, Pennell, Matthew W·2018·Systematic Biology

Published version of a preprint

Abstract

As a result of the process of descent with modification, closely related species tend to be similar to one another in a myriad different ways. In statistical terms, this means that traits measured on one species will not be independent of traits measured on others. Since their introduction in the 1980s, phylogenetic comparative methods (PCMs) have been framed as a solution to this problem. In this article, we argue that this way of thinking about PCMs is deeply misleading. Not only has this sowed widespread confusion in the literature about what PCMs are doing but has led us to develop methods that are susceptible to the very thing we sought to build defenses against-unreplicated evolutionary events. Through three Case Studies, we demonstrate that the susceptibility to singular events is indeed a recurring problem in comparative biology that links several seemingly unrelated controversies. In each Case Study, we propose a potential solution to the problem. While the details of our proposed solutions differ, they share a common theme: unifying hypothesis testing with data-driven approaches (which we term "phylogenetic natural history") to disentangle the impact of singular evolutionary events from that of the factors we are investigating. More broadly, we argue that our field has, at times, been sloppy when weighing evidence in support of causal hypotheses. We suggest that one way to refine our inferences is to re-imagine phylogenies as probabilistic graphical models; adopting this way of thinking will help clarify precisely what we are testing and what evidence supports our claims.

AI snapshot

Written from the paper’s full text.

TL;DR

The paper argues that phylogenetic comparative methods are commonly mischaracterized as solving nonindependence and are instead vulnerable to singular, unreplicated evolutionary events that can generate spurious associations. Through three case studies it recommends combining hypothesis testing with data-driven “phylogenetic natural history” and using graphical models to clarify causal inference.

Key findings

  • Across continuous and discrete comparative methods, a single unreplicated shift can drive significant associations; in Felsenstein’s worst-case simulations, as shift variance relative to BM variance increases, the proportion of significant contrast regressions increases dramatically (each point represents 200 simulations for a fixed phylogeny).
  • Reanalysis of the Scales et al. (2009) data set of fast glycolytic muscle fiber fraction across 22 squamate lizards found the original predator-escape (PE) hypothesis was 13.0 AICc units better than the next closest model (FMPE), but a Bayesian mixture with RJMCMC gave intermediate weight to PE on empirical data and recovered only a single highly supported shift on the stem branch of *Phrynosoma*; combined analysis gave strongest support to a *Phrynosoma*-only model, intermediate support to PE, and little support to the reversible-jump component.
  • For discrete traits under Darwin’s scenario, Pagel’s correlation test statistic reduces to \(D = 2(\ln(T)-\ln(t))\), so support for the dependent model increases with total tree length; simulations on 20-taxon trees matched this prediction.
  • The authors recommend unifying hypothesis testing with data-driven “phylogenetic natural history” and rendering phylogenies as probabilistic graphical models/Bayesian networks to clarify causal assumptions.

Methods

  • Conceptual synthesis with three case studies; no single empirical data set spans all analyses.
  • Case I simulations used a two-clade phylogeny (unresolved or Yule fully bifurcating), two traits under independent Brownian motion with \(\sigma^2 = 1\), and a singular event on a stem branch drawn from a multivariate normal with uncorrelated equal variances that were a scalar multiple of \(\sigma^2\); Case III derived Pagel’s test under Darwin’s scenario and simulated 20-taxon trees in diversitree with irreversible transitions on one randomly chosen internal branch, constrained vs. unconstrained Pagel models, root state 0, and loss rates 0.
  • Case II built a Bayesian mixture model on the R package bayou, reanalyzing the Scales et al. (2009) 22-squamate data set and simulated data sets; expected trait values were a weighted average of a fixed PE regime painting and an RJMCMC-estimated shift configuration, with a truncated Poisson prior on number of shifts (mean 0.5, maximum 10) and a symmetric beta(0.8, 0.8) prior on the weight parameter.

Limitations

  • Stated by the authors: the “singular events” model is primarily illustrative; fitting realistic cases requires estimating the location and number of events; there is no one-size-fits-all solution; many details remain to be worked out and alternative paths were not considered.
  • Stated by the authors: in Case II, vague priors on the number and location of shifts in the reversible-jump analysis reward correctly guessing which branch contains a shift; ascertainment bias is likely prevalent; Darwin’s scenario is a boundary case, and the derivation’s assumptions differ slightly from available software.
  • Evident from the text: Case II is limited to one 22-species lizard data set plus simulated data sets, and Case III’s analytical result assumes traits were selected without first looking at their phylogenetic distribution—a condition the authors say is rarely met.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1093/sysbio/syy031

Cites

127 of 127 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

16 of 68 cited sources checked · 9 supported · 0 flagged · accuracy not yet measured

  • Premisecitation

    Failure to consider alternative models in which the background diversification rate changes across the tree explains support for trait-dependent diversification.

    “The work of Beaulieu and O'Meara (Beaulieu et al. 2013;Beaulieu andO'Meara 2014, 2016) has illuminated important underlying reasons behind Rabosky and Goldberg's findings: the failure to consider alternative models in which the”
    Quote in the paperSubstantial claim1 of 2 sources checked
    • cites Beaulieu et al. 2013 source
    • cites Beaulieu and O'Meara 2016 source
  • Interpretationcitation

    Accounting for background shifts in evolutionary regimes unrelated to the focal trait association is general and applies across comparative biology.

    “We think that the solution proposed by Beaulieu and O'Meara (2016)-accounting for background shifts in evolutionary regimes unrelated to the focal trait association-is general and applies across comparative biology.”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites Beaulieu and O'Meara (2016) source
  • Interpretationcitation

    The Brownian motion model is inconsistent with how we think of the process of adapting to an optimal state.

    “While this model is useful (and has often been used) for testing for adaptation, it is inconsistent with how we think of the process of adapting to an optimal state (Lande 1976;Hansen 1997;Hansen and Orzack 2005;Hansen et al. 2008;Hansen and Bartoszek 2012).”
    Quote in the paperSubstantial claim1 of 2 sources checked
    • cites Lande 1976 source
    • cites Hansen 1997 source
  • Premisecitation

    A wide breadth of macroevolutionary data suggest that abrupt shifts and discontinuities have been a major feature of life on Earth.

    “a wide breadth of macroevolutionary data suggest that abrupt shifts and discontinuities have been a major feature of life on Earth”
    Quote in the paperSubstantial claim3 of 3 sources checked
    • cites Uyeda et al. 2011 source

      The paper’s opening section reports that a model combining rare, substantial bursts of phenotypic change with shorter-term bounded fluctuations best fits its data. But those data chiefly concern body size in mammals, squamates, and birds; they do not establish that abrupt shifts and discontinuities have been a major feature of life on Earth generally. (LLM, conf=0.85)

      Experimental — accuracy not yet measured
    • cites Landis and Schraiber 2017 source

      The Abstract describes evidence of rapid evolutionary pulses in fossil and ecological data, and the Discussion reports that jump models best explained body-size evolution in 32% of the 66 vertebrate clades studied. These passages support abrupt shifts as a feature of evolution, but the claim extends the finding to life on Earth generally; the paper says the prevalence of pulsed evolution across the Tree of Life remains unknown. Page numbers were not available in our copy. (LLM, conf=0.86)

      Experimental — accuracy not yet measured
    • cites Jablonski 2017 source
  • Premisenone given

    Hansen's introduction of the Ornstein-Uhlenbeck process to comparative biology and the suite of methods built on his approach have been the only real attempts to capture the basic dynamics of adaptive trait evolution on phylogenies.

    “Hansen's introduction of the Ornstein-Uhlenbeck (OU) process to comparative biology and the suite of methods built on his approach have been the only real attempts to actually try and capture the basic dynamics of adaptive trait evolution on phylogenies.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites Hansen 1997 source

      In “The Evolutionary Approach to a Primary Optimum” (page unavailable), Hansen identifies his model as an Ornstein–Uhlenbeck process and describes a novel biological interpretation of it. But he explicitly says the process had previously been suggested for comparative studies, so the paper does not support saying he introduced it to comparative biology. The Abstract describes his method, but does not establish that methods built on it were the only attempts to capture adaptive trait evolution on phylogenies. (LLM, conf=0.88)

      Experimental — accuracy not yet measured
  • Classified as probably not a substantial claim. 27
  • May combine two claims. 35
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Tests of adaptive evolution come in two flavors: those with an a priori hypothesis about which lineages belong to which regimes, and those where the locations of regime changes are estimated along with the parameters of the OU process.

    “Tests of adaptive evolution come in two flavors: those with an a priori hypothesis (or hypotheses) regarding which lineages belong to which distinct regimes based on ancestral state reconstruction of explanatory factors (Butler and King 2004;Beaulieu et al. 2012) and those where the locations of regime changes are themselves estimated along with the parameters of the OU process (Ingram and Mahler”
    Quote in the paperNot a substantial claim1 of 2 sources checked
    • cites Butler and King 2004 source
    • cites Ingram and Mahler 2013 source
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Interpretationcitation

    HSMs (following Beaulieu et al. 2013; Beaulieu and O'Meara 2016) are a potentially powerful, and widely applicable solution.

    “For example, we highlighted in the introduction that we think HSMs (following Beaulieu et al. 2013;Beaulieu and O'Meara 2016) are a potentially powerful, and widely applicable solution, even though we did not consider these in detail here.”
    Quote in the paperNot a substantial claim1 of 2 sources checked
    • cites Beaulieu et al. 2013 source
    • cites Beaulieu and O'Meara 2016 source
  • May combine two claims.

    Premisenone given

    Causal reasoning tools have been embraced by computer science, epidemiology and the social sciences, but largely ignored by comparative biologists, with rare exceptions being recent introductions of phylogenetic path analysis and causal models for paleontological time-series.

    “These tools have been embraced by fields such as computer science, epidemiology and the social sciences, but largely ignored by comparative biologists [rare exceptions are the recent introductions of phylogenetic path analysis by Hardenberg and Gonzalez-Voyer (2013) and the application of causal models to make inferences from paleontological time-series by Reitan and Liow (2017)].”
    Quote in the paperSubstantial claim1 of 2 sources checked
    • cites Hardenberg and Gonzalez-Voyer (2013) source
    • cites Reitan and Liow (2017) source
  • Classified as probably not a substantial claim.

    Interpretationcitation

    This fundamental problem has sown doubts about the suitability and reliability of many methods in comparative biology.

    “This fundamental problem has sown doubts about the suitability and reliability of many methods in comparative biology (e.g., Losos 2011), even if it was not obvious that these issues were connected.”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites Losos 2011 source
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationcitation

    Rigorous examination of goodness-of-fit and model adequacy following any comparative analysis is critical for finding unforeseen singular events driving signal in the data set.

    “Furthermore, we also think that rigorous examination of goodness-of-fit and model adequacy following any comparative analysis is critical for finding unforeseen singular events driving signal in the data set (Garland et al. 1992;Boettiger et al. 2012;Slater and Pennell 2013;Pennell et al. 2015).”
    Quote in the paperNot a substantial claim1 of 3 sources checked
    • cites Garland et al. 1992 source
    • cites Boettiger et al. 2012 source

      The Introduction (§1.1; page unavailable) says comparative results can be difficult to interpret without assessing model fit, uncertainty, or power, supporting the value of rigorous evaluation. The cited paper does not say that post-analysis goodness-of-fit or model-adequacy checks reveal unforeseen singular events driving the signal in a dataset. (LLM, conf=0.82)

      Experimental — accuracy not yet measured
    • cites Slater and Pennell 2013 source
  • May combine two claims.

    Findingown data

    Estimating a transformation for the errors will not rescue the analysis; the estimated value lies between 0 and 1, and both OLS and IC are susceptible.

    “We also note that estimating a transformation for the errors (Pagel 1999;Freckleton et al. 2002) will not rescue the analysis; the estimated value of will lie between 0 and 1 and we have found both these more extreme cases (OLS and IC, respectively) to be susceptible.”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites Pagel 1999 source
    • cites Freckleton et al. 2002 source
  • May combine two claims.

    Findingown data

    In the original Scales data set, there are weakly supported shifts in the clades leading to the sister group of Phrynosoma lizards, and the branch leading to Acanthodactylus scutellatus and Aspidoscelis tigris.

    “In the original Scales data set, there are weakly supported shifts in the clades leading to the sister group of Phrynosoma lizards, and the branch leading to Acanthodactylus scutellatus and Aspidoscelis tigris.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Combining all three hypotheses simultaneously by placing a Dirichlet prior on the vector w recovers strongest support for the Phrynosoma-only model, intermediate support for the PE hypothesis, and very little weight on the reversible-jump hypothesis.

    “Doing so recovers strongest support for the Phrynosoma-only model, intermediate support for the PE hypothesis, and very little weight on the reversible-jump hypothesis, which has no strongly supported shifts (Fig. 5).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    IC and Phylogenetic Generalized Least Squares do not completely address the problem of singular evolutionary events; these methods are still susceptible to singular evolutionary events.

    “Here, we revisit Felsenstein's worst-case scenario in order to demonstrate that IC and Phylogenetic Generalized Least Squares (PGLS) do not completely address the problem that we tend to think they do-these methods are still susceptible to singular evolutionary events.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    In the simulated data sets B and C, the correct model receives highest support with neither alternative being well-supported.

    “In B and C, the correct model receives highest support with neither of the alternatives being well-supported.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingreasoning

    The shading of the points indicates cases where the assumption of low gain rates is violated, as outlying points with max(Q) values much greater than 1/T are much more likely to fall off the predicted line.

    “The shading of the points indicates cases where this assumption is violated, as outlying points with max(Q) values much greater than 1/T (where only 1 shift is expected) are much more likely to fall off the predicted line.”
    Quote in the paperNot a substantial claim
    • The authors state this as an assumption: The rates of gain of the traits are so low that only one shift is ever observed (in the Figure 6 analysis).
  • May combine two claims.

    Findingown data

    In the original Scales data set, the Phrynosoma-only hypothesis receives the most weight, indicating a singular shift best explains the patterns observed, while an intermediate weight is given to the PE hypothesis.

    “In the original Scales data set, the Phrynosoma-only hypothesis receives the most weight (indicating a singular shift best explains the patterns observed in the data), while an intermediate weight is given to the PE hypothesis (which explains a good amount of the remaining variation).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingreasoning

    Both networks can produce data sets with phylogenetic signal in both body size and migratory behavior, and both can produce a data set with the distribution in Figure 9D.

    “Therefore, both networks can produce data sets with phylogenetic signal in both body size and migratory behavior, and both can produce a data set with the distribution in Figure 9D (see Supplementary Material available on Dryad for additional details on generating Fig. 9).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    A high posterior probability on a regime shift in the genus Phrynosoma is estimated from the empirical data only, indicating that while the PE hypothesis explains some patterns, it does not fully explain the shift present in Phrynosoma.

    “We estimate a high posterior probability on a regime shift in the genus Phrynosoma from the empirical data only (red circle), indicating that while the PE hypothesis explains some patterns in the data, it does not fully explain the shift present in the behaviorally and ecologically unique genus Phrynosoma.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

    Interpretationreasoning

    The great uncertainty in possible models is incorporated as a prior on the arrangement of shifts and is limited in explanatory power, something that researcher-driven biological hypotheses are much more capable of accomplishing.

    “Rather, the great uncertainty in possible models is incorporated as a prior on the arrangement of shifts and is limited in explanatory power, something that researcher-driven biological hypotheses are much more capable of accomplishing.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationnone given

    Given a large enough tree, a priori hypotheses are likely to be strongly supported; if one can predict which one branch out of many will contain a shift, then one may be on to something.

    “As discussed above, given a large enough tree such a priori hypotheses are likely to be strongly supported; if you can predict which one branch out of many will contain a shift then you may be on to something.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Interpretationcitation

    These scenarios ultimately reduce to whether or not coincident unreplicated events are evidence of a causal link between traits.

    “As with Case Study I, these scenarios ultimately reduce to whether or not coincident unreplicated events are evidence of a causal link between traits (Maddison and FitzJohn 2015), a problem we will address in Case Study III.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Maddison and FitzJohn 2015 source
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    Detecting a signal of evolutionary covariation is more difficult in discrete characters.

    “Detecting a signal of evolutionary covariation is more difficult in discrete characters, but examining this situation isolates the recurring problem we have identified in the two previous Case Studies—whether or not coincident unreplicated events are evidence of causal links between traits.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    The conclusions of Scales et al. (2009) hold up, even when accommodating evolutionary regime shifts unrelated to the factors being considered, although the weight of evidence appears larger than it actually is.

    “Therefore, the conclusions of Scales et al. (2009) hold up, even when accommodating evolutionary regime shifts unrelated to the factors being considered, although the weight of evidence appears to be larger than it actually is.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Scales et al. (2009) source
  • Classified as probably not a substantial claim.

    Premisenone given

    Models that actually describe singular event scenarios are rarely considered in comparative analyses.

    “Furthermore, models that actually describe such scenarios-like our”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Premisecitation

    The problem of nonindependence does not occur if characters respond essentially instantaneously to natural selection in the current environment, so that phylogenetic inertia is essentially absent.

    “Felsenstein also noted that the problem of nonindependence does not occur if”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Felsenstein 1985 source
  • May combine two claims.

    Interpretationreasoning

    Discovering the location of well-supported shifts on the phylogeny does not say anything about causation; it is merely a descriptive technique.

    “In fact, discovering the location of wellsupported shifts on the phylogeny does not say anything about causation; it is merely a descriptive technique to find major features of the data where there is evidence that the parameters governing the dynamics of trait evolution have shifted on the phylogeny.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Multioptima OU models have been widely used to test for shifts in evolutionary regimes.

    “Multioptima OU models have been widely used to test for the presence of shifts in evolutionary regimes (i.e., parts of the phylogeny with their own optima, or less commonly, their own strength of selection parameters).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Butler and King 2004 source
  • May combine two claims.

    Interpretationnone given

    Allowing for unaccounted shifts can provide a stronger test and more nuanced conclusions regarding the support for a particular predictor driving trait evolution across a phylogeny.

    “We show here that allowing for unaccounted shifts can provide a stronger test and more nuanced conclusions regarding the support for a particular predictor driving trait evolution across a phylogeny.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing). May combine two claims.

    Premisenone given

    Hypothesis testing seeks to understand the causes of evolutionary shifts, while data-driven approaches are descriptive and exploratory.

    “The former (hypothesis testing) seeks to understand the causes of evolutionary shifts, while the latter (data driven) is a descriptive and exploratory approach to understanding evolutionary patterns.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    These scenarios do not differ qualitatively from Felsenstein's worst-case scenario nor the Phrynosoma-only model scenario from Case Studies I and II.

    “Note that these scenarios do not differ qualitatively from Felsenstein's worst-case scenario nor the Phrynosoma-only model scenario from Case Studies I and II (Fig. 1).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationown data

    The PE hypothesis has explanatory power beyond simply explaining a singular shift in Phrynosoma and supports the original authors' conclusions.

    “In the case of the PE hypothesis, we show that it does indeed have explanatory power beyond simply explaining a singular shift in Phrynosoma and support the original authors' conclusions.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Interpretationreasoning

    If the signal for the PE hypothesis is driven entirely by singular evolution in Phrynosoma, then any number of causal factors that differ between Phrynosoma and other lizards could be equally as likely as PE.

    “If so, then any number of causal factors that differ between Phrynosoma and other lizards could be equally as likely as PE-including FM with a slight reclassification of character states!”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation

    Most continuous trait models are Gaussian and do not accommodate abrupt, discontinuous shifts in phenotypes.

    “While today we have a much wider range of comparative models to choose from including some that allow for adaptive shifts, most continuous trait models are Gaussian (e.g., Pagel 1999;Blomberg et al. 2003;Butler and King 2004;O'Meara et al. 2006;Eastman et al. 2011;Beaulieu et al. 2012;Uyeda and Harmon 2014) and do not accommodate abrupt, discontinuous shifts in phenotypes.”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites Pagel 1999 source
    • cites Blomberg et al. 2003 source
    • cites Butler and King 2004 source
  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Interpretationnone given

    In all three scenarios, something novel and interesting happened on a single branch and the distribution of traits at the tips of the phylogeny reflects this.

    “In all three scenarios, something novel and interesting happened on a single branch and the distribution of traits at the tips of the phylogeny reflects this.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    The resolution of Simpson's paradox rests entirely on causal assumptions, which are immediately apparent from graphical models but difficult to express with standard mathematical formulae.

    “The resolution of Simpson's paradox rests entirely on causal assumptions; which are immediately apparent from graphical models but difficult to express with standard mathematical formulae.”
    • Also stated in: § CONCLUDING REMARKS: ARE OUR MODELS VALID · plain
      “The resolution of Simpson's paradox rests entirely on causal assumptions; which are immediately apparent from graphical models but difficult to express with standard mathematical formulae.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    In the network where body size influences migratory behavior, all phylogenetic signal comes from the evolution of body size, which becomes irrelevant once body size is observed, so PGLS is not needed.

    “We also note that all the phylogenetic signal is coming from the evolution of body size, which becomes irrelevant once we observe body size, and thus we do not need to perform PGLS.”
    Quote in the paperSubstantial claim
    • The authors state this as an assumption: Body size influences migratory behavior (in the illustrative example).
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationcitation

    One way to gain a foothold on the problem of causation is to build, communicate, and analyze PCMs in a graphical modeling framework.

    “One way to gain a foothold on the problem of causation is to build, communicate, and analyze PCMs in a graphical modeling framework-a perspective that has recently been advocated by Höhna et al. (2014Höhna et al. ( , 2016)).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Höhna et al. (2014, 2016)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Classified as probably not a substantial claim.

    Interpretationnone given

    In Case Study II, the authors present one solution to the problem that involves explicitly accounting for the possibility of unaccounted adaptive shifts using Bayesian Mixture modeling.

    “In Case Study II, we present one solution to the problem that involves explicitly accounting for the possibility of unaccounted adaptive shifts using Bayesian Mixture modeling.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    In the example, a four species phylogeny provides possible pathways for causal effects, but variables may have entirely nonphylogenetic causes or may be blocked from ancestral causes by observed measurements, rendering the phylogeny irrelevant.

    “In our example, a four species phylogeny provides possible pathways for causal effects, but variables may have entirely nonphylogenetic causes or may be blocked from ancestral causes by observed measurements, rendering the phylogeny irrelevant (e.g., Fig. 7A).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    The remarkable coincidence is not just that the two characters happened to evolve on the same branch but that they were never subsequently gained or lost throughout the rest of the tree.

    “The remarkable coincidence is not just that the two characters happened to evolve on the same branch but that they were never subsequently gained or lost throughout the rest of the tree.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    Discontinuous processes and singular events are poorly handled in the current framework and lead to much confusion about what statistical methods allow us to infer from comparative data.

    “We have shown that discontinuous processes and singular events are poorly handled in our current framework and lead to much confusion about what exactly, our statistical methods are allowing us to infer from comparative data.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationown data

    Accounting for the possibility of idiosyncratic evolutionary events will be an essential step towards a solution.

    “As we illustrate through our Case Studies, we think that accounting for the possibility of idiosyncratic evolutionary events will be an essential step towards such a solution.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

    Interpretationreasoning

    Comparative data and the phylogeny underlying it are largely beyond the control of the researcher, but careful consideration of the data is required to understand what research questions can be reasonably answered.

    “This is in large part because comparative data and the phylogeny that underly it are largely beyond the control of the researcher, but careful consideration of the data is required to understand what research questions can be reasonably answered.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    It is common practice among systematists to search for defining and diagnostic characteristics for named clades; these traits are likely the same sorts of traits that researchers might include in comparative analysis, thereby greatly increasing the likelihood of finding traits with independent, unrelated origins that align with Darwin's scenario.

    “For example, it is common practice among systematists to search for defining and diagnostic characteristics for named clades; these traits are of especial interest and are likely the same sorts of traits that are researchers might include in comparative analysis, thereby greatly increasing the likelihood of finding traits with independent, unrelated origins that align with Darwin's scenario.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    Biologists do not shy away from forming causal statements from correlative data regardless.

    “And it is clear from reading the macroevolutionary literature, biologists do not shy away from forming causal statements from correlative data regardless.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationnone given

    Any compelling solution will involve a unification of phylogenetic natural history and hypothesis-testing approaches.

    “but we do think that any compelling solution will involve a unification of phylogenetic natural history and hypothesis-testing approaches.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    The authors ultimately disagree with Maddison and FitzJohn (2015) that finding whether two variables are part of the same adaptive/functional network constitutes a weak conclusion; the challenges of making these inferences from any comparative data set are significant.

    “We ultimately disagree with them that this constitutes a weak conclusion; the challenges of making these inferences from any comparative data set are significant.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Maddison and FitzJohn (2015) source
  • May combine two claims.

    Interpretationnone given

    Intermediate cases will only introduce slight differences and may not be distinguishable from the fully dependent case under Darwin's Scenario.

    “However, such intermediate cases will only introduce slight differences and may not be distinguishable from the fully dependent case under Darwin's Scenario (though they will be important in more intermediate cases, see Supplementary Material available on Dryad).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationnone given

    Understanding the exact mathematical reasons why Pagel's test infers a significant correlation in a given case provides a clear boundary condition that can help develop quantitative corrections for ascertainment bias.

    “Understanding the exact mathematical reasons why Pagel's test infers a significant correlation in a given case provides a clear boundary condition that can help develop quantitative corrections for ascertainment bias.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    If migratory behavior causes changes in body size, then increasing body size will always decrease species abundance.

    “Therefore, we are assured that increasing body size will likewise always decrease species abundance.”
    Quote in the paperSubstantial claim
    • The authors state this as an assumption: Migratory behavior causes changes in body size (in the illustrative example).
  • May combine two claims.

    Interpretationreasoning

    Under network (B), the correct method is PGLS because increasing body size will have no effect on migratory behavior, and unaccounted phylogenetic residual error is present in the observed data.

    “However, under network (B) the correct method is PGLS (gray line) as increasing body size will have no effect on migratory behavior, and unaccounted phylogenetic residual error is present in the observed data.”
    Quote in the paperSubstantial claim
    • The authors state this as an assumption: Migratory behavior causes changes in body size (in the illustrative example).
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    Explicitly including phylogeny in graphical models of causation forces researchers to reckon with the scope of the inference problem and the ability of their data to be informative.

    “By explicitly including phylogeny into our graphical models of causation, we are forced to reckon with the scope of the inference problem and the ability of our data to be informative.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    Under network (A), increasing body size will simultaneously decrease species abundance and increase migratory behavior, which itself increases abundance, leading to a net slight increase in abundance.

    “This is because increasing body size will simultaneously decrease species abundance and increase migratory behavior, which itself increases abundance, leading to a net slight increase in abundance.”
    Quote in the paperSubstantial claim
    • The authors state this as an assumption: Body size influences migratory behavior (in the illustrative example).
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    By making models explicit, the phylogeny is best thought of as a pathway for past factors to causally influence the present-day distribution of observed states.

    “By making our models explicit, we see that the phylogeny is best thought of as a pathway for past factors to causally influence the present-day distribution of observed states.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Interpretationreasoning

    Extending the analytical approach to more complicated scenarios will likely provide an even more meaningful estimate of the weight of evidence supporting a hypothesis of correlation.

    “As a result, extending our analytical approach to more complicated scenarios will likely provide an even more meaningful estimate of the weight of evidence supporting a hypothesis of correlation.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Interpretationcitation

    Maddison and FitzJohn (2015) hinted that the coincident occurrence of single events could be a way of measuring the evidence for a correlation, but did not work out the details as the authors have done here.

    “Maddison and FitzJohn (2015) hinted that the coincident occurrence of single events could be a way of measuring the evidence for a correlation, but did not work out the details as we have done here.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Maddison and FitzJohn (2015) source
  • Classified as probably not a substantial claim.

    Interpretationnone given

    In all three Case Studies, the uniting philosophy is to consider models that account for background shifts in evolutionary regime, rather than strict adherence to a particular methodology.

    “Indeed, we find that in all three Case Studies, the uniting philosophy is to consider models that account for background shifts in evolutionary regime, rather than strict adherence to a particular methodology.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    The issues of ascertainment bias are likely to rapidly dissipate as we move away from the boundary case of Darwin's scenario.

    “Furthermore, the issues of ascertainment bias are likely to rapidly dissipate as we move away from the boundary case of Darwin's scenario.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    From the bird size and abundance example, Westoby et al. were right all along: PCMs are powerful tools for drawing inferences from interspecific data but they necessarily imply some types of causal structures and negate others.

    “However, from our example of bird size and abundance, it is apparent that Westoby et al. were right all along: PCMs are a powerful tools for drawing inferences from interspecific data but they necessarily imply some types of causal structures and negate others.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Premisecitation

    Westoby and colleagues were concerned that including phylogeny in interspecific comparisons necessarily favored some causal explanations over others.

    “Westoby and colleagues were concerned that including phylogeny in interspecific comparisons necessarily favored some causal explanations over others.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Westoby et al. (1995a,b)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

56 of 56
  • The paper relies on this without support.

    Descent with modification causes closely related species to be similar to one another in many traits.

    “As a result of the process of descent with modification, closely related species tend to be similar to one another in a myriad different ways.”
  • The authors state this as an assumption.

    Trait correlations can result from a single random shift drawn from a different distribution than the one used to model trait evolution across the rest of the branches.

    “We can do so by including another phylogenetically plausible model: that trait correlations result from a single random shift, drawn from a different distribution than the one used to model trait evolution across the rest of the branches.”
  • The authors state this as an assumption.

    The macroevolutionary optimum of a particular species is a weighted average of past regimes, as is typical in all OU models with discrete shifts in regimes.

    “we consider the macroevolutionary optimum of a particular species to be a weighted average of past regimes, as is typical in all OU models with discrete shifts in regimes (Butler and King 2004;Beaulieu et al. 2012)”
  • The authors state this as an assumption.

    The traits were selected for study without first looking at their phylogenetic distribution.

    “we assume that the traits were selected for study without first looking at their phylogenetic distribution, a condition that we (as well as Maddison and FitzJohn 2015) suspect is rarely met in practice”
  • The authors state this as an assumption.

    The likelihood of evolving these traits at all is quite small.

    “we can make the assumption that the likelihood of evolving these traits at all is quite small”
  • The authors state this as an assumption.

    Under Markovian assumptions, replaying the tape of life will likely lead to many worlds where milk and middle ear bones don't exist at all.

    “In other words, replaying the tape of life, under Markovian assumptions, will likely lead to many worlds where milk and middle ear bones don't exist at all.”
  • The authors state this as an assumption.

    The rates of gain of the traits are so low that only one shift is ever observed.

    “Particularly, we assume that the rates of gain of the traits are so low that only one shift is ever observed.”
  • The authors state this as an assumption.

    Ancestors are causes of descendants, and not vice versa.

    “the nature of phylogenies allows us to assume that ancestors are causes of descendants, and not vice versa”
  • The authors state this as an assumption.

    Body size influences migratory behavior (in the illustrative example).

    “If we assume that body size influences migratory behavior”
  • The authors state this as an assumption.

    Migratory behavior causes changes in body size (in the illustrative example).

    “if migratory behavior causes changes in body size”
  • The authors state this as an assumption.

    The rates of gain of the traits are so low that only one shift is ever observed (in the Figure 6 analysis).

    “we assume that the rates of gain of the traits are so low that only one shift is ever observed”
11 of 11

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Very large datasets will almost always produce significant P-values, even if the estimated effect size is relatively small.

    “Hence, in the extreme, very large datasets will almost always produce significant P-values, even if the estimated effect size is relatively small122 (Fig. 4).”

    From A phylogenetic approach to comparative genomics (2025) · cites this paper as [122]

    Case Study I reports significant regressions driven by a single phylogenetic shift, with significance increasing as the size of that shift increases. It does not say that very large datasets almost always yield significant P-values despite small estimated effects. Searches for sample size, P-values, and effect size did not find that relationship in our copy; the supplied passages have no page numbers. (LLM, conf=0.74)

    Experimental — accuracy not yet measured

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Uyeda, J. C., Zenil-Ferguson, R., & Pennell, M. W.
Affiliations
  • Virginia Tech (US)
  • Department of Biological Sciences, University of Idaho, 875 Perimeter Drive, Moscow, ID 83844 USA
  • University of British Columbia (CA)
Corresponding author
Uyeda, Josef C
Venue
Systematic Biology
Published
2018-04-25
Volume
67
Issue
6
Pages
1091-1109
ISSN
  • 1063-5157 (ISSN-L)
  • 1076-836X
OpenAlex
W2951967147
Cited by
313
References
113
Citations by year
2026: 23 · 2025: 40 · 2024: 39 · 2023: 53 · 2022: 37 · 2021: 40 · 2020: 24 · 2019: 39 · 2018: 16 · 2017: 1
FWCI
22.03
Type
journal article
Language
en
Open access
Locations
  • Systematic Biology (publishedVersion)
  • bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by-nc)
  • PubMed (publishedVersion)
Funders
  • NSERC Discovery
  • NSF (DEB-1208912, DBI-1661516)
Topics
  • Physical Sciences › Earth and Planetary Sciences › Paleontology › Evolution and Paleontology Studies
  • Physical Sciences › Mathematics › Geometry and Topology › Morphological variations and asymmetry
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Genomics and Phylogenetic Studies
Keywords
phylogenetic comparative analysis, hypothesis testing, causal inference, probabilistic graphical models, phylogeny, comparative biology
MeSH terms
Classification, Phylogeny

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-11-02.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-11-02.

Cited sources are checked by gpt-6-sol.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review