The DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index.
R$^{2}$s for Correlated Data: Phylogenetic Models, LMMs, and GLMMs
Open accessAbstract
Many researchers want to report an $R^{2}$ to measure the variance explained by a model. When the model includes correlation among data, such as phylogenetic models and mixed models, defining an $R^{2}$ faces two conceptual problems. (i) It is unclear how to measure the variance explained by predictor (independent) variables when the model contains covariances. (ii) Researchers may want the $R^{2}$ to include the variance explained by the covariances by asking questions such as "How much of the data is explained by phylogeny?" Here, I investigated three $R^{2}$s for phylogenetic and mixed models. $R^{2}_{resid}$ is an extension of the ordinary least-squares $R^{2}$ that weights residuals by variances and covariances estimated by the model; it is closely related to $R^{2}_{glmm}$ presented by Nakagawa and Schielzeth (2013. A general and simple method for obtaining R2 from generalized linear mixed-effects models. Methods Ecol. Evol. 4:133-142). $R^{2}_{pred}$ is based on predicting each residual from the fitted model and computing the variance between observed and predicted values. $R^{2}_{lik}$ is based on the likelihood of fitted models, and therefore, reflects the amount of information that the models contain. These three $R^{2}$s are formulated as partial $R^{2}$s, making it possible to compare the contributions of predictor variables and variance components (phylogenetic signal and random effects) to the fit of models. Because partial $R^{2}$s compare a full model with a reduced model without components of the full model, they are distinct from marginal $R^{2}$s that partition additive components of the variance. I assessed the properties of the $R^{2}$s for phylogenetic models using simulations for continuous and binary response data (phylogenetic generalized least squares and phylogenetic logistic regression). Because the $R^{2}$s are designed broadly for any model for correlated data, I also compared $R^{2}$s for linear mixed models and generalized linear mixed models. $R^{2}_{resid}$, $R^{2}_{pred}$, and $R^{2}_{lik}$ all have similar performance in describing the variance explained by different components of models. However, $R^{2}_{pred}$ gives the most direct answer to the question of how much variance in the data is explained by a model. $R^{2}_{resid}$ is most appropriate for comparing models fit to different data sets, because it does not depend on sample sizes. And $R^{2}_{lik}$ is most appropriate to assess the importance of different components within the same model applied to the same data, because it is most closely associated with statistical significance tests.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Fitting Linear Mixed-Effects Models Using lme4
Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015) · Journal of Statistical Software · doi:10.18637/jss.v067.i01 · Cited by 86,835
Model selection and multimodel inference: a practical information-theoretic approach.
Guthery, F. S., Burnham, K. P., & Anderson, D. R. (2003) · The Journal of Wildlife Management · doi:10.2307/3802723 · Cited by 41,495
(2005) · Statistics for Biology and Health · doi:10.1007/0-387-27255-0_9 · Cited by 20,133
McCullagh, P., & Nelder, J. A. (1989) · doi:10.1007/978-1-4899-3242-6 · Cited by 16,836
Data Analysis Using Regression and Multilevel/Hierarchical Models
Gelman, A., & Hill, J. (2006) · doi:10.1017/cbo9780511790942 · Cited by 13,597
Limited-dependent and qualitative variables in econometrics
Maddala, G. S. (1983) · Cambridge University Press eBooks · doi:10.1017/cbo9780511810176 · Cited by 13,240
APE: analyses of phylogenetics and evolution in R language
Paradis, E., Claude, J., & Strimmer, K. (2004) · Bioinformatics · doi:10.1093/bioinformatics/btg412 · Cited by 11,335
A general and simple method for obtaining R 2 from generalized linear mixed‐effects models
Nakagawa, S., & Schielzeth, H. (2013) · Methods in Ecology and Evolution · doi:10.1111/j.2041-210x.2012.00261.x · Cited by 10,356
Phylogenies and the Comparative Method
Felsenstein, J. (1985) · The American Naturalist · doi:10.1086/284325 · Cited by 9,793
Generalized linear mixed models: a practical guide for ecology and evolution
Bolker, B. M., Brooks, M. E., Clark, C. J., Geange, S. W., Poulsen, J. R., Stevens, M. H. H., & White, J.-S. S. (2009) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2008.10.008 · Cited by 8,910
A note on a general definition of the coefficient of determination
NAGELKERKE, N. J. D. (1991) · Biometrika · doi:10.1093/biomet/78.3.691 · Cited by 5,927 · cited 1×
“Therefore , Nagelkerke (1991) and Cameron and Windmeijer (1996) proposed dividing by the maximum ˆ f throughout, I have used this standardization.”
MethodBartoń, K. (2010) · CRAN: Contributed Packages · doi:10.32614/cran.package.mumin · Cited by 4,829
TESTING FOR PHYLOGENETIC SIGNAL IN COMPARATIVE DATA: BEHAVIORAL TRAITS ARE MORE LABILE
Blomberg, S. P., Garland, T., & Ives, A. R. (2003) · Evolution · doi:10.1111/j.0014-3820.2003.tb00285.x · Cited by 4,678
Self-citationApproximate Inference in Generalized Linear Mixed Models
Breslow, N. E., & Clayton, D. G. (1993) · Journal of the American Statistical Association · doi:10.1080/01621459.1993.10594284 · Cited by 4,629
Small sample inference for fixed effects from restricted maximum likelihood
Kenward, M. G., & Roger, J. H. (1997) · Biometrics · doi:10.2307/2533558 · Cited by 4,552
The theory and practice of econometrics
(1986) · Journal of Macroeconomics · doi:10.1016/0164-0704(86)90027-3 · Cited by 4,342
(2017) · doi:10.1098/rsif.2017.0213 · Cited by 2,813
Model Selection and Inference: A Practical Information-Theoretic Approach
Beier, P., Burnham, K. P., & Anderson, D. R. (2001) · The Journal of Wildlife Management · doi:10.2307/3803117 · Cited by 2,440
Plackett, R. L., & Cox, D. R. (1971) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2344247 · Cited by 2,264
Procedures for the Analysis of Comparative Data Using Phylogenetically Independent Contrasts
Garland, T., Harvey, P. H., & Ives, A. R. (1992) · Systematic Biology · doi:10.1093/sysbio/41.1.18 · Cited by 2,151
Self-citationGrafen, A. (1989) · Philosophical Transactions of the Royal Society of London. B, Biological Sciences · doi:10.1098/rstb.1989.0106 · Cited by 2,142
Martins, E. P., & Hansen, T. F. (1997) · The American Naturalist · doi:10.1086/286013 · Cited by 1,711
MuMIn : multi-model inference, R package version 0.12.0
Bartoń, K. A. (2009) · Medical Entomology and Zoology · Cited by 1,686
Petersen, K. B., & Pedersen, M. S. (2012) · doi:10.5281/zenodo.8002926 · Cited by 1,434
Estimation in generalized linear models with random effects
SCHALL, R. (1991) · Biometrika · doi:10.1093/biomet/78.4.719 · Cited by 1,243
An R-squared measure of goodness of fit for some common nonlinear regression models
Colin Cameron, A., & Windmeijer, F. A. G. (1997) · Journal of Econometrics · doi:10.1016/s0304-4076(96)01818-0 · Cited by 1,180
Inferring evolutionary processes from phylogenies
PAGEL, M. (1997) · Zoologica Scripta · doi:10.1111/j.1463-6409.1997.tb00423.x · Cited by 1,106
A Linear-Time Algorithm for Gaussian and Non-Gaussian Trait Evolution Models
Tung Ho, L. S., & Ané, C. (2014) · Systematic Biology · doi:10.1093/sysbio/syu005 · Cited by 1,085
Kvålseth, T. O. (1985) · The American Statistician · doi:10.1080/00031305.1985.10479448 · Cited by 990
arm: Data Analysis Using Regression and Multilevel/Hierarchical Models
Gelman, A., & Su, Y.-S. (2007) · CRAN: Contributed Packages · doi:10.32614/cran.package.arm · Cited by 955
Extension of Nakagawa & Schielzeth's R2GLMM to random slopes models
Johnson, P. C. D. (2014) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.12225 · Cited by 948
Lachenbruch, P. A., McCullagh, P., & Nelder, J. A. (1990) · Biometrics · doi:10.2307/2532465 · Cited by 939
Phylogenetic Signal, Evolutionary Process, and Rate
Revell, L. J., Harmon, L. J., & Collar, D. C. (2008) · Systematic Biology · doi:10.1080/10635150802302427 · Cited by 879
Kvalseth, T. O. (1985) · The American Statistician · doi:10.2307/2683704 · Cited by 740
Coefficients of Determination for Multiple Logistic Regression Analysis
Menard, S. (2000) · The American Statistician · doi:10.1080/00031305.2000.10474502 · Cited by 737
Analysis of Phylogenetics and Evolution with R
Paradis, E. (2012) · Springer eBooks · doi:10.1007/978-1-4614-1743-9 · Cited by 692
An R2 statistic for fixed effects in the linear mixed model
Edwards, L. J., Muller, K. E., Wolfinger, R. D., Qaqish, B. F., & Schabenberger, O. (2008) · Statistics in Medicine · doi:10.1002/sim.3429 · Cited by 627
Measuring explained variation in linear mixed effects models
Xu, R. (2003) · Statistics in Medicine · doi:10.1002/sim.1572 · Cited by 541
Phylogenetic Logistic Regression for Binary Dependent Variables
Ives, A. R., & Garland, T. (2010) · Systematic Biology · doi:10.1093/sysbio/syp074 · Cited by 504
Self-citationWithin-Species Variation and Measurement Error in Phylogenetic Comparative Methods
Ives, A. R., Midford, P. E., & Garland, T. (2007) · Systematic Biology · doi:10.1080/10635150701313830 · Cited by 485
Self-citationMETHODS FOR THE ANALYSIS OF COMPARATIVE DATA IN EVOLUTIONARY BIOLOGY
Lynch, M. (1991) · Evolution · doi:10.1111/j.1558-5646.1991.tb04375.x · Cited by 447
Bauwens, D., Garland, T., Castilla, A. M., & Van Damme, R. (1995) · Evolution · doi:10.1111/j.1558-5646.1995.tb02321.x · Cited by 438
An R2statistic for fixed effects in the generalized linear mixed model
Jaeger, B. C., Edwards, L. J., Das, K., & Sen, P. K. (2017) · Journal of Applied Statistics · doi:10.1080/02664763.2016.1193725 · Cited by 399
TESTING FOR PHYLOGENETIC SIGNAL IN COMPARATIVE DATA: BEHAVIORAL TRAITS ARE MORE LABILE
Blomberg, S. P., Garland, T., & Ives, A. R. (2003) · Evolution · doi:10.1554/0014-3820(2003)057[0717:tfpsic]2.0.co;2 · Cited by 369
Self-citationR 2 Measures Based on Wald and Likelihood Ratio Joint Significance Tests
Magee, L. (1990) · The American Statistician · doi:10.1080/00031305.1990.10475731 · Cited by 368
The theory and practice of econometrics
Judge, G. G. (1980) · Cited by 316
R -Squared Measures for Count Data Regression Models With Applications to Health-Care Utilization
Cameron, A. C., & Windmeijer, F. A. G. (1996) · Journal of Business & Economic Statistics · doi:10.1080/07350015.1996.10524648 · Cited by 302
Housworth, E. A., Martins, E. P., & Lynch, M. (2004) · The American Naturalist · doi:10.1086/380570 · Cited by 291
Lavin, S. R., Karasov, W. H., Ives, A. R., Middleton, K. M., & Garland Jr., T. (2008) · Physiological and Biochemical Zoology · doi:10.1086/590395 · Cited by 289
Self-citationGeneralized linear mixed models for phylogenetic analyses of community structure
Ives, A. R., & Helmus, M. R. (2011) · Ecological Monographs · doi:10.1890/10-1264.1 · Cited by 281
Self-citationPinheiro, J. C., & Chao, E. C. (2006) · Journal of Computational and Graphical Statistics · doi:10.1198/106186006x96962 · Cited by 278
QUANTIFYING PHYLOGENETICALLY STRUCTURED ENVIRONMENTAL VARIATION
Desdevises, Y., Legendre, P., Azouzi, L., & Morand, S. (2003) · Evolution · doi:10.1111/j.0014-3820.2003.tb01508.x · Cited by 277
R 2 Measures Based on Wald and Likelihood Ratio Joint Significance Tests
Magee, L. (1990) · The American Statistician · doi:10.2307/2685352 · Cited by 274
Cragg, J. G., & Uhler, R. S. (1970) · The Canadian Journal of Economics · doi:10.2307/133656 · Cited by 240
Bauwens, D., Garland, T., Castilla, A. M., & Damme, R. V. (1995) · Evolution · doi:10.2307/2410408 · Cited by 229
Goodness of Fit in Generalized Least Squares Estimation
Buse, A. (1973) · The American Statistician · doi:10.1080/00031305.1973.10479003 · Cited by 226
General Methods for Evolutionary Quantitative Genetic Inference from Generalized Mixed Models
de Villemereuil, P., Schielzeth, H., Nakagawa, S., & Morrissey, M. (2016) · Genetics · doi:10.1534/genetics.115.186536 · Cited by 223
R-Squared Measures for Count Data Regression Models with Applications to Health-Care Utilization
Cameron, A. C., & Windmeijer, F. A. G. (1996) · Journal of Business & Economic Statistics · doi:10.2307/1392433 · Cited by 218
Fixed-effect variable selection in linear mixed models using statistics
Orelien, J. G., & Edwards, L. J. (2007) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2007.06.006 · Cited by 121
Phylogenetic Regression for Binary Dependent Variables
Ives, A. R., & Garland, T. (2014) · Modern Phylogenetic Comparative Methods and Their Application in Evolutionary Biology · doi:10.1007/978-3-662-43550-2_9 · Cited by 91
Self-citationR2 STATISTICS FOR MIXED MODELS
Kramer, M. (2005) · Conference on Applied Statistics in Agriculture · doi:10.4148/2475-7772.1142 · Cited by 76
Goodness-of-fit measures of R 2 for repeated measures mixed effect models
Liu, H., Zheng, Y., & Shen, J. (2008) · Journal of Applied Statistics · doi:10.1080/02664760802124422 · Cited by 49
Hadfield, J. D. (2015) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.12354 · Cited by 40
Cited by
(2017) · doi:10.1098/rsif.2017.0213 · Cited by 2,813
Vincze, O., Colchero, F., Lemaître, J.-F., Conde, D. A., Pavard, S., Bieuville, M., Urrutia, A. O., Ujvari, B., Boddy, A. M., Maley, C. C., et al. (2022) · Nature · doi:10.1038/s41586-021-04224-5 · Cited by 226
Rubisco Adaptation Is More Limited by Phylogenetic Constraint Than by Catalytic Trade-off
Bouvier, J. W., Emms, D. M., Rhodes, T., Bolton, J. S., Brasnett, A., Eddershaw, A., Nielsen, J. R., Unitt, A., Whitney, S. M., & Kelly, S. (2021) · Molecular Biology and Evolution · doi:10.1093/molbev/msab079 · Cited by 65
A phylogenetic approach to comparative genomics
Dewar, A. E., Belcher, L. J., & West, S. A. (2025) · Nature Reviews Genetics · doi:10.1038/s41576-024-00803-0 · Cited by 41
Metadata
- Authors
- Ives, A. R.
- Venue
- Systematic Biology
- Publisher
- Oxford University Press (OUP)
- Published
- 2018-09-17
- Volume
- 68
- Issue
- 2
- Pages
- 234-251
- ISSN
- 1063-5157 (ISSN-L)
- 1076-836X
- OpenAlex
- W2949965588
- Cited by
- 256
- References
- 63
- FWCI
- 16.93
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.