The DOI matches its Crossref record; 84 of the 85 references it cites were found in a registry or an index.
Repeatability for Gaussian and non-Gaussian data: a practical guide for biologists.
Abstract
Repeatability (more precisely the common measure of repeatability, the intra-class correlation coefficient, ICC) is an important index for quantifying the accuracy of measurements and the constancy of phenotypes. It is the proportion of phenotypic variation that can be attributed to between-subject (or between-group) variation. As a consequence, the non-repeatable fraction of phenotypic variation is the sum of measurement error and phenotypic flexibility. There are several ways to estimate repeatability for Gaussian data, but there are no formal agreements on how repeatability should be calculated for non-Gaussian data (e.g. binary, proportion and count data). In addition to point estimates, appropriate uncertainty estimates (standard errors and confidence intervals) and statistical significance for repeatability estimates are required regardless of the types of data. We review the methods for calculating repeatability and the associated statistics for Gaussian and non-Gaussian data. For Gaussian data, we present three common approaches for estimating repeatability: correlation-based, analysis of variance (ANOVA)-based and linear mixed-effects model (LMM)-based methods, while for non-Gaussian data, we focus on generalised linear mixed-effects models (GLMM) that allow the estimation of repeatability on the original and on the underlying latent scale. We also address a number of methods for calculating standard errors, confidence intervals and statistical significance; the most accurate and recommended methods are parametric bootstrapping, randomisation tests and Bayesian approaches. We advocate the use of LMM- and GLMM-based approaches mainly because of the ease with which confounding variables can be controlled for. Furthermore, we compare two types of repeatability (ordinary repeatability and extrapolated repeatability) in relation to narrow-sense heritability. This review serves as a collection of guidelines and recommendations for biologists to calculate repeatability and heritability from both Gaussian and non-Gaussian data.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The survey was based on the validated International Hospital Outcomes Study questionnaire. 25”
From Nurses’ Shift Length and Overtime Working in 12 European Countries: The Association With Perceived Quality of Care and Patient Safety (2014) · cites this paper as [25]
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2000) · doi:10.32614/r.manuals · Cited by 355,893
Modern Applied Statistics with S
Venables, W. N., & Ripley, B. D. (2002) · Statisctics and computing/Statistics and computing · doi:10.1007/978-0-387-21706-2 · Cited by 25,941
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
Introduction to Quantitative Genetics.
Edwards, A. W. F., & Falconer, D. S. (1982) · Biometrics · doi:10.2307/2529912 · Cited by 21,447
Biometry: The Principles and Practice of Statistics in Biological Research
Sokal, R. R., & Rohlf, F. J. (1969) · Cited by 20,963
Data Analysis Using Regression and Multilevel/Hierarchical Models
Gelman, A., & Hill, J. (2006) · doi:10.1017/cbo9780511790942 · Cited by 13,597
Generalized linear mixed models: a practical guide for ecology and evolution
Bolker, B. M., Brooks, M. E., Clark, C. J., Geange, S. W., Poulsen, J. R., Stevens, M. H. H., & White, J.-S. S. (2009) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2008.10.008 · Cited by 8,910
Forming inferences about some intraclass correlation coefficients.
McGraw, K. O., & Wong, S. P. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.1.30 · Cited by 6,903
Genetics and Analysis of Quantitative Traits
(2002) · Journal of Animal Breeding and Genetics · doi:10.1046/j.1439-0388.2002.00356.x · Cited by 6,176
MCMC Methods for Multi-Response Generalized Linear Mixed Models: The MCMCglmm R Package
Hadfield, J. D. (2010) · Journal of Statistical Software · doi:10.18637/jss.v033.i02 · Cited by 4,900
Research works printed but not linked: 3
- Becker W. A.(1992).A manual of quantitative genetics 5th edition. Academic Enterprises Pullman WA.
- Faraway J. J., 2006, Extending the linear model
- Snijders T. A. B., 1999, Multilevel analysis: an introduction to basic and advanced multilevel modeling.
Cited by
Sorted by citations
A general and simple method for obtaining R 2 from generalized linear mixed‐effects models
Nakagawa, S., & Schielzeth, H. (2013) · Methods in Ecology and Evolution · doi:10.1111/j.2041-210x.2012.00261.x · Cited by 10,356
Multimodel inference in ecology and evolution: challenges and solutions
Grueber, C. E., Nakagawa, S., Laws, R., & Jamieson, I. G. (2011) · Journal of Evolutionary Biology · doi:10.1111/j.1420-9101.2010.02210.x · Cited by 2,355
A brief introduction to mixed effects modelling and multi-model inference in ecology
Harrison, X. A., Donaldson, L., Correa-Cano, M. E., Evans, J., Fisher, D. N., Goodwin, C. E. D., Robinson, B. S., Hodgson, D. J., & Inger, R. (2018) · PeerJ · doi:10.7717/peerj.4794 · Cited by 2,094
rptR: repeatability estimation and variance decomposition by generalized linear mixed‐effects models
Stoffel, M. A., Nakagawa, S., & Schielzeth, H. (2017) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.12797 · Cited by 1,779
Metadata
- Authors
- Nakagawa, S., & Schielzeth, H.
- Affiliations
- Max Planck Society (DE)
- Corresponding author
- Nakagawa, Shinichi
- Schielzeth, Holger
- Venue
- Biological Reviews
- Publisher
- Wiley
- Published
- 2010-06-21
- Volume
- 85
- Issue
- 4
- Pages
- 935-956
- ISSN
- 0006-3231 (ISSN-L)
- 1464-7931
- 1469-185X
- OpenAlex
- W2045443942
- Cited by
- 2,584
- References
- 85
- Citations by year
- 2026: 109 · 2025: 165 · 2024: 141 · 2023: 171 · 2022: 235 · 2021: 222 · 2020: 206 · 2019: 197 · 2018: 215 · 2017: 198 · 2016: 183 · 2015: 167 · 2014: 136 · 2013: 107 · 2012: 78
- FWCI
- 8.27
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Biological reviews/Biological reviews of the Cambridge Philosophical Society (publishedVersion)
- PubMed (publishedVersion)
- PUB – Publications at Bielefeld University (Bielefeld University) (submittedVersion)
- MPG.PuRe (Max Planck Society) (submittedVersion)
- Topics
- Life Sciences › Agricultural and Biological Sciences › Ecology, Evolution, Behavior and Systematics › Animal Behavior and Reproduction
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
- Life Sciences › Agricultural and Biological Sciences › Ecology, Evolution, Behavior and Systematics › Morphological variations and asymmetry
- Keywords
- repeatability, intraclass correlation coefficient, non-Gaussian data, linear mixed models, measurement error, phenotypic flexibility, statistical significance, parametric bootstrapping, permutation tests, Bayesian approach, narrow-sense heritability, binary data, count data, proportion data
- MeSH terms
- Analysis of Variance, Phenotype, Regression Analysis, Statistics as Topic, Reproducibility of Results, Confidence Intervals, Normal Distribution, Linear Models, Least-Squares Analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review