Cited by 2,584Animal Behavior and ReproductionReliability and Agreement in MeasurementMorphological variations and asymmetry

The DOI matches its Crossref record; 84 of the 85 references it cites were found in a registry or an index.

Repeatability for Gaussian and non-Gaussian data: a practical guide for biologists.

Nakagawa, Shinichi, Schielzeth, Holger·2010·Biological Reviews

DOI 10.1111/j.1469-185x.2010.00141.x

Open this paper in CoChat — free account

Abstract

Repeatability (more precisely the common measure of repeatability, the intra-class correlation coefficient, ICC) is an important index for quantifying the accuracy of measurements and the constancy of phenotypes. It is the proportion of phenotypic variation that can be attributed to between-subject (or between-group) variation. As a consequence, the non-repeatable fraction of phenotypic variation is the sum of measurement error and phenotypic flexibility. There are several ways to estimate repeatability for Gaussian data, but there are no formal agreements on how repeatability should be calculated for non-Gaussian data (e.g. binary, proportion and count data). In addition to point estimates, appropriate uncertainty estimates (standard errors and confidence intervals) and statistical significance for repeatability estimates are required regardless of the types of data. We review the methods for calculating repeatability and the associated statistics for Gaussian and non-Gaussian data. For Gaussian data, we present three common approaches for estimating repeatability: correlation-based, analysis of variance (ANOVA)-based and linear mixed-effects model (LMM)-based methods, while for non-Gaussian data, we focus on generalised linear mixed-effects models (GLMM) that allow the estimation of repeatability on the original and on the underlying latent scale. We also address a number of methods for calculating standard errors, confidence intervals and statistical significance; the most accurate and recommended methods are parametric bootstrapping, randomisation tests and Bayesian approaches. We advocate the use of LMM- and GLMM-based approaches mainly because of the ease with which confounding variables can be controlled for. Furthermore, we compare two types of repeatability (ordinary repeatability and extrapolated repeatability) in relation to narrow-sense heritability. This review serves as a collection of guidelines and recommendations for biologists to calculate repeatability and heritability from both Gaussian and non-Gaussian data.

Integrity signals

Registry

Crossref · 10.1111/j.1469-185x.2010.00141.x

Cites

84 of 84 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

R: A Language and Environment for Statistical Computing
R Core Team (2000) · doi:10.32614/r.manuals · Cited by 355,893
Modern Applied Statistics with S
Venables, W. N., & Ripley, B. D. (2002) · Statisctics and computing/Statistics and computing · doi:10.1007/978-0-387-21706-2 · Cited by 25,941
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
Introduction to Quantitative Genetics.
Edwards, A. W. F., & Falconer, D. S. (1982) · Biometrics · doi:10.2307/2529912 · Cited by 21,447
Biometry: The Principles and Practice of Statistics in Biological Research
Sokal, R. R., & Rohlf, F. J. (1969) · Cited by 20,963
Data Analysis Using Regression and Multilevel/Hierarchical Models
Gelman, A., & Hill, J. (2006) · doi:10.1017/cbo9780511790942 · Cited by 13,597
Generalized linear mixed models: a practical guide for ecology and evolution
Bolker, B. M., Brooks, M. E., Clark, C. J., Geange, S. W., Poulsen, J. R., Stevens, M. H. H., & White, J.-S. S. (2009) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2008.10.008 · Cited by 8,910
Forming inferences about some intraclass correlation coefficients.
McGraw, K. O., & Wong, S. P. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.1.30 · Cited by 6,903
Genetics and Analysis of Quantitative Traits
(2002) · Journal of Animal Breeding and Genetics · doi:10.1046/j.1439-0388.2002.00356.x · Cited by 6,176
MCMC Methods for Multi-Response Generalized Linear Mixed Models: The MCMCglmm R Package
Hadfield, J. D. (2010) · Journal of Statistical Software · doi:10.18637/jss.v033.i02 · Cited by 4,900

Show all 85 references

Research works printed but not linked: 3

Becker W. A.(1992).A manual of quantitative genetics 5th edition. Academic Enterprises Pullman WA.
Faraway J. J., 2006, Extending the linear model
Snijders T. A. B., 1999, Multilevel analysis: an introduction to basic and advanced multilevel modeling.

Sorted by citations

A general and simple method for obtaining R 2 from generalized linear mixed‐effects models
Nakagawa, S., & Schielzeth, H. (2013) · Methods in Ecology and Evolution · doi:10.1111/j.2041-210x.2012.00261.x · Cited by 10,356
The coefficient of determination R 2 and intra-class correlation coefficient from generalized linear mixed-effects models revisited and expanded
(2017) · doi:10.1098/rsif.2017.0213 · Cited by 2,813
Multimodel inference in ecology and evolution: challenges and solutions
Grueber, C. E., Nakagawa, S., Laws, R., & Jamieson, I. G. (2011) · Journal of Evolutionary Biology · doi:10.1111/j.1420-9101.2010.02210.x · Cited by 2,355
A brief introduction to mixed effects modelling and multi-model inference in ecology
Harrison, X. A., Donaldson, L., Correa-Cano, M. E., Evans, J., Fisher, D. N., Goodwin, C. E. D., Robinson, B. S., Hodgson, D. J., & Inger, R. (2018) · PeerJ · doi:10.7717/peerj.4794 · Cited by 2,094
rptR: repeatability estimation and variance decomposition by generalized linear mixed‐effects models
Stoffel, M. A., Nakagawa, S., & Schielzeth, H. (2017) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.12797 · Cited by 1,779
The reliability paradox: Why robust cognitive tasks do not produce reliable individual differences
Hedge, C., Powell, G., & Sumner, P. (2018) · Behavior Research Methods · doi:10.3758/s13428-017-0935-1 · Cited by 1,457
Robustness of linear mixed-effects models to violations of distributional assumptions
Schielzeth, H., Dingemanse, N. J., Nakagawa, S., Westneat, D. F., Allegue, H., Teplitsky, C., Réale, D., Dochtermann, N. A., Garamszegi, L. Z., & Araya‐Ajoy, Y. G. (2020) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.13434 · Cited by 1,393
“The expected phenotypic variance was 2 P = 2 + 2 + 2 1 2 x 1 + 2 2 2 x 2 = 1.08 (Allegue et al., 2017), the expected unadjusted repeatability was thus 2 ∕ 2 P = 0.46, and the expected adjusted repeatability was thus Radj = 2 2 + 2 = 0.5 (Nakagawa & Schielzeth, 2010).”
InfluentialSelf-citation
Quantifying individual variation in behaviour: mixed‐effect modelling approaches
Dingemanse, N. J., & Dochtermann, N. A. (2012) · Journal of Animal Ecology · doi:10.1111/1365-2656.12013 · Cited by 1,084
Extension of Nakagawa & Schielzeth's R2GLMM to random slopes models
Johnson, P. (2014) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.12225 · Cited by 952
Constructing, conducting and interpreting animal social network analysis
Farine, D. R., & Whitehead, H. (2015) · Journal of Animal Ecology · doi:10.1111/1365-2656.12418 · Cited by 966
Intraclass correlation – A discussion and demonstration of basic features
Liljequist, D., Elfving, B., & Roaldsen, K. S. (2019) · PLoS ONE · doi:10.1371/journal.pone.0219854 · Cited by 910
variancePartition: interpreting drivers of variation in complex gene expression studies
Hoffman, G. E., & Schadt, E. E. (2016) · BMC Bioinformatics · doi:10.1186/s12859-016-1323-z · Cited by 769
Test-retest reliabilities of resting-state FMRI measurements in human brain functional connectomics: A systems neuroscience perspective
Zuo, X., & Xing, X.-X. (2014) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2014.05.009 · Cited by 678
Between-individual differences in behavioural plasticity within populations: causes and consequences
Dingemanse, N. J., & Wolf, M. (2013) · Animal Behaviour · doi:10.1016/j.anbehav.2012.12.032 · Cited by 458
Nested by design: model fitting and interpretation in a mixed model era
Schielzeth, H., & Nakagawa, S. (2013) · Methods in Ecology and Evolution · doi:10.1111/j.2041-210x.2012.00251.x · Cited by 394
partR2 : partitioning R 2 in generalized linear mixed models
Stoffel, M. A., Nakagawa, S., & Schielzeth, H. (2021) · PeerJ · doi:10.7717/peerj.11414 · Cited by 434
Consistent Individual Differences Drive Collective Behavior and Group Functioning of Schooling Fish
Jolles, J. W., Boogert, N. J., Sridhar, V. H., Couzin, I. D., & Manica, A. (2017) · Current Biology · doi:10.1016/j.cub.2017.08.004 · Cited by 363
Individual improvements and selective mortality shape lifelong migratory performance
Sergio, F., Tanferna, A., de Stephanis, R., López, L., Blas, J., Tavecchia, G., Preatoni, D. G., & Hiraldo, F. (2014) · Nature · doi:10.1038/nature13696 · Cited by 353
Cognitive performance is linked to group size and affects fitness in Australian magpies
Ashton, B. J., Ridley, A. R., Edwards, E. K., & Thornton, A. (2018) · Nature · doi:10.1038/nature25503 · Cited by 336
Nurses’ Shift Length and Overtime Working in 12 European Countries: The Association With Perceived Quality of Care and Patient Safety
Griffiths, P., Dall’Ora, C., Simon, M., Ball, J., Lindqvist, R., Rafferty, A.-M., Schoonhoven, L., Tishelman, C., & Aiken, L. H. (2014) · Medical Care · doi:10.1097/mlr.0000000000000233 · Cited by 316
“It also indicates the proportion of variance in the outcome that can be attributed to variation between groups (wards, hospitals, countries) as opposed to between individuals.(30) The association of shift length and overtime with the outcome measures was estimated through a binomial generalized linear mixed model.”
Method
Studying the evolutionary ecology of cognition in the wild: a review of practical and conceptual challenges
Morand‐Ferron, J., Cole, E. F., & Quinn, J. L. (2015) · Biological reviews/Biological reviews of the Cambridge Philosophical Society · doi:10.1111/brv.12174 · Cited by 290
Stability of the human faecal microbiome in a cohort of adult men
Mehta, R. S., Abu-Ali, G. S., Drew, D. A., Lloyd-Price, J., Subramanian, A., Lochhead, P., Joshi, A. D., Ivey, K. L., Khalili, H., Brown, G. T., et al. (2018) · Nature Microbiology · doi:10.1038/s41564-017-0096-0 · Cited by 273
To boldly go: individual differences in boldness influence migratory tendency
Chapman, B. B., Hulthén, K., Blomqvist, D. R., Hansson, L., Nilsson, J., Brodersen, J., Nilsson, P. A., Skov, C., & Brönmark, C. (2011) · Ecology Letters · doi:10.1111/j.1461-0248.2011.01648.x · Cited by 276
Structural tract alterations predict downstream tau accumulation in amyloid-positive older individuals
Jacobs, H. I. L., Hedden, T., Schultz, A. P., Sepulcre, J., Perea, R. D., Amariglio, R. E., Papp, K. V., Rentz, D. M., Sperling, R. A., & Johnson, K. A. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0070-z · Cited by 270
Lifetime development of behavioural phenotype in the house mouse (Mus musculus)
Brust, V., Schindler, P. M., & Lewejohann, L. (2015) · Frontiers in Zoology · doi:10.1186/1742-9994-12-s1-s17 · Cited by 287
Nonindependence and sensitivity analyses in ecological and evolutionary meta‐analyses
Noble, D. W. A., Lagisz, M., O’Dea, R. E., & Nakagawa, S. (2017) · Molecular Ecology · doi:10.1111/mec.14031 · Cited by 273
Urbanization and its effects on personality traits: a result of microevolution or phenotypic plasticity?
Miranda, A. C., Schielzeth, H., Sonntag, T., & Partecke, J. (2013) · Global Change Biology · doi:10.1111/gcb.12258 · Cited by 286
Measuring and understanding individual differences in cognition
Boogert, N. J., Madden, J. R., Morand‐Ferron, J., & Thornton, A. (2018) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2017.0280 · Cited by 288
Variation in personality and behavioural plasticity across four populations of the great tit Parus major
Dingemanse, N. J., Bouwman, K. M., van de Pol, M., van Overveld, T., Patrick, S. C., Matthysen, E., & Quinn, J. L. (2011) · Journal of Animal Ecology · doi:10.1111/j.1365-2656.2011.01877.x · Cited by 257
Comparing parent–offspring regression with frequentist and Bayesian animal models to estimate heritability in wild populations: a simulation study for Gaussian and binary traits
de Villemereuil, P., Giménez, O., & Doligez, B. (2012) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.12011 · Cited by 247
We need to talk about reliability: making better use of test-retest studies for study design and interpretation
Matheson, G. J. (2019) · PeerJ · doi:10.7717/peerj.6918 · Cited by 246
A practical guide for inferring reliable dominance hierarchies and estimating their uncertainty
Sánchez‐Tójar, A., Schroeder, J., & Farine, D. R. (2017) · Journal of Animal Ecology · doi:10.1111/1365-2656.12776 · Cited by 247
How not to measure boldness: novel object and antipredator responses are not the same in wild baboons
Carter, A. J., Marshall, H. H., Heinsohn, R., & Cowlishaw, G. (2012) · Animal Behaviour · doi:10.1016/j.anbehav.2012.06.015 · Cited by 227
General Methods for Evolutionary Quantitative Genetic Inference from Generalized Mixed Models
de Villemereuil, P., Schielzeth, H., Nakagawa, S., & Morrissey, M. B. (2016) · Genetics · doi:10.1534/genetics.115.186536 · Cited by 226
Quantitative evidence synthesis: a practical guide on meta-analysis, meta-regression, and publication bias tests for environmental sciences
Nakagawa, S., Yang, Y., Macartney, E. L., Spake, R., & Lagisz, M. (2023) · Environmental Evidence · doi:10.1186/s13750-023-00301-6 · Cited by 242
“By seeing I2 as a type of interclass correlation (also known as repeatability [65],), we can generalize I2 to multilevel models.”
Background
Larger groups of passerines are more efficient problem solvers in the wild
Morand‐Ferron, J., & Quinn, J. L. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1111560108 · Cited by 211
Defining behavioural syndromes and the role of ‘syndrome deviation’ in understanding their evolution
Dingemanse, N. J., Dochtermann, N. A., & Nakagawa, S. (2012) · Behavioral Ecology and Sociobiology · doi:10.1007/s00265-012-1416-2 · Cited by 211
Is risk taking during foraging a personality trait? A field test for cross-context consistency in boldness
Dammhahn, M., & Almeling, L. (2012) · Animal Behaviour · doi:10.1016/j.anbehav.2012.08.014 · Cited by 208
Two sides of a coin: ecological and chronobiological perspectives of timing in the wild
Helm, B., Visser, M. E., Schwartz, W. J., Kronfeld‐Schor, N., Gerkema, M. P., Piersma, T., & Bloch, G. (2017) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2016.0246 · Cited by 216
Demystifying animal ‘personality’ (or not): why individual variation matters to experimental biologists
Roche, D. G., Careau, V., & Binning, S. A. (2016) · Journal of Experimental Biology · doi:10.1242/jeb.146712 · Cited by 218
Individual Variation in Parental Care Reaction Norms: Integration of Personality and Plasticity
Westneat, D. F., Hatch, M. I., Wetzel, D., & Ensminger, A. L. (2011) · The American Naturalist · doi:10.1086/662173 · Cited by 205
Endocrine mechanisms, behavioral phenotypes and plasticity: known relationships and open questions
Hau, M., & Goymann, W. (2015) · Frontiers in Zoology · doi:10.1186/1742-9994-12-s1-s7 · Cited by 201
Long‐term individual foraging site fidelity—why some gannets don't change their spots
Wakefield, E. D., Cleasby, I. R., Bearhop, S., Bodey, T. W., Davies, R., Miller, P. I., Newton, J., Votier, S. C., & Hamer, K. C. (2015) · Ecology · doi:10.1890/14-1300.1 · Cited by 188
Behavioural individuality in clonal fish arises despite near-identical rearing conditions
Bierbach, D., Laskowski, K., & Wolf, M. (2017) · Nature Communications · doi:10.1038/ncomms15361 · Cited by 193
Restless roosts: Light pollution affects behavior, sleep, and physiology in a free‐living songbird
Ouyang, J. Q., de Jong, M., van Grunsven, R. H. A., Matson, K. D., Haussmann, M. F., Meerlo, P., Visser, M. E., & Spoelstra, K. (2017) · Global Change Biology · doi:10.1111/gcb.13756 · Cited by 185
An approach to estimate short‐term, long‐term and reaction norm repeatability
Araya‐Ajoy, Y. G., Mathot, K. J., & Dingemanse, N. J. (2015) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.12430 · Cited by 184
Early Childhood Educators’ Self-Efficacy in Science, Math, and Literacy Instruction and Science Practice in the Classroom
Gerde, H. K., Pierce, S. J., Lee, K., & Egeren, L. A. V. (2017) · Early Education and Development · doi:10.1080/10409289.2017.1360127 · Cited by 185
Quantifying the predictability of behaviour: statistical approaches for the study of between‐individual variation in the within‐individual variance
Cleasby, I. R., Nakagawa, S., & Schielzeth, H. (2014) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.12281 · Cited by 180
The town bird and the country bird: problem solving and immunocompetence vary with urbanization
Audet, J., Ducatez, S., & Lefebvre, L. (2015) · Behavioral Ecology · doi:10.1093/beheco/arv201 · Cited by 177
Individual‐based measurements of light intensity provide new insights into the effects of artificial light at night on daily rhythms of urban‐dwelling songbirds
Dominoni, D. M., Carmona‐Wagner, E. O., Hofmann, M. M., Kranstauber, B., & Partecke, J. (2013) · Journal of Animal Ecology · doi:10.1111/1365-2656.12150 · Cited by 175
Glucocorticoid-Mediated Phenotypes in Vertebrates
Hau, M., Casagrande, S., Ouyang, J. Q., & Baugh, A. T. (2016) · Advances in the study of behavior · doi:10.1016/bs.asb.2016.01.002 · Cited by 176
The intrepid urban coyote: a comparison of bold and exploratory behavior in coyotes from urban and rural environments
Breck, S., Poessel, S. A., Mahoney, P., & Young, J. (2019) · Scientific Reports · doi:10.1038/s41598-019-38543-5 · Cited by 149
Personality, Foraging and Fitness Consequences in a Long Lived Seabird
Patrick, S. C., & Weimerskirch, H. (2014) · PLoS ONE · doi:10.1371/journal.pone.0087269 · Cited by 170
Who are the innovators? A field experiment with 2 passerine species
Morand‐Ferron, J., Cole, E. F., Rawles, J. E. C., & Quinn, J. L. (2011) · Behavioral Ecology · doi:10.1093/beheco/arr120 · Cited by 170
The repeatability of cognitive performance: a meta-analysis
Cauchoix, M., Chow, P. K. Y., van Horik, J. O., Atance, C. M., Barbeau, E. J., Barragan‐Jason, G., Bize, P., Boussard, A., Buechel, S. D., Cabirol, A., et al. (2018) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2017.0281 · Cited by 164
Individuals in space: personality-dependent space use, movement and microhabitat use facilitate individual spatial niche specialization
Schirmer, A., Herde, A., Eccard, J. A., & Dammhahn, M. (2019) · Oecologia · doi:10.1007/s00442-019-04365-5 · Cited by 162
Natural selection, plasticity and the emergence of a behavioural syndrome in the wild
Adriaenssens, B., & Johnsson, J. I. (2012) · Ecology Letters · doi:10.1111/ele.12011 · Cited by 161
Genome-Wide Association Studies Reveal a Simple Genetic Basis of Resistance to Naturally Coevolving Viruses in Drosophila melanogaster
Magwire, M. M., Fabian, D. K., Schweyen, H., Cao, C., Longdon, B., Bayer, F., & Jiggins, F. M. (2012) · PLoS Genetics · doi:10.1371/journal.pgen.1003057 · Cited by 162
Frontiers in quantifying wildlife behavioural responses to chemical pollution
Bertram, M. G., Martin, J. M., McCallum, E. S., Alton, L. A., Brand, J. A., Brooks, B. W., Červený, D., Fick, J. B., Ford, A. T., Hellström, G., et al. (2022) · Biological reviews/Biological reviews of the Cambridge Philosophical Society · doi:10.1111/brv.12844 · Cited by 172
Perspectives – Minimizing Observer Bias in Behavioral Studies: A Review and Recommendations
Burghardt, G. M., Bartmess-LeVasseur, J., Browning, S. A., Morrison, K. E., Stec, C. L., Zachau, C. E., & Freeberg, T. M. (2012) · Ethology · doi:10.1111/j.1439-0310.2012.02040.x · Cited by 174
General Quantitative Genetic Methods for Comparative Biology
de Villemereuil, P., & Nakagawa, S. (2014) · Springer eBooks · doi:10.1007/978-3-662-43550-2_11 · Cited by 153
Heritability of telomere variation: it is all about the environment!
Dugdale, H. L., & Richardson, D. S. (2018) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2016.0450 · Cited by 156
Inferring influence and leadership in moving animal groups
Strandburg‐Peshkin, A., Papageorgiou, D., Crofoot, M. C., & Farine, D. R. (2018) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2017.0006 · Cited by 156
Consistent individual differences in the social phenotypes of wild great tits, Parus major
Aplin, L. M., Firth, J. A., Farine, D. R., Voelkl, B., Crates, R., Čulina, A., Garroway, C. J., Hinde, C. A., Kidd, L. R., Psorakis, I., et al. (2015) · Animal Behaviour · doi:10.1016/j.anbehav.2015.07.016 · Cited by 155
Individual differences in searching behaviour and spatial foraging consistency in a central place marine predator
Patrick, S. C., Bearhop, S., Grémillet, D., Lescroël, A., Grecian, W. J., Bodey, T. W., Hamer, K. C., Wakefield, E. D., Nuz, M. L., & Votier, S. C. (2013) · Oikos · doi:10.1111/j.1600-0706.2013.00406.x · Cited by 155
Effects of age and reproductive status on individual foraging site fidelity in a long-lived marine predator
Votier, S. C., Fayet, A. L., Bearhop, S., Bodey, T. W., Clark, B. L., Grecian, W. J., Guilford, T., Hamer, K. C., Jeglinski, J. W. E., Morgan, G., et al. (2017) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2017.1068 · Cited by 152
An empiricist guide to animal personality variation in ecology and evolution
Dall, S. R. X., & Griffith, S. C. (2014) · Frontiers in Ecology and Evolution · doi:10.3389/fevo.2014.00003 · Cited by 150
Using repeatability to study physiological and behavioural traits: ignore time-related change at your peril
Biro, P. A., & Stamps, J. A. (2015) · Animal Behaviour · doi:10.1016/j.anbehav.2015.04.008 · Cited by 149
Reliability of graph analysis of resting state fMRI using test-retest dataset from the Human Connectome Project
Termenón, M., Jaillard, A. S., Delon‐Martin, C., & Achard, S. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.05.062 · Cited by 154
A Tale of Two Phylogenies: Comparative Analyses of Ecological Interactions
Hadfield, J. D., Krasnov, B. R., Poulin, R., & Nakagawa, S. (2014) · The American Naturalist · doi:10.1086/674445 · Cited by 141
Personality-matching habitat choice, rather than behavioural plasticity, is a likely driver of a phenotype–environment covariance
Holtmann, B., Santos, E. S. A., Lara, C. E., & Nakagawa, S. (2017) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2017.0943 · Cited by 146
A meta-analysis of correlated behaviours with implications for behavioural syndromes: mean effect size, publication bias, phylogenetic effects and the role of mediator variables
Garamszegi, L. Z., Markó, G., & Herczeg, G. (2012) · Evolutionary Ecology · doi:10.1007/s10682-012-9589-8 · Cited by 144
Trophic transfer of microplastics does not affect fish personality
Tosetto, L., Williamson, J. E., & Brown, C. (2016) · Animal Behaviour · doi:10.1016/j.anbehav.2016.10.035 · Cited by 150
Repeatability, heritability, and age‐dependence of seasonal plasticity in aggressiveness in a wild passerine bird
Araya‐Ajoy, Y. G., & Dingemanse, N. J. (2016) · Journal of Animal Ecology · doi:10.1111/1365-2656.12621 · Cited by 142
A comprehensive guideline for Bland–Altman and intra class correlation calculations to properly compare two methods of measurement and interpret findings
Haghayegh, S., Kang, H.-A., Khoshnevis, S., Smolensky, M. H., & Diller, K. R. (2020) · Physiological Measurement · doi:10.1088/1361-6579/ab86d6 · Cited by 152
“…and formulae presented for the ‘Single Measurement Per Subject’ study design using a corrected k0 instead of k (number of measurements per subject) (Nakagawa and Schielzeth 2010) as k0 = 1 n− 1 ( N− ∑n i=1 ki 2 N ) (11) where n is the number of subjects, N is the total number of measurements,…”
Method
Animal personality and pace-of-life syndromes: do fast-exploring fairy-wrens die young?
Hall, M. L., van Asten, T., Katsis, A. C., Dingemanse, N. J., Magrath, M. J. L., & Mulder, R. A. (2015) · Frontiers in Ecology and Evolution · doi:10.3389/fevo.2015.00028 · Cited by 140
Absolute Consistency: Individual versus Population Variation in Annual-Cycle Schedules of a Long-Distance Migrant Bird
Conklin, J. R., Battley, P. F., & Potter, M. A. (2013) · PLoS ONE · doi:10.1371/journal.pone.0054535 · Cited by 142
Criteria for acceptable studies of animal personality and behavioural syndromes
Dingemanse, N. J., & WRIGHT, J. M. (2020) · Ethology · doi:10.1111/eth.13082 · Cited by 139
Metabolic rates, and not hormone levels, are a likely mediator of between‐individual differences in behaviour: a meta‐analysis
Holtmann, B., Lagisz, M., & Nakagawa, S. (2016) · Functional Ecology · doi:10.1111/1365-2435.12779 · Cited by 145
Symbioses shape feeding niches and diversification across insects
Cornwallis, C. K., Padje, A. V. ’., Ellers, J., Klein, M., Jackson, R., Kiers, E. T., West, S. A., & Henry, L. M. (2023) · Nature Ecology & Evolution · doi:10.1038/s41559-023-02058-0 · Cited by 137
Do opposites attract? Effects of personality matching in breeding pairs of captive giant pandas on reproductive success
Martin‐Wintle, M. S., Shepherdson, D. J., Zhang, G., Huang, Y., Luo, B., & Swaisgood, R. R. (2017) · Biological Conservation · doi:10.1016/j.biocon.2017.01.010 · Cited by 141
Personality predicts individual responsiveness to the risks of starvation and predation
Quinn, J. L., Cole, E. F., Bates, J., Payne, R. W., & Cresswell, W. R. (2011) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2011.2227 · Cited by 134
Dominance and plumage traits: meta-analysis and metaregression analysis
Santos, E. S. A., Scheck, D., & Nakagawa, S. (2011) · Animal Behaviour · doi:10.1016/j.anbehav.2011.03.022 · Cited by 135
Characterizing behavioural ‘characters’: an evolutionary framework
Araya‐Ajoy, Y. G., & Dingemanse, N. J. (2013) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2013.2645 · Cited by 130
Parental provisioning behaviour plays a key role in linking personality with reproductive success
Mutzel, A., Dingemanse, N. J., Araya‐Ajoy, Y. G., & Kempenaers, B. (2013) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2013.1019 · Cited by 132
Personality variation in a clonal insect: The pea aphid, Acyrthosiphon pisum
Schuett, W., Dall, S. R. X., Baeumer, J., Kloesener, M. H., Nakagawa, S., Beinlich, F. R. M., & Eggers, T. (2011) · Developmental Psychobiology · doi:10.1002/dev.20538 · Cited by 129
Slow explorers take less risk: a problem of sampling bias in ecological studies
Stuber, E. F., Araya‐Ajoy, Y. G., Mathot, K. J., Mutzel, A., Nicolaus, M., Wijmenga, J. J., Mueller, J. C., & Dingemanse, N. J. (2013) · Behavioral Ecology · doi:10.1093/beheco/art035 · Cited by 129
Context dependency of trait repeatability and its relevance for management and conservation of fish populations
Killen, S. S., Adriaenssens, B., Marras, S., Claireaux, G., & Cooke, S. J. (2016) · Conservation Physiology · doi:10.1093/conphys/cow007 · Cited by 127
Urbanization Is Associated with Divergence in Pace-of-Life in Great Tits
Charmantier, A., Demeyrier, V., Lambrechts, M. M., Perret, S., & Grégoire, A. (2017) · Frontiers in Ecology and Evolution · doi:10.3389/fevo.2017.00053 · Cited by 127
Test-retest reliability of graph metrics of resting state MRI functional brain networks: A review
Andellini, M., Cannatà, V., Gazzellini, S., Bernardi, B., & Napolitano, A. (2015) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2015.05.020 · Cited by 128
Within seasons and among years: When are corticosterone levels repeatable?
Ouyang, J. Q., Hau, M., & Bonier, F. (2011) · Hormones and Behavior · doi:10.1016/j.yhbeh.2011.08.004 · Cited by 125
Epidemiology and Heritability of Major Depressive Disorder, Stratified by Age of Onset, Sex, and Illness Course in Generation Scotland: Scottish Family Health Study (GS:SFHS)
Fernandez-Pujals, A. M., Adams, M. J., Thomson, P. A., McKechanie, A. G., Blackwood, D., Smith, B. H., Dominiczak, A. F., Morris, A. D., Matthews, K., Campbell, A., et al. (2015) · PLoS ONE · doi:10.1371/journal.pone.0142197 · Cited by 132
The repeatability of glucocorticoids: A review and meta-analysis.
Taff, C., Schoenle, L. A., & Vitousek, M. (2018) · General and Comparative Endocrinology · doi:10.1016/j.ygcen.2018.01.011 · Cited by 110
Dispersal response to climate change: scaling down to intraspecific variation
Bestion, E., Clobert, J., & Côté, J. (2015) · Ecology Letters · doi:10.1111/ele.12502 · Cited by 128
Personality-dependent spatial ecology occurs independently from dispersal in wild burbot (Lota lota)
Harrison, P. M., Gutowsky, L. F. G., Martins, E. G., Patterson, D., Cooke, S. J., & Power, M. (2014) · Behavioral Ecology · doi:10.1093/beheco/aru216 · Cited by 123
Evidence for evolution in response to natural selection in a contemporary human population
Milot, E., Mayer, F. M., Nussey, D. H., Boisvert, M., Pelletier, F., & Réale, D. J. F. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1104210108 · Cited by 122
Consistency in boldness, activity and exploration at different stages of life
Herde, A., & Eccard, J. A. (2013) · BMC Ecology · doi:10.1186/1472-6785-13-49 · Cited by 122
Are personality differences in a small iteroparous mammal maintained by a life-history trade-off?
Dammhahn, M. (2012) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2012.0212 · Cited by 122
Boldness-exploration behavioral syndrome: interfamily variability and repeatability of personality traits in the young of the convict cichlid (Amatitlania siquia)
Mazué, G. P. F., Dechaume‐Moncharmont, F., & Godin, J.-G. J. (2015) · Behavioral Ecology · doi:10.1093/beheco/arv030 · Cited by 121
Speed Determines Leadership and Leadership Determines Learning during Pigeon Flocking
Pettit, B., Ákos, Z., Vicsek, T., & Biro, D. (2015) · Current Biology · doi:10.1016/j.cub.2015.10.044 · Cited by 120

Authors: Nakagawa, S., & Schielzeth, H.
Affiliations: Max Planck Society (DE)
Corresponding author: Nakagawa, Shinichi
Schielzeth, Holger
ORCID: Nakagawa, Shinichi
Schielzeth, Holger
Venue: Biological Reviews
Publisher: Wiley
Published: 2010-06-21
Volume: 85
Issue: 4
Pages: 935-956
ISSN: 0006-3231 (ISSN-L)
1464-7931
1469-185X
DOI: 10.1111/j.1469-185x.2010.00141.x
OpenAlex: W2045443942
Cited by: 2,584
References: 85
Citations by year: 2026: 109 · 2025: 165 · 2024: 141 · 2023: 171 · 2022: 235 · 2021: 222 · 2020: 206 · 2019: 197 · 2018: 215 · 2017: 198 · 2016: 183 · 2015: 167 · 2014: 136 · 2013: 107 · 2012: 78
FWCI: 8.27
Type: journal article
Language: en
Open access: closed
Licence: onlinelibrary.wiley.com/termsAndConditions#vor (vor)
Locations: Biological reviews/Biological reviews of the Cambridge Philosophical Society (publishedVersion)
PubMed (publishedVersion)
PUB – Publications at Bielefeld University (Bielefeld University) (submittedVersion)
MPG.PuRe (Max Planck Society) (submittedVersion)
Topics: Life Sciences › Agricultural and Biological Sciences › Ecology, Evolution, Behavior and Systematics › Animal Behavior and Reproduction
Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
Life Sciences › Agricultural and Biological Sciences › Ecology, Evolution, Behavior and Systematics › Morphological variations and asymmetry
Keywords: repeatability, intraclass correlation coefficient, non-Gaussian data, linear mixed models, measurement error, phenotypic flexibility, statistical significance, parametric bootstrapping, permutation tests, Bayesian approach, narrow-sense heritability, binary data, count data, proportion data
MeSH terms: Analysis of Variance, Phenotype, Regression Analysis, Statistics as Topic, Reproducibility of Results, Confidence Intervals, Normal Distribution, Linear Models, Least-Squares Analysis

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Repeatability for Gaussian and non-Gaussian data: a practical guide for biologists.

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks