The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Power analysis for generalized linear mixed models in ecology and evolution
Open accessAbstract
Summary: ‘Will my study answer my research question?’ is the most fundamental question a researcher can ask when designing a study, yet when phrased in statistical terms – ‘What is the power of my study?’ or ‘How precise will my parameter estimate be?’ – few researchers in ecology and evolution (EE) try to answer it, despite the detrimental consequences of performing under‐ or over‐powered research. We suggest that this reluctance is due in large part to the unsuitability of simple methods of power analysis (broadly defined as any attempt to quantify prospectively the ‘informativeness’ of a study) for the complex models commonly used in EE research. With the aim of encouraging the use of power analysis, we present simulation from generalized linear mixed models (GLMM s) as a flexible and accessible approach to power analysis that can account for random effects, overdispersion and diverse response distributions. We illustrate the benefits of simulation‐based power analysis in two research scenarios: estimating the precision of a survey to estimate tick burdens on grouse chicks and estimating the power of a trial to compare the efficacy of insecticide‐treated nets in malaria mosquito control. We provide a freely available R function, sim.glmm, for simulating from GLMM s. Analysis of simulated data revealed that the effects of accounting for realistic levels of random effects and overdispersion on power and precision estimates were substantial, with correspondingly severe implications for study design in the form of up to fivefold increases in sampling effort. We also show the utility of simulations for identifying scenarios where GLMM‐fitting methods can perform poorly. These results illustrate the inadequacy of standard analytical power analysis methods and the flexibility of simulation‐based power analysis for GLMM s. The wider use of these methods should contribute to improving the quality of study design in EE.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007) · Behavior Research Methods · doi:10.3758/bf03193146 · Cited by 65,971
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Random effects structure for confirmatory hypothesis testing: Keep it maximal
Barr, D. J., Levy, R., Scheepers, C., & Tily, H. J. (2013) · Journal of Memory and Language · doi:10.1016/j.jml.2012.11.001 · Cited by 10,328
Generalized linear mixed models: a practical guide for ecology and evolution
Bolker, B. M., Brooks, M. E., Clark, C. J., Geange, S. W., Poulsen, J. R., Stevens, M. H. H., & White, J.-S. S. (2009) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2008.10.008 · Cited by 8,910 · cited 6×
“Various methods of accounting for overdispersion are available, including negative binomial and quasi-Poisson for counts, and beta-binomial and quasi-binomial for binomial data (Bolker et al. 2009; O’Hara &Kotze 2010; Warton &Hui 2011; Zuur, Hilbe & Leno 2013).”
BackgroundMethodInfluentialPseudoreplication and the Design of Ecological Field Experiments
Hurlbert, S. H. (1984) · Ecological Monographs · doi:10.2307/1942661 · Cited by 8,377 · cited 1×
“EE researchers are generally alert to the impact of non-independence and overdispersion on inference, as evidenced by the widespread awareness of pseu- doreplication (Hurlbert 1984) and the popularity of GLMMs (Bolker et al. 2009).”
BackgroundWhy Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 2×
“Consequently many, possibly most, studies are underpowered (Jennions & Møller 2003; Smith, Hardy&Gammell 2011) and likely to be uninformative or misleading (Ioannidis 2005).”
BackgroundSufficient Sample Sizes for Multilevel Modeling
Maas, C. J. M., & Hox, J. J. (2005) · Methodology · doi:10.1027/1614-2241.1.3.86 · Cited by 3,582 · cited 1×
“This effect has been observed in multilevel LMMs, where power is limited principally by the highest level sample size (Maas & Hox 2005; Snijders 2005).”
BackgroundEcological models and data in R
Bolker, B. M. (2008) · doi:10.2307/j.ctvcm4g37 · Cited by 1,297 · cited 5×
“…Centre for Population and EcosystemHealth, Institute of Biodiversity, Animal Health andComparativeMedicine, University of Glasgow,GrahamKerr Building, GlasgowG12 8QQ,UK; 2RobertsonCentre for Biostatistics, University of Glasgow, BoydOrr Building, GlasgowG12 8QQ,UK; 3Department of…”
BackgroundMethodInfluentialExperimental designs balanced for the estimation of residual effects of treatments
Williams, E. (1949) · Australian Journal of Scientific Research Series A Physical Sciences · doi:10.1071/ch9490149 · Cited by 1,104
Standard Errors and Sample Sizes for Two-Level Research
Snijders, T. A. B., & Bosker, R. J. (1993) · Journal of Educational Statistics · doi:10.3102/10769986018003237 · Cited by 487 · cited 3×
“Simulation-based power analysis methods are available for Gaussian GLMMs (Martin et al. 2011), but there is a lack of guidance and soft- ware facilitating power analysis for scenarios with non-Gauss- ian responses and more complex random effect structures.”
A survey of the statistical power of research in behavioral ecology and animal behavior
Jennions, M. D. (2003) · Behavioral Ecology · doi:10.1093/beheco/14.3.438 · Cited by 278 · cited 1×
“Consequently many, possibly most, studies are underpowered (Jennions & Møller 2003; Smith, Hardy&Gammell 2011) and likely to be uninformative or misleading (Ioannidis 2005).”
Background
Cited by
SIMR : an R package for power analysis of generalized linear mixed models by simulation
Green, P., & MacLeod, C. J. (2016) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.12504 · Cited by 2,467
Estimating power in (generalized) linear mixed models: An open introduction and tutorial in R
Kumle, L., Võ, M. L.-H., & Draschkow, D. (2021) · Behavior Research Methods · doi:10.3758/s13428-021-01546-0 · Cited by 552
Defining the Core Microbiome in Corals’ Microbial Soup
Hernandez-Agreda, A., Gates, R. D., & Ainsworth, T. D. (2017) · Trends in Microbiology · doi:10.1016/j.tim.2016.11.003 · Cited by 309
Minimum Time Required to Detect Population Trends: The Need for Long-Term Monitoring Programs
White, E. R. (2019) · BioScience · doi:10.1093/biosci/biy144 · Cited by 274
Szöcs, E., & Schäfer, R. B. (2015) · Environmental Science and Pollution Research · doi:10.1007/s11356-015-4579-3 · Cited by 52
Metadata
- Authors
- Johnson, P. C. D., Barry, S. J. E., Ferguson, H. M., & Müller, P.
- Venue
- Methods in Ecology and Evolution
- Publisher
- Wiley
- Published
- 2014-12-06
- Volume
- 6
- Issue
- 2
- Pages
- 133-142
- ISSN
- 2041-210X (ISSN-L)
- OpenAlex
- W2050104232
- Cited by
- 243
- References
- 11
- FWCI
- 15.47
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.