The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Balancing Type I error and power in linear mixed models
Open accessAbstract
Linear mixed-effects models have increasingly replaced mixed-model analyses of variance for statistical inference in factorial psycholinguistic experiments. Although LMMs have many advantages over ANOVA, like ANOVAs, setting them up for data analysis also requires some care. One simple option, when numerically possible, is to fit the full variance-covariance structure of random effects (the maximal model; Barr, Levy, Scheepers & Tily, 2013), presumably to keep Type I error down to the nominal α in the presence of random effects. Although it is true that fitting a model with only random intercepts may lead to higher Type I error, fitting a maximal model also has a cost: it can lead to a significant loss of power. We demonstrate this with simulations and suggest that for typical psychological and psycholinguistic data, higher power is achieved without inflating Type I error rate if a model selection criterion is used to select a random effect structure that is supported by the data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
Fitting Linear Mixed-Effects Models Using lme4
Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015) · Journal of Statistical Software · doi:10.18637/jss.v067.i01 · Cited by 86,835
Self-citationEstimating the Dimension of a Model
Schwarz, G. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344136 · Cited by 47,033
Information Theory and an Extension of the Maximum Likelihood Principle
Akaike, H. (1998) · Springer Series in Statistics · doi:10.1007/978-1-4612-1694-0_15 · Cited by 17,781
Data Analysis Using Regression and Multilevel/Hierarchical Models
Gelman, A., & Hill, J. (2006) · doi:10.1017/cbo9780511790942 · Cited by 13,597
Mixed-Effects Models in Sand S-PLUS
Pinheiro, J. C., & Bates, D. M. (2000) · Statistics and Computing · doi:10.1007/978-1-4419-0318-1 · Cited by 11,187
Self-citationRandom effects structure for confirmatory hypothesis testing: Keep it maximal
Barr, D. J., Levy, R., Scheepers, C., & Tily, H. J. (2013) · Journal of Memory and Language · doi:10.1016/j.jml.2012.11.001 · Cited by 10,328
Mixed-Effects Models in S and S-PLUS
(2001) · Technometrics · doi:10.1198/tech.2001.s574 · Cited by 9,278
Self-citationBrown, R. A., Hastie, T. J., & Tibshirani, R. J. (1991) · Biometrics · doi:10.2307/2532174 · Cited by 8,176
Koyak, R. A., Hastie, T. J., & Tibshirani, R. J. (1991) · Journal of the American Statistical Association · doi:10.2307/2290538 · Cited by 7,596
Analyzing linguistic data : a practical introduction to statistics using R
Baayen, R. H. (2008) · Cited by 2,069
Generalized Additive Models: An Introduction With R
Anderson-Cook, C. M. (2007) · Journal of the American Statistical Association · doi:10.1198/jasa.2007.s188 · Cited by 1,582
Beyond Power Calculations: Assessing Type S (Sign) and Type M (Magnitude) Errors
Gelman, A., & Carlin, J. (2014) · Perspectives on Psychological Science · doi:10.1177/1745691614551642 · Cited by 1,343
Bates, D. M., Kliegl, R. M., Vasishth, S., & Baayen, R. H. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.04967 · Cited by 1,008
Self-citationConclusions beyond support: overconfident estimates in mixed models
Schielzeth, H., & Forstmeier, W. (2009) · Behavioral Ecology · doi:10.1093/beheco/arn145 · Cited by 952
Mixed-Effects Models in S and S-PLUS
(2000) · Statistics and Computing · doi:10.1007/b98882 · Cited by 930
Self-citationWestfall, J., Kenny, D. A., & Judd, C. M. (2014) · Journal of Experimental Psychology: General · doi:10.1037/xge0000014 · Cited by 928
Analyzing linguistic data: a practical introduction to statistics using R
Dévière, E. (2009) · Journal of Applied Statistics · doi:10.1080/02664760802366783 · Cited by 892
An investigation of the false discovery rate and the misinterpretation of p -values
Colquhoun, D. (2014) · Royal Society Open Science · doi:10.1098/rsos.140216 · Cited by 792
Selected Papers of Hirotugu Akaike
(1998) · Springer Series in Statistics · doi:10.1007/978-1-4612-1694-0 · Cited by 791
Generalized Linear Mixed Models
Stroup, W. W. (2016) · CRC Press eBooks · doi:10.1201/b13151 · Cited by 441
Model Comparison and the Principle of Parsimony
Vandekerckhove, J., Matzke, D., & Wagenmakers, E.-J. (2015) · Oxford Handbooks Online · doi:10.1093/oxfordhb/9780199957996.013.14 · Cited by 269
Statistical methods for linguistic research: Foundational Ideas—Part II
Nicenboim, B., & Vasishth, S. (2016) · Language and Linguistics Compass · doi:10.1111/lnc3.12207 · Cited by 263
Self-citationJäger, L. A., Engelmann, F., & Vasishth, S. (2017) · Journal of Memory and Language · doi:10.1016/j.jml.2017.01.004 · Cited by 227
Self-citationThe cave of shadows: Addressing the human factor with generalized additive mixed models
Baayen, H., Vasishth, S., Kliegl, R., & Bates, D. (2017) · Journal of Memory and Language · doi:10.1016/j.jml.2016.11.006 · Cited by 212
Self-citationde Groot, A. D. (2014) · Acta Psychologica · doi:10.1016/j.actpsy.2014.02.001 · Cited by 188
Sorensen, T., Hohenstein, S., & Vasishth, S. (2016) · The Quantitative Methods for Psychology · doi:10.20982/tqmp.12.3.p175 · Cited by 180
Self-citationProcessing Chinese Relative Clauses: Evidence for the Subject-Relative Advantage
Vasishth, S., Chen, Z., Qiang, L., & Gueilan, G. (2013) · PLoS ONE · doi:10.1371/journal.pone.0077006 · Cited by 157
Self-citationGałecki, A. T. (2017) · Biometrics · doi:10.1111/biom.12825 · Cited by 80
Jäger, L. A., Engelmann, F., & Vasishth, S. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00617 · Cited by 71
Self-citationOn the ambiguity of interaction and nonlinear main effects in a regime of dependent covariates
Matuschek, H., & Kliegl, R. M. (2017) · Behavior Research Methods · doi:10.3758/s13428-017-0956-9 · Cited by 18
Self-citationGonzález, J., de Boeck, P. A. L., & Tuerlinckx, F. (2013) · Journal of the Royal Statistical Society Series C (Applied Statistics) · doi:10.1111/rssc.12031 · Cited by 8
Cited by
Bakdash, J. Z., & Marusich, L. R. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.00456 · Cited by 2,018
Fixed and random effects models: making an informed choice
Bell, A., Fairbrother, M., & Jones, K. (2019) · Quality & Quantity · doi:10.1007/s11135-018-0802-x · Cited by 1,085
Best practice guidance for linear mixed-effects models in psychological science
Meteyard, L., & Davies, R. A. I. (2020) · Journal of Memory and Language · doi:10.1016/j.jml.2020.104092 · Cited by 698
Yarkoni, T. (2022) · Behavioral and Brain Sciences · doi:10.1017/s0140525x20001685 · Cited by 701
An Introduction to Linear Mixed-Effects Modeling in R
Brown, V. A. (2021) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245920960351 · Cited by 576
“…in this example, the random-effects structure including random intercepts for both participants and items, as well as by-participant random slopes for word difficulty, would represent the maximal random-effects structure justified by the design (see Barr et al., 2013; Matuschek et al., 2017).”
BackgroundMethod
Metadata
- Authors
- Matuschek, H., Kliegl, R., Vasishth, S., Baayen, H., & Bates, D.
- Venue
- Journal of Memory and Language
- Publisher
- Elsevier BV
- Published
- 2017-06
- Volume
- 94
- Pages
- 305-315
- ISSN
- 0749-596X (ISSN-L)
- OpenAlex
- W2123565526
- Cited by
- 2,010
- References
- 32
- FWCI
- 84.81
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.