The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Balancing Type I error and power in linear mixed models
Open accessAbstract
Linear mixed-effects models have increasingly replaced mixed-model analyses of variance for statistical inference in factorial psycholinguistic experiments. Although LMMs have many advantages over ANOVA, like ANOVAs, setting them up for data analysis also requires some care. One simple option, when numerically possible, is to fit the full variance-covariance structure of random effects (the maximal model; Barr, Levy, Scheepers & Tily, 2013), presumably to keep Type I error down to the nominal α in the presence of random effects. Although it is true that fitting a model with only random intercepts may lead to higher Type I error, fitting a maximal model also has a cost: it can lead to a significant loss of power. We demonstrate this with simulations and suggest that for typical psychological and psycholinguistic data, higher power is achieved without inflating Type I error rate if a model selection criterion is used to select a random effect structure that is supported by the data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
Fitting Linear Mixed-Effects Models Using lme4
Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015) · Journal of Statistical Software · doi:10.18637/jss.v067.i01 · Cited by 86,835
Self-citationEstimating the Dimension of a Model
Schwarz, G. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344136 · Cited by 47,033
Information Theory and an Extension of the Maximum Likelihood Principle
Akaike, H. (1998) · Springer Series in Statistics · doi:10.1007/978-1-4612-1694-0_15 · Cited by 17,781
Data Analysis Using Regression and Multilevel/Hierarchical Models
Gelman, A., & Hill, J. (2006) · doi:10.1017/cbo9780511790942 · Cited by 13,597
Mixed-Effects Models in Sand S-PLUS
Pinheiro, J. C., & Bates, D. M. (2000) · Statistics and Computing · doi:10.1007/978-1-4419-0318-1 · Cited by 11,187
Self-citationRandom effects structure for confirmatory hypothesis testing: Keep it maximal
Barr, D. J., Levy, R., Scheepers, C., & Tily, H. J. (2013) · Journal of Memory and Language · doi:10.1016/j.jml.2012.11.001 · Cited by 10,328
Mixed-Effects Models in S and S-PLUS
(2001) · Technometrics · doi:10.1198/tech.2001.s574 · Cited by 9,278
Self-citationBrown, R. A., Hastie, T. J., & Tibshirani, R. J. (1991) · Biometrics · doi:10.2307/2532174 · Cited by 8,176
Koyak, R. A., Hastie, T. J., & Tibshirani, R. J. (1991) · Journal of the American Statistical Association · doi:10.2307/2290538 · Cited by 7,596
Cited by
Bakdash, J. Z., & Marusich, L. R. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.00456 · Cited by 2,018
Fixed and random effects models: making an informed choice
Bell, A., Fairbrother, M., & Jones, K. (2019) · Quality & Quantity · doi:10.1007/s11135-018-0802-x · Cited by 1,085
Yarkoni, T. (2022) · Behavioral and Brain Sciences · doi:10.1017/s0140525x20001685 · Cited by 701
Best practice guidance for linear mixed-effects models in psychological science
Meteyard, L., & Davies, R. A. I. (2020) · Journal of Memory and Language · doi:10.1016/j.jml.2020.104092 · Cited by 698
An Introduction to Linear Mixed-Effects Modeling in R
Brown, V. A. (2021) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245920960351 · Cited by 576
“…in this example, the random-effects structure including random intercepts for both participants and items, as well as by-participant random slopes for word difficulty, would represent the maximal random-effects structure justified by the design (see Barr et al., 2013; Matuschek et al., 2017).”
BackgroundMethodYu, Z., Guindani, M., Grieco, S. F., Chen, L., Holmes, T. C., & Xu, X. (2022) · Neuron · doi:10.1016/j.neuron.2021.10.030 · Cited by 563
Brauer, M., & Curtin, J. J. (2018) · Psychological Methods · doi:10.1037/met0000159 · Cited by 555
Estimating power in (generalized) linear mixed models: An open introduction and tutorial in R
Kumle, L., Võ, M. L.-H., & Draschkow, D. (2021) · Behavior Research Methods · doi:10.3758/s13428-021-01546-0 · Cited by 552
Heisig, J. P., & Schaeffer, M. (2019) · European Sociological Review · doi:10.1093/esr/jcy053 · Cited by 552
Grazing and ecosystem service delivery in global drylands
Maestre, F. T., Le Bagousse-Pinguet, Y., Delgado-Baquerizo, M., Eldridge, D. J., Saiz, H., Berdugo, M., Gozalo, B., Ochoa, V., Guirado, E., García-Gómez, M., et al. (2022) · Science · doi:10.1126/science.abq4062 · Cited by 419
Wieling, M. (2018) · Journal of Phonetics · doi:10.1016/j.wocn.2018.03.002 · Cited by 362
Statistical methods for linguistic research: Foundational Ideas—Part II
Nicenboim, B., & Vasishth, S. (2016) · Language and Linguistics Compass · doi:10.1111/lnc3.12207 · Cited by 263
Self-citationTen common statistical mistakes to watch out for when writing or reviewing a manuscript
Makin, T. R., & Orban de Xivry, J.-J. (2019) · eLife · doi:10.7554/elife.48175 · Cited by 238
Application of the Hierarchical Bootstrap to Multi-Level Data in Neuroscience
Saravanan, V., Berman, G. J., & Sober, S. J. (2019) · doi:10.1101/819334 · Cited by 170
Understanding Mixed-Effects Models Through Data Simulation
DeBruine, L. M., & Barr, D. J. (2021) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245920965119 · Cited by 148
Contextual priming of word meanings is stabilized over sleep
Gaskell, M. G., Cairney, S. A., & Rodd, J. M. (2019) · Cognition · doi:10.1016/j.cognition.2018.09.007 · Cited by 98
Selective effects of age of acquisition on morphological priming: evidence for a sensitive period.
Veríssimo, J., Heyer, V., Jacob, G., & Clahsen, H. (2018) · Language Acquisition · doi:10.1080/10489223.2017.1346104 · Cited by 75
N400 and P600 modulation in presupposition accommodation: The effect of different trigger types
Domaneschi, F., Canal, P., Masia, V., Lombardi Vallauri, E., & Bambini, V. (2018) · Journal of Neurolinguistics · doi:10.1016/j.jneuroling.2017.08.002 · Cited by 69
Dose-response effects of d-amphetamine on effort-based decision-making and reinforcement learning
Soder, H. E., Cooper, J. A., Lopez-Gamundi, P., Hoots, J. K., Nunez, C., Lawlor, V. M., Lane, S. D., Treadway, M. T., & Wardle, M. C. (2021) · Neuropsychopharmacology · doi:10.1038/s41386-020-0779-8 · Cited by 61
Martin, C. B., Hong, B., Newsome, R. N., Savel, K., Meade, M. E., Xia, A., Honey, C. J., & Barense, M. D. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2214285119 · Cited by 47
Grégoire, S., Doucerain, M., Morin, L., & Finkelstein-Fox, L. (2021) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2021.03.006 · Cited by 38
Is taurine an aging biomarker?
Fernandez, M. E., Bernier, M., Price, N. L., Camandola, S., Aon, M. A., Vaughan, K., Mattison, J. A., Preston, J. D., Jones, D. P., Tanaka, T., et al. (2025) · Science · doi:10.1126/science.adl2116 · Cited by 33
Pando‐Naude, V., Matthews, T. E., Højlund, A., Jakobsen, S., Østergaard, K., Johnsen, E., Garza‐Villarreal, E. A., Witek, M. A. G., Penhune, V., & Vuust, P. (2024) · European Journal of Neuroscience · doi:10.1111/ejn.16128 · Cited by 29
“Random effects structures were determined following the recommendations of Bates et al. (2015) and Matuschek et al. (2017).”
MethodApplication of the hierarchical bootstrap to multi-level data in neuroscience
Saravanan, V., Berman, G. J., & Sober, S. J. (2020) · arXiv · doi:10.48550/arxiv.2007.07797 · Cited by 26
Semi-field studies to better understand the impact of eave tubes on mosquito mortality and behaviour
Barreaux, A. M. G., Brou, N., Koffi, A. A., N’Guessan, R., Oumbouke, W. A., Tia, I. Z., & Thomas, M. B. (2018) · Malaria Journal · doi:10.1186/s12936-018-2457-4 · Cited by 19
Barreaux, A. M. G., Oumbouke, W. A., Tia, I. Z., Brou, N., Koffi, A. A., N’guessan, R., & Thomas, M. B. (2019) · Malaria Journal · doi:10.1186/s12936-019-2936-2 · Cited by 10
Lian, K., Hammarström, D., Hamarsland, H., Mølmen, K. S., Moen, S. C., & Ellefsen, S. (2024) · European Journal of Applied Physiology · doi:10.1007/s00421-024-05446-x · Cited by 3
Bauditz, S. C., Gander, F., Grob, A., Traut, A. C., Uhlich, M., Hess, U., & Ziegler, M. (2026) · European Journal of Personality · doi:10.1177/08902070261449352
Metadata
- Authors
- Matuschek, H., Kliegl, R., Vasishth, S., Baayen, H., & Bates, D.
- Venue
- Journal of Memory and Language
- Publisher
- Elsevier BV
- Published
- 2017-06
- Volume
- 94
- Pages
- 305-315
- ISSN
- 0749-596X (ISSN-L)
- OpenAlex
- W2123565526
- Cited by
- 2,010
- References
- 32
- FWCI
- 84.81
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.