The DOI matches its Crossref record; 49 of the 50 references it cites were found in a registry or an index.
Power Analysis and Effect Size in Mixed Effects Models: A Tutorial
Open accessPublished version of a preprint
Abstract
In psychology, attempts to replicate published findings are less successful than expected. For properly powered studies replication rate should be around 80%, whereas in practice less than 40% of the studies selected from different areas of psychology can be replicated. Researchers in cognitive psychology are hindered in estimating the power of their studies, because the designs they use present a sample of stimulus materials to a sample of participants, a situation not covered by most power formulas. To remedy the situation, we review the literature related to the topic and introduce recent software packages, which we apply to the data of two masked priming studies with high power. We checked how we could estimate the power of each study and how much they could be reduced to remain powerful enough. On the basis of this analysis, we recommend that a properly powered reaction time experiment with repeated measures has at least 1,600 word observations per condition (e.g., 40 participants, 40 stimuli). This is considerably more than current practice. We also show that researchers must include the number of observations in meta-analyses because the effect sizes currently reported depend on the number of stimuli presented to the participants. Our analyses can easily be applied to new datasets gathered.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Aggregations provide independent observations for non-parametric testing and make it appropriate when dealing with small sample sizes and repeated measures [8].”
From How University Disability Services Professionals Write Image Descriptions for HCI Figures Using Generative AI (2026) · cites this paper as [8]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Fitting Linear Mixed-Effects Models Using lme4
Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015) · Journal of Statistical Software · doi:10.18637/jss.v067.i01 · Cited by 86,835 · cited 2×
“Table 2: Outcome of the lmer analysis (Bates et al., 2015) of the Adelman et al.”
BackgroundFaul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007) · Behavior Research Methods · doi:10.3758/bf03193146 · Cited by 65,971
Mixed-effects modeling with crossed random effects for subjects and items
Baayen, R. H., Davidson, D. J., & Bates, D. M. (2008) · Journal of Memory and Language · doi:10.1016/j.jml.2007.12.005 · Cited by 8,540
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
Power failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567 · cited 1×
“What must be avoided, is that authors try out the various options and only report the one that produces a “significant” effect, a phenomenon known as p-hacking (Simmons et al., 2011).”
BackgroundAnalyzing Linguistic Data: A Practical Introduction to Statistics using R
Baayen, R. H. (2008) · doi:10.1017/cbo9780511801686 · Cited by 3,253
The New Statistics: Why and How
Cumming, G. (2014) · Psychological Science · doi:10.1177/0956797613504966 · Cited by 3,200 · cited 1×
“First, p-values show wide sample-to-sample variability, particularly when they are based on studies with small sample sizes (Cumming, 2014; Halsey, Curran-Everett, Vowler, & Drummond, 2015).”
BackgroundSIMR : an R package for power analysis of generalized linear mixed models by simulation
Green, P., & MacLeod, C. J. (2016) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.12504 · Cited by 2,467 · cited 1×
“A particularly interesting R package is simR (Green & MacLeod, 2016; Green, MacLeod, & Alday, 2016).2 2 The authors thank Jason Geller for pointing them to this package.”
BackgroundAnalyzing linguistic data: a practical introduction to statistics using R
Dévière, E. (2009) · Journal of Applied Statistics · doi:10.1080/02664760802366783 · Cited by 2,347 · cited 2×
“Some authors demand the use of transformations to get normal distributions (e.g., Baayen, 2008).”
Background
Flagged first, then by citations
1 of the 50 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Lakens, D. (2022) · Collabra Psychology · doi:10.1525/collabra.33267 · Cited by 1,962
Lakens, D. (2021) · Collabra: Psychology · doi:10.31234/osf.io/9d3yf · Cited by 1,935
Brysbaert, M. (2019) · Journal of Cognition · doi:10.5334/joc.72 · Cited by 996
“Brysbaert and Stevens (2018) recommended 40 participants and 40 stimuli per condition as good practice in reaction time studies with two repeated-measures conditions.”
BackgroundMethodInfluentialSelf-citationBest practice guidance for linear mixed-effects models in psychological science
Meteyard, L., & Davies, R. A. I. (2020) · Journal of Memory and Language · doi:10.1016/j.jml.2020.104092 · Cited by 817
How many words do we read per minute? A review and meta-analysis of reading rate
Brysbaert, M. (2019) · Journal of Memory and Language · doi:10.1016/j.jml.2019.104047 · Cited by 553
Self-citationEstimating power in (generalized) linear mixed models: An open introduction and tutorial in R
Kumle, L., Võ, M. L.-H., & Draschkow, D. (2021) · Behavior Research Methods · doi:10.3758/s13428-021-01546-0 · Cited by 552
“Instead, we wish to highlight an approach introduced in Brysbaert and Stevens (2018).”
BackgroundMethodInfluentialHow many words do we read per minute? A review and meta-analysis of reading ratePreprint
Brysbaert, M. (2019) · Journal of Memory and Language · doi:10.31234/osf.io/xynwg · Cited by 512
Self-citationA Practical Primer To Power Analysis for Simple Experimental Designs
Perugini, M., Gallucci, M., & Costantini, G. (2018) · International Review of Social Psychology · doi:10.5334/irsp.181 · Cited by 482
“For more complex designs, such as factorial within-subjects designs and mixed designs, accessible introductions to power analysis can be found in Brysbaert and Stevens (2018) and Guo, Logan, Glueck and Muller (2013).”
MethodMethods in cognitive pupillometry: Design, preprocessing, and statistical analysis
Mathôt, S., & Vilotijević, A. (2022) · Behavior Research Methods · doi:10.3758/s13428-022-01957-7 · Cited by 235
Baker, D. H., Vilidaitė, G., Lygo-Frett, F., Smith, A. K., Flack, T. R., Gouws, A. D., & Andrews, T. J. (2020) · Psychological Methods · doi:10.1037/met0000337 · Cited by 314
“These problems are common across many scientific disciplines, and estimates of power across studies in the neurosciences (Button et al., 2013) yield power values in the range 8–30%, far below the desired level of (cid:2) 80%.”
InfluentialPernet, C. R., Garrido, M. I., Gramfort, A., Maurits, N. M., Michel, C. M., Pang, E. W., Salmelin, R. H., Schoffelen, J., Valdes-Sosa, P. A., & Puce, A. (2020) · Nature Neuroscience · doi:10.1038/s41593-020-00709-0 · Cited by 244
AI-generated vs. Human Artworks. A Perception Bias Towards Artificial Intelligence?
Ragot, M., Martin, N., & Cojean, S. (2020) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3334480.3382892 · Cited by 261
“The effect sizes were based on [10] (measured as d ).”
BackgroundSiegelman, N., Schroeder, S., Acartürk, C., Ahn, H.-D., Alexeeva, S., Amenta, S., Bertram, R., Bonandrini, R., Brysbaert, M., Chernova, D., et al. (2022) · Behavior Research Methods · doi:10.3758/s13428-021-01772-6 · Cited by 160
“This is because each of such conditions would generally meet the 80% power requirement of 40 participants × 40 observations estimated in Brysbaert and Stevens (2018).”
BackgroundSelf-citationCognitive sex differences and hemispheric asymmetry: A critical review of 40 years of research
Hirnstein, M., Hugdahl, K., & Hausmann, M. (2018) · Laterality Asymmetries of Body Brain and Cognition · doi:10.1080/1357650x.2018.1497044 · Cited by 183
Murayama, K., Usami, S., & Sakaki, M. (2022) · Psychological Methods · doi:10.1037/met0000330 · Cited by 181
“1.5% referred to past work on the power analysis of mixed-effects modelling (e.g., Brysbaert & Stevens, 2018) to justify sample size.”
MethodInfluentialWhat We Owe to Family: The Impact of Special Obligations on Moral Judgment
McManus, R. M., Max Kleiman-weiner, A., & Young, L. (2020) · Psychological Science · doi:10.1177/0956797619900321 · Cited by 159
Oberpriller, J., Leite, M. D. S., & Pichler, M. (2022) · Ecology and Evolution · doi:10.1002/ece3.9062 · Cited by 105
“Moreover, the impact of study design on type I error and power stresses the importance of pre-experiments and power analyses (e.g. Johnson et al. 2015; Green & MacLeod 2016; Brysbaert & Stevens 2018) to maximize the meaningfulness and efficiency of a study.”
You That Read Wrong Again! A Transposed-Word Effect in Grammaticality Judgments
Mirault, J., Snell, J., & Jonathan Grainger, B. (2018) · Psychological Science · doi:10.1177/0956797618806296 · Cited by 98
“We thus ended up collecting 2,320 measurements per ungrammatical condition, meeting the criterion of Brysbaert and Stevens (2018) stating that 1,600 measurements per condition are necessary for sufficient statistical power.”
MethodJaeger, L., & Eckhardt, A. (2020) · Information Systems Journal · doi:10.1111/isj.12317 · Cited by 95
“Effect sizes for our theoretical variables are calculated using Cohen's d (Brysbaert & Stevens, 2018; Cohen, 1988).”
MethodToomer, M., & Elgort, I. (2019) · Language Learning · doi:10.1111/lang.12335 · Cited by 105
What did we learn from forty years of research on semantic interference? A Bayesian meta-analysis
Bürki, A., Elbuy, S., Madec, S., & Vasishth, S. (2020) · Journal of Memory and Language · doi:10.1016/j.jml.2020.104125 · Cited by 124
Gullifer, J. W., & Titone, D. A. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/7jq3w · Cited by 7
van Moorselaar, D., Daneshtalab, N., & Slagter, H. (2020) · bioRxiv · doi:10.1101/2020.04.05.026070 · Cited by 84
Examining the Adoption and Abandonment of Security, Privacy, and Identity Theft Protection Practices
Zou, Y., Roundy, K., Tamersoy, A., Shintre, S., Roturier, J., & Schaub, F. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376570 · Cited by 84
“The sample size followed the rule of thumb for linear mixed-effect models – at least 1,600 observations per condition in designs with repeated measures [16].”
Method(Generalized Linear) Mixed‐Effects Modeling: A Learner Corpus Example
Gries, S. Τ. (2021) · Language Learning · doi:10.1111/lang.12448 · Cited by 94
“…different information criteria play in it; validation of models with complex RES; and finally, power analysis for MEMs with complex RES (e.g., see Brysbaert & Stevens, 2018, as well as Meteyard & Davies, 2020, for recent discussions and the R packages of Donohue, 2020; Martin, 2020; Reich,…”
MethodLangenberg, B., Janczyk, M., Koob, V., Kliegl, R. M., & Mayer, A. (2022) · Behavior Research Methods · doi:10.3758/s13428-022-01902-8 · Cited by 88
Semantic diversity, frequency and the development of lexical quality in children’s word reading
Hsiao, Y., & Nation, K. (2018) · Journal of Memory and Language · doi:10.1016/j.jml.2018.08.005 · Cited by 75
Reading Text When Studying in a Second Language: An Eye‐Tracking Study
Dirix, N., Beken, H. V., Bruyne, E. D., Brysbaert, M., & Duyck, W. (2019) · Reading Research Quarterly · doi:10.1002/rrq.277 · Cited by 86
“Brysbaert and Stevens (2018) reported that a d value of 0.09 calculated with Westfall et al.’s equation turned into an effect size of 0.30 when calculated in an analysis of variance over participants on condition means based on 40 items and to 0.80 when the condition means were based on 350 items.”
MethodInfluentialSelf-citationWild, H. A., Kyröläinen, A.-J., & Kuperman, V. (2022) · PLoS ONE · doi:10.1371/journal.pone.0271191 · Cited by 72
Chen, X., Affourtit, J., Ryskin, R., Regev, T. I., Norman-Haignere, S., Jouravlev, O., Malik-Moraleda, S., Kean, H., Varley, R., & Fedorenko, E. (2023) · Cerebral Cortex · doi:10.1093/cercor/bhad087 · Cited by 57
“Abbreviations: β, the beta estimate for the effect; SE, standard error of the mean by participants; df, degrees of freedom; d, Cohen’s d (Westfall et al. 2014; Brysbaert and Stevens 2018); t, the t statistic; P, the significance value (for the individual fROIs, these values have been FDR-corrected for the number of fR…”
BackgroundNakata, T., & Elgort, I. (2020) · Second language Research · doi:10.1177/0267658320927764 · Cited by 77
“The final regression models were subjected to model criticism, potentially harmful outliers (i.e. data points with standardized residuals exceeding 2.5 standard deviations) were removed and the model was refitted (Baayen, 2008; Baayen, Davidson and Bates, 2008; Brysbaert and Stevens, 2018).”
MethodInfluentialWalker, E. A., Redfern, A., & Oleson, J. (2019) · Journal of Speech Language and Hearing Research · doi:10.1044/2018_jslhr-l-astm-18-0250 · Cited by 98
“Relative effect sizes were computed following Brysbaert and Stevens (2018).”
MethodHuang, P., Chen, J., Potenza, M. N., Griffiths, M. D., Pakpour, A. H., Chen, J., Lin, Y.-C., Hung, C., O’Brien, K., & Lin, C. (2022) · Journal of Behavioral Addictions · doi:10.1556/2006.2022.00084 · Cited by 66
Meadows, G., Brophy, L., Shawyer, F., Enticott, J. C., Fossey, E., Thornton, C. D., Weller, P. J., Wilson-Evered, E., Edan, V., & Slade, M. (2019) · The Lancet Psychiatry · doi:10.1016/s2215-0366(18)30429-2 · Cited by 59
Zengilowski, A., Schuetze, B. A., Nash, B. L., & Schallert, D. L. (2021) · Educational Psychologist · doi:10.1080/00461520.2020.1861948 · Cited by 67
“These tools cannot be used when a researcher includes only one-topic/two-texts in a study, but can only be employed to their full capacity when there is adequate sampling of texts in a study (Brysbaert & Stevens, 2018).”
BackgroundPatri, J.-F., Cavallo, A., Pullar, K. F., Soriano, M., Valente, M., Koul, A., Avenanti, A., Panzeri, S., & Becchio, C. (2020) · bioRxiv · doi:10.1101/2020.04.18.047787 · Cited by 57
How to embrace variation and accept uncertainty in linguistic and psycholinguistic data analysisPreprint
Vasishth, S., & Gelman, A. (2019) · Linguistics · doi:10.31234/osf.io/zcf8s · Cited by 57
“Accessible tutorials for automating the simulation-based power computation process are also available (Brysbaert and Stevens 2018; DeBruine and Barr 2020).”
MethodBouwer, F., Fahrenfort, J. J., Millard, S. K., Kloosterman, N., & Slagter, H. (2020) · bioRxiv · doi:10.1101/2020.01.08.899278 · Cited by 56
Dong, Y., Liu, Y., & Cai, R. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.00875 · Cited by 60
Moral dilemmas and trust in leaders during a global health crisis
Everett, J. A. C., Colombatto, C., Awad, E., Boggio, P. S., Bos, B., Brady, W. J., Chawla, M., Chituc, V., Chung, D., Drupp, M. A., et al. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01156-y · Cited by 81
The cognitive basis for the split-attention effect.
Pouw, W. T. J. L., Rop, G., de Koning, B. B., & PAAS, F. G. W. C. (2019) · Journal of Experimental Psychology General · doi:10.1037/xge0000578 · Cited by 63
A mobile approach-avoidance task
Zech, H., Rotteveel, M., DIJK, W. W. V., & van Dillen, L. F. (2020) · Behavior Research Methods · doi:10.3758/s13428-020-01379-3 · Cited by 56
“…on Experiment 1 indicated that a sample of 150 participants would allow us to detect approach-avoidance effects based on RT ( b = 0.241) and RF ( b = 1.262) with a power of 99% (for method used, see Brysbaert & Stevens, 2018, and the project ’ s Open Science Framework page; https://osf.io/y5b32/).”
MethodInfluentialAn fMRI Study of Response and Semantic Conflict in the Stroop Task
Parris, B. A., Wadsley, M. G., Hasshim, N., Benattayallah, A., Augustinova, M., & Ferrand, L. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02426 · Cited by 48
Best Practices in Data Analysis and Sharing in Neuroimaging using MEEGPreprint
Pernet, C. R., Garrido, M. I., Gramfort, A., Maurits, N. M., Michel, C. M., Pang, E. W., Salmelin, R. H., Schoffelen, J., Valdes-Sosa, P. A., & Puce, A. (2018) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/a8dhx · Cited by 58
Proactive distractor suppression elicited by statistical regularities in visual search
Huang, C., Vilotijević, A., Theeuwes, J., & Donk, M. (2021) · Psychonomic Bulletin & Review · doi:10.3758/s13423-021-01891-3 · Cited by 64
“This approach provides more power and can deal with unbalanced design and missing data (Brysbaert & Stevens, 2018).”
BackgroundThe Role of Figurative Complexity in the Comprehension and Appreciation of Advertisements
Sobrino, P. P., Littlemore, J., & Houghton, D. (2018) · Applied Linguistics · doi:10.1093/applin/amy039 · Cited by 74
The Role of Crosslinguistic Influence in Multilingual Processing: Lexicon Versus Syntax
Lago, S., Mosca, M., & Garcia, A. S. (2020) · Language Learning · doi:10.31219/osf.io/xc6wd · Cited by 48
Decomposing loss aversion from gaze allocation and pupil dilation
Feng, S., Ramakrishnan, A., Seok, D., Zhao, W. J., Thelaus, S., Cen, P., & Platt, M. L. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1919670117 · Cited by 69
Luo, W., Kramer, R. P., Kompier, M. E., Smolders, K. C. H. J., de Kort, Y. A. W., & Lichtenbelt, W. D. V. M. (2023) · Building and Environment · doi:10.1016/j.buildenv.2023.110380 · Cited by 51
West, G., Melby‐Lervåg, M., & Hulme, C. (2021) · Developmental Psychology · doi:10.1037/dev0001172 · Cited by 63
“…tasks, have poor reliability (Bogaerts, Siegelman, Ben-Porat & Frost, 2017; West et al., 2018) which may reflect the fact that difference scores (Lord, 1958; Overall & Woodward, 1975) and scores derived from short tasks tend to be unreliable (Brysbaert & Stevens, 2018; Nunally & Bernstein, 1994).”
BackgroundPower considerations in bilingualism research: Time to step up our game
Brysbaert, M. (2020) · Bilingualism Language and Cognition · doi:10.1017/s1366728920000437 · Cited by 61
Self-citationGordon, I., Wallot, S., & Berson, Y. (2021) · Psychophysiology · doi:10.1111/psyp.13857 · Cited by 45
“…1.24 BPM .15 1.44 .10 .918 .02 EDA −1.35 1.41 −.96 .339 −.18 BPM:EDA 1.83 1.57 1.17 .241 .25 Note: b are the model coefficients, SE are the coefficients' standard errors, t and p are the associated values of a t- test, testing the coefficient, and the effect size d (see Brysbaert & Stevens, 2018).”
MethodInfluentialBalance between solitude and socializing: everyday solitude time both benefits and harms well-being
Weinstein, N., Vuorre, M., Adams, M., & Nguyen, T.-V. T. (2023) · Scientific Reports · doi:10.1038/s41598-023-44507-7 · Cited by 67
“Our plan to collect up to 3150 data points was also based on recommendations to include a minimum of 1600–1700 data points for mixed effects models with an unclear prior effect size 52–54 .”
MethodStatistical Considerations for Analyzing Ecological Momentary Assessment Data
Oleson, J., Jones, M. A., Jorgensen, E. J., & Wu, Y.-H. (2021) · Journal of Speech Language and Hearing Research · doi:10.1044/2021_jslhr-21-00081 · Cited by 62
Manipulating Prior Beliefs Causally Induces Under- and Overconfidence
Marcke, H. V., Denmat, P. L., Verguts, T., & Desender, K. (2024) · Psychological Science · doi:10.1177/09567976241231572 · Cited by 44
“In doing so, we ensure that we have high experimental power, well above the 1,600 trials per cell usually required of the design, combined across participants and items (Brysbaert & Stevens, 2018).”
BackgroundSlim, M. S., & Hartsuiker, R. J. (2022) · Behavior Research Methods · doi:10.3758/s13428-022-01989-z · Cited by 48
“This observation has important implications for the required sample size for web-based eye tracking compared to lab-based data, since the required sample size to obtain adequate statistical power relies on the size of the effect (e.g., Brysbaert & Stevens, 2018; Green & MacLeod, 2016).”
MethodHuang, Y., Richter, E., Kleickmann, T., & Richter, D. (2022) · Computers & Education · doi:10.1016/j.compedu.2022.104503 · Cited by 58
Bellovary, A. K., Young, N. A., & Goldenberg, A. (2021) · Affective Science · doi:10.1007/s42761-021-00046-w · Cited by 54
“The simulated power analysis was based on Brysbaert and Stevens’ (2018) recommendations and was conducted using the powerlmm package (Magnusson, 2017) in R.”
MethodConducting linguistic experiments online with OpenSesame and OSWeb
Mathôt, S., & March, J. (2021) · Language Learning · doi:10.31234/osf.io/wnryc · Cited by 43
“Brysbaert and Stevens (2018) recently estimated that a properly powered within-subject experiment requires around 1,600 observations per condition.”
BackgroundThe Application of Signal Detection Theory to Acceptability Judgments
Huang, Y., & Ferreira, F. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.00073 · Cited by 55
Bayesian modeling of temporal expectations in the human brain
Visalli, A., Capizzi, M., Ambrosini, E., Mazzonetto, I., & Vallesi, A. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2019.116097 · Cited by 51
Small Samples in Instructed Second Language Acquisition Research
Loewen, S., & Hui, B. (2021) · Modern Language Journal · doi:10.1111/modl.12700 · Cited by 72
Mind-wandering rates fluctuate across the day: evidence from an experience-sampling study
Smith, G., Mills, C., Paxton, A., & Kalina Christoff, A. (2018) · Cognitive Research Principles and Implications · doi:10.1186/s41235-018-0141-4 · Cited by 49
Multilevel mediation analysis in R: A comparison of bootstrap and Bayesian approaches
Falk, C. F., Vogel, T. A., Hammami, S., & Miočević, M. (2023) · Behavior Research Methods · doi:10.3758/s13428-023-02079-4 · Cited by 50
“In retrospect, this middle of our studied sample sizes is not too far off from what might be acceptable for a two-condition experimental study in cognitive psychology (i.e., 1600 total observations per experimental condition, or 40 participants with 40 trials; Brysbaert & Stevens, 2018).”
Influence of safety climate on risk tolerance and risk-taking behavior: A cross-cultural examination
Bhandari, S., & Hallowell, M. R. (2021) · Safety Science · doi:10.1016/j.ssci.2021.105559 · Cited by 52
Expression Authenticity: The Role of Genuine and Deliberate Displays in Emotion Perception
Zloteanu, M., & Krumhuber, E. G. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.611248 · Cited by 49
“Using mixed-effects models such variability can easily be accounted for without the need to remove data or make assumptions regarding its validity, thereby allowing for more robust analyses (Brysbaert and Stevens, 2018).”
BackgroundProactive enhancement and suppression elicited by statistical regularities in visual search.
Huang, C., Donk, M., & Theeuwes, J. (2022) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/xhp0001002 · Cited by 66
“Moreover, this approach is known for the merits of utilizing the dataset at an observation level (i.e., trial) that provided us more power to fi nd the true effect (Brysbaert & Stevens, 2018).”
BackgroundA Case for Multisite Second Language Acquisition Research: Challenges, Risks, and Rewards
Moranski, K., & Ziegler, N. (2020) · Language Learning · doi:10.1111/lang.12434 · Cited by 50
The Processing of Linguistic Prominence
Kember, H., Choi, J., Yu, J., & Cutler, A. (2019) · Language and Speech · doi:10.1177/0023830919880217 · Cited by 57
“To check this, we conducted post-hoc power analyses using the R package simR (Green & MacLeod, 2016), a robust tool for calculating power in mixed effects models (Brysbaert & Stevens, 2018).”
MethodNahatame, S. (2021) · Language Learning · doi:10.1111/lang.12455 · Cited by 56
Koval, N. G. (2019) · Applied Psycholinguistics · doi:10.1017/s0142716419000158 · Cited by 52
Spaces for relaxing, spaces for recharging: How parks affect people's emotions
Rapuano, M., Ruotolo, F., Ruggiero, G., Masullo, M., Maffei, L., Galderisi, A., Palmieri, A., & Iachini, T. (2022) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2022.101809 · Cited by 46
Effect of Indoor Temperature and Glazing with Saturated Color on Visual Perception of Daylight
Chinazzo, G., Wienold, J., & Andersen, M. (2020) · LEUKOS The Journal of the Illuminating Engineering Society of North America · doi:10.1080/15502724.2020.1726182 · Cited by 39
“…estimate the effect size of mixed-effects models with more than one fixed effects as in the present study (we acknowledge however the possibility to perform the calculation of the effect size for simple designs with one fixed effect and two random factors as reported in Brysbaert and Stevens 2018).”
BackgroundEmergent data analysis in phonetic sciences: Towards pluralism and reproducibility
Roettger, T. B., Winter, B., & Baayen, R. H. (2018) · Journal of Phonetics · doi:10.1016/j.wocn.2018.12.001 · Cited by 46
Information transfer within and between autistic and non-autistic people
Crompton, C. J., Foster, S. J., Wilks, C. E. H., Dodd, M., Efthimiou, T. N., Ropar, D., Sasson, N. J., Lages, M., & Fletcher‐Watson, S. (2025) · Nature Human Behaviour · doi:10.1038/s41562-025-02163-z · Cited by 45
“A priori power analyses for linear mixed-effect models are notoriously difficult to conduct and require simulation studies 81,82 .”
Angele, B., Baciero, A., Gómez, P., & Perea, M. (2022) · Behavior Research Methods · doi:10.3758/s13428-021-01742-y · Cited by 46
Balkaran, B. L., Jaffe, D. H., Umuhire, D., Rive, B., & Milz, R. (2021) · BMC Psychiatry · doi:10.1186/s12888-021-03255-6 · Cited by 41
“Effect size were calculated using Cohen’s d approximation adjusted for use of multilevel modeling [42].”
MethodInformation Integration and Mesoscopic Cortical Connectivity during Propofol Anesthesia
Liang, Z., Cheng, L., Shao, S., Jin, X., Yu, T., SLEIGH, J. W., & Li, X. (2019) · Anesthesiology · doi:10.1097/aln.0000000000003015 · Cited by 41
The role of sensorimotor processes in social group contagion
Cracco, E., & Braß, M. (2018) · Cognitive Psychology · doi:10.1016/j.cogpsych.2018.02.001 · Cited by 44
Hotz, I., Deschwanden, P. F., Liem, F., Mérillat, S., Malagurski, B., Kollias, S., & Jäncke, L. (2021) · Human Brain Mapping · doi:10.1002/hbm.25739 · Cited by 33
“Relative effect sizes were calculated following Brysbaert and Stevens (2018) and according to Westfall, Kenny, and Judd (2014).”
MethodA beginner’s guide to eye tracking for psycholinguistic studies of reading
Schotter, E. R., & Dillon, B. (2025) · Behavior Research Methods · doi:10.3758/s13428-024-02572-4 · Cited by 32
“…measures over both participants and items), a general recommendation is that a properly powered reaction time experiment (and note that fixation durations are technically reaction times) should have at least 1600 observations (40 participants, 40 stimuli) per condition (Brysbaert & Stevens, 2018).”
Kosie, J. E., & Lew‐Williams, C. (2024) · Developmental Science · doi:10.1111/desc.13515 · Cited by 34
Ratan, R., Klein, M. S., Ucha, C. R., & Cherchiglia, L. (2022) · Computers & Education · doi:10.1016/j.compedu.2022.104643 · Cited by 42
Reliability and Feasibility of Linear Mixed Models in Fully Crossed Experimental Designs
Scandola, M., & Tidoni, E. (2024) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459231214454 · Cited by 51
“Several scholars have detailed the bases of LMMs and have provided suggestions and tools to reduce model complexity (Brysbaert & Stevens, 2018; DeBruine & Barr, 2021; Harrison et al., 2018; Luke, 2017; Matuschek et al., 2017; Singmann & Kellen 2020) and achieve the best compromise between Type I…”
BackgroundTask-specific bilingual effects in Mandarin-English speaking high school students in China
Privitera, A. J., Momenian, M., & Weekes, B. (2022) · Current Research in Behavioral Sciences · doi:10.1016/j.crbeha.2022.100066 · Cited by 32
Johannes, N., Buijzen, M., & Veling, H. (2020) · Journal of Experimental Psychology General · doi:10.1037/xge0000888 · Cited by 32
“Power calculations with mixed-effects models can be complicated (Brysbaert & Stevens, 2018; DeBruine & Barr, 2019).”
MethodFrom categories to gradience: Auto-coding sociophonetic variation with random forests
Villarreal, D., Clark, L., Hay, J. B., & Watson, K. (2020) · Laboratory Phonology Journal of the Association for Laboratory Phonology · doi:10.5334/labphon.216 · Cited by 32
“…affected confidence ratings—but we again urge caution in not over-interpreting these null results given the likelihood of low power in this model (Brysbaert & Stevens, 2018; Judd et al., 2017; Kirby & Sonderegger, 2018; Westfall et al., 2014).15 15 We fit the same models of confidence as…”
BackgroundResultOn-Field Ski Kinematic According to Leg and Discipline in Elite Alpine Skiers
Alhammoud, M., Hansen, C., Meyer, F., Hautier, C. A., & Morel, B. (2020) · Frontiers in Sports and Active Living · doi:10.3389/fspor.2020.00056 · Cited by 38
Unified syntax in the bilingual mind
Declerck, M., Wen, Y., Snell, J., Meade, G. F., & Jonathan Grainger, B. (2019) · Psychonomic Bulletin & Review · doi:10.3758/s13423-019-01666-x · Cited by 50
Beyond emotional similarity: The role of situation-specific motives.
Goldenberg, A., García, D., Halperin, E., Zaki, J., Kong, D., Golarai, G., & Gross, J. J. (2019) · Journal of Experimental Psychology General · doi:10.1037/xge0000625 · Cited by 35
Effects of peer observation on risky decision-making in adolescence: A meta-analytic review.
Powers, K. E., Schaefer, L., Figner, B., & Somerville, L. H. (2022) · Psychological Bulletin · doi:10.1037/bul0000382 · Cited by 41
“Cohen ’ s d for mixed-effects models was computed using the formulas provided in Westfall et al. (2014); see also Brysbaert and Stevens (2018).”
MethodDelayed gaze shifts away from others’ eyes in children and adolescents with social anxiety disorder
Kleberg, J. L., Högström, J., Sundström, K., Frick, A., & Serlachius, E. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2020.09.022 · Cited by 36
Immediate sensorimotor grounding of novel concepts learned from language alonePreprint
Guenther, F., Nguyen, T., Chen, L., Dudschig, C., Kaup, B., & Glenberg, A. M. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/gs69k · Cited by 2
Akbaş, T., Neptune, R. R., & Sulzer, J. S. (2019) · Frontiers in Neurology · doi:10.3389/fneur.2019.00301 · Cited by 36
Earth Gravity-Congruent Motion Benefits Pursuit Gain for Parabolic Trajectories
Jörges, B., & López‐Moliner, J. (2019) · Scientific Reports · doi:10.1038/s41598-019-50512-6 · Cited by 32
Evidence of SQUARC and distance effects in a weight comparison task
Dalmaso, M., & Vicovaro, M. (2019) · Cognitive Processing · doi:10.1007/s10339-019-00905-2 · Cited by 44
Erritzøe, D., Barba, T., Spriggs, M. J., Rosas, F. E., Nutt, D., & Carhart-Harris, R. L. (2024) · Journal of Psychopharmacology · doi:10.1177/02698811241237870 · Cited by 36
Kelty‐Stephen, D. G., Lee, J.-H., Cole, K. R., Shields, R. K., & Mangalam, M. (2023) · Perceptual and Motor Skills · doi:10.1177/00315125221149147 · Cited by 29
“…report an approximation of effect sizes for all covariates—both an intraclass coefficient to confirm that random effects played only a small role in the performance of the model (Lorah, 2018) and an analogue of Cohen’s d for mixed-effects modeling (Brysbaert & Stevens, 2018; Westfall et al., 2014).”
MethodArndt, H. L., Granfeldt, J., & Gullberg, M. (2022) · Language Learning · doi:10.1111/lang.12555 · Cited by 31
When time stands upright: STEARC effects along the vertical axis
Dalmaso, M., Schnapper, Y., & Vicovaro, M. (2022) · Psychological Research · doi:10.1007/s00426-022-01693-9 · Cited by 30
“Sample size was determined by following the guidelines for linear mixed-effects models including subjects and items as random factors (Brysbaert & Stevens, 2018).”
Method
Metadata
- Authors
- Brysbaert, M., & Stevens, M.
- Affiliations
- Ghent University (BE)
- Corresponding author
- Brysbaert, Marc
- ORCID
- Brysbaert, Marc
- Venue
- Journal of Cognition
- Publisher
- Ubiquity Press, Ltd.
- Published
- 2018
- Volume
- 1
- Issue
- 1
- Pages
- 9-9
- ISSN
- 2514-4820 (ISSN-L)
- PMC
- PMC6646942
- OpenAlex
- W2783948250
- Cited by
- 1,420
- References
- 50
- Citations by year
- 2026: 154 · 2025: 290 · 2024: 189 · 2023: 195 · 2022: 195 · 2021: 162 · 2020: 130 · 2019: 73 · 2018: 31
- FWCI
- 82.16
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Journal of Cognition (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Ghent University Academic Bibliography (Ghent University) (submittedVersion, cc-by-sa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- PsyArXiv (OSF Preprints) (submittedVersion, cc-by)
- PsyArXiv (OSF Preprints) (submittedVersion)
- OSF Preprints (OSF Preprints) (submittedVersion, cc-by)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Keywords
- power analysis, effect size, mixed models, replication, cognitive psychology, masked priming, reaction time, repeated measures, sample size, meta-analysis, statistical power
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
