The DOI matches its Crossref record; 70 of the 70 references it cites were found in a registry or an index.
To transform or not to transform: using generalized linear mixed models to analyse reaction time data
Open accessAbstract
Linear mixed-effect models (LMMs) are being increasingly widely used in psychology to analyse multi-level research designs. This feature allows LMMs to address some of the problems identified by Speelman and McGann (2013) about the use of mean data, because they do not average across individual responses. However, recent guidelines for using LMM to analyse skewed reaction time (RT) data collected in many cognitive psychological studies recommend the application of non-linear transformations to satisfy assumptions of normality. Uncritical adoption of this recommendation has important theoretical implications which can yield misleading conclusions. For example, Balota et al. (2013) showed that analyses of raw RT produced additive effects of word frequency and stimulus quality on word identification, which conflicted with the interactive effects observed in analyses of transformed RT. Generalized linear mixed-effect models (GLMM) provide a solution to this problem by satisfying normality assumptions without the need for transformation. This allows differences between individuals to be properly assessed, using the metric most appropriate to the researcher's theoretical context. We outline the major theoretical decisions involved in specifying a GLMM, and illustrate them by reanalysing Balota et al.'s datasets. We then consider the broader benefits of using GLMM to investigate individual differences.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
Model selection and multimodel inference: a practical information-theoretic approach.
Guthery, F. S., Burnham, K. P., & Anderson, D. R. (2003) · The Journal of Wildlife Management · doi:10.2307/3802723 · Cited by 41,495
Hierarchical Linear Models: Applications and Data Analysis Methods.
Longford, N. T., Bryk, A. S., & Raudenbush, S. W. (1993) · Contemporary Sociology · doi:10.2307/2075823 · Cited by 18,724
McCullagh, P., & Nelder, J. A. (1989) · doi:10.1007/978-1-4899-3242-6 · Cited by 16,836
An Analysis of Transformations
Box, G. E. P., & Cox, D. R. (1964) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1964.tb00553.x · Cited by 15,052
Mixed-Effects Models in Sand S-PLUS
Pinheiro, J. C., & Bates, D. M. (2000) · Statistics and Computing · doi:10.1007/978-1-4419-0318-1 · Cited by 11,187
Random effects structure for confirmatory hypothesis testing: Keep it maximal
Barr, D. J., Levy, R., Scheepers, C., & Tily, H. J. (2013) · Journal of Memory and Language · doi:10.1016/j.jml.2012.11.001 · Cited by 10,328
Mixed-effects modeling with crossed random effects for subjects and items
Baayen, R. H., Davidson, D. J., & Bates, D. M. (2008) · Journal of Memory and Language · doi:10.1016/j.jml.2007.12.005 · Cited by 8,540
Brown, R. A., Hastie, T. J., & Tibshirani, R. J. (1991) · Biometrics · doi:10.2307/2532174 · Cited by 8,176
Koyak, R. A., Hastie, T. J., & Tibshirani, R. J. (1991) · Journal of the American Statistical Association · doi:10.2307/2290538 · Cited by 7,596
Generalized Linear Models (2nd ed.).
Therneau, T. M., McCullagh, P., & Nelder, J. A. (1993) · Journal of the American Statistical Association · doi:10.2307/2290358 · Cited by 4,907
McClelland, J. L., & Rumelhart, D. E. (1981) · Psychological Review · doi:10.1037/0033-295x.88.5.375 · Cited by 4,889
On the Theory of Scales of Measurement
Stevens, S. S. (1946) · Science · doi:10.1126/science.103.2684.677 · Cited by 4,761
Ratcliff, R. (1978) · Psychological Review · doi:10.1037/0033-295x.85.2.59 · Cited by 4,513
Analyzing Linguistic Data: A Practical Introduction to Statistics using R
Baayen, R. H. (2008) · doi:10.1017/cbo9780511801686 · Cited by 3,253 · cited 1×
“For over 100 years, cognitive psychologists have used RT to investigate unobservable mental processes (Donders, 1868/1969; Luce, 1986). These investigations are based on two fundamental assumptions: (i) mental processes take time to complete, and that (ii) each measured RT reflects a composite of several distinct stag…”
Automatic and effortful processes in memory.
Hasher, L., & Zacks, R. T. (1979) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.108.3.356 · Cited by 2,812
Chronometric explorations of mind
Posner, M. I. (1978) · Cited by 2,441
The language-as-fixed-effect fallacy: A critique of language statistics in psychological research
Clark, H. H. (1973) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(73)80014-3 · Cited by 2,222
Interaction of information in word recognition.
Morton, J. (1969) · Psychological Review · doi:10.1037/h0027366 · Cited by 2,151
(1986) · Cited by 2,022
Memory-scanning: mental processes revealed by reaction-time experiments.
Sternberg, S. (1969) · PubMed · Cited by 1,953
Glass, G. V., Peckham, P. D., & Sanders, J. R. (1972) · Review of Educational Research · doi:10.3102/00346543042003237 · Cited by 1,826 · cited 2×
“We then consider the broader benefits of using GLMM to investigate individual differences.”
MethodOn the speed of mental processes
Donders, F. C. (1969) · Acta Psychologica · doi:10.1016/0001-6918(69)90065-1 · Cited by 1,784
Rumelhart, D. E., & McClelland, J. L. (1982) · Psychological Review · doi:10.1037//0033-295x.89.1.60 · Cited by 1,525
Generalized additive models for medical research
Hastie, T., & Tibshirani, R. (1995) · Statistical Methods in Medical Research · doi:10.1177/096228029500400302 · Cited by 1,266
The simplest complete model of choice response time: Linear ballistic accumulation
Brown, S. D., & Heathcote, A. (2008) · Cognitive Psychology · doi:10.1016/j.cogpsych.2007.12.002 · Cited by 1,123
Mixed-Effects Models in S and S-PLUS
(2000) · Statistics and Computing · doi:10.1007/b98882 · Cited by 930
Neural computation of log likelihood in control of saccadic eye movements
Carpenter, R. H. S., & Williams, M. L. L. (1995) · Nature · doi:10.1038/377059a0 · Cited by 823
Faust, M. E., Balota, D. A., Spieler, D. H., & Ferraro, F. R. (1999) · Psychological Bulletin · doi:10.1037//0033-2909.125.6.777 · Cited by 628
An introduction to multivariate adaptive regression splines
Friedman, J. H., & Roosen, C. B. (1995) · Statistical Methods in Medical Research · doi:10.1177/096228029500400303 · Cited by 588
Analysis of response time distributions: An example using the Stroop task.
Heathcote, A., Popiel, S. J., & Mewhort, D. J. K. (1991) · Psychological Bulletin · doi:10.1037//0033-2909.109.2.340 · Cited by 537
Harwell, M. R., Rubinstein, E. N., Hayes, W. S., & Olds, C. C. (1992) · Journal of Educational Statistics · doi:10.3102/10769986017004315 · Cited by 484
Linear and Generalized Linear Mixed Models and Their Applications
(2007) · Springer Series in Statistics · doi:10.1007/978-0-387-47946-0 · Cited by 477
Lix, L. M., Keselman, J. C., & Keselman, H. J. (1996) · Review of Educational Research · doi:10.3102/00346543066004579 · Cited by 474
Retrieval processes in recognition memory.
Ratcliff, R., & Murdock, B. B. (1976) · Psychological Review · doi:10.1037//0033-295x.83.3.190 · Cited by 465
Matzke, D., & Wagenmakers, E.-J. (2009) · Psychonomic Bulletin & Review · doi:10.3758/pbr.16.5.798 · Cited by 461
Generalized Linear Mixed Models
Stroup, W. W. (2016) · CRC Press eBooks · doi:10.1201/b13151 · Cited by 441
Rouder, J. N., & Lu, J. (2005) · Psychonomic Bulletin & Review · doi:10.3758/bf03196750 · Cited by 419
Testing for Interaction in Binary Logit and Probit Models: Is a Product Term Essential?
Berry, W. D., DeMeritt, J. H. R., & Esarey, J. (2010) · American Journal of Political Science · doi:10.1111/j.1540-5907.2009.00429.x · Cited by 411
Generalized linear models with random effects : unified analysis via h-likelihood
Lee, Y., Nelder, J. A., & Pawitan, Y. (2006) · Thammasat University Digital Collections · Cited by 381
On interpretation of interactions
Loftus, G. R. (1978) · Memory & Cognition · doi:10.3758/bf03197461 · Cited by 378
Lix, L. M., Keselman, J. C., & Keselman, H. J. (1996) · Review of Educational Research · doi:10.2307/1170654 · Cited by 367
Plaut, D. C., & Booth, J. R. (2000) · Psychological Review · doi:10.1037/0033-295x.107.4.786 · Cited by 355
On the linear relation between the mean and the standard deviation of a response time distribution.
Wagenmakers, E.-J., & Brown, S. (2007) · Psychological Review · doi:10.1037/0033-295x.114.3.830 · Cited by 354
Generalized Linear Models with Random Effects
Lee, Y., Nelder, J. A., & Pawitan, Y. (2006) · Chapman & Hall/CRC eBooks · doi:10.1201/9781420011340 · Cited by 322
Balota, D. A., & Yap, M. J. (2011) · Current Directions in Psychological Science · doi:10.1177/0963721411408885 · Cited by 284
Why do semantic priming effects increase in old age? A meta-analysis.
Laver, G. D., & Burke, D. M. (1993) · Psychology and Aging · doi:10.1037//0882-7974.8.1.34 · Cited by 267
A diffusion model account of masking in two-choice letter identification.
Ratcliff, R., & Rouder, J. N. (2000) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037//0096-1523.26.1.127 · Cited by 239
A linear mixed model analysis of masked repetition priming
Kliegl, R., Masson, M. E. J., & Richter, E. M. (2010) · Visual Cognition · doi:10.1080/13506280902986058 · Cited by 230
Visual word recognition: A multistage activation model.
Borowsky, R., & Besner, D. (1993) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037//0278-7393.19.4.813 · Cited by 183
Heathcote, A., Brown, S. D., & Cousineau, D. (2004) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03195574 · Cited by 160
Balota, D. A., Aschenbrenner, A. J., & Yap, M. J.-M. (2013) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0032186 · Cited by 157
Cognition, Information Processing, and Psychophysics
(2013) · Psychology Press eBooks · doi:10.4324/9780203763131 · Cited by 153
General slowing in semantic priming and word recognition.
Myerson, J., Ferraro, F. R., Hale, S., & Lima, S. D. (1992) · Psychology and Aging · doi:10.1037//0882-7974.7.2.257 · Cited by 150
Do Children and the Elderly Show Heightened Semantic Priming? How to Answer the Question
Chapman, L. J., Chapman, J. P., Curran, T. E., et al. (1994) · Developmental Review · doi:10.1006/drev.1994.1007 · Cited by 144
The ex-Wald distribution as a descriptive model of response times
Schwarz, W. (2001) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03195403 · Cited by 130
Zandt, T. V., & Ratcliff, R. (1995) · Psychonomic Bulletin & Review · doi:10.3758/bf03214411 · Cited by 126
Distinguishing common and task-specific processes in word identification: A matter of some moment?
Andrews, S., & Heathcote, A. (2001) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/0278-7393.27.2.514 · Cited by 126
Self-citationSpeelman, C. P., & McGann, M. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00451 · Cited by 119
On the use of multilevel modeling as an alternative to items analysis in psycholinguistic research
Locker, L., Hoffman, L., & Bovaird, J. A. (2007) · Behavior Research Methods · doi:10.3758/bf03192962 · Cited by 113
Additive and interactive effects on response time distributions in visual word recognition.
Yap, M. J.-M., & Balota, D. A. (2007) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/0278-7393.33.2.274 · Cited by 106
Forster, K. I., & Dickinson, R. G. (1976) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/0022-5371(76)90014-1 · Cited by 105
Frequency and visual quality in a word-nonword classification task
Stanners, R. F., Jastrzembski, J. E., & Westbrook, A. (1975) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(75)80069-7 · Cited by 104
Yap, M. J.-M., Tse, C., & Balota, D. A. (2009) · Journal of Memory and Language · doi:10.1016/j.jml.2009.07.001 · Cited by 104
Generalized linear models in soil science
Lane, P. W. (2002) · European Journal of Soil Science · doi:10.1046/j.1365-2389.2002.00440.x · Cited by 103
Yap, M. J.-M., Balota, D. A., Tse, C., & Besner, D. (2008) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/0278-7393.34.3.495 · Cited by 91
Kinoshita, S., Mozer, M. C., & Forster, K. I. (2011) · Journal of Experimental Psychology General · doi:10.1037/a0024230 · Cited by 74
Are Unshifted Distributional Models Appropriate for Response Time?
Rouder, J. N. (2005) · Psychometrika · doi:10.1007/s11336-005-1297-7 · Cited by 52
A hierarchical approach for fitting curves to response time measurements
Rouder, J. N., Tuerlinckx, F., Speckman, P. L., Lu, J., & Gómez, P. (2008) · Psychonomic Bulletin & Review · doi:10.3758/pbr.15.6.1201 · Cited by 45
Modulation of additive and interactive effects in lexical decision by trial history.
Masson, M. E. J., & Kliegl, R. M. (2012) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0029180 · Cited by 38
Cited by
Power Analysis and Effect Size in Mixed Effects Models: A Tutorial
Brysbaert, M., & Stevens, M. (2018) · Journal of Cognition · doi:10.5334/joc.10 · Cited by 1,420
“Others warn that transformations may alter the nature of the data (e.g., a logarithmic transformation may alter the interactions between independent variables; Lo & Andrews, 2015).”
BackgroundMethodThe JASP guidelines for conducting and reporting a Bayesian analysis
van Doorn, J., van den Bergh, D., Böhm, U., Dablander, F., Derks, K., Draws, T., Etz, A., Evans, N. J., Gronau, Q. F., Haaf, J. M., et al. (2021) · Psychonomic Bulletin & Review · doi:10.3758/s13423-020-01798-5 · Cited by 1,114
“The main measure of the study is a reaction time variable, which can for various reasons be non-normally distributed (Lo & Andrews, 2015; but see Schramm & Rouder, 2019).”
BackgroundAn Introduction to Linear Mixed-Effects Modeling in R
Brown, V. A. (2021) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245920960351 · Cited by 576
Combining speed and accuracy to control for speed-accuracy trade-offs(?)
Liesefeld, H. R., & Janczyk, M. (2019) · Behavior Research Methods · doi:10.3758/s13428-018-1076-x · Cited by 369
Physical Therapy versus Glucocorticoid Injection for Osteoarthritis of the Knee
Deyle, G. D., Allen, C. S., Allison, S. C., Gill, N. W., Hando, B. R., Petersen, E. J., Dusenberry, D. I., & Rhon, D. I. (2020) · New England Journal of Medicine · doi:10.1056/nejmoa1905877 · Cited by 277
Metadata
- Authors
- Lo, S., & Andrews, S.
- Venue
- Frontiers in Psychology
- Publisher
- Frontiers Media SA
- Published
- 2015-08-07
- Volume
- 6
- Pages
- 1171-1171
- ISSN
- 1664-1078 (ISSN-L)
- OpenAlex
- W1568266824
- Cited by
- 973
- References
- 70
- FWCI
- 22.48
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.