The DOI matches its Crossref record.
Newton—Raphson and EM Algorithms for Linear Mixed-Effects Models for Repeated-Measures Data
Abstract
We develop an efficient and effective implementation of the Newton—Raphson (NR) algorithm for estimating the parameters in mixed-effects models for repeated-measures data. We formulate the derivatives for both maximum likelihood and restricted maximum likelihood estimation and propose improvements to the algorithm discussed by Jennrich and Schlüchter (1986) to speed convergence and ensure a positive-definite covariance matrix for the random effects at each iteration. We use matrix decompositions to develop efficient and computationally stable implementations of both the NR algorithm and an EM algorithm (Laird and Ware 1982) for this model. We compare the two methods (EM vs. NR) in terms of computational order and performance on two sample data sets and conclude that in most situations a well-implemented NR algorithm is preferable to the EM algorithm or EM algorithm with Aitken's acceleration. The term repeated measures refers to experimental designs where there are several individuals and several measurements taken on each individual. In the mixed-effects model each individual's vector of responses is modeled as a parametric function, where some of the parameters or “effects” are random variables with a multivariate normal distribution. This model has been successful because it can handle unbalanced data (different designs for different individuals), missing data (observations on all individuals are taken at the same design points, but some individuals have missing data), and jointly dependent random effects. The price for this flexibility is that the parameter estimates may be difficult to compute. We propose some new methods for implementing the EM and NR algorithms and draw conclusions about their performance. We also discuss extensions of the mixed-effects model to incoporate nonindependent conditional error structure and nested-type designs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Missing data: our view of the state of the art
Schafer, J. L., & Graham, J. W. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.2.147 · Cited by 11,638
Beyond SEM: General latent variable modeling
Muthén, B. O. (2002) · Behaviormetrika · doi:10.2333/bhmk.29.81 · Cited by 1,074
van Dyk, D. A., & Meng, X.-L. (2001) · Journal of Computational and Graphical Statistics · doi:10.1198/10618600152418584 · Cited by 1,052
Variance components testing in the longitudinal mixed effects model
Stram, D. O., & Lee, J. W. (1994) · Biometrics · doi:10.2307/2533455 · Cited by 992
Parameter expansion to accelerate EM: the PX-EM algorithm
Liu, C. (1998) · Biometrika · doi:10.1093/biomet/85.4.755 · Cited by 433
Statistical analysis of longitudinal neuroimage data with Linear Mixed Effects models
Bernal-Rusiel, J. L., Greve, D. N., Reuter, M., Fischl, B., & Sabuncu, M. R. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2012.10.065 · Cited by 360
Wicks, P., Vaughan, T. E., Massagli, M. P., & Heywood, J. (2011) · Nature Biotechnology · doi:10.1038/nbt.1837 · Cited by 362
Air Pollution and Mortality: Estimating Regional and National Dose-Response Relationships
Dominici, F., Daniels, M., Zeger, S. L., & Samet, J. M. (2002) · Journal of the American Statistical Association · doi:10.1198/016214502753479266 · Cited by 303
The effect of outdoor fungal spore concentrations on daily asthma severity.
Delfino, R. J., Zeiger, R. S., Seltzer, J. M., Street, D. H., Matteucci, R. M., Anderson, P. R., & Koutrakis, P. (1997) · Environmental Health Perspectives · doi:10.1289/ehp.97105622 · Cited by 191
Reliable Estimation of Capillary Transit Time Distributions Using DSC-MRI
Mouridsen, K., Hansen, M. B., Østergaard, L., & Jespersen, S. N. (2014) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.2014.111 · Cited by 133
Boldrini, M., Galfalvy, H., Dwork, A. J., Rosoklija, G. B., Trencevska-Ivanovska, I., Pavlovski, G., Hen, R., Arango, V., & Mann, J. J. (2019) · Biological Psychiatry · doi:10.1016/j.biopsych.2018.12.022 · Cited by 116
Joss, D., Khan, A., Lazar, S. W., & Teicher, M. H. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02373 · Cited by 65
Darton, T. C., Blohmke, C. J., Giannoulatou, E., Waddington, C. S., Jones, C., Sturges, P., Webster, C., Drakesmith, H., Pollard, A. J., & Armitage, A. E. (2015) · PLOS Neglected Tropical Diseases · doi:10.1371/journal.pntd.0004029 · Cited by 45
Leveille, S. G., Mejilla, R., Ngo, L., Fossa, A., Elmore, J. G., Darer, J., Ralston, J. D., Delbanco, T., & Walker, J. (2016) · Medical Care · doi:10.1097/mlr.0000000000000442 · Cited by 36
Causal mediation analysis with a latent mediator
Albert, J. M., Geng, C., & Nelson, S. (2016) · Biometrical Journal · doi:10.1002/bimj.201400124 · Cited by 26
Kamrath, C., Wettstaedt, L., Hartmann, M. F., & Wudy, S. A. (2019) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2019-00438 · Cited by 18
A Model-Agnostic Approach for Explaining the Predictions on Clustered Data
Zhou, Z., Sun, M., & Chen, J. (2019) · 2019 IEEE International Conference on Data Mining (ICDM) · doi:10.1109/icdm.2019.00202 · Cited by 5
Dycke, N., & Gurevych, I. (2025) · arXiv · doi:10.48550/arxiv.2508.21422 · Cited by 1
What do we mean by validating a prognostic model?
(2000) · doi:10.1002/(sici)1097-0258(20000229)19:4<453::aid-sim350>3.0.co;2-5
Metadata
- Authors
- Lindstrom, M. J., & Bates, D. M.
- Venue
- Journal of the American Statistical Association
- Publisher
- Informa UK Limited
- Published
- 1988-12
- Volume
- 83
- Issue
- 404
- Pages
- 1014-1022
- ISSN
- 0162-1459 (ISSN-L)
- 1537-274X
- OpenAlex
- W2081283602
- Cited by
- 862
- References
- 0
- FWCI
- 5.70
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
