The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
Maximizing Generalized Linear Mixed Model Likelihoods With an Automated Monte Carlo EM Algorithm
Open accessAbstract
Summary: Two new implementations of the EM algorithm are proposed for maximum likelihood fitting of generalized linear mixed models. Both methods use random (independent and identically distributed) sampling to construct Monte Carlo approximations at the E-step. One approach involves generating random samples from the exact conditional distribution of the random effects (given the data) by rejection sampling, using the marginal distribution as a candidate. The second method uses a multivariate t importance sampling approximation. In many applications the two methods are complementary. Rejection sampling is more efficient when sample sizes are small, whereas importance sampling is better with larger sample sizes. Monte Carlo approximation using random samples allows the Monte Carlo error at each iteration to be assessed by using standard central limit theory combined with Taylor series methods. Specifically, we construct a sandwich variance estimate for the maximizer at each approximate E-step. This suggests a rule for automatically increasing the Monte Carlo sample size after iterations in which the true EM step is swamped by Monte Carlo error. In contrast, techniques for assessing Monte Carlo error have not been developed for use with alternative implementations of Monte Carlo EM algorithms utilizing Markov chain Monte Carlo E-step approximations. Three different data sets, including the infamous salamander data of McCullagh and Nelder, are used to illustrate the techniques and to compare them with the alternatives. The results show that the methods proposed can be considerably more efficient than those based on Markov chain Monte Carlo algorithms. However, the methods proposed may break down when the intractable integrals in the likelihood function are of high dimension.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
Statistical Analysis With Missing Data
Lahiff, M., Little, R. J. A., & Rubin, D. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289883 · Cited by 17,265
Littell, R. C. (1996) · Medical Entomology and Zoology · Cited by 10,547
The EM Algorithm and Extensions
Kushary, D. (1998) · Technometrics · doi:10.1080/00401706.1998.10485534 · Cited by 5,417
Generalized Linear Models (2nd ed.).
Therneau, T. M., McCullagh, P., & Nelder, J. A. (1993) · Journal of the American Statistical Association · doi:10.2307/2290358 · Cited by 4,907
Approximate Inference in Generalized Linear Mixed Models
Breslow, N. E., & Clayton, D. G. (1993) · Journal of the American Statistical Association · doi:10.1080/01621459.1993.10594284 · Cited by 4,629
Statistical Analysis With Missing Data
Ghosh, S. (1988) · Technometrics · doi:10.1080/00401706.1988.10488446 · Cited by 4,576
Markov Chains for Exploring Posterior Distributions
Tierney, L. (1994) · The Annals of Statistics · doi:10.1214/aos/1176325750 · Cited by 3,452
On the Convergence Properties of the EM Algorithm
Wu, C. F. J. (1983) · The Annals of Statistics · doi:10.1214/aos/1176346060 · Cited by 3,269
Finding the Observed Information Matrix When Using the EM Algorithm
Louis, T. A. (1982) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1982.tb01203.x · Cited by 2,229
Practical markov chain monte carlo
Geyer, C. J. (1992) · Statistical Science · doi:10.1214/ss/1177011137 · Cited by 2,045
Maximum likelihood estimation via the ECM algorithm: A general framework
MENG, X.-L., & RUBIN, D. B. (1993) · Biometrika · doi:10.1093/biomet/80.2.267 · Cited by 1,861
Generalized Linear Models, 2nd Edn.
Cheek, P. J., McCullagh, P., & Nelder, J. A. (1990) · Applied Statistics · doi:10.2307/2347392 · Cited by 1,512
A Monte Carlo Implementation of the EM Algorithm and the Poor Man's Data Augmentation Algorithms
Wei, G. C. G., & Tanner, M. A. (1990) · Journal of the American Statistical Association · doi:10.1080/01621459.1990.10474930 · Cited by 1,453
Asymptotic methods in analysis
de Bruijn, N. G. (1958) · International Linear Collider · Cited by 1,332
The Selection of Prior Distributions by Formal Rules
Kass, R. E., & Wasserman, L. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10477003 · Cited by 1,308
Generalized linear mixed models a pseudo-likelihood approach
Wolfinger, R., & O'connell, M. (1993) · Journal of Statistical Computation and Simulation · doi:10.1080/00949659308811554 · Cited by 1,271
Estimation in generalized linear models with random effects
SCHALL, R. (1991) · Biometrika · doi:10.1093/biomet/78.4.719 · Cited by 1,243
Generalized Linear Models with Random Effects; a Gibbs Sampling Approach
Zeger, S. L., & Karim, M. R. (1991) · Journal of the American Statistical Association · doi:10.1080/01621459.1991.10475006 · Cited by 987
Hierarchical Generalized Linear Models
Lee, Y., & Nelder, J. A. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02105.x · Cited by 970
Lachenbruch, P. A., McCullagh, P., & Nelder, J. A. (1990) · Biometrics · doi:10.2307/2532465 · Cited by 939
The EM Algorithm—an Old Folk-song Sung to a Fast New Tune
Meng, X.-L., & Van Dyk, D. (1997) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00082 · Cited by 802
Maximum Likelihood Algorithms for Generalized Linear Mixed Models
McCulloch, C. E. (1997) · Journal of the American Statistical Association · doi:10.1080/01621459.1997.10473613 · Cited by 761
The ECME algorithm: A simple extension of EM and ECM with faster monotone convergence
LIU, C., & RUBIN, D. B. (1994) · Biometrika · doi:10.1093/biomet/81.4.633 · Cited by 613
MTW, & Tanner, M. A. (1997) · Journal of the American Statistical Association · doi:10.2307/2965746 · Cited by 608
Asymptotic Methods in Analysis
Fedoryuk, M. V. (1989) · Encyclopaedia of Mathematical Sciences · doi:10.1007/978-3-642-61310-4_2 · Cited by 508
Analysis of Binary Data (2nd ed.).
Steffey, D., Cox, D. R., & Snell, E. J. (1990) · Journal of the American Statistical Association · doi:10.2307/2289625 · Cited by 499
Bias correction in generalised linear mixed models with a single component of dispersion
BRESLOW, N. E., & LIN, X. (1995) · Biometrika · doi:10.1093/biomet/82.1.81 · Cited by 497
Bias Correction in Generalized Linear Mixed Models with Multiple Components of Dispersion
Lin, X., & Breslow, N. E. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476971 · Cited by 407
Nonlinear multilevel models, with an application to discrete response data
GOLDSTEIN, H. (1991) · Biometrika · doi:10.1093/biomet/78.1.45 · Cited by 395
Geometric Ergodicity and Hybrid Markov Chains
Roberts, G., & Rosenthal, J. (1997) · Electronic Communications in Probability · doi:10.1214/ecp.v2-981 · Cited by 317
Latent Variable Models for Mixed Discrete and Continuous Outcomes
Sammel, M. D., Ryan, L. M., & Legler, J. M. (1997) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00090 · Cited by 313
Monte Carlo EM Estimation for Time Series Models Involving Counts
Chan, K. S., & Ledolter, J. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476508 · Cited by 275
Estimation in Generalized Mixed Models
McGilchrist, C. A. (1994) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1994.tb01959.x · Cited by 274
Maximum Likelihood Variance Components Estimation for Binary Data
McCulloch, C. E. (1994) · Journal of the American Statistical Association · doi:10.1080/01621459.1994.10476474 · Cited by 229
Generalized Linear Models with Random Effects; Salamander Mating Revisited
Karim, M. R., & Zeger, S. L. (1992) · Biometrics · doi:10.2307/2532317 · Cited by 156
Asymptotically Unbiased Estimation in Generalized Linear Models with Random Effects
Kuk, A. Y. C. (1995) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.2517-6161.1995.tb02035.x · Cited by 138
Maximum Likelihood Estimation for Probit-Linear Mixed Models with Correlated Random Effects
Chan, J., & Kuk, A. Y. C. (1997) · Biometrics · doi:10.2307/2533099 · Cited by 93
Analysis of Binary Data. 2nd Edn.
Diamond, I. D., Cox, D. R., & Snell, E. J. (1990) · Journal of the Royal Statistical Society Series C (Applied Statistics) · doi:10.2307/2347766 · Cited by 79
Logistic regression with random coefficients
Longford, N. T. (1994) · Computational Statistics & Data Analysis · doi:10.1016/0167-9473(92)00062-v · Cited by 77
A Relative Off set Orthogonality Convergence Criterion for Nonlinear least Squares
Bates, D. M., & Watts, D. G. (1981) · Technometrics · doi:10.1080/00401706.1981.10486262 · Cited by 72
Natarajan, R., & McCulloch, C. E. (1995) · Biometrika · doi:10.1093/biomet/82.3.639 · Cited by 66
Geometric Ergodicity of Gibbs and Block Gibbs Samplers for a Hierarchical Random Effects Model
Hobert, J. P., & Geyer, C. J. (1998) · Journal of Multivariate Analysis · doi:10.1006/jmva.1998.1778 · Cited by 66
Self-citationLansky, D. M., & Casella, G. (1992) · Springer eBooks · doi:10.1007/978-1-4612-2856-1_67 · Cited by 11
Cited by
Generalized linear mixed models: a practical guide for ecology and evolution
Bolker, B. M., Brooks, M. E., Clark, C. J., Geange, S. W., Poulsen, J. R., Stevens, M. H. H., & White, J.-S. S. (2009) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2008.10.008 · Cited by 8,910
Park, T., & Casella, G. (2008) · Journal of the American Statistical Association · doi:10.1198/016214508000000337 · Cited by 2,934
Optimization Transfer Using Surrogate Objective Functions
Lange, K., Hunter, D. R., & Yang, I. (2000) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.2000.10474858 · Cited by 808
Regression-based latent factor models
Agarwal, D., & Chen, B.-C. (2009) · Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1557019.1557029 · Cited by 514
Generalized Linear Mixed Models
Mcculloch, C. E., & Neuhaus, J. M. (2014) · Wiley StatsRef: Statistics Reference Online · doi:10.1002/9781118445112.stat07540 · Cited by 459
Metadata
- Authors
- Booth, J. G., & Hobert, J. P.
- Venue
- Journal of the Royal Statistical Society Series B: Statistical Methodology
- Publisher
- Oxford University Press (OUP)
- Published
- 1999-01-01
- Volume
- 61
- Issue
- 1
- Pages
- 265-285
- ISSN
- 1369-7412 (ISSN-L)
- 1467-9868
- OpenAlex
- W2090692107
- Cited by
- 551
- References
- 44
- FWCI
- 19.17
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.