A case study on the choice, interpretation and checking of multilevel models for longitudinal binary outcomes
Open accessThe DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
Recent advances in statistical software have led to the rapid diffusion of new methods for modelling longitudinal data. Multilevel (also known as hierarchical or random effects) models for binary outcomes have generally been based on a logistic-normal specification, by analogy with earlier work for normally distributed data. The appropriate application and interpretation of these models remains somewhat unclear, especially when compared with the computationally more straightforward semiparametric or 'marginal' modelling (GEE) approaches. In this paper we pose two interrelated questions. First, what limits should be placed on the interpretation of the coefficients and inferences derived from random-effect models involving binary outcomes? Second, what diagnostic checks are appropriate for evaluating whether such random-effect models provide adequate fits to the data? We address these questions by means of an extended case study using data on adolescent smoking from a large cohort study. Bayesian estimation methods are used to fit a discrete-mixture alternative to the standard logistic-normal model, and posterior predictive checking is used to assess model fit. Surprising parallels in the parameter estimates from the logistic-normal and mixture models are described and used to question the interpretability of the so-called 'subject-specific' regression coefficients from the standard multilevel approach. Posterior predictive checks suggest a serious lack of fit of both multilevel models. The results do not provide final answers to the two questions posed, but we expect that lessons learned from the case study will provide general guidance for further investigation of these important issues.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Estimating causal effects of treatments in randomized and nonrandomized studies
Rubin, D. B. (1974) · Journal of Educational Psychology · doi:10.1037/h0037350 · Cited by 9,436 · cited 1×
“Under suitable assumptions, such differences may sometimes be interpreted as causal effects (Rubin, 1974; Holland, 1986).”
BackgroundMIXOR: a computer program for mixed-effects ordinal regression analysis
Hedeker, D., & Gibbons, R. D. (1996) · Computer Methods and Programs in Biomedicine · doi:10.1016/0169-2607(96)01720-8 · Cited by 408 · cited 1×
“The second approach is to use Gauss–Hermite quadrature to evaluate the likelihood using numerical integration; this has been implemented in the freeware package MIXOR (Hedeker et al., 1994; Hedeker and Gibbons, 1996) and is now also available for models involving one random effect in Stata.”
Method
Cited by
(2009) · Cited by 2,013
Latent Variable Analysis: Growth Mixture Modeling and Related Techniques for Longitudinal Data
Muthén, B. (2004) · The SAGE Handbook of Quantitative Methodology for the Social Sciences · doi:10.4135/9781412986311.n19 · Cited by 1,534
Hubbard (2010) · doi:10.1097/ede.0b013e3181caeb90 · Cited by 1,139
15 Design and Analysis of Cross-Over Trials
Kenward, M. G., & Jones, B. (2007) · Handbook of Statistics · doi:10.1016/s0169-7161(07)27015-4 · Cited by 871
On the unnecessary ubiquity of hierarchical linear modeling.
McNeish, D., Stapleton, L. M., & Silverman, R. D. (2017) · Psychological Methods · doi:10.1037/met0000078 · Cited by 742
Metadata
- Authors
- Carlin, J. B.
- Venue
- Biostatistics
- Publisher
- Oxford University Press (OUP)
- Published
- 2001-12-01
- Volume
- 2
- Issue
- 4
- Pages
- 397-416
- ISSN
- 1465-4644 (ISSN-L)
- 1468-4357
- OpenAlex
- W2141105019
- Cited by
- 109
- References
- 2
- FWCI
- 3.28
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.