The effect of correlation structure on treatment contrasts estimated from incomplete clinical trial data with likelihood-based repeated measures compared with last observation carried forward ANOVA
The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
Valid analyses of longitudinal data can be problematic, particularly when subjects dropout prior to completing the trial for reasons related to the outcome. Regulatory agencies often favor the last observation carried forward (LOCF) approach for imputing missing values in the primary analysis of clinical trials. However, recent evidence suggests that likelihood-based analyses developed under the missing at random framework provide viable alternatives. The within-subject error correlation structure is often the means by which such methods account for the bias from missing data. The objective of this study was to extend previous work that used only one correlation structure by including several common correlation structures in order to assess the effect of the correlation structure in the data, and how it is modeled, on Type I error rates and power from a likelihood-based repeated measures analysis (MMRM), using LOCF for comparison. Data from four realistic clinical trial scenarios were simulated using autoregressive, compound symmetric and unstructured correlation structures. When the correct correlation structure was fit, MMRM provided better control of Type I error and power than LOCF. Although misfitting the correlation structure in MMRM inflated Type I error and altered power, misfitting the structure was typically less deleterious than using LOCF. In fact, simply specifying an unstructured matrix for use in MMRM, regardless of the true correlation structure, yielded superior control of Type I error than LOCF in every scenario. The present and previous investigations have shown that the bias in LOCF is influenced by several factors and interactions between them. Hence, it is difficult to precisely anticipate the direction and magnitude of bias from LOCF in practical situations. However, in scenarios where the overall tendency is for patient improvement, LOCF tends to: 1) overestimate a drug's advantage when dropout is higher in the comparator and underestimate the advantage when dropout is lower in the comparator; 2) overestimate a drug's advantage when the advantage is maximum at intermediate time points and underestimate the advantage when the advantage increases over time; and 3) have a greater likelihood of overestimating a drug's advantage when the advantage is small. In scenarios in which the overall tendency is for patient worsening, the above biases are reversed. In the simulation scenarios considered in this study, which were patterned after acute phase neuropsychiatric clinical trials, the likelihood-based repeated measures approach, implemented with standard software, was more robust to the bias from missing data than LOCF, and choice of correlation structure was not an impediment to its implementation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Linear Mixed Models for Longitudinal Data
Verbeke, G. (1997) · Lecture Notes in Statistics · doi:10.1007/978-1-4612-2294-1_3 · Cited by 3,506
ACCOUNTING FOR DROPOUT BIAS USING MIXED-EFFECTS MODELS
Mallinckrodt, C. H., Clark, W. S., & David, S. R. (2001) · Journal of Biopharmaceutical Statistics · doi:10.1081/bip-100104194 · Cited by 398 · cited 7×
“However, the present results and previous empirical studies [4,12-14] have clearly shown that conservative behavior of LOCF is not guaranteed.”
BackgroundMethodResultInfluentialSelf-citationDetke, M. J., Lu, Y., Goldstein, D. J., Hayes, J. R., & Demitrack, M. A. (2002) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.v63n0407 · Cited by 384 · cited 1×
“The unstructured matrix was modeled after the structures seen in previous studies [28-30] where variances tended to increase over time and adjacent correlations Table 2 Co(variances) input for simulations”
MethodDuloxetine in the Treatment of Major Depressive Disorder: A Double-Blind Clinical Trial
Goldstein, D. J., Mallinckrodt, C., Lu, Y., & Demitrack, M. A. (2002) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.v63n0309 · Cited by 334 · cited 1×
“The unstructured matrix was modeled after the structures seen in previous studies [28-30] where variances tended to increase over time and adjacent correlations Table 2 Co(variances) input for simulations”
MethodSelf-citation
Cited by
Prednisone, Azathioprine, and N -Acetylcysteine for Pulmonary Fibrosis
The Idiopathic Pulmonary Fibrosis Clinical Research Network (2012) · New England Journal of Medicine · doi:10.1056/nejmoa1113354 · Cited by 1,621
Recommendations for the Primary Analysis of Continuous Endpoints in Longitudinal Clinical Trials
Mallinckrodt, C. H., Lane, P. W., Schnell, D., Peng, Y., & Mancuso, J. P. (2008) · Drug Information Journal · doi:10.1177/009286150804200402 · Cited by 354
Self-citationMMRM vs. LOCF: A Comprehensive Comparison Based on Simulation Study and 25 NDA Datasets
Siddiqui, O., Hung, H. M. J., & O'Neill, R. (2009) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543400802609797 · Cited by 301
Hartford, J., Kornstein, S., Liebowitz, M., Pigott, T., Russell, J., Detke, M., Walker, D., Ball, S., Dunayevich, E., Dinkel, J., et al. (2007) · International Clinical Psychopharmacology · doi:10.1097/yic.0b013e32807fb1b2 · Cited by 286
Handling drop‐out in longitudinal clinical trials: a comparison of the LOCF and MMRM approaches
Lane, P. (2008) · Pharmaceutical Statistics · doi:10.1002/pst.267 · Cited by 262
Metadata
- Authors
- Mallinckrodt, C. H., Kaiser, C. J., Watkin, J. G., Molenberghs, G., & Carroll, R. J.
- Venue
- Clinical Trials
- Publisher
- SAGE Publications
- Published
- 2004-12
- Volume
- 1
- Issue
- 6
- Pages
- 477-489
- ISSN
- 1740-7745 (ISSN-L)
- 1740-7753
- OpenAlex
- W2119459148
- Cited by
- 94
- References
- 4
- FWCI
- 3.61
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The effect of correlation structure on treatment contrasts estimated from incomplete clinical trial data with likelihood-based repeated measures compared with last observation carried forward ANOVA. https://app.cochat.ai/papers/10.1191/1740774504cn049oa
- The paper
- Mallinckrodt, C. H., Kaiser, C. J., Watkin, J. G., Molenberghs, G., & Carroll, R. J. (2004). The effect of correlation structure on treatment contrasts estimated from incomplete clinical trial data with likelihood-based repeated measures compared with last observation carried forward ANOVA. Clinical Trials. https://doi.org/10.1191/1740774504cn049oa
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.