Analysis of randomised trials with long-term follow-up
Open accessAbstract
Randomised trials with long-term follow-up can provide estimates of the long-term effects of health interventions. However, analysis of long-term outcomes in randomised trials may be complicated by problems with the administration of treatment such as non-adherence, treatment switching and co-intervention, and problems obtaining outcome measurements arising from loss to follow-up and death of participants. Methods for dealing with these issues that involve conditioning on post-randomisation variables are unsatisfactory because they may involve the comparison of non-exchangeable groups and generate estimates that do not have a valid causal interpretation. We describe approaches to analysis that potentially provide estimates of causal effects when such issues arise. Brief descriptions are provided of the use of instrumental variable and propensity score methods in trials with imperfect adherence, marginal structural models and g-estimation in trials with treatment switching, mixed longitudinal models and multiple imputation in trials with loss to follow-up, and a sensitivity analysis that can be used when trial follow-up is truncated by death or other events. Clinical trialists might consider these methods both at the design and analysis stages of randomised trials with long-term follow-up.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
For exercise training there are additional long-term study challenges such as non-adherence to maintenance training.
“For exercise training there are additional challenges such as non-adherence to maintenance training [93, 94].”
From International urogynecology consultation chapter 3 committee 2; conservative treatment of patient with pelvic organ prolapse: Pelvic floor muscle training (2022) · cites this paper as [94]
The Background identifies exercise programs as sustained interventions, and the Main text, under “Non-adherence and non-compliance,” says non-adherence is more common with sustained interventions and discusses adherence to exercise. These passages support non-adherence as a challenge for exercise trials, but do not specifically address maintenance training. Page numbers are not available in our copy. (LLM, conf=0.83)
Experimental — accuracy not yet measuredLong-term studies of any intervention face general challenges from loss to follow-up, co-interventions, treatment switching and competing events.
“There are general challenges to long-term studies of any intervention due to loss-to follow-up, co-interventions, treatment switching and competing events [93, 94].”
From International urogynecology consultation chapter 3 committee 2; conservative treatment of patient with pelvic organ prolapse: Pelvic floor muscle training (2022) · cites this paper as [94]
The Abstract and Background identify loss to follow-up, co-intervention, treatment switching, and death or other events as challenges in randomised trials with long-term follow-up. The claim is broader than the paper: it refers to long-term studies of any intervention, while the paper focuses on randomised trials and its Background table says treatment switching affects intermittent or sustained interventions. (LLM, conf=0.85)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
A Proportional Hazards Model for the Subdistribution of a Competing Risk
Fine, J. P., & Gray, R. J. (1999) · Journal of the American Statistical Association · doi:10.1080/01621459.1999.10474144 · Cited by 14,290 · cited 1× · see citing works
“Arguably such analyses should not be conducted [10].”
BackgroundEstimating causal effects of treatments in randomized and nonrandomized studies
Rubin, D. B. (1974) · Journal of Educational Psychology · doi:10.1037/h0037350 · Cited by 9,436 · see citing works
Sterne, J. A. C., White, I. R., Carlin, J. B., Spratt, M., Royston, P., Kenward, M. G., Wood, A. M., & Carpenter, J. R. (2009) · BMJ · doi:10.1136/bmj.b2393 · Cited by 7,299 · see citing works
Fisher, B., Anderson, S., Bryant, J., Margolese, R. G., Deutsch, M., Fisher, E. R., Jeong, J.-H., & Wolmark, N. (2002) · New England Journal of Medicine · doi:10.1056/nejmoa022152 · Cited by 6,249 · see citing works
Statistics and Causal Inference
Holland, P. W. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478354 · Cited by 5,293 · see citing works
Identification of Causal Effects Using Instrumental Variables
Angrist, J. D., Imbens, G. W., & Rubin, D. B. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476902 · Cited by 4,230 · see citing works
Review: a gentle introduction to imputation of missing values.
Donders, A. R. T., van der Heijden, G. J. M. G., Stijnen, T., & Moons, K. G. M. (2006) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.01.014 · Cited by 2,582 · see citing works
The prevention and treatment of missing data in clinical trials
Little, R. J., D'Agostino, R., Cohen, M. L., Dickersin, K., Emerson, S. S., Farrar, J. T., Frangakis, C., Hogan, J. W., Molenberghs, G., Murphy, S. A., et al. (2012) · New England Journal of Medicine · doi:10.1056/nejmsr1203730 · Cited by 1,884 · see citing works
Explanation in Causal Inference: Methods for Mediation and Interaction
VanderWeele, T. J. (2015) · Cited by 1,540 · see citing works
Angrist, J. D., & Imbens, G. W. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476535 · Cited by 1,346 · see citing works
Explanatory and Pragmatic Attitudes in Therapeutical Trials
Schwartz, D., & Lellouch, J. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.01.012 · Cited by 1,253 · see citing works
Explanatory and pragmatic attitudes in therapeutical trials
Schwartz, D., & Lellouch, J. (1967) · Journal of Chronic Diseases · doi:10.1016/0021-9681(67)90041-0 · Cited by 1,185 · see citing works
Angrist, J. D., & Imbens, G. W. (1995) · Journal of the American Statistical Association · doi:10.2307/2291054 · Cited by 917 · see citing works
Beyond the intention-to-treat in comparative effectiveness research
Hernán, M. A., & Hernández-Díaz, S. (2012) · Clinical Trials · doi:10.1177/1740774511420743 · Cited by 528 · see citing works
Making trials matter: pragmatic and explanatory trials and the problem of applicability
Treweek, S. P., & Zwarenstein, M. (2009) · Trials · doi:10.1186/1745-6215-10-37 · Cited by 482 · see citing works
The Prevention and Treatment of Missing Data in Clinical Trials
National Research Council (2010) · National Academies Press eBooks · doi:10.17226/12955 · Cited by 439 · see citing works
Methods for dealing with time‐dependent confounding
Daniel, R., Cousens, S. N., Stavola, B. L. D., Kenward, M. G., & Sterne, J. A. C. (2012) · Statistics in Medicine · doi:10.1002/sim.5686 · Cited by 378 · see citing works
Does Cox analysis of a randomized survival study yield a causal treatment effect?
Aalen, O. O., Cook, R. J., & Røysland, K. (2015) · Lifetime Data Analysis · doi:10.1007/s10985-015-9335-y · Cited by 213 · see citing works
Dunn, G., Maracy, M. R., & Tomenson, B. (2005) · Statistical Methods in Medical Research · doi:10.1191/0962280205sm403oa · Cited by 203 · see citing works
Missing Data in Clinical Studies: Issues and Methods
Ibrahim, J. G., Chu, H., & Chen, M. (2012) · Journal of Clinical Oncology · doi:10.1200/jco.2011.38.7589 · Cited by 202 · see citing works
Lower Urinary Tract Symptoms and Pelvic Floor Muscle Exercise Adherence After 15 Years
Bø, K., Kvarstein, B., & Nygaard, I. (2005) · Obstetrics & Gynecology · doi:10.1097/01.aog.0000157207.95680.6d · Cited by 159 · see citing works
Self-citationA Simple Method for Principal Strata Effects When the Outcome Has Been Truncated Due to Death
Chiba, Y., & VanderWeele, T. J. (2011) · American Journal of Epidemiology · doi:10.1093/aje/kwq418 · Cited by 143 · see citing works
Causal Inference from Longitudinal Studies with Baseline Randomization
Toh, S., & Hernán, M. Á. (2008) · The International Journal of Biostatistics · doi:10.2202/1557-4679.1117 · Cited by 128 · see citing works
On the use of propensity scores in principal causal effect estimation
Jo, B., & Stuart, E. A. (2009) · Statistics in Medicine · doi:10.1002/sim.3669 · Cited by 115 · see citing works
Estimating Intervention Effects of Prevention Programs: Accounting for Noncompliance
Stuart, E. A., Perry, D. F., Le, H., & Ialongo, N. S. (2008) · Prevention Science · doi:10.1007/s11121-008-0104-y · Cited by 112 · see citing works
Beyond intention to treat: What is the right question?
Shrier, I., Steele, R. J., Verhagen, E. A. L. M., Herbert, R., Riddell, C. A., & Kaufman, J. S. (2013) · Clinical Trials · doi:10.1177/1740774513504151 · Cited by 106 · see citing works
Self-citationThe Truncation-by-Death Problem
McConnell, S., Stuart, E. A., & Devaney, B. (2008) · Evaluation Review · doi:10.1177/0193841x07309115 · Cited by 52 · see citing works
TREATMENT SWITCHING: STATISTICAL AND DECISION-MAKING CHALLENGES AND APPROACHES
Latimer, N. R., Henshall, C., Siebert, U., & Bell‐Gorrod, H. (2016) · International Journal of Technology Assessment in Health Care · doi:10.1017/s026646231600026x · Cited by 39 · see citing works
Reporting delay and corrected incidence of multiple sclerosis
Esbjerg, S., Keiding, N., & Koch‐Henriksen, N. (1999) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19990715)18:13 · Cited by 38 · see citing works
Daza, E. J., Hudgens, M. G., & Herring, A. H. (2017) · The Stata Journal Promoting communications on statistics and Stata · doi:10.1177/1536867x1701700202 · Cited by 21 · see citing works
Instrumental Variables Methods in Experimental Criminological Research: What, Why, and How?
Angrist, J. D. (2005) · National Bureau of Economic Research · doi:10.3386/t0314 · Cited by 18 · see citing works
Explanatory and Pragmatic Clinical Trials
Herbert, R. (2010) · Pharmaceutical Sciences Encyclopedia · doi:10.1002/9780470571224.pse246 · Cited by 5 · see citing works
Self-citationStuart, E. A., Warkentien, S., & Jo, B. (2011) · Society for Research on Educational Effectiveness · Cited by 2 · see citing works
Morgan, A. (2012) · Cancer Nursing Practice · doi:10.7748/cnp.11.3.8.s2 · Cited by 1 · see citing works
Flagged first, then by citations
Research works printed but not linked: 1
- [28]Evans I Thornton H Chalmers I Glasziou P Testing treatments 2011 2 London Pinter & Martin 22171402
Cited by
Sorted by citations
Physiotherapy management of urinary incontinence in females
Bø, K. (2020) · Journal of Physiotherapy · doi:10.1016/j.jphys.2020.06.011 · Cited by 80 · see citing works
Self-citationBø, K., Anglès-Acedo, S., Batra, A., Brækken, I. H., Chan, Y. L., Jorge, C. H., Kruger, J., Yadav, M., & Dumoulin, C. (2022) · International Urogynecology Journal · doi:10.1007/s00192-022-05324-0 · Cited by 64 · see citing works
“For exercise training there are additional challenges such as non-adherence to maintenance training [93, 94].”
BackgroundSelf-citation
- Authors
- Herbert, R. D., Kasza, J., & Bø, K.
- Affiliations
- Monash University (AU)
- Akershus University Hospital (NO)
- Venue
- BMC Medical Research Methodology
- Published
- 2018-05-29
- Volume
- 18
- Issue
- 1
- Pages
- 48-48
- ISSN
- 1471-2288 (ISSN-L)
- PMC
- PMC5975460
- OpenAlex
- W2806048670
- Cited by
- 80
- References
- 34
- Citations by year
- 2026: 10 · 2025: 12 · 2024: 7 · 2023: 12 · 2022: 14 · 2021: 13 · 2020: 9 · 2019: 3
- FWCI
- 5.15
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- BMC Medical Research Methodology (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Monash University Research Portal (Monash University) (acceptedVersion, other-oa)
- UNSWorks (University of New South Wales, Sydney, Australia) (submittedVersion, cc-by-nc-nd)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- NORA - Norwegian Open Research Archives (submittedVersion, cc-by)
- Funders
- National Health and Medical Research Council (RG153190)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Keywords
- randomised trials, long-term follow-up, medication adherence, treatment switching, co-interventions, loss to follow-up, causal inference, instrumental variables, propensity score methods, marginal structural models, G-estimation, multiple imputation, sensitivity analysis, truncation by death
- MeSH terms
- Follow-Up Studies, Humans, Time Factors, Randomized Controlled Trials as Topic, Drug Monitoring, Outcome Assessment, Health Care
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review