Is intent‐to‐treat analysis always (ever) enough?
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
In a commentary written several years ago [1], Professor D. Rubin and I pointed out that one is usually advised to analyse clinical trials – the preferred modern strategy for empirical evaluation of medical therapies [2, 3]– for significance levels and estimates using only, or at least primarily, the intention-to-treat principle (see, e.g. [4]). We noted, however, that the intention-to-treat estimator (see below) estimates so-called 'use-effectiveness', the causal effect on outcome of prescribing the drug, rather than the medically more important 'method-effectiveness', the causal effect on outcome of actually taking the drug. We argued that studies should be designed so that they can yield valid estimates of method-effectiveness, although so long as protocols are not followed exactly, such estimates may depend heavily on additional assumptions (scientific models – see section on longitudinal data with dropout, below); ones that go beyond the data at hand. In this paper, I present a conceptual framework for thinking about causal estimands and estimators for both use and method effectiveness, with emphasis on the latter, focusing on the problems posed by deviations from protocol, notably noncompliance and dropout. The paper is a review and exposition, rather than a presentation of original material. Section 2 presents a conceptual framework, setting context, defining causal estimands (population quantities describing causal effects of treatments) for use effectiveness and method effectiveness, how these change in the face of noncompliance, and the problem created by dropout; section 3 discusses estimators of the causal estimands defined in section 2; section 4 considers the effect of dropout on the estimators; and section 5 discusses implications for study design. Although different in some details, the ideas, point of view, and notation presented here are essentially those presented in the statistical literature by D. Rubin and colleagues, based on the Rubin Causal Model. Rather than provide extensive references throughout this work, I limit further citations to important additional works which discuss specific points or present examples, and offer here a minimal set of references which provide background and an entree to the relevant literature [5, 6], and a more complete and technical discussion of noncompliance [1, 7-9], dropout [10, 11], and scientific modelling of drug dose-concentration-response [12, 13]. The context is a clinical trial in which n individuals are nominally assigned either to a control treatment, coded 0, or a test treatment, coded 1, and a univariate outcome is observed. The control and test treatments are assumed to differ. The random variable indicating nominal assignment for individual i is Zi, and the random variable denoting the individual's outcome is Yi. A key design feature of randomized clinical trials is 'random assignment' to nominal treatment. Since the validity of every estimator discussed in section 3 depends on this assumption, it deserves to be stated formally: it is assumed henceforth that the probability of being assigned to test (control) treatment is independent of pretrial prognosis and all other baseline patient characteristics. Two types of deviation from protocol will be of concern to this paper, noncompliance and dropout, and I introduce next the notation required to deal with them. Non-compliance recognizes that nominal assignment, the treatment assigned by the experimenter, may differ from actual assignment, the treatment taken by the patient. The random variable indicating actual assignment is Di; it can be written Di(Zi) to explicitly recognize that it is a function of assignment. Di can take the value 0, 1 or 'other', where the first two values correspond to values of Z– control (0) and test (1) – and the last indicates no particular treatment, but simply that actual treatment is unknown; some alternative is pursued. Thus, while recognizing only one 'version' of control and test treatments, I acknowledge the possibility of multiple versions of the alternative. In general, Y will be a function of D (and hence Z). Let Yi(d) denote the potential outcome (see below) for individual i actually receiving treatment Di=d. To maintain parallelism with dropout (below), I introduce the (redundant) random variable ), where I(·) is the indicator function, taking the value 1 if its logical argument is true, and 0 if it is not, to designate whether the intended outcome is observed (Ui=1) or not (Ui=0). I assume that the compliance tendency of each individual in the circumstances of the trial is a (unknown) baseline variable, Vi, which determines the values of Ui(z) according to Table 1. Dropout, as a problem for analysis and interpretation of a clinical trial herein refers to a data set that is incomplete due to the loss of the outcome datum from one or more subjects. The random variable indicating responder status is Ri. It takes the value 1 if the outcome of individual
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Identification of Causal Effects Using Instrumental Variables
Angrist, J. D., Imbens, G. W., & Rubin, D. B. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476902 · Cited by 4,230
Multiple imputation after 18+ years
Rubin, D. B. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476908 · Cited by 4,072
Causal Diagrams for Epidemiologic Research
Greenland, S., Pearl, J., & Robins, J. M. (1999) · Epidemiology · doi:10.1097/00001648-199901000-00008 · Cited by 3,728
Little, R. J., & Rubin, D. B. (2000) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.21.1.121 · Cited by 721
Bayesian inference for causal effects in randomized experiments with noncompliance
Imbens, G. W., & Rubin, D. B. (1997) · The Annals of Statistics · doi:10.1214/aos/1034276631 · Cited by 538
Pharmacokinetic/Pharmacodynamic Modeling in Drug Development
Sheiner, L. B., & Steimer, J.-L. (2000) · Annual Review of Pharmacology and Toxicology · doi:10.1146/annurev.pharmtox.40.1.67 · Cited by 351
Cited by
Intention-to-treat concept: A review
Gupta, S. (2011) · Perspectives in Clinical Research · doi:10.4103/2229-3485.83221 · Cited by 1,921
Ordás, I., Mould, D. R., Feagan, B. G., & Sandborn, W. J. (2012) · Clinical Pharmacology & Therapeutics · doi:10.1038/clpt.2011.328 · Cited by 498
Macnamara, B. N., & Burgoyne, A. P. (2023) · Psychological Bulletin · doi:10.1037/bul0000352 · Cited by 415
“Per-protocol analyses are sometimes described as “ proof of principle ” or method effectiveness (Porta et al., 2007; Sheiner, 2002) and are most appropriate when the goal of the study is to evaluate the potential bene fi t for those who receive the treatment as planned (Hollis & Campbell, 1999).”
BackgroundAndrews, P. J. D., Avenell, A., Noble, D. W., Campbell, M. K., Croal, B. L., Simpson, W. G., Vale, L. D., Battison, C. G., Jenkinson, D. J., Cook, J. A., et al. (2011) · BMJ · doi:10.1136/bmj.d1542 · Cited by 379
Improving Adherence to Smoking Cessation Treatment: Smoking Outcomes in a Web-based Randomized Trial
Graham, A. L., Papandonatos, G. D., Cha, S., Erar, B., & Amato, M. S. (2018) · Annals of Behavioral Medicine · doi:10.1093/abm/kax023 · Cited by 18
“Following the recommendations of Sheiner and Rubin [30, 31], we then used novel methodological approaches to estimate the causal effects of treatment utilization in promoting short-term abstinence, when the recommended treatment components (online community and cessation medication) were used alone or in combination.”
Method
Metadata
- Authors
- Sheiner, L. B.
- Venue
- British Journal of Clinical Pharmacology
- Publisher
- Wiley
- Published
- 2002-08
- Volume
- 54
- Issue
- 2
- Pages
- 203-211
- ISSN
- 0306-5251 (ISSN-L)
- 1365-2125
- OpenAlex
- W1505057094
- Cited by
- 53
- References
- 6
- FWCI
- 1.08
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Is intent‐to‐treat analysis always (ever) enough? https://app.cochat.ai/papers/10.1046/j.1365-2125.2002.01628.x
- The paper
- Sheiner, L. B. (2002). Is intent‐to‐treat analysis always (ever) enough? British Journal of Clinical Pharmacology. https://doi.org/10.1046/j.1365-2125.2002.01628.x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.