Non‐inferiority trials: the ‘at least as good as’ criterion
The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
Abstract
To demonstrate in a clinical trial that a new or experimental therapy (et) is ‘at least as good as’ a standard therapy (st), a statistical test or confidence interval procedure must rule out clinical inferiority with a high probability. The term ‘at least as good as’ implies equivalent but not necessarily superior efficacy. As it is statistically impossible to demonstrate equivalence (that is, prove the null hypothesis of no difference), Blackwelder proposed a one‐sided significance test to reject the null hypothesis that standard therapy is better than experimental therapy by a clinically acceptable amount, δ BW. In this paper, Blackwelder's approach is redefined in terms of the ratio of two means (RTrue=μ et/μ st) based on a continuous variate with higher values denoting greater improvement. The ratio‐based equivalents to Blackwelder's hypotheses will be shown. The ratio parameter has the benefit of being available as a dimensionless percentage, not tied to a specified difference in means. Thus, a study can be sized to assure, with high probability, that the experimental therapy is ‘at least’ (RLB×100) per cent ‘as effective as’ the standard therapy, where RLB is the selected lower bound on the percentage effectiveness. A practical rationale is given for defining non‐inferiority as a high fraction or percentage of the standard drug's efficacy, both in terms of statistical efficiency and medical relevance. For most typical ‘at least as good as’ applications (when RLB<RTrue ⩽1), the ratio formatted test of H0:RTrue⩽RLB is shown to be more efficient than Blackwelder's test of H0:μ st ‐ μ et ⩾ δ BW, thereby requiring smaller sample sizes to detect the directionally based non‐null alternatives contained in H1:μ et/μ st>RLB or, equivalently, μ st ‐ μ et<δ BW. Further, when RTrue= 1.0, tests of Blackwelder's hypotheses, their ratio‐based equivalents and conventional superiority can be evaluated for comparative efficiency. Testing H0:RTrue⩽R LB with single‐sided critical region of size α, versus H1:RTrue>RLB, is shown to be more efficient than excluding RLB from the lower limit of a 100(1–2α) per cent two‐sided symmetric confidence interval centred by R̂. Relevant examples will be presented. Copyright © 2003 John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Schuirmann, D. J. (1987) · Journal of Pharmacokinetics and Biopharmaceutics · doi:10.1007/bf01068419 · Cited by 2,696
Cited by
Aspirin and extended-release dipyridamole versus clopidogrel for recurrent stroke
Sacco, R. L., Diener, H.-C., Yusuf, S., Cotton, D., Ôunpuu, S., Lawton, W. A., Palesch, Y., Martin, R. H., Albers, G. W., Bath, P., et al. (2008) · New England Journal of Medicine · doi:10.1056/nejmoa0805002 · Cited by 961
Heres, S., Davis, J., Maino, K., Jetzinger, E., Kissling, W., & Leucht, S. (2006) · American Journal of Psychiatry · doi:10.1176/appi.ajp.163.2.185 · Cited by 450
Guidance on the environmental risk assessment of genetically modified plants
(GMO), E. P. O. G. M. O. (2010) · EFSA Journal · doi:10.2903/j.efsa.2010.1879 · Cited by 428
“The effect size may be asymmetric, and in particular may be set as zero in one direction to yield a non-inferiority form of the equivalence test (Laster and Johnson, 2003).”
Oviedo-Joekes, E., Guh, D., Brissette, S., Marchand, K., MacDonald, S., Lock, K., Harrison, S., Janmohamed, A., Anis, A. H., Krausz, M., et al. (2016) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2016.0109 · Cited by 208
Bio-creep in non-inferiority clinical trials
Everson‐Stewart, S., & Emerson, S. S. (2010) · Statistics in Medicine · doi:10.1002/sim.4053 · Cited by 64
Metadata
- Authors
- Laster, L. L., & Johnson, M. F.
- Venue
- Statistics in Medicine
- Publisher
- Wiley
- Published
- 2002-12-18
- Volume
- 22
- Issue
- 2
- Pages
- 187-200
- ISSN
- 0277-6715 (ISSN-L)
- 1097-0258
- OpenAlex
- W2104524275
- Cited by
- 101
- References
- 1
- FWCI
- 2.52
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.