Commentary: Relative treatment effects are consistent across the spectrum of underlying risks … usually
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
To practice evidence-based therapeutics, clinicians have to integrate measures of efficacy and safety from the literature with their patient's unique risks and values.1 To do this requires two assumptions. First, we assume that we can accurately estimate our patient's underlying baseline risk (or the ‘expected event rate’ referred to by Furukawa and colleagues).2 This is no simple matter: while clinicians appear to be reasonably accurate in estimating the relative risks of different patients, even experienced clinicians perform poorly when estimating any one individual's absolute risk.3 Methods for estimating the expected event rate for a particular patient have recently been reviewed and will not be considered further in this commentary.1 The second common assumption in extrapolating from trials or meta-analyses to individual patients (who typically are at different risks from the ‘average patient’ in these studies), is that the relative effects of therapy are similar for patients at different risks. The study by Furukawa and colleagues2 in this issue of the International Journal of Epidemiology adds to the emerging evidence supporting the validity of this assumption. In discussing underlying or baseline risks in this commentary, I am not referring simply to the control event rate, but rather to patient characteristics (such as age, gender, disease aetiology, concomitant conditions, or disease status) present at baseline and known to impact prognosis for that particular disease. It is well recognized that any analyses relating treatment effects to control event rates in the same dataset will demonstrate a relation even if none exists (since the control event rate factors into both the expression for baseline risk and the expression for treatment effect).4 The best evidence for deciding whether treatment responsiveness differs across a spectrum of underlying risks would arise from individual patient data meta-analyses where the relative treatment effects in subgroups with widely varying risks can be directly compared. Although some such analyses have been conducted, they are few and far between and we are left to consider the second best approach to address this question: comparison of the relative treatment effects in different trials testing the same intervention (assuming that patients in different trials with the same condition will have different risk profiles). The problem is how to find these groups of related trials—the easiest solution (employed by Furukawa and colleagues) is to review the reference lists of the rigorously conducted systematic reviews included in the Cochrane Collaboration database. I have described this approach as second best as selection bias may very well distort the findings (since a group of trials reporting widely divergent treatment effects are unlikely to be pooled to provide a single summary measure due to excessive heterogeneity). However, at this time it is the best we have. Schmid et al.5 provided the first such systematic approach by examining the relationship between effect measures and baseline risk in 115 meta-analyses (using a hierarchical model to account for the functional correlation between observed rates discussed earlier and random error in measurement of the control rate). They found that while the risk difference was significantly related to underlying risk in 31% of cases, in 87% of cases the relative risk (RR) (and in 86% of cases the odds ratio [OR]) did not vary significantly with the control event rate. Fukurawa and colleagues extend this work in a separate dataset by demonstrating high rates of concordance for both the OR and the RR in 1843 comparisons between individual trials and the summary effect measures derived from pooling all other trials in that topic area.2 In particular, they found that the concordance rates were high for both OR and RR even when control event rates differed substantially (up to threefold) between trials. They found a qualitative discrepancy (where an individual trial reported an RR [or OR] in the opposite direction from the summary RR [or OR] for the other trials) in only 4% of cases but could not discern any features of these trials that suggested why such a discrepancy may occur. Thus, while both studies suggest that relative effect measures are constant across the usual spectrum of underlying risks in the vast majority of cases, neither study has advanced our understanding of when this assumption is unlikely to hold. Sackett has hypothesized that relative treatment effects will be constant over the usual range of underlying risks for ‘risk factor’ interventions designed to slow the progress of disease, but that they will rise with increasing baseline risk for interventions designed to reverse the consequences of a disease process.6 This latter situation would seem to apply particularly when the intervention has both positive and negative effects on the outcome of interest (for example, surgical procedures to prevent ce
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Furukawa, T. A., Guyatt, G. H., & Griffith, L. E. (2002) · International Journal of Epidemiology · doi:10.1093/ije/31.1.72 · Cited by 318
Who benefits from medical interventions?
Smith, G. D., & Egger, M. (1994) · BMJ · doi:10.1136/bmj.308.6921.72 · Cited by 128
Cited by
Explaining the decrease in U.S. deaths from coronary disease, 1980–2000
Ford, E. S., Ajani, U. A., Croft, J. B., Critchley, J. A., Labarthe, D. R., Kottke, T. E., Giles, W. H., & Capewell, S. (2007) · New England Journal of Medicine · doi:10.1056/nejmsa053935 · Cited by 2,757
Unal, B., Critchley, J. A., & Capewell, S. (2004) · Circulation · doi:10.1161/01.cir.0000118498.35499.b2 · Cited by 739
Explaining the Decline in Coronary Heart Disease Mortality in Finland between 1982 and 1997
Laatikainen, T., Critchley, J., Vartiainen, E., Salomaa, V., Ketonen, M., & Capewell, S. (2005) · American Journal of Epidemiology · doi:10.1093/aje/kwi274 · Cited by 331
Ezekowitz, J. A., Armstrong, P. W., & McAlister, F. A. (2003) · Annals of Internal Medicine · doi:10.7326/0003-4819-138-6-200303180-00007 · Cited by 265
Self-citationStatistical Analysis of Cost‐effectiveness Data
Willan, A. R., & Briggs, A. H. (2006) · doi:10.1002/0470856289 · Cited by 155
Metadata
- Authors
- McAlister, F. A.
- Venue
- International Journal of Epidemiology
- Publisher
- Oxford University Press (OUP)
- Published
- 2002-02
- Volume
- 31
- Issue
- 1
- Pages
- 76-77
- ISSN
- 0300-5771 (ISSN-L)
- 1464-3685
- OpenAlex
- W2168646276
- Cited by
- 53
- References
- 2
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.