Importance of trends in the interpretation of an overall odds ratio in the meta‐analysis of clinical trials
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
This paper contains a proposition related to the publication of meta‐analyses of clinical trials. We consider the situation where the results of a number of trials are summarized by a common or typical odds ratio. We show that stating such an odds ratio as the summary of evidence from a number of trials can be misleading if certain systematic differences between trials exist. In such cases the author should state not just one odds ratio but also its dependence on the relevant characteristics of the trials. In particular, we propose that those reporting a meta‐analysis state in advance a (limited) number of variables to be considered for potential interaction with the exposure (risk factor or treatment) of interest. The list might include centre size and the odds in the placebo or control group if such an effect is a priori clinically plausible. The trials should be ordered according to each of these variables and a trend test for the odds ratio should be computed. Apart from a ‘genuine’ effect, an appreciable interaction could also be indicative of the (multiplicative) odds ratio being an inappropriate measure for the particular meta‐analysis. Without any consideration as to the possibility of interaction, the meta‐analysis should be considered incomplete. If such an interaction exists, the odds ratio should be stated as a function of the interacting variable, either as a formula or (preferably) in a table stating the odds ratio for a number of different values of the interacting variable, and not as a single summary statistic.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Peto, R. (1987) · Statistics in Medicine · doi:10.1002/sim.4780060306 · Cited by 409
Inter‐study differences: How should they influence the interpretation and analysis of results?
Bailey, K. R. (1987) · Statistics in Medicine · doi:10.1002/sim.4780060327 · Cited by 108
Cited by
Advanced methods in meta‐analysis: multivariate approach and meta‐regression
van Houwelingen, H. C., Arends, L. R., & Stijnen, T. (2002) · Statistics in Medicine · doi:10.1002/sim.1040 · Cited by 1,580
Systematic Review: Why sources of heterogeneity in meta-analysis should be investigated
Thompson, S. G. (1994) · BMJ · doi:10.1136/bmj.309.6965.1351 · Cited by 1,017
Bayesian methods in meta-analysis and evidence synthesis
Sutton, A. J., & Abrams, K. R. (2001) · Statistical Methods in Medical Research · doi:10.1177/096228020101000404 · Cited by 710
Hill, G. E., Frawley, W. H., Griffith, K. E., Forestner, J. E., & Minei, J. P. (2003) · The Journal of Trauma: Injury, Infection, and Critical Care · doi:10.1097/01.ta.0000022460.21283.53 · Cited by 556
Cholesterol lowering and mortality: the importance of considering initial level of risk.
Smith, G. D., Song, F., & Sheldon, T. A. (1993) · BMJ · doi:10.1136/bmj.306.6889.1367 · Cited by 423
Barker, F. G., & Ogilvy, C. S. (1996) · Journal of Neurosurgery · doi:10.3171/jns.1996.84.3.0405 · Cited by 358
Risk and the Efficacy of Antiinflammatory Agents: Retrospective and Confirmatory Studies of Sepsis
Eichacker, P. Q., Parent, C., Kalil, A., Esposito, C., Cui, X., Banks, S. M., Gerstenberger, E. P., Fitz, Y., Danner, R. L., & Natanson, C. (2002) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.200204-302oc · Cited by 341
Meta-analysis: Statistical alchemy for the 21st century
Feinstein, A. R. (1995) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(94)00110-c · Cited by 339
Choosing between randomised and non-randomised studies: a systematic review.
Britton, McKee, Black, McPherson, Sanderson, & Bain (1998) · Health Technology Assessment · doi:10.3310/hta2130 · Cited by 308
Threats to Applicability of Randomised Trials: Exclusions and Selective Participation
Britton, A., McKee, M., Black, N., McPherson, K., Sanderson, C., & Bain, C. (1999) · Journal of Health Services Research & Policy · doi:10.1177/135581969900400210 · Cited by 299
Efficacy of Drug Treatment in Obsessive–Compulsive Disorder: a Meta-Analytic Review
Piccinelli, M., Pini, S., Bellantuono, C., & Wilkinson, G. (1995) · British Journal of Psychiatry · doi:10.1192/bjp.166.4.424 · Cited by 282
Warn, D. E., Thompson, S. G., & Spiegelhalter, D. J. (2002) · Statistics in Medicine · doi:10.1002/sim.1189 · Cited by 277
Methods for Exploring Heterogeneity in Meta-Analysis
Song, F., Sheldon, T. A., Sutton, A. J., Abrams, K. R., & Jones, D. R. (2001) · Evaluation & the Health Professions · doi:10.1177/01632780122034849 · Cited by 253
Metadata
- Authors
- Brand, R., & Kragt, H.
- Venue
- Statistics in Medicine
- Publisher
- Wiley
- Published
- 1992-01
- Volume
- 11
- Issue
- 16
- Pages
- 2077-2082
- ISSN
- 0277-6715 (ISSN-L)
- 1097-0258
- OpenAlex
- W4249596886
- Cited by
- 64
- References
- 2
- FWCI
- 3.98
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.