Meta-Analysis of Odds Ratios: Current Good Practices
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
Background: Many systematic reviews of randomized clinical trials lead to meta-analyses of odds ratios (ORs). The customary methods of estimating an overall OR involve weighted averages of the individual trials’ estimates of the logarithm of the OR. That approach, however, has several shortcomings, arising from assumptions and approximations, that render the results unreliable. Although the problems have been documented in the literature for many years, the conventional methods persist in software and applications. A well-developed alternative approach avoids the approximations by working directly with the numbers of subjects and events in the arms of the individual trials. Objective: We aim to raise awareness of methods that avoid the conventional approximations, can be applied with widely available software, and produce more-reliable results. Methods: We summarize the fixed-effect and random-effects approaches to meta-analysis; describe conventional, approximate methods and alternative methods; apply the methods in a meta-analysis of 19 randomized trials of endoscopic sclerotherapy in patients with cirrhosis and esophagogastric varices; and compare the results. We demonstrate the use of SAS, Stata, and R software for the analysis. Results: In the example, point estimates and confidence intervals for the overall log-odds-ratio differ between the conventional and alternative methods, in ways that can affect inferences. Programming is straightforward in the 3 software packages; an appendix, Suppemental Digital Content 1 (http://links.lww.com/MLR/B335) gives the details. Conclusions: The modest additional programming required should not be an obstacle to adoption of the alternative methods. Because their results are unreliable, use of the conventional methods for meta-analysis of ORs should be discontinued.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
IntHout, J., Ioannidis, J. P., & Borm, G. F. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-25 · Cited by 2,419
Dias, S., Sutton, A. J., Ades, A. E., & Welton, N. J. (2013) · Medical Decision Making · doi:10.1177/0272989x12458724 · Cited by 1,207
Stijnen, T., Hamza, T. H., & Özdemir, P. (2010) · Statistics in Medicine · doi:10.1002/sim.4040 · Cited by 757
Kuss, O. (2015) · Statistics in Medicine · doi:10.1002/sim.6383 · Cited by 206
Robust variance estimation for random effects meta-analysis
Sidik, K., & Jonkman, J. N. (2006) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2005.07.019 · Cited by 138
Cited by
Ssentongo, P., Ssentongo, A. E., Heilbrunn, E. S., Ba, D. M., & Chinchilli, V. M. (2020) · PLOS ONE · doi:10.1371/journal.pone.0238215 · Cited by 532
van den Berk-Clark, C., Secrest, S., Walls, J., Hallberg, E., Lustman, P. J., Schneider, F. D., & Scherrer, J. F. (2018) · Health Psychology · doi:10.1037/hea0000593 · Cited by 212
“We used recommendations of Chang and Hoaglin (2017) to determine heterogeneity using log ratios through Stata userwritten code “METAN,” which determined pooled ORs and heterogeneity (i2) using ORs combined with upper and lower 95% CI (Harris et al., 2010) from calculations provided in the Cochrane…”
MethodInterventional Fairness: Causal Database Repair for Algorithmic Fairness
Salimi, B., Rodriguez, L., Howe, B., & Suciu, D. (2019) · Proceedings of the 2019 International Conference on Management of Data · doi:10.1145/3299869.3319901 · Cited by 145
“We used standard techniques in meta-analysis to compute the pooled odds ratio [8], and its statistical significance, needed to compute ROD.”
MethodLeung, C., Pei, J., Hudec, K., Shams, F., Munthali, R., & Vigo, D. (2022) · Journal of Medical Internet Research · doi:10.2196/36004 · Cited by 94
Metadata
- Authors
- Chang, B.-H., & Hoaglin, D. C.
- Venue
- Medical Care
- Published
- 2017-04
- Volume
- 55
- Issue
- 4
- Pages
- 328-335
- ISSN
- 0025-7079 (ISSN-L)
- OpenAlex
- W2588229802
- Cited by
- 120
- References
- 5
- FWCI
- 2.09
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Meta-Analysis of Odds Ratios: Current Good Practices. https://app.cochat.ai/papers/10.1097/mlr.0000000000000696
- The paper
- Chang, B.-H., & Hoaglin, D. C. (2017). Meta-Analysis of Odds Ratios: Current Good Practices. Medical Care. https://doi.org/10.1097/mlr.0000000000000696
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.