An Exact Method for Meta-Analysis of Case-Control and Follow-Up Studies
Abstract
In this paper, we describe an exact method for estimating a common relative risk across different epidemiologic study designs. The types of studies allowed by the method include case-control studies, follow-up studies with an internal comparison group, and follow-up studies with an external comparison group. Because the method is exact, sparseness of individual studies is not an issue. Those wishing to perform a meta-analysis of case-control studies and follow-up studies in which both the exposure and outcome are rare will find the method particularly useful. To allow one to perform the computations efficiently, we present a partial polynomial multiplication algorithm. We also describe a public-domain computer program that performs the necessary calculations.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Only five articles referred to the combination of different non-randomised studies.
“Only five articles referred to the combination of different non-randomised studies [38, 70, 75, 79, 80].”
From Methods to systematically review and meta-analyse observational studies: a systematic scoping review of recommendations (2018) · cites this paper as [79]
Cites
Statistical methods in cancer research. Volume I - The analysis of case-control studies.
Breslow, N. E., & Day, N. E. (1980) · PubMed · Cited by 4,895 · see citing works
The Algebra of Random Variables
Nelson, P. R., & Springer, M. D. (1981) · Technometrics · doi:10.2307/1268039 · Cited by 583 · see citing works
Analysis of Binary Data (2nd ed.).
Steffey, D. L., Cox, D. R., & Snell, E. J. (1990) · Journal of the American Statistical Association · doi:10.2307/2289625 · Cited by 503 · see citing works
Risk of Connective-Tissue Diseases and Other Disorders after Breast Implantation
Gabriel, S. E., O’Fallon, W. M., Kurland, L. T., Beard, C. M., Woods, J. E., & Melton, L. J. (1994) · New England Journal of Medicine · doi:10.1056/nejm199406163302401 · Cited by 426 · see citing works
Computing an Exact Confidence Interval for the Common Odds Ratio in Several 2×2 Contingency Tables
Mehta, C. R., Patel, N. R., & Gray, R. J. (1985) · Journal of the American Statistical Association · doi:10.1080/01621459.1985.10478212 · Cited by 328 · see citing works
Gart, J. J. (1971) · Revue de l Institut International de Statistique / Review of the International Statistical Institute · doi:10.2307/1402171 · Cited by 270 · see citing works
The Analysis of Several 2 × 2 Contingency Tables
Zelen, M. (1971) · Biometrika · doi:10.1093/biomet/58.1.129 · Cited by 261 · see citing works
Computing an Exact Confidence Interval for the Common Odds Ratio in Several 2 × 2 Contingency Tables
Mehta, C. R., Patel, N. R., & Gray, R. M. (1985) · Journal of the American Statistical Association · doi:10.2307/2288562 · Cited by 155 · see citing works
Exact Estimates for a Rate Ratio
Martin, D. O., & Austin, H. D. (1996) · Epidemiology · doi:10.1097/00001648-199601000-00006 · Cited by 104 · see citing works
Self-citationA quasi‐exact test for comparing two binomial proportions
Hirji, K. F., Tan, S., & Elashoff, R. M. (1991) · Statistics in Medicine · doi:10.1002/sim.4780100713 · Cited by 99 · see citing works
Median Unbiased Estimation for Binary Data
Hirji, K. F., Tsiatis, A. A., & Mehta, C. R. (1989) · The American Statistician · doi:10.1080/00031305.1989.10475597 · Cited by 93 · see citing works
Schusterman, M. A., Kroll, S. S., Reece, G. P., Miller, M. J., Ainslie, N. B., Halabi, S., & Balch, C. M. (1993) · Annals of Plastic Surgery · doi:10.1097/00000637-199331010-00001 · Cited by 86 · see citing works
Scleroderma and augmentation mammoplasty ‐ a causal relationship?
Englert, H., & Brooks, P. (1994) · Australian and New Zealand Journal of Medicine · doi:10.1111/j.1445-5994.1994.tb04439.x · Cited by 66 · see citing works
A Meta-analysis of Breast Implants and Connective Tissue Disease
Perkins, L. L., Clark, B. D., Klein, P. J., & Cook, R. R. (1995) · Annals of Plastic Surgery · doi:10.1097/00000637-199512000-00001 · Cited by 58 · see citing works
Breast silicone implants and risk of systemic lupus erythematosus
Strom, B. L., Reidenberg, M. M., Freundlich, B., & Schinnar, R. (1994) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(94)90109-0 · Cited by 57 · see citing works
Hochberg, M. C., Lethbridge‐Çejku, M., Scott, W. W., Reichle, R., Plato, C. C., & Tobin, J. D. (1994) · Arthritis & Rheumatism · doi:10.1002/art.1780370811 · Cited by 55 · see citing works
Fast Computation of Exact Confidence Limits for the Common Odds Ratio in a Series of 2 × 2 Tables
Vollset, S. E., Hirji, K. F., & Elashoff, R. M. (1991) · Journal of the American Statistical Association · doi:10.1080/01621459.1991.10475057 · Cited by 46 · see citing works
Median Unbiased Estimation for Binary Data
Hirji, K. F., Tsiatis, A. A., & Mehta, C. R. (1989) · The American Statistician · doi:10.2307/2685158 · Cited by 41 · see citing works
Re: Breast Implants, Cancer, and Systemic Sclerosis
McLaughlin, J. K., Fraumeni, J. F., OLSEN, J., & Mellemkjær, L. (1994) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/86.18.1424 · Cited by 32 · see citing works
Fast Computation of Exact Confidence Limits for the Common Odds Ratio in a Series of 2 × 2 Tables
Vollset, S. E., Hirji, K. F., & Elashoff, R. M. (1991) · Journal of the American Statistical Association · doi:10.2307/2290585 · Cited by 31 · see citing works
Algorithms for the Analysis of Several $2 \times 2$ Contingency Tables
Pagano, M., & Tritchler, D. (1983) · SIAM Journal on Scientific and Statistical Computing · doi:10.1137/0904024 · Cited by 27 · see citing works
Birnbaum, A. (1964) · Bulletin of Mathematical Statistics · doi:10.5109/13011 · Cited by 25 · see citing works
Guess, H. A., & Thomas, J. E. (1990) · Epidemiology · doi:10.1097/00001648-199001000-00016 · Cited by 18 · see citing works
Exact Tests for Interaction in Several 2 × 2 Tables
Hirji, K. F., Vollset, S. E., dos Reis, I. M., & Afifi, A. A. (1996) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.1996.10474706 · Cited by 11 · see citing works
Satten, G. A., & Kupper, L. L. (1990) · Biometrics · doi:10.2307/2531645 · Cited by 11 · see citing works
A Note on Exact Analysis of Several 2 x 2 Tables
Hirji, K. F. (1996) · Biometrics · doi:10.2307/2533062 · Cited by 7 · see citing works
Exact Tests for Interaction in Several 2 × 2 Tables
Hirji, K. F., Vollset, S. E., dos Reis, I. M., et al. (1996) · Journal of Computational and Graphical Statistics · doi:10.2307/1390800 · Cited by 5 · see citing works
Morain, W. D. (1995) · Annals of Plastic Surgery · doi:10.1097/00000637-199511000-00022 · Cited by 1 · see citing works
Hosmer (1997) · doi:10.1002/(sici)1097-0258(19970515)16:9
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Composite Outcomes in Randomized Trials
Freemantle, N., Calvert, M., Wood, J., Eastaugh, J., & Griffin, C. (2003) · JAMA · doi:10.1001/jama.289.19.2554 · Cited by 785 · see citing works
Mueller, M., D’Addario, M., Egger, M., Cevallos, M., Dekkers, O., Mugglin, C., & Scott, P. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0495-9 · Cited by 400 · see citing works
“Only five articles referred to the combination of different non-randomised studies [38, 70, 75, 79, 80].”
BackgroundNovotný, L., & Vı́tek, L. (2003) · Experimental Biology and Medicine · doi:10.1177/15353702-0322805-29 · Cited by 347 · see citing works
Prevalence of migraine on each day of the natural menstrual cycle
MacGregor, E. A., & Hackshaw, A. K. (2004) · Neurology · doi:10.1212/01.wnl.0000133134.68143.2e · Cited by 260 · see citing works
Sickle cell trait and the risk of venous thromboembolism among blacks
Austin, H. D., Key, N. S., Benson, J. M., Lally, C. A., Dowling, N. F., Whitsett, C., & Hooper, W. C. (2007) · Blood · doi:10.1182/blood-2006-11-057604 · Cited by 250 · see citing works
Self-citationMolecular evidence for the role of mycobacteria in sarcoidosis: a meta-analysis
Gupta, D., Agarwal, R., Aggarwal, A. N., & Jindal, S. K. (2007) · European Respiratory Journal · doi:10.1183/09031936.00002607 · Cited by 232 · see citing works
Handedness in schizophrenia: a quantitative review of evidence
Dragović, M., & Hammond, G. (2005) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.2005.00519.x · Cited by 210 · see citing works
“Because of few observations in some handedness categories, an exact likelihood method (52) was chosen to evaluate the combined odds ratio.”
MethodMortality in Concurrent Type 1 Diabetes and Anorexia Nervosa
Nielsen, S. L., Emborg, C., & Mølbak, A. G. (2002) · Diabetes Care · doi:10.2337/diacare.25.2.309 · Cited by 195 · see citing works
“Inspection of the 95% CIs shows considerable overlap for the AN and concurrent case subject strata, and formal testing (17) does not reject a hypothesis of homogeneity of SMRs for these two strata (exact, P 0.”
BackgroundInfluentialEPIDEMIOLOGY AND MORTALITY OF EATING DISORDERS
Nielsen, S. L. (2001) · Psychiatric Clinics of North America · doi:10.1016/s0193-953x(05)70217-3 · Cited by 161 · see citing works
Prevention of menstrual attacks of migraine
MacGregor, E. A., Frith, A., Ellis, J. E., Aspinall, L., & Hackshaw, A. K. (2006) · Neurology · doi:10.1212/01.wnl.0000249114.52802.55 · Cited by 154 · see citing works
Combescure, C., Foucher, Y., & Jackson, D. (2014) · Statistics in Medicine · doi:10.1002/sim.6111 · Cited by 127 · see citing works
Cassese, S., Byrne, R. A., Ott, I., Ndrepepa, G., Nerad, M., Kastrati, A., & Fusaro, M. (2012) · Circulation Cardiovascular Interventions · doi:10.1161/circinterventions.112.969972 · Cited by 121 · see citing works
“Because these approximations may have a major impact on the results when the outcomes are rare, the ORs for categorical outcomes were calculated using the exact conditional likelihood method (exact) without approximation from 2×2 contingency tables according to Martin and Austin.(13) The risk estimates were reported a…”
MethodInfluentialEating disorders in females with type 1 diabetes: an update of a meta‐analysis
Nielsen, S. L. (2002) · European Eating Disorders Review · doi:10.1002/erv.474 · Cited by 121 · see citing works
Long-acting β-agonists: a review of formoterol safety data from asthma clinical trials
Sears, M. R., Ottosson, A., Radner, F., & Suissa, S. (2008) · European Respiratory Journal · doi:10.1183/09031936.00145006 · Cited by 109 · see citing works
Nath, A., Agarwal, R., Malhotra, P., & Varma, S. (2009) · Internal Medicine Journal · doi:10.1111/j.1445-5994.2009.02060.x · Cited by 97 · see citing works
Keogh, R. H., & Cox, D. R. (2014) · Cambridge University Press eBooks · doi:10.1017/cbo9781139094757 · Cited by 70 · see citing works
Is the Mortality Higher in the Pulmonary vs the Extrapulmonary ARDS?
Agarwal, R., Rajagopala, S., Nath, A., & Jindal, S. K. (2007) · CHEST Journal · doi:10.1378/chest.07-2182 · Cited by 68 · see citing works
Colorectal Cancer Risk in Monoallelic Carriers of MYH Variants
Webb, E. L., Rudd, M. F., & Houlston, R. S. (2006) · The American Journal of Human Genetics · doi:10.1086/507912 · Cited by 63 · see citing works
Chan, I. S. F. (2003) · Statistical Methods in Medical Research · doi:10.1191/0962280203sm314ra · Cited by 56 · see citing works
Mouchet, J., Salvo, F., Raschi, E., Poluzzi, E., Antonazzo, I. C., De Ponti, F., & Bégaud, B. (2018) · Vaccine · doi:10.1016/j.vaccine.2018.02.036 · Cited by 49 · see citing works
“However, not only would this have been difficult to implement but it would also have required particular statistical expertise beyond the scope of the study [43,44].”
BackgroundWootton, S. H., Arnold, K., Hill, H. A., McAllister, S. K., Ray, M., Kellum, M. E., LaMarre, M., Lane, M. E., Chaitram, J. M., Lance-Parker, S. E., et al. (2004) · Infection Control and Hospital Epidemiology · doi:10.1086/502413 · Cited by 50 · see citing works
“Details regarding the methods used have been previously published.(8)”
MethodSystematic reviews of nursing research
Evans, D. J. (2001) · Intensive and Critical Care Nursing · doi:10.1054/iccn.2000.1550 · Cited by 47 · see citing works
Polysaccharide vaccines for preventing serogroup A meningococcal meningitis
Patel, M. S., & Lee, C.-K. (2005) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001093.pub2 · Cited by 43 · see citing works
Fusaro, M., Cassese, S., Ndrepepa, G., King, L. A., Tada, T., Ott, I., & Kastrati, A. (2013) · International Journal of Cardiology · doi:10.1016/j.ijcard.2013.06.081 · Cited by 39 · see citing works
Rotulo, G. A., Beaupain, B., Rialland, F., Paillard, C., Nachit, O., Galambrun, C., Gandemer, V., Bertrand, Y., Neven, B., Doré, É., et al. (2020) · Bone Marrow Transplantation · doi:10.1038/s41409-020-0800-1 · Cited by 35 · see citing works
Sensitivity and specificity of meningeal signs in patients with meningitis
Akaishi, T., Kobayashi, J., Abe, M., Ishizawa, K., Nakashima, I., Aoki, M., & Ishii, T. (2019) · Journal of General and Family Medicine · doi:10.1002/jgf2.268 · Cited by 33 · see citing works
Averis, A. K., & Pearson, A. (2003) · JBI Reports · doi:10.1046/j.1479-6988.2003.00003.x · Cited by 29 · see citing works
Nielsen, S. L., & Vilmar, J. W. (2021) · Psychiatry Research · doi:10.1016/j.psychres.2021.114091 · Cited by 26 · see citing works
Cassese, S., Ndrepepa, G., King, L. A., Nerad, M., Schunkert, H., Kastrati, A., Ott, I., & Fusaro, M. (2015) · EuroIntervention · doi:10.4244/eijy15m03_01 · Cited by 22 · see citing works
Anonymous group peer review in surgery morbidity and mortality conference
Bender, L. C., Klingensmith, M. E., Freeman, B. D., Chapman, W. C., Dunagan, W. C., Gottlieb, J. E., & Hall, B. L. (2009) · The American Journal of Surgery · doi:10.1016/j.amjsurg.2008.09.032 · Cited by 16 · see citing works
Standardized Mortality Ratio in Bulimia Nervosa
Nielsen, S. L. (2003) · Archives of General Psychiatry · doi:10.1001/archpsyc.60.8.851 · Cited by 15 · see citing works
The Use of Meta‐analysis in Pharmacoepidemiology
Berlin, J. A. (2000) · Pharmacoepidemiology · doi:10.1002/0470842555.ch38 · Cited by 14 · see citing works
Farasani, A. M. (2018) · Saudi Journal of Biological Sciences · doi:10.1016/j.sjbs.2018.12.011 · Cited by 12 · see citing works
“It is a statistical study for clubbing the results of replication studies from different ethnic populations (Martin and Austin, 2000).”
BackgroundCepeda, M. S., Berlin, J. A., Glasser, S. C., Battisti, W. P., & Schuemie, M. J. (2015) · Drugs in R&D · doi:10.1007/s40268-015-0085-9 · Cited by 11 · see citing works
“To determine whether an adjective was used more often by industry or non-industry authors, we used an exact test for contingency tables [13], stratifying by journal to adjust for any differences in language in the different journals.”
MethodAgarwal, R., Aggarwal, A. N., & Gupta, D. (2009) · PubMed · Cited by 6 · see citing works
Polysaccharide vaccines for preventing serogroup A meningococcal meningitis
Patel, M. S., & Lee, C. (2000) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001093 · Cited by 6 · see citing works
Primary coronary angioplasty versus thrombolysis for acute myocardial infarction
Buchan, I. E., Hooper, L., McElduff, P., Freemantle, N., & Martin, D. O. (2003) · The Lancet · doi:10.1016/s0140-6736(03)13012-7 · Cited by 4 · see citing works
Self-citationThe Use of Metaanalysis in Pharmacoepidemiology
Berlin, J. A., Crowe, B. J., Xia, H. A., & Evans, S. J. W. (2019) · Pharmacoepidemiology · doi:10.1002/9781119413431.ch36 · Cited by 3 · see citing works
The Use of Meta‐analysis in Pharmacoepidemiology
Berlin, J. A., Cepeda, S., & Kim, C. J. (2012) · Pharmacoepidemiology · doi:10.1002/9781119959946.ch40 · Cited by 3 · see citing works
Cochrane Review: Polysaccharide vaccines for preventing serogroup A meningococcal meningitis
Patel, M. S., & Lee, C.-K. (2011) · Evidence-Based Child Health A Cochrane Review Journal · doi:10.1002/ebch.753 · Cited by 2 · see citing works
Nielsen, S. L., & Mitchell, A. J. (2015) · Comprehensive Psychiatry · doi:10.1016/j.comppsych.2015.05.011 · Cited by 1 · see citing works
Biostatistical aspects for the use of evidence based medicine in health technology assessment
Freemantle, N. (2008) · The European Journal of Health Economics · doi:10.1007/s10198-008-0123-4 · Cited by 1 · see citing works
“This is because the odds ratio scale enables more straightforward calculation of the standard error, which can include theoretically exact approaches [30].”
BackgroundWilcox, N., Dumont, M., González‐Neira, A., Carvalho, S., Beauparlant, C. J., Crotti, M., Luccarini, C., Soucy, P., Dubois, S., Núñez‐Torres, R., et al. (2022) · medRxiv · doi:10.1101/2022.06.17.22276537 · Cited by 1 · see citing works
“For the BCAC datasets, we used an exact conditional test 25 , 26 , stratified by country and library preparation method (BRIDGES vs Perspective).”
Method
- Authors
- Martin, D. O., & Austin, H.
- Affiliations
- Duke Medical Center (US)
- Emory University (US)
- ORCID
- Martin, David O.
- Venue
- Epidemiology
- Published
- 2000-05
- Volume
- 11
- Issue
- 3
- Pages
- 255-260
- ISSN
- 1044-3983 (ISSN-L)
- OpenAlex
- W1985547846
- Cited by
- 44
- References
- 28
- Citations by year
- 2022: 1 · 2021: 1 · 2020: 1 · 2019: 3 · 2018: 3 · 2015: 3 · 2014: 2 · 2013: 1 · 2012: 2
- FWCI
- 1.01
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Epidemiology (publishedVersion, public-domain)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic Associations and Epidemiology
- Keywords
- meta-analysis, exact algorithms, case-control study, follow-up study, rare exposures
- MeSH terms
- Follow-Up Studies, Humans, Meta-Analysis as Topic, Case-Control Studies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
