The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Confronting publication bias: A cohort design for meta‐analysis
Abstract
In evaluating therapies, clinical investigators often need to rely on the published clinical trial literature which may be biased in favour of studies with positive or ‘encouraging’ results and this may lead to erroneous conclusions of therapeutic effectiveness. The problem of publication bias can be magnified when the evaluation is based on a pooled analysis of clinical trial results, since in this case even small differences between treatment groups may reach statistical significance. In this paper a model is developed for pooling the results of clinical trials which is free from publication bias. It is proposed that an international registry of all clinical trials be established with the objectives and endpoints of each trial clearly defined in the register. In this way for each therapeutic issue researchers can select a cohort of clinical trials independently from the trial results. The approach is illustrated using the International Cancer Research Data Bank (ICRDB) registry of cancer clinical trials to evaluate the effect of chemotherapy on survival in advanced ovarian cancer. In this example, the conclusions based on a pooled analysis of registered trials have important differences from a more traditional review of the published trials. Implications of the results and problems in implementing the model are discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Aspects of the Analysis of Data From Retrospective Studies of Disease
(1959) · JNCI: Journal of the National Cancer Institute · doi:10.1093/jnci/22.4.719 · Cited by 14,689
The combination of estimates from different experiments
Cochran, W. G. (1954) · Biometrics · doi:10.2307/3001666 · Cited by 5,380
Freiman, J. A., Chalmers, T. C., Smith, H., & Kuebler, R. R. (1978) · New England Journal of Medicine · doi:10.1056/nejm197809282991304 · Cited by 1,628
A method for assessing the quality of a randomized control trial
Chalmers, T. C., Smith, H., Blackburn, B., Silverman, B., Schroeder, B., Reitman, D., & Ambroz, A. (1981) · Controlled Clinical Trials · doi:10.1016/0197-2456(81)90056-8 · Cited by 1,349
Publication bias: the case for an international registry of clinical trials.
Simes, R. J. (1986) · Journal of Clinical Oncology · doi:10.1200/jco.1986.4.10.1529 · Cited by 747
Self-citation
Cited by
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109
Selective publication of antidepressant trials and its influence on apparent efficacy
Turner, E. H., Matthews, A. M., Linardatos, E., Tell, R. A., & Rosenthal, R. (2008) · New England Journal of Medicine · doi:10.1056/nejmsa065779 · Cited by 2,435
Systematic Review and Meta-analysis: When One Study Is Just not Enough
Garg, A. X., Hackam, D., & Tonelli, M. (2008) · Clinical Journal of the American Society of Nephrology · doi:10.2215/cjn.01430307 · Cited by 2,258
meta-analysis bias in location and selection of studies
Egger, M., & Smith, G. D. (1998) · BMJ · doi:10.1136/bmj.316.7124.61 · Cited by 1,374
Publication bias in meta-analysis its causes and consequences
Thornton, A. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(99)00161-4 · Cited by 1,291
Egger, M., Jüni, P., Bartlett, C., Holenstein, F., & Sterne, J. (2003) · Health Technology Assessment · doi:10.3310/hta7010 · Cited by 1,181
Language bias in randomised controlled trials published in English and German
Egger, M., Zellweger-Zähner, T., Schneider, M., Junker, C., Lengeler, C., & Antes, G. (1997) · The Lancet · doi:10.1016/s0140-6736(97)02419-7 · Cited by 1,028
Weaver, W. D. (1997) · JAMA · doi:10.1001/jama.1997.03550230069040 · Cited by 1,005
The Handbook of Research Synthesis
Ziegel, E. R., Cooper, H., & Hedges, L. (1995) · Technometrics · doi:10.2307/1269651 · Cited by 927
Publication bias in clinical trials due to statistical significance or direction of trial results
Hopewell, S., Loudon, K., Clarke, M. J., Oxman, A. D., & Dickersin, K. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000006.pub3 · Cited by 898
Adjusting for publication bias in the presence of heterogeneity
Terrin, N., Schmid, C. H., Lau, J., & Olkin, I. (2003) · Statistics in Medicine · doi:10.1002/sim.1461 · Cited by 809
Publication bias—a problem in interpreting medical data
Begg, C. B., & Berlin, J. A. (1988) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2982993 · Cited by 814
Publication bias: the case for an international registry of clinical trials.
Simes, R. J. (1986) · Journal of Clinical Oncology · doi:10.1200/jco.1986.4.10.1529 · Cited by 747
Self-citationMeta-analysis: synthesizing research findings in ecology and evolution
Arnqvist, G., & Wooster, D. (1995) · Trends in Ecology & Evolution · doi:10.1016/s0169-5347(00)89073-4 · Cited by 570
Formulating Questions and Locating Primary Studies for Inclusion in Systematic Reviews
Counsell, C. (1997) · Annals of Internal Medicine · doi:10.7326/0003-4819-127-5-199709010-00008 · Cited by 505
Meta-analysis of data from animal studies: A practical guide
Vesterinen, H. M., Sena, E. S., Egan, K. J., Hirst, T. C., Churolov, L., Currie, G. L., Antonic, A., Howells, D. W., & Macleod, M. R. (2014) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2013.09.010 · Cited by 488
Publication Bias in Research Synthesis: Sensitivity Analysis Using A Priori Weight Functions.
Vevea, J. L., & Woods, C. M. (2005) · Psychological Methods · doi:10.1037/1082-989x.10.4.428 · Cited by 461
Sterling, T. D., Rosenbaum, W. L., & Weinkam, J. J. (1995) · The American Statistician · doi:10.1080/00031305.1995.10476125 · Cited by 453
Publication and related biases.
Song, Eastwood, Gilbody, Duley, & Sutton (2000) · Health Technology Assessment · doi:10.3310/hta4100 · Cited by 427
Systematic review of outpatient services for chronic pain control.
McQuay, Moore, Eccleston, Morley, & Williams (1997) · Health Technology Assessment · doi:10.3310/hta1060 · Cited by 424
Grey Literature in Meta-Analyses
Conn, V. S., Valentine, J. C., Cooper, H. M., & Rantz, M. J. (2003) · Nursing Research · doi:10.1097/00006199-200307000-00008 · Cited by 400
Low molecular weight heparin in prevention of perioperative thrombosis.
Leizorovicz, A., Haugh, M. C., Chapuis, F. R., Samama, M. M., & Boissel, J. P. (1992) · BMJ · doi:10.1136/bmj.305.6859.913 · Cited by 378
Modeling Publication Selection Effects in Meta-Analysis
Hedges, L. V. (1992) · Statistical Science · doi:10.1214/ss/1177011364 · Cited by 359
Delbaldo, C., Michiels, S., Syz, N., Soria, J.-C., Le Chevalier, T., & Pignon, J.-P. (2004) · JAMA · doi:10.1001/jama.292.4.470 · Cited by 337
Agreement among reviewers of review articles
Oxman, A. D., Guyatt, G. H., Singer, J., Goldsmith, C. H., Hutchison, B. G., Milner, R. A., & Streiner, D. L. (1991) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(91)90205-n · Cited by 282
Efficacy of Drug Treatment in Obsessive–Compulsive Disorder: a Meta-Analytic Review
Piccinelli, M., Pini, S., Bellantuono, C., & Wilkinson, G. (1995) · British Journal of Psychiatry · doi:10.1192/bjp.166.4.424 · Cited by 282
Uses and abuses of meta-analysis
Egger, M., Smith, G. D., & Sterne, J. A. (2001) · Clinical Medicine · doi:10.7861/clinmedicine.1-6-478 · Cited by 255
Time to publication for results of clinical trials
Hopewell, S., Clarke, M. J., Stewart, L., & Tierney, J. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000011.pub2 · Cited by 243
Michiels, S., Piedbois, P., Burdett, S., Syz, N., Stewart, L., & Pignon, J.-P. (2005) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462305050154 · Cited by 154
Using Dissertations to Examine Potential Bias in Child and Adolescent Clinical Trials.
McLeod, B. D., & Weisz, J. R. (2004) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.72.2.235 · Cited by 125
Heinsman, D. T., & Shadish, W. R. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.2.154 · Cited by 125
Meta-analysis in medical research: Potentials and limitations
Zwahlen, M., Renehan, A., & Egger, M. (2008) · Urologic Oncology: Seminars and Original Investigations · doi:10.1016/j.urolonc.2006.12.001 · Cited by 70
Toward prospective registration of clinical trials
Meinert, C. L. (1988) · Controlled Clinical Trials · doi:10.1016/0197-2456(88)90002-5 · Cited by 57
Prospective approaches to accumulating evidence
Thomas, J., Askie, L. M., Berlin, J. A., Elliott, J. H., Ghersi, D., Simmonds, M., Takwoingi, Y., Tierney, J. F., & Higgins, J. P. (2019) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9781119536604.ch22 · Cited by 26
Metadata
- Authors
- Simes, R. J.
- Venue
- Statistics in Medicine
- Publisher
- Wiley
- Published
- 1987-01
- Volume
- 6
- Issue
- 1
- Pages
- 11-29
- ISSN
- 0277-6715 (ISSN-L)
- 1097-0258
- OpenAlex
- W2151970467
- Cited by
- 216
- References
- 5
- FWCI
- 11.48
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.