The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Meta‐analysis of clinical trials as a scientific discipline. I: Control of bias and comparison with large co‐operative trials
Abstract
Meta‐analysis is an important method of bridging the gap between undersized randomized control trials and the treatment of patients. However, as in any retrospective study, the opportunities for bias to distort the results are widespread. Attempts must be made to introduce the controls found in prospective studies by blinding the selection of papers and extraction of data and making blinded duplicate determinations. Informal and personalized methods of obtaining data are probably more liable to error and bias than employing only published data. Publication bias is a serious problem requiring further research. There also need to be more comparisons of meta‐analysed small studies with large co‐operative trials.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Primary, Secondary, and Meta-Analysis of Research
GLASS, G. V. (1976) · Educational Researcher · doi:10.3102/0013189x005010003 · Cited by 4,890
Meta-Analytic Procedures for Social Research
Rosenthal, R. (1991) · doi:10.4135/9781412984997 · Cited by 4,635
Beta blockade during and after myocardial infarction: An overview of the randomized trials
Yusuf, S., Peto, R., Lewis, J., Collins, R., & Sleight, P. (1985) · Progress in Cardiovascular Diseases · doi:10.1016/s0033-0620(85)80003-7 · Cited by 3,205
A method for assessing the quality of a randomized control trial
Chalmers, T. C., Smith, H., Blackburn, B., Silverman, B., Schroeder, B., Reitman, D., & Ambroz, A. (1981) · Controlled Clinical Trials · doi:10.1016/0197-2456(81)90056-8 · Cited by 1,349
Self-citationBias in treatment assignment in controlled clinical trials
Chalmers, T. C., Celano, P., Sacks, H. S., & Smith, H. (1983) · New England Journal of Medicine · doi:10.1056/nejm198312013092204 · Cited by 864
Self-citation
Research works printed but not linked: 75
- 10.1146/annurev.pu.06.050185.000245 · DOI
- 10.1002/sim.4780030421 · DOI · Paper page
- 10.1038/bjc.1976.220 · DOI · Paper page
- 10.1038/bjc.1977.1 · DOI · Paper page
- 10.1016/S0197-2456(80)80006-7 · DOI · Paper page
- Glass G. V., 1981, Meta‐analysis in Social Research, 11
- Hedges L. V., 1985, Statistical Methods for Meta‐analysis
- Sacks H. S., 1985, Meta‐analyses of randomized control trials, Clinical Research, 33, 525A
- 10.1056/NEJM198702193160806 · DOI · Paper page
- Chalmers T. C., 1983, Clinical Trials: Issues and Approaches, 115
- 10.1016/0197-2456(86)90029-2 · DOI
- Chalmers T. C.‘Concluding session: general discussion’ in Chalmers T. C. and Amacher P. (eds.) ‘Conference on recent history of randomized clinical trials’ Controlled Clinical Trials 3 299–309(1982). · doi:10.1016/0197-2456(82)90013-7
- 10.1200/JCO.1986.4.6.942 · DOI · Paper page
- 10.1002/sim.4780060306 · DOI · Paper page
- 10.1002/sim.4780060308 · DOI · Paper page
- 10.1002/sim.4780060314 · DOI
- Chan S. S., 1982, The epidemiology of unpublished randomized control trials, Clinical Research, 30, 234A
- Dickersin K. Chan S. S. Chalmers T. C. Sacks H. S.andSmith H.Jr.‘Publication bias in randomized control trials’ Controlled Clinical Trials (in press).
- 10.1056/NEJM197602262940905 · DOI · Paper page
- 10.1056/NEJM198307073090105 · DOI · Paper page
- 10.1016/S0016-5085(81)80123-0 · doi:10.1016/s0016-5085(81)80123-0
- 10.1016/S0016-5085(19)34653-0 · DOI
- 10.1037/h0083036 · DOI
- 10.1037/0033-2909.86.3.638 · DOI · Paper page
- 10.1002/sim.4780040103 · DOI
- Chalmers I. Hetherington J. Newdick M. Mutch L. Grant A. Enkin M. Enkin E.andDickersin K.‘The Oxford database of perinatal trials: Developing a register of published reports of controlled trials’ Controlled Clinical Trials (in press).
- 10.1016/0197-2456(85)90106-0 · DOI · Paper page
- 10.1056/NEJM198401053100103 · DOI · Paper page
- 10.1016/S0002-9149(84)80306-9 · DOI
- 10.1136/hrt.53.4.388 · DOI
- Yusuf S., 1983, Reduction in infarct size, arrhythmias and chest pain by early intravenous beta blockade in suspected acute myocardial infarction, Circulation, 67, I‐32
- 10.1136/bmj.286.6364.506 · DOI
- 10.1111/j.1365-2125.1982.tb02057.x · DOI
- 10.1016/S0140-6736(80)90231-7 · DOI · Paper page
- 10.1161/01.CIR.57.6.1091 · DOI · Paper page
- 10.1136/hrt.43.6.617 · DOI
- 10.1136/bmj.4.5578.508 · DOI
- 10.1172/JCI109677 · DOI
- 10.1016/S0140-6736(84)90651-2 · DOI · Paper page
- Herlitz J., 1984, The Goteborg metoprolol trial in acute myocardial infarction, American Journal of Cardiology, 53, 1D
- 10.1016/S0140-6736(79)92684-9 · DOI · Paper page
- 10.1136/hrt.45.5.583 · DOI
- Jurgensen H. J., 1984, Effect of acute and long‐term beta‐adrenergic blockade with alprenolol in definite or suspected myocardial infarction, Acta Medica Scandinavica, 680, 4
- 10.1016/S0140-6736(78)91628-8 · DOI · Paper page
- Evemy K. L., 1978, Intravenous and oral practolol in the acute stages of myocardial infarction, European Journal of Cardiology, 7, 391
- 10.1093/oxfordjournals.eurheartj.a061844 · DOI
- The MIAMI Trial Research Group, 1985, MIAMI: Metoprolol in acute myocardial infarction, American Journal of Cardiology, 56, 1G
- ISIS‐1 (First International Study of Infarct Survival) Collaborative Group, 1986, Randomised trial of intravenous atenolol among 16,027 cases of suspected acute myocardial infarction: ISIS‐1, Lancet, 2, 57
- 10.1136/bmj.3.5770.325 · DOI
- 10.1111/j.0954-6820.1971.tb04333.x · DOI
- 10.1016/S0140-6736(71)92501-3 · DOI
- 10.1016/S0140-6736(73)90463-7 · DOI
- 10.1136/bmj.2.6044.1100 · DOI
- 10.1056/NEJM197910113011501 · DOI · Paper page
- The European Cooperative Study Group, 1981, Streptokinase in Acute myocardial infarction extended report of the European cooperative trial, Acta Medica Scandinavica, 648, 7
- Amery A., 1969, Single‐blind randomised multicentre trial comparing heparin and streptokinase treatment in recent myocardial infarction, Acta Medica Scandinavica, 505, 4
- 10.1056/NEJM198606053142301 · DOI · Paper page
- 10.1016/0002-8703(86)90001-3 · DOI
- Schmutzler R., 1971, Fibrinolytic therapy in acute myocardial infarction, Thromb Diath Haemorrh, 47, 211
- Gormsen J., 1972, Biochemical evaluation of standard treatment with streptokinase in acute myocardial infarction, Acta Medica Scandinavica, 191, 77
- Gruppo Italiano Per Lo Studio Della Streptochinasi Nell'infarto Miocardico (GISSI), 1986, Effectiveness of intravenous thrombolytic treatment in acute myocardial infarction, Lancet, 1, 397
- 10.1136/adc.61.2.196 · doi:10.1136/adc.61.2.196
- Bedard M. P., 1984, Effect of prophylactic phenobarbital on intraventricular hemorrhage in high‐risk infants, Pediatrics, 73, 435, 10.1542/peds.73.4.435 · doi:10.1542/peds.73.4.435
- 10.1016/S0140-6736(83)91217-5 · doi:10.1016/s0140-6736(83)91217-5
- Goldstein G. W., 1982, Further Observations on the use of phenobarbital to prevent neonatal intracranial hemorrhage, Pediatrics, 70, 1014, 10.1542/peds.70.6.1014 · doi:10.1542/peds.70.6.1014
- 10.1016/S0140-6736(82)92357-1 · doi:10.1016/s0140-6736(82)92357-1
- 10.1016/S0140-6736(81)90470-0 · doi:10.1016/s0140-6736(81)90470-0
- Morgan M. E. I., 1982, Does phenobarbitone prevent periventricular hemorrhage in very low‐birth‐weight babies?: A controlled trial, Pediatrics, 70, 186, 10.1542/peds.70.2.186 · doi:10.1542/peds.70.2.186
- 10.1016/S0140-6736(82)92062-1 · doi:10.1016/s0140-6736(82)92062-1
- 10.1016/S0140-6736(81)90848-5 · doi:10.1016/s0140-6736(81)90848-5
- 10.1055/s-2008-1033960 · doi:10.1055/s-2008-1033960
- 10.1055/s-2007-999915 · doi:10.1055/s-2007-999915
- Kuban K. C. K., 1986, Neonatal intracranial hemorrhage and phenobarbital, Pediatrics, 77, 443, 10.1542/peds.77.4.443 · doi:10.1542/peds.77.4.443
- 10.1093/oxfordjournals.eurheartj.a061905 · DOI · Paper page
- 10.1056/NEJM198211043071904 · DOI · Paper page
Cited by
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gotzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · BMJ · doi:10.1136/bmj.c869 · Cited by 8,883
SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials
Chan, A.-W., Tetzlaff, J. M., Gotzsche, P. C., Altman, D. G., Mann, H., Berlin, J. A., Dickersin, K., Hrobjartsson, A., Schulz, K. F., Parulekar, W. R., et al. (2013) · BMJ · doi:10.1136/bmj.e7586 · Cited by 6,251
The Revised CONSORT Statement for Reporting Randomized Trials: Explanation and Elaboration
Altman, D. G., Schulz, K. F., Moher, D., Egger, M., Davidoff, F., Elbourne, D., Gøtzsche, P. C., Lang, T., & for the CONSORT Group (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-134-8-200104170-00012 · Cited by 3,835
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gøtzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2012) · International Journal of Surgery · doi:10.1016/j.ijsu.2011.10.001 · Cited by 2,345
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gøtzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.03.004 · Cited by 1,858
Risk factors for pre-eclampsia at antenatal booking: systematic review of controlled studies
Duckitt, K., & Harrington, D. (2005) · BMJ · doi:10.1136/bmj.38380.674340.e0 · Cited by 1,784
Publication bias in meta-analysis its causes and consequences
Thornton, A. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(99)00161-4 · Cited by 1,291
Cumulative Meta-Analysis of Therapeutic Trials for Myocardial Infarction
Lau, J., Antman, E. M., Jimenez-Silva, J., Kupelnick, B., Mosteller, F., & Chalmers, T. C. (1992) · New England Journal of Medicine · doi:10.1056/nejm199207233270406 · Cited by 1,140
Self-citationAllocation concealment in randomised trials: defending against deciphering
Schulz, K. F., & Grimes, D. A. (2002) · The Lancet · doi:10.1016/s0140-6736(02)07750-4 · Cited by 923
Publication bias: evidence of delayed publication in a cohort study of clinical research projects
Stern, J. M., & Simes, R. J. (1997) · BMJ · doi:10.1136/bmj.315.7109.640 · Cited by 818
Publication bias—a problem in interpreting medical data
Begg, C. B., & Berlin, J. A. (1988) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2982993 · Cited by 814
Validation of an index of the quality of review articles
Oxman, A. D., & Guyatt, G. H. (1991) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(91)90160-b · Cited by 786
Meta-analysis of the literature or of individual patient data: is there a difference?
Stewart, L. A., & Parmar, M. K. B. (1993) · The Lancet · doi:10.1016/0140-6736(93)93004-k · Cited by 769
Issues in the meta-analysis of cluster randomized trials
Donner, A., & Klar, N. (2002) · Statistics in Medicine · doi:10.1002/sim.1301 · Cited by 734
A note on graphical presentation of estimated odds ratios from several clinical trials
Galbraith, R. F. (1988) · Statistics in Medicine · doi:10.1002/sim.4780070807 · Cited by 663
Maxwell, S. E. (2004) · Psychological Methods · doi:10.1037/1082-989x.9.2.147 · Cited by 654
Incorporating variations in the quality of individual randomized trials into meta-analysis
Detsky, A. S., Naylor, C. D., O'Rourke, K., McGeer, A. J., & L'Abbé, K. A. (1992) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(92)90085-2 · Cited by 640
A Meta-analysis of the Effect of Estrogen Replacement Therapy on the Risk of Breast Cancer
Steinberg, K. K. (1991) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1991.03460150089030 · Cited by 626
Sample size calculations in randomised trials: mandatory and mystical
Schulz, K. F., & Grimes, D. A. (2005) · The Lancet · doi:10.1016/s0140-6736(05)61034-3 · Cited by 549
Subverting Randomization in Controlled Trials
Schulz, K. F. (1995) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1995.03530180050029 · Cited by 516
Treatment of major depression with psychotherapy or psychotherapy-pharmacotherapy combinations
Thase, M. E. (1997) · Archives of General Psychiatry · doi:10.1001/archpsyc.1997.01830230043006 · Cited by 515
Schulz, K. F. (1994) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1994.03520020051014 · Cited by 512
Smoking and female infertility: a systematic review and meta-analysis
Augood, C., Duckitt, K., & Templeton, A. A. (1998) · Human Reproduction · doi:10.1093/humrep/13.6.1532 · Cited by 510
Formulating Questions and Locating Primary Studies for Inclusion in Systematic Reviews
Counsell, C. (1997) · Annals of Internal Medicine · doi:10.7326/0003-4819-127-5-199709010-00008 · Cited by 505
Heald, C. L., Fowkes, F. G. R., Murray, G. D., & Price, J. F. (2006) · Atherosclerosis · doi:10.1016/j.atherosclerosis.2006.03.011 · Cited by 434
Overcoming the limitations of current meta-analysis of randomised controlled trials
Pogue, J., & Yusuf, S. (1998) · The Lancet · doi:10.1016/s0140-6736(97)08461-4 · Cited by 428
Publication and related biases.
Song, Eastwood, Gilbody, Duley, & Sutton (2000) · Health Technology Assessment · doi:10.3310/hta4100 · Cited by 427
Fleiss, J. L., & Gross, A. J. (1991) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(91)90261-7 · Cited by 404
Rosenfeld, R. M., Vertrees, J. E., Carr, J., Cipolle, R. J., Uden, D. L., Giebink, G. S., & Canafax, D. M. (1994) · The Journal of Pediatrics · doi:10.1016/s0022-3476(94)70356-6 · Cited by 380
Siragusa, S., Cosmi, B., Piovella, F., Hirsh, J., & Ginsberg, J. S. (1996) · The American Journal of Medicine · doi:10.1016/s0002-9343(97)89484-3 · Cited by 373
A Meta-analysis of Alcohol Consumption in Relation to Risk of Breast Cancer
Longnecker, M. P. (1988) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1988.03410050072032 · Cited by 368
Large Trials vs Meta-analysis of Smaller Trials: How Do Their Results Compare?
Cappelleri, J. C. (1996) · JAMA · doi:10.1001/jama.1996.03540160054033 · Cited by 336
Brief mindfulness training for negative affectivity: A systematic review and meta-analysis.
Schumer, M. C., Lindsay, E. K., & Creswell, J. D. (2018) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000324 · Cited by 316
“…including unpublished studies may reduce the risk of publication bias, their inclusion can introduce other sources of bias (Higgins & Green, 2011), including the possibility of critical methodological mistakes and unreliable results not addressed through peer-review (Chalmers et al., 1987).”
Selecting and Appraising Studies for a Systematic Review
Meade, M. O., & Richardson, W. S. (1997) · Annals of Internal Medicine · doi:10.7326/0003-4819-127-7-199710010-00005 · Cited by 283
Agreement among reviewers of review articles
Oxman, A. D., Guyatt, G. H., Singer, J., Goldsmith, C. H., Hutchison, B. G., Milner, R. A., & Streiner, D. L. (1991) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(91)90205-n · Cited by 282
Efficacy of Drug Treatment in Obsessive–Compulsive Disorder: a Meta-Analytic Review
Piccinelli, M., Pini, S., Bellantuono, C., & Wilkinson, G. (1995) · British Journal of Psychiatry · doi:10.1192/bjp.166.4.424 · Cited by 282
Meta-analysis: Neither quick nor easy
Berman, N. G., & Parker, R. A. (2002) · BMC Medical Research Methodology · doi:10.1186/1471-2288-2-10 · Cited by 270
Lee, I., Agarwal, R. K., Lee, B. Y., Fishman, N. O., & Umscheid, C. A. (2010) · Infection Control & Hospital Epidemiology · doi:10.1086/657134 · Cited by 252
Pham, B., Klassen, T. P., Lawson, M. L., & Moher, D. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.08.021 · Cited by 206
CONSORT 2025 explanation and elaboration: updated guideline for reporting randomised trials
Hopewell, S., Chan, A.-W., Collins, G. S., Hróbjartsson, A., Moher, D., Schulz, K. F., Tunn, R., Aggarwal, R., Berkwits, M., Berlin, J. A., et al. (2025) · BMJ · doi:10.1136/bmj-2024-081124 · Cited by 205
Schulz, K. F., Grimes, D. A., Altman, D. G., & Hayes, R. J. (1996) · BMJ · doi:10.1136/bmj.312.7033.742 · Cited by 163
Nam, I., Mengersen, K., & Garthwaite, P. (2003) · Statistics in Medicine · doi:10.1002/sim.1410 · Cited by 153
Metadata
- Authors
- Chalmers, T. C., Levin, H., Sacks, H. S., Reitman, D., Berrier, J., & Nagalingam, R.
- Venue
- Statistics in Medicine
- Publisher
- Wiley
- Published
- 1987-04
- Volume
- 6
- Issue
- 3
- Pages
- 315-325
- ISSN
- 0277-6715 (ISSN-L)
- 1097-0258
- OpenAlex
- W2105494532
- Cited by
- 246
- References
- 5
- FWCI
- 13.29
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.