The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Reported Methodologic Quality and Discrepancies between Large and Small Randomized Trials in Meta-Analyses
Abstract
PURPOSE: To explore whether reported methodologic quality affects estimated intervention effects in randomized trials and contributes to discrepancies between the results of large randomized trials and small randomized trials in meta-analyses. DATA SOURCES: Meta-analyses of randomized trials that included at least one large trial (>/=1000 participants) were included, regardless of the therapeutic area. Eligible meta-analyses were identified through electronic searches and bibliographies of relevant articles. STUDY SELECTION: Full-length randomized trials. DATA EXTRACTION: Methodologic quality was assessed according to reported randomization, double blinding, and follow-up as separate components and by using the Jadad composite scale. DATA SYNTHESIS: Fourteen meta-analyses involving 190 randomized trials from eight therapeutic areas were included. Compared with large trials, intervention effects were exaggerated in small trials with inadequate allocation sequence generation (ratio of odds ratios, 0.46 [95% CI, 0.25 to 0.83]; P = 0.011), inadequate allocation concealment (ratio of odds ratios, 0.49 [CI, 0.27 to 0.86]; P = 0.014), and no double blinding (ratio of odds ratios, 0.52 [CI, 0.28 to 0.96]; P = 0.01). Large trials did not differ significantly from small trials with adequate generation of the allocation sequence, adequate allocation concealment, or adequate double blinding. No association was seen between reported follow-up and intervention effects. The Jadad scale provided no additional information because the scale and the quality components overlapped substantially. CONCLUSIONS: Inadequate generation of the allocation sequence, allocation concealment, and double blinding lead to exaggerated estimates of intervention benefit and may contribute to discrepancies between the results of large randomized trials and small randomized trials in meta-analyses.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Assessing the quality of reports of randomized clinical trials: Is blinding necessary?
Jadad, A. R., Moore, R. A., Carroll, D., Jenkinson, C., Reynolds, D. J. M., Gavaghan, D. J., & McQuay, H. J. (1996) · Controlled Clinical Trials · doi:10.1016/0197-2456(95)00134-4 · Cited by 17,582
Schulz (1995) · doi:10.1001/jama.1995.03520290060030 · Cited by 5,634
Moher, D., Pham, B., Jones, A., Cook, D. J., Jadad, A. R., Moher, M., Tugwell, P., & Klassen, T. P. (1998) · The Lancet · doi:10.1016/s0140-6736(98)01085-x · Cited by 3,560
Improving the Quality of Reporting of Randomized Controlled Trials: The CONSORT Statement
Begg, C. (1996) · JAMA · doi:10.1001/jama.1996.03540080059030 · Cited by 3,127
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109
The Hazards of Scoring the Quality of Clinical Trials for Meta-analysis
Jüni, P. (1999) · JAMA · doi:10.1001/jama.282.11.1054 · Cited by 1,981
meta-analysis bias in location and selection of studies
Egger, M., & Smith, G. D. (1998) · BMJ · doi:10.1136/bmj.316.7124.61 · Cited by 1,374
Moher, D., Jadad, A. R., Nichol, G., Penman, M., Tugwell, P., & Walsh, S. (1995) · Controlled Clinical Trials · doi:10.1016/0197-2456(94)00031-w · Cited by 1,308
Nicotine replacement therapy for smoking cessation
Silagy, C., Lancaster, T., Stead, L., Mant, D., & Fowler, G. (2004) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000146.pub2 · Cited by 972
Large Trials vs Meta-analysis of Smaller Trials: How Do Their Results Compare?
Cappelleri, J. C. (1996) · JAMA · doi:10.1001/jama.1996.03540160054033 · Cited by 336
Cited by
Items 101–126 of 126
Naci, H., Dias, S., & Ades, A. E. (2014) · BMJ · doi:10.1136/bmj.g5741 · Cited by 61
Primer: strengths and weaknesses of meta-analysis
Finckh, A., & Tramèr, M. R. (2008) · Nature Clinical Practice Rheumatology · doi:10.1038/ncprheum0732 · Cited by 62
Holmskov, M., Storebø, O. J., Moreira-Maia, C. R., Ramstad, E., Magnusson, F. L., Krogh, H. B., Groth, C., Gillies, D., Zwi, M., Skoog, M., et al. (2017) · PLOS ONE · doi:10.1371/journal.pone.0178187 · Cited by 58
Self-citationNiu, H., Sanabria-Cabrera, J., Alvarez-Alvarez, I., Robles-Diaz, M., Stankevičiūtė, S., Aithal, G. P., Björnsson, E. S., Andrade, R. J., & Lucena, M. I. (2021) · Pharmacological Research · doi:10.1016/j.phrs.2020.105404 · Cited by 58
Gurusamy, K. S., Vaughan, J., Toon, C. D., & Davidson, B. R. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd008261.pub2 · Cited by 51
Lifestyle modifications for nonalcohol-related fatty liver disease: a network meta-analysis
Buzzetti, E., Linden, A., Best, L. M., Madden, A. M., Roberts, D., Chase, T. J. G., Freeman, S. C., Cooper, N. J., Sutton, A. J., Fritche, D., et al. (2021) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013156.pub2 · Cited by 46
Saltaji, H., Armijo-Olivo, S., Cummings, G. G., Amin, M., da Costa, B. R., & Flores-Mir, C. (2018) · Journal of Dental Research · doi:10.1177/0022034517725049 · Cited by 40
Control interventions in randomised trials among people with mental health disorders
Faltinsen, E., Todorovac, A., Staxen Bruun, L., Hróbjartsson, A., Gluud, C., Kongerslev, M. T., Simonsen, E., & Storebø, O. J. (2022) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000050.pub2 · Cited by 40
Self-citationColesevelam for type 2 diabetes mellitus: an abridged Cochrane review
Ooi, C. P., & Loke, S. C. (2014) · Diabetic Medicine · doi:10.1111/dme.12295 · Cited by 39
Pan, J., Pan, Q., Chen, Y., Zhang, H., & Zheng, X. (2019) · The Journal of Maternal-Fetal & Neonatal Medicine · doi:10.1080/14767058.2017.1376318 · Cited by 35
The impact of blinding on trial results: A systematic review and meta‐analysis
(2023) · doi:10.1002/cesm.12015 · Cited by 35
Redmond, S., von Elm, E., Blümle, A., Gengler, M., Gsponer, T., & Egger, M. (2013) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.06.020 · Cited by 32
Are they necessary? Preventive therapies for post-stroke depression: a meta-analysis of RCTs
Gu, J., Huang, H., Chen, K., Huang, G., Huang, Y., & Xu, H. (2020) · Psychiatry Research · doi:10.1016/j.psychres.2019.112670 · Cited by 24
Corso, M., Cancelliere, C., Mior, S., Salmi, L. R., Cedraschi, C., Nordin, M., Sci, D. M., Taylor-Vaisey, A., & Côté, P. (2022) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2021.09.007 · Cited by 24
Nutritional supplementation for nonalcohol-related fatty liver disease: a network meta-analysis
Komolafe, O., Buzzetti, E., Linden, A., Best, L. M., Madden, A. M., Roberts, D., Chase, T. J., Fritche, D., Freeman, S. C., Cooper, N. J., et al. (2021) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013157.pub2 · Cited by 21
Khan, M. S., Shaikh, A., Ochani, R. K., Akhtar, T., Fatima, K., Khan, S. U., Mookadam, F., Murad, M. H., Figueredo, V. M., Doukky, R., et al. (2019) · Circulation: Cardiovascular Quality and Outcomes · doi:10.1161/circoutcomes.118.005260 · Cited by 21
Spielmans, G. I., Berman, M. I., Linardatos, E., Rosenlicht, N. Z., Perry, A., & Tsai, A. C. (2016) · Focus · doi:10.1176/appi.focus.140202 · Cited by 20
Mortality from cirrhosis: lack of progress over the last 35 years
Gluud, C. (2005) · Gut · doi:10.1136/gut.2005.072876 · Cited by 17
Self-citationZhang, H., Li, S., Yang, J., Zheng, Y., Wang, J., Lu, W., Zhou, Y., Yin, Q., Zhu, R., & Guo, C. (2015) · Gastroenterology Review · doi:10.5114/pg.2015.51187 · Cited by 17
Lu, L.-M., He, J., Zeng, J.-C., Liao, M.-X., Jia, C., & Pan, H.-H. (2017) · Chinese Journal of Integrative Medicine · doi:10.1007/s11655-016-2451-z · Cited by 16
Jiang, L., Gao, C., Yan, P., Chen, P., Jiang, C., Xu, Y., & Chen, M. (2022) · The Journal of Maternal-Fetal & Neonatal Medicine · doi:10.1080/14767058.2020.1814239 · Cited by 16
Retracted(2016) · PubMed · doi:10.6133/apjcn.092015.24 · Cited by 14
Allocation concealment: a methodological review
Clark, L., Schmidt, U., Tharmanathan, P., Adamson, J., Hewitt, C., & Torgerson, D. (2013) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.12032 · Cited by 12
Ouyang, Y., & Li, J. (2025) · Medicine · doi:10.1097/md.0000000000041495 · Cited by 10
Gao, C., Fu, Q., Chen, P., Liu, Z., & Zhou, Q. (2019) · The American Journal of Emergency Medicine · doi:10.1016/j.ajem.2019.06.050 · Cited by 9
Placebo, usual care and wait-list interventions for all mental health disorders
Faltinsen, E., Todorovac, A., Hróbjartsson, A., Gluud, C., Kongerslev, M. T., Simonsen, E., & Storebø, O. J. (2019) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000050 · Cited by 9
Self-citation
Metadata
- Authors
- Kjaergard, L. L., Villumsen, J., & Gluud, C.
- Venue
- Annals of Internal Medicine
- Publisher
- American College of Physicians
- Published
- 2001-12-04
- Volume
- 135
- Issue
- 11
- Pages
- 982-989
- ISSN
- 0003-4819 (ISSN-L)
- 1539-3704
- OpenAlex
- W2117294447
- Cited by
- 2,283
- References
- 10
- FWCI
- 72.32
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.