Comparison of bias adjustment methods in meta-analysis suggests that quality effects modeling may have less limitations than other approaches
The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Abstract
The quality of primary research is commonly assessed prior to inclusion in meta-analyses. Findings are discussed in the context of the quality appraisal by categorising studies according to risk of bias. The impact of appraised risk of bias on study outcomes are typically judged by the reader, however several methods have been developed to quantify this risk of bias assessment and incorporate it into the pooled results of meta-analysis; a process known as bias-adjustment. We discuss the advantages and limitations of methods for bias-adjustment in meta-analysis to inform those using and synthesising research evidence in clinical practice and academia. The methods discussed include weighting, stratification, regression, use of empirically based prior distributions and elicitation by experts.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Sensitivity analysis in observational research: Introducing the E-value
VanderWeele, T. J., & Ding, P. (2017) · Annals of Internal Medicine · doi:10.7326/m16-2607 · Cited by 6,350
GRADE guidelines: 4. Rating the quality of evidence—study limitations (risk of bias)
Guyatt, G. H., Oxman, A. D., Vist, G., Kunz, R., Brozek, J., Alonso-Coello, P., Montori, V., Akl, E. A., Djulbegovic, B., & Falck-Ytter, Y. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.07.017 · Cited by 2,798
Robust variance estimation in meta‐regression with dependent effect size estimates
Hedges, L. V., Tipton, E., & Johnson, M. C. (2010) · Research Synthesis Methods · doi:10.1002/jrsm.5 · Cited by 2,086
Sackett, D. L. (1979) · Journal of Chronic Diseases · doi:10.1016/0021-9681(79)90012-2 · Cited by 2,075
The Hazards of Scoring the Quality of Clinical Trials for Meta-analysis
Jüni, P. (1999) · JAMA · doi:10.1001/jama.282.11.1054 · Cited by 1,981
QUANTITATIVE METHODS IN THE REVIEW OF EPIDEMIOLOGIC LITERATURE1
GREENLAND, S. (1987) · Epidemiologic Reviews · doi:10.1093/oxfordjournals.epirev.a036298 · Cited by 1,644
de Souza, R. J., Mente, A., Maroleanu, A., Cozma, A. I., Ha, V., Kishibe, T., Uleryk, E., Budylowski, P., Schünemann, H., Beyene, J., et al. (2015) · BMJ · doi:10.1136/bmj.h3978 · Cited by 1,424
Moher, D., Jadad, A. R., Nichol, G., Penman, M., Tugwell, P., & Walsh, S. (1995) · Controlled Clinical Trials · doi:10.1016/0197-2456(94)00031-w · Cited by 1,308
Self-citationA new improved graphical and quantitative method for detecting bias in meta-analysis
Furuya-Kanamori, L., Barendregt, J. J., & Doi, S. A. R. (2018) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000141 · Cited by 1,160
Self-citationUsing the E-Value to Assess the Potential Effect of Unmeasured Confounding in Observational Studies
Haneuse, S., VanderWeele, T. J., & Arterburn, D. (2019) · JAMA · doi:10.1001/jama.2018.21554 · Cited by 988
Cited by
Barker, T. H., Stone, J. C., Sears, K., Klugar, M., Tufanaru, C., Leonardi-Bee, J., Aromataris, E., & Munn, Z. (2023) · JBI Evidence Synthesis · doi:10.11124/jbies-22-00430 · Cited by 1,225
Self-citationBarker, T. H., Habibi, N., Aromataris, E., Stone, J. C., Leonardi-Bee, J., Sears, K., Hasanoff, S., Klugar, M., Tufanaru, C., Moola, S., et al. (2024) · JBI Evidence Synthesis · doi:10.11124/jbies-23-00268 · Cited by 843
“16,17 Regardless of the approach reviewers choose, the analysis and interpretation of the synthesized findings should always incorporate the results of the critical appraisal process into the report.”
BackgroundSelf-citationQuality versus Risk-of-Bias assessment in clinical research
Furuya-Kanamori, L., Xu, C., Hasan, S. S., & Doi, S. A. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.09.044 · Cited by 88
Physical activity in pregnancy prevents gestational diabetes: A meta-analysis
Doi, S. A. R., Furuya-Kanamori, L., Toft, E., Musa, O. A. H., Mohamed, A. M., Clark, J., & Thalib, L. (2020) · Diabetes Research and Clinical Practice · doi:10.1016/j.diabres.2020.108371 · Cited by 33
Self-citation
Metadata
- Authors
- Stone, J. C., Glass, K., Munn, Z., Tugwell, P., & Doi, S. A. R.
- Venue
- Journal of Clinical Epidemiology
- Publisher
- Elsevier BV
- Published
- 2020-01
- Volume
- 117
- Pages
- 36-45
- ISSN
- 0895-4356 (ISSN-L)
- OpenAlex
- W2973239684
- Cited by
- 61
- References
- 22
- FWCI
- 4.34
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Comparison of bias adjustment methods in meta-analysis suggests that quality effects modeling may have less limitations than other approaches. https://app.cochat.ai/papers/10.1016/j.jclinepi.2019.09.010
- The paper
- Stone, J. C., Glass, K., Munn, Z., Tugwell, P., & Doi, S. A. R. (2020). Comparison of bias adjustment methods in meta-analysis suggests that quality effects modeling may have less limitations than other approaches. Journal of Clinical Epidemiology. https://doi.org/10.1016/j.jclinepi.2019.09.010
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.