Quality of Conduct and Reporting of Meta-analyses of Surgical Interventions
The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Meta-analyses are useful tools for summarizing surgical evidence as they aim to encompass multiple sources of information on a particular research question, but they may be prone to methodological and reporting biases. We evaluated the conduct and reporting of meta-analyses of surgical interventions. METHODS AND FINDINGS: We performed a systematic review of 150 meta-analyses of randomized trials of surgical interventions published between January 2010 and June 2011. A comprehensive search strategy was executed using MEDLINE, EMBASE, and the Cochrane Database of Systematic Reviews. Data were independently extracted by 2 authors using the PRISMA statement (preferred reporting items for systematic reviews and meta-analyses, a standardized quality of reporting guideline) and AMSTAR (a tool for methodological quality). Descriptive statistics were used for individual items, and as a measure of overall compliance, PRISMA and AMSTAR scores were calculated as the sum of adequately reported domains. A median of 8 trials (interquartile range = 8) was included in each meta-analysis. One third of all meta-analyses had an author with a background in epidemiology and/or statistics. Forty-four percent were published in PRISMA-endorsing journals with a median impact factor of 3.5. There was moderate compliance with PRISMA, with an average of 71% of items reported, but poorer compliance with AMSTAR, with 48% of items adequately described, on average. CONCLUSIONS: Substantial gaps in the conduct and reporting of meta-analyses within the surgical literature exist, mainly in the specification of aims and/or objectives, the use of preplanned protocols, and the evaluation of potential bias at the review (rather than trial) level. Editorial insistence on using reporting guidelines would improve this situation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
SPIRIT 2013 Statement: Defining Standard Protocol Items for Clinical Trials
Chan, A.-W., Tetzlaff, J. M., Altman, D. G., Laupacis, A., Gøtzsche, P. C., Krleža-Jerić, K., Hróbjartsson, A., Mann, H., Dickersin, K., Berlin, J. A., et al. (2013) · Annals of Internal Medicine · doi:10.7326/0003-4819-158-3-201302050-00583 · Cited by 7,363
Development of AMSTAR: A measurement tool to assess the methodological quality of systematic reviews
Shea, B. J., Grimshaw, J. M., Wells, G. A., Boers, M., Andersson, N., Hamel, C., Porter, A. C., Tugwell, P., Moher, D., & Bouter, L. M. (2007) · BMC Medical Research Methodology · doi:10.1186/1471-2288-7-10 · Cited by 4,374
Funnel plots for detecting bias in meta-analysis
Sterne, J. A. C., & Egger, M. (2001) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(01)00377-8 · Cited by 3,779
The well-built clinical question: A key to evidence-based decisions
(1995) · ACP Journal Club · doi:10.7326/acpjc-1995-123-3-a12 · Cited by 2,931 · cited 1×
“authors, n (%) 1–3 31 (20) 4–6 79 (53) >6 40 (27) Department of first author, n (%) Surgical 101 (67) Medical 37 (25) Epi/stats 11 (7) Other 1 (1) Author with epi/stats degree, n (%) 49 (33)”
Pharmaceutical industry sponsorship and research outcome and quality: systematic review
Lexchin, J., Bero, L. A., Djulbegovic, B., & Clark, O. (2003) · BMJ · doi:10.1136/bmj.326.7400.1167 · Cited by 2,147
The Hazards of Scoring the Quality of Clinical Trials for Meta-analysis
Jüni, P. (1999) · JAMA · doi:10.1001/jama.282.11.1054 · Cited by 1,981
Systematic Review of the Empirical Evidence of Study Publication Bias and Outcome Reporting Bias
Dwan, K., Altman, D. G., Arnaiz, J. A., Bloom, J., Chan, A.-W., Cronin, E., Decullier, E., Easterbrook, P. J., Von Elm, E., Gamble, C., et al. (2008) · PLoS ONE · doi:10.1371/journal.pone.0003081 · Cited by 1,546 · cited 1×
“9 52 (35) ≥10 3 (2) PRISMA endorsing journal,”
Kirkham, J. J., Dwan, K. M., Altman, D. G., Gamble, C., Dodd, S., Smyth, R., & Williamson, P. R. (2010) · BMJ · doi:10.1136/bmj.c365 · Cited by 1,133
Savović, J., Jones, H. E., Altman, D. G., Harris, R. J., Jüni, P., Pildal, J., Als-Nielsen, B., Balk, E. M., Gluud, C., Gluud, L. L., et al. (2012) · Annals of Internal Medicine · doi:10.7326/0003-4819-157-6-201209180-00537 · Cited by 1,049
How Quickly Do Systematic Reviews Go Out of Date? A Survival Analysis
Shojania, K. G., Sampson, M., Ansari, M. T., Ji, J., Doucette, S., & Moher, D. (2007) · Annals of Internal Medicine · doi:10.7326/0003-4819-147-4-200708210-00179 · Cited by 838 · cited 1×
“Orthopaedic 25 (17) Cardiothoracic 18 (12) Vascular 12 (8) Urology 10 (7) ENT/head and neck 8 (5) Neurosurgery 5 (3) Plastic and reconstructive 1 (1) Funding source, n (%) Industry 4 (3) Unclear 78 (52) No external source 33 (22) Non-industry 35 (23) Conclusion, n (%) Supports surgical intervention 74 (49) Further res…”
Background
Cited by
Page, M. J., & Moher, D. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0663-8 · Cited by 769
“Association between journal endorsement of the PRISMA Statement and SR adherence to PRISMA [38, 39, 46, 71, 77, 81, 84, 94] 8”
BackgroundMethodScoping review on interventions to improve adherence to reporting guidelines in health research
Blanco, D., Altman, D., Moher, D., Boutron, I., Kirkham, J. J., & Cobo, E. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-026589 · Cited by 154
Jin, Y., Sanger, N., Shams, I., Luo, C., Shahid, H., Li, G., Bhatt, M., Zielinski, L., Bantoto, B., Wang, M., et al. (2018) · Journal of Multidisciplinary Healthcare · doi:10.2147/jmdh.s155103 · Cited by 134
Koffel, J. B., & Rethlefsen, M. L. (2016) · PLOS ONE · doi:10.1371/journal.pone.0163309 · Cited by 107
Yan, P., Yao, L., Li, H., Zhang, M., Xun, Y., Li, M., Cai, H., Lu, C., Hu, L., Guo, T., et al. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2018.12.013 · Cited by 107
Metadata
- Authors
- Adie, S., Ma, D., Harris, I. A., Naylor, J. M., & Craig, J. C.
- Venue
- Annals of Surgery
- Published
- 2015-04
- Volume
- 261
- Issue
- 4
- Pages
- 685-694
- ISSN
- 0003-4932 (ISSN-L)
- OpenAlex
- W1967621232
- Cited by
- 76
- References
- 23
- FWCI
- 8.97
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Quality of Conduct and Reporting of Meta-analyses of Surgical Interventions. https://app.cochat.ai/papers/10.1097/sla.0000000000000836
- The paper
- Adie, S., Ma, D., Harris, I. A., Naylor, J. M., & Craig, J. C. (2015). Quality of Conduct and Reporting of Meta-analyses of Surgical Interventions. Annals of Surgery. https://doi.org/10.1097/sla.0000000000000836
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.