The quality of systematic reviews/meta‐analyses published in the field of bariatrics: A cross‐sectional systematic survey using AMSTAR 2 and ROBIS
Open accessThe DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
Summary: High‐quality systematic reviews (SR) and meta‐analyses (MA) are considered to be reliable sources of information. This study aims to assess the quality of studies published as SR or MA in the field of bariatrics in 2016 and 2017. We identified SR and MA in the field of bariatrics by searching electronic databases (MEDLINE, Embase, and Cochrane Database of Systematic Reviews). Eligible studies were those identified as SR/MA in the title/abstract, which aimed to assess any outcome in patients with morbid obesity undergoing or scheduled to undergo bariatric surgery. Two authors independently reviewed all titles and abstracts, assessed full texts of potentially eligible studies, and assessed the quality of included studies. Any discrepancies were resolved by the third reviewer. We evaluated the quality and risk of bias of each SR/MA using AMSTAR 2 checklist and ROBIS tool, respectively. Seventy‐eight of 4236 references met inclusion criteria and were assessed for their quality/risk of bias. The methodological quality of 99% of all papers was classified as “critically low.” A total of 6% of the studies were at low risk of bias, and 78% were assessed as being at high risk of bias. The methodological quality of studies published in 2016 and 2017 as SR/MA is highly unsatisfactory.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
PRISMA-P Group, Moher, D., Shamseer, L., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., & Stewart, L. A. (2015) · Systematic Reviews · doi:10.1186/2046-4053-4-1 · Cited by 26,223
Shea, B. J., Reeves, B. C., Wells, G., Thuku, M., Hamel, C., Moran, J., Moher, D., Tugwell, P., Welch, V., Kristjansson, E., et al. (2017) · BMJ · doi:10.1136/bmj.j4008 · Cited by 10,636
ROBIS: A new tool to assess risk of bias in systematic reviews was developed
Whiting, P., Savović, J., Higgins, J. P. T., Caldwell, D. M., Reeves, B. C., Shea, B., Davies, P., Kleijnen, J., & Churchill, R. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.06.005 · Cited by 2,272
The Mass Production of Redundant, Misleading, and Conflicted Systematic Reviews and Meta‐analyses
IOANNIDIS, J. P. A. (2016) · The Milbank Quarterly · doi:10.1111/1468-0009.12210 · Cited by 1,483
Alonso-Coello, P., Schünemann, H. J., Moberg, J., Brignardello-Petersen, R., Akl, E. A., Davoli, M., Treweek, S., Mustafa, R. A., Rada, G., Rosenbaum, S., et al. (2016) · BMJ · doi:10.1136/bmj.i2016 · Cited by 1,317
Eriksen, M. B., & Frandsen, T. F. (2018) · Journal of the Medical Library Association · doi:10.5195/jmla.2018.345 · Cited by 1,216
Cook, D. J., Sackett, D. L., & Spitzer, W. O. (1995) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(94)00172-m · Cited by 573
A descriptive analysis of overviews of reviews published between 2000 and 2011.
Hartling, L., Chisholm, A., Thomson, D., & Dryden, D. M. (2012) · PLoS ONE · doi:10.1371/journal.pone.0049667 · Cited by 241
Overviews of reviews often have limited rigor: a systematic review
Pieper, D., Buechter, R., Jerinic, P., & Eikermann, M. (2012) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2012.06.015 · Cited by 213 · cited 8×
“Only 3% of the published reviews [13, 43] had answer “Yes” in four or more of the seven critical domains and just 7% of papers [2, 19, 33, 37, 59] had answer “Yes” in three of the seven critical domains.”
BackgroundMethodInfluentialOlsson Möller, U., Beck, I., Rydén, L., & Malmström, M. (2019) · BMC Cancer · doi:10.1186/s12885-019-5648-7 · Cited by 189
Cited by
Ferguson, T., Olds, T., Curtis, R., Blake, H., Crozier, A. J., Dankiw, K., Dumuid, D., Kasai, D., O'Connor, E., Virgara, R., et al. (2022) · The Lancet Digital Health · doi:10.1016/s2589-7500(22)00111-x · Cited by 605
Nieto González, D. M. (2022) · doi:10.11144/javeriana.10554.58492 · Cited by 6
“(2020) [36], encontró que alrededor del 99% de 4236 estudios entre 2016 y 2017, clasificados como revisiones sistemáticas en el campo de la cirugía bariátrica, fueron clasificados como con “una metodología críticamente pobre” por AMSTAR-2 y ROBIS.”
BackgroundInfluentialPredictors of Higher Quality of Systematic Reviews Addressing Nutrition and Cancer Prevention
Storman, D., Koperny, M., Zając, J., Polak, M., Weglarz, P., Bochenek-Cibor, J., Swierz, M. J., Staskiewicz, W., Gorecka, M., Skuza, A., et al. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19010506 · Cited by 6
Self-citation
Metadata
- Authors
- Storman, M., Storman, D., Jasinska, K. W., Swierz, M. J., & Bala, M. M.
- Venue
- Obesity Reviews
- Publisher
- Wiley
- Published
- 2020-01-29
- Volume
- 21
- Issue
- 5
- Pages
- e12994-e12994
- ISSN
- 1467-7881 (ISSN-L)
- 1467-789X
- OpenAlex
- W3003531337
- Cited by
- 70
- References
- 15
- FWCI
- 2.98
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.