The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
The methodological quality of robotic surgical meta-analyses needed to be improved: a cross-sectional study
Abstract
Objectives The aims of the article were to assess the methodological quality of robotic surgical meta-analyses (MAs) using A MeaSurement Tool to Assess systematic Reviews (AMSTAR-2) and to explore the factors of methodological quality.Study design and setting Robotic surgical MAs published between 2015 and 2018 were identified through a systematical search in PubMed, EMBASE, Cochrane library, and Web of Science databases. The methodological quality of eligible MAs was evaluated by AMSTAR-2. Data extraction and the methodological quality of MAs assessment were double checked by four trained reviewers. The intraclass correlation coefficient (ICC) was used to assess the consistency of quantitative measurements, and the ICC for overall score and score of critical domains were 0.952 and 0.912, respectively. Multivariate regression analysis was used to identify potential factors affecting methodological quality.Results A total of 123 MAs focused on 18 surgical locations were included. The findings showed that, regarding quality, only two (1.6%) of 123 MAs were high, two (1.6%) were moderate, two (1.6%) were low, and the remainder 117 (95.1%) were critical low. Multiple linear regression analysis revealed that publishing year and journal rank independently associated with methodological quality of MAs; origin region (P > 0.05), Preferred Reporting Items for Systematic Reviews and Meta-Analyses (P = 0.421), randomized controlled trial enrollment (P = 0.304), and funding support (P = 0.958) did not influence the quality of the MAs. Registration (item 2) and funding reported for individual studies (item 10) showed the poorest adherence in the MAs.Conclusion Our study showed that the previously published robotic surgical MAs lack good scientific quality, especially in those published in Q2- to Q4-rated journals. Potential solutions to improve the quality of future robotic surgical MAs include preregistration and funding reported for individual studies.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“although the Web of Science is one of the most widely used databases in visualization research, it is not the source of the whole act research literature”
From Characteristics and trends in acceptance and commitment therapy research: A bibliometric analysis (2022) · cites this paper as Yan et al., 2019
Citations
Cites
Shea, B. J., Reeves, B. C., Wells, G., Thuku, M., Hamel, C., Moran, J., Moher, D., Tugwell, P., Welch, V., Kristjansson, E., et al. (2017) · BMJ · doi:10.1136/bmj.j4008 · Cited by 10,636
Development of AMSTAR: A measurement tool to assess the methodological quality of systematic reviews
Shea, B. J., Grimshaw, J. M., Wells, G. A., Boers, M., Andersson, N., Hamel, C., Porter, A. C., Tugwell, P., Moher, D., & Bouter, L. M. (2007) · BMC Medical Research Methodology · doi:10.1186/1471-2288-7-10 · Cited by 4,374
ROBIS: A new tool to assess risk of bias in systematic reviews was developed
Whiting, P., Savović, J., Higgins, J. P. T., Caldwell, D. M., Reeves, B. C., Shea, B., Davies, P., Kleijnen, J., & Churchill, R. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.06.005 · Cited by 2,272
Pharmaceutical industry sponsorship and research outcome and quality: systematic review
Lexchin, J., Bero, L. A., Djulbegovic, B., & Clark, O. (2003) · BMJ · doi:10.1136/bmj.326.7400.1167 · Cited by 2,147
Shea, B. J., Hamel, C., Wells, G. A., Bouter, L. M., Kristjansson, E., Grimshaw, J., Henry, D. A., & Boers, M. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.10.009 · Cited by 1,755
Industry sponsorship and research outcome
Lundh, A., Lexchin, J., Mintzes, B., Schroll, J. B., & Bero, L. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000033.pub3 · Cited by 1,697
Systematic Reviews: Rationale for systematic reviews
Mulrow, C. D. (1994) · BMJ · doi:10.1136/bmj.309.6954.597 · Cited by 1,677
Randomised trials in surgery: problems and possible solutions
McCulloch, P. G., Taylor, I., Sasako, M., Lovett, B., & Griffin, D. (2002) · BMJ · doi:10.1136/bmj.324.7351.1448 · Cited by 761
Yaxley, J. W., Coughlin, G. D., Chambers, S. K., Occhipinti, S., Samaratunga, H., Zajdlewicz, L., Dunglison, N., Carter, R., Williams, S., Payton, D. J., et al. (2016) · The Lancet · doi:10.1016/s0140-6736(16)30592-x · Cited by 732
External Validation of a Measurement Tool to Assess Systematic Reviews (AMSTAR)
Shea, B. J., Bouter, L. M., Peterson, J., Boers, M., Andersson, N., Ortiz, Z., Ramsay, T., Bai, A., Shukla, V. K., & Grimshaw, J. M. (2007) · PLoS ONE · doi:10.1371/journal.pone.0001350 · Cited by 569
Bhandari, M., Busse, J. W., Jackowski, D., Montori, V. M., Schünemann, H. J., Sprague, S., Mears, D., Schemitsch, E. H., Heels-Ansdell, D., & Devereaux, P. J. (2004) · Europe PMC (PubMed Central) · Cited by 550
An international registry of systematic-review protocols
Booth, A., Clarke, M., Ghersi, D., Moher, D., Petticrew, M., & Stewart, L. (2011) · The Lancet · doi:10.1016/s0140-6736(10)60903-8 · Cited by 512
Quality of Reporting of Randomized Trials as a Measure of Methodologic Quality
Huwiler-Müntener, K. (2002) · JAMA · doi:10.1001/jama.287.21.2801 · Cited by 397
Prevalence and outcomes of incidental imaging findings: umbrella review
O’Sullivan, J. W., Muntinga, T., Grigg, S. E., & Ioannidis, J. P. A. (2018) · BMJ · doi:10.1136/bmj.k2387 · Cited by 360
Funding of US Biomedical Research, 2003-2008
Dorsey, E. R. (2010) · JAMA · doi:10.1001/jama.2009.1987 · Cited by 337
Ge, L., Tian, J., Li, Y., Pan, J.-X., Ge, L., Wei, D., Xing, X., Pan, B., Chen, Y., Song, F., et al. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.10.012 · Cited by 319
Association of Journal Quality Indicators With Methodological Quality of Clinical Research Articles
Lee, K. P. (2002) · JAMA · doi:10.1001/jama.287.21.2805 · Cited by 284
Bero, L., Oostvogel, F., Bacchetti, P., & Lee, K. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040184 · Cited by 249
The methodological and reporting quality of systematic reviews from China and the USA are similar
Tian, J., Zhang, J., Ge, L., Yang, K., & Song, F. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.12.004 · Cited by 248
Berlin, J. A., & Golub, R. M. (2014) · JAMA · doi:10.1001/jama.2014.8167 · Cited by 161
Systematic review found AMSTAR, but not R(evised)-AMSTAR, to have good measurement properties
Pieper, D., Büchter, R. B., Li, L., Prediger, B., & Eikermann, M. (2014) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.12.009 · Cited by 160
Bafeta, A., Trinquart, L., Séror, R., & Ravaud, P. (2013) · BMJ · doi:10.1136/bmj.f3675 · Cited by 106
Robotic cholecystectomy versus conventional laparoscopic cholecystectomy: A meta-analysis
Huang, Y., Chua, T. C., Maddern, G. J., & Samra, J. S. (2016) · Surgery · doi:10.1016/j.surg.2016.08.061 · Cited by 105
Industry Sponsorship and Research Outcome
Bero, L. A. (2013) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2013.4190 · Cited by 104
Hannink, G., Gooszen, H. G., & Rovers, M. M. (2013) · Annals of Surgery · doi:10.1097/sla.0b013e3182864fa3 · Cited by 101
Minimally invasive surgery techniques in pelvic exenteration: a systematic and meta-analysis review
Collaborative, T. P. (2018) · Surgical Endoscopy · doi:10.1007/s00464-018-6299-5 · Cited by 86
Moher, D., Soeken, K. L., Sampson, M., Ben‐Porat, L., & Berman, B. (2002) · BMC Pediatrics · doi:10.1186/1471-2431-2-3 · Cited by 81
Assessing the Quality of Reports of Systematic Reviews: The QUOROM Statement Compared to Other Tools
Shea, B., Dubé, C., & Moher, D. (2001) · Wiley eBooks · doi:10.1002/9780470693926.ch7 · Cited by 80
Quality of Conduct and Reporting of Meta-analyses of Surgical Interventions
Adie, S., F., D. D., Harris, I. A., Naylor, J., & Craig, J. C. (2015) · Annals of Surgery · doi:10.1097/sla.0000000000000836 · Cited by 77
Xourafas, D., Ashley, S. W., & Clancy, T. E. (2017) · Journal of Gastrointestinal Surgery · doi:10.1007/s11605-017-3463-5 · Cited by 77
Littell, J. H., & White, H. (2017) · Research on Social Work Practice · doi:10.1177/1049731517703748 · Cited by 76
Evaluation of methodology and quality characteristics of systematic reviews in orthodontics
Papageorgiou, S. N., Papadopoulos, M. A. A. P., & Athanasiou, A. E. (2011) · Orthodontics and Craniofacial Research · doi:10.1111/j.1601-6343.2011.01522.x · Cited by 68
Thulliez, M., Angoulvant, D., Pisella, P., & Bejan‐Angoulvant, T. (2018) · JAMA Ophthalmology · doi:10.1001/jamaophthalmol.2018.0002 · Cited by 62
Methodology and reporting of meta-analyses in the neurosurgical literature
Klimo, P., Thompson, C. J., Ragel, B. T., & Boop, F. A. (2014) · Journal of neurosurgery · doi:10.3171/2013.11.jns13195 · Cited by 60
Papageorgiou, S. N., Papadopoulos, M. A. A. P., & Athanasiou, A. E. (2013) · European Journal of Orthodontics · doi:10.1093/ejo/cjt008 · Cited by 51
Ho, R. S., Wu, X., Yuan, J., Liu, S., Lai, X., Wong, S. Y., & Chung, V. C. (2015) · npj Primary Care Respiratory Medicine · doi:10.1038/npjpcrm.2014.102 · Cited by 50
Valverde, A., Goasguen, N., Oberlin, O., Svrcek, M., Fléjou, J., Sézeur, A., Mosnier, H., Houdart, R., & Lupinacci, R. M. (2017) · Surgical Endoscopy · doi:10.1007/s00464-017-5455-7 · Cited by 50
Reporting and methodological qualities of published surgical meta-analyses
Zhang, H., Han, J. S., Zhu, Y., Lau, W. Y., Schwartz, M., Xie, G.-Q., Dai, S.-Y., Shen, Y., Wu, M., Shen, F., et al. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.06.009 · Cited by 43
Sharma, S., & Oremus, M. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2018.03.012 · Cited by 43
Cochrane and Campbell Collaborations, and health equity
Tugwell, P., Petticrew, M. P., Robinson, V. A., Kristjansson, E., & Maxwell, L. J. (2006) · The Lancet · doi:10.1016/s0140-6736(06)68490-0 · Cited by 42
Policymakers, experts review evidence-based medicine
Young, D. (2005) · American Journal of Health-System Pharmacy · doi:10.1093/ajhp/62.4.342 · Cited by 35
Many Reviews Are Systematic but Some Are More Transparent and Completely Reported than Others
Editors, T. P. M. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040147 · Cited by 34
Valverde, A., Goasguen, N., Oberlin, O., Svrcek, M., Fléjou, J., Sézeur, A., Mosnier, H., Houdart, R., & Lupinacci, R. M. (2017) · Surgical Endoscopy · doi:10.1007/s00464-017-5691-x · Cited by 33
Policymakers, experts review evidence-based medicine
Young, D. (2005) · American Journal of Health-System Pharmacy · doi:10.1093/ajhp/62.4.0342 · Cited by 22
Stonier, T., Simson, N., Lee, S., Robertson, I., Amer, T., Somani, B. K., Rai, B. P., & Aboumarzouk, O. M. (2017) · Arab Journal of Urology · doi:10.1016/j.aju.2017.05.002 · Cited by 22
Methodological Quality Assessment of Meta-analyses in Endodontics
Kattan, S. A., Lee, S., Kohli, M. R., Setzer, F. C., & Karabucak, B. (2017) · Journal of Endodontics · doi:10.1016/j.joen.2017.07.019 · Cited by 22
Limited Evidence for Robot-assisted Surgery
Broholm, M., Hansen, I. O., & Rosenberg, J. (2016) · Surgical Laparoscopy Endoscopy & Percutaneous Techniques · doi:10.1097/sle.0000000000000248 · Cited by 17
Level of evidence of abdominal surgery clinical research in Saudi Arabia
Maghrabi, Y., Baeesa, M. S., Kattan, J., Altaf, A., & Baeesa, S. S. (2017) · Saudi Medical Journal · doi:10.15537/smj.2017.8.18456 · Cited by 10
Can We Accomplish Better Oncological Results with Robot-Assisted Radical Prostatectomy?
Kural, A. R., Öbek, C., & Doğanca, T. (2017) · Journal of Endourology · doi:10.1089/end.2016.0585 · Cited by 6
Robot‐assisted vs open radical prostatectomy: the day after
Ficarra, V., Novara, G., & Dasgupta, P. (2017) · British Journal of Urology · doi:10.1111/bju.13891 · Cited by 1
Cited by
Sorted by citations
Geng, Y., Zhang, Q., Feng, S., Li, C., Wang, L., Zhao, X., Yang, Z., Li, Z., Luo, H., Liu, R., et al. (2021) · Cancer Medicine · doi:10.1002/cam4.3718 · Cited by 118
Cao, L., Li, X., Yan, P., Wang, X., Li, M., Li, R., Shi, X., Liu, X., & Yang, K. (2019) · Journal of Clinical Hypertension · doi:10.1111/jch.13583 · Cited by 112
The effectiveness and safety of acupuncture for depression: An overview of meta-analyses
Li, M., Niu, J., Yan, P., Yao, L., He, W., Wang, M., Li, H., Cao, L., Li, X., Shi, X., et al. (2019) · Complementary Therapies in Medicine · doi:10.1016/j.ctim.2019.102202 · Cited by 78
Matthias, K., Rissling, O., Pieper, D., Morche, J., Nocon, M., Jacobs, A., Wegewitz, U. E., Schirm, J., & Lorenz, R. C. (2020) · Heliyon · doi:10.1016/j.heliyon.2020.e04776 · Cited by 72
Jiang, W., Yan, P., Zhao, C., Si, M., Tian, W., Zhang, Y., Tian, H., Feng, S., Han, C., Yang, J., et al. (2020) · Surgical Endoscopy · doi:10.1007/s00464-019-07283-y · Cited by 69
Metadata
- Authors
- Yan, P., Yao, L., Li, H., Zhang, M., Xun, Y., Li, M., Cai, H., Lu, C., Hu, L., Guo, T., Liu, R., & Yang, K.
- Affiliations
- Gansu Provincial Hospital (CN)
- Hong Kong Baptist University (HK)
- Lanzhou University (CN)
- Chinese PLA General Hospital (CN)
- Corresponding author
- Liu, Rong
- Yang, Kehu
- ORCID
- Venue
- Journal of Clinical Epidemiology
- Publisher
- Elsevier BV
- Published
- 2019-05
- Volume
- 109
- Pages
- 20-29
- ISSN
- 0895-4356 (ISSN-L)
- OpenAlex
- W2905661211
- Cited by
- 107
- References
- 49
- Citations by year
- 2026: 3 · 2025: 2 · 2024: 9 · 2023: 11 · 2022: 13 · 2021: 26 · 2020: 22 · 2019: 21
- FWCI
- 13.11
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Clinical Epidemiology (publishedVersion)
- PubMed (publishedVersion)
- Lanzhou University Institutional Repository (submittedVersion)
- Funders
- Fundamental Research Funds for the Central Universities, China (16LZUJBWTD013, 18LZUJBWZX006)
- Gansu Provincial Hospital, China (17GSSY9-1, Grant no. 18GSSY3-8)
- Key Laboratory of Evidence Based Medicine and Knowledge Translation Foundation (GSXZYZH2018006)
- Laboratory Of Intelligent Medical Engineering (GSXZYZH2018001)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Keywords
- robotic surgery, meta-analysis, methodological quality, AMSTAR 2, reporting quality, research registration, funding disclosure, journal impact factor
- MeSH terms
- Cross-Sectional Studies, Humans, Meta-Analysis as Topic, Multivariate Analysis, Robotic Surgical Procedures
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review