The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
The methodological quality of robotic surgical meta-analyses needed to be improved: a cross-sectional study
Abstract
Objectives The aims of the article were to assess the methodological quality of robotic surgical meta-analyses (MAs) using A MeaSurement Tool to Assess systematic Reviews (AMSTAR-2) and to explore the factors of methodological quality.Study design and setting Robotic surgical MAs published between 2015 and 2018 were identified through a systematical search in PubMed, EMBASE, Cochrane library, and Web of Science databases. The methodological quality of eligible MAs was evaluated by AMSTAR-2. Data extraction and the methodological quality of MAs assessment were double checked by four trained reviewers. The intraclass correlation coefficient (ICC) was used to assess the consistency of quantitative measurements, and the ICC for overall score and score of critical domains were 0.952 and 0.912, respectively. Multivariate regression analysis was used to identify potential factors affecting methodological quality.Results A total of 123 MAs focused on 18 surgical locations were included. The findings showed that, regarding quality, only two (1.6%) of 123 MAs were high, two (1.6%) were moderate, two (1.6%) were low, and the remainder 117 (95.1%) were critical low. Multiple linear regression analysis revealed that publishing year and journal rank independently associated with methodological quality of MAs; origin region (P > 0.05), Preferred Reporting Items for Systematic Reviews and Meta-Analyses (P = 0.421), randomized controlled trial enrollment (P = 0.304), and funding support (P = 0.958) did not influence the quality of the MAs. Registration (item 2) and funding reported for individual studies (item 10) showed the poorest adherence in the MAs.Conclusion Our study showed that the previously published robotic surgical MAs lack good scientific quality, especially in those published in Q2- to Q4-rated journals. Potential solutions to improve the quality of future robotic surgical MAs include preregistration and funding reported for individual studies.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“although the Web of Science is one of the most widely used databases in visualization research, it is not the source of the whole act research literature”
From Characteristics and trends in acceptance and commitment therapy research: A bibliometric analysis (2022) · cites this paper as Yan et al., 2019
Citations
Cites
Shea, B. J., Reeves, B. C., Wells, G., Thuku, M., Hamel, C., Moran, J., Moher, D., Tugwell, P., Welch, V., Kristjansson, E., et al. (2017) · BMJ · doi:10.1136/bmj.j4008 · Cited by 10,636
Development of AMSTAR: A measurement tool to assess the methodological quality of systematic reviews
Shea, B. J., Grimshaw, J. M., Wells, G. A., Boers, M., Andersson, N., Hamel, C., Porter, A. C., Tugwell, P., Moher, D., & Bouter, L. M. (2007) · BMC Medical Research Methodology · doi:10.1186/1471-2288-7-10 · Cited by 4,374
ROBIS: A new tool to assess risk of bias in systematic reviews was developed
Whiting, P., Savović, J., Higgins, J. P. T., Caldwell, D. M., Reeves, B. C., Shea, B., Davies, P., Kleijnen, J., & Churchill, R. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.06.005 · Cited by 2,272
Pharmaceutical industry sponsorship and research outcome and quality: systematic review
Lexchin, J., Bero, L. A., Djulbegovic, B., & Clark, O. (2003) · BMJ · doi:10.1136/bmj.326.7400.1167 · Cited by 2,147
Shea, B. J., Hamel, C., Wells, G. A., Bouter, L. M., Kristjansson, E., Grimshaw, J., Henry, D. A., & Boers, M. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.10.009 · Cited by 1,755
Industry sponsorship and research outcome
Lundh, A., Lexchin, J., Mintzes, B., Schroll, J. B., & Bero, L. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000033.pub3 · Cited by 1,697
Systematic Reviews: Rationale for systematic reviews
Mulrow, C. D. (1994) · BMJ · doi:10.1136/bmj.309.6954.597 · Cited by 1,677
Randomised trials in surgery: problems and possible solutions
McCulloch, P. G., Taylor, I., Sasako, M., Lovett, B., & Griffin, D. (2002) · BMJ · doi:10.1136/bmj.324.7351.1448 · Cited by 761
Yaxley, J. W., Coughlin, G. D., Chambers, S. K., Occhipinti, S., Samaratunga, H., Zajdlewicz, L., Dunglison, N., Carter, R., Williams, S., Payton, D. J., et al. (2016) · The Lancet · doi:10.1016/s0140-6736(16)30592-x · Cited by 732
External Validation of a Measurement Tool to Assess Systematic Reviews (AMSTAR)
Shea, B. J., Bouter, L. M., Peterson, J., Boers, M., Andersson, N., Ortiz, Z., Ramsay, T., Bai, A., Shukla, V. K., & Grimshaw, J. M. (2007) · PLoS ONE · doi:10.1371/journal.pone.0001350 · Cited by 569
Cited by
Sorted by citations
Items 101–107 of 107
Guan, X., Lao, Y., Wang, J., Wang, Y., Bai, Y., Li, X., Liu, S., Li, Z., Li, F., & Dong, Z. (2024) · Figshare · doi:10.6084/m9.figshare.26645404
Guan, X., Lao, Y., Wang, J., Wang, Y., Bai, Y., Li, X., Liu, S., Li, Z., Li, F., & Dong, Z. (2024) · Figshare · doi:10.6084/m9.figshare.24647300
Guan, X., Lao, Y., Wang, J., Wang, Y., Bai, Y., Li, X., Liu, S., Li, Z., Li, F., & Dong, Z. (2024) · Figshare · doi:10.6084/m9.figshare.26645401
Guan, X., Lao, Y., Wang, J., Wang, Y., Bai, Y., Li, X., Liu, S., Li, Z., Li, F., & Dong, Z. (2023) · Figshare · doi:10.6084/m9.figshare.24647245
Li, X., Nian, T., Liu, W., Shang, X. K., Xx, D., Guo, K., Chen, N., Wang, Y., Chen, Y., & Yang, K. (2026) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2024-113487
Yi, S., Ruan, J., Wang, Z., Ding, F., Liu, Y., Ao, Q., Ren, Z., Wu, C., Luo, Y., Niu, M., et al. (2026) · BMC Veterinary Research · doi:10.1186/s12917-026-05468-x
Storman, M., Storman, D., Świerz, M. J., Jasińska, K., Jemioło, P., & Bała, M. M. (2026) · Obesity Reviews · doi:10.1111/obr.70147
Metadata
- Authors
- Yan, P., Yao, L., Li, H., Zhang, M., Xun, Y., Li, M., Cai, H., Lu, C., Hu, L., Guo, T., Liu, R., & Yang, K.
- Affiliations
- Gansu Provincial Hospital (CN)
- Hong Kong Baptist University (HK)
- Lanzhou University (CN)
- Chinese PLA General Hospital (CN)
- Corresponding author
- Liu, Rong
- Yang, Kehu
- ORCID
- Venue
- Journal of Clinical Epidemiology
- Publisher
- Elsevier BV
- Published
- 2019-05
- Volume
- 109
- Pages
- 20-29
- ISSN
- 0895-4356 (ISSN-L)
- OpenAlex
- W2905661211
- Cited by
- 107
- References
- 49
- Citations by year
- 2026: 3 · 2025: 2 · 2024: 9 · 2023: 11 · 2022: 13 · 2021: 26 · 2020: 22 · 2019: 21
- FWCI
- 13.11
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Clinical Epidemiology (publishedVersion)
- PubMed (publishedVersion)
- Lanzhou University Institutional Repository (submittedVersion)
- Funders
- Fundamental Research Funds for the Central Universities, China (16LZUJBWTD013, 18LZUJBWZX006)
- Gansu Provincial Hospital, China (17GSSY9-1, Grant no. 18GSSY3-8)
- Key Laboratory of Evidence Based Medicine and Knowledge Translation Foundation (GSXZYZH2018006)
- Laboratory Of Intelligent Medical Engineering (GSXZYZH2018001)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Keywords
- robotic surgery, meta-analysis, methodological quality, AMSTAR 2, reporting quality, research registration, funding disclosure, journal impact factor
- MeSH terms
- Cross-Sectional Studies, Humans, Meta-Analysis as Topic, Multivariate Analysis, Robotic Surgical Procedures
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review