Reporting and methodological quality of meta-analyses in urological literature
Open accessAbstract
Purpose To assess the overall quality of published urological meta-analyses and identify predictive factors for high quality. Materials and Methods We systematically searched PubMed to identify meta-analyses published from January 1st, 2011 to December 31st, 2015 in 10 predetermined major paper-based urology journals. The characteristics of the included meta-analyses were collected, and their reporting and methodological qualities were assessed by the PRISMA checklist (27 items) and AMSTAR tool (11 items), respectively. Descriptive statistics were used for individual items as a measure of overall compliance, and PRISMA and AMSTAR scores were calculated as the sum of adequately reported domains. Logistic regression was used to identify predictive factors for high qualities. Results A total of 183 meta-analyses were included. The mean PRISMA and AMSTAR scores were 22.74 ± 2.04 and 7.57 ± 1.41, respectively. PRISMA item 5, protocol and registration, items 15 and 22, risk of bias across studies, items 16 and 23, additional analysis had less than 50% adherence. AMSTAR item 1, “ a priori ” design, item 5, list of studies and item 10, publication bias had less than 50% adherence. Logistic regression analyses showed that funding support and “ a priori ” design were associated with superior reporting quality, following PRISMA guideline and “ a priori ” design were associated with superior methodological quality. Conclusions Reporting and methodological qualities of recently published meta-analyses in major paper-based urology journals are generally good. Further improvement could potentially be achieved by strictly adhering to PRISMA guideline and having “ a priori ” protocol.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The reporting and methodological qualities of recently published MAs in paper-based urology journals have been generally good.
“Fortunately, the reporting and methodological qualities of recently published MAs in paper-based urology journals have been generally good [14].”
From Reporting quality of abstracts of systematic reviews/meta-analyses: An appraisal of Arab Journal of Urology across 12 years: the PRISMA-Abstracts checklist (2023) · cites this paper as [14]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823 · see citing works
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042 · see citing works
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859 · see citing works
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164 · see citing works
Dermyshi, E., Wang, Y., Yan, C., Hong, W., Qiu, G., Gong, X., & Zhang, T. (2017) · Neonatology · doi:10.1159/000454668 · Cited by 24,577 · see citing works
Stroup, D. F. (2000) · JAMA · doi:10.1001/jama.283.15.2008 · Cited by 20,623 · see citing works
Wang, G., Ma, R., Qiao, G., Wada, K., Aizawa, Y., & Satoh, T. (2015) · Integrative Medicine International · doi:10.1159/000368408 · Cited by 18,759 · see citing works
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00136 · Cited by 10,349 · see citing works
Sterne, J. A. C., Sutton, A. J., Ioannidis, J. P. A., Terrin, N., Jones, D. R., Lau, J., Carpenter, J., Rucker, G., Harbord, R. M., Schmid, C. H., et al. (2011) · BMJ · doi:10.1136/bmj.d4002 · Cited by 7,709 · see citing works
Development of AMSTAR: A measurement tool to assess the methodological quality of systematic reviews
Shea, B. J., Grimshaw, J. M., Wells, G. A., Boers, M., Andersson, N., Hamel, C., Porter, A. C., Tugwell, P., Moher, D., & Bouter, L. M. (2007) · BMC Medical Research Methodology · doi:10.1186/1471-2288-7-10 · Cited by 4,374 · see citing works
Shea, B. J., Hamel, C., Wells, G. A., Bouter, L. M., Kristjansson, E., Grimshaw, J., Henry, D. A., & Boers, M. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.10.009 · Cited by 1,755 · see citing works
The nuts and bolts of PROSPERO: an international prospective register of systematic reviews
Booth, A., Clarke, M., Dooley, G., Ghersi, D., Moher, D., Petticrew, M., & Stewart, L. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-2 · Cited by 1,433 · see citing works
Systematic Review: Why sources of heterogeneity in meta-analysis should be investigated
Thompson, S. G. (1994) · BMJ · doi:10.1136/bmj.309.6965.1351 · Cited by 1,017 · see citing works
McAuley, L., Pham, B., Tugwell, P., & Moher, D. (2000) · The Lancet · doi:10.1016/s0140-6736(00)02786-0 · Cited by 812 · see citing works
External Validation of a Measurement Tool to Assess Systematic Reviews (AMSTAR)
Shea, B. J., Bouter, L. M., Peterson, J., Boers, M., Andersson, N., Ortiz, Z., Ramsay, T., Bai, A., Shukla, V. K., & Grimshaw, J. M. (2007) · PLoS ONE · doi:10.1371/journal.pone.0001350 · Cited by 569 · see citing works
Tewari, A. K., Sooriakumaran, P., Bloch, D. A., Seshadri‐Kreaden, U., Hebert, A. E., & Wiklund, P. N. (2012) · European Urology · doi:10.1016/j.eururo.2012.02.029 · Cited by 519 · see citing works
Andriole, G. L. (2012) · Yearbook of Urology · doi:10.1016/j.yuro.2012.07.016 · Cited by 406 · see citing works
Association Between Analytic Strategy and Estimates of Treatment Outcomes in Meta-analyses
Dechartres, A., Altman, D. G., Trinquart, L., Boutron, I., & Ravaud, P. (2014) · JAMA · doi:10.1001/jama.2014.8166 · Cited by 233 · see citing works
Reporting of results from network meta-analyses: methodological systematic review
Bafeta, A., Trinquart, L., Seror, R., & Ravaud, P. (2014) · BMJ · doi:10.1136/bmj.g1741 · Cited by 220 · see citing works
Reeves, F., Preece, P. D., Kapoor, J., Everaerts, W., Murphy, D. G., Corcoran, N. M., & Costello, A. J. (2014) · European Urology · doi:10.1016/j.eururo.2014.10.020 · Cited by 210 · see citing works
Systematic review and meta-analysis: techniques and a guide for the academic surgeon.
Phan, K. H., Tian, D. H., Cao, C. Q., Black, D. A., & Yan, T. D. (2015) · PubMed Central · doi:10.3978/j.issn.2225-319x.2015.02.04 · Cited by 167 · see citing works
Berlin, J. A., & Golub, R. M. (2014) · JAMA · doi:10.1001/jama.2014.8167 · Cited by 161 · see citing works
Systematic review found AMSTAR, but not R(evised)-AMSTAR, to have good measurement properties
Pieper, D., Büchter, R. B., Li, L., Prediger, B., & Eikermann, M. (2014) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.12.009 · Cited by 160 · see citing works
Tunis, A. S., McInnes, M. D. F., Hanna, R. R., & Esmail, K. (2013) · Radiology · doi:10.1148/radiol.13130273 · Cited by 150 · see citing works
van Die, M. D., Bone, K. M., Williams, S., & Pirotta, M. V. (2013) · British Journal of Urology · doi:10.1111/bju.12435 · Cited by 130 · see citing works
Reporting and Methodological Quality of Systematic Reviews in the Orthopaedic Literature
Gagnier, J. J., & Kellam, P. J. (2013) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.l.00597 · Cited by 112 · see citing works
Faggion, C. M. (2015) · BMC Medical Research Methodology · doi:10.1186/s12874-015-0062-6 · Cited by 109 · see citing works
Bafeta, A., Trinquart, L., Séror, R., & Ravaud, P. (2013) · BMJ · doi:10.1136/bmj.f3675 · Cited by 106 · see citing works
Synthesizing Evidence: Shifting the Focus From Individual Studies to the Body of Evidence
Murad, M. H., & Montori, V. M. (2013) · JAMA · doi:10.1001/jama.2013.5616 · Cited by 104 · see citing works
What is publication bias in a meta-analysis?
Sedgwick, P. M. (2015) · BMJ · doi:10.1136/bmj.h4419 · Cited by 102 · see citing works
Quality of Conduct and Reporting of Meta-analyses of Surgical Interventions
Adie, S., F., D. D., Harris, I. A., Naylor, J., & Craig, J. C. (2015) · Annals of Surgery · doi:10.1097/sla.0000000000000836 · Cited by 76 · see citing works
Reporting and methodological qualities of published surgical meta-analyses
Zhang, H., Han, J. S., Zhu, Y., Lau, W. Y., Schwartz, M., Xie, G.-Q., Dai, S.-Y., Shen, Y., Wu, M., Shen, F., et al. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.06.009 · Cited by 43 · see citing works
Liu, P., Qiu, Y., Qian, Y., Chen, X., Wang, Y., Cui, J., & Zhai, X. (2016) · Journal of Gastroenterology and Hepatology · doi:10.1111/jgh.13591 · Cited by 20 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Liu, H., Zhou, X., Yu, G., & Sun, X. (2019) · International Journal of Nursing Practice · doi:10.1111/ijn.12729 · Cited by 36 · see citing works
O'Kelly, F., DeCotiis, K., Aditya, I., Braga, L. H., & Koyle, M. A. (2020) · Journal of Pediatric Urology · doi:10.1016/j.jpurol.2019.12.002 · Cited by 34 · see citing works
Sun, X., Zhou, X., Yu, Y., & Liu, H. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0622-7 · Cited by 33 · see citing works
Reporting quality in systematic reviews of in vitro studies: a systematic review
Elshafay, A., Omran, E. S., Abdelkhalek, M., El-Badry, M. O., Eisa, H. G., Fala, S. Y., Dang, T. B., Ghanem, M. A. T., Elbadawy, M., Elhady, M. T., et al. (2019) · Current Medical Research and Opinion · doi:10.1080/03007995.2019.1607270 · Cited by 29 · see citing works
Li, L., Xu, C., Deng, K., Zhou, X., Liu, Z., Busse, J. W., Ren, Y., Zou, K., & Sun, X. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2018.09.014 · Cited by 23 · see citing works
Sun, X., Wang, D., Wang, M., Li, H., & Liu, B. (2021) · Nursing Open · doi:10.1002/nop2.767 · Cited by 20 · see citing works
Hasan, H., Muhammed, T., Yu, J., Taguchi, K., Samargandi, O. A., Howard, A. F., Lo, A., Olson, R. A., & Goddard, K. (2017) · Cancer Epidemiology · doi:10.1016/j.canep.2017.08.013 · Cited by 18 · see citing works
Sun, X., Zhou, X., Zhang, Y., & Liu, H. (2019) · Journal of Nursing Scholarship · doi:10.1111/jnu.12462 · Cited by 16 · see citing works
Tao, T., Shi, M., Tan, B.-Y., Zhang, X., Sun, F., Liu, B.-R., Li, S., & Li, Z. (2024) · Systematic Reviews · doi:10.1186/s13643-024-02606-0 · Cited by 16 · see citing works
Quality and Reporting Completeness of Systematic Reviews and Meta-Analyses in Dermatology
Smires, S. B., Afach, S., Mazaud, C., Phan, C., Doval, I. G., Boyle, R. J., Dellavalle, R. P., Williams, H. C., Grindlay, D. J. C., Sbidian, É., et al. (2020) · Journal of Investigative Dermatology · doi:10.1016/j.jid.2020.05.109 · Cited by 16 · see citing works
Xu, C., Liu, T.-Z., Jia, P., Liu, Y., Li, L., Cheng, L.-L., & Sun, X. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0623-6 · Cited by 15 · see citing works
Jiang, Q., Liu, Q., Chen, F., Zeng, X., Song, F., Lu, Z., & Cao, S. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.07.008 · Cited by 11 · see citing works
Li, L., Deng, K., Busse, J. W., Zhou, X., Xu, C., Liu, Z., Ren, Y., Zou, K., & Sun, X. (2020) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.03.017 · Cited by 9 · see citing works
El Ansari, W., AlRumaihi, K., El-Ansari, K., Arafa, M., Elbardisi, H., Majzoub, A., Shamsodini, A., & Al Ansari, A. (2023) · Arab Journal of Urology · doi:10.1080/2090598x.2022.2113127 · Cited by 6 · see citing works
Kunkel, S. T., Sabatino, M. J., Moschetti, W. E., & Jevsevar, D. S. (2018) · Clinical Research in Orthopaedics · doi:10.33309/2639-8885.010101 · Cited by 3 · see citing works
Publication of Positive Studies in the Urologic Literature
Rapp, D. E., Tuong, M. N. E., Zillioux, J. M., Patel, N., Shah, J., & Ballantyne, C. C. (2020) · Urology · doi:10.1016/j.urology.2020.06.098 · Cited by 2 · see citing works
Peña, A. M., Ladd, C., Anderson, J. M., Torgerson, T., Hartwell, M. L., Johnson, B. S., McMurray, M., & Vassar, M. B. (2022) · Urology · doi:10.1016/j.urology.2021.12.019 · Cited by 2 · see citing works
Tao, T., Shi, M., Tan, B.-Y., ZHANG, X.-S., Feng-ling, S. U. N., Liu, B.-R., Shao-jun, L. I., & Zhen-Hua, L. I. (2023) · Research Square · doi:10.21203/rs.3.rs-2708022/v1 · Cited by 2 · see citing works
Xia, H., Peng, S., Huang, S., Jiang, J., Zeng, X., Zhang, H., Pu, X., Zou, K., Lü, Y., Xu, H., et al. (2022) · Surgical Endoscopy · doi:10.1007/s00464-022-09570-7
Tao, T., Shi, M.-P., Tan, B.-Y., Zhang, X., Sun, F.-L., Liu, B.-R., Li, S.-J., & Li, Z.-H. (2024) · Figshare · doi:10.6084/m9.figshare.26751020
Tao, T., Shi, M.-P., Tan, B.-Y., Zhang, X.-S., Sun, F.-L., Liu, B.-R., Li, S.-J., & Li, Z.-H. (2024) · Figshare · doi:10.6084/m9.figshare.26751023
Tao, T., Shi, M.-P., Tan, B.-Y., Zhang, X.-S., Sun, F.-L., Liu, B.-R., Li, S.-J., & Li, Z.-H. (2024) · Figshare · doi:10.6084/m9.figshare.26751017
- Authors
- Xia, L., Xu, J., & Guzzo, T. J.
- Affiliations
- University of Pennsylvania (US)
- University of Miami (US)
- Corresponding author
- Xia, Leilei
- Guzzo, Thomas J.
- ORCID
- Venue
- PeerJ
- Publisher
- PeerJ
- Published
- 2017-04-19
- Volume
- 5
- Pages
- e3129
- ISSN
- 2167-8359 (ISSN-L)
- PMC
- PMC5399869
- OpenAlex
- W2607097952
- Cited by
- 22
- References
- 33
- Citations by year
- 2024: 4 · 2023: 1 · 2022: 3 · 2021: 1 · 2020: 3 · 2019: 5 · 2018: 4 · 2017: 1
- FWCI
- 3.18
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PeerJ (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- The Linda and Joel Appel Urologic Oncology Research Fund
- The Honickman Family Urologic Research Fund
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › scientometrics and bibliometrics research
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- meta-analysis, reporting quality, methodological quality, urology literature, PRISMA checklist, AMSTAR, financial support, publication bias, risk of bias
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
