Association of Study Quality with Completeness of Reporting: Have Completeness of Reporting and Quality of Systematic Reviews and Meta-Analyses in Major Radiology Journals Changed Since Publication of the PRISMA Statement?
The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
PURPOSE: To evaluate whether completeness of reporting of systematic reviews and meta-analyses in major radiology journals has changed since publication of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement; a secondary objective is to evaluate whether completeness of reporting (ie, PRISMA) is associated with study quality (ie, Assessing the Methodological Quality of Systematic Reviews [AMSTAR]). MATERIALS AND METHODS: Systematic reviews and meta-analyses published in major radiology journals between January 2007 and December 2011 were identified by searching MEDLINE with the modified Montori method. Studies were reviewed independently by two investigators and assessed for adherence to the AMSTAR and PRISMA checklists. The average results were analyzed to assess for change in mean score before and after PRISMA publication and to assess results over time; a Pearson correlation coefficient was calculated to assess for any association between PRISMA and AMSTAR results. RESULTS: Included were 130 studies from 11 journals. Average PRISMA and AMSTAR results were 21.8 of 27 and 7.2 of 11, respectively. The average result was higher after publication of PRISMA, and PRISMA-reported items were 22.6 of 27 after publication of PRISMA versus 20.9 of 27 before publication of PRISMA; AMSTAR results were 7.7 of 11 after publication of PRISMA versus 6.7 of 11 before publication of PRISMA. There was a strong positive correlation (r = 0.86) between the PRISMA and AMSTAR results. There was high variability between journals. Radiology had the highest PRISMA reported items (24.7 of 27), and American Journal of Neuroradiology had the lowest (19.6 of 27). Two major areas for improvement include study protocol registration and assessment of risk of bias across studies (ie, publication bias). CONCLUSION: In major radiology journal studies, there was modest improvement in completeness of reporting of systematic reviews and meta-analyses, assessed by PRISMA, which was strongly associated with higher study quality, assessed by AMSTAR. SUPPLEMENTAL MATERIAL: http://radiology.rsna.org/lookup/suppl/doi:10.1148/radiol.13130273/-/DC1.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Development of AMSTAR: A measurement tool to assess the methodological quality of systematic reviews
Shea, B. J., Grimshaw, J. M., Wells, G. A., Boers, M., Andersson, N., Hamel, C., Porter, A. C., Tugwell, P., Moher, D., & Bouter, L. M. (2007) · BMC Medical Research Methodology · doi:10.1186/1471-2288-7-10 · Cited by 4,374
Deeks, J. J., Macaskill, P., & Irwig, L. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.01.016 · Cited by 2,910
Shea, B. J., Hamel, C., Wells, G. A., Bouter, L. M., Kristjansson, E., Grimshaw, J., Henry, D. A., & Boers, M. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.10.009 · Cited by 1,755
Users' Guides to the Medical Literature: IX. A Method for Grading Health Care Recommendations
Guyatt, G. H. (1995) · JAMA · doi:10.1001/jama.1995.03530220066035 · Cited by 846
Moher, D., Altman, D. G., Liberati, A., & Tetzlaff, J. (2011) · Epidemiology · doi:10.1097/ede.0b013e3181fe7825 · Cited by 627
Reproductive outcomes in women with congenital uterine anomalies: a systematic review
Chan, Y. Y., Jayaprakasan, K., Tan, A., Thornton, J. G., Coomarasamy, A., & Raine‐Fenning, N. J. (2011) · Ultrasound in Obstetrics & Gynecology · doi:10.1002/uog.10056 · Cited by 564
Kung, J. (2010) · The Open Dentistry Journal · doi:10.2174/1874210601004020084 · Cited by 329
Menke, J. (2010) · Radiology · doi:10.1148/radiol.10091938 · Cited by 319
Hudelist, G., English, J., Thomas, A. E., Tinelli, A., Singer, C. F., & Keckstein, J. (2011) · Ultrasound in Obstetrics & Gynecology · doi:10.1002/uog.8858 · Cited by 270
Dave, M., Elmunzer, B. J., Dwamena, B. A., & Higgins, P. D. R. (2010) · Radiology · doi:10.1148/radiol.10091953 · Cited by 265
Cited by
McInnes, M. D. F., Moher, D., Thombs, B. D., McGrath, T. A., Bossuyt, P. M., and the PRISMA-DTA Group, Clifford, T., Cohen, J. F., Deeks, J. J., Gatsonis, C., et al. (2018) · JAMA · doi:10.1001/jama.2017.19163 · Cited by 3,210
Self-citationPage, M. J., & Moher, D. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0663-8 · Cited by 769
Page, M. J., Shamseer, L., Altman, D. G., Tetzlaff, J., Sampson, M., Tricco, A. C., Catalá-López, F., Li, L., Reid, E. K., Sarkis-Onofre, R., et al. (2016) · PLOS Medicine · doi:10.1371/journal.pmed.1002028 · Cited by 768
“, physical therapy [14], complementary and alternative medicine [15], and radiology [16]).”
BackgroundSalameh, J.-P., Bossuyt, P. M., McGrath, T. A., Thombs, B. D., Hyde, C. J., Macaskill, P., Deeks, J. J., Leeflang, M., Korevaar, D. A., Whiting, P., et al. (2020) · BMJ · doi:10.1136/bmj.m2632 · Cited by 719
Self-citationThe Hong Kong Principles for assessing researchers: Fostering research integrity
Moher, D., Bouter, L., Kleinert, S., Glasziou, P., Sham, M. H., Barbour, V., Coriat, A.-M., Foeger, N., & Dirnagl, U. (2020) · PLOS Biology · doi:10.1371/journal.pbio.3000737 · Cited by 540
Metadata
- Authors
- Tunis, A. S., McInnes, M. D. F., Hanna, R., & Esmail, K.
- Venue
- Radiology
- Published
- 2013-11
- Volume
- 269
- Issue
- 2
- Pages
- 413-426
- ISSN
- 0033-8419 (ISSN-L)
- 1527-1315
- OpenAlex
- W2129089157
- Cited by
- 146
- References
- 10
- FWCI
- 3.33
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Association of Study Quality with Completeness of Reporting: Have Completeness of Reporting and Quality of Systematic Reviews and Meta-Analyses in Major Radiology Journals Changed Since Publication of the PRISMA Statement? https://app.cochat.ai/papers/10.1148/radiol.13130273
- The paper
- Tunis, A. S., McInnes, M. D. F., Hanna, R., & Esmail, K. (2013). Association of Study Quality with Completeness of Reporting: Have Completeness of Reporting and Quality of Systematic Reviews and Meta-Analyses in Major Radiology Journals Changed Since Publication of the PRISMA Statement? Radiology. https://doi.org/10.1148/radiol.13130273
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.