Quality of conduct and reporting in rapid reviews: an exploration of compliance with PRISMA and AMSTAR guidelines
Open accessThe DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Rapid reviews are an accelerated evidence synthesis approach intended to meet the timely needs of decision-makers in healthcare settings. Quality of conduct and reporting has been described in the rapid review literature; however, no formal assessment has been carried out using available instruments. The objective of this study was to explore compliance with conduct and reporting guidelines in rapid reviews published or posted online during 2013 and 2014. METHODS: We performed a comprehensive literature search for rapid reviews using multiple bibliographic databases (e.g. PubMed, MEDLINE, EMBASE, the Cochrane Library) through December 31, 2014. Grey literature was searched thoroughly, and health technology assessment agencies were surveyed to identify additional rapid review products. Candidate reviews were assessed for inclusion using pre-specified eligibility criteria. Detailed data was collected from the included reviews on study and reporting characteristics and variables significant to rapid reviews (e.g. nomenclature, definition). We evaluated the quality of conduct and reporting of included rapid reviews using the A Measurement Tool to Assess Systematic Reviews (AMSTAR) and Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) checklists. Compliance with each checklist item was examined, and the sum of adequately reported items was used to describe overall compliance. Rapid reviews were stratified to explore differences in compliance related to publication status. The association between compliance and time to completion or length of publication was explored through univariate regression. RESULTS: Sixty-six rapid reviews were included. There were heterogeneous nomenclature, research questions and approaches to rapid reviews. Compliance with AMSTAR and PRISMA checklists was poor. Published rapid reviews were compliant with individual PRISMA items more often than unpublished reviews, but no difference was seen in AMSTAR item compliance overall. There was evidence of an association between length of publication and time to completion and the number of adequately reported PRISMA or AMSTAR items. CONCLUSIONS: Transparency and inadequate reporting are significant limitations of rapid reviews. Scientific editors, authors and producing agencies should ensure that the reporting of conduct and findings is accurate and complete. Further research may be warranted to explore reporting and conduct guidelines specific to rapid reviews and how these guidelines may be applied across the spectrum of rapid review approaches.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Shea, B. J., Hamel, C., Wells, G. A., Bouter, L. M., Kristjansson, E., Grimshaw, J., Henry, D. A., & Boers, M. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.10.009 · Cited by 1,755 · cited 1×
“The Preferred Reporting Items of Systematic Reviews and MetaAnalyses (PRISMA) statement and the A Measurement Tool to Assess Systematic Reviews (AMSTAR) checklist are reliable and practical instruments designed to help end-users discriminate between systematic reviews with a focus on quality of reporting and conduct […”
MethodEvidence summaries: the evolution of a rapid review approach
Khangura, S., Konnyu, K., Cushman, R., Grimshaw, J., & Moher, D. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-10 · Cited by 1,232 · cited 3×
“In many of the other included rapid reviews, eligibility criteria were expanded to consider more evidence when no studies of a certain type were located, an iterative process that is common in both systematic and rapid reviews [2, 9].”
BackgroundSelf-citationE-Mental Health: A Rapid Review of the Literature
Lal, S., & Adair, C. E. (2014) · Psychiatric Services · doi:10.1176/appi.ps.201300009 · Cited by 417 · cited 2×
“Following full-text review, 66 rapid reviews produced between 2013 and 2014 fulfilled our eligibility criteria and were included [12–77].”
BackgroundKung, J. (2010) · The Open Dentistry Journal · doi:10.2174/1874210601004020084 · Cited by 329 · cited 2×
“This tool was later assessed to have poor measurement properties compared to the original instrument in a sample of systematic reviews, so further research or revision may be required before investigation of its use can be considered [96, 97].”
MethodWatt, A., Cameron, A., Sturm, L., Lathlean, T., Babidge, W., Blamey, S., Facey, K., Hailey, D., Norderhaug, I., & Maddern, G. (2008) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462308080185 · Cited by 226 · cited 1×
“In line with the results of previous work, many of the identified studies did not report methods in sufficient detail [1, 3, 5], a problem not unique to rapid reviews [87].”
ResultBungay, H., & Vella-Burrows, T. (2013) · Perspectives in Public Health · doi:10.1177/1757913912466946 · Cited by 217 · cited 2×
“Thirtythree were journal-published [12–44] and 33 were unpublished [45–77] rapid reviews.”
BackgroundReviews: Rapid! Rapid! Rapid! …and systematic
Schünemann, H. J., & Moja, L. (2015) · Systematic Reviews · doi:10.1186/2046-4053-4-4 · Cited by 166 · cited 1×
“This is complicated further by the lack of an accepted or validated definition for rapid reviews, which results in the term ‘rapid review’ having different meanings to the assortment of stakeholders who produce or use them [2, 8].”
BackgroundRAPID VERSUS FULL SYSTEMATIC REVIEWS: VALIDITY IN CLINICAL PRACTICE?
Watt, A., Cameron, A., Sturm, L., Lathlean, T., Babidge, W., Blamey, S., Facey, K., Hailey, D., Norderhaug, I., & Maddern, G. (2008) · ANZ Journal of Surgery · doi:10.1111/j.1445-2197.2008.04730.x · Cited by 163 · cited 1×
“However, there are limited studies comparing the methods of rapid reviews to those of more fulsome systematic reviews [5, 98–100].”
BackgroundUsing Existing Systematic Reviews in Complex Systematic Reviews
Whitlock, E. P., Lin, J. S., Chou, R., Shekelle, P., & Robinson, K. A. (2008) · Annals of Internal Medicine · doi:10.7326/0003-4819-148-10-200805200-00010 · Cited by 144
Harker, J., & Kleijnen, J. (2012) · International Journal of Evidence-Based Healthcare · doi:10.1111/j.1744-1609.2012.00290.x · Cited by 137 · cited 3×
“Any or all of these components may be tailored or even omitted as part of the streamlining processes designed to expedite systematic review completion times [3] so were unable to ascertain whether the reporting omissions were attributable to the rapid review approach or simply poor reporting [88].”
BackgroundResult
Cited by
Page, M. J., & Moher, D. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0663-8 · Cited by 769
“Data on rapid review adherence to the PRISMA Statement [103] 1”
MethodSelf-citationHamel, C., Michaud, A., Thuku, M., Skidmore, B., Stevens, A., Nussbaumer-Streit, B., & Garritty, C. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.09.041 · Cited by 384
The economic burden of antibiotic resistance: A systematic review and meta-analysis
Poudel, A. N., Zhu, S., Cooper, N., Little, P., Tarrant, C., Hickman, M., & Yao, G. (2023) · PLOS ONE · doi:10.1371/journal.pone.0285170 · Cited by 264
Vukušić Rukavina, T., Viskić, J., Machala Poplašen, L., Relić, D., Marelić, M., Jokic, D., & Sedak, K. (2021) · Journal of Medical Internet Research · doi:10.2196/25770 · Cited by 199
The use of rapid review methods for the U.S. Preventive services task force
Patnode, C. D., Eder, M. L., Walsh, E. S., Viswanathan, M., & Lin, J. S. (2018) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2017.07.024 · Cited by 40
Metadata
- Authors
- Kelly, S. E., Moher, D., & Clifford, T. J.
- Venue
- Systematic Reviews
- Published
- 2016-05-10
- Volume
- 5
- Issue
- 1
- Pages
- 79-79
- ISSN
- 2046-4053 (ISSN-L)
- OpenAlex
- W2346281528
- Cited by
- 137
- References
- 13
- FWCI
- 9.17
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Quality of conduct and reporting in rapid reviews: an exploration of compliance with PRISMA and AMSTAR guidelines. https://app.cochat.ai/papers/10.1186/s13643-016-0258-9
- The paper
- Kelly, S. E., Moher, D., & Clifford, T. J. (2016). Quality of conduct and reporting in rapid reviews: an exploration of compliance with PRISMA and AMSTAR guidelines. Systematic Reviews. https://doi.org/10.1186/s13643-016-0258-9
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.