The use of rapid review methods in health technology assessments: 3 case studies
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Rapid reviews are of increasing importance within health technology assessment due to time and resource constraints. There are many rapid review methods available although there is little guidance as to the most suitable methods. We present three case studies employing differing methods to suit the evidence base for each review and outline some issues to consider when selecting an appropriate method. METHODS: Three recently completed systematic review short reports produced for the UK National Institute for Health Research were examined. Different approaches to rapid review methods were used in the three reports which were undertaken to inform the commissioning of services within the NHS and to inform future trial design. We describe the methods used, the reasoning behind the choice of methods and explore the strengths and weaknesses of each method. RESULTS: Rapid review methods were chosen to meet the needs of the review and each review had distinctly different challenges such as heterogeneity in terms of populations, interventions, comparators and outcome measures (PICO) and/or large numbers of relevant trials. All reviews included at least 10 randomised controlled trials (RCTs), each with numerous included outcomes. For the first case study (sexual health interventions), very diverse studies in terms of PICO were included. P-values and summary information only were presented due to substantial heterogeneity between studies and outcomes measured. For the second case study (premature ejaculation treatments), there were over 100 RCTs but also several existing systematic reviews. Data for meta-analyses were extracted directly from existing systematic reviews with new RCT data added where available. For the final case study (cannabis cessation therapies), studies included a wide range of interventions and considerable variation in study populations and outcomes. A brief summary of the key findings for each study was presented and narrative synthesis used to summarise results for each pair of interventions compared. CONCLUSIONS: Rapid review methods need to be chosen to meet both the nature of the evidence base of a review and the challenges presented by the included studies. Appropriate methods should be chosen after an assessment of the evidence base.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Evidence summaries: the evolution of a rapid review approach
Khangura, S., Konnyu, K., Cushman, R., Grimshaw, J., & Moher, D. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-10 · Cited by 1,232 · cited 2×
“views is potentially very useful [6] [8] and can save valuable time and resources.”
BackgroundExpediting systematic reviews: methods and implications of rapid reviews
Ganann, R., Ciliska, D., & Thomas, H. (2010) · Implementation Science · doi:10.1186/1748-5908-5-56 · Cited by 752
Watt, A., Cameron, A., Sturm, L., Lathlean, T., Babidge, W., Blamey, S., Facey, K., Hailey, D., Norderhaug, I., & Maddern, G. (2008) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462308080185 · Cited by 226 · cited 2×
“In addition, rapid reviews are less likely to use external experts and peer review and therefore they have potentially less scrutiny from clinical and methodological experts [4].”
BackgroundReviews: Rapid! Rapid! Rapid! …and systematic
Schünemann, H. J., & Moja, L. (2015) · Systematic Reviews · doi:10.1186/2046-4053-4-4 · Cited by 166 · cited 2×
“Schünemann HJ, Moja L. Reviews: Rapid!”
MethodRAPID VERSUS FULL SYSTEMATIC REVIEWS: VALIDITY IN CLINICAL PRACTICE?
Watt, A., Cameron, A., Sturm, L., Lathlean, T., Babidge, W., Blamey, S., Facey, K., Hailey, D., Norderhaug, I., & Maddern, G. (2008) · ANZ Journal of Surgery · doi:10.1111/j.1445-2197.2008.04730.x · Cited by 163 · cited 2×
“Reviews must be “fit for purpose” so that they reflect the knowledge needs of the commissioning body [10].”
BackgroundRAPID REVIEW: AN EMERGING APPROACH TO EVIDENCE SYNTHESIS IN HEALTH TECHNOLOGY ASSESSMENT
Khangura, S., Polisena, J., Clifford, T. J., Farrah, K., & Kamel, C. (2014) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462313000664 · Cited by 138 · cited 1×
“Rapid reviews are particularly important in the field of health technology assessment (HTA) where they are used to support informed decision making [7].”
BackgroundHarker, J., & Kleijnen, J. (2012) · International Journal of Evidence-Based Healthcare · doi:10.1111/j.1744-1609.2012.00290.x · Cited by 137 · cited 2×
“In addition, the limitations associated with the chosen rapid review approach are frequently not discussed [2].”
BackgroundHow to conduct systematic reviews more expeditiously?
Tsertsvadze, A., Chen, Y.-F., Moher, D., Sutcliffe, P., & McCarthy, N. (2015) · Systematic Reviews · doi:10.1186/s13643-015-0147-7 · Cited by 104
James, M. M.-S., Cooper, K., & Kaltenthaler, E. (2017) · Evidence and Policy · doi:10.1332/174426416x14726622176074 · Cited by 9
Self-citation
Cited by
Waffenschmidt, S., Knelangen, M., Sieben, W., Bühn, S., & Pieper, D. (2019) · BMC Medical Research Methodology · doi:10.1186/s12874-019-0782-0 · Cited by 626
The use of rapid review methods for the U.S. Preventive services task force
Patnode, C. D., Eder, M. L., Walsh, E. S., Viswanathan, M., & Lin, J. S. (2018) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2017.07.024 · Cited by 40
Griebler, U., Dobrescu, A., Ledinger, D., Klingenstein, P., Sommer, I., Emprechtinger, R., Persad, E., Gadinger, A., Trivella, M., Klerings, I., et al. (2023) · Research Synthesis Methods · doi:10.1002/jrsm.1656 · Cited by 5
“26,27 Others noted that there is no “ one size fits all ” for the use of RR methods 26 and proposed a flexible framework considering factors such as the available time.”
Method
Metadata
- Authors
- Kaltenthaler, E., Cooper, K., Pandor, A., Martyn-St. James, M., Chatters, R., & Wong, R.
- Venue
- BMC Medical Research Methodology
- Published
- 2016-08-26
- Volume
- 16
- Issue
- 1
- Pages
- 108-108
- ISSN
- 1471-2288 (ISSN-L)
- OpenAlex
- W2517024432
- Cited by
- 38
- References
- 9
- FWCI
- 4.89
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The use of rapid review methods in health technology assessments: 3 case studies. https://app.cochat.ai/papers/10.1186/s12874-016-0216-1
- The paper
- Kaltenthaler, E., Cooper, K., Pandor, A., Martyn-St. James, M., Chatters, R., & Wong, R. (2016). The use of rapid review methods in health technology assessments: 3 case studies. BMC Medical Research Methodology. https://doi.org/10.1186/s12874-016-0216-1
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.