Applicability and Clinical Relevance of Results in Randomized Controlled Trials: The Cochrane Review on Exercise Therapy for Low Back Pain as an Example
Open accessThe DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
Abstract
In Brief Study Design. A critical appraisal of the literature. Objectives. To increase awareness of the importance of applicability and clinical relevance of the results of randomized controlled trials (RCTs) in the field of spinal disorders by formulating a list of items for assessment of applicability and clinical relevance of results of RCTs. Summary of Background Data. In systematic reviews of randomized controlled trials (RCTs), critical appraisal of methodologic quality is considered important. Less attention has been paid to the assessment of the applicability and the clinical relevance of the results. Methods. RCTs in an update of the Cochrane review on exercise therapy for low back pain were used. Most of the trials did not score positively on the five Cochrane Back Review Group basic items describing patients: intervention and setting, outcome, effect size, and benefits related to adverse effects. Item 1 was met by 88% of the trials, but item 2 only by 51%, item 3 by 67%, item 4 by 35%, and item 5 by 0%. Subsequently, a more comprehensive list of items for the assessment of applicability and clinical relevance of results of RCTs was developed. These criteria were pilot tested on the RCTs. After pilot testing and a subsequent consensus meeting, the list of items was drafted and circulated among the members of the Editorial Board of the Cochrane Back Review Group. Changes were made in response to comments. Results. The final list consists of 40 items. The items are ordered on two headings: Does the report enable the assessment of applicability? Are the study results clinically relevant? We present examples of informative and noninformative reporting of RCTs in order to illustrate how information on applicability and clinical relevance of results can be assessed. Conclusions. Authors of RCTs should adequately report on items that are essential to assess the applicability and clinical relevance of results. The presented list of items may help clinicians reading RCTs and authors of systematic reviews to draw more balanced conclusions on applicability and clinical relevance of results. It is essential for readers to be able to assess the most important items related to the applicability (generalizability) and clinical relevance of results of randomized controlled trials (RCTs). This paper presents a method on how to improve the assessment of these features of RCTs. Authors writing a manuscript of an RCT or clinicians reading these papers may use the list of items, and they may also be helpful for researchers and editors reviewing manuscripts.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Meta-Analysis: Exercise Therapy for Nonspecific Low Back Pain
Hayden, J. A., van Tulder, M. W., Malmivaara, A. V., & Koes, B. W. (2005) · Annals of Internal Medicine · doi:10.7326/0003-4819-142-9-200505030-00013 · Cited by 611 · cited 2×
“These final items are explained below with examples of informative and noninformative reporting in trials included in the update of the Cochrane systematic review on exercise therapy for low back pain.(4) We have picked the examples for illustration purposes only.”
BackgroundMethodSelf-citation
Cited by
2009 updated method guidelines for systematic reviews in the Cochrane Back Review Group
Furlan, A. D., Pennick, V., Bombardier, C., & van Tulder, M. (2009) · Spine · doi:10.1097/brs.0b013e3181b1c99f · Cited by 1,663
Behavioural treatment for chronic low-back pain
Henschke, N., Ostelo, R. W., van Tulder, M. W., Vlaeyen, J. W., Morley, S., Assendelft, W. J., & Main, C. J. (2010) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002014.pub3 · Cited by 718
Multidisciplinary treatment for chronic pain: a systematic review of interventions and outcomes
Scascighini, L., Toma, V., Dober-Spielmann, S., & Sprott, H. (2008) · Rheumatology · doi:10.1093/rheumatology/ken021 · Cited by 613
Schünemann, H. J., Tugwell, P., Reeves, B. C., Akl, E. A., Santesso, N., Spencer, F. A., Shea, B., Wells, G., & Helfand, M. (2013) · Research Synthesis Methods · doi:10.1002/jrsm.1078 · Cited by 248
“Elements of this framework have been described by various authors but in a limited fashion and without reference to the PICO approach (Malmivaara et al., 2006; Rothwell, 2005).”
BackgroundMethodBell, J. A., & Burnett, A. (2009) · Journal of Occupational Rehabilitation · doi:10.1007/s10926-009-9164-5 · Cited by 159
Metadata
- Authors
- Malmivaara, A., Koes, B. W., Bouter, L. M., & van Tulder, M. W.
- Venue
- Spine
- Published
- 2006-06
- Volume
- 31
- Issue
- 13
- Pages
- 1405-1409
- ISSN
- 0362-2436 (ISSN-L)
- OpenAlex
- W1967364512
- Cited by
- 56
- References
- 1
- FWCI
- 6.77
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Applicability and Clinical Relevance of Results in Randomized Controlled Trials: The Cochrane Review on Exercise Therapy for Low Back Pain as an Example. https://app.cochat.ai/papers/10.1097/01.brs.0000219868.30427.66
- The paper
- Malmivaara, A., Koes, B. W., Bouter, L. M., & van Tulder, M. W. (2006). Applicability and Clinical Relevance of Results in Randomized Controlled Trials: The Cochrane Review on Exercise Therapy for Low Back Pain as an Example. Spine. https://doi.org/10.1097/01.brs.0000219868.30427.66
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.