Applicability and generalisability of the results of systematic reviews to public health practice and policy: a systematic review
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
BACKGROUND: The purpose of the study was to evaluate systematic reviews of research into two public health priorities, tobacco consumption and HIV infection, in terms of the reporting of data related to the applicability of trial results (i.e., whether the results of a trial can be reasonably applied or generalized to a definable group of patients in a particular setting in routine practice, also called external validity or generalisability). METHODS: All systematic reviews of interventions aimed at reducing or stopping tobacco use and treating or preventing HIV infection published in the Cochrane database of systematic reviews and in journals indexed in MEDLINE between January 1997 and December 2007 were selected. We used a standardized data abstraction form to extract data related to applicability in terms of the context of the trial, (country, centres, settings), participants (recruitment, inclusion and exclusion criteria, baseline characteristics of participants such as age, sex, ethnicity, coexisting diseases or co-morbidities, and socioeconomic status), treatment (duration, intensity/dose of treatment, timing and delivery format), and the outcomes assessment from selected reviews. RESULTS: A total of 98 systematic reviews were selected (57 Cochrane reviews and 41 non-Cochrane reviews); 49 evaluated interventions aimed at reducing or stopping tobacco use and 49 treating or preventing HIV infection. The setting of the individual studies was reported in 45 (46%) of the systematic reviews, the number of centres in 21 (21%), and the country where the trial took place in 62 (63%). Inclusion and exclusion criteria of the included studies were reported in 16 (16%) and 13 (13%) of the reviews, respectively. Baseline characteristics of participants in the included studies were described in 59 (60%) of the reviews. These characteristics concerned age in about half of the reviews, sex in 46 (47%), and ethnicity in 9 (9%).Applicability of results was discussed in 13 (13%) of the systematic reviews. The reporting was better in systematic reviews by the Cochrane Collaboration than by non-Cochrane groups. CONCLUSIONS: Our study highlighted the lack of consideration of applicability of results in systematic reviews of research into 2 public health priorities: tobacco consumption and HIV infection.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
External validity of randomised controlled trials: “To whom do the results of this trial apply?”
Rothwell, P. M. (2005) · The Lancet · doi:10.1016/s0140-6736(04)17670-8 · Cited by 2,544 · cited 4×
“validity and the applicability of trial research is a multidimensional concept [4,16].”
BackgroundMethodInfluentialBoutron, I., Moher, D., Altman, D. G., Schulz, K. F., Ravaud, P., & for the CONSORT Group* (2008) · Annals of Internal Medicine · doi:10.7326/0003-4819-148-4-200802190-00008 · Cited by 2,292
Self-citationThe Hazards of Scoring the Quality of Clinical Trials for Meta-analysis
Jüni, P. (1999) · JAMA · doi:10.1001/jama.282.11.1054 · Cited by 1,981 · cited 1×
“Several methodological works have been published to allow for adequately understanding and assessing internal validity [5-10].”
BackgroundMoher, D., Jadad, A. R., Nichol, G., Penman, M., Tugwell, P., & Walsh, S. (1995) · Controlled Clinical Trials · doi:10.1016/0197-2456(94)00031-w · Cited by 1,308 · cited 1×
“Several methodological works have been published to allow for adequately understanding and assessing internal validity [5-10].”
BackgroundWhat is missing from descriptions of treatment in trials and reviews?
Glasziou, P., Meats, E., Heneghan, C., & Shepperd, S. (2008) · BMJ · doi:10.1136/bmj.39590.732037.47 · Cited by 614
Use of GRADE grid to reach decisions on clinical practice guidelines when consensus is elusive
Jaeschke, R., Guyatt, G. H., Dellinger, P., Schunemann, H., Levy, M. M., Kunz, R., Norris, S., Bion, J., & for the GRADE working group (2008) · BMJ · doi:10.1136/bmj.a744 · Cited by 577 · cited 1×
“Considering that applicability is essential for the developers of guidelines to grade the strength of recommendations, the Grading of Recommendations Assessment, Development and Evaluation (GRADE) system for grading the evidence of clinical guidelines clearly tackles this issue [40].”
BackgroundJadad, A. R., Cook, D. J., Jones, A., Klassen, T. P., Tugwell, P., Moher, M., & Moher, D. (1998) · JAMA · doi:10.1001/jama.280.3.278 · Cited by 534
Risk of bias versus quality assessment of randomised controlled trials: cross sectional study
Hartling, L., Ospina, M., Liang, Y., Dryden, D. M., Hooton, N., Krebs Seida, J., & Klassen, T. P. (2009) · BMJ · doi:10.1136/bmj.b4012 · Cited by 348 · cited 1×
“Recently, the Cochrane Collaboration developed a specific tool to appraise the internal validity of trial results included in systematic reviews, the Risk of Bias tool [11] and research is still being conducted in this field[12].”
MethodHow to assess the external validity of therapeutic trials: a conceptual approach
Dekkers, O. M., Elm, E. V., Algra, A., Romijn, J. A., & Vandenbroucke, J. P. (2010) · International Journal of Epidemiology · doi:10.1093/ije/dyp174 · Cited by 219
Behavior change intervention research in healthcare settings
Glasgow, R. E., Bull, S. S., Gillette, C., Klesges, L. M., & Dzewaltowski, D. A. (2002) · American Journal of Preventive Medicine · doi:10.1016/s0749-3797(02)00437-3 · Cited by 181
Cited by
Simera, I., Moher, D., Hirst, A., Hoey, J., Schulz, K. F., & Altman, D. G. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-24 · Cited by 590
Welch, V., Petticrew, M., Petkovic, J., Moher, D., Waters, E., White, H., Tugwell, P., Atun, R., Awasthi, S., Barbour, V., et al. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.09.001 · Cited by 297
He, J., Morales, D. R., & Guthrie, B. (2020) · Trials · doi:10.1186/s13063-020-4139-0 · Cited by 147
the PRISMA-Equity Bellagio group, Welch, V., Petticrew, M., Petkovic, J., Moher, D., Waters, E., White, H., & Tugwell, P. (2015) · International Journal for Equity in Health · doi:10.1186/s12939-015-0219-2 · Cited by 114
Caird, J., Sutcliffe, K., Kwan, I., Dickson, K., & Thomas, J. (2015) · Evidence & Policy · doi:10.1332/174426514x13988609036850 · Cited by 81
Metadata
- Authors
- Ahmad, N., Boutron, I., Dechartres, A., Durieux, P., & Ravaud, P.
- Venue
- Trials
- Published
- 2010-02-26
- Volume
- 11
- Issue
- 1
- Pages
- 20-20
- ISSN
- 1745-6215 (ISSN-L)
- OpenAlex
- W2099267253
- Cited by
- 53
- References
- 10
- FWCI
- 1.85
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Applicability and generalisability of the results of systematic reviews to public health practice and policy: a systematic review. https://app.cochat.ai/papers/10.1186/1745-6215-11-20
- The paper
- Ahmad, N., Boutron, I., Dechartres, A., Durieux, P., & Ravaud, P. (2010). Applicability and generalisability of the results of systematic reviews to public health practice and policy: a systematic review. Trials. https://doi.org/10.1186/1745-6215-11-20
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.