Assessment of generalisability in trials of health interventions: suggested framework and systematic review
Open accessThe DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
Most evaluations of new treatments use highly selected populations, making it difficult to decide whether they would work elsewhere. Systematic evaluation and reporting of applicability is required
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Moher, D., Schulz, K. F., & Altman, D. G. (2001) · The Lancet · doi:10.1016/s0140-6736(00)04337-3 · Cited by 5,373
Framework for design and evaluation of complex interventions to improve health
Campbell, M. (2000) · BMJ · doi:10.1136/bmj.321.7262.694 · Cited by 3,474
Realist review - a new method of systematic review designed for complex policy interventions
Pawson, R., Greenhalgh, T., Harvey, G., & Walshe, K. (2005) · Journal of Health Services Research & Policy · doi:10.1258/1355819054308530 · Cited by 3,190
Process evaluation in randomised controlled trials of complex interventions
Oakley, A., Strange, V., Bonell, C., Allen, E., & Stephenson, J. (2006) · BMJ · doi:10.1136/bmj.332.7538.413 · Cited by 1,247
Self-citation
Cited by
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gotzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · BMJ · doi:10.1136/bmj.c869 · Cited by 8,883
“Frameworks for the evaluation of external validity have been proposed, including qualitative studies, such as in integral ‘‘process evaluations’’[270] and checklists.”
MethodProcess evaluation of complex interventions: Medical Research Council guidance
Moore, G. F., Audrey, S., Barker, M., Bond, L., Bonell, C., Hardeman, W., Moore, L., O'Cathain, A., Tinati, T., Wight, D., et al. (2015) · BMJ · doi:10.1136/bmj.h1258 · Cited by 6,204
Self-citationMoher, D., Hopewell, S., Schulz, K. F., Montori, V., Gøtzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2012) · International Journal of Surgery · doi:10.1016/j.ijsu.2011.10.001 · Cited by 2,345
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gøtzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.03.004 · Cited by 1,858
Identifying and Avoiding Bias in Research
Pannucci, C. J., & Wilkins, E. G. (2010) · Plastic and Reconstructive Surgery · doi:10.1097/prs.0b013e3181de24bc · Cited by 1,079
Bonell, C., Fletcher, A., Morton, M., Lorenc, T., & Moore, L. (2012) · Social Science & Medicine · doi:10.1016/j.socscimed.2012.08.032 · Cited by 582
“Second, complex interventions interact with context, meaning that their effectiveness will be dependent upon factors such as socio-economic and environmental conditions, organisational readiness, policy context, target population (Bonell et al., 2006).”
BackgroundSelf-citationGrant, A., Treweek, S., Dreischulte, T., Foy, R., & Guthrie, B. (2013) · Trials · doi:10.1186/1745-6215-14-15 · Cited by 541
“terature on process evaluation and the RE-AIM framework [3,11,19,23,26,27,31], and on published process evaluations”
BackgroundMethodMichelson, D., Davenport, C., Dretzke, J., Barlow, J., & Day, C. (2013) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-013-0128-0 · Cited by 292
Gardner, F., Montgomery, P., & Knerr, W. (2016) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2015.1015134 · Cited by 290
Harden, A., Brunton, G., Fletcher, A., & Oakley, A. (2009) · BMJ · doi:10.1136/bmj.b4254 · Cited by 268
Self-citationInternal and external validity of cluster randomised trials: systematic review of recent trials
Eldridge, S., Ashby, D., Bennett, C., Wakelin, M., & Feder, G. (2008) · BMJ · doi:10.1136/bmj.39517.495764.25 · Cited by 224
Bonell, C. P., Hargreaves, J., Cousens, S., Ross, D., Hayes, R., Petticrew, M., & Kirkwood, B. R. (2011) · Journal of Epidemiology and Community Health · doi:10.1136/jech.2008.082602 · Cited by 223
Self-citationEffectiveness of pharmacist intervention for asthma control improvement
Mehuys, E., Van Bortel, L., De Bolle, L., Van Tongelen, I., Annemans, L., Remon, J. P., & Brusselle, G. (2008) · European Respiratory Journal · doi:10.1183/09031936.00112007 · Cited by 218
“Moreover, the random selection of the pharmacies participating in the present study, and the community-based patient selection using fairly straightforward inclusion criteria also pleads for the generalisability of the study results [ 35 ].”
ResultBonell, C., Jamal, F., Harden, A., Wells, H., Parry, W., Fletcher, A., Petticrew, M., Thomas, J., Whitehead, M., Campbell, R., et al. (2013) · Public Health Research · doi:10.3310/phr01010 · Cited by 192
Self-citationGrant, S. P., Mayo-Wilson, E., Melendez-Torres, G. J., & Montgomery, P. (2013) · PLoS ONE · doi:10.1371/journal.pone.0065442 · Cited by 111
“For example, the CONSORT Statement and its extensions have primarily focused on standards related to internal validity, but researchers are increasingly interested in the applicability of trial findings and have called for updated standards to improve the assessment of external validity.[14,15,16,17,18,19] For example…”
BackgroundMethodInfluentialCheng, Q., Xu, B., Ng, M. S. N., Duan, Y., & So, W. K. W. (2022) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2021.104162 · Cited by 83
Utilization patterns and user characteristics of an ad libitum Internet weight loss program
Binks, M., & van Mierlo, T. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1347 · Cited by 52
Warren, E., Melendez-Torres, G. J., Viner, R., & Bonell, C. (2020) · Trials · doi:10.1186/s13063-020-04688-2 · Cited by 32
Self-citationBonell, C., Prost, A., Melendez-Torres, G. J., Davey, C., & Hargreaves, J. R. (2021) · Journal of Epidemiology and Community Health · doi:10.1136/jech-2020-214287 · Cited by 24
Self-citation
Metadata
- Authors
- Bonell, C., Oakley, A., Hargreaves, J., Strange, V, & Rees, R.
- Venue
- BMJ
- Publisher
- BMJ
- Published
- 2006-08-10
- Volume
- 333
- Issue
- 7563
- Pages
- 346-349
- ISSN
- 0007-1447 (ISSN-L)
- 0959-8138
- 1468-5833
- OpenAlex
- W1975205242
- Cited by
- 165
- References
- 4
- FWCI
- 3.58
- Type
- journal article
- Language
- en
- Open access
- bronze
- Licence
- www.bmj.org/licenses/tdm/1.0/terms-and-conditions.html (tdm)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.