Evaluating complex interventions: Perspectives and issues for health behaviour change interventions
The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: Health behaviour change interventions (HBCIs), used in health education, health promotion, patient education and psychotherapy areas, are considered complex interventions. The objective of this article is to discuss the value and limitations of using randomised clinical trials (RCTs) to asses HBCIs. METHODS: A scoping review of the literature was conducted to identify the main challenges of using RCTs for evaluating HBCIs. The issues were illustrated by case studies selected from research conducted by our multidisciplinary team. RESULTS: In complex interventions, effects are produced not only by the intervention, but are strongly linked to context. Issues relating to transferability of results are therefore critical, and require adjustments to the RCT model. Sampling bias, biases related to the experimental conditions and biases due to the absence of double-blindness were examined and illustrated by case studies. CONCLUSION: The results underline the importance of a multidisciplinary approach. They call for adapted or alternative evaluation models that overcome the limitations of RCTs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Framework for design and evaluation of complex interventions to improve health
Campbell, M. (2000) · BMJ · doi:10.1136/bmj.321.7262.694 · Cited by 3,474 · cited 2×
“The areas of health education, health promotion, patient education and clinical health-care, including psychotherapies (Campbell et al., 2000) are among the most active in health behaviour change.”
Assessing Risk of Bias in Included Studies
Higgins, J. P., & Altman, D. G. (2008) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9780470712184.ch8 · Cited by 3,396 · cited 1×
“Biases that can occur during RCTs, e.g. selection, performance, attrition and detection biases are well documented, especially for clinical research (Higgins & Altman, 2008).”
A tutorial on pilot studies: the what, why and how
Thabane, L., Ma, J., Chu, R., Cheng, J., Ismaila, A., Rios, L. P., Robson, R., Thabane, M., Giangregorio, L., & Goldsmith, C. H. (2010) · BMC Medical Research Methodology · doi:10.1186/1471-2288-10-1 · Cited by 3,384
Relation of the therapeutic alliance with outcome and other variables: a meta-analytic review
Martin, D. J., Garske, J. P., & Davis, M. K. (2000) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.68.3.438 · Cited by 3,355
Rudd (2006) · doi:10.1002/(issn)1097-4679 · Cited by 2,635
Wood, L., Egger, M., Gluud, L. L., Schulz, K. F., Jüni, P., Altman, D. G., Gluud, C., Martin, R. M., Wood, A. J. G., & Sterne, J. A. C. (2008) · BMJ · doi:10.1136/bmj.39465.451748.ad · Cited by 2,538 · cited 2×
“In contrast, there was little evidence of bias in trials with objective outcomes (Wood et al., 2008).”
Mediators and Mechanisms of Change in Psychotherapy Research
Kazdin, A. E. (2007) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.3.022806.091432 · Cited by 2,504 · cited 2×
“Such evidence is consistent with clinicians ’ views (Kazdin, 2007) and patients ’ views (Johansson & Eklund, 2003) describing the therapeutic relationship as a key determinant of treatment success.”
Empirically supported psychological interventions: Controversies and evidence
Chambless, D. L., & Ollendick, T. H. (2001) · Annual Review of Psychology · doi:10.1146/annurev.psych.52.1.685 · Cited by 2,097
Process evaluation in randomised controlled trials of complex interventions
Oakley, A., Strange, V., Bonell, C., Allen, E., & Stephenson, J. (2006) · BMJ · doi:10.1136/bmj.332.7538.413 · Cited by 1,247 · cited 2×
“A first adjustment is that of process evaluation within RCTs (Oakley, Strange, Bonell, Allen, & Stephenson, 2006): the principle is not to disregard the trial, but rather to include an evaluation of the process within the experimental design, to understand the explanatory elements that may influence the outcome, such…”
Explanatory and pragmatic attitudes in therapeutical trials
Schwartz, D., & Lellouch, J. (1967) · Journal of Chronic Diseases · doi:10.1016/0021-9681(67)90041-0 · Cited by 1,185 · cited 1×
“…conditions: e.g. pragmatic RCTs designed to test the effectiveness of an intervention in routine clinical practice (Roland & Torgerson, 1998; Schwartz & Lellouch, 1967); the fully randomised preference design, developed to account for subject preference in open trials (Torgerson &…”
Evidence-Based Public Health: Moving Beyond Randomized Trials
Victora, C. G., Habicht, J.-P., & Bryce, J. (2004) · American Journal of Public Health · doi:10.2105/ajph.94.3.400 · Cited by 1,056 · cited 21×
“In most real-life situations, the dose received by the population is likely to be smaller than in any type of trial (Victora et al., 2004).”
InfluentialCriteria for evaluating evidence on public health interventions
Rychetnik, L., Frommer, M., Hawe, P., & Shiell, A. (2002) · Journal of Epidemiology and Community Health · doi:10.1136/jech.56.2.119 · Cited by 1,042
Blinding in randomised trials: hiding who got what
Schulz, K. F., & Grimes, D. A. (2002) · The Lancet · doi:10.1016/s0140-6736(02)07816-9 · Cited by 952
Shirk, S. R., & Karver, M. (2003) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.71.3.452 · Cited by 698 · cited 1×
“Meta-analysis of studies in both adult (Martin, Garske, & Davis, 2000) and child (Shirk & Karver, 2003) mental health research have shown a consistent association between measures of therapeutic alliance and treatment outcome, particularly when alliance is measured at early stages of treatment…”
Qualitative research in health care: Using qualitative methods in health related action research
Meyer, J. (2000) · BMJ · doi:10.1136/bmj.320.7228.178 · Cited by 596
Bonell, C., Fletcher, A., Morton, M., Lorenc, T., & Moore, L. (2012) · Social Science & Medicine · doi:10.1016/j.socscimed.2012.08.032 · Cited by 582 · cited 1×
“Recently Bonell, Fletcher, Morton, Lorenc, and Moore (2012) have proposed the concept of ‘ realistic randomized controlled trial ’ , to integrate the components of an intervention and their interactions into the evaluation.”
Patient preferences and randomised clinical trials.
Brewin, C. R., & Bradley, C. (1989) · BMJ · doi:10.1136/bmj.299.6694.313 · Cited by 503 · cited 1×
“(Brewin & Bradley, 1989; Torgerson & Torgerson, 2008).”
Designing Randomised Trials in Health, Education and the Social Sciences
Torgerson, D. J., & Torgerson, C. J. (2008) · doi:10.1057/9780230583993 · Cited by 366
Natural experiments: an underused tool for public health?
Petticrew, M., Cummins, S., Ferrell, C., Findlay, A., Higgins, C., Hoy, C., Kearns, A., & Sparks, L. (2005) · Public Health · doi:10.1016/j.puhe.2004.11.008 · Cited by 318 · cited 1×
“Thus, we are witnessing a paradigm shift in which observational studies (or natural experiments Petticrew et al., 2005) and quasi-experimental studies (where random assignment is lacking) are being considered based on their capacity to produce data under ‘ real-life ’ conditions (Campbell &…”
Klein, D. N., Schwartz, J. E., Santiago, N. J., Vivian, D., Vocisano, C., Castonguay, L. G., Arnow, B., Blalock, J. A., Manber, R., Markowitz, J. C., et al. (2003) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.71.6.997 · Cited by 264 · cited 2×
“These studies, as well as findings within trials (Klein et al., 2003), have also indicated the consistency of the alliance effect across different types of treatment.”
Henry, W. P., Schacht, T. E., Strupp, H. H., Butler, S. F., & Binder, J. L. (1993) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.61.3.441 · Cited by 204
Signs and Voices in psychotherapy
Stiles, W. B. (1999) · Psychotherapy Research · doi:10.1080/10503309912331332561 · Cited by 181 · cited 2×
“Its emergence reflects, rather, the appropriate use of other elements of the therapeutic process (Stiles, 1999).”
Bugge, C., Williams, B., Hagen, S., Logan, J., Glazener, C., Pringle, S., & Sinclair, L. (2013) · Trials · doi:10.1186/1745-6215-14-353 · Cited by 175 · cited 2×
“, 2004) so as to maximise the likelihood of delivering a definitive trial that is high in terms of both internal validity and external validity (Bugge et al., 2013).”
Cited by
Bishop, F. L., Fenge-Davies, A. L., Kirby, S., & Geraghty, A. W. A. (2015) · Psychology & Health · doi:10.1080/08870446.2014.953529 · Cited by 121
Elbers, S., van Gessel, C., Renes, R. J., van der Lugt, R., Wittink, H., & Hermsen, S. (2021) · Journal of Medical Internet Research · doi:10.2196/18462 · Cited by 47
“Consequently, theoretically sound interventions may be discarded due to insufficient attention to crucial translational factors such as low perceived utility by patients or health care providers (HCPs), inconvenient navigation, or a discrepancy between the intervention requirements and patients’ preferences [9-14].”
BackgroundEvans, K., Morrell, C. J., & Spiby, H. (2018) · Journal of Advanced Nursing · doi:10.1111/jan.13456 · Cited by 33
de Bruin, M. (2015) · Psychology & Health · doi:10.1080/08870446.2014.960653 · Cited by 36
Metadata
- Authors
- Tarquinio, C., Kivits, J., Minary, L., Coste, J., & Alla, F.
- Venue
- Psychology & Health
- Publisher
- Informa UK Limited
- Published
- 2014-10-21
- Volume
- 30
- Issue
- 1
- Pages
- 35-51
- ISSN
- 0887-0446 (ISSN-L)
- 1476-8321
- OpenAlex
- W1989248276
- Cited by
- 83
- References
- 23
- FWCI
- 13.36
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.