Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 54 of the 56 references it cites were found in a registry or an index; 70 of the 153 sources its claims cite were checked for support.

Optimisation of complex health interventions prior to a randomised controlled trial: a scoping review of strategies used

Open access

Abstract

BACKGROUND: Many complex intervention trials fail to show an intervention effect. Although this may be due to genuine ineffectiveness, it may also be the result of sub-optimal intervention design, implementation failure or a combination of these. Given current financial constraints and the pressure to reduce waste and increase value in health services research, pre-trial strategies are needed to reduce the likelihood of design or implementation failure and to maximise the intervention's potential for effectiveness. In this scoping review, we aimed to identify and synthesise the available evidence relating to the strategies and methods used to 'optimise' complex interventions at the pre-trial stage. METHODS: We searched MEDLINE, CINAHL, AMED, PsycINFO and ProQuest Nursing & Allied Health Source for papers published between January 2000 and March 2015. We included intervention development and optimisation studies that explored potential intervention weaknesses and limitations before moving to a definitive randomised controlled trial (RCT). Two reviewers independently applied selection criteria and systematically extracted information relating to the following: study characteristics; intervention under development; framework used to guide the development process; areas of focus of the optimisation process, methods used and outcomes of the optimisation process. Data were tabulated and summarised in a narrative format. RESULTS: We screened 3968 titles and 231 abstracts for eligibility. Eighty-nine full-text papers were retrieved; 27 studies met our selection criteria. Optimisation strategies were used for a range of reasons: to explore the feasibility and acceptability of the intervention to patients and healthcare professionals; to estimate the effectiveness and cost-effectiveness of different combinations of intervention components; and to identify potential barriers to implementation. Methods varied widely across studies, from interviews and focus groups to economic modelling and probability analysis. CONCLUSIONS: The review identifies a range of optimisation strategies currently used. Although a preliminary classification of these strategies can be proposed, a series of questions remain as to which methods to use for different interventions and how to determine when the intervention is ready or 'optimised enough' to be tested in a RCT. Future research should explore potential answers to the questions raised, to guide researchers in the development and evaluation of more effective interventions.

Overview

CoChat Summary

TL;DR

This scoping review maps pre-trial strategies used to optimise complex health interventions before a definitive RCT. It identifies 27 studies using varied methods, proposes a preliminary classification of optimisation strategies, and highlights unresolved questions about which methods to use and when an intervention is “optimised enough” to proceed.

Key findings

  • From 3968 titles, 231 abstracts and 89 full texts, 27 studies met inclusion criteria; most were from the UK (n = 19, 70.4%) and published from 2011 onwards (n = 17, 63.0%).
  • Optimisation focused on acceptability/feasibility to stakeholders in 14 studies, preliminary effect or long-term impact in 7 studies, and more than one element in 6 studies; methods ranged from interviews and focus groups to factorial experiments, economic modelling and probability analysis.
  • 17 of 27 studies used the MRC 2000 framework, the 2008 version or a combination; 2 used intervention mapping, 2 used MOST, 2 used intervention modelling, 1 used new mHealth guidelines, and the remaining studies did not specify a framework.
  • 16 studies refined the intervention and then tested it in pilot studies or full-scale RCTs; 2 studies were discouraged from moving to full-scale RCT because the intervention did not show expected potential effectiveness, and outcome data were unavailable for 2 studies.

Methods

  • Scoping review following Arksey and O’Malley’s iterative stages, with searches of MEDLINE, CINAHL, AMED, The Cochrane Methodology Register, PsycINFO and ProQuest Nursing & Allied Health Source for English-language papers published 1 January 2000 to 31 March 2015, plus hand-searching.
  • Included pre-trial intervention development, pilot or feasibility studies of complex multicomponent interventions that explicitly referred to optimisation or fitted the review’s definition; excluded complementary and alternative medicines, optimisation of trial parameters, conference abstracts/posters, study protocols and methodological papers with no empirical data.
  • Two reviewers independently applied selection criteria and extracted data; hierarchical task analysis was used to decompose each study by aim/area of focus, methods and outcome, with results summarised narratively.

Limitations

  • Stated by the authors: the scoping review does not aim to be exhaustive, and other optimisation strategies may exist that were not captured; terminology and core concepts around “optimisation” lack consensus.
  • Stated by the authors: not all included studies clearly reported optimisation objectives, the level of methodological detail varied widely, and there were conflicting reports about the added value of stakeholder involvement.
  • Evident from the text: no quality assessment of included studies was performed, consistent with the paper’s note that scoping reviews generally do not apply quality filters unless specified; the English-language and 2000–2015 limits may also restrict coverage.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1186/s40814-016-0058-y

Cites

54 of 54 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Fig. 1 Key phases of the main frameworks that currently provide guidance on conducting pre-trial testing. Shaded boxes indicate ‘optimisation’ stages. These frameworks have all been employed, to varying degrees, to define potential limitations and weaknesses of the intervention, in order to refine the intervention before moving to the trial stage.
Fig. 1 Key phases of the main frameworks that currently provide guidance on conducting pre-trial testing. Shaded boxes indicate ‘optimisation’ stages. These frameworks have all been employed, to varying degrees, to define potential limitations and weaknesses of the intervention, in order to refine the intervention before moving to the trial stage.CC BY · PubMed Central
Fig. 2 Iterative approach followed to conduct this scoping review
Fig. 2 Iterative approach followed to conduct this scoping reviewCC BY · PubMed Central
Fig. 3 Study flow diagram. (In asterisk) Duplicates between databases searched simultaneously were removed automatically, whereas further duplicates were retrieved manually
Fig. 3 Study flow diagram. (In asterisk) Duplicates between databases searched simultaneously were removed automatically, whereas further duplicates were retrieved manuallyCC BY · PubMed Central
Fig. 4 Representative examples of the HTA applied to Gray et al. [27]. Gray et al. [27] reported on the development and optimisation of the Football Fans in Training programme (p-FFIT), an intervention to help men lose weight, become more active and adopt healthier eating habits. In the programme development phase, an expert multidisciplinary group led the development of the pilot programme. The aim of the optimisation phase was to inform final modifications to the programme prior to full-scale evaluation. This phase involved a series of qualitative studies to explore the programme delivery from the viewpoints of both participants and coaches. These include participant feedback forms, participant focus groups, telephone or face-to-face interviews with non-completers, coach focus groups and interviews, a coach workshop and programme session observations. The coding frame was based on perceived acceptability/satisfaction, views on likely effectiveness of programme components and suggestions for changes. The process evaluation confirmed that the p-FFIT was highly acceptable to both participants and coaches. A number of potential areas for improvement were identified and, where possible, incorporated into the optimised FFIT intervention
Fig. 4 Representative examples of the HTA applied to Gray et al. [27]. Gray et al. [27] reported on the development and optimisation of the Football Fans in Training programme (p-FFIT), an intervention to help men lose weight, become more active and adopt healthier eating habits. In the programme development phase, an expert multidisciplinary group led the development of the pilot programme. The aim of the optimisation phase was to inform final modifications to the programme prior to full-scale evaluation. This phase involved a series of qualitative studies to explore the programme delivery from the viewpoints of both participants and coaches. These include participant feedback forms, participant focus groups, telephone or face-to-face interviews with non-completers, coach focus groups and interviews, a coach workshop and programme session observations. The coding frame was based on perceived acceptability/satisfaction, views on likely effectiveness of programme components and suggestions for changes. The process evaluation confirmed that the p-FFIT was highly acceptable to both participants and coaches. A number of potential areas for improvement were identified and, where possible, incorporated into the optimised FFIT interventionCC BY · PubMed Central

Verification

Claims the paper makes

18 Valid · 0 Not valid · 22 Not checked · 54 Own results and interpretations

34 more claims · 8 with their cited sources checked

Create a free account to see all 94 claims and to verify the 83 references still open.

See all claims — free account
  • It may state two separate claims as one. 33
  • Probably not a substantial claim. 37
  • The quote only partly states this claim. 1

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

4 more claims about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

2 of 2

Citations

Cites

Show all 56 references

Cited by

See all 101

Metadata

Authors
Levati, S., Campbell, P., Frost, R., Dougall, N., Wells, M., Donaldson, C., & Hagen, S.
Affiliations
  • Glasgow Caledonian University (GB)
  • University of Stirling (GB)
Corresponding author
Levati, Sara
Venue
Pilot and Feasibility Studies
Published
2016-03-15
Volume
2
Issue
1
Pages
17-17
ISSN
2055-5784 (ISSN-L)
OpenAlex
W2302517145
Cited by
101
References
56
Citations by year
2026: 4 · 2025: 8 · 2024: 7 · 2023: 10 · 2022: 11 · 2021: 12 · 2020: 20 · 2019: 14 · 2018: 11 · 2017: 3 · 2016: 1
FWCI
1.85
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Pilot and Feasibility Studies (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • ResearchOnline (Glasgow Caledonian University) (acceptedVersion, cc-by)
  • Edinburgh Napier Research Repository (Edinburgh Napier University) (submittedVersion, cc-by)
  • Stirling Online Research Repository (University of Stirling) (submittedVersion, cc-by)
  • UCL Discovery (University College London) (submittedVersion)
  • Research Output (Edinburgh Napier University) (submittedVersion, cc-by)
Topics
  • Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
  • Social Sciences › Sociology and Political Science › Delphi Technique in Research
  • Social Sciences › Public Administration › Evaluation and Performance Assessment
Keywords
complex interventions, intervention optimization, intervention design, implementation barriers, feasibility and acceptability, cost-effectiveness, intervention components, randomized controlled trials

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-09-30, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-09-30 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Optimisation of complex health interventions prior to a randomised controlled trial: a scoping review of strategies used. https://app.cochat.ai/papers/10.1186/s40814-016-0058-y
The paper
Levati, S., Campbell, P., Frost, R., Dougall, N., Wells, M., Donaldson, C., & Hagen, S. (2016). Optimisation of complex health interventions prior to a randomised controlled trial: a scoping review of strategies used. Pilot and Feasibility Studies. https://doi.org/10.1186/s40814-016-0058-y

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.