Evaluating the feasibility of complex interventions in mental health services: standardised measure and reporting guidelines
Open accessThe DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
Background: The feasibility of implementation is insufficiently considered in clinical guideline development, leading to human and financial resource wastage. Aims: To develop (a) an empirically based standardised measure of the feasibility of complex interventions for use within mental health services and (b) reporting guidelines to facilitate feasibility assessment. Method: A focused narrative review of studies assessing implementation blocks and enablers was conducted with thematic analysis and vote counting used to determine candidate items for the measure. Twenty purposively sampled studies (15 trial reports, 5 protocols) were included in the psychometric evaluation, spanning different interventions types. Cohen's kappa (κ) was calculated for interrater reliability and test–retest reliability. Results: In total, 95 influences on implementation were identified from 299 references. The final measure – Structured Assessment of FEasibility (SAFE) – comprises 16 items rated on a Likert scale. There was excellent interrater (κ = 0.84, 95% CI 0.79–0.89) and test–retest reliability (κ = 0.89, 95% CI 0.85–0.93). Cost information and training time were the two influences least likely to be reported in intervention papers. The SAFE reporting guidelines include 16 items organised into three categories (intervention, resource consequences, evaluation). Conclusions: A novel approach to evaluating interventions, SAFE, supplements efficacy and health economic evidence. The SAFE reporting guidelines will allow feasibility of an intervention to be systematically assessed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496
Making psychological theory useful for implementing evidence based practice: a consensus approach
Michie, S. (2005) · Quality and Safety in Health Care · doi:10.1136/qshc.2004.011155 · Cited by 3,440
Effectiveness and efficiency of guideline dissemination and implementation strategies
Grimshaw, J., Thomas, R., MacLennan, G., Fraser, C., Ramsay, C., Vale, L., Whitty, P., Eccles, M., Matowe, L., Shirran, L., et al. (2004) · Health Technology Assessment · doi:10.3310/hta8060 · Cited by 3,044
A conceptual framework for implementation fidelity
Carroll, C., Patterson, M., Wood, S., Booth, A., Rick, J., & Balain, S. (2007) · Implementation Science · doi:10.1186/1748-5908-2-40 · Cited by 2,559
Wiltsey Stirman, S., Kimberly, J., Cook, N., Calloway, A., Castro, F., & Charns, M. (2012) · Implementation Science · doi:10.1186/1748-5908-7-17 · Cited by 1,355
Planning and Studying Improvement in Patient Care: The Use of Theoretical Perspectives
GROL, R. P. T. M., BOSCH, M. C., HULSCHER, M. E. J. L., ECCLES, M. P., & WENSING, M. (2007) · The Milbank Quarterly · doi:10.1111/j.1468-0009.2007.00478.x · Cited by 943
Chaudoir, S. R., Dugan, A. G., & Barr, C. H. (2013) · Implementation Science · doi:10.1186/1748-5908-8-22 · Cited by 800
Hopewell, S., Ravaud, P., Baron, G., & Boutron, I. (2012) · BMJ · doi:10.1136/bmj.e4178 · Cited by 235
Michie, S., Pilling, S., Garety, P., Whitty, P., Eccles, M. P., Johnston, M., & Simmons, J. (2007) · Implementation Science · doi:10.1186/1748-5908-2-8 · Cited by 161
A framework and a measurement instrument for sustainability of work practices in long-term care
Slaghuis, S. S., Strating, M. M., Bal, R. A., & Nieboer, A. P. (2011) · BMC Health Services Research · doi:10.1186/1472-6963-11-314 · Cited by 71
Prevention, innovation and implementation science in mental health: the next wave of reform
McGorry, P. (2013) · British Journal of Psychiatry · doi:10.1192/bjp.bp.112.119222 · Cited by 56
Cited by
Iyadurai, L., Blackwell, S. E., Meiser-Stedman, R., Watson, P. C., Bonsall, M. B., Geddes, J. R., Nobre, A. C., & Holmes, E. A. (2018) · Molecular Psychiatry · doi:10.1038/mp.2017.23 · Cited by 266
Measuring implementation outcomes: An updated systematic review of measures’ psychometric properties
Mettert, K., Lewis, C., Dorsey, C., Halko, H., & Weiner, B. (2020) · Implementation Research and Practice · doi:10.1177/2633489520936644 · Cited by 162
Lewis-Fernández, R., Aggarwal, N. K., Lam, P. C., Galfalvy, H., Weiss, M. G., Kirmayer, L. J., Paralikar, V., Deshpande, S. N., Díaz, E., Nicasio, A. V., et al. (2017) · British Journal of Psychiatry · doi:10.1192/bjp.bp.116.193862 · Cited by 130
Development of the REFOCUS intervention to increase mental health team support for personal recovery
Slade, M., Bird, V., Boutillier, C. L., Farkas, M., Grey, B., Larsen, J., Leamy, M., Oades, L., & Williams, J. (2015) · British Journal of Psychiatry · doi:10.1192/bjp.bp.114.155978 · Cited by 47
Self-citationMarsiglia, F. F., Kulis, S. S., Cutrín, O., Medina-Mora, M. E., Real, T., Nuño-Gutiérrez, B. L., Corona, M. D., Mendoza-Meléndez, M. Á., Gresenz, K., & Alcala-Calvillo, D. (2022) · Prevention Science · doi:10.1007/s11121-022-01409-w · Cited by 7
Metadata
- Authors
- Bird, V. J., Boutillier, C. L., Leamy, M., Williams, J., Bradstreet, S., & Slade, M.
- Venue
- British Journal of Psychiatry
- Publisher
- Royal College of Psychiatrists
- Published
- 2014-04
- Volume
- 204
- Issue
- 4
- Pages
- 316-321
- ISSN
- 0007-1250 (ISSN-L)
- 1472-1465
- OpenAlex
- W2098086154
- Cited by
- 90
- References
- 11
- FWCI
- 5.53
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.