The DOI matches its Crossref record; 79 of the 80 references it cites were found in a registry or an index.
Intervention description is not enough: evidence from an in-depth multiple case study on the untold role and impact of context in randomised controlled trials of seven complex interventions
Open accessAbstract
BACKGROUND: A number of single case reports have suggested that the context within which intervention studies take place may challenge the assumptions that underpin randomised controlled trials (RCTs). However, the diverse ways in which context may challenge the central tenets of the RCT, and the degree to which this information is known to researchers or subsequently reported, has received much less attention. In this paper, we explore these issues by focusing on seven RCTs of interventions varying in type and degree of complexity, and across diverse contexts. METHODS: This in-depth multiple case study using interviews, focus groups and documentary analysis was conducted in two phases. In phase one, a RCT of a nurse-led intervention provided a single exploratory case and informed the design, sampling and data collection within the main study. Phase two consisted of a multiple explanatory case study covering a spectrum of trials of different types of complex intervention. A total of eighty-four data sources across the seven trials were accessed. RESULTS: We present consistent empirical evidence across all trials to indicate that four key elements of context (personal, organisational, trial and problem context) are crucial to understanding how a complex intervention works and to enable both assessments of internal validity and likely generalisability to other settings. The ways in which context challenged trial operation was often complex, idiosyncratic, and subtle; often falling outside of current trial reporting formats. However, information on such issues appeared to be available via first hand 'insider accounts' of each trial suggesting that improved reporting on the role of context is possible. CONCLUSIONS: Sufficient detail about context needs to be understood and reported in RCTs of complex interventions, in order for the transferability of complex interventions to be assessed. Improved reporting formats that require and encourage the clarification of both general and project-specific threats to the likely internal and external validity need to be developed. In addition, a cultural change is required in which the open and honest reporting of such issues is seen as an indicator of study strength and researcher integrity, rather than a symbol of a poor quality study or investigator ability.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“and therefore best explored using qualitative research.”
From Maximising the impact of qualitative research in feasibility studies for randomised controlled trials: guidance for researchers (2015) · cites this paper as [20]
In the citing paper
“The important role of context within complex intervention trials was highlighted in a recent study which found that contextual threats to trial conduct were often subtle, idiosyncratic and complex [20]”
From Maximising the impact of qualitative research in feasibility studies for randomised controlled trials: guidance for researchers (2015) · cites this paper as [20]
In the citing paper
“some researchers have rightly highlighted as a limitation the lack of diversity in the sampling process for their qualitative feasibility study [20].”
From Maximising the impact of qualitative research in feasibility studies for randomised controlled trials: guidance for researchers (2015) · cites this paper as [20]
In the citing paper
“The effectiveness of complex interventions, as well as their success in reaching all relevant target populations, is critically influenced by their implementation in a given context; indeed, effectiveness, implementation and context are inextricably linked [1, 2].”
From Making sense of complexity in context and implementation: the Context and Implementation of Complex Interventions (CICI) framework (2017) · cites this paper as [2]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1984) · Cited by 81,983
Case study research: design and methods
Phelan, S. (2011) · Evaluation & Research in Education · doi:10.1080/09500790.2011.582317 · Cited by 21,763
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
the CONSORT Group, Schulz, K. F., Altman, D. G., & Moher, D. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-18 · Cited by 13,371
Developing and evaluating complex interventions: the new Medical Research Council guidance
Craig, P., Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., & Petticrew, M. (2008) · BMJ · doi:10.1136/bmj.a1655 · Cited by 10,995
Methods for the thematic synthesis of qualitative research in systematic reviews
Thomas, J., & Harden, A. (2008) · BMC Medical Research Methodology · doi:10.1186/1471-2288-8-45 · Cited by 9,312
Qualitative research in health care: Analysing qualitative data
Pope, C. (2000) · BMJ · doi:10.1136/bmj.320.7227.114 · Cited by 8,131
Męcfal, S. (2012) · University of Lodz Repository (University of Łódź) · Cited by 6,617
Qualitative data analysis for applied policy research
(2002) · Analyzing Qualitative Data · doi:10.4324/9780203413081-14 · Cited by 4,964
Qualitative research in health care: Assessing quality in qualitative research
Mays, N. (2000) · BMJ · doi:10.1136/bmj.320.7226.50 · Cited by 3,742
Realist review - a new method of systematic review designed for complex policy interventions
Pawson, R., Greenhalgh, T., Harvey, G., & Walshe, K. (2005) · Journal of Health Services Research & Policy · doi:10.1258/1355819054308530 · Cited by 3,190 · cited 3×
“Pawson et al. (2005) describe interventions as ‘leaky’ [22], although they are based on particular theories and given particular titles, they are then ‘delivered in a mutating fashion shaped by refinement, reinvention and adaptation to local circumstances’ (p23).”
Research works printed but not linked: 2
- Medical Research Council: A framework for development and evaluation of RCTs for complex interventions to improve health. 2000, London: Medical Research Council
- Voigt-Radloff S, Graff M, Leonhart R, Hull M, Rikkert MO, Vernooij-Dassen M: Why did an effective Dutch complex psycho-social intervention for people with dementia not work in the German healthcare context? Lessons learnt from a process evaluation alongside a multicentre RCT. BMJ Open. 2011, 10.1136/bmjopen-2011-000094. · DOI
Cited by
Pfadenhauer, L. M., Gerhardus, A., Mozygemba, K., Lysdahl, K. B., Booth, A., Hofmann, B., Wahlster, P., Polus, S., Burns, J., Brereton, L., et al. (2017) · Implementation Science · doi:10.1186/s13012-017-0552-5 · Cited by 1,016
Interventions to improve the appropriate use of polypharmacy for older people
Patterson, S. M., Cadogan, C. A., Kerse, N., Cardwell, C. R., Bradley, M. C., Ryan, C., & Hughes, C. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd008165.pub3 · Cited by 754
Grant, A., Treweek, S., Dreischulte, T., Foy, R., & Guthrie, B. (2013) · Trials · doi:10.1186/1745-6215-14-15 · Cited by 541
Self-citationInterventions to improve the appropriate use of polypharmacy for older people
Rankin, A., Cadogan, C. A., Patterson, S. M., Kerse, N., Cardwell, C. R., Bradley, M. C., Ryan, C., & Hughes, C. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd008165.pub4 · Cited by 511
O’Cathain, A., Hoddinott, P., Lewin, S., Thomas, K. J., Young, B., Adamson, J., Jansen, Y. J., Mills, N., Moore, G., & Donovan, J. L. (2015) · Pilot and Feasibility Studies · doi:10.1186/s40814-015-0026-y · Cited by 458
“recent study which found that contextual threats to trial conduct were often subtle, idiosyncratic and complex [20],”
Metadata
- Authors
- Wells, M., Williams, B., Treweek, S., Coyle, J., & Taylor, J.
- Affiliations
- University of Dundee (GB)
- University of Stirling (GB)
- University of St Andrews (GB)
- Corresponding author
- Wells, Mary
- Venue
- Trials
- Published
- 2012-06-28
- Volume
- 13
- Issue
- 1
- Pages
- 95-95
- ISSN
- 1745-6215 (ISSN-L)
- PMC
- PMC3475073
- OpenAlex
- W2095751455
- Cited by
- 297
- References
- 80
- Citations by year
- 2026: 16 · 2025: 15 · 2024: 28 · 2023: 21 · 2022: 34 · 2021: 23 · 2020: 30 · 2019: 22 · 2018: 19 · 2017: 20 · 2016: 20 · 2015: 22 · 2014: 19 · 2013: 8
- FWCI
- 27.84
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Trials (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Aberdeen University Research Archive (Aberdeen University) (submittedVersion)
- Edinburgh Research Explorer (University of Edinburgh) (submittedVersion, other-oa)
- Discovery Research Portal (University of Dundee) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Stirling Online Research Repository (University of Stirling) (submittedVersion, cc-by)
- Research Output (Edinburgh Napier University) (submittedVersion, cc-by)
- University of Birmingham Research Portal (University of Birmingham) (submittedVersion, other-oa)
- Edinburgh Napier Research Repository (Edinburgh Napier University) (submittedVersion, cc-by)
- Spiral (Imperial College London) (submittedVersion, other-oa)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Keywords
- complex interventions, trial reporting, internal validity, generalizability, transferability, organizational context, personal context, problem context, insider account, nurse-led intervention, reporting guidelines
- MeSH terms
- Adaptation, Psychological, Attitude of Health Personnel, Cooperative Behavior, Humans, Health Knowledge, Attitudes, Practice, Organizational Objectives, Patient Care Team, Professional-Patient Relations, Research Design, Research Personnel, Reproducibility of Results, Randomized Controlled Trials as Topic, Treatment Outcome, Practice Guidelines as Topic, Evidence-Based Medicine, Guideline Adherence, Interdisciplinary Communication, Research Subjects
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Intervention description is not enough: evidence from an in-depth multiple case study on the untold role and impact of context in randomised controlled trials of seven complex interventions. https://app.cochat.ai/papers/10.1186/1745-6215-13-95
- The paper
- Wells, M., Williams, B., Treweek, S., Coyle, J., & Taylor, J. (2012). Intervention description is not enough: evidence from an in-depth multiple case study on the untold role and impact of context in randomised controlled trials of seven complex interventions. Trials. https://doi.org/10.1186/1745-6215-13-95
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.