Colliding ideals – an interview study of how intervention researchers address adherence and adaptations in replication studies
Open accessThe DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
Abstract
BACKGROUND: For an intervention to be considered evidence-based, findings need to be replicated. When this is done in new contexts (e.g., a new country), adaptations may be needed. Yet, we know little about how researchers approach this. This study aims to explore how researchers reason about adaptations and adherence when conducting replication studies, describe what adaptations they make and how these are reported in scientific journals. METHODS: This was an interview study conducted in 2014 with principal investigators of Swedish replication studies reporting adaptations to an intervention from another country. Studies (n = 36) were identified through a database of 139 Swedish psychosocial and psychological intervention studies. Twenty of the 21 principal investigators agreed to participate in semi-structured telephone interviews, covering 33 interventions. Manifest content analysis was used to identify types of adaptations, and qualitative content analysis was used to explore reasoning and reporting of adaptations and adherence. RESULTS: The most common adaptation was adding components and modifying the content to the target population and setting. When reasoning about adaptations and adherence, the researchers were influenced by four main factors: whether their implicit aim was to replicate or improve an intervention; the nature of evidence outlying the intervention such as manuals, theories and core components; the nature of the context, including approaches to cultural adaptations and constraints in delivering the intervention; and the needs of clients and professionals. Reporting of adaptations in scientific journals involved a conflict between transparency and practical concerns such as word count. CONCLUSIONS: Researchers responsible for replicating interventions in a new country face colliding ideals when trying to protect the internal validity of the study while considering adaptations to ensure that the intervention fits into the context. Implicit assumptions about the role of replication seemed to influence how this conflict was resolved. Some emphasised direct replications as central in the knowledge accumulation process (stressing adherence). Others assumed that interventions generally need to be improved, giving room for adaptations and reflecting an incremental approach to knowledge accumulation. This has implications for design and reporting of intervention studies as well as for how findings across studies are synthesised.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The process, nature, and outcomes of modifications to evidence-based programs/practices (EBPs) have often not been well documented, despite considerable recent interest in the field of implementation science [5, 6].”
From The FRAME: an expanded framework for reporting adaptations and modifications to evidence-based interventions (2019) · cites this paper as [5]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Rogers, E. M., Singhal, A., & Quinlan, M. M. (2019) · An Integrated Approach to Communication Theory and Research · doi:10.4324/9780203710753-35 · Cited by 37,322
Graneheim, U. H., & Lundman, B. (2004) · Nurse Education Today · doi:10.1016/j.nedt.2003.10.001 · Cited by 20,772 · cited 1×
“of adaptations, and qualitative content analysis with an inductive approach [26] was used to explore rea-”
MethodHoffmann, T. C., Glasziou, P. P., Boutron, I., Milne, R., Perera, R., Moher, D., Altman, D. G., Barbour, V., Macdonald, H., Johnston, M., et al. (2014) · BMJ · doi:10.1136/bmj.g1687 · Cited by 10,548 · cited 1×
“It also underlines the importance of describing interventions, contexts and adaptations in greater detail, as encouraged in recent reporting guidelines [48].”
BackgroundThe Logic of Scientific Discovery.
Hutchison, T. W., & Popper, K. R. (1959) · Economica · doi:10.2307/2550489 · Cited by 7,499
Stanton, B. F., & Rogers, E. M. (1963) · Journal of Farm Economics · doi:10.2307/1235767 · Cited by 6,675
KRISTOF‐BROWN, A. L., ZIMMERMAN, R. D., & JOHNSON, E. C. (2005) · Personnel Psychology · doi:10.1111/j.1744-6570.2005.00672.x · Cited by 4,082 · cited 1×
“, work processes) and people [46], and between interventions and organisation and its members [47], is also applicable in the context of intervention research.”
BackgroundCurran, G. M., Bauer, M., Mittman, B., Pyne, J. M., & Stetler, C. (2012) · Medical Care · doi:10.1097/mlr.0b013e3182408812 · Cited by 4,058
How should meta‐regression analyses be undertaken and interpreted?
Thompson, S. G., & Higgins, J. P. T. (2002) · Statistics in Medicine · doi:10.1002/sim.1187 · Cited by 3,026 · cited 1×
“analysis and mixed treatment comparisons [43].”
Mediators and Mechanisms of Change in Psychotherapy Research
Kazdin, A. E. (2007) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.3.022806.091432 · Cited by 2,504
The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change
Chambers, D. A., Glasgow, R. E., & Stange, K. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-117 · Cited by 1,724 · cited 1×
“In line with these findings, several researchers argue that adaptations are necessary at all steps of the research-to-practice pathway [21, 22].”
Result
Cited by
Wiltsey Stirman, S., Baumann, A. A., & Miller, C. J. (2019) · Implementation Science · doi:10.1186/s13012-019-0898-y · Cited by 1,329
von Thiele Schwarz, U., Aarons, G. A., & Hasson, H. (2019) · BMC Health Services Research · doi:10.1186/s12913-019-4668-y · Cited by 134
“It also includes showing that adaptation happens not only when EBIs are used in practice but also during trials, indicating that intervention researchers also needs to attend to issues related to fidelity and adaptation [27].”
BackgroundSelf-citationRichter, A., Sjunnestrand, M., Strandh, M. R., & Hasson, H. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19063489 · Cited by 197
Self-citationFrom replication to substantiation: A complexity theory perspective
Al‐Hoorie, A. H., Hiver, P. V., Larsen‐Freeman, D., & Lowie, W. M. (2021) · Language Teaching · doi:10.1017/s0261444821000409 · Cited by 47
“In replication of field experiments, there is a constant tension between adherence to and adaptation of experimental protocols (Bauman et al., 1991; Hansen, 2011; von Thiele Schwarz et al., 2018).”
Hill, J., Cuthel, A. M., Lin, P., & Grudzen, C. R. (2020) · Contemporary Clinical Trials Communications · doi:10.1016/j.conctc.2020.100570 · Cited by 28
“While monitoring intervention adaptations is important, its application is not a universal practice [31], and often applied retrospectively [32].”
Background
Metadata
- Authors
- von Thiele Schwarz, U., Förberg, U., Sundell, K., & Hasson, H.
- Affiliations
- Karolinska University Hospital (SE)
- Karolinska Institutet (SE)
- Region Stockholm (SE)
- Venue
- BMC Medical Research Methodology
- Published
- 2018-05-08
- Volume
- 18
- Issue
- 1
- Pages
- 36-36
- ISSN
- 1471-2288 (ISSN-L)
- PMC
- PMC5941334
- OpenAlex
- W2807297007
- Cited by
- 20
- References
- 56
- Citations by year
- 2026: 2 · 2025: 4 · 2023: 1 · 2022: 4 · 2021: 2 · 2020: 3 · 2019: 4
- FWCI
- 3.43
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0/ (tdm)
- Locations
- BMC Medical Research Methodology (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Forte: Swedish Research Council for Health, Working Life and Wellfare (2014-0303)
- Swedish National Research Council (2016-01261)
- Socialstyrelsen (-)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Keywords
- intervention replication, intervention adaptation, intervention adherence, evidence-based interventions, cross-cultural adaptation, transparency in research reporting, internal validity, psychosocial interventions, knowledge accumulation
- MeSH terms
- Adaptation, Psychological, Cross-Cultural Comparison, Humans, Interviews as Topic, Research Personnel, Biomedical Research, Evidence-Based Practice, Research Report
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Colliding ideals – an interview study of how intervention researchers address adherence and adaptations in replication studies. https://app.cochat.ai/papers/10.1186/s12874-018-0496-8
- The paper
- von Thiele Schwarz, U., Förberg, U., Sundell, K., & Hasson, H. (2018). Colliding ideals – an interview study of how intervention researchers address adherence and adaptations in replication studies. BMC Medical Research Methodology. https://doi.org/10.1186/s12874-018-0496-8
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
