Measurement of implementation components ten years after a nationwide introduction of empirically supported programs – a pilot study
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Ten years after the nationwide dissemination of two evidence-based treatment programs, the status of the implementation components was evaluated in a cross-sectional study. The aim of the study was to pilot a standardized measure of implementation components by examining the factor structure, the reliabilities of the scores, and their association with implementation outcome variables. The aim was also to compare implementation profiles of the two evidence-based programs based on multi informant assessments. METHODS: The 218 participants in the study were therapists, supervisors, and agency leaders working with Parent Management Training, the Oregon model (PMTO), and Multisystemic Therapy (MST) in Norway. Interviewers filled in an electronic version of the Implementation Components Questionnaire during a telephone interview. RESULTS: The factor analysis of the eight one-dimensional subscales resulted in an individual clinical-level factor and an organizational system-level factor. Age, experience, and number of colleagues in the workplace were negatively correlated with positive ratings of the implementation process, but the number of colleagues working with the same program predicted positive ratings. MST and PMTO had different implementation profiles and therapists, supervisors, and managers evaluated some of the implementation drivers significantly differently. CONCLUSIONS: The psychometric quality of the questionnaire was supported by measures of internal consistency, factor analyses of the implementation components, and the comparisons of implementation profiles between programs and respondent groups. A moderate, but consistent association in the expected direction was found with the implementation outcome variables.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Curran, P. J., West, S. G., & Finch, J. F. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.1.16 · Cited by 5,512
Durlak, J. A., & DuPre, E. P. (2008) · American Journal of Community Psychology · doi:10.1007/s10464-008-9165-0 · Cited by 5,304
The Challenge of Innovation Implementation
Klein, K. J., & Sorra, J. S. (1996) · The Academy of Management Review · doi:10.2307/259164 · Cited by 2,113 · cited 5×
“The implementation climate scale consists of 32 items that relate to the use of innovations in organizations and were adapted from the work of Klein and Sorra [2] and Panzano et al. [18].”
BackgroundMethodInfluentialProctor, E. K., Landsverk, J., Aarons, G., Chambers, D., Glisson, C., & Mittman, B. (2009) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-008-0197-4 · Cited by 1,894 · cited 4×
“Implementation outcomes may include the penetration of a program within an organization [6], the increase of productivity and competence, or changes in organizational structures or procedures within an organization.”
BackgroundResultInfluentialCore Implementation Components
Fixsen, D. L., Blase, K. A., Naoom, S. F., & Wallace, F. (2009) · Research on Social Work Practice · doi:10.1177/1049731509335549 · Cited by 1,103
Effectiveness, Transportability, and Dissemination of Interventions: What Matters When?
Schoenwald, S. K., & Hoagwood, K. (2001) · Psychiatric Services · doi:10.1176/appi.ps.52.9.1190 · Cited by 763 · cited 1×
“Similarly, the relationship between the ICQ measure and Treatment Adherence Measure Scores (TAM scores) [31] should also be examined.”
BackgroundShortell, S. M. (2004) · Medical Care Research and Review · doi:10.1177/1077558704266768 · Cited by 145 · cited 1×
“The factor analysis of seven of the eight subscales demonstrated a two-level factor structure of the implementation components, which is in line with the multi-level perspective discussed in the literature [6,15,16].”
Result
Cited by
Implementation Science: A Brief Overview and a Look Ahead
Ogden, T., & Fixsen, D. L. (2014) · Zeitschrift für Psychologie · doi:10.1027/2151-2604/a000160 · Cited by 296
Self-citationMultisystemic Therapy ® : Clinical Overview, Outcomes, and Implementation Research
Henggeler, S. W., & Schaeffer, C. M. (2016) · Family Process · doi:10.1111/famp.12232 · Cited by 149
Dopp, A. R., Coen, A. S., Smith, A. B., Reno, J., Bernstein, D. H., Kerns, S. E. U., & Altschul, D. (2018) · Behavior Therapy · doi:10.1016/j.beth.2017.12.003 · Cited by 33
Fidelity, not adaptation, is essential for implementation
Fixsen, D. L. (2025) · Frontiers in Health Services · doi:10.3389/frhs.2025.1575179 · Cited by 19
Classifying Changes to Preventive Interventions: Applying Adaptation Taxonomies
Roscoe, J. N., Shapiro, V. B., Whitaker, K., & Kim, B. K. E. (2019) · The Journal of Primary Prevention · doi:10.1007/s10935-018-00531-2 · Cited by 12
Metadata
- Authors
- Ogden, T., Bjørnebekk, G., Kjøbli, J., Patras, J., Christiansen, T., Taraldsen, K., & Tollefsen, N.
- Venue
- Implementation Science
- Published
- 2012-05-31
- Volume
- 7
- Issue
- 1
- Pages
- 49-49
- ISSN
- 1748-5908 (ISSN-L)
- OpenAlex
- W2165636429
- Cited by
- 55
- References
- 7
- FWCI
- 7.03
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Measurement of implementation components ten years after a nationwide introduction of empirically supported programs – a pilot study. https://app.cochat.ai/papers/10.1186/1748-5908-7-49
- The paper
- Ogden, T., Bjørnebekk, G., Kjøbli, J., Patras, J., Christiansen, T., Taraldsen, K., & Tollefsen, N. (2012). Measurement of implementation components ten years after a nationwide introduction of empirically supported programs – a pilot study. Implementation Science. https://doi.org/10.1186/1748-5908-7-49
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.