The DOI matches its Crossref record; 14 of the 15 references it cites were found in a registry or an index.
Increasing the impact of randomized controlled trials: an example of a hybrid effectiveness–implementation design in psychotherapy research
Abstract
Randomized controlled trials (RCTs) are the gold standard for clinical research. However, significant delays between completion of RCTs and adoption of evidence-based practices into clinical settings remain. Engagement of stakeholders and implementation-focused outcomes to augment traditional RCTs hold the potential to increase the impact of RCT outcomes for clinical practice and more rapidly lead to the adoption of evidence-based practices in clinical settings. The purpose of this study is to discuss hybrid effectiveness–implementation designs and use a project example to highlight important methodological considerations to enhance the impact of RCTs. A hybrid effectiveness–implementation study assessed the effectiveness and implementation potential of brief cognitive behavioral therapy (bCBT) for rural Veterans. A patient-randomized trial (bCBT vs. enhanced usual care) explored the impact on depression symptoms. Implementation elements included engagement of stakeholders and a multifaceted provider training and support program to increase bCBT use by providers in Veterans Health Administration (VA) community-based outpatient clinics. Implementation outcomes included the number of providers who adopted bCBT, provider fidelity, and delivery outcomes (e.g., use of measurement-based care, treatment engagement, and completion). Hybrid designs offer opportunities to improve the alignment between research and practice, potentially improving dissemination of evidence-based interventions and reducing known delays in the translation from research to practice. Expansion of traditional RCTs through collaborative stakeholder contributions and stakeholder/consumer-informed implementation approaches is critical to improve adoption postproject. Although hybrid designs offer significant benefits related to generalizability and adoption, these approaches involve complex procedures and processes and often come at the cost of reduced internal study controls.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Thus, the purpose of a Hybrid Type 1 feasibility study is generally to inform the development or refinement of the implementation strategy rather than to test potential effects or mechanisms [22, 47].”
From Guidance for conducting feasibility and pilot studies for implementation trials (2020) · cites this paper as [22]
In the citing paper
“However, testing the implementation strategy on implementation outcomes may be a secondary aim in these trials and positioned as a pilot [22].”
From Guidance for conducting feasibility and pilot studies for implementation trials (2020) · cites this paper as [22]
In the citing paper
“As is the case for well conducted effectiveness trials, implementation trials often require partnerships with end-users and at times, the prioritisation of end-user needs over methods (e.g. random assignment) that seek to maximise internal validity [15, 22].”
From Guidance for conducting feasibility and pilot studies for implementation trials (2020) · cites this paper as [22]
Citations
Cites
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
(1998) · The Journal of Clinical Psychiatry · Cited by 19,139
Whiteford, H. A., Degenhardt, L., Rehm, J., Baxter, A. J., Ferrari, A. J., Erskine, H. E., Charlson, F. J., Norman, R. E., Flaxman, A. D., Johns, N., et al. (2013) · The Lancet · doi:10.1016/s0140-6736(13)61611-6 · Cited by 6,006
Audit and feedback: effects on professional practice and healthcare outcomes
Ivers, N., Jamtvedt, G., Flottorp, S., Young, J. M., Odgaard-Jensen, J., French, S. D., O'Brien, M. A., Johansen, M., Grimshaw, J., & Oxman, A. D. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000259.pub3 · Cited by 5,485
Curran, G. M., Bauer, M., Mittman, B., Pyne, J. M., & Stetler, C. (2012) · Medical Care · doi:10.1097/mlr.0b013e3182408812 · Cited by 4,058
Self-citationThe answer is 17 years, what is the question: understanding time lags in translational research
Morris, Z. S., Wooding, S., & Grant, J. (2011) · Journal of the Royal Society of Medicine · doi:10.1258/jrsm.2011.110180 · Cited by 3,340
Six-item screener to identify cognitive impairment among potential subjects for clinical research
Callahan, C. M., Unverzagt, F. W., Hui, S. L., Perkins, A. J., & Hendrie, H. C. (2002) · Medical Care · doi:10.1097/00005650-200209000-00007 · Cited by 1,499
Seventy-five trials and eleven systematic reviews a day: how will we ever keep up?
Bastian, H., Glasziou, P., & Chalmers, I. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000326 · Cited by 1,188
Glasgow, R. E., McKay, H. G., Piette, J. D., & Reynolds, K. D. (2001) · Patient Education and Counseling · doi:10.1016/s0738-3991(00)00186-5 · Cited by 648
A Guide for applying a revised version of the PARIHS framework for implementation
Stetler, C. B., Damschroder, L. J., Helfrich, C. D., & Hagedorn, H. J. (2011) · Implementation Science · doi:10.1186/1748-5908-6-99 · Cited by 402
Research works printed but not linked: 2
- Institute of Medicine Committee on Crossing the Quality Chasm: Adaptation to Mental Health and Addictive, D, 2006, The National Academies Collection: Reports funded by National Institutes of Health Improving the Quality of Health Care for Mental and Substance-Use Conditions: Quality Chasm Series
- Landsverk, 2012, Design and Analysis in Dissemination and Implementation Research Dissemination and Implementation Research in Health: Translating Science in Practice
Cited by
An introduction to effectiveness-implementation hybrid designs
Landes, S. J., McBain, S. A., & Curran, G. M. (2019) · Psychiatry Research · doi:10.1016/j.psychres.2019.112513 · Cited by 516
Self-citationGuidance for conducting feasibility and pilot studies for implementation trials
Pearson, N., Naylor, P.-J., Ashe, M. C., Fernandez, M., Yoong, S. L., & Wolfenden, L. (2020) · Pilot and Feasibility Studies · doi:10.1186/s40814-020-00634-w · Cited by 475
“random assignment) that seek to maximise internal validity [15, 22].”
BackgroundMethodReflections on 10 years of effectiveness-implementation hybrid studies
Curran, G. M., Landes, S. J., McBain, S. A., Pyne, J. M., Smith, J. D., Fernandez, M. E., Chambers, D. A., & Mittman, B. S. (2022) · Frontiers in Health Services · doi:10.3389/frhs.2022.1053496 · Cited by 299
“(10) discussed applications of hybrid studies in psychotherapy research.”
BackgroundSelf-citationReprint of: An introduction to effectiveness-implementation hybrid designs
Landes, S. J., McBain, S. A., & Curran, G. M. (2020) · Psychiatry Research · doi:10.1016/j.psychres.2019.112630 · Cited by 190
Self-citationYoong, S. L., Jones, J. Z., Pearson, N., Swindle, T., Barnes, C., Delaney, T. M., Lum, M., Golley, R. K., Matwiejczyk, L., Kelly, B., et al. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18052745 · Cited by 24
“Researchers currently employing such dual purpose designs can benefit from increasingly available literature, defining and describing Hybrid design methodology and reporting, allowing for greater consistency in use of terminology and easier identification of trials [105, 108-110].”
Method
Metadata
- Authors
- Johnson, A. L., Ecker, A. H., Fletcher, T. L., Hundt, N., Kauth, M. R., Martin, L. A., Curran, G. M., & Cully, J. A.
- Affiliations
- Baylor College of Medicine (US)
- Central Arkansas Veterans Healthcare System (US)
- Corresponding author
- Cully, Jeffrey A
- ORCID
- Venue
- Translational Behavioral Medicine
- Publisher
- Oxford University Press (OUP)
- Published
- 2018-11-26
- Volume
- 10
- Issue
- 3
- Pages
- 629-636
- ISSN
- 1613-9860 (ISSN-L)
- 1869-6716
- OpenAlex
- W2903350211
- Cited by
- 27
- References
- 15
- Citations by year
- 2026: 6 · 2025: 1 · 2024: 4 · 2023: 5 · 2022: 3 · 2021: 3 · 2020: 2 · 2019: 3
- FWCI
- 3.05
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Translational Behavioral Medicine (publishedVersion, public-domain)
- PubMed (publishedVersion)
- Funders
- Department of Veterans Affairs, Health Services Research and Development (IIR 13-315)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Health Sciences › Health Professions › General Health Professions › Mental Health and Patient Involvement
- Keywords
- randomized controlled trials, brief cognitive behavioral therapy, rural veterans, depression, stakeholder engagement, implementation outcomes, research-practice gap, evidence-based practice dissemination, measurement-based care
- MeSH terms
- Humans, Primary Health Care, Veterans, Cognitive Behavioral Therapy, Randomized Controlled Trials as Topic, Evidence-Based Practice
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Increasing the impact of randomized controlled trials: an example of a hybrid effectiveness–implementation design in psychotherapy research. https://app.cochat.ai/papers/10.1093/tbm/iby116
- The paper
- Johnson, A. L., Ecker, A. H., Fletcher, T. L., Hundt, N., Kauth, M. R., Martin, L. A., Curran, G. M., & Cully, J. A. (2020). Increasing the impact of randomized controlled trials: an example of a hybrid effectiveness–implementation design in psychotherapy research. Translational Behavioral Medicine. https://doi.org/10.1093/tbm/iby116
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.