The DOI matches its Crossref record; 140 of the 143 references it cites were found in a registry or an index.
Protocol: Adaptive Implementation of Effective Programs Trial (ADEPT): cluster randomized SMART trial comparing a standard versus enhanced implementation strategy to improve outcomes of a mood disorders program
Open accessAbstract
BACKGROUND: Despite the availability of psychosocial evidence-based practices (EBPs), treatment and outcomes for persons with mental disorders remain suboptimal. Replicating Effective Programs (REP), an effective implementation strategy, still resulted in less than half of sites using an EBP. The primary aim of this cluster randomized trial is to determine, among sites not initially responding to REP, the effect of adaptive implementation strategies that begin with an External Facilitator (EF) or with an External Facilitator plus an Internal Facilitator (IF) on improved EBP use and patient outcomes in 12 months. METHODS/DESIGN: This study employs a sequential multiple assignment randomized trial (SMART) design to build an adaptive implementation strategy. The EBP to be implemented is life goals (LG) for patients with mood disorders across 80 community-based outpatient clinics (N = 1,600 patients) from different U.S. regions. Sites not initially responding to REP (defined as < 50% patients receiving ≥ 3 EBP sessions) will be randomized to receive additional support from an EF or both EF/IF. Additionally, sites randomized to EF and still not responsive will be randomized to continue with EF alone or to receive EF/IF. The EF provides technical expertise in adapting LG in routine practice, whereas the on-site IF has direct reporting relationships to site leadership to support LG use in routine practice. The primary outcome is mental health-related quality of life; secondary outcomes include receipt of LG sessions, mood symptoms, implementation costs, and organizational change. DISCUSSION: This study design will determine whether an off-site EF alone versus the addition of an on-site IF improves EBP uptake and patient outcomes among sites that do not respond initially to REP. It will also examine the value of delaying the provision of EF/IF for sites that continue to not respond despite EF. TRIAL REGISTRATION: ClinicalTrials.gov identifier: NCT02151331.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In a subsequent study, Kilbourne et al. (2014) are using SMART to examine an adaptive version of REP (64).”
From An Overview of Research and Evaluation Designs for Dissemination and Implementation (2017) · cites this paper as [64]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
Self-efficacy: Toward a unifying theory of behavioral change
Bandura, A. (1977) · Psychological Review · doi:10.1037/0033-295x.84.2.191 · Cited by 43,925
Rogers, E. M., Singhal, A., & Quinlan, M. M. (2019) · Routledge eBooks · doi:10.4324/9780203710753-35 · Cited by 37,670
A Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7
Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.10.1092 · Cited by 31,765
Kytle, J., & Bandura, A. (1978) · Contemporary Sociology · doi:10.2307/2065952 · Cited by 25,422
Valente, T. W. (2003) · Genetics in Medicine · doi:10.1097/01.gim.0000061743.67794.c4 · Cited by 20,559
(1985) · Medical Entomology and Zoology · Cited by 19,180
WARE, J. E., KOSINSKI, M., & KELLER, S. D. (1996) · Medical Care · doi:10.1097/00005650-199603000-00003 · Cited by 17,392
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496
Health Behavior and Health Education: Theory, Research, and Practice
(1992) · Annals of Internal Medicine · doi:10.7326/0003-4819-116-4-350_1 · Cited by 13,232
Research works printed but not linked: 1
- Chyba MM, Washington LR: Questionnaires from the National Health Interview Survey, 1985-89. Vital Health Stat Ser. 1993, 1: 1-412.
Cited by
Sorted by citations
Items 101–130 of 130
Kirchner, J. E., Dollar, K. M., Smith, J. L., Pitcock, J. A., Curtis, N. D., Morris, K. K., Fletcher, T. L., & Toper, D. R. (2020) · doi:10.21203/rs.3.rs-60193/v1 · Cited by 2
Self-citationA Pilot Study Comparing Tools for Tracking Implementation Strategies and Treatment AdaptationsPreprint
Walsh‐Bailey, C., Palazzo, L. G., Jones, S. M. W., Mettert, K. D., Powell, B. J., Stirman, S. W., Lyon, A. R., Rohde, P., & Lewis, C. C. (2020) · doi:10.21203/rs.2.20638/v1 · Cited by 2
A Pilot Study Comparing Tools for Tracking Implementation Strategies and Treatment AdaptationsPreprint
Walsh‐Bailey, C., Palazzo, L. G., Jones, S. M. W., Mettert, K. D., Powell, B. J., Stirman, S. W., Lyon, A. R., Rohde, P., & Lewis, C. C. (2020) · doi:10.21203/rs.2.22628/v1 · Cited by 2
Freeman, N. L. B., Browder, S. E., Rowland, B., Jones, E. P., Hoch, M., Kim, A., Zhou, C. W., Kahkoska, A. R., McGinigle, K. L., Ivanova, A., et al. (2025) · medRxiv · doi:10.1101/2025.06.06.25329149 · Cited by 2
Siegle, A., zu Sayn-Wittgenstein-Hohenstein, F., & Roes, M. (2020) · Implementation Science · doi:10.1186/s13012-020-01033-8 · Cited by 2
Leonard, C., Carey, E., Holstein, A., Ho, P. M., & Heckman, J. T. (2024) · Implementation Science · doi:10.1186/s13012-023-01329-5 · Cited by 2
Köberlein–Neu, J., & Söling, S. (2024) · Springer eBooks · doi:10.1007/978-3-658-43860-9_22 · Cited by 1
O’Grady, M. A., Kapoor, S., Harrison, L., Kwon, N. S., Suleiman, A. O., & Muench, F. J. (2022) · Implementation Science Communications · doi:10.1186/s43058-022-00333-y · Cited by 1
Smith, S. N., Almirall, D., Choi, S. Y., Andrews, C. M., Koschmann, E., Rusch, A., Bilek, E. L., Lane, A., Abelson, J. L., Eisenberg, D., et al. (2024) · Journal of Affective Disorders · doi:10.1016/j.jad.2024.08.048 · Cited by 2
Self-citationMoniz, M. H., Kilbourne, A. M., Peahl, A. F., Waljee, J. F., Cocroft, S., Simpson, C., Low, L. K., Bicket, M. C., Englesbe, M. J., Stout, M. J., et al. (2025) · Frontiers in Global Women s Health · doi:10.3389/fgwh.2025.1504511 · Cited by 1
Self-citationEgesa, I. J., Bonnett, L. J., Emsley, R., Marson, A. G., & Smith, C. T. (2025) · Clinical Trials · doi:10.1177/17407745251385535 · Cited by 1
Sequential, Multiple Assignment, Randomized Trials (SMART)
Seewald, N. J., Hackworth, O., & Almirall, D. (2022) · Springer eBooks · doi:10.1007/978-3-319-52636-2_280 · Cited by 1
Self-citationComparison of Dynamic Treatment Regimes with An Ordinal OutcomePreprint
Ghosh, P., & Chakraborty, B. (2018) · arXiv (Cornell University) · Cited by 1
Health services for health promotion and disease prevention
Smith, J., & Mapstone, J. (2020) · Oxford University Press eBooks · doi:10.1093/oso/9780198837206.003.0013
Nealy, Z. B. (2025) · Elsevier eBooks · doi:10.1016/b978-0-323-91790-2.00041-1
Eisman, A. B., Koffkey, C., Fridline, J., Harvey, C., Hasson, R. E., Palinkas, L. A., & Kilbourne, A. M. (2025) · Implementation Research and Practice · doi:10.1177/26334895251330520 · Cited by 1
Self-citationYuan, C. T., Wang, N., Fink, T., Almirall, D., Appel, L. J., Cook, C., Cooper, L. A., Dalcin, A., Gennusa, J. V., Goldsholl, S., et al. (2025) · Implementation Science · doi:10.1186/s13012-025-01461-4
Self-citationDias, E., Padilla, J. R., Cuccaro, P. M., Walker, T. J., Balasubramanian, B. A., Savas, L. S., Valerio-Shewmaker, M. A., Chenier, R. S., & Fernandez, M. E. (2024) · Figshare · doi:10.6084/m9.figshare.26747846
Ford, J. H., Cheng, H. L., Gassman, M., Fontaine, H., Garneau, H. C., Keith, R., Michael, E., & McGovern, M. P. (2022) · Figshare · doi:10.6084/m9.figshare.21249591
Huebschmann, A. G., Wagner, N. M., Gleason, M. C., Brinton, J. T., Brtnikova, M., Brewer, S. E., Begum, A., Armstrong, R., DeCamp, L. R., McFarlane, A. E., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26761710
Smith, S. N., Almirall, D., Choi, S. Y., Koschmann, E., Rusch, A., Bilek, E. L., Lane, A., Abelson, J. L., Eisenberg, D., Himle, J. A., et al. (2022) · Figshare · doi:10.6084/m9.figshare.20279450
Self-citationDias, E., Padilla, J. R., Cuccaro, P. M., Walker, T. J., Balasubramanian, B. A., Savas, L. S., Valerio-Shewmaker, M. A., Chenier, R. S., & Fernandez, M. E. (2024) · Figshare · doi:10.6084/m9.figshare.26747843
Ford, J. H., Cheng, H. L., Gassman, M., Fontaine, H., Garneau, H. C., Keith, R., Michael, E., & McGovern, M. P. (2022) · Figshare · doi:10.6084/m9.figshare.21249594
Lambdin, B. H., Bluthenthal, R. N., Garner, B. R., Wenger, L. D., Browne, E. N., Morris, T., Ongais, L., Megerian, C. E., & Kral, A. H. (2024) · Figshare · doi:10.6084/m9.figshare.25309948
Eisman, A. B., Whitman, J., Palinkas, L. A., Fridline, J., Harvey, C., Kilbourne, A. M., & Hutton, D. W. (2023) · Figshare · doi:10.6084/m9.figshare.24540710
Self-citationHuebschmann, A. G., Wagner, N. M., Gleason, M. C., Brinton, J. T., Brtnikova, M., Brewer, S. E., Begum, A., Armstrong, R., DeCamp, L. R., McFarlane, A. E., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26761623
Kilbourne, A. M., Geng, E., Eshun‐Wilson, I., Sweeney, S. M., Shelley, D., Cohen, D. J., Kirchner, J. E., Fernandez, M. E., & Parchman, M. L. (2024) · Figshare · doi:10.6084/m9.figshare.26589924
Self-citationEisman, A. B., Whitman, J., Palinkas, L. A., Fridline, J., Harvey, C., Kilbourne, A. M., & Hutton, D. W. (2026) · Mental Health & Prevention · doi:10.1016/j.mhp.2026.200498
Self-citationSong, Y., Speth, K. A., Kilbourne, A. K., Quanbeck, A., Almirall, D., & Wang, L. (2026) · Biometrics · doi:10.1093/biomtc/ujag078
Self-citationFrom efficiency to sustainability: The evolution of smart healthcare systems
Mujawar, N. K., & Suryawanshi, A. R. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-33512-9.00015-9
Metadata
- Authors
- Kilbourne, A. M., Almirall, D., Eisenberg, D., Waxmonsky, J., Goodrich, D. E., Fortney, J. C., Kirchner, J. E., Solberg, L. I., Main, D., Bauer, M. S., Kyle, J., Murphy, S. A., Nord, K. M., & Thomas, M. R.
- Affiliations
- VA Ann Arbor Healthcare System (US)
- University of Michigan (US)
- University of Colorado Anschutz (US)
- Health Services Research & Development (US)
- Quality Enhancement Research Initiative (US)
- HealthPartners (US)
- University of Colorado Denver (US)
- VA Boston Healthcare System (US)
- Corresponding author
- Kilbourne, Amy M
- ORCID
- Venue
- Implementation Science
- Published
- 2014-09-30
- Volume
- 9
- Issue
- 1
- Pages
- 132-132
- ISSN
- 1748-5908 (ISSN-L)
- PMC
- PMC4189548
- OpenAlex
- W1972388887
- Cited by
- 130
- References
- 143
- Citations by year
- 2026: 3 · 2025: 8 · 2024: 20 · 2023: 14 · 2022: 25 · 2021: 12 · 2020: 14 · 2019: 10 · 2018: 8 · 2017: 8 · 2016: 5 · 2015: 3
- FWCI
- 9.63
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- Implementation Science (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Deep Blue (University of Michigan) (submittedVersion)
- Digital Access to Scholarship at Harvard (DASH) (Harvard University) (submittedVersion, cc-by)
- Funders
- U.S. Public Health Service (R01 099898)
- National Institute of Mental Health (R01MH099898)
- National Institute on Drug Abuse (P50DA010075)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Psychology › Clinical Psychology › Psychiatric care and mental health services
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Keywords
- evidence-based practice uptake, mood disorders, external facilitators, community-based outpatient clinics, mental health-related quality of life, implementation costs, organizational change, sequential multiple assignment randomized trial, ADEPT
- MeSH terms
- Community Mental Health Services, Humans, Program Development, Evidence-Based Medicine, Mood Disorders, Quality Improvement, Patient Outcome Assessment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review

