The DOI matches its Crossref record; 45 of the 46 references it cites were found in a registry or an index.
A model for rigorously applying the Exploration, Preparation, Implementation, Sustainment (EPIS) framework in the design and measurement of a large scale collaborative multi-site study
Open accessAbstract
BACKGROUND: This paper describes the means by which a United States National Institute on Drug Abuse (NIDA)-funded cooperative, Juvenile Justice-Translational Research on Interventions for Adolescents in the Legal System (JJ-TRIALS), utilized an established implementation science framework in conducting a multi-site, multi-research center implementation intervention initiative. The initiative aimed to bolster the ability of juvenile justice agencies to address unmet client needs related to substance use while enhancing inter-organizational relationships between juvenile justice and local behavioral health partners. METHODS: The EPIS (Exploration, Preparation, Implementation, Sustainment) framework was selected and utilized as the guiding model from inception through project completion; including the mapping of implementation strategies to EPIS stages, articulation of research questions, and selection, content, and timing of measurement protocols. Among other key developments, the project led to a reconceptualization of its governing implementation science framework into cyclical form as the EPIS Wheel. The EPIS Wheel is more consistent with rapid-cycle testing principles and permits researchers to track both progressive and recursive movement through EPIS. Moreover, because this randomized controlled trial was predicated on a bundled strategy method, JJ-TRIALS was designed to rigorously test progress through the EPIS stages as promoted by facilitation of data-driven decision making principles. The project extended EPIS by (1) elucidating the role and nature of recursive activity in promoting change (yielding the circular EPIS Wheel), (2) by expanding the applicability of the EPIS framework beyond a single evidence-based practice (EBP) to address varying process improvement efforts (representing varying EBPs), and (3) by disentangling outcome measures of progression through EPIS stages from the a priori established study timeline. DISCUSSION: The utilization of EPIS in JJ-TRIALS provides a model for practical and applied use of implementation frameworks in real-world settings that span outer service system and inner organizational contexts in improving care for vulnerable populations. TRIAL REGISTRATION: NCT02672150 . Retrospectively registered on 22 January 2016.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Future studies that include an EPIS adoption decision phase is warranted as both theoretical and research-based publications related to the EPIS framework indicate that an adoption decision is the end result of the Exploration Phase (Becan et al., 2018; Nilsen, 2015).”
From Implementation-as-Usual in Community-Based Organizations Providing Specialized Services to Individuals with Autism Spectrum Disorder: A Mixed Methods Study (2021) · cites this paper as Becan et al., 2018
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496
Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0319-7 · Cited by 8,721
Self-citationMaking sense of implementation theories, models and frameworks
Nilsen, P. (2015) · Implementation Science · doi:10.1186/s13012-015-0242-0 · Cited by 4,447
Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors
Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0327-7 · Cited by 3,240 · cited 9×
“It was initially designed for implementation science research focused on public sector services including mental health and child welfare, and similarly organized systems such as substance use disorder treatment (Aarons et al., 2011).”
BackgroundMethodInfluentialSelf-citationImplementation strategies: recommendations for specifying and reporting
Proctor, E. K., Powell, B. J., & McMillen, J. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-139 · Cited by 2,585
Proctor, E. K., Landsverk, J., Aarons, G., Chambers, D., Glisson, C., & Mittman, B. (2009) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-008-0197-4 · Cited by 1,894
Self-citationBridging Research and Practice
Tabak, R. G., Khoong, E. C., Chambers, D. A., & Brownson, R. C. (2012) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2012.05.024 · Cited by 1,386
Aarons, G. A. (2004) · Mental Health Services Research · doi:10.1023/b:mhsr.0000024351.12294.65 · Cited by 1,272
Self-citationA compilation of strategies for implementing clinical innovations in health and mental health
Powell, B. J., McMillen, J. C., Proctor, E. K., Carpenter, C. R., Griffey, R. T., Bunger, A. C., Glass, J. E., & York, J. L. (2012) · Medical Care Research and Review · doi:10.1177/1077558711430690 · Cited by 1,069
Planning and Studying Improvement in Patient Care: The Use of Theoretical Perspectives
GROL, R. P. T. M., BOSCH, M. C., HULSCHER, M. E. J. L., ECCLES, M. P., & WENSING, M. (2007) · The Milbank Quarterly · doi:10.1111/j.1468-0009.2007.00478.x · Cited by 943
Glisson, C., & Hemmelgarn, A. (1998) · Child Abuse & Neglect · doi:10.1016/s0145-2134(98)00005-2 · Cited by 744
Chambers, D. A., & Norton, W. E. (2016) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2016.05.011 · Cited by 581
Designing theoretically-informed implementation interventions
The Improved Clinical Effectiveness through Behavioural Research Group (ICEBeRG) (2006) · Implementation Science · doi:10.1186/1748-5908-1-4 · Cited by 380
Deming, W. E. (2000) · MIT Press Books · Cited by 357
Novins, D. K., Green, A. E., Legha, R. K., & Aarons, G. A. (2013) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2013.07.012 · Cited by 270
Self-citationPsychiatric Disorder, Comorbidity, and Suicidal Behavior in Juvenile Justice Youth
Wasserman, G. A., McReynolds, L. S., Schwalbe, C. S. J., Keating, J. M., & Jones, S. A. (2010) · Criminal Justice and Behavior · doi:10.1177/0093854810382751 · Cited by 267
Chamberlain, P., Brown, C. H., & Saldana, L. (2011) · Implementation Science · doi:10.1186/1748-5908-6-116 · Cited by 262
Aarons, G. A., Green, A. E., Trott, E., Willging, C. E., Torres, E. M., Ehrhart, M. G., & Roesch, S. C. (2016) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-016-0751-4 · Cited by 251
Self-citationMohr, D. C., Schueller, S. M., Riley, W. T., Brown, C. H., Cuijpers, P., Duan, N., Kwasny, M. J., Stiles-Shields, C., & Cheung, K. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.4391 · Cited by 216
Moving innovations into treatment: A stage-based approach to program change
Simpson, D. D., & Flynn, P. M. (2007) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2006.12.023 · Cited by 195
Self-citationSaldana, L., Chamberlain, P., Bradford, W. D., Campbell, M., & Landsverk, J. (2014) · Children and Youth Services Review · doi:10.1016/j.childyouth.2013.10.006 · Cited by 175
Juvenile Justice and Substance Use
Chassin, L. (2008) · The Future of Children · doi:10.1353/foc.0.0017 · Cited by 167
Belenko, S. R., Knight, D. K., Wasserman, G. A., Dennis, M. L., Wiley, T., Taxman, F. S., Oser, C. B., Dembo, R., Robertson, A. A., & Sales, J. M. (2017) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2016.12.012 · Cited by 164
Self-citationShortell, S. M. (2004) · Medical Care Research and Review · doi:10.1177/1077558704266768 · Cited by 145
Aarons, G. A., Fettes, D. L., Hurlburt, M. S., Palinkas, L. A., Gunderson, L. M., Willging, C. E., & Chaffin, M. J. (2014) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2013.876642 · Cited by 126
Self-citationA national survey of substance abuse treatment for juvenile offenders
Young, D. W., Dembo, R., & Henderson, C. E. (2007) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2006.12.018 · Cited by 123
Dissemination and Implementation of Evidence-Based Practices in Child and Adolescent Mental Health
Beidas, R. S., Kendall, P. C., & McClelland, H. (2017) · Clinical Psychology Forum · doi:10.53841/bpscpf.2017.1.300.46 · Cited by 109
Cooperative, T. J.-T., Knight, D. K., Belenko, S. R., Wiley, T., Robertson, A. A., Arrigona, N., Dennis, M. L., Bartkowski, J. P., McReynolds, L. S., Becan, J. E., et al. (2015) · Implementation Science · doi:10.1186/s13012-016-0423-5 · Cited by 103
Self-citationDelivering more effective treatment to adolescents: Improving the juvenile drug court model
Belenko, S. R., & Logan, T. (2003) · Journal of Substance Abuse Treatment · doi:10.1016/s0740-5472(03)00123-5 · Cited by 93
Lau, A. S., & Brookman-Frazee, L. I. (2015) · Implementation Science · doi:10.1186/s13012-016-0388-4 · Cited by 82
Treating adolescent substance abuse problems in the juvenile drug court
Belenko, S. R., & Dembo, R. (2003) · International Journal of Law and Psychiatry · doi:10.1016/s0160-2527(02)00205-4 · Cited by 75
Service Referral for Juvenile Justice Youths: Associations with Psychiatric Disorder and Recidivism
Hoeve, M., McReynolds, L. S., & Wasserman, G. A. (2013) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-013-0472-x · Cited by 73
Interventions and Services Offered to Former Juvenile Offenders Reentering Their Communities
Spencer, M. B., & Jones-Walker, C. (2004) · Youth Violence and Juvenile Justice · doi:10.1177/1541204003260049 · Cited by 71
Bunger, A. C., Collins‐Camargo, C., McBeath, B., Chuang, E., Jolles, M. P., & Wells, R. S. (2014) · Children and Youth Services Review · doi:10.1016/j.childyouth.2014.01.017 · Cited by 66
Organizational Cost of Quality Improvement for Depression Care
Liu, C., Rubenstein, L. V., Kirchner, J. E., Fortney, J. C., Perkins, M. W., Ober, S. K., Pyne, J. M., & Chaney, E. F. (2008) · Health Services Research · doi:10.1111/j.1475-6773.2008.00911.x · Cited by 64
Measuring Sustainment of Multiple Practices Fiscally Mandated in Children’s Mental Health Services
Brookman-Frazee, L. I., Stadnick, N. A., Roesch, S. C., Regan, J., Barnett, M. L., Bando, L., Innes-Gomberg, D., & Lau, A. S. (2016) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-016-0731-8 · Cited by 58
Adolescent-only substance abuse treatment: Availability and adoption of components of quality
Knudsen, H. K. (2008) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2008.06.002 · Cited by 55
Prevalence of Psychiatric Disorders in the Texas Juvenile Correctional System
Harzke, A. J., Baillargeon, J., Baillargeon, G. M., Henry, J., Olvera, R. L., Torrealday, O., Penn, J. V., & Parikh, R. (2012) · Journal of Correctional Health Care · doi:10.1177/1078345811436000 · Cited by 42
Innovation adoption as facilitated by a change-oriented workplace
Becan, J. E., Knight, D. K., & Flynn, P. M. (2011) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2011.10.014 · Cited by 41
Self-citationDouglas, S., Button, S., & Casey, S. E. (2016) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-014-0607-8 · Cited by 38
Williams, N. J., & Glisson, C. A. (2014) · Cited by 30
Cooperative, T. J.-T., Fisher, J. H., Becan, J. E., Harris, P. W., Nager, A., Baird-Thomas, C., Hogue, A., Bartkowski, J. P., & Wiley, T. (2018) · Health & Justice · doi:10.1186/s40352-018-0067-4 · Cited by 15
Self-citationThe Benefits of Community and Juvenile Justice Involvement in Organizational Research.
Leukefeld, C. G., Cawood, M., Wiley, T., Robertson, A. A., Fisher, J. H., Arrigona, N., Donohue, P., Staples-Horne, M., Harris, P. W., Dembo, R., et al. (2017) · PubMed · Cited by 14
Self-citationFlynn, P. M., Knight, D. K., Godley, M. D., & Knudsen, H. K. (2011) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2011.10.029 · Cited by 14
Self-citationJuvenile Corrections and Public Health Collaborations: Opportunities for Improved Health Outcomes
Staples-Horne, M., Duffy, K., & Rorie, M. (2007) · Springer eBooks · doi:10.1007/978-0-387-71695-4_18 · Cited by 3
Cited by
Sorted by citations
Systematic review of the Exploration, Preparation, Implementation, Sustainment (EPIS) framework
Moullin, J. C., Dickson, K. S., Stadnick, N. A., Rabin, B., & Aarons, G. A. (2019) · Implementation Science · doi:10.1186/s13012-018-0842-6 · Cited by 1,223
Self-citationTen recommendations for using implementation frameworks in research and practice
Moullin, J. C., Dickson, K. S., Stadnick, N. A., Albers, B., Nilsen, P., Broder-Fingert, S., Mukasa, B., & Aarons, G. A. (2020) · Implementation Science Communications · doi:10.1186/s43058-020-00023-7 · Cited by 488
Self-citationTen years of implementation outcomes research: a scoping review
Proctor, E. K., Bunger, A. C., Lengnick-Hall, R., Gerke, D. R., Martin, J. K., Phillips, R. J., & Swanson, J. C. (2023) · Implementation Science · doi:10.1186/s13012-023-01286-z · Cited by 424
Nápoles, A. M., & Stewart, A. L. (2018) · BMC Health Services Research · doi:10.1186/s12913-018-3521-z · Cited by 163
Crable, E. L., Lengnick‐Hall, R., Stadnick, N. A., Moullin, J. C., & Aarons, G. A. (2022) · Implementation Science · doi:10.1186/s13012-022-01256-x · Cited by 124
Self-citation
Metadata
- Authors
- Becan, J. E., Bartkowski, J. P., Knight, D. K., Wiley, T. R. A., DiClemente, R., Ducharme, L., Welsh, W. N., Bowser, D., McCollister, K., Hiller, M., Spaulding, A. C., Flynn, P. M., Swartzendruber, A., Dickson, M. F., Fisher, J. H., & Aarons, G. A.
- Affiliations
- Texas Christian University (US)
- The University of Texas at San Antonio (US)
- National Institute on Drug Abuse (US)
- Emory University (US)
- National Institute on Alcohol Abuse and Alcoholism (US)
- Temple University (US)
- University of Miami (US)
- University of Georgia (US)
- University of Kentucky (US)
- National Center on Addiction and Substance Abuse at Columbia University (US)
- University of California San Diego (US)
- Corresponding author
- Becan, Jennifer E.
- ORCID
- Venue
- Health & Justice
- Published
- 2018-04-13
- Volume
- 6
- Issue
- 1
- Pages
- 9-9
- ISSN
- 2194-7899 (ISSN-L)
- PMC
- PMC5899075
- OpenAlex
- W2799439473
- Cited by
- 119
- References
- 46
- Citations by year
- 2026: 13 · 2025: 13 · 2024: 18 · 2023: 13 · 2022: 17 · 2021: 26 · 2020: 10 · 2019: 5 · 2018: 3
- FWCI
- 16.80
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- Health & Justice (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, other-oa)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- UKnowledge (University of Kentucky) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- TUScholarShare (Temple University) (submittedVersion, cc-by)
- Funders
- National Institute on Drug Abuse (U01DA036221, U01DA036226, U01DA036233, U01DA036176, U01DA036225, U01DA036224, U01DA036158, R21DA044378)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Keywords
- EPIS framework, implementation science, juvenile justice, substance use, implementation strategies, outcome measurement, interorganizational relationships, data-driven decision making, vulnerable populations
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
