Bridging Science to Practice: Achieving Prevention Program Implementation Fidelity in the Community Youth Development Study
Abstract
This paper describes the development, application, and results of an implementation monitoring component of the Communities That Care (CTC) prevention framework used in the Community Youth Development Study (CYDS) to ensure high‐fidelity prevention program implementation. This system was created based on research that community‐based implementation of evidence‐based prevention programs often includes adaptations in program design, content, or manner of delivery (Gottfredson and Gottfredson, Journal of research in crime and delinquency, 39, 3–35, 2002; Hallfors and Godette, Health Education Research, 17, 461–470, 2002; Wandersman and Florin, American Psychologist, 58, 441–448, 2003). A lack of fidelity to the implementation standards delineated by program designers is one indicator of a gap between prevention science and practice which can lessen the likelihood that communities will realize the positive participant effects demonstrated in research trials. By using the CTC model to select and monitor the quality of prevention activities, the 12 CYDS communities replicated 13 prevention programs with high rates of adherence to the programs' core components and in accordance with dosage requirements regarding the number, length, and frequency of sessions. This success indicates the potential of the CTC program implementation monitoring system to enhance community Prevention Delivery Systems (Wandersman et al. American Journal of Community Psychology, this issue) and improve the likelihood of desired participant changes.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Training is useful for equipping those who deliver an intervention to do so well and faithfully.
“Training is an effective component of preparing implementers to deliver an intervention with quality and fidelity (e.g., Dusenbury et al. 2003, 2005; Ennett et al. 2003; Fagan et al. 2008; Gager and Elias 1997).”
From Translational research in South Africa: evaluating implementation quality using a factorial design (2012) · cites this paper as Fagan et al. 2008
Coaching, technical assistance, and teacher support provided continuously matter for implementation fidelity.
“Technical assistance, teacher support or coaching on an on-going basis is important to fidelity of implementation (e.g., Fagan et al. 2008; Harshbarger et al. 2006).”
From Translational research in South Africa: evaluating implementation quality using a factorial design (2012) · cites this paper as Fagan et al. 2008
MSED administrator backing is crucial for successfully disseminating evidence-based interventions at scale.
“This level of support is a critical component of successful large scale dissemination of EBIs (e.g., August et al. 2004; Fagan et al. 2008; Payne et al. 2006).”
From Translational research in South Africa: evaluating implementation quality using a factorial design (2012) · cites this paper as Fagan et al. 2008
Cites
(2005) · Cited by 3,748 · see citing works
Dusenbury, L. (2003) · Health Education Research · doi:10.1093/her/18.2.237 · Cited by 1,671 · see citing works
Wandersman, A., Duffy, J., Flaspohler, P., Noonan, R., Lubell, K., Stillman, L., Blachman, M., Dunville, R., & Saul, J. (2008) · American Journal of Community Psychology · doi:10.1007/s10464-008-9174-z · Cited by 1,339 · see citing works
Fidelity Criteria: Development, Measurement, and Validation
Mowbray, C. T., Holter, M. C., Teague, G. B., & Bybee, D. I. (2003) · American Journal of Evaluation · doi:10.1177/109821400302400303 · Cited by 884 · see citing works
Issues in Disseminating and Replicating Effective Prevention Programs
Elliott, D. S., & Mihalic, S. (2004) · Prevention Science · doi:10.1023/b:prev.0000013981.28071.52 · Cited by 794 · see citing works
Henggeler, S. W., Melton, G. B., Brondino, M. J., Scherer, D. G., & Hanley, J. H. (1997) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.65.5.821 · Cited by 755 · see citing works
Promoting science-based prevention in communities
Hawkins, J. D., Catalano, R. F., & Arthur, M. W. (2002) · Addictive Behaviors · doi:10.1016/s0306-4603(02)00298-8 · Cited by 551 · see citing works
Self-citationHenggeler, S. W., Melton, G. B., Brondino, M. J., et al. (1997) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.65.5.821 · Cited by 543 · see citing works
Examining the Role of Implementation Quality in School-Based Prevention Using the PATHS Curriculum
Kam, C.-M., Greenberg, M. T., & Walls, C. T. (2003) · Prevention Science · doi:10.1023/a:1021786811186 · Cited by 516 · see citing works
Blueprints for Violence Prevention
Mihalic, S. W., Irwin, K., Elliott, D. S., Fagan, A. A., & Hansen, D. C. (2001) · PsycEXTRA Dataset · doi:10.1037/e304162003-001 · Cited by 497 · see citing works
Self-citationQuality of School-Based Prevention Programs: Results from a National Survey
Gottfredson, D. C., & Gottfredson, G. D. (2002) · Journal of Research in Crime and Delinquency · doi:10.1177/002242780203900101 · Cited by 474 · see citing works
Heinrichs, N., Bertram, H., Kuschel, A., & Hahlweg, K. (2005) · Prevention Science · doi:10.1007/s11121-005-0006-1 · Cited by 446 · see citing works
Community interventions and effective prevention.
Wandersman, A., & Florin, P. (2003) · American Psychologist · doi:10.1037/0003-066x.58.6-7.441 · Cited by 444 · see citing works
Diffusion of a School-Based Substance Abuse Prevention Program: Predictors of Program Implementation
Rohrbach, L. A., Graham, J. A., & Hansen, W. B. (1993) · Preventive Medicine · doi:10.1006/pmed.1993.1020 · Cited by 431 · see citing works
2001: Youth Violence—A Report of the Surgeon General
Coleman, M. J., & H.Ganong, L. (2014) · Sage eBooks · doi:10.4135/9781452286143.n705 · Cited by 350 · see citing works
Communities that care: Action for drug abuse prevention
Regehr, C. (1993) · Children and Youth Services Review · doi:10.1016/0190-7409(93)90046-c · Cited by 309 · see citing works
Promoting intervention fidelity
Dumas, J. E., Lynch, A. M., Laughlin, J. E., Smith, E. P., & Prinz, R. J. (2001) · American Journal of Preventive Medicine · doi:10.1016/s0749-3797(00)00272-5 · Cited by 277 · see citing works
Ennett, S. T., Ringwalt, C. L., Thorne, J., Rohrbach, L. A., Vincus, A., Simons-Rudolph, A., & Jones, S. (2003) · Prevention Science · doi:10.1023/a:1021777109369 · Cited by 276 · see citing works
Common risk and protective factors in successful prevention programs.
Durlak, J. A. (1998) · American Journal of Orthopsychiatry · doi:10.1037/h0080360 · Cited by 266 · see citing works
Hallfors, D. (2002) · Health Education Research · doi:10.1093/her/17.4.461 · Cited by 265 · see citing works
Preventing Harmful Substance Use: the evidence base for policy and practice
Stockwell, T. R., Gruenewald, P. J., Toumbourou, J. W., & LOXLEY, W. M. (2005) · Figshare · Cited by 217 · see citing works
Schoenwald, S. K., Sheidow, A. J., & Letourneau, E. J. (2004) · Journal of Clinical Child & Adolescent Psychology · doi:10.1207/s15374424jccp3301_10 · Cited by 206 · see citing works
Fagan, A. A., & Mihalic, S. W. (2003) · Journal of Community Psychology · doi:10.1002/jcop.10045 · Cited by 197 · see citing works
Self-citationBlueprints for Violence Prevention
Mihalic, S. W., & Irwin, K. (2003) · Youth Violence and Juvenile Justice · doi:10.1177/1541204003255841 · Cited by 191 · see citing works
Teacher Training as a Behavior Change Process: Principles and Results from a Longitudinal Study
Kealey, K. A., Peterson, A. V., Gaul, M. A., & Dinh, K. T. (2000) · Health Education & Behavior · doi:10.1177/109019810002700107 · Cited by 187 · see citing works
Changing teaching practices to promote achievement and bonding to school.
Abbott, R. D., O'Donnell, J., Hawkins, J. D., Hemphill, S. A., Kosterman, R., & Catalano, R. F. (1998) · American Journal of Orthopsychiatry · doi:10.1037/h0080363 · Cited by 182 · see citing works
Self-citationChinman, M., Hannah, G., Wandersman, A. H., Ebener, P. A., Hunter, S. B., Imm, P., & Sheldon, J. (2005) · American Journal of Community Psychology · doi:10.1007/s10464-005-3390-6 · Cited by 167 · see citing works
Mitchell, R. E., Florin, P. R., & Stevenson, J. F. (2002) · Health Education & Behavior · doi:10.1177/109019802237029 · Cited by 130 · see citing works
Recruitment and Retention of High-Risk Families into a Preventive Parent Training Intervention
Dumka, L. E., Garza, C. A., Roosa, M. W., & Stoerzinger, H. D. (1997) · The Journal of Primary Prevention · doi:10.1023/a:1024626105091 · Cited by 122 · see citing works
Blueprints for Violence Prevention
Mihalic, S. W., Fagan, A. A., Irwin, K., Ballard, D., & Elliott, D. S. (2004) · PsycEXTRA Dataset · doi:10.1037/e302992005-001 · Cited by 108 · see citing works
Self-citationSpoth, R. L., & Redmond, C. R. (2002) · Prevention Science · doi:10.1023/a:1019946617140 · Cited by 78 · see citing works
Quinby, R. K., Hanson, K. G., Brooke-Weiss, B. L., Arthur, M. W., Hawkins, J. D., & Fagan, A. A. (2008) · Journal of Community Psychology · doi:10.1002/jcop.20194 · Cited by 74 · see citing works
Self-citationA Process Evaluation of the District of Columbia “Know Your Body” Project
TAGGART, V. S., Bush, P. J., Zuckerman, A. E., & Theiss, P. K. (1990) · Journal of School Health · doi:10.1111/j.1746-1561.1990.tb05907.x · Cited by 65 · see citing works
Blueprints for Violence Prevention. Juvenile Justice Bulletin.
Mihalic, S. W., Irwin, K., Elliott, D., Fagan, A. A., & Hansen, D. C. (2001) · Cited by 62 · see citing works
Self-citationWelsh, B. C., & Farrington, D. P. (2006) · Springer eBooks · doi:10.1007/1-4020-4244-2 · Cited by 59 · see citing works
Spoth, R. L., Guyll, M., Trudeau, L., & Lillehoj, C. J. (2002) · Journal of Community Psychology · doi:10.1002/jcop.10021 · Cited by 52 · see citing works
Bauman, K. E., Ennett, S. T., Foshee, V. A., Pemberton, M. R., & Hicks, K. A. (2001) · Health Education & Behavior · doi:10.1177/109019810102800406 · Cited by 51 · see citing works
Greenberg, M. T., Feinberg, M. E., Gomez, B. J., & Osgood, D. W. (2005) · doi:10.1002/9780470713624.ch11 · Cited by 31 · see citing works
Understanding implementation in Early Head Start programs: Implications for policy and practice
Paulsell, D., Kisker, E. E., Love, J. M., & Raikes, H. H. (2002) · Infant Mental Health Journal · doi:10.1002/imhj.10001 · Cited by 20 · see citing works
Successful Program Development Using Implementation Evaluation
Lynch, K. B., Geller, S. R., Hunt, D., Galano, J., & Dubas, J. S. (1998) · Journal of Prevention & Intervention in the Community · doi:10.1300/j005v17n02_05 · Cited by 13 · see citing works
“WE'VE GOT A GUN?”: comparing reports of adolescents and their parents about household firearms
Sorenson, S. B., & Cook, P. J. (2007) · Journal of Community Psychology · doi:10.1002/jcop.20213 · Cited by 10 · see citing works
Flagged first, then by citations
2 of the 43 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
The Quality Implementation Framework: A Synthesis of Critical Steps in the Implementation Process
Meyers, D. C., Durlak, J. A., & Wandersman, A. (2012) · American Journal of Community Psychology · doi:10.1007/s10464-012-9522-x · Cited by 1,102 · see citing works
“Nevertheless, there has been a steady improvement in the number and quality of studies investigating implementation, and there are now more carefully done quantitative and qualitative reports that shed light on the implementation process (e.g., Domitrovich et al. 2010; Fagan et al. 2008; Saunders et al. 2006; Walker a…”
BackgroundBonell, C., Fletcher, A., Morton, M., Lorenc, T., & Moore, L. (2012) · Social Science & Medicine · doi:10.1016/j.socscimed.2012.08.032 · Cited by 582 · see citing works
“1 Realist trials would additionally determine the validity of program theory rather than only examining ‘what works’ to better inform policy and practice in the long-term.”
BackgroundPutting the Pieces Together: An Integrated Model of Program Implementation
Berkel, C., Mauricio, A. M., Schoenfelder, E. N., & Sandler, I. N. (2010) · Prevention Science · doi:10.1007/s11121-010-0186-1 · Cited by 532 · see citing works
“Diffusion of innovation theory (Rogers 2003) suggests the potential for “program drift,” in which, after repeated delivery of the program, facilitators stray from the curriculum as originally intended and implementation declines (Fagan et al. 2008).”
BackgroundCyril, S., Smith, B. J., Possamai‐Inesedy, A., & Renzaho, A. M. N. (2015) · Global Health Action · doi:10.3402/gha.v8.29842 · Cited by 529 · see citing works
Wandersman, A., Chien, V. H., & Katz, J. (2012) · American Journal of Community Psychology · doi:10.1007/s10464-012-9509-7 · Cited by 422 · see citing works
Results of a Type 2 Translational Research Trial to Prevent Adolescent Drug Use and Delinquency
Hawkins, J. D., Oesterle, S., Brown, E. C., Arthur, M. W., Abbott, R. D., Fagan, A. A., & Catalano, R. F. (2009) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/archpediatrics.2009.141 · Cited by 278 · see citing works
“Analyses also have found that tested and effective preventive programs were selected and well implemented in the CTC communities.(48) Hypothesized effects of CTC on targeted risk factors and on the incidence of delinquent behavior have been observed 3 years after implementation of CTC in communities.”
BackgroundSelf-citationHawkins, J. D., Brown, E. C., Oesterle, S., Arthur, M. W., Abbott, R. D., & Catalano, R. F. (2008) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2008.01.022 · Cited by 235 · see citing works
“In total, 13 programs were delivered in 95 cycles in 2004 –2005, and 16 programs were delivered in 156 cycles during 2005–2006 [ 21 ].”
BackgroundMethodInfluentialSelf-citationHawkins, J. D., Catalano, R. F., Arthur, M. W., Egan, E. A., Brown, E. C., Abbott, R. D., & Murray, D. M. (2008) · Prevention Science · doi:10.1007/s11121-008-0092-y · Cited by 230 · see citing works
“The feedback provided by these measures is used to support continuous quality improvement of prevention programs during Phase 5 (see Fagan et al. 2008 ).”
BackgroundMethodSelf-citationSchool-Based Programs for Increasing Connectedness and Reducing Risk Behavior: A Systematic Review
Chapman, R. L., Buckley, L., Sheehan, M. C., & Shochet, I. M. (2013) · Educational Psychology Review · doi:10.1007/s10648-013-9216-4 · Cited by 168 · see citing works
Interventions for Student Engagement: Overview and State of the Field
Fredricks, J. A., Reschly, A. L., & Christenson, S. L. (2019) · Elsevier eBooks · doi:10.1016/b978-0-12-813413-9.00001-2 · Cited by 139 · see citing works
Oesterle, S., Kuklinski, M. R., Hawkins, J. D., Skinner, M. L., Guttmannova, K., & Rhew, I. C. (2018) · American Journal of Public Health · doi:10.2105/ajph.2018.304320 · Cited by 117 · see citing works
Self-citationPractical Implementation Science: Developing and Piloting the Quality Implementation Tool
Meyers, D. C., Katz, J., Chien, V. H., Wandersman, A., Scaccia, J., & Wright, A. (2012) · American Journal of Community Psychology · doi:10.1007/s10464-012-9521-y · Cited by 116 · see citing works
Rohrbach, L. A., Gunning, M., Sun, P., & Sussman, S. Y. (2009) · Prevention Science · doi:10.1007/s11121-009-0151-z · Cited by 93 · see citing works
“problems that may arise ( Fagan et al. 2008; Kam et al. 2003).”
Fagan, A. A., Hanson, K., Hawkins, J. D., & Arthur, M. W. (2009) · Journal of Community Psychology · doi:10.1002/jcop.20332 · Cited by 84 · see citing works
“N IH -PA Author M anuscript N IH -PA Author M anuscript N IH -PA Author M anuscript implementation fidelity of the CTC system as a whole (see Quinby et al., 2008) and the selected prevention programs (see Fagan et al., 2008; Fagan, Hanson, Hawkins, & Arthur, 2008) are summarized below.”
MethodSelf-citationEffects of Participation in After-School Programs for Middle School Students: A Randomized Trial
Gottfredson, D. C., Cross, A. B., Wilson, D., Rorie, M. L., & Connell, N. M. (2010) · Journal of Research on Educational Effectiveness · doi:10.1080/19345741003686659 · Cited by 87 · see citing works
Quinby, R. K., Hanson, K. G., Brooke-Weiss, B. L., Arthur, M. W., Hawkins, J. D., & Fagan, A. A. (2008) · Journal of Community Psychology · doi:10.1002/jcop.20194 · Cited by 74 · see citing works
Self-citationFlay, B. R., & Allred, C. G. (2010) · Springer eBooks · doi:10.1007/978-90-481-8675-4_28 · Cited by 73 · see citing works
Design and Analysis of the Community Youth Development Study Longitudinal Cohort Sample
Brown, E. C., Graham, J. A., Hawkins, J. D., Arthur, M. W., Baldwin, M. M., Oesterle, S., Briney, J. S., Catalano, R. F., & Abbott, R. D. (2009) · Evaluation Review · doi:10.1177/0193841x09337356 · Cited by 70 · see citing works
“…with prevention service providers (e.g., teachers, principals, and prevention program directors); (d) annual assessments of CTC functioning via surveys of CTC board members (Arthur et al., in press); and (e) ongoing assessment of prevention program implementation fidelity (Fagan et al. 2008).”
BackgroundInfluentialSelf-citationRowbotham, S. J., Conte, K. P., & Hawe, P. (2019) · Implementation Science · doi:10.1186/s13012-019-0899-x · Cited by 69 · see citing works
“For example, Fagan and colleagues [23] defined programme dosage as ‘the extent to which programs achieved the required number, length, and frequency of sessions’ (p.”
BackgroundHow prevention curricula are taught under real‐world conditions
Miller-Day, M. A., Pettigrew, J., Hecht, M. L., Shin, Y., Graham, J., & Krieger, J. L. R. (2013) · Health Education · doi:10.1108/09654281311329259 · Cited by 66 · see citing works
“Based on this view, past fidelity research predominately focussed on adherence and dosage as key determinants for the effectiveness of prevention curricula (Fagan et al., 2008; Sloboda et al., 2009; Szulanski and Winter, 2002).”
Determinants of Community Coalition Ability to Support Evidence-Based Programs
Brown, L. D., Feinberg, M. E., & Greenberg, M. T. (2010) · Prevention Science · doi:10.1007/s11121-010-0173-6 · Cited by 63 · see citing works
“When coalitions function effectively, they may be able to better assist with several core implementation challenges such as the acquisition of program funding and the development of commitment among local stakeholders for EBP implementation (Fagan et al. 2008; Hawkins et al. 2002).”
BackgroundRhoades, B. L., Bumbarger, B. K., & Moore, J. E. (2012) · American Journal of Community Psychology · doi:10.1007/s10464-012-9502-1 · Cited by 62 · see citing works
Eboreime, E., Abímbọ́lá, Ṣ., Obi, F. A., Ebirim, O., Olubajo, O., Eyles, J. D., Nxumalo, N., & Mambulu, F. N. (2017) · BMC Health Services Research · doi:10.1186/s12913-017-2179-2 · Cited by 62 · see citing works
The TRIP Team, Kegeles, S. M., Rebchook, G., Tebbetts, S., & Arnold, E. A. (2015) · Implementation Science · doi:10.1186/s13012-015-0216-2 · Cited by 61 · see citing works
“These findings, in accordance with others’ recommendations [43,51,53], indicate that TA should include feedback on fidelity, especially if CBOs are not evaluating themselves.”
ResultPrevention service system transformation using <i>Communities That Care</i>
Brown, E. C., Hawkins, J. D., Arthur, M. W., Briney, J. S., & Fagan, A. A. (2011) · Journal of Community Psychology · doi:10.1002/jcop.20426 · Cited by 57 · see citing works
“Details of the CTC implementation process are described in Fagan et al. (2008), Hawkins et al.”
MethodSelf-citationvan Niekerk, A., Seedat, M., Kramer, S., Suffla, S., Bulbulia, S., & Ismail, G. (2014) · BMC Public Health · doi:10.1186/1471-2458-14-s2-s7 · Cited by 57 · see citing works
“The recent call to merge empirical, evidence-based and community-based practices [6,34] underscores the need to bridge the gap between these traditions in order to ensure the identification of effective interventions that can demonstrate a high level of quality [35].”
BackgroundFagan, A. A., Hanson, K. G., Briney, J. S., & Hawkins, J. D. (2011) · American Journal of Community Psychology · doi:10.1007/s10464-011-9463-9 · Cited by 55 · see citing works
Self-citationChinman, M., Acosta, J., Ebener, P. A., Malone, P. S., & Slaughter, M. E. (2015) · Implementation Science · doi:10.1186/s13012-016-0446-y · Cited by 56 · see citing works
“Fidelity results in EQUIPS are similar to CTC [51], PROSPER [52], and Rohrbach et al.”
MethodImplementing Effective Community-Based Prevention Programs in the Community Youth Development Study
Fagan, A. A., Hanson, K. G., Hawkins, J. D., & Arthur, M. W. (2008) · Youth Violence and Juvenile Justice · doi:10.1177/1541204008315937 · Cited by 55 · see citing works
“In a prior article (Fagan et al., 2008), we hypothesized that the strong adherence and dosage outcomes were due to a comprehensive program monitoring system used in the study, which combined local oversight by community prevention coalitions with external oversight by staff from the Social…”
BackgroundSelf-citationTomlinson, M., Hunt, X., & Rotheram‐Borus, M. J. (2018) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.13650 · Cited by 52 · see citing works
Wainer, A., & Ingersoll, B. R. (2013) · Clinical Psychology Science and Practice · doi:10.1111/cpsp.12045 · Cited by 54 · see citing works
Gloppen, K. M., Arthur, M. W., Hawkins, J. D., & Shapiro, V. B. (2012) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2011.12.018 · Cited by 52 · see citing works
Self-citationTranslational research in South Africa: evaluating implementation quality using a factorial design
Caldwell, L. L., Smith, E. A., Collins, L. M., Graham, J. W., Lai, M., Wegner, L., Vergnani, T., Matthews, C., & Jacobs, J. (2012) · Child & Youth Care Forum · doi:10.1007/s10566-011-9164-4 · Cited by 50 · see citing works
Griffin, T. L., Pallan, M. J., Clarke, J. L., Lancashire, E. R., Lyon, A., Parry, J. M., & Adab, P. (2014) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-014-0112-1 · Cited by 50 · see citing works
“Potential data collection methods were then identified from the literature [12,13,33-35] and through seeking advice from researchers with experience in the field.”
MethodOesterle, S., Hawkins, J. D., Fagan, A. A., Abbott, R. D., & Catalano, R. F. (2010) · Prevention Science · doi:10.1007/s11121-010-0178-1 · Cited by 47 · see citing works
“…youth-focused programs (Participate and Learn Skills, Big Brothers/Big Sisters, Stay Smart, and academic tutoring), and family-focused programs (Strengthening Families 10–14, Guiding Good Choices, Parents Who Care, Family Matters, and Parenting Wisely) (Fagan et al. 2008b; Quinby et al. 2008).”
InfluentialSelf-citationFagan, A. A., Arthur, M. W., Hanson, K., Briney, J. S., & Hawkins, J. D. (2011) · Prevention Science · doi:10.1007/s11121-011-0226-5 · Cited by 46 · see citing works
Self-citationEsbensen, F., Matsuda, K. N., Taylor, T. J., & Peterson, D. (2011) · Evaluation Review · doi:10.1177/0193841x10388126 · Cited by 46 · see citing works
“Indeed, finding methods to enhance implementation of evidence-based practices provides a ‘‘bridge’’ between research and practice (Fagan et al. 2008).”
Hansen, W. B., Pankratz, M. M., Dusenbury, L., Giles, S. M., Bishop, D. C., Albritton, J., Albritton, L. P., & Strack, J. (2013) · Health Education · doi:10.1108/09654281311329268 · Cited by 45 · see citing works
Effects of the Communities That Care Prevention System on Youth Reports of Protective Factors
Kim, B. E., Gloppen, K. M., Rhew, I. C., Oesterle, S., & Hawkins, J. D. (2014) · Prevention Science · doi:10.1007/s11121-014-0524-9 · Cited by 44 · see citing works
“Programs included universal school-based programs (e.g., All-Stars, Life Skills Training, Lion’s Quest Skills for Adolescence, Project Alert, Olweus Bullying Prevention Program, and Program Development Evaluation Training), selective programs for youth thought to be at elevated risk (e.g., Participate and Learn Skills…”
BackgroundMethodInfluentialSelf-citationAn Analysis of Preference Relative to Teacher Implementation of Intervention
Johnson, L., Wehby, J. H., Symons, F. J., Moore, T. C., Maggin, D. M., & Sutherland, K. S. (2013) · The Journal of Special Education · doi:10.1177/0022466913475872 · Cited by 44 · see citing works
“Years of research examining fidelity of implementation suggests that though the commitment to adopting a practice is necessary, it is not sufficient for ensuring fidelity (Durlak & DuPre, 2008; Fagan et al., 2008).”
BackgroundBarriers to empowerment: Assessment of community-led local development organizations in Pakistan
Wahid, A., Ahmad, M. S., Talib, N. B. A., Shah, I. A., Tahir, M. D., Jan, F. A., & Saleem, M. Q. (2016) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2016.11.163 · Cited by 43 · see citing works
Lachman, J. M., Heinrichs, N., Jansen, E., Brühl, A., Tăut, D., Fang, X., Gardner, F. E. M., Hutchings, J., Ward, C. L., Williams, M. E., et al. (2019) · Contemporary Clinical Trials · doi:10.1016/j.cct.2019.105855 · Cited by 43 · see citing works
Adab, P., Barrett, T. G., Bhopal, R. S., Cade, J. E., Canaway, A., Cheng, K. K., Clarke, J. L., Daley, A., Deeks, J. J., Duda, J. L., et al. (2018) · Health Technology Assessment · doi:10.3310/hta22080 · Cited by 41 · see citing works
Gottfredson, D. C., Cross, A. B., Wilson, D., Rorie, M. L., & Connell, N. M. (2009) · Prevention Science · doi:10.1007/s11121-009-0156-7 · Cited by 40 · see citing works
“This level of adherence to the program is comparable to the levels reported from the evaluation of the Communities that Care prevention system in which a variety of evidence-based program models (including All Stars) were implemented in community settings (Fagan et al. 2008).”
ResultInfluencing Adolescent Leisure Motivation: Intervention Effects of Health Wise South Africa
Caldwell, L. L., Patrick, M. E., Smith, E. A., Palen, L.-A., & Wegner, L. (2010) · Journal of Leisure Research · doi:10.1080/00222216.2010.11950202 · Cited by 39 · see citing works
Shapiro, V. B., Oesterle, S., & Hawkins, J. D. (2014) · American Journal of Community Psychology · doi:10.1007/s10464-014-9684-9 · Cited by 38 · see citing works
“Fifth, coalition members work with community organizations to promote high-quality program implementation by monitoring regularly collected data to ensure the newly installed programs and policies are well implemented and effective (Fagan et al. 2008).”
BackgroundMethodSelf-citationReciprocal Relations between Coalition Functioning and the Provision of Implementation Support
Brown, L. D., Feinberg, M. E., Shapiro, V. B., & Greenberg, M. T. (2013) · Prevention Science · doi:10.1007/s11121-013-0447-x · Cited by 38 · see citing works
“…to build coalition member understanding of the CTC strategy, which adopts a science-based approach to prevention, emphasizing high quality implementation by selecting EBPs that respond to observed community needs and by monitoring implementation fidelity (Fagan et al. 2008; Hawkins et al. 2002).”
BackgroundAsgary-Eden, V., & Lee, C. M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-011-0371-y · Cited by 37 · see citing works
Wandersman, A., & Scheier, L. M. (2024) · Evaluation & the Health Professions · doi:10.1177/01632787241248768 · Cited by 40 · see citing works
“…need to promote quality implementation by providing practitioners with tools and TTA to improve fi delity and quality adaptation, foster buy-in, and achieve desired outcomes (Fagan et al., 2008; Mitchell et al., 2002; O ’ Donnell et al., 2000; Wandersman et al., 2012; Watson-Thompson et al., 2013).”
BackgroundResearchers, Practitioners, and Funders: Using the Framework to Get Us on the Same Page
Emshoff, J. G. (2008) · American Journal of Community Psychology · doi:10.1007/s10464-008-9168-x · Cited by 34 · see citing works
“Fagan et al. (2008) describe just such an implementation monitoring system which they used in conjunction with the Communities That Care, a framework that exemplifies a Prevention Support System.”
MethodThe effects of implementation fidelity in the Towards No Drug Abuse dissemination trial
Little, M. A., Sussman, S. Y., Sun, P., & Rohrbach, L. A. (2013) · Health Education · doi:10.1108/09654281311329231 · Cited by 35 · see citing works
“Consistent with previous research (Fagan et al., 2008; Mihalic et al., 2008; Thaker et al., 2008; Wiecha et al., 2004) and Chen’s (1998) conceptual model, we found that school organizational capacity was related to higher levels of implementation fidelity.”
BackgroundResultAsgary-Eden, V., & Lee, C. M. (2011) · Professional Psychology Research and Practice · doi:10.1037/a0022745 · Cited by 35 · see citing works
Measuring Fidelity and Adaptation
Bishop, D. C., Pankratz, M. M., Hansen, W. B., Albritton, J., Albritton, L. P., & Strack, J. (2013) · Evaluation & the Health Professions · doi:10.1177/0163278713476882 · Cited by 35 · see citing works
“Fagan and her colleagues (Fagan et al., 2008) similarly created an implementation monitoring system for the Communities That Care model designed to promote high levels of program fidelity.”
BackgroundAhtola, A., Haataja, A., Kärnä, A., Poskiparta, E., & Salmivalli, C. (2013) · Educational Research · doi:10.1080/00131881.2013.844941 · Cited by 34 · see citing works
Chinman, M., Ebener, P. A., Malone, P. S., Cannon, J. S., D’Amico, E. J., & Acosta, J. (2018) · Implementation Science · doi:10.1186/s13012-018-0825-7 · Cited by 31 · see citing works
The Process of Adoption of Evidence-based Tobacco Use Prevention Programs in California Schools
Little, M. A., Pokhrel, P., Sussman, S. Y., & Rohrbach, L. A. (2014) · Prevention Science · doi:10.1007/s11121-013-0457-8 · Cited by 29 · see citing works
“…: L. A. Rohrbach Institute for Prevention Research, Keck School of Medicine, University of Southern California, Los Angeles, CA, USA reducing youth risk behaviors (Fagan et al. 2008; National Cancer Institute & SAMHSA 2010; United States Department of Health and Human Services & SAMHSA 2010).”
InfluentialIachini, A. L., Beets, M. W., Ball, A., & Lohman, M. (2014) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2014.05.001 · Cited by 29 · see citing works
Conceptualizing and measuring community road-safety climate
Luria, G., Boehm, A., & Mazor, T. (2014) · Safety Science · doi:10.1016/j.ssci.2014.07.003 · Cited by 28 · see citing works
Fagan, A. A., Brooke-Weiss, B. L., Cady, R., & Hawkins, J. D. (2009) · Australian & New Zealand Journal of Criminology · doi:10.1375/acri.42.3.387 · Cited by 28 · see citing works
“Early evaluations of the study have indicated that school-based and other programs have been well implemented (Fagan et al., 2008b). and that children in the intervention communities report a significantly slower increase in risk factors and less initiation of delinquency compared to children in…”
BackgroundResultSelf-citationRöding, D., Soellner, R., Reder, M., Birgel, V., Kleiner, C., Stolz, M., Groeger-Roth, F., Krauth, C., & Walter, U. (2021) · BMC Public Health · doi:10.1186/s12889-021-11935-x · Cited by 26 · see citing works
“Considering the heterogenous effects of the CYDS at the different follow-up intervals [43–45], we assume small effects (d = .2) for our primary outcomes in both the cohort and repeated cross-sectional design.”
BackgroundInfluentialShek, D. T. L., Sun, R. C. F., & Kan, V. W. M. (2009) · The Scientific World JOURNAL · doi:10.1100/tsw.2009.116 · Cited by 25 · see citing works
Taussig, H. N., Dmitrieva, J., Garrido, E. F., Cooley, J. L., & Crites, E. L. (2021) · Prevention Science · doi:10.1007/s11121-021-01235-6 · Cited by 24 · see citing works
“Attention to critical implementation strategies is vitally important to ensure high-quality transportability of interventions from research-based settings into community-based settings (Fagan et al., 2008; Mihalic & Irwin, 2003).”
BackgroundHaggerty, K. P., & Shapiro, V. B. (2013) · Social Work in Public Health · doi:10.1080/19371918.2013.774812 · Cited by 24 · see citing works
Evidence‐Based Policy and Practice: key challenges for improvement
Cherney, A., & Head, B. W. (2010) · Australian Journal of Social Issues · doi:10.1002/j.1839-4655.2010.tb00195.x · Cited by 22 · see citing works
Rhew, I. C., Hawkins, J. D., Murray, D. M., Fagan, A. A., Oesterle, S., Abbott, R. D., & Catalano, R. F. (2015) · Prevention Science · doi:10.1007/s11121-015-0613-4 · Cited by 23 · see citing works
“For example, findings suggest that CTC communities implemented prevention programs with high fidelity (Fagan et al. 2008) and implemented a greater number of tested and effective programs than control communities, and these tested and effective programs reached more youths in CTC communities during the course of the s…”
BackgroundSelf-citationRoss, A., Duckworth, K., Smith, D. J., Wyness, G., & Schoon, I. (2011) · PsycEXTRA Dataset · doi:10.1037/e603692011-001 · Cited by 24 · see citing works
“In the case of the specific initiative described in this article (Fagan et al., 2008), the Community Youth Development Study, the action plans developed by each community board were critically evaluated by the Social Development Research Group at the University of Washington and revised in the light of their comments.”
MethodInfluentialComponent analysis of adherence in a family intervention
Hill, L. G., & Owens, R. W. (2013) · Health Education · doi:10.1108/09654281311329222 · Cited by 22 · see citing works
“Other studies of SFP fidelity have also used measures of global adherence to curriculum and found that fidelity was high (all implementations had greater than 80 percent adherence) (Fagan et al., 2008; Spoth et al., 2002, 2007) and unrelated to short-term outcomes (Spoth et al., 2002, 2007).”
MethodConclusion: Status of Student Engagement Interventions
Fredricks, J. A., Reschly, A. L., & Christenson, S. L. (2019) · Elsevier eBooks · doi:10.1016/b978-0-12-813413-9.00025-5 · Cited by 23 · see citing works
PREVENTION IS A SOUND PUBLIC AND PRIVATE INVESTMENT*
Catalano, R. F. (2007) · Criminology & Public Policy · doi:10.1111/j.1745-9133.2007.00443.x · Cited by 22 · see citing works
The Effects of Teacher Fidelity of Implementation of Pathways to Health on Student Outcomes
Little, M. A., Riggs, N. R., Shin, H.-S., Tate, E. B., & Pentz, M. A. (2013) · Evaluation & the Health Professions · doi:10.1177/0163278713489879 · Cited by 21 · see citing works
Fagan, A. A., Hawkins, J. D., & Catalano, R. F. (2008) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195327892.003.0016 · Cited by 22 · see citing works
Self-citationWider and deeper: The future of criminology in Europe
Smith, D. J. (2013) · European Journal of Criminology · doi:10.1177/1477370813500885 · Cited by 20 · see citing works
“A further body of evidence shows that the more faithfully and fully a programme is implemented, the more likely it is to work (Durlak and DuPre, 2008; Fagan et al., 2008; Wandersman et al., 2008).”
BackgroundLower‐Hoppe, L. M., Anderson‐Butcher, D., Lo, M., & Turner, B. A. (2020) · Leisure/Loisir · doi:10.1080/14927713.2020.1815564 · Cited by 20 · see citing works
Monahan, K. C., Hawkins, J. D., & Abbott, R. D. (2012) · Prevention Science · doi:10.1007/s11121-012-0298-x · Cited by 20 · see citing works
“The Community Youth Development Study (CYDS) is the first community-randomized trial of CTC (Fagan et al. 2008; Hawkins et al. 2008).”
Self-citationFactor Validation of a Fidelity of Implementation Measure for Social Behavior Systems
Massar, M. M., McIntosh, K., & Mercer, S. H. (2017) · Remedial and Special Education · doi:10.1177/0741932517736515 · Cited by 19 · see citing works
Cantu, A., Hill, L., & Becker, L. (2010) · Journal of Children's Services · doi:10.5042/jcs.2010.0692 · Cited by 18 · see citing works
“…trial remained faithful to the content and design of the programme as intended (Chen, 1998) and as reported in experimental trials of the same programme (Spoth et al, 2002; Spoth et al, 2003; Spoth et al, 2007; Fagan et al, 2008); and (2) whether implementation quality affected programme outcomes.”
BackgroundResultHansen, W. B. (2014) · Springer eBooks · doi:10.1007/978-1-4899-7424-2_15 · Cited by 19 · see citing works
Service Providers’ Adherence to an Evidence-Based Parenting Program: What are They Missing and Why?
Taylor, W. D., Asgary-Eden, V., Lee, C. M., & LaRoche, K. J. (2013) · Journal of Child and Family Studies · doi:10.1007/s10826-013-9812-4 · Cited by 19 · see citing works
“Although self-reported adherence has been found to be highly associated with observed adherence (Fagan et al. 2008), it has also been found to be an overestimate (Ward et al. 2013).”
BackgroundEvaluating Environmental Change Strategies: Challenges and Solutions
Pettibone, K. G., Friend, K. B., Nargiso, J. E., & Florin, P. R. (2012) · American Journal of Community Psychology · doi:10.1007/s10464-012-9556-0 · Cited by 18 · see citing works
“Process evaluation challenges include assessing implementation fidelity (Treno and Lee 2002), measuring dosage (Holder et al. 1997a), and operationalizing, quantifying, and attributing effects of a strategy to changes in intermediary outcomes (DeGroff et al. 2010; Fagan et al. 2008; Ohmer 2008).”
BackgroundYouth Work: A Systematic Map of the Research Literature
Dickson, K., Vigurs, C., & Newman, M. (2013) · PsycEXTRA Dataset · doi:10.1037/e509412014-001 · Cited by 18 · see citing works
Implementación y adaptación en Colombia del sistema preventivo Communities That Care
Mejía‐Trujillo, J., Pérez‐Gómez, A., & Reyes, M. F. (2015) · Adicciones · doi:10.20882/adicciones.750 · Cited by 17 · see citing works
Horn, M. L. V., Fagan, A. A., Hawkins, J. D., & Oesterle, S. (2014) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2014.04.004 · Cited by 17 · see citing works
Self-citationEffect of the Communities That Care Prevention System on Adolescent Handgun Carrying
Rowhani‐Rahbar, A., Oesterle, S., Gause, E. L., Kuklinski, M. R., Ellyson, A. M., Schleimer, J. P., Dalve, K., Weybright, E. H., Briney, J. S., & Hawkins, J. D. (2023) · JAMA Network Open · doi:10.1001/jamanetworkopen.2023.6699 · Cited by 16 · see citing works
Self-citationChapter 4 Adapting Research-Based Practices with Fidelity: Flexibility by Design
Johnson, L., & McMaster, K. L. (2013) · Advances in learning and behavioral disabilities · doi:10.1108/s0735-004x(2013)0000026006 · Cited by 16 · see citing works
“The Community Youth Development Study (CYDS; Fagan et al., 2008) exemplifies how empirical information may inform flexible implementation of interventions.”
BackgroundKim, B. E., Gilman, A. B., & Hawkins, J. D. (2014) · Springer eBooks · doi:10.1007/978-3-319-08720-7_28 · Cited by 15 · see citing works
Self-citationEfficient Implementation Monitoring in Routine Prevention Practice: A Grand Challenge for Schools
Shapiro, V. B., Kim, B. E., Robitaille, J. L., LeBuffe, P. A., & Ziemer, K. L. (2018) · Journal of the Society for Social Work and Research · doi:10.1086/699153 · Cited by 15 · see citing works
Transforming Prevention Systems in the United States and The Netherlands Using Communities That Care
Steketee, M., Oesterle, S., Jonkman, H., Hawkins, J. D., Haggerty, K. P., & Aussems, C. (2013) · European Journal on Criminal Policy and Research · doi:10.1007/s10610-012-9194-y · Cited by 15 · see citing works
“…community key leaders, and implementation of a greater number of tested and effective interventions and with greater fidelity compared to control communities (Arthur et al. 2010; Brown et al. 2008; Brown et al. 2007; Brown et al. 2011; Fagan et al. 2011, 2008a, 2008b, 2009; Quinby et al. 2008).”
Self-citationGiles, S. M., Pankratz, M. M., Ringwalt, C., Jackson‐Newsom, J., Hansen, W. B., Bishop, D. C., Dusenbury, L., & Gottfredson, N. C. (2012) · Journal of Drug Education · doi:10.2190/de.42.4.b · Cited by 15 · see citing works
Using implementation evaluation to uncover a child neglect prevention program
Bérubé, A., Lafantaisie, V., Dubeau, D., Coutu, S., Caron, J., & Devault, A. (2014) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2014.03.001 · Cited by 14 · see citing works
Process Evaluation of a Positive Youth Development Program: Project P.A.T.H.S
Law, B. M. F., & Shek, D. T. L. (2011) · Research on Social Work Practice · doi:10.1177/1049731511404436 · Cited by 14 · see citing works
An innovative medical and dental hygiene clinic for street youth: Results of a process evaluation
Rowan, M. S., Mason, M., Robitaille, A., Labrecque, L., & Tocchi, C. L. (2013) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2013.04.005 · Cited by 13 · see citing works
Exploring the concept of research utilization: Implications for evidence-based crime prevention
Cherney, A. (2009) · Crime Prevention and Community Safety · doi:10.1057/cpcs.2009.4 · Cited by 12 · see citing works
Axford, N., & Hobbs, T. (2010) · Child Indicators Research · doi:10.1007/s12187-010-9074-2 · Cited by 11 · see citing works
Process Evaluation of a Positive Youth Development Program in Hong Kong Based on Different Cohorts
Law, B. M. F., & Shek, D. T. L. (2012) · The Scientific World JOURNAL · doi:10.1100/2012/736730 · Cited by 11 · see citing works
“It is an important factor affecting the quality of program implementation [3, 29].”
BackgroundRetractedAssessing Sustained Effects of Communities That Care on Youth Protective Factors
Kim, B. E., Oesterle, S., Hawkins, J. D., & Shapiro, V. B. (2015) · Journal of the Society for Social Work and Research · doi:10.1086/684163 · Cited by 11 · see citing works
“CTC communities also selected and implemented more tested and effective prevention programs than control communities, and CTC communities’ implementations had high adherence to core program components, high-quality delivery, and met the required dosage (Fagan et al., 2008b).”
BackgroundSelf-citationThe Logic and Practice of the Prevention of Mental Disorders
Mendelson, T., Pas, E. T., Leis, J. A., Bradshaw, C. P., Rebok, G. W., & Mandell, W. (2012) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195390445.003.0017 · Cited by 11 · see citing works
La salud comunitaria en los equipos de atención primaria: objetivo de dirección
Adell, C. N., Rua, M. P., Soler, J. C., Alvarez, C. S., & Farga, A. E. (2016) · Atención Primaria · doi:10.1016/j.aprim.2015.10.009 · Cited by 11 · see citing works
Rhew, I. C., Oesterle, S., Coffman, D. L., & Hawkins, J. D. (2018) · Evaluation & the Health Professions · doi:10.1177/0163278718759397 · Cited by 11 · see citing works
Self-citationTelleen, S., Kim, Y. O., & Pesce, R. C. (2009) · Journal of Prevention & Intervention in the Community · doi:10.1080/10852350903196340 · Cited by 10 · see citing works
“Program monitoring has been found to be critical to implementation and reaching targeted outcomes across a variety of violence prevention programs (Fagan, Hanson, Hawkins, & Arthur, 2008 ).”
BackgroundBehavioral Health and Disasters: Looking to the Future
Palinkas, L. A. (2014) · The Journal of Behavioral Health Services & Research · doi:10.1007/s11414-013-9390-7 · Cited by 10 · see citing works
- Authors
- Fagan, A. A., Hanson, K., Hawkins, J. D., & Arthur, M. W.
- Affiliations
- University of South Carolina (US)
- University of Washington (US)
- Corresponding author
- Fagan, Abigail A.
- Venue
- American Journal of Community Psychology
- Publisher
- Wiley
- Published
- 2008-02-27
- Volume
- 41
- Issue
- 3-4
- Pages
- 235-249
- ISSN
- 0091-0562 (ISSN-L)
- 1573-2770
- OpenAlex
- W2053091076
- Cited by
- 171
- References
- 43
- Citations by year
- 2026: 3 · 2025: 1 · 2024: 5 · 2023: 4 · 2022: 2 · 2021: 4 · 2020: 2 · 2019: 10 · 2018: 10 · 2017: 7 · 2016: 12 · 2015: 12 · 2014: 16 · 2013: 21 · 2012: 17
- FWCI
- 28.92
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- American Journal of Community Psychology (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institutes of Health
- National Institute on Drug Abuse (R01DA015183)
- National Cancer Institute
- Center for Substance Abuse Prevention
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Sociology and Political Science › Crime Patterns and Interventions
- Health Sciences › Health Professions › General Health Professions › Community Health and Development
- Keywords
- implementation fidelity, prevention program implementation, Communities That Care, implementation monitoring, evidence-based prevention programs, program adaptation, community-based prevention, research-practice gap
- MeSH terms
- Adolescent, Adolescent Behavior, Data Collection, Health Promotion, Humans, Risk-Taking, United States, Program Evaluation, Community Networks, Evidence-Based Medicine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review