Implementation Matters: A Review of Research on the Influence of Implementation on Program Outcomes and the Factors Affecting Implementation
The DOI matches its Crossref record; 177 of the 177 references it cites were found in a registry or an index.
Abstract
The first purpose of this review was to assess the impact of implementation on program outcomes, and the second purpose was to identify factors affecting the implementation process. Results from over quantitative 500 studies offered strong empirical support to the conclusion that the level of implementation affects the outcomes obtained in promotion and prevention programs. Findings from 81 additional reports indicate there are at least 23 contextual factors that influence implementation. The implementation process is affected by variables related to communities, providers and innovations, and aspects of the prevention delivery system (i.e., organizational functioning) and the prevention support system (i.e., training and technical assistance). The collection of implementation data is an essential feature of program evaluations, and more information is needed on which and how various factors influence implementation in different community settings.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Unfortunately, despite strong evidence for a wide variety of universal prevention programs for student mental health, findings suggest that inconsistent implementation is common and that problems with delivery attenuate their impact [50–53].”
From Leading the charge in the education sector: development and validation of the School Implementation Leadership Scale (SILS) (2022) · cites this paper as [50]
In the citing paper
“The presence of a positive culture which was receptive to change and valued innovation was viewed as important for implementation [32, 41, 58].”
From Achieving change in primary care—causes of the evidence to practice gap: systematic reviews of reviews (2015) · cites this paper as [32]
In the citing paper
“Secondary themes associated with policy and legislation included fit with local or national agenda, where compatibility between interventions and local or national policies, or an organisation’s mission, priorities and values promoted adoption [16, 32].”
From Achieving change in primary care—causes of the evidence to practice gap: systematic reviews of reviews (2015) · cites this paper as [32]
In the citing paper
“Positive and trusting inter-professional relationships through the presence of bi-directional communication and giving staff abundant opportunity to discuss salient matters and provide input to challenges before and during implementation were perceived to be facilitators [32, 41, 55].”
From Achieving change in primary care—causes of the evidence to practice gap: systematic reviews of reviews (2015) · cites this paper as [32]
In the citing paper
“competencies, e.g. adequate training and good computer experience/skills were shown to facilitate implementation [16, 17, 31, 32, 34, 41, 42, 44, 54–58, 60, 67, 70, 77, 80, 81, 84–86].”
From Achieving change in primary care—causes of the evidence to practice gap: systematic reviews of reviews (2015) · cites this paper as [32]
21 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Rogers, E. M., Singhal, A., & Quinlan, M. M. (2019) · An Integrated Approach to Communication Theory and Research · doi:10.4324/9780203710753-35 · Cited by 37,322
(2005) · Cited by 3,748
Bellg, A. J., Treatment Fidelity Workgroup of the NIH Behavior Change Consortium, Borrelli, B., Resnick, B., Hecht, J., Minicucci, D. S., Ory, M., Ogedegbe, G., Orwig, D., Ernst, D., et al. (2004) · Health Psychology · doi:10.1037/0278-6133.23.5.443 · Cited by 2,620
Community Programs to Promote Youth Development
(2002) · National Academies Press eBooks · doi:10.17226/10022 · Cited by 2,020
Dusenbury, L. (2003) · Health Education Research · doi:10.1093/her/18.2.237 · Cited by 1,671
Dane, A. V., & Schneider, B. H. (1998) · Clinical Psychology Review · doi:10.1016/s0272-7358(97)00043-3 · Cited by 1,557 · cited 5×
“For example, Dane and Schneider (1998) found that only 39 of 162 (24”
BackgroundInfluentialEffectiveness of mentoring programs for youth: A meta-analytic review
DuBois, D. L., Holloway, B. E., Valentine, J. C., & Cooper, H. (2002) · American Journal of Community Psychology · doi:10.1023/a:1014628810714 · Cited by 1,544 · cited 1×
“For example, in a review of 59 mentoring studies, DuBois et al. (2002) found programs that monitored implementation obtained effect sizes three times larger than programs that reported no monitoring (mean effects of 0.18 vs. 0.06, respectively).”
BackgroundInfluentialAmerican Psychological Association (2003) · American Psychologist · doi:10.1037/0003-066x.58.5.377 · Cited by 1,445
Wandersman, A., Duffy, J., Flaspohler, P., Noonan, R., Lubell, K., Stillman, L., Blachman, M., Dunville, R., & Saul, J. (2008) · American Journal of Community Psychology · doi:10.1007/s10464-008-9174-z · Cited by 1,339
(1999) · PubMed · Cited by 1,155
Shediac-Rizkallah, M. C., & Bone, L. R. (1998) · Health Education Research · doi:10.1093/her/13.1.87 · Cited by 1,129 · cited 3×
“Our focus was on capacity relative to successful implementation, and we hypothesized that a multilevel ecological perspective was necessary for understanding successful implementation, a view shared by several other authors (Altschuld et al. 1999; Riley et al. 2001; Shediac-Rizkallah and Bone 1998; Wandersman 2003).”
BackgroundResultBotvin, G. J. (1995) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1995.03520380042033 · Cited by 974
Mahoney, J. L., Larson, R. W., & Eccles, J. S. (2005) · Medical Entomology and Zoology · Cited by 959
Fidelity Criteria: Development, Measurement, and Validation
MOWBRAY, C. (2003) · The American Journal of Evaluation · doi:10.1016/s1098-2140(03)00057-2 · Cited by 884
Research on Curriculum and Instruction Implementation
Fullan, M., & Pomfret, A. (1977) · Review of Educational Research · doi:10.2307/1170134 · Cited by 732
Is Sustainability Possible? A Review and Commentary on Empirical Studies of Program Sustainability
Scheirer, M. A. (2005) · American Journal of Evaluation · doi:10.1177/1098214005278752 · Cited by 710 · cited 2×
“…were used to identify factors affecting implementation, and for this area we also included the commentaries of several authors based on their extensive research or field experiences (e.g., Elias et al. 2003; Hogan et al. 2003; Kealey et al. 2000; Mihalic et al. 2004; Scheirer, 2005; Wolff, 2001).”
MethodTobler, N. S. (1986) · Journal of Drug Issues · doi:10.1177/002204268601600405 · Cited by 649
The effects of school-based intervention programs on aggressive behavior: A meta-analysis.
Wilson, S. J., Lipsey, M. W., & Derzon, J. H. (2003) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.71.1.136 · Cited by 601
Botvin, G. J., Baker, E., Dusenbury, L., & Tortu, S. (1990) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.58.4.437 · Cited by 565
The Effectiveness of Whole-School Antibullying Programs: A Synthesis of Evaluation Research
Smith, J. D., Schneider, B. H., Smith, P. K., & Ananiadou, K. (2004) · School Psychology Review · doi:10.1080/02796015.2004.12086267 · Cited by 561
State of the Science on Psychosocial Interventions for Ethnic Minorities
Miranda, J., Bernal, G., Lau, A., Kohn, L., Hwang, W.-C., & LaFromboise, T. (2005) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.1.102803.143822 · Cited by 534
Examining the Role of Implementation Quality in School-Based Prevention Using the PATHS Curriculum
Kam, C.-M., Greenberg, M. T., & Walls, C. T. (2003) · Prevention Science · doi:10.1023/a:1021786811186 · Cited by 515
Elias, M. J., Zins, J. E., Graczyk, P. A., & Weissberg, R. P. (2003) · School Psychology Review · doi:10.1080/02796015.2003.12086200 · Cited by 483
Quality of School-Based Prevention Programs: Results from a National Survey
Gottfredson, D. C., & Gottfredson, G. D. (2002) · Journal of Research in Crime and Delinquency · doi:10.1177/002242780203900101 · Cited by 474
Diffusion of Innovations in Health Service Organisations: A Systematic Literature Review
Greenhalgh, T., Robert, G., Bate, P., Macfarlane, F., & Kyriakidou, O. (2007) · Cited by 453
Noell, G. H., Witt, J. C., Slider, N. J., Connell, J. E., Gatti, S. L., Williams, K. L., Koenig, J. L., Resetar, J. L., & Duhon, G. J. (2005) · School Psychology Review · doi:10.1080/02796015.2005.12086277 · Cited by 453
Preventing drug abuse in schools
Botvin, G. J. (2000) · Addictive Behaviors · doi:10.1016/s0306-4603(00)00119-2 · Cited by 446
Diffusion of a School-Based Substance Abuse Prevention Program: Predictors of Program Implementation
Rohrbach, L. A., Graham, J. W., & Hansen, W. B. (1993) · Preventive Medicine · doi:10.1006/pmed.1993.1020 · Cited by 431
Domitrovich, C. E., & Greenberg, M. T. (2000) · Journal of Educational and Psychological Consultation · doi:10.1207/s1532768xjepc1102_04 · Cited by 428
Ialongo, N. S., Werthamer, L., Kellam, S. G., Brown, C. H., Wang, S., & Lin, Y. (1999) · American Journal of Community Psychology · doi:10.1023/a:1022137920532 · Cited by 425
Implementation of Educational Innovation
Berman, P., & McLaughlin, M. W. (1976) · The Educational Forum · doi:10.1080/00131727609336469 · Cited by 410
Initial impact of the fast track prevention trial for conduct problems: II. Classroom effects.
Conduct Problems Prevention Research Group (1999) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.67.5.648 · Cited by 401
School Physical Education: Effect of the Child and Adolescent Trial for Cardiovascular Health
McKenzie, T. L., Nader, P. R., Strikmiller, P. K., Yang, M., Stone, E. J., Perry, C. L., Taylor, W. C., Epping, J. N., Feldman, H. A., Luepker, R. V., et al. (1996) · Preventive Medicine · doi:10.1006/pmed.1996.0074 · Cited by 360
Solomon, D., Battistich, V., Watson, M., Schaps, E., & Lewis, C. (2000) · Social Psychology of Education · doi:10.1023/a:1009609606692 · Cited by 359
Connell, D. B., Turner, R. R., & Mason, E. F. (1985) · Journal of School Health · doi:10.1111/j.1746-1561.1985.tb05656.x · Cited by 359
Empirical and clinical focus of child and adolescent psychotherapy research.
Kazdin, A. E., Bass, D. C., Ayers, W. A., & Rodgers, A. Y. (1990) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.58.6.729 · Cited by 355
Battistich, V., Schaps, E., & Wilson, N. (2004) · Journal of Primary Prevention · doi:10.1023/b:jopp.0000018048.38517.cd · Cited by 335
A cognitive-behavioral approach to substance abuse prevention
Botvin, G. J., Baker, E., Renick, N. L., Filazzola, A. D., & Botvin, E. M. (1984) · Addictive Behaviors · doi:10.1016/0306-4603(84)90051-0 · Cited by 327
Community Science: Bridging the Gap between Science and Practice with Community‐Centered Models
Wandersman, A. (2003) · American Journal of Community Psychology · doi:10.1023/a:1023954503247 · Cited by 322
Forgatch, M. S., Patterson, G. R., & DeGarmo, D. S. (2005) · Behavior Therapy · doi:10.1016/s0005-7894(05)80049-8 · Cited by 320
A cognitive-behavioral approach to substance abuse prevention: One-year follow-up
Botvin, G. J., Baker, E., Filazzola, A. D., & Botvin, E. M. (1990) · Addictive Behaviors · doi:10.1016/0306-4603(90)90006-j · Cited by 313
The fidelity‐adaptation debate: Implications for the implementation of public sector social programs
Blakely, C. H., Mayer, J. P., Gottschalk, R. G., Schmitt, N., Davidson, W. S., Roitman, D. B., & Emshoff, J. G. (1987) · American Journal of Community Psychology · doi:10.1007/bf00922697 · Cited by 297 · cited 4×
“Nevertheless, three quantitative studies have found that adaptations made by providers improved program outcomes (Blakely et al. 1987; McGraw et al. 1996; Kerr et al. 1985).”
BackgroundInfluentialNoell, G. H., Witt, J. C., Gilbertson, D. N., Ranier, D. D., & Freeland, J. T. (1997) · School Psychology Quarterly · doi:10.1037/h0088949 · Cited by 295
Initial Impact of the Fast Track Prevention Trial for Conduct Problems: II. Classroom Effects
Bierman, K. L., Coie, J. D., Dodge, K. A., Greenberg, M. T., Lochman, J. E., McMahon, R. J., & Pinderhughes, E. E. (1999) · Journal of Consulting and Clinical Psychology · Cited by 290
Empirical and clinical focus of child and adolescent psychotherapy research.
Kazdin, A. E., Bass, D., Ayers, W. A., & Rodgers, A. (1990) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.58.6.729 · Cited by 290
Contributions of qualitative research to the validity of intervention research
Nastasi, B. K., & Schensul, S. L. (2005) · Journal of School Psychology · doi:10.1016/j.jsp.2005.04.003 · Cited by 280
Successful Prevention Programs for Children and Adolescents
Durlak, J. A. (1997) · Issues in Clinical Child Psychology · doi:10.1007/978-1-4899-0065-4 · Cited by 276
Self-citationRingwalt, C. L., Ennett, S., Johnson, R., Rohrbach, L. A., Simons-Rudolph, A., Vincus, A., & Thorne, J. (2003) · Health Education & Behavior · doi:10.1177/1090198103030003010 · Cited by 273
Kallestad, J. H., & Olweus, D. (2003) · Prevention & Treatment · doi:10.1037/1522-3736.6.1.621a · Cited by 272
Harachi, T. W., Abbott, R. D., Catalano, R. F., Haggerty, K. P., & Fleming, C. B. (1999) · American Journal of Community Psychology · doi:10.1023/a:1022194005511 · Cited by 269
Lapan, R. T., Gysbers, N. C., & Petroski, G. F. (2001) · Journal of Counseling & Development · doi:10.1002/j.1556-6676.2001.tb01977.x · Cited by 244
Avoiding Type III Errors in Health Education Program Evaluations: A Case Study
Basch, C. E., Sliepcevich, E. M., Gold, R. S., Duncan, D. F., & Kolbe, L. J. (1985) · Health Education Quarterly · doi:10.1177/109019818501200311 · Cited by 244
Why Program Implementation is Important
Durlak, J. A. (1998) · Journal of Prevention & Intervention in the Community · doi:10.1300/j005v17n02_02 · Cited by 236
Self-citationSchool-Based Prevention Programs for Children and Adolescents
Durlak, J. (1995) · Sage eBooks · doi:10.4135/9781483327396 · Cited by 234
Self-citationABER, J. L., JONES, S. M., BROWN, J. L., CHAUDRY, N., & SAMPLES, F. (1998) · Development and Psychopathology · doi:10.1017/s0954579498001576 · Cited by 230
Kendrick, J. S., Zahniser, S. C., Miller, N., Salas, N., Stine, J., Gargiullo, P. M., Floyd, R. L., Spierto, F. W., Sexton, M., & Metzger, R. W. (1995) · American Journal of Public Health · doi:10.2105/ajph.85.2.217 · Cited by 225
Managing Adolescent Behavior A Multiyear, Multischool Study
Gottfredson, D. C., Gottfredson, G. D., & Hybl, L. G. (1993) · American Educational Research Journal · doi:10.2307/1163194 · Cited by 221
Kegler, M. C., Steckler, A., Mcleroy, K., & Malek, S. H. (1998) · Health Education & Behavior · doi:10.1177/109019819802500308 · Cited by 221
Comer's School Development Program in Chicago: A Theory-Based Evaluation
Cook, T. D., Murphy, R. F., & Hunt, H. D. (2000) · American Educational Research Journal · doi:10.2307/1163533 · Cited by 220
Payne, A. A., Gottfredson, D. C., & Gottfredson, G. D. (2006) · Prevention Science · doi:10.1007/s11121-006-0029-2 · Cited by 210
Effects of the Child Development Project on Students' Drug Use and Other Problem Behaviors
Battistich, V., Schaps, E., Watson, M., Solomon, D., & Lewis, C. (2000) · Journal of Primary Prevention · doi:10.1023/a:1007057414994 · Cited by 208
Reinventing fidelity: The transfer of social technology among settings
Bauman, L. J., Stein, R. E. K., & Ireys, H. T. (1991) · American Journal of Community Psychology · doi:10.1007/bf00937995 · Cited by 208
(2000) · American Journal of Public Health · doi:10.2105/ajph.90.7.1082 · Cited by 207
Stotts, A. L., DiClemente, C. C., & Dolan-Mullen, P. (2002) · Addictive Behaviors · doi:10.1016/s0306-4603(01)00174-5 · Cited by 205
Implementing Community-Based Prevention Programming: A Review of the Literature
Stith, S. M., Pruitt, I. T. P., Dees, J., Fronce, M., Green, N., Som, A., & Linkh, D. J. (2006) · The Journal of Primary Prevention · doi:10.1007/s10935-006-0062-8 · Cited by 200
Evaluating community coalition characteristics and functioning: a summary of measurement tools
Granner, M. L. (2004) · Health Education Research · doi:10.1093/her/cyg056 · Cited by 199
Fagan, A. A., & Mihalic, S. (2003) · Journal of Community Psychology · doi:10.1002/jcop.10045 · Cited by 197
Smoking prevention among urban minority youth: Assessing effects on outcome and mediating variables.
Botvin, G. J., Dusenbury, L., Baker, E., & James-Ortiz, S. (1992) · Health Psychology · doi:10.1037//0278-6133.11.5.290 · Cited by 193
Felner, R., Jackson, A. W., Kasak, D., Mulhall, P., Brand, S., & Flowers, N. (1997) · Preparing Adolescents for the Twenty-First Century · doi:10.1017/cbo9780511600913.005 · Cited by 190
Teacher Training as a Behavior Change Process: Principles and Results from a Longitudinal Study
Kealey, K. A., Peterson, A. V., Gaul, M. A., & Dinh, K. T. (2000) · Health Education & Behavior · doi:10.1177/109019810002700107 · Cited by 187
Changing teaching practices to promote achievement and bonding to school.
Abbott, R. D., O'Donnell, J., Hawkins, J. D., Hill, K. G., Kosterman, R., & Catalano, R. F. (1998) · American Journal of Orthopsychiatry · doi:10.1037/h0080363 · Cited by 182
Hansen, W. B., Graham, J. W., Wolkenstein, B. H., & Rohrbach, L. A. (1991) · Journal of Studies on Alcohol · doi:10.15288/jsa.1991.52.568 · Cited by 179
Pentz, M. A., Trebow, E. A., Hansen, W. B., MacKinnon, D. P., Dwyer, J. H., Johnson, C. A., Flay, B. R., Daniels, S., & Cormack, C. (1990) · Evaluation Review · doi:10.1177/0193841x9001400303 · Cited by 172
Layers of identity: Multiple psychological senses of community within a community setting
Brodsky, A. E., & Marx, C. M. (2001) · Journal of Community Psychology · doi:10.1002/1520-6629(200103)29:2<161::aid-jcop1011>3.0.co;2-1 · Cited by 170
A skills training approach to smoking prevention among hispanic youth
Botvin, G. J., Dusenbury, L., Baker, E., James-Ortiz, S., & Kerner, J. (1989) · Journal of Behavioral Medicine · doi:10.1007/bf00844872 · Cited by 167
Chinman, M., Hannah, G., Wandersman, A., Ebener, P., Hunter, S. B., Imm, P., & Sheldon, J. (2005) · American Journal of Community Psychology · doi:10.1007/s10464-005-3390-6 · Cited by 166
Noell, G. H., Duhon, G. J., Gatti, S. L., & Connell, J. E. (2002) · School Psychology Review · doi:10.1080/02796015.2002.12086152 · Cited by 165
A Practitioner's Guide to Successful Coalitions
Wolff, T. (2001) · American Journal of Community Psychology · doi:10.1023/a:1010366310857 · Cited by 163
Evaluation of a High School Peer Group Intervention for At-Risk Youth
Cho, H., Hallfors, D. D., & Sánchez, V. (2005) · Research on Child and Adolescent Psychopathology · doi:10.1007/s10802-005-3574-4 · Cited by 155
McCormick, L. K., Steckler, A. B., & McLeroy, K. R. (1995) · American Journal of Health Promotion · doi:10.4278/0890-1171-9.3.210 · Cited by 154
The effects of direct training and treatment integrity on treatment outcomes in school consultation.
Sterling-Turner, H. E., Watson, T. S., & Moore, J. W. (2002) · School Psychology Quarterly · doi:10.1521/scpq.17.1.47.19906 · Cited by 154
Bloom, H. S., Hill, C. J., & Riccio, J. A. (2003) · Journal of Policy Analysis and Management · doi:10.1002/pam.10154 · Cited by 149
Pediatric Office-Based Smoking Intervention: Impact On Maternal Smoking and Relapse
Wall, M. A., Severson, H. H., Andrews, J. A., Lichtenstein, E., & Zoref, L. (1995) · Pediatrics · doi:10.1542/peds.96.4.622 · Cited by 148
Program sustainability begins with the first events
Pluye, P., Potvin, L., Denis, J.-L., Pelletier, J., & Mannoni, C. (2005) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2004.10.003 · Cited by 147
Elias, M. J., Gara, M., Ubriaco, M., Rothbaum, P. A., Clabby, J. F., & Schuyler, T. (1986) · American Journal of Community Psychology · doi:10.1007/bf00911174 · Cited by 141
Comer's School Development Program in Prince George's County, Maryland: A Theory-Based Evaluation
Cook, T. D., Habib, F.-N., Phillips, M., Settersten, R. A., Shagle, S. C., & Degirmencioglu, S. M. (1999) · American Educational Research Journal · doi:10.2307/1163550 · Cited by 140
Fidelity of Problem-Solving Implementation and Relationship to Student Performance
Telzrow, C. F., McNamara, K., & Hollinger, C. L. (2000) · School Psychology Review · doi:10.1080/02796015.2000.12086029 · Cited by 139
Smoking prevention among urban minority youth: Assessing effects on outcome and mediating variables.
Botvin, G. J., Dusenbury, L., Baker, E., et al. (1992) · Health Psychology · doi:10.1037/0278-6133.11.5.290 · Cited by 134
Diffusion of an Integrated Health Education Program in an Urban School System: Planet Health
Wiecha, J. L. (2004) · Journal of Pediatric Psychology · doi:10.1093/jpepsy/jsh050 · Cited by 133
Chinman, M., Imm, P., & Wandersman, A. (2004) · Cited by 132
How best to measure implementation of school health curricula: a comparison of three measures
Resnicow, K., Davis, M., Smith, M., Lazarus-Yaroch, A., Baranowski, T., Baranowski, J., Doyle, C., & Wang, D. T. (1998) · Health Education Research · doi:10.1093/her/13.2.239 · Cited by 130
Lillehoj, C. J. (., Griffin, K. W., & Spoth, R. (2004) · Health Education & Behavior · doi:10.1177/1090198103260514 · Cited by 128
Perry, C. L., Sellers, D. E., Johnson, C., Pedersen, S., Bachman, K. J., Parcel, G. S., Stone, E. J., Luepker, R. V., Wu, M., Nader, P. R., et al. (1997) · Health Education & Behavior · doi:10.1177/109019819702400607 · Cited by 123
Saunders, R. P., Ward, D., Felton, G. M., Dowda, M., & Pate, R. R. (2006) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2006.08.006 · Cited by 112 · cited 1×
“…Of Measures Aspect of Implementation Rohrbach et al. (1993) Substance abuse prevention 1 Fidelity Self-report & observation Categorical 3 of 6 Saunders et al. (2006) Physical health promotion 2 Fidelity & dosage Observations, interviews & record review Categorical 1 of 1 Solomon et al.…”
BackgroundStory, M., Mays, R. W., Bishop, D. B., Perry, C. L., Taylor, G., Smyth, M., & Gray, C. (2000) · Health Education & Behavior · doi:10.1177/109019810002700205 · Cited by 112
THE CLASSWIDE PEER TUTORING PROGRAM: IMPLEMENTATION FACTORS MODERATING STUDENTS' ACHIEVEMENT
Greenwood, C. R., Terry, B., Arreaga‐Mayer, C., & Finney, R. (1992) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.1992.25-101 · Cited by 111
Teenage Health Teaching Modules: Impact of Teacher Training on Implementation and Student Outcomes
Ross, J. G., Luepker, R. V., Nelson, G. D., Saavedra, P., & Hubbard, B. M. (1991) · Journal of School Health · doi:10.1111/j.1746-1561.1991.tb07856.x · Cited by 111
A Three-Year Evaluation of the Know Your Body Program in Inner-City Schoolchildren
Resnicow, K., Cohn, L., Reinhardt, J., Cross, D., Futterman, R., Kirschner, E., Wynder, E. L., & Allegrante, J. P. (1992) · Health Education Quarterly · doi:10.1177/109019819201900410 · Cited by 110
James, S., Reddy, P., Ruiter, R. A. C., McCauley, A., & Borne, B. V. D. (2006) · AIDS Education and Prevention · doi:10.1521/aeap.2006.18.4.281 · Cited by 108
Bourque, S. L. (1998) · The Journal of Primary Prevention · doi:10.1023/a:1022657710171 · Cited by 107
Whole School Improvement and Restructuring as Prevention and Promotion
Felner, R. D., Favazza, A., Shim, M., Brand, S., Gu, K., & Noonan, N. (2001) · Journal of School Psychology · doi:10.1016/s0022-4405(01)00057-7 · Cited by 107
Estimating Intervention Effectiveness: Synthetic Projection of Field Evaluation Results
Derzon, J. H., Sale, E. W., Springer, J. F., & Brounstein, P. J. (2005) · The Journal of Primary Prevention · doi:10.1007/s10935-005-5391-5 · Cited by 104
August, G. J., Lee, S. S., Bloomquist, M. L., Realmuto, G. M., & Hektner, J. M. (2003) · Prevention Science · doi:10.1023/a:1026072316380 · Cited by 102
Elder, J. P., Perry, C. L., Stone, E. J., Johnson, C., Yang, M., Edmundson, E. W., Smyth, M. H., Galati, T., Feldman, H. A., Cribb, P. W., et al. (1996) · Preventive Medicine · doi:10.1006/pmed.1996.0080 · Cited by 92
August, G. J., Bloomquist, M. L., Lee, S. S., Realmuto, G. M., & Hektner, J. M. (2006) · Prevention Science · doi:10.1007/s11121-005-0024-z · Cited by 90
Henderson, J. L., MacKay, S., & Peterson-Badali, M. (2006) · Journal of Clinical Child & Adolescent Psychology · doi:10.1207/s15374424jccp3501_1 · Cited by 89
A multiple case study of implementation in 10 local Project ASSIST coalitions in North Carolina
Kegler, M. C., Steckler, A., Malek, S. H., & McLeroy, K. (1998) · Health Education Research · doi:10.1093/her/13.2.225 · Cited by 88
Gingiss, P. L., Roberts-Gray, C. R., & Boerm, M. (2006) · Prevention Science · doi:10.1007/s11121-006-0038-1 · Cited by 86
Smith, D. W., McCormick, L. K., Steckler, A. B., & McLeroy, K. R. (1993) · Journal of School Health · doi:10.1111/j.1746-1561.1993.tb07151.x · Cited by 86
Efficacy of Training and Fidelity of Implementation of the Life Skills Training Program
Hahn, E. J., Noland, M. P., Rayens, M. K., & Christie, D. M. (2002) · Journal of School Health · doi:10.1111/j.1746-1561.2002.tb01333.x · Cited by 85
Bush, P. J., Zuckerman, A. E., Taggart, V. S., Theiss, P. K., Peleg, E. O., & Smith, S. A. (1989) · Health Education Quarterly · doi:10.1177/109019818901600206 · Cited by 85
Successful Program Implementation: Lessons from Blueprints: (300782005-001)
Milhalic, S., Irwin, K., Fagan, A., Ballard, D., & Elliott, D. (2004) · PsycEXTRA Dataset · doi:10.1037/e300782005-001 · Cited by 81
School-based smoking prevention: The teacher training process
Tortu, S., & Botvin, G. J. (1989) · Preventive Medicine · doi:10.1016/0091-7435(89)90075-3 · Cited by 79
Scheirer, M. A. (1990) · Journal of Health and Social Behavior · doi:10.2307/2137173 · Cited by 78
Noell, G. H., & Witt, J. C. (1999) · The Journal of Special Education · doi:10.1177/002246699903300103 · Cited by 78
FIELD REPLICATION OF CLASSWIDE PEER TUTORING
Greenwood, C. R., Dinwiddie, G., Bailey, V., Carta, J. J., Dorsey, D., Kohler, F. W., Nelson, C., Rotholz, D., & Schulte, D. (1987) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.1987.20-151 · Cited by 77
Reynolds, K. D., Franklin, F. A., Leviton, L. C., Maloy, J., Harrington, K. F., Yaroch, A. L., Person, S., & Jester, P. (2000) · Health Education & Behavior · doi:10.1177/109019810002700204 · Cited by 76
McGraw, S. A., Sellers, D. E., Johnson, C. C., Stone, E. J., Bachman, K. J., Bebchuk, J., Luepker, R. V., & Edmundson, E. W. (1996) · Evaluation Review · doi:10.1177/0193841x9602000304 · Cited by 75
Riley, B. L. (2001) · Health Education Research · doi:10.1093/her/16.4.425 · Cited by 73
Ary, D. V., Biglan, A., Glasgow, R. E., Zoref, L., Black, C., Ochs, L., Severson, H. H., Kelly, R., Weissman, W., Lichtenstein, E. H., et al. (1990) · Journal of Behavioral Medicine · doi:10.1007/bf00846835 · Cited by 69
Perry, C. L., Murray, D. M., & Griffin, G. (1990) · Journal of School Health · doi:10.1111/j.1746-1561.1990.tb05890.x · Cited by 69
Brief Report: The Adaptation of Project Northland for Urban Youth
Komro, K. A. (2004) · Journal of Pediatric Psychology · doi:10.1093/jpepsy/jsh049 · Cited by 69
Basen‐Engquist, K., O'Hara‐Tompkins, N., Lovato, C. Y., Lewis, M. J., Parcel, G. S., & Gingiss, P. (1994) · Journal of School Health · doi:10.1111/j.1746-1561.1994.tb03323.x · Cited by 66
Results of the TeachWell worksite wellness program.
Resnicow, K., Davis, M., Smith, M., Baranowski, T., Lin, L. S., Baranowski, J., Doyle, C., & Wang, D. T. (1998) · American Journal of Public Health · doi:10.2105/ajph.88.2.250 · Cited by 66
A Process Evaluation of the District of Columbia “Know Your Body” Project
Taggart, V. S., Bush, P. J., Zuckerman, A. E., & Theiss, P. K. (1990) · Journal of School Health · doi:10.1111/j.1746-1561.1990.tb05907.x · Cited by 65
Drug education practice: results of an observational study
Hansen, W. B. (1999) · Health Education Research · doi:10.1093/her/14.1.85 · Cited by 65
Riley, B., Taylor, S. M., & Elliott, S. J. (2003) · Health Education Research · doi:10.1093/her/cyf051 · Cited by 62
Greenwood, C. R., Tapia, Y., Abbott, M., & Walton, C. (2003) · The Journal of Special Education · doi:10.1177/00224669030370020401 · Cited by 61
Wandersman, A., Morrissey, E., Davino, K., Seybolt, D. C., Crusto, C. A., Nation, M. A., Goodman, R., & Imm, P. (1998) · The Journal of Primary Prevention · doi:10.1023/a:1022681407618 · Cited by 60
Dufrene, B. A., Noell, G. H., Gilbertson, D. N., & Duhon, G. J. (2005) · School Psychology Review · doi:10.1080/02796015.2005.12086276 · Cited by 59
Komro, K. A., Perry, C. L., Veblen‐Mortenson, S., Farbakhsh, K., Kugler, K. C., Alfano, K. A., Dudovitz, B., Williams, C. L., & Jones‐Webb, R. (2006) · The Journal of Primary Prevention · doi:10.1007/s10935-005-0029-1 · Cited by 58
Enhancing Implementation of the Teenage Health Teaching Modules
Parcel, G. S., Ross, J. G., Lavin, A. T., Portnoy, B., Nelson, G. D., & Winters, F. (1991) · Journal of School Health · doi:10.1111/j.1746-1561.1991.tb07857.x · Cited by 57
Reconciling Concept and Context: The Dilemma of Implementation in School-Based Health Promotion
MacDonald, M. A., & Green, L. W. (2001) · Health Education & Behavior · doi:10.1177/109019810102800607 · Cited by 56
Comprehensive evaluation of a model alcohol education curriculum.
Hopkins, R. H., Mauss, A. L., Kearney, K. A., & Weisheit, R. A. (1988) · Journal of Studies on Alcohol · doi:10.15288/jsa.1988.49.38 · Cited by 55
Scheirer, M. A., Shediac, M. C., & Cassady, C. E. (1995) · Health Education Research · doi:10.1093/her/10.1.11 · Cited by 53
Spoth, R., Guyll, M., Trudeau, L., & Goldberg‐Lillehoj, C. (2002) · Journal of Community Psychology · doi:10.1002/jcop.10021 · Cited by 53
Cunningham, P. B., & Henggeler, S. W. (2001) · Journal of Clinical Child & Adolescent Psychology · doi:10.1207/s15374424jccp3002_9 · Cited by 49
Intervention fidelity in family-based prevention counseling for adolescent problem behaviors
Hogue, A., Liddle, H. A., Singer, A., & Leckrone, J. (2005) · Journal of Community Psychology · doi:10.1002/jcop.20031 · Cited by 48
Cullen, K. W., Baranowski, T., Baranowski, J., Hebert, D., DeMoor, C., Hearn, M. D., & Resnicow, K. (1999) · Journal of School Health · doi:10.1111/j.1746-1561.1999.tb06433.x · Cited by 46
Gingiss, P. L. (1992) · Journal of School Health · doi:10.1111/j.1746-1561.1992.tb06035.x · Cited by 45
Hopper, C. A., Munoz, K. D., Gruber, M. B., MacConnie, S., Schonfeldt, B., & Shunk, T. (1996) · Children's Health Care · doi:10.1207/s15326888chc2503_5 · Cited by 45
Implication of Results: Factors for Success
Fors, S. W., & Doster, M. E. (1985) · Journal of School Health · doi:10.1111/j.1746-1561.1985.tb05658.x · Cited by 44
Long‐Term Implementation of the Teenage Health Teaching Modules by Trained Teachers: A Case Study
Tappe, M. K., Galer‐Unti, R. A., & Bailey, K. C. (1995) · Journal of School Health · doi:10.1111/j.1746-1561.1995.tb08203.x · Cited by 43
The Implementation and Institutionalization of a School-Based Youth Suicide Prevention Program
Kalafat, J. D., & Ryerson, D. M. (1999) · The Journal of Primary Prevention · doi:10.1023/a:1022658826641 · Cited by 39
Increasing Teacher Receptivity toward Use of Tobacco Prevention Education Programs
Gingiss, P. L., Gottlieb, N. H., & Brink, S. G. (1994) · Journal of Drug Education · doi:10.2190/2uxc-na52-cal0-g9rj · Cited by 39
A Multiple Case Study of Neighborhood Partnerships for Positive Youth Development
Kegler, M. C., & Wyatt, V. H. (2003) · American Journal of Health Behavior · doi:10.5993/ajhb.27.2.7 · Cited by 38
August, G. J., Egan, E. A., Realmuto, G. M., & Hektner, J. M. (2003) · Research on Child and Adolescent Psychopathology · doi:10.1023/a:1025401115430 · Cited by 37
Goldman, K. D. (1994) · Health Education Quarterly · doi:10.1177/109019819402100406 · Cited by 37
Stevens, V. K., Oost, P. V., & Bourdeaudhuij, I. D. (2001) · Journal of School Psychology · doi:10.1016/s0022-4405(01)00073-5 · Cited by 34
Dissemination of heart health promotion in the Ontario Public Health System: 1989-1999
Riley, B. (2003) · Health Education Research · doi:10.1093/her/18.1.15 · Cited by 33
Effects on Students of Teacher Training in Use of a Drug Education Curriculum
Allison, K. R., Silverman, G., & Dignam, C. (1990) · Journal of Drug Education · doi:10.2190/hdrv-3ryr-56fy-ym1x · Cited by 32
Bell, M. L., Kelley‐Baker, T., Rider, R. P., & Ringwalt, C. L. (2005) · Journal of School Health · doi:10.1111/j.1746-1561.2005.tb06667.x · Cited by 32
Dubas, J. S., Lynch, K. B., Galano, J., Geller, S. R., & Hunt, D. (1998) · Journal of Drug Education · doi:10.2190/vby0-rlxa-wj05-nprx · Cited by 31
Kerr, D. M., Kent, L., & Lam, T. C. M. (1985) · Evaluation Review · doi:10.1177/0193841x8500900405 · Cited by 31
Implementing the ecological approach in tobacco control programs: results of a case study
Richard, L., Lehoux, P., Breton, É., Denis, J., Labrie, L., & Léonard, C. (2004) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2004.07.004 · Cited by 30
Pierre, T. L. S., & Kaltreider, D. L. (2004) · American Journal of Evaluation · doi:10.1177/109821400402500405 · Cited by 29
Wandersman, A. H., Duffy, J. L., Flaspohler, P. D., Noonan, R. K., Lubell, K. M., Stillman, L., Blachman, M., Dunville, R. L., & Saul, J. R. (2007) · PsycEXTRA Dataset · doi:10.1037/e628612012-125 · Cited by 29
Smith, D. W., Redican, K. J., & Olsen, L. K. (1992) · Journal of School Health · doi:10.1111/j.1746-1561.1992.tb06022.x · Cited by 28
Cooke, M. (2000) · Health Promotion International · doi:10.1093/heapro/15.2.113 · Cited by 26
Dusenbury, L., Brannigan, R., Falco, M., & Lake, A. (2004) · Journal of alcohol and drug education · Cited by 25
Kramer, L., Laumann, G., & Brunson, L. (2000) · Journal of Educational and Psychological Consultation · doi:10.1207/s1532768xjepc1101_4 · Cited by 25
Community Readiness for Prevention
Engstrom, M., Jason, L. A., Townsend, S. M., Pokorny, S. B., & Curie, C. J. (2002) · Journal of Prevention & Intervention in the Community · doi:10.1300/j005v24n01_03 · Cited by 22
Process and Outcome Evaluation in Primary Prevention
Moskowitz, J. M., Schaps, E. M., & Malvin, J. H. (1982) · Evaluation Review · doi:10.1177/0193841x8200600604 · Cited by 20
The Research-to-Practice Ball Game
Vadasy, P. F., Jenkins, J. R., Antil, L. R., Phillips, N. B., & Pool, K. (1997) · Remedial and Special Education · doi:10.1177/074193259701800303 · Cited by 20
Winfree, L. T., Lynskey, D. P., & Maupin, J. R. (1999) · Criminal Justice Review · doi:10.1177/073401689902400203 · Cited by 20
Implementing a middle school health promotion research project
Piper, D. L., King, M. J., & Moberg, D. P. (1993) · Evaluation and Program Planning · doi:10.1016/0149-7189(93)90001-o · Cited by 19
Maintenance of Community Change: Enforcing Youth Access to Tobacco Laws
Jason, L. A., Pokorny, S. B., Kunz, C. B., & Adams, M. (2004) · Journal of Drug Education · doi:10.2190/uy5p-hd1f-n7a6-leh9 · Cited by 15
Successful Program Development Using Implementation Evaluation
Lynch, K. B., Geller, S. R., Hunt, D., Galano, J., & Dubas, J. S. (1998) · Journal of Prevention & Intervention in the Community · doi:10.1300/j005v17n02_05 · Cited by 13
Steckler, A., McLeroy, K. R., Goodman, R. M., Smith, D. W., Dawson, L., & Howell, K. A. (1989) · Family & Community Health · doi:10.1097/00003727-198911000-00004 · Cited by 11
Richmond, Virginia's Two Decades of Experience with Ira Gordon's Approach to Parent Education
Binford, V. M., & Newell, J. M. (1991) · The Elementary School Journal · doi:10.1086/461650 · Cited by 9
School-based Educational Innovations: Case Illustrations of Context-Sensitive Evaluations
Altschuld, J. W., Kumar, D. D., Smith, D. W., & Goodway, J. D. (1999) · Family & Community Health · doi:10.1097/00003727-199904000-00008 · Cited by 9
Reflections on implementing a community agency-school prevention program
Pierre, T. L. S., & Kaltreider, D. L. (2001) · Journal of Community Psychology · Cited by 8
Mitchell, C. M. (1983) · American Journal of Community Psychology · doi:10.1007/bf00896605 · Cited by 7
Vincent, M. L., Paine‐Andrews, A., Fisher, J., Devereaux, R. S., Dolan, H. G., Harris, K. J., & Reininger, B. M. (2000) · Family & Community Health · doi:10.1097/00003727-200010000-00005 · Cited by 6
Amenability and Implementation in Secondary School Antitobacco Programs
Barr, J. E., Tubman, J. G., Montgomery, M. J., & Soza-Vento, R. M. (2002) · American Journal of Health Behavior · doi:10.5993/ajhb.26.1.1 · Cited by 6
Disseminating Science-Based Prevention: Lessons Learned from Csap's Capts
Hogan, J. A., Baca, I., Daley, C., Garcia, T., Jaker, J., Lowther, M., & Klitzner, M. D. (2003) · Journal of Drug Education · doi:10.2190/dwmw-0t6t-61n1-gb7x · Cited by 5
Research works printed but not linked: 11
- *Backer T. E., 2002, Finding the balance: Program fidelity and adaptation in substance abuse prevention: A state-of-the-art review
- 10.1037/0022-006X.58.4.437 · doi:10.1037/0022-006x.58.4.437 · Paper page
- 10.3102/00028312037002535 · doi:10.3102/00028312037002535 · Paper page
- *Epstein A. S., 1993, Training for quality: Improving early childhood programs systematic training. Monographs of the High/Scope Educational Research Foundation, No. 9
- 10.3102/00346543047002335 · doi:10.3102/00346543047002335 · Paper page
- 10.3102/00028312030001179 · doi:10.3102/00028312030001179 · Paper page
- *Levenson-Gingiss P. Gottlieb N. H. & Brink S. G. (1994). Increasing teacher receptivity toward use of tobacco prevention education programs.Journal of Drug Education 2. 163–176. · DOI · Paper page
- 10.1177/109821400302400303 · doi:10.1177/109821400302400303 · Paper page
- *Rankin W., 1978, An evaluation of workshops designed to prepare teachers in alcohol education, Journal of Alcohol & Drug Education, 23, 1
- *Rogers E. M. (2003).Diffusion of innovation. (5th ed.). New York: Free Press.
- 10.1002/1520-6629(200103)29:2<107::AID-JCOP1008>3.0.CO;2-6 · doi:10.1002/1520-6629(200103)29:2<107::aid-jcop1008>3.0.co;2-6
Cited by
Durlak, J. A., Weissberg, R. P., Dymnicki, A. B., Taylor, R. D., & Schellinger, K. B. (2011) · Child Development · doi:10.1111/j.1467-8624.2010.01564.x · Cited by 10,854
Self-citationProcess evaluation of complex interventions: Medical Research Council guidance
Moore, G. F., Audrey, S., Barker, M., Bond, L., Bonell, C., Hardeman, W., Moore, L., O'Cathain, A., Tinati, T., Wight, D., et al. (2015) · BMJ · doi:10.1136/bmj.h1258 · Cited by 6,204
Making sense of implementation theories, models and frameworks
Nilsen, P. (2015) · Implementation Science · doi:10.1186/s13012-015-0242-0 · Cited by 4,447
Schreibman, L., Dawson, G., Stahmer, A. C., Landa, R., Rogers, S. J., McGee, G. G., Kasari, C., Ingersoll, B., Kaiser, A. P., Bruinsma, Y., et al. (2015) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-015-2407-8 · Cited by 1,421
“Fidelity of implementation is likely a potential mediating variable affecting child outcomes, with higher fidelity of implementation of an effective procedure resulting in better outcomes (Durlak and DuPre 2008; Gresham et al. 2000; Stahmer and Gist 2001).”
Wiltsey Stirman, S., Kimberly, J., Cook, N., Calloway, A., Castro, F., & Charns, M. (2012) · Implementation Science · doi:10.1186/1748-5908-7-17 · Cited by 1,355
“We also employed a snowballing strategy, in which we searched the reference sections of reviews and theoretical papers on implementation and sustainability [2-4,19,23,25,28,29] and those found in our review.”
Metadata
- Authors
- Durlak, J. A., & DuPre, E. P.
- Affiliations
- Loyola University Chicago (US)
- Corresponding author
- Durlak, Joseph A.
- ORCID
- Durlak, Joseph A.
- Venue
- American Journal of Community Psychology
- Publisher
- Wiley
- Published
- 2008-03-06
- Volume
- 41
- Issue
- 3-4
- Pages
- 327-350
- ISSN
- 0091-0562 (ISSN-L)
- 1573-2770
- OpenAlex
- W2163287225
- Cited by
- 5,304
- References
- 177
- Citations by year
- 2026: 324 · 2025: 310 · 2024: 366 · 2023: 394 · 2022: 394 · 2021: 415 · 2020: 506 · 2019: 372 · 2018: 356 · 2017: 328 · 2016: 295 · 2015: 332 · 2014: 302 · 2013: 211 · 2012: 187
- FWCI
- 12.25
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- American Journal of Community Psychology (publishedVersion)
- PubMed (publishedVersion)
- Funders
- American Psychological Association
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Community Health and Development
- Keywords
- program implementation, implementation fidelity, program outcomes, prevention programs, contextual factors, organizational functioning, technical assistance, training, program evaluation, community settings, provider factors
- MeSH terms
- Health Promotion, Program Development, Outcome Assessment, Health Care
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.