Measuring Quality of Delivery in a Substance Use Prevention Program
Abstract
The purpose of this study was to develop and validate an observation measure designed to capture teachers' use of interactive teaching skills within the delivery of the All Stars substance use prevention program. Coders counted the number of times teachers praised and encouraged students, accepted and used students' ideas, asked questions, self-disclosed personal anecdotes, and corrected student misbehavior. These teacher behaviors loaded on three factors: classroom management, acknowledgment, and student-centered methods. Classroom management was negatively related to student engagement. Acknowledgment was negatively related to students' normative beliefs. Student-centered methods were positively related to student idealism and normative beliefs, and marginally predicted decreases in student marijuana use. Editors' Strategic Implications: The authors provide a promising approach to studying pedagogical prevention approaches, and they also link teaching processes to student outcomes. This study of program delivery should be of general interest (i.e., not limited to substance use prevention) to practitioners and researchers.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
A coding system and manual were created for the four target lessons, with codes for dosage and adherence.
“We have developed a coding system and manual similar to the work of others (Forgatch et al. 2005; Giles et al. 2008; Knutson et al. 2003). Specific codes have been developed for each of the four lessons with regard to dosage and adherence.”
From Translational research in South Africa: evaluating implementation quality using a factorial design (2012) · cites this paper as Giles et al. 2008
Cites
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 23,433 · see citing works
Forming inferences about some intraclass correlation coefficients.
McGraw, K. O., & Wong, S. P. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.1.30 · Cited by 6,903 · see citing works
Tobler, N. S. (1986) · Journal of Drug Issues · doi:10.1177/002204268601600405 · Cited by 648 · see citing works
Effectiveness of School-Based Drug Prevention Programs: A Meta-Analysis of the Research
Tobler, N. S., & Stratton, H. H. (1997) · The Journal of Primary Prevention · doi:10.1023/a:1024630205999 · Cited by 601 · see citing works
Dusenbury, L., Brannigan, R., Hansen, W. B., Walsh, J., & Falco, M. (2005) · Health Education Research · doi:10.1093/her/cyg134 · Cited by 278 · see citing works
Self-citationHarachi, T. W., Abbott, R. D., Catalano, R. F., Haggerty, K. P., & Fleming, C. B. (1999) · American Journal of Community Psychology · doi:10.1023/a:1022194005511 · Cited by 269 · see citing works
Drug Prevention Programs Can Work:
Tobler, N. S. (1992) · Journal of Addictive Diseases · doi:10.1300/j069v11n03_01 · Cited by 239 · see citing works
Eleven Components of Effective Drug Abuse Prevention Curricula
Dusenbury, L., & Falco, M. (1995) · Journal of School Health · doi:10.1111/j.1746-1561.1995.tb08205.x · Cited by 238 · see citing works
Self-citationChanging teaching practices to promote achievement and bonding to school.
Abbott, R. D., O'Donnell, J., Hawkins, J. D., Hemphill, S. A., Kosterman, R., & Catalano, R. F. (1998) · American Journal of Orthopsychiatry · doi:10.1037/h0080363 · Cited by 182 · see citing works
Hansen, W. B., Graham, J. W., Wolkenstein, B. H., & Rohrbach, L. A. (1991) · Journal of Studies on Alcohol · doi:10.15288/jsa.1991.52.568 · Cited by 179 · see citing works
Self-citationHow all Stars Works: An Examination of Program Effects on Mediating Variables
McNeal, R. B., Hansen, W. B., Harrington, N. G., & Giles, S. M. (2004) · Health Education & Behavior · doi:10.1177/1090198103259852 · Cited by 175 · see citing works
Self-citationEffects of Program Implementation on Adolescent Drug Use Behavior
Pentz, M. A., Trebow, E. A., Hansen, W. B., MacKinnon, D. P., Dwyer, J. H., Johnson, C. A., Flay, B. R., Daniels, S., & Cormack, C. (1990) · Evaluation Review · doi:10.1177/0193841x9001400303 · Cited by 172 · see citing works
Self-citationA skills training approach to smoking prevention among hispanic youth
Botvin, G. J., Dusenbury, L., Baker, E., James-Ortiz, S., & Kerner, J. F. (1989) · Journal of Behavioral Medicine · doi:10.1007/bf00844872 · Cited by 166 · see citing works
Self-citationHarrington, N. G., Giles, S. M., Hoyle, R. H., Feeney, G. J., & Yungbluth, S. C. (2001) · Health Education & Behavior · doi:10.1177/109019810102800502 · Cited by 156 · see citing works
Self-citationHansen, W. B. (1996) · Substance Use & Misuse · doi:10.3109/10826089609063981 · Cited by 135 · see citing works
Self-citationEffectiveness of School-Based Drug Prevention Programs for Marijuana Use
Tobler, N. S., Lessard, T., Marshall, D., Ochshorn, P., & Roona, M. (1999) · School Psychology International · doi:10.1177/0143034399201008 · Cited by 126 · see citing works
Drug education practice: results of an observational study
Hansen, W. B. (1999) · Health Education Research · doi:10.1093/her/14.1.85 · Cited by 65 · see citing works
Self-citationTobler, N. S. (2000) · The Journal of Primary Prevention · doi:10.1023/a:1021362620740 · Cited by 60 · see citing works
The integrity of smoking prevention curriculum delivery
Sobol, D. F., Dent, C. W., Gleason, L. R., et al. (1989) · Health Education Research · doi:10.1093/her/4.1.59 · Cited by 52 · see citing works
Ringwalt, C. L., Pankratz, M. M., Hansen, W. B., Dusenbury, L., Jackson‐Newsom, J., Giles, S. M., & Brodish, P. (2007) · Health Education & Behavior · doi:10.1177/1090198107303311 · Cited by 41 · see citing works
Self-citationContent and Teaching Strategies in 10 Selected Drug Abuse Prevention Curricula
Bosworth, K., & Sailes, J. (1993) · Journal of School Health · doi:10.1111/j.1746-1561.1993.tb06134.x · Cited by 28 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
School‐based programmes for preventing smoking
Thomas, R. E., McLellan, J., & Perera, R. (2013) · Evidence-Based Child Health: A Cochrane Review Journal · doi:10.1002/ebch.1937 · Cited by 120 · see citing works
Translational research in South Africa: evaluating implementation quality using a factorial design
Caldwell, L. L., Smith, E. A., Collins, L. M., Graham, J. W., Lai, M., Wegner, L., Vergnani, T., Matthews, C., & Jacobs, J. (2012) · Child & Youth Care Forum · doi:10.1007/s10566-011-9164-4 · Cited by 50 · see citing works
- Authors
- Giles, S., Jackson-Newsom, J., Pankratz, M. M., Hansen, W. B., Ringwalt, C. L., & Dusenbury, L.
- Affiliations
- Wake Forest University (US)
- Pacific Institute For Research and Evaluation (US)
- Tanglewood Research (US)
- Corresponding author
- Giles, Steven
- Venue
- The Journal of Primary Prevention
- Published
- 2008-11
- Volume
- 29
- Issue
- 6
- Pages
- 489-501
- ISSN
- 0278-095X (ISSN-L)
- 1573-6547
- OpenAlex
- W2087068814
- Cited by
- 29
- References
- 21
- Citations by year
- 2026: 1 · 2020: 1 · 2019: 2 · 2018: 1 · 2016: 1 · 2014: 4 · 2013: 7 · 2012: 4
- FWCI
- 1.97
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- The Journal of Primary Prevention (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institute on Drug Abuse (R01DA016098)
- Topics
- Health Sciences › Medicine › Epidemiology › Substance Abuse Treatment and Outcomes
- Health Sciences › Health Professions › Speech and Hearing › School Health and Nursing Education
- Social Sciences › Psychology › Developmental and Educational Psychology › Behavioral and Psychological Studies
- Keywords
- substance use prevention, teacher behavior, classroom management, student-centered learning, student engagement, normative beliefs, cannabis use, prevention education, observational coding
- MeSH terms
- Adolescent, Adolescent Behavior, Chicago, Child, Factor Analysis, Statistical, Female, Health Promotion, Humans, Male, Quality of Health Care, School Health Services, Teaching, Program Evaluation, Substance-Related Disorders
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
