Cited by 262Substance Abuse Treatment and OutcomesSchool Health and Nursing EducationSmoking Behavior and Cessation

School-based programmes to reduce and prevent substance use in different age groups: What works for whom? Systematic review and meta-regression analysis

Open access
Onrust, Simone A., Otten, Roy, Lammers, Jeroen, Smit, Filip·2016·Clinical Psychology Review

Abstract

BACKGROUND: Findings from systematic reviews and meta-analyses about the effectiveness of school-based programmes to prevent or reduce substance abuse are inconclusive. We hypothesise that in order to be effective, programmes have to be aligned with the developmental stages of the intended target group (childhood, early, middle, or late adolescence). The present study provides an overview of universal and targeted programmes, while distinguishing four age groups and examining which intervention characteristics are the effective components for the respective groups. METHODS: Databases were searched for controlled studies of school-based programmes, evaluating their effectiveness on either smoking, alcohol or drug use. Multivariate meta-regression analysis was used to analyse the associations between effects and programme characteristics. RESULTS: Our meta-analysis evaluates 288 programmes with a total of 436,180 participants. The findings support our hypothesis that specific aspects of the school-based programmes are effective in some developmental stages, but not for other age groups. The differences in effectiveness are systematically related to psychological and cognitive needs and capacities. DISCUSSION: Our findings highlight the importance of considering a developmental perspective when designing and offering school-based prevention programmes. The various developmental stages offer different possibilities and opportunities for the reduction and prevention of substance use.

Verified 2026-10-06 · 11 references not checked yet

AI snapshot

Written from the paper’s full text.

TL;DR

This systematic review and meta-regression of 241 studies (288 programmes; 436,180 students aged 4–21) found that school-based substance-use prevention effects and effective components differ by developmental stage. Universal programmes showed small significant effects in elementary and early adolescence, limited effects in middle adolescence, and no significant universal effects in late adolescence, while high-risk late-adolescent programmes showed medium effects for smoking and alcohol.

Key findings

  • Across 288 programmes, most targeted smoking (79%), alcohol use (53%), and drug use (38%); 71% were universal, and early adolescence (grades 6–7) was the most commonly targeted age group (43%).
  • Universal programmes: elementary school showed small significant effects on smoking (d = −.15), alcohol (d = −.14), and drug use (d = −.14); grades 6–7 showed small significant effects on smoking (d = −.14), alcohol (d = −.10), and drug use (d = −.14); grades 8–9 showed a significant effect only on smoking (d = −.09); grades 10–12 showed no significant effects.
  • High-risk programmes: no significant effects for elementary school; grades 6–7 showed small significant effects on smoking (d = −.12), alcohol (d = −.10), and drug use (d = −.08); grades 8–9 showed no significant effects; grades 10–12 showed medium effects on smoking (d = −.35) and alcohol (d = −.32), and a small effect on drug use (d = −.21).
  • Meta-regression for universal smoking: elementary school effectiveness was predicted by generic programmes (B = −.23), social skills (B = −.13), self-control (B = −.23), problem solving (B = −.10), and healthy alternatives (B = −.15); early adolescence by self-control (B = −.12), problem solving (B = −.13), social norm adjustment (B = −.08), healthy alternatives (B = −.25), peer education (B = −.09), and parental involvement (B = −.10); middle adolescence had no significant predictors; late adolescence by self-control (B = −.23), social norm adjustment (B = −.23), and peer education (B = −.74, based on a single study).

Methods

  • Systematic review and meta-analysis/meta-regression of controlled school-based programmes; searched PsycINFO, Pubmed, ERIC, and COCHRANE (January 1966–April 2013; English, German, Dutch) plus reference lists. Inclusion required school setting, elementary/middle/high school students, behavioural smoking/alcohol/drug outcomes, a control condition, and sufficient data to calculate effect sizes.
  • Included 241 studies reporting 288 programmes and 436,180 students aged 4–21. Outcomes were smoking, alcohol use, and drug use; programme content/context was coded dichotomously by two independent researchers, with kappa coefficients from 0.81 to 1.00.
  • Random-effects pooled effect sizes were calculated by age group (elementary, grades 6–7, grades 8–9, grades 10–12), heterogeneity was assessed with I², and meta-regression was performed in Stata using “meta-reg,” with sensitivity analyses adjusting for methodological features. Negative effect sizes indicated programme students were less engaged in substance use than controls.

Limitations

  • Paper-stated: conclusions from meta-regression coefficients warrant caution about causality; only included variables were analysed, so unmeasured variables may explain variability; programme content/context was based on descriptions, and good programmes may have been poorly described; many studies were excluded because effect sizes could not be calculated, and authors of missing-data studies were not all contacted.
  • Evident from the text: heterogeneity was often moderate to high (e.g., universal smoking grades 6–7 I² = 81%; high-risk smoking grades 8–9 I² = 85%); some predictors relied on single studies (e.g., peer education for late-adolescent universal smoking); the oldest age group had small numbers of studies; only 18.4% of evaluations had adequate missing-data handling, and 66% of outcomes were collected within 3 months.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1016/j.cpr.2015.11.002

Cites

29 of 40 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

0 of 26 cited sources checked · 0 supported · 0 flagged

  • Findingown data

    Universal programmes for grade 6 and 7 students demonstrated a small significant effect on drug use (d = -.14).

    “Universal programmes for grade 6 and 7 students also demonstrated a small significant effect on smoking behaviour (d = -.14),alcohol use (d = -.10) and drug use (d = -.14).”
    Quote in the paperSubstantial claim
  • Findingown data

    Universal programmes for elementary school children demonstrated a small and statistically significant effect on smoking behaviour (d = -.15).

    “Universal programmes for elementary school children demonstrated a small and statistically significant effect on smoking behaviour (d = -.15).”
    Quote in the paperSubstantial claim
  • Findingown data

    For grade 8 and 9 students, there were no significant predictors of effectiveness on smoking behaviour.

    “For grade 8 and 9 students (middle adolescence), there were no significant predictors of the effectiveness on smoking behaviour.”
    Quote in the paperSubstantial claim
  • Findingown data

    No significant effects were found for universal programmes for grade 8 and 9 students on drug use.

    “However, no significant effects were found for alcohol use and drug use.”
    Quote in the paperSubstantial claim
  • Findingown data

    For grade 6 and 7 students, focusing on healthy alternatives predicts effectiveness on alcohol use (B = -0.14; p = 0.02).

    “focusing on healthy alternatives (B = -0.14;p = 0.02)”
    Quote in the paperSubstantial claim
  • May combine two claims. 28
  • Classified as probably not a substantial claim. 23
  • The quote only partly states this claim. 32
  • May combine two claims.

    Findingown data

    Heterogeneity for grade 8 and 9 programmes was between low and moderate for smoking (I2 = 38%) and between moderate and high for alcohol use (I2 = 59%) and drug use (I2 = 70%).

    “Heterogeneity for this age group was between low and moderate for programmes evaluated on smoking (I 2 = 38%) and between moderate and high for programmes evaluated on alcohol use (I 2 = 59%) and drug use (I 2 = 70%).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingreasoning

    Heterogeneity was high for programmes evaluated on smoking (I2 = 76%) and drug use (I2 = 85%) for the oldest age group.

    “Heterogeneity was high for programmes evaluated on smoking (I 2 = 76%) and drug use (I 2 = 85%).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    The most common theoretical orientation of the programmes for most age groups was the social influence approach, with the exception of alcohol and drug use prevention programmes for grade 10-12 students which are mostly based on the trans-theoretical model of change.

    “The most common theoretical orientation of the programmes for most age groups was the social influence approach, with the exception of alcohol and drug use prevention programmes for grade 10-12 students which are mostly based on the trans-theoretical model of change.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Refusal skills training was very common.

    “Refusal skills training was also very common.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Programmes targeting grade 6 and 7 high-risk students mostly included health education and refusal skills training and applied a social influence approach.

    “Programmes targeting grade 6 and 7 high-risk students (early adolescence) mostly included health education and refusal skills training and applied a social influence approach.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Most of these programmes involved several skill training units related to social emotional learning, of which problem solving or decision making skills training was the most common.

    “Most of these programmes involved several skill training units related to social emotional learning, of which problem solving or decision making skills training was the most common.”
    Quote in the paperNot a substantial claim
  • The quote only partly states this claim.

    Findingown data

    Among universal school-based prevention programmes, the overall effect size for alcohol use was -0.22 (95% CI -0.48 to -0.04) for grade 10-12 students.

    “Overall effect size: Cohen's d | -.15 | -.14 | -.09 | -.15 | -.14 | -.10 | .01 | -.22 | -.14 | -.14 | -.06 | -.07”
    Quote in the paperSubstantial claim
  • The quote only partly states this claim.

    Findingown data

    Among programmes targeting high-risk students, the overall effect size for alcohol use was -0.32 (95% CI -0.55 to -0.08) for grade 10-12 students.

    “Overall effect size: Cohen's d | -.09 | -.12 | -.25 | -.35 | .00 | -.10 | -.13 | -.32 | -.10 | -.08 | -.24 | -.21”
    Quote in the paperSubstantial claim
  • The quote only partly states this claim.

    Findingown data

    Among programmes targeting high-risk students, the overall effect size for alcohol use was -0.13 (95% CI -0.30 to 0.03) for grade 8 and 9 students.

    “Overall effect size: Cohen's d | -.09 | -.12 | -.25 | -.35 | .00 | -.10 | -.13 | -.32 | -.10 | -.08 | -.24 | -.21”
    Quote in the paperNot a substantial claim
  • The quote only partly states this claim.

    Findingown data

    Among programmes targeting high-risk students, the overall effect size for smoking was -0.35 (95% CI -0.48 to -0.21) for grade 10-12 students.

    “Overall effect size: Cohen's d | -.09 | -.12 | -.25 | -.35 | .00 | -.10 | -.13 | -.32 | -.10 | -.08 | -.24 | -.21”
    Quote in the paperSubstantial claim
  • The quote only partly states this claim.

    Findingown data

    Among programmes targeting high-risk students, the overall effect size for smoking was -0.12 (95% CI -0.16 to -0.07) for grade 6 and 7 students.

    “Overall effect size: Cohen's d | -.09 | -.12 | -.25 | -.35 | .00 | -.10 | -.13 | -.32 | -.10 | -.08 | -.24 | -.21”
    Quote in the paperNot a substantial claim
  • The quote only partly states this claim.

    Findingown data

    Among universal school-based prevention programmes, the overall effect size for alcohol use was 0.01 (95% CI -0.06 to 0.07) for grade 8 and 9 students.

    “Overall effect size: Cohen's d | -.15 | -.14 | -.09 | -.15 | -.14 | -.10 | .01 | -.22 | -.14 | -.14 | -.06 | -.07”
    Quote in the paperSubstantial claim
  • The quote only partly states this claim.

    Findingown data

    Among universal school-based prevention programmes, the overall effect size for drug use was -0.14 (95% CI -0.20 to -0.08) for grade 6 and 7 students.

    “Overall effect size: Cohen's d | -.15 | -.14 | -.09 | -.15 | -.14 | -.10 | .01 | -.22 | -.14 | -.14 | -.06 | -.07”
    Quote in the paperSubstantial claim
  • The quote only partly states this claim.

    Findingown data

    Among programmes targeting high-risk students, the overall effect size for drug use was -0.08 (95% CI -0.12 to -0.04) for grade 6 and 7 students.

    “Overall effect size: Cohen's d | -.09 | -.12 | -.25 | -.35 | .00 | -.10 | -.13 | -.32 | -.10 | -.08 | -.24 | -.21”
    Quote in the paperNot a substantial claim
  • The quote only partly states this claim.

    Findingown data

    Among universal school-based prevention programmes, the overall effect size for alcohol use was -0.14 (95% CI -0.21 to -0.08) for grade 1-5 students.

    “Overall effect size: Cohen's d | -.15 | -.14 | -.09 | -.15 | -.14 | -.10 | .01 | -.22 | -.14 | -.14 | -.06 | -.07”
    Quote in the paperSubstantial claim
  • The quote only partly states this claim.

    Findingown data

    In meta-regression of universal programmes, healthy alternatives was associated with a smoking effect size coefficient of B=-0.15 (p=0.05) in elementary school students.

    “Healthy alternatives | Smoking | -.15 | 0.05 | -.25 | 0.01 | -.00 | 0.97 | .18 | 0.26”
    Quote in the paperNot a substantial claim
  • The quote only partly states this claim.

    Findingown data

    In meta-regression of universal programmes, healthy alternatives was associated with a smoking effect size coefficient of B=-0.25 (p=0.01) in early adolescence.

    “Healthy alternatives | Smoking | -.15 | 0.05 | -.25 | 0.01 | -.00 | 0.97 | .18 | 0.26”
    Quote in the paperSubstantial claim
  • The quote only partly states this claim.

    Findingown data

    Among programmes targeting high-risk students, the overall effect size for drug use was -0.10 (95% CI -0.27 to 0.08) for grade 1-5 students.

    “Overall effect size: Cohen's d | -.09 | -.12 | -.25 | -.35 | .00 | -.10 | -.13 | -.32 | -.10 | -.08 | -.24 | -.21”
    Quote in the paperNot a substantial claim
  • The quote only partly states this claim.

    Findingown data

    Among universal school-based prevention programmes, the overall effect size for smoking was -0.15 (95% CI -0.21 to -0.08) for grade 1-5 students.

    “Overall effect size: Cohen's d | -.15 | -.14 | -.09 | -.15 | -.14 | -.10 | .01 | -.22 | -.14 | -.14 | -.06 | -.07”
    Quote in the paperSubstantial claim
  • The quote only partly states this claim.

    Findingown data

    Among universal school-based prevention programmes, the overall effect size for smoking was -0.09 (95% CI -0.13 to -0.06) for grade 8 and 9 students.

    “Overall effect size: Cohen's d | -.15 | -.14 | -.09 | -.15 | -.14 | -.10 | .01 | -.22 | -.14 | -.14 | -.06 | -.07”
    Quote in the paperSubstantial claim
  • The quote only partly states this claim.

    Findingown data

    Among programmes targeting high-risk students, the overall effect size for alcohol use was 0.00 (95% CI -0.17 to 0.16) for grade 1-5 students.

    “Overall effect size: Cohen's d | -.09 | -.12 | -.25 | -.35 | .00 | -.10 | -.13 | -.32 | -.10 | -.08 | -.24 | -.21”
    Quote in the paperNot a substantial claim
  • The quote only partly states this claim.

    Findingown data

    Among programmes targeting high-risk students, the overall effect size for drug use was -0.21 (95% CI -0.37 to -0.06) for grade 10-12 students.

    “Overall effect size: Cohen's d | -.09 | -.12 | -.25 | -.35 | .00 | -.10 | -.13 | -.32 | -.10 | -.08 | -.24 | -.21”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    The majority of programmes were universal (71%).

    “The majority of programmes were universal (71%).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Most programmes concentrated on smoking (79%), more than half were directed at alcohol use (53%), and about 38% at drug use.

    “Most programmes concentrated on smoking (79%), more than half of the programmes were directed at alcohol use (53%), and about 38% of the programmes at drug use.”
    Quote in the paperNot a substantial claim
  • The quote only partly states this claim.

    Findingown data

    Among programmes targeting high-risk students, the overall effect size for drug use was -0.24 (95% CI -0.53 to 0.04) for grade 8 and 9 students.

    “Overall effect size: Cohen's d | -.09 | -.12 | -.25 | -.35 | .00 | -.10 | -.13 | -.32 | -.10 | -.08 | -.24 | -.21”
    Quote in the paperNot a substantial claim
  • The quote only partly states this claim.

    Findingown data

    Among universal school-based prevention programmes, the overall effect size for smoking was -0.14 (95% CI -0.20 to -0.09) for grade 6 and 7 students.

    “Overall effect size: Cohen's d | -.15 | -.14 | -.09 | -.15 | -.14 | -.10 | .01 | -.22 | -.14 | -.14 | -.06 | -.07”
    Quote in the paperSubstantial claim
  • The quote only partly states this claim.

    Findingown data

    Among universal school-based prevention programmes, the overall effect size for alcohol use was -0.10 (95% CI -0.15 to -0.05) for grade 6 and 7 students.

    “Overall effect size: Cohen's d | -.15 | -.14 | -.09 | -.15 | -.14 | -.10 | .01 | -.22 | -.14 | -.14 | -.06 | -.07”
    Quote in the paperSubstantial claim
  • The quote only partly states this claim.

    Findingown data

    Among programmes targeting high-risk students, the overall effect size for alcohol use was -0.10 (95% CI -0.15 to -0.04) for grade 6 and 7 students.

    “Overall effect size: Cohen's d | -.09 | -.12 | -.25 | -.35 | .00 | -.10 | -.13 | -.32 | -.10 | -.08 | -.24 | -.21”
    Quote in the paperNot a substantial claim
  • The quote only partly states this claim.

    Findingown data

    Among programmes targeting high-risk students, the overall effect size for smoking was -0.09 (95% CI -0.25 to 0.08) for grade 1-5 students.

    “Overall effect size: Cohen's d | -.09 | -.12 | -.25 | -.35 | .00 | -.10 | -.13 | -.32 | -.10 | -.08 | -.24 | -.21”
    Quote in the paperNot a substantial claim
  • The quote only partly states this claim.

    Findingown data

    Among universal school-based prevention programmes, the overall effect size for drug use was -0.06 (95% CI -0.22 to 0.09) for grade 8 and 9 students.

    “Overall effect size: Cohen's d | -.15 | -.14 | -.09 | -.15 | -.14 | -.10 | .01 | -.22 | -.14 | -.14 | -.06 | -.07”
    Quote in the paperNot a substantial claim
  • The quote only partly states this claim.

    Findingown data

    Among universal school-based prevention programmes, the overall effect size for smoking was -0.15 (95% CI -0.36 to 0.06) for grade 10-12 students.

    “Overall effect size: Cohen's d | -.15 | -.14 | -.09 | -.15 | -.14 | -.10 | .01 | -.22 | -.14 | -.14 | -.06 | -.07”
    Quote in the paperSubstantial claim
  • The quote only partly states this claim.

    Findingown data

    Among programmes targeting high-risk students, the overall effect size for smoking was -0.25 (95% CI -0.56 to 0.05) for grade 8 and 9 students.

    “Overall effect size: Cohen's d | -.09 | -.12 | -.25 | -.35 | .00 | -.10 | -.13 | -.32 | -.10 | -.08 | -.24 | -.21”
    Quote in the paperNot a substantial claim
  • The quote only partly states this claim.

    Findingown data

    Among universal school-based prevention programmes, the overall effect size for drug use was -0.14 (95% CI -0.28 to -0.01) for grade 1-5 students.

    “Overall effect size: Cohen's d | -.15 | -.14 | -.09 | -.15 | -.14 | -.10 | .01 | -.22 | -.14 | -.14 | -.06 | -.07”
    Quote in the paperSubstantial claim
  • The quote only partly states this claim.

    Findingown data

    In meta-regression of programmes targeting high-risk students, principles of cognitive behaviour therapy was associated with a smoking effect size coefficient of B=-0.36 (p=0.04) in middle adolescence.

    “Principles cognitive behaviour therapy | Smoking b | .13 | 0.29 | -.01 | 0.92 | -.36 | 0.04 | -10 | 0.24”
    Quote in the paperSubstantial claim
  • The quote only partly states this claim.

    Findingown data

    In meta-regression of programmes targeting high-risk students, coping with stress was associated with a smoking effect size coefficient of B=-0.58 (p=0.01) in middle adolescence.

    “Coping with stress | Smoking | .31 | 0.07 | -.04 | 0.65 | -.58 | 0.01 | -.19 | 0.01”
    Quote in the paperSubstantial claim
  • The quote only partly states this claim.

    Findingown data

    In meta-regression of programmes targeting high-risk students, coping with stress was associated with a smoking effect size coefficient of B=-0.19 (p=0.01) in late adolescence.

    “Coping with stress | Smoking | .31 | 0.07 | -.04 | 0.65 | -.58 | 0.01 | -.19 | 0.01”
    Quote in the paperSubstantial claim
  • The quote only partly states this claim.

    Findingown data

    In meta-regression of programmes targeting high-risk students, social influence approach was associated with a smoking effect size coefficient of B=0.27 (p=0.03) in elementary school students.

    “Social influence approach | Smoking | .27 | 0.03 | .11 | 0.19 | -.16 | 0.41 | -.15 | 0.14”
    Quote in the paperNot a substantial claim
  • The quote only partly states this claim.

    Findingown data

    In meta-regression of universal programmes, parents involved was associated with a smoking effect size coefficient of B=-0.10 (p=0.02) in early adolescence.

    “Parents involved | Smoking | -.09 | 0.27 | -.10 | 0.02 | .01 | 0.93 | .10 | 0.61”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    One explanation for the inconclusive results might stem from the absence of a developmental perspective on substance use prevention and interventions.

    “One explanation for the inconclusive results might stem from the absence of a developmental perspective on substance use prevention and interventions.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Most programmes consider the age of substance use initiation as an appropriate timing of the programme, but differences of psychological and cognitive needs and capacities of the intended target groups are usually not taken into account.
    • The authors state this as an assumption: Substance use prevention programmes have to attune to developmental needs in order to be effective.
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Conformity to peers peaks during early adolescence, as social acceptance becomes more important.

    “That is, conformity to peers peaks during this developmental period, as social acceptance becomes more important”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Forehand & Wierson, 1994 source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Reward-seeking behaviour culminates in middle adolescence, with the presence of peers resulting in a substantial increase in risk-taking behaviour.

    “Reward-seeking behaviour culminates in middle adolescence (Steinberg, 2010), with the presence of peers resulting in a substantial increase in risk-taking behaviour (Steinberg, 2007)”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites Steinberg, 2010 source

      Not checked in the free run.

    • cites Steinberg, 2007 source

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Premisecitation

    Several systematic reviews and meta-analyses of substance use prevention programmes identified studies either demonstrating significant effects or showing no effect at all.

    “Several systematic reviews and meta-analyses of substance use prevention programmes identified studies either demonstrating significant effects, or showing no effect at all”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites Faggiano et al., 2005 source

      Not checked in the free run.

    • cites Foxcroft & Tsertsvadze, 2011

      Not checked in the free run.

    • cites Norberg, Kezelman, & Lim-Howe, 2013 source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    In elementary school, substance use is rare and expectancies about the effects of substances are predominantly negative.

    “In elementary school, substance use is rare and expectancies about the effects of substances are predominantly negative”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Masten, Faden, Zucker, & Spear, 2008

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Substance use at a young age may entail a substantial disease burden and significant social and economic costs.

    “It is well established that substance use at a young age is associated with an elevated risk of substance use disorders later in life, mental health problems, which may entail a substantial disease burden, followed by significant social and economic costs”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites DeWit, Adlaf, Offord, & Ogborne, 2000 source

      Not checked in the free run.

    • cites Gil, Wagner, & Tubman, 2004

      Not checked in the free run.

    • cites Rehm et al., 2009 source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    It is generally assumed that the most effective method to prevent substance use in early adolescence is the social influence approach.

    “It is generally assumed that the most effective method to prevent substance use in this stage is the social influence approach”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Cuijpers, 2002 source

      Not checked in the free run.

    • cites Newton, O'Leary-Barrett, & Conrod, 2013

      Not checked in the free run.

    • cites Newton, Conrod, Teesson, & Faggiano, 2012

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    During late adolescence, opportunities for substance use prevention increase.

    “During late adolescence, opportunities for substance use prevention increase.”
    Quote in the paperNot a substantial claim
    • The authors state this as an assumption: Substance use prevention programmes have to attune to developmental needs in order to be effective.
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductown data

    In the majority of the evaluations, a randomized design was used (73%).

    “In the majority of the evaluations, a randomized design was used (73%).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationown data

    Both refusal skills training and making a public commitment not to use substances are related to adverse effects in grade 8 and 9 universal alcohol programmes.

    “However, both predictors are related to adverse effects.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation

    For late adolescents, many social activities occur in drinking contexts and substance use becomes more and more normalized.

    “For late adolescents, many social activities occur in drinking contexts and substance use becomes more and more normalized”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Schulenberg & Maggs, 2002

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductown data

    Slightly more than half of the evaluations appeared free of other biases (53%).

    “slightly more than half of the evaluations appeared free of other biases as well (53%).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductown data

    Most of the evaluations appeared free of selective reporting (88%).

    “Most of the evaluations also appeared free of selective reporting (88%)”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductown data

    Variables were coded separately by two independent researchers, and inter-rater reliability was outstanding with kappa coefficients ranging from 0.81 to 1.00.

    “Variables were coded separately by two independent researchers.The inter-rater reliability was outstanding.Kappa coefficients corrected for chance agreement ranged from 0.81 (problem solving or decision making skill training) to 1.00 (mentoring).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S1 (asserted), S3 (load-bearing), S4 (based). The quote only partly states this claim.

    Study design and conductown data

    Sensitivity analyses demonstrate that all predictors for grade 10-12 universal smoking programmes remain significant after controlling for study quality.

    “Sensitivity analyses demonstrate that all predictors remain significant after controlling for study quality (results not shown).”
    Quote in the paperNot a substantial claim
  • May combine two claims. The quote only partly states this claim.

    Interpretationown data

    Adverse effects are found for refusal skills training and peer education in grade 6 and 7 universal alcohol programmes.

    “Adverse effects are found refusal skills training and peer education.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Study design and conductown data

    The influence of peer education on smoking in grade 10-12 universal programmes is based on a single study and firmer conclusions require more data.

    “However, the influence of peer education is based on a single study and firmer conclusions require more data.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationown data

    Generic programmes are related to less favourable outcomes, while teaching students how to cope with stress and anxiety and applying techniques from cognitive behavioural therapy are related to larger reductions in smoking behaviour for high-risk grade 8 and 9 students.

    “Generic programmes are related to less favourable outcomes, while teaching students how to cope with stress and anxiety and applying techniques from cognitive behavioural therapy are related to larger reductions in smoking behaviour.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationown data

    Self-control training, programmes based on the Transtheoretical model and behavioural management by a parent or teacher are related to larger reductions in drug behaviour for high-risk grade 10-12 students.

    “Self-control training, programmes based on the Transtheoretical model and behavioural management by a parent or teacher are related to larger reductions in drug behaviour.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductnone given

    A substance use prevention strategy or methodological feature could only be coded as present if it was reported somewhere; characteristics that are not reported are not always absent and vice versa.

    “We were only able to code a certain substance use prevention strategy or methodological feature as present if it was reported somewhere.We are aware that characteristics that are not reported, are not always absent and vice”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationown data

    High risk late adolescents benefit from self-control training and the involvement of parents.

    “Corresponding to our results of universal programmes, high risk late adolescents do benefit from self-control training and the involvement of parents.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationnone given

    Many of these findings can be subscribed to changes in biological, cognitive, emotional and social development as well as to changes in the physical and social environment that take place in childhood and adolescence.

    “Many of these findings can be subscribed to changes in biological, cognitive, emotional and social development as well as to changes in the physical and social environment that take place in childhood and adolescence.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationown data

    Universal prevention appears difficult in middle adolescence and none of the selected substance use prevention strategies were related to more favourable results.

    “Universal prevention however, appears difficult and none of the selected substance use prevention strategies were related to more favourable results.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    The study demonstrates that it makes good sense to adopt a developmental perspective when designing and offering preventive interventions for substance use in youngsters.

    “To summarize, our study demonstrates that it makes good sense to adopt a developmental perspective when designing and offering preventive interventions for substance use in youngsters.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    Social norm strategies were related to positive results in early adolescents, while preparing students for peer pressure was not.

    “The finding that social norm strategies were related to positive results in early adolescents, while preparing students for peer pressure was not, does fit in with the most important developmental changes in early adolescence.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    Programme characteristics were coded by two independent researchers with outstanding inter-rater reliability.

    “the coding of programme characteristics by two independent researchers with outstanding inter-rater reliability”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    Sensitivity analyses were used in order to adjust for methodological features of the reviewed studies.

    “and sensitivity analyses in order to adjust for methodological features of the reviewed studies.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationnone given

    All developmental periods offer different possibilities for the prevention or reduction of substance use fitting in with the primary developmental tasks and changes defining each developmental stage.

    “All developmental periods offer different possibilities for the prevention or reduction of substance use fitting in with the primary developmental tasks and changes defining each developmental stage.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    High risk late adolescents do not benefit from a social influences approach or refusal skills training; these strategies are even counterproductive.

    “Unlike our findings of universal programmes, high risk late adolescents do not benefit from a social influences approach or refusal skills training.These substance use prevention strategies are even counterproductive.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Study design and conductreasoning

    Because conclusions are based on regression coefficients expressing the strength of a substance use prevention strategy on behavioural outcomes, some caution is warranted with making conclusions about causality.

    “Because our conclusions are based on regression coefficients expressing the strength of a substance use prevention strategy on behavioural outcomes, some caution is warranted with making conclusions about causality.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationown data

    The social influence approach in itself was not related to the effectiveness of universal programmes and was marginally related to adverse outcomes in high risk students.

    “The social influence approach in itself was not related to the effectiveness of universal programmes and marginally related to adverse outcomes in high risk students.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductreasoning

    The conclusions were only based on the variables that were included in the analyses, and it is possible that variability in programme effects is related to an unmeasured variable.

    “Another limitation of our research strategy is that the conclusions were only based on the variables that were included in the analyses.It is always possible that the variability in programme effects is related to an unmeasured variable.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Study design and conductown data

    A large number of studies were excluded because effect sizes could not be calculated, and this exclusion could have influenced the findings.

    “Finally, we excluded a large number of studies due to the fact that we were not able to calculate effect sizes.Considering the magnitude of our study, we were not able to contact all authors of studies with missing data.Exclusion of these studies, however, could have influenced our findings.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductreasoning

    The analyses were based on a description of the content and context of the programmes, but good programmes may have been described poorly.

    “Another limitation of our study is the fact that we based our analyses on a description of the content and context of the programmes, but good programmes may have been described poorly.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationown data

    Analyses of programmes for high risk students suggested that drawing attention to substance use can even be harmful in elementary school, as several substance use prevention strategies addressing substances were related to adverse outcomes in high risk students.

    “The analyses of programmes for high risk students suggested that drawing the attention to substance use can even be harmful in this developmental stage, as several substance use prevention strategies addressing substances were related to adverse outcomes in high risk students.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Study design and conductnone given

    The study used systematic search strategies.

    “Other strengths of our study are the systematic search strategies”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Study design and conductreasoning

    The study only included controlled studies with longitudinal data, in which the utilization of the substance use prevention strategies were antecedent to the measurement of behavioural outcomes, strengthening etiological inference.

    “However, our study only included controlled studies with longitudinal data, in which the utilization of the substance use prevention strategies were antecedent to the measurement of behavioural outcomes, strengthening etiological inference.”
    Quote in the paperSubstantial claim
75 of 75
  • The paper relies on this without support.

    Most programmes consider the age of substance use initiation as an appropriate timing of the programme, but differences of psychological and cognitive needs and capacities of the intended target groups are usually not taken into account.

    “Although most programmes consider the age of substance use initiation as an appropriate timing of the programme, differences of psychological and cognitive needs and capacities of the intended target groups are usually not taken into account.”
  • The authors state this as an assumption.

    Substance use prevention programmes have to attune to developmental needs in order to be effective.

    “We suspect that substance use prevention programmes have to attune to these developmental needs in order to be effective.”
  • The paper relies on this without support.

    During development from children to adults, youngsters cycle through several developmental stages, which are all characterized by specific needs and possibilities.

    “However, during their development from children to adults, youngsters cycle through several developmental stages, which are all characterized by specific needs and possibilities.”
  • The paper relies on this without support.

    None of the available reviews and meta-analyses considers the effectiveness of substance use prevention programmes while taking into account the different developmental stages.

    “Although there are several reviews and meta-analyses available on the effectiveness of substance use prevention and interventions, none of these studies considers the effectiveness of these programmes while taking into account the different developmental stages.”
  • The paper relies on this without support.

    Characteristics that are not reported in programme descriptions are not always absent, and reported characteristics are not always present.

    “We are aware that characteristics that are not reported, are not always absent and vice”
5 of 5

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • High-risk late-adolescence smoking social-norm p-values differ

    Major

    For the same smoking coefficient of −.30, the narrative reports p = .02 but Table 6 reports p = .06.

  • Smoking social-norm result conflicts with Table 4

    Major

    For late-adolescent universal programmes, the narrative reports a significant smoking association of −.23 (p = .02), while Table 4 reports −.06 (p = .53).

  • Late-adolescence alcohol and drug heterogeneity values are reversed

    Major

    The narrative assigns I2 values of 85% to drug use and 44% to alcohol use; Table 3 assigns 85% to alcohol use and 44% to drug use.

  • High-risk middle-adolescence generic-programme effect has opposite signs

    Major

    The narrative reports a positive coefficient and interprets generic programmes as having less favourable smoking outcomes. Table 6 reports a negative coefficient for that age group and outcome.

  • Title-screening counts leave 41 abstracts unaccounted for

    Minor

    Excluding 3,426 of 4,801 titles leaves 1,375 records, not the 1,416 abstracts reported as screened.

    Reported 1416 · recomputed 1375

5 of 5

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Onrust, S. A., Otten, R., Lammers, J., & Smit, F.
Affiliations
  • Trimbos Institute (NL)
  • Pluryn (NL)
Corresponding author
Onrust, Simone A.
Venue
Clinical Psychology Review
Publisher
Elsevier BV
Published
2016-03
Volume
44
Pages
45-59
ISSN
0272-7358 (ISSN-L)
OpenAlex
W2210098386
Cited by
262
References
40
Citations by year
2026: 26 · 2025: 20 · 2024: 25 · 2023: 17 · 2022: 37 · 2021: 33 · 2020: 40 · 2019: 25 · 2018: 21 · 2017: 14 · 2016: 4
FWCI
1.68
Type
journal article
Language
en
Open access
Locations
  • Clinical Psychology Review (publishedVersion, cc-by-nc-nd)
  • PubMed (publishedVersion)
  • Amsterdam UMC (VU Amsterdam) - Institutional Repository (publishedVersion)
  • Pure Amsterdam UMC (submittedVersion)
  • Radboud Repository (Radboud University) (submittedVersion)
  • Radboud Repository (Radboud University) (submittedVersion, other-oa)
  • Data Archiving and Networked Services (DANS) (submittedVersion)
Topics
  • Health Sciences › Medicine › Epidemiology › Substance Abuse Treatment and Outcomes
  • Health Sciences › Health Professions › Speech and Hearing › School Health and Nursing Education
  • Health Sciences › Medicine › Physiology › Smoking Behavior and Cessation
Keywords
school-based prevention, substance use prevention, substance use reduction, developmental stages, age groups, adolescents, children, smoking prevention, alcohol prevention, program characteristics, intervention effectiveness
MeSH terms
Smoking Prevention, Adolescent, Age Factors, Alcohol Drinking, Female, Humans, Male, School Health Services, Schools, Substance-Related Disorders

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-06.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-06.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review