Methodological Challenges Examining Subgroup Differences: Examples from Universal School-based Youth Violence Prevention Trials
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
This article reviews the literature on school-based universal violence prevention programs to illustrate key methodological challenges for investigating subgroup differences in prevention effects. The variety of potential moderating factors examined within this literature is discussed within the context of a social-ecological model. Our review of this literature identified the following methodological issues: the need for a clear a priori theoretical basis for selecting potential moderators, inflated Type I error rates that result from large numbers of comparisons, the absence of explicit tests of moderation, interpretive issues arising from a restricted range on moderator variables, the failure to report effect size estimates, the presence of potential confounding factors, and the importance of examining factors that might operate at multiple ecological levels. These points are illustrated using examples of studies, primarily within youth violence prevention research, that have identified factors within the individual, school, and community that moderate the outcomes of preventive interventions. We conclude with general recommendations for future work. These include the benefits of using the social-ecological model to provide a basis for moving from exploratory to more theory-driven confirmatory models of subgroup differences, the potential merits of qualitative research designed to identify factors that may influence the effectiveness of intervention efforts for specific subgroups of individuals, and the provision of effect size estimates and confidence intervals for effect sizes in prevention reports.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The world report on violence and health
Krug, E. G., Mercy, J. A., Dahlberg, L. L., & Zwi, A. B. (2002) · The Lancet · doi:10.1016/s0140-6736(02)11133-0 · Cited by 9,110
Introduction to Statistical Mediation Analysis
MacKinnon, D. P. (2012) · doi:10.4324/9780203809556 · Cited by 5,618
Testing the number of components in a normal mixture
Lo, Y. (2001) · Biometrika · doi:10.1093/biomet/88.3.767 · Cited by 4,640
Standards of Evidence: Criteria for Efficacy, Effectiveness and Dissemination
Flay, B. R., Biglan, A., Boruch, R. F., Castro, F. G., Gottfredson, D., Kellam, S., Mościcki, E. K., Schinke, S., Valentine, J. C., & Ji, P. (2005) · Prevention Science · doi:10.1007/s11121-005-5553-y · Cited by 1,338
Coie, J. D., Watt, N. F., West, S. G., Hawkins, J. D., Asarnow, J. R., Markman, H. J., Ramey, S. L., Shure, M. B., & Long, B. (1993) · American Psychologist · doi:10.1037/0003-066x.48.10.1013 · Cited by 1,253 · cited 2×
“Because most disorders are multiply determined, individuals within a target population may vary in their exposure to risk factors, and their levels of promotive and protective factors (Coie et al. 1993).”
BackgroundBierman, K. L., Conduct Problems Prevention Research Group, Coie, J. D., Dodge, K. A., Greenberg, M. T., Lochman, J. E., McMahon, R. J., & Pinderhughes, E. (2010) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0018607 · Cited by 397
Those confounded moderators in meta-analysis: good, bad, and ugly
Lipsey, M. W. (2003) · The ANNALS of the American Academy of Political and Social Science · doi:10.1177/0002716202250791 · Cited by 283 · cited 2×
“This is a problem in individual studies and in meta-analyses, where moderators may be correlated with study selection criteria (Lipsey 2003).”
Background
Cited by
Rowe, H. L., & Trickett, E. J. (2018) · Educational Psychology Review · doi:10.1007/s10648-017-9425-3 · Cited by 79
Humphrey, N., Hennessey, A., Lendrum, A., Wigelsworth, M., Turner, A., Panayiotou, M., Joyce, C., Pert, K., Stephens, E., Wo, L., et al. (2018) · Public Health Research · doi:10.3310/phr06100 · Cited by 38
Students with disabilities in social and emotional learning interventions: A systematic review
Daley, S. G., & McCarthy, M. F. (2021) · Remedial and Special Education · doi:10.1177/0741932520964917 · Cited by 34
Rothman, A. J. (2013) · Prevention Science · doi:10.1007/s11121-012-0333-y · Cited by 30
“…might augment or impair the underlying process and thus enable investigators to be prepared to measure and test potential moderators of the intervention and, in doing so, facilitate the transition from descriptive, exploratory research to theoreticallygrounded efforts (see Farrell et al. 2012).”
BackgroundResultEvaluating the genetic susceptibility to peer reported bullying behaviors
Musci, R. J., Bettencourt, A. F., Sisto, D., Maher, B., Uhl, G., Ialongo, N., & Bradshaw, C. P. (2018) · Psychiatry Research · doi:10.1016/j.psychres.2018.03.016 · Cited by 13
“However, it is clear that not all youth involved in bullying evidence the same pattern of behaviors and associated risk factors therefore not everyone will benefit from the same type of intervention (Farrell et al., 2013) so selective interventions that are biologically informed may have more success in reducing bully…”
Self-citation
Metadata
- Authors
- Farrell, A. D., Henry, D. B., & Bettencourt, A.
- Venue
- Prevention Science
- Published
- 2011-01-28
- Volume
- 14
- Issue
- 2
- Pages
- 121-133
- ISSN
- 1389-4986 (ISSN-L)
- 1573-6695
- OpenAlex
- W1989093148
- Cited by
- 74
- References
- 7
- FWCI
- 7.59
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Methodological Challenges Examining Subgroup Differences: Examples from Universal School-based Youth Violence Prevention Trials. https://app.cochat.ai/papers/10.1007/s11121-011-0200-2
- The paper
- Farrell, A. D., Henry, D. B., & Bettencourt, A. (2013). Methodological Challenges Examining Subgroup Differences: Examples from Universal School-based Youth Violence Prevention Trials. Prevention Science. https://doi.org/10.1007/s11121-011-0200-2
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.