Universal Interventions: Fully Exploring Their Impacts and Potential to Produce Population-Level Impacts
Abstract
In this article we seek to promote a deeper understanding of the value of universal intervention research in education as well as other fields and to call for greater interdisciplinary learning and discourse. Our goal is to deepen the conversation regarding how to build a stronger research orientation toward longitudinal, population-level outcomes in education and mental health. After highlighting the value of universal approaches targeting entire populations and their relevance to education, we raise issues regarding the traditional benchmarks of efficacy when applied to universal intervention trials and suggest alternative metrics for judging the impact of universal approaches. We conclude with lessons based on exemplar studies to help shape future research and policy regarding universal interventions.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Without clear evidence about why average effect sizes differ in later studies, researchers may prematurely discard interventions that yield low average effects but could provide meaningful benefits at scale for targeted groups.
“Without clear evidence about why average effect sizes differ in later-conducted studies—evidence that could be acquired from a systematic investigation of effect heterogeneity—researchers may prematurely discard interventions that yield low average effects but could provide meaningful and replicable benefits at scale for targeted groups21,23.”
From A national experiment reveals where a growth mindset improves achievement (2019) · cites this paper as [21]
Most interventions that are effective in initial efficacy trials show weaker or no effects when scaled up in effectiveness trials with more heterogeneous samples.
“most interventions that are effective in initial efficacy trials go on to show weaker or no effects when they are scaled up in effectiveness trials that deliver treatments under everyday conditions to more heterogeneous samples21–23.”
From A national experiment reveals where a growth mindset improves achievement (2019) · cites this paper as [21]
Historically, scientific methods used to answer questions about heterogeneity of intervention effects have been underdeveloped and underused.
“Historically, the scientific methods used to answer questions about the heterogeneity of intervention effects have been underdeveloped and underused21,24,25.”
From A national experiment reveals where a growth mindset improves achievement (2019) · cites this paper as [21]
Cites
Durlak, J. A., Weissberg, R. P., Dymnicki, A. B., Taylor, R. D., & Schellinger, K. B. (2011) · Child Development · doi:10.1111/j.1467-8624.2010.01564.x · Cited by 8,746 · see citing works
Heart Disease and Stroke Statistics—2013 Update: A Report From the American Heart Association
Go, A. S., Mozaffarian, D., Roger, V. L., Benjamin, E. J., Berry, J. D., Borden, W. B., Bravata, D. M., Dai, S., Ford, E. S., Fox, C. S., et al. (2013) · Circulation · doi:10.1161/cir.0b013e31828124ad · Cited by 5,292 · see citing works
Equifinality and multifinality in developmental psychopathology
Cicchetti, D., & Rogosch, F. A. (1996) · Development and Psychopathology · doi:10.1017/s0954579400007318 · Cited by 1,842 · cited 1× · see citing works
“Uncertainty in our predictive models is in part due to the complicated, multilevel nature of development as indicated by the concept equifinality (Cicchetti & Rogosch, 1997).”
BackgroundStandards of Evidence: Criteria for Efficacy, Effectiveness and Dissemination
Flay, B. R., Biglan, A., Boruch, R. F., Castro, F. G., Gottfredson, D., Kellam, S., Mościcki, E. K., Schinke, S., Valentine, J. C., & Ji, P. (2005) · Prevention Science · doi:10.1007/s11121-005-5553-y · Cited by 1,338 · see citing works
Go, A. S., Mozaffarian, D., Roger, V. L., Benjamin, E. J., Berry, J. D., Borden, W. B., Bravata, D. M., Dai, S., Ford, E. S., Fox, C. S., et al. (2013) · Circulation · doi:10.1161/cir.0b013e318282ab8f · Cited by 1,294 · see citing works
Epigenetics and the biological definition of gene×environment interactions
Meaney, M. J. (2010) · Child Development · doi:10.1111/j.1467-8624.2009.01381.x · Cited by 1,239 · see citing works
Confidence intervals for the number needed to treat.
Altman, D. G. (1998) · BMJ · doi:10.1136/bmj.317.7168.1309 · Cited by 938 · see citing works
Promoting Academic and Social-Emotional School Readiness: The Head Start REDI Program
Bierman, K. L., Domitrovich, C. E., Nix, R. L., Gest, S. D., Welsh, J. A., Greenberg, M. T., Blair, C., Nelson, K. E., & Gill, S. (2008) · Child Development · doi:10.1111/j.1467-8624.2008.01227.x · Cited by 884 · see citing works
Self-citationBALFANZ, R., HERZOG, L., & MAC IVER, D. J. (2007) · Educational Psychologist · doi:10.1080/00461520701621079 · Cited by 804 · see citing works
School-Based Interventions for Aggressive and Disruptive Behavior
Wilson, S. J., & Lipsey, M. W. (2007) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2007.04.011 · Cited by 783 · see citing works
Effect Size, Practical Importance, and Social Policy for Children
McCartney, K., & Rosenthal, R. (2000) · Child Development · doi:10.1111/1467-8624.00131 · Cited by 429 · see citing works
The economic value of social and emotional learning
Belfield, C., Bowden, A. B., Klapp, A., Levin, H., Shand, R., & Zander, S. (2015) · Journal of Benefit-Cost Analysis · doi:10.1017/bca.2015.55 · Cited by 307 · see citing works
Engel, M., Claessens, A., & Finch, M. A. (2013) · Educational Evaluation and Policy Analysis · doi:10.3102/0162373712461850 · Cited by 259 · see citing works
da Costa, B. R., Rutjes, A. W., Johnston, B. C., Reichenbach, S., Nüesch, E., Tonia, T., Gemperli, A., Guyatt, G. H., & Jüni, P. (2012) · International Journal of Epidemiology · doi:10.1093/ije/dys124 · Cited by 145 · see citing works
Cooper, B. R., & Lanza, S. T. (2014) · Child Development · doi:10.1111/cdev.12278 · Cited by 88 · see citing works
Bloom, H. S., & Michalopoulos, C. (2013) · Prevention Science · doi:10.1007/s11121-010-0198-x · Cited by 83 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
A national experiment reveals where a growth mindset improves achievement
Yeager, D. S., Hanselman, P., Walton, G. M., Murray, J. S., Crosnoe, R., Muller, C., Tipton, E., Schneider, B., Hulleman, C. S., Hinojosa, C. P., et al. (2019) · Nature · doi:10.1038/s41586-019-1466-y · Cited by 1,513 · see citing works
Interpreting effect sizes of education interventions
Kraft, M. A. (2020) · Educational Researcher · doi:10.3102/0013189x20912798 · Cited by 1,281 · see citing works
Petersen, K. J., Qualter, P., & Humphrey, N. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.01214 · Cited by 195 · see citing works
Jennings, P. A., Doyle, S., Oh, Y., Rasheed, D., Frank, J. L., & Brown, J. L. (2019) · Journal of School Psychology · doi:10.1016/j.jsp.2019.07.009 · Cited by 186 · see citing works
Evidence for Social and Emotional Learning in Schools
Greenberg, M. T. (2023) · doi:10.54300/928.269 · Cited by 179 · see citing works
Self-citationthe MYRIAD team, Kuyken, W., Nuthall, E., Byford, S., Crane, C., Dalgleish, T., Ford, T., Greenberg, M. T., Ukoumunne, O. C., Viner, R. M., et al. (2017) · Trials · doi:10.1186/s13063-017-1917-4 · Cited by 77 · see citing works
Self-citationShaw, D. S., Mendelsohn, A. L., & Morris, P. A. (2021) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-021-00366-0 · Cited by 64 · see citing works
Miguel, C., Amarnath, A., Akhtar, A., Malik, A., Baranyi, G., Barbui, C., Karyotaki, E., & Cuijpers, P. (2023) · Occupational and Environmental Medicine · doi:10.1136/oemed-2022-108698 · Cited by 55 · see citing works
Promoting learning from null or negative results in prevention science trials
Axford, N., Berry, V., Lloyd, J., Hobbs, T., & Wyatt, K. (2022) · Prevention Science · doi:10.1007/s11121-020-01140-4 · Cited by 34 · see citing works
Maloney, S., Montero-Marin, J., & Kuyken, W. (2024) · Psychotherapy Research · doi:10.1080/10503307.2023.2269299 · Cited by 18 · see citing works
“…the MBCT curricula offered to wider audiences (e.g., M-FP and MBCTL) will optimize reach but may produce smaller effects ( beginning of funnel ) whereas more tailored programmes (e.g., MBCT-TiF) will optimize effects but may reach a smaller audience ( end of funnel ) (Greenberg & Abenavoli, 2017).”
BackgroundMoyes, E., Nutman, G., & Mirman, J. H. (2022) · Journal of Child & Adolescent Trauma · doi:10.1007/s40653-022-00454-5 · Cited by 19 · see citing works
Maloney, S., Surawy, C., Martin, M., Montero-Marin, J., & Kuyken, W. (2023) · Mindfulness · doi:10.1007/s12671-023-02193-6 · Cited by 10 · see citing works
“We know that interventions that are offered to the general population tend to be more accessible but produce smaller effect sizes (Greenberg & Abenavoli, 2017), so an investigation of its constituent components in terms of how and why they work can further our understanding to best optimize both…”
Background
- Authors
- Greenberg, M. T., & Abenavoli, R.
- Affiliations
- Pennsylvania State University (US)
- Corresponding author
- Greenberg, Mark T.
- Venue
- Journal of Research on Educational Effectiveness
- Publisher
- Informa UK Limited
- Published
- 2016-10-13
- Volume
- 10
- Issue
- 1
- Pages
- 40-67
- ISSN
- 1934-5739 (ISSN-L)
- 1934-5747
- OpenAlex
- W2531443228
- Cited by
- 255
- References
- 16
- Citations by year
- 2026: 27 · 2025: 37 · 2024: 23 · 2023: 36 · 2022: 30 · 2021: 32 · 2020: 30 · 2019: 14 · 2018: 17 · 2017: 8
- FWCI
- 14.24
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Research on Educational Effectiveness (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Evaluation and Performance Assessment
- Social Sciences › Education › Early Childhood Education and Development
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Keywords
- universal interventions, population-level outcomes, longitudinal outcomes, impact indicators, mental health interventions, educational intervention, interdisciplinary research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review