Probing the effects of individual components in multiple component prevention programs
Abstract
Assessing the contributions of individual components in multi‐component interventions poses complex challenges for prevention researchers. We review the strengths and weaknesses of designs and analyses that may be useful in answering three questions: (1) Is each of the individual components contributing to the outcome? (2) Is the program optimal? and (3), Through what processes are the components of the program achieving their effects? Factorial and fractional factorial designs in which a systematically selected portion of all possible treatment combinations is implemented are used to address question 1. Response surface designs in which each component is quantitatively scaled are explored in relation to question 2. Mediational analysis, a hybrid of experimental and correlational approaches, is considered in relation to question 3. Design enhancements are offered that may further strengthen some of these techniques. These techniques offer promise of enhancing both the basic science and applied science contributions of prevention research.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. E., & Cohen, J. (1989) · Technometrics · doi:10.2307/1270020 · Cited by 99,588 · see citing works
Baron, R. M., & Kenny, D. A. (1986) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.51.6.1173 · Cited by 91,542 · see citing works
Baron, R. M., & Kenny, D. A. (1986) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.51.6.1173 · Cited by 91,532 · see citing works
Statistical power analysis for the behavioral sciences
Cohen, J. (1990) · Computers Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,406 · see citing works
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,385 · see citing works
Multiple regression: testing and interpreting interactions
(1992) · Choice Reviews Online · doi:10.5860/choice.29-3352 · Cited by 36,644 · see citing works
Significance tests and goodness of fit in the analysis of covariance structures.
Bentler, P. M., & Bonett, D. G. (1980) · Psychological Bulletin · doi:10.1037/0033-2909.88.3.588 · Cited by 19,266 · see citing works
Hierarchical Linear Models: Applications and Data Analysis Methods.
Longford, N. T., Bryk, A. S., & Raudenbush, S. W. (1993) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2075823 · Cited by 18,768 · see citing works
(1979) · Medical Entomology and Zoology · Cited by 11,252 · see citing works
Quasi-experimentation: Design and analysis issues for field settings
Shrout, P. E. (1980) · Evaluation and Program Planning · doi:10.1016/0149-7189(80)90063-4 · Cited by 6,091 · see citing works
Hawkins, J. D., Catalano, R. F., & Miller, J. Y. (1992) · Psychological Bulletin · doi:10.1037/0033-2909.112.1.64 · Cited by 5,428 · see citing works
Empirical Model Building and Response Surfaces
Freeny, A. E., Box, G. E. P., & Draper, N. R. (1988) · Technometrics · doi:10.2307/1270169 · Cited by 5,238 · see citing works
Statistics for experimenters. An introduction to design, data analysis, and model building.
Box, G. E. P., Hunter, W. G., & Hunter, J. S. (1978) · Cited by 4,021 · see citing works
Handbook of Psychotherapy and Behavior Change
Garfield, S. L., Bergin, A. E., & Dryden, W. (1987) · Journal of Cognitive Psychotherapy · doi:10.1891/0889-8391.1.4.264a · Cited by 3,998 · see citing works
Hierarchical Linear Models: Applications and Data Analysis Methods.
Goldstein, H., Bryk, A. S., & Raudenbush, S. W. (1993) · Journal of the American Statistical Association · doi:10.2307/2290750 · Cited by 3,320 · see citing works
Process Analysis: Estimating Mediation in Treatment Evaluations
Judd, C. M., & Kenny, D. A. (1981) · Evaluation Review · doi:10.1177/0193841x8100500502 · Cited by 2,442 · see citing works
Research design in clinical psychology
Kazdin, A. E. (1952) · Journal of Clinical Psychology · doi:10.1002/1097-4679(195201)8:1 · Cited by 2,153 · see citing works
Estimating Mediated Effects in Prevention Studies
MacKinnon, D. P., & Dwyer, J. H. (1993) · Evaluation Review · doi:10.1177/0193841x9301700202 · Cited by 1,936 · see citing works
Kenny, D. A. (1979) · Medical Entomology and Zoology · Cited by 1,376 · see citing works
Mediators, moderators, and tests for mediation.
James, L. R., & Brett, J. M. (1984) · Journal of Applied Psychology · doi:10.1037/0021-9010.69.2.307 · Cited by 1,339 · see citing works
Coie, J. D., Watt, N. F., West, S. G., Hawkins, J. D., Asarnow, J. R., Markman, H. J., Ramey, S. L., Shure, M. B., & Long, B. (1993) · American Psychologist · doi:10.1037/0003-066x.48.10.1013 · Cited by 1,253 · cited 2× · see citing works
“However, designs and analyses should be developed to the extent possible to be capable of probing the plausibility of the assumptions that have been made, particularly if they are compatible with other competing theoretical viewpoints ( Coie et al., 1993 ).”
BackgroundSelf-citationCoie, J. D., Watt, N. F., West, S. G., Hawkins, J. D., Asarnow, J. R., Markman, H. J., Ramey, S. L., Shure, M. B., & Long, B. (1993) · American Psychologist · doi:10.1037//0003-066x.48.10.1013 · Cited by 1,247 · see citing works
Self-citationIntroduction to Structural Equation Models.
Cherlin, A. J., & Duncan, O. D. (1976) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2064059 · Cited by 1,242 · see citing works
Mediators, moderators, and tests for mediation.
James, L. R., & Brett, J. M. (1984) · Journal of Applied Psychology · doi:10.1037//0021-9010.69.2.307 · Cited by 1,150 · see citing works
Cohen, P. (1980) · Evaluation and Program Planning · doi:10.1016/0149-7189(80)90009-9 · Cited by 1,139 · see citing works
Statistical design and analysis of experiments: with applications to engineering and science
(1990) · Choice Reviews Online · doi:10.5860/choice.27-2741 · Cited by 952 · see citing works
Do studies of statistical power have an effect on the power of studies?
Sedlmeier, P., & Gigerenzer, G. (1989) · Psychological Bulletin · doi:10.1037/0033-2909.105.2.309 · Cited by 748 · see citing works
Statistics for Experimenters: An Introduction to Design, Data Analysis, and Model Building
Parameswaran, R., Box, G. E. P., Hunter, W. G., & Hunter, J. S. (1979) · Journal of Marketing Research · doi:10.2307/3150696 · Cited by 685 · see citing works
Response Surface Methodology: 1966-1988
Myers, R. H., Khuri, A. I., Carter, W. H., et al. (1989) · Technometrics · doi:10.2307/1268813 · Cited by 597 · see citing works
Silvey, S. D. (1980) · Springer eBooks · doi:10.1007/978-94-009-5912-5 · Cited by 573 · see citing works
Estimating the effects of social interventions
Judd, C. M., & Kenny, D. A. (1981) · Medical Entomology and Zoology · Cited by 538 · see citing works
Pentz, M. A. (1989) · JAMA · doi:10.1001/jama.261.22.3259 · Cited by 534 · see citing works
Within-subjects designs: To use or not to use?
Greenwald, A. G. (1976) · Psychological Bulletin · doi:10.1037/0033-2909.83.2.314 · Cited by 529 · see citing works
Introduction to Structural Equation Models
(1975) · Elsevier eBooks · doi:10.1016/c2009-0-03148-1 · Cited by 446 · see citing works
Job seeking, reemployment, and mental health: A randomized field experiment in coping with job loss.
Caplan, R. D., Vinokur, A. D., Price, R., & van Ryn, M. (1989) · Journal of Applied Psychology · doi:10.1037/0021-9010.74.5.759 · Cited by 425 · see citing works
Psychosocial approaches to smoking prevention: A review of findings.
Flay, B. R. (1985) · Health Psychology · doi:10.1037//0278-6133.4.5.449 · Cited by 422 · see citing works
Webster-Stratton, C. H., Kolpacoff, M., & Hollinsworth, T. (1988) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.56.4.558 · Cited by 410 · see citing works
A Multicommunity Trial for Primary Prevention of Adolescent Drug Abuse
Pentz, M. A. (1989) · JAMA · doi:10.1001/jama.1989.03420220073030 · Cited by 381 · see citing works
Psychosocial approaches to smoking prevention: A review of findings.
Flay, B. R. (1985) · Health Psychology · doi:10.1037/0278-6133.4.5.449 · Cited by 328 · see citing works
Statistical power of psychological research: What have we gained in 20 years?
Rossi, J. S. (1990) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.58.5.646 · Cited by 323 · see citing works
Statistical power of psychological research: What have we gained in 20 years?
Rossi, J. S. (1990) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.58.5.646 · Cited by 323 · see citing works
Theory as method: small theories of treatments
Lipsey, M. W. (1993) · New Directions for Program Evaluation · doi:10.1002/ev.1637 · Cited by 322 · see citing works
The Design of Experiments: Statistical Principles for Practical Applications.
Causton, D. R., & Mead, R. (1989) · Journal of Ecology · doi:10.2307/2260996 · Cited by 315 · see citing works
MacKinnon, D. P., Johnson, C. A., Pentz, M. A., Dwyer, J. H., Hansen, W. B., Flay, B. R., & Wang, E. Y.-I. (1991) · Health Psychology · doi:10.1037/0278-6133.10.3.164 · Cited by 311 · see citing works
Statistical Issues in the Study of Temporal Data: Daily Experiences
West, S. G., & Hepworth, J. T. (1991) · Journal of Personality · doi:10.1111/j.1467-6494.1991.tb00261.x · Cited by 307 · see citing works
Self-citationEffects of four maintenance programs on the long-term management of obesity
Perri, M. G., McAllister, D. A., Gange, J. J., Jordan, R. C., McAdoo, W. G., & Nezu, A. M. (1988) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.56.4.529 · Cited by 304 · see citing works
Webster-Stratton, C. H., Kolpacoff, M., & Hollinsworth, T. (1988) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.56.4.558 · Cited by 304 · see citing works
Experimental Design: Review and Comment
Steinberg, D. M., & Hunter, W. G. (1984) · Technometrics · doi:10.1080/00401706.1984.10487928 · Cited by 300 · see citing works
Measuring Daily Events and Experiences: Decisions for the Researcher
Stone, A. A., Kessler, R. C., & Haythomthwatte, J. A. (1991) · Journal of Personality · doi:10.1111/j.1467-6494.1991.tb00260.x · Cited by 278 · see citing works
Statistical power analysis : a computer program
Cohen, J., & Borenstein, M. (1988) · Medical Entomology and Zoology · Cited by 270 · see citing works
Aiken, L. S., West, S. G., SECHREST, L. B., Reno, R. R., Roediger, H. L., III, Scarr, S. W., Kazdin, A. E., & Sherman, S. J. (1990) · American Psychologist · doi:10.1037/0003-066x.45.6.721 · Cited by 249 · see citing works
Self-citationHansen, W. B., Johnson, C. A., Flay, B. R., Graham, J. A., & Sobel, J. L. (1988) · Preventive Medicine · doi:10.1016/0091-7435(88)90059-x · Cited by 247 · see citing works
Primary Prevention and Promotion in the Schools
Bond, L. A., & Compas, B. E. (1989) · Medical Entomology and Zoology · Cited by 244 · see citing works
The children of divorce parenting intervention: Outcome evaluation of an empirically based program
Wolchik, S. A., West, S. G., Westover, S., Sandler, I. N., Martin, A., Lustig, J. L., Tein, J., & Fisher, J. L. (1993) · American Journal of Community Psychology · doi:10.1007/bf00941505 · Cited by 214 · see citing works
Self-citationCooper, W. H., & Richardson, A. J. (1986) · Journal of Applied Psychology · doi:10.1037/0021-9010.71.2.179 · Cited by 193 · see citing works
Pentz, M. A., Dwyer, J. H., MacKinnon, D. P., Flay, B. R., Hansen, W. B., Wang, E. Y. I., & Johnson, C. A. (1989) · PubMed · Cited by 187 · see citing works
Bayesian Estimation and Experimental Design in Linear Regression Models
Leonard, T., & Pilz, J. (1992) · Journal of the American Statistical Association · doi:10.2307/2290681 · Cited by 182 · see citing works
Linking empirically based theory and evaluation: The family bereavement program
Sandler, I. N., West, S. G., Baca, L. M., Pillow, D. R., Gersten, J. C., Rogosch, F. A., Virdin, L. M., Beals, J., Reynolds, K. D., Kallgren, C. A., et al. (1992) · American Journal of Community Psychology · doi:10.1007/bf00937756 · Cited by 162 · see citing works
Self-citationPrevention of Mental Disorders, Alcohol and Other Drug Use in Children and Adolescents
Gonzales, J. J. (1990) · Psychosomatics · doi:10.1016/s0033-3182(90)72148-2 · Cited by 156 · see citing works
A new conceptual framework for establishing school-based social competence promotion programs.
Weissberg, R. P., Caplan, M. Z., & Sivo, P. J. (1989) · Cited by 111 · see citing works
Response Surface Methodology: 1966–l988
Myers, R. H., Khuri, A. I., & Carter, W. H. (1989) · Technometrics · doi:10.1080/00401706.1989.10488509 · Cited by 106 · see citing works
Aiken, L. S., West, S. G., Woodward, C. K., Reno, R. R., & Reynolds, K. D. (1994) · Health Psychology · doi:10.1037/0278-6133.13.6.526 · Cited by 105 · see citing works
Self-citationA Celebration of Statistics: The ISI Centenary Volume.
Baxter, L. A., Atkinson, A. C., & Fienberg, S. E. (1991) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.2307/2983049 · Cited by 103 · see citing works
Introduction to Linear Models.
Bartko, J. J., Ward, J. H., & Jennings, E. (1974) · Journal of the American Statistical Association · doi:10.2307/2285550 · Cited by 98 · see citing works
New Directions for Program Evaluation
(2016) · New Directions for Program Evaluation · doi:10.1002/(issn)1551-2371 · Cited by 96 · see citing works
Communication for Health: Unselling Heart Disease
Maccoby, N., & Farquhar, J. W. (1975) · Journal of Communication · doi:10.1111/j.1460-2466.1975.tb00613.x · Cited by 86 · see citing works
The Design of Experiments: Statistical Principles for Practical Application
Derringer, G. C., & Mead, R. (1990) · Technometrics · doi:10.2307/1270125 · Cited by 85 · see citing works
Applied Factorial and Fractional Designs.
Paterson, L., McLean, R. A., & Anderson, V. L. (1985) · Journal of the Royal Statistical Society Series C (Applied Statistics) · doi:10.2307/2347480 · Cited by 78 · see citing works
Introduction to Linear Models and Experimental Design
Gill, P. S., Woodward, J. A., Bonett, D. G., et al. (1992) · Technometrics · doi:10.2307/1270042 · Cited by 75 · see citing works
Natural social behaviors in hyperactive children: Dose effects of methylphenidate.
Whalen, C. K., Henker, B. A., Swanson, J. M., Granger, D. A., Kliewer, W. L., & Spencer, J. (1987) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.55.2.187 · Cited by 71 · see citing works
Harackiewicz, J. M., Sansone, C., Blair, L. W., Epstein, J. A., & al, E. (1987) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.55.3.372 · Cited by 68 · see citing works
Introduction to linear models and experimental design
(1990) · Choice Reviews Online · doi:10.5860/choice.28-2197 · Cited by 62 · see citing works
Publication Trends in JPSP: Stability and Change in Topics, Methods, and Theories Across Two Decades
West, S. G., Newsom, J. T., & Fenaughty, A. M. (1992) · Personality and Social Psychology Bulletin · doi:10.1177/0146167292184012 · Cited by 54 · see citing works
Self-citationFamilies in Transition: Primary Prevention Programs That Work
Bond, L. A., & Wagner, B. M. (1988) · Medical Entomology and Zoology · Cited by 52 · see citing works
Psychotherapy and behavior change: social, cultural, and methodological perspectives
(1989) · Choice Reviews Online · doi:10.5860/choice.26-4148 · Cited by 52 · see citing works
Harackiewicz, J. M., Sansone, C., Blair, L. W., et al. (1987) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.55.3.372 · Cited by 52 · see citing works
Applied Factorial and Fractional Designs
Ziegel, E. R., McLean, R. A., & Anderson, V. L. (1985) · Technometrics · doi:10.2307/1269714 · Cited by 30 · see citing works
Increasing the Use of Mammography: A Pilot Program
Reynolds, K. D., West, S. G., & Aiken, L. S. (1990) · Health Education Quarterly · doi:10.1177/109019819001700407 · Cited by 28 · see citing works
Self-citationLarge-Scale Social Experimentation in the United States
Fienberg, S. E., Singer, B. H., & Tanur, J. M. (1985) · Springer eBooks · doi:10.1007/978-1-4613-8560-8_12 · Cited by 25 · see citing works
How to think, not what to think: A cognitive approach to prevention.
Shure, M. B. (1988) · Cited by 15 · see citing works
An airport director's perspective on disaster planning and mental health needs.
Anderson, T. D. (1988) · American Psychologist · doi:10.1037//0003-066x.43.9.721 · Cited by 9 · see citing works
An Introduction to the Optimum Design of Experiments
Atkinson, A. C. (1985) · Springer eBooks · doi:10.1007/978-1-4613-8560-8_20 · Cited by 5 · see citing works
Hierarchical Linear Models: Potential Applications in Psychological Research?
Kreft, I. G. G. (1992) · PsycEXTRA Dataset · doi:10.1037/e602812011-007 · Cited by 2 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Collins, L. M., Dziak, J. J., & Li, R. (2009) · Psychological Methods · doi:10.1037/a0015826 · Cited by 431 · see citing works
Syndemics and Health Disparities: A Methodological Note
Tsai, A. C., & Venkataramani, A. S. (2016) · AIDS and Behavior · doi:10.1007/s10461-015-1260-2 · Cited by 176 · see citing works
Dziak, J. J., Nahum-Shani, I., & Collins, L. M. (2012) · Psychological Methods · doi:10.1037/a0026972 · Cited by 142 · see citing works
Collins, L. M., Chakraborty, B., Murphy, S. A., & Strecher, V. (2009) · Clinical Trials · doi:10.1177/1740774508100973 · Cited by 80 · see citing works
Conceptual Introduction to the Multiphase Optimization Strategy (MOST)
Collins, L. M. (2018) · Statistics for Social and Behavioral Sciences · doi:10.1007/978-3-319-72206-1_1 · Cited by 51 · see citing works
Petsolari, M., Ibrahim, S. B., & Slovak, P. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642619 · Cited by 35 · see citing works
Barreira, P. J., Tepper, M. C., Gold, P. B., Holley, D., & Macias, C. (2010) · Psychiatric Quarterly · doi:10.1007/s11126-010-9124-4 · Cited by 6 · see citing works
- Authors
- West, S. G., Aiken, L. S., & Todd, M.
- Affiliations
- Arizona State University (US)
- Corresponding author
- West, Stephen G.
- ORCID
- Todd, Michael
- Venue
- American Journal of Community Psychology
- Publisher
- Wiley
- Published
- 1993-10
- Volume
- 21
- Issue
- 5
- Pages
- 571-605
- ISSN
- 0091-0562 (ISSN-L)
- 1573-2770
- OpenAlex
- W2085396258
- Cited by
- 69
- References
- 83
- Citations by year
- 2026: 1 · 2024: 2 · 2021: 1 · 2020: 3 · 2019: 1 · 2018: 4 · 2017: 2 · 2016: 2 · 2015: 1 · 2014: 2 · 2013: 1 · 2012: 5
- FWCI
- 0.95
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- American Journal of Community Psychology (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institutes of Health (1r03ca046736-01, 2p50mh039246-06)
- National Institute of Mental Health (NIMH P50MH39246)
- National Cancer Institute (R03-CA46736)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Social Sciences › Decision Sciences › Management Science and Operations Research › Evaluation and Performance Assessment
- Health Sciences › Medicine › Epidemiology › Substance Abuse Treatment and Outcomes
- Keywords
- multicomponent intervention, prevention programs, factorial design, fractional factorial design, response surface design, program optimization, intervention components, process evaluation
- MeSH terms
- Mental Disorders, Combined Modality Therapy, Community Mental Health Services, Humans, Outcome and Process Assessment, Health Care, Research, Risk Factors
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review