A Hybrid Evaluation-Optimization Trial to Evaluate an Intervention Targeting the Intersection of Alcohol and Sex in College Students and Simultaneously Test an Additional Component Aimed at Preventing Sexual Violence
Open accessThe DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Using the multiphase optimization strategy (MOST), we previously developed and optimized an online behavioral intervention, itMatters, aimed at reducing the risk of sexually transmitted infections (STI) among first-year college students by targeting the intersection of alcohol use and sexual behaviors. PURPOSE: We had two goals: (a) to evaluate the optimized itMatters intervention and (b) to determine whether the candidate sexual violence prevention (SVP) component (included at the request of participating universities) had a detectable effect and therefore should be added to create a new version of itMatters. We also describe the hybrid evaluation-optimization trial we conducted to accomplish these two goals in a single experiment. METHODS: First year college students (N = 3,098) at four universities in the USA were individually randomized in a hybrid evaluation-optimization 2 × 2 factorial trial. Data were analyzed using regression models, with pre-test outcome variables included as covariates in the models. Analyses were conducted separately with (a) immediate post-test scores and (b) 60-day follow-up scores as outcome variables. RESULTS: Experimental results indicated a significant effect of itMatters on targeted proximal outcomes (norms) and on one distal behavioral outcome (binge drinking). There were no significant effects on other behavioral outcomes, including the intersection of alcohol and sexual behaviors. In addition, there were mixed results (positive short-term effect; no effect at 60-day follow-up) of the SVP component on targeted proximal outcomes (students' self-efficacy to reduce/prevent sexual violence and perceived effectiveness of protective behavioral strategies). CONCLUSIONS: The hybrid evaluation-optimization trial enabled us to evaluate the individual and combined effectiveness of the optimized itMatters intervention and the SVP component in a single experiment, conserving resources and providing greatly improved efficiency. TRIAL REGISTRATION: NCT04095065.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Specifically, MOST enables the systematic identification of active treatment components in multicomponent interventions, including how the presence or absence of one or more components affects the performance of other components.59–61”
From Optimising psychological treatment for pain after breast cancer: a factorial design study protocol in Denmark (2023) · cites this paper as [61]
The cited source says what the claim attributes to it.
In the citing paper
“The Multiphase Optimization Strategy (MOST) is a methodological framework, conceptually rooted in engineering, designed specifically for optimisation of multicomponent interventions.”
From Optimising psychological treatment for pain after breast cancer: a factorial design study protocol in Denmark (2023) · cites this paper as [61]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The theory of planned behavior
Ajzen, I. (1991) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(91)90020-t · Cited by 90,587
Cialdini, R. B., Kallgren, C. A., & Reno, R. R. (1991) · Advances in Experimental Social Psychology · doi:10.1016/s0065-2601(08)60330-5 · Cited by 3,143
Collins, L. M., Murphy, S. A., & Strecher, V. (2007) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2007.01.022 · Cited by 1,082
Self-citationChanging Norms to Change Behavior
Miller, D. T., & Prentice, D. A. (2016) · Annual Review of Psychology · doi:10.1146/annurev-psych-010814-015013 · Cited by 527
Perkins, H. W., Haines, M. P., & Rice, R. (2005) · Journal of Studies on Alcohol · doi:10.15288/jsa.2005.66.470 · Cited by 467
Collins, L. M., Dziak, J. J., & Li, R. (2009) · Psychological Methods · doi:10.1037/a0015826 · Cited by 431 · cited 2×
“As is the standard in intervention optimization research and factorial analysis of variance [24, 29], we defined main effects and interactions using effect coding (−1, 1).”
BackgroundMethodSelf-citationWechsler, H., Nelson, T. E., Lee, J. E., Seibring, M., Lewis, C., & Keeling, R. P. (2003) · Journal of Studies on Alcohol · doi:10.15288/jsa.2003.64.484 · Cited by 428
Efficacy of computer technology-based HIV prevention interventions: a meta-analysis
Noar, S. M., Black, H. G., & Pierce, L. B. (2009) · AIDS · doi:10.1097/qad.0b013e32831c5500 · Cited by 385
Rehm, J., Shield, K. D., Joharchi, N., & Shuper, P. A. (2012) · Addiction · doi:10.1111/j.1360-0443.2011.03621.x · Cited by 344 · cited 1×
“, alcohol consumption increases intentions to engage in sex without a condom) [2, 3].”
BackgroundThe Multiphase Optimization Strategy for Engineering Effective Tobacco Use Interventions
Collins, L. M., Baker, T. B., Mermelstein, R. J., Piper, M. E., Jorenby, D. E., Smith, S. S., Christiansen, B. A., Schlam, T. R., Cook, J. W., & Fiore, M. C. (2011) · Annals of Behavioral Medicine · doi:10.1007/s12160-010-9253-x · Cited by 300
Self-citationCollins, L. M. (2018) · Statistics for Social and Behavioral Sciences · doi:10.1007/978-3-319-72206-1 · Cited by 257
Self-citationNoar, S. M. (2008) · AIDS and Behavior · doi:10.1007/s10461-007-9313-9 · Cited by 250
Computer-delivered interventions to reduce college student drinking: A meta-analysis
Carey, K. B., Scott‐Sheldon, L. A. J., Elliott, J. C., Bolles, J. R., & Carey, M. P. (2009) · Addiction · doi:10.1111/j.1360-0443.2009.02691.x · Cited by 250 · cited 1×
“Most existing interventions target alcohol use [13, 14] or condom use [15–17] independently.”
BackgroundHooking Up and Sexual Risk Taking Among College Students: A Health Belief Model Perspective
Downing-Matibag, T. M., & Geisinger, B. (2009) · Qualitative Health Research · doi:10.1177/1049732309344206 · Cited by 240
Fromme, K., & Corbin, W. (2004) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.72.6.1038 · Cited by 195 · cited 1×
“Most existing interventions target alcohol use [13, 14] or condom use [15–17] independently.”
BackgroundScott-Sheldon, L. A. J., Huedo-Medina, T. B., Warren, M. R., Johnson, B. T., & Carey, M. P. (2011) · JAIDS Journal of Acquired Immune Deficiency Syndromes · doi:10.1097/qai.0b013e31823554d7 · Cited by 112
Justus, A. N., Finn, P. R., & Steinmetz, J. E. (2000) · Alcoholism: Clinical and Experimental Research · doi:10.1097/00000374-200007000-00013 · Cited by 106 · cited 1×
“, alcohol consumption increases intentions to engage in sex without a condom) [2, 3].”
BackgroundSeth, P., Wingood, G. M., DiClemente, R. J., & Robinson, L. S. (2011) · Women's Health Issues · doi:10.1016/j.whi.2010.10.005 · Cited by 98
Lewis, M. A., Rees, M., Logan, D. E., Kaysen, D. L., & Kilmer, J. R. (2010) · Psychology of Addictive Behaviors · doi:10.1037/a0018361 · Cited by 98
Doumas, D. M., & Andersen, L. L. (2009) · Journal of College Counseling · doi:10.1002/j.2161-1882.2009.tb00037.x · Cited by 85
Kuperberg, A., & Padgett, J. E. (2015) · The Journal of Sex Research · doi:10.1080/00224499.2014.901284 · Cited by 84 · cited 1×
“, in the sophomore year) and/or require booster sessions to see an effect on distal behavioral outcomes [38].”
BackgroundPellegrini, C. A., Hoffman, S. A., Collins, L. M., & Spring, B. (2014) · Contemporary Clinical Trials · doi:10.1016/j.cct.2014.05.007 · Cited by 83
Self-citationRandolph, M. E., Torres, H., Gore-Felton, C. E., Lloyd, B., & McGarvey, E. L. (2009) · The American Journal of Drug and Alcohol Abuse · doi:10.1080/00952990802585422 · Cited by 80
The Association Between Alcohol and Sexual Risk Behaviors Among College Students: a Review
Brown, J. L., Gause, N. K., & Northern, N. (2016) · Current Addiction Reports · doi:10.1007/s40429-016-0125-8 · Cited by 78 · cited 1×
“, having sex with a partner that you would not have under other circumstance and/or increase condom misuse) thus increases risk of STI acquisition [28].”
BackgroundGwadz, M. V., Collins, L. M., Cleland, C. M., Leonard, N. R., Wilton, L., Gandhi, M., Scott Braithwaite, R., Perlman, D. C., Kutnick, A., & Ritchie, A. S. (2017) · BMC Public Health · doi:10.1186/s12889-017-4279-7 · Cited by 73
Self-citationNorris, J., Stoner, S. A., Hessler, D., Zawacki, T., Davis, K. C., George, W. H., Morrison, D. M., Parkhill, M. R., & Abdallah, D. A. (2009) · Psychology of Addictive Behaviors · doi:10.1037/a0013998 · Cited by 67
Computer-based interventions for sexual health promotion: systematic review and meta-analyses
Bailey, J. V., Murray, E., Rait, G., Mercer, C. H., Morris, R. W., Peacock, R., Cassell, J., & Nazareth, I. (2012) · International Journal of STD & AIDS · doi:10.1258/ijsa.2011.011221 · Cited by 65
Spring, B., Pfammatter, A. F., Marchese, S. H., Stump, T., Pellegrini, C., McFadden, H. G., Hedeker, D., Siddique, J., Jordan, N., & Collins, L. M. (2020) · Obesity · doi:10.1002/oby.22915 · Cited by 61
Self-citationWatkins, E., Newbold, A., Tester-Jones, M., Javaid, M., Cadman, J., Collins, L. M., Graham, J., & Mostazir, M. (2016) · BMC Psychiatry · doi:10.1186/s12888-016-1054-8 · Cited by 51
Self-citationCoding and Interpretation of Effects in Analysis of Data from a Factorial Experiment
Kugler, K. C., Dziak, J. J., & Trail, J. B. (2018) · Statistics for social and behavioral sciences · doi:10.1007/978-3-319-91776-4_6 · Cited by 50
Patterns of reasoning and decision making about condom use by urban college students
Patel, V. L., Gutnik, L. A., Yoskowitz, N. A., O’Sullivan, L. F., & Kaufman, D. R. (2006) · AIDS Care · doi:10.1080/09540120500333509 · Cited by 45
Phillips, S. M., Collins, L. M., Penedo, F. J., Courneya, K. S., Welch, W. A., Cottrell, A., Lloyd, G. R., Gavin, K. L., Cella, D. F., Ackermann, R. T., et al. (2018) · Contemporary Clinical Trials · doi:10.1016/j.cct.2018.01.001 · Cited by 40
Self-citationHuffman, J. C., Albanese, A. M., Campbell, K. A., Celano, C. M., Millstein, R. A., Mastromauro, C. A., Healy, B. C., Chung, W.-J., Januzzi, J. L., Collins, L. M., et al. (2017) · Clinical Trials · doi:10.1177/1740774516673365 · Cited by 37
Self-citationBernstein, S. L., Dziura, J., Weiss, J., Miller, T., Vickerman, K. A., Grau, L. E., Pantalon, M. V., Abroms, L., Collins, L. M., & Toll, B. (2018) · Contemporary Clinical Trials · doi:10.1016/j.cct.2017.12.016 · Cited by 35
Self-citationUwatoko, T., Luo, Y., Sakata, M., Kobayashi, D., Sakagami, Y., Takemoto, K., Collins, L. M., Watkins, E., Hollon, S. D., Wason, J., et al. (2018) · Trials · doi:10.1186/s13063-018-2719-z · Cited by 34
Self-citationAlcohol Consumption and Academic Retention in First-Year College Students.
Liguori, G. A., & Lonbaken, B. (2015) · College student journal · Cited by 28
The importance of psychosocial factors in the prevention of HPV infection and cervical cancer
Fernández-Esquer, M. E., Ross, M. W., & Torres, I. (2000) · International Journal of STD & AIDS · doi:10.1258/0956462001915110 · Cited by 27
Kugler, K. C., Balantekin, K. N., Birch, L. L., & Savage, J. S. (2016) · BMC Public Health · doi:10.1186/s12889-016-3850-y · Cited by 26
Gilchrist, H., Smith, K., Magee, C., & Jones, S. C. (2012) · Research Online (University of Wollongong) · Cited by 21
Massengale, K. E. C., Ma, A., Rulison, K. L., Milroy, J. J., & Wyrick, D. L. (2016) · Journal of American College Health · doi:10.1080/07448481.2016.1233557 · Cited by 21
Self-citationFearnow-Kenney, M. D., Wyrick, D. L., Milroy, J. J., Reifsteck, E. J., Day, T., & Kelly, S. E. (2015) · The Sport Psychologist · doi:10.1123/tsp.2015-0016 · Cited by 20
Self-citationWyrick, D. L., Tanner, A. E., Milroy, J. J., Guastaferro, K., Bhandari, S., Kugler, K. C., Thorpe, S. Y., Ware, S., Miller, A. M., & Collins, L. M. (2020) · Journal of American College Health · doi:10.1080/07448481.2020.1790571 · Cited by 20 · cited 7×
“To fill this gap, we developed and optimized itMatters, an intervention for first year college students designed to support sexual health and prevent STIs by addressing alcohol use and sexual behaviors with a specific focus on this critical intersection [18].”
BackgroundMethodInfluentialSelf-citationKugler, K. C., Wyrick, D. L., Tanner, A. E., Milroy, J. J., Chambers, B. D., Ma, A., Guastaferro, K., & Collins, L. M. (2018) · Statistics for social and behavioral sciences · doi:10.1007/978-3-319-91776-4_1 · Cited by 14
Self-citationBlack First-Year College Students’ Alcohol Outcome Expectancies
Thorpe, S. Y., Tanner, A. E., Ware, S., Guastaferro, K., Milroy, J. J., & Wyrick, D. L. (2020) · American Journal of Health Education · doi:10.1080/19325037.2020.1713259 · Cited by 5 · cited 1×
“This possibility is consistent with other research showing that “higher risk” students are more difficult to recruit and retain as research participants [32].”
ResultSelf-citationDudley, W. N., Milroy, J. J., Reifsteck, E. J., Rulison, K. L., & Wyrick, D. L. (2017) · NC Digital Online Collection of Knowledge and Scholarship (The University of North Carolina at Greensboro) · Cited by 4
Self-citation
Research works printed but not linked: 1
- Johnston, 2010, Monitoring the Future: National Survey Results on Drug Use, 1975–2009
Cited by
Intervention Optimization: A Paradigm Shift and Its Potential Implications for Clinical Psychology
Collins, L. M., Nahum-Shani, I. B., Guastaferro, K., Strayhorn, J. C., Vanness, D. J., & Murphy, S. A. (2024) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-080822-051119 · Cited by 85
Self-citationKettrey, H. H., Thompson, M. P., Marx, R. A., & Davis, A. J. (2023) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2023.02.022 · Cited by 53
Collins, L. M., Strayhorn, J. C., & Vanness, D. J. (2021) · Translational Behavioral Medicine · doi:10.1093/tbm/ibab087 · Cited by 43
Self-citationGuastaferro, K., & Collins, L. M. (2021) · Implementation Research and Practice · doi:10.1177/26334895211054363 · Cited by 42
“…loss (e.g., Spring et al., 2020), HIV (e.g., Caldwell et al., 2012; Gwadz et al., 2017), the prevention of sexually transmitted infections (STI; Tanner et al., 2021; Wyrick et al., 2020), positive emotions among highrisk cardiac patients (Celano et al., 2018; Huffman et al., 2017) and…”
BackgroundSelf-citationO’Hara, K. L., Knowles, L. M., Guastaferro, K., & Lyon, A. R. (2022) · Implementation Research and Practice · doi:10.1177/26334895221131052 · Cited by 24
“…successfully optimize multicomponent interventions including, but not limited to, smoking cessation (Piper et al., 2016, 2018; Schlam et al., 2016), weight loss (Spring et al., 2020), and prevention of sexually transmitted infections in college students (Tanner et al., 2021; Wyrick et al., 2020).”
BackgroundSelf-citation
Metadata
- Authors
- Tanner, A. E., Guastaferro, K. M., Rulison, K. L., Wyrick, D. L., Milroy, J. J., Bhandari, S., Thorpe, S., Ware, S., Miller, A. M., & Collins, L. M.
- Affiliations
- University of North Carolina at Greensboro (US)
- Pennsylvania State University (US)
- New York University (US)
- Corresponding author
- Tanner, Amanda E
- ORCID
- Venue
- Annals of Behavioral Medicine
- Publisher
- Oxford University Press (OUP)
- Published
- 2021-03-11
- Volume
- 55
- Issue
- 12
- Pages
- 1184-1187
- ISSN
- 0742-5554 (ISSN-L)
- 0883-6612
- 1532-4796
- PMC
- PMC8601044
- OpenAlex
- W3133855179
- Cited by
- 14
- References
- 45
- Citations by year
- 2026: 1 · 2025: 2 · 2024: 1 · 2023: 5 · 2022: 2 · 2021: 3
- FWCI
- 1.98
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Licence
- academic.oup.com/journals/pages/open_access/funder_policies/chorus/standard_publication_model (vor)
- Locations
- Annals of Behavioral Medicine (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- NC Digital Online Collection of Knowledge and Scholarship (The University of North Carolina at Greensboro) (submittedVersion)
- Funders
- National Institute on Alcohol Abuse and Alcoholism (R01 AA022931)
- National Institute of Drug Abuse (P50 DA039838)
- National Center for Advancing Translational Sciences (TR000127, TR002014)
- Topics
- Health Sciences › Medicine › Epidemiology › Substance Abuse Treatment and Outcomes
- Social Sciences › Gender Studies › Sexual Assault and Victimization Studies
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Adolescent Sexual and Reproductive Health
- Keywords
- university students, alcohol consumption, sexual behavior, sexual violence prevention, sexually transmitted infections, binge drinking, social norms, self-efficacy, multiphase optimization strategy, intervention optimization
- MeSH terms
- Alcohol Drinking, Humans, Sexual Behavior, Sex Offenses, Students, Universities
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.