Biomedical and behavioral outcomes of Keep It Up!: an ehealth HIV prevention program RCT.

Mustanski, Brian; Parsons, Jeffrey T.; Sullivan, Patrick S.; Madkins, Krystal; Rosenberg, Eli; Swann, Gregory

doi:10.1016/j.amepre.2018.04.026

Cited by 103HIV/AIDS Research and InterventionsHIV, Drug Use, Sexual RiskAdolescent Sexual and Reproductive Health

Biomedical and behavioral outcomes of Keep It Up!: an ehealth HIV prevention program RCT.

Open access

Mustanski, Brian, Parsons, Jeffrey T., Sullivan, Patrick S., Madkins, Krystal, Rosenberg, Eli, Swann, Gregory·2018·American Journal of Preventive Medicine

DOI 10.1016/j.amepre.2018.04.026PMC PMC6314292

Open this paper in CoChat — free account

Abstract

Introduction HIV diagnoses among young men who have sex with men are increasing, but few effective HIV prevention interventions exist for this population. An RCT was conducted of the online Keep It Up! intervention to determine if it significantly reduced condomless anal sex and sexually transmitted infections compared with an HIV knowledge condition.Study design From May 2013 to March 2017, a total of 901 participants were enrolled in a double-blinded RCT of Keep It Up! with 1-year follow-up. After completing baseline surveys and sexually transmitted infection testing, participants were randomized by an eHealth platform to the intervention or control condition.Setting/participants HIV-negative men who have sex with men reporting condomless anal sex, aged 18-29 years, were recruited through advertising and from HIV testing sites and outreach in Atlanta, Georgia; Chicago, Illinois; and New York, New York.Intervention Multimedia was used to address HIV knowledge and motivate safer behaviors. The control condition reflected existing online HIV information.Main outcome measures Primary outcomes were incident gonorrhea or chlamydia at 12-month follow-up and self-reported condomless anal sex with casual partners at 3-, 6-, and 12-month follow-up.Results In 2017, data were analyzed from 445 (49%) participants randomized to the intervention and 456 (51%) to the control. Participants were primarily racial/ethnic minorities (63%). Sexually transmitted infections at Month 12 was 40% lower for intervention participants (risk ratio=0.60, 95% CI=0.38, 0.95, p=0.01). For the primary behavioral outcome, both arms showed reductions over time with 44% of control and 37% of intervention participants reporting condomless anal sex at Month 12 (prevalence ratio=0.83, 95% CI=0.70, 0.99, p=0.04).Conclusions The Keep It Up! intervention resulted in significantly lower sexually transmitted infection incidence and a small but significant decrease in condomless anal sex 12 months post-intervention relative to an online HIV knowledge condition. In addition, this study demonstrated the feasibility and acceptability of at-home sexually transmitted infection testing as part of an eHealth intervention.Trial registration This study is registered at www.clinicaltrials.gov NCT01836445.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1016/j.amepre.2018.04.026

Cites

44 of 44 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Brief, online, electronic-learning modules for young MSM have been reported to be effective in reducing incident STIs.
“Brief, online, electronic-learning modules for young MSM have been reported to be effective in reducing incident STIs and offer a convenient client platform for effective interventions (10).”
From Sexually Transmitted Infections Treatment Guidelines, 2021 (2021) · cites this paper as [10]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Longitudinal Data Analysis for Discrete and Continuous Outcomes
Zeger, S. L., & Liang, K. (1986) · Biometrics · doi:10.2307/2531248 · Cited by 7,730 · see citing works
Analysis of Longitudinal Data
Everitt, B. S. (2001) · Psychology Press eBooks · doi:10.4324/9781410605542-11 · Cited by 6,877 · see citing works
Dialysis Dose and Intradialytic Hypotension: Results from the HEMO Study
Causland, F. R. M., Brunelli, S. M., & Waikar, S. S. (2013) · American Journal of Nephrology · doi:10.1159/000355958 · Cited by 2,705 · see citing works
Sexually transmitted diseases treatment guidelines (2015)
Workowski, K., & BOLAN, G. A. (2015) · The Scientific Issues of Ternopil Volodymyr Hnatiuk National Pedagogical University Series pedagogy · doi:10.18370/2309-4117.2015.24.51-56 · Cited by 2,684 · see citing works
From epidemiological synergy to public health policy and practice: the contribution of other sexually transmitted diseases to sexual transmission of HIV infection.
Fleming, D. T., & Wasserheit, J. N. (1999) · Sexually Transmitted Infections · doi:10.1136/sti.75.1.3 · Cited by 2,271 · see citing works
E-learning and the science of instruction: Proven guidelines for consumers and designers of multimedia learning
Clark, R. C., Mayer, R. E., & Thalheimer, W. (2003) · Performance Improvement Journal · doi:10.1002/pfi.4930420510 · Cited by 2,257 · see citing works
Bias in analytic research
Sackett, D. L. (1979) · Journal of Chronic Diseases · doi:10.1016/0021-9681(79)90012-2 · Cited by 2,075 · see citing works
e‐Learning and the Science of Instruction
(2016) · Wiley eBooks · doi:10.1002/9781119239086 · Cited by 1,444 · see citing works
Sexually Transmitted Diseases Treatment Guidelines 2002
(2002) · PsycEXTRA Dataset · doi:10.1037/e548482006-001 · Cited by 1,229 · see citing works
Stratified Randomization for Clinical Trials
Kernan, W. N., Viscoli, C. M., Makuch, R. W., Brass, L. M., & Horwitz, R. I. (1999) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(98)00138-3 · Cited by 627 · see citing works
Analysis of Longitudinal Data
(2003) · Technometrics · doi:10.1198/tech.2003.s147 · Cited by 495 · see citing works
Empirical tests of an information-motivation-behavioral skills model of AIDS-preventive behavior with gay men and heterosexual university students.
Fisher, J. D., Fisher, W. A., Williams, S. S., & Malloy, T. E. (1994) · Health Psychology · doi:10.1037//0278-6133.13.3.238 · Cited by 425 · see citing works
Efficacy of computer technology-based HIV prevention interventions: a meta-analysis
Noar, S. M., Black, H. G., & Pierce, L. B. (2008) · AIDS · doi:10.1097/qad.0b013e32831c5500 · Cited by 385 · see citing works
Successes and challenges of HIV prevention in men who have sex with men
Sullivan, P. S., Carballo‐Diéguez, A., Coates, T. J., Goodreau, S. M., McGowan, I., Sanders, E. J., Smith, A. D., Goswami, P., & Sánchez, J. (2012) · The Lancet · doi:10.1016/s0140-6736(12)60955-6 · Cited by 377 · see citing works
Empirical tests of an information-motivation-behavioral skills model of AIDS-preventive behavior with gay men and heterosexual university students.
Fisher, J. D., Fisher, W. A., Williams, S. S., et al. (1994) · Health Psychology · doi:10.1037/0278-6133.13.3.238 · Cited by 345 · see citing works
Internet Use and Sexual Health of Young Men Who Have Sex with Men: A Mixed-Methods Study
Mustanski, B. S., Lyons, T., & Garcia, S. C. (2010) · Archives of Sexual Behavior · doi:10.1007/s10508-009-9596-1 · Cited by 262 · see citing works
Understanding Racial HIV/STI Disparities in Black and White Men Who Have Sex with Men: A Multilevel Approach
Sullivan, P. S., Peterson, J. L., Rosenberg, E. S., Kelley, C. F., Cooper, H. L. F., Vaughan, A. S., Salazar, L. F., Frew, P. M., Wingood, G. M., DiClemente, R. J., et al. (2014) · PLoS ONE · doi:10.1371/journal.pone.0090514 · Cited by 234 · see citing works
Relationship characteristics and sexual risk-taking in young men who have sex with men.
Mustanski, B. S., Newcomb, M. E., & Clerkin, E. M. (2011) · Health Psychology · doi:10.1037/a0023858 · Cited by 207 · see citing works
Evaluating AIDS Prevention Interventions Using Behavioral and Biological Outcome Measures
Fishbein, M., & Pequegnat, W. (2000) · Sexually Transmitted Diseases · doi:10.1097/00007435-200002000-00008 · Cited by 188 · see citing works
eHealth Interventions for HIV Prevention in High-Risk Men Who Have Sex With Men: A Systematic Review
Schnall, R., Travers, J. L., Rojas, M., & Carballo‐Diéguez, A. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.3393 · Cited by 172 · see citing works
Treatment of sexually transmitted infections for HIV prevention: end of the road or new beginning?
Hayes, R., Watson‐Jones, D., Celum, C., van de Wijgert, J. H. H. M., & Wasserheit, J. N. (2010) · AIDS · doi:10.1097/01.aids.0000390704.35642.47 · Cited by 172 · see citing works
E-Learning and the Science of Instruction: Proven Guidelines for Consumers and Designers of Multimedia Learning
Moore, D. R. (2006) · Educational Technology Research and Development · doi:10.1007/s11423-006-8254-8 · Cited by 145 · see citing works
Feasibility, Acceptability, and Preliminary Efficacy of an Online HIV Prevention Program for Diverse Young Men who have Sex with Men: The Keep It Up! Intervention
Mustanski, B. S., Garofalo, R., Monahan, C., Gratzer, B., & Andrews, R. (2013) · AIDS and Behavior · doi:10.1007/s10461-013-0507-z · Cited by 144 · see citing works
A randomized controlled trial utilizing motivational interviewing to reduce HIV risk and drug use in young gay and bisexual men
Parsons, J. T., Lelutiu-Weinberger, C., Botsko, M., & Golub, S. A. (2014) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0035311 · Cited by 137 · see citing works
Self-citation
Control of sexually transmitted infections and prevention of HIV transmission: mending a fractured paradigm
Steen, R., Wi, T., Kamali, A., & Ndowa, F. J. (2009) · Bulletin of the World Health Organization · doi:10.2471/blt.08.059212 · Cited by 131 · see citing works
Exploring Patterns of Awareness and Use of HIV Pre-Exposure Prophylaxis Among Young Men Who Have Sex with Men
Strauss, B. B., Greene, G. J., Phillips, G., Bhatia, R., Madkins, K., Parsons, J. T., & Mustanski, B. S. (2016) · AIDS and Behavior · doi:10.1007/s10461-016-1480-0 · Cited by 131 · see citing works
High HIV incidence and prevalence and associated factors among young MSM, 2008
Balaji, A. B., Bowles, K. E., Le, B. C., Paz‐Bailey, G., & Oster, A. M. (2012) · AIDS · doi:10.1097/qad.0b013e32835ad489 · Cited by 126 · see citing works
Incidence of HIV Infection and Sexually Transmitted Infections and Related Risk Factors Among Very Young Men Who Have Sex With Men
Garofalo, R., Hotton, A., Kuhns, L. M., Gratzer, B., & Mustanski, B. S. (2016) · JAIDS Journal of Acquired Immune Deficiency Syndromes · doi:10.1097/qai.0000000000000933 · Cited by 106 · see citing works
. HIV intervention research for men who have sex with men: a 7-year update.
Johnson, W. D., Holtgrave, D. R., McClellan, W. M., Flanders, W. D., Hill, A. N., & Goodman, M. (2005) · AIDS Education and Prevention · doi:10.1521/aeap.2005.17.6.568 · Cited by 105 · see citing works
Using New Technologies to Improve the Prevention and Management of Chronic Conditions in Populations
Oldenburg, B. F., Taylor, C. B., O'Neil, A. E., Cocker, F., & Cameron, L. D. (2015) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-031914-122848 · Cited by 104 · see citing works
Methods for the Design and Analysis of Relationship and Partner Effects on Sexual Health
Mustanski, B. S., Starks, T. J., & Newcomb, M. E. (2013) · Archives of Sexual Behavior · doi:10.1007/s10508-013-0215-9 · Cited by 98 · see citing works
HIV and Sexually Transmitted Infection Incidence and Associated Risk Factors Among High-Risk MSM and Male-to-Female Transgender Women in Lima, Peru
Castillo, R., Konda, K. A., León, S. R., Silva‐Santisteban, A., Salazar, X., Klausner, J. D., Coates, T. J., & Cáceres, C. F. (2015) · JAIDS Journal of Acquired Immune Deficiency Syndromes · doi:10.1097/qai.0000000000000667 · Cited by 77 · see citing works
Age-Specific Race and Ethnicity Disparities in HIV Infection and Awareness Among Men Who Have Sex With Men—20 US Cities, 2008–2014
Wejnert, C., Hess, K. L., Rose, C. E., Balaji, A. B., Smith, J. C., & Paz‐Bailey, G. (2015) · The Journal of Infectious Diseases · doi:10.1093/infdis/jiv500 · Cited by 69 · see citing works
Sexually transmitted disease surveillance 2015
Barton, J. E., Braxton, J. R., Davis, D. W., de Voux, A., Flagg, E. W., Grier, L., Harvey, A., Kidd, S., Kirkcaldy, R. D., Kreisel, K. M., et al. (2016) · Cited by 63 · see citing works
HIV Rates Are Increasing in Gay/Bisexual Teens
Mustanski, B., & Fisher, C. B. (2016) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2016.02.026 · Cited by 61 · see citing works
Self-citation
A Data-Driven Simulation of HIV Spread Among Young Men Who Have Sex With Men
Beck, E. C., Birkett, M. A., Armbruster, B., & Mustanski, B. S. (2015) · JAIDS Journal of Acquired Immune Deficiency Syndromes · doi:10.1097/qai.0000000000000733 · Cited by 53 · see citing works
Internet-Based HIV Prevention With At-Home Sexually Transmitted Infection Testing for Young Men Having Sex With Men: Study Protocol of a Randomized Controlled Trial of Keep It Up! 2.0
Mustanski, B. S., Madkins, K., Greene, G. J., Parsons, J. T., Johnson, B. A., Sullivan, P. S., Bass, M., & Abel, R. (2017) · JMIR Research Protocols · doi:10.2196/resprot.5740 · Cited by 41 · see citing works
Prevalence and Risk Factors for Rectal and Urethral Sexually Transmitted Infections From Self-Collected Samples Among Young Men Who Have Sex With Men Participating in the Keep It Up! 2.0 Randomized Controlled Trial
Mustanski, B. S., Feinstein, B. A., Madkins, K., Sullivan, P. S., & Swann, G. (2017) · Sexually Transmitted Diseases · doi:10.1097/olq.0000000000000636 · Cited by 41 · see citing works
Health disparities in HIV/AIDS, viral hepatitis, sexually transmitted diseases, and tuberculosis; issues, burden, and response, a retrospective review, 2000-2004
Campoluci, R., Dean, H. D., DeLuca, N., Melendez-Morales, L., & Steele, C. B. (2007) · Cited by 41 · see citing works
Incidence of HIV Infection in Young Gay, Bisexual, and Other YMSM
Halkitis, P. N., Kapadia, F., & Ompad, D. C. (2015) · JAIDS Journal of Acquired Immune Deficiency Syndromes · doi:10.1097/qai.0000000000000616 · Cited by 37 · see citing works
Validation of the HIV Risk Assessment of Sexual Partnerships (H-RASP): Comparison to a 2-Month Prospective Diary Study
Swann, G., Newcomb, M. E., & Mustanski, B. S. (2017) · Archives of Sexual Behavior · doi:10.1007/s10508-017-1033-2 · Cited by 32 · see citing works
Using Sexually Transmitted Disease Incidence as a Surrogate Marker for HIV Incidence in Prevention Trials
Pinkerton, S. D., & Layde, P. M. (2002) · Sexually Transmitted Diseases · doi:10.1097/00007435-200205000-00009 · Cited by 27 · see citing works
Analysis of False-Negative Human Immunodeficiency Virus Rapid Tests Performed on Oral Fluid in 3 International Clinical Research Studies
Curlin, M. E., Gvetadze, R. J., Leelawiwat, W., Martin, M., Rose, C. E., Niska, R. W., Segolodi, T. M., Choopanya, K., Tongtoyai, J., Holtz, T. H., et al. (2017) · Clinical Infectious Diseases · doi:10.1093/cid/cix228 · Cited by 23 · see citing works
Control of sexually transmitted infections for HIV prevention
White, R. G., Celum, C., Wasserheit, J. N., Aral, S. O., & Hayes, R. (2008) · The Lancet · doi:10.1016/s0140-6736(08)61541-x · Cited by 9 · see citing works

Flagged first, then by citations

Sorted by citations

Sexually Transmitted Infections Treatment Guidelines, 2021
Workowski, K. A., Bachmann, L. H., Chan, P. A., Johnston, C. M., Muzny, C. A., Park, I., Reno, H., Zenilman, J. M., & Bolan, G. A. (2021) · MMWR. Recommendations and Reports · doi:10.15585/mmwr.rr7004a1 · Cited by 2,759 · see citing works
The persistent and evolving HIV epidemic in American men who have sex with men
Mayer, K. H., Nelson, L. E., Hightow‐Weidman, L., Mimiaga, M. J., Mena, L. A., Reisner, S. L., Daskalakis, D., Safren, S. A., Beyrer, C., & Sullivan, P. S. (2021) · The Lancet · doi:10.1016/s0140-6736(21)00321-4 · Cited by 135 · see citing works
Effectiveness, Acceptability, and Feasibility of Digital Health Interventions for LGBTIQ+ Young People: Systematic Review
Gilbey, D., Morgan, H., Lin, A., & Perry, Y. (2020) · Journal of Medical Internet Research · doi:10.2196/20158 · Cited by 112 · see citing works
“Of the 17 interventions identified as having focused on risk reduction and management of STIs, 1 focused on pre-exposure prophylaxis adherence [66], 2 focused on reducing unprotected sex [67-71], 7 targeted multiple aspects of HIV prevention [72-83], 2 focused on HPV prevention [84,85,101], 3 focused on increasing STI…”
Background
A Systematic Review of eHealth Interventions Addressing HIV/STI Prevention Among Men Who Have Sex With Men
Nguyen, L. H., Tran, B. X., Rocha, L. E. C., Nguyen, H. L. T., Yang, P., Latkin, C. A., Thorson, A. E., & Strömdahl, S. K. (2019) · AIDS and Behavior · doi:10.1007/s10461-019-02626-1 · Cited by 98 · see citing works
A systematic review and meta-analysis of combination behavioral interventions Co-targeting psychosocial syndemics and HIV-related health behaviors for sexual minority men
Pantalone, D. W., Nelson, K. M., Batchelder, A. W., Chiu, C., Gunn, H. A., & Horvath, K. J. (2020) · The Journal of Sex Research · doi:10.1080/00224499.2020.1728514 · Cited by 81 · see citing works
Electronic and other new media technology interventions for HIV care and prevention: a systematic review
Maloney, K. M., Bratcher, A. M., Wilkerson, R., & Sullivan, P. S. (2020) · Journal of the International AIDS Society · doi:10.1002/jia2.25439 · Cited by 87 · see citing works
Bringing HIV Self-Testing to Scale in the United States: a Review of Challenges, Potential Solutions, and Future Opportunities
Steehler, K., & Siegler, A. J. (2019) · Journal of Clinical Microbiology · doi:10.1128/jcm.00257-19 · Cited by 75 · see citing works
A systematic review of mHealth interventions for HIV prevention and treatment among gay, bisexual, and other men who have sex with men
Nelson, K. M., Perry, N. S., Horvath, K. J., & Smith, L. R. (2020) · Translational Behavioral Medicine · doi:10.1093/tbm/ibaa007 · Cited by 61 · see citing works
The Development and Testing of a Relationship Skills Intervention to Improve HIV Prevention Uptake Among Young Gay, Bisexual, and Other Men Who Have Sex With Men and Their Primary Partners (We Prevent): Protocol for a Randomized Controlled Trial
Gamarel, K. E., Darbes, L. A., Hightow‐Weidman, L., Sullivan, P. S., & Stephenson, R. B. (2018) · JMIR Research Protocols · doi:10.2196/10370 · Cited by 56 · see citing works
Participatory Interventions for Sexual Health Promotion for Adolescents and Young Adults on the Internet: Systematic Review
Martin, P., Cousin, L., Gottot, S., Bourmaud, A., Rochebrochard, É. D. L., & Alberti, C. (2020) · Journal of Medical Internet Research · doi:10.2196/15378 · Cited by 62 · see citing works
Behavioral Efficacy of a Sexual Health Mobile App for Men Who Have Sex With Men: Randomized Controlled Trial of Mobile Messaging for Men
Sullivan, P. S., Stephenson, R. B., Hirshfield, S., Mehta, C. C., Zahn, R. J., Bauermeister, J. A., Horvath, K. J., Chiasson, M. A., Gelaude, D., Mullin, S., et al. (2022) · Journal of Medical Internet Research · doi:10.2196/34574 · Cited by 52 · see citing works
Efficacy of MyPEEPS Mobile, an HIV Prevention Intervention Using Mobile Technology, on Reducing Sexual Risk Among Same-Sex Attracted Adolescent Males
Schnall, R., Kuhns, L. M., Pearson, C. R., Batey, D. S., Bruce, J., Hidalgo, M. A., Hirshfield, S., Janulis, P. F., Jia, H., Radix, A. E., et al. (2022) · JAMA Network Open · doi:10.1001/jamanetworkopen.2022.31853 · Cited by 53 · see citing works
What If My Dad Finds Out!?: Assessing Adolescent Men Who Have Sex with Men’s Perceptions About Parents as Barriers to PrEP Uptake
Moskowitz, D., Macapagal, K. R., Mongrella, M. C., Pérez-Cardona, L., Newcomb, M. E., & Mustanski, B. S. (2020) · AIDS and Behavior · doi:10.1007/s10461-020-02827-z · Cited by 48 · see citing works
eHealth Interventions to Address Sexual Health, Substance Use, and Mental Health Among Men Who Have Sex With Men: Systematic Review and Synthesis of Process Evaluations
Meiksin, R., Meléndez‐Torres, G. J., Falconer, J., Witzel, T. C., Weatherburn, P., & Bonell, C. P. (2021) · Journal of Medical Internet Research · doi:10.2196/22477 · Cited by 47 · see citing works
Acceptability and Preliminary Efficacy of an Online HIV Prevention Intervention for Single Young Men Who Have Sex with Men Seeking Partners Online: The myDEx Project
Bauermeister, J. A., Tingler, R. C., Demers, M., Connochie, D. M., Gillard, G., Shaver, J., Chavanduka, T., & Harper, G. W. (2019) · AIDS and Behavior · doi:10.1007/s10461-019-02426-7 · Cited by 49 · see citing works
Factors Associated With HIV Testing in Teenage Men Who Have Sex With Men
Mustanski, B. S., Moskowitz, D., Moran, K., Rendina, H. J., Newcomb, M. E., & Macapagal, K. R. (2020) · PEDIATRICS · doi:10.1542/peds.2019-2322 · Cited by 44 · see citing works
Resistance as Participation: Queer Theory’s Applications for HIV Health Technology Design
Green, M. (2020) · Technical Communication Quarterly · doi:10.1080/10572252.2020.1831615 · Cited by 45 · see citing works
Adjunctive interventions: change methods directed at recipients that support uptake and use of health innovations
Smith, J. D., Li, D. H., Merle, J. L., Keiser, B., Mustanski, B. S., & Benbow, N. (2024) · Implementation Science · doi:10.1186/s13012-024-01345-z · Cited by 46 · see citing works
Evaluation of a Stepped-Care eHealth HIV Prevention Program for Diverse Adolescent Men Who Have Sex With Men: Protocol for a Hybrid Type 1 Effectiveness Implementation Trial of SMART
Mustanski, B. S., Moskowitz, D., Moran, K., Newcomb, M. E., Macapagal, K. R., Rodríguez-Díaz, C. E., Rendina, H. J., Laber, E. B., Li, D. H., Matson, M., et al. (2020) · JMIR Research Protocols · doi:10.2196/19701 · Cited by 40 · see citing works
HIV Prevention Via Mobile Messaging for Men Who Have Sex With Men (M-Cubed): Protocol for a Randomized Controlled Trial
Sullivan, P. S., Zahn, R. J., Wiatrek, S. E., Chandler, C. J., Hirshfield, S., Stephenson, R. B., Bauermeister, J. A., Chiasson, M. A., Downing, M. J., Gelaude, D., et al. (2019) · JMIR Research Protocols · doi:10.2196/16439 · Cited by 38 · see citing works
Design Considerations for Implementing eHealth Behavioral Interventions for HIV Prevention in Evolving Sociotechnical Landscapes
Li, D. H., Brown, C. H., Gallo, C. G., Morgan, E., Sullivan, P. S., Young, S. D., & Mustanski, B. S. (2019) · Current HIV/AIDS Reports · doi:10.1007/s11904-019-00455-4 · Cited by 36 · see citing works
The Effectiveness of Electronic Health Interventions for Promoting HIV-Preventive Behaviors Among Men Who Have Sex With Men: Meta-Analysis Based on an Integrative Framework of Design and Implementation Features
Xin, M., Viswanath, K., Li, A. Y. C., Cao, W., Yuhong, H., Lau, J. T. F., & Mo, P. K. H. (2020) · Journal of Medical Internet Research · doi:10.2196/15977 · Cited by 36 · see citing works
The Young Men and Media Study: A Pilot Randomized Controlled Trial of a Community-Informed, Online HIV Prevention Intervention for 14–17-Year-Old Sexual Minority Males
Nelson, K. M., Perry, N. S., Stout, C. D., DUNSIGER, S. I., & Carey, M. P. (2021) · AIDS and Behavior · doi:10.1007/s10461-021-03412-8 · Cited by 35 · see citing works
Relationship Education and HIV Prevention for Young Male Couples Administered Online via Videoconference: Protocol for a National Randomized Controlled Trial of 2GETHER
Newcomb, M. E., Sarno, E. L., Bettin, E., Carey, J., Ciolino, J., Hill, R., Garcia, C. P., Macapagal, K., Mustanski, B., Swann, G., et al. (2019) · JMIR Research Protocols · doi:10.2196/15883 · Cited by 23 · see citing works
Ethical Considerations in HIV eHealth Intervention Research: Implications for Informational Risk in Recruitment, Data Maintenance, and Consent Procedures
Fisher, C. B., Bragard, E., & Bloom, R. F. (2020) · Current HIV/AIDS Reports · doi:10.1007/s11904-020-00489-z · Cited by 28 · see citing works
“Safe Behind My Screen”: Adolescent Sexual Minority Males’ Perceptions of Safety and Trustworthiness on Geosocial and Social Networking Apps
Jozsa, K., Kraus, A., Korpak, A. K., Birnholtz, J. P., Moskowitz, D., & Macapagal, K. R. (2021) · Archives of Sexual Behavior · doi:10.1007/s10508-021-01962-5 · Cited by 28 · see citing works
Measuring Acceptability and Engagement of The Keep It Up! Internet-Based HIV Prevention Randomized Controlled Trial for Young Men Who Have Sex With Men
Madkins, K., Moskowitz, D., Moran, K., Dellucci, T. V., & Mustanski, B. S. (2019) · AIDS Education and Prevention · doi:10.1521/aeap.2019.31.4.287 · Cited by 29 · see citing works
The Changing Science of HIV Epidemiology in the United States
DʼSouza, G., Golub, E. T., & Gange, S. J. (2019) · American Journal of Epidemiology · doi:10.1093/aje/kwz211 · Cited by 25 · see citing works
Effectiveness of the SMART Sex Ed program among 13–18 year old English and Spanish speaking adolescent men who have sex with men
Mustanski, B. S., Saber, R., Macapagal, K. R., Matson, M., Laber, E. B., Rodríguez-Díaz, C. E., Moran, K., Carrion, A., Moskowitz, D., & Newcomb, M. E. (2022) · AIDS and Behavior · doi:10.1007/s10461-022-03806-2 · Cited by 26 · see citing works
Addressing Health Inequities in Digital Clinical Trials: A Review of Challenges and Solutions From the Field of HIV Research
Wirtz, A. L., Logie, C. H., & Mbuagbaw, L. C. E. (2022) · Epidemiologic Reviews · doi:10.1093/epirev/mxac008 · Cited by 25 · see citing works
Navigating the Long Road Forward for Maximizing PrEP Impact Among Adolescent Men Who Have Sex with Men
Huebner, D. M., & Mustanski, B. S. (2019) · Archives of Sexual Behavior · doi:10.1007/s10508-019-1454-1 · Cited by 25 · see citing works
Exploring Potential Implementation Barriers and Facilitators of the SMART Program: A Stepped-Care Package of eHealth HIV Prevention Interventions for Adolescent Men Who Have Sex with Men
Ventuneac, A., Li, D. H., Mongrella, M. C., Moskowitz, D., Weingardt, K. R., Brown, C. H., Parsons, J. T., & Mustanski, B. S. (2019) · Sexuality Research and Social Policy · doi:10.1007/s13178-019-00402-3 · Cited by 23 · see citing works
Theories of change for e-health interventions targeting HIV/STIs and sexual risk, substance use and mental ill health amongst men who have sex with men: systematic review and synthesis
Meiksin, R., Meléndez‐Torres, G. J., Falconer, J., Witzel, T. C., Weatherburn, P., & Bonell, C. P. (2021) · Systematic Reviews · doi:10.1186/s13643-020-01523-2 · Cited by 23 · see citing works
Development of a Mobile App to Increase the Uptake of HIV Pre-exposure Prophylaxis Among Latino Sexual Minority Men: Qualitative Needs Assessment
Cantos, V. D., Hagen, K. S., Duarte, A. P., Escobar, C., Batina, I., Orozco, H., Rodríguez, J., Camacho-González, A., & Siegler, A. J. (2023) · JMIR Formative Research · doi:10.2196/43844 · Cited by 21 · see citing works
Molecular screening in a longitudinal cohort of young men who have sex with men and young transgender women: associations with focus on the emerging sexually transmitted pathogenMycoplasma genitalium
Munson, E. L., Morgan, E., Sienkiewicz, L., Thomas, Y., Buehler, K., Ryan, D. T., Clifford, A., & Mustanski, B. S. (2020) · Sexually Transmitted Infections · doi:10.1136/sextrans-2020-054463 · Cited by 18 · see citing works
“Talking About it Publicly Made Me Feel Both Curious and Embarrassed”: Acceptability, Feasibility, and Appropriateness of a Stigma-Mitigation Training to Increase Health Worker Comfort Discussing Anal Sexuality in HIV Services
Kutner, B. A., Wu, Y., Balán, I. C., & Meyers, K. A. (2019) · AIDS and Behavior · doi:10.1007/s10461-019-02758-4 · Cited by 17 · see citing works
eHealth Interventions to Address HIV and Other Sexually Transmitted Infections, Sexual Risk Behavior, Substance Use, and Mental Ill-health in Men Who Have Sex With Men: Systematic Review and Meta-analysis
Meléndez‐Torres, G. J., Meiksin, R., Witzel, T. C., Weatherburn, P., Falconer, J., & Bonell, C. P. (2022) · JMIR Public Health and Surveillance · doi:10.2196/27061 · Cited by 16 · see citing works
Biomedical and behavioral outcomes of 2GETHER: A randomized controlled trial of a telehealth HIV prevention program for young male couples.
Newcomb, M. E., Swann, G., Macapagal, K. R., Sarno, E. L., Whitton, S. W., & Mustanski, B. S. (2023) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000823 · Cited by 16 · see citing works
The CAN-DO-IT Model: a Process for Developing and Refining Online Recruitment in HIV/AIDS and Sexual Health Research
Macapagal, K. R., Li, D. H., Clifford, A., Madkins, K., & Mustanski, B. S. (2020) · Current HIV/AIDS Reports · doi:10.1007/s11904-020-00491-5 · Cited by 15 · see citing works
Keep it Up! 3.0: Study Protocol for a Type III Hybrid Implementation-Effectiveness Cluster-Randomized TrialPreprint
Mustanski, B. S., Saber, R., Jones, J. P., Macapagal, K. R., Benbow, N., Li, D. H., Brown, C. H., Janulis, P. F., Smith, J. D., Marsh, E., et al. (2022) · SSRN Electronic Journal · doi:10.1016/j.cct.2023.107134 · Cited by 15 · see citing works
Comprehensive Molecular Screening in a Cohort of Young Men Who Have Sex With Men and Transgender Women: Effect of Additive Rectal Specimen Source Collection and Analyte Testing
Munson, E. L., Reynoso, A., Pass, M., Buehler, K., Ryan, D. T., Clifford, A., Morgan, E., & Mustanski, B. S. (2020) · Sexually Transmitted Diseases · doi:10.1097/olq.0000000000001244 · Cited by 14 · see citing works
Perceptions and Experiences of Returning Self-collected Specimens for HIV, Bacterial STI and Potential PrEP Adherence Testing among Sexual Minority Men in the United States
Sharma, A., Gandhi, M., Sallabank, G., Merrill, L., & Stephenson, R. B. (2022) · AIDS and Behavior · doi:10.1007/s10461-022-03846-8 · Cited by 13 · see citing works
A Review of Serious Gaming as an Intervention for HIV Prevention
Smith, A. U., Khawly, G., Jann, J., Zetina, A. P. M., Padilla, J. J., & Schnall, R. (2023) · Current HIV/AIDS Reports · doi:10.1007/s11904-023-00659-9 · Cited by 13 · see citing works
Using Intervention Mapping to Developmentally Adapt an Online HIV Risk Reduction Program for Adolescent Men Who Have Sex with Men
Li, D. H., Moskowitz, D., Macapagal, K. R., Saber, R., & Mustanski, B. S. (2020) · Prevention Science · doi:10.1007/s11121-020-01148-w · Cited by 13 · see citing works
mHealth-Based Gamification Interventions Among Men Who Have Sex With Men in the HIV Prevention and Care Continuum: Systematic Review and Meta-Analysis
Luo, Q., Zhang, Y., Wang, W., Cui, T., & Li, T. (2024) · JMIR mhealth and uhealth · doi:10.2196/49509 · Cited by 14 · see citing works
Enhancing HIV Cognitive Abilities and Self-Management Through Information Technology–Assisted Interventions: Scoping Review
Huang, H., Xie, M., Yang, Z. Y., & Wang, A. (2024) · Journal of Medical Internet Research · doi:10.2196/57363 · Cited by 14 · see citing works
Study Evaluating Self-Collected Specimen Return for HIV, Bacterial STI, and Potential Pre-Exposure Prophylaxis Adherence Testing Among Sexual Minority Men in the United States
Sharma, A., Gandhi, M., Sallabank, G., Merrill, L., & Stephenson, R. B. (2022) · American Journal of Men s Health · doi:10.1177/15579883221115591 · Cited by 12 · see citing works
A Relationship-Focused HIV Prevention Intervention for Young Sexual Minority Men in the United States: A Pilot Randomized Controlled Trial of the We Prevent Intervention
Gamarel, K. E., Darbes, L. A., Wall, K. M., Jones, J. S., Washington, C., Rosso, M. T., Claude, K., Hightow‐Weidman, L., Sullivan, P. S., & Stephenson, R. B. (2023) · AIDS and Behavior · doi:10.1007/s10461-023-03994-5 · Cited by 12 · see citing works
The Role of Family Support and Communication on PrEP Attitudes and Stigma Among Black Men who have Sex with Men (BMSM)
Boyd, D. T., Abu-Ba’are, G. R., Zigah, E. Y., Williams, A. T., & Flores, D. D. (2023) · Sexually Transmitted Diseases · doi:10.1097/olq.0000000000001832 · Cited by 12 · see citing works
Predicting the Transition From Suicidal Ideation to Suicide Attempt Among Sexual and Gender Minority Youths
Berona, J., Whitton, S. W., Newcomb, M. E., Mustanski, B. S., & Gibbons, R. D. (2021) · Psychiatric Services · doi:10.1176/appi.ps.202000497 · Cited by 12 · see citing works
Barriers and Facilitators to HIV Testing Among Adolescents and Young Adults in Washington, District of Columbia: Formative Research to Inform the Development of an mHealth Intervention
Wilbourn, B. C., Howell, T. H., Castel, A. D., D’Angelo, L. J., Trexler, C., Carr, R., & Greenberg, D. (2022) · JMIR Formative Research · doi:10.2196/29196 · Cited by 11 · see citing works
“Your Package Could Not Be Delivered”: The State of Digital HIV Intervention Implementation in the US
Li, D. H., Macapagal, K. R., Mongrella, M. C., Saber, R., & Mustanski, B. S. (2024) · Current HIV/AIDS Reports · doi:10.1007/s11904-024-00693-1 · Cited by 11 · see citing works
E-health interventions targeting STIs, sexual risk, substance use and mental health among men who have sex with men: four systematic reviews
Meiksin, R., Meléndez‐Torres, G. J., Miners, A. H., Falconer, J., Witzel, T. C., Weatherburn, P., & Bonell, C. P. (2022) · Public Health Research · doi:10.3310/brwr6308 · Cited by 10 · see citing works
Social and behavioural research prospects for sexually transmissible infection prevention in the era of advances in biomedical approaches
Hogben, M., Dittus, P., Leichliter, J. S., & Aral, S. O. (2020) · Sexual Health · doi:10.1071/sh19105 · Cited by 11 · see citing works
A content analysis of college students’ gaps in knowledge about sexually transmitted infections
Lederer, A. M., & Sheena, B. S. (2020) · Health Education Journal · doi:10.1177/0017896920959091 · Cited by 10 · see citing works
Protocol for an attention-matched randomized controlled trial of 2GETHER: a relationship education and HIV prevention program for young male couples
Newcomb, M. E., Sarno, E. L., Bettin, E., Conway, A., Carey, J., Garcia, C. P., Hill, R., Jozsa, K., Swann, G., Addington, E., et al. (2022) · Trials · doi:10.1186/s13063-022-06457-9 · Cited by 6 · see citing works
Preferred Characteristics for mHealth Interventions Among Young Sexual Minoritized Men to Support HIV Testing and PrEP Decision-Making: Focus Group Study
Zapata, J. P., Hirshfield, S., Nelson, K. M., Horvath, K. J., & John, S. A. (2023) · JMIR Formative Research · doi:10.2196/51103 · Cited by 10 · see citing works
Using Video Games to Improve the Sexual Health of Young People Aged 15 to 25 Years: Rapid Review
Vega, I. F., Eleftheriou, A., & Graham, C. A. (2022) · JMIR Serious Games · doi:10.2196/33207 · Cited by 11 · see citing works
Brief Report: Sexual Debut Among 14- to 17-year-old Sexual Minority Males: A Preliminary Investigation of Early HIV Risk and Sexual Health Needs
Nelson, K. M., Perry, N. S., Stout, C. D., & Carey, M. P. (2020) · JAIDS Journal of Acquired Immune Deficiency Syndromes · doi:10.1097/qai.0000000000002342 · Cited by 9 · see citing works
Video selection and assessment for an app-based HIV prevention messaging intervention: formative research
Downing, M. J., Wiatrek, S. E., Zahn, R. J., Mansergh, G., Olansky, E., Gelaude, D., Sullivan, P. S., Stephenson, R. B., Siegler, A. J., Bauermeister, J. A., et al. (2023) · mHealth · doi:10.21037/mhealth-21-53 · Cited by 9 · see citing works
Behavior Change Among HIV-Negative Men Who Have Sex with Men Not Using PrEP in the United States
Goodreau, S. M., Barry, M. P., Hamilton, D. T., Williams, A. M., Wang, L. Y., Sanchez, T., Katz, D. A., & Delaney, K. P. (2024) · AIDS and Behavior · doi:10.1007/s10461-024-04281-7 · Cited by 8 · see citing works
Development, Refinement, and Acceptability of Digital Gaming to Improve HIV Testing Among Adolescents and Young Adults at Risk for HIV
Wilbourn, B. C., Howell, T. H., Castel, A. D., D’Angelo, L. J., Trexler, C., Carr, R., & Greenberg, D. (2019) · Games for Health Journal · doi:10.1089/g4h.2018.0162 · Cited by 8 · see citing works
Explorations of the Role of Digital Technology in HIV-Related Implementation Research: Case Comparisons of Five Ending the HIV Epidemic Supplement Awards
Jones, J. S., Knox, J., Meanley, S., Yang, P., Lounsbury, D. W., Huang, T. T. ‐., Bauermeister, J. A., Gonzalez‐Hernandez, G., Frye, V. A., Grov, C., et al. (2022) · JAIDS Journal of Acquired Immune Deficiency Syndromes · doi:10.1097/qai.0000000000002983 · Cited by 8 · see citing works
Adolescent Preferences for a Pediatric Primary Care-based Sexually Transmitted Infection and HIV Prevention Intervention
Wood, S. M., Bauermeister, J. A., Fiks, A. G., Phillips, A. W., Richardson, H. M., Garcia, S. M., Maleki, P., Beidas, R. S., Young, J. F., Gross, R., et al. (2024) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2024.01.033 · Cited by 7 · see citing works
Use of Behavior Change Techniques in Digital HIV Prevention Programs for Adolescents and Young People: Systematic Review
Mo, P. K. H., Xie, L., Lee, T. C., & Li, A. Y. C. (2024) · JMIR Public Health and Surveillance · doi:10.2196/59519 · Cited by 5 · see citing works
Feasibility of a Mobile Health Intervention for Providing a Continuum of HIV Services for MSM: Pilot Study of the WeTest Program in 3 Cities in China
Zhu, Z., Lu, X., Gao, P., Wang, X., Hu, X., Xie, N., Liu, C., Zhao, Y., Zhao, Y., Dai, Z., et al. (2024) · Current HIV Research · doi:10.2174/011570162x280190240105063449 · Cited by 5 · see citing works
Anatomic Site–Specific Gonorrhea and Chlamydia Testing and Incidence Among People With HIV Engaged in Care at 4 US Clinical Centers, 2014–2018
Menza, T. W., Berry, S. A., Dombrowski, J., Cachay, E. R., Crane, H. M., Kitahata, M. M., & Mayer, K. H. (2022) · Open Forum Infectious Diseases · doi:10.1093/ofid/ofac298 · Cited by 5 · see citing works
Barriers and Facilitators to Implementing Keep It Up!, A Digital Health Intervention, in Community-Based Organizations
Zamantakis, A., Zapata, J. P., Greenawalt, I., Knapp, A. A., Benbow, N., & Mustanski, B. S. (2024) · AIDS and Behavior · doi:10.1007/s10461-024-04525-6 · Cited by 5 · see citing works
Lessons Learned From the Implementation of a Pilot Study on Self-collected Specimen Return by Sexual Minority Men (Project Caboodle!): Qualitative Exploration
Sallabank, G., Stephenson, R. B., Gandhi, M., Merrill, L., & Sharma, A. (2023) · JMIR Formative Research · doi:10.2196/43539 · Cited by 5 · see citing works
Comparing Implementation and Effectiveness Outcomes for Two Implementation Strategies of the Keep It Up! Digital HIV Prevention Program: A Type 3 Hybrid Effectiveness-Implementation Trial
Mustanski, B. S., Benbow, N., Macapagal, K. R., Li, D. H., Madkins, K., Saber, R., Linas, B. P., Smith, J., Brown, C. H., Munroe, S., et al. (2025) · AIDS and Behavior · doi:10.1007/s10461-025-04838-0 · Cited by 4 · see citing works
Aceptabilidad y viabilidad de intervenciones mediadas por tecnología en la prevención del VIH: Una revisión sistemática
Medina, R. S., Piña, C. R. R., & Losada, A. V. (2021) · Revista Científica Arbitrada de la Fundación MenteClara · doi:10.32351/rca.v6.231 · Cited by 4 · see citing works
Recommendations for the Development of HIV Prevention Interventions Among Latino Young Sexual Minority Groups
Marzán‐Rodríguez, M., Rodríguez-Díaz, C. E., & Mustanski, B. S. (2020) · Sexuality Research and Social Policy · doi:10.1007/s13178-020-00494-2 · Cited by 4 · see citing works
Association of demographics and psychological barriers with late presentation of HIV among men who have sex with men in Chengdu, China
Zhang, J., Xin, J., Guo, D., Chen, L., He, L., Tang, J. Y., Li, Y., Wang, J., & Yang, X. (2025) · Scientific Reports · doi:10.1038/s41598-025-33749-2 · Cited by 3 · see citing works
A mixed-methods approach to assessing implementers’ readiness to adopt digital health interventions (RADHI)
Li, D. H., Zamantakis, A., Zapata, J. P., Danielson, E. C., Saber, R., Benbow, N., Smith, J. D., Swann, G., Macapagal, K. R., & Mustanski, B. S. (2024) · Implementation Science Communications · doi:10.1186/s43058-024-00628-2 · Cited by 4 · see citing works
Developing technology-based interventions for infectious diseases: ethical considerations for young sexual and gender minority people
Cascalheira, C. J., Pugh, T. H., Hong, C., Birkett, M. A., Macapagal, K. R., & Holloway, I. W. (2023) · Frontiers in Reproductive Health · doi:10.3389/frph.2023.1303218 · Cited by 3 · see citing works
Economic Evaluation of Delivering an Evidence-Based Online HIV Prevention Program to MSM via Direct-To-Consumer Marketing Versus Community-Based Organization Recruitment
Munroe, S., Schackman, B. R., Madkins, K., Saber, R., Macapagal, K. R., Vititow, J., Sweeney, N. R., Feder, N. M., Benbow, N., Mustanski, B. S., et al. (2024) · JAIDS Journal of Acquired Immune Deficiency Syndromes · doi:10.1097/qai.0000000000003572 · Cited by 3 · see citing works
The Value and Challenge of Frequent Human Immunodeficiency Virus (HIV) Testing Among Young Men Who Have Sex With Men in the United States
Schackman, B. R. (2020) · Clinical Infectious Diseases · doi:10.1093/cid/ciaa1060 · Cited by 3 · see citing works
Effects of Condom Use on Human Immunodeficiency Virus Transmission Among Adolescent Sexual Minority Males in the United States: A Mixed Epidemiology and Epidemic Modeling Study.
Katz, D. A., Hamilton, D. T., Rosenthal, E. M., Wang, L. Y., Dunville, R. L., Aslam, M. V., Barrios, L. C., Zlotorzynska, M., Sanchez, T., Sullivan, P. S., et al. (2021) · PubMed Central · doi:10.1097/olq.0000000000001485 · Cited by 2 · see citing works
Incentivizing Prevention: Community Based Organizations’ Perceptions on Financial Incentives for Recruitment and Retention of Participants in Keep it Up! (KIU!), an eHealth HIV Prevention Intervention
Zamantakis, A., Zapata, J. P., Smith, J. D., Danielson, E. C., Macapagal, K. R., Saber, R., Li, D. H., Benbow, N., & Mustanski, B. S. (2025) · AIDS and Behavior · doi:10.1007/s10461-025-04963-w · Cited by 2 · see citing works
“I don’t see myself represented:” Strategies and considerations for engaging gay male Native Hawaiian and Other Pacific Islander teens in research and HIV prevention services
Pacheco, M. Y., Warfield, S. K., Hatzistavrakis, P., Mochida-Meek, S., Moskowitz, D., Matson, M., & Mustanski, B. S. (2022) · AIDS and Behavior · doi:10.1007/s10461-022-03843-x · Cited by 2 · see citing works
Substance Use Classes Among YMSM in an HIV Digital Health Intervention Program: Implications for Acceptability, Engagement, and Health Outcomes
Zapata, J. P., Swann, G., Zamantakis, A., Madkins, K., Danielson, E. C., & Mustanski, B. S. (2025) · AIDS and Behavior · doi:10.1007/s10461-025-04619-9 · Cited by 2 · see citing works
Predicting the impact of sexual behavior change on adolescent STI in the US and New York State: a case study of the teen-SPARC tool
Goodreau, S. M., Pollock, E. D., Wang, L. Y., Barrios, L. C., Dunville, R. L., Aslam, M. V., Katz, D. A., Hart-Malloy, R., Rosenthal, E. M., Trigg, M., et al. (2020) · Annals of Epidemiology · doi:10.1016/j.annepidem.2020.05.009 · Cited by 2 · see citing works
Considerations for evaluating pragmatic design elements in digital health intervention trials: the case of Keep It Up! 3.0
Benbow, N., Li Dennis, H., Macapagal, K. R., Krystal, M., Rana, S., Zamantakis, A., Emma, R., Smith Justin, D., & Mustanski, B. S. (2025) · Implementation Science Communications · doi:10.1186/s43058-025-00777-y · Cited by 1 · see citing works
Effects of Digital Health Interventions to Promote Safer Sex Behaviors Among Youth: Systematic Review and Bayesian Network Meta-Analysis
Zhu, Y., Peng, W., Hu, D., Choi, E. P. H., Valimaki, M. A., Zhang, C., & Li, X. (2026) · Journal of Medical Internet Research · doi:10.2196/87071 · Cited by 1 · see citing works
The Disregarded HIV Prevention Strategies—Their Potential to Uphold the Pandemic, and the Challenges Facing Societies
Dennin, R. H., Sinn, A., & Du, Z. (2018) · World Journal of AIDS · doi:10.4236/wja.2018.84011 · Cited by 1 · see citing works
Adolescent sexual and reproductive health: digital technology risks and opportunities
Bull, S. S., Devine, S., Shlay, J. C., Hammes, A., & Schmiege, S. J. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-817319-0.00009-8 · Cited by 1 · see citing works
A Surveillance Data-Based Model System for Assessing the Effects of HIV Intervention and Prevention Strategies
Song, R., Green, T. A., & Hall, H. I. (2019) · Journal of Public Health Management and Practice · doi:10.1097/phh.0000000000001083
New communication technologies, social media, and public health
Sullivan, P. S., Siegler, A. J., & Hightow‐Weidman, L. (2021) · doi:10.1093/med/9780198816805.003.0025
Quantitative Study Designs: Experimental
(2020) · Springer Publishing Company eBooks · doi:10.1891/9780826182067.0006
Online sexual, reproductive, and transgender healthcare for LGBTQI+ youth: A scoping reviewPreprint
McLeod, J., Estcourt, C. S., Flowers, P., Gibbs, J., & MacDonald, J. (2024) · medRxiv · doi:10.1101/2024.08.06.24311547
Community-Based Organizations’ Approaches to Recruitment and Retention for a Digital HIV Prevention Intervention for Young Men Who Have Sex With Men: A Mixed Methods Study
Zamantakis, A., Danielson, E. C., Rudd, E., Zapata, J. P., Benbow, N., Saber, R., Knapp, A. A., & Mustanski, B. S. (2025) · Journal of Medical Internet Research · doi:10.2196/63199 · Cited by 1 · see citing works
Effects of Digital Health Interventions to Promote Safer Sex Behaviors among Youth: A Systematic Review and Network Meta-analysis (Preprint)Preprint
Zhu, Y., Peng, W., Hu, D., Choi, E. P. H., Valimaki, M. A., Zhang, C., & Li, X. (2025) · doi:10.2196/preprints.87071
Additional file 1 of Theories of change for e-health interventions targeting HIV/STIs and sexual risk, substance use and mental ill health amongst men who have sex with men: systematic review and synthesis
Meiksin, R., Meléndez‐Torres, G. J., Falconer, J., Witzel, T. C., Weatherburn, P., & Bonell, C. P. (2021) · Figshare · doi:10.6084/m9.figshare.13552003
Additional file 1 of Adjunctive interventions: change methods directed at recipients that support uptake and use of health innovations
Smith, J. D., Li, D. H., Merle, J. L., Keiser, B., Mustanski, B. S., & Benbow, N. (2024) · Figshare · doi:10.6084/m9.figshare.26678816
Additional file 2 of Theories of change for e-health interventions targeting HIV/STIs and sexual risk, substance use and mental ill health amongst men who have sex with men: systematic review and synthesis
Meiksin, R., Meléndez‐Torres, G. J., Falconer, J., Witzel, T. C., Weatherburn, P., & Bonell, C. P. (2021) · Figshare · doi:10.6084/m9.figshare.13552006
Evaluating a Multimedia Messaging Intervention to Increase Adolescent HIV Testing: Protocol for a Hybrid Type 1 Effectiveness Implementation Study
Macapagal, K. R., Avila, A. A., Buehler, Z. M., Gordon, J. D., Knapp, A. A., Hurtado, M., Lorenzo, J., Foran, J. E., Newcomb, M. E., Mustanski, B. S., et al. (2026) · JMIR Research Protocols · doi:10.2196/88465
When scientific constraints and real-world implementation collide: lessons from a hybrid type 3 study of a digital, direct-to-consumer HIV prevention program
Macapagal, K. R., Madkins, K., Knapp, A. A., Hurtado, M., Paton, M. J., Norton, B., Owusu, J., Greenawalt, I., Li, D. H., & Mustanski, B. S. (2026) · Implementation Science Communications · doi:10.1186/s43058-026-01089-5
Promising Technology-Driven Interventions for Black Sexual Minority Men
Ramos, S. R., & Rodriguez, C. (2026) · Springer eBooks · doi:10.1007/978-3-032-18233-3_13
Inclusion of underserved young people in digital public health interventions for mental health, sexual health and substance use: A systematic review and intervention component analysis
Tatton, C., Kirby, J., Armitage, J. M., Robinson, S., Aslam, R. W., Arthur, T., Harrison, S., Mutanda, D., Garside, R., Coon, J. T., et al. (2026) · Internet Interventions · doi:10.1016/j.invent.2026.100985
Efficacy of an Interactive Life Simulation Gaming App on Improving HIV Testing Uptake Among Adolescents and Young Adults at Risk for HIV: Results of a Randomized Controlled Trial
Castel, A. D., Kuo, I. C., Ciarleglio, A., Kauzlarich, L., Trexler, C., Banerji, S., Moscovich, T. C., Banas, J. C., Carney, C. X., Shaw, C., et al. (2026) · JMIR Serious Games · doi:10.2196/82297

Feasibility, Acceptability, and Preliminary Efficacy of an Online HIV Prevention Program for Diverse Young Men who have Sex with Men: The Keep It Up! Intervention
Mustanski, B. S., Garofalo, R., Monahan, C., Gratzer, B., & Andrews, R. (2013) · AIDS and Behavior · doi:10.1007/s10461-013-0507-z · Cited by 144 · see citing works
Internet-Based HIV Prevention With At-Home Sexually Transmitted Infection Testing for Young Men Having Sex With Men: Study Protocol of a Randomized Controlled Trial of Keep It Up! 2.0
Mustanski, B. S., Madkins, K., Greene, G. J., Parsons, J. T., Johnson, B. A., Sullivan, P. S., Bass, M., & Abel, R. (2017) · JMIR Research Protocols · doi:10.2196/resprot.5740 · Cited by 41 · see citing works
Implementation and Evaluation of the Keep It Up! Online HIV Prevention Intervention in a Community-Based Setting
Greene, G. J., Madkins, K., Andrews, K., Dispenza, J., & Mustanski, B. S. (2016) · AIDS Education and Prevention · doi:10.1521/aeap.2016.28.3.231 · Cited by 39 · see citing works
The NIMH Multisite HIV Prevention Trial: Reducing HIV Sexual Risk Behavior
NIMH Multisite HIV Prevention Trial Group (1998) · Science · doi:10.1126/science.280.5371.1889 · Cited by 286 · see citing works
Randomised controlled trial of a brief, clinic-based intervention to promote safer sex among young Black men who have sex with men: implications for pre-exposure prophylaxis-related counselling
Crosby, R. A., Mena, L. A., & Vickers‐Smith, R. (2019) · Sexual Health · doi:10.1071/sh18156 · Cited by 4 · see citing works

Authors: Mustanski, B., Parsons, J. T., Sullivan, P. S., Madkins, K., Rosenberg, E., & Swann, G.
Affiliations: Northwestern University (US)
City University of New York (US)
State University of New York (US)
Corresponding author: Mustanski, Brian
ORCID: Mustanski, Brian
Parsons, Jeffrey T.
Sullivan, Patrick S.
Madkins, Krystal
Rosenberg, Eli
Swann, Gregory
Venue: American Journal of Preventive Medicine
Publisher: Elsevier BV
Published: 2018-08
Volume: 55
Issue: 2
Pages: 151-158
ISSN: 0749-3797 (ISSN-L)
DOI: 10.1016/j.amepre.2018.04.026
PMC: PMC6314292
OpenAlex: W2811047402
Cited by: 103
References: 43
Citations by year: 2026: 8 · 2025: 7 · 2024: 13 · 2023: 9 · 2022: 15 · 2021: 13 · 2020: 23 · 2019: 13 · 2018: 2
FWCI: 9.63
Type: journal article
Language: en
Open access: green
www.ncbi.nlm.nih.gov
Licence: www.elsevier.com/tdm/userlicense/1.0/ (tdm)
www.elsevier.com/legal/tdmrep-license (tdm)
Locations: American Journal of Preventive Medicine (publishedVersion)
PubMed (publishedVersion)
Europe PMC (PubMed Central) (acceptedVersion)
PubMed Central (acceptedVersion)
Funders: National Institute on Drug Abuse
Centers for Disease Control and Prevention
Gilead Sciences
National Institute of Mental Health (R01DA035145)
National Institutes of Health
Topics: Health Sciences › Medicine › Infectious Diseases › HIV/AIDS Research and Interventions
Health Sciences › Medicine › Epidemiology › HIV, Drug Use, Sexual Risk
Health Sciences › Health Professions › General Health Professions › Adolescent Sexual and Reproductive Health
Keywords: HIV prevention, young men who have sex with men, digital health interventions, condomless anal sex, sexually transmitted infections, gonorrhea, chlamydia, HIV/AIDS knowledge, HIV-negative men, online health interventions, sexual risk behavior, racial and ethnic minorities, intervention feasibility and acceptability, HIV prevention messaging
MeSH terms: Adult, Humans, Health Knowledge, Attitudes, Practice, Male, Surveys and Questionnaires, Sexually Transmitted Diseases, United States, HIV Infections, Telemedicine, Homosexuality, Male, Risk Reduction Behavior, Young Adult

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Biomedical and behavioral outcomes of Keep It Up!: an ehealth HIV prevention program RCT.

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Self-check

Cites

Cited by

Related

Record

About these checks