The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
Biomedical and behavioral outcomes of Keep It Up!: an ehealth HIV prevention program RCT.
Open accessAbstract
Introduction HIV diagnoses among young men who have sex with men are increasing, but few effective HIV prevention interventions exist for this population. An RCT was conducted of the online Keep It Up! intervention to determine if it significantly reduced condomless anal sex and sexually transmitted infections compared with an HIV knowledge condition.Study design From May 2013 to March 2017, a total of 901 participants were enrolled in a double-blinded RCT of Keep It Up! with 1-year follow-up. After completing baseline surveys and sexually transmitted infection testing, participants were randomized by an eHealth platform to the intervention or control condition.Setting/participants HIV-negative men who have sex with men reporting condomless anal sex, aged 18-29 years, were recruited through advertising and from HIV testing sites and outreach in Atlanta, Georgia; Chicago, Illinois; and New York, New York.Intervention Multimedia was used to address HIV knowledge and motivate safer behaviors. The control condition reflected existing online HIV information.Main outcome measures Primary outcomes were incident gonorrhea or chlamydia at 12-month follow-up and self-reported condomless anal sex with casual partners at 3-, 6-, and 12-month follow-up.Results In 2017, data were analyzed from 445 (49%) participants randomized to the intervention and 456 (51%) to the control. Participants were primarily racial/ethnic minorities (63%). Sexually transmitted infections at Month 12 was 40% lower for intervention participants (risk ratio=0.60, 95% CI=0.38, 0.95, p=0.01). For the primary behavioral outcome, both arms showed reductions over time with 44% of control and 37% of intervention participants reporting condomless anal sex at Month 12 (prevalence ratio=0.83, 95% CI=0.70, 0.99, p=0.04).Conclusions The Keep It Up! intervention resulted in significantly lower sexually transmitted infection incidence and a small but significant decrease in condomless anal sex 12 months post-intervention relative to an online HIV knowledge condition. In addition, this study demonstrated the feasibility and acceptability of at-home sexually transmitted infection testing as part of an eHealth intervention.Trial registration This study is registered at www.clinicaltrials.gov NCT01836445.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Brief, online, electronic-learning modules for young MSM have been reported to be effective in reducing incident STIs and offer a convenient client platform for effective interventions (10).”
From Sexually Transmitted Infections Treatment Guidelines, 2021 (2021) · cites this paper as [10]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Longitudinal Data Analysis for Discrete and Continuous Outcomes
Zeger, S. L., & Liang, K. (1986) · Biometrics · doi:10.2307/2531248 · Cited by 7,781
Everitt, B. S. (2001) · Psychology Press eBooks · doi:10.4324/9781410605542-11 · Cited by 6,877
Dialysis Dose and Intradialytic Hypotension: Results from the HEMO Study
Causland, F. R. M., Brunelli, S. M., & Waikar, S. S. (2013) · American Journal of Nephrology · doi:10.1159/000355958 · Cited by 2,705
Sexually transmitted diseases treatment guidelines (2015)
Workowski, K., & BOLAN, G. A. (2015) · The Scientific Issues of Ternopil Volodymyr Hnatiuk National Pedagogical University Series pedagogy · doi:10.18370/2309-4117.2015.24.51-56 · Cited by 2,684
Fleming, D. T., & Wasserheit, J. N. (1999) · Sexually Transmitted Infections · doi:10.1136/sti.75.1.3 · Cited by 2,271
Clark, R. C., Mayer, R. E., & Thalheimer, W. (2003) · Performance Improvement Journal · doi:10.1002/pfi.4930420510 · Cited by 2,257
Sackett, D. L. (1979) · Journal of Chronic Diseases · doi:10.1016/0021-9681(79)90012-2 · Cited by 2,075
e‐Learning and the Science of Instruction
(2016) · Wiley eBooks · doi:10.1002/9781119239086 · Cited by 1,556
Sexually Transmitted Diseases Treatment Guidelines 2002
(2002) · PsycEXTRA Dataset · doi:10.1037/e548482006-001 · Cited by 1,238
Stratified Randomization for Clinical Trials
Kernan, W. N., Viscoli, C. M., Makuch, R. W., Brass, L. M., & Horwitz, R. I. (1999) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(98)00138-3 · Cited by 627
Cited by
Sorted by citations
Sexually Transmitted Infections Treatment Guidelines, 2021
Workowski, K. A., Bachmann, L. H., Chan, P. A., Johnston, C. M., Muzny, C. A., Park, I., Reno, H., Zenilman, J. M., & Bolan, G. A. (2021) · MMWR. Recommendations and Reports · doi:10.15585/mmwr.rr7004a1 · Cited by 3,018
The persistent and evolving HIV epidemic in American men who have sex with men
Mayer, K. H., Nelson, L. E., Hightow‐Weidman, L., Mimiaga, M. J., Mena, L. A., Reisner, S. L., Daskalakis, D., Safren, S. A., Beyrer, C., & Sullivan, P. S. (2021) · The Lancet · doi:10.1016/s0140-6736(21)00321-4 · Cited by 138
Gilbey, D., Morgan, H., Lin, A., & Perry, Y. (2020) · Journal of Medical Internet Research · doi:10.2196/20158 · Cited by 112
“Of the 17 interventions identified as having focused on risk reduction and management of STIs, 1 focused on pre-exposure prophylaxis adherence [66], 2 focused on reducing unprotected sex [67-71], 7 targeted multiple aspects of HIV prevention [72-83], 2 focused on HPV prevention [84,85,101], 3 focused on increasing STI…”
BackgroundNguyen, L. H., Tran, B. X., Rocha, L. E. C., Nguyen, H. L. T., Yang, P., Latkin, C. A., Thorson, A. E., & Strömdahl, S. K. (2019) · AIDS and Behavior · doi:10.1007/s10461-019-02626-1 · Cited by 101
“Both interventions obtained the improvement of HIV/AIDS knowledge and sexual risk behaviors [56], and reduced rates of STIs compared with the control group [58].”
BackgroundMethodInfluentialPantalone, D. W., Nelson, K. M., Batchelder, A. W., Chiu, C., Gunn, H. A., & Horvath, K. J. (2020) · The Journal of Sex Research · doi:10.1080/00224499.2020.1728514 · Cited by 81
“However, with some notable successes (Mustanski et al., 2018), the effectiveness and eventual implementation of technology-based studies have not been fully determined.”
BackgroundMaloney, K. M., Bratcher, A. M., Wilkerson, R., & Sullivan, P. S. (2020) · Journal of the International AIDS Society · doi:10.1002/jia2.25439 · Cited by 88
Steehler, K., & Siegler, A. J. (2019) · Journal of Clinical Microbiology · doi:10.1128/jcm.00257-19 · Cited by 75
“Keep It Up! is one intervention that aimed to reduce STI transmission by offering online video education through enacting various real-life scenarios (57).”
BackgroundNelson, K. M., Perry, N. S., Horvath, K. J., & Smith, L. R. (2020) · Translational Behavioral Medicine · doi:10.1093/tbm/ibaa007 · Cited by 61
Gamarel, K. E., Darbes, L. A., Hightow‐Weidman, L., Sullivan, P. S., & Stephenson, R. B. (2018) · JMIR Research Protocols · doi:10.2196/10370 · Cited by 57
“Online interventions are seen as convenient for youth users and allow for home-based access to health messaging, thereby reducing fears of embarrassment or outing by connecting with local resources [36,41].”
BackgroundMartin, P., Cousin, L., Gottot, S., Bourmaud, A., Rochebrochard, É. D. L., & Alberti, C. (2020) · Journal of Medical Internet Research · doi:10.2196/15378 · Cited by 62
“Our review found few plans to observe a robust indicator, such as STI incidence [52], HIV-related care engagement and viral suppression [29], or pregnancy [53,54].”
BackgroundSullivan, P. S., Stephenson, R. B., Hirshfield, S., Mehta, C. C., Zahn, R. J., Bauermeister, J. A., Horvath, K. J., Chiasson, M. A., Gelaude, D., Mullin, S., et al. (2022) · Journal of Medical Internet Research · doi:10.2196/34574 · Cited by 52
“intervention (Keep It Up [40]) will examine the outcomes of centralized versus decentralized implementation approaches, and the results of the study may inform how the M-cubed intervention could be most effectively implemented [41].”
Schnall, R., Kuhns, L. M., Pearson, C. R., Batey, D. S., Bruce, J., Hidalgo, M. A., Hirshfield, S., Janulis, P. F., Jia, H., Radix, A. E., et al. (2022) · JAMA Network Open · doi:10.1001/jamanetworkopen.2022.31853 · Cited by 53
Moskowitz, D., Macapagal, K. R., Mongrella, M. C., Pérez-Cardona, L., Newcomb, M. E., & Mustanski, B. S. (2020) · AIDS and Behavior · doi:10.1007/s10461-020-02827-z · Cited by 48
Meiksin, R., Meléndez‐Torres, G. J., Falconer, J., Witzel, T. C., Weatherburn, P., & Bonell, C. P. (2021) · Journal of Medical Internet Research · doi:10.2196/22477 · Cited by 47
Bauermeister, J. A., Tingler, R. C., Demers, M., Connochie, D. M., Gillard, G., Shaver, J., Chavanduka, T., & Harper, G. W. (2019) · AIDS and Behavior · doi:10.1007/s10461-019-02426-7 · Cited by 51
Factors Associated With HIV Testing in Teenage Men Who Have Sex With Men
Mustanski, B. S., Moskowitz, D., Moran, K., Rendina, H. J., Newcomb, M. E., & Macapagal, K. R. (2020) · PEDIATRICS · doi:10.1542/peds.2019-2322 · Cited by 45
Resistance as Participation: Queer Theory’s Applications for HIV Health Technology Design
Green, M. (2020) · Technical Communication Quarterly · doi:10.1080/10572252.2020.1831615 · Cited by 45
“…are not necessarily misguided, as public health researchers increasingly turn to digital avenues for delivering care (e.g., Tso et al., 2016), and as digital health technologies have demonstrated a capacity to improve sexual health outcomes for LGBTQ+ individuals (e.g., Mustanski et al., 2018).”
BackgroundSmith, J. D., Li, D. H., Merle, J. L., Keiser, B., Mustanski, B. S., & Benbow, N. (2024) · Implementation Science · doi:10.1186/s13012-024-01345-z · Cited by 46
Mustanski, B. S., Moskowitz, D., Moran, K., Newcomb, M. E., Macapagal, K. R., Rodríguez-Díaz, C. E., Rendina, H. J., Laber, E. B., Li, D. H., Matson, M., et al. (2020) · JMIR Research Protocols · doi:10.2196/19701 · Cited by 40
“Similarly, IMB constructs have been associated with condom use consistency and PrEP use among MSM [64,69,86-89].”
Sullivan, P. S., Zahn, R. J., Wiatrek, S. E., Chandler, C. J., Hirshfield, S., Stephenson, R. B., Bauermeister, J. A., Chiasson, M. A., Downing, M. J., Gelaude, D., et al. (2019) · JMIR Research Protocols · doi:10.2196/16439 · Cited by 38
“Specimens were returned to the study laboratory by mail, and STI testing was performed in a Clinical Laboratory Improvement Amendments–certified laboratory using methods previously reported [25].”
MethodLi, D. H., Brown, C. H., Gallo, C. G., Morgan, E., Sullivan, P. S., Young, S. D., & Mustanski, B. S. (2019) · Current HIV/AIDS Reports · doi:10.1007/s11904-019-00455-4 · Cited by 36
“Through two randomized controlled trials (RCTs), labeled 1.0 [47] and 2.0 [61, 62], KIU! was shown to be highly acceptable and efficacious in reducing condomless anal sex and incidence of rectal/urethral STIs.”
MethodInfluentialXin, M., Viswanath, K., Li, A. Y. C., Cao, W., Yuhong, H., Lau, J. T. F., & Mo, P. K. H. (2020) · Journal of Medical Internet Research · doi:10.2196/15977 · Cited by 36
“Finally, 45 articles with a total sample size of 27,704 were deemed eligible and included in this meta-analysis [38-82].”
BackgroundNelson, K. M., Perry, N. S., Stout, C. D., DUNSIGER, S. I., & Carey, M. P. (2021) · AIDS and Behavior · doi:10.1007/s10461-021-03412-8 · Cited by 35
Newcomb, M. E., Sarno, E. L., Bettin, E., Carey, J., Ciolino, J. D., Hill, R., Garcia, C. P., Macapagal, K. R., Mustanski, B. S., Swann, G., et al. (2019) · JMIR Research Protocols · doi:10.2196/15883 · Cited by 29
“✓ ✓ Urethral and rectal Chlamydia and Gonorrhea: Aptima Combo 2 GC/CT nucleic acid amplification test [63] STIa incidence”
Fisher, C. B., Bragard, E., & Bloom, R. F. (2020) · Current HIV/AIDS Reports · doi:10.1007/s11904-020-00489-z · Cited by 28
Jozsa, K., Kraus, A., Korpak, A. K., Birnholtz, J. P., Moskowitz, D., & Macapagal, K. R. (2021) · Archives of Sexual Behavior · doi:10.1007/s10508-021-01962-5 · Cited by 32
Madkins, K., Moskowitz, D., Moran, K., Dellucci, T. V., & Mustanski, B. S. (2019) · AIDS Education and Prevention · doi:10.1521/aeap.2019.31.4.287 · Cited by 29
“The objective of this study was to examine the acceptability and engagement of KIU!, and explore any differences by demographics, within the context of a randomized controlled trial (RCT).”
InfluentialThe Changing Science of HIV Epidemiology in the United States
DʼSouza, G., Golub, E. T., & Gange, S. J. (2019) · American Journal of Epidemiology · doi:10.1093/aje/kwz211 · Cited by 25
“For example, e-health apps were shown in recent randomized trials to increase HIV knowledge and motivate safer behaviors among men who have sex with men, as shown by lower incidence of sexually transmitted infections (69, 70).”
BackgroundMustanski, B. S., Saber, R., Macapagal, K. R., Matson, M., Laber, E. B., Rodríguez-Díaz, C. E., Moran, K., Carrion, A., Moskowitz, D., & Newcomb, M. E. (2022) · AIDS and Behavior · doi:10.1007/s10461-022-03806-2 · Cited by 26
Wirtz, A. L., Logie, C. H., & Mbuagbaw, L. C. E. (2022) · Epidemiologic Reviews · doi:10.1093/epirev/mxac008 · Cited by 25
Huebner, D. M., & Mustanski, B. S. (2019) · Archives of Sexual Behavior · doi:10.1007/s10508-019-1454-1 · Cited by 25
“Emerging research suggests many AMSM are concerned about taking to their parents about using PrEP (Fisher, Fried, Macapagal, & Mustanski, 2018).”
BackgroundVentuneac, A., Li, D. H., Mongrella, M. C., Moskowitz, D., Weingardt, K. R., Brown, C. H., Parsons, J. T., & Mustanski, B. S. (2019) · Sexuality Research and Social Policy · doi:10.1007/s13178-019-00402-3 · Cited by 23
Meiksin, R., Meléndez‐Torres, G. J., Falconer, J., Witzel, T. C., Weatherburn, P., & Bonell, C. P. (2021) · Systematic Reviews · doi:10.1186/s13643-020-01523-2 · Cited by 23
Cantos, V. D., Hagen, K. S., Duarte, A. P., Escobar, C., Batina, I., Orozco, H., Rodríguez, J., Camacho-González, A., & Siegler, A. J. (2023) · JMIR Formative Research · doi:10.2196/43844 · Cited by 21
“Mustanski et al [27] developed a 7-module, web-based, multimedia intervention (Keep it Up!), which resulted in lower STI incidence compared with a web-based HIV knowledge condition [27].”
BackgroundMunson, E. L., Morgan, E., Sienkiewicz, L., Thomas, Y., Buehler, K., Ryan, D. T., Clifford, A., & Mustanski, B. S. (2020) · Sexually Transmitted Infections · doi:10.1136/sextrans-2020-054463 · Cited by 18
Kutner, B. A., Wu, Y., Balán, I. C., & Meyers, K. A. (2019) · AIDS and Behavior · doi:10.1007/s10461-019-02758-4 · Cited by 17
Meléndez‐Torres, G. J., Meiksin, R., Witzel, T. C., Weatherburn, P., Falconer, J., & Bonell, C. P. (2022) · JMIR Public Health and Surveillance · doi:10.2196/27061 · Cited by 16
“Very low No meta-analysis; 1 study [35] Midterm HIV infections”
BackgroundMethodInfluentialNewcomb, M. E., Swann, G., Macapagal, K. R., Sarno, E. L., Whitton, S. W., & Mustanski, B. S. (2023) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000823 · Cited by 16
Macapagal, K. R., Li, D. H., Clifford, A., Madkins, K., & Mustanski, B. S. (2020) · Current HIV/AIDS Reports · doi:10.1007/s11904-020-00491-5 · Cited by 15
Mustanski, B. S., Saber, R., Jones, J. P., Macapagal, K. R., Benbow, N., Li, D. H., Brown, C. H., Janulis, P. F., Smith, J. D., Marsh, E., et al. (2022) · SSRN Electronic Journal · doi:10.1016/j.cct.2023.107134 · Cited by 15
Munson, E. L., Reynoso, A., Pass, M., Buehler, K., Ryan, D. T., Clifford, A., Morgan, E., & Mustanski, B. S. (2020) · Sexually Transmitted Diseases · doi:10.1097/olq.0000000000001244 · Cited by 14
“gonorrhoeae–specific nucleic acid from extraurogenital specimens collected from STI clinic populations and from other at-risk demographics.(9,10) The urogenital parasite”
BackgroundSharma, A., Gandhi, M., Sallabank, G., Merrill, L., & Stephenson, R. B. (2022) · AIDS and Behavior · doi:10.1007/s10461-022-03846-8 · Cited by 13
A Review of Serious Gaming as an Intervention for HIV Prevention
Smith, A. U., Khawly, G., Jann, J., Zetina, A. P. M., Padilla, J. J., & Schnall, R. (2023) · Current HIV/AIDS Reports · doi:10.1007/s11904-023-00659-9 · Cited by 13
Li, D. H., Moskowitz, D., Macapagal, K. R., Saber, R., & Mustanski, B. S. (2020) · Prevention Science · doi:10.1007/s11121-020-01148-w · Cited by 13
Luo, Q., Zhang, Y., Wang, W., Cui, T., & Li, T. (2024) · JMIR mhealth and uhealth · doi:10.2196/49509 · Cited by 15
“Meta-analysis of randomized controlled trials assessing the effect of gamified digital interventions on the number of condomless anal sex acts among men who have sex with men 6 months post intervention [32,33].”
BackgroundHuang, H., Xie, M., Yang, Z. Y., & Wang, A. (2024) · Journal of Medical Internet Research · doi:10.2196/57363 · Cited by 14
“…channels, such as digital games, street interviews, and therapist-guided group psychological discussions, to enhance the effectiveness of performing multimedia interventions, providing participants with knowledge about preventing HIV/AIDS and sexually transmitted infections [18,19,31].”
Sharma, A., Gandhi, M., Sallabank, G., Merrill, L., & Stephenson, R. B. (2022) · American Journal of Men s Health · doi:10.1177/15579883221115591 · Cited by 12
“…Web-based studies to request the return of self-collected specimens for HIV or bacterial STI testing (Biello et al., 2021; Grov et al., 2016; Merchant et al., 2018; Mustanski et al., 2018; Salow et al., 2017; P. S. Sullivan, Stephenson, et al., 2021; S. P. Sullivan, Sullivan, & Stephenson, 2021).”
BackgroundGamarel, K. E., Darbes, L. A., Wall, K. M., Jones, J. S., Washington, C., Rosso, M. T., Claude, K., Hightow‐Weidman, L., Sullivan, P. S., & Stephenson, R. B. (2023) · AIDS and Behavior · doi:10.1007/s10461-023-03994-5 · Cited by 12
Boyd, D. T., Abu-Ba’are, G. R., Zigah, E. Y., Williams, A. T., & Flores, D. D. (2023) · Sexually Transmitted Diseases · doi:10.1097/olq.0000000000001832 · Cited by 12
“91).(22) Open family communication was measured using a single item on a 5-point Likert scale ranging from 1 (strongly disagree) to 5 (strongly agree).”
Berona, J., Whitton, S. W., Newcomb, M. E., Mustanski, B. S., & Gibbons, R. D. (2021) · Psychiatric Services · doi:10.1176/appi.ps.202000497 · Cited by 14
Wilbourn, B. C., Howell, T. H., Castel, A. D., D’Angelo, L. J., Trexler, C., Carr, R., & Greenberg, D. (2022) · JMIR Formative Research · doi:10.2196/29196 · Cited by 11
“Innovative strategies to overcome these barriers and increase HIV testing among AYA include social media campaigns [33,34] and mobile health (mHealth) interventions [35,36], both of which have been endorsed by the Centers for Disease Control and Prevention (CDC) to reduce HIV risk and improve sexual health among adole…”
BackgroundLi, D. H., Macapagal, K. R., Mongrella, M. C., Saber, R., & Mustanski, B. S. (2024) · Current HIV/AIDS Reports · doi:10.1007/s11904-024-00693-1 · Cited by 11
“Many studies reported delivering the intervention directly to consumers (DTC; e.g., [39, 40]), but there were also examples of fully or partially digital HIV interventions being integrated into schools (e.g., [41–43]), clinics (e.g., [44–46]), and other settings (e.g., [47–50]).”
Meiksin, R., Meléndez‐Torres, G. J., Miners, A. H., Falconer, J., Witzel, T. C., Weatherburn, P., & Bonell, C. P. (2022) · Public Health Research · doi:10.3310/brwr6308 · Cited by 10
Hogben, M., Dittus, P., Leichliter, J. S., & Aral, S. O. (2020) · Sexual Health · doi:10.1071/sh19105 · Cited by 11
A content analysis of college students’ gaps in knowledge about sexually transmitted infections
Lederer, A. M., & Sheena, B. S. (2020) · Health Education Journal · doi:10.1177/0017896920959091 · Cited by 16
“This strategy has been recommended in other sexual health research, as subsequent educational sessions may reinforce or extend previously learned information (Daigle et al., 2009; McMahon et al., 2015; Mustanski et al., 2018).”
BackgroundNewcomb, M. E., Sarno, E. L., Bettin, E., Conway, A., Carey, J., Garcia, C., Hill, R., Jozsa, K., Swann, G., Addington, E. L., et al. (2022) · Trials · doi:10.1186/s13063-022-06457-9 · Cited by 10
“STI incidence Urethral and rectal Chlamydia and Gonorrhea – Aptima Combo 2 GC/CT nucleic acid amplification test [47] X X”
Zapata, J. P., Hirshfield, S., Nelson, K. M., Horvath, K. J., & John, S. A. (2023) · JMIR Formative Research · doi:10.2196/51103 · Cited by 10
“Prior research has shown that many in-person interventions can be adapted using mobile health (mHealth) technology for health behavior change [27-32].”
BackgroundUsing Video Games to Improve the Sexual Health of Young People Aged 15 to 25 Years: Rapid Review
Vega, I. F., Eleftheriou, A., & Graham, C. A. (2022) · JMIR Serious Games · doi:10.2196/33207 · Cited by 11
“Minigames are found in several games, particularly in the form of quizzes [29,34,36,37].”
InfluentialNelson, K. M., Perry, N. S., Stout, C. D., & Carey, M. P. (2020) · JAIDS Journal of Acquired Immune Deficiency Syndromes · doi:10.1097/qai.0000000000002342 · Cited by 9
Downing, M. J., Wiatrek, S. E., Zahn, R. J., Mansergh, G., Olansky, E., Gelaude, D., Sullivan, P. S., Stephenson, R. B., Siegler, A. J., Bauermeister, J. A., et al. (2023) · mHealth · doi:10.21037/mhealth-21-53 · Cited by 9
Behavior Change Among HIV-Negative Men Who Have Sex with Men Not Using PrEP in the United States
Goodreau, S. M., Barry, M. P., Hamilton, D. T., Williams, A. M., Wang, L. Y., Sanchez, T., Katz, D. A., & Delaney, K. P. (2024) · AIDS and Behavior · doi:10.1007/s10461-024-04281-7 · Cited by 8
Wilbourn, B. C., Howell, T. H., Castel, A. D., D’Angelo, L. J., Trexler, C., Carr, R., & Greenberg, D. (2019) · Games for Health Journal · doi:10.1089/g4h.2018.0162 · Cited by 8
“…for increasing desired health behaviors among their sample populations, there has been limited research on increasing HIV testing among AYAs through gaming, 25–29 an approach that has been endorsed by the U.S. Centers for Disease Control and Prevention (CDC) to reduce HIV risk among adolescents.”
BackgroundJones, J. S., Knox, J., Meanley, S., Yang, P., Lounsbury, D. W., Huang, T. T. ‐., Bauermeister, J. A., Gonzalez‐Hernandez, G., Frye, V. A., Grov, C., et al. (2022) · JAIDS Journal of Acquired Immune Deficiency Syndromes · doi:10.1097/qai.0000000000002983 · Cited by 8
“The Keep It Up! intervention 10,11,30 is currently being scaled up in a type III hybrid-effectiveness study 31 ; however, few other technology-based interventions have reached this stage of development.”
BackgroundWood, S. M., Bauermeister, J. A., Fiks, A. G., Phillips, A. W., Richardson, H. M., Garcia, S. M., Maleki, P., Beidas, R. S., Young, J. F., Gross, R., et al. (2024) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2024.01.033 · Cited by 7
Mo, P. K. H., Xie, L., Lee, T. C., & Li, A. Y. C. (2024) · JMIR Public Health and Surveillance · doi:10.2196/59519 · Cited by 5
“However, BCTs from level 3 were more frequently used in studies targeting older adolescents (aged ≥ 18 years) [55,57,62,65-71,74 ,84]”
Zhu, Z., Lu, X., Gao, P., Wang, X., Hu, X., Xie, N., Liu, C., Zhao, Y., Zhao, Y., Dai, Z., et al. (2024) · Current HIV Research · doi:10.2174/011570162x280190240105063449 · Cited by 5
Menza, T. W., Berry, S. A., Dombrowski, J., Cachay, E. R., Crane, H. M., Kitahata, M. M., & Mayer, K. H. (2022) · Open Forum Infectious Diseases · doi:10.1093/ofid/ofac298 · Cited by 5
Zamantakis, A., Zapata, J. P., Greenawalt, I., Knapp, A. A., Benbow, N., & Mustanski, B. S. (2024) · AIDS and Behavior · doi:10.1007/s10461-024-04525-6 · Cited by 5
Sallabank, G., Stephenson, R. B., Gandhi, M., Merrill, L., & Sharma, A. (2023) · JMIR Formative Research · doi:10.2196/43539 · Cited by 5
“To evaluate the benefits and challenges of bringing this approach to scale, researchers are increasingly requesting GBMSM to return self-collected specimens as part of web-based sexual health studies [28-32].”
BackgroundMustanski, B. S., Benbow, N., Macapagal, K. R., Li, D. H., Madkins, K., Saber, R., Linas, B. P., Smith, J., Brown, C. H., Munroe, S., et al. (2025) · AIDS and Behavior · doi:10.1007/s10461-025-04838-0 · Cited by 4
“Briefly, KIU! has been tested in multiple studies since 2009 [12–14] and, as the first DHI classified by the CDC as a “best evidence” HIV risk reduction intervention [ 14], is ideal for evaluating pragmatic, real-world implementation.”
InfluentialMedina, R. S., Piña, C. R. R., & Losada, A. V. (2021) · Revista Científica Arbitrada de la Fundación MenteClara · doi:10.32351/rca.v6.231 · Cited by 4
“Además en los últimos años, ha cobrado una gran relevancia las intervenciones a través del uso de la tecnología que busca tener una mayor cobertura y atender a población de difícil acceso (Mustanski et al., 2018; Suryavanshi et al., 2020).”
Marzán‐Rodríguez, M., Rodríguez-Díaz, C. E., & Mustanski, B. S. (2020) · Sexuality Research and Social Policy · doi:10.1007/s13178-020-00494-2 · Cited by 4
“…men, have the potential to be effective in reducing risk behaviors and increase HIV testing rates (Mustanski et al., 2018; Mustanski, Greene, Ryan, & Whitton, 2015; Prescott et al., 2016; Schnall, Travers, Rojas, & Carballo-Diéguez, 2014; Ybarra, Liu, Prescott, Phillips 2nd, & Mustanski, 2018).”
BackgroundZhang, J., Xin, J., Guo, D., Chen, L., He, L., Tang, J. Y., Li, Y., Wang, J., & Yang, X. (2025) · Scientific Reports · doi:10.1038/s41598-025-33749-2 · Cited by 3
Li, D. H., Zamantakis, A., Zapata, J. P., Danielson, E. C., Saber, R., Benbow, N., Smith, J. D., Swann, G., Macapagal, K. R., & Mustanski, B. S. (2024) · Implementation Science Communications · doi:10.1186/s43058-024-00628-2 · Cited by 4
“In a multi-city effectiveness trial, KIU! demonstrated effectiveness at changing biomedical HIV risk outcomes [18] and received a “best evidence” rating from the CDC [12].”
BackgroundCascalheira, C. J., Pugh, T. H., Hong, C., Birkett, M. A., Macapagal, K. R., & Holloway, I. W. (2023) · Frontiers in Reproductive Health · doi:10.3389/frph.2023.1303218 · Cited by 3
Munroe, S., Schackman, B. R., Madkins, K., Saber, R., Macapagal, K. R., Vititow, J., Sweeney, N. R., Feder, N. M., Benbow, N., Mustanski, B. S., et al. (2024) · JAIDS Journal of Acquired Immune Deficiency Syndromes · doi:10.1097/qai.0000000000003572 · Cited by 3
Schackman, B. R. (2020) · Clinical Infectious Diseases · doi:10.1093/cid/ciaa1060 · Cited by 3
Katz, D. A., Hamilton, D. T., Rosenthal, E. M., Wang, L. Y., Dunville, R. L., Aslam, M. V., Barrios, L. C., Zlotorzynska, M., Sanchez, T., Sullivan, P. S., et al. (2021) · PubMed Central · doi:10.1097/olq.0000000000001485 · Cited by 2
Zamantakis, A., Zapata, J. P., Smith, J. D., Danielson, E. C., Macapagal, K. R., Saber, R., Li, D. H., Benbow, N., & Mustanski, B. S. (2025) · AIDS and Behavior · doi:10.1007/s10461-025-04963-w · Cited by 2
“3.0 trial was to understand how best to scale up implementation of KIU! in CBO settings, with a secondary aim of further establishing effectiveness in the context of broad implementation [47, 49].”
InfluentialPacheco, M. Y., Warfield, S. K., Hatzistavrakis, P., Mochida-Meek, S., Moskowitz, D., Matson, M., & Mustanski, B. S. (2022) · AIDS and Behavior · doi:10.1007/s10461-022-03843-x · Cited by 2
Zapata, J. P., Swann, G., Zamantakis, A., Madkins, K., Danielson, E. C., & Mustanski, B. S. (2025) · AIDS and Behavior · doi:10.1007/s10461-025-04619-9 · Cited by 2
“)” program, a CDC designated best-evidence HIV prevention intervention [ 33– 36 ].”
Goodreau, S. M., Pollock, E. D., Wang, L. Y., Barrios, L. C., Dunville, R. L., Aslam, M. V., Katz, D. A., Hart-Malloy, R., Rosenthal, E. M., Trigg, M., et al. (2020) · Annals of Epidemiology · doi:10.1016/j.annepidem.2020.05.009 · Cited by 2
“60), with larger point estimates for reductions for younger participants (8).”
BackgroundBenbow, N., Li Dennis, H., Macapagal, K. R., Krystal, M., Rana, S., Zamantakis, A., Emma, R., Smith Justin, D., & Mustanski, B. S. (2025) · Implementation Science Communications · doi:10.1186/s43058-025-00777-y · Cited by 1
“…in sexually transmitted infection (STI) incidence compared to the HIV information control arm, as well as a significant pre-post decrease in self-reported condomless sex [18, 23], which provided the necessary evidence to be classified by the CDC as a “best evidence” HIV risk reduction intervention.”
Zhu, Y., Peng, W., Hu, D., Choi, E. P. H., Valimaki, M. A., Zhang, C., & Li, X. (2026) · Journal of Medical Internet Research · doi:10.2196/87071 · Cited by 1
“The reference list of included studies is provided in Multimedia Appendix 4 [26, 49-71 49-71 ].”
Dennin, R. H., Sinn, A., & Du, Z. (2018) · World Journal of AIDS · doi:10.4236/wja.2018.84011 · Cited by 1
“” [112] [113] and online services [114] may be helpful to some degree.”
BackgroundAdolescent sexual and reproductive health: digital technology risks and opportunities
Bull, S. S., Devine, S., Shlay, J. C., Hammes, A., & Schmiege, S. J. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-817319-0.00009-8 · Cited by 1
Song, R., Green, T. A., & Hall, H. I. (2019) · Journal of Public Health Management and Practice · doi:10.1097/phh.0000000000001083
New communication technologies, social media, and public health
Sullivan, P. S., Siegler, A. J., & Hightow‐Weidman, L. (2021) · doi:10.1093/med/9780198816805.003.0025
Quantitative Study Designs: Experimental
(2020) · Springer Publishing Company eBooks · doi:10.1891/9780826182067.0006
Online sexual, reproductive, and transgender healthcare for LGBTQI+ youth: A scoping reviewPreprint
McLeod, J., Estcourt, C. S., Flowers, P., Gibbs, J., & MacDonald, J. (2024) · medRxiv · doi:10.1101/2024.08.06.24311547
Zamantakis, A., Danielson, E. C., Rudd, E., Zapata, J. P., Benbow, N., Saber, R., Knapp, A. A., & Mustanski, B. S. (2025) · Journal of Medical Internet Research · doi:10.2196/63199 · Cited by 1
“Despite evidence that DHIs are effective for improving HIV prevention outcomes [25,30,43], the requirements to effectively scale these programs and bring them to practice are not well-established.”
Zhu, Y., Peng, W., Hu, D., Choi, E. P. H., Valimaki, M. A., Zhang, C., & Li, X. (2025) · doi:10.2196/preprints.87071
Meiksin, R., Meléndez‐Torres, G. J., Falconer, J., Witzel, T. C., Weatherburn, P., & Bonell, C. P. (2021) · Figshare · doi:10.6084/m9.figshare.13552003
Smith, J. D., Li, D. H., Merle, J. L., Keiser, B., Mustanski, B. S., & Benbow, N. (2024) · Figshare · doi:10.6084/m9.figshare.26678816
Meiksin, R., Meléndez‐Torres, G. J., Falconer, J., Witzel, T. C., Weatherburn, P., & Bonell, C. P. (2021) · Figshare · doi:10.6084/m9.figshare.13552006
Macapagal, K. R., Avila, A. A., Buehler, Z. M., Gordon, J. D., Knapp, A. A., Hurtado, M., Lorenzo, J., Foran, J. E., Newcomb, M. E., Mustanski, B. S., et al. (2026) · JMIR Research Protocols · doi:10.2196/88465
“Those who report being tested are prompted to securely upload evidence of their HIV or STI test via a participant-specific REDCap link in line with procedures from prior work [68,69].”
Macapagal, K. R., Madkins, K., Knapp, A. A., Hurtado, M., Paton, M. J., Norton, B., Owusu, J., Greenawalt, I., Li, D. H., & Mustanski, B. S. (2026) · Implementation Science Communications · doi:10.1186/s43058-026-01089-5
Promising Technology-Driven Interventions for Black Sexual Minority Men
Ramos, S. R., & Rodriguez, C. (2026) · Springer eBooks · doi:10.1007/978-3-032-18233-3_13
Tatton, C., Kirby, J., Armitage, J. M., Robinson, S., Aslam, R. W., Arthur, T., Harrison, S., Mutanda, D., Garside, R., Coon, J. T., et al. (2026) · Internet Interventions · doi:10.1016/j.invent.2026.100985
“…through peer videos, soap operas, images and testimonials in sexual health interventions for YMSM (Bull et al., 2012; Mustanski et al., 2013; Mustanski et al., 2018; Schnall et al., 2022; Tan et al., 2022; Whiteley et al., 2018; Bauermeister et al., 2022), girls (Hebert et al., 2018; Patel…”
InfluentialCastel, A. D., Kuo, I. C., Ciarleglio, A., Kauzlarich, L., Trexler, C., Banerji, S., Moscovich, T. C., Banas, J. C., Carney, C. X., Shaw, C., et al. (2026) · JMIR Serious Games · doi:10.2196/82297
“Although some of these programs have demonstrated preliminary acceptability and feasibility, results from several of these trials are forthcoming, and there is limited research on their efficacy in increasing HIV testing among adolescents and young adults [33,36-39].”
Metadata
- Authors
- Mustanski, B., Parsons, J. T., Sullivan, P. S., Madkins, K., Rosenberg, E., & Swann, G.
- Affiliations
- Northwestern University (US)
- City University of New York (US)
- State University of New York (US)
- Corresponding author
- Mustanski, Brian
- ORCID
- Venue
- American Journal of Preventive Medicine
- Publisher
- Elsevier BV
- Published
- 2018-08
- Volume
- 55
- Issue
- 2
- Pages
- 151-158
- ISSN
- 0749-3797 (ISSN-L)
- PMC
- PMC6314292
- OpenAlex
- W2811047402
- Cited by
- 103
- References
- 43
- Citations by year
- 2026: 8 · 2025: 7 · 2024: 13 · 2023: 9 · 2022: 15 · 2021: 13 · 2020: 23 · 2019: 13 · 2018: 2
- FWCI
- 9.63
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- American Journal of Preventive Medicine (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institute on Drug Abuse
- Centers for Disease Control and Prevention
- Gilead Sciences
- National Institute of Mental Health (R01DA035145)
- National Institutes of Health
- Topics
- Health Sciences › Medicine › Infectious Diseases › HIV/AIDS Research and Interventions
- Health Sciences › Medicine › Epidemiology › HIV, Drug Use, Sexual Risk
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Adolescent Sexual and Reproductive Health
- Keywords
- HIV prevention, young men who have sex with men, digital health interventions, condomless anal sex, sexually transmitted infections, gonorrhea, chlamydia, HIV/AIDS knowledge, HIV-negative men, online health interventions, sexual risk behavior, racial and ethnic minorities, intervention feasibility and acceptability, HIV prevention messaging
- MeSH terms
- Adult, Humans, Health Knowledge, Attitudes, Practice, Male, Surveys and Questionnaires, Sexually Transmitted Diseases, United States, HIV Infections, Telemedicine, Homosexuality, Male, Risk Reduction Behavior, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review