Initial Design of Culturally Informed Behavioral Intervention Technologies: Developing an mHealth Intervention for Young Sexual Minority Men With Generalized Anxiety Disorder and Major Depression
Open accessAbstract
BACKGROUND: To our knowledge, there is no well-articulated process for the design of culturally informed behavioral intervention technologies. OBJECTIVE: This paper describes the early stages of such a process, illustrated by the methodology for the ongoing development of a behavioral intervention technology targeting generalized anxiety disorder and major depression among young sexual minority men. METHODS: We integrated instructional design for Internet behavioral intervention technologies with greater detail on information sources that can identify user needs in understudied populations, as well as advances in the understanding of technology-specific behavioral intervention technology dimensions that may need to be culturally tailored. RESULTS: General psychological theory describing how to effect change in the clinical target is first integrated with theory describing potentially malleable factors that help explain the clinical problem within the population. Additional information sources are then used to (1) evaluate the theory, (2) identify population-specific factors that may affect users' ability to relate to and benefit from the behavioral intervention technology, and (3) establish specific skills, attitudes, knowledge, etc, required to change malleable factors posited in the theory. User needs result from synthesis of this information. Product requirements are then generated through application of the user needs to specific behavioral intervention technology dimensions (eg, technology platform). We provide examples of considerations relevant to each stage of this process and how they were applied. CONCLUSIONS: This process can guide the initial design of other culturally informed behavioral intervention technologies. This first attempt to create a systematic design process can spur development of guidelines for design of behavioral intervention technologies aimed to reduce health disparities.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The current literature provides some guidance on how to adapt mobile phone-based interventions for use in countries where they were not specifically designed, acknowledging the essential role of the end user.
“The current literature provides some guidance on how to adapt mobile phone-based interventions (for use in countries wherein it was not specifically designed), acknowledging the essential role of the end user in this process [24,46,47].”
From Assessing the Cross-Cultural Adaptation and Translation of a Text-Based Mobile Smoking Cessation Program in Samoa (TXTTaofiTapaa): Pilot Study (2018) · cites this paper as [47]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Meyer, I. H. (2003) · Psychological Bulletin · doi:10.1037/0033-2909.129.5.674 · Cited by 14,736 · see citing works
Respondent-Driven Sampling: A New Approach to the Study of Hidden Populations
Heckathorn, D. D. (1997) · Social Problems · doi:10.2307/3096941 · Cited by 4,305 · see citing works
Minority Stress and Mental Health in Gay Men
Meyer, I. H. (1995) · Journal of Health and Social Behavior · doi:10.2307/2137286 · Cited by 4,264 · see citing works
How does sexual minority stigma “get under the skin”? A psychological mediation framework
Hatzenbuehler, M. L. (2009) · Psychological Bulletin · doi:10.1037/a0016441 · Cited by 2,695 · see citing works
(1993) · Medical Entomology and Zoology · Cited by 2,491 · see citing works
Internet-based cognitive behaviour therapy for symptoms of depression and anxiety: A meta-analysis
SPEK, V., CUIJPERS, P., NYKLÍČEK, I., RIPER, H., KEYZER, J., & POP, V. (2007) · Psychological Medicine · doi:10.1017/s0033291706008944 · Cited by 1,586 · see citing works
Toward a unified treatment for emotional disorders
Barlow, D. H., Allen, L. B., & Choate, M. L. (2004) · Behavior Therapy · doi:10.1016/s0005-7894(04)80036-4 · Cited by 1,430 · see citing works
The psychological implications of concealing a stigma: A cognitive-affective-behavioral model
Pachankis, J. E. (2007) · Psychological Bulletin · doi:10.1037/0033-2909.133.2.328 · Cited by 1,305 · see citing works
Mohr, D. C., Cuijpers, P., & Lehman, K. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1602 · Cited by 1,097 · see citing works
Self-citationMethods to support human-centred design
MAGUIRE, M. (2001) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.2001.0503 · Cited by 1,057 · see citing works
Almeida, J., Johnson, R. M., Corliss, H. L., Molnar, B. E., & Azrael, D. R. (2009) · Journal of Youth and Adolescence · doi:10.1007/s10964-009-9397-9 · Cited by 968 · see citing works
Women’s health, men’s health, and gender and health: implications of intersectionality
Hankivsky, O. (2012) · Social Science & Medicine · doi:10.1016/j.socscimed.2011.11.029 · Cited by 796 · see citing works
D’Augelli, A. R., Hershberger, S. L., & Pilkington, N. W. (1998) · American Journal of Orthopsychiatry · doi:10.1037/h0080345 · Cited by 642 · see citing works
Encyclopedia of Behavioral Medicine
Rachlin, D. J. (2013) · Reference Reviews · doi:10.1108/rr-05-2013-0108 · Cited by 625 · see citing works
Toward a unified treatment for emotional disorders - republished Article
Barlow, D. H., Allen, L. B., & Choate, M. L. (2016) · Behavior Therapy · doi:10.1016/j.beth.2016.11.005 · Cited by 536 · see citing works
Cochran, S. D. (2001) · American Psychologist · doi:10.1037/0003-066x.56.11.931 · Cited by 447 · see citing works
The Health and Health Care of Lesbian, Gay, and Bisexual Adolescents
Coker, T. R., Austin, S. B., & Schuster, M. A. (2010) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.012809.103636 · Cited by 363 · see citing works
Seeking Safety. A Treatment Manual for PTSD and Substance Abuse.
&NA; (2002) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-200206000-00025 · Cited by 357 · see citing works
School outcomes of sexual minority youth in the United States: evidence from a national study
RUSSELL, S. T., SEIF, H., & TRUONG, N. L. (2001) · Journal of Adolescence · doi:10.1006/jado.2000.0365 · Cited by 316 · see citing works
Measuring sexual orientation in adolescent health surveys: Evaluation of eight school-based surveys
Saewyc, E., Bauer, G. R., Skay, C. L., Bearinger, L. H., Resnick, M. D., Reis, E., & Murphy, A. (2004) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2004.06.002 · Cited by 275 · see citing works
Richardson, T., Stallard, P., & Velleman, S. (2010) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-010-0069-9 · Cited by 272 · see citing works
Rosario, M., Schrimshaw, E. W., & Hunter, J. (2006) · AIDS Education and Prevention · doi:10.1521/aeap.2006.18.5.444 · Cited by 259 · see citing works
Adolescent health services: missing opportunities
Gootman, J. A., Sim, L. J., & Lawrence, R. S. (2009) · Choice Reviews Online · doi:10.5860/choice.47-0895 · Cited by 250 · see citing works
Murdock, T. B., & Bolch, M. B. (2005) · Psychology in the Schools · doi:10.1002/pits.20054 · Cited by 240 · see citing works
Parents’ awareness of lesbian, gay, and bisexual youths’ sexual orientation
D’Augelli, A. R., Grossman, A. H., & Starks, M. T. (2005) · Journal of Marriage and the Family · doi:10.1111/j.0022-2445.2005.00129.x · Cited by 238 · see citing works
Social anxiety in young gay men
Pachankis, J. E., & Goldfried, M. R. (2006) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2006.01.001 · Cited by 221 · see citing works
Szymanski, D. M., & Gupta, A. (2009) · Journal of Counseling Psychology · doi:10.1037/a0013317 · Cited by 207 · see citing works
Development of a Unified Protocol for the Treatment of Emotional Disorders in Youth
Ehrenreich, J. T., Goldstein, C. R., Wright, L. R., & Barlow, D. H. (2009) · Child & Family Behavior Therapy · doi:10.1080/07317100802701228 · Cited by 197 · see citing works
Scourfield, J., Roen, K., & McDermott, E. (2008) · Health & Social Care in the Community · doi:10.1111/j.1365-2524.2008.00769.x · Cited by 188 · see citing works
Rosario, M., Rotheram‐Borus, M. J., & Reid, H. M. (1996) · Journal of Community Psychology · doi:10.1002/(sici)1520-6629(199604)24:2 · Cited by 174 · see citing works
An Ecological Framework for Cancer Communication: Implications for Research
Patrick, K., Intille, S. S., & Zabinski, M. F. (2005) · Journal of Medical Internet Research · doi:10.2196/jmir.7.3.e23 · Cited by 98 · see citing works
Adolescents define sexual orientation and suggest ways to measure it
Friedman, M., Silvestre, A. J., Gold, M. A., Marković, N., Savin‐Williams, R. C., Huggins, J., & Sell, R. L. (2004) · Journal of Adolescence · doi:10.1016/j.adolescence.2004.03.006 · Cited by 93 · see citing works
Glover, J. A., Galliher, R. V., & Lamere, T. G. (2009) · Journal of Homosexuality · doi:10.1080/00918360802551555 · Cited by 90 · see citing works
Multimodal e-mental health treatment for depression: a feasibility trial
Mohr, D. C., Duffecy, J., Jin, L., Ludman, E. J., Lewis, A., Begale, M., & McCarthy Jr, M. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1370 · Cited by 82 · see citing works
Self-citationAre Real Moods Required to Reveal Mood-Congruent and Mood-Dependent Memory?
Eich, E., & Macaulay, D. (2000) · Psychological Science · doi:10.1111/1467-9280.00249 · Cited by 81 · see citing works
Confidant support and the mental wellbeing of lesbian and gay young adults: a longitudinal analysis
Vincke, J., & van Heeringen, K. (2002) · Journal of Community & Applied Social Psychology · doi:10.1002/casp.671 · Cited by 79 · see citing works
Mustanski, B. S., Johnson, A. K., Garofalo, R., Ryan, D. T., & Birkett, M. A. (2012) · AIDS and Behavior · doi:10.1007/s10461-012-0359-y · Cited by 78 · see citing works
The Health and Health Behaviors of Young Men Who Have Sex with Men
Kipke, M. D., Kubicek, K., Weiss, G., Wong, C. F., Lopez, D. M., Iverson, E. F., & Ford, W. (2007) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2006.10.019 · Cited by 75 · see citing works
What Lessons do Coming Out as Gay Men or Lesbians have for People Stigmatized by Mental Illness?
Corrigan, P. W., Larson, J. E., Hautamaki, J. B., Matthews, A. K., Kuwabara, S., Rafacz, J. D., Walton, J. L., Wassel, A. K., & O’Shaughnessy, J. (2009) · Community Mental Health Journal · doi:10.1007/s10597-009-9187-6 · Cited by 61 · see citing works
Using Instructional Design Process to Improve Design and Development of Internet Interventions
Hilgart, M. M., Ritterband, L. M., Thorndike, F. P., & Kinzie, M. B. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.1890 · Cited by 61 · see citing works
Depression, cognitive skill, and metacognitive skill in problem solving
Slife, B. D., & Weaver, C. A. (1992) · Cognition & Emotion · doi:10.1080/02699939208411055 · Cited by 57 · see citing works
Four architectures of instruction
Clark, R. C. (2000) · Performance Improvement Journal · doi:10.1002/pfi.4140391011 · Cited by 53 · see citing works
Internet sexuality research with rural men who have sex with men: Can we recruit and retain them?
Bowen, A. M. (2005) · The Journal of Sex Research · doi:10.1080/00224490509552287 · Cited by 47 · see citing works
Valdez, R. S., Gibbons, M. C., Siegel, E. R., Kukafka, R., & Brennan, P. F. (2012) · Health and Technology · doi:10.1007/s12553-012-0031-6 · Cited by 46 · see citing works
Lyons, H. Z., Bieschke, K. J., Dendy, A. K., Worthington, R. L., & Georgemiller, R. J. (2010) · Professional Psychology Research and Practice · doi:10.1037/a0021121 · Cited by 43 · see citing works
Flagged first, then by citations
Research works printed but not linked: 3
- [3]Institute of Medicine; Board on the Health of Select Populations; Committee on LGBT Health Issues and Research Gaps and Opportunities The Health of Lesbian, Gay, Bisexual, and Transgender (LGBT) People: Building a Foundation for Better Understanding 2011 Washington, D.C National Academies Press 22013611
- [32]Pilkington NW D'Augelli AR Victimization of lesbian, gay, and bisexual youth in community settings J Community Psychol 1995 23 1 34 56 10.1002/1520-6629(199501)199523:199501<199534::AID-JCOP2290230105>2290230103.2290230100.CO;2290230102-N · DOI
- [47]Miller WR Rollnick S Motivational Interviewing, Second Edition: Preparing People for Change 2002 New York The Guilford Press
Cited by
Sorted by citations
The Use and Effectiveness of Mobile Apps for Depression: Results From a Fully Remote Clinical Trial
Arean, P. A., Hallgren, K. A., Jordan, J. T., Gazzaley, A., Atkins, D. C., Heagerty, P. J., & Anguera, J. A. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.6482 · Cited by 376 · see citing works
Use of Digital Mental Health for Marginalized and Underserved Populations
Schueller, S. M., Hunter, J. F., Figueroa, C., & Aguilera, A. (2019) · Current Treatment Options in Psychiatry · doi:10.1007/s40501-019-00181-z · Cited by 268 · see citing works
Ramos, G., & Chavira, D. A. (2022) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2019.10.004 · Cited by 143 · see citing works
National Healthcare Disparities Report, 2008
(2009) · PsycEXTRA Dataset · doi:10.1037/e593132009-001 · Cited by 150 · see citing works
Barriers and Facilitators to Telemedicine: Can You Hear Me Now?
López, A. M., Lam, K., & Thota, R. (2021) · American Society of Clinical Oncology Educational Book · doi:10.1200/edbk_320827 · Cited by 145 · see citing works
National Healthcare Disparities Report, 2011
UNSPECIFIED (2011) · PsycEXTRA Dataset · doi:10.1037/e579292012-001 · Cited by 141 · see citing works
National Healthcare Disparities Report, 2005
(2005) · PsycEXTRA Dataset · doi:10.1037/e593252009-001 · Cited by 70 · see citing works
The Role of Perceived Loneliness in Youth Addictive Behaviors: Cross-National Survey Study
Savolainen, I., Oksanen, A., Kaakinen, M., Sirola, A., & Paek, H. (2019) · JMIR Mental Health · doi:10.2196/14035 · Cited by 71 · see citing works
National Healthcare Disparities Report, 2004
(2004) · PsycEXTRA Dataset · doi:10.1037/e593272009-001 · Cited by 63 · see citing works
Explaining effective mental health support for LGBTQ+ youth: A meta-narrative review
McDermott, E., Eastham, R., Hughes, E. A., Pattinson, E. M., Johnson, K., Davis, S., Pryjmachuk, S., Mateus, C., & Jenzen, O. (2021) · SSM - Mental Health · doi:10.1016/j.ssmmh.2021.100004 · Cited by 62 · see citing works
National Healthcare Disparities Report, 2012
(2013) · PsycEXTRA Dataset · doi:10.1037/e553752013-001 · Cited by 48 · see citing works
Fleming, J. B., Hill, Y. N., & Burns, M. N. (2017) · JMIR Human Factors · doi:10.2196/humanfactors.7392 · Cited by 44 · see citing works
Self-citationNational Healthcare Disparities Report
(2003) · PsycEXTRA Dataset · doi:10.1037/e308932005-001 · Cited by 38 · see citing works
Hubach, R. D., O’Neil, A. M., Stowe, M., Giano, Z. D., Curtis, B. L., & Fisher, C. B. (2020) · Archives of Sexual Behavior · doi:10.1007/s10508-019-01612-x · Cited by 34 · see citing works
Lee, J. H., Giovenco, D., & Operario, D. (2017) · Journal of Health Communication · doi:10.1080/10810730.2017.1341566 · Cited by 24 · see citing works
McCool, J., Tanielu, H., Umali, E., & Whittaker, R. (2018) · JMIR mHealth and uHealth · doi:10.2196/mhealth.9033 · Cited by 15 · see citing works
Shuldiner, J., Shah, N., Reis, C., Chalmers, I., Ivers, N. M., & Nathan, P. C. (2022) · JMIR Human Factors · doi:10.2196/37606 · Cited by 13 · see citing works
Wells, K. B., Thames, A. D., Young, A. S., Zhang, L., Heilemann, M. V., Romero, D. F., Oliva, A., Jones, F., Tang, L., Brymer, M. J., et al. (2022) · JMIR Formative Research · doi:10.2196/42031 · Cited by 13 · see citing works
Goodsmith, N., Moore, E. M., Siddiq, H., Barceló, N. E., Ulloa-Flores, E., Loera, G., Jones, F., Aguilar‐Gaxiola, S., Wells, K. B., & Arevian, A. C. (2022) · Journal of Health Care for the Poor and Underserved · doi:10.1353/hpu.2022.0039 · Cited by 10 · see citing works
East, M. L., Havard, B., & Hastings, N. B. (2016) · Journal of Technology in Human Services · doi:10.1080/15228835.2016.1233842 · Cited by 7 · see citing works
Perceptions of Endocrine Therapy in African-American Breast Cancer Survivors: Mixed Methods Study
Donevant, S. B., Heiney, S. P., Wineglass, C. M., Schooley, B. L., Singh, A., & Sheng, J. (2021) · JMIR Formative Research · doi:10.2196/23884 · Cited by 5 · see citing works
McDermott, E., Eastham, R., Hughes, E., Pattison, E., Johnson, K., Davis, S., Pryjmachuk, S., Mateus, C., Jenzen, O., & McNulty, F. (2024) · Health and Social Care Delivery Research · doi:10.3310/kywa6382 · Cited by 3 · see citing works
Ramos, N., Jones, S., Zhang, L., Nuno, M. A., Ramsey, B., Ceseña, D., Mireles, A., & Wells, K. B. (2025) · JMIR Formative Research · doi:10.2196/67082 · Cited by 1 · see citing works
Kofoworola, D. O., Akanni, O. O., & Solagbade, A. J. (2024) · Electronic Journal of Medical and Educational Technologies · doi:10.29333/ejmets/14300 · Cited by 1 · see citing works
A Framework for Analyzing Patient-centered Mobile Applications for Mental Health
Batoroev, K., Boehmann, T., & Tokar, O. (2015) · Journal of the Association for Information Systems · Cited by 1 · see citing works
Duan, W., Zhang, J., & Lei, H. E. (2018) · Advances in Psychological Science · doi:10.3724/sp.j.1042.2018.01232 · Cited by 1 · see citing works
Jacobs, M. N. (2021) · University of the Western Cape Electronic Theses and Dissertations Repository (University of the Western Cape)
Designing A Provincial Surveillance and Support System for Childhood Cancer SurvivorsPreprint
Shuldiner, J., Shah, N., Reis, C., Chalmers, I., Ivers, N. M., & Nathan, P. C. (2022) · Research Square · doi:10.21203/rs.3.rs-1292746/v1
Miracle or misfortune? Analyzing Reddit users’ narratives about Ozempic medication for weight loss
Omosun, F., & Young, A. (2026) · Atlantic Journal of Communication · doi:10.1080/15456870.2026.2623661
Chen, Z., Hoskin, J. M., Murray, S. M., Sanchez, T., Glick, J. L., Wiginton, J. M., Fine, S. L., & Robinson, K. (2026) · doi:10.2196/preprints.94108
- Authors
- Burns, M. N., Montague, E., & Mohr, D. C.
- Affiliations
- Northwestern University (US)
- Corresponding author
- Burns, Michelle Nicole
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2013-12-05
- Volume
- 15
- Issue
- 12
- Pages
- e271
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC3869054
- OpenAlex
- W2000396398
- Cited by
- 24
- References
- 45
- Citations by year
- 2026: 2 · 2025: 1 · 2024: 2 · 2022: 4 · 2021: 4 · 2020: 1 · 2019: 3 · 2018: 2 · 2017: 2 · 2016: 2 · 2015: 1
- FWCI
- 2.04
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Institute of Mental Health (K08MH094441)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Keywords
- mobile health, generalized anxiety disorder, major depressive disorder, instructional design, user needs analysis, culturally tailored interventions, health disparities, design process
- MeSH terms
- Adolescent, Anxiety Disorders, Behavior Therapy, Cultural Characteristics, Major Depressive Disorder, Humans, Male, Models, Psychological, Telemedicine, Homosexuality, Male, Health Status Disparities, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review