Usability of a Culturally Informed mHealth Intervention for Symptoms of Anxiety and Depression: Feedback From Young Sexual Minority Men
Open accessThe DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
BACKGROUND: To date, we are aware of no interventions for anxiety and depression developed as mobile phone apps and tailored to young sexual minority men, a group especially at risk of anxiety and depression. We developed TODAY!, a culturally informed mobile phone intervention for young men who are attracted to men and who have clinically significant symptoms of anxiety or depression. The core of the intervention consists of daily psychoeducation informed by transdiagnostic cognitive behavioral therapy (CBT) and a set of tools to facilitate putting these concepts into action, with regular mood ratings that result in tailored feedback (eg, tips for current distress and visualizations of mood by context). OBJECTIVE: The aim of this study was to conduct usability testing to understand how young sexual minority men interact with the app, to inform later stages of intervention development. METHODS: Participants (n=9) were young sexual minority men aged 18-20 years (Mean=19.00, standard deviation [SD]=0.71; 44% black, 44% white, and 11.1% Latino), who endorsed at least mild depression and anxiety symptoms. Participants were recruited via flyers, emails to college lesbian, gay, bisexual, and transgender (LGBT) organizations, Web-based advertisements, another researcher's database of sexual minority youth interested in research participation, and word of mouth. During recorded interviews, participants were asked to think out loud while interacting with the TODAY! app on a mobile phone or with paper prototypes. Feedback identified from these recordings and from associated field notes were subjected to thematic analysis using a general inductive approach. To aid interpretation of results, methods and results are reported according to the consolidated criteria for reporting qualitative research (COREQ). RESULTS: Thematic analysis of usability feedback revealed a theme of general positive feedback, as well as six recurring themes that informed continued development: (1) functionality (eg, highlight new material when available), (2) personalization (eg, more tailored feedback), (3) presentation (eg, keep content brief), (4) aesthetics (eg, use brighter colors), (5) LGBT or youth content (eg, add content about coming out), and (6) barriers to use (eg, perceiving psychoeducation as homework). CONCLUSIONS: Feedback from usability testing was vital to understanding what young sexual minority men desire from a mobile phone intervention for symptoms of anxiety and depression and was used to inform the ongoing development of such an intervention.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
A General Inductive Approach for Analyzing Qualitative Evaluation Data
Thomas, D. R. (2006) · American Journal of Evaluation · doi:10.1177/1098214005283748 · Cited by 10,858
Löwe, B., Decker, O., Müller, S., Brähler, E., Schellberg, D., Herzog, W., & Herzberg, P. Y. (2008) · Medical Care · doi:10.1097/mlr.0b013e318160d093 · Cited by 4,527 · cited 1×
“33) on the GAD-7 was in the 92nd percentile [43].”
BackgroundMinority Stress and Mental Health in Gay Men
Meyer, I. H. (1995) · Journal of Health and Social Behavior · doi:10.2307/2137286 · Cited by 4,264 · cited 2×
“The senior author has previously conducted research with this population through partnerships with other researchers and institutes, and her perspective is informed by the minority stress theory [25,26].”
BackgroundAn Ultra-Brief Screening Scale for Anxiety and Depression: The PHQ–4
Kroenke, K., Spitzer, R. L., Williams, J. B. W., & Löwe, B. (2009) · Psychosomatics · doi:10.1016/s0033-3182(09)70864-3 · Cited by 4,261
A mathematical model of the finding of usability problems
Nielsen, J., & Landauer, T. K. (1993) · Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '93 · doi:10.1145/169059.169166 · Cited by 1,961
Internet-based cognitive behaviour therapy for symptoms of depression and anxiety: A meta-analysis
SPEK, V., CUIJPERS, P., NYKLÍČEK, I., RIPER, H., KEYZER, J., & POP, V. (2007) · Psychological Medicine · doi:10.1017/s0033291706008944 · Cited by 1,586 · cited 1×
“If expanding access to care is one of our goals, and feedback from usability testers has been mixed, why do we not consider removing or replacing the coaching protocol? We know from the broader literature that eHealth interventions for anxiety and depression have been plagued by low levels of adherence that limit thei…”
BackgroundHeron, K. E., & Smyth, J. M. (2010) · British Journal of Health Psychology · doi:10.1348/135910709x466063 · Cited by 1,438
Cochran, S. D., Sullivan, J. G., & Mays, V. M. (2003) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.71.1.53 · Cited by 1,109
Bostwick, W. B., Boyd, C. J., Hughes, T. L., & McCabe, S. E. (2010) · American Journal of Public Health · doi:10.2105/ajph.2008.152942 · Cited by 829 · cited 1×
“Gay men, specifically, experience mood and anxiety disorders at 2-3 times the rate of heterosexual men [2].”
BackgroundMerry, S. N., Stasiak, K., Shepherd, M., Frampton, C., Fleming, T., & Lucassen, M. F. G. (2012) · BMJ · doi:10.1136/bmj.e2598 · Cited by 716
Guidelines for psychological practice with lesbian, gay, and bisexual clients.
American Psychological Association (2012) · American Psychologist · doi:10.1037/a0024659 · Cited by 624
Pachankis, J. E., Hatzenbuehler, M. L., Rendina, H. J., Safren, S. A., & Parsons, J. T. (2015) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000037 · Cited by 619 · cited 1×
“A small randomized controlled trial demonstrated some promising outcomes compared with a wait-list control [14].”
ResultMustanski, B., Garofalo, R., Herrick, A., & Donenberg, G. (2007) · Annals of Behavioral Medicine · doi:10.1007/bf02879919 · Cited by 487 · cited 1×
“Additionally, anxiety and depression have been linked with human immunodeficiency virus (HIV) risk behavior (eg, condomless anal sex) among young sexual minority men (eg, [5-7]); this is especially salient given that rates of new HIV infections are particularly high in young sexual minority men aged 13-24 years, accou…”
Backgroundvan Ballegooijen, W., Cuijpers, P., van Straten, A., Karyotaki, E., Andersson, G., Smit, J. H., & Riper, H. (2014) · PLoS ONE · doi:10.1371/journal.pone.0100674 · Cited by 409
Pachankis, J. E. (2014) · Clinical Psychology: Science and Practice · doi:10.1111/cpsp.12078 · Cited by 217 · cited 1×
“One, a face-to-face intervention for young gay and bisexual men, was developed using an approach and guiding principles [12,13] similar to those we describe here.”
MethodPachankis, J. E. (2015) · Archives of Sexual Behavior · doi:10.1007/s10508-015-0480-x · Cited by 205
Hilvert-Bruce, Z., Rossouw, P. J., Wong, N., Sunderland, M., & Andrews, G. (2012) · Behaviour Research and Therapy · doi:10.1016/j.brat.2012.04.001 · Cited by 193 · cited 1×
“If expanding access to care is one of our goals, and feedback from usability testers has been mixed, why do we not consider removing or replacing the coaching protocol? We know from the broader literature that eHealth interventions for anxiety and depression have been plagued by low levels of adherence that limit thei…”
BackgroundSalomon, E. A., Mimiaga, M. J., Husnik, M. J., Welles, S. L., Manseau, M. W., Montenegro, A. B., Safren, S. A., Koblin, B. A., Chesney, M. A., & Mayer, K. H. (2009) · AIDS and Behavior · doi:10.1007/s10461-008-9439-4 · Cited by 144 · cited 1×
“Similarly, young sexual minority men are at greater risk for anxiety and depressive symptoms than their heterosexual peers [3], and male sexual minority youth experience more associated symptoms than adult sexual minority men [4].”
BackgroundSample size in usability studies
Schmettow, M. (2012) · Communications of the ACM · doi:10.1145/2133806.2133824 · Cited by 123
Social Anxiety as a Risk Factor for Unprotected Intercourse Among Gay and Bisexual Male Youth
Hart, T. A., & Heimberg, R. G. (2005) · AIDS and Behavior · doi:10.1007/s10461-005-9021-2 · Cited by 93 · cited 1×
“Additionally, anxiety and depression have been linked with human immunodeficiency virus (HIV) risk behavior (eg, condomless anal sex) among young sexual minority men (eg, [5-7]); this is especially salient given that rates of new HIV infections are particularly high in young sexual minority men aged 13-24 years, accou…”
BackgroundLucassen, M. F., Hatcher, S., Fleming, T. M., Stasiak, K., Shepherd, M. J., & Merry, S. N. (2015) · Australasian Psychiatry · doi:10.1177/1039856215579542 · Cited by 49 · cited 2×
“In any domain they could both be evaluated in, the youth who usability tested TODAY! and the youth who participated in focus groups and feasibility trials for Rainbow SPARX gave similar feedback on these two different interventions [17,50].”
BackgroundMethodBurns, M. N., Montague, E., & Mohr, D. C. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2826 · Cited by 24
Self-citation
Cited by
Use of Digital Mental Health for Marginalized and Underserved Populations
Schueller, S. M., Hunter, J. F., Figueroa, C., & Aguilera, A. (2019) · Current Treatment Options in Psychiatry · doi:10.1007/s40501-019-00181-z · Cited by 268
Patients’ Perceptions of mHealth Apps: Meta-Ethnographic Review of Qualitative Studies
Vo, V., Auroy, L., & Sarradon-Eck, A. (2019) · JMIR mHealth and uHealth · doi:10.2196/13817 · Cited by 294
Smartphone Apps for the Treatment of Mental Disorders: Systematic Review
Miralles, I., Granell, C., Díaz-Sanahuja, L., Van Woensel, W., Bretón-López, J., Mira, A., Castilla, D., & Casteleyn, S. (2020) · JMIR mHealth and uHealth · doi:10.2196/14897 · Cited by 188
Gilbey, D., Morgan, H., Lin, A., & Perry, Y. (2020) · Journal of Medical Internet Research · doi:10.2196/20158 · Cited by 112
Lucassen, M., Samra, R., Iacovides, I., Fleming, T., Shepherd, M., Stasiak, K., & Wallace, L. (2018) · JMIR Serious Games · doi:10.2196/11249 · Cited by 64
Metadata
- Authors
- Fleming, J. B., Hill, Y. N., & Burns, M. N.
- Venue
- JMIR Human Factors
- Publisher
- JMIR Publications Inc.
- Published
- 2017-08-25
- Volume
- 4
- Issue
- 3
- Pages
- e22
- ISSN
- 2292-9495 (ISSN-L)
- OpenAlex
- W2748827340
- Cited by
- 44
- References
- 23
- FWCI
- 3.80
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.