Usability of a Smartphone Application to Support the Prevention and Early Intervention of Anxiety in Youth
Open accessThe DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Abstract
Anxiety disorders are among the most common psychiatric problems in youth, fail to spontaneously remit, and place some youth at risk for additional behavioral and emotional difficulties. Efforts to target anxiety have resulted in evidence-based interventions but the resulting prevention effects are relatively small, often weakening over time. Mobile health (mHealth) tools could be of use to strengthen the effects of anxiety prevention efforts. Although a large number of mHealth apps have been developed, few have been evaluated in terms of usability prior to clinical effectiveness testing. Because usability is one of the main barriers to mHealth usage and adoption, the objective of this research was to evaluate the usability of a smartphone application (app) corresponding to an indicated prevention and early intervention targeting youth anxiety. To accomplish this, 132 children (M age = 9.65; 63% girls) and 45 service providers (M age = 29.13, 87% female) rated our app along five established dimensions of usability (ease of use, ease of learning, quality of support information, satisfaction, and stigma) using a standardized group-based testing protocol. Findings showed that the app was highly and positively rated by both youth and providers, with some variations (lower ratings when errors occurred). Path analyses findings also showed that system understanding was significantly related to greater system satisfaction, but that such relation occurred through the quality of support information offered by the app.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788
Enders, C., & Bandalos, D. (2001) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem0803_5 · Cited by 4,978
Nielsen, J. (1994) · Conference companion on Human factors in computing systems - CHI '94 · doi:10.1145/259963.260531 · Cited by 2,759
Nielsen, J. (1995) · Conference companion on Human factors in computing systems - CHI '95 · doi:10.1145/223355.223730 · Cited by 2,620
The Proteus Effect: The Effect of Transformed Self-Representation on Behavior
Yee, N., & Bailenson, J. (2007) · Human Communication Research · doi:10.1111/j.1468-2958.2007.00299.x · Cited by 2,126 · cited 1×
“…of the blob incorporated proven mHealth intervention methodology known as the proteus effect, which posits that animated representations that reward the user for positive behavior provide increased motivation to perform activities that promote the desired behavior change (Yee & Bailenson, 2007).”
BackgroundAngold, A., Costello, E. J., & Erkanli, A. (1999) · Journal of Child Psychology and Psychiatry · doi:10.1111/1469-7610.00424 · Cited by 1,872
RMediation: An R package for mediation analysis confidence intervals
Tofighi, D., & MacKinnon, D. P. (2011) · Behavior Research Methods · doi:10.3758/s13428-011-0076-x · Cited by 1,419 · cited 2×
“We used the products of coefficients estimator and bias-corrected bootstrap sampling distributions provided by RMediation (Tofighi & MacKinnon, 2011) to estimate the significance of indirect effects of quality of support information as well as the effects of number of event errors on the system understanding and syste…”
MethodTreating anxiety disorders in children: Results of a randomized clinical trial.
Kendall, P. C. (1994) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.62.1.100 · Cited by 1,376
Rebooting psychotherapy research and practice to reduce the burden of mental illness
Kazdin, A. E., & Blase, S. L. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691610393527 · Cited by 1,254 · cited 1×
“…associated with other types of technologies (e.g., web-based tools), and even affecting change in economically disparate populations (Baggett et al., 2010; Comer & Barlow, 2014; Kazdin & Blase, 2011), new and better tools will continue to be found in the research area and consumer marketplace.”
BackgroundMethods to support human-centred design
MAGUIRE, M. (2001) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.2001.0503 · Cited by 1,057 · cited 1×
“Second, poor usability typically reflects difficult to learn, poorly designed, and complicated systems to the extent that these systems can lead to reduced engagement and usage because critical content may not be presented effectively (Jaspers, 2009; Maguire, 2001).”
BackgroundComorbidity of anxiety and depression in children and adolescents: 20 years after
Cummings, C. M., Caporino, N. E., & Kendall, P. C. (2014) · Psychological Bulletin · doi:10.1037/a0034733 · Cited by 1,028
mHealth for mental health: Integrating smartphone technology in behavioral healthcare.
Luxton, D. D., McCann, R. A., Bush, N. E., Mishkind, M. C., & Reger, G. M. (2011) · Professional Psychology: Research and Practice · doi:10.1037/a0024485 · Cited by 809
Comorbidity of anxiety and depression in children and adolescents
Brady, E. U., & Kendall, P. C. (1992) · Psychological Bulletin · doi:10.1037/0033-2909.111.2.244 · Cited by 748
Usability of mobile applications: literature review and rationale for a new usability model
Harrison, R., Flood, D., & Duce, D. (2013) · Journal of Interaction Science · doi:10.1186/2194-0827-1-1 · Cited by 736
The Anxiety Disorders Interview Schedule for Children
SILVERMAN, W. K., & NELLES, W. B. (1988) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-198811000-00019 · Cited by 688
Evidence-based psychosocial treatments for phobic and anxiety disorders in children and adolescents
Silverman, W. K., Pina, A. A., & Viswesvaran, C. (2008) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374410701817907 · Cited by 660
Jaspers, M. W. M. (2009) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2008.10.002 · Cited by 649 · cited 4×
“…sequence data (how user navigated from one activity to another; Hilbert & Redmiles, 2000) could help identify inefficiencies in design organization (e.g., button locations not intuitively placed for users) and whether user interactions follow the anticipated design sequences (Jaspers, 2009).”
BackgroundMethodInfluentialEmpirical Studies on Usability of mHealth Apps: A Systematic Literature Review
Zapata, B. C., Fernández-Alemán, J. L., Idri, A., & Toval, A. (2015) · Journal of Medical Systems · doi:10.1007/s10916-014-0182-2 · Cited by 585
Stice, E., Shaw, H., Bohon, C., Marti, C. N., & Rohde, P. (2009) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0015168 · Cited by 553
Diagnostic Inaccuracy of Smartphone Applications for Melanoma Detection
Wolf, J. A., Moreau, J. F., Akilov, O., Patton, T., English, J. C., Ho, J., & Ferris, L. K. (2013) · JAMA Dermatology · doi:10.1001/jamadermatol.2013.2382 · Cited by 393
Brown, W., Yen, P.-Y., Rojas, M., & Schnall, R. (2013) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2013.08.001 · Cited by 299 · cited 5×
“…and combined into one measure to assess the five dimensions of usability outlined by the ISO/IEC and typical standards noted in the literature (Brown et al., 2013; Matthews et al., 2008; Nielsen, 1994): ease of use, quality of support information, ease of learning, satisfaction, and social…”
BackgroundMethodInfluentialThe prevention of child and adolescent anxiety: a meta-analytic review
Fisak, B. J., Richard, D., & Mann, A. (2011) · Prevention Science · doi:10.1007/s11121-011-0210-0 · Cited by 271
Advancing the science of mHealth
Nilsen, W., Kumar, S., Shar, A., Varoquiers, C., Wiley, T., Riley, W. T., Pavel, M., & Atienza, A. A. (2012) · Journal of Health Communication · doi:10.1080/10810730.2012.677394 · Cited by 226
The SmartCAT: An m-Health Platform for Ecological Momentary Intervention in Child Anxiety Treatment
Pramana, G., Parmanto, B., Kendall, P. C., & Silk, J. S. (2014) · Telemedicine and e-Health · doi:10.1089/tmj.2013.0214 · Cited by 162 · cited 2×
“These findings are encouraging and generally similar to those reported in the handful of studies that have reported usability tests of mHealth tools for youth (Dixon et al., 2013; O’Malley et al., 2014; Pramana et al., 2014; Tang et al., 2013).”
BackgroundResultA meta-analytic review on the prevention of symptoms of anxiety in children and adolescents
(2011) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2011.07.001 · Cited by 154 · cited 1×
“Despite progress, effect sizes for anxiety prevention are relatively small to moderate, often attenuating over time (Fisak, Richard, & Mann, 2011; Teubert & Pinquart, 2011).”
BackgroundPsychopathology of Adolescent Social Phobia
Beidel, D. C., Turner, S. M., Young, B. J., Ammerman, R. T., Sallee, F. R., & Crosby, L. (2007) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/s10862-006-9021-1 · Cited by 138
A pilot test of a tailored mobile and web-based diabetes messaging system for adolescents
Mulvaney, S. A., Anders, S., Smith, A. K., Pittel, E. J., & Johnson, K. B. (2012) · Journal of Telemedicine and Telecare · doi:10.1258/jtt.2011.111006 · Cited by 128
Rapee, R. M., Wignall, A., Sheffield, J., Kowalenko, N., Davis, A., McLoone, J., & Spence, S. H. (2006) · Prevention Science · doi:10.1007/s11121-006-0035-4 · Cited by 87 · cited 1×
“…of Anxiety in Youth, Cognitive and Behavioral Practice (2017), http://dx.doi.org/10.1016/j.cbpra.2016.11.002 Program Scale (RPS; Stigma subscale; Rapee et al., 2006) were slightly modified and combined into one measure to assess the five dimensions of usability outlined by the ISO/IEC and…”
MethodInfluential
Cited by
Bakker, D., & Rickard, N. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.11.016 · Cited by 231
Ramos, G., & Chavira, D. A. (2022) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2019.10.004 · Cited by 143
Gonsalves, P. P., Hodgson, E. S., Kumar, A., Aurora, T., Chandak, Y., Sharma, R., Michelson, D., & Patel, V. (2019) · Frontiers in Public Health · doi:10.3389/fpubh.2019.00238 · Cited by 68
“Local infrastructural limitations, particularly the lack of online functionality, limited design decisions that might harness the full range of benefits of mobile health interventions for this population, such as “on-thego” use to facilitate practice (40, 41) or the ability to connect with other users (12, 31).”
BackgroundMeyer, A. (2022) · Psychophysiology · doi:10.1111/psyp.14050 · Cited by 31
Radomski, A. D., Bagnell, A., Curtis, S., Hartling, L., & Newton, A. S. (2020) · JMIR Mental Health · doi:10.2196/15795 · Cited by 30
“Evaluations of adolescent experiences with various iCBT program delivery and content formats have revealed good program usability (eg, program had few errors and it was easy to learn to use) [21-24], moderate-to-strong credibility (eg, the program contained expert and reliable information), promising treatment expecta…”
Metadata
- Authors
- Stoll, R. D., Pina, A. A., Gary, K., & Amresh, A.
- Venue
- Cognitive and Behavioral Practice
- Publisher
- Elsevier BV
- Published
- 2017-11
- Volume
- 24
- Issue
- 4
- Pages
- 393-404
- ISSN
- 1077-7229 (ISSN-L)
- OpenAlex
- W2574134503
- Cited by
- 64
- References
- 28
- FWCI
- 8.48
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.