Efficacy of a Web-Based Guided Recommendation Service for a Curated List of Readily Available Mental Health and Well-Being Mobile Apps for Young People: Randomized Controlled Trial
Open accessThe DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Mental disorders are highly prevalent for the people who are aged between 16 and 25 years and can permanently disrupt the development of these individuals. Easily available mobile health (mHealth) apps for mobile phones have great potential for the prevention and early intervention of mental disorders in young adults, but interventions are required that can help individuals to both identify high-quality mobile apps and use them to change health and lifestyle behavior. OBJECTIVES: The study aimed to assess the efficacy of a Web-based self-guided app recommendation service ("The Toolbox") in improving the well-being of young Australians aged between 16 and 25 years. The intervention was developed in collaboration with young adults and consists of a curated list of 46 readily available health and well-being apps, assessed and rated by professionals and young people. Participants are guided by an interactive quiz and subsequently receive recommendations for particular apps to download and use based on their personal goals. METHODS: The study was a waitlist, parallel-arm, randomized controlled trial. Our primary outcome measure was change in well-being as measured by the Mental Health Continuum-Short Form (MHC-SF). We also employed ecological momentary assessments (EMAs) to track mood, energy, rest, and sleep. Participants were recruited from the general Australian population, via several Web-based and community strategies. The study was conducted through a Web-based platform consisting of a landing Web page and capabilities to administer study measures at different time points. Web-based measurements were self-assessed at baseline and 4 weeks, and EMAs were collected repeatedly at regular weekly intervals or ad hoc when participants interacted with the study platform. Primary outcomes were analyzed using linear mixed-models and intention-to-treat (ITT) analysis. RESULTS: A total of 387 participants completed baseline scores and were randomized into the trial. Results demonstrated no significant effect of "The Toolbox" intervention on participant well-being at 4 weeks compared with the control group (P=.66). There were also no significant differences between the intervention and control groups at 4 weeks on any of the subscales of the MHC-SF (psychological: P=.95, social: P=.42, emotional: P=.95). Repeat engagement with the study platform resulted in a significant difference in mood, energy, rest, and sleep trajectories between intervention and control groups as measured by EMAs (P<.01). CONCLUSIONS: This was the first study to assess the effectiveness of a Web-based well-being intervention in a sample of young adults. The design of the intervention utilized expert rating of existing apps and end-user codesign approaches resulting in an app recommendation service. Our finding suggests that recommended readily available mental health and well-being apps may not lead to improvements in the well-being of a nonclinical sample of young people, but might halt a decline in mood, energy, rest, and sleep. TRIAL REGISTRATION: Australian New Zealand Clinical Trials Registry (ANZCTR): ACTRN12614000710628; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=366145 (Archived by WebCite at http://www.webcitation.org/ 6pWDsnKme).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Mental illness and/or mental health? Investigating axioms of the complete state model of health
Keyes, C. L. M. (2005) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.73.3.539 · Cited by 3,357
Mental health of young people: A global public-health challenge
Patel, V., Flisher, A. J., Hetrick, S., & McGorry, P. (2007) · The Lancet · doi:10.1016/s0140-6736(07)60368-7 · Cited by 3,126 · cited 2×
“Adolescence is a crucial developmental stage for the individual and disruption to mental health during this stage can have far-reaching effects, and whose full personal and socioeconomic impact often only becomes apparent at a later stage in life [3].”
Eysenbach, G. (2005) · Journal of Medical Internet Research · doi:10.2196/jmir.7.1.e11 · Cited by 2,524 · cited 1×
“The reason for the greater attrition rate in the intervention group is unclear and, along with many factors associated with the high attrition rates in Web-based interventions, requires further study [32].”
Mobile app rating scale: a new tool for assessing the quality of health mobile apps
Stoyanov, S. R., Hides, L., Kavanagh, D. J., Zelenko, O., Tjondronegoro, D., & Mani, M. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.3422 · Cited by 2,233 · cited 3×
“First, a contextual review of available apps was conducted, followed by a review of these apps according to the MARS [10] by professionals and young people.”
InfluentialSmartphones for smarter delivery of mental health programs: A systematic review
Donker, T., Petrie, K., Proudfoot, J., Clarke, J., Birch, M.-R., & Christensen, H. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2791 · Cited by 1,136 · cited 1×
“Those mobile mental health apps that are based on evidence-based principles and have demonstrated efficacy often have been developed as part of research studies and are not available publically [8].”
Mackenzie, C. S., Gekoski, W. L., & Knox, V. J. (2006) · Aging & Mental Health · doi:10.1080/13607860600641200 · Cited by 878 · cited 1×
“However, differences in help-seeking behavior between males and females likely account for the majority of this difference [28].”
The use of theory in health behavior research from 2000 to 2005: a systematic review
Painter, J. E., Borba, C. P. C., Hynes, M., Mays, D., & Glanz, K. (2008) · Annals of Behavioral Medicine · doi:10.1007/s12160-008-9042-y · Cited by 556
Mobile Health Apps to Facilitate Self-Care: A Qualitative Study of User Experiences
Anderson, K., Burford, O., & Emmerton, L. (2016) · PLOS ONE · doi:10.1371/journal.pone.0156164 · Cited by 502
Review and evaluation of mindfulness-based iPhone apps
Mani, M., Kavanagh, D. J., Hides, L., & Stoyanov, S. R. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.4328 · Cited by 495
Mobile Apps for Bipolar Disorder: A Systematic Review of Features and Content Quality
Nicholas, J., Larsen, M. E., Proudfoot, J., & Christensen, H. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.4581 · Cited by 438 · cited 1×
“Most apps also did not contain source citations or privacy policies, making it difficult for users to assess app quality [6].”
Huckvale, K., Prieto, J. T., Tilney, M., Benghozi, P.-J., & Car, J. (2015) · BMC Medicine · doi:10.1186/s12916-015-0444-y · Cited by 376
Finding a Depression App: A Review and Content Analysis of the Depression App Marketplace
Shen, N., Levitan, M.-J., Johnson, A., Bender, J. L., Hamilton-Page, M., Jadad, A. (. R., & Wiljer, D. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.3713 · Cited by 282 · cited 1×
“In addition, the majority of apps are generally identified and downloaded by users directly from apps stores and the keywords people use when searching for specific health apps do not necessarily yield the most appropriate or effective app [20].”
Moore, R. C., Depp, C. A., Wetherell, J. L., & Lenze, E. J. (2016) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2016.01.011 · Cited by 274 · cited 1×
“To date, there are few studies of well-being interventions utilizing momentary assessments as outcome measures, although their superiority to traditional questionnaire measures has recently been reported [31].”
Quantifying App Store Dynamics: Longitudinal Tracking of Mental Health Apps
Larsen, M. E., Nicholas, J., & Christensen, H. (2016) · JMIR mHealth and uHealth · doi:10.2196/mhealth.6020 · Cited by 177 · cited 1×
“…the content, functionality, and aesthetics of some apps may have changed during the short time from when they were added to “The Toolbox” to when they were accessed by participants, as is common on mobile app marketplaces [33], thus not meeting, or differing significantly from their expectations.”
Bolier, L., Haverman, M., Kramer, J., Westerhof, G. J., Riper, H., Walburg, J. A., Boon, B., & Bohlmeijer, E. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2603 · Cited by 116 · cited 3×
“Whereas there are several randomized controlled trials of the efficacy of Web-based services to improve mental health, previous studies have been conducted in adults with symptoms of anxiety and depression [25,34,35].”
Uptake and usage of IntelliCare: A publicly available suite of mental health and well-being apps
Lattie, E. G., Schueller, S. M., Sargent, E., Stiles-Shields, C., Tomasino, K. N., Corden, M. E., Begale, M., Karr, C. J., & Mohr, D. C. (2016) · Internet Interventions · doi:10.1016/j.invent.2016.06.003 · Cited by 113 · cited 4×
“Disseminating a curated list of mental health and well-being apps for depression and anxiety alone has been recently demonstrated to yield better app uptake [13]; however, ours is the first study to investigate effectiveness of such an intervention.”
InfluentialWhitfield, G., & Williams, C. (2004) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s1352465804001031 · Cited by 83 · cited 1×
“Although technology mediated mental health interventions have frequently been praised for their potential and ease of access, previous research into one-size-fits-all intervention has demonstrated that these interventions have limited appeal and that they have failed to gain traction within health care [4].”
Kramer, J., Conijn, B., Oijevaar, P., & Riper, H. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.3261 · Cited by 69
A web-based adolescent positive psychology program in schools: randomized controlled trial
Burckhardt, R., Manicavasagar, V., Batterham, P. J., Miller, L. M., Talbot, E., & Lum, A. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.4329 · Cited by 67 · cited 1×
“2 years) [25] and under 16-years-old school-based samples [26].”
Cited by
Liverpool, S., Mota, C. P., Sales, C. M. D., Čuš, A., Carletto, S., Hancheva, C., Sousa, S., Cerón, S. C., Moreno-Peral, P., Pietrabissa, G., et al. (2020) · Journal of Medical Internet Research · doi:10.2196/16317 · Cited by 408
State of the Field of Mental Health Apps
Neary, M., & Schueller, S. M. (2018) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2018.01.002 · Cited by 247
Bakker, D., & Rickard, N. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.11.016 · Cited by 231
Bidargaddi, N., Almirall, D., Murphy, S., Nahum-Shani, I., Kovalcik, M., Pituch, T., Maaieh, H., & Strecher, V. (2018) · JMIR mHealth and uHealth · doi:10.2196/10123 · Cited by 189
Self-citationBergin, A. D., Vallejos, E. P., Davies, E. B., Daley, D., Ford, T., Harold, G., Hetrick, S., Kidner, M., Long, Y., Merry, S., et al. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-00339-7 · Cited by 157
Metadata
- Authors
- Bidargaddi, N., Musiat, P., Winsall, M., Vogl, G., Blake, V., Quinn, S., Orlowski, S., Antezana, G., & Schrader, G.
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2017-05-12
- Volume
- 19
- Issue
- 5
- Pages
- e141
- ISSN
- 1438-8871 (ISSN-L)
- OpenAlex
- W2613022057
- Cited by
- 61
- References
- 19
- FWCI
- 4.97
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.