An Artificial Therapist (Manage Your Life Online) to Support the Mental Health of Youth: Co-Design and Case Series
Open accessThe DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Abstract
Background: The prevalence of child and adolescent mental health issues is increasing faster than the number of services available, leading to a shortfall. Mental health chatbots are a highly scalable method to address this gap. Manage Your Life Online (MYLO) is an artificially intelligent chatbot that emulates the method of levels therapy. Method of levels is a therapy that uses curious questioning to support the sustained awareness and exploration of current problems. Objective: This study aimed to assess the feasibility and acceptability of a co-designed interface for MYLO in young people aged 16 to 24 years with mental health problems. Methods: An iterative co-design phase occurred over 4 months, in which feedback was elicited from a group of young people (n=7) with lived experiences of mental health issues. This resulted in the development of a progressive web application version of MYLO that could be used on mobile phones. We conducted a case series to assess the feasibility and acceptability of MYLO in 13 young people over 2 weeks. During this time, the participants tested MYLO and completed surveys including clinical outcomes and acceptability measures. We then conducted focus groups and interviews and used thematic analysis to obtain feedback on MYLO and identify recommendations for further improvements. Results: Most participants were positive about their experience of using MYLO and would recommend MYLO to others. The participants enjoyed the simplicity of the interface, found it easy to use, and rated it as acceptable using the System Usability Scale. Inspection of the use data found evidence that MYLO can learn and adapt its questioning in response to user input. We found a large effect size for the decrease in participants’ problem-related distress and a medium effect size for the increase in their self-reported tendency to resolve goal conflicts (the proposed mechanism of change) in the testing phase. Some patients also experienced a reliable change in their clinical outcome measures over the 2 weeks. Conclusions: We established the feasibility and acceptability of MYLO. The initial outcomes suggest that MYLO has the potential to support the mental health of young people and help them resolve their own problems. We aim to establish whether the use of MYLO leads to a meaningful reduction in participants’ symptoms of depression and anxiety and whether these are maintained over time by conducting a randomized controlled evaluation trial.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
SUS: A 'Quick and Dirty' Usability Scale
(1996) · Usability Evaluation In Industry · doi:10.1201/9781498710411-35 · Cited by 8,989
Racine, N., McArthur, B. A., Cooke, J. E., Eirich, R., Zhu, J., & Madigan, S. (2021) · JAMA Pediatrics · doi:10.1001/jamapediatrics.2021.2482 · Cited by 2,805 · cited 1×
“Globally, the prevalence of child and adolescent mental health issues has increased during the COVID-19 pandemic, up to a current rate of 1 in 5 [1].”
BackgroundFitzpatrick, K. K., Darcy, A., & Vierhile, M. (2017) · JMIR Mental Health · doi:10.2196/mental.7785 · Cited by 2,730
Behavior: The Control of Perception
Kuhn, A., & Powers, W. T. (1975) · Contemporary Sociology · doi:10.2307/2063243 · Cited by 2,398 · cited 2×
“According to PCT, psychological distress is caused by conflicting goals or values within an individual, and these internal conflicts lead the individual to experience loss of control, which manifests as psychological distress [33].”
BackgroundInkster, B., Sarda, S., & Subramanian, V. (2018) · doi:10.2196/preprints.12106 · Cited by 1,063
Chatbots and Conversational Agents in Mental Health: A Review of the Psychiatric Landscape
Vaidyam, A. N., Wisniewski, H., Halamka, J. D., Kashavan, M. S., & Torous, J. B. (2019) · The Canadian Journal of Psychiatry · doi:10.1177/0706743719828977 · Cited by 1,048 · cited 4×
“Conversational agents, or chatbots, that use artificial intelligence technology are a promising and fast-growing subset of mental health apps [12,13] that may be more engaging and therefore have higher levels of self-adherence than noninteractive apps [14].”
InfluentialBarlow, D. H., Farchione, T. J., Bullis, J. R., Gallagher, M. W., Murray-Latin, H., Sauer-Zavala, S., Bentley, K. H., Thompson-Hollands, J., Conklin, L. R., Boswell, J. F., et al. (2017) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2017.2164 · Cited by 853 · cited 1×
“Furthermore, universal interventions, both traditional and digital, have been shown to have similar effects on outcomes as their disorder-specific counterparts [30], yet are more flexible and scalable [31].”
BackgroundTorous, J., Nicholas, J., Larsen, M. E., Firth, J., & Christensen, H. (2018) · Evidence Based Mental Health · doi:10.1136/eb-2018-102891 · Cited by 790
Inductive content analysis: A guide for beginning qualitative researchers
Vears, D. F., & Gillam, L. (2022) · Focus on Health Professional Education: A Multi-Professional Journal · doi:10.11157/fohpe.v23i1.544 · Cited by 741
Fulmer, R., Joerin, A., Gentile, B., Lakerink, L., & Rauws, M. (2018) · doi:10.2196/preprints.9782 · Cited by 715
Abd-Alrazaq, A. A., Rababeh, A., Alajlani, M., Bewick, B. M., & Househ, M. (2020) · Journal of Medical Internet Research · doi:10.2196/16021 · Cited by 503 · cited 1×
“A recent review [74] only identified 2 controlled trials of chatbots that gathered information on adverse events during the trial but specifically asked about harms caused by the chatbots [25,75].”
BackgroundArtificially intelligent chatbots in digital mental health interventions: a review
Boucher, E. M., Harake, N. R., Ward, H. E., Stoeckl, S. E., Vargas, J., Minkel, J., Parks, A. C., & Zilca, R. (2021) · Expert Review of Medical Devices · doi:10.1080/17434440.2021.2013200 · Cited by 440 · cited 1×
“However, empirical evidence for the use of chatbots is currently lacking [14,16,17], and many apps are not designed and built according to a robust theoretical basis for a therapeutic paradigm [10,18].”
BackgroundFreeman, D., Haselton, P., Freeman, J., Spanlang, B., Kishore, S., Albery, E., Denne, M., Brown, P., Slater, M., & Nickless, A. (2018) · The Lancet Psychiatry · doi:10.1016/s2215-0366(18)30226-8 · Cited by 377
Ly, K. H., Ly, A.-M., & Andersson, G. (2017) · Internet Interventions · doi:10.1016/j.invent.2017.10.002 · Cited by 368
Chandrashekar, P. (2018) · mHealth · doi:10.21037/mhealth.2018.03.02 · Cited by 359
Co-design of eHealth Interventions With Children and Young People
Thabrew, H., Fleming, T., Hetrick, S., & Merry, S. (2018) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2018.00481 · Cited by 351 · cited 1×
“Of the 30 digital mental health technologies identified by Jones et al [65], only 2 papers reported on the co-design of a mental health chatbot [66,67].”
BackgroundPractitioner review: Co‐design of digital mental health technologies with children and young people
Bevan Jones, R., Stallard, P., Agha, S. S., Rice, S., Werner‐Seidler, A., Stasiak, K., Kahn, J., Simpson, S. A., Alvarez‐Jimenez, M., Rice, F., et al. (2020) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.13258 · Cited by 317 · cited 2×
“Of the 30 digital mental health technologies identified by Jones et al [65], only 2 papers reported on the co-design of a mental health chatbot [66,67].”
BackgroundInsights from user reviews to improve mental health apps
Alqahtani, F., & Orji, R. (2020) · Health Informatics Journal · doi:10.1177/1460458219896492 · Cited by 286 · cited 1×
“Most apps use strategies based on therapy modalities and lack a theoretical underpinning or use >1 strategy or theory [9].”
BackgroundConversational agents in the treatment of mental health problems: mixed-method systematic review
Gaffney, H., Mansell, W., & Tai, S. (2019) · JMIR Mental Health · doi:10.2196/14166 · Cited by 275
Self-citationMorris, R. R., Kouddous, K., Kshirsagar, R., & Schueller, S. M. (2018) · Journal of Medical Internet Research · doi:10.2196/10148 · Cited by 273
Greer, S., Ramo, D., Chang, Y.-J., Fu, M., Moskowitz, J., & Haritatos, J. (2019) · JMIR mHealth and uHealth · doi:10.2196/15018 · Cited by 265 · cited 1×
“Other studies have mostly included student populations [19,24,69], White people [24,70], and women [19,70].”
Hoermann, S., McCabe, K. L., Milne, D. N., & Calvo, R. A. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7023 · Cited by 263 · cited 1×
“Conversational agents, or chatbots, that use artificial intelligence technology are a promising and fast-growing subset of mental health apps [12,13] that may be more engaging and therefore have higher levels of self-adherence than noninteractive apps [14].”
BackgroundTopper, M., Emmelkamp, P. M. G., Watkins, E., & Ehring, T. (2017) · Behaviour Research and Therapy · doi:10.1016/j.brat.2016.12.015 · Cited by 254 · cited 1×
“Many trials have already gathered information on adverse life events that occurred before the trial using a variety of measures [72,73].”
BackgroundKlos, M. C., Escoredo, M., Joerin, A., Lemos, V. N., Rauws, M., & Bunge, E. L. (2021) · JMIR Formative Research · doi:10.2196/20678 · Cited by 200 · cited 1×
“Similarly, researchers found that a higher number of messages exchanged with another artificial intelligence chatbot was associated with more positive feedback [76], and increased engagement led to improvements in symptoms of anxiety and depression [77].”
Potential and Pitfalls of Mobile Mental Health Apps in Traditional Treatment: An Umbrella Review
Koh, J., Tng, G. Y. Q., & Hartanto, A. (2022) · Journal of Personalized Medicine · doi:10.3390/jpm12091376 · Cited by 155
Gaffney, H., Mansell, W., Edwards, R., & Wright, J. (2014) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s135246581300060x · Cited by 122 · cited 4×
“An initial proof-of-concept randomized controlled trial (RCT) compared a single session of a MYLO prototype with a session with ELIZA, a chatbot that uses natural language processing to emulate a human-centered psychotherapist [39] with a university student sample [40].”
BackgroundMethodInfluentialSelf-citationHealth-focused conversational agents in person-centered care: a review of apps
Parmar, P., Ryu, J., Pandya, S., Sedoc, J., & Agarwal, S. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00560-6 · Cited by 113
Exposure and reorganization: The what and how of effective psychotherapy
Carey, T. A. (2011) · Clinical Psychology Review · doi:10.1016/j.cpr.2010.04.004 · Cited by 112 · cited 1×
“Therefore, therapeutic interventions based on PCT aim to sustain a client’s awareness of their problem to explore the conflict until a superordinate goal enters awareness, which is in turn explored to support the effective reorganization and restoration of control [32,37,38].”
BackgroundBird, T., Mansell, W., Wright, J., Gaffney, H., & Tai, S. (2018) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s1352465817000820 · Cited by 109 · cited 2×
“A similar, larger RCT with students and staff of 2 universities in the United Kingdom also found that MYLO was rated by users as more helpful than ELIZA [41].”
Self-citationPreliminary Evaluation of the Engagement and Effectiveness of a Mental Health Chatbot
Daley, K., Hungerbuehler, I., Cavanagh, K., Claro, H. G., Swinton, P. A., & Kapps, M. (2020) · Frontiers in Digital Health · doi:10.3389/fdgth.2020.576361 · Cited by 101
Bennion, M. R., Hardy, G. E., Moore, R. K., Kellett, S., & Millings, A. (2020) · Journal of Medical Internet Research · doi:10.2196/16794 · Cited by 68 · cited 1×
“The retention rate, albeit for a short period, compares favorably with similar studies on mental health chatbots [21,24,62].”
ResultLy, K. H., Dahl, J., Carlbring, P., & Andersson, G. (2012) · SpringerPlus · doi:10.1186/2193-1801-1-11 · Cited by 66 · cited 2×
“The topic guide (Multimedia Appendix 2 [31,54]) was adapted from the study by Gaffney et al [31] to investigate what the participants found helpful and unhelpful regarding MYLO.”
MethodA Smartphone App for Adolescents With Sleep Disturbance: Development of the Sleep Ninja
Werner-Seidler, A., O'Dea, B., Shand, F., Johnston, L., Frayne, A., Fogarty, A. S., & Christensen, H. (2017) · JMIR Mental Health · doi:10.2196/mental.7614 · Cited by 64
Gega, L., Smith, J., & Reynolds, S. (2013) · Psychotherapy Research · doi:10.1080/10503307.2013.766941 · Cited by 47
Pinto, M. D., Greenblatt, A. M., Hickman, R. L., Rice, H. M., Thomas, T. L., & Clochesy, J. M. (2016) · Perspectives in Psychiatric Care · doi:10.1111/ppc.12112 · Cited by 46
Schmitt, J. C., Valiente, R. M., García-Escalera, J., Arnáez, S., Espinosa, V., Sandín, B., & Chorot, P. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19095365 · Cited by 45 · cited 1×
“…to those of a formal mental disorder (based XSL • FO RenderX on the narrow diagnostic criteria of the Diagnostic and Statistical Manual of Mental Disorders [26] or International Classification of Disease systems [27]) or the precise etiological factors driving the symptoms and impairments [28,29].”
Marken, R. S., & Carey, T. A. (2015) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.1919 · Cited by 41 · cited 1×
“Therefore, therapeutic interventions based on PCT aim to sustain a client’s awareness of their problem to explore the conflict until a superordinate goal enters awareness, which is in turn explored to support the effective reorganization and restoration of control [32,37,38].”
BackgroundDomhardt, M., Engler, S., Nowak, H., Lutsch, A., Baumel, A., & Baumeister, H. (2021) · Journal of Medical Internet Research · doi:10.2196/29742 · Cited by 41 · cited 1×
“Therefore, more research is needed to demonstrate the efficacy of conversational agents, including greater transparency and evaluation of the proposed mechanisms of action used [10,22].”
BackgroundThematic Analysis on User Reviews for Depression and Anxiety Chatbot Apps: Machine Learning Approach
Ahmed, A., Aziz, S., Khalifa, M., Shah, U., Hassan, A., Abd-Alrazaq, A., & Househ, M. (2022) · JMIR Formative Research · doi:10.2196/27654 · Cited by 37
Carey, T. A., Kelly, R. E., Mansell, W., & Tai, S. J. (2012) · The Cognitive Behaviour Therapist · doi:10.1017/s1754470x12000037 · Cited by 37 · cited 1×
“These findings are consistent with the theoretical principles of MYLO (PCT), which implies that everyone differs in what external therapeutic conditions allow the internal process of psychological change to occur [78].”
ResultGaffney, H., Mansell, W., & Tai, S. (2020) · Digital Health · doi:10.1177/2055207620911580 · Cited by 26
Cited by
Li, H., Zhang, R., Lee, Y.-C., Kraut, R. E., & Mohr, D. C. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00979-5 · Cited by 598
Hua, Y., Siddals, S., Ma, Z., Galatzer‐Levy, I., Xia, W., Hau, C., Na, H., Flathers, M., Linardon, J., Ayubcha, C., et al. (2025) · World Psychiatry · doi:10.1002/wps.21352 · Cited by 117
Grodniewicz, J. P., & Hohol, M. (2023) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1190084 · Cited by 100
Kuhail, M. A., Al-Shamaileh, O., Farooq, S., Shahin, H., Abdelzaher, F., & Thomas, J. (2025) · Human Behavior and Emerging Technologies · doi:10.1155/hbe2/9942295 · Cited by 11
Metadata
- Authors
- Wrightson-Hester, A.-R., Anderson, G., Dunstan, J., McEvoy, P. M., Sutton, C. J., Myers, B., Egan, S., Tai, S., Johnston-Hollitt, M., Chen, W., Gedeon, T., & Mansell, W.
- Venue
- JMIR Human Factors
- Publisher
- JMIR Publications Inc.
- Published
- 2023-07-21
- Volume
- 10
- Pages
- e46849
- ISSN
- 2292-9495 (ISSN-L)
- OpenAlex
- W4384923078
- Cited by
- 43
- References
- 42
- FWCI
- 10.19
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.