A Chatbot-Delivered Stress Management Coaching for Students (MISHA App): Pilot Randomized Controlled Trial
Open accessThe DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
Abstract
Background: Globally, students face increasing mental health challenges, including elevated stress levels and declining well-being, leading to academic performance issues and mental health disorders. However, due to stigma and symptom underestimation, students rarely seek effective stress management solutions. Conversational agents in the health sector have shown promise in reducing stress, depression, and anxiety. Nevertheless, research on their effectiveness for students with stress remains limited. Objective: This study aims to develop a conversational agent–delivered stress management coaching intervention for students called MISHA and to evaluate its effectiveness, engagement, and acceptance. Methods: In an unblinded randomized controlled trial, Swiss students experiencing stress were recruited on the web. Using a 1:1 randomization ratio, participants (N=140) were allocated to either the intervention or waitlist control group. Treatment effectiveness on changes in the primary outcome, that is, perceived stress, and secondary outcomes, including depression, anxiety, psychosomatic symptoms, and active coping, were self-assessed and evaluated using ANOVA for repeated measure and general estimating equations. Results: The per-protocol analysis revealed evidence for improvement of stress, depression, and somatic symptoms with medium effect sizes (Cohen d=−0.36 to Cohen d=−0.60), while anxiety and active coping did not change (Cohen d=−0.29 and Cohen d=0.13). In the intention-to-treat analysis, similar results were found, indicating reduced stress (β estimate=−0.13, 95% CI −0.20 to −0.05; P<.001), depressive symptoms (β estimate=−0.23, 95% CI −0.38 to −0.08; P=.003), and psychosomatic symptoms (β estimate=−0.16, 95% CI −0.27 to −0.06; P=.003), while anxiety and active coping did not change. Overall, 60% (42/70) of the participants in the intervention group completed the coaching by completing the postintervention survey. They particularly appreciated the quality, quantity, credibility, and visual representation of information. While individual customization was rated the lowest, the target group fitting was perceived as high. Conclusions: Findings indicate that MISHA is feasible, acceptable, and effective in reducing perceived stress among students in Switzerland. Future research is needed with different populations, for example, in students with high stress levels or compared to active controls. Trial Registration: German Clinical Trials Register DRKS 00030004; https://drks.de/search/en/trial/DRKS00030004
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007) · Behavior Research Methods · doi:10.3758/bf03193146 · Cited by 65,971
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
Löwe, B., Decker, O., Müller, S., Brähler, E., Schellberg, D., Herzog, W., & Herzberg, P. Y. (2008) · Medical Care · doi:10.1097/mlr.0b013e318160d093 · Cited by 4,527 · cited 1×
“The Generalized Anxiety Disorder-7 is a 7-item questionnaire that measures anxiety symptoms [71].”
BackgroundSchwarzer, R. (2008) · Applied Psychology · doi:10.1111/j.1464-0597.2007.00325.x · Cited by 2,569
Eysenbach, G. (2005) · Journal of Medical Internet Research · doi:10.2196/jmir.7.1.e11 · Cited by 2,524 · cited 1×
“Furthermore, participants might discontinue using the intervention upon achieving their personal goals, indicating that nonuse is not due to loss of interest [83,84].”
BackgroundAuerbach, R. P., Collaborators, W. W.-I., Mortier, P., Bruffaerts, R., Alonso, J., Benjet, C., Cuijpers, P., Demyttenaere, K., Ebert, D. D., Green, J. G., et al. (2018) · Journal of Abnormal Psychology · doi:10.1037/abn0000362 · Cited by 2,522 · cited 1×
“Younger individuals, particularly students [3-7], are experiencing a decline in mental health on a global scale [8,9].”
BackgroundThe prevalence and correlates of depression, anxiety, and stress in a sample of college students
Beiter, R., Nash, R., McCrady, M., Rhoades, D., Linscomb, M., Clarahan, M., & Sammut, S. (2015) · Journal of Affective Disorders · doi:10.1016/j.jad.2014.10.054 · Cited by 2,030 · cited 3×
“Chronic stress is closely related to mental illnesses such as anxiety disorders and depression, leading to various symptoms such as sleep disturbances, pain, dizziness, cardiovascular and digestive problems, as well as fatigue [1,2].”
BackgroundResultMental health problems and help-seeking behavior among college students
Hunt, J., & Eisenberg, D. (2010) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2009.08.008 · Cited by 1,949
Persuasive System Design Does Matter: a Systematic Review of Adherence to Web-based Interventions
Kelders, S. M., Kok, R. N., Ossebaard, H. C., & Van Gemert-Pijnen, J. E. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.2104 · Cited by 1,308 · cited 1×
“The extent to which a participant has to engage with the intervention to derive the maximum benefits is termed intended use [80].”
BackgroundPerski, O., Blandford, A., West, R., & Michie, S. (2017) · Translational Behavioral Medicine · doi:10.1007/s13142-016-0453-1 · Cited by 1,193
Chatbots and Conversational Agents in Mental Health: A Review of the Psychiatric Landscape
Vaidyam, A. N., Wisniewski, H., Halamka, J. D., Kashavan, M. S., & Torous, J. B. (2019) · The Canadian Journal of Psychiatry · doi:10.1177/0706743719828977 · Cited by 1,048 · cited 2×
“…of CAs in various health domains [37,38], including promoting physical activity [39]; managing pain [40]; reducing substance abuse [41,42]; improving depression, distress, and stress [43]; enhancing general wellness and pain [44]; and facilitating self-adherence and psychoeducation [38].”
BackgroundInterventions to reduce stress in university students: A review and meta-analysis
Regehr, C., Glancy, D., & Pitts, A. (2013) · Journal of Affective Disorders · doi:10.1016/j.jad.2012.11.026 · Cited by 956
Development and validation of the user version of the Mobile application rating scale (uMARS)
Stoyanov, S. R., Hides, L., Kavanagh, D. J., & Wilson, H. (2016) · JMIR mhealth and uhealth · doi:10.2196/mhealth.5849 · Cited by 872 · cited 1×
“We evaluated the feasibility and acceptance of MISHA using the user version of the Mobile App Rating Scale (uMARS) [86] after the intervention.”
Lattie, E. G., Adkins, E. C., Winquist, N., Stiles-Shields, C., Wafford, Q. E., & Graham, A. K. (2019) · Journal of Medical Internet Research · doi:10.2196/12869 · Cited by 843 · cited 1×
“A systematic review confirmed that digital interventions for the enhancement of mental well-being among college students can be effective in improving depression, anxiety, and mental well-being [98].”
BackgroundKlein, E. M., Brähler, E., Dreier, M., Reinecke, L., Müller, K. W., Schmutzer, G., Wölfling, K., & Beutel, M. E. (2016) · BMC Psychiatry · doi:10.1186/s12888-016-0875-9 · Cited by 716 · cited 1×
“To measure the effectiveness of the program, we assessed perceived stress at preintervention (T1) and postintervention (T2) time points using the German version of the Perceived Stress Scale, a self-report questionnaire consisting of 10 items [68].”
MethodArtificial Intelligence-Based Chatbots for Promoting Health Behavioral Changes: Systematic Review.
Aggarwal, A., Tam, C. C., Wu, D., Li, X., & Qiao, S. (2023) · Journal of medical Internet research · doi:10.2196/40789 · Cited by 683 · cited 1×
“Research highlights the critical issue of inadequate transparency in data input and algorithms, undermining the reliability and validity of results [107,109].”
BackgroundLinardon, J., & Fuller-Tyszkiewicz, M. (2020) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000459 · Cited by 573
Conversational Agents in Health Care: Scoping Review and Conceptual Analysis
Tudor Car, L., Dhinagaran, D. A., Kyaw, B. M., Kowatsch, T., Joty, S., Theng, Y.-L., & Atun, R. (2020) · Journal of Medical Internet Research · doi:10.2196/17158 · Cited by 553
Self-citationTorous, J., Lipschitz, J., Ng, M., & Firth, J. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.11.167 · Cited by 546
Munder, T., Wilmers, F., Leonhart, R., Linster, H. W., & Barth, J. (2010) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.658 · Cited by 538
Abd-Alrazaq, A. A., Rababeh, A., Alajlani, M., Bewick, B. M., & Househ, M. (2020) · Journal of Medical Internet Research · doi:10.2196/16021 · Cited by 503 · cited 1×
“…of CAs in various health domains [37,38], including promoting physical activity [39]; managing pain [40]; reducing substance abuse [41,42]; improving depression, distress, and stress [43]; enhancing general wellness and pain [44]; and facilitating self-adherence and psychoeducation [38].”
BackgroundSharma, A., Lin, I. W., Miner, A. S., Atkins, D. C., & Althoff, T. (2023) · Nature Machine Intelligence · doi:10.1038/s42256-022-00593-2 · Cited by 500
Standalone smartphone apps for mental health—a systematic review and meta-analysis
Weisel, K. K., Fuhrmann, L. M., Berking, M., Baumeister, H., Cuijpers, P., & Ebert, D. D. (2019) · npj Digital Medicine · doi:10.1038/s41746-019-0188-8 · Cited by 447 · cited 1×
“A meta-analysis by Weisel et al [28] highlighted the advantages of apps, including location and time independence, reduced stigmatization, and low costs [29].”
MethodStade, E. C., Stirman, S. W., Ungar, L. H., Boland, C. L., Schwartz, H. A., Yaden, D. B., Sedoc, J., DeRubeis, R. J., Willer, R., & Eichstaedt, J. C. (2024) · npj Mental Health Research · doi:10.1038/s44184-024-00056-z · Cited by 391 · cited 1×
“While in the future, LLM-based interventions may be able to deliver more complex interventions in the field of psychology, it is crucial to consider the potential risk and limitations of implementing these technologies [110].”
BackgroundLy, K. H., Ly, A.-M., & Andersson, G. (2017) · Internet Interventions · doi:10.1016/j.invent.2017.10.002 · Cited by 368
Sieverink, F., Kelders, S. M., & van Gemert-Pijnen, J. E. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.8578 · Cited by 331 · cited 2×
“This definition was based on the fact that participants may have varied goals and desired outcomes, leading to differences in their use of MISHA’s features, including frequency and duration [81,82].”
BackgroundDepression and suicide ideation among students accessing campus health care
Mackenzie, S., Wiegel, J. R., Mundt, M., Brown, D., Saewyc, E., Heiligenstein, E., Harahan, B., & Fleming, M. (2011) · American Journal of Orthopsychiatry · doi:10.1111/j.1939-0025.2010.01077.x · Cited by 323
Survey of conversational agents in health
Montenegro, J. L. Z., da Costa, C. A., & da Rosa Righi, R. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.03.054 · Cited by 322 · cited 1×
“Natural language processing and LLM enable the CA to interpret user inputs more dynamically with increased natural interactions [105,106].”
BackgroundLiu, H., Peng, H., Song, X., Xu, C., & Zhang, M. (2022) · Internet Interventions · doi:10.1016/j.invent.2022.100495 · Cited by 296 · cited 2×
“Furthermore, a previous study evaluating an artificial intelligence (AI)–based chatbot that provided self-help interventions for students to reduce depression lacked detailed descriptions of evidence-based intervention designs, leaving uncertainty about the elements implemented [54].”
BackgroundChanging personality traits with the help of a digital personality change intervention
Stieger, M., Flückiger, C., Rüegger, D., Kowatsch, T., Roberts, B. W., & Allemand, M. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2017548118 · Cited by 273
Self-citationSchachner, T., Keller, R., & v Wangenheim, F. (2020) · Journal of Medical Internet Research · doi:10.2196/20701 · Cited by 267 · cited 2×
“Research highlights the critical issue of inadequate transparency in data input and algorithms, undermining the reliability and validity of results [107,109].”
BackgroundProchaska, J. J., Vogel, E. A., Chieng, A., Kendra, M., Baiocchi, M., Pajarito, S., & Robinson, A. (2021) · Journal of Medical Internet Research · doi:10.2196/24850 · Cited by 257 · cited 1×
“…effectiveness of CAs in various health domains [37,38], including promoting physical activity [39]; managing pain [40]; reducing substance abuse [41,42]; improving depression, distress, and stress [43]; enhancing general wellness and pain [44]; and facilitating self-adherence and…”
BackgroundThe Need for a Mental Health Technology Revolution in the COVID-19 Pandemic
Figueroa, C. A., & Aguilera, A. (2020) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2020.00523 · Cited by 227 · cited 1×
“These include the fear of being stigmatized [25], underestimation of the impact of stress, limited availability of therapy options, and high cost, particularly for young people in education [26,27].”
BackgroundResponse to a relational agent by hospital patients with depressive symptoms
Bickmore, T. W., Mitchell, S. E., Jack, B. W., Paasche-Orlow, M. K., Pfeifer, L. M., & O’Donnell, J. (2010) · Interacting with Computers · doi:10.1016/j.intcom.2009.12.001 · Cited by 218
He, Y., Yang, L., Qian, C., Li, T., Su, Z., Zhang, Q., & Hou, X. (2023) · Journal of Medical Internet Research · doi:10.2196/43862 · Cited by 213 · cited 1×
“Conversational agents (CAs), commonly known as chatbots, are designed to simulate humanlike conversations and are increasingly used in clinical and nonclinical settings [34-36].”
BackgroundHauser-Ulrich, S., Künzli, H., Meier-Peterhans, D., & Kowatsch, T. (2020) · JMIR mHealth and uHealth · doi:10.2196/15806 · Cited by 210 · cited 2×
“…the feasibility, acceptance, and effectiveness of CAs in various health domains [37,38], including promoting physical activity [39]; managing pain [40]; reducing substance abuse [41,42]; improving depression, distress, and stress [43]; enhancing general wellness and pain [44]; and facilitating…”
BackgroundMethodSelf-citationLarge language model AI chatbots require approval as medical devices
Gilbert, S., Harvey, H., Melvin, T., Vollebregt, E., & Wicks, P. (2023) · Nature Medicine · doi:10.1038/s41591-023-02412-6 · Cited by 207 · cited 1×
“Although large language model (LLM)–based CAs have recently gained increasing attention [45], they are still subject to basic research in computer science because of several severe shortcomings, such as hallucinations and nonconscious bias, among others [46].”
BackgroundThe digital placebo effect: mobile mental health meets clinical psychiatry
Torous, J., & Firth, J. (2016) · The Lancet Psychiatry · doi:10.1016/s2215-0366(15)00565-9 · Cited by 200
Basic strategies of cognitive behavioral therapy.
Wenzel, A. (2017) · Psychiatric Clinics of North America · doi:10.1016/j.psc.2017.07.001 · Cited by 199 · cited 1×
“The stress management program includes fundamental elements derived from CBT, such as cognitive restructuring, identification, evaluation, and modification of maladaptive thought patterns [65].”
BackgroundLim, S. M., Shiau, C. W. C., Cheng, L. J., & Lau, Y. (2022) · Behavior Therapy · doi:10.1016/j.beth.2021.09.007 · Cited by 163 · cited 1×
“However, to date, CA interventions in the field of mental health are almost entirely rule based [108].”
BackgroundThe Law of Attrition Revisited
Christensen, H., & Mackinnon, A. (2006) · Journal of Medical Internet Research · doi:10.2196/jmir.8.3.e20 · Cited by 161
An Overview of Machine Learning in Chatbots
Suta, P., Lan, X., Wu, B., Mongkolnam, P., & Chan, J. H. (2020) · International Journal of Mechanical Engineering and Robotics Research · doi:10.18178/ijmerr.9.4.502-510 · Cited by 152
Moller, A. C., Merchant, G., Conroy, D. E., West, R., Hekler, E., Kugler, K. C., & Michie, S. (2017) · Journal of Behavioral Medicine · doi:10.1007/s10865-016-9818-7 · Cited by 151 · cited 1×
“This definition was based on the fact that participants may have varied goals and desired outcomes, leading to differences in their use of MISHA’s features, including frequency and duration [81,82].”
BackgroundSun, S., Lin, D., Goldberg, S., Shen, Z., Chen, P., Qiao, S., Brewer, J., Loucks, E., & Operario, D. (2022) · Journal of Counseling Psychology · doi:10.1037/cou0000568 · Cited by 138
Gabrielli, S., Rizzi, S., Bassi, G., Carbone, S., Maimone, R., Marchesoni, M., & Forti, S. (2021) · JMIR mHealth and uHealth · doi:10.2196/27965 · Cited by 125 · cited 2×
“In a study involving CA Atena [53], the overall reduction in anxiety and stress levels may not have been substantial; however, the intervention showed promise in supporting individuals with high stress levels during the COVID-19 pandemic.”
BackgroundResultMak, W. W., Tong, A. C., Yip, S. Y., Lui, W. W., Chio, F. H., Chan, A. T., & Wong, C. C. (2018) · JMIR Mental Health · doi:10.2196/mental.8597 · Cited by 123 · cited 1×
“Studies have demonstrated the positive impact of interventions such as behavioral therapy–based approaches, relaxation and mindfulness exercises, psychoeducation, and time and study management strategies in reducing stress among students [10,18,19].”
Karekla, M., Kasinopoulos, O., Neto, D. D., Ebert, D. D., Van Daele, T., Nordgreen, T., Höfer, S., Oeverland, S., & Jensen, K. L. (2019) · European Psychologist · doi:10.1027/1016-9040/a000349 · Cited by 117 · cited 1×
“Personalization on an individual level is essential in promoting trust, engagement, adherence, and effectiveness to digital health interventions [66,67].”
BackgroundBird, T., Mansell, W., Wright, J., Gaffney, H., & Tai, S. (2018) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s1352465817000820 · Cited by 109 · cited 1×
“Initial findings demonstrate the feasibility, acceptance, and effectiveness of CAs in various health domains [37,38], including promoting physical activity [39]; managing pain [40]; reducing substance abuse [41,42]; improving depression, distress, and stress [43]; enhancing general wellness and…”
BackgroundPreliminary Evaluation of the Engagement and Effectiveness of a Mental Health Chatbot
Daley, K., Hungerbuehler, I., Cavanagh, K., Claro, H. G., Swinton, P. A., & Kapps, M. (2020) · Frontiers in Digital Health · doi:10.3389/fdgth.2020.576361 · Cited by 101 · cited 1×
“A large single-arm study evaluated Viki, an instant-messenger platform-based intervention [96], and found reduced stress and depressive symptoms.”
BackgroundKramer, J.-N., Künzler, F., Mishra, V., Smith, S. N., Kotz, D., Scholz, U., Fleisch, E., & Kowatsch, T. (2020) · Annals of Behavioral Medicine · doi:10.1093/abm/kaaa002 · Cited by 84 · cited 2×
“…findings demonstrate the feasibility, acceptance, and effectiveness of CAs in various health domains [37,38], including promoting physical activity [39]; managing pain [40]; reducing substance abuse [41,42]; improving depression, distress, and stress [43]; enhancing general wellness and pain [44];…”
BackgroundMethodSelf-citationPreventing harm from non-conscious bias in medical generative AI
Hastings, J. (2024) · The Lancet Digital Health · doi:10.1016/s2589-7500(23)00246-7 · Cited by 60
Schulte‐Frankenfeld, P. M., & Trautwein, F. (2022) · Applied Psychology: Health and Well-Being · doi:10.1111/aphw.12328 · Cited by 51 · cited 1×
“Initial evidence suggests that smartphone apps can effectively reduce perceived stress, distress, depression, and anxiety and improve quality of life, psychological health, well-being, and self-regulation among student populations [30-32].”
BackgroundVirtual Humans in Health-Related Interventions: A Meta-Analysis
Ma, T., Sharifi, H., & Chattopadhyay, D. (2019) · Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290607.3312853 · Cited by 37 · cited 1×
“…of CAs in various health domains [37,38], including promoting physical activity [39]; managing pain [40]; reducing substance abuse [41,42]; improving depression, distress, and stress [43]; enhancing general wellness and pain [44]; and facilitating self-adherence and psychoeducation [38].”
BackgroundUlrich, S., Gantenbein, A. R., Zuber, V., Von Wyl, A., Kowatsch, T., & Künzli, H. (2024) · Journal of Medical Internet Research · doi:10.2196/50132 · Cited by 36 · cited 1×
“Hence, we decided to implement an established, safe, and transparent approach to using CAs and used a rule-based CA [39,40,48-51].”
MethodSelf-citationHofmann, F.-H., Sperth, M., & Holm-Hadulla, R. M. (2017) · Psychotherapeut · doi:10.1007/s00278-017-0224-6 · Cited by 32
Cited by
Hua, Y., Siddals, S., Ma, Z., Galatzer‐Levy, I., Xia, W., Hau, C., Na, H., Flathers, M., Linardon, J., Ayubcha, C., et al. (2025) · World Psychiatry · doi:10.1002/wps.21352 · Cited by 117
Zhang, Q., Zhang, R., Xiong, Y., Sui, Y., Tong, C., & Lin, F.-H. (2025) · Journal of Medical Internet Research · doi:10.2196/78238 · Cited by 56
“For example, rule-based chatbots that formulate responses to user queries through a predetermined set of rules without employing any AI algorithms or techniques were excluded (eg [27]).”
Feng, X., Tian, L., Ho, G. W. K., Yorke, J., & Hui, V. (2025) · Journal of Medical Internet Research · doi:10.2196/79850 · Cited by 51
Brill, E., Vinay, R., Nißen, M., Joshi, P., Klöppel, S., & Kowatsch, T. (2025) · JMIR Formative Research · doi:10.2196/66885 · Cited by 5
Self-citation
Metadata
- Authors
- Ulrich, S., Lienhard, N., Künzli, H., & Kowatsch, T.
- Venue
- JMIR mHealth and uHealth
- Publisher
- JMIR Publications Inc.
- Published
- 2024-06-26
- Volume
- 12
- Pages
- e54945
- ISSN
- 2291-5222 (ISSN-L)
- OpenAlex
- W4396611672
- Cited by
- 36
- References
- 56
- FWCI
- 13.07
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.