The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Artificial Intelligence–Based Chatbot for Anxiety and Depression in University Students: Pilot Randomized Controlled Trial
Open accessPublished version of a preprint
Abstract
Background: Artificial intelligence–based chatbots are emerging as instruments of psychological intervention; however, no relevant studies have been reported in Latin America. Objective: The objective of the present study was to evaluate the viability, acceptability, and potential impact of using Tess, a chatbot, for examining symptoms of depression and anxiety in university students. Methods: This was a pilot randomized controlled trial. The experimental condition used Tess for 8 weeks, and the control condition was assigned to a psychoeducation book on depression. Comparisons were conducted using Mann-Whitney U and Wilcoxon tests for depressive symptoms, and independent and paired sample t tests to analyze anxiety symptoms. Results: The initial sample consisted of 181 Argentinian college students (158, 87.2% female) aged 18 to 33. Data at week 8 were provided by 39 out of the 99 (39%) participants in the experimental condition and 34 out of the 82 (41%) in the control group. On an average, 472 (SD 249.52) messages were exchanged, with 116 (SD 73.87) of the messages sent from the users in response to Tess. A higher number of messages exchanged with Tess was associated with positive feedback (F2,36=4.37; P=.02). No significant differences between the experimental and control groups were found from the baseline to week 8 for depressive and anxiety symptoms. However, significant intragroup differences demonstrated that the experimental group showed a significant decrease in anxiety symptoms; no such differences were observed for the control group. Further, no significant intragroup differences were found for depressive symptoms. Conclusions: The students spent a considerable amount of time exchanging messages with Tess and positive feedback was associated with a higher number of messages exchanged. The initial results show promising evidence for the usability and acceptability of Tess in the Argentinian population. Research on chatbots is still in its initial stages and further research is needed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“When used enough, there can be positive mental health outcomes16–19.”
From Loneliness and suicide mitigation for students using GPT3-enabled chatbots (2024) · cites this paper as [18]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“For instance, the therapeutic AI agents or chatbots identified by our systematic search (i.e., Wysa, Woebot, TEO, Tess, XiaoE, and Sexpert) were effective at delivering self-guided therapy content by communicating intelligently with their users, promoting a significant reduction in mental health symptom severity with high user satisfaction (73, 74, 76–78, 82, 84, 90).”
From Examining the role of AI technology in online mental healthcare: opportunities, challenges, and implications, a mixed-methods review (2024) · cites this paper as [78]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“The NMA considered n=4 RCTs (74, 76–78).”
From Examining the role of AI technology in online mental healthcare: opportunities, challenges, and implications, a mixed-methods review (2024) · cites this paper as [78]
The cited source says what the claim attributes to it.
In the citing paper
“The meta-analysis assessing the impact of AI-augmented interventions for the management of depression symptoms considered n=7 studies (74, 76–78, 80, 84, 90) presenting pre- and post-intervention depression score outcomes.”
From Examining the role of AI technology in online mental healthcare: opportunities, challenges, and implications, a mixed-methods review (2024) · cites this paper as [78]
The cited source says what the claim attributes to it.
In the citing paper
“12 of the included studies (41, 73–83) presented data on treatment dropout, online or remote psychotherapy interventions reported a dropout rate between 0% and 61%, psychoeducation a dropout rate between 4% and 60% and no intervention a dropout rate between 5% and 34%.”
From Examining the role of AI technology in online mental healthcare: opportunities, challenges, and implications, a mixed-methods review (2024) · cites this paper as [78]
7 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,395
The Efficacy of Cognitive Behavioral Therapy: A Review of Meta-analyses
Hofmann, S. G., Asnaani, A., Vonk, I. J. J., Sawyer, A. T., & Fang, A. (2012) · Cognitive Therapy and Research · doi:10.1007/s10608-012-9476-1 · Cited by 3,445
Fitzpatrick, K. K., Darcy, A., & Vierhile, M. (2017) · JMIR Mental Health · doi:10.2196/mental.7785 · Cited by 2,730 · cited 7×
“Currently, there are two chatbots that have addressed anxiety and depressive symptoms, Woebot [6] and Tess [7].”
BackgroundMethodResultInfluentialEysenbach, G. (2005) · Journal of Medical Internet Research · doi:10.2196/jmir.7.1.e11 · Cited by 2,524
Considerations in determining sample size for pilot studies
Hertzog, M. A. (2008) · Research in Nursing & Health · doi:10.1002/nur.20247 · Cited by 2,337
What is Motivational Interviewing?
Rollnick, S., & Miller, W. R. (1995) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s135246580001643x · Cited by 1,737
Internet-Based and Other Computerized Psychological Treatments for Adult Depression: A Meta-Analysis
Andersson, G., & Cuijpers, P. (2009) · Cognitive Behaviour Therapy · doi:10.1080/16506070903318960 · Cited by 1,368
Ten Things that Motivational Interviewing Is Not
Miller, W. R., & Rollnick, S. (2009) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s1352465809005128 · Cited by 1,315
Inkster, B., Sarda, S., & Subramanian, V. (2018) · doi:10.2196/preprints.12106 · Cited by 1,063
Andrews, G., Basu, A., Cuijpers, P., Craske, M. G., McEvoy, P., English, C. L., & Newby, J. M. (2018) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2018.01.001 · Cited by 922
Emotion-focused therapy: Coaching clients to work through their feelings.
Greenberg, L. S. (2002) · doi:10.1037/10447-000 · Cited by 843
Fulmer, R., Joerin, A., Gentile, B., Lakerink, L., & Rauws, M. (2018) · doi:10.2196/preprints.9782 · Cited by 715
Self-citationMohr, D. C., Burns, M. N., Schueller, S. M., Clarke, G., & Klinkman, M. (2013) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2013.03.008 · Cited by 693 · cited 1×
“Behavioral intervention technologies (BITs) are a novel and effective delivery format that can expand the mental health services offered and facilitate early access to those in need [3].”
BackgroundInternet-Delivered Psychological Treatments
Andersson, G. (2016) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-021815-093006 · Cited by 595
Linardon, J., & Fuller-Tyszkiewicz, M. (2020) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000459 · Cited by 573
Newman, M. G., Zuellig, A. R., Kachin, K. E., Constantino, M. J., Przeworski, A., Erickson, T., & Cashman-McGrath, L. (2002) · Behavior Therapy · doi:10.1016/s0005-7894(02)80026-0 · Cited by 553 · cited 2×
“The Generalized Anxiety Disorder Scale (GAD-7) [19] is a 7-item self-reporting scale that evaluates the frequency and severity of anxious thoughts and behaviors during the last 2 weeks.”
BackgroundInfluentialHarrer, M., Adam, S. H., Baumeister, H., Cuijpers, P., Karyotaki, E., Auerbach, R. P., Kessler, R. C., Bruffaerts, R., Berking, M., & Ebert, D. D. (2019) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.1759 · Cited by 445
Heber, E., Ebert, D. D., Lehr, D., Cuijpers, P., Berking, M., Nobis, S., & Riper, H. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.5774 · Cited by 408
Ly, K. H., Ly, A.-M., & Andersson, G. (2017) · Internet Interventions · doi:10.1016/j.invent.2017.10.002 · Cited by 368
Titov, N., Dear, B. F., Johnston, L., Lorian, C., Zou, J., Wootton, B., Spence, J., McEvoy, P. M., & Rapee, R. M. (2013) · PLoS ONE · doi:10.1371/journal.pone.0062873 · Cited by 364 · cited 1×
“The completion rates found in the current study are better than that observed in most unpaid and unsupported Internet-based interventions for depression and anxiety, where 90% of the users withdraw after the first two sessions [25].”
ResultConversational agents in the treatment of mental health problems: mixed-method systematic review
Gaffney, H., Mansell, W., & Tai, S. (2019) · JMIR Mental Health · doi:10.2196/14166 · Cited by 275
Torous, J., Chan, S. R., Yee-Marie Tan, S., Behrens, J., Mathew, I., Conrad, E. J., Hinton, L., Yellowlees, P., & Keshavan, M. (2014) · JMIR Mental Health · doi:10.2196/mental.4004 · Cited by 228
Deady, M., Choi, I., Calvo, R. A., Glozier, N., Christensen, H., & Harvey, S. B. (2017) · BMC Psychiatry · doi:10.1186/s12888-017-1473-1 · Cited by 222
Bendig, E., Erb, B., Schulze-Thuesing, L., & Baumeister, H. (2022) · Verhaltenstherapie · doi:10.1159/000501812 · Cited by 214
Emotion-focused therapy: coaching clients to work through their feelings
(2002) · Choice Reviews Online · doi:10.5860/choice.40-0594 · Cited by 177
Validation and calibration of the patient health questionnaire (PHQ-9) in Argentina
Lanza, M. U., Daray, F. M., Teti, G. L., Coppolillo, F., Herlax, G., Saba, G., Rubinstein, A., Araya, R., & Irazola, V. E. (2019) · BMC Psychiatry · doi:10.1186/s12888-019-2262-9 · Cited by 174
Stephens, T. N., Joerin, A., Rauws, M., & Werk, L. N. (2019) · Translational Behavioral Medicine · doi:10.1093/tbm/ibz043 · Cited by 150
Self-citationSolution-Focused Brief Therapy
Bannink, F. P. (2007) · Journal of Contemporary Psychotherapy · doi:10.1007/s10879-006-9040-y · Cited by 129
Gaffney, H., Mansell, W., Edwards, R., & Wright, J. (2014) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s135246581300060x · Cited by 122 · cited 1×
“Other examples of chatbots with empirical support are Manage Your Life Online (MYLO) that focuses on problem solving [8]; Shim, for well-being based on the cognitive behavioral approach and elements of positive psychology [9]; Tess for pediatric obesity and prediabetes treatment [10]; and Wysa, a chatbot that uses cog…”
BackgroundArtificial Intelligence Chatbot for Depression: Descriptive Study of Usage.
Dosovitsky, G., Pineda, B. S., Jacobson, N. C., Chang, C., Escoredo, M., & Bunge, E. L. (2020) · JMIR Formative Research · doi:10.2196/17065 · Cited by 118 · cited 1×
“57) of messages sent to Tess by adult users [27].”
BackgroundCía, A. H., Stagnaro, J. C., Aguilar‐Gaxiola, S., Vommaro, H., Loera, G., Medina‐Mora, M. E., Sustas, S. E., Benjet, C. L., & Kessler, R. C. (2018) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-018-1492-3 · Cited by 82
Blow, A. J., Curtis, A. F., Wittenborn, A. K., & Gorman, L. A. (2015) · Contemporary Family Therapy · doi:10.1007/s10591-015-9345-7 · Cited by 45
Cognitive Behavior Therapy, Basics and Beyond, Second Edition
Davidson, J. (2013) · Journal of Psychiatric Practice · doi:10.1097/01.pra.0000432605.83964.85 · Cited by 33
Inventario de Estilos de Pensamiento: Propiedades psicométricas en universitarios de Buenos Aires
Consejo Nacional de Investigaciones Científicas y Técnicas (CONICET), A., Hoffmann, A. F., Facultad de Psicología, U. D. B. A., Uriel, F., Facultad de Psicología, U. D. B. A., Fernández, R., Facultad de Psicología, U. D. B. A., Liporace, M. F., & Consejo Nacional de Investigaciones Científicas y Técnicas (CONICET), A. F. D. P. (2019) · Interacciones Revista de Avances en Psicología · doi:10.24016/2019.v5n2.165 · Cited by 22
The (Ir)Responsibility of (Under)Estimating Missing Data
Fernández, P., Vallejo, G., Livacic-Rojas, P. E., & Herrero, E. T. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.00556 · Cited by 20
Mira, A., Farfallini, L., Baños, R., Bretón-López, J. M., & Botella, C. (2016) · Psicodebate · doi:10.18682/pd.v16i2.597 · Cited by 11
Research works printed but not linked: 4
- 10.2196/mental.9782 · doi:10.2196/mental.9782 · Paper page
- 10.2196/12106 · doi:10.2196/12106 · Paper page
- 2013, IBM SPSS Statistics for Windows, Version 22
- Tomczak, M, 2014, Trends in Sport Sciences, 1, 19
Cited by
Li, H., Zhang, R., Lee, Y.-C., Kraut, R. E., & Mohr, D. C. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00979-5 · Cited by 598
Do AI chatbots improve students learning outcomes? Evidence from a meta‐analysis
Wu, R., & Yu, Z. (2024) · British Journal of Educational Technology · doi:10.1111/bjet.13334 · Cited by 576
The impact of ChatGPT on higher education
Dempere, J., Modugu, K., Hesham, A., & Ramasamy, L. K. (2023) · Frontiers in Education · doi:10.3389/feduc.2023.1206936 · Cited by 519
Artificially intelligent chatbots in digital mental health interventions: a review
Boucher, E. M., Harake, N. R., Ward, H. E., Stoeckl, S. E., Vargas, J., Minkel, J., Parks, A. C., & Zilca, R. (2021) · Expert Review of Medical Devices · doi:10.1080/17434440.2021.2013200 · Cited by 440
“in the control group, who read a psychoeducational book on depression [109].”
BackgroundArtificial intelligence applications in Latin American higher education: a systematic review
Salas-Pilco, S. Z., & Yang, Y. (2022) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-022-00326-w · Cited by 330
“Chatbots are also being used to detect anxiety and depressive symptoms in students and address delays associated with access to treatment (Klos et al., 2021).”
Background
Metadata
- Authors
- Klos, M. C., Escoredo, M., Joerin, A., Lemos, V. N., Rauws, M., & Bunge, E. L.
- Affiliations
- xAI (United States) (US)
- Consejo Nacional de Investigaciones Científicas y Técnicas (AR)
- Palo Alto University (US)
- ORCID
- Venue
- JMIR Formative Research
- Publisher
- JMIR Publications Inc.
- Published
- 2021-08-12
- Volume
- 5
- Issue
- 8
- Pages
- e20678
- ISSN
- 2561-326X (ISSN-L)
- PMC
- PMC8391753
- OpenAlex
- W3171455429
- Cited by
- 200
- References
- 36
- Citations by year
- 2026: 38 · 2025: 66 · 2024: 51 · 2023: 31 · 2022: 12 · 2021: 2
- FWCI
- 21.55
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Formative Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Conicet (submittedVersion, cc-by-nc-sa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Keywords
- chatbots, depression, anxiety, university students, digital mental health interventions, acceptability, usability, psychoeducation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
