A Chatbot to Support Young People During the COVID-19 Pandemic in New Zealand: Evaluation of the Real-World Rollout of an Open Trial
Open accessThe DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
Background: The number of young people in New Zealand (Aotearoa) who experience mental health challenges is increasing. As those in Aotearoa went into the initial COVID-19 lockdown, an ongoing digital mental health project was adapted and underwent rapid content authoring to create the Aroha chatbot. This dynamic digital support was designed with and for young people to help manage pandemic-related worry. Objective: Aroha was developed to provide practical evidence-based tools for anxiety management using cognitive behavioral therapy and positive psychology. The chatbot included practical ideas to maintain social and cultural connection, and to stay active and well. Methods: Stay-at-home orders under Aotearoa’s lockdown commenced on March 20, 2020. By leveraging previously developed chatbot technology and broader existing online trial infrastructure, the Aroha chatbot was launched promptly on April 7, 2020. Dissemination of the chatbot for an open trial was via a URL, and feedback on the experience of the lockdown and the experience of Aroha was gathered via online questionnaires and a focus group, and from community members. Results: In the 2 weeks following the launch of the chatbot, there were 393 registrations, and 238 users logged into the chatbot, of whom 127 were in the target age range (13-24 years). Feedback guided iterative and responsive content authoring to suit the dynamic situation and motivated engineering to dynamically detect and react to a range of conversational intents. Conclusions: The experience of the implementation of the Aroha chatbot highlights the feasibility of providing timely event-specific digital mental health support and the technology requirements for a flexible and enabling chatbot architectural framework.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“There were also several CBT based studies [54,55,58,59,61-65], as well as mixed hybrid CBD studies involving other techniques such as combined CBT with dialectical behavior therapy (DBT) [65] and combined mindfulness with CBT [62,64].”
From Psychological Interventions and Those With Elements of Positive Psychology for Child and Youth Mental Health During the COVID-19 Pandemic: Literature Review, Lessons Learned, and Areas for Future Knowledge Dissemination (2024) · cites this paper as [55]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Almost all of interventions were digital, with the majority being delivered through a web-based mobile health app-based platform [45-47,49-56,58-68,70-73,76,79-82].”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ELIZA—a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1966) · Communications of the ACM · doi:10.1145/365153.365168 · Cited by 4,452 · cited 1×
“A dialog agent or “chatbot” style interaction for digital mental health has attracted interest since Eliza in the 1960s [11], even though its imitation of a psychotherapist through the simple linguistic token manipulation that was possible at the time was limited.”
Mental health of young people: A global public-health challenge
Patel, V., Flisher, A. J., Hetrick, S., & McGorry, P. (2007) · The Lancet · doi:10.1016/s0140-6736(07)60368-7 · Cited by 3,126 · cited 2×
“The COVID-19 pandemic has ongoing impacts on young people in terms of the transition from education to vocation [4-6], and in the context of developmental changes and emergence to adulthood [1].”
Self-citationFitzpatrick, K. K., Darcy, A., & Vierhile, M. (2017) · JMIR Mental Health · doi:10.2196/mental.7785 · Cited by 2,730 · cited 2×
“In the case of Aroha, we initially used techniques drawn from CBT and positive psychology, and integrated in a bicultural context, which have been shown to be efficacious across many groups and via conversational agents [12,29].”
Gratitude and well-being: A review and theoretical integration
Wood, A. M., Froh, J. J., & Geraghty, A. W. A. (2010) · Clinical Psychology Review · doi:10.1016/j.cpr.2010.03.005 · Cited by 2,121
Mental health effects of school closures during COVID-19
Lee, J. (2020) · The Lancet Child & Adolescent Health · doi:10.1016/s2352-4642(20)30109-7 · Cited by 1,882
Conversational agents in healthcare: a systematic review
Laranjo, L., Dunn, A. G., Tong, H. L., Kocaballi, A. B., Chen, J., Bashir, R., Surian, D., Gallego, B., Magrabi, F., Lau, A. Y. S., et al. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy072 · Cited by 1,388 · cited 1×
“A systematic review of conversational agents in health care found mental health to be the most common area of application [13].”
Mental Health Smartphone Apps: Review and Evidence-Based Recommendations for Future Developments
Bakker, D., Kazantzis, N., Rickwood, D., & Rickard, N. (2016) · JMIR Mental Health · doi:10.2196/mental.4984 · Cited by 886
The design and implementation of Xiaoice, an empathetic social chatbot
Zhou, L., Gao, J., Li, D., & Shum, H.-Y. (2020) · Computational Linguistics · doi:10.1162/coli_a_00368 · Cited by 777
The Design and Implementation of XiaoIce, an Empathetic Social Chatbot
Zhou, L., Gao, J., Li, D., & Shum, H.-Y. (2018) · arXiv · doi:10.48550/arxiv.1812.08989 · Cited by 777
Merry, S. N., Stasiak, K., Shepherd, M., Frampton, C., Fleming, T., & Lucassen, M. F. G. (2012) · BMJ · doi:10.1136/bmj.e2598 · Cited by 716
Research works printed but not linked: 1
- Webb, S, 2020, Rapid Evidence Brief: COVID-19 Youth Recovery Plan 2020–2022
Cited by
Yuan, A., Colato, E. G., Pescosolido, B. A., Song, H., & Samtani, S. (2024) · ACM Transactions on Management Information Systems · doi:10.1145/3701041 · Cited by 107
Limpanopparat, S., Gibson, E., & Harris, A. (2024) · Computers in Human Behavior Artificial Humans · doi:10.1016/j.chbah.2024.100081 · Cited by 101
Use of automated conversational agents in improving young population mental health: a scoping review
Balan, R., Dobrean, A., & Poetar, C. R. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01072-1 · Cited by 56
“Anxiety was the most frequent targeted emotional component of mental health by automated CAs ( n = 12) 8,10,12,27,33,35,37,38,41 – 43 , 45 .”
InfluentialMosadeghrad, A. M., Afshari, M., Isfahani, P., Ezzati, F., Abbasi, M., Farahani, S. A., Zahmatkesh, M., & Eslambolchi, L. (2024) · BMC Health Services Research · doi:10.1186/s12913-024-11278-4 · Cited by 34
Cho, Y., Rai, S., Ungar, L., Sedoc, J., & Guntuku, S. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.698 · Cited by 33
Park, J., Singh, V. K., & Wiśniewski, P. (2024) · JMIR Medical Informatics · doi:10.2196/62758 · Cited by 39
Therapy and Emotional Support through a Chatbot
Andrade-Arenas, L., Yactayo-Arias, C., & Pucuhuayla-Revatta, F. (2024) · International Journal of Online and Biomedical Engineering (iJOE) · doi:10.3991/ijoe.v20i02.45377 · Cited by 15
Xie, Z. (2025) · Social Media + Society · doi:10.1177/20563051251323391 · Cited by 18
Orpin, J., Rodriguez, A., Harrop, D., Mills, E., Campbell, F., Martin‐Kerry, J., Turner, J., Horsman, J. M., Painter, J., Julian, M., et al. (2023) · Journal of Child Health Care · doi:10.1177/13674935231184919 · Cited by 17
Kang, A., Hetrick, S. E., Cargo, T., Hopkins, S. A., Ludin, N. M., Bodmer, S., Stevenson, K., Holt‐Quick, C., & Stasiak, K. (2023) · JMIR Formative Research · doi:10.2196/44556 · Cited by 17
Self-citationLyzwinski, L., Zwicker, J. D., Mcdonald, S., & Tough, S. (2024) · JMIR Pediatrics and Parenting · doi:10.2196/59171 · Cited by 7
“Of the studies that demonstrated effectiveness, one was a multicomponent positive psychological intervention [53], several were mindfulness-based interventions [43,52,64,66,70,72,82] as well as CBT based [54,55,58,59,63,64,73,74,77].”
BackgroundMaessen, S. E., Taylor, B. J., Gillon, G. T., Barnes, H. M., Firestone, R. T., Taylor, R. W., Milne, B. J., Hetrick, S. E., Cargo, T., McNeill, B., et al. (2023) · Journal of the Royal Society of New Zealand · doi:10.1080/03036758.2023.2173257 · Cited by 6
Self-citationHelpBot: A Web-Based Chatbot to Handle Depression Among Adolescents
Jusoh, S., Alfawareh, H. M., Kadir, R. A., & Hosseinzadeh, H. (2024) · International Conference on Computing and Artificial Intelligence (ICCAI) · doi:10.1145/3669754.3669777 · Cited by 5
Conversational agents for Children's mental health and mental disorders: A scoping review
Martin, R., & Richmond, S. (2023) · Computers in Human Behavior Artificial Humans · doi:10.1016/j.chbah.2023.100028 · Cited by 7
Ferland, L., Owan, R., Kunkel, Z., Qu, H., Gini, M. L., & Koutstaal, W. (2025) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3725738 · Cited by 3
Ng, J., Crawford, J., Ng, J. W., & Razali, M. S. (2025) · Young Consumers Insight and Ideas for Responsible Marketers · doi:10.1108/yc-10-2024-2305 · Cited by 6
Friend or Therapist? A Systematic Literature Review on Chatbots and Mental Health in Young People
Hashmati, N., Skoog, T., Obaid, M., & Eriksson, T. (2026) · doi:10.1145/3780045.3780052 · Cited by 3
Madera, F., Nicodemo, G., Guasco, S., Ciulli, T., & Cardinali, P. (2026) · European Psychologist · doi:10.1027/1016-9040/a000580 · Cited by 2
Chatbots and COVID-19: Taking Stock of the Lessons Learned
Arnold, V., Purnat, T. D., Marten, R., Pattison, A. B., & Gouda, H. (2024) · Journal of Medical Internet Research · doi:10.2196/54840 · Cited by 7
Chatbots and virtual health assistants in patient counseling
Patne, A. Y., Suryawanshi, M. V., & Vinchurkar, K. (2025) · Elsevier eBooks · doi:10.1016/b978-0-443-43823-3.00003-0 · Cited by 2
Ludin, N. M., Prescott, A. E., Martínez-García, A., Bodmer, S., Stevenson, K., Allen, N., Sharma, V., Davies, N., Hopkins, S. A., Stasiak, K., et al. (2025) · Mental Health & Prevention · doi:10.1016/j.mhp.2025.200469 · Cited by 1
Self-citationPrescott, A. E., Wereta, S., Newnham-Scarth, F., Hetrick, S. E., Holt‐Quick, C., Ludin, N. M., Fortune, S. A., Cargo, T., & Scarth, B. (2026) · Mental Health & Prevention · doi:10.1016/j.mhp.2026.200482 · Cited by 1
Self-citationLiu, Y., Sang, T., Shu, W.-T., Qiu, Q., & Hu, Y. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2540060
Babbott, K. M., Grover, E., Boggiss, A. L., Thabrew, H., & Serlachius, A. S. (2026) · Journal of Primary Health Care · doi:10.1071/hc25132
Scoping Review: Intervention Methods in Conversational Agent-Based Cognitive Behavioral Therapy
Striegl, J., Butz, N., & Loitsch, C. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-29842-3_16
dos Santos, L. L., Matos, B. L., & Silva-Calpa, G. F. M. (2026) · Journal on Interactive Systems · doi:10.5753/jis.2026.6787
Sepadi, M. D. (2026) · Frontiers in Education · doi:10.3389/feduc.2026.1874952
Explaining value creation in mental health IT configurations: An integrated framework
Olivera, W., Mathiassen, L., Baird, A. M., & Xia, Y. (2026) · Information & Management · doi:10.1016/j.im.2026.104451
Metadata
- Authors
- Ludin, N., Holt-Quick, C., Hopkins, S., Stasiak, K., Hetrick, S., Warren, J., & Cargo, T.
- Affiliations
- University of Auckland (NZ)
- Corresponding author
- Warren, Jim
- ORCID
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2022-11-04
- Volume
- 24
- Issue
- 11
- Pages
- e38743
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC9640203
- OpenAlex
- W4304758258
- Cited by
- 28
- References
- 24
- Citations by year
- 2026: 8 · 2025: 6 · 2024: 9 · 2023: 5
- FWCI
- 4.42
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- Ministry of Business, Innovation and Employment (UOAX1511)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Clinical Psychology › COVID-19 and Mental Health
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Keywords
- chatbots, youth mental health, COVID-19 pandemic, lockdown, anxiety reduction, cognitive behavioral therapy, positive psychology, digital mental health interventions, chatbot architecture, New Zealand
- MeSH terms
- COVID-19, Adolescent, Mental Disorders, Communicable Disease Control, Humans, New Zealand, Young Adult, Pandemics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.