Developing, Implementing, and Evaluating an Artificial Intelligence-Guided Mental Health Resource Navigation Chatbot for Health Care Workers and Their Families During and Following the COVID-19 Pandemic: Protocol for a Cross-sectional Study
Open accessPublished version of a preprint
Abstract
BACKGROUND: Approximately 1 in 3 Canadians will experience an addiction or mental health challenge at some point in their lifetime. Unfortunately, there are multiple barriers to accessing mental health care, including system fragmentation, episodic care, long wait times, and insufficient support for health system navigation. In addition, stigma may further reduce an individual's likelihood of seeking support. Digital technologies present new and exciting opportunities to bridge significant gaps in mental health care service provision, reduce barriers pertaining to stigma, and improve health outcomes for patients and mental health system integration and efficiency. Chatbots (ie, software systems that use artificial intelligence to carry out conversations with people) may be explored to support those in need of information or access to services and present the opportunity to address gaps in traditional, fragmented, or episodic mental health system structures on demand with personalized attention. The recent COVID-19 pandemic has exacerbated even further the need for mental health support among Canadians and called attention to the inefficiencies of our system. As health care workers and their families are at an even greater risk of mental illness and psychological distress during the COVID-19 pandemic, this technology will be first piloted with the goal of supporting this vulnerable group. OBJECTIVE: This pilot study seeks to evaluate the effectiveness of the Mental Health Intelligent Information Resource Assistant in supporting health care workers and their families in the Canadian provinces of Alberta and Nova Scotia with the provision of appropriate information on mental health issues, services, and programs based on personalized needs. METHODS: The effectiveness of the technology will be assessed via voluntary follow-up surveys and an analysis of client interactions and engagement with the chatbot. Client satisfaction with the chatbot will also be assessed. RESULTS: This project was initiated on April 1, 2021. Ethics approval was granted on August 12, 2021, by the University of Alberta Health Research Board (PRO00109148) and on April 21, 2022, by the Nova Scotia Health Authority Research Ethics Board (1027474). Data collection is anticipated to take place from May 2, 2022, to May 2, 2023. Publication of preliminary results will be sought in spring or summer 2022, with a more comprehensive evaluation completed by spring 2023 following the collection of a larger data set. CONCLUSIONS: Our findings can be incorporated into public policy and planning around mental health system navigation by Canadian mental health care providers-from large public health authorities to small community-based, not-for-profit organizations. This may serve to support the development of an additional touch point, or point of entry, for individuals to access the appropriate services or care when they need them, wherever they are. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): PRR1-10.2196/33717.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
AI chatbots facilitate well-designed multimodal conversations that can effectively assist in patient intervention, postoperative support, and psychiatric care.
“Previous studies have revealed that AI chatbots facilitate well-designed multimodal conversations that can effectively assist in a variety of areas such as patient intervention (8), postoperative support (9), and psychiatric care (10)”
From Digital affordances of AI chatbots in nursing education: a systematic review of learning gains and gaps in the evidence (2026) · cites this paper as [10]
The Introduction’s “Opportunities for Health Chatbots” section describes conversational chatbots as promising for mental health care, and “Chatbot Development” describes MIRA’s text and button-based exchanges. But this is a study protocol: the Introduction says evidence of effectiveness for mental health navigation is limited. It does not establish that multimodal conversations effectively assist psychiatric care. The citations for patient intervention and postoperative support are attached to other parts of the sentence. (LLM, conf=0.86)
Experimental — accuracy not yet measuredPrior to the ChatGPT era, several papers described adaptations of AI Chatbots by specific medical disciplines, with promising initial results.
“Prior to the ChatGPT era, several papers described adaptations of AI Chatbots by specific medical disciplines, with promising initial results [35].”
From ChatGPT and the Future of Digital Health: A Study on Healthcare Workers’ Perceptions and Expectations (2023) · cites this paper as [35]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
(2012) · Cited by 9,062 · see citing works
ELIZA—a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1966) · Communications of the ACM · doi:10.1145/365153.365168 · Cited by 4,452 · see citing works
Walker, E. R., McGee, R. E., & Druss, B. G. (2015) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2014.2502 · Cited by 2,976 · see citing works
How mental health care should change as a consequence of the COVID-19 pandemic
Moreno, C., Wykes, T., Galderisi, S., Nordentoft, M., Crossley, N., Jones, N., Cannon, M., Correll, C. U., Byrne, L., Carr, S., et al. (2020) · The Lancet Psychiatry · doi:10.1016/s2215-0366(20)30307-2 · Cited by 1,840 · see citing works
Factors affecting response rates of the web survey: A systematic review
Fan, W., & Yan, Z. (2009) · Computers in Human Behavior · doi:10.1016/j.chb.2009.10.015 · Cited by 1,535 · see citing works
Conversational agents in healthcare: a systematic review
Laranjo, L., Dunn, A. G., Tong, H. L., Kocaballi, A. B., Chen, J., Bashir, R., Surian, D., Gallego, B., Magrabi, F., Lau, A. Y. S., et al. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy072 · Cited by 1,388 · cited 7× · see citing works
“Chatbot performance will also be evaluated based on additional technical measures identified in reflection of other evaluative works within the field of chatbots in health to allow for the cross-comparability of the findings [56,92,95-97], including an analysis of intent classification accuracy scores, entity recognit…”
BackgroundMethodInfluentialPsychological impact of the COVID-19 pandemic on health care workers in Singapore
Tan, B. Y. Q., Chew, N. W. S., Lee, G. K. H., Jing, M., Goh, Y., Yeo, L. L. L., Zhang, K., Chin, H.-K., Ahmad, A., Khan, F. A., et al. (2020) · Annals of Internal Medicine · doi:10.7326/m20-1083 · Cited by 1,279 · see citing works
MORIN, C., LEBLANC, M., DALEY, M., GREGOIRE, J., & MERETTE, C. (2006) · Sleep Medicine · doi:10.1016/j.sleep.2005.08.008 · Cited by 1,191 · see citing works
Comparing Response Rates from Web and Mail Surveys: A Meta-Analysis
Shih, T.-H., & Fan, X. (2008) · Field Methods · doi:10.1177/1525822x08317085 · Cited by 1,159 · see citing works
Chatbots and Conversational Agents in Mental Health: A Review of the Psychiatric Landscape
Vaidyam, A. N., Wisniewski, H., Halamka, J. D., Kashavan, M. S., & Torous, J. B. (2019) · The Canadian Journal of Psychiatry · doi:10.1177/0706743719828977 · Cited by 1,048 · see citing works
Li, Z.-Y., Ge, J., Yang, M.-L., Feng, J., Qiao, M., Jiang, R., Bi, J.-J., Zhan, G.-F., Xu, X.-L., Wang, L., et al. (2020) · medRxiv · doi:10.1016/j.bbi.2020.03.007 · Cited by 1,021 · see citing works
It's only a computer: virtual humans increase willingness to disclose
Lucas, G. M., Gratch, J., King, A., & Morency, L.-P. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2014.04.043 · Cited by 977 · cited 1× · see citing works
“Although further analysis is required in the context of mental health care, research suggests that patients report greater comfort or preference in disclosing sensitive health information to a computer or technological device than to a human [46,47].”
BackgroundFulmer, R., Joerin, A., Gentile, B., Lakerink, L., & Rauws, M. (2018) · doi:10.2196/preprints.9782 · Cited by 715 · see citing works
An overview of the features of chatbots in mental health: A scoping review
Abd-alrazaq, A. A., Alajlani, M., Alalwan, A. A., Bewick, B. M., Gardner, P., & Househ, M. (2019) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2019.103978 · Cited by 605 · see citing works
Cabarkapa, S., Nadjidai, S. E., Murgier, J., & Ng, C. H. (2020) · Brain, Behavior, & Immunity - Health · doi:10.1016/j.bbih.2020.100144 · Cited by 522 · see citing works
Primary Health Care in Canada: Systems in Motion
Hutchison, B. G., Lévesque, J., Strumpf, E., & Coyle, N. (2011) · Milbank Quarterly · doi:10.1111/j.1468-0009.2011.00628.x · Cited by 509 · see citing works
Abd-Alrazaq, A. A., Rababeh, A., Alajlani, M., Bewick, B. M., & Househ, M. (2020) · Journal of Medical Internet Research · doi:10.2196/16021 · Cited by 503 · cited 1× · see citing works
“More specifically, although chatbots currently show promise in a variety of health care settings [52-54], there is limited information on their effectiveness in supporting mental health system navigation [52,55-57].”
BackgroundThe digital revolution and its impact on mental health care
Bucci, S., Schwannauer, M., & Berry, N. (2019) · Psychology and Psychotherapy: Theory, Research and Practice · doi:10.1111/papt.12222 · Cited by 444 · see citing works
Embodied conversational agents in clinical psychology: a scoping review
Provoost, S., Lau, H. M., Ruwaard, J., & Riper, H. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6553 · Cited by 433 · see citing works
Web Versus Other Survey Modes: An Updated and Extended Meta-Analysis Comparing Response Rates
Daikeler, J., Bošnjak, M., & Manfreda, K. L. (2019) · Journal of Survey Statistics and Methodology · doi:10.1093/jssam/smz008 · Cited by 422 · see citing works
Use of Services by Persons With Mental and Addictive Disorders
Narrow, W. E. (1993) · Archives of General Psychiatry · doi:10.1001/archpsyc.1993.01820140017002 · Cited by 390 · see citing works
A randomized controlled trial of an automated exercise coach for older adults
Bickmore, T. W., Silliman, R. A., Nelson, K., Cheng, D. M., Winter, M., Henault, L., & Paasche‐Orlow, M. K. (2013) · Journal of the American Geriatrics Society · doi:10.1111/jgs.12449 · Cited by 305 · cited 1× · see citing works
“Existing evidence supports the use of health chatbots for empowering users to engage in physical activity and consumption of nutritious food and increasing patient access to health information, among other benefits [48-51].”
BackgroundSahebi, A., Nejati-Zarnaqi, B., Moayedi, S., Yousefi, K., Torres, M., & Golitaleb, M. (2021) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2021.110247 · Cited by 293 · see citing works
Release Strategies and the Social Impacts of Language Models
Solaiman, I., Brundage, M., Clark, J., Askell, A., Herbert-Voss, A., Wu, J., Radford, A., Krueger, G., Kim, J. W., Kreps, S., et al. (2019) · arXiv · doi:10.48550/arxiv.1908.09203 · Cited by 292 · see citing works
Insomnia and health problems in Canadians
Sutton, D. A., Moldofsky, H., & Badley, E. M. (2001) · Sleep · doi:10.1093/sleep/24.6.665 · Cited by 207 · see citing works
Automated interventions for multiple health behaviors using conversational agents
Bickmore, T. W., Schulman, D., & Sidner, C. (2013) · Patient Education and Counseling · doi:10.1016/j.pec.2013.05.011 · Cited by 206 · see citing works
Health information seeking behaviour: A concept analysis
Zimmerman, M. S., & Shaw, G. (2020) · Health Information & Libraries Journal · doi:10.1111/hir.12287 · Cited by 198 · see citing works
Watson, A., Bickmore, T., Cange, A., Kulshreshtha, A., & Kvedar, J. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.1629 · Cited by 180 · see citing works
Sunderland, A., & Findlay, L. (2013) · PubMed · Cited by 152 · see citing works
Technical metrics used to evaluate health care chatbots: scoping review
Abd-Alrazaq, A., Safi, Z., Alajlani, M., Warren, J., Househ, M., & Denecke, K. (2020) · Journal of Medical Internet Research · doi:10.2196/18301 · Cited by 150 · see citing works
Automatic Dialogue Generation with Expressed Emotions
Huang, C., Zai͏̈ane, O. R., Trabelsi, A., & Dziri, N. (2018) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n18-2008 · Cited by 146 · see citing works
Self-citationKypri, K., & McAnally, H. M. (2005) · Preventive Medicine · doi:10.1016/j.ypmed.2005.07.010 · Cited by 138 · see citing works
Towards a chatbot for digital counselling
Cameron, G., Cameron, D., Megaw, G., Bond, R., Mulvenna, M. D., O’Neill, S. M., Armour, C., & McTear, M. (2017) · Electronic workshops in computing · doi:10.14236/ewic/hci2017.24 · Cited by 138 · see citing works
Compulsory Substance Abuse Treatment: An Overview of Recent Findings and Issues
Wild, T. C., Roberts, A. B., & Cooper, E. L. (2002) · European Addiction Research · doi:10.1159/000052059 · Cited by 129 · see citing works
Philip, P., Micoulaud-Franchi, J.-A., Sagaspe, P., Sevin, E. D., Olive, J., Bioulac, S., & Sauteraud, A. (2017) · Scientific Reports · doi:10.1038/srep42656 · Cited by 128 · see citing works
Linke, S., Murray, E., Butler, C., & Wallace, P. (2007) · Journal of Medical Internet Research · doi:10.2196/jmir.9.2.e10 · Cited by 127 · see citing works
Advancing health equity with artificial intelligence
Thomasian, N. M., Eickhoff, C., & Adashi, E. Y. (2021) · Journal of Public Health Policy · doi:10.1057/s41271-021-00319-5 · Cited by 117 · see citing works
Strudwick, G., Sockalingam, S., Kassam, I., Sequeira, L., Bonato, S., Youssef, A., Mehta, R., Green, N., Agic, B., Soklaridis, S., et al. (2021) · JMIR Mental Health · doi:10.2196/26550 · Cited by 110 · see citing works
Mossabir, R., Morris, R., Kennedy, A. P., Blickem, C., & Rogers, A. E. (2014) · Health & Social Care in the Community · doi:10.1111/hsc.12176 · Cited by 108 · see citing works
Dankwa-Mullan, I., Scheufele, E. L., Matheny, M. E., Quintana, Y., Chapman, W. W., Jackson, G., & South, B. R. (2021) · Journal of Health Care for the Poor and Underserved · doi:10.1353/hpu.2021.0065 · Cited by 108 · see citing works
Philip, P., Dupuy, L., Auriacombe, M., Serre, F., de Sevin, É., Sauteraud, A., & Micoulaud‐Franchi, J. (2020) · npj Digital Medicine · doi:10.1038/s41746-019-0213-y · Cited by 105 · see citing works
Changes in unmet health care needs.
Sanmartin, C., Houle, C., Tremblay, S., & Berthelot, J. (2002) · PubMed · Cited by 100 · see citing works
Humphreys, K., & Klaw, E. (2001) · Journal of Studies on Alcohol · doi:10.15288/jsa.2001.62.528 · Cited by 98 · see citing works
Making Quality Health Websites a National Public Health Priority: Toward Quality Standards
Devine, T., Broderick, J., Harris, L. M., Wu, H., & Hilfiker, S. W. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5999 · Cited by 98 · see citing works
Assessing the Usability of a Chatbot for Mental Health Care
Cameron, G., Cameron, D., Megaw, G., Bond, R., Mulvenna, M. D., O’Neill, S. M., Armour, C., & McTear, M. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-17705-8_11 · Cited by 92 · see citing works
A path analysis of Internet health information seeking behaviors among older adults
Chang, S. J., & Im, E. (2013) · Geriatric Nursing · doi:10.1016/j.gerinurse.2013.11.005 · Cited by 89 · see citing works
Safe Infant Sleep Recommendations on the Internet: Let's Google It
Chung, M., Oden, R. P., Joyner, B. L., Corley, A. M. S., & Moon, R. Y. (2012) · The Journal of Pediatrics · doi:10.1016/j.jpeds.2012.06.004 · Cited by 81 · see citing works
Ellis, J., Mullan, J., Worsley, A. F., & Pai, N. B. (2012) · International Journal of Family Medicine · doi:10.1155/2012/397039 · Cited by 80 · see citing works
Martínez-Miranda, J., Martínez, A., Ramos, R., Aguilar, H., Jiménez, L., Arias, H., Rosales, G., & Valencia, E. (2019) · Journal of Medical Systems · doi:10.1007/s10916-019-1387-1 · Cited by 79 · see citing works
Use of an interactive computer agent to support breastfeeding
Edwards, R. A., Bickmore, T., Jenkins, L., Foley, M., & Manjourides, J. (2013) · Maternal and Child Health Journal · doi:10.1007/s10995-013-1222-0 · Cited by 63 · see citing works
Valaitis, R. K., Cleghorn, L., Ploeg, J., Risdon, C., Mangin, D. A., Dolovich, L. R., Agarwal, G., Oliver, D., Gaber, J., & Chung, H. (2020) · BMC Family Practice · doi:10.1186/s12875-020-01143-8 · Cited by 61 · see citing works
A Multi-Component Framework for the Analysis and Design of Explainable Artificial Intelligence
Kim, M., Atakishiyev, S., Babiker, H. K. B., Farruque, N., Goebel, R. G., Zai͏̈ane, O. R., Motallebi, M.-H., Rabelo, J. C. B., Syed, T. I., Yao, H., et al. (2021) · Machine Learning and Knowledge Extraction · doi:10.3390/make3040045 · Cited by 57 · see citing works
Self-citationTemporal sequencing of alcohol-related problems, problem recognition, and help-seeking episodes.
Simpson, C., & Tucker, J. (2002) · Addictive Behaviours · doi:10.1016/s0306-4603(01)00200-3 · Cited by 47 · see citing works
Ipser, J., Dewing, S., & Stein, D. J. (2007) · Current Psychiatry Reports · doi:10.1007/s11920-007-0037-3 · Cited by 46 · see citing works
Older Adults’ Awareness of Community Health and Support Services for Dementia Care
Ploeg, J., Denton, M. A., Tindale, J. A., Hutchison, B. G., Brazil, K., Akhtar‐Danesh, N., Lillie, J., & Plenderleith, J. M. (2009) · Canadian Journal on Aging / La Revue canadienne du vieillissement · doi:10.1017/s0714980809990195 · Cited by 45 · see citing works
Where Would You Turn for Help? Older Adults' Awareness of Community Support Services
Denton, M. A., Ploeg, J., Tindale, J. A., Hutchison, B. G., Brazil, K., Akhtar‐Danesh, N., Quinlan, M., Lillie, J., Plenderleith, J. M., & Boos, L. (2008) · Canadian Journal on Aging / La Revue canadienne du vieillissement · doi:10.3138/cja.27.4.359 · Cited by 42 · see citing works
Interpreting Deep Learning Models in Natural Language Processing: A ReviewPreprint
Sun, X., Yang, D., Li, X., Zhang, T., Meng, Y., Qiu, H., Wang, G., Hovy, E. H., & Li, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.10470 · Cited by 40 · see citing works
Response Rates in Online Surveys With Affective Disorder Participants
Burgard, T., Bošnjak, M., & Wedderhoff, N. (2020) · Zeitschrift für Psychologie · doi:10.1027/2151-2604/a000394 · Cited by 36 · see citing works
Evaluating the quality of perinatal anxiety information available online
Kirby, P. L., Reynolds, K., Walker, J. R., Furer, P., & Pryor, T. A. M. (2018) · Archives of Women s Mental Health · doi:10.1007/s00737-018-0875-5 · Cited by 35 · see citing works
A Technological Approach to Reaching a Hidden Population of Problem Drinkers
Lieberman, D. Z., & Huang, S. W. (2008) · Psychiatric Services · doi:10.1176/ps.2008.59.3.297 · Cited by 31 · see citing works
Tjepkema, M. (2005) · PubMed · Cited by 29 · see citing works
Could a virtual human be used to explore excessive daytime sleepiness in patients?
Philip, P., Bioulac, S., Sauteraud, A., Chaufton, C., & Olive, J. (2014) · Presence: Teleoperators and Virtual Environments · doi:10.1162/pres_a_00197 · Cited by 25 · see citing works
Noble, J. M., Vuong, W., Surood, S., Urichuk, L., Greenshaw, A. J., & Agyapong, V. I. O. (2021) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2021.640795 · Cited by 23 · see citing works
Self-citationSyan, A., Lam, J. Y.-Y., Huang, C., Smith, M. S. M., Darnay, K., Hawke, L. D., & Henderson, J. L. (2021) · Health Expectations · doi:10.1111/hex.13214 · Cited by 16 · see citing works
Objective functions: (In)humanity and inequity in artificial intelligence
Blackwell, A. F. (2019) · Hau Journal of Ethnographic Theory · doi:10.1086/703871 · Cited by 11 · see citing works
Chatbot as a Telehealth Intervention Strategy in the COVID-19 Pandemic
Chagas, B. A., Ferreguetti, K., Ferreira, T. C., Marcolino, M. S., Ribeiro, L. B., Pagano, A. S., Reis, Z. S. N., Prates, R. O., Meira, W., & Ribeiro, A. L. P. (2021) · CLEI electronic journal · doi:10.19153/cleiej.24.3.6 · Cited by 7 · see citing works
Simulated Annealing for Emotional Dialogue Systems
Dong, C., Huang, C., Zaïane, O., & Mou, L. (2021) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3459637.3482182 · Cited by 5 · see citing works
Farruque, N., Huang, C., Zai͏̈ane, O. R., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.12364 · Cited by 5 · see citing works
Self-citationImplementing the Transforming Your Care agenda in Northern Ireland within integrated structures
Birrell, D., & Heenan, D. (2012) · Journal of Integrated Care · doi:10.1108/14769011211285156 · Cited by 4 · see citing works
Flagged first, then by citations
Research works printed but not linked: 3
- [2]Pearson C Janz T Ali J Mental and substance use disorders in Canada Statistics Canada 2015 2021-09-15 https://www150.statcan.gc.ca/n1/en/pub/82-624-x/2013001/article/11855-eng.pdf?st=d8oRDqRq
- [16]Chappell NL McDonald L Stones M Aging in Contemporary Canada. 2nd edition 2008 Toronto, ON, Canada Pearson-Prentice Hall
- [27]WHO Coronavirus (COVID-19) Dashboard World Health Organization 2021-07-19 https://covid19.who.int/ 37184163
Cited by
Sorted by citations
Temsah, M.-H., Aljamaan, F., Malki, K. H., Alhasan, K., Altamimi, I., Aljarbou, R., Bazuhair, F., Alsubaihin, A., Abdulmajeed, N., Alshahrani, F. S., et al. (2023) · Healthcare · doi:10.3390/healthcare11131812 · Cited by 179 · see citing works
Assessment of artificial intelligence applications in responding to dental trauma
Özden, İ., Gökyar, M., Ozden, M. E., & Öveçoğlu, H. S. (2024) · Dental Traumatology · doi:10.1111/edt.12965 · Cited by 95 · see citing works
Intelligent Virtual Laboratory Development and Implementation using the RASA Framework
Josphineleela, R., Kaliappan, S., Natrayan, L., & Bhatt, U. M. (2023) · International Conference on Computing Methodologies and Communication (ICCMC) · doi:10.1109/iccmc56507.2023.10083701 · Cited by 55 · see citing works
Sarkar, S., Gaur, M., Chen, L. K., Garg, M., & Srivastava, B. (2023) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2023.1229805 · Cited by 38 · see citing works
AI Chatbots for Psychological Health for Health Professionals: Scoping Review
Baek, G., Cha, C., & Han, J.-H. (2025) · JMIR Human Factors · doi:10.2196/67682 · Cited by 42 · see citing works
Cho, Y., Rai, S., Ungar, L., Sedoc, J., & Guntuku, S. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.698 · Cited by 33 · see citing works
Rządeczka, M., Sterna, A., Stolińska, J., Kaczyńska, P., & Moskalewicz, M. (2024) · JMIR Mental Health · doi:10.2196/64396 · Cited by 32 · see citing works
User experience with a parenting chatbot micro intervention
Entenberg, G. A., Dosovitsky, G., Aghakhani, S., Mostovoy, K., Carre, N., Marshall, Z., Benfica, D., Mizrahi, S., Testerman, A., Rousseau, A., et al. (2023) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.989022 · Cited by 29 · see citing works
Akilesh, S., Sheik Abdullah, A., Abinaya, R., Dhanushkodi, S. R., & Sekar, R. (2023) · International Conference on Research Methodologies in Knowledge Management, Artificial Intelligence and Telecommunication Engineering (RMKMATE) · doi:10.1109/rmkmate59243.2023.10368616 · Cited by 29 · see citing works
Cheng, C., Lin, W., Liu, H., Chen, Y., Chiang, C., & Hung, K. (2023) · Nephrology · doi:10.1111/nep.14239 · Cited by 27 · see citing works
Artificial Intelligence-Based Chatbots to Combat COVID-19 Pandemic: A Scoping Review
Mahdavi, A., Amanzadeh, M., Hamedan, M., & Naemi, R. (2023) · Shiraz E-Medical Journal · doi:10.5812/semj-139627 · Cited by 23 · see citing works
Perspectives on Artificial Intelligence in Nursing in Asia
Lukkahatai, N., & Han, G. (2024) · Asian/Pacific Island Nursing Journal · doi:10.2196/55321 · Cited by 24 · see citing works
Boit, S., & Patil, R. (2025) · JMIR Mental Health · doi:10.2196/75078 · Cited by 24 · see citing works
Levin, C., Naimi, E., & Saban, M. (2024) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2024.105566 · Cited by 17 · see citing works
Khorev, V. S., Kiselev, A. R., Badarin, A., Antipov, V. M., Drapkina, O. M., Kurkin, S., & Hramov, A. E. (2024) · The European Physical Journal Special Topics · doi:10.1140/epjs/s11734-024-01289-x · Cited by 16 · see citing works
Rahman, M. S., Sabbir, M. M., Zhang, J., Taufique, K. M. R., & Rahman, M. M. (2024) · International Journal of Consumer Studies · doi:10.1111/ijcs.13096 · Cited by 14 · see citing works
Chatbots in Psychology: Revolutionizing Clinical Support and Mental Health Care
de Filippis, R., & Foysal, A. A. (2024) · Voice of the Publisher · doi:10.4236/vp.2024.103025 · Cited by 15 · see citing works
Speech Recognition and Neural Networks based Talking Health Care Bot (THCB): Medibot
Bandopadhyay, D., Ghosh, R., Chatterjee, R., Das, N., & Sadhukhan, B. (2023) · International Conference on Computing Methodologies and Communication (ICCMC) · doi:10.1109/iccmc56507.2023.10084191 · Cited by 11 · see citing works
Cross, S. P. M., Mangelsdorf, S. N., Valentine, L., O’Sullivan, S., McEnery, C., Scott, I., Gilbertson, T., Louis, S., Myer, J., Liu, P., et al. (2025) · Internet Interventions · doi:10.1016/j.invent.2025.100849 · Cited by 15 · see citing works
Chatbots in Pharmacy: A Boon or a Bane for Patient Care and Pharmacy Practice?
Ramadhani, C. (2023) · Sciences of Pharmacy · doi:10.58920/sciphar02030001 · Cited by 14 · see citing works
Privacy in Chatbot Conversation-Driven Development: A Comprehensive Review and Requirements Proposal
Silva, G. R. S., & Canedo, E. D. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3730578 · Cited by 6 · see citing works
Sakhi: AI-Generated Mental Health Companion
Agarwal, M., Chauhan, D., Yadav, N., & Singhal, S. (2024) · International Conference on Innovative Sustainable Technologies for Energy, Mechatronics, and Smart Systems (ISTEMS) · doi:10.1109/istems60181.2024.10560327 · Cited by 6 · see citing works
AI-Powered Mental Health Assessment using Emotion Detection for Real-Time Analysis
Vijay, K., Raghakeerthana, R., Milinda, R. R., & Thusheel, S. (2025) · International Conference on Computational, Communication and Information Technology (ICCCIT) · doi:10.1109/icccit62592.2025.10928009 · Cited by 6 · see citing works
Dolman, A. J., Kaliappan, S., Zhou, Y., Palleti, D., Marquard, J. L., Lee, S. I., Karkar, R., & Jimison, H. B. (2025) · Innovation in Aging · doi:10.1093/geroni/igaf106 · Cited by 4 · see citing works
A review on recent advancements of ChatGPT and datafication in healthcare applications
Jagatheesaperumal, S. K., Pandiyarajan, A., Boopathy, P., Deepa, N., Barreto, A. G., & de Albuquerque, V. D. (2025) · Comput. Biol. Medicine · doi:10.1016/j.compbiomed.2025.110885 · Cited by 4 · see citing works
Son, N. K., Sangaiah, A. K., Paramarthika, L. K. M., Rajendran, V., Bian, G., & Alenazi, M. J. F. (2025) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2025.3572596 · Cited by 3 · see citing works
El chatbot aplicado a salud. Una revisión bibliométrica
Torres, J. E. C., Moreno, C. E. S., Moncada, J. S. M., & Pineda, J. D. P. (2024) · Revista de Comunicación y Salud · doi:10.35669/rcys.2025.15.e355 · Cited by 3 · see citing works
Peran Chatbot dalam Menangani Masalah Kesehatan Mental selama Pandemi COVID-19: Tinjauan Mini
Hisan, U. K., & Amri, M. M. (2022) · Bincang Sains dan Teknologi · doi:10.56741/bst.v1i01.33 · Cited by 3 · see citing works
Assistive Chatbots for healthcare: a succinct reviewPreprint
Bhattacharya, B. S. (2023) · doi:10.36227/techrxiv.23741469 · Cited by 3 · see citing works
Wei, S., Wei, W., & Zou, G. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2026.1832598 · Cited by 2 · see citing works
“…studies have revealed that AI chatbots facilitate well-designed multimodal conversations that can effectively assist in a variety of areas such as patient intervention (8), postoperative support (9), and psychiatric care (10), which has attracted great interest in nursing education research (3).”
Evaluating Canada's Position in AI Adoption for eHealth System
Kimiagari, S. (2025) · International Journal of Knowledge Management · doi:10.4018/ijkm.384590 · Cited by 2 · see citing works
Assistive Chatbots for healthcare: a succinct reviewPreprint
Bhattacharya, B. S. (2023) · doi:10.36227/techrxiv.23741469.v1 · Cited by 3 · see citing works
Ghongade, H. P., & Bhadre, A. A. (2025) · Wiley eBooks · doi:10.1002/9781394197750.ch5 · Cited by 2 · see citing works
Design Proposal for a Chatbot with Mental Support Functionalities Based on Artificial Intelligence
Collantes, L. H., Wibawa, A. P., Palma, H. H., Bohórquez, M. O., Plazas-Alvarado, J., & Jiménez-Coronado, A. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-60012-8_2 · Cited by 1 · see citing works
Exploring the Need for XAI for Managing Celiac Disease in Healthcare Sector in Saudi Arabia
Alzahrani, A., Alnanih, R., & Alsaedi, O. A. (2024) · Procedia Computer Science · doi:10.1016/j.procs.2024.11.129 · Cited by 1 · see citing works
Chatbots and virtual health assistants in patient counseling
Patne, A. Y., Suryawanshi, M. V., & Vinchurkar, K. (2025) · Elsevier eBooks · doi:10.1016/b978-0-443-43823-3.00003-0 · Cited by 1 · see citing works
AI Chatbots as Companions for Trauma Survivors: Balancing Algorithmic Responses and Genuine Empathy
Alqaidoom, M. M., & Ateeq, A. A. (2025) · Studies in systems, decision and control · doi:10.1007/978-3-031-91424-9_13 · Cited by 1 · see citing works
Exploring Dialog Act Recognition in Open Domain Conversational Agents
Sultana, M., & Zai͏̈ane, O. R. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-39831-5_22 · Cited by 1 · see citing works
Self-citationAndrade, Q. D. S., & da Silva, C. B. (2023) · Escola Regional de Computação Bahia, Alagoas e Sergipe (ERBASE) · doi:10.5753/erbase.2023.236057 · Cited by 1 · see citing works
Zhao, X., Varisco, R., Borghouts, J. W., Eikey, E. V., Safani, D., Mukamel, D. B., Schueller, S. M., & Sorkin, D. H. (2024) · BMC Health Services Research · doi:10.1186/s12913-024-11041-9 · Cited by 1 · see citing works
AI Chatbots for Psychological Health for Health Professionals: A Scoping Review (Preprint)Preprint
Han, J.-H., Baek, G., & Cha, C. (2024) · doi:10.2196/preprints.67682 · Cited by 1 · see citing works
Mehta, U. M., Bagali, K. B., & Kommanapalli, S. (2024) · Springer eBooks · doi:10.1007/978-981-97-0503-0_10
The future of digital mental health care: challenges and opportunities for practice
Jesto, S., & Kunnumpurath, B. (2024) · Elsevier eBooks · doi:10.1016/b978-0-443-22270-2.00006-x
Investigating Family Dynamics and Children's Safety in the era of Artificial Intelligence
Shafik, W. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-2170-7.ch006
Mental Health Resource Retrieval Using Semantic Similarity and Knowledge Graphs
Prakash, V., Gharaat, M. A., Foster, A. L., Merrick, D., Desnoyers, E., Noble, J. M., Porter, K., Greenshaw, A. J., & Zai͏̈ane, O. R. (2025) · Lecture notes in business information processing · doi:10.1007/978-3-032-08603-7_6
Self-citationHastings, S., Botey, A. P., Salas, A. S., & Robson, P. J. (2025) · BMC Health Services Research · doi:10.1186/s12913-025-13583-y
Neto, J. G. D. F. L., & Castro, A. F. C. (2025) · Revista Foco · doi:10.54751/revistafoco.v18n12-039
Zhao, X., Varisco, R., Borghouts, J. W., Eikey, E. V., Safani, D., Mukamel, D. B., Schueller, S. M., & Sorkin, D. H. (2024) · Figshare · doi:10.6084/m9.figshare.26718099
Editorial: Mental health in the age of artificial intelligence
Noble, J. M., Ha, K., & Greenshaw, A. (2026) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2025.1750256
Self-citationAI-Powered Mental Health Platforms for Workforce Well-Being in Manufacturing Units
Bakiyaraj, K., M, G. S., Lathika, K., Suba Lakshmi, P., Kesavan, A., & Shilpa, A. (2025) · International Conference on Artificial Intelligence and Knowledge Discovery in Concurrent Engineering (ICECONF) · doi:10.1109/iceconf65644.2025.11379611
Integrating Artificial Intelligence Into Peer Support
Swarbrick, M. A., & Jones, N. (2026) · Psychiatric Services · doi:10.1176/appi.ps.20260080
A scoping review of digital mental health literacy interventions for the general population
Khir, S. M., Bakar, A. N. A., Rashid, A. H. A., Isa, M. A., Chan, W. H., Shari, N. I., Panatik, S. A., Harun, N. A., & Yunus, W. M. A. W. M. (2026) · Discover Psychology · doi:10.1007/s44202-026-00826-0
Цифровая трансформация психологического сопровождения личности в тензионных состояниях
Фрейманис, И. Ф., & Игнатова, Е. С. (2026) · Психиатрия психотерапия и клиническая психология · doi:10.34883/pi.2026.17.1.027
- Authors
- Noble, J. M., Zamani, A., Gharaat, M., Merrick, D., Maeda, N., Lambe Foster, A., Nikolaidis, I., Goud, R., Stroulia, E., Agyapong, V. I. O., Greenshaw, A. J., Lambert, S., Gallson, D., Porter, K., Turner, D., & Zaiane, O.
- Affiliations
- University of Alberta (CA)
- University of Regina (CA)
- Mood Disorders Society of Canada (CA)
- University of Toronto (CA)
- Dalhousie University (CA)
- ORCID
- Venue
- JMIR Research Protocols
- Publisher
- JMIR Publications Inc.
- Published
- 2022-07-25
- Volume
- 11
- Issue
- 7
- Pages
- e33717
- ISSN
- 1929-0748 (ISSN-L)
- PMC
- PMC9361145
- OpenAlex
- W4285364236
- Cited by
- 53
- References
- 66
- Citations by year
- 2026: 5 · 2025: 17 · 2024: 16 · 2023: 14 · 2022: 1
- FWCI
- 10.60
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Research Protocols (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- University of Alberta
- Mitacs
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Keywords
- chatbots, healthcare workers, COVID-19 pandemic, mental health stigma, artificial intelligence, Alberta, Nova Scotia, psychological distress
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
