Cited by 11Digital Mental Health InterventionsSocial Robot Interaction and HRIEmotion and Mood Recognition

A Systematic Review on Mental Health Chatbots: Trends, Design Principles, Evaluation Methods, and Future Research Agenda

Open access
Kuhail, Mohammad Amin, Al-Shamaileh, Ons, Farooq, Shahbano, Shahin, Hana, Abdelzaher, Fatema, Thomas, Justin·2025·Human Behavior and Emerging Technologies

Abstract

Recent decades have witnessed a rise in the prevalence of common mental health problems coupled with an increasing demand for talk‐based psychological therapies. This has coincided with the rise of mental health chatbots (MHCs), a corollary of which is the use of MHCs, AI‐driven, conversational agents, to provide interactive support, guidance, and therapeutic engagement for persons experiencing mental health challenges. There has been a growing research interest in MHCs, and this study provides a much‐needed systematic review that examines this expanding research literature, identifying themes, trends, and areas worthy of further exploration. This review identified and systematically explored 97 published papers on MHCs. Most studies explored MHC design and evaluation, emphasizing empathy‐based chatbots and their relative efficacy compared with conventional delivery modes (e.g., in‐person human therapists). Text‐based communication was the most frequently utilized modality over and above the use of audio, graphical, or mixed modes. The most commonly used therapeutic orientation among MHCs was cognitive behavioral therapy (CBT), with far less focus on third‐wave evidence‐based approaches such as dialectical behavior therapy and acceptance and commitment therapy. The most frequently targeted mental health condition was depression, although there were several other conditions also considered. Most MHC research has not considered cultural appropriateness or cultural adaptation of interventions. Further, limited attention to severe or high‐risk symptomatology has been given. Meanwhile, we noted that most of the studies used quantitative and mixed evaluation methods. Evaluation shows persistent challenges around personalization, privacy, and technical reliability. Future research should focus on integrating human‐in‐the‐loop mechanisms, advancing cultural adaptation, incorporating thought‐challenging CBT techniques, embedding ethics into design, and exploring large language models (LLMs) for more adaptive and empathetic support.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1155/hbe2/9942295

Cites

43 of 43 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Existing reviews and meta-analyses of LLM-CBs for mental health focus on applications of LLM-CBs as clinical intervention tools, often under research-protocol conditions.

    “Although reviews and meta-analyses of LLM-CBs for mental health exist13,14,29,30, as well as scoping reviews on the implementation of LLM-CBs in mental health31,32, their focus is narrowed to applications of LLM-CBs as clinical intervention tools.”

    From A scoping review on the mental health harms of LLM-based chatbots (2026) · cites this paper as [30]

    Section 3 (Related Work; page not available) says prior mental-health-chatbot reviews examine intervention effectiveness, but also lists design, user experience, technology, ethics, and other objectives. Section 6.2.5 discusses LLMs but does not establish that reviews of LLM-based chatbots are narrowly focused on clinical intervention tools or research-protocol conditions. (LLM, conf=0.78)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 139

  1. N. Chitadze, "A Policy of Mental Health Protection in the Example of Europe," in Perspectives and Considerations on Navigating the Mental Healthcare System, ed. S. V. Alstyne (IGI Global, 2023), 110-141, https://doi.org/10.4018/978-1- 6684-5049-9.ch005. · DOI
  2. G. Gupta and D. Gupta, "Predicting the Prevalence of Mental Disorders Among Different Age Groups: A Review," in Pro- ceedings of the 2021 2nd International Conference on Secure Cyber Computing and Communications (ICSCCC) (IEEE, 2021), https://doi.org/10.1109/ICSCCC51823.2021.9478115. · DOI
  3. E. L. Cordoba, "Well-Being and Mental Health of Healthcare Workers Before, During, and After COVID-19," Salud Men- tal 44, no. 5 (2021): 211-214, https://doi.org/10.17711/ SM.0185-3325.2021.027. · DOI
  4. R. Patt and D. Meva, "Advancements in Machine Learning- Based Mental Health Prediction: A Comprehensive Review," in Proceedings of Fifth International Conference on Comput- ing, Communications, and Cyber-Security, eds. S. Tanwar, P. Singh, and M. Ganzha (Springer, 2024), 497-507, https:// doi.org/10.1007/978-981-97-2550-2_36. · DOI
  5. K. M. Sowers, W. S. Rowe, and J. R. Clay, "The Intersection Between Physical Health and Mental Health: A Global Per- spective," Journal of Evidence-Based Social Work 6, no. 1 (2009): 111-126, https://doi.org/10.1080/15433710802633734. · DOI
  6. J. Campion, "Public Mental Health," in Advances in Psychia- try, eds. A. Javed and K. Fountoulakis (Springer, 2019), 555https://doi.org/10.1007/978-3-319-70554-5_31. · DOI
  7. R. Kargbo, "3-Pyrrolidine-Indole Derivatives as 5-HT2- Selective Receptor Modulators for the Potential Treatment of Mental Disorders," ACS Medicinal Chemistry Letters 23 Human Behavior and Emerging Technologies 13, no. 5 (2022): 749-751, https://doi.org/10.1021/ acsmedchemlett.2c00128. · DOI
  8. D. Soeteman, L. Roijen, R. Verheul, and J. Busschbach, "The Economic Burden of Personality Disorders in Mental Health Care," The Journal of Clinical Psychiatry 69, no. 2 (2008): 259-265, https://doi.org/10.4088/JCP.v69n0212. · DOI · Paper page
  9. H. Taylor, N. Menachemi, A. Gilbert, J. Chaudhary, and J. Blackburn, "Economic Burden Associated With Untreated Mental Illness in Indiana," JAMA Health Forum 4, no. 10 (2023): https://doi.org/10.1001/jamahealthforum.2023.3535. · DOI
  10. S. Ayarekar, V. Nangare, Gaurav, A. P. Godge, R. V. Maha- dik, and S. Desai, "Addressing Mental Health Needs in Public Health Management: Bridging Gaps in Services and Sup- port," International Journal of Medical Toxicology & Legal Medicine 27, no. 1S (2024): 466-477.
  11. R. Kabir, S. Isigi, and C. Candussi, "Public Mental Health and Access to Mental Health Services in South Asia," in Access to Mental Health Care in South Asia, eds. S. Arafat and S. Kar (Springer, 2024), https://doi.org/10.1007/978-981-99-9153- 2_11. · DOI
  12. S. Pinchover, R. Raanan, H. Gadassi, et al., "Pediatricians at the Forefront of Child Mental Health? A Delphi Method Explora- tion," Israel Journal of Health Policy Research 13, no. 1 (2024): 73, https://doi.org/10.1186/s13584-024-00661-5. · DOI
  13. P. Behera, J. Parida, N. Kakade, S. Pati, and S. Acharya, "Addressing Barriers to Mental Healthcare Access for Ado- lescents Living in Slums: A Qualitative Multi-Stakeholder Study in Odisha, India," Children and Youth Services Review 145, no. 1 (2023): 106810, https://doi.org/10.1016/ j.childyouth.2023.106810. · DOI
  14. M. Sogomonjan, "Challenges and Opportunities for E- Mental Health Policy: An Estonian Case Study," Contempo- rary Social Science 16, no. 2 (2021): 185-198, https:// doi.org/10.1080/21582041.2020.1720795. · DOI
  15. A. Benítez-Guijarro, R. Bond, F. Booth, et al., "Co-Creating Requirements and Assessing End-User Acceptability of a Voice-Based Chatbot to Support Mental Health: A Thematic Analysis of a Living Lab Workshop," in Lecture Notes in Elec- trical Engineering, ed. Z. C. S. N. Luis Fernando D'Haro (Springer, 2021), 201-212, https://doi.org/10.1007/978-981- 15-8395-7_15. · DOI
  16. M. Casu, S. Triscari, S. Battiato, L. Guarnera, and P. Caponnetto, "AI Chatbots for Mental Health: A Scoping Review of Effectiveness, Feasibility, and Applications," Applied Sciences 14, no. 13 (2024): 5889, https://doi.org/ 10.3390/app14135889. · DOI
  17. V. Gupta, V. Joshi, A. Jain, and I. Garg, "Chatbot for Men- tal Health Support Using NLP," in Proceedings of the 2023 4th International Conference for Emerging Technology (INCET) (IEEE, 2023), https://doi.org/10.1109/ INCET57972.2023.10170573. · DOI
  18. A.-R. Wrightson-Hester, G. Anderson, J. Dunstan, et al., "An Artificial Therapist (Manage Your Life Online) to Support the Mental Health of Youth: Co-Design and Case Series," JMIR Human Factors 10, no. 1 (2023): e46849, https:// doi.org/10.2196/46849. · DOI
  19. A. Ansari, T. Upadhyay, H. Vaidya, and A. Kapruwan, "Chat- bots for Mental Health: Leveraging LSTM and Seq2Seq Architectures to Enhance User Well-Being," in Proceedings of the 2024 IEEE International Conference on Information Technology, Electronics and Intelligent Communication Sys- tems (ICITEICS) (IEEE, 2024), https://doi.org/10.1109/ ICITEICS61368.2024.10624828. · DOI
  20. K. Mishra, H. Bodkhe, R. Naik, N. Bangalkar, and P. Dubey, "Advancements in Conversational AI: Building Mental Health Chatbot With BERT Model," in Proceedings of the 2023 Inter- national Conference on Artificial Intelligence for Innovations in Healthcare Industries (ICAIIHI) (IEEE, 2023), https://doi.org/ 10.1109/ICAIIHI57871.2023.10489148. · DOI
  21. G. Cameron, D. Cameron, G. Megaw, et al., "Towards a Chat- bot for Digital Counselling," in Proceedings of the 31st Inter- national BCS Human Computer Interaction Conference (HCI 2017) (BCS Learning & Development, 2017), https:// doi.org/10.14236/ewic/HCI2017.24. · DOI
  22. N. Damij and S. Bhattacharya, "The Role of AI Chatbots in Mental Health Related Public Services in a (Post) Pandemic World: A Review and Future Research Agenda," in Proceedings of the 2022 IEEE Technology and Engineering Management Conference (TEMSCON EUROPE) (IEEE, 2022), https:// doi.org/10.1109/TEMSCONEUROPE54743.2022.9801962. · DOI
  23. M. Khosravi and G. Azar, "Factors Influencing Patient Engagement in Mental Health Chatbots: A Thematic Anal- ysis of Findings From a Systematic Review of reviews," Digital Health 10 (2024): https://doi.org/10.1177/ 20552076241247983. · DOI
  24. B. Omarov, S. Narynov, and Z. Zhumanov, "Artificial Intelligence-Enabled Chatbots in Mental Health: A Systematic Review," Computers, Materials and Continua 74, no. 3 (2023): 5105-5122, https://doi.org/10.32604/cmc.2023.034655. · DOI
  25. V. L. P. Molli, "Effectiveness of AI-Based Chatbots in Mental Health Support: A Systematic Review," Journal of Healthcare AI and ML 9, no. 9 (2022): 1-11.
  26. Y. Zhu, R. Wang, and C. Pu, ""I Am Chatbot, Your Virtual Mental Health Adviser." What Drives Citizens' Satisfaction and Continuance Intention Toward Mental Health Chatbots During the COVID-19 Pandemic? An Empirical Study in China," Digital Health 8 (2022): 205520762210900, https:// doi.org/10.1177/20552076221090031. · DOI
  27. T. Fritsch, "Chatbots: An Overview of Current Issues and Challenges," in Lecture Notes in Networks and Systems Advances in Information and Communication (Springer, 2024), 84-104, https://doi.org/10.1007/978-3-031-53960-2_7. · DOI
  28. S. Kelly, S. Kaye, and O. Oviedo-Trespalacios, "A Multi- Industry Analysis of the Future Use of AI Chatbots," Human Behavior and Emerging Technologies 2022 (2022): 2552099, https://doi.org/10.1155/2022/2552099. · DOI
  29. M. Rauws, "The Rise of the Mental Health Chatbot," in Arti- ficial Intelligence in Medicine, eds. N. Lidströmer and H. Ash- rafian (Springer, 2022), 1609-1618, https://doi.org/10.1007/ 978-3-030-64573-1_218. · DOI
  30. R. M. Lopes, A. F. Silva, A. C. A. Rodrigues, and V. Melo, "Chatbots for Well-Being: Exploring the Impact of Artificial Intelligence on Mood Enhancement and Mental Health," European Psychiatry 67, no. S1 (2024): S550-S551, https:// doi.org/10.1192/j.eurpsy.2024.1143. · DOI
  31. G. Nicol, R. Wang, S. Graham, S. Dodd, and J. Garbutt, "Chatbot-Delivered Cognitive Behavioral Therapy in Adoles- cents With Depression and Anxiety During the COVID-19 Pandemic: Feasibility and Acceptability Study," JMIR Forma- tive Research 6, no. 11 (2022): e40242, https://doi.org/ 10.2196/40242. · DOI · Paper page
  32. J. Schroeder, C. Wilkes, K. Rowan, et al., "Pocket Skills: A Conversational Mobile Web App to Support Dialectical Behavioral Therapy," in Proceedings of the 2018 CHI Confer- ence on Human Factors in Computing Systems (Association for Computing Machinery, 2018), https://doi.org/10.1145/ 3173574.3173972. · DOI · Paper page
  33. L. Jerome, P. McNamee, N. Abdel-Halim, K. Elliot, and J. Woods, "Solution-Focused Approaches in Adult Mental Health Research: A Conceptual Literature Review and Narra- tive Synthesis," Frontiers in Psychiatry 14 (2023): https:// doi.org/10.3389/fpsyt.2023.1068006. · DOI
  34. H. Frost, P. Campbell, M. Maxwell, et al., "Effectiveness of Motivational Interviewing on Adult Behaviour Change in Health and Social Care Settings: A Systematic Review of Reviews," PLoS One 13, no. 10 (2018): e0204890, https:// doi.org/10.1371/journal.pone.0204890. · DOI
  35. S. Coghlan, K. Leins, S. Sheldrick, M. Cheong, P. Gooding, and S. D'Alfonso, "To Chat or Bot to Chat: Ethical Issues With Using Chatbots in Mental Health," Digital Health 9 (2023): 20552076231183542, https://doi.org/10.1177/ 20552076231183542. · DOI
  36. M. J. Beg, M. Verma, K. M. M. Vishvak Chanthar, and M. K. Verma, "Artificial Intelligence for Psychotherapy: A Review of the Current State and Future Directions," Indian Journal of Psychological Medicine 47, no. 4 (2025): 314-325, https:// doi.org/10.1177/02537176241260819. · DOI · Paper page
  37. H. J. Han, S. Mendu, B. K. Jaworski, J. E. Owen, and S. Abdullah, "Preliminary Evaluation of a Conversational Agent to Support Self-Management of Individuals Living With Posttraumatic Stress Disorder: Interview Study With Clinical Experts," JMIR Formative Research 5, no. 4 (2023): e21678.
  38. R. Maharjan, D. A. Rohani, K. Doherty, P. Baekgaard, and J. E. Bardram, "What Is the Difference? Investigating the Self-Report of Wellbeing via Conversational Agent and Web App," IEEE Pervasive Computing 21, no. 2 (2022): 60- 68, https://doi.org/10.1109/MPRV.2022.3147374. · DOI
  39. R. Maharjan, K. Doherty, D. A. Rohani, P. Bækgaard, and J. E. Bardram, "Experiences of a Speech-Enabled Conversational Agent for the Self-Report of Well-Being Among People Liv- ing With Affective Disorders: An in-the-Wild Study," ACM Transactions on Interactive Intelligent Systems 12, no. 2 (2022): 1-29, https://doi.org/10.1145/3484508. · DOI
  40. S. Park, S. Park, and M. Whang, "Empathic Responses of Behavioral-Synchronization in Human-Agent Interaction," Computers, Materials and Continua 71, no. 2 (2022): 3761- 3784, https://doi.org/10.32604/cmc.2022.023738. · DOI
  41. L. Alazraki, A. Ghachem, N. Polydorou, F. Khosmood, and A. Edalat, "An Empathetic AI Coach for Self-Attachment Therapy," in Proceedings of the 2021 IEEE Third Interna- tional Conference on Cognitive Machine Intelligence (CogMI) (IEEE, 2021), https://doi.org/10.1109/CogMI52975. 2021.00019. · DOI
  42. O. Demasi, Y. Li, and Z. Yu, "A Multi-Persona Chatbot for Hotline Counselor Training," in Findings of the Association for Computational Linguistics: EMNLP 2020, eds. T. Cohn, Y. He, and Y. Liu (Association for Computational Linguistics, 2020), 3623-3636.
  43. K. Ellis-Brush, "Augmenting Coaching Practice Through Digital Methods," International Journal of Evidence Based Coaching and Mentoring 15 (2021): 187-197, https:// doi.org/10.24384/er2p-4857. · DOI
  44. O. Romanovskyi, N. Pidbutska, and A. Knysh, "Elomia Chat- bot: The Effectiveness of Artificial Intelligence in the Fight for Mental Health," in CEUR Workshop Proceedings (CEUR- WS.ORG, 2021).
  45. I. Hungerbuehler, K. Daley, K. Cavanagh, H. Garcia Claro, and M. Kapps, "Chatbot-Based Assessment of Employees' Mental Health: Design Process and Pilot Implementation," JMIR Formative Research 5, no. 4 (2021): e21678, https:// doi.org/10.2196/21678. · DOI · Paper page
  46. G. Dosovitsky and E. L. Bunge, "Bonding With Bot: User Feedback on a Chatbot for Social Isolation," Frontiers in Dig- ital Health 3 (2021): https://doi.org/10.3389/fdgth.2021. 735053. · DOI
  47. S. T. A. Park, J. Han, S. Lee, W. Rhee, and B. Suh, ""I Wrote as if I Were Telling a Story to Someone I Knew.": Designing Chatbot Interactions for Expressive Writing in Mental Health," in Proceedings of the 2021 ACM Designing Interac- tive Systems Conference (Association for Computing Machin- ery, 2021), https://doi.org/10.1145/3461778.3462143. · DOI
  48. G. Park, J. Chung, and S. Lee, "Effect of AI Chatbot Emo- tional Disclosure on User Satisfaction and Reuse Intention for Mental Health Counseling: A Serial Mediation Model," Current Psychology 42, no. 32 (2022): 28663-28673, https:// doi.org/10.1007/s12144-022-03932-z. · DOI
  49. V. P. H. Raji and P. U. Maheswari, "COVID-19 Lockdown in India: An Experimental Study on Promoting Mental Well- ness Using a Chatbot During the Coronavirus," International Journal of Mental Health Promotion 24, no. 2 (2022): 189- 205, https://doi.org/10.32604/ijmhp.2022.011865. · DOI
  50. R. Ahmad, D. Siemon, U. Gnewuch, and S. Robra-Bissantz, "The Benefits and Caveats of Personality-Adaptive Conversa- tional Agents in Mental Health Care," Americas Conference on Information Systems (AIS eLibrary, 2021).
  51. A. B. Rakib, E. A. Rumky, A. J. Ashraf, M. M. Hillas, and M. A. Rahman, "Mental Healthcare Chatbot Using Sequence-to-Sequence Learning and BiLSTM," in Interna- tional Conference on Brain Informatics, Lecture Notes in Computer Science (Springer, 2021), https://doi.org/10.1007/ 978-3-030-86993-9_34. · DOI
  52. S. Kang, D. M. Krum, P. Khooshabeh, et al., "Social Influence of Humor in Virtual Human Counselor's Self-Disclosure," Computer Animation and Virtual Worlds 28, no. 3-4 (2017): e1763, https://doi.org/10.1002/cav.1763. · DOI
  53. P. McAllister, J. Kerr, M. McTear, et al., "Towards Chatbots to Support Bibliotherapy Preparation and Delivery," in Inter- national Workshop on Chatbot Research and Design, Lecture Notes in Computer Science (Springer, 2020), https://doi.org/ 10.1007/978-3-030-39540-7_9. · DOI
  54. B. Persons, P. Jain, C. Chagnon, and S. Djamasbi, "Designing the Empathetic Research IoT Network (ERIN) Chatbot for Mental Health Resources," in International Conference on Human-Computer Interaction, Lecture Notes in Computer Science (Springer, 2021), https://doi.org/10.1007/978-3-030- 77750-0_41. · DOI
  55. S. Ter Stal, G. Jongbloed, and M. Tabak, "Embodied Conver- sational Agents in eHealth: How Facial and Textual Expres- sions of Positive and Neutral Emotions Influence Perceptions of Mutual Understanding," Interacting with Computers 33, no. 2 (2021): 167-176, https://doi.org/ 10.1093/iwc/iwab019. · DOI
  56. C. Potts, F. Lindström, R. Bond, et al., "A Multilingual Digital Mental Health and Well-Being Chatbot (ChatPal): Pre-Post Multicenter Intervention Study," Journal of Med- ical Internet Research 25 (2023): e43051, https://doi.org/ 10.2196/43051. · DOI
  57. F. Booth, C. Potts, R. Bond, et al., "A Mental Health and Well-Being Chatbot: User Event Log Analysis," JMIR mHealth and uHealth 11 (2023): e43052, https://doi.org/ 10.2196/43052. · DOI
  58. A. J. Law, R. Hu, L. Alazraki, A. Gopalan, N. Polydorou, and A. Edalat, "A Multilingual Virtual Guide for Self-Attachment Technique," in Proceedings of the 2022 IEEE 4th International Conference on Cognitive Machine Intelligence (CogMI) (IEEE, 2022), https://doi.org/10.1109/CogMI56440.2022.00025. · DOI
  59. S. Thakur, D. Rastogi, and L. Singh, "MOODY: A Natural Language Processing-Based Chatbot for Mental Health Care," in Sustainable Technology and Advanced Computing in Electrical Engineering, Lecture Notes in Electrical Engi- neering (Springer, 2022), https://doi.org/10.1007/978-981- 19-4364-5_64. · DOI
  60. M. Jackson-Triche, D. Vetal, E. Turner, P. Dahiya, and C. Mangurian, "Meeting the Behavioral Health Needs of Health Care Workers During COVID-19 by Leveraging Chatbot Technology: Development and Usability Study," Journal of Medical Internet Research 25 (2023): e40635, https://doi.org/10.2196/40635. · DOI
  61. J. Lavelle, N. Dunne, H. E. Mulcahy, and L. McHugh, "Chat- bot-Delivered Cognitive Defusion Versus Cognitive Restruc- turing for Negative Self-Referential Thoughts: A Pilot Study," The Psychological Record 72, no. 2 (2022): 247-261, https:// doi.org/10.1007/s40732-021-00478-7. · DOI
  62. C. Sweeney, C. Potts, E. Ennis, et al., "Can Chatbots Help Support a Person's Mental Health? Perceptions and Views From Mental Healthcare Professionals and Experts," ACM Transactions on Computing for Healthcare 2, no. 3 (2021): 1-15, https://doi.org/10.1145/3453175. · DOI
  63. L. Qiu, Y. Shiu, P. Lin, et al., "What if Bots Feel Moods? Towards Controllable Retrieval-Based Dialogue Systems With Emotion-Aware Transition Networks," in Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval (Association for Computing Machinery, 2020), https://doi.org/10.1145/ 3397271.340110. · DOI
  64. M. Lee, S. Ackermans, N. Van As, H. Chang, E. Lucas, and W. IJsselsteijn, "Caring for Vincent: A Chatbot for Self- Compassion," in Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Association for Computing Machinery, 2019), https://doi.org/10.1145/ 3290605.3300932. · DOI
  65. E. Cho, "Hey Google, Can I Ask You Something in Private?," in Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Association for Computing Machin- ery, 2019), https://doi.org/10.1145/3290605.3300488. · DOI · Paper page
  66. K. Loveys, M. Sagar, I. Pickering, and E. Broadbent, "A Digi- tal Human for Delivering a Remote Loneliness and Stress Intervention to At-Risk Younger and Older Adults During the COVID-19 Pandemic: Randomized Pilot Trial," JMIR Mental Health 8, no. 11 (2021): e31586, https://doi.org/ 10.2196/31586. · DOI
  67. H. Ryu, S. Kim, D. Kim, S. Han, K. Lee, and Y. Kang, "Simple and Steady Interactions Win the Healthy Mentality," Pro- ceedings of the ACM on Human-Computer Interaction 4, no. - CSCW2 (2020): 1-25, https://doi.org/10.1145/3415223. · DOI · Paper page
  68. P. Rathnayaka, N. Mills, D. Burnett, D. De Silva, D. Alahakoon, and R. Gray, "A Mental Health Chatbot With Cognitive Skills for Personalised Behavioural Activation and Remote Health Monitoring," Sensors 22, no. 10 (2022): 3653, https://doi.org/10.3390/s22103653. · DOI
  69. C. Potts, E. Ennis, R. B. Bond, et al., "Chatbots to Support Mental Wellbeing of People Living in Rural Areas: Can User Groups Contribute to Co-Design?," Journal of Technology in Behavioral Science 6, no. 4 (2021): 652-665, https://doi.org/ 10.1007/s41347-021-00222-6. · DOI
  70. R. Maharjan, D. A. Rohani, P. Bækgaard, J. Bardram, and K. Doherty, "Can We Talk? Design Implications for the Questionnaire-Driven Self-Report of Health and Wellbeing via Conversational Agent," in Proceedings of the 3rd Con- ference on Conversational User Interfaces (Association for Computing Machinery, 2021), https://doi.org/10.1145/ 3469595.3469600. · DOI
  71. R. R. Dedeepya, L. C. Koneru, A. Lakshmi, and G. K. Kumar, "Stress Management System," in Proceedings of the 2022 IEEE Delhi Section Conference (DELCON) (IEEE, 2022), https:// doi.org/10.1109/DELCON54057.2022.9753121. · DOI
  72. A. Matsumoto, T. Kamita, Y. Tawaratsumida, et al., "Com- bined Use of Virtual Reality and a Chatbot Reduces Emo- tional Stress More Than Using Them Separately," JUCS - Journal of Universal Computer Science 27, no. 12 (2021): 1371-1389, https://doi.org/10.3897/jucs.77237. · DOI
  73. A. Schick, J. Feine, S. Morana, A. Maedche, and U. Reininghaus, "Validity of Chatbot Use for Mental Health Assessment: Experimental Study," JMIR mHealth and uHealth 10, no. 10 (2022): e28082, https://doi.org/10.2196/28082. · DOI
  74. M. L. Mauriello, N. Tantivasadakarn, M. A. Mora-Mendoza, et al., "A Suite of Mobile Conversational Agents for Daily Stress Management (PoPBots): Mixed Methods Exploratory Study," JMIR Formative Research 5, no. 9 (2021): e25294, https://doi.org/10.2196/25294. · DOI
  75. A. J. C. Trappey, A. P. C. Lin, K. Y. K. Hsu, C. V. Trappey, and K. L. K. Tu, "Development of an Empathy-Centric Counsel- ing Chatbot System Capable of Sentimental Dialogue Analy- sis," Processes 10, no. 5 (2022): 930, https://doi.org/10.3390/ pr10050930. · DOI
  76. M. Kawasaki, N. Yamashita, Y.-C. Lee, and K. Nohara, "Assessing Users' Mental Status From Their Journaling Behavior Through Chatbots," in Proceedings of the 20th ACM International Conference on Intelligent Virtual Agents (Association for Computing Machinery, 2020), https:// doi.org/10.1145/3383652.3423870. · DOI
  77. G. Anmella, M. Sanabra, M. Primé-Tous, et al., "Vickybot, a Chatbot for Anxiety-Depressive Symptoms and Work- 27 Human Behavior and Emerging Technologies Related Burnout in Primary Care and Health Care Profes- sionals: Development, Feasibility, and Potential Effectiveness Studies," Journal of Medical Internet Research 25 (2023): e43293, https://doi.org/10.2196/43293. · DOI
  78. W. W. S. Mak, S. M. Ng, and F. H. T. Leung, "A Web-Based Stratified Stepped Care Platform for Mental Well-Being (TourHeart+): User-Centered Research and Design," JMIR Formative Research 7 (2023): e38504, https://doi.org/ 10.2196/38504. · DOI
  79. C. Schillings, D. Meissner, B. Erb, D. Schultchen, E. Bendig, and O. Pollatos, "A Chatbot-Based Intervention With ELME to Improve Stress and Health-Related Parameters in a Stressed Sample: Study Protocol of a Randomised Controlled Trial," Frontiers in Digital Health 5 (2023): https://doi.org/ 10.3389/fdgth.2023.1046202. · DOI
  80. K. Loveys, M. Antoni, L. Donkin, M. Sagar, W. Xu, and E. Broadbent, "Effects of Cognitive Behavioral Stress Man- agement Delivered by a Virtual Human, Teletherapy, and an E-Manual on Psychological and Physiological Outcomes in Adult Women: An Experimental Test," Multimodal Tech- nologies and Interaction 6, no. 11 (2022): 99, https://doi.org/ 10.3390/mti6110099. · DOI
  81. A. L. S. Oliveira, L. N. Matos, M. C. Junior, and Z. N. C. Delabrida, "An Initial Assessment of a Chatbot for Rumination-Focused Cognitive Behavioral Therapy (RFCBT) in College Students," in Lecture Notes in Computer Science (Springer, 2021), 549-564, https://doi.org/10.1007/ 978-3-030-86979-3_39. · DOI
  82. R. Shao, "An Empathetic AI for Mental Health Intervention: Conceptualizing and Examining Artificial Empathy," in Pro- ceedings of the 2nd Empathy-Centric Design Workshop (Asso- ciation for Computing Machinery, 2023), https://doi.org/ 10.1145/3588967.3588971. · DOI
  83. L. Medeiros, T. Bosse, and C. Gerritsen, "Can a Chatbot Comfort Humans? Studying the Impact of a Supportive Chatbot on Users' Self-Perceived Stress," IEEE Transactions on Human-Machine Systems 52, no. 3 (2022): 343-353, https://doi.org/10.1109/THMS.2021.3113643. · DOI
  84. Y. Lee, N. Yamashita, and Y. Huang, "Designing a Chatbot as a Mediator for Promoting Deep Self-Disclosure to a Real Mental Health Professional," in Proceedings of the ACM on Human-Computer Interaction 4, no. CSCW1 (2020): 1-27, https://doi.org/10.1145/3392836. · DOI
  85. S. Park, J. Choi, S. Lee, et al., "Designing a Chatbot for a Brief Motivational Interview on Stress Management: Qualitative Case Study," Journal of Medical Internet Research 21, no. 4 (2019): e12231, https://doi.org/10.2196/12231. · DOI
  86. J. Meng and Y. Dai, "Emotional Support From AI Chatbots: Should a Supportive Partner Self-Disclose or Not?," Journal of Computer-Mediated Communication 26, no. 4 (2021): 207-222, https://doi.org/10.1093/jcmc/zmab005. · DOI
  87. A. P. C. Lin, C. V. Trappey, C. Luan, A. J. C. Trappey, and K. L. K. Tu, "A Test Platform for Managing School Stress Using a Virtual Reality Group Chatbot Counseling System," Applied Sciences 11, no. 19 (2021): 9071, https://doi.org/ 10.3390/app11199071. · DOI
  88. Y. Sakurai, Y. Ikegami, M. Sakai, et al., "VICA, a Visual Counseling Agent for Emotional Distress," Journal of Ambi- ent Intelligence and Humanized Computing 10, no. 12 (2019): 4993-5005, https://doi.org/10.1007/s12652-019- 01180-x. · DOI
  89. E. Durden, M. C. Pirner, S. J. Rapoport, A. Williams, A. Robinson, and V. L. Forman-Hoffman, "Changes in Stress, Burnout, and Resilience Associated With an 8-Week Inter- vention With Relational Agent "Woebot"," Internet Interven- tions 33 (2023): 100637, https://doi.org/10.1016/ j.invent.2023.100637. · DOI
  90. T. Eagle, C. Blau, S. Bales, N. Desai, V. Li, and S. Whittaker, ""I Don't Know What You Mean by 'I Am Anxious'": A New Method for Evaluating Conversational Agent Responses to Standardized Mental Health Inputs for Anxiety and Depression," ACM Transactions on Interactive Intelligent Systems 12, no. 2 (2022): 1-23, https://doi.org/10.1145/ 3488057. · DOI
  91. F. Ali, Q. Zhang, M. Tauni, and K. Shahzad, "Social Chatbot: My Friend in my Distress," International Journal of Human- Computer Interaction 40, no. 7 (2024): 1702-1712, https:// doi.org/10.1080/10447318.2022.2150745. · DOI
  92. P. Kaywan, K. Ahmed, Y. Miao, A. Ibaida, and B. Gu, "DEPRA: An Early Depression Detection Analysis Chatbot," in International Conference on Health Information Science, Lecture Notes in Computer Science (Springer, 2021), https://doi.org/10.1007/978-3-030-90885-0_18. · DOI
  93. T. Saha, S. Reddy, A. Das, S. Saha, and P. Bhattacharyya, "A Shoulder to Cry On: Towards a Motivational Virtual Assis- tant for Assuaging Mental Agony," in Proceedings of the 2022 Conference of the North American Chapter of the Associ- ation for Computational Linguistics: Human Language Tech- nologies (Association for Computational Linguistics, 2022), 2436-2449.
  94. V. Mai, A. Bauer, C. Deggelmann, C. Neef, and A. Richert, "AI-Based Coaching: Impact of a Chatbot's Disclosure Behavior on the Working Alliance and Acceptance," in Lecture Notes in Computer Science HCI International 2022 -Late Breaking Papers: Interacting With Extended Reality and Artificial Intelligence (Springer Nature Switzer- land, 2022), 391-406, https://doi.org/10.1007/978-3-031- 21707-4_28. 28 Human Behavior and Emerging Technologies · DOI
  95. P. Dev, S. Haque, A. Noor, et al., "A Comparative Study of Chatbot Catered Toward Mental Health," in Proceed- ings of the 2022 IEEE International Conference on Artifi- cial Intelligence in Engineering and Technology (IICAIET) (IEEE, 2022), https://doi.org/10.1109/IICAIET55139.2022. 9936778. · DOI
  96. R. X. Schwartz, A. Ramanan, D. Patel, A. Lynch, S. Baee, and L. Barnes, "Dara: Development of a Chatbot Support System for an Anxiety Reduction Digital Intervention," in Proceed- ings of the 2022 Systems and Information Engineering Design Symposium (SIEDS) (IEEE, 2022), https://doi.org/10.1109/ SIEDS55548.2022.9799419. · DOI
  97. D. Gifu and E. Pop, "Smart Solutions to Keep Your Mental Balance," Procedia Computer Science 214 (2022): 503-510, https://doi.org/10.1016/j.procs.2022.11.205. · DOI
  98. M. Gotthardt, J. Striegl, C. Loitsch, and G. Weber, "Voice Assistant-Based CBT for Depression in Students: Effects of Empathy-Driven Dialog Management," in Computers Help- ing People With Special Needs. ICCHP-AAATE 2022, Lecture Notes in Computer Science (Springer, 2022), https://doi.org/ 10.1007/978-3-031-08648-9_52. · DOI
  99. J. Striegl, M. Gotthardt, C. Loitsch, and G. Weber, "Inves- tigating the Usability of Voice Assistant-Based CBT for Age-Related Depression," in Computers Helping People With Special Needs. ICCHP-AAATE 2022, Lecture Notes in Com- puter Science (Springer, 2022), https://doi.org/10.1007/978- 3-031-08648-9_50. · DOI
  100. A. U. Hussna, A. N. K. Laz, M. S. Sikder, J. Uddin, H. Tinmaz, and A. M. Esfar-E-Alam, "PRERONA: Mental Health Bengali Chatbot for Digital Counselling," in Intelligent Human Com- puter Interaction, eds. M. Singh, D. Kang, J. Lee, U. Tiwary, D. Singh, and W. Chung (Springer, 2021), 274-286, https:// doi.org/10.1007/978-3-030-68449-5_28. · DOI
  101. D. Y. Park and H. Kim, "Determinants of Intentions to Use Digital Mental Healthcare Content Among University Stu- dents, Faculty, and Staff: Motivation, Perceived Usefulness, Perceived Ease of Use, and Parasocial Interaction With AI Chatbot," Sustainability 15, no. 1 (2023): 872, https:// doi.org/10.3390/su15010872. · DOI
  102. B. Inkster, M. Kadaba, and V. Subramanian, "Understanding the Impact of an AI-Enabled Conversational Agent Mobile App on Users' Mental Health and Wellbeing With a Self- Reported Maternal Event: A Mixed Method Real-World Data mHealth Study," Frontiers in Global Women's Health 4 (2023): https://doi.org/10.3389/fgwh.2023.1084302. · DOI
  103. P. Kaywan, K. Ahmed, A. Ibaida, Y. Miao, and B. Gu, "Early Detection of Depression Using a Conversational AI Bot: A Non-Clinical Trial," PLoS One 18, no. 2 (2023): e0279743, https://doi.org/10.1371/journal.pone.0279743. · DOI
  104. Q. Wang, S. Peng, Z. Zha, et al., "Enhancing the Conversa- tional Agent With an Emotional Support System for Mental Health Digital Therapeutics," Frontiers in Psychiatry 14 (2023): https://doi.org/10.3389/fpsyt.2023.1148534. · DOI
  105. F. Delahunty, I. D. Wood, and M. Arcan, "First Insights on a Passive Major Depressive Disorder Prediction System With Incorporated Conversational Chatbot," AICS (pp. 327-338, https://ceur-ws.org/Vol-2259/aics_30.pdf.
  106. L. Tavabi, A. Poon, A. S. Rizzo, and M. Soleymani, "Com- puter-Based PTSD Assessment in VR Exposure Therapy," in International Conference on Human-Computer Interac- tion, Lecture Notes in Computer Science (Springer, 2020), https://doi.org/10.1007/978-3-030-59990-4_32. · DOI
  107. E. Vermetten, M. L. Tielman, E. Van Dort, et al., "Using VR- Based Interventions, Wearable Technology, and Text Mining to Improve Military and Veteran Mental Health," Journal of Military Veteran and Family Health 6, no. S1 (2020): 26-35, https://doi.org/10.3138/jmvfh.2019-0033. · DOI
  108. K. Shidara, H. Tanaka, H. Adachi, et al., "Automatic Thoughts and Facial Expressions in Cognitive Restructuring With Virtual Agents," Frontiers in Computer Science 4 (2022): https://doi.org/10.3389/fcomp.2022.762424. · DOI
  109. K. Denecke, S. Vaaheesan, and A. Arulnathan, "A Mental Health Chatbot for Regulating Emotions (SERMO) -Con- cept and Usability Test," IEEE Transactions on Emerging Topics in Computing 9, no. 3 (2021): 1170-1182, https:// doi.org/10.1109/TETC.2020.2974478. · DOI
  110. S. Karkosz, J. M. Michałowski, K. Sanna, N. Szczepaniak, and B. Konat, "Human-Therapeutic Chatbot Interaction Analy- sis, on the Example of Fido," in International Conference on Human-Computer Interaction (Springer, 2022), https:// doi.org/10.1007/978-3-031-06394-7_53. · DOI
  111. I. Salhi, K. E. Guemmat, M. Qbadou, and K. Mansouri, "Towards Developing a Pocket Therapist: An Intelligent Adaptive Psychological Support Chatbot Against Mental Health Disorders in a Pandemic Situation," Indonesian Jour- nal of Electrical Engineering and Computer Science 23, no. 2 (2021): 1200, https://doi.org/10.11591/ijeecs.v23.i2.pp1200- 1211. · DOI
  112. C. V. Wheeler, "Regulating AI Therapy Chatbots: A Call for Federal Oversight," Texas A&M Law Review 12, no. 2 (2025): 891-923, https://doi.org/10.37419/LR.V12.I2.9. · DOI
  113. N. Tawiah and J. P. Monestime, "Promoting Equity in AI- Driven Mental Health Care for Marginalized Populations," Proceedings of the AAAI Symposium Series 4, no. 1 (2024): 323-327, https://doi.org/10.1609/aaaiss.v4i1.31810. · DOI
  114. H. R. Saeidnia, S. G. Hashemi Fotami, B. Lund, and N. Ghiasi, "Ethical Considerations in Artificial Intelligence Interven- tions for Mental Health and Well-Being: Ensuring Responsi- ble Implementation and Impact," Social Sciences 13, no. 7 (2024): 381, https://doi.org/10.3390/socsci13070381. · DOI
  115. H. Morrin, L. Nicholls, M. Levin, et al., Delusions by Design? How Everyday AIs Might Be Fuelling Psychosis (and What Can Be Done About It) (PsyArXiv Preprints, 2025).
  116. I. Grey, P. Tohme, J. Thomas, M. Al Mazrouie, and R. Abi-Habib, "Preferred Therapist Characteristics of Mus- lim College Women in the United Arab Emirates: Implica- tions for Psychotherapy," Mental Health, Religion & Culture 23, no. 9 (2020): 745-755, https://doi.org/ 10.1080/13674676.2020.1795823. · DOI
  117. Z. V. Segal, J. M. G. Williams, and J. D. Teasdale, Mindful- ness-Based Cognitive Therapy for Depression: A New Approach to Preventing Relapse (Guilford Press, 2002).
  118. M. Holohan and R. Müller, "Beyond Humanism: Telling Response-Able Stories About Significant Otherness in Human-Chatbot Relations," Frontiers in Psychology 15 (2024): https://doi.org/10.3389/fpsyg.2024.1357572. · DOI
  119. M. Meadi, J. Bernstein, N. Batelaan, A. Van Balkom, and S. Metselaar, "Does a Lack of Emotions Make Chatbots Unfit to Be Psychotherapists?," Bioethics 38, no. 6 (2024): 503-510, https://doi.org/10.1111/bioe.13299. · DOI · Paper page
  120. M. A. Kuhail, N. Alturki, J. Thomas, A. K. Alkhalifa, and A. Alshardan, "Human-Human vs Human-AI Therapy: An Empirical Study," International Journal of Human-Computer Interaction 41, no. 11 (2025): 6841-6852, https://doi.org/ 10.1080/10447318.2024.2385001. · DOI
  121. A. Sharma, I. W. Lin, A. S. Miner, D. C. Atkins, and T. Althoff, "Human-AI Collaboration Enables More Empathic Conversa- tions in Text-Based Peer-to-Peer Mental Health Support" 2022, arxiv, https://arxiv.org/abs/2203.15144. · arXiv
  122. H. Chin, H. Song, G. Baek, et al., "The Potential of Chatbots for Emotional Support and Promoting Mental Well-Being in Different Cultures: Mixed Methods Study," Journal of Medical Internet Research 25 (2023): e51712, https:// doi.org/10.2196/51712. · DOI
  123. V. Nittas, P. Daniore, S. J. Chavez, and T. B. Wray, "Chal- lenges in Implementing Cultural Adaptations of Digital Health Interventions," Communications Medicine 4, no. 1 (2024): https://doi.org/10.1038/s43856-023-00426-2. · DOI
  124. S. Jameel, M. Munivenkatappa, S. S. Arumugham, and K. Thennarasu, "Cultural Adaptation of Cognitive Behaviour Therapy for Depression: A Qualitative Study Exploring Views of Patients and Practitioners From India," Cognitive Behaviour Therapist 15 (2022): https://doi.org/10.1017/ S1754470X22000137. · DOI
  125. S. Shafiq, Z. Bano, S. S. Randhawa, K. H. Khan, Q. A. Muhammad, and A. Muhammad, "Effectiveness of Adapted Cognitive Behaviour Therapy for Dysthymia: An Evidence Based Case Study," Journal of the Pakistan Medical Associa- tion 72, no. 3 (2022): 554-554.
  126. L. Balcombe, "AI Chatbots in Digital Mental Health," Infor- matics 10, no. 4 (2023): 82, https://doi.org/10.3390/ informatics10040082. · DOI
  127. H. Park, M. Jung, M. Ji, J. Kim, and U. Oh, "Muse Alpha: Pri- mary Study of AI Chatbot for Psychotherapy With Socratic Methods," in Proceedings of the 2023 Congress in Computer Science, Computer Engineering, & Applied Computing (CSCE) (IEEE, 2023), https://doi.org/10.1109/CSCE60160.2023.00431. · DOI
  128. G. R. Shegekar, S. R. Gajbhiye, G. S. Bhosale, and S. S. Adi- kane, "Review Paper on AI Chatbot for Mental Health Sup- port," International Journal for Research in Applied Science and Engineering Technology 12, no. 10 (2024): 252-254, https://doi.org/10.22214/ijraset.2024.64499. · DOI
  129. G. Yew, "Trust in and Ethical Design of Carebots: The Case for Ethics of Care," International Journal of Social Robotics 13, no. 4 (2021): 629-645, https://doi.org/10.1007/s12369- 020-00653-w. · DOI
  130. S. Atkins, I. Badrie, and S. Otterloo, "Applying Ethical AI Frameworks in Practice: Evaluating Conversational AI Chat- bot Solutions," Computers and Society Research Journal 1 (2021): https://doi.org/10.54822/QXOM4114. · DOI
  131. D. Ramandanis and S. Xinogalos, "Designing a Chatbot for Contemporary Education: A Systematic Literature Review," Information 14, no. 9 (2023): 503, https://doi.org/10.3390/ info14090503. · DOI
  132. J. Liu, D. Li, H. Cao, T. Ren, Z. Liao, and J. Wu, "ChatCoun- selor: A Large Language Models for Mental Health Support" 2023, https://arxiv.org/abs/2309.15461. 30 Human Behavior and Emerging Technologies · arXiv
  133. I. Song, S. Pendse, N. Kumar, and M. De Choudhury, "The Typing Cure: Experiences With Large Language Model Chat- bots for Mental Health Support" 2024, https://arxiv.org/abs/ 2401.14362.
  134. A. Heinz, R. El-Baba, M. Botvinick, N. Goodman, K. Lee, and T. Singer, "Response to Letters About "Randomized Trial of a Generative AI Chatbot for Mental Health Treatment"," NEJM AI 2, no. 9 (2025): https://doi.org/10.1056/AIp2500680. · DOI
  135. L. Hipgrave, J. Goldie, S. Dennis, and A. Coleman, "Balancing Risks and Benefits: Clinicians' Perspectives on the Use of Generative AI Chatbots in Mental Healthcare," Frontiers in Digital Health 7 (2025): https://doi.org/10.3389/ fdgth.2025.1606291. · DOI
  136. S. Siddals, J. Torous, and A. Coxon, ""It Happened to be the Perfect Thing": Experiences of Generative AI Chatbots for Mental Health," Npj Mental Health Research 3, no. 1 (2024): https://doi.org/10.1038/s44184-024-00097-4. · DOI · Paper page
  137. M. De Choudhury, S. Pendse, and N. Kumar, "Benefits and Harms of Large Language Models in Digital Mental Health" 2023, https://arxiv.org/abs/2311.14693. · arXiv
  138. T. Heston, "Evaluating Risk Progression in Mental Health Chatbots Using Escalating Prompts," medRxiv (2023): https://doi.org/10.1101/2023.09.10.23295321. · DOI
  139. J. I. Park, M. Abbasian, I. Azimi, et al., "Building Trust in Mental Health Chatbots: Safety Metrics and LLM-Based Evaluation Tools" https://arxiv.org/abs/2408.04650. · arXiv

Cited by

Sorted by citations

Authors
Kuhail, M. A., Al-Shamaileh, O., Farooq, S., Shahin, H., Abdelzaher, F., & Thomas, J.
Affiliations
  • Zayed University (AE)
  • University of Alberta (CA)
  • University of Liverpool (GB)
Corresponding author
Kuhail, Mohammad Amin
Venue
Human Behavior and Emerging Technologies
Publisher
Wiley
Published
2025-01
Volume
2025
Issue
1
ISSN
2578-1863 (ISSN-L)
OpenAlex
W7106712149
Cited by
11
References
43
Citations by year
2026: 11
FWCI
1.28
Type
journal article
Language
en
Open access
Locations
  • Human Behavior and Emerging Technologies (publishedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
Zayed University (R23014)
Topics
  • Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
  • Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Emotion and Mood Recognition
Keywords
mental health chatbots, chatbots, chatbot evaluation, cognitive behavioral therapy, depression, cultural adaptation, human-in-the-loop, large language models, third-wave therapies

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review