Development and Evaluation of ClientBot: Patient-Like Conversational Agent to Train Basic Counseling Skills
Open accessPublished version of a preprint
Abstract
BACKGROUND: Training therapists is both expensive and time-consuming. Degree-based training can require tens of thousands of dollars and hundreds of hours of expert instruction. Counseling skills practice often involves role-plays, standardized patients, or practice with real clients. Performance-based feedback is critical for skill development and expertise, but trainee therapists often receive minimal and subjective feedback, which is distal to their skill practice. OBJECTIVE: In this study, we developed and evaluated a patient-like neural conversational agent, which provides real-time feedback to trainees via chat-based interaction. METHODS: The text-based conversational agent was trained on an archive of 2354 psychotherapy transcripts and provided specific feedback on the use of basic interviewing and counseling skills (ie, open questions and reflections-summary statements of what a client has said). A total of 151 nontherapists were randomized to either (1) immediate feedback on their use of open questions and reflections during practice session with ClientBot or (2) initial education and encouragement on the skills. RESULTS: Participants in the ClientBot condition used 91% (21.4/11.2) more reflections during practice with feedback (P<.001) and 76% (14.1/8) more reflections after feedback was removed (P<.001) relative to the control group. The treatment group used more open questions during training but not after feedback was removed, suggesting that certain skills may not improve with performance-based feedback. Finally, after feedback was removed, the ClientBot group used 31% (32.5/24.7) more listening skills overall (P<.001). CONCLUSIONS: This proof-of-concept study demonstrates that practice and feedback can improve trainee use of basic counseling skills.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Providing supervision and performance feedback during and after psychotherapy sessions enhances trainees' and therapists' skills acquisition and retention.
“Providing supervision and performance feedback during and after psychotherapy sessions enhances trainees’ and therapists’ skills acquisition and retention [20,23].”
From Attitudes Toward the Adoption of 2 Artificial Intelligence–Enabled Mental Health Tools Among Prospective Psychotherapists: Cross-sectional Study (2023) · cites this paper as [20]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · see citing works
Neural Networks: A Comprehensive Foundation
Haykin, S. (1998) · Cited by 30,070 · see citing works
Hattie, J., & Timperley, H. (2007) · Review of Educational Research · doi:10.3102/003465430298487 · Cited by 12,905 · cited 2× · see citing works
“Research from cognitive science suggests delayed, nonspecific feedback is not sufficient to promote learning and develop expertise [15].”
Amazon's Mechanical Turk: A New Source of Inexpensive, Yet High-Quality, Data?
Buhrmester, M., Kwang, T., & Gosling, S. D. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691610393980 · Cited by 9,996 · see citing works
Learning long-term dependencies with gradient descent is difficult
Bengio, Y., Simard, P., & Frasconi, P. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.279181 · Cited by 8,542 · see citing works
(2010) · Cited by 8,261 · see citing works
Kluger, A. N., & DeNisi, A. (1996) · Psychological Bulletin · doi:10.1037/0033-2909.119.2.254 · Cited by 5,882 · see citing works
Motivational Interviewing: Helping People Change
Tober, G. (2013) · Alcohol and Alcoholism · doi:10.1093/alcalc/agt010 · Cited by 4,267 · see citing works
Advances in natural language processing
Hirschberg, J., & Manning, C. D. (2015) · Science · doi:10.1126/science.aaa8685 · Cited by 1,712 · see citing works
Schmidt, R. A., & Bjork, R. A. (1992) · Psychological Science · doi:10.1111/j.1467-9280.1992.tb00029.x · Cited by 1,582 · cited 1× · see citing works
“The Schmidt study [43] has pointed out that treatment differences in acquisition do not necessarily have an impact on retention and transfer.”
Vinyals, O., & Le, Q. (2015) · arXiv · doi:10.48550/arxiv.1506.05869 · Cited by 1,400 · see citing works
Assessing competence in the use of motivational interviewing
Moyers, T. B., Martin, T., Manuel, J. K., Hendrickson, S. M. L., & Miller, W. R. (2005) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2004.11.001 · Cited by 738 · see citing works
Towards AI-Complete Question Answering: A Set of Prerequisite Toy Tasks
Weston, J., Bordes, A., Chopra, S., Rush, A. M., van Merriënboer, B., Joulin, A., & Mikolov, T. (2015) · arXiv · doi:10.48550/arxiv.1502.05698 · Cited by 670 · see citing works
County-level estimates of mental health professional shortage in the United States.
Thomas, K., Ellis, A. R., Konrad, T., Holzer, C., & Morrissey, J. (2009) · Psychiatric Services · doi:10.1176/ps.2009.60.10.1323 · Cited by 589 · see citing works
Defining competencies in psychology supervision: A consensus statement
Falender, C. A., Cornish, J. A. E., Goodyear, R. K., Hatcher, R. L., Kaslow, N. J., Leventhal, G. S., Shafranske, E. P., Sigmon, S. T., Stoltenberg, C. D., & GRUS, C. L. (2004) · Journal of Clinical Psychology · doi:10.1002/jclp.20013 · Cited by 355 · see citing works
Sustaining motivational interviewing: A meta-analysis of training studies
Schwalbe, C. S., Oh, H. Y., & Zweben, A. (2014) · Addiction · doi:10.1111/add.12558 · Cited by 343 · see citing works
Behavioral Signal Processing: Deriving Human Behavioral Informatics From Speech and Language
Narayanan, S. S., & Georgiou, P. G. (2013) · Proceedings of the IEEE · doi:10.1109/jproc.2012.2236291 · Cited by 286 · see citing works
Expertise in psychotherapy: An elusive goal?
Tracey, T. J. G., Wampold, B. E., Lichtenberg, J. W., & Goodyear, R. K. (2014) · American Psychologist · doi:10.1037/a0035099 · Cited by 270 · see citing works
Bias detectives: the researchers striving to make algorithms fair
Courtland, R. (2018) · Nature · doi:10.1038/d41586-018-05469-3 · Cited by 205 · see citing works
Gallucci, G., Swartz, W., & Hackerman, F. (2005) · Psychiatric Services · doi:10.1176/appi.ps.56.3.344 · Cited by 193 · see citing works
“Sorry, I’m Not Accepting New Patients”
Kugelmass, H. (2016) · Journal of Health and Social Behavior · doi:10.1177/0022146516647098 · Cited by 164 · see citing works
Tanana, M., Hallgren, K. A., Imel, Z. E., Atkins, D. C., & Srikumar, V. (2016) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2016.01.006 · Cited by 141 · see citing works
Self-citationAtkins, D. C., Steyvers, M., Imel, Z. E., & Smyth, P. (2014) · Implementation Science · doi:10.1186/1748-5908-9-49 · Cited by 130 · see citing works
Self-citationXiao, B., Imel, Z. E., Georgiou, P., Atkins, D. C., & Narayanan, S. S. (2015) · PLoS ONE · doi:10.1371/journal.pone.0143055 · Cited by 111 · see citing works
Self-citationDesigning Contestability: Interaction Design, Machine Learning, and Mental Health
Hirsch, T., Merced, K., Narayanan, S., Imel, Z. E., & Atkins, D. C. (2017) · Proceedings of the 2017 Conference on Designing Interactive Systems · doi:10.1145/3064663.3064703 · Cited by 110 · see citing works
Self-citationThe impact of psychotherapy training: Introduction to the special section
Helge Rønnestad, M., & Ladany, N. (2006) · Psychotherapy Research · doi:10.1080/10503300600612241 · Cited by 89 · see citing works
Hubal, R. C., Kizakevich, P. N., Guinn, C. I., Merino, K. D., & West, S. L. (2000) · PubMed · Cited by 78 · see citing works
Evidence‐based clinical supervision: rationale and illustration
Milne, D. L., & Westerman, C. (2001) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.297 · Cited by 67 · see citing works
Helping Skills: Facilitating Exploration, Insight, and Action
Levenson, H. (2001) · Psychotherapy Research · doi:10.1093/ptr/11.1.124 · Cited by 67 · see citing works
Virtual reality in psychotherapy training
Beutler, L. E., & Harwood, T. M. (2004) · Journal of Clinical Psychology · doi:10.1002/jclp.10266 · Cited by 65 · see citing works
Rosengren, D. B., Hartzler, B. J., Baer, J. S., Wells, E. A., & Dunn, C. W. (2008) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2008.03.018 · Cited by 61 · see citing works
Can, D., Marín, R. A., Georgiou, P., Imel, Z. E., Atkins, D. C., & Narayanan, S. S. (2016) · Journal of Counseling Psychology · doi:10.1037/cou0000111 · Cited by 61 · see citing works
Self-citationXiao, B., Huang, C.-W., Imel, Z. E., Atkins, D. C., Georgiou, P., & Narayanan, S. S. (2016) · PeerJ Computer Science · doi:10.7717/peerj-cs.59 · Cited by 52 · see citing works
Self-citation"It's hard to argue with a computer"
Hirsch, T., Soma, C. S., Merced, K., Kuo, P. B., Dembe, A., Caperton, D. D., Atkins, D. C., & Imel, Z. E. (2018) · Designing Interactive Systems Conference · doi:10.1145/3196709.3196776 · Cited by 42 · see citing works
Self-citationUsing Standardized Patients for Formative Feedback in an Introduction to Psychotherapy Course
Klamen, D. L. (2002) · Academic Psychiatry · doi:10.1176/appi.ap.26.3.168 · Cited by 36 · see citing works
Artificial Intelligence: A Frontier of Automation
Samuel, A. L. (1962) · The Annals of the American Academy of Political and Social Science · doi:10.1177/000271626234000103 · Cited by 29 · see citing works
Baer, J. S., Carpenter, K. M., Beadnell, B. A., Stoner, S. A., Ingalsbe, M. H., Hartzler, B. J., Rosengren, D. B., & Drager, Z. (2012) · Journal of Studies on Alcohol and Drugs · doi:10.15288/jsad.2012.73.154 · Cited by 15 · see citing works
Clinical Communication Skills in Medicine
Suresh, E. (2024) · CRC Press eBooks · doi:10.1201/9781003533337 · Cited by 8 · see citing works
Flagged first, then by citations
Research works printed but not linked: 3
- [23]Miller WR Rollnick S Motivational Interviewing: Helping People Change 2012 New York City Guilford Press
- [27]Jurafsky D Martin JH An introduction to natural language processing, computational linguistics, and speech recognition Prentice Hall Series in Artificial Intelligence 2009 Upper Saddle River, New Jersey Prentice Hall, Pearson Educational International 1 1024
- [40]Collobert R Kavukcuoglu K Farabet C Torch7: A matlab-like environment for machine learning 2011 NIPS 2011 December 12-17, 2011 Granada, Spain 1 6
Cited by
Sorted by citations
Sharma, A., Lin, I. W., Miner, A. S., Atkins, D. C., & Althoff, T. (2023) · Nature Machine Intelligence · doi:10.1038/s42256-022-00593-2 · Cited by 500 · see citing works
Self-citationBickman, L. (2020) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-020-01065-8 · Cited by 184 · see citing works
A Scoping Review of Machine Learning in Psychotherapy Research
Aafjes-van Doorn, K., Kamsteeg, C., Bate, J., & Aafjes, M. (2021) · Psychotherapy Research · doi:10.1080/10503307.2020.1808729 · Cited by 179 · see citing works
Maher, C. A., Davis, C. R., Curtis, R. G., Short, C. E., & Murphy, K. J. (2020) · JMIR mHealth and uHealth · doi:10.2196/17558 · Cited by 165 · see citing works
Sharma, A. K., Lin, I. W., Miner, A. S., Atkins, D. C., & Althoff, T. (2021) · International World Wide Web Conference (WWW) · doi:10.1145/3442381.3450097 · Cited by 168 · see citing works
Self-citationSharma, A., Rushton, K., Lin, I. W., Nguyen, T., & Althoff, T. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642761 · Cited by 119 · see citing works
Imel, Z. E., Pace, B. T., Soma, C. S., Tanana, M., Hirsch, T., Gibson, J., Georgiou, P., Narayanan, S. S., & Atkins, D. C. (2019) · Psychotherapy · doi:10.1037/pst0000221 · Cited by 96 · see citing works
Self-citationDai, C., Ke, F., Pan, Y., Moon, J., & Liu, Z. (2024) · Educational Psychology Review · doi:10.1007/s10648-024-09855-4 · Cited by 91 · see citing works
Debets, T., Banihashem, S. K., Brinke, D. J.-T., Vos, T. E. J., Wenniger, G. M. D. B., & Camp, G. (2025) · Computers & Education · doi:10.1016/j.compedu.2025.105323 · Cited by 113 · see citing works
Proof of Concept: Using ChatGPT to Teach Emergency Physicians How to Break Bad News
Webb, J. J. (2023) · Cureus · doi:10.7759/cureus.38755 · Cited by 80 · see citing works
Ba, S., Yang, L., Yan, Z., Looi, C. K., & Gašević, D. (2025) · Computers and Education Open · doi:10.1016/j.caeo.2025.100284 · Cited by 84 · see citing works
Here's to the future: Conversational agents in higher education- a scoping review
Pereira, D. S. M., Falcão, F., Costa, L., Lunn, B. S., Pêgo, J. M., & Costa, P. (2023) · International Journal of Educational Research · doi:10.1016/j.ijer.2023.102233 · Cited by 75 · see citing works
Cognitive Reframing of Negative Thoughts through Human-Language Model Interaction
Sharma, A., Rushton, K., Lin, I. W., Wadden, D., Lucas, K., Miner, A. S., Nguyen, T., & Althoff, T. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.555 · Cited by 76 · see citing works
An Overview of the Use of Chatbots in Medical and Healthcare Education
Frangoudes, F., Hadjiaros, M., Schiza, E. C., Matsangidou, M., Tsivitanidou, O., & Neokleous, K. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-77943-6_11 · Cited by 51 · see citing works
Kleine, A.-K., Kokje, E., Lermer, E., & Gaube, S. (2023) · JMIR Human Factors · doi:10.2196/46859 · Cited by 49 · see citing works
Shen, S., WELCH, C. A., Mihalcea, R. F., & Pérez‐Rosas, V. (2020) · Annual Meeting of the Special Interest Group on Discourse and Dialogue · doi:10.18653/v1/2020.sigdial-1.2 · Cited by 42 · see citing works
Virtual Simulations to Train Social Workers for Competency-Based Learning: A Scoping Review
Baker, E. A., & Jenney, A. (2022) · Journal of Social Work Education · doi:10.1080/10437797.2022.2039819 · Cited by 39 · see citing works
Developing a natural language-based AI-chatbot for social work training: an illustrative case study
Chan, C., & Li, F. (2023) · China Journal of Social Work · doi:10.1080/17525098.2023.2176901 · Cited by 27 · see citing works
Meyer, S., & Elsweiler, D. (2025) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2025.103514 · Cited by 34 · see citing works
Technology-Based Methods for Training Counseling Skills in Behavioral Health: a Scoping Review
Magill, M., Mastroleo, N. R., & Martino, S. (2022) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-022-00252-8 · Cited by 25 · see citing works
Duro, E. S. D., Improta, R., & Stella, M. (2025) · Emerging Trends in Drugs Addictions and Health · doi:10.1016/j.etdah.2025.100170 · Cited by 26 · see citing works
A Multi-Persona Chatbot for Hotline Counselor Training
DeMasi, O., Li, Y., & Yu, Z. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.324 · Cited by 24 · see citing works
Adaptive Empathy Learning Support in Peer Review Scenarios
Wambsganss, T., Soellner, M., Koedinger, K. R., & Leimeister, J. M. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517740 · Cited by 24 · see citing works
PAIR: Prompt-Aware margIn Ranking for Counselor Reflection Scoring in Motivational Interviewing
Min, D. J., Pérez‐Rosas, V., Resnicow, K., & Mihalcea, R. F. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.11 · Cited by 22 · see citing works
Investigating psychotherapists’ attitudes towards artificial intelligence in psychotherapy
Wagner, J., & Schwind, A.-S. (2025) · BMC Psychology · doi:10.1186/s40359-025-03071-7 · Cited by 29 · see citing works
Helping the Helper : Supporting Peer Counselors via AI-Empowered Practice and Feedback
Hsu, S.-L., Shah, R. S., Senthil, P., Ashktorab, Z., Dugan, C., Geyer, W., & Yang, D. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3710993 · Cited by 69 · see citing works
Lozoya, D. C., Conway, M., Duro, E. S. D., & D’Alfonso, S. (2025) · JMIR Medical Education · doi:10.2196/68056 · Cited by 22 · see citing works
Bonfitto, G. R., Roletto, A., Savardi, M., Fasulo, S. V., Catania, D., & Signoroni, A. (2024) · Radiography · doi:10.1016/j.radi.2024.02.015 · Cited by 22 · see citing works
Sibley, M., Bickman, L., Atkins, D., Tanana, M. J., Coxe, S., Ortiz, M., Martin, P., King, J., Monroy, J. M., Ponce, T., et al. (2023) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2023.02.001 · Cited by 17 · see citing works
Self-citationJeong, D., Lee, H., Yang, H., Park, J. C., & Lee, S. M. (2025) · Journal of Counseling & Development · doi:10.1002/jcad.12560 · Cited by 18 · see citing works
Meinlschmidt, G., Koc, S., Boerner, E., Tegethoff, M., Simacek, T., Schirmer, L., & Schneider, M. (2025) · BMC Medical Education · doi:10.1186/s12909-025-07307-3 · Cited by 15 · see citing works
Ren, X., Spina, G., Vries, S. D., Bijkerk, A., Faber, B., & Geraedts, A. S. (2020) · IEEE Access · doi:10.1109/access.2020.3005733 · Cited by 15 · see citing works
Rational AIs with emotional deficits: ChatGPT vs. counselors in providing emotional reflections
Eryılmaz, A., & Başal, A. (2024) · Current Psychology · doi:10.1007/s12144-024-06947-w · Cited by 14 · see citing works
Brinsley, J., Singh, B., & Maher, C. A. (2023) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2023.04.023 · Cited by 15 · see citing works
Albaladejo‐González, M., Ruipérez‐Valiente, J. A., & Mármol, F. G. (2024) · ACM Computing Surveys · doi:10.1145/3699712 · Cited by 14 · see citing works
Conversational Agents in Palliative Care: Potential Benefits, Risks, and Next Steps
Schenker, Y., Abdullah, S., Arnold, R. M., & Schmitz, K. H. (2024) · Journal of Palliative Medicine · doi:10.1089/jpm.2023.0534 · Cited by 13 · see citing works
Darnell, D. A., Areán, P. A., Dorsey, S., Atkins, D. C., Tanana, M., Hirsch, T., Mooney, S. D., Boudreaux, E. D., & Comtois, K. A. (2021) · JMIR Research Protocols · doi:10.2196/33695 · Cited by 11 · see citing works
Self-citationLi, J. Z., Herderich, A., & Goldenberg, A. (2024) · doi:10.31234/osf.io/fzvd8 · Cited by 10 · see citing works
Darnell, D. A., Pierson, A., Tanana, M., Dorsey, S., Boudreaux, E. D., Areán, P. A., & Comtois, K. A. (2024) · JMIR Formative Research · doi:10.2196/56402 · Cited by 10 · see citing works
Self-citationHudon, A., Beaudoin, M., Phraxayavong, K., Potvin, S., & Dumais, A. (2023) · Journal of Personalized Medicine · doi:10.3390/jpm13050801 · Cited by 10 · see citing works
Virtual Agent-based Communication Skills Training to Facilitate Health Persuasion Among Peers
Nouraei, F., Rebello, K. J., Fallah, M., Murali, P., Matuszak, H., Jap, V., Parker, A. G., Paasche‐Orlow, M. K., & Bickmore, T. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3711101 · Cited by 10 · see citing works
Herschbach, L., Wietek, T. F., Stegemann–Philipps, C., Sonanini, A., Herrmann, B., Erschens, R. S., Herrmann‐Werner, A., & Holderried, F. (2025) · Journal of Medical Internet Research · doi:10.2196/82818 · Cited by 9 · see citing works
Kotov, A., Carcone, A. I., & Towner, E. (2024) · JMIR Research Protocols · doi:10.2196/60361 · Cited by 10 · see citing works
Chatbot development strategies: a review of current studies and applications
Yiğit, G., & Bayraktar, R. (2025) · Knowledge and Information Systems · doi:10.1007/s10115-025-02462-x · Cited by 9 · see citing works
TherapyTrainer: Using AI to Train Therapists in Written Exposure Therapy
Stade, E. C., Eichstaedt, J., Kaysen, D. L., Salesha, A., Greenberger, A., Singhvi, S., & Stirman, S. (2025) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2025.06.005 · Cited by 9 · see citing works
Oster, C., Leibbrandt, R. E., Schoo, A. M. M., Lange, B. S., Litt, J., Morello, A., Antonello, C., Powers, D. M. W., Maeder, A. J., & Lawn, S. (2022) · International Journal of Health Promotion and Education · doi:10.1080/14635240.2022.2047095 · Cited by 8 · see citing works
Our journey with an AI assistant offering narrative therapy on WhatsApp
Chan, C., Zhao, J., & Zhao, Y. (2024) · Journal of Social Work Practice · doi:10.1080/02650533.2024.2420314 · Cited by 7 · see citing works
Zhang, T. T., Saunders, R., Pilling, S., & O’Driscoll, C. (2026) · JMIR Medical Education · doi:10.2196/84091 · Cited by 7 · see citing works
Aalsma, M. C., Adams, Z. W., Smoker, M. P., Marriott, B. R., Ouyang, F., Meudt, E., & Hulvershorn, L. A. (2023) · The Journal of Behavioral Health Services & Research · doi:10.1007/s11414-023-09833-8 · Cited by 7 · see citing works
Wang, C.-L., & Tseng, Y.-C. (2024) · Extended Abstracts of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613905.3650957 · Cited by 6 · see citing works
Han, Y. (2024) · Korean Journal of Acupuncture · doi:10.14406/acu.2024.001 · Cited by 6 · see citing works
A Case Study on Assessing AI Assistant Competence in Narrative Interviews
Chan, C., Zhao, Y., & Zhao, J. (2024) · F1000Research · doi:10.12688/f1000research.151952.2 · Cited by 5 · see citing works
Sharma, A., Lin, I. W., Miner, A. S., Atkins, D. C., & Althoff, T. (2022) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/747 · Cited by 5 · see citing works
Self-citationAn Exploratory Study of a Narrative Therapy Chatbot with Social Work Students
Chan, C. (2025) · Journal of Technology in Human Services · doi:10.1080/15228835.2025.2559342 · Cited by 6 · see citing works
Schmidt, S., Lozoya, D. C., Kiropoulos, L. A., Conway, M., & D’Alfonso, S. (2025) · BMC Medical Education · doi:10.1186/s12909-025-07668-9 · Cited by 4 · see citing works
Hall, S., Grant, G. D., Hussey, S., Harwood, B., Austin, L., & Gospos, E. (2026) · Currents in Pharmacy Teaching and Learning · doi:10.1016/j.cptl.2026.102588 · Cited by 4 · see citing works
Artificial Intelligence to Support Human-Provided Mental Health Treatment
Soma, C. S., Kuo, P. B., Mehta, M., Srikumar, V., Imel, Z. E., & Atkins, D. C. (2026) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-061724-075336 · Cited by 6 · see citing works
Self-citationDevelopment and Validation of Conversational Agent to Pregnancy Safe-education
Montenegro, J. L. Z., da Costa, C. A., Righi, R. D. R., Farias, E. R., & Matté, L. B. (2023) · Journal of Medical Systems · doi:10.1007/s10916-022-01903-2 · Cited by 4 · see citing works
Sibley, M. H., Bickman, L., Atkins, D. C., Coxe, S. J., King, J., Tanana, M., Martin, P., Page, T. F., Ortiz, M., Tapia, J. D., et al. (2025) · Prevention Science · doi:10.1007/s11121-025-01868-x · Cited by 3 · see citing works
Self-citationOn Using Chatbots to Promote Smoking Cessation Among Adolescents of Low Socioeconomic StatusPreprint
Simon, P., Krishnan‐Sarin, S., & Huang, T.-H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.08814 · Cited by 3 · see citing works
Investigating the use of AI in psychological counseling: systematic review
Li, B., Paracha, S., Limniou, M., & Zhang, X. (2025) · Mental Health and Digital Technologies · doi:10.1108/mhdt-04-2025-0027 · Cited by 4 · see citing works
Exploring More-than-human Ethics of Large Language Models in Social Service Delivery
Seniutis, M., Sas, A., & Gružauskas, V. (2026) · Ethics and Social Welfare · doi:10.1080/17496535.2025.2593823 · Cited by 2 · see citing works
AI in Social Work, Counseling, and Psychology Education
Rafi, S. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-4362-4.ch001 · Cited by 2 · see citing works
Provence, S., & Forcehimes, A. A. (2024) · Cureus · doi:10.7759/cureus.57719 · Cited by 2 · see citing works
Kaewrattanapat, N., Wannapiroon, P., & Nilsook, P. (2023) · International Education Studies · doi:10.5539/ies.v16n2p103 · Cited by 2 · see citing works
One-Sided Parasociality with AI
Degen, J. L. (2025) · Palgrave Studies in Cyberpsychology. · doi:10.1007/978-3-032-07438-6_5 · Cited by 2 · see citing works
Scaling Empathy: How AI Enhances Advisor Communication Skills to Promote Financial Wellness
Lynn, C. (2026) · Financial Planning Review · doi:10.1002/cfp2.70025 · Cited by 1 · see citing works
GenAI for Social Work Field Education: Client Simulation with Real-Time Feedback
Sungarda, J., Liu, H., Zhou, Z., Wu, T.-H., Cheung, J. C.-S., & Kao, B. (2025) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata66926.2025.11402062 · Cited by 1 · see citing works
Developing AI-powered virtual patient chatbots for diagnostic reasoning training
Han, Y., Park, Y., & Lee, J. (2026) · Academic Medicine · doi:10.1093/acamed/wvag094 · Cited by 1 · see citing works
Ha, T. L., Han, I., Yang, H., & Lee, S. M. (2026) · Asia Pacific Education Review · doi:10.1007/s12564-026-10134-w · Cited by 1 · see citing works
Evaluating AI-based Mental Health Interventions
Sharma, A. (2026) · ACM eBooks · doi:10.1145/3749728.3749733 · Cited by 1 · see citing works
Errors Behind Asking Open-Ended Questions: A Study in Individual Counseling Class
Afrida, Y., & Yusri, F. (2020) · Jurnal Educative Journal of Educational Studies · doi:10.30983/educative.v5i2.3679 · Cited by 1 · see citing works
Lehmann, R., Albrecht, J., & Zauter, S. (2021) · Perspektiven Sozialwirtschaft und Sozialmanagement · doi:10.1007/978-3-658-32556-5_12 · Cited by 1 · see citing works
Kleine, A., Kokje, E., Gaube, S., & Lermer, E. (2023) · doi:10.31234/osf.io/c8yr3 · Cited by 1 · see citing works
Online Training and Monitoring of Clinical Skills in Behavioral Health: A Scoping Review (Preprint)Preprint
Magill, M., Mastroleo, N. R., & Martino, S. (2020) · doi:10.2196/preprints.22116
Evaluating Language Models for Assessing Counselor Reflections
Min, D. J., Pérez‐Rosas, V., Resnicow, K., & Mihalcea, R. F. (2024) · ACM Transactions on Computing for Healthcare · doi:10.1145/3709364
Zhang, T. T., Saunders, R., Pilling, S., & O’Driscoll, C. (2025) · doi:10.2196/preprints.84091
Mallon, C., Murphy, T., McFarlane, S., Gorman, C., Mulvenna, M. D., Gorman, J., McTear, M., Bond, R. R., & Ennis, E. (2025) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn64981.2025.11227816
Effects of a Customized Chatbot Intervention on Social Work Students’ Counseling Self-Efficacy
Mo, K. Y., Chow, L., Mok, L. W.-K., & Wang, C. J.-Y. (2025) · Research on Social Work Practice · doi:10.1177/10497315251394310
Lawrence, H., Stirman, S. W., Dorison, S. H., Yun, T., & Jones, M. (2026) · doi:10.2196/preprints.91157
Using ChatGPT to Reduce Academic Misconduct in a Systems Analysis Course: a Case Study
Mason, R., Seton, C., & Benson, J. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-13056-3_1
Converse, E., Louie, R., Safer, D. L., Pacheco, J. P., Fang, W., Kent, J., Arnow, B. A., & Yang, D. (2026) · doi:10.2196/preprints.93199
Liu, H., Tuerxun, N., & Chen, J. (2026) · Research Square · doi:10.21203/rs.3.rs-9368123/v1
MIAdvisor: Enhancing counselor competence in motivational interviewing through visual analytics
Wang, X., Ye, J., Zhang, G., Liu, Y., & Guo, H. (2026) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2026.103853
Evaluating Role-Consistency in LLMs for Counselor Training
Rudolph, E., Engert, N., & Albrecht, J. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-21997-8_26 · Cited by 2 · see citing works
Supplementary Material for Evaluating AI-Based Mental Health Interventions
Sharma, A. (2026) · ACM eBooks · doi:10.1145/3749728.3749737
Human–AI Collaboration to Empower People Seeking Support
Sharma, A. (2026) · ACM eBooks · doi:10.1145/3749728.3749732
(2026) · ACM eBooks · doi:10.1145/3749728.3749738
(2026) · ACM eBooks · doi:10.1145/3749728.3749739
Supplementary Materials for Human–AI Collaboration to Empower People Providing Support
Sharma, A. (2026) · ACM eBooks · doi:10.1145/3749728.3749735
Human–AI Collaboration to Empower People Providing Support
Sharma, A. (2026) · ACM eBooks · doi:10.1145/3749728.3749731
Sharma, A. (2026) · ACM eBooks · doi:10.1145/3749728.3749730
(2026) · ACM eBooks · doi:10.1145/3749728.3749729
Supplementary Materials for Human–AI Collaboration to Empower People Seeking Support
Sharma, A. (2026) · ACM eBooks · doi:10.1145/3749728.3749736
(2026) · ACM eBooks · doi:10.1145/3749728.3749734
Owayyed, M. A., Tielman, M. L., & Brinkman, W. (2026) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2026.103923
Khan, N., Sheibani, N., Sequeira, L., Gauvreau, S., Palachi, A., Naveed, A., Shearkhani, S., Ensan, F., Raman, P., & Milligan, K. (2026) · doi:10.2196/preprints.109043
Virtual Strings Attached - Implementing SIAs with Attachment Styles for Psychotherapist Training
Reinwarth, A. L., Tsovaltzi, D., Gebhard, P., Altmann, U., & Wessler, J. (2026) · Companion Publication of the International Conference on Multimodal Interaction (ICMI Companion) · doi:10.1145/3776591.3836660
Converse, E., Louie, R., Safer, D. L., Pacheco, J. P., Fang, W., Kent, J., Arnow, B. A., & Yang, D. (2026) · Interactive Journal of Medical Research · doi:10.2196/93199
- Authors
- Tanana, M. J., Soma, C. S., Srikumar, V., Atkins, D. C., & Imel, Z. E.
- Affiliations
- University of Utah (US)
- University of Washington (US)
- Corresponding author
- Tanana, Michael J
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2019-07-15
- Volume
- 21
- Issue
- 7
- Pages
- e12529
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC6662153
- OpenAlex
- W2934582891
- Cited by
- 100
- References
- 36
- Citations by year
- 2026: 30 · 2025: 22 · 2024: 15 · 2023: 13 · 2022: 6 · 2021: 4 · 2020: 8 · 2019: 2
- FWCI
- 2.28
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Keywords
- chatbots, counseling skills training, performance feedback, therapist training, open problems, reflective listening, psychotherapy transcripts, chat-based interaction
- MeSH terms
- Proof of Concept Study, Deep Learning, Communication, Counseling, Humans, Psychotherapy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
