A qualitative content analysis of ChatGPT 's client simulation role‐play for practising counselling skills
Abstract
Abstract Role‐play is often used as a pedagogical technique by counsellor educators to help counsellors‐in‐training (CITs) learn and practise counselling skills. This study used qualitative content analysis to assess the effectiveness of Chat Generative Pre‐Trained Transformer (ChatGPT), an artificial intelligence (AI) chatbot, in simulating client role‐play to facilitate practising counselling skills. The author used 10 case vignettes to conduct a simulated role‐play where ChatGPT was asked to simulate the client and author as counsellor. The results indicated that ChatGPT demonstrated authenticity, consistency, appropriate emotional expression, cultural sensitivity, empathy and self‐awareness while portraying the client. However, at times, ChatGPT's responses to the counsellor's questions appeared overly idealised, lacking the authenticity typically observed in real clients. Furthermore, ChatGPT, as a simulated client, lacked non‐verbal cues, limiting the overall experience of counselling skill practice. Recommendations for CITs and future research are discussed.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Cites
Qualitative Content Analysis in Practice
Schreier, M. (2012) · doi:10.4135/9781529682571 · Cited by 5,801 · see citing works
Qualitative Content Analysis: A Focus on Trustworthiness
Elo, S., Kääriäinen, M., Kanste, O., Pölkki, T., Utriainen, K., & Kyngäs, H. (2014) · Sage Open · doi:10.1177/2158244014522633 · Cited by 4,395 · see citing works
Bergin and Garfield's Handbook of Psychotherapy and Behavior Change
Lambert, M. J. (2003) · Cited by 3,383 · see citing works
DeCuir-Gunby, J. T., Marshall, P. L., & McCulloch, A. W. (2011) · Field Methods · doi:10.1177/1525822x10388468 · Cited by 1,456 · see citing works
The history of simulation in medical education and possible future directions
Bradley, P. (2006) · Medical Education · doi:10.1111/j.1365-2929.2006.02394.x · Cited by 1,049 · see citing works
ChatGPT Goes to Law SchoolPreprint
Choi, J. H., Hickman, K. E., Monahan, A., & Schwarcz, D. B. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4335905 · Cited by 522 · see citing works
The Empirical Evidence for Telemedicine Interventions in Mental Disorders
Bashshur, R. L., Shannon, G. W., Bashshur, N., & Yellowlees, P. (2015) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2015.0206 · Cited by 442 · see citing works
Therapeutic alliance predicts symptomatic improvement session by session.
Falkenström, F., Granström, F., & Holmqvist, R. (2013) · Journal of Counseling Psychology · doi:10.1037/a0032258 · Cited by 296 · see citing works
Emunah, R. (2019) · Routledge eBooks · doi:10.4324/9781315725406 · Cited by 159 · see citing works
Using Theater to Teach Clinical Empathy: A Pilot Study
Dow, A. W., Leong, D., Anderson, A., Wenzel, R. P., & VCU Theater-Medicine Team* (2007) · Journal of General Internal Medicine · doi:10.1007/s11606-007-0224-2 · Cited by 104 · see citing works
Exploring telemental health practice before, during, and after the COVID-19 pandemic
Zhu, D., Paige, S. R., Slone, H., Gutierrez, A., Lutzky, C., Hedriana, H., Barrera, J. F., Ong, T., & Bunnell, B. E. (2021) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x211025943 · Cited by 74 · see citing works
Integrating Actors Into a Simulation Program
Pascucci, R. C., Weinstock, P. H., O’Connor, B. E., et al. (2013) · Simulation in Healthcare The Journal of the Society for Simulation in Healthcare · doi:10.1097/sih.0b013e3182a3ded7 · Cited by 65 · see citing works
USING SIMULATED SESSIONS TO ENHANCE CLINICAL SOCIAL WORK EDUCATION
Mooradian, J. K. (2008) · Journal of Social Work Education · doi:10.5175/jswe.2008.200700026 · Cited by 59 · see citing works
Utilizing Actors to Simulate Clients in Social Work Student Role Plays
Petracchi, H. E., & Collins, K. S. (2006) · Journal of Teaching in Social Work · doi:10.1300/j067v26n01_13 · Cited by 47 · see citing works
Using Actors in Experiential Group Counseling Leadership Training
Fall, K. A., & Levitov, J. E. (2002) · The Journal for Specialists in Group Work · doi:10.1177/0193392202027002002 · Cited by 37 · see citing works
USE OF SIMULATED CLIENTS IN MARRIAGE AND FAMILY THERAPY EDUCATION
Hodgson, J. L., Lamson, A. L. S., & Feldhousen, E. B. (2007) · Journal of Marital and Family Therapy · doi:10.1111/j.1752-0606.2007.00003.x · Cited by 36 · see citing works
Effectiveness of simulated clinical teaching in general practice: randomised controlled trial
Elley, C. R., Wong, C., Arroll, B., Kennelly, J., Doerr, H., Moir, F., Fishman, T., Moyes, S. A., & Kerse, N. M. (2012) · Journal of Primary Health Care · doi:10.1071/hc12281 · Cited by 35 · see citing works
Educational Technology and Distance Supervision in Counselor Education
Carlisle, R., Hays, D. G., Pribesh, S. L., et al. (2017) · Counselor Education and Supervision · doi:10.1002/ceas.12058 · Cited by 30 · see citing works
Osborn, C. J., Dean, E. P., & Petruzzi, M. (2004) · Counselor Education and Supervision · doi:10.1002/j.1556-6978.2004.tb01865.x · Cited by 28 · see citing works
Counselors’ Perceptions of Distance Counseling: A National Survey
Maurya, R. K., Bruce, M. A., & Therthani, S. (2020) · Journal of Asia Pacific Counseling · doi:10.18401/2020.10.2.3 · Cited by 27 · see citing works
Self-citationInterdisciplinary Role Play Between Social Work and Theater Students
Dennison, S. T. (2011) · Journal of Teaching in Social Work · doi:10.1080/08841233.2011.597670 · Cited by 25 · see citing works
Counselor Clinical Training With Client‐Actors
Levitov, J. E., Fall, K. A., & JENNINGS, M. C. (1999) · Counselor Education and Supervision · doi:10.1002/j.1556-6978.1999.tb00575.x · Cited by 25 · see citing works
Actors in the Classroom: The Dramatic Pedagogy Model of Counselor Education
Clarke, P. B., Binkley, E. E., & Andrews, S. M. (2016) · Journal of Creativity in Mental Health · doi:10.1080/15401383.2016.1196156 · Cited by 24 · see citing works
An Actor's Handbook: An Alphabetical Arrangement of Concise Statements on Aspects of Acting
Stanislavski, K. (1963) · Medical Entomology and Zoology · Cited by 22 · see citing works
Master’s Students’ Experiences in a Multicultural Counseling Role-Play
Rapisarda, C. A., Jencius, M., & McGlothlin, J. M. (2011) · International Journal for the Advancement of Counselling · doi:10.1007/s10447-011-9139-z · Cited by 18 · see citing works
Using AI Based Chatbot ChatGPT for Practicing Counseling Skills through Role-playPreprint
Maurya, R. K. (2023) · doi:10.31234/osf.io/s47jb · Cited by 6 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Wang, J., & Fan, W. (2025) · Humanities and Social Sciences Communications · doi:10.1057/s41599-025-04787-y · Cited by 322 · see citing works
RetractedWei, S., Wei, W., & Zou, G. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2026.1832598 · Cited by 2 · see citing works
“This aligns with existing research conclusions that AI currently struggles to realistically simulate clinical scenarios and provide reliable professional information (56).”
- Authors
- Maurya, R. K.
- Affiliations
- University of North Florida (US)
- Corresponding author
- Maurya, Rakesh K.
- ORCID
- Maurya, Rakesh K.
- Venue
- Counselling and Psychotherapy Research
- Publisher
- Wiley
- Published
- 2023-09-27
- Volume
- 24
- Issue
- 2
- Pages
- 614-630
- ISSN
- 1473-3145 (ISSN-L)
- 1746-1405
- OpenAlex
- W4387100160
- Cited by
- 51
- References
- 26
- Citations by year
- 2026: 16 · 2025: 24 · 2024: 9 · 2023: 2
- FWCI
- 15.05
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Counselling and Psychotherapy Research (publishedVersion)
- Topics
- Social Sciences › Psychology › Social Psychology › Counseling Practices and Supervision
- Physical Sciences › Computer Science › Information Systems › Artificial Intelligence in Education
- Health Sciences › Medicine › Physiology › Simulation-Based Education in Healthcare
- Keywords
- ChatGPT, AI chatbots, role play, counseling skills training, simulated clients, authenticity, empathy, cultural sensitivity, nonverbal cues, case vignettes
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review