Large-scale Analysis of Counseling Conversations: An Application of Natural Language Processing to Mental Health
Open accessThe DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
Mental illness is one of the most pressing public health issues of our time. While counseling and psychotherapy can be effective treatments, our knowledge about how to conduct successful counseling conversations has been limited due to lack of large-scale data with labeled outcomes of the conversations. In this paper, we present a large-scale, quantitative study on the discourse of text-message-based counseling conversations. We develop a set of novel computational discourse analysis methods to measure how various linguistic aspects of conversations are correlated with conversation outcomes. Applying techniques such as sequence-based conversation models, language model comparisons, message clustering, and psycholinguistics-inspired word frequency analyses, we discover actionable conversation strategies that are associated with better conversation outcomes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures










Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For example, innovations in computer science (e.g., natural language processing and machine learning) are being used to assess language patterns of successful crisis interventions in text-based mental health conversations (18, 35).”
From Key Considerations for Incorporating Conversational AI in Psychotherapy (2019) · cites this paper as [18]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533 · cited 1×
“We also used distributed word embeddings (e.g., (Mikolov et al., 2013)) instead of TF-IDF vectors but found the latter to produce better clusters.”
MethodVADER: a parsimonious rule-based model for sentiment analysis of social media text
Hutto, C., & Gilbert, E. (2014) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v8i1.14550 · Cited by 6,087
The Psychological Meaning of Words: LIWC and Computerized Text Analysis Methods
Tausczik, Y. R., & Pennebaker, J. W. (2010) · Journal of Language and Social Psychology · doi:10.1177/0261927x09351676 · Cited by 5,774 · cited 1×
“Texters start explaining their issue largely in terms of the past and present but over time talk more about the future (see Figure 9A; each plot shows the relative amount of words in the LIWC past, present, and future categories (Tausczik and Pennebaker, 2010)).”
Psychological Aspects of Natural Language Use: Our Words, Our Selves
Pennebaker, J. W., Mehl, M. R., & Niederhoffer, K. G. (2003) · Annual Review of Psychology · doi:10.1146/annurev.psych.54.101601.145041 · Cited by 2,624
Concreteness ratings for 40 thousand generally known English word lemmas
Brysbaert, M., Warriner, A. B., & Kuperman, V. (2014) · Behavior Research Methods · doi:10.3758/s13428-013-0403-5 · Cited by 1,821
Lenggenhager, J. (1947) · PubMed · Cited by 1,772
Dialogue Act Modeling for Automatic Tagging and Recognition of Conversational Speech
Stolcke, A., Ries, K., Coccaro, N., Shriberg, E., Bates, R., Jurafsky, D., Taylor, P., Martin, R., Ess-Dykema, C. V., & Meteer, M. (2000) · Computational Linguistics · doi:10.1162/089120100561737 · Cited by 1,108
Therapeutic Discourse: Psychotherapy as Conversation
Tannen, D., Labov, W., & Fanshel, D. (1981) · Language · doi:10.2307/413709 · Cited by 938
Pyszczynski, T., & Greenberg, J. (1987) · Psychological Bulletin · doi:10.1037/0033-2909.102.1.122 · Cited by 825 · cited 4×
“Figure 9B shows that a smaller amount of self-focus is associated with more successful conversations (providing support for the self-focus model of depression (Pyszczynski and Greenberg, 1987)).”
BackgroundResultInfluentialLinguistic Style Matching in Social Interaction
Niederhoffer, K. G., & Pennebaker, J. W. (2002) · Journal of Language and Social Psychology · doi:10.1177/026192702237953 · Cited by 562
Research works printed but not linked: 5
- Levitt Dana Heller, 2005, The Journal of Humanistic Counseling, Education and Development, 44(1).
- Niederhoffer Kate G., 2002, Journal of Language and Social Psychology, 21(4).
- Pyszczynski Tom, 1987, Journal of Personality and Social Psychology, 52(5).
- Ren Shiquan, 2010, Journal of Applied Statistics, 37(9).
- Tausczik Yla R., 2010, Journal of Language and Social Psychology, 29(1).
Cited by
Items 301–319 of 319
Attention-Augmented BiGRU for Mental Health State Classification from Reddit Conversational Data
Saiphy, S., Meenakshi, K., & Bhargava, D. (2026) · International Conference on Intelligent Systems in Engineering, Secured Systems and Cybersecurity (ICISESSC) · doi:10.1109/icisessc68634.2026.11542586
MIAdvisor: Enhancing counselor competence in motivational interviewing through visual analytics
Wang, X., Ye, J., Zhang, G., Liu, Y., & Guo, H. (2026) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2026.103853
Calambur, V., Young, J., Razi, A., & Huh, J. (2026) · ACM Transactions on Computing for Healthcare · doi:10.1145/3817048
“For instance, Althoff et al. found that on average, more successful counselors providing SMS-based support had longer support messages [5].”
Automatic Detection of Personality Disorders from Text and Audio: A Systematic Review
Fersi, S., Mechti, S., & Faïz, R. (2026) · Intelligence in Business and Industry (IBI) · doi:10.1109/ibi68858.2026.11604115
“Clinical interviews and therapy transcripts provide more diagnostically relevant data but are typically small and rarely public due to privacy constraints [3], [19].”
Supplementary Material for Evaluating AI-Based Mental Health Interventions
Sharma, A. (2026) · ACM eBooks · doi:10.1145/3749728.3749737
Human–AI Collaboration to Empower People Seeking Support
Sharma, A. (2026) · ACM eBooks · doi:10.1145/3749728.3749732
(2026) · ACM eBooks · doi:10.1145/3749728.3749738
(2026) · ACM eBooks · doi:10.1145/3749728.3749739
Supplementary Materials for Human–AI Collaboration to Empower People Providing Support
Sharma, A. (2026) · ACM eBooks · doi:10.1145/3749728.3749735
Human–AI Collaboration to Empower People Providing Support
Sharma, A. (2026) · ACM eBooks · doi:10.1145/3749728.3749731
Sharma, A. (2026) · ACM eBooks · doi:10.1145/3749728.3749730
(2026) · ACM eBooks · doi:10.1145/3749728.3749729
Supplementary Materials for Human–AI Collaboration to Empower People Seeking Support
Sharma, A. (2026) · ACM eBooks · doi:10.1145/3749728.3749736
(2026) · ACM eBooks · doi:10.1145/3749728.3749734
Zahir, M. H., Tauheed, N., Siddiqui, S. Y., Yousaf, S. M. J., Rahim, M., & Arif, A. (2024) · International Journal of Innovations in Science and Technology · doi:10.33411/ijist/1149
Khan, N., Sheibani, N., Sequeira, L., Gauvreau, S., Palachi, A., Naveed, A., Shearkhani, S., Ensan, F., Raman, P., & Milligan, K. (2026) · doi:10.2196/preprints.109043
Mindel, J. R., Xie, S., Chan, Y. K., Swartz, H. A., Kraut, R. E., Zhu, H., Fang, A., & Wu, T. (2026) · ACM Conference on Human-AI Complementarity and Alignment · doi:10.1145/3834580.3838750
Finetuned BERT Model for Hybridization of Psychological Problem Detection and Sentiment Analysis
Mondal, A., Das, S., Chatterjee, S., Paul, T., & Pradhan, M. (2026) · International Conference on Computing, Intelligence, and Application (CIACON) · doi:10.1109/ciacon70148.2026.11688351
“Common psychological disorders include depression, anxiety, and PTSD [11] [12] [13].”
Segmentation and Classification in Therapeutic Transcripts with Fine-Tuned BERT and SBERT
de Almeida, C. P., Bernardino, H. S., de Souza, J. F., & Martins, L. F. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-39904-5_39
Metadata
- Authors
- Althoff, T., Clark, K., & Leskovec, J.
- Affiliations
- Stanford University (US)
- Venue
- Transactions of the Association for Computational Linguistics
- Publisher
- MIT Press - Journals
- Published
- 2016-12
- Volume
- 4
- Pages
- 463-476
- ISSN
- 2307-387X (ISSN-L)
- PMC
- PMC5361062
- OpenAlex
- W2484061479
- Cited by
- 322
- References
- 31
- Citations by year
- 2026: 33 · 2025: 38 · 2024: 25 · 2023: 39 · 2022: 44 · 2021: 37 · 2020: 40 · 2019: 28 · 2018: 18 · 2017: 18 · 2016: 1
- FWCI
- 34.02
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- cc-by
- Locations
- Transactions of the Association for Computational Linguistics (publishedVersion, cc-by)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation (1010921, 1149837)
- National Institutes of Health
- Defense Advanced Research Projects Agency
- Multidisciplinary University Research Initiative
- National Institute of Biomedical Imaging and Bioengineering (U54EB020405)
- Army Research Office
- Topics
- Social Sciences › Psychology › Social Psychology › Mental Health via Writing
- Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Keywords
- counseling conversations, psychotherapy, computational discourse analysis, conversational strategies, message clustering, psycholinguistics, word frequency analysis, language model comparison, mental health
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.