Cited by 233Mental Health via WritingSentiment Analysis and Opinion MiningTopic Modeling

The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.

MentalBERT: Publicly Available Pretrained Language Models for Mental Healthcare

Open access

Ji, Shaoxiong, Zhang, Tianlin, Ansari, Luna, Fu, Jie, Tiwari, Prayag, Cambria, Erik·2022·Proceedings of the Language Resources and Evaluation Conference

DOI 10.63317/2d7umxifj8wz

Open this paper in CoChat — free account Open PDF

Abstract

Mental health is a critical issue in modern society, and mental disorders could sometimes turn to suicidal ideation without adequate treatment.Early detection of mental disorders and suicidal ideation from social content provides a potential way for effective social intervention.Recent advances in pretrained contextualized language representations have promoted the development of several domain-specific pretrained models and facilitated several downstream applications.However, there are no existing pretrained language models for mental healthcare.This paper trains and releases two pretrained masked language models, i.e., MentalBERT and MentalRoBERTa, to benefit machine learning for the mental healthcare research community.Besides, we evaluate our trained domain-specific models and several variants of pretrained language models on several mental disorder detection benchmarks and demonstrate that language representations pretrained in the target domain improve the performance of mental health detection tasks.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.63317/2d7umxifj8wz

Cites

38 of 38 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
BioBERT: a pre-trained biomedical language representation model for biomedical text mining
Lee, J., Yoon, W., Kim, S., Kim, D., Kim, S., So, C. H., & Kang, J. (2020) · Bioinformatics · doi:10.1093/bioinformatics/btz682 · Cited by 7,218
Domain-specific language model pretraining for biomedical natural language processing
Gu, Y., Tinn, R., Cheng, H., Lucas, M., Usuyama, N., Liu, X., Naumann, T., Gao, J., & Poon, H. (2022) · ACM Transactions on Computing for Healthcare · doi:10.1145/3458754 · Cited by 2,170
Don’t Stop Pretraining: Adapt Language Models to Domains and Tasks
Gururangan, S., Marasović, A., Swayamdipta, S., Lo, K., Beltagy, I., Downey, D., & Smith, N. A. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.740 · Cited by 2,103
Publicly Available Clinical
Alsentzer, E., Murphy, J., Boag, W., Weng, W.-H., Jindi, D., Naumann, T., & McDermott, M. (2019) · Proceedings of the 2nd Clinical Natural Language Processing Workshop · doi:10.18653/v1/w19-1909 · Cited by 1,736
Machine learning in mental health: a scoping review of methods and applications
Shatte, A. B. R., Hutchinson, D. M., & Teague, S. J. (2019) · Psychological Medicine · doi:10.1017/s0033291719000151 · Cited by 1,047
Discovering Shifts to Suicidal Ideation from Mental Health Content in Social Media
Choudhury, M. D., Kıcıman, E., Dredze, M. H., Coppersmith, G., & Kumar, M. (2016) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858207 · Cited by 706
ClinicalBERT: Modeling Clinical Notes and Predicting Hospital Readmission
Huang, K., Altosaar, J., & Ranganath, R. (2019) · arXiv · doi:10.48550/arxiv.1904.05342 · Cited by 618

Show all 38 references

Research works printed but not linked: 11

Ansari, L., Ji, S., Chen, Q., and Cambria, E. (2022). Ensemble hybrid learning methods for automated depression detection. IEEE Transactions on Com- putational Social Systems.
Cambria, E., Hussain, A., Durrani, T., Havasi, C., Eckl, C., and Munro, J. (2010). Sentic computing for patient centered applications. In IEEE ICSP, pages 1279-1282.
Cambria, E., Benson, T., Eckl, C., and Hussain, A. (2012). Sentic PROMs: Application of sentic com- puting to the development of a novel unified frame- work for measuring health-care quality. Expert Sys- tems with Applications, 39(12):10533-10543.
Cambria, E., Liu, Q., Decherchi, S., Xing, F., , and Kwok, K. (2022). SenticNet 7: A commonsense- based neurosymbolic ai framework for explainable sentiment analysis. In LREC.
Grassi, M., Cambria, E., Hussain, A., and Piazza, F. (2011). Sentic web: A new paradigm for managing social media affective information. Cognitive Com- putation, 3(3):480-489.
Lee, A., Kummerfeld, J. K., An, L. C., and Mihalcea, R. (2021). Micromodels for efficient, explainable, and reusable systems: A case study on mental health. arXiv preprint arXiv:2109.13770. · arXiv
Lin, C., Miller, T., Dligach, D., Bethard, S., and Savova, G. (2019). A BERT-based universal model for both within-and cross-sentence clinical temporal relation extraction. In Proceedings of the 2nd Clin- ical Natural Language Processing Workshop, pages 65-71.
Martínez-Castaño, R., Htait, A., Azzopardi, L., and Moshfeghi, Y. (2021). BERT-Based Transform- ers for Early Detection of Mental Health Illnesses. In International Conference of the Cross-Language Evaluation Forum for European Languages, pages 189-200. Springer.
Mehta, Y., Majumder, N., Gelbukh, A., and Cambria, E. (2020). Recent trends in deep learning based personality detection. Artificial Intelligence Review, 53:2313-2339.
Shickel, B., Siegel, S., Heesacker, M., Benton, S., and Rashidi, P. (2020). Automatic detection and clas- sification of cognitive distortions in mental health text. In 2020 IEEE 20th International Conference on Bioinformatics and Bioengineering (BIBE), pages 275-280. IEEE.
Wolf, T., Chaumond, J., Debut, L., Sanh, V., Delangue, C., Moi, A., Cistac, P., Funtowicz, M., Davison, J., Shleifer, S., et al. (2020). Transformers: State-of- the-art natural language processing. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstra- tions, pages 38-45.

Sorted by citations

Items 101–200 of 233

Multi-class categorization of reasons behind mental disturbance in long texts
Garg, M. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.110742 · Cited by 6
Exploring Federated Learning to Trace Depression in Social Media with Language Models
Vasconcelos, A. B., Drummond, L. M. A., Brum, R. C., & Paes, A. (2023) · International Symposium on Computer Architecture and High Performance Computing Workshops (SBAC-PADW) · doi:10.1109/sbac-padw60351.2023.00014 · Cited by 6
An Early Depression Detection Model on Social Media using Emotional and Causal Features
Zong, L., Zheng, J., Zhang, X., Liu, X., Liang, W., & Xu, B. (2023) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm58861.2023.10385946 · Cited by 5
A Review of Mental Health Analysis Through Social Media Using Machine Learning and Deep Learning Approaches
Saleem, M., & Afzal, H. (2024) · International Conference on Engineering & Computing Technologies (ICECT) · doi:10.1109/icect61618.2024.10581373 · Cited by 5
NLP as a Lens for Causal Analysis and Perception Mining to Infer Mental Health on Social MediaPreprint
Garg, M., Saxena, C., Naseem, U., Sohn, S., & Dorr, B. J. (2023) · doi:10.36227/techrxiv.21972974.v1 · Cited by 5
Explainable AI for Mental Disorder Detection on Social Media: A Survey and Outlook
Ibrahimov, Y., Anwar, T., & Yuan, T. (2026) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2026.3688443 · Cited by 36
Improving Mental Health Classifier Generalization with Pre-diagnosis Data
Liu, Y., Biester, L., & Mihalcea, R. F. (2023) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v17i1.22169 · Cited by 3
What Clued the AI Doctor In? On the Influence of Data Source and Quality for Transformer-Based Medical Self-Disclosure Detection
Valizadeh, M., Qian, X., Ranjbar-Noiey, P., Caragea, C., & Parde, N. (2023) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2023.eacl-main.86 · Cited by 4
Dual Layer Cogni - Insight Deep-Mood Encoder: A Two- Tiered Approach for Depression Detection
Firoz, N., Berestneva, O. G., & Aksyonov, S. V. (2024) · International Russian Smart Industry Conference (SmartIndustryCon) · doi:10.1109/smartindustrycon61328.2024.10516113 · Cited by 4
DepreRedditBR: Um conjunto de dados textuais com postagens depressivas no idioma português brasileiro
Herculano, A. D. R., de Paula, T.-H. A. B., Fernandes, D. Y. D. S., & Rêgo, A. S. D. C. (2024) · doi:10.5753/dsw.2024.243994 · Cited by 4
DepreBERTBR: Um Modelo de Linguagem Pré-treinado para o Domínio da Depressão no Idioma Português Brasileiro
Herculano, A. D. R., Souza, D. Y., & Rêgo, A. S. D. C. (2024) · Simpósio Brasileiro de Bancos de Dados (SBBD) · doi:10.5753/sbbd.2024.240807 · Cited by 5
D₂X: Depression Detection System Through X Using Hybrid Machine Learning
Angskun, T., Tipprasert, S., Thippongtorn, A., & Angskun, J. (2024) · IEEE Access · doi:10.1109/access.2024.3502241 · Cited by 4
On the reliability of Large Language Models to misinformed and demographically informed prompts
Aremu, T., Akinwehinmi, O., Nwagu, C., Ahmed, S. I., Orji, R., Amo, P. A. D., & Saddik, A. E. (2025) · AI Magazine · doi:10.1002/aaai.12208 · Cited by 4
TAKECare: A temporal-hierarchical framework with knowledge fusion for personalized clinical predictive modeling
Wu, J., Mei, X., Mao, R., He, K., & Cambria, E. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103620 · Cited by 5
Self-citation
Privacy Aware Question-Answering System for Online Mental Health Risk Assessment
Chhikara, P., Pasupulety, U., Marshall, J., Chaurasia, D., & Kumari, S. (2023) · Workshop on Biomedical Language Processing (BioNLP) · doi:10.18653/v1/2023.bionlp-1.18 · Cited by 5
MM-EMOG: Multi-Label Emotion Graph Representation for Mental Health Classification on Social Media
Cabral, R. C., Han, S. C., Poon, J., & Nenadić, G. (2024) · Robotics · doi:10.3390/robotics13030053 · Cited by 5
Leveraging LLMs for Mental Health: Detection and Recommendations from Social Discussions
Aggarwal, V., Thukral, S., Patel, K., & Chatterjee, A. (2024) · IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT) · doi:10.1109/wi-iat62293.2024.00055 · Cited by 3
Transforming social media text into predictive tools for depression through AI: A test-case study on the Beck Depression Inventory-II
Ravenda, F., Preti, A., Poletti, M., Mira, A., Crestani, F., & Raballo, A. (2025) · PLOS Digital Health · doi:10.1371/journal.pdig.0000848 · Cited by 3
Psychotherapist remarks’ ML classifier: insights from LLM and topic modeling application
Vanin, A. V., Bolshev, V. E., & Panfilova, A. S. (2025) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2025.1608163 · Cited by 7
MentalLLM: A Transformer-Based Large Language Model Framework for Depression Detection
Ayrin, F. J., Rahman, M. M., Quader, M. A., Dass, A., Khondaker, M. M. H., Chakraborty, M., Saha, P. P., Khan, M. R. K., Akuthota, V., & Anwar, A. S. (2025) · IEEE International Women in Engineering (WIE) Conference on Electrical and Computer Engineering (WIECON-ECE) · doi:10.1109/wiecon-ece69386.2025.11525902 · Cited by 3
Conceptualizing Suicidal Behavior: Utilizing Explanations of Predicted Outcomes to Analyze Longitudinal Social Media Data
Nguyễn, V. M., Nur, N., Stern, W., Mercer, T., Sen, C., Bhattacharyya, S., Tumbiolo, V., & Goh, S. J. (2023) · International Conference on Machine Learning and Applications · doi:10.1109/icmla58977.2023.00316 · Cited by 3
Data Augmentation Impact on Deep learning Performance for Stress Detection
Hamdi, E. S., Mabrouk, M., Rady, S., & Aref, M. M. (2023) · International Conference on Intelligent Computing and Information Systems (ICICIS) · doi:10.1109/icicis58388.2023.10391179 · Cited by 3
Adaptive attention-aware fusion for human-in-the-loop behavioral health detection
Brown, M., Azmee, A. A., Khan, M. A. A. H., Thomas, D. M., Pei, Y., & Nandan, M. (2024) · Smart Health · doi:10.1016/j.smhl.2024.100475 · Cited by 3
Textionnaire: An NLP-Based Questionnaire Analysis Method for Complex and Ambiguous Task Decision Support
Rashidiani, S., Doyle, T. E., Samavi, R., Duncan, L., Pires, P., & Sassi, R. B. (2022) · IEEE International Conference on Cognitive Informatics & Cognitive Computing (ICCI*CC) · doi:10.1109/iccicc57084.2022.10101497 · Cited by 3
Detecting Mental Health Disorders Using NLP
Tom, A., Das, G., Hemmige, J. B., Deshpande, P., Bangshi, S. R., Paduri, A. R., & Darapaneni, N. (2023) · IEEE Pune Section International Conference (PuneCon) · doi:10.1109/punecon58714.2023.10450025 · Cited by 3
SOK: Application of machine learning models in child and youth mental health decision-making
Daneshvar, H., Boursalie, O., Samavi, R., Doyle, T. E., Duncan, L., Pires, P., & Sassi, R. B. (2024) · Elsevier eBooks · doi:10.1016/b978-0-443-13671-9.00003-x · Cited by 3
Scale-CoT: Integrating LLM with Psychiatric Scales for Analyzing Mental Health Issues on Social Media
Wang, B., Sun, Y., Zi, Y., Zhao, Y., & Qin, B. (2024) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm62325.2024.10822322 · Cited by 3
MULTIWD: Multiple Wellness Dimensions in Social Media PostsPreprint
Sathvik, M., & Garg, M. (2023) · doi:10.36227/techrxiv.22816586 · Cited by 3
Revealing Depression Through Social Media via Adaptive Gated Cross-Modal Fusion Augmented With Insights From Personality Traits
Pradnyana, G. A., Anggraeni, W., Yuniarno, E. M., & Purnomo, M. H. (2025) · IEEE Access · doi:10.1109/access.2025.3593273 · Cited by 4
Multimodal Graph Representation Learning over Arbitrary Sets of Modalities
Patapati, S., & Srinivasan, T. (2026) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61042.2026.00686 · Cited by 2
Pan-Canadian Electronic Medical Record Diagnostic and Unstructured Text Data for Capturing PTSD: Retrospective Observational Study
Kosowan, L., Singer, A. G., Zulkernine, F. H., Zafari, H., Nesca, M., & Muthumuni, D. (2022) · JMIR Medical Informatics · doi:10.2196/41312 · Cited by 2
An Example of (Too Much) Hyper-Parameter Tuning In Suicide Ideation Detection
Schoene, A. M., Ortega, J. E., Amir, S., & Church, K. (2023) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v17i1.22227 · Cited by 2
Domain-Enhanced Attention Enabled Deep Network for Behavioral Health Identification from 911 Narratives
Azmee, A. A., Brown, M., Khan, M. A. A. H., Thomas, D. M., Pei, Y., & Nandan, M. (2023) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata59044.2023.10386126 · Cited by 2
Early Depression Detection with Transformer Models: Analyzing the Relationship between Linguistic and Psychology-Based Features
Halimeh, H., Caron, M., & Müller, O. (2023) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2023.415 · Cited by 2
Detection of Bipolar Disorder on Social Media Data Utilizing Biomedical, Clinical and Mental Health Domain Fine-Tuned Word Embeddings
Thamrin, S. A., & Chen, A. L. P. (2024) · IEEE International Conference on Healthcare Informatics (ICHI) · doi:10.1109/ichi61247.2024.00098 · Cited by 3
AI framework for DRIVE model based mental health detection in text: a case study on how coping strategies are expressed during COVID-19
AlSumait, L., Alfarhan, A., & AlHeneidi, H. H. (2025) · PeerJ Computer Science · doi:10.7717/peerj-cs.2828 · Cited by 2
A Narrative Review on Human Anxiety Detection in Social Media using Natural Language Processing
Senanayake, A., & Liyanage, S. R. (2023) · The journal of desk research review and analysis. · doi:10.4038/jdrra.v1i2.20 · Cited by 2
Visualizing Mental Health Insights: A Pipeline from Social Media to Chernoff Faces
Nagi, F., Alzubaidi, M. S., Shah, U., Shah, H. A., Alabdulla, M., Househ, M. S., & Agus, M. (2024) · Studies in health technology and informatics · doi:10.3233/shti240820 · Cited by 1
Mental Distress in English Posts from r/AmITheAsshole Subreddit Community with Language Models
Guan, Q. (2025) · Corpus-based Studies across Humanities · doi:10.1515/csh-2025-0006 · Cited by 1
Gender, Age, and Depression detection with BERT-based multitask model
Oulahbib, I., Benhaddi, M., & Hadaj, S. E. (2025) · International Conference on Innovative Research in Applied Science, Engineering and Technology (IRASET) · doi:10.1109/iraset64571.2025.11008193 · Cited by 1
Training TikTok creators in mental health communication can benefit their audiences
Liu, Y., Motta, M., Brenna, K., McLaurin, S., Speer, K., Scherer, E. M., Smith, M. A., & Yarnell, A. (2026) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2026.101101 · Cited by 1
Understanding Community 'Likes' and Clinical Perspective in Mental Health Discourse: Insights from YouTube Comments on College Students' Mental Health
Kim, H., Choi, B., Daly, B. P., & Huh, J. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757434 · Cited by 2
MindSync
Shree, A. N. R., Macharla, S. R., Monteiro, D. H., Yathin, K. N., Vishwanath, H., & Biradar, A. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-3306-9.ch009 · Cited by 1
Enhancing explainability and performance of the depression detection model on social media utilizing feature engineering and LLMs
Thamrin, S. A., & Chen, A. L. P. (2026) · Health Information Science and Systems · doi:10.1007/s13755-026-00446-x · Cited by 2
Enhancing Machine Learning Models for Mental Health Classification Through Iterative Training and Text‐Based Augmentation
Das, S., Khondakar, K. R., Mazumdar, H., Kaushik, A., & Singh, S. K. (2026) · International Journal of Intelligent Systems · doi:10.1155/int/2620320 · Cited by 2
Natural language processing for mental health assessment: a survey and comparative evaluation
Cao, Y., Xiao, G. G., Xi, P., Okuhara, S., Fan, Y., & Liu, Z. (2026) · International Journal of Data Science and Analytics · doi:10.1007/s41060-026-01146-1 · Cited by 2
Automatic Depressive Symptom Detection on Social Media Using the BDI-II
Higuera-Gutiérrez, C. A., López-Nava, I. H., Montes-y-Gómez, M., Aragón, M. E., & Losada, D. E. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-28393-1_26 · Cited by 1
Natural Language Processing Applied to Psychiatric Clinical Notes: Scoping Review
Rao, S., Chen, X. R., Deng, G., Xie, J., Jiang, T., Li, T., Zhang, Y., & Jiang, H. (2026) · JMIR Medical Informatics · doi:10.2196/91249 · Cited by 2
Discerning mental illnesses from social media posts using machine and deep learning algorithms
Harish, R., Vaid, A., Byakod, S. S., Kumar, A., & Arya, A. (2023) · AIP conference proceedings · doi:10.1063/5.0143052 · Cited by 1
Mental Illness Prediction by Refined-Attention Transformer Encoder with Mental RoBERTa
Chen, O. T.-C., Huang, W., & Chang, C.-H. (2023) · IEEE International Conference on Consumer Electronics - Taiwan (ICCE-Taiwan) · doi:10.1109/icce-taiwan58799.2023.10226890 · Cited by 1
One-Model-Connects-All: A Unified Graph Pre-Training Model for Online Community Modeling
Ma, R., Xu, J., Zhang, X., Zhang, H., Zhao, Z., Zhang, Q., Huang, X., & Wei, Z. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.1003 · Cited by 1
Analysis of medical conversations for the detection of depression
Zaman, I.-R., Trăușan-Matu, Ș., & Rebedea, T. E. (2023) · RoCHI - International Conference on Human-Computer Interaction (RoCHI) · doi:10.37789/rochi.2023.1.1.4 · Cited by 2
SAFENet: Towards a Robust Suicide Assessment in Social Media Using Selective Prediction Framework
Thapa, S., Salman, M., Shah, S. B., Zhang, Q., Rashid, J., Hu, L., Razzak, I., & Naseem, U. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825727 · Cited by 1
THYMES: A Framework for Detecting Suicidal Ideation from Social Media Posts Using Hyperbolic Learning
Thapa, S., Salman, M., Shah, S. B., Shiwakoti, S., Zhang, Q., Hu, L., Razzak, I., & Naseem, U. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825881 · Cited by 1
Decoding Linguistic Nuances in Mental Health Text Classification Using Expressive Narrative Stories
Tang, J., Guo, Q., Zhao, Y., & Shang, Y. (2024) · IEEE International Conference on Cognitive Machine Intelligence (CogMI) · doi:10.1109/cogmi62246.2024.00035 · Cited by 1
NLP as a Lens for Causal Analysis and Perception Mining to Infer Mental Health on Social MediaPreprint
Garg, M., Saxena, C., Naseem, U., Sohn, S., & Dorr, B. J. (2023) · doi:10.36227/techrxiv.21972974 · Cited by 1
MULTIWD: Multiple Wellness Dimensions in Social Media PostsPreprint
Sathvik, M., & Garg, M. (2023) · doi:10.36227/techrxiv.22816586.v1 · Cited by 1
Monte Carlo Tree Search for Interpreting Stress in Natural Language
Swanson, K., Hsu, J., & Süzgün, M. (2022) · Workshop on Language Technology for Equality, Diversity, Inclusion (LT-EDI) · doi:10.18653/v1/2022.ltedi-1.12
Improving Mental and Emotional Wellbeing based on Intelligent Techniques. Application to the case of Smart Offices
López, S. M. (2023) · doi:10.20868/upm.thesis.73105
HelaDepDet 2.0 - A Novel Deep Learning Approach for Detecting the Severity of Human Depression on Social Media Analysis (Preprint)Preprint
Priyadarshana, Y. H. P. P., Liang, Z., & Piumarta, I. (2023) · doi:10.2196/preprints.55181
Edge of Tomorrow: Evaluating Misinformation and Bias in LLM-Powered Chatbots on Climate Change and Mental HealthPreprint
Aremu, T., Akinwehinmi, O., Nwagu, C., Ahmed, S. I., Orji, R., del Amo, P. A., & Saddik, A. E. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4699451
Common N-Gram Method (CNG): A Promising Approach to Detecting Mental Health Disorders on Social Media
Agarwal, H., & Kešelj, V. (2024) · International Symposium INFOTEH-JAHORINA (INFOTEH) · doi:10.1109/infoteh60418.2024.10495942 · Cited by 1
Outcomes that matter to depressed adolescents can be identified with large language modelsPreprint
Xin, A. W., Lossio-Ventura, J. A., Krause, K. R., Fiorini, G., Midgley, N., Pereira, F., & Nielson, D. M. (2024) · doi:10.31234/osf.io/t9fcp
A Prototypical Classifier with Boosting Augmented Redundancy Detector for Causal Analysis of Mental Health over Social Media
Liang, Y., Wang, L., Wang, X., & He, L. (2024) · Lecture notes in computer science · doi:10.1007/978-981-97-5569-1_10
Domain Knowledge-Driven Multi-Label Behavioral Health Identification from Police Report
Azmee, A. A., Nweke, F., Khan, M. A. A. H., Pei, Y., Thomas, D., & Nandan, M. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825617
Multi-task Learning with Pre-trained Language Models for Mental Illness Screening
Shrestha, A., Tlachac, M., Flores, R., Hickey, K., & Rundensteiner, E. A. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825698
Towards Understanding Bipolar Disorder Through Social Media and Transformer Models: Challenges and InsightsPreprint
Srivastava, V., Boggavarapu, L., Shin, A., Datta, A., Lu, Y., & Bhaumik, R. (2025) · medRxiv · doi:10.1101/2025.03.05.25323466
AnxiBERT - Prompt Engineering for Social Media Anxiety Detection
Senanayake, A., & Liyanage, S. R. (2024) · International Conference on Natural Language Processing and Information Retrieval (NLPIR) · doi:10.1145/3711542.3711559
Training TikTok creators in mental health communication can benefit their audiences on social mediaPreprint
Liu, Y., Motta, M., Brenna, K., McLaurin, S., Speer, K., Scherer, E. M., Smith, M. A., & Yarnell, A. (2025) · SocArXiv (OSF Preprints) · doi:10.31235/osf.io/p65nv_v2
AI-Powered Virtual Mental Health Assistant for Early-Stage NLP-Based Mental Health Screening
Loy, D. Y. K., Yau, P. C., & Wong, D. (2025) · Cognitive Models and Artificial Intelligence Conference (AICCONF) · doi:10.1109/aicconf64766.2025.11063866 · Cited by 1
Fine-Tuned Mistral Model for Multi-Agent Mental Health Counseling System
Patel, A., Lohumi, P., Shah, V., Dash, M., & Arya, M. S. (2025) · International Conference on Computing and Artificial Intelligence (ICCAI) · doi:10.1109/iccai66501.2025.00056
Autοmated depressiοn level estimatiοn : a study οn discοurse structure, input representatiοn and clinical reliability
Agarwal, N. (2024) · theses.fr (ABES) · doi:10.70675/0ec38ff1zb190z4c8azb4c8z5dd424926b1d
Estimatiοn οf depressiοn level frοm text : symptοm-based apprοach, external knοwledge, dataset validity
Milintsevich, K. (2024) · theses.fr (ABES) · doi:10.70675/b486d74cz4a3az42fezb96cz4b01aa529c8b
Mental Health Monitoring with NLP: Transformer-Based Models for Depression Detection on Reddit
Bhatt, K., Pandey, P., & Chaturvedi, N. (2026) · Lecture notes in networks and systems · doi:10.1007/978-981-95-7241-0_1
MentalBERT with Contrastive Learning for Mental Disorder Classification from Social Media: A Comparative and Explainable Study
Zulfa, A. Q., Alfarozi, S. A. I., Kusrohmaniah, S., & Wibirama, S. (2026) · International Conference on Current Research in Artificial Intelligence and Data Science (ICCRAIDS) · doi:10.1109/iccraids67816.2026.11519647
Blunt Giants, Sharp Specialists : Decoding Stress and Triggers Beyond General-Purpose LLMs
Ghosh, S. K., Singh, G. V., Pathak, K., & Ekbal, A. (2026) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2026.3686713
Can LLM Agents Really Simulate Clients in Counseling?
Yu, S., Kim, D., Roh, Y., Kwon, K., & Oh, H. (2026) · ACM Symposium on Applied Computing · doi:10.1145/3748522.3779828
Risk-Aware Calibration and Interpretable Baselines for Mental Health Text Classification
Bindumadhavi, P., Kaliappan, S., Chythanya, K. R., & Bangari, A. S. (2026) · ASU International Conference in Emerging Technologies for Sustainability and Intelligent Systems (ICETSIS) · doi:10.1109/icetsis68266.2026.11549367
An Artificial Intelligence-Based Detection of Comorbid Depression, Anxiety, and Substance Use Disorder in Korean Counseling Dialogues Using an Explainable Hierarchical Attention Network with Shapley Additive Explanations
Choi, M., Jo, J., & Jeong, J.-H. (2026) · Diagnostics · doi:10.3390/diagnostics16121817
Large Language Models na Identificação de Ideação Suicida em Textos não Clínicos em Inglês
Coutinho, L. C., Veras, A. E. R., Damasceno, R. C. P., & de Oliveira, A. C. (2026) · Revista Eletrônica de Iniciação Científica em Computação · doi:10.5753/reic.2026.7642
Depression Detection using a Lightweight Transformer with SBERT
Sudhishna, K. S., Ramakrishnan, Sarvesh, R. R., Arvind Acharya, R., & Vishahan, U. (2026) · International Conference on Inventive Research in Computing Applications (ICIRCA) · doi:10.1109/icirca69024.2026.11570487
Identifying Depressive Content in Decentralized Social Networks: A Case Study on Bluesky
Chaves, A. M., Lemos, G., Ferreira, G. R., Braga, L. P., Meira, W., & Pappa, G. L. (2026) · doi:10.5753/sbcas.2026.21678
SHED: Semantic Heterogeneous Graph Learning for Estimating Eating Disorder Severity
Anwar, T., Abuhassan, M., Chengfei Liu, A., Jarman, H. K., McLean, S. A., Paxton, S. J., Rodgers, R. F., & Fuller‐Tyszkiewicz, M. (2026) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2026.3707439
A Generative Multi-agent Framework for Modeling Depressive Language Entrainment
van Papendrecht, C. H., Bollen, J., & Roy, D. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-29909-3_29
A Comparative Analysis for Multi-Class Mental Health Condition Detection from Text
Dodeja, S., Dubey, S. K., Agrawal, H., & Nagpal, B. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-28379-5_17
Social media-based machine learning method for predicting symptoms in people with post-traumatic stress disorder with cancer
Sharmin, S., Ali, M. S., Jahan, N., Pathan, M. R. K., Rahman, A., Farid, F. A., Karim, H. B. A., & Miah, A. S. M. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-01728-9
Benchmarking large language models against practicing clinicians on psychopathological assessment
Lenz, E., Naamanka, J., Trabert, W., Bottlender, R., Malchow, B., Meyer‐Lindenberg, A., Gradinger, T., & Schwarz, E. (2026) · npj Digital Medicine · doi:10.1038/s41746-026-02852-7
Contrastive Self-Supervised Learning for Mental Health Risk Prediction with Continual Language Adaptation
Adiyattil, R., Thangamayan, S., Bagawati, D. T., Ramanan, R. R., Nishanth, V. M., & Akshaya., E. (2026) · International Conference on System, Computation, Automation and Networking (ICSCAN) · doi:10.1109/icscan66520.2026.11588511
From Text to Multimodal Signals: A Comprehensive Review of Transformer-Based Stress Detection Models
Verma, N., Malik, K., & Jindal, S. (2026) · Procedia Computer Science · doi:10.1016/j.procs.2026.05.083
Explainable Multi-Class Mental Health Classification from Social Media Using DistilBERT and Knowledge Graphs
Saha, S., & Kumar, S. (2026) · International Conference on Secure Cyber Computing and Communications (ICSCCC) · doi:10.1109/icsccc69031.2026.11600237
MentalBERT: A Comparative Study on Addressing Mental Health Issues Using Transformer-Based Language Model
Saha, P., Hassan, T., Seyam, M. S. A., Onik, Z. A., & Nur, K. M. (2026) · International Conference on Frontiers of Engineering and Emerging Technologies (FET) · doi:10.1109/fet68771.2026.11601738
CounselingQA: scaling professional mental-health guidance via dense retrieval and large language models
Pérez, A., Piñeiro, C., & Parapar, J. (2026) · Social Network Analysis and Mining · doi:10.1007/s13278-026-01620-5
CIERTe: Continuous Inter-Event Relative Temporal Anchoring for Anxiety Detection from Social Media Posts
Senanayake, A., & Liang, Z. (2026) · ACM International Conference on Bioinformatics, Computational Biology, and Health Informatics (ACM-BCB) · doi:10.1145/3807503.3819474
KASH: 1-Bit Key-Value Cache Quantizaiton via Asymmetric Hashing
Zhang, Y., Hu, Q., Wei, Z., & Cheng, J. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-31930-2_25
Early Detection of Suicidal Ideation Through Indonesian Twitter Content
Jiwanggi, M. A., Purwandari, B., & Budi, I. D. (2026) · Advances in sustainability science and technology · doi:10.1007/978-3-032-25267-8_10
The Impact of Social Media on Student Cognitive Intelligence, Attention, and Problem-Solving: A Proposed Validation Framework with Behavioral and Facial Expression Analysis
Singh, S., & Taluja, A. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-28594-2_1
CueSupport-MH: An Explainable Dataset and Interpretable Framework for Mental Health Risk Detection and Response Safety Evaluation
Alotaibi, F., Sathvik, M., Younus, M., & Lee, M. G. (2026) · IEEE Access · doi:10.1109/access.2026.3719595
DR-Transformer: A Dual-Regularized Transformer Combining Sparse Attention and Supervised Contrastive Learning for Interpretable Stress Detection in Social Media Text
Alaoui, M. C., Joudar, N., & Ettaouil, M. (2026) · AI · doi:10.3390/ai7080300
Population-Level Profiling of DSM-5 Depressive Symptoms Among Self-Reported ADHD and ASD Users on Twitter: An Exploratory Study Using Advanced NLP and Statistical Analysis (Preprint)Preprint
Rizwan, M., Nabergoj, D., & Demšar, J. (2026) · doi:10.2196/preprints.106441
Mitigating Spurious Correlations in Mental Health Analysis: A Contrastive Learning Approach for Cross-Domain Robustness
Shin, D., Ham, Y., Lee, S. W., & Park, S. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818907

Authors: Ji, S., Zhang, T., Ansari, L., Fu, J., Tiwari, P., & Cambria, E.
Affiliations: Aalto University (FI)
University of Manchester (GB)
Mila - Quebec Artificial Intelligence Institute (CA)
Nanyang Technological University (SG)
ORCID: Ji, Shaoxiong
Zhang, Tianlin
Ansari, Luna
Fu, Jie
Tiwari, Prayag
Cambria, Erik
Venue: Proceedings of the Language Resources and Evaluation Conference
Publisher: European Language Resources Association (ELRA)
Published: 2022-06
Pages: 7184-7190
ISSN: 2522-2686
DOI: 10.63317/2d7umxifj8wz
OpenAlex: W3209409148
Cited by: 233
References: 38
Citations by year: 2026: 68 · 2025: 30 · 2024: 62 · 2023: 55 · 2022: 18
FWCI: 79.56
Type: conference paper
Language: en
Open access: hybrid
doi.org
Licence: cc-by-nc
Locations: Language Resources and Evaluation Conference (LREC) (publishedVersion, cc-by-nc)
arXiv (Cornell University) (submittedVersion)
arXiv (Cornell University) (cc-by)
Funders: China Scholarship Council
Topics: Social Sciences › Psychology › Social Psychology › Mental Health via Writing
Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
Keywords: pre-trained language models, mental disorder detection, suicidal ideation detection, masked language models, social media text analysis, mental health services

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

MentalBERT: Publicly Available Pretrained Language Models for Mental Healthcare

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Self-check

Citations

Cites

Cited by

Related

Metadata

Record

About these checks