The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Natural Language Processing Reveals Vulnerable Mental Health Support Groups and Heightened Health Anxiety on Reddit During COVID-19: Observational Study
Open accessPublished version of a preprint
Abstract
Background: The COVID-19 pandemic is impacting mental health, but it is not clear how people with different types of mental health problems were differentially impacted as the initial wave of cases hit. Objective: The aim of this study is to leverage natural language processing (NLP) with the goal of characterizing changes in 15 of the world’s largest mental health support groups (eg, r/schizophrenia, r/SuicideWatch, r/Depression) found on the website Reddit, along with 11 non–mental health groups (eg, r/PersonalFinance, r/conspiracy) during the initial stage of the pandemic. Methods: We created and released the Reddit Mental Health Dataset including posts from 826,961 unique users from 2018 to 2020. Using regression, we analyzed trends from 90 text-derived features such as sentiment analysis, personal pronouns, and semantic categories. Using supervised machine learning, we classified posts into their respective support groups and interpreted important features to understand how different problems manifest in language. We applied unsupervised methods such as topic modeling and unsupervised clustering to uncover concerns throughout Reddit before and during the pandemic. Results: We found that the r/HealthAnxiety forum showed spikes in posts about COVID-19 early on in January, approximately 2 months before other support groups started posting about the pandemic. There were many features that significantly increased during COVID-19 for specific groups including the categories “economic stress,” “isolation,” and “home,” while others such as “motion” significantly decreased. We found that support groups related to attention-deficit/hyperactivity disorder, eating disorders, and anxiety showed the most negative semantic change during the pandemic out of all mental health groups. Health anxiety emerged as a general theme across Reddit through independent supervised and unsupervised machine learning analyses. For instance, we provide evidence that the concerns of a diverse set of individuals are converging in this unique moment of history; we discovered that the more users posted about COVID-19, the more linguistically similar (less distant) the mental health support groups became to r/HealthAnxiety (ρ=–0.96, P<.001). Using unsupervised clustering, we found the suicidality and loneliness clusters more than doubled in the number of posts during the pandemic. Specifically, the support groups for borderline personality disorder and posttraumatic stress disorder became significantly associated with the suicidality cluster. Furthermore, clusters surrounding self-harm and entertainment emerged. Conclusions: By using a broad set of NLP techniques and analyzing a baseline of prepandemic posts, we uncovered patterns of how specific mental health problems manifest in language, identified at-risk users, and revealed the distribution of concerns across Reddit, which could help provide better resources to its millions of users. We then demonstrated that textual analysis is sensitive to uncover mental health complaints as they appear in real time, identifying vulnerable groups and alarming themes during COVID-19, and thus may have utility during the ongoing pandemic and other world-changing events such as elections and protests.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures






Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“The two studies we identified ( Low et al., 2020; Saha et al., 2020) reported heightened levels of suicide-related posting/suicidality.”
From The impact of the COVID-19 pandemic on self-harm and suicidal behaviour: update of living systematic review (2021) · cites this paper as Low et al., 2020
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Psychological Impact of Quarantine and How to Reduce It: Rapid Review of the Evidence
Brooks, S. K., Webster, R. K., Smith, L. E., Woodland, L., Wessely, S., Greenberg, N., & Rubin, G. J. (2020) · doi:10.2139/ssrn.3532534 · Cited by 16,394
The psychological impact of quarantine and how to reduce it: Rapid review of the evidence
Brooks, S. K., Webster, R. K., Smith, L. E., Woodland, L., Wessely, S., Greenberg, N., & Rubin, G. J. (2020) · The Lancet · doi:10.1016/s0140-6736(20)30460-8 · Cited by 16,378
Psychological interventions for people affected by the COVID-19 epidemic
Duan, L., & Zhu, G. (2020) · The Lancet Psychiatry · doi:10.1016/s2215-0366(20)30073-0 · Cited by 1,885
Detecting depression and mental illness on social media: an integrative review
Guntuku, S. C., Yaden, D. B., Kern, M. L., Ungar, L. H., & Eichstaedt, J. C. (2017) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2017.07.005 · Cited by 722
Natural language processing in mental health applications using non-clinical texts
CALVO, R. A., MILNE, D. N., HUSSAIN, M. S., & CHRISTENSEN, H. (2017) · Natural Language Engineering · doi:10.1017/s1351324916000383 · Cited by 362
Shahsavari, S., Holur, P., Wang, T., Tangherlini, T. R., & Roychowdhury, V. (2020) · Journal of Computational Social Science · doi:10.1007/s42001-020-00086-5 · Cited by 354
Depression and Self-Harm Risk Assessment in Online Forums
Yates, A., Cohan, A., & Goharian, N. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1322 · Cited by 323
Termorshuizen, J. D., Watson, H. J., Thornton, L. M., Borg, S., Flatt, R. E., MacDermod, C. M., Harper, L. E., van Furth, E. F., Peat, C. M., & Bulik, C. M. (2020) · doi:10.1101/2020.05.28.20116301 · Cited by 304
Wardell, J. D., Kempe, T., Rapinda, K. K., Single, A., Bilevicius, E., Frohlich, J. R., Hendershot, C. S., & Keough, M. T. (2020) · Alcoholism: Clinical and Experimental Research · doi:10.1111/acer.14425 · Cited by 288
Alonzi, S., La Torre, A., & Silverstein, M. W. (2020) · Psychological Trauma: Theory, Research, Practice, and Policy · doi:10.1037/tra0000840 · Cited by 211
Research works printed but not linked: 5
- 10.18653/v1/w19-3003 · doi:10.18653/v1/w19-3003
- Pennebaker, JW, 2015, LIWC 2015 Operator’s Manual
- De ChoudhuryMGamonMCountsSHorvitzEPredicting depression via social media2013Seventh International AAAI Conference on Weblogs and Social Media AAAI Publications2013Cambridge, Massachusetts
- Park, A, 2017, AMIA Annu Symp Proc, 2017, 1362
- McInnes, L, 2018, arXiv, 1
Cited by
Torous, J., Bucci, S., Bell, I. H., Kessing, L. V., Faurholt‐Jepsen, M., Whelan, P., Carvalho, A. F., Keshavan, M., Linardon, J., & Firth, J. (2021) · World Psychiatry · doi:10.1002/wps.20883 · Cited by 1,199
Self-citationLaestadius, L., Bishop, A., Gonzalez, M., Illenčík, D., & Campos-Castillo, C. (2024) · New Media & Society · doi:10.1177/14614448221142007 · Cited by 420
John, A., Eyles, E., Webb, R. T., Okolie, C., Schmidt, L., Arensman, E., Hawton, K., O'Connor, R. C., Kapur, N., Moran, P., et al. (2021) · F1000Research · doi:10.12688/f1000research.25522.2 · Cited by 189
The impact of the COVID-19 pandemic on self-harm and suicidal behaviour: a living systematic review
John, A., Okolie, C., Eyles, E., Webb, R. T., Schmidt, L., McGuinness, L. A., Olorisade, B. K., Arensman, E., Hawton, K., Kapur, N., et al. (2020) · F1000Research · doi:10.12688/f1000research.25522.1 · Cited by 178
Artificial intelligence in psychiatry research, diagnosis, and therapy
Sun, J., Dong, Q., Wang, S.-W., Zheng, Y., Liu, X., Lu, T., Yuan, K., Shi, J., Hu, B., Hu, B., et al. (2023) · Asian Journal of Psychiatry · doi:10.1016/j.ajp.2023.103705 · Cited by 198
Metadata
- Authors
- Low, D. M., Rumker, L., Talkar, T., Torous, J., Cecchi, G., & Ghosh, S. S.
- Affiliations
- Harvard University (US)
- Broad Institute (US)
- Beth Israel Deaconess Medical Center (US)
- IBM Research - Thomas J. Watson Research Center (US)
- Corresponding author
- Low, Daniel M
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2020-10-12
- Volume
- 22
- Issue
- 10
- Pages
- e22635
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC7575341
- OpenAlex
- W3085890295
- Cited by
- 340
- References
- 17
- Citations by year
- 2026: 34 · 2025: 46 · 2024: 58 · 2023: 78 · 2022: 72 · 2021: 49 · 2020: 3
- FWCI
- 55.20
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DSpace@MIT (Massachusetts Institute of Technology) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Massachusetts Institute of Technology
- National Institutes of Health
- National Human Genome Research Institute (T32HG002295)
- National Institute on Deafness and Other Communication Disorders (T32DC000038)
- Topics
- Social Sciences › Psychology › Social Psychology › Mental Health via Writing
- Social Sciences › Psychology › Clinical Psychology › COVID-19 and Mental Health
- Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
- Keywords
- COVID-19 pandemic, mental health, online support groups, Reddit, health anxiety, suicide, loneliness, social isolation, financial stress, attention deficit hyperactivity disorder, eating disorders, borderline personality disorder, post-traumatic stress disorder, self-harm, text mining, sentiment analysis, topic modeling, unsupervised clustering, online communities
- MeSH terms
- Betacoronavirus, COVID-19, SARS-CoV-2, Adolescent, Adult, Anxiety, Borderline Personality Disorder, Female, Humans, Male, Mental Health, Middle Aged, Natural Language Processing, Pneumonia, Viral, Self-Help Groups, Stress Disorders, Post-Traumatic, Global Health, Coronavirus Infections, Young Adult, Pandemics, Suicidal Ideation, Social Media
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.