The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Forecasting the onset and course of mental illness with Twitter data
Open accessAbstract
We developed computational models to predict the emergence of depression and Post-Traumatic Stress Disorder in Twitter users. Twitter data and details of depression history were collected from 204 individuals (105 depressed, 99 healthy). We extracted predictive features measuring affect, linguistic style, and context from participant tweets (N = 279,951) and built models using these features with supervised learning algorithms. Resulting models successfully discriminated between depressed and healthy content, and compared favorably to general practitioners’ average success rates in diagnosing depression, albeit in a separate population. Results held even when the analysis was restricted to content posted before first depression diagnosis. State-space temporal analysis suggests that onset of depression may be detectable from Twitter data several months prior to diagnosis. Predictive results were replicated with a separate sample of individuals diagnosed with PTSD (N users = 174, N tweets = 243,775). A state-space time series model revealed indicators of PTSD almost immediately post-trauma, often many months prior to clinical diagnosis. These methods suggest a data-driven, predictive approach for early screening and detection of mental illness.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“For PTSD in particular, although studies have yet to validate models in a clinical setting, past work has shown that AI-based language techniques can distinguish Twitter users that have publicly disclosed a diagnosis of the condition from random selections of users (e.g. Coppersmith, Dredze, & Harman, 2014; Preotiuc-Pietro, Sap, Schwartz, & Ungar, 2015; Reece et al. 2017).”
From World Trade Center responders in their own words: predicting PTSD symptom trajectories with AI-based language analyses of interviews (2023) · cites this paper as Reece et al. 2017
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“In Reece et al, 52 the LabMT was the first predictor in the random forest model to detect PTSD on Twitter data.”
From Linguistic markers for identifying post-traumatic stress disorder and associated symptoms: a systematic literature review (2025) · cites this paper as [52]
The cited source says what the claim attributes to it.
In the citing paper
“The first 2 studies leverage social media data and rely on selfreported PTSD diagnoses, which may contribute to their higher AUC values.”
From Linguistic markers for identifying post-traumatic stress disorder and associated symptoms: a systematic literature review (2025) · cites this paper as [52]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“From the forest plot highlights studies with notably higher AUC scores, particularly Reece et al, 52 Kirinde Gamaarachchige and Inkpen, 84 and Schultebraucks et al. 43”
From Linguistic markers for identifying post-traumatic stress disorder and associated symptoms: a systematic literature review (2025) · cites this paper as [52]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The CES-D Scale: A Self-Report Depression Scale for Research in the General Population
Radloff, L. S. (1977) · Applied Psychological Measurement · doi:10.1177/014662167700100306 · Cited by 53,267
The Parable of Google Flu: Traps in Big Data Analysis
Lazer, D., Kennedy, R., King, G., & Vespignani, A. (2014) · Science · doi:10.1126/science.1248506 · Cited by 2,523
Reputation as a sufficient condition for data quality on Amazon Mechanical Turk
Peer, E., Vosgerau, J., & Acquisti, A. (2014) · Behavior Research Methods · doi:10.3758/s13428-013-0434-y · Cited by 1,618 · cited 1×
“MTurk workers who have completed at least 100 tasks, with a minimum 95% approval rating, have been found to provide reliable, valid survey responses (32).”
BackgroundClinical diagnosis of depression in primary care: a meta-analysis
Mitchell, A. J., Vaze, A., & Rao, S. (2009) · The Lancet · doi:10.1016/s0140-6736(09)60879-5 · Cited by 1,251 · cited 6×
“Precision, recall, specificity, negative predictive value, and F1 accuracy scores are reported, and general practitioners’ unassisted diagnostic accuracy rates as reported in Mitchell, Vaze, and Rao28 (MVR) and Taubman-Ben-Ari et al.22 (TBA) are used as informal benchmarks for depression and PTSD, respectively.”
BackgroundInfluentialFerrari, A. J., Somerville, A. J., Baxter, A. J., Norman, R., Patten, S. B., Vos, T., & Whiteford, H. A. (2013) · Psychological Medicine · doi:10.1017/s0033291712001511 · Cited by 1,230 · cited 1×
“Depression has emerged as the leading mental health condition of interest among computational social scientists (712), as it is a relatively common mental disorder (16) and influences a range of behaviors and patterns of communication (17).”
BackgroundLanguage use of depressed and depression-vulnerable college students
Rude, S., Gortner, E.-M., & Pennebaker, J. (2004) · Cognition & Emotion · doi:10.1080/02699930441000030 · Cited by 1,018 · cited 1×
“This trajectory matches closely with average improvement time frames observed in therapeutic programs (45).”
BackgroundTemporal patterns of happiness and information in a global social network: hedonometrics and Twitter
Dodds, P. S., Harris, K. D., Kloumann, I. M., Bliss, C. A., & Danforth, C. M. (2011) · PLoS ONE · doi:10.1371/journal.pone.0026752 · Cited by 809 · cited 2×
“Word shift graphs We averaged labMT happiness scores across observations in each class, after the removal of common neutral words and retweeted promotional material (38) , .”
BackgroundMethodSelf-citationDiscovering Shifts to Suicidal Ideation from Mental Health Content in Social Media
De Choudhury, M., Kiciman, E., Dredze, M., Coppersmith, G., & Kumar, M. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858207 · Cited by 683 · cited 1×
“In addition to physical ailments, predictive screening methods have successfully identified markers in social media data for a number of mental health issues, including addiction (6), depression (712), PostTraumatic Stress Disorder (PTSD) (13,14), and suicidal ideation (15).”
BackgroundBrief screening instrument for post-traumatic stress disorder
Brewin, C. R., Rose, S., Andrews, B., Green, J., Tata, P., McEvedy, C., Turner, S., & Foa, E. B. (2002) · British Journal of Psychiatry · doi:10.1192/bjp.181.2.158 · Cited by 623 · cited 2×
“The Trauma Screening Questionnaire (TSQ) was used to screen for PTSD (31).”
BackgroundMethodFeeling bad on Facebook: depression disclosures by college students on a social networking site
Moreno, M. A., Jelenchick, L. A., Egan, K. G., Cox, E., Young, H., Gannon, K. E., & Becker, T. (2011) · Depression and Anxiety · doi:10.1002/da.20805 · Cited by 603
Research works printed but not linked: 2
- De Choudhury, M., Gamon, M., Counts, S. & Horvitz, E. Predicting depression via social media. In Seventh International AAAI Conference on Weblogs and Social Media (2013).
- Park, M., Cha, C. & Cha, M. Depressive moods of users portrayed in Twitter. In Proceedings of the ACM SIGKDD Workshop on healthcare informatics (HI-KDD) (pp. 1–8) (2012).
Cited by
Social Media and Mental Health: Benefits, Risks, and Opportunities for Research and Practice
Naslund, J. A., Bondre, A., Torous, J., & Aschbrenner, K. A. (2020) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-020-00134-x · Cited by 746
Detecting depression and mental illness on social media: an integrative review
Guntuku, S. C., Yaden, D. B., Kern, M. L., Ungar, L. H., & Eichstaedt, J. C. (2017) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2017.07.005 · Cited by 722
“[11] predicted user depression and posttraumatic stress-disorder (PTSD) status from text and Twitter meta-data that preceded a reported first episode (see Figure 2 for examples of meta-data) with relatively high Areas under the Receiver Operating Characteristic (ROC) curve (AUCs) of .”
BackgroundFacebook language predicts depression in medical records
Eichstaedt, J. C., Smith, R. J., Merchant, R. M., Ungar, L. H., Crutchley, P., Preoţiuc-Pietro, D., Asch, D. A., & Schwartz, H. A. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1802331115 · Cited by 643
“The fact that language content captures the depressionrelated variance in the other feature groups is consistent with what has been seen in previous work (6, 7, 18).”
BackgroundResultInfluentialMethods in predictive techniques for mental health status on social media: a critical review
Chancellor, S., & De Choudhury, M. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0233-7 · Cited by 557
Instagram photos reveal predictive markers of depression
Reece, A. G., & Danforth, C. M. (2017) · EPJ Data Science · doi:10.1140/epjds/s13688-017-0110-z · Cited by 519
Self-citation
Metadata
- Authors
- Reece, A. G., Reagan, A. J., Lix, K. L. M., Dodds, P. S., Danforth, C. M., & Langer, E. J.
- Affiliations
- Harvard University (US)
- University of Vermont (US)
- Stanford University (US)
- Corresponding author
- Reece, Andrew G.
- Danforth, Christopher M.
- ORCID
- Venue
- Scientific Reports
- Published
- 2017-10-11
- Volume
- 7
- Issue
- 1
- Pages
- 13006-13006
- ISSN
- 2045-2322 (ISSN-L)
- PMC
- PMC5636873
- OpenAlex
- W2512937600
- Semantic Scholar
- 1290aa325025d705edc3b04d244eab2766779755
- Cited by
- 401
- References
- 49
- Citations by year
- 2026: 21 · 2025: 48 · 2024: 44 · 2023: 57 · 2022: 65 · 2021: 68 · 2020: 41 · 2019: 36 · 2018: 15 · 2017: 6
- FWCI
- 38.39
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Scientific Reports (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Digital Access to Scholarship at Harvard (DASH) (Harvard University) (submittedVersion, cc-by)
- ScholarWorks -A service of University of Vermont Libraries (University of Vermont) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation (1447634)
- Harvard University
- Topics
- Social Sciences › Psychology › Social Psychology › Mental Health via Writing
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Keywords
- depression, post-traumatic stress disorder, Twitter, social media, early detection, language style, affect, computational psychiatry, early screening
- MeSH terms
- Depression, Humans, Stress Disorders, Post-Traumatic, Disease Progression, Social Media
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Forecasting the onset and course of mental illness with Twitter data. https://app.cochat.ai/papers/10.1038/s41598-017-12961-9
- The paper
- Reece, A. G., Reagan, A. J., Lix, K. L. M., Dodds, P. S., Danforth, C. M., & Langer, E. J. (2017). Forecasting the onset and course of mental illness with Twitter data. Scientific Reports. https://doi.org/10.1038/s41598-017-12961-9
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.