DLATK: Differential Language Analysis ToolKit
Open accessThe DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Abstract
H. Andrew Schwartz, Salvatore Giorgi, Maarten Sap, Patrick Crutchley, Lyle Ungar, Johannes Eichstaedt. Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing: System Demonstrations. 2017.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482 · cited 1×
“When used through the interface script, DLATK by default corrects for multiple comparisons using the Benjamini-Hochberg method of FDR correction (Benjamini and Hochberg, 1995).”
MethodScikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016
An introduction to ROC analysis
Fawcett, T. (2006) · Pattern Recognition Letters · doi:10.1016/j.patrec.2005.10.010 · Cited by 21,879 · cited 1×
“Where controls are not needed, there are many other options, often less computationally complex, such as TF-IDF , Informative Dirichlet Prior , 3 or classification accuracy metrics like Area Under the ROC Curve (Fawcett, 2006).”
MethodConstruct validity in psychological tests.
Cronbach, L. J., & Meehl, P. E. (1955) · Psychological Bulletin · doi:10.1037/h0040957 · Cited by 11,195 · cited 1×
“DLATK can provide researchers with enough information to generate hypotheses and clarify the “nomological net” of a construct (Cronbach and Meehl, 1955); That is, help identify the psychological and social processes and constructs that relate to (are sufficiently correlated with) the outcome under…”
BackgroundLinear Statistical Inference and its Applications: Second Editon
Rao, C. R. (1973) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316436 · Cited by 10,489
Statsmodels: Econometric and Statistical Modeling with Python
Seabold, S., & Perktold, J. (2010) · Proceedings of the Python in Science Conference · doi:10.25080/majora-92bf1922-011 · Cited by 6,465 · cited 1×
“…sits on top of many popular open source packages used for data analysis and machine learning (scikit-learn (Pedregosa et al., 2011) and statsmodels (Seabold and Perktold, 2010)) as well as NLP spe-cific packages (Stanford parser (Chen and Man-ning, 2014), TweetNLP (Gimpel et al., 2011) and NLTK…”
BackgroundMultiple comparisons among means
Dunn, O. J. (1961) · Journal of the American Statistical Association · doi:10.1080/01621459.1961.10482090 · Cited by 5,006 · cited 1×
“Other options, such as the more conservative Bon-ferroni correction (Dunn, 1961) are also available.”
MethodApplied Logistic Regression Analysis
(1996) · Technometrics · doi:10.1080/00401706.1996.10484485 · Cited by 3,598
NLTK: the Natural Language Toolkit
Loper, E., & Bird, S. (2002) · Proceedings of the ACL-02 Workshop on Effective tools and methodologies for teaching natural language processing and computational linguistics - · doi:10.3115/1118108.1118117 · Cited by 3,218 · cited 1×
“NLTK (Loper and Bird, 2002)).”
Applied Logistic Regression Analysis
Menard, S. (2002) · Sage eBooks · doi:10.4135/9781412983433 · Cited by 2,989
Cited by
Transformer models for text-based emotion detection: a review of BERT-based approaches
Acheampong, F. A., Nunoo-Mensah, H., & Chen, W. (2021) · Artificial Intelligence Review · doi:10.1007/s10462-021-09958-2 · Cited by 659
Using large language models in psychology
Demszky, D., Yang, D., Yeager, D. S., Bryan, C. J., Clapper, M., Chandhok, S., Eichstaedt, J. C., Hecht, C., Jamieson, J., Johnson, M., et al. (2023) · Nature Reviews Psychology · doi:10.1038/s44159-023-00241-5 · Cited by 369
“This is a Linux-based library that provides a user-friendly interface to many natural language processing Python libraries, including those that provide access to LLMs 113 .”
MethodSelf-citationTrotzek, M., Koitka, S., & Friedrich, C. M. (2020) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2018.2885515 · Cited by 226
“With a similar purpose, Differential Language Analysis Toolkit (DLATK) [22], an open-source Python library, was created for text analysis with a psychological, health, or social focus.”
MethodJaidka, K., Giorgi, S., Schwartz, H. A., Kern, M. L., Ungar, L. H., & Eichstaedt, J. C. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1906364117 · Cited by 228
“In the primary analysis, we determined the convergent validity between the language-based methods and the Gallup county-level outcomes using an open-source Python codebase (29).”
MethodSelf-citationUnderstanding and Measuring Psychological Stress Using Social Media
Chandra Guntuku, S., Buffone, A., Jaidka, K., Eichstaedt, J. C., & Ungar, L. H. (2019) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v13i01.3223 · Cited by 133
Self-citationMental Health Analysis in Social Media Posts: A Survey
Garg, M. (2023) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-022-09863-z · Cited by 197
“The non-neural models may be implemented via the DLATK Python package [90].”
MethodThe language of well-being: Tracking fluctuations in emotion experience through everyday speech.
Sun, J., Schwartz, H. A., Son, Y., Kern, M. L., & Vazire, S. (2019) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000244 · Cited by 148
“, 2013; Schwartz et al., 2016) examined correlations between open-vocabulary topics and life satisfaction. Schwartz, Eichstaedt, Kern, Dziurzynski, Agrawal, and colleagues (2013) predicted county-level life satisfaction from Tweets that were geolocated to those counties (the Tweeters were not the same people who provi…”
BackgroundMethodInfluentialSelf-citationLLM-generated messages can persuade humans on policy issues
Bai, H., Voelkel, J. G., Muldowney, S., Eichstaedt, J. C., & Willer, R. (2025) · Nature Communications · doi:10.1038/s41467-025-61345-5 · Cited by 110
Self-citationObschonka, M., Lee, N., Rodríguez‐Pose, A., Eichstaedt, J. C., & Ebert, T. (2019) · Small Business Economics · doi:10.1007/s11187-019-00204-2 · Cited by 131
“Using the methods described in Park et al. (2015) and an opensource code base (Differential Language Analysis ToolKit, see dlatk.wwbp.org; Schwartz et al. 2017), we extracted the relative frequency of words and phrases for every user, in addition to their use of 2000 topics extracted in previous…”
MethodSelf-citationModeling Empathy and Distress in Reaction to News Stories
Buechel, S., Buffone, A., Slaff, B., Ungar, L., & Sedoc, J. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1507 · Cited by 102
“The Differential Language Analysis Toolkit (Schwartz et al., 2017) was utilized for this analysis.”
MethodSelf-citationSuicide Risk Assessment with Multi-level Dual-Context Language and
Matero, M., Idnani, A., Son, Y., Giorgi, S., Vu, H., Zamani, M., Limbachiya, P., Guntuku, S. C., & Schwartz, H. A. (2019) · Proceedings of the Sixth Workshop on Computational Linguistics and Clinical Psychology · doi:10.18653/v1/w19-3005 · Cited by 102
“All non-neural models were implemented via the DLATK Python package (Schwartz et al., 2017).”
MethodSelf-citationKjell, O., Sikström, S., Kjell, K., & Schwartz, H. A. (2022) · Scientific Reports · doi:10.1038/s41598-022-07520-w · Cited by 126
“These ranges were based on a wide range of empirical evidence from applications of the DLATK package 31 which has applied the same models for Python rather than R.”
MethodSelf-citationCan Twitter be used to predict county excessive alcohol consumption rates?
Curtis, B., Giorgi, S., Buffone, A. E. K., Ungar, L., Ashford, R. D., Hemmons, J., Summers, D., Hamilton, C., & Schwartz, H. A. (2018) · PLoS ONE · doi:10.1371/journal.pone.0194290 · Cited by 98
Self-citationAge and gender in language, emoji, and emoticon usage in instant messages
Koch, T. K., Romero, P., & Stachl, C. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2021.106990 · Cited by 125
Categorizing and Inferring the Relationship between the Text and Image of Twitter Posts
Vempala, A., & Preoțiuc-Pietro, D. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1272 · Cited by 110
“When performed using text features, this technique was coined Differential Language Analysis (Schwartz et al., 2013, 2017).”
MethodKjell, O., Kjell, K., & Schwartz, H. A. (2023) · Psychiatry Research · doi:10.1016/j.psychres.2023.115667 · Cited by 150
Self-citationAutomatically Identifying Complaints in Social Media
Preotiuc-Pietro, D., Găman, M., & Aletras, N. (2019) · Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1495 · Cited by 71
Guntuku, S. C., Buttenheim, A. M., Sherman, G. T., & Merchant, R. M. (2021) · Vaccine · doi:10.1016/j.vaccine.2021.06.014 · Cited by 68
Facebook versus Twitter: Differences in Self-Disclosure and Trait Prediction
Jaidka, K., Guntuku, S. C., & Ungar, L. (2018) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v12i1.15026 · Cited by 77
Self-citationOjo, A., Guntuku, S. C., Zheng, M., Beidas, R. S., & Ranney, M. L. (2020) · JMIR Public Health and Surveillance · doi:10.2196/24562 · Cited by 51
“After tokenizing the tweets [15], we extracted the relative frequency of single words and phrases and created two sets of features: (1) an open vocabulary feature set [16] defined using the MALLET (Machine Learning for Language Toolkit) implementation of latent Dirichlet allocation [17], an unsupervised clustering alg…”
Ganesan, A. V., Matero, M., Ravula, A. R., Vu, H., & Schwartz, H. A. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.357 · Cited by 74
Self-citationReal-world unexpected outcomes predict city-level mood states and risk-taking behavior
Otto, A. R., & Eichstaedt, J. C. (2018) · PLoS ONE · doi:10.1371/journal.pone.0206923 · Cited by 46
Self-citationSon, Y., Clouston, S. A. P., Kotov, R., Eichstaedt, J. C., Bromet, E. J., Luft, B. J., & Schwartz, H. A. (2023) · Psychological Medicine · doi:10.1017/s0033291721002294 · Cited by 42
Self-citationYang, Q., Tufts, C., Ungar, L., Guntuku, S. C., & Merchant, R. M. (2018) · Journal of Health Communication · doi:10.1080/10810730.2018.1540671 · Cited by 49
“URLs and user handles were identified and retweets (starting with an ‘ RT: ’ ) were removed using the Differential Language Analysis Toolkit (DLATK; Schwartz et al., 2017).”
MethodSelf-citationSwaminathan, V., Schwartz, H. A., Menezes, R., & Hill, S. (2022) · Journal of Interactive Marketing · doi:10.1177/10949968221088275 · Cited by 47
“We used Schwartz et al. ’ s (2017) social media tokenizer, which appropriately handles extra-linguistic social media content such as hashtags, emoticons, and “ at-mentions ” of other users.”
MethodInfluentialSelf-citationAgarwal, S., Guntuku, S. C., Robinson, O. C., Dunn, A., & Ungar, L. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.00341 · Cited by 78
“This was conducted using an open source language analysis toolkit (DLATK) (Schwartz et al., 2017).”
MethodSelf-citationTwitter Corpus of the #BlackLivesMatter Movement and Counter Protests: 2013 to 2021
Giorgi, S., Guntuku, S. C., Himelein-Wachowiak, M., Kwarteng, A. E., Hwang, S., Rahman, M., & Curtis, B. L. (2022) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v16i1.19373 · Cited by 42
“As opposed to splitting up the tweets by white space, we use a tokenizer built specifically for social media text that can pick emojis, hashtags, and misspellings (Schwartz et al. 2017).”
Self-citationUnderstanding Weekly COVID-19 Concerns through Dynamic Content-Specific LDA Topic Modeling
Zamani, M., Schwartz, H. A., Eichstaedt, J. C., Guntuku, S. C., Ganesan, A. V., Clouston, S., & Giorgi, S. (2020) · Workshop on Natural Language Processing and Computational Social Science (NLP+CSS) · doi:10.18653/v1/2020.nlpcss-1.21 · Cited by 39
“All text pre-processing as well as the prediction task is done with the Python package DLATK (Schwartz et al., 2017).”
MethodSelf-citationExploring Substance Use Tweets of Youth in the United States: Mixed Methods Study
Stevens, R. C., Brawner, B. M., Kranzler, E. C., Giorgi, S., Lazarus, E., Abera, M., Huang, S. X. L., & Ungar, L. (2020) · JMIR Public Health and Surveillance · doi:10.2196/16191 · Cited by 33
“After removing both non-English tweets and duplicate tweets [32,33], often from bots and advertisers, we produced age and racial affiliation estimates for each user based on our tested algorithms [34,35].”
MethodSelf-citationSantos, L. A., Voelkel, J. G., Willer, R., & Zaki, J. (2022) · Psychological Science · doi:10.1177/09567976221098594 · Cited by 41
“First, we determined the relative frequency with which participants used words and two- to three-word phrases using Differential Language Analysis Toolkit (DLATK), an open-source Python language-analysis package (Schwartz et al., 2017).”
MethodHawes, M. T., Schwartz, H. A., Son, Y., & Klein, D. N. (2022) · Psychological Medicine · doi:10.1017/s0033291722003452 · Cited by 42
Self-citationKjell, O., Giorgi, S., & Schwartz, H. A. (2021) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/293kt · Cited by 39
Self-citationGuntuku, S. C., Purtle, J., Meisel, Z. F., Merchant, R. M., & Agarwal, A. K. (2021) · Journal of Medical Internet Research · doi:10.2196/27300 · Cited by 32
“Language Feature Extraction We extracted the relative frequency of single words and phrases from tweets by using the Differential Language Analysis ToolKit package [8] and created two sets of features—(1) an open vocabulary that was defined by using latent Dirichlet allocation [9], an unsupervised clustering algorithm…”
MethodDiachronic degradation of language models: Insights from social media
Jaidka, K., Chhaya, N., & Ungar, L. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-2032 · Cited by 55
“These topics are modeled as open-ended clusters of words from actual distributions in social media over approximately 18 million Facebook updates, and are provided as an open-sourced resource in the DLATK python toolkit (Schwartz et al., 2017).”
BackgroundSelf-citationUsing Search Queries to Understand Health Information Needs in Africa
Abebe, R., Hill, S., Vaughan, J. W., Small, P. M., & Schwartz, H. A. (2019) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v13i01.3360 · Cited by 30
Self-citationIreland, M. E., & Iserman, M. (2018) · Workshop on Computational Linguistics and Clinical Psychology (CLPsych) · doi:10.18653/v1/w18-0620 · Cited by 37
“LIWC is also arguably more appropriate than open-vocabulary approaches in smaller samples (N 5,000), where individual words or topics may not occur often enough to be useful predictors (Schwartz et al., 2016, 2017).”
BackgroundModeling the Severity of Complaints in Social Media
Jin, M., & Αλέτρας, Ν. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.180 · Cited by 43
Analyzing Political Parody in Social Media
Maronikolakis, A., Villegas, D. S., Preoțiuc-Pietro, D., & Αλέτρας, Ν. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.403 · Cited by 33
Correcting Sociodemographic Selection Biases for Population Prediction from Social Media
Giorgi, S., Lynn, V., Gupta, K., Ahmed, F., Matz, S., Ungar, L., & Schwartz, H. A. (2022) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v16i1.19287 · Cited by 51
“We concatenate all tweets from each user in our data set and tokenize using a tokenzier built for social media data (Schwartz et al. 2017).”
MethodSelf-citationThe language of character strengths: Predicting morally valued traits on social media
Pang, D., Eichstaedt, J. C., Buffone, A. E. K., Slaff, B., Ruch, W., & Ungar, L. (2019) · Journal of Personality · doi:10.1111/jopy.12491 · Cited by 31
“Second, again using DLATK, we performed DLA (Schwartz, Eichstaedt, Dziurzynski, Kern, Blanco, Ramones, et al., 2013) to identify the most distinguishing language features for our outcomes.”
MethodSelf-citationQuillivic, R., Gayraud, F., Auxéméry, Y., Vanni, L., Peschanski, D., Eustache, F., Dayan, J., & Mesmoudi, S. (2024) · Scientific Reports · doi:10.1038/s41598-024-61557-7 · Cited by 24
AI-based analysis of social media language predicts addiction treatment dropout at 90 days
Curtis, B. L., Giorgi, S., Ungar, L., Vu, H., Yaden, D. B., Liu, T., Yadeta, K., & Schwartz, H. A. (2023) · Neuropsychopharmacology · doi:10.1038/s41386-023-01585-5 · Cited by 32
“[17], and implemented within the Differential Language Analysis Toolkit (DLATK [27]).”
Self-citationSimchon, A., Guntuku, S. C., Simhon, R., Ungar, L., Hassin, R. R., & Gilead, M. (2020) · Journal of Experimental Psychology General · doi:10.1037/xge0000767 · Cited by 27
“From each post in our dataset, the frequency of single words was extracted using an open-source language analysis toolkit (Schwartz et al., 2017).”
Self-citationAssociation Between HIV-Related Tweets and HIV Incidence in the United States: Infodemiology Study
Stevens, R. C., Bonett, S., Bannon, J. A., Chittamuru, D., Slaff, B., Browne, S., Huang, S. X. L., & Bauermeister, J. A. (2020) · Journal of Medical Internet Research · doi:10.2196/17196 · Cited by 23
Learning Word Ratings for Empathy and Distress from Document-Level User ResponsesPreprint
Sedoc, J., Buechel, S., Nachmany, Y., Buffone, A. E. K., & Ungar, L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.01079 · Cited by 44
“(2014), as implemented in the Differential Language Analysis Toolkit (DLATK, (Schwartz et al., 2017)).”
MethodSelf-citationAhmed, S., Chen, V. H. H., Jaidka, K., Hooi, R., & Chib, A. I. (2021) · Asian Journal of Communication · doi:10.1080/01292986.2021.1929358 · Cited by 32
“Using the Python NLTK (Loper & Bird, 2002) and DLATK toolkits (Schwartz et al., 2017), we filtered the posts to retain only those which were posted in English and mentioned immigrants.”
MethodStatistical inferences for polarity identification in natural language
Pröllochs, N., Feuerriegel, S., & Neumann, D. (2018) · PLoS ONE · doi:10.1371/journal.pone.0209323 · Cited by 29
You versus we: How pronoun use shapes perceptions of receptiveness
Hussein, M. A., & Tormala, Z. L. (2023) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2023.104555 · Cited by 25
Ahmed, S., Jaidka, K., Chen, V. H. H., Cai, M., Chen, A., Emes, C. S., Yu, V., & Chib, A. I. (2024) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1280366 · Cited by 39
“Utilizing the Python Mallet package via the Differential Language Analysis Toolkit (DLATK), which is tailored for short social media posts (Schwartz et al., 2017), we conducted a grid search to determine the optimal alpha parameter and the number of topics.”
MethodTurnwald, B. P., Perry, M. A., Jurgens, D., Prabhakaran, V., Jurafsky, D., Markus, H. R., & Crum, A. J. (2022) · Appetite · doi:10.1016/j.appet.2022.105949 · Cited by 24
“Word-level cross validation of themes As a fully data-driven open-vocabulary approach, we determined which words and phrases from Twitter were most associated with each of the 7 themes using an open-source Python-based language analysis infrastructure (Schwartz et al., 2017).”
MethodUnderstanding Communication in an Online Cancer Forum: Content Analysis Study
Andy, A., & Andy, U. U. (2021) · JMIR Cancer · doi:10.2196/29555 · Cited by 21
“Using the DLATK package [18], we generated 20 LDA topics from the /r/Cancer posts by users that self-declared to have or had cancer (ie, the “has cancer” group) and users who self-declared to be family members or friends (ie, the “family or friend” group); we chose to generate 20 topics because we varied the number of…”
MethodJaidka, K. (2022) · Scientific Reports · doi:10.1038/s41598-022-07219-y · Cited by 33
More Evidence that Twitter Language Predicts Heart Disease: A Response and ReplicationPreprint
Eichstaedt, J. C., Schwartz, H. A., Giorgi, S., Kern, M. L., Park, G., Sap, M., Labarthe, D. R., Larson, E. E., Seligman, M. E. P., & Ungar, L. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/p75ku · Cited by 21
“We built simple ridge regression models (a straightforward machine learning extension of linear regression models) using DLATK ( Schwartz et al, 2017 ), picking ridge hyperparameters that are appropriate for the number of different predictors in the different models (2,000 Twitter topics: alpha =…”
BackgroundMethodInfluentialSelf-citationEichstaedt, J. C., & Weidman, A. C. (2020) · European Journal of Personality · doi:10.1002/per.2261 · Cited by 27
“…et al., 2016), for the 2895 human-annotated Facebook statuses in the calibration sample, we used the Differential Language Analysis ToolKit (DLATK; Schwartz et al., 2017; see dlatk.wwbp.org) to extract three sets of linguistic features: (i) the relative frequency of occurrences of words and…”
MethodSelf-citationWanchoo, K., Abrams, M. P., Merchant, R. M., Ungar, L., & Guntuku, S. C. (2023) · PLoS ONE · doi:10.1371/journal.pone.0280337 · Cited by 19
Self-citationCultural Differences in Tweeting about Drinking Across the US
Giorgi, S., Yaden, D. B., Eichstaedt, J. C., Ashford, R. D., Buffone, A. E. K., Schwartz, H. A., Ungar, L., & Curtis, B. L. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17041125 · Cited by 22
“Early versions of this process (“tokenizing”) used white spaces to split a sentence into words, but we used a more modern version designed to handle social media language data (which may include, for example, “:)!” to be broken up into “:)” and “!”) [32].”
MethodSelf-citationSouthwick, L., Guntuku, S. C., Klinger, E. V., Pelullo, A., McCalpin, H. J., & Merchant, R. M. (2021) · International Review of Psychiatry · doi:10.1080/09540261.2020.1854195 · Cited by 18
“Using ordinary least squares regression, we identified words, phrases and topics significantly associated with valence and effect size was measured using Pearson ’ s r with the DLATK library (Schwartz et al., 2017).”
MethodAndy, A. (2021) · JMIR Formative Research · doi:10.2196/28738 · Cited by 24
“Using the Dlatk package [25], for each group of /r/AskReddit posts (ie, posts belonging to /r/Lonely users and the control group users), the proportion of token words associated with LIWC categories were determined.”
MethodDetecting Symptoms of Depression on Reddit
Liu, T., Jain, D., Rapole, S. R., Curtis, B. L., Eichstaedt, J. C., Ungar, L., & Guntuku, S. C. (2023) · ACM Web Science Conference (WebSci) · doi:10.1145/3578503.3583621 · Cited by 26
“We tokenized every post using happierfuntokenizer from the DLATK Python library [56] and masked specific tokens, such as URLs into meta tags.”
MethodSelf-citationRobust language-based mental health assessments in time and space through social media
Mangalik, S., Eichstaedt, J. C., Giorgi, S., Mun, J., Ahmed, F., Gill, G., Ganesan, A. V., Subrahmanya, S., Soni, N., Clouston, S., et al. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01100-0 · Cited by 35
Self-citationKjell, O., Kjell, K., & Schwartz, H. A. (2023) · doi:10.31234/osf.io/yfd8g · Cited by 15
Self-citationMeasuring the Language of Self-Disclosure across Corpora
Reuel, A., Peralta, S., Sedoc, J., Sherman, G. T., & Ungar, L. (2022) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2022.findings-acl.83 · Cited by 22
“309 N-gram distributions We tokenized the texts us- 310 ing the Happier Fun Tokenizer (Schwartz et al., 311 2017) and extracted uni-, bi- and trigrams.”
MethodSelf-citationGriffis, H. M., Asch, D. A., Schwartz, H. A., Ungar, L., Buttenheim, A. M., Barg, F. K., Mitra, N., & Merchant, R. M. (2020) · JMIR Diabetes · doi:10.2196/14431 · Cited by 21
Self-citationUsing Facebook language to predict and describe excessive alcohol use
Jose, R., Matero, M., Sherman, G. T., Curtis, B. L., Giorgi, S., Schwartz, H. A., & Ungar, L. (2022) · Alcoholism Clinical and Experimental Research · doi:10.1111/acer.14807 · Cited by 15
“…behavioral norms of drinking abstinence or moderation while simultaneously discouraging other health- compromising behaviors (e.g., smoking, drug use, and risky sex; Seybold & Hill, 2001), it is not entirely surprising that low- risk drinkers appear to use more religious language over social media.”
Self-citationArtificial intelligence language predictors of two-year trauma-related outcomes
Oltmanns, J. R., Schwartz, H. A., Ruggero, C., Son, Y., Miao, J., Waszczuk, M., Clouston, S. A. P., Bromet, E. J., Luft, B. J., & Kotov, R. (2021) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2021.09.015 · Cited by 13
Self-citationTowards Mental Health Analysis in Social Media for Low-resourced Languages
Garg, M. (2023) · ACM Transactions on Asian and Low-Resource Language Information Processing · doi:10.1145/3638761 · Cited by 24
“Differential Language Analysis Toolkit ( DLATK ) is an end-to-end human text analysis package for social media and social scientific applications [102].”
BackgroundRai, S., Kornides, M. L., Morgan, J. C., Kumar, A., Cappella, J. N., & Guntuku, S. C. (2024) · Scientific Reports · doi:10.1038/s41598-024-64703-3 · Cited by 16
Giorgi, S., Zhao, K., Feng, A. H., & Martin, L. J. (2023) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v17i1.22141 · Cited by 20
“We then extract unigrams from each submission using a tokenizer designed to capture the idiosyncrasies of social media text (e.g., emoticons, misspellings; Schwartz et al. (2017)).”
MethodSelf-citationPredicting Email and Article Clickthroughs with Domain-adaptive Language Models
Jaidka, K., Goyal, T., & Chhaya, N. (2018) · ACM Web Science Conference (WebSci) · doi:10.1145/3201064.3201071 · Cited by 17
“We used DLATK’s implementation of Python’s scikitlearn package [30] to model email clickthroughs in terms of the language of the subject lines.”
MethodCOVID-19 contact tracing app reviews reveal concerns and motivations around adoption
Dixon, E. L., Joshi, S. M., Ferrell, W. J., Volpp, K. G. M., Merchant, R. M., & Guntuku, S. C. (2022) · PLoS ONE · doi:10.1371/journal.pone.0273222 · Cited by 12
“Logistic regression was used to identify topics associated with review ratings [14].”
MethodIdentifying Locus of Control in Social Media Language
Rouhizadeh, M., Jaidka, K., Smith, L. K., Schwartz, H. A., Buffone, A. E. K., & Ungar, L. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1145 · Cited by 11
“To train and test the classifiers for the Stage 1 and 2, we use the Differential Language Analysis ToolKit2 (DLATK) (Schwartz et al., 2017), a Python package developed for social media text analysis.”
MethodSelf-citationQuantifying Community Characteristics of Maternal Mortality Using Social Media
Abebe, R., Giorgi, S., Tedijanto, A., Buffone, A. E. K., & Schwartz, H. A. (2020) · International World Wide Web Conference (WWW) · doi:10.1145/3366423.3380066 · Cited by 16
“ugh which Black communities experience increased rates of maternal mortality? All data processing, feature extraction and statistical analysis are performed using the open source Python package DLATK [78]. 5.1 Prediction We use two types of predictive models, depending on the type of independent variables. All non-lan…”
MethodInfluentialSelf-citationIndu, V. T., & Thampi, S. M. (2021) · Communications in computer and information science · doi:10.1007/978-981-16-0425-6_17 · Cited by 13
Evaluating Contextual Embeddings and their Extraction Layers for Depression Assessment
Matero, M., Hung, A., & Schwartz, H. A. (2022) · Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis (WASSA) · doi:10.18653/v1/2022.wassa-1.9 · Cited by 16
“…there has been some work applying contextual embeddings and transformer language models to human-level predictions, the most in depth has been V Ganesan et al. (2021) who investigated the use of contextual embeddings in low-data scenarios across various areas including mental health,…”
BackgroundResultSelf-citationDouglas, I. P., Skillicorn, A. T., Chan, D., Bencharit, L. Z., & Billington, S. L. (2024) · Cities · doi:10.1016/j.cities.2024.105383 · Cited by 8
Chan, M. S., Lohmann, S., Morales, A., Zhai, C., Ungar, L., Holtgräve, D. R., & Albarracín, D. (2018) · AIDS and Behavior · doi:10.1007/s10461-018-2046-0 · Cited by 8
“They used tweets from June 2009 to March 2010 [38] and identified two topics that were negatively and positively associated with HIV prevalence rates in counties.”
MethodSelf-citationLinguistic analysis of empathy in medical school admission essays
Yaden, M. E., Yaden, D. B., Buffone, A. E. K., Eichstaedt, J. C., Crutchley, P., Smith, L. K., Cass, J. L., Callahan, C. A., Rosenthal, S., Ungar, L., et al. (2020) · International Journal of Medical Education · doi:10.5116/ijme.5f2d.0359 · Cited by 8
Self-citationGolos, A., Guntuku, S. C., Piltch-Loeb, R. N., Leininger, L. J., Simanek, A. M., Kumar, A., Albrecht, S. S., Dowd, J. B., Jones, M., & Buttenheim, A. M. (2023) · PLoS ONE · doi:10.1371/journal.pone.0281773 · Cited by 11
Giorgi, S., Yaden, D. B., Eichstaedt, J. C., Ungar, L., Schwartz, H. A., Kwarteng, A. E., & Curtis, B. L. (2023) · Scientific Reports · doi:10.1038/s41598-023-34468-2 · Cited by 13
Self-citationStade, E. C., Ungar, L., Eichstaedt, J. C., Sherman, G. T., & Ruscio, A. M. (2023) · doi:10.31234/osf.io/7qvcz · Cited by 8
Self-citationPerseverative thinking is associated with features of spoken language
Stade, E. C., Ungar, L., Havaldar, S., & Ruscio, A. M. (2023) · Behaviour Research and Therapy · doi:10.1016/j.brat.2023.104307 · Cited by 10
“(R Core Team, 2019), and the Differential Language Analysis ToolKit, version 1.2.6 (Schwartz et al., 2017).”
InfluentialSelf-citationUnsupervised multimodal learning for image-text relation classification in tweets
Sun, L. J., Li, Q., Liu, L., & Su, Y. (2023) · Pattern Analysis and Applications · doi:10.1007/s10044-023-01204-5 · Cited by 7
Lomas, T., Nilsson, A., Kjell, O., Niemiec, R. M., Pawelski, J. O., Padgett, R. N., & VanderWeele, T. J. (2025) · The Journal of Positive Psychology · doi:10.1080/17439760.2025.2459400 · Cited by 14
“…quantifying language differences in the embedding space uses very recent language analysis techniques (Kjell et al., 2023), topic analysis is one of the most common approaches to understand language differences, having been around for over two decades (Blei et al., 2003; Schwartz et al., 2017).”
Assessing Objective Recommendation Quality through Political Forecasting
Schwartz, H. A., Rouhizadeh, M., Bishop, M., Tetlock, P. E., Mellers, B. A., & Ungar, L. (2017) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d17-1250 · Cited by 10
“All methods were implemented within the package, dlatk (Schwartz et al., 2017).”
MethodSelf-citationResidualized Factor Adaptation for Community Social Media Prediction Tasks
Zamani, M., Schwartz, H. A., Lynn, V., Giorgi, S., & Balasubramanian, N. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1392 · Cited by 8
“The open-source Differential Language Analysis ToolKit was used for the entire analysis pipeline (feature extraction through modeling) (Schwartz et al., 2017) 1 .”
Self-citationSoni, N., Matero, M., Balasubramanian, N., & Schwartz, H. A. (2022) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2022.findings-acl.52 · Cited by 31
Self-citationDu, Y. Y. L., Jain, D., Cho, Y., Hou, D. X., Guntuku, S. C., Ungar, L., & Tay, L. (2024) · Journal of Career Assessment · doi:10.1177/10690727241289125 · Cited by 8
Self-citationPsychAdapter: adapting LLMs to reflect traits, personality, and mental health
Vu, H., Nguyen, H. A., Ganesan, A. V., Juhng, S., Kjell, O., Sedoc, J., Kern, M. L., Boyd, R. L., Ungar, L., Schwartz, H. A., et al. (2026) · npj Artificial Intelligence · doi:10.1038/s44387-026-00071-9 · Cited by 31
“…be trained, without risk to patients,usingsimulatedconversationpartnersexpressingdifferentlevelsof depressionandpersonalitycharacteristics,aidingintheirabilitytopickup indicationsofdistresswithouthigh-riskpatientinteractions. further, transformer-basedtextgenerationmodelsarebuiltintomanymodern…”
Self-citationNonsuicidal Self-Injury and Substance Use Disorders: A Shared Language of Addiction
Giorgi, S., Himelein-Wachowiak, M., Habib, D., Ungar, L., & Curtis, B. L. (2022) · Workshop on Computational Linguistics and Clinical Psychology (CLPsych) · doi:10.18653/v1/2022.clpsych-1.15 · Cited by 10
“We use the Mallet Java software wrapper within the DLATK Python package (McCallum, 2002; Schwartz et al., 2017).”
MethodSelf-citationFrom virus to viral: content analysis of HIV-related Twitter messages among young men in the U.S.
Wang, Y., Bannon, J. A., Roszkowska, N., Wilson, E. L., Bonett, S., Lazarus, E., Dowshen, N., & Stevens, R. C. (2024) · BMC Digital Health · doi:10.1186/s44247-024-00102-y · Cited by 5
“Non-English tweets were identified using existing open-source algorithms [34, 35] and removed.”
MethodPoint-of-Interest Type Inference from Social Media Text
Villegas, D. S., Preoțiuc-Pietro, D., & Αλέτρας, Ν. (2020) · Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the International Joint Conference on Natural Language Processing (AACL-IJCNLP) · doi:10.18653/v1/2020.aacl-main.80 · Cited by 9
Discourse-Level Representations can Improve Prediction of Degree of Anxiety
Juhng, S., Matero, M., Varadarajan, V., Eichstaedt, J. C., Ganesan, A. V., & Schwartz, H. A. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-short.128 · Cited by 23
Self-citationQuantifying the Suicidal Tendency on Social Media: A SurveyPreprint
Garg, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.03663 · Cited by 15
“Category Sub-Category Feature Type Research Articles Emotional Emotional Model Plutchik Post [93] VAD Post [48, 60, 102] Affect & Intensity Post [60] big 5 personality [99] Post [60] Anxiety, anger, dep.”
BackgroundMethodGiorgi, S., Bellew, D., Habib, D. R. S., Sedoc, J., Smitterberg, C. W., Devoto, A., Himelein-Wachowiak, M., & Curtis, B. L. (2024) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v18i1.31328 · Cited by 19
Self-citationBeech, A., Fan, H., Shu, J., Oyarzún, J. P., Nadel, P., Karaman, O. T., Vranos, S., Phelps, E. A., & Kredlow, M. A. (2025) · Journal of Affective Disorders · doi:10.1016/j.jad.2025.01.139 · Cited by 9
Liu, T., Giorgi, S., Tao, X., Guntuku, S. C., Bellew, D., Curtis, B. L., & Ungar, L. (2023) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v17i1.22226 · Cited by 11
“Text-Based Estimates We employed off-the-shelf text-based models to estimate age, gender (Sap et al. 2014), depression (Schwartz et al. 2017), stress (Guntuku et al. 2019), and life satisfaction (Jaidka et al. 2020).”
Self-citationShapira, N., Atzil–Slonim, D., Juravski, D., Baruch, M., Stolowicz-Melman, D., Paz, A., Alfi‐Yogev, T., Azoulay, R., Singer, A., Revivo, M., et al. (2021) · Workshop on Computational Linguistics and Clinical Psychology (CLPsych) · doi:10.18653/v1/2021.clpsych-1.6 · Cited by 10
“, 2015), Vaderlexicon (Hutto and Gilbert, 2014), NRC-SentimentEmotion-Lexicon (Mohammad and Turney, 2013), MRC (Coltheart, 1981), and DLATK (Schwartz et al., 2017), however no valid psycho-linguistic lexicon for Hebrew exists.”
BackgroundGuntuku, S. C., Giorgi, S., & Ungar, L. (2018) · Workshop on Computational Linguistics and Clinical Psychology (CLPsych) · doi:10.18653/v1/w18-0610 · Cited by 9
Self-citation
Metadata
- Authors
- Schwartz, H. A., Giorgi, S., Sap, M., Crutchley, P., Ungar, L., & Eichstaedt, J.
- Affiliations
- University of Washington (US)
- Stony Brook University (US)
- Corresponding author
- Giorgi, Salvatore
- ORCID
- Venue
- Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing: System Demonstrations
- Published
- 2017
- Pages
- 55-60
- OpenAlex
- W2757124792
- Semantic Scholar
- 038ad68cae08893958f6c1285dd924df74565372
- Cited by
- 130
- References
- 40
- Citations by year
- 2026: 6 · 2025: 6 · 2024: 11 · 2023: 25 · 2022: 16 · 2021: 19 · 2020: 15 · 2019: 12 · 2018: 19 · 2017: 1
- FWCI
- 5.86
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Conference on Empirical Methods in Natural Language Processing: System Demonstrations (EMNLP) (publishedVersion, cc-by)
- Funders
- University of Pennsylvania
- Templeton Religion Trust (TRT0048)
- Stony Brook University
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
- Social Sciences › Psychology › Social Psychology › Mental Health via Writing
- Social Sciences › General Social Sciences › Computational and Text Analysis Methods
- Keywords
- language change, language variation, corpus comparison
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.