Personality in 100,000 Words: A large-scale analysis of personality and word use among bloggers
Open accessAbstract
Previous studies have found systematic associations between personality and individual differences in word use. Such studies have typically focused on broad associations between major personality domains and aggregate word categories, potentially masking more specific associations. Here I report the results of a large-scale analysis of personality and word use in a large sample of blogs (N=694). The size of the dataset enabled pervasive correlations with personality to be identified for a broad range of lexical variables, including both aggregate word categories and individual English words. The results replicated category-level findings from previous offline studies, identified numerous novel associations at both a categorical and single-word level, and underscored the value of complementary approaches to the study of personality and word use.
AI snapshot
Written from the paper’s full text.
TL;DR
This study analyzed personality and word use in 694 blogs, finding pervasive associations between Big Five traits/facets and both LIWC categories and individual words. It replicated prior offline findings while showing that broad category-level analyses can mask or contradict narrower facet- and word-level associations.
Key findings
- Of 330 Big Five–LIWC category correlations, 145 (43.9%) were significant at p < .05 and 49 (14.8%) at p < .001; the study replicated 15 of 30 correlations from Pennebaker and King (1999) and 15 of 24 from Hirsh and Peterson (2009).
- Facet-level analyses found 28.8% of 1,980 facet–LIWC correlations significant at p < .05 and 152 (7.7%) at p < .001, with substantial heterogeneity: Extraversion and Openness showed 42 and 56 heterogeneous categories, respectively.
- Openness had far more word-level correlates than other traits: it correlated significantly (p < .001) with 393 words, whereas Neuroticism, Extraversion, and Conscientiousness each correlated with fewer than 30 words.
- Word-level analyses revealed opposite-direction associations within categories, e.g., Agreeableness correlated positively with affection words like “loves,” “love,” and “hug” (all ρ ≥ .2, p < .001) but negatively with “porn,” “gay,” and “fuck” (all ρ < −.21, p < .001).
Methods
- Naturalistic sample of 694 blogs (524 female; mean age = 36.2 years, range 18–78, SD = 11.7), recruited via Google Blog Search and email; blogs averaged 115,423 words and spanned a mean of 23.9 months.
- Personality was measured with the 50-item IPIP NEO-FFI for Big Five traits (N = 576) and the 300-item IPIP NEO-PI-R for 30 facets (N = 431); language was analyzed with LIWC 2001 across 66 categories and with normalized counts of the 5,608 most frequent words.
- Analyses used Spearman rank correlations; word-level analyses included only blogs with ≥50,000 words (N = 406), used p < .001 thresholding, and applied split-half reliability and False Discovery Rate checks.
Limitations
- The paper states likely selection bias: only a small proportion of bloggers publicly display email addresses and only a fraction agreed to participate, potentially restricting personality variance and ruling out direct comparison with the general population.
- The paper states that many correlations were modest (largest LIWC–Big Five correlation = .23; mean absolute significant correlation = .14) and that all language variables were simple word counts, ignoring context, irony, images, and higher-order semantics.
- Evident from the text: the sample was three-quarters female, included only Google Blogger blogs, relied on self-report personality, and was correlational, so causal and generalizability claims are constrained.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
0 of 45 cited sources checked · 0 supported · 0 flagged
- Findingown data
Artistic Interests and Emotionality failed to show the robust positive associations with Articles and Prepositions demonstrated by the other facets and total Openness scores.
“Conversely, Artistic Interests and Emotionality failed to show the robust positive associations with Articles and Prepositions demonstrated by the other facets and total Openness scores.”
Quote in the paperSubstantial claim- Rests on an assumption: The blog content analyzed was authored by the participant blogger themselves.
- Findingown data
Cooperation correlated with 'unusual' (ρ = .3).
“Unanticipated associations included correlations between Self-Consciousness and ‘sizes’ (ρ = .27), Intellect and ‘against’ (ρ = .37), Trust and ‘summer’ (ρ = .31), and Cooperation and ‘unusual’ (ρ = .3), to name a few (all of these examples survived even an extremely conservative Bonferroni correction for 5,000 comparison—i.e., p < .00001).”
Quote in the paperNot a substantial claim - Findingown data
The analysis revealed significant heterogeneity for 44% of trait/category combinations.
“The analysis revealed significant heterogeneity for a large proportion of trait/category combinations (44%)5.”
Quote in the paperNot a substantial claim - Findingown data
Agreeableness showed a small but statistically significant positive correlation with use of Sexual words (ρ = .08, p < .05).
“For example, Agreeableness showed a small but statistically significant positive correlation with use of Sexual words (ρ = .08, p < .05), and Extraversion, a trait often associated with increased incentive facilitation and agentic behavior (Depue & Collins, 1999), correlated negatively with several categories reflecting goal orientation and work-related achievement (Occupation, Job/work, and”
Quote in the paperNot a substantial claim- Rests on an assumption: The blog content analyzed was authored by the participant blogger themselves.
- Findingown data
Self-Consciousness correlated with 'sizes' (ρ = .27).
“Unanticipated associations included correlations between Self-Consciousness and ‘sizes’ (ρ = .27), Intellect and ‘against’ (ρ = .37), Trust and ‘summer’ (ρ = .31), and Cooperation and ‘unusual’ (ρ = .3), to name a few (all of these examples survived even an extremely conservative Bonferroni correction for 5,000 comparison—i.e., p < .00001).”
Quote in the paperNot a substantial claim
- Findingown data
Neuroticism correlated positively with usage of several different negative emotion word categories, including Anxiety/Fear, Sadness, Anger, and total Negative Emotions.
“Consistent with previous studies of personality and affective reactivity (Costa & McCrae, 1980; Larsen & Ketelaar, 1991), Neuroticism correlated positively with usage of several different negative emotion word categories, including Anxiety/Fear, Sadness, Anger, and total Negative Emotions (Table 1; Figure S1).”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Costa & McCrae, 1980 source
Not checked in the free run.
- cites Larsen & Ketelaar, 1991 source
Not checked in the free run.
- Rests on an assumption: The blog content analyzed was authored by the participant blogger themselves.
- Findingown data
The word 'sizes' was most commonly used in the context of clothing sizes.
“inspection of the local context of “sizes” revealed that the word was most commonly used in the context of clothing sizes (e.g., “a few sizes too big”, “bras of all sizes”, “dropping dress sizes”, etc.)”
Quote in the paperNot a substantial claim - Findingown data
Extraversion correlated negatively with several categories reflecting goal orientation and work-related achievement (Occupation, Job/work, and Achievement; ρ's < -.08, p's < .05).
“For example, Agreeableness showed a small but statistically significant positive correlation with use of Sexual words (ρ = .08, p < .05), and Extraversion, a trait often associated with increased incentive facilitation and agentic behavior (Depue & Collins, 1999), correlated negatively with several categories reflecting goal orientation and work-related achievement (Occupation, Job/work, and”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Depue & Collins, 1999 source
Not checked in the free run.
- Rests on an assumption: The blog content analyzed was authored by the participant blogger themselves.
- Findingown data
Most Extraversion facets correlated positively with use of categories related to positive emotions and social processes.
“Not surprisingly, many of the facet-level results reaffirmed the domain-level results; for example, most Neuroticism facets correlated positively with negative emotion word use (Table 3, Figure S1); most Extraversion facets correlated positively with use of categories related to positive emotions and social processes (Table 3, Figure S2); and nearly all Agreeableness facets correlated negatively”
Quote in the paperNot a substantial claim- Rests on an assumption: The blog content analyzed was authored by the participant blogger themselves.
- Findingown data
Intellect correlated with 'against' (ρ = .37).
“Unanticipated associations included correlations between Self-Consciousness and ‘sizes’ (ρ = .27), Intellect and ‘against’ (ρ = .37), Trust and ‘summer’ (ρ = .31), and Cooperation and ‘unusual’ (ρ = .3), to name a few (all of these examples survived even an extremely conservative Bonferroni correction for 5,000 comparison—i.e., p < .00001).”
Quote in the paperNot a substantial claim - Findingown data
Agreeableness was positively correlated with categories indicating social communality and positive emotion (e.g., 1st Person Plural References, Family, Friends, and Positive Emotions).
“Agreeableness, a trait characterized by an affiliative social orientation and tendency to avoid conflict with others (Graziano & Eisenberg, 1997; Graziano, Jensen-Campbell, & Hair, 1996), was positively correlated with categories indicating social communality and positive emotion (e.g., 1st Person Plural References, Family, Friends, and Positive Emotions), and negatively correlated with the use of”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Graziano & Eisenberg, 1997
Not checked in the free run.
- cites Graziano, Jensen-Campbell, & Hair, 1996
Not checked in the free run.
- Rests on an assumption: The blog content analyzed was authored by the participant blogger themselves.
- Findingown data
Extraversion correlated positively with words reflecting social settings or experiences (e.g., 'bar', 'restaurant', 'drinking', 'dancing', 'crowd', and 'sang'; all ρ's >= .19, p's < .001).
“Extraversion correlated positively with words reflecting social settings or experiences (e.g., ‘bar’, ‘restaurant’, ‘drinking’, ‘dancing’, ‘crowd’, and ‘sang’; all ρ's >= .19, p's < .001)”
Quote in the paperSubstantial claim - Findingown data
Agreeableness was negatively correlated with the use of Negative Emotion words (particularly Anger words) and Swear words.
“Agreeableness, a trait characterized by an affiliative social orientation and tendency to avoid conflict with others (Graziano & Eisenberg, 1997; Graziano, Jensen-Campbell, & Hair, 1996), was positively correlated with categories indicating social communality and positive emotion (e.g., 1st Person Plural References, Family, Friends, and Positive Emotions), and negatively correlated with the use of”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Graziano & Eisenberg, 1997
Not checked in the free run.
- cites Graziano, Jensen-Campbell, & Hair, 1996
Not checked in the free run.
- Rests on an assumption: The blog content analyzed was authored by the participant blogger themselves.
- Findingown data
The Artistic Interests and Emotionality facets showed LIWC correlations that were almost diametrically opposite to those displayed by the other four facets (Imagination, Adventurousness, Intellect, and Liberalism).
“Most notably, the Artistic Interests and Emotionality facets showed LIWC correlations that were almost diametrically opposite to those displayed by the other four facets (Imagination, Adventurousness, Intellect, and Liberalism; Figure S3).”
Quote in the paperSubstantial claim- Rests on an assumption: The blog content analyzed was authored by the participant blogger themselves.
- Findingcitation
Extraversion was associated with increased use of categories related to positive emotions and interpersonal interaction, including Positive Emotions, Social Processes, Friends, Sexuality, and 2nd Person References.
“Conversely, Extraversion was associated with increased use of categories related to positive emotions and interpersonal interaction (Lucas & Diener, 2001; Pavot, Diener, & Fujita, 1990), including Positive Emotions, Social Processes, Friends, Sexuality, and 2nd Person References (Table 1; Figure S2).”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Lucas & Diener, 2001
Not checked in the free run.
- cites Pavot, Diener, & Fujita, 1990
Not checked in the free run.
- Rests on an assumption: The blog content analyzed was authored by the participant blogger themselves.
- Findingown data
Heterogeneity in facet-level correlations with the LIWC categories was even more striking for Openness.
“Heterogeneity in facet-level correlations with the LIWC categories was even more striking for Openness.”
Quote in the paperSubstantial claim- Rests on an assumption: The blog content analyzed was authored by the participant blogger themselves.
- Findingown data
Category-based analyses focusing on the 30 lower-order facets of the Big Five identified a large number of associations.
“Category-based analyses focusing on the 30 lower-order facets of the Big Five identified a large number of associations.”
Quote in the paperNot a substantial claim- Rests on an assumption: The blog content analyzed was authored by the participant blogger themselves.
- Findingown data
In most cases, the FDR criterion was close to the nominal p < .05 rate, suggesting that there was minimal inflation of Type I error.
“In most cases, the FDR criterion was close to the nominal p < .05 rate, suggesting that there was minimal inflation of Type I error.”
Quote in the paperNot a substantial claim - Findingown data
Openness showed strong positive correlations with words associated with intellectual or cultural experience (e.g., 'poet', 'culture', 'narrative', 'art', 'universe', and 'literature'; all ρ's >= .27, p's < .001).
“Openness showed strong positive correlations with words associated with intellectual or cultural experience (e.g., ‘poet’, ‘culture’, ‘narrative’, ‘art’, ‘universe’, and ‘literature’; all ρ's >= .27, p's < .001).”
Quote in the paperNot a substantial claim - Findingown data
Extraversion facets displayed at least three distinct patterns of correlation with the LIWC categories.
“Extraversion facets displayed at least three distinct patterns of correlation with the LIWC categories (Figure S2).”
Quote in the paperSubstantial claim- Rests on an assumption: The blog content analyzed was authored by the participant blogger themselves.
- Findingown data
Considerable facet-level heterogeneity was identified; for each of the Big Five traits, a formal test identified at least 6 LIWC categories that showed statistically significant facet-level heterogeneity (p < .05).
“Importantly, however, considerable facet-level heterogeneity was also identified. For each of the Big Five traits, a formal test of heterogeneity of correlated correlation coefficients (Meng Rosenthal, & Rubin, 1992) identified at least 6 LIWC categories that showed statistically significant facet-level heterogeneity (p < .05).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Meng Rosenthal, & Rubin, 1992
Not checked in the free run.
- Rests on an assumption: The blog content analyzed was authored by the participant blogger themselves.
- Findingown data
Most cases of statistically significant heterogeneity consisted of heterogeneity in the magnitude of correlation coefficients rather than their sign.
“inspection revealed that most cases of statistically significant heterogeneity consisted of heterogeneity in the magnitude of correlation coefficients rather than their sign (i.e., coefficients were large for some words and close to zero for others).”
Quote in the paperSubstantial claim - Findingown data
Nearly all Agreeableness facets correlated negatively with the use of Anger and Swearing words.
“Not surprisingly, many of the facet-level results reaffirmed the domain-level results; for example, most Neuroticism facets correlated positively with negative emotion word use (Table 3, Figure S1); most Extraversion facets correlated positively with use of categories related to positive emotions and social processes (Table 3, Figure S2); and nearly all Agreeableness facets correlated negatively”
Quote in the paperNot a substantial claim- Rests on an assumption: The blog content analyzed was authored by the participant blogger themselves.
- Findingown data
Most Neuroticism facets correlated positively with negative emotion word use.
“Not surprisingly, many of the facet-level results reaffirmed the domain-level results; for example, most Neuroticism facets correlated positively with negative emotion word use (Table 3, Figure S1); most Extraversion facets correlated positively with use of categories related to positive emotions and social processes (Table 3, Figure S2); and nearly all Agreeableness facets correlated negatively”
Quote in the paperNot a substantial claim- Rests on an assumption: The blog content analyzed was authored by the participant blogger themselves.
- Findingown data
Category-based analyses revealed robust correlations between the Big Five traits and the frequency with which bloggers used different word categories.
“Category-based analyses similar to those used in previous studies (Fast & Funder, 2008; Hirsh & Peterson, 2009; Pennebaker & King, 1999) revealed robust correlations between the Big Five traits and the frequency with which bloggers used different word categories.”
Quote in the paperSubstantial claim0 of 3 sources checked- cites Fast & Funder, 2008
Not checked in the free run.
- cites Hirsh & Peterson, 2009
Not checked in the free run.
- cites Pennebaker & King, 1999
Not checked in the free run.
- Rests on an assumption: The blog content analyzed was authored by the participant blogger themselves.
- Findingown data
Trust correlated with 'summer' (ρ = .31).
“Unanticipated associations included correlations between Self-Consciousness and ‘sizes’ (ρ = .27), Intellect and ‘against’ (ρ = .37), Trust and ‘summer’ (ρ = .31), and Cooperation and ‘unusual’ (ρ = .3), to name a few (all of these examples survived even an extremely conservative Bonferroni correction for 5,000 comparison—i.e., p < .00001).”
Quote in the paperNot a substantial claim - Findingown data
Neuroticism correlated positively with negative emotion words (e.g., 'awful', 'lazy', 'depressing', 'terrible', and 'stressful'; all ρ's >= .19, p's < .001).
“For example, Neuroticism correlated positively with negative emotion words (e.g., ‘awful’, ‘lazy’, ‘depressing’, ‘terrible’, and ‘stressful’; all ρ's >= .19, p's < .001)”
Quote in the paperSubstantial claim - Findingown data
Extraversion and Openness showed a markedly greater degree of facet-level heterogeneity (42 and 56 heterogeneous categories, respectively).
“Extraversion and Openness showed a markedly greater degree of facet-level heterogeneity (42 and 56 heterogeneous categories, respectively).”
Quote in the paperNot a substantial claim- Rests on an assumption: The blog content analyzed was authored by the participant blogger themselves.
- Findingown data
Excitement-Seeking correlated positively with a number of sports-related words within the School category ('football', 'team', 'basketball', 'dating', and 'coach'; ρ's = .13 - .27, p < .05).
“However, Excitement-Seeking correlated positively with a number of sports-related words within the School category (‘football’, ‘team’, ‘basketball’, ‘dating’, and ‘coach’; ρ's = .13 - .27, p < .05), and negatively with a number of words related to academic pursuits (‘books’, ‘book’, and ‘desk’; ρ's = -.13 to -.27, p < .05).”
Quote in the paperSubstantial claim - Findingown data
The single largest correlation between any LIWC category and Big Five trait was .23.
“Indeed, the single largest correlation between any LIWC category and Big Five trait was .23 (Figure S4)—a magnitude close to the mean statistically significant effect size found in some previous studies (Fast & Funder, 2008; Hirsh & Peterson, 2009; Mehl et al., 2006).”
Quote in the paperSubstantial claim - Findingown data
At the category level, there was no relation between Excitement-Seeking and the School category (ρ = .02, ns).
“At the category level, there was no relation between the two variables (ρ = .02, ns).”
Quote in the paperSubstantial claim - Findingown data
The present study identified multiple personality correlates for virtually all LIWC categories.
“In contrast, the present study identified multiple personality correlates for virtually all LIWC categories, suggesting that personality plays a relatively pervasive role in shaping the language people use, and that diffuse associations with both function and content words can be reliably identified given a sufficiently large dataset.”
Quote in the paperSubstantial claim - Findingown data
Intellect correlated negatively with the Space category (ρ = -.11, p < .05).
“Second, Intellect (a facet of Openness reflecting interest and engagement with intellectual ideas) correlated negatively with the Space category (ρ = -.11, p < .05), despite the fact that the top 10 correlations with individual words within that category were all positive (ρ's = .18 - .33, p's < .01).”
Quote in the paperNot a substantial claim - Findingown data
Openness showed considerably stronger associations with both category-level and word-level language use than the other traits.
“Most notably, Openness showed considerably stronger associations with both category-level and word-level language use than the other traits6.”
Quote in the paperSubstantial claim - Findingown data
Correlations with personality were identified not only for relatively broad word categories, but also for individual words.
“Third, correlations with personality were identified not only for relatively broad word categories, but also for individual words.”
Quote in the paperSubstantial claim - Findingown data
Intellect was negatively correlated with a number of words that denoted more concrete spatial terms ('up', 'out', 'top', 'bottom', and 'down'; ρ's = -.14 to -.16, p's < .05).
“In contrast, Intellect was negatively correlated with a number of words that denoted more concrete spatial terms (‘up’, ‘out’, ‘top’, ‘bottom’, and ‘down’; ρ's = -.14 to -.16, p's < .05).”
Quote in the paperSubstantial claim - Findingown data
Openness correlated robustly with the mean string length of all words used (ρ = .26, p < .001).
“A post-hoc analysis confirmed this supposition, as Openness correlated robustly with the mean string length of all words used (ρ = .26, p < .001).”
Quote in the paperSubstantial claim - Findingown data
Excitement-Seeking correlated negatively with a number of words related to academic pursuits within the School category ('books', 'book', and 'desk'; ρ's = -.13 to -.27, p < .05).
“However, Excitement-Seeking correlated positively with a number of sports-related words within the School category (‘football’, ‘team’, ‘basketball’, ‘dating’, and ‘coach’; ρ's = .13 - .27, p < .05), and negatively with a number of words related to academic pursuits (‘books’, ‘book’, and ‘desk’; ρ's = -.13 to -.27, p < .05).”
Quote in the paperSubstantial claim - Findingown data
The top 10 correlations with individual words within the Space category were all positive (ρ's = .18 - .33, p's < .01).
“Second, Intellect (a facet of Openness reflecting interest and engagement with intellectual ideas) correlated negatively with the Space category (ρ = -.11, p < .05), despite the fact that the top 10 correlations with individual words within that category were all positive (ρ's = .18 - .33, p's < .01).”
Quote in the paperSubstantial claim - Premisereasoning
Category-based approaches are limited in their capacity to discover novel and unexpected relations between personality and word use, because the categories used to predict personality are typically developed rationally and are thus constrained by prior theory and researchers' intuitions.
“Moreover, category-based approaches are necessarily limited in their capacity to discover novel and unexpected relations between personality and word use, because the categories used to predict personality are typically developed rationally and are thus constrained by prior theory and researchers' intuitions.”
Quote in the paperSubstantial claim - Premisereasoning
Category-based approaches necessarily sacrifice specificity, because statistically reliable correlations between personality traits and individual words may be washed out when those words are averaged or summed together with many other words.
“Although the categorical approach has taught us a great deal about the relation between personality and language, it necessarily sacrifices specificity, because statistically reliable correlations between personality traits and individual words may be “washed out” when those words are averaged or summed together with many other words.”
Quote in the paperSubstantial claim - Interpretationreasoning
Such selection effects should generally deflate rather than spuriously inflate the correlations reported here, because their primary effect would be to restrict the range of distribution of some personality traits, artificially limiting the amount of personality variance available to correlate with other variables.
“However, such selection effects should generally deflate rather than spuriously inflate the correlations reported here, because their primary effect would be to restrict the range of distribution of some personality traits, artificially limiting the amount of personality variance available to correlate with other variables.”
Quote in the paperNot a substantial claim - Study design and conductreasoning
The blog data provided a naturalistic window into the influence of personality on language use that could not be influenced by demand characteristics.
“Because bloggers were free to write about any topic of their choosing and were (at the time of writing) unaware that their writing would be analyzed in relation to personality, the data provided an naturalistic window into the influence of personality on language use that could not be influenced by demand characteristics.”
Quote in the paperSubstantial claim- Rests on an assumption: Bloggers were unaware that their writing would be analyzed in relation to personality at the time of writing.
- Premisecitation
Previous studies have found systematic associations between personality and individual differences in word use.
“Previous studies have found systematic associations between personality and individual differences in word use.”
- Also stated in: § Abstract · plain
“Recent studies have identified systematic associations between personality and language use in a variety of different contexts, including directed writing assignments (Hirsh & Peterson, 2009; Pennebaker & King, 1999), structured interviews (Fast & Funder, 2008) and naturalistic recordings of day-to-day speech (Mehl, Gosling, & Pennebaker, 2006).”
Quote in the paperSubstantial claim0 of 3 sources checked- cites Hirsh & Peterson, 2009
Not checked in the free run.
- cites Pennebaker & King, 1999
Not checked in the free run.
- cites Fast & Funder, 2008
Not checked in the free run.
- Also stated in: § Abstract · plain
- Premisecitation
Most previous studies have focused on writing samples collected under laboratory settings or other relatively constrained contexts.
“First, most studies have focused on writing samples collected under laboratory settings or other relatively constrained contexts.”
Quote in the paperSubstantial claim0 of 3 sources checked- cites Fast & Funder, 2008
Not checked in the free run.
- cites Hirsh & Peterson, 2009
Not checked in the free run.
- cites Pennebaker & King, 1999
Not checked in the free run.
- Interpretationreasoning
The present dataset was uniquely positioned to support large-scale analyses of highly specific associations between personality and word use.
“Thus, the present dataset was uniquely positioned to support large-scale analyses of highly specific associations between personality and word use.”
Quote in the paperSubstantial claim - Interpretationown data
The facet-level analyses confirmed that the domain-level Big Five analyses reported in the previous section masked considerable and potentially important heterogeneity at the level of narrower traits.
“Thus, the facet-level analyses confirmed that the domain-level Big Five analyses reported in the previous section masked considerable and potentially important heterogeneity at the level of narrower traits.”
Quote in the paperSubstantial claim- Rests on an assumption: The blog content analyzed was authored by the participant blogger themselves.
- Interpretationreasoning
Such a pattern could potentially result solely from differences in the reliabilities of individual words, and therefore provided only weak evidence for true heterogeneity.
“Such a pattern could potentially result solely from differences in the reliabilities of individual words (cf. Figure 1), and therefore provided only weak evidence for true heterogeneity.”
Quote in the paperSubstantial claim - Study design and conductreasoning
Selection bias likely influenced the results to some extent.
“First, it is likely that selection bias influenced the results to some extent, since only a small proportion of bloggers publicly display their email addresses, and of those who do only a fraction agreed to participate when contacted via email.”
Quote in the paperNot a substantial claim - Interpretationown data
The present study replicated and extended previous associations between personality and language use in a uniquely large sample of blog-derived writing samples.
“In conclusion, the present study replicated and extended previous associations between personality and language use in a uniquely large sample of blog-derived writing samples.”
Quote in the paperSubstantial claim - Interpretationreasoning
Failing to account for heterogeneity within the School category could have led to the erroneous conclusion that Excitement-Seeking was entirely unrelated to word use reflecting scholastic pursuits.
“Thus, failing to account for heterogeneity within the School category could have led to the erroneous conclusion that Excitement-Seeking was entirely unrelated to word use reflecting scholastic pursuits.”
Quote in the paperSubstantial claim - Interpretationown data
The present study replicated many previous findings in a large and heterogeneous sample of blogs.
“The present study replicated many of these findings in a large and heterogeneous sample of blogs, suggesting that personality exerts similar influences on offline and online forms of self-expression.”
Quote in the paperSubstantial claim - Interpretationreasoning
The modest effect sizes found in the present study and other large-sample studies are likely to be more representative of the true population effects.
“Thus, far from flagging a problem with the present methodology, the modest effect sizes found in the present study and other large-sample studies (Pennebaker & King 1999) are likely to be more representative of the true population effects.”
Quote in the paperSubstantial claim - Premisecitation
Human observers can rely on a much broader array of contextual and semantic cues when inferring other people's personalities from their writing and/or websites.
“By contrast, human observers can rely on a much broader array of contextual and semantic cues when inferring other people's personalities from their writing and/or websites (e.g., Back et al., 2010; Marcus, Machilek, & Schutz, 2006; Vazire & Gosling 2004).”
Quote in the paperSubstantial claim0 of 3 sources checked- cites Back et al., 2010 source
Not checked in the free run.
- cites Marcus, Machilek, & Schutz, 2006
Not checked in the free run.
- cites Vazire & Gosling 2004
Not checked in the free run.
- Interpretationown data
Diffuse associations with both function and content words can be reliably identified given a sufficiently large dataset.
“In contrast, the present study identified multiple personality correlates for virtually all LIWC categories, suggesting that personality plays a relatively pervasive role in shaping the language people use, and that diffuse associations with both function and content words can be reliably identified given a sufficiently large dataset.”
Quote in the paperSubstantial claim - Premisecitation
Effect sizes for statistically significant effects typically vary inversely with sample size, because when power is relatively low, one must capitalize on chance in order to obtain statistically significant results.
“It is important to remember, however, that effect sizes for statistically significant effects typically vary inversely with sample size, because when power is relatively low, one must capitalize on chance in order to obtain statistically significant results (Ioannidis, 2008; Yarkoni, 2009).”
Quote in the paperSubstantial claim0 of 2 sources checked - Interpretationown data
Because affection-related words had much higher usage rates than sexual behavior/swearwords, the overall category-level scores for Sexual word use were dominated by words related to affection rather than sex.
“however, because the affection-related had much higher usage rates than the latter ones, the overall category-level scores for Sexual word use were dominated by words related to affection rather than sex.”
Quote in the paperSubstantial claim - Interpretationown data
Neuroticism may be associated primarily with adjectival words used to describe events in a negative way (e.g., 'awful', 'depressing', 'terrible', and 'stressful') rather than nouns connoting actual negative events.
“For example, rather than simply demonstrating that Neurotic individuals use more negative emotion words, the present findings suggest that Neuroticism may be associated primarily with adjectival words used to describe events in a negative way (e.g., ‘awful’, ‘depressing’, ‘terrible’, and ‘stressful’) rather than nouns connoting actual negative events.”
Quote in the paperSubstantial claim - Interpretationreasoning
Because the concrete spatial words were much more common, they dominated overall scores for the Space category.
“Again, because the latter words were much more common, they dominated overall scores for the Space category.”
Quote in the paperSubstantial claim - Interpretationown data
The Sexual words category contained heterogeneous word subsets that referred both to love and affection as well as sexual behavior and swearwords.
“The Sexual words category contained heterogeneous word subsets that referred both to love and affection as well as sexual behavior and swearwords”
Quote in the paperSubstantial claim - Study design and conductreasoning
The present study had sufficient power to detect relatively modest effects for many individual English words even when modeling subject as a random variable.
“In contrast, the present study had sufficient power to detect relatively modest effects for many individual English words even when modeling subject as a random variable.”
Quote in the paperSubstantial claim - Interpretationown data
Personality plays a relatively pervasive role in shaping the language people use.
“In contrast, the present study identified multiple personality correlates for virtually all LIWC categories, suggesting that personality plays a relatively pervasive role in shaping the language people use, and that diffuse associations with both function and content words can be reliably identified given a sufficiently large dataset.”
Quote in the paperSubstantial claim - Interpretationown data
Personality exerts similar influences on offline and online forms of self-expression.
“The present study replicated many of these findings in a large and heterogeneous sample of blogs, suggesting that personality exerts similar influences on offline and online forms of self-expression.”
Quote in the paperSubstantial claim - Premisecitation
Openness is positively correlated with a broad range of cognitive abilities, including vocabulary.
“Moreover, because Openness is positively correlated with a broad range of cognitive abilities, including vocabulary (Ackerman & Heggestad, 1997; Gignac, Stough, & Loukomitis, 2004), it is reasonable to suppose that highly Open individuals use “big words” more often, effectively resulting in strong positive correlations for many individual words (but conversely, producing negative correlations for”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Ackerman & Heggestad, 1997 source
Not checked in the free run.
- cites Gignac, Stough, & Loukomitis, 2004
Not checked in the free run.
- Classified as probably not a substantial claim. 9
- May combine two claims. 35
- The quote only partly states this claim. 1
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataThe full sample contained 694 blogs (524 female; mean age = 36.2 years, range = 18-78, sd = 11.7).
“In total, the full sample contained 694 blogs (524 female; mean age = 36.2 years, range = 18 -78, sd = 11.7), though the actual sample size was smaller for some analyses because not all participants provided personality data (see below).”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataOf the 330 different correlation coefficients between the Big Five traits and the 66 LIWC categories, 145 (43.9%) were statistically significant at p < .05, and 49 (14.8%) were statistically significant at p < .001.
“Of the 330 different correlation coefficients between the Big Five traits and the 66 LIWC categories, 145 (43.9%) were statistically significant at p < .05, and 49 (14.8%) were statistically significant at p < .001.”
Quote in the paperSubstantial claim- Rests on an assumption: The blog content analyzed was authored by the participant blogger themselves.
May combine two claims.
Findingown dataThe results directly replicated previous findings at a rate substantially greater than chance; specifically, the present study successfully replicated 15 of 30 correlations between Big Five dimensions and LIWC categories reported by Pennebaker & King (1999), and 15 of 24 Big Five correlations reported by Hirsh & Peterson (2009).
“Moreover, the results directly replicated previous findings at a rate substantially greater than chance; specifically, the present study successfully replicated 15 of 30 correlations between Big Five dimensions and LIWC categories reported by Pennebaker & King (1999), and 15 of 24 Big Five correlations reported by Hirsh & Peterson (2009).”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Pennebaker & King (1999)
Not checked in the free run.
- cites Hirsh & Peterson (2009)
Not checked in the free run.
- Rests on an assumption: The blog content analyzed was authored by the participant blogger themselves.
May combine two claims.
Findingown dataOpenness correlated significantly with 393 individual words, whereas Neuroticism, Extraversion, and Conscientiousness each correlated with fewer than 30 words.
“In particular, Openness correlated significantly (p < .001) with 393 words, whereas Neuroticism, Extraversion and Conscientiousness all correlated with fewer than 30 words.”
Quote in the paperSubstantial claimMay combine two claims. The quote only partly states this claim.
Findingown dataOf the 1980 different correlation coefficients between the 30 facets and the 66 LIWC categories, (28.8%) were statistically significant at p < .05, and 152 (7.7%) were statistically significant at p < .001.
“Of the 1980 different correlation coefficients between the 30 facets and the 66 LIWC categories, (28.8%) were statistically significant at p < .05, and 152 (7.7%) were statistically significant at p < .0014.”
Quote in the paperNot a substantial claim- Rests on an assumption: The blog content analyzed was authored by the participant blogger themselves.
May combine two claims.
Findingown dataOpenness to Experience was negatively correlated with 37 of the 66 LIWC categories, and positively correlated with only 4 categories.
“Most notably, Openness to Experience, which one might have expected to correlate positively with categories associated with emotional, intellectual, or sensory experience, was negatively correlated with 37 of the 66 LIWC categories, and positively correlated with only 4 categories.”
Quote in the paperSubstantial claim- Rests on an assumption: The blog content analyzed was authored by the participant blogger themselves.
May combine two claims.
Findingown dataThese dissociations could not be explained by heterogeneity in the Openness facets themselves; intercorrelations between the six facets were all directionally positive, and were moderate or strong in most cases.
“Importantly, these dissociations could not be explained by heterogeneity in the Openness facets themselves. Intercorrelations between the six facets were all directionally positive, and were moderate or strong in most cases.”
Quote in the paperSubstantial claim- Rests on an assumption: The blog content analyzed was authored by the participant blogger themselves.
May combine two claims.
Findingown dataThe Assertiveness and Activity Level facets showed generally weaker relations with the LIWC categories than the other facets, with the notable exception that Activity Level was the only Extraversion facet to correlate positively with categories related to goal-directed and achievement-seeking behavior (School, Job/work, and Achievement).
“Third, the Assertiveness and Activity Level facets showed generally weaker relations with the LIWC categories than the other facets, with the notable exception that Activity Level was the only Extraversion facet to correlate positively with categories related to goal-directed and achievement-seeking behavior (School, Job/work, and Achievement).”
Quote in the paperSubstantial claim- Rests on an assumption: The blog content analyzed was authored by the participant blogger themselves.
May combine two claims.
FindingcitationPeople high on Openness tended to use more Articles (ρ = .2, p < .001) and Prepositions (ρ = .17, p < .001) than people low on Openness.
“This pattern appeared to reflect a fundamental difference in language style rather than content (Chung & Pennebaker 2007); people high on Openness tended to use more Articles (ρ = .2, p < .001) and Prepositions (ρ = .17, p < .001) than people low on Openness, suggesting a potential tendency to favor high-frequency function words at the expense of the lower frequency content words that made up most”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Chung & Pennebaker 2007
Not checked in the free run.
- Rests on an assumption: The blog content analyzed was authored by the participant blogger themselves.
May combine two claims.
Findingown dataExcitement-Seeking was the only Extraversion facet to correlate positively with the Negative Emotions, Anger, and Swearing categories or negatively with the Inclusive, Home, and Grooming categories.
“Second, Excitement-Seeking was the only Extraversion facet to correlate positively with the Negative Emotions, Anger, and Swearing categories or negatively with the Inclusive, Home, and Grooming categories.”
Quote in the paperSubstantial claim- Rests on an assumption: The blog content analyzed was authored by the participant blogger themselves.
May combine two claims.
Findingown dataFor Neuroticism, most of the heterogeneity appeared to stem primarily from a single facet: Self-Consciousness differed from the other facets in that it showed no positive correlation with negative affect categories, and conversely, was the only Neuroticism facet to correlate negatively with categories related to interpersonal interaction.
“For Neuroticism, most of the heterogeneity appeared to stem primarily from a single facet: Self-Consciousness differed from the other facets in that it showed no positive correlation with negative affect categories, and conversely, was the only Neuroticism facet to correlate negatively with categories related to interpersonal interaction (Table 3, Figure S1).”
Quote in the paperSubstantial claim- Rests on an assumption: The blog content analyzed was authored by the participant blogger themselves.
May combine two claims.
Findingown dataThe number of heterogeneous categories was relatively low for Conscientiousness (6 categories), Neuroticism (16), and Agreeableness (15).
“The number of heterogeneous categories was relatively low for Conscientiousness (6 categories), Neuroticism (16), and Agreeableness (15).”
Quote in the paperNot a substantial claim- Rests on an assumption: The blog content analyzed was authored by the participant blogger themselves.
May combine two claims.
Findingown dataThe facets of Friendliness, Gregariousness, and Cheerfulness all showed consistent positive correlations with most categories related to positive affect, communality, and interpersonal interaction (e.g., Positive Emotions, Social Processes, 1st Person Plural references, Friends, Family, and Sexual words), whereas the other facets did not.
“First, the facets of Friendliness, Gregariousness, and Cheerfulness all showed consistent positive correlations with most categories related to positive affect, communality, and interpersonal interaction (e.g., Positive Emotions, Social Processes, 1st Person Plural references, Friends, Family, and Sexual words), whereas the other facets did not.”
Quote in the paperSubstantial claim- Rests on an assumption: The blog content analyzed was authored by the participant blogger themselves.
May combine two claims.
Findingown dataAgreeableness correlated positively with some words in the Sexual words category (e.g., 'loves', 'love', and 'hug'; all ρ's >= .2, p's < .001) but negatively with others (e.g., 'porn', 'gay', and 'fuck'; all ρ's < -.21, p < .001).
“First, Agreeableness correlated positively with some words in the Sexual words category (e.g., ‘loves’, ‘love’, and ‘hug’; all ρ's >= .2, p's < .001) but negatively with others (e.g., ‘porn’, ‘gay’, and ‘fuck’; all ρ's < -.21, p < .001).”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataArtistic Interests and Emotionality correlated positively with use of the Position Emotion, Inclusive, and Physical States categories, whereas the other four facets generally showed negative correlations.
“Artistic Interests and Emotionality correlated positively with use of the Position Emotion, Inclusive, and Physical States categories, whereas the other four facets generally showed negative correlations.”
Quote in the paperSubstantial claim- Rests on an assumption: The blog content analyzed was authored by the participant blogger themselves.
May combine two claims.
Findingown dataArtistic Interests correlated .33 with Intellect, despite the fact that the two facets showed robust correlations in opposite directions with Positive Emotion word use (ρ's = .18 and -.24, respectively; p's < .0001).
“For example, Artistic Interests correlated .33 with Intellect, despite the fact that the two facets showed robust correlations in opposite directions with Positive Emotion word use (ρ's = .18 and -.24, respectively; p's < .0001).”
Quote in the paperSubstantial claim- Rests on an assumption: The blog content analyzed was authored by the participant blogger themselves.
May combine two claims.
Findingown dataIn the present study, 44% of all correlations between the Big Five traits and LIWC categories were statistically significant, yet the mean absolute correlation was only .14.
“In the present study, 44% of all correlations between the Big Five traits and LIWC categories were statistically significant, yet the mean absolute correlation was only .14.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataA post-hoc analysis showed Agreeableness correlated strongly in opposite directions with two four-word categories related to love and affection ('love', 'loves', 'loved', and 'loving'; ρ = .33) versus sexual behavior ('fuck', 'porn', 'gay', and 'rape'; ρ = -.4), and the two 4-word categories were themselves negatively correlated (ρ= -.15, p < .01).
“A post-hoc analysis supported this supposition, as Agreeableness correlated strongly in opposite directions with two four-word categories related to love and affection (‘love’, ‘loves’, ‘loved’, and ‘loving’; ρ = .33) versus sexual behavior (‘fuck’, ‘porn’, ‘gay’, and ‘rape’; ρ = -.4), and the two 4-word categories were themselves negatively correlated (ρ= -.15, p < .01).”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductown data83% of participants (N = 576) had scores for the Big Five factors, and 62% (N = 431) had additional facet-level scores.
“Thus, 83% of participants (N = 576) had scores for the Big Five factors of personality (Neuroticism, Extraversion, Openness, Agreeableness, and Conscientiousness), and 62% (N = 431) had additional facet-level scores2.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
PremisereasoningSuch writing samples limit the types of analyses researchers can conduct, as it is generally not possible to reliably estimate usage rates for individual words, but only for aggregate categories.
“As discussed below, such writing samples limit the types of analyses researchers can conduct, as it is generally not possible to reliably estimate usage rates for individual words, but only for aggregate categories.”
Quote in the paperSubstantial claimMay combine two claims.
Study design and conductreasoningBecause most participants were recruited via email, the resulting sample was not truly random: bias could arise either because some people were more likely to publish their email address on their blog, or because some people were more likely to respond to the invitation than others.
“Note that because most participants were recruited via email, the resulting sample was not truly random: bias could arise either because some people were more likely to publish their email address on their blog (a requisite for being contacted), or because some people were more likely to respond to the invitation than others.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisereasoningPrevious studies typically gather data on a small number of occasions, which cannot establish whether associations remain stable over months or years.
“Moreover, data are typically gathered from participants on a small number of occasions (often just one) spanning several hours or days; such datasets cannot be used to establish whether any identified associations between personality and language remain stable over much longer periods of time (i.e., months or years), or reflect transient influences (e.g., mood).”
Quote in the paperSubstantial claimMay combine two claims.
Study design and conductown dataControlling for gender and age had negligible effects on the results; for virtually all analyses, > 90% of statistically significant correlations continued to show a significant correlation in the same direction.
“The fact that females comprised three-quarters of the sample raised the possibility that results might be disproportionately driven by one gender; however, partial correlation analysis demonstrated that controlling for gender and age had negligible effects on the results. For virtually all analyses, > 90% of statistically significant correlations continued to show a significant correlation in the”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
PremisecitationIt remains unclear to what extent the results of constrained studies generalize to less constrained real-world situations.
“It remains unclear to what extent the results of such studies generalize to less constrained real-world situations where people's personalities can influence not only how they write or talk about specific topics, but also what topics they choose to write or talk about (cf. Pennebaker, Mehl, & Niederhoffer, 2003).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Pennebaker, Mehl, & Niederhoffer, 2003 source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationStudies have consistently identified theoretically predicted correlations between Extraversion and Neuroticism and usage of words related to positive and negative emotion categories.
“studies have consistently identified theoretically predicted correlations between the dimensions of Extraversion and Neuroticism and usage of words related to a variety of positive and negative emotion categories (Hirsh & Peterson, 2009; Lee, Kim, Seo, & Chung, 2007; Pennebaker & King 1999).”
Quote in the paperNot a substantial claim0 of 3 sources checked- cites Hirsh & Peterson, 2009
Not checked in the free run.
- cites Lee, Kim, Seo, & Chung, 2007
Not checked in the free run.
- cites Pennebaker & King 1999
Not checked in the free run.
May combine two claims.
Study design and conductown dataA split-half reliability analysis confirmed that the writing sample supported reliable estimation even of word categories with a relatively low base rate: the mean split-half correlation for the 66 categories was .81 (range = .43 - .94), and only 2 categories (Anxiety and Inhibition) had correlations lower than .6.
“A split-half reliability analysis (i.e., randomly dividing each participants posts into two halves, and then correlating each category's frequency across halves for all participants) confirmed this supposition: the mean split-half correlation for the 66 categories was .81 (range = .43 - .94), and only 2 categories (Anxiety and Inhibition) had correlations lower than .6.”
Quote in the paperSubstantial claimMay combine two claims.
Study design and conductreasoningTo minimize Type I error risk from multiple comparisons, interpretation was based primarily on aggregate patterns, and FDR correction (5%) was used.
“To minimize this risk, interpretation of statistically significant findings was based primarily on the aggregate pattern of results with multiple categories or traits rather than on individual correlation coefficients. Additionally, the presence or absence of statistical significance is reported in key tables using a complementary False Discovery Rate criterion (FDR), which adaptively controls the”
Quote in the paperSubstantial claim0 of 2 sources checkedClassified as probably not a substantial claim. May combine two claims.
Study design and conductreasoningOnly the 5,608 words that occurred most frequently across all blogs were analyzed; only blogs containing 50,000 or more words were included in the word-level analyses (N = 406).
“First, only the 5,608 words that occurred most frequently across all blogs were analyzed3; second, only blogs containing 50,000 or more words were included in the word-level analyses (N = 406).”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Study design and conductnone givenWord-level results were thresholded at p < .001 in order to minimize the incidence of false positives.
“Word-level results were thresholded at p < .001 in order to minimize the incidence of false positives.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningHighly self-conscious people may be more attuned and concerned with their physical appearance.
“suggesting that highly self-conscious people may be more attuned and concerned with their physical appearance”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationcitationThe pattern of Openness correlations reflects a fundamental difference in language style rather than content, with high Openness favoring high-frequency function words at the expense of lower frequency content words.
“This pattern appeared to reflect a fundamental difference in language style rather than content (Chung & Pennebaker 2007); people high on Openness tended to use more Articles (ρ = .2, p < .001) and Prepositions (ρ = .17, p < .001) than people low on Openness, suggesting a potential tendency to favor high-frequency function words at the expense of the lower frequency content words that made up most”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Chung & Pennebaker 2007
Not checked in the free run.
- Rests on an assumption: The blog content analyzed was authored by the participant blogger themselves.
May combine two claims.
Interpretationown dataCollectively, these findings are consistent with the notion that the affiliative and agentic aspects of Extraversion are relatively distinct and have only partially overlapping correlates.
“Collectively, these findings are consistent with the notion that the affiliative and agentic aspects of Extraversion are relatively distinct and have only partially overlapping correlates (Depue & Morrone-Strupinsky, 2005; Watson & Clark, 1997).”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Depue & Morrone-Strupinsky, 2005 source
Not checked in the free run.
- cites Watson & Clark, 1997
Not checked in the free run.
- Rests on an assumption: The blog content analyzed was authored by the participant blogger themselves.
May combine two claims.
Study design and conductown dataA split-half reliability analysis for words suggested that reliability was high to moderate (> .6) for the first 2,000 - 3,000 or so words, and somewhat lower thereafter; even for low-ranked words, split-half correlations generally remained above .4.
“The analysis suggested that reliability was high to moderate (> .6) for the first 2,000 – 3,000 or so words, and somewhat lower thereafter. However, even for low-ranked words, split-half correlations generally remained above .4, a level considered acceptable for present purposes given that word-level analyses focused primarily on the aggregate pattern of associations with personality rather than”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningThe positively correlated words in the Space category occurred relatively infrequently and predominantly expressed relational spatial concepts (e.g., 'among', 'between', 'further', and 'under').
“The explanation for this seemingly paradoxical finding was that the positively correlated words occurred relatively infrequently and predominantly expressed relational spatial concepts (e.g., ‘among’, ‘between’, ‘further’, and ‘under’).”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
PremisecitationIndividual differences in personality have previously been linked to differences in linguistic style in laboratory and experience-sampling settings.
“Individual differences in personality have previously been linked to differences in linguistic style in laboratory and experience-sampling settings (Fast & Funder, 2008; Hirsh & Peterson, 2009; Mehl et al., 2006; Pennebaker & King 1999).”
Quote in the paperSubstantial claim0 of 3 sources checked- cites Fast & Funder, 2008
Not checked in the free run.
- cites Hirsh & Peterson, 2009
Not checked in the free run.
- cites Mehl et al., 2006 source
Not checked in the free run.
May combine two claims.
Interpretationown dataHigh-level associations between broad traits and aggregate word categories can mask, and in some cases even contradict, robust but relatively narrow associations.
“The results demonstrate that high-level associations between broad traits and aggregate word categories can mask, and in some cases even contradict, robust but relatively narrow associations.”
Quote in the paperSubstantial claimMay combine two claims.
PremisecitationHirsh and Peterson (2009) found fewer than 15% of tested effects to be statistically significant, yet obtained a much larger mean statistically significant r of .23.
“In contrast, Hirsh and Peterson (2009) found fewer than 15% of tested effects to be statistically significant, yet obtained a much larger mean statistically significant r of .23.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Hirsh and Peterson (2009)
Not checked in the free run.
May combine two claims.
InterpretationreasoningHighly Open individuals use "big words" more often, effectively resulting in strong positive correlations for many individual words.
“it is reasonable to suppose that highly Open individuals use “big words” more often, effectively resulting in strong positive correlations for many individual words (but conversely, producing negative correlations for LIWC categories that tend to be made up of a relatively small number of high-frequency words).”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningThe primary consequence of selection bias would be a restricted distribution of personality scores among self-selected participants, which would generally tend to deflate effect sizes and statistical power, leading to results that actually underestimate the magnitude of true population effects.
“However, it is important to note that the primary consequence of selection bias would be a restricted distribution of personality scores among self-selected participants, which would generally tend to deflate effect sizes and statistical power, leading to results that actually underestimate the magnitude of true population effects.”
Quote in the paperNot a substantial claim- The authors state this as an assumption: Bloggers who participated had systematically different personalities from those who did not.
May combine two claims.
InterpretationcitationThe results converge with other recent findings suggesting that people do not present themselves in an idealized and overly positive way online, and maintain online identities that reflect the way they genuinely see themselves and are seen by others.
“The results converge with other recent findings suggesting that, contrary to popular wisdom, people do not present themselves in an idealized and overly positive way online (Turkle, 1997), and maintain online identities that reflect the way they genuinely see themselves and are seen by others (Back et al., 2010; Vazire & Gosling, 2004).”
Quote in the paperNot a substantial claim0 of 3 sources checked- cites Turkle, 1997
Not checked in the free run.
- cites Back et al., 2010 source
Not checked in the free run.
- cites Vazire & Gosling, 2004
Not checked in the free run.
May combine two claims.
Study design and conductnone givenAll language variables in the present study were ultimately derived from simple counts of word use, and no contextual factors or higher-order semantic variables were taken into consideration.
“Finally, although the present study explored language use at the level of both aggregate categories and individual words, all language variables were ultimately derived from simple counts of word use, and no contextual factors or higher-order semantic variables were taken into consideration.”
Quote in the paperSubstantial claim
The paper relies on this without support.
Bloggers were unaware that their writing would be analyzed in relation to personality at the time of writing.
“Because bloggers were free to write about any topic of their choosing and were (at the time of writing) unaware that their writing would be analyzed in relation to personality, the data provided an naturalistic window into the influence of personality on language use that could not be influenced by demand characteristics.”
The paper relies on this without support.
The blog content analyzed was authored by the participant blogger themselves.
“The contents of participants' blogs were subsequently downloaded and parsed using a set of custom scripts written in the Ruby programming language.”
The authors state this as an assumption.
Bloggers who participated had systematically different personalities from those who did not.
“It is reasonable to suppose that bloggers who participated had systematically different personalities from those who did not (e.g., they might be more Agreeable or Open).”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Yarkoni identified single word results which would not have been caught with LIWC, such as 'hug' correlating positively with agreeableness.
“He identified single word results which would not have been caught with LIWC, such as ‘hug’ correlating positively with agreeableness (there is no physical affection category inLIWC), but, considering the sparse nature of words, 406 blogs does not result in comprehensive view.”
From Personality, Gender, and Age in the Language of Social Media: The Open-Vocabulary Approach (2013) · cites this paper as [27]
To date, this represents the largest study, by an order of magnitude, of language and personality.
“To date, this represents the largest study, by an order of magnitude, of language and personality.”
From Personality, Gender, and Age in the Language of Social Media: The Open-Vocabulary Approach (2013) · cites this paper as [27]
Openness exhibits the most variation across conditions of other studies, and its component traits are most loosely related.
“openness exhibits the most variation across conditions of other studies (for examples, see [25], [27], [65]), and its component traits are most loosely related [85].”
From Personality, Gender, and Age in the Language of Social Media: The Open-Vocabulary Approach (2013) · cites this paper as [27]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Conflicting counts of words analyzed
MinorThe methods say 5,608 individual words were analyzed, but the results say the analysis used 5,068 words.
“First, only the 5,608 words that occurred most frequently across all blogs were analyzed3”
“I correlated bloggers' personality scores with a set of 5,068 individual words.”
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482 · see citing works
The control of the false discovery rate in multiple testing under dependency
Benjamini, Y., & Yekutieli, D. (2001) · The Annals of Statistics · doi:10.1214/aos/1013699998 · Cited by 10,490 · see citing works
Foundations of statistical natural language processing
Manning, C. D., & Schütze, H. (1999) · Cited by 9,816 · see citing works
Life on the Screen: Identity in the Age of the Internet
Turkle, S. (1997) · Cited by 6,340 · see citing works
The international personality item pool and the future of public-domain personality measures
Goldberg, L. R., Johnson, J. A., Eber, H. W., Hogan, R., Ashton, M. C., Cloninger, C. R., & Gough, H. G. (2006) · Journal of Research in Personality · doi:10.1016/j.jrp.2005.08.007 · Cited by 3,185 · see citing works
Influence of extraversion and neuroticism on subjective well-being: Happy and unhappy people
Costa, P. T., & McCrae, R. R. (1980) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.38.4.668 · Cited by 2,652 · cited 1× · see citing works
“Consistent with previous studies of personality and affective reactivity (Costa & McCrae, 1980; Larsen & Ketelaar, 1991), Neuroticism correlated positively with usage of several different negative emotion word categories, including Anxiety/Fear, Sadness, Anger, and total Negative Emotions (Table 1;…”
ResultInfluence of extraversion and neuroticism on subjective well-being: Happy and unhappy people.
Costa, P. T., & McCrae, R. R. (1980) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.38.4.668 · Cited by 2,648 · see citing works
Psychological Aspects of Natural Language Use: Our Words, Our Selves
Pennebaker, J. W., Mehl, M. R., & Niederhoffer, K. G. (2003) · Annual Review of Psychology · doi:10.1146/annurev.psych.54.101601.145041 · Cited by 2,624 · see citing works
Comparing correlated correlation coefficients
Meng, X.-L., Rosenthal, R., & Rubin, D. B. (1992) · Psychological Bulletin · doi:10.1037/0033-2909.111.1.172 · Cited by 2,472 · see citing works
Linguistic Inquiry and Word Count (LIWC)
Chung, C. K., & Pennebaker, J. W. (2012) · IGI Global eBooks · doi:10.4018/978-1-60960-741-8.ch012 · Cited by 2,152 · see citing works
Depue, R. A., & Collins, P. F. (1999) · Behavioral and Brain Sciences · doi:10.1017/s0140525x99002046 · Cited by 2,046 · see citing works
Linguistic styles: language use as an individual difference
Pennebaker, J. W., & King, L. A. (1999) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.77.6.1296 · Cited by 1,961 · see citing works
Intelligence, personality, and interests: Evidence for overlapping traits
Ackerman, P. L., & Heggestad, E. D. (1997) · Psychological Bulletin · doi:10.1037/0033-2909.121.2.219 · Cited by 1,719 · cited 1× · see citing works
“Moreover, because Openness is positively correlated with a broad range of cognitive abilities, including vocabulary (Ackerman & Heggestad, 1997;Gignac, Stough, & Loukomitis, 2004), it is reasonable to suppose that highly Open individuals use “big words” more often, effectively resulting in strong…”
BackgroundWhy Most Discovered True Associations Are Inflated
Ioannidis, J. P. A. (2008) · Epidemiology · doi:10.1097/ede.0b013e31818131e7 · Cited by 1,495 · see citing works
Personality and susceptibility to positive and negative emotional states.
Larsen, R. J., & Ketelaar, T. (1991) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.61.1.132 · Cited by 1,293 · see citing works
Facebook Profiles Reflect Actual Personality, Not Self-Idealization
Back, M. D., Stopfer, J. M., Vazire, S., Gaddis, S., Schmukle, S. C., Egloff, B., & Gosling, S. D. (2010) · Psychological Science · doi:10.1177/0956797609360756 · Cited by 1,169 · see citing works
Extraversion and Its Positive Emotional Core
Watson, D., & Clark, L. A. (1997) · Handbook of Personality Psychology · doi:10.1016/b978-012134645-4/50030-5 · Cited by 1,081 · see citing works
Personality and susceptibility to positive and negative emotional states.
Larsen, R. J., & Ketelaar, T. (1991) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.61.1.132 · Cited by 1,062 · cited 1× · see citing works
“Consistent with previous studies of personality and affective reactivity (Costa & McCrae, 1980; Larsen & Ketelaar, 1991), Neuroticism correlated positively with usage of several different negative emotion word categories, including Anxiety/Fear, Sadness, Anger, and total Negative Emotions (Table 1;…”
Resultdepue, R. A., & morrone-strupinsky, J. V. (2005) · Behavioral and Brain Sciences · doi:10.1017/s0140525x05000063 · Cited by 958 · see citing works
Graziano, W. G., & Eisenberg, N. (1997) · Elsevier eBooks · doi:10.1016/b978-012134645-4/50031-7 · Cited by 794 · see citing works
Mehl, M. R., Gosling, S. D., & Pennebaker, J. W. (2006) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.90.5.862 · Cited by 764 · see citing works
Perceiving interpersonal conflict and reacting to it: The case for agreeableness.
Graziano, W. G., Jensen‐Campbell, L. A., & Hair, E. C. (1996) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.70.4.820 · Cited by 642 · see citing works
Yarkoni, T. (2009) · Perspectives on Psychological Science · doi:10.1111/j.1745-6924.2009.01127.x · Cited by 549 · see citing works
Self-citationPerceiving interpersonal conflict and reacting to it: The case for agreeableness.
Graziano, W. G., Jensen‐Campbell, L. A., & Hair, E. C. (1996) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.70.4.820 · Cited by 536 · see citing works
(2007) · Cited by 521 · see citing works
Mehl, M. R., & Pennebaker, J. W. (2003) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.84.4.857 · Cited by 508 · cited 2× · see citing works
“The power of a more naturalistic approach is demonstrated by a series of recent studies by Mehl and colleagues, who have used the Electronically Activated Recorder (Mehl & Pennebaker, 2003) to Address correspondence to: Tal Yarkoni, Department of Psychology and Neuroscience, UCB 345, University of Colorado at Boulder,…”
MethodContextual Diversity, Not Word Frequency, Determines Word-Naming and Lexical Decision Times
Adelman, J. S., Brown, G. D. A., & Quesada, J. F. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01787.x · Cited by 505 · see citing works
Patterns of Natural Language Use: Disclosure, Personality, and Social Integration
Pennebaker, J. W., & Graybeal, A. (2001) · Current Directions in Psychological Science · doi:10.1111/1467-8721.00123 · Cited by 501 · see citing works
e-Perceptions: Personality Impressions Based on Personal Websites.
Vazire, S., & Gosling, S. D. (2004) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.87.1.123 · Cited by 460 · see citing works
Vazire, S., & Mehl, M. R. (2008) · Journal of Personality and Social Psychology · doi:10.1037/a0013314 · Cited by 458 · see citing works
Pavot, W., Diener, E., & Fujita, F. (1990) · Personality and Individual Differences · doi:10.1016/0191-8869(90)90157-m · Cited by 396 · see citing works
Personality in cyberspace: Personal web sites as media for personality expressions and impressions.
Marcus, B., Machilek, F., & Schütz, A. (2006) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.90.6.1014 · Cited by 302 · see citing works
Personality and language use in self-narratives
Hirsh, J. B., & Peterson, J. B. (2009) · Journal of Research in Personality · doi:10.1016/j.jrp.2009.01.006 · Cited by 297 · see citing works
Fast, L. A., & Funder, D. C. (2008) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.94.2.334 · Cited by 292 · see citing works
Understanding extraverts' enjoyment of social situations: The importance of pleasantness.
Lucas, R. E., & Diener, E. (2001) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.81.2.343 · Cited by 273 · see citing works
Oberlander, J., & Nowson, S. (2006) · International Conference on Computational Linguistics and Annual Meeting of the Association for Computational Linguistics (COLING/ACL) · doi:10.3115/1273073.1273154 · Cited by 211 · see citing works
Delucchi, K., & Bostrom, A. (2004) · American Journal of Psychiatry · doi:10.1176/appi.ajp.161.7.1159 · Cited by 165 · see citing works
What Are They Blogging About? Personality, Topic and Motivation in Blogs
Gill, A. J., Nowson, S., & Oberlander, J. (2009) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v3i1.13949 · Cited by 144 · see citing works
Oberlander, J., & Gill, A. J. (2006) · Discourse Processes · doi:10.1207/s15326950dp4203_1 · Cited by 133 · see citing works
The Relations Between Personality and Language Use
Lee, C. H., Kim, K., Seo, Y. S., & Chung, C. K. (2007) · The Journal of General Psychology · doi:10.3200/genp.134.4.405-414 · Cited by 105 · see citing works
The Language of Weblogs: A study of genre and individual differences
Nowson, S. (2006) · ERA · Cited by 76 · see citing works
Openness, intelligence, and self-report intelligence
Gignac, G. E. (2003) · Intelligence · doi:10.1016/j.intell.2003.10.005 · Cited by 71 · see citing works
Identifying more bloggers Towards large scale personality classification of personal weblogs
Nowson, S., & Oberlander, J. (2007) · Cited by 65 · see citing works
Telling losses: Personality correlates and functions of bereavement narratives
Baddeley, J. L., & Singer, J. A. (2008) · Journal of Research in Personality · doi:10.1016/j.jrp.2007.07.006 · Cited by 56 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Choosing Prediction Over Explanation in Psychology: Lessons From Machine Learning
Yarkoni, T., & Westfall, J. (2017) · Perspectives on Psychological Science · doi:10.1177/1745691617693393 · Cited by 1,930 · see citing works
Self-citationPersonality, Gender, and Age in the Language of Social Media: The Open-Vocabulary Approach
Schwartz, H. A., Eichstaedt, J. C., Kern, M. L., Dziurzynski, L., Ramones, S. M., Agrawal, M., Shah, A., Kosinski, M., Stillwell, D., Seligman, M. E. P., et al. (2013) · PLoS ONE · doi:10.1371/journal.pone.0073791 · Cited by 1,700 · see citing works
Psychological targeting as an effective approach to digital mass persuasion
Matz, S. C., Kosinski, M., Nave, G., & Stillwell, D. J. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1710966114 · Cited by 892 · see citing works
Automatic personality assessment through social media language.
Park, G., Schwartz, H. A., Eichstaedt, J. C., Kern, M. L., Kosinski, M., Stillwell, D. J., Ungar, L. H., & Seligman, M. E. P. (2015) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000020 · Cited by 802 · see citing works
Fairness in machine learning: A survey
Caton, S., & Haas, C. (2024) · ACM Computing Surveys · doi:10.1145/3616865 · Cited by 646 · see citing works
Hirsh, J. B., Kang, S. K., & Bodenhausen, G. V. (2012) · Psychological Science · doi:10.1177/0956797611436349 · Cited by 506 · see citing works
Internet Research in Psychology
Gosling, S. D., & Mason, W. (2015) · Annual Review of Psychology · doi:10.1146/annurev-psych-010814-015321 · Cited by 458 · see citing works
Using Hashtags to Capture Fine Emotion Categories from Tweets
Mohammad, S. M., & Kiritchenko, S. (2014) · Computational Intelligence · doi:10.1111/coin.12024 · Cited by 409 · see citing works
Making conversations with chatbots more personalized
Shumanov, M., & Johnson, L. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2020.106627 · Cited by 363 · see citing works
Predicting personality from patterns of behavior collected with smartphones
Stachl, C., Au, Q., Schoedel, R., Gosling, S. D., Harari, G. M., Buschek, D., Völkel, S. T., Schuwerk, T., Oldemeier, M., Ullmann, T., et al. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1920484117 · Cited by 362 · see citing works
You are what you tweet: Personality expression and perception on Twitter
Qiu, L., Lin, H. Y., Ramsay, J. E., & Yang, F. (2012) · Journal of Research in Personality · doi:10.1016/j.jrp.2012.08.008 · Cited by 330 · see citing works
Language-based personality: a new approach to personality in a digital world
Boyd, R. L., & Pennebaker, J. W. (2017) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2017.07.017 · Cited by 296 · see citing works
Text Mining in Organizational Research
Kobayashi, V. B., Mol, S. T., Berkers, H., Kismihók, G., & den Hartog, D. D. (2017) · Organizational Research Methods · doi:10.1177/1094428117722619 · Cited by 253 · see citing works
Narcissistic rhetoric and crowdfunding performance: A social role theory perspective
Anglin, A. H., Wolfe, M. T., Short, J. C., McKenny, A. F., & Pidduck, R. J. (2018) · Journal of Business Venturing · doi:10.1016/j.jbusvent.2018.04.004 · Cited by 274 · see citing works
When Words Sweat: Identifying Signals for Loan Default in the Text of Loan Applications
Netzer, O., Lemaire, A., & Herzenstein, M. (2019) · Journal of Marketing Research · doi:10.1177/0022243719852959 · Cited by 238 · see citing works
A meta-analysis of correlations between depression and first person singular pronoun use
Edwards, T., & Holtzman, N. S. (2017) · Journal of Research in Personality · doi:10.1016/j.jrp.2017.02.005 · Cited by 224 · see citing works
New Talent Signals: Shiny New Objects or a Brave New World?
Chamorro‐Premuzic, T., Winsborough, D., Sherman, R. A., & Hogan, R. (2016) · Industrial and Organizational Psychology · doi:10.1017/iop.2016.6 · Cited by 224 · see citing works
Gaining insights from social media language: Methodologies and challenges.
Kern, M. L., Park, G., Eichstaedt, J. C., Schwartz, H. A., Sap, M., Smith, L. K., & Ungar, L. H. (2016) · Psychological Methods · doi:10.1037/met0000091 · Cited by 221 · see citing works
The Impact of User Personality Traits on Word of Mouth: Text-Mining Social Media Platforms
Adamopoulos, P., Ghose, A., & Todri, V. (2018) · Information Systems Research · doi:10.1287/isre.2017.0768 · Cited by 210 · see citing works
The YouTube Lens: Crowdsourced Personality Impressions and Audiovisual Analysis of Vlogs
Biel, J.-I., & Gatica-Perez, D. (2013) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2012.2225032 · Cited by 209 · see citing works
Tackman, A. M., Sbarra, D. A., Carey, A. L., Donnellan, M. B., Horn, A. B., Holtzman, N. S., Edwards, T. S., Pennebaker, J. W., & Mehl, M. R. (2018) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000187 · Cited by 208 · see citing works
Personality Predictions Based on User Behavior on the Facebook Social Media Platform
Tadesse, M. M., Lin, H., Xu, B., & Yang, L. (2018) · IEEE Access · doi:10.1109/access.2018.2876502 · Cited by 207 · see citing works
Eichstaedt, J. C., Kern, M. L., Yaden, D. B., Schwartz, H. A., Giorgi, S., Park, G., Hagan, C. A., Tobolsky, V. A., Smith, L. K., Buffone, A. E. K., et al. (2021) · Psychological Methods · doi:10.1037/met0000349 · Cited by 193 · see citing works
Sounds like a narcissist: Behavioral manifestations of narcissism in everyday life
Holtzman, N. S., Vazire, S., & Mehl, M. R. (2010) · Journal of Research in Personality · doi:10.1016/j.jrp.2010.06.001 · Cited by 180 · see citing works
Trusting Virtual Agents: The Effect of Personality
Zhou, M. X., Mark, G., Li, J., & Yang, H. (2019) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3232077 · Cited by 176 · see citing works
Understanding individuals' personal values from social media word use
Chen, J., Hsieh, G., Mahmud, J., & Nichols, J. W. (2014) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/2531602.2531608 · Cited by 173 · see citing works
Using Big Data as a window into consumers’ psychology
Matz, S., & Netzer, O. (2017) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2017.05.009 · Cited by 168 · see citing works
Text messaging, personality, and the social context
Holtgraves, T. (2011) · Journal of Research in Personality · doi:10.1016/j.jrp.2010.11.015 · Cited by 166 · see citing works
Analyzing Polarization in Social Media: Method and Application to Tweets on 21 Mass Shootings
Demszky, D., Garg, N., Voigt, R., Zou, J., Shapiro, J., Gentzkow, M., & Jurafsky, D. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1304 · Cited by 164 · see citing works
“, 2012) and in various other domains (Hirsh and Peterson, 2009; Yarkoni, 2010; Pennebaker, 2011).”
BackgroundIntroverted elves & conscientious gnomes
Yee, N., Ducheneaut, N., Nelson, L., & Likarish, P. (2011) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979052 · Cited by 147 · see citing works
Personality Traits Predict Smartphone Usage
Stachl, C., Hilbert, S., Au, J., Buschek, D., Luca, A. D., Bischl, B., Hußmann, H., & Bühner, M. (2017) · European Journal of Personality · doi:10.1002/per.2113 · Cited by 147 · see citing works
The datafication of talent: how technology is advancing the science of human potential at work
Chamorro‐Premuzic, T., Akhtar, R., Winsborough, D., & Sherman, R. A. (2017) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2017.04.007 · Cited by 146 · see citing works
Kern, M. L., Eichstaedt, J. C., Schwartz, H. A., Dziurzynski, L., Ungar, L., Stillwell, D. J., Kosiński, M., Ramones, S. M., & Seligman, M. E. P. (2013) · Assessment · doi:10.1177/1073191113514104 · Cited by 142 · see citing works
Bottom-Up and Top-Down: Predicting Personality with Psycholinguistic and Language Model Features
Mehta, Y., Fatehi, S., Kazameini, A., Stachl, C., Cambria, E., & Eetemadi, S. (2020) · Proceedings · doi:10.1109/icdm50108.2020.00146 · Cited by 141 · see citing works
Perceptions of personality in text-based media and OSN: A meta-analysis
Tskhay, K. O., & Rule, N. O. (2014) · Journal of Research in Personality · doi:10.1016/j.jrp.2013.12.004 · Cited by 139 · see citing works
Large Scale Personality Classification of Bloggers
Iacobelli, F., Gill, A. J., Nowson, S., & Oberlander, J. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-24571-8_71 · Cited by 136 · see citing works
Designing Personality-Adaptive Conversational Agents for Mental Health Care
Ahmad, R., Siemon, D., Gnewuch, U., & Robra-Bissantz, S. (2022) · Information Systems Frontiers · doi:10.1007/s10796-022-10254-9 · Cited by 134 · see citing works
Psychological Text Analysis in the Digital Humanities
Boyd, R. L. (2017) · Springer eBooks · doi:10.1007/978-3-319-54499-1_7 · Cited by 133 · see citing works
Fairness in Machine Learning: A Survey
Caton, S., & Haas, C. (2020) · arXiv · doi:10.48550/arxiv.2010.04053 · Cited by 646 · see citing works
Privacy in the age of psychological targeting
Matz, S., Appel, R. E., & Kosiński, M. (2019) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2019.08.010 · Cited by 127 · see citing works
Hu, Y., Xu, A., Hong, Y., Gal, D., Sinha, V. S., & Akkiraju, R. (2018) · Journal of Management Information Systems · doi:10.1080/07421222.2019.1628908 · Cited by 126 · see citing works
Values in Words: Using Language to Evaluate and Understand Personal Values
Boyd, R. L., Wilson, S. R., Pennebaker, J. W., Kosiński, M., Stillwell, D. J., & Mihalcea, R. F. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v9i1.14589 · Cited by 125 · see citing works
Obschonka, M., Fisch, C., & Boyd, R. L. (2017) · Journal of Business Venturing Insights · doi:10.1016/j.jbvi.2017.05.005 · Cited by 104 · see citing works
Fan, J., Sun, T., Liu, J., Zhao, T., Zhang, B., Chen, Z., Glorioso, M., & Hack, E. (2023) · Journal of Applied Psychology · doi:10.1037/apl0001082 · Cited by 123 · see citing works
Narcissism and the use of personal pronouns revisited.
Carey, A. L., Brucks, M. S., Küfner, A. C. P., Holtzman, N. S., Deters, F. G., Back, M. D., Donnellan, M. B., Pennebaker, J. W., & Mehl, M. R. (2015) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000029 · Cited by 121 · see citing works
Personalization as a promise: Can Big Data change the practice of insurance?
Barry, L., & Arthur Charpentier, A. (2020) · Big Data & Society · doi:10.1177/2053951720935143 · Cited by 119 · see citing works
People With Dark Personalities Tend to Create a Physically Attractive Veneer
Holtzman, N. S., & Strube, M. (2012) · Social Psychological and Personality Science · doi:10.1177/1948550612461284 · Cited by 117 · see citing works
The language of well-being: Tracking fluctuations in emotion experience through everyday speech.
Sun, J., Schwartz, H. A., Son, Y., Kern, M. L., & Vazire, S. (2019) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000244 · Cited by 116 · see citing works
Feldman, G., Lian, H., Kosiński, M., & Stillwell, D. J. (2017) · Social Psychological and Personality Science · doi:10.1177/1948550616681055 · Cited by 114 · see citing works
Beukeboom, C. J., Tanis, M., & Vermeulen, I. (2012) · Journal of Language and Social Psychology · doi:10.1177/0261927x12460844 · Cited by 113 · see citing works
Gou, L., Zhou, M. X., & Yang, H. (2014) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2557398 · Cited by 113 · see citing works
Yarkoni, T. (2012) · Current Directions in Psychological Science · doi:10.1177/0963721412457362 · Cited by 111 · see citing works
Self-citationTsiakali, K. (2018) · Journal of Hospitality Marketing & Management · doi:10.1080/19368623.2018.1477643 · Cited by 110 · see citing works
Klein, C., Clutton, P., & Dunn, A. (2019) · PLoS ONE · doi:10.1371/journal.pone.0225098 · Cited by 108 · see citing works
25 Tweets to Know You: A New Model to Predict Personality with Social Media
Arnoux, P.-H., Xu, A., Boyette, N., Mahmud, J., Akkiraju, R., & Sinha, V. S. (2017) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v11i1.14963 · Cited by 107 · see citing works
A Positivity Bias in Written and Spoken English and Its Moderation by Personality and Gender
Augustine, A. A., Mehl, M. R., & Larsen, R. J. (2011) · Social Psychological and Personality Science · doi:10.1177/1948550611399154 · Cited by 107 · see citing works
Zhang, S., Bantum, E. O., Owen, J. E., Henry, S. B., & Elhadad, N. (2016) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocw093 · Cited by 103 · see citing works
Large language models can infer psychological dispositions of social media users
Peters, H., & Matz, S. (2024) · PNAS Nexus · doi:10.1093/pnasnexus/pgae231 · Cited by 102 · see citing works
Holtzman, N. S. (2011) · Journal of Research in Personality · doi:10.1016/j.jrp.2011.09.002 · Cited by 102 · see citing works
Who Will Retweet This? Detecting Strangers from Twitter to Retweet Information
Lee, K., Mahmud, J., Chen, J., Zhou, M. X., & Nichols, J. W. (2015) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/2700466 · Cited by 101 · see citing works
Koutsoumpis, A., Oostrom, J. K., Holtrop, D., van Breda, W., Ghassemi, S., & de Vries, R. E. (2022) · Psychological Bulletin · doi:10.1037/bul0000381 · Cited by 95 · see citing works
You Are Known by How You Vlog: Personality Impressions and Nonverbal Behavior in YouTube
Biel, J.-I., Aran, O., & Gática-Pérez, D. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v5i1.14160 · Cited by 92 · see citing works
The Expression of Personality in Virtual Worlds
Yee, N., Harris, H., Jabon, M. E., & Bailenson, J. N. (2010) · Social Psychological and Personality Science · doi:10.1177/1948550610379056 · Cited by 90 · see citing works
CEO Personality and Firm Policies
Gow, I. D., Kaplan, S. N., Larcker, D. F., & Zakolyukina, A. A. (2016) · National Bureau of Economic Research · doi:10.3386/w22435 · Cited by 88 · see citing works
A Survey of Computational Methods for Online Mental State Assessment on Social Media
Ríssola, E. A., Losada, D. E., & Crestani, F. (2021) · ACM Transactions on Computing for Healthcare · doi:10.1145/3437259 · Cited by 84 · see citing works
Wei, H., Zhang, F., Yuan, N. J., Cao, C., Fu, H., Xie, X., Rui, Y., & Ma, W. (2017) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3018661.3018717 · Cited by 84 · see citing works
Zimmermann, J., Wolf, M., Bock, A., Peham, D., & Benecke, C. (2013) · Journal of Research in Personality · doi:10.1016/j.jrp.2013.01.008 · Cited by 82 · see citing works
Identifying At-Risk Employees: Modeling Psychosocial Precursors of Potential Insider Threats
Greitzer, F. L., Kangas, L. J., Noonan, C. F., Dalton, A. C., & Hohimer, R. E. (2012) · Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.2012.309 · Cited by 80 · see citing works
Using AI predicted personality to enhance advertising effectiveness
Shumanov, M., Cooper, H. B., & Ewing, M. T. (2021) · European Journal of Marketing · doi:10.1108/ejm-12-2019-0941 · Cited by 79 · see citing works
Hrazdil, K., Novák, J., Rogo, R., Wiedman, C. I., & Zhang, R. (2019) · Journal of Business Finance & Accounting · doi:10.1111/jbfa.12406 · Cited by 78 · see citing works
Linguistic Markers of Grandiose Narcissism: A LIWC Analysis of 15 Samples
Holtzman, N. S., Tackman, A. M., Carey, A. L., Brucks, M. S., Küfner, A. C. P., Deters, F. G., Back, M. D., Donnellan, M. B., Pennebaker, J. W., Sherman, R. A., et al. (2019) · Journal of Language and Social Psychology · doi:10.1177/0261927x19871084 · Cited by 78 · see citing works
Neurobiological substrates of personality: A critical overview.
Yarkoni, T. (2014) · American Psychological Association eBooks · doi:10.1037/14343-003 · Cited by 77 · see citing works
Self-citationLearning from Multiple Social Networks
Nie, L., Song, X., & Chua, T. (2016) · Synthesis lectures on information concepts, retrieval, and services · doi:10.1007/978-3-031-02300-2 · Cited by 76 · see citing works
Hierarchical Modeling for User Personality Prediction: The Role of Message-Level Attention
Lynn, V., Balasubramanian, N., & Schwartz, H. A. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.472 · Cited by 75 · see citing works
Above and beyond Short-Term Mating, Long-Term Mating is Uniquely Tied to Human Personality
Holtzman, N. S., & Strube, M. (2013) · Evolutionary Psychology · doi:10.1177/147470491301100514 · Cited by 75 · see citing works
Mining personality traits from social messages for game recommender systems
Yang, H.-C., & Huang, Z.-R. (2019) · Knowledge-Based Systems · doi:10.1016/j.knosys.2018.11.025 · Cited by 71 · see citing works
MoralStrength: Exploiting a moral lexicon and embedding similarity for moral foundations prediction
Araque, Ó., Gatti, L., & Kalimeri, K. (2019) · Knowledge-Based Systems · doi:10.1016/j.knosys.2019.105184 · Cited by 73 · see citing works
Choi, S., Williams, D. C., & Kim, H. (2020) · New Media & Society · doi:10.1177/1461444820977199 · Cited by 72 · see citing works
Crone, D., Bode, S., Murawski, C., & Laham, S. (2018) · PLoS ONE · doi:10.1371/journal.pone.0190954 · Cited by 77 · see citing works
Küfner, A. C. P., Back, M. D., Nestler, S., & Egloff, B. (2010) · Journal of Research in Personality · doi:10.1016/j.jrp.2010.05.003 · Cited by 70 · see citing works
Lee, K., Mahmud, J., Chen, J., Zhou, M. X., & Nichols, J. W. (2014) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/2557500.2557502 · Cited by 70 · see citing works
Personality Prediction Based on Twitter Information in Bahasa Indonesia
Suhartono, D., Ong, V., Rahmanto, A. D. S., Williem, N. G. N., Nugroho, A. E., Andangsari, E. W., & Suprayogi, M. N. (2017) · Annals of Computer Science and Information Systems · doi:10.15439/2017f359 · Cited by 69 · see citing works
Assessing the Unacquainted: Inferred Reviewer Personality and Review Helpfulness
Liu, A. X., Li, Y., & Xu, S. X. (2021) · MIS Quarterly · doi:10.25300/misq/2021/14375 · Cited by 67 · see citing works
Hi YouTube!: personality impressions and verbal content in social video
Biel, J.-I., Tsiminaki, V., Dines, J., & Gatica-Perez, D. (2013) · Proceedings of the 15th ACM on International conference on multimodal interaction · doi:10.1145/2522848.2522877 · Cited by 66 · see citing works
Knowledge of words: An interpretable approach for personality recognition from social media
Han, S., Huang, H., & Tang, Y. (2020) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.105550 · Cited by 65 · see citing works
Hickman, L., Saef, R. M., Ng, V., Woo, S. E., Tay, L., & Bosch, N. (2021) · Human Resource Management Journal · doi:10.1111/1748-8583.12356 · Cited by 65 · see citing works
New perspectives on gray sheep behavior in E-commerce recommendations
Srivastava, A., Bala, P. K., & Kumar, B. (2019) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2019.02.018 · Cited by 64 · see citing works
Translation and validation of the Ten-Item-Personality Inventory into Spanish and Catalan
Ruiz, V. R., Oberst, U. E., Gosling, S. D., Rusiñol, J., & Lusar, A. C. (2013) · RECERCAT (Consorci de Serveis Universitaris de Catalunya) · Cited by 62 · see citing works
Personality-based refinement for sentiment classification in microblog
Lin, J., Mao, W., & Zeng, D. D. (2017) · Knowledge-Based Systems · doi:10.1016/j.knosys.2017.06.031 · Cited by 60 · see citing works
Quantitative Study of Music Listening Behavior in a Social and Affective Context
Yang, Y.-H., & Liu, J.-Y. (2013) · IEEE transactions on multimedia · doi:10.1109/tmm.2013.2265078 · Cited by 61 · see citing works
Multi-Document Transformer for Personality Detection
Yang, F., Quan, X., Yang, Y., & Yu, J. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i16.17673 · Cited by 57 · see citing works
Hrazdil, K., Mahmoudian, F., & Nazari, J. A. (2021) · Corporate Social Responsibility and Environmental Management · doi:10.1002/csr.2116 · Cited by 57 · see citing works
Describing the ideal victim: A linguistic analysis of victim descriptions
Lewis, J. A., Hamilton, J. C., & Elmore, J. D. (2021) · Current Psychology · doi:10.1007/s12144-019-00347-1 · Cited by 56 · see citing works
Recommending targeted strangers from whom to solicit information on social media
Mahmud, J., Zhou, M. X., Megiddo, N., Nichols, J. W., & Drews, C. (2013) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/2449396.2449403 · Cited by 55 · see citing works
Assessing the Big Five personality traits with latent semantic analysis
Kwantes, P. J., Derbentseva, N., Lam, Q., Vartanian, O. A., & Marmurek, H. H. C. (2016) · Personality and Individual Differences · doi:10.1016/j.paid.2016.07.010 · Cited by 55 · see citing works
Tong, S. T., Corriero, E. F., Wibowo, K. A., Makki, T. W., & Slatcher, R. B. (2019) · New Media & Society · doi:10.1177/1461444819872678 · Cited by 55 · see citing works
Liu, H., Huang, Y., Wang, Z., Liu, K., Hu, X., & Wang, W. (2019) · Applied Sciences · doi:10.3390/app9101992 · Cited by 54 · see citing works
Confiding in and Listening to Virtual Agents
Li, J. J., Zhou, M. X., Yang, H., & Mark, G. J. (2017) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3025171.3025206 · Cited by 53 · see citing works
How to Trick AI: Users' Strategies for Protecting Themselves from Automatic Personality Assessment
Völkel, S. T., Häuslschmid, R., Werner, A., Hußmann, H., & Butz, A. M. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376877 · Cited by 52 · see citing works
Boland, J. E., & Queen, R. M. (2016) · PLoS ONE · doi:10.1371/journal.pone.0149885 · Cited by 52 · see citing works
- Authors
- Yarkoni, T.
- Affiliations
- University of Colorado Boulder (US)
- Corresponding author
- Yarkoni, Tal
- ORCID
- Yarkoni, Tal
- Venue
- Journal of Research in Personality
- Publisher
- Elsevier BV
- Published
- 2010-06
- Volume
- 44
- Issue
- 3
- Pages
- 363-373
- ISSN
- 0092-6566 (ISSN-L)
- PMC
- PMC2885844
- OpenAlex
- W1973871257
- Cited by
- 637
- References
- 41
- Citations by year
- 2026: 54 · 2025: 40 · 2024: 41 · 2023: 39 · 2022: 57 · 2021: 73 · 2020: 56 · 2019: 62 · 2018: 37 · 2017: 44 · 2016: 32 · 2015: 29 · 2014: 25 · 2013: 22 · 2012: 15
- FWCI
- 16.82
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Licence
- Locations
- Journal of Research in Personality (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institutes of Health
- National Institute of Nursing Research (F32NR012081)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Personality Traits and Psychology
- Social Sciences › Psychology › Social Psychology › Mental Health via Writing
- Physical Sciences › Computer Science › Artificial Intelligence › Authorship Attribution and Profiling
- Keywords
- personality, word usage, bloggers, English vocabulary, language and personality, replication
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-10.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-10.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review