From Text to Thought: How Analyzing Language Can Advance Psychological Science
Open accessThe DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Abstract
Humans have been using language for millennia but have only just begun to scratch the surface of what natural language can reveal about the mind. Here we propose that language offers a unique window into psychology. After briefly summarizing the legacy of language analyses in psychological science, we show how methodological advances have made these analyses more feasible and insightful than ever before. In particular, we describe how two forms of language analysis—natural-language processing and comparative linguistics—are contributing to how we understand topics as diverse as emotion, creativity, and religion and overcoming obstacles related to statistical power and culturally diverse samples. We summarize resources for learning both of these methods and highlight the best way to combine language analysis with more traditional psychological paradigms. Applying language analysis to large-scale and cross-cultural datasets promises to provide major breakthroughs in psychological science.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
null (2016) · Philosophy Study · doi:10.17265/2159-5313/2016.09.003 · Cited by 28,317
The weirdest people in the world?
Henrich, J., Heine, S. J., & Norenzayan, A. (2010) · Behavioral and Brain Sciences · doi:10.1017/s0140525x0999152x · Cited by 12,641
Measuring individual differences in implicit cognition: the implicit association test
Greenwald, A. G., McGhee, D. E., & Schwartz, J. L. K. (1998) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.74.6.1464 · Cited by 9,210
Nonparametric permutation tests for functional neuroimaging: A primer with examples
Nichols, T. E., & Holmes, A. P. (2002) · Human Brain Mapping · doi:10.1002/hbm.1058 · Cited by 6,256
Core affect and the psychological construction of emotion.
Russell, J. A. (2003) · Psychological Review · doi:10.1037/0033-295x.110.1.145 · Cited by 6,113 · cited 1×
“…categories that possess little variation around the world or are socially learned categories that vary in their experience and conceptualization across cultures (Cowen & Keltner, 2020; Ekman & Friesen, 1971; Izard, 2013; Plutchik, 1991; Lindquist et al., 2012; Mesquita et al., 2016; Russell, 2003).”
VADER: a parsimonious rule-based model for sentiment analysis of social media text
Hutto, C., & Gilbert, E. (2014) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v8i1.14550 · Cited by 6,087
Cohen, J. (1992) · Current Directions in Psychological Science · doi:10.1111/1467-8721.ep10768783 · Cited by 5,870
The Psychological Meaning of Words: LIWC and Computerized Text Analysis Methods
Tausczik, Y. R., & Pennebaker, J. W. (2010) · Journal of Language and Social Psychology · doi:10.1177/0261927x09351676 · Cited by 5,774 · cited 1×
“…of language analysis for psychological theorizing was not fully realized until the development of computational methods of language analysis, the most popular of which may be the technique known as linguistic inquiry and word count (LIWC; Pennebaker et al., 2007; Tausczik & Pennebaker, 2010).”
Constants across cultures in the face and emotion.
Ekman, P., & Friesen, W. V. (1971) · Journal of Personality and Social Psychology · doi:10.1037/h0030377 · Cited by 5,509 · cited 2×
“This analysis allowed us to increase the scale and generalizability over previous field studies of cross-cultural differences in emotion that had relied on smaller sample sizes and two-culture comparisons (Bryant & Barrett, 2008; Ekman & Friesen, 1971; Gendron et al., 2014, 2015, 2020).”
An introduction to latent semantic analysis
Landauer, T. K., Foltz, P. W., & Laham, D. (1998) · Discourse Processes · doi:10.1080/01638539809545028 · Cited by 4,880 · cited 1×
“One of these algorithms, latent semantic analysis, is arguably the most foundational method of generating topic models (Landauer et al., 1998), but it is not the only method.”
ELIZA—a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1966) · Communications of the ACM · doi:10.1145/365153.365168 · Cited by 4,452 · cited 2×
“Other early NLP developments involved ELIZA (Weizenbaum, 1966)—a computer therapist that could respond to human complaints (“I feel sad”) with realistic therapist comments (“and why do you feel sad?”)—and Jabberwacky.”
Experimental evidence of massive-scale emotional contagion through social networks
Kramer, A. D. I., Guillory, J. E., & Hancock, J. T. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1320040111 · Cited by 3,687 · cited 1×
“…and colexification can sometimes uncover evolutionary dynamics. studies have shown experimentally that emotional sentiment conveyed by language on social-media websites (e.g., Facebook) is more likely to make individuals who view that language express similar emotions (Kramer et al., 2014).”
Guilford, J. P. (1950) · American Psychologist · doi:10.1037/h0063487 · Cited by 3,588
JAMES, W. (1884) · Mind · doi:10.1093/mind/os-ix.34.188 · Cited by 3,446
The brain basis of emotion: a meta-analytic review
Lindquist, K. A., Wager, T. D., Kober, H., Bliss-Moreau, E., & Barrett, L. F. (2012) · Behavioral and Brain Sciences · doi:10.1017/s0140525x11000446 · Cited by 2,320 · cited 1×
“…categories that possess little variation around the world or are socially learned categories that vary in their experience and conceptualization across cultures (Cowen & Keltner, 2020; Ekman & Friesen, 1971; Izard, 2013; Plutchik, 1991; Lindquist et al., 2012; Mesquita et al., 2016; Russell, 2003).”
Self-citationEkman, P. (1999) · Handbook of Cognition and Emotion · doi:10.1002/0470013494.ch3 · Cited by 2,125
stm : An R Package for Structural Topic Models
Roberts, M. E., Stewart, B. M., & Tingley, D. (2019) · Journal of Statistical Software · doi:10.18637/jss.v091.i02 · Cited by 1,714 · cited 1×
“…that words belong in topics (Steyvers & Griffiths, 2007); latent Dirichlet allocation is a Bayesian version of probabilistic latent semantic analysis (Blei et al., 2003), and structural topic models examine the relationships between variables and the prevalence of topics (Roberts et al., 2019).”
Personality, Gender, and Age in the Language of Social Media: The Open-Vocabulary Approach
Schwartz, H. A., Eichstaedt, J. C., Kern, M. L., Dziurzynski, L., Ramones, S. M., Agrawal, M., Shah, A., Kosinski, M., Stillwell, D., Seligman, M. E. P., et al. (2013) · PLoS ONE · doi:10.1371/journal.pone.0073791 · Cited by 1,700
Russell, J. A. (1994) · Psychological Bulletin · doi:10.1037/0033-2909.115.1.102 · Cited by 1,640
Emotion shapes the diffusion of moralized content in social networks
Brady, W. J., Wills, J. A., Jost, J. T., Tucker, J. A., & Van Bavel, J. J. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1618923114 · Cited by 1,580 · cited 1×
“Correlational studies find that social-media information with high emotional content is more likely to be shared than information with low emotional content (Brady et al., 2017).”
Large-Scale Psychological Differences Within China Explained by Rice Versus Wheat Agriculture
Talhelm, T., Zhang, X., Oishi, S., Shimin, C., Duan, D., Lan, X., & Kitayama, S. (2014) · Science · doi:10.1126/science.1246850 · Cited by 1,374 · cited 1×
“…Science and Science Advances have argued that rice farming (vs. wheat farming) is responsible for current-day cultural differences in collectivism (Talhelm et al., 2014, 2018), but these correlational surveys have not been able to causally test this hypothesis or even establish whether…”
Word embeddings quantify 100 years of gender and ethnic stereotypes
Garg, N., Schiebinger, L., Jurafsky, D., & Zou, J. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1720347115 · Cited by 1,065 · cited 1×
“NLP techniques also carry the same gender and racial biases as the language-and human-generated labels they are trained upon (Garg et al., 2018; Kiritchenko & Mohammad, 2018).”
The cultural evolution of prosocial religions
Norenzayan, A., Shariff, A. F., Gervais, W. M., Willard, A. K., McNamara, R. A., Slingerland, E., & Henrich, J. (2016) · Behavioral and Brain Sciences · doi:10.1017/s0140525x14001356 · Cited by 934
The growing problem of loneliness
Cacioppo, J. T., & Cacioppo, S. (2018) · The Lancet · doi:10.1016/s0140-6736(18)30142-9 · Cited by 897 · cited 1×
“…concepts are transmitted more reliably than low-arousal concepts, and social concepts are transmitted more reliably than asocial concepts (Mesoudi & Whiten, 2008), illustrating the salience of high-arousal feelings (Kensinger, 2004) and sociality (Cacioppo & Cacioppo, 2018) to human experience.”
The origin and evolution of religious prosociality
Norenzayan, A., & Shariff, A. F. (2008) · Science · doi:10.1126/science.1158757 · Cited by 874
Language Phylogenies Reveal Expansion Pulses and Pauses in Pacific Settlement
Gray, R. D., Drummond, A. J., & Greenhill, S. J. (2009) · Science · doi:10.1126/science.1166858 · Cited by 866
Linguistic Markers of Psychological Change Surrounding September 11, 2001
Cohn, M. A., Mehl, M. R., & Pennebaker, J. W. (2004) · Psychological Science · doi:10.1111/j.0956-7976.2004.00741.x · Cited by 808
Rad, M. S., Martingano, A. J., & Ginges, J. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1721165115 · Cited by 746
Uniting the Tribes: Using Text for Marketing Insight
Berger, J., Humphreys, A., Ludwig, S., Moe, W. W., Netzer, O., & Schweidel, D. A. (2020) · Journal of Marketing · doi:10.1177/0022242919873106 · Cited by 742 · cited 1×
“…al., 2007; Rudkowsky et al., 2018) and some broader reviews about the utility of language analysis for the social and organizational sciences (e.g., Berger et al., 2020; Boyd & Schwartz, 2020; Kjell et al., 2019; Short et al., 2018), few articles have discussed how multiple forms of linguistic…”
Online panels in social science research: Expanding sampling methods beyond Mechanical Turk
Chandler, J., Rosenzweig, C., Moss, A. J., Robinson, J., & Litman, L. (2019) · Behavior Research Methods · doi:10.3758/s13428-019-01273-7 · Cited by 668
Facebook language predicts depression in medical records
Eichstaedt, J. C., Smith, R. J., Merchant, R. M., Ungar, L. H., Crutchley, P., Preoţiuc-Pietro, D., Asch, D. A., & Schwartz, H. A. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1802331115 · Cited by 643
Words of wisdom: Language use over the life span
Pennebaker, J. W., & Stone, L. D. (2003) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.85.2.291 · Cited by 518
Examining Gender and Race Bias in Two Hundred Sentiment Analysis Systems
Kiritchenko, S., & Mohammad, S. (2018) · Proceedings of the Seventh Joint Conference on Lexical and Computational Semantics · doi:10.18653/v1/s18-2005 · Cited by 384
Disgust Sensitivity, Political Conservatism, and Voting
Inbar, Y., Pizarro, D., Iyer, R., & Haidt, J. (2012) · Social Psychological and Personality Science · doi:10.1177/1948550611429024 · Cited by 358 · cited 1×
“For example, there is a highly cited link between cultures’ pathogen prevalence and political conservatism, which many scholars cite as evidence that disgust sensitivity makes people more conservative (Inbar et al., 2012).”
Watts, J., Greenhill, S. J., Atkinson, Q. D., Currie, T. E., Bulbulia, J., & Gray, R. D. (2015) · Proceedings of the Royal Society B: Biological Sciences · doi:10.1098/rspb.2014.2556 · Cited by 352
Self-citationJohnson, D. D. P. (2005) · Human Nature · doi:10.1007/s12110-005-1017-0 · Cited by 323
Boyd, R. L., & Schwartz, H. A. (2021) · Journal of Language and Social Psychology · doi:10.1177/0261927x20967028 · Cited by 317 · cited 1×
“…et al., 2018) and some broader reviews about the utility of language analysis for the social and organizational sciences (e.g., Berger et al., 2020; Boyd & Schwartz, 2020; Kjell et al., 2019; Short et al., 2018), few articles have discussed how multiple forms of linguistic analysis can be…”
Social Structure, Infectious Diseases, Disasters, Secularism, and Cultural Change in America
Grossmann, I., & Varnum, M. E. W. (2015) · Psychological Science · doi:10.1177/0956797614563765 · Cited by 299
Emotion, language, and cultural scripts.
Wierzbicka, A. (2004) · Emotion and culture: Empirical studies of mutual influence. · doi:10.1037/10152-004 · Cited by 275
Ritual human sacrifice promoted and sustained the evolution of stratified societies
Watts, J., Sheehan, O., Atkinson, Q. D., Bulbulia, J., & Gray, R. D. (2016) · Nature · doi:10.1038/nature17159 · Cited by 188
Self-citation
Cited by
Over-reliance on English hinders cognitive science
Blasi, D. E., Henrich, J., Adamou, E., Kemmerer, D., & Majid, A. (2022) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2022.09.015 · Cited by 396
GPT is an effective tool for multilingual psychological text analysis
Rathje, S., Mirea, D.-M., Sucholutsky, I., Marjieh, R., Robertson, C. E., & Van Bavel, J. J. (2024) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2308950121 · Cited by 297
Associative thinking at the core of creativity
Beaty, R. E., & Kenett, Y. N. (2023) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2023.04.004 · Cited by 224
Using natural language processing to analyse text data in behavioural science
Feuerriegel, S., Maarouf, A., Bär, D., Geissler, D., Schweisthal, J., Pröllochs, N., Robertson, C. E., Rathje, S., Hartmann, J., Mohammad, S. M., et al. (2025) · Nature Reviews Psychology · doi:10.1038/s44159-024-00392-z · Cited by 140
“This abundance of text data can be leveraged by behavioural science researchers to understand psychology and capture human behaviour 6–8 .”
Choi, M., Pei, J., Kumar, S., Shu, C., & Jurgens, D. (2023) · arXiv · doi:10.48550/arxiv.2305.14938 · Cited by 73
Metadata
- Authors
- Jackson, J. C., Watts, J., List, J.-M., Puryear, C., Drabble, R., & Lindquist, K. A.
- Venue
- Perspectives on Psychological Science
- Publisher
- SAGE Publications
- Published
- 2021-10-04
- Volume
- 17
- Issue
- 3
- Pages
- 805-826
- ISSN
- 1745-6916 (ISSN-L)
- 1745-6924
- OpenAlex
- W3117748961
- Cited by
- 167
- References
- 40
- FWCI
- 23.61
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.