Automated text analysis in psychology: methods, applications, and future developments
The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
Recent years have seen rapid developments in automated text analysis methods focused on measuring psychological and demographic properties. While this development has mainly been driven by computer scientists and computational linguists, such methods can be of great value for social scientists in general, and for psychologists in particular. In this paper, we review some of the most popular approaches to automated text analysis from the perspective of social scientists, and give examples of their applications in different theoretical domains. After describing some of the pros and cons of these methods, we speculate about future methodological developments, and how they might change social sciences. We conclude that, despite the fact that current methods have many disadvantages and pitfalls compared to more traditional methods of data collection, the constant increase of computational power and the wide availability of textual data will inevitably make automated text analysis a common tool for psychologists.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
WordNet: a lexical database for English
Miller, G. A. (1995) · Communications of the ACM · doi:10.1145/219717.219748 · Cited by 14,015 · cited 1×
“Yet with the increasing availability of large databases of semantic relations, such as WordNet (Miller, 1995 ), it is possible to use automated algorithms for building dictionaries based on one or another semantic relation (Kim & Hovy, 2004 ; Mishne, 2005 ) with minimum human input.”
MethodBrain magnetic resonance imaging with contrast dependent on blood oxygenation.
Ogawa, S., Lee, T. M., Kay, A. R., & Tank, D. W. (1990) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.87.24.9868 · Cited by 6,483
Landauer, T. K., & Dumais, S. T. (1997) · Psychological Review · doi:10.1037/0033-295x.104.2.211 · Cited by 6,282
The Psychological Meaning of Words: LIWC and Computerized Text Analysis Methods
Tausczik, Y. R., & Pennebaker, J. W. (2010) · Journal of Language and Social Psychology · doi:10.1177/0261927x09351676 · Cited by 5,774 · cited 2×
“Similarly, depressed people are also more likely to use fi rst person singular pronouns (Rude et al., 2004 ), and the same is true for people in lower power [ 1 ] For historical background, see Stone, Dunphy, & Smith ( 1966 ); Graesser et al. ( 2004 ); and Tausczik & Pennebaker ( 2010 ).”
BackgroundMethodBlei, D. M. (2012) · Communications of the ACM · doi:10.1145/2133806.2133826 · Cited by 5,516 · cited 1×
“…number of topics as known variables, and approximates the posterior distribution of the hidden variables: topics given document, topics given document and words (see Blei, 2012 , for a review). between the essays written on diff erent days was signifi cantly correlated to subsequent medical visits.”
BackgroundAn introduction to latent semantic analysis
Landauer, T. K., Foltz, P. W., & Laham, D. (1998) · Discourse Processes · doi:10.1080/01638539809545028 · Cited by 4,880
Liberals and conservatives rely on different sets of moral foundations.
Graham, J., Haidt, J., & Nosek, B. A. (2009) · Journal of Personality and Social Psychology · doi:10.1037/a0015141 · Cited by 4,560
Private traits and attributes are predictable from digital records of human behavior
Kosinski, M., Stillwell, D., & Graepel, T. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1218772110 · Cited by 2,829
Linguistic styles: language use as an individual difference
Pennebaker, J. W., & King, L. A. (1999) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.77.6.1296 · Cited by 1,961
Tastes, ties, and time: a new social network dataset using Facebook.com
Lewis, K., Kaufman, J., Gonzalez, M., Wimmer, A., & Christakis, N. (2008) · Social Networks · doi:10.1016/j.socnet.2008.07.002 · Cited by 1,024 · cited 2×
“Some of this data is already in analysis-friendly form, such as social network information (Lewis, Kaufman, Gonzalez, Wimmer, & Christakis, 2008 ; Lerman & Ghosh, 2010 ), diurnal activity patterns (Krishnamurthy, Gill, & Arlitt, 2008 ), reputation (Standifi rd, 2001 ), or Facebook ‘likes’ (Kosinski,…”
BackgroundLanguage use of depressed and depression-vulnerable college students
Rude, S., Gortner, E.-M., & Pennebaker, J. (2004) · Cognition & Emotion · doi:10.1080/02699930441000030 · Cited by 1,018
Information contagion: an empirical study of the spread of news on digg and twitter social networks
Lerman, K., & Ghosh, R. (2010) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v4i1.14021 · Cited by 813
Linguistic Markers of Psychological Change Surrounding September 11, 2001
Cohn, M. A., Mehl, M. R., & Pennebaker, J. W. (2004) · Psychological Science · doi:10.1111/j.0956-7976.2004.00741.x · Cited by 808
Gender differences in language use: An analysis of 14,000 text samples
Newman, M. L., Groom, C. J., Handelman, L. D., & Pennebaker, J. W. (2008) · Discourse Processes · doi:10.1080/01638530802073712 · Cited by 788 · cited 1×
“One way to assess the automated text analysis in psychology [ 5 ] For example, in Newman et al. ( 2008 ), 70% of the eff ect sizes which are signifi cant at p < .001 will be considered small in terms of Cohen’s classifi cation. degree to which values and attitudes have changed over time is to create…”
MethodPennebaker, J. W. (2011) · New Scientist · doi:10.1016/s0262-4079(11)62167-2 · Cited by 780
Mehl, M. R., Gosling, S. D., & Pennebaker, J. W. (2006) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.90.5.862 · Cited by 764 · cited 1×
“Other language features have also been linked to psychological variables: extroverted authors, for example, tend to write longer texts but prefer shorter words and less complex language (Pennebaker & King, 1999 ; Mehl, Gosling, & Pennebaker, 2006 ).”
BackgroundKrishnamurthy, B., Gill, P., & Arlitt, M. (2008) · Proceedings of the first workshop on Online social networks · doi:10.1145/1397735.1397741 · Cited by 697 · cited 1×
“…analysis-friendly form, such as social network information (Lewis, Kaufman, Gonzalez, Wimmer, & Christakis, 2008 ; Lerman & Ghosh, 2010 ), diurnal activity patterns (Krishnamurthy, Gill, & Arlitt, 2008 ), reputation (Standifi rd, 2001 ), or Facebook ‘likes’ (Kosinski, Stillwell, & Graepel, 2013 ).”
Linguistic Features of Writing Quality
McNamara, D. S., Crossley, S. A., & McCarthy, P. M. (2010) · Written Communication · doi:10.1177/0741088309351547 · Cited by 570
Word Use in the Poetry of Suicidal and Nonsuicidal Poets
Wiltsey Stirman, S., & Pennebaker, J. W. (2001) · Psychosomatic Medicine · doi:10.1097/00006842-200107000-00001 · Cited by 547
Computational methods in authorship attribution
Koppel, M., Schler, J., & Argamon, S. (2009) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20961 · Cited by 528
The Secret Life of Pronouns: Flexibility in Writing Style and Physical Health
Campbell, R. S., & Pennebaker, J. W. (2003) · Psychological Science · doi:10.1111/1467-9280.01419 · Cited by 430
Ensuring the data-rich future of the social sciences
King, G. (2011) · Science · doi:10.1126/science.1197872 · Cited by 394
The Changing Psychology of Culture From 1800 Through 2000
Greenfield, P. M. (2013) · Psychological Science · doi:10.1177/0956797613479387 · Cited by 391
Cited by
Third wave positive psychology: broadening towards complexity
Lomas, T., Waters, L., Williams, P., Oades, L. G., & Kern, M. L. (2021) · The Journal of Positive Psychology · doi:10.1080/17439760.2020.1805501 · Cited by 380
Gaining insights from social media language: Methodologies and challenges.
Kern, M. L., Park, G., Eichstaedt, J. C., Schwartz, H. A., Sap, M., Smith, L. K., & Ungar, L. H. (2016) · Psychological Methods · doi:10.1037/met0000091 · Cited by 221
Moral foundations twitter corpus: a collection of 35k tweets annotated for moral sentiment
Hoover, J., Portillo-Wightman, G., Yeh, L., Havaldar, S., Davani, A. M., Lin, Y., Kennedy, B., Atari, M., Kamel, Z., Mendlen, M., et al. (2020) · Social Psychological and Personality Science · doi:10.1177/1948550619876629 · Cited by 177
Self-citationLiu, X. (2020) · Industrial Marketing Management · doi:10.1016/j.indmarman.2019.02.021 · Cited by 140
Metadata
- Authors
- ILIEV, R., DEHGHANI, M., & SAGI, E.
- Venue
- Language and Cognition
- Publisher
- Cambridge University Press (CUP)
- Published
- 2014-07-31
- Volume
- 7
- Issue
- 2
- Pages
- 265-290
- ISSN
- 1866-9808 (ISSN-L)
- 1866-9859
- OpenAlex
- W2319191615
- Cited by
- 119
- References
- 25
- FWCI
- 27.87
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.