The DOI matches its Crossref record; 83 of the 83 references it cites were found in a registry or an index.
Natural Language Analysis and the Psychology of Verbal Behavior: The Past, Present, and Future States of the Field
Open accessAbstract
Throughout history, scholars and laypeople alike have believed that our words contain subtle clues about what we are like as people, psychologically speaking. However, the ways in which language has been used to infer psychological processes has seen dramatic shifts over time and, with modern computational technologies and digital data sources, we are on the verge of a massive revolution in language analysis research. In this article, we discuss the past and current states of research at the intersection of language analysis and psychology, summarizing the central successes and shortcomings of psychological text analysis to date. We additionally outline and discuss a critical need for language analysis practitioners in the social sciences to expand their view of verbal behavior. Lastly, we discuss the trajectory of interdisciplinary research on language and the challenges of integrating analysis methods across paradigms, recommending promising future directions for the field along the way.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, such a dictionary-based approach oversimplifies older people's interactions with SVA to a one-way initiative by the user and fails to capture the communicative nature of such interactions—the transmission and coordination of complex information with others (7).”
From Understanding older people's voice interactions with smart voice assistants: a new modified rule-based natural language processing model with human input (2024) · cites this paper as [7]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Ambrose, A., Wittgenstein, L., & Anscombe, G. E. M. (1954) · Philosophy and Phenomenological Research · doi:10.2307/2103745 · Cited by 12,289
XLNet: Generalized Autoregressive Pretraining for Language Understanding
Yang, Z., Dai, Z., Yang, Y., Carbonell, J., Salakhutdinov, R., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1906.08237 · Cited by 6,687
The Psychological Meaning of Words: LIWC and Computerized Text Analysis Methods
Tausczik, Y. R., & Pennebaker, J. W. (2010) · Journal of Language and Social Psychology · doi:10.1177/0261927x09351676 · Cited by 5,774
Text as Data: The Promise and Pitfalls of Automatic Content Analysis Methods for Political Texts
Grimmer, J., & Stewart, B. M. (2013) · Political Analysis · doi:10.1093/pan/mps028 · Cited by 3,297 · cited 2×
“For example, political science papers describing computational text analysis (Grimmer & Stewart, 2013); psychology papers describing machine learning (Stachl et al., 2020), and machine learning papers describing social sciences (O’Connor et al., 2011).”
BackgroundQuantitative Analysis of Culture Using Millions of Digitized Books
Michel, J.-B., Shen, Y. K., Aiden, A. P., Veres, A., Gray, M. K., The Google Books Team, Pickett, J. P., Hoiberg, D., Clancy, D., Norvig, P., et al. (2010) · Science · doi:10.1126/science.1199644 · Cited by 3,235
Beyond valence: Toward a model of emotion-specific influences on judgement and choice
Lerner, J. S., & Keltner, D. (2000) · Cognition & Emotion · doi:10.1080/026999300402763 · Cited by 3,171
Semantics derived automatically from language corpora contain human-like biases
Caliskan, A., Bryson, J. J., & Narayanan, A. (2017) · Science · doi:10.1126/science.aal4230 · Cited by 2,887
Personality, Gender, and Age in the Language of Social Media: The Open-Vocabulary Approach
Schwartz, H. A., Eichstaedt, J. C., Kern, M. L., Dziurzynski, L., Ramones, S. M., Agrawal, M., Shah, A., Kosinski, M., Stillwell, D., Seligman, M. E. P., et al. (2013) · PLoS ONE · doi:10.1371/journal.pone.0073791 · Cited by 1,700
Self-citation
Research works printed but not linked: 6
- 10.1609/icwsm.v8i1.14547 · DOI
- Clarke A. C., Kubrick S. (1968). 2001: A space odyssey. The New American Library.
- Freud S. (1915). The unconscious. Penguin Classics.
- O’Connor B., Bamman D., Smith N. A. (2011). Computational text analysis for social science: Model assumptions and complexity. In Mason W., Vaughan J. W., Wallach H. (Eds.), Second Workshop on Computational Social Science and Wisdom of the Crowds (pp. 1–7). Curran Associates.
- Pennebaker J. W., Francis M. E. (1999). Linguistic Inquiry and Word Count (LIWC): A computer-based text analysis program. Lawrence Erlbaum.
- Prasad R. Dinesh N. Lee A. Miltsakaki E. Robaldo L. Joshi A. Webber B. (2008 May). The Penn Discourse TreeBank 2.0. In Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC’08). LREC 2008 Marrakech Morocco. http://www.lrec-conf.org/proceedings/lrec2008/pdf/754_paper.pdf
Cited by
Sorted by citations
Using large language models in psychology
Demszky, D., Yang, D., Yeager, D. S., Bryan, C. J., Clapper, M., Chandhok, S., Eichstaedt, J. C., Hecht, C., Jamieson, J., Johnson, M., et al. (2023) · Nature Reviews Psychology · doi:10.1038/s44159-023-00241-5 · Cited by 369
From Text to Thought: How Analyzing Language Can Advance Psychological Science
Jackson, J. C., Watts, J., List, J., Puryear, C., Drabble, R., & Lindquist, K. A. (2021) · Perspectives on Psychological Science · doi:10.1177/17456916211004899 · Cited by 203
Large Language Model–Based Responses to Patients’ In-Basket Messages
Small, W. R., Wiesenfeld, B. M., Brandfield-Harvey, B., Jonassen, Z., Mandal, S., Stevens, E. R., Major, V. J., Lostraglio, E., Szerencsy, A. C., Jones, S., et al. (2024) · JAMA Network Open · doi:10.1001/jamanetworkopen.2024.22399 · Cited by 115
Macanovic, A. (2022) · Social Science Research · doi:10.1016/j.ssresearch.2022.102784 · Cited by 120
Koutsoumpis, A., Oostrom, J. K., Holtrop, D., van Breda, W., Ghassemi, S., & de Vries, R. E. (2022) · Psychological Bulletin · doi:10.1037/bul0000381 · Cited by 102
Metadata
- Authors
- Boyd, R. L., & Schwartz, H. A.
- Affiliations
- Lancaster University (GB)
- Stony Brook University (US)
- Corresponding author
- Boyd, Ryan L.
- Venue
- Journal of Language and Social Psychology
- Publisher
- SAGE Publications
- Published
- 2020-10-28
- Volume
- 40
- Issue
- 1
- Pages
- 21-41
- ISSN
- 0261-927X (ISSN-L)
- 1552-6526
- PMC
- PMC8373026
- OpenAlex
- W3094938719
- Cited by
- 317
- References
- 83
- Citations by year
- 2026: 47 · 2025: 52 · 2024: 82 · 2023: 60 · 2022: 43 · 2021: 29 · 2020: 4
- FWCI
- 37.15
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Journal of Language and Social Psychology (publishedVersion, cc-by)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Lancaster EPrints (Lancaster University) (submittedVersion)
- Funders
- Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung (196255)
- National Institute on Alcohol Abuse and Alcoholism (R01AA028032)
- Topics
- Social Sciences › Psychology › Social Psychology › Mental Health via Writing
- Social Sciences › General Social Sciences › Computational and Text Analysis Methods
- Physical Sciences › Computer Science › Artificial Intelligence › Authorship Attribution and Profiling
- Keywords
- natural language analysis, verbal behavior, language and personality, computational text analysis, digital data sources, interdisciplinary research, methodological integration
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
