Cited by 317Mental Health via WritingComputational and Text Analysis MethodsAuthorship Attribution and Profiling

The DOI matches its Crossref record; 83 of the 83 references it cites were found in a registry or an index.

Natural Language Analysis and the Psychology of Verbal Behavior: The Past, Present, and Future States of the Field

Open access

Boyd, Ryan L., Schwartz, H. Andrew·2021·Journal of Language and Social Psychology

DOI 10.1177/0261927x20967028PMC PMC8373026

Open this paper in CoChat — free account Open PDF

Abstract

Throughout history, scholars and laypeople alike have believed that our words contain subtle clues about what we are like as people, psychologically speaking. However, the ways in which language has been used to infer psychological processes has seen dramatic shifts over time and, with modern computational technologies and digital data sources, we are on the verge of a massive revolution in language analysis research. In this article, we discuss the past and current states of research at the intersection of language analysis and psychology, summarizing the central successes and shortcomings of psychological text analysis to date. We additionally outline and discuss a critical need for language analysis practitioners in the social sciences to expand their view of verbal behavior. Lastly, we discuss the trajectory of interdisciplinary research on language and the challenges of integrating analysis methods across paradigms, recommending promising future directions for the field along the way.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1177/0261927x20967028

Cites

83 of 83 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Philosophical Investigations.
Ambrose, A., Wittgenstein, L., & Anscombe, G. E. M. (1954) · Philosophy and Phenomenological Research · doi:10.2307/2103745 · Cited by 12,289
XLNet: Generalized Autoregressive Pretraining for Language Understanding
Yang, Z., Dai, Z., Yang, Y., Carbonell, J., Salakhutdinov, R., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1906.08237 · Cited by 6,687
The Psychological Meaning of Words: LIWC and Computerized Text Analysis Methods
Tausczik, Y. R., & Pennebaker, J. W. (2010) · Journal of Language and Social Psychology · doi:10.1177/0261927x09351676 · Cited by 5,774
Text as Data: The Promise and Pitfalls of Automatic Content Analysis Methods for Political Texts
Grimmer, J., & Stewart, B. M. (2013) · Political Analysis · doi:10.1093/pan/mps028 · Cited by 3,297 · cited 2×
“For example, political science papers describing computational text analysis (Grimmer & Stewart, 2013); psychology papers describing machine learning (Stachl et al., 2020), and machine learning papers describing social sciences (O’Connor et al., 2011).”
Background
Quantitative Analysis of Culture Using Millions of Digitized Books
Michel, J.-B., Shen, Y. K., Aiden, A. P., Veres, A., Gray, M. K., The Google Books Team, Pickett, J. P., Hoiberg, D., Clancy, D., Norvig, P., et al. (2010) · Science · doi:10.1126/science.1199644 · Cited by 3,235
Beyond valence: Toward a model of emotion-specific influences on judgement and choice
Lerner, J. S., & Keltner, D. (2000) · Cognition & Emotion · doi:10.1080/026999300402763 · Cited by 3,171
Semantics derived automatically from language corpora contain human-like biases
Caliskan, A., Bryson, J. J., & Narayanan, A. (2017) · Science · doi:10.1126/science.aal4230 · Cited by 2,887
Personality, Gender, and Age in the Language of Social Media: The Open-Vocabulary Approach
Schwartz, H. A., Eichstaedt, J. C., Kern, M. L., Dziurzynski, L., Ramones, S. M., Agrawal, M., Shah, A., Kosinski, M., Stillwell, D., Seligman, M. E. P., et al. (2013) · PLoS ONE · doi:10.1371/journal.pone.0073791 · Cited by 1,700
Self-citation

Show all 83 references

Research works printed but not linked: 6

10.1609/icwsm.v8i1.14547 · DOI
Clarke A. C., Kubrick S. (1968). 2001: A space odyssey. The New American Library.
Freud S. (1915). The unconscious. Penguin Classics.
O’Connor B., Bamman D., Smith N. A. (2011). Computational text analysis for social science: Model assumptions and complexity. In Mason W., Vaughan J. W., Wallach H. (Eds.), Second Workshop on Computational Social Science and Wisdom of the Crowds (pp. 1–7). Curran Associates.
Pennebaker J. W., Francis M. E. (1999). Linguistic Inquiry and Word Count (LIWC): A computer-based text analysis program. Lawrence Erlbaum.
Prasad R. Dinesh N. Lee A. Miltsakaki E. Robaldo L. Joshi A. Webber B. (2008 May). The Penn Discourse TreeBank 2.0. In Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC’08). LREC 2008 Marrakech Morocco. http://www.lrec-conf.org/proceedings/lrec2008/pdf/754_paper.pdf

Sorted by citations

Items 101–200 of 317

Perils and Opportunities in Using Large Language Models in Psychological ResearchPreprint
Abdurahman, S., Atari, M., Karimi-Malekabadi, F., Xue, M. J., Trager, J. P., Park, P. S., Golazizian, P., Omrani, A., & Dehghani, M. (2023) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/tg79n · Cited by 10
Learning Foreign Language Towards Its Media and Identity To Motivate Student’s Personal Growth
Rahmat, W., Fitriyah, R., Zulfa, Z., Riza, A., Afrinda, P. D., Fitri, R., Pebriani, Y., & Endila, W. (2023) · Studies in Media and Communication · doi:10.11114/smc.v11i7.6440 · Cited by 8
A Failed Cross-Validation Study on the Relationship between LIWC Linguistic Indicators and Personality: Exemplifying the Lack of Generalizability of Exploratory Studies
Martínez‐Huertas, J. Á., Moreno, J. D., Olmos, R., Martínez-Mingo, A., & Jorge‐Botana, G. (2022) · Psych · doi:10.3390/psych4040059 · Cited by 9
Feelings in words: Emotion word use and cardiovascular reactivity in marital interactions.
Meier, T., Stephens, J. E., & Haase, C. M. (2023) · Emotion · doi:10.1037/emo0001299 · Cited by 10
How Experts React: The World Health Organization’s Appraisal of COVID-19 via Communication Patterns
Markowitz, D. M. (2021) · Journal of Language and Social Psychology · doi:10.1177/0261927x211026346 · Cited by 8
Latent mechanisms of language disorganization relate to specific dimensions of psychopathology
Fradkin, I., Adams, R. A., Siegelman, N., Moran, R., & Dolan, R. (2024) · Nature Mental Health · doi:10.1038/s44220-024-00351-w · Cited by 10
Global Staycation Trends: A Comparative Analysis of Consumer Interest Across Time and Regions
Mulvey, M. S., Elliot, S., & Lever, M. W. (2024) · Tourism Analysis · doi:10.3727/108354224x17275202230523 · Cited by 7
Language measures correlate with other measures used to study emotion
Munin, S., Ong, D. C., Okland, S., Freedman, G., & Beer, J. S. (2025) · Communications Psychology · doi:10.1038/s44271-025-00212-x · Cited by 7
Leveraging artificial intelligence for resident recruitment: can the dream of holistic review be realized?
John, A. S., & Kavic, S. M. (2022) · Artificial Intelligence Surgery · doi:10.20517/ais.2022.24 · Cited by 7
Towards automatic conceptual metaphor detection for psychological tasks
Panicheva, P., Mamaev, I. D., & Litvinova, T. (2022) · Information Processing & Management · doi:10.1016/j.ipm.2022.103191 · Cited by 9
Consumer insights from text analysis
Packard, G. M., Moore, S. G., & Berger, J. A. (2023) · Journal of Consumer Psychology · doi:10.1002/jcpy.1383 · Cited by 7
Uncovering the Secret Life of We-Pronouns in the German Parliament
Bachmann, R., & Gleibs, I. H. (2024) · Zeitschrift für Psychologie · doi:10.1027/2151-2604/a000564 · Cited by 7
Computational Personality Assessment - An Overview and PerspectivePreprint
Stachl, C., Boyd, R. L., Horstmann, K. T., Khambatta, P., Matz, S., & Harari, G. M. (2021) · doi:10.31234/osf.io/ck2bj · Cited by 7
Self-citation
Overuse of Moral Language Dampens Content Engagement on Social MediaPreprint
Candia, C., Atari, M., Kteily, N., & Uzzi, B. (2022) · doi:10.31235/osf.io/bzs5e · Cited by 7
Climate action on Twitter: perceived barriers for actions and actors, and sentiments during COP26
Wang, X., Judge, M., & Steg, L. (2024) · Environmental Research Communications · doi:10.1088/2515-7620/ad7fbc · Cited by 7
Are we listening to every word? Using multiple analytic methods to examine qualitative data
Boyd, R. L., Morrison, N. R., Horwitz, S. D., Maciag, R., Travers‐Hill, E., & Kim, Y.-S. (2024) · Cogent Mental Health · doi:10.1080/28324765.2024.2433791 · Cited by 6
Self-citation
Using natural language processing to track negative emotions in the daily lives of adolescents.
Fisher, H., Jaffe, N., Pidvirny, K., Tierney, A. O., Pizzagalli, D. A., & Webb, C. A. (2026) · Journal of Psychopathology and Clinical Science · doi:10.1037/abn0001150 · Cited by 7
Deconstructing Depression Stigma: Integrating AI-driven Data Collection and Analysis with Causal Knowledge Graphs
Meng, H., Zhang, R., Wang, G., Yang, Y., Qin, P., Lee, J., & Lee, Y. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714255 · Cited by 10
The Mental Health of Australian, Chinese and Vietnamese University Students: A Cross‐Cultural Comparison of the DASS‐21
Le, D. T., Chan, R. C. K., Hao, J., & Wilkinson, R. B. (2025) · International Journal of Psychology · doi:10.1002/ijop.70057 · Cited by 6
Natural Language Response Formats for Assessing Depression and Worry With Large Language Models: A Sequential Evaluation With Model Pre-Registration
Gu, Z., Kjell, K., Schwartz, H. A., & Kjell, O. (2025) · Assessment · doi:10.1177/10731911251364022 · Cited by 10
Self-citation
PsychAdapter: adapting LLMs to reflect traits, personality, and mental health
Vu, H., Nguyen, H. A., Ganesan, A. V., Juhng, S., Kjell, O., Sedoc, J., Kern, M. L., Boyd, R. L., Ungar, L., Schwartz, H. A., et al. (2026) · npj Artificial Intelligence · doi:10.1038/s44387-026-00071-9 · Cited by 22
Self-citation
Comparing the language style of heads of state in the US, UK, Germany and Switzerland during COVID-19
Dworakowski, O., Meier, T., Mehl, M. R., Pennebaker, J. W., Boyd, R. L., & Horn, A. B. (2024) · Scientific Reports · doi:10.1038/s41598-024-51362-7 · Cited by 6
Self-citation
Emotional tone in clinical high risk for psychosis: novel insights from a natural language analysis approach
Olson, G. M., Damme, K. S. F., Cowan, H. R., Alliende, L. M., & Mittal, V. A. (2024) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2024.1389597 · Cited by 7
Peering into the team role kaleidoscope: the interplay of personal characteristics and verbal interactions in collaborative problem solving
Buseyne, S., Vrijdags, A., Said‐Metwaly, S., Danquigny, T., Heutte, J., Depaepe, F., & Raes, A. (2024) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1345892 · Cited by 6
Affective, cognitive, and contextual cues in Reddit posts on artificial intelligence
Savela, N., Pellert, M., Latikka, R., Bergdahl, J., García, D., & Oksanen, A. (2024) · Journal of Computational Social Science · doi:10.1007/s42001-024-00335-x · Cited by 3
A golden age of behavioural social psychology? Towards a social psychology of power and intergroup relations in the digital age
Levine, M. (2025) · British Journal of Social Psychology · doi:10.1111/bjso.12896 · Cited by 5
Influence of Internet of things on human psychology (internet of thoughts) for education, healthcare, and businesses
Mah, P. M., Skalna, I., Munyeshuri, E., & John, A. (2022) · ICST Transactions on Mobile Communications and Applications · doi:10.4108/eetmca.v7i2.2627 · Cited by 6
Mental health effects of COVID-19 lockdowns: A Twitter-based analysis
Colella, S., Dufourt, F., Hildebrand, V. A., & Vivès, R. (2023) · Economics & Human Biology · doi:10.1016/j.ehb.2023.101307 · Cited by 7
Sound healing reduces generalized anxiety during the pandemic: A feasibility study
Jain, S., McKusick, E., Ciccone, L., Sprengel, M. L., & Ritenbaugh, C. (2023) · Complementary Therapies in Medicine · doi:10.1016/j.ctim.2023.102947 · Cited by 6
Words to Submit by: Language Patterns Indicate Conference Acceptance for the International Communication Association
Markowitz, D. M. (2021) · Journal of Language and Social Psychology · doi:10.1177/0261927x20988765 · Cited by 6
Linguistic Markers of Inherently False AI Communication and Intentionally False Human Communication: Evidence from Hotel ReviewsPreprint
Markowitz, D. M., Hancock, J. T., & Bailenson, J. N. (2023) · doi:10.31234/osf.io/mnyz8 · Cited by 6
What are we telling our students about AI? An exploratory analysis of university instructors’ generative AI syllabi policies
Tong, S. T., DeTone, A., Frederick, A., & Odebiyi, S. (2025) · Communication Education · doi:10.1080/03634523.2025.2477479 · Cited by 4
Healthcare providers’ psychological investment in clinical recommendations: Investigating the role of implicit racial attitudes
Duffy, C. M. C., Bú, E. A. D., Pereira, C. R., Madeira, F., & Hagiwara, N. (2024) · Social Science & Medicine · doi:10.1016/j.socscimed.2024.117435 · Cited by 5
Moral Outrage Predicts the Virality of Petitions for Change on Social Media, But Not the Number of Signatures They Receive
Leach, S., Formanowicz, M., Nikadon, J., & Cichocka, A. K. (2025) · Social Psychological and Personality Science · doi:10.1177/19485506251335373 · Cited by 7
COVID-19 lies and truths: Employing the Elaboration Likelihood Model (ELM) and Linguistic Inquiry and Word Count (LIWC) to gain insights into the persuasive techniques evident in disinformation (fake news)
Whitty, M. T., & Ruddy, C. (2025) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2025.100797 · Cited by 6
Science Training for Political Reporters: Understanding Impact with a Mixed Methods Approach
Smith, H. M., Markowitz, D. M., & Gilbert, C. (2022) · Journalism Practice · doi:10.1080/17512786.2022.2065337 · Cited by 5
Investigating the Readability and Linguistic, Psychological, and Emotional Characteristics of Digital Dementia Information Written in the English Language: Multitrait-Multimethod Text Analysis
Engineer, M., Kot, S., & Dixon, E. (2023) · JMIR Formative Research · doi:10.2196/48143 · Cited by 5
Beyond surveys: leveraging automated text analysis of travellers’ online reviews to enhance service quality and willingness to recommend
Robertson, J., Vella, J. M., Duncan, S. Y., Pitt, C., PITT, L. F., & Caruana, A. (2023) · Journal of Strategic Marketing · doi:10.1080/0965254x.2023.2256738 · Cited by 5
Teaching Psychology in Era of Digital Intelligence: The Role of Artificial Intelligence in Knowledge-Oriented and Research-Oriented Education
Yu, F., Zhao, Y., Xu, L., & Peng, K. (2025) · Frontiers of digital education. · doi:10.1007/s44366-025-0043-1 · Cited by 8
Representations in Developing Statistical Thinking in Secondary Education
Selvakumar, P., Sharma, A., Roy, S. S., Mohit, M., & Manjunath, T. C. (2025) · IGI Global eBooks · doi:10.4018/979-8-3693-9934-7.ch005 · Cited by 5
A BERT's Eye View: A Big Data Framework for Assessing Language Convergence and Accommodation
Rosen, Z. P. (2022) · Journal of Language and Social Psychology · doi:10.1177/0261927x221095865 · Cited by 9
Psychological Well-Being in Childhood and Cardiometabolic Risk in Middle Adulthood: Findings From the 1958 British Birth Cohort
Boehm, J. K., Qureshi, F., & Kubzansky, L. D. (2022) · Psychological Science · doi:10.1177/09567976221075608 · Cited by 7
Emotional State of Older Adults During the COVID-19 Pandemic: Insights from the Cognitive and Social Well-Being (CoSoWELL) Corpus
Kyröläinen, A.-J., & Kuperman, V. (2023) · Experimental Aging Research · doi:10.1080/0361073x.2023.2219188 · Cited by 5
The Influence of Linguistic Styles in Property Titles on Room Rates: A Hedonic Pricing Model
Heo, C. Y., & Park, K. (2023) · Cornell Hospitality Quarterly · doi:10.1177/19389655231209910 · Cited by 5
Lessons in Developing a Behavioral Coding Protocol to Analyze In-the-Wild Child–Robot Interaction Events and Experiments
Indurkhya, X., & Venture, G. (2024) · Electronics · doi:10.3390/electronics13071175 · Cited by 5
Can Generative AI Infer Thinking Style from Language? Evaluating the Utility of AI as a Psychological Text Analysis ToolPreprint
Markowitz, D. M. (2023) · doi:10.31234/osf.io/zy8gr · Cited by 5
Multimodal fusion for athlete state prediction leveraging XLNet and deep generative models
Feng, Y., Sun, Y., & Hang, C. (2025) · Alexandria Engineering Journal · doi:10.1016/j.aej.2025.07.021 · Cited by 4
A Hitchhiker’s Guide to Translation – Ideas for Fostering and Disseminating (Clinical) Translational Psychology
Berg, M., Suchotzki, K., Zimmermann, J., Merz, C. J., Szota, K., Brandt, H., Hartwigsen, G., Lincoln, T. M., Mokros, A., Gade, M., et al. (2025) · European Psychologist · doi:10.1027/1016-9040/a000555 · Cited by 4
Ethics Incognito: Detecting Ethically Relevant Courses Across Curricula in Higher Education
Ongis, M., Kidd, D., & Miner, J. (2023) · Journal of Academic Ethics · doi:10.1007/s10805-023-09482-8 · Cited by 4
The topography of thought
Berger, J. A., & Toubia, O. (2024) · PNAS Nexus · doi:10.1093/pnasnexus/pgae163 · Cited by 4
A cyberterrorist behind the keyboard
Etaywe, A., Macfarlane, K., & Alazab, M. (2024) · Journal of Language Aggression and Conflict · doi:10.1075/jlac.00120.eta · Cited by 4
Mapping Linguistic Shifts During Psychological Coping With the COVID-19 Pandemic
Zhu, X. (2022) · Journal of Language and Social Psychology · doi:10.1177/0261927x221116335 · Cited by 4
Deceptive (De)humanization: How Lying About Perceived Outgroups is Revealed in Language
Markowitz, D. M. (2022) · Journal of Language and Social Psychology · doi:10.1177/0261927x221117497 · Cited by 4
Avicii’s S.O.S.: A psychobiographical approach and corpus-based discourse analysis on suicidal ideation
Yeh, A., & Trang, P. T. M. (2022) · Psychology of Language and Communication · doi:10.2478/plc-2022-0010 · Cited by 4
Teen-adult interactions during the co-design of data literacy activities for the public library: insights from a natural language processing analysis of linguistic patterns
Bowler, L., Lopatovska, I., & Rosin, M. S. (2023) · Information and Learning Sciences · doi:10.1108/ils-06-2023-0076 · Cited by 6
What’s in an emotion word? The multiple roles of labeling in emotional functioning and well-being
Hoemann, K. (2024) · The Psychology of learning and motivation/The psychology of learning and motivation · doi:10.1016/bs.plm.2024.03.001 · Cited by 9
The Grievance Dictionary: Understanding threatening language use
van der Vegt, I., Mozes, M., Kleinberg, B., & Gill, P. (2021) · Behavior Research Methods · doi:10.3758/s13428-021-01536-2 · Cited by 42
From Text to Thought: How Analyzing Language Can Advance Psychological SciencePreprint
Jackson, J. C., Watts, J., List, J., Puryear, C., Drabble, R., & Lindquist, K. A. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/qat4r · Cited by 4
Age and gender differences in loneliness during the COVID-19: Analyses on large cross-sectional surveys and emotion diariesPreprint
Jung, Y., Lee, Y. K., & Hahn, S. (2022) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/2bdek · Cited by 5
Understanding Collaborative Learning Processes and Outcomes Through Student Discourse Dynamics
Park, S., Nixon, N., D’Mello, S. K., Shariff, D., & Choi, J. (2025) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/3706468.3706547 · Cited by 3
Building a holistic nature play curriculum for kindergartens: insights from educational ecology
Xu, Y., Rahman, M. N. A., & Ansyah, E. H. (2025) · Journal of Outdoor and Environmental Education · doi:10.1007/s42322-024-00190-4 · Cited by 3
Exploring the Human-LLM Synergy in Advancing Theory-driven Qualitative Analysis
Meng, H., Yang, Y., Fu, W., Lee, J., Li, Y., & Lee, Y. (2025) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3778354 · Cited by 33
Can leaders motivate employees’ energy-efficient behavior with thoughtful communication?
Hoffmann, C., & Thommes, K. (2024) · Journal of Environmental Economics and Management · doi:10.1016/j.jeem.2024.102990 · Cited by 3
Social Structural Differences in Qualitative Perspectives on Well-Being
Boylan, J. M., Adams, M., & Boehm, J. K. (2024) · Applied Research in Quality of Life · doi:10.1007/s11482-024-10344-7 · Cited by 3
Predicting neuroticism with open-ended response using natural language processing
Yoon, S., Jang, J., Son, G., Park, S., Hwang, J., Choeh, J. Y., & Choi, K. (2024) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2024.1437569 · Cited by 3
Behavioral Observation and Coding
Thorson, K. R., & West, T. V. (2024) · Cambridge University Press eBooks · doi:10.1017/9781009170123.017 · Cited by 4
The narratives of war (NoW) corpus of written testimonies of the Russia-Ukraine war
Засєкін, С. В., Zasiekina, L., Altman, E., Hryntus, M., & Kuperman, V. (2025) · Language Resources and Evaluation · doi:10.1007/s10579-025-09813-8 · Cited by 8
Automating the Detection of Linguistic Intergroup Bias Through Computerized Language Analysis
Collins, K. A., & Boyd, R. L. (2025) · Journal of Language and Social Psychology · doi:10.1177/0261927x251318887 · Cited by 3
Self-citation
The More Similar, the Better? Associations Between Latent Semantic Similarity and Emotional Experiences Differ Across Conversation Contexts
Yu, C.-W. F., Chuang, Y., Lotsos, A. N., Meier, T., & Haase, C. M. (2025) · Journal of Language and Social Psychology · doi:10.1177/0261927x251343096 · Cited by 4
An exploration of basic human values in 38 million obituaries over 30 years
Markowitz, D. M., Mazzuchi, T., Syropoulos, S., Law, K. F., & Young, L. (2025) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2510318122 · Cited by 3
Words for Sale: Linguistic Complexity Associates with Higher Housing Prices in Online Realty Advertisements
Markowitz, D. M. (2023) · Journal of Language and Social Psychology · doi:10.1177/0261927x231154911 · Cited by 3
Increase in Linguistic Complexity in Older Adults During COVID-19
Karabin, M., Kyröläinen, A.-J., & Kuperman, V. (2023) · Experimental Aging Research · doi:10.1080/0361073x.2022.2163831 · Cited by 3
Emotional brand communication on social media to foster financial well-being
Plessis, C. D. (2023) · Online Journal of Communication and Media Technologies · doi:10.30935/ojcmt/13452 · Cited by 5
Sadness and Anxiety Language in Reddit Messages Before and After Quitting a Job
Ireland, M. E., Iserman, M., & Adams, K. (2023) · Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis (WASSA) · doi:10.18653/v1/2023.wassa-1.41 · Cited by 3
“All the Makings of an Eventual NFL Starter:” Racial/Ethnic Disparities in a Decade of National Football League Draft Profiles as Revealed by Natural Language Processing
Markowitz, D. M. (2023) · Communication & Sport · doi:10.1177/21674795231205751 · Cited by 3
Trauma Isn’t One Size Fits All: How Online Support Communities Point to Different Diagnostic Criteria for C-PTSD and PTSD
Wang, W., Blackburn, K. G., Thompson, R. M., Bajaj, K., Pedler, R., & Fucci, K. (2024) · Health Communication · doi:10.1080/10410236.2024.2314343 · Cited by 3
The (Linguistic) Profile of the Impostor Phenomenon
Brandt, P., Ibrahim, F., & Herzberg, P. Y. (2024) · Zeitschrift für Psychologie · doi:10.1027/2151-2604/a000562 · Cited by 4
Breaking down the laughter: an exploration into the linguistic dimensions in stand-up comedy ratings
Cela, H., Veit, S., & Wood, G. M. D. O. (2024) · BMC Psychology · doi:10.1186/s40359-024-02187-6 · Cited by 3
Teacher Talk: Assessing the Promise of Teacher Emotional Tone as a Classroom Measure
Santiago‐Rosario, M. R., Yadav, A., & McIntosh, K. (2025) · Journal of Positive Behavior Interventions · doi:10.1177/10983007251335637 · Cited by 3
Excursions in Rorschachlandia: Surveying the scientific and philosophical landscape of Hermann Rorschach's Psychodiagnostics
Acklin, M. W. (2022) · Journal of the History of the Behavioral Sciences · doi:10.1002/jhbs.22235 · Cited by 3
Tracing the Adoption and Effects of Open Science in Communication ResearchPreprint
Markowitz, D. M., Taylor, S. H., & Song, H. (2020) · doi:10.17605/osf.io/58jyf · Cited by 3
Toward a Deeper Understanding of Prolific Lying: Building a Profile of Situation-Level and Individual-Level CharacteristicsPreprint
Markowitz, D. M. (2021) · doi:10.31234/osf.io/p3y4x · Cited by 3
Linguistic Markers of Self-Disclosure: Using YouTube Coming Out Videos to Study Disclosure LanguagePreprint
Doyle, P. C., & Campbell, W. K. (2020) · doi:10.31234/osf.io/tvgs9 · Cited by 3
BERTAgent: The Development of a Novel Tool to Quantify Agency in Textual DataPreprint
Nikadon, J., Suitner, C., Erseghe, T., Džanko, L., & Formanowicz, M. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/qw6u3 · Cited by 3
The Rise and Fall Of Popular Entrepreneurship? How Media Construct Popular EntrepreneurshipPreprint
Schmid, S., & Welter, F. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4749779 · Cited by 3
Opportunities and Challenges to Conversations with Generative AI: Integrating Theoretical Perspectives from Clark and Pennebaker
Markowitz, D. M. (2024) · Asian Communication Research · doi:10.20879/acr.2024.21.025 · Cited by 2
Elucidating the emotional persona in the Romanian university students’ academic discourse: a corpus-based exploration
Dudău, D. P., Chitez, M., & Sava, F. A. (2025) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1514795 · Cited by 3
Cultural fit in emotion versus language: a study of Dutch-speaking Belgians and Turkish migrants in Belgium
Şencan, R. S., Mesquita, B., & Hoemann, K. (2025) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1488779 · Cited by 2
Retracted: Application of Transformer-Based Language Models in Neuro-Linguistic Programming for Automated Personality Insights from Large-Scale Textual Corpora
Orosoo, M., Veigas, A. D., Gupta, D., Punithaasree, K. S., Rengarajan, M., & Prema, S. (2024) · International Conference on Communication, Control and Intelligent Systems (CCIS) · doi:10.1109/ccis63231.2024.10931998 · Cited by 2
Retracted
Text speaks louder: Insights into personality from natural language processing
Saeteros, D., Gallardo‐Pujol, D., & Ortiz-Martínez, D. (2025) · PLoS ONE · doi:10.1371/journal.pone.0323096 · Cited by 4
A discourse on the use of machine learning (ML) in personality psychology: Can we expect ML to predict questionnaire scores from idiographic text-based data?
Schreiber, M., Jenny, G. J., Hürlimann, M., Parfenova, Y., von Däniken, P., & Cieliebak, M. (2025) · Journal of Research in Personality · doi:10.1016/j.jrp.2025.104666 · Cited by 4
Context in Natural Language Processing Research: Advancing an Understanding of Affordances and Constraints on Verbal Behavior
Markowitz, D. M. (2025) · Journal of Language and Social Psychology · doi:10.1177/0261927x251377802 · Cited by 2
Necro‑Branding and Psychographic Segmentation of Necro‑Celebrities vis‑à‑vis Alive‑Celebrities: a methodological 3‑step text‑analysis of Elvis Presley, the Royal Family, Picasso & Co.
Mu, S. R., & Baumann, C. (2026) · Journal of Strategic Marketing · doi:10.1080/0965254x.2026.2638454 · Cited by 2
When I am sixty-four… evaluating language markers of well-being in healthy aging narratives
Meier, T., Mehl, M. R., Martin, M., & Horn, A. B. (2024) · PLoS ONE · doi:10.1371/journal.pone.0302103 · Cited by 3
Does Twitter Data Mirror the European North–South Family Ties Divide? A Comparative Analysis of Tweets About Family
Gil‐Clavel, S., & Mulder, C. H. (2024) · Population Research and Policy Review · doi:10.1007/s11113-024-09891-6 · Cited by 2
Target pressure and corporate scandals: a natural language processing investigation of how organizational culture underlies institutional failures
Reader, T. W., & Gillespie, A. (2024) · European Journal of Work and Organizational Psychology · doi:10.1080/1359432x.2024.2398181 · Cited by 2
Digital technologies in linguistic education: Experience of development and implementation
Riezina, O. V., & Yarova, L. (2024) · Turkish Journal of Education · doi:10.19128/turje.1444808 · Cited by 4
Cognitive-Affective Styles of Biden and Trump Supporters: An Automated Text Analysis Study
Abe, J. A. A. (2022) · Social Psychological and Personality Science · doi:10.1177/19485506221082737 · Cited by 2
The Gorgon psycholinguistic archetype: LIWC-22 analysis
Бережна, М. В. (2022) · CURRENT TRENDS AND FIELDS OF PHILOLOGICAL STUDIES IN THE CHALLENGING REALITY · doi:10.30525/978-9934-26-227-2-33 · Cited by 2
Personality Disorder and Verbal BehaviorPreprint
Entwistle, C., Marceau, E. M., & Boyd, R. L. (2021) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/3gdpx · Cited by 2
Self-citation

Authors: Boyd, R. L., & Schwartz, H. A.
Affiliations: Lancaster University (GB)
Stony Brook University (US)
Corresponding author: Boyd, Ryan L.
ORCID: Boyd, Ryan L.
Schwartz, H. Andrew
Venue: Journal of Language and Social Psychology
Publisher: SAGE Publications
Published: 2020-10-28
Volume: 40
Issue: 1
Pages: 21-41
ISSN: 0261-927X (ISSN-L)
1552-6526
DOI: 10.1177/0261927x20967028
PMC: PMC8373026
OpenAlex: W3094938719
Cited by: 317
References: 83
Citations by year: 2026: 47 · 2025: 52 · 2024: 82 · 2023: 60 · 2022: 43 · 2021: 29 · 2020: 4
FWCI: 37.15
Type: journal article
Language: en
Open access: hybrid
doi.org
Licence: cc-by
creativecommons.org/licenses/by/4.0/ (unspecified)
journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Locations: Journal of Language and Social Psychology (publishedVersion, cc-by)
PubMed (publishedVersion)
PubMed Central (acceptedVersion)
Lancaster EPrints (Lancaster University) (submittedVersion)
Funders: Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung (196255)
National Institute on Alcohol Abuse and Alcoholism (R01AA028032)
Topics: Social Sciences › Psychology › Social Psychology › Mental Health via Writing
Social Sciences › General Social Sciences › Computational and Text Analysis Methods
Physical Sciences › Computer Science › Artificial Intelligence › Authorship Attribution and Profiling
Keywords: natural language analysis, verbal behavior, language and personality, computational text analysis, digital data sources, interdisciplinary research, methodological integration

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Natural Language Analysis and the Psychology of Verbal Behavior: The Past, Present, and Future States of the Field

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Self-check

Citations

Cites

Cited by

Related

Metadata

Record

About these checks