An ideological asymmetry in the diffusion of moralized content on social media among political leaders.
Open accessThe DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Abstract
= 286,255) sent from federal politicians (presidential candidates, members of the Senate and House of Representatives) in the year leading up to the 2016 U.S. presidential election-a period in which Democrats and Republicans sought to maximize their influence over potential voters. Across all types of elites, we found a "moral contagion" effect: elites' use of moral-emotional language was robustly associated with increases in message diffusion. We also discovered an ideological asymmetry: conservative elites gained greater diffusion when using moral-emotional language compared to liberal elites, even when accounting for extremity of ideology and other source cues. Specific moral emotion expressions related to moral outrage-namely, moral anger and disgust-were impactful for elites across the political spectrum, whereas moral emotion expression related to religion and patriotism were more impactful for conservative elites. These findings help inform the scientific understanding of political propaganda in the digital age, and the antecedents of political polarization in American politics. (PsycINFO Database Record (c) 2019 APA, all rights reserved).
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“We also used previously validated dictionaries that counted the number of positive and negative affect words per post (51) and the number of moral-emotional words per post (22).”
From Out-group animosity drives engagement on social media (2021) · cites this paper as [22]
In the citing paper
“Tweets expressing moral and emotional content are more likely to be retweeted within online political conversations, especially by members of one’s political in-group (21, 22).”
From Out-group animosity drives engagement on social media (2021) · cites this paper as [22]
In the citing paper
“Following prior work (22), we log-transformed the retweet-count and share outcome variables to account for the fact that these variables are typically skewed.”
From Out-group animosity drives engagement on social media (2021) · cites this paper as [22]
In the citing paper
“These market incentives both reflect and exacerbate ideological and affective forms of polarization, insofar as emotionally charged material, such as that which is contemptuous of ideological adversaries, is more likely to go ‘viral’ than more measured types of political discourse260,263,269,270.”
From Cognitive–motivational mechanisms of political polarization in social-communicative contexts (2022) · cites this paper as [270]
Citations
Cites
Rogers, E. M., Singhal, A., & Quinlan, M. M. (2019) · An Integrated Approach to Communication Theory and Research · doi:10.4324/9780203710753-35 · Cited by 37,322
The spread of true and false news online
Vosoughi, S., Roy, D., & Aral, S. (2018) · Science · doi:10.1126/science.aap9559 · Cited by 8,847
The Elaboration Likelihood Model of Persuasion
Petty, R. E., & Cacioppo, J. T. (1986) · Advances in Experimental Social Psychology · doi:10.1016/s0065-2601(08)60214-2 · Cited by 8,822 · cited 3×
“…important theoretical assumption of social psychology is that characteristics of the communication source (i.e., who is sending the message) often interact with the framing or content of the message (Chaiken, 1980; McGarty, Haslam, Hutchinson, & Turner, 1994; McGuire, 1985; Petty & Cacioppo, 1986).”
BackgroundThe emotional dog and its rational tail: A social intuitionist approach to moral judgment.
Haidt, J. (2001) · Psychological Review · doi:10.1037/0033-295x.108.4.814 · Cited by 8,048 · cited 1×
“This work extends research on the role of emotion in moral and political discourse (Haidt, 2001; Skitka, 2010) and attitude formation and change (Petty & Cacioppo, 1986) to digital platforms and online social networks.”
BackgroundThe Psychological Meaning of Words: LIWC and Computerized Text Analysis Methods
Tausczik, Y. R., & Pennebaker, J. W. (2010) · Journal of Language and Social Psychology · doi:10.1177/0261927x09351676 · Cited by 5,774 · cited 1×
“In order to measure positive and negative valence, we assessed each distinctly emotional and moral-emotional word’s valence assignment based on the previously validated LIWC dictionary (Tausczik & Pennebaker, 2010).”
MethodChaiken, S. (1980) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.39.5.752 · Cited by 5,516 · cited 1×
“…important theoretical assumption of social psychology is that characteristics of the communication source (i.e., who is sending the message) often interact with the framing or content of the message (Chaiken, 1980; McGarty, Haslam, Hutchinson, & Turner, 1994; McGuire, 1985; Petty & Cacioppo, 1986).”
BackgroundPolitical conservatism as motivated social cognition.
Jost, J. T., Glaser, J., Kruglanski, A. W., & Sulloway, F. J. (2003) · Psychological Bulletin · doi:10.1037/0033-2909.129.3.339 · Cited by 4,904
Self-citationFiske, S. T., & Neuberg, S. L. (1990) · Advances in Experimental Social Psychology · doi:10.1016/s0065-2601(08)60317-2 · Cited by 3,323 · cited 2×
“In doing so, we were also able to explore the effects of other automatically perceived social category cues (race and age; Brewer, 1988; Fiske & Neuberg, 1990) that could impact diffusion, including the age and race of Congress members.”
BackgroundWhat Makes Online Content Viral?
Berger, J., & Milkman, K. L. (2012) · Journal of Marketing Research · doi:10.1509/jmr.10.0353 · Cited by 3,178 · cited 2×
“It also suggests that emotional appeals lacking moral content may not always be sufficient to activate political engagement online (cf. Berger & Milkman, 2012).”
BackgroundRussell, J. A., & Barrett, L. F. (1999) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.76.5.805 · Cited by 3,102 · cited 1×
“…to improve upon the shortcomings of lexicon-based approaches (Baharudin, Lee, & Khan, 2010), but the ideal approach is to combine multiple methods of measuring and analyzing emotional expression insofar as emotions are multicomponential phenomena (e.g., valence, arousal; Russell & Barrett, 1999).”
BackgroundPetty, R. E., Wegener, D. T., & Fabrigar, L. R. (1997) · Annual Review of Psychology · doi:10.1146/annurev.psych.48.1.609 · Cited by 2,290 · cited 3×
“, who is sending the message) often interact with the framing or content of the message (Chaiken, 1980; McGarty, Haslam, Hutchinson, & Turner, 1994; McGuire, 1985; Petty & Cacioppo, 1986).”
BackgroundFrom Tweets to Polls: Linking Text Sentiment to Public Opinion Time Series
O'Connor, B., Balasubramanyan, R., Routledge, B., & Smith, N. (2010) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v4i1.14031 · Cited by 1,923
Generalized Estimating Equations
Hardin, J. W., & Hilbe, J. M. (2002) · doi:10.1201/9781420035285 · Cited by 1,766
Social Functions of Emotions at Four Levels of Analysis
Keltner, D., & Haidt, J. (1999) · Cognition and Emotion · doi:10.1080/026999399379168 · Cited by 1,743 · cited 1×
“That specific emotions may be more salient during political discourse is consistent with sociofunctional accounts of emotion that stress the communicative function of emotion in guiding social interactions (Campos, Mumme, Kermoian, & Campos, 1994; Keltner & Haidt, 1999).”
BackgroundEmotion shapes the diffusion of moralized content in social networks
Brady, W. J., Wills, J. A., Jost, J. T., Tucker, J. A., & Van Bavel, J. J. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1618923114 · Cited by 1,580 · cited 6×
“…of three large-scale studies of elite communication that directly investigated these questions about moral contagion among political elites and potential moderators of the effect, which has thus far been explored only in the context of social media usage by ordinary citizens (Brady et al., 2017).”
BackgroundMethodResultInfluentialSelf-citationRozin, P., Lowery, L., Imada, S., & Haidt, J. (1999) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.76.4.574 · Cited by 1,566
A dual process model of impression formation.
Brewer, M. B. (1988) · Cited by 1,499
Tweeting From Left to Right: Is Online Political Communication More Than an Echo Chamber?
Barberá, P., Jost, J. T., Nagler, J., Tucker, J. A., & Bonneau, R. (2015) · Psychological Science · doi:10.1177/0956797615594620 · Cited by 1,472
Self-citationSocial Cognition: Thinking Categorically about Others
Macrae, C. N., & Bodenhausen, G. V. (2000) · Annual Review of Psychology · doi:10.1146/annurev.psych.51.1.93 · Cited by 1,359 · cited 1×
“These findings point to the possible importance of social categorization (and stereotyping) processes when it comes to information diffusion in online social networks (Macrae & Bodenhausen, 2000).”
BackgroundHogg, M. A. (2016) · Peace Psychology Book Series · doi:10.1007/978-3-319-29869-6_1 · Cited by 1,338 · cited 2×
“…be that the ideological asymmetry in moral-emotional contagion is sensitive to which political party has presidential power, such that the party out of presidential power gains more from appeals to moral emotion that can help affirm their constituent’s threatened political identity (Hogg, 2006).”
BackgroundSocial bots distort the 2016 U.S. Presidential election online discussion
Bessi, A., & Ferrara, E. (2016) · First Monday · doi:10.5210/fm.v21i11.7090 · Cited by 993 · cited 2×
“In fact, research suggests that bots mainly tweeted candidate-supporting content during the 2016 election (Bessi & Ferrara, 2016).”
A Spatial Model for Legislative Roll Call Analysis
Poole, K. T., & Rosenthal, H. (1985) · American Journal of Political Science · doi:10.2307/2111172 · Cited by 989 · cited 1×
“To measure the ideological orientation of each elite, we pulled an estimate of their ideology based on voting recordings using the freely available DWNOMINATE database (Poole & Rosenthal, 1985).”
Methodtidytext: Text Mining and Analysis Using Tidy Data Principles in R
Silge, J., & Robinson, D. (2016) · The Journal of Open Source Software · doi:10.21105/joss.00037 · Cited by 941 · cited 1×
“In order to measure specific emotion expressions associated with moralemotional words, we used the R tidytext package (Silge & Robinson, 2016), which allowed us to tokenize each tweet and then classify each token as representing one or many discrete emotions (overlap in classification was allowed;…”
MethodThe Partisan Brain: An Identity-Based Model of Political Belief
Van Bavel, J. J., & Pereira, A. (2018) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2018.01.004 · Cited by 743 · cited 1×
“…2017), the content that appeals to the moral values of political identities and ideologies is especially popular, regardless of message veracity (Van Bavel & Pereira, 2018), and may help explain why fake news spreads farther, faster and deeper than truth (Vosoughi, Roy, & Aral, 2018).”
BackgroundIdeological Asymmetries and the Essence of Political Psychology
Jost, J. T. (2017) · Political Psychology · doi:10.1111/pops.12407 · Cited by 696 · cited 2×
“…research finding that conservatives are more sensitive than liberals to high-arousal emotions such as anger, contempt, anxiety, and threat, and more moralistic when it comes to social issues (Hibbing, Smith, & Alford, 2014; Jost, 2017; Jost, Glaser, Kruglanski, & Sulloway, 2003; Tomkins, 1995).”
BackgroundSelf-citationA Review of Machine Learning Algorithms for Text-Documents Classification
Baharudin, B., Lee, L. H., & Khan, K. (2010) · Journal of Advances in Information Technology · doi:10.4304/jait.1.1.4-20 · Cited by 653
Moral outrage in the digital age
Crockett, M. J. (2017) · Nature Human Behaviour · doi:10.1038/s41562-017-0213-3 · Cited by 618 · cited 1×
“While our research demonstrates that moral and emotional content is associated with viral spreading within political networks, future research should investigate whether the particular design of social media platforms amplifies the attraction to moral and emotional expression (Crockett, 2017).”
BackgroundDifferences in negativity bias underlie variations in political ideology
Hibbing, J. R., Smith, K. B., & Alford, J. R. (2014) · Behavioral and Brain Sciences · doi:10.1017/s0140525x13001192 · Cited by 608
Can an Angry Woman Get Ahead?: Status Conferral, Gender, and Expression of Emotion in the Workplace
Brescoll, V. L., & Uhlmann, E. L. (2008) · Psychological Science · doi:10.1111/j.1467-9280.2008.02079.x · Cited by 571 · cited 1×
“…language when it is wielded by male rather than female politicians insofar as females are often evaluated negatively when they express high-arousal emotions (Brescoll & Uhlmann, 2008; Lewis, 2000)—even when the emotions are gender-normative (Hutson-Comeaux & Kelly, 2002; Thomas, 2016).”
BackgroundValentino, N. A., Hutchings, V. L., Banks, A. J., & Davis, A. K. (2008) · Political Psychology · doi:10.1111/j.1467-9221.2008.00625.x · Cited by 568
How Social Media Facilitates Political Protest: Information, Motivation, and Social Networks
Jost, J. T., Barberá, P., Bonneau, R., Langer, M., Metzger, M., Nagler, J., Sterling, J., & Tucker, J. A. (2018) · Political Psychology · doi:10.1111/pops.12478 · Cited by 492
Self-citationThe Psychology of Moral Conviction
Skitka, L. J., Hanson, B. E., Morgan, G. S., & Wisneski, D. C. (2021) · Annual Review of Psychology · doi:10.1146/annurev-psych-063020-030612 · Cited by 454
NRC-Canada: Building the State-of-the-Art in Sentiment Analysis of Tweets
Mohammad, S. M., Kiritchenko, S., & Zhu, X. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1308.6242 · Cited by 451
Election Forecasts With Twitter: How 140 Characters Reflect the Political Landscape
Tumasjan, A., Sprenger, T. O., Sandner, P. G., & Welpe, I. M. (2011) · Social Science Computer Review · doi:10.1177/0894439310386557 · Cited by 447
A FUNCTIONALIST PERSPECTIVE ON THE NATURE OF EMOTION
Campos, J. J., Mumme, D. L., Kermoian, R., & Campos, R. G. (2008) · Monographs of the Society for Research in Child Development · doi:10.1111/j.1540-5834.1994.tb01289.x · Cited by 447
Contextual sensitivity in scientific reproducibility
Van Bavel, J. J., Mende-Siedlecki, P., Brady, W. J., & Reinero, D. A. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1521897113 · Cited by 398
Self-citationStieglitz, S., & Dang-Xuan, L. (2012) · 2012 45th Hawaii International Conference on System Sciences · doi:10.1109/hicss.2012.476 · Cited by 288 · cited 2×
“Diffusion was indexed as the number of retweets each message received, because retweet counts provide a high-quality measure of information diffusion on Twitter (Barberá et al., 2015; Stieglitz & Dang-Xuan, 2012).”
BackgroundValenzuela, S., Piña, M., & Ramírez, J. (2017) · Journal of Communication · doi:10.1111/jcom.12325 · Cited by 272
Ideological asymmetries in conformity, desire for shared reality, and the spread of misinformation
Jost, J. T., van der Linden, S., Panagopoulos, C., & Hardin, C. D. (2018) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2018.01.003 · Cited by 237
Self-citationMoralization in social networks and the emergence of violence during protests
Mooijman, M., Hoover, J., Lin, Y., Ji, H., & Dehghani, M. (2018) · Nature Human Behaviour · doi:10.1038/s41562-018-0353-0 · Cited by 229
Gaining insights from social media language: Methodologies and challenges.
Kern, M. L., Park, G., Eichstaedt, J. C., Schwartz, H. A., Sap, M., Smith, L. K., & Ungar, L. H. (2016) · Psychological Methods · doi:10.1037/met0000091 · Cited by 221 · cited 1×
“Our research is among the first to measure specific expressions of moral emotion in online networks, although lexicon-based methods for measuring emotion come with some limitations such as insensitivity to word negations (Kern et al., 2016).”
BackgroundThe Effects of Salient Group Memberships on Persuasion
Mcgarty, C., Haslam, S. A., Hutchinson, K. J., & Turner, J. C. (1994) · Small Group Research · doi:10.1177/1046496494252007 · Cited by 187
What Do Retweets Indicate? Results from User Survey and Meta-Review of Research
Metaxas, P., Mustafaraj, E., Wong, K., Zeng, L., O'Keefe, M., & Finn, S. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v9i1.14661 · Cited by 162 · cited 1×
“Users often share messages on social media that represent beliefs, opinions, and values they endorse as well as authors they trust (Metaxas et al., 2015).”
BackgroundHogg, M. A. (2010) · Handbook of Social Psychology · doi:10.1002/9780470561119.socpsy002031 · Cited by 138
Generalized Estimating Equations (GEE)
Hardin, J. W. (2005) · Encyclopedia of Statistics in Behavioral Science · doi:10.1002/0470013192.bsa250 · Cited by 131 · cited 1×
“Our multilevel model accounted for nonindependence of data using Generalized Estimating Equations (GEE) with robust standard error estimation (Hardin, 2005), and an exchangeable correlation structure.”
MethodThe Role of Social Networks in Information Diffusion
Bakshy, E., Rosenn, I., Marlow, C., & Adamic, L. A. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1201.4145 · Cited by 129
The nature of viral altruism and how to make it stick
van der Linden, S. (2017) · Nature Human Behaviour · doi:10.1038/s41562-016-0041 · Cited by 95 · cited 1×
“For instance, social movements that are promoted in terms of moral and emotional content are more likely to be shared virally, presumably because this type of promotion makes people more likely to treat support for the movement as a moral imperative (Van Der Linden, 2017).”
BackgroundConstrained by Emotion: Women, Leadership, and Expressing Emotion in the Workplace
Smith, J. S., Brescoll, V. L., & Thomas, E. L. (2015) · International handbooks of quality-of-life · doi:10.1007/978-94-017-9897-6_13 · Cited by 38
Tomkins, S. S., & Smith, B. (1995) · Cambridge University Press eBooks · doi:10.1017/cbo9780511663994.011 · Cited by 17
(2000) · doi:10.1002/(sici)1099-1379(200003)21:2<221::aid-job36>3.0.co;2-0 · cited 2×
“…language when it is wielded by male rather than female politicians insofar as females are often evaluated negatively when they express high-arousal emotions (Brescoll & Uhlmann, 2008; Lewis, 2000)—even when the emotions are gender-normative (Hutson-Comeaux & Kelly, 2002; Thomas, 2016).”
Background
Cited by
Out-group animosity drives engagement on social media
Rathje, S., Van Bavel, J. J., & van der Linden, S. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2024292118 · Cited by 560
Brady, W. J., Crockett, M. J., & Van Bavel, J. J. (2020) · Perspectives on Psychological Science · doi:10.1177/1745691620917336 · Cited by 417
“…between moral-emotional language and sharing was replicated during the 2016 U.S. election campaigns among political leaders, where retweets of messages from more than 500 presidential candidates and members of the U.S. Congress were analyzed (Brady, Wills, Burkart, Jost, & Van Bavel, 2019).”
BackgroundInfluentialSelf-citationHow social learning amplifies moral outrage expression in online social networks
Brady, W. J., McLoughlin, K., Doan, T. N., & Crockett, M. J. (2021) · Science Advances · doi:10.1126/sciadv.abe5641 · Cited by 375
Self-citationUsing large language models in psychology
Demszky, D., Yang, D., Yeager, D. S., Bryan, C. J., Clapper, M., Chandhok, S., Eichstaedt, J. C., Hecht, C., Jamieson, J., Johnson, M., et al. (2023) · Nature Reviews Psychology · doi:10.1038/s44159-023-00241-5 · Cited by 369
“Score language on social media or other platforms for potentially harmful language (for example, prejudice, misinformation or extremism 107,108 ), and use the resulting algorithms to evaluate the real-world impact of interventions to reduce harmful language on social media.”
BackgroundMathematical foundations of moral preferences
Capraro, V., & Perc, M. (2021) · Journal of The Royal Society Interface · doi:10.1098/rsif.2020.0880 · Cited by 310
Metadata
- Authors
- Brady, W. J., Wills, J. A., Burkart, D., Jost, J. T., & Van Bavel, J. J.
- Affiliations
- New York University (US)
- Princeton University (US)
- ORCID
- Brady, William J.
- Venue
- Journal of Experimental Psychology: General
- Published
- 2019-10
- Volume
- 148
- Issue
- 10
- Pages
- 1802-1813
- ISSN
- 0096-3445 (ISSN-L)
- 1939-2222
- OpenAlex
- W2908052923
- Cited by
- 188
- References
- 50
- Citations by year
- 2026: 23 · 2025: 25 · 2024: 27 · 2023: 44 · 2022: 24 · 2021: 19 · 2020: 19 · 2019: 7
- FWCI
- 24.51
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Journal of Experimental Psychology General (publishedVersion, other-oa)
- PubMed (publishedVersion)
- Funders
- National Science Foundation (SES-1349089; SES-1248077; SES-1248077-001)
- New York University
- Topics
- Social Sciences › Communication › Social Media and Politics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Psychology of Moral and Emotional Judgment
- Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
- Keywords
- message dissemination, moral emotions, moral outrage, political leaders, ideological asymmetry, conservative elites, moral language, political propaganda, political polarization, 2016 US presidential election, social media, patriotism, disgust
- MeSH terms
- Communication, Cues, Emotions, Humans, Language, Leadership, Morals, Politics, United States, Expressed Emotion, Social Networking, Social Media
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.