The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Analyzing Polarization in Social Media: Method and Application to Tweets on 21 Mass Shootings
Open accessAbstract
Dorottya Demszky, Nikhil Garg, Rob Voigt, James Zou, Jesse Shapiro, Matthew Gentzkow, Dan Jurafsky. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers). 2019.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The text we found for this paper looks like another document, so the self-check wasn’t run.
Citations
Cites
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071 · cited 2×
“Train GloVe embeddings (Pennington et al., 2014) on V based on 11-50k random samples of tweets from each event.”
BackgroundMethodAustin, J. L. (1975) · doi:10.1093/acprof:oso/9780198245537.001.0001 · Cited by 21,496
Critical race theory: an introduction
Delgado, R., Stefancic, J., & Harris, A. (2013) · Choice Reviews Online · doi:10.5860/choice.50-2938 · Cited by 5,992
Exposure to ideologically diverse news and opinion on Facebook
Bakshy, E., Messing, S., & Adamic, L. A. (2015) · Science · doi:10.1126/science.aaa1160 · Cited by 3,245 · cited 3×
“com/ddemszky/framing-twitter 2016) and Facebook (Bakshy et al., 2015).”
BackgroundIyengar, S., Sood, G., & Lelkes, Y. (2012) · Public Opinion Quarterly · doi:10.1093/poq/nfs038 · Cited by 2,996 · cited 1×
“, 2009), and so emotional expression represents another semantic layer relevant to polarization (Iyengar et al., 2012; Suhay, 2015).”
Background(2009) · Cited by 1,900
Political Polarization in the American Public
Fiorina, M. P., & Abrams, S. J. (2008) · Annual Review of Political Science · doi:10.1146/annurev.polisci.11.053106.153836 · Cited by 1,798 · cited 1×
“, forthcoming), and the propagation of partisan frames can influence public opinion (Chong and Druckman, 2007) and party identification (Fiorina and Abrams, 2008).”
BackgroundFraming Bias: Media in the Distribution of Power
Entman, R. M. (2007) · Journal of Communication · doi:10.1111/j.1460-2466.2006.00336.x · Cited by 1,781 · cited 1×
“The strategy of highlighting particular aspects within topics as a means of framing (Entman, 2007) has also been quantified in the NLP literature (Boydstun et al.”
BackgroundPolitical Polarization on Twitter
Conover, M., Ratkiewicz, J., Francisco, M., Goncalves, B., Flammini, A., & Menczer, F. (2011) · Zenodo · doi:10.5281/zenodo.4589064 · Cited by 1,254
A biterm topic model for short texts
Yan, X., Guo, J., Lan, Y., & Cheng, X. (2013) · International World Wide Web Conference (WWW) · doi:10.1145/2488388.2488514 · Cited by 1,165 · cited 3×
“We build on the ability of vector space models to represent higher-level semantics to develop our own embedding-based topic assignment approach, comparing it with two traditional LDAbased methods: MALLET8 and the Biterm Topic Model (BTM) (Yan et al., 2013); BTM was developed specifically for tweets.”
MethodInfluentialFraming Public Opinion in Competitive Democracies
Chong, D., & Druckman, J. N. (2007) · American Political Science Review · doi:10.1017/s0003055407070554 · Cited by 1,127 · cited 1×
“, forthcoming), and the propagation of partisan frames can influence public opinion (Chong and Druckman, 2007) and party identification (Fiorina and Abrams, 2008).”
BackgroundMedia and Political Polarization
Prior, M. (2013) · Annual Review of Political Science · doi:10.1146/annurev-polisci-100711-135242 · Cited by 1,125
(2017) · International Conference on Learning Representations · Cited by 1,075
Redlawsk, D. P. (2002) · The Journal of Politics · doi:10.1111/1468-2508.00161 · Cited by 978 · cited 1×
“Affect is intimately tied to ideological reasoning (Redlawsk, 2002; Taber et al., 2009), and so emotional expression represents another semantic layer relevant to polarization (Iyengar et al.”
BackgroundThe Notional Category of Modality
Kratzer, A. (2002) · doi:10.1002/9780470758335.ch12 · Cited by 836 · cited 1×
“Modality is a lexical category concerned with necessity and possibility (Kratzer, 2002; Fintel, 2006).”
BackgroundPennebaker, J. W. (2011) · New Scientist · doi:10.1016/s0262-4079(11)62167-2 · Cited by 780
Differences in negativity bias underlie variations in political ideology
Hibbing, J. R., Smith, K. B., & Alford, J. R. (2014) · Behavioral and Brain Sciences · doi:10.1017/s0140525x13001192 · Cited by 649
Personality in 100,000 Words: A large-scale analysis of personality and word use among bloggers
Yarkoni, T. (2010) · Journal of Research in Personality · doi:10.1016/j.jrp.2010.04.001 · Cited by 637 · cited 1×
“, 2012) and in various other domains (Hirsh and Peterson, 2009; Yarkoni, 2010; Pennebaker, 2011).”
BackgroundConservatives are more easily disgusted than liberals
Inbar, Y., Pizarro, D. A., & Bloom, P. (2009) · Cognition & Emotion · doi:10.1080/02699930802110007 · Cited by 574 · cited 1×
“…literature on emotion and political ideology: conservatives score higher than liberals on subjective measures of fear (e.g. Jost et al., 2017; Federico et al., 2009; Hibbing et al., 2014) and disgust sensitivity is also associated with political conservativism (e.g. Inbar et al., 2009, 2012).”
BackgroundMonroe, B. L., Colaresi, M. P., & Quinn, K. M. (2008) · Political Analysis · doi:10.1093/pan/mpn018 · Cited by 542 · cited 3×
“To compare the partisanship of tokens at the event- and topic-level, we also z-score the log odds ratios (Monroe et al., 2008) within events and topics; the most partisan tokens are reported in Appendix F.”
BackgroundInfluentialThe Motivated Processing of Political Arguments
Taber, C. S., Cann, D. M., & Kucsova, S. (2009) · Political Behavior · doi:10.1007/s11109-008-9075-8 · Cited by 465 · cited 2×
“Affect is intimately tied to ideological reasoning (Redlawsk, 2002; Taber et al., 2009), and so emotional expression represents another semantic layer relevant to polarization (Iyengar et al., 13Note that these words in fact have the largest difference (negative and positive, respectively) if we…”
BackgroundHalberstam, Y., & Knight, B. G. (2016) · Journal of Public Economics · doi:10.1016/j.jpubeco.2016.08.011 · Cited by 417 · cited 1×
“(2014), which takes advantage of homophily in the following behavior of users on twitter (Halberstam and Knight, 2016).”
BackgroundInducing Domain-Specific Sentiment Lexicons from Unlabeled Corpora
Hamilton, W. L., Clark, K., Leskovec, J., & Jurafsky, D. (2016) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d16-1057 · Cited by 379 · cited 1×
“Since word-affect associations are highly domain dependent, we tailored an existing affect lexicon, the NRC Emotion Lexicon (Mohammad and Turney, 2013), to our domain via label propagation (Hamilton et al., 2016).”
MethodSelf-citationGun Policy, Opinion, Tragedy, and Blame Attribution: The Conditional Influence of Issue Frames
Haider‐Markel, D. P., & Joslyn, M. R. (2001) · The Journal of Politics · doi:10.1111/0022-3816.00077 · Cited by 368 · cited 1×
“Several works find that frames have changed over time and between such events (Muschert and Carr, 2006; Schildkraut and Muschert, 2014), and that frames influence opinions on gun policies (HaiderMarkel and Joslyn, 2001).”
BackgroundDisgust Sensitivity, Political Conservatism, and Voting
Inbar, Y., Pizarro, D., Iyer, R., & Haidt, J. (2012) · Social Psychological and Personality Science · doi:10.1177/1948550611429024 · Cited by 358 · cited 1×
“…literature on emotion and political ideology: conservatives score higher than liberals on subjective measures of fear (e.g. Jost et al., 2017; Federico et al., 2009; Hibbing et al., 2014) and disgust sensitivity is also associated with political conservativism (e.g. Inbar et al., 2009, 2012).”
BackgroundMedia Salience and the Process of Framing: Coverage of the Columbine School Shootings
Chyi, H. I., & McCombs, M. (2004) · Journalism & Mass Communication Quarterly · doi:10.1177/107769900408100103 · Cited by 339 · cited 1×
“Framing and polarization in the context of mass shootings is well-studied, though much of the literature studies the role of media (Chyi and McCombs, 2004; Schildkraut and Elsass, 2016) and politicians (Johnson et al.”
BackgroundYou are what you tweet: Personality expression and perception on Twitter
Qiu, L., Lin, H. Y., Ramsay, J. E., & Yang, F. (2012) · Journal of Research in Personality · doi:10.1016/j.jrp.2012.08.008 · Cited by 330 · cited 7×
“Prior NLP work in this area has considered how to extract factual information on gun violence from news (Pavlick et al., 2016) as well as quantify stance and public opinion on Twitter (Benton et al., 2016) and across the web (Ayers et al., 2016); here we advance NLP approaches to the public discourse surrounding gun v…”
BackgroundInfluentialThe Politics of Fear: Is There an Ideological Asymmetry in Existential Motivation?
Jost, J. T., Stern, C., Rule, N. O., & Sterling, J. L. (2017) · Social Cognition · doi:10.1521/soco.2017.35.4.324 · Cited by 328 · cited 1×
“…accord with existing literature on emotion and political ideology: conservatives score higher than liberals on subjective measures of fear (e.g. Jost et al., 2017; Federico et al., 2009; Hibbing et al., 2014) and disgust sensitivity is also associated with political conservativism (e.g. Inbar…”
Stieglitz, S., & Dang-Xuan, L. (2012) · Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.2012.476 · Cited by 322 · cited 1×
“, 2017) and that emotive political tweets are more likely to be shared (Stieglitz and Dang-Xuan, 2012).”
BackgroundPersonality and language use in self-narratives
Hirsh, J. B., & Peterson, J. B. (2009) · Journal of Research in Personality · doi:10.1016/j.jrp.2009.01.006 · Cited by 312 · cited 1×
“, 2012) and in various other domains (Hirsh and Peterson, 2009; Yarkoni, 2010; Pennebaker, 2011).”
BackgroundBeyond Binary Labels: Political Ideology Prediction of Twitter Users
Preoțiuc-Pietro, D., Liu, Y., Hopkins, D. J., & Ungar, L. (2017) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p17-1068 · Cited by 310 · cited 7×
“Others have shown that emotion words can help detect political ideology on Twitter (Preoţiuc-Pietro et al., 2017) and that emotive political tweets are more likely to be shared (Stieglitz and Dang-Xuan, 2012).”
BackgroundInfluentialThe Media Frames Corpus: Annotations of Frames Across Issues
Card, D., Boydstun, A. E., Gross, J. H., Resnik, P., & Smith, N. A. (2015) · doi:10.3115/v1/p15-2072 · Cited by 224 · cited 1×
“The strategy of highlighting particular aspects within topics as a means of framing (Entman, 2007) has also been quantified in the NLP literature (Boydstun et al., 2013; Card et al., 2015; Naderi and Hirst, 2017).”
BackgroundMass shootings and the media: why all events are not created equal
Schildkraut, J., Elsass, H. J., & Meredith, K. (2017) · Journal of Crime and Justice · doi:10.1080/0735648x.2017.1284689 · Cited by 153 · cited 2×
“C L ] 4 A pr 2 01 9 problems (Drakulich, 2015); in the mass shooting context, race is a factor in an event’s newsworthiness (Schildkraut et al., 2018) and is often mentioned prominently in media coverage, particularly when the shooter is non-white (Mingus and Zopf, 2010; Park et al., 2012).”
BackgroundSuhay, E. (2014) · Political Behavior · doi:10.1007/s11109-014-9269-1 · Cited by 151 · cited 1×
“, 2009), and so emotional expression represents another semantic layer relevant to polarization (Iyengar et al., 2012; Suhay, 2015).”
BackgroundField, A., Kliger, D., Wintner, S., Pan, J., Jurafsky, D., & Tsvetkov, Y. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1393 · Cited by 120 · cited 1×
“Topic choice can be a tool for agenda-setting by establishing what an author or institution deems worthy of discussion (McCombs, 2002), and works in NLP have used topic modeling as an approach to measure this effect (Tsur et al., 2015; Field et al., 2018).”
Self-citationInferring User Political Preferences from Streaming Communications
Volkova, S., Coppersmith, G., & Durme, B. V. (2014) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/v1/p14-1018 · Cited by 119 · cited 1×
“We estimate the party affiliation of users in the dataset from the political accounts they follow using a method similar to that of Volkova et al. (2014), which takes advantage of homophily in the following behavior of users on twitter (Halberstam and Knight, 2016).”
MethodThe Black/White Binary Paradigm of Race: The Normal Science of American Racial Thought
Perea, J. F. (1997) · bepress Legal Repository · doi:10.15779/z38mf05 · Cited by 111 · cited 1×
“These findings support related work (Perea, 1997; Delgado and Stefancic, 2017) discussing binary conceptualization of race in the US, and its influence in determining whether a shooter’s mental health or aspects of their identity are discussed.”
BackgroundA Frame of Mind: Using Statistical Models for Detection of Framing and Agenda Setting Campaigns
Tsur, O., Calacci, D., & Lazer, D. M. J. (2015) · doi:10.3115/v1/p15-1157 · Cited by 108 · cited 1×
“Topic choice can be a tool for agenda-setting by establishing what an author or institution deems worthy of discussion (McCombs, 2002), and works in NLP have used topic modeling as an approach to measure this effect (Tsur et al., 2015; Field et al., 2018).”
Media Salience and the Framing of Mass Murder in Schools
Schildkraut, J., & Muschert, G. W. (2013) · Homicide Studies · doi:10.1177/1088767913511458 · Cited by 90 · cited 1×
“Several works find that frames have changed over time and between such events (Muschert and Carr, 2006; Schildkraut and Muschert, 2014), and that frames influence opinions on gun policies (HaiderMarkel and Joslyn, 2001).”
BackgroundFederico, C. M., Hunt, C. V., & Ergun, D. (2009) · Social Justice Research · doi:10.1007/s11211-009-0097-0 · Cited by 81 · cited 2×
“…literature on emotion and political ideology: conservatives score higher than liberals on subjective measures of fear (e.g. Jost et al., 2017; Federico et al., 2009; Hibbing et al., 2014) and disgust sensitivity is also associated with political conservativism (e.g. Inbar et al., 2009, 2012).”
BackgroundResultMental Illness, the Media, and the Moral Politics of Mass Violence
Duxbury, S., Frizzell, L. C., & Lindsay, S. L. (2018) · Journal of Research in Crime and Delinquency · doi:10.1177/0022427818787225 · Cited by 78 · cited 1×
“Duxbury et al. (2018) find that media representations of white shooters disproportionately divert blame by framing them as mentally ill while representations of non-white shooters are more frequently criminalized, highlighting histories of violent behavior.”
BackgroundExplicit and Hidden Racial Bias in the Framing of Social Problems
Drakulich, K. (2015) · Social Problems · doi:10.1093/socpro/spu003 · Cited by 74 · cited 1×
“problems (Drakulich, 2015); in the mass shooting context, race is a factor in an event’s newsworthiness (Schildkraut et al.”
BackgroundRace in Media Coverage of School Shootings
Park, S., Holody, K. J., & Zhang, X. (2012) · Journalism & Mass Communication Quarterly · doi:10.1177/1077699012448873 · Cited by 65 · cited 2×
“C L ] 4 A pr 2 01 9 problems (Drakulich, 2015); in the mass shooting context, race is a factor in an event’s newsworthiness (Schildkraut et al., 2018) and is often mentioned prominently in media coverage, particularly when the shooter is non-white (Mingus and Zopf, 2010; Park et al., 2012).”
BackgroundIdentifying Media Frames and Frame Dynamics Within and Across Policy Issues
Boydstun, A. E., & Gross, J. H. (2013) · Cited by 60
Balasubramanyan, R., Cohen, W. W., Pierce, D. R., et al. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v6i1.14237 · Cited by 44
Analyzing Polarization in Social Media: Method and Application to Tweets on 21 Mass ShootingsPreprint
Demszky, D., Garg, N., Voigt, R., Zou, J., Gentzkow, M. A., Shapiro, J. M., & Jurafsky, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.01596 · Cited by 43
Self-citationClassifying Frames at the Sentence Level in News Articles
Naderi, N., & Hirst, G. (2017) · International conference Recent advances in natural language processing · doi:10.26615/978-954-452-049-6_070 · Cited by 37 · cited 1×
“The strategy of highlighting particular aspects within topics as a means of framing (Entman, 2007) has also been quantified in the NLP literature (Boydstun et al., 2013; Card et al., 2015; Naderi and Hirst, 2017).”
BackgroundMass Shootings: Media, Myths, and Realities
Elsass, H. J., & Schildkraut, J. (2016) · Cited by 36
The Gun Violence Database: A new task and data set for NLP
Pavlick, E., Ji, H., Pan, X., & Callison-Burch, C. (2016) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d16-1106 · Cited by 29 · cited 2×
“Prior NLP work in this area has considered how to extract factual information on gun violence from news (Pavlick et al., 2016) as well as quantify stance and public opinion on Twitter (Benton et al., 2016) and across the web (Ayers et al., 2016); here we advance NLP approaches to the public…”
BackgroundWhite Means Never Having to Say You're Sorry The Racial Project in Explaining Mass Shootings
Mingus, W., & Zopf, B. J. (2010) · Social Thought and Research · doi:10.17161/str.1808.10073 · Cited by 22 · cited 1×
“, 2018) and is often mentioned prominently in media coverage, particularly when the shooter is non-white (Mingus and Zopf, 2010; Park et al., 2012).”
BackgroundMessage Impartiality in Social Media Discussions
Zafar, M. B., Gummadi, K. P., & Danescu-Niculescu-Mizil, C. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v10i1.14754 · Cited by 22 · cited 2×
“, that polarized messages are more likely to be shared (Zafar et al., 2016) and that certain topics are more polarizing (Balasubramanyan et al.”
BackgroundModeling of Political Discourse Framing on Twitter
Johnson, K., Jin, D., & Goldwasser, D. (2017) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v11i1.14958 · Cited by 19 · cited 1×
“Framing and polarization in the context of mass shootings is well-studied, though much of the literature studies the role of media (Chyi and McCombs, 2004; Schildkraut and Elsass, 2016) and politicians (Johnson et al., 2017).”
BackgroundAfter Sandy Hook Elementary: A Year in the Gun Control Debate on TwitterPreprint
Benton, A., Hancock, B., Coppersmith, G., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.02060 · Cited by 15 · cited 8×
“Prior NLP work in this area has considered how to extract factual information on gun violence from news (Pavlick et al., 2016) as well as quantify stance and public opinion on Twitter (Benton et al., 2016) and across the web (Ayers et al., 2016); here we advance NLP approaches to the public discourse surrounding gun v…”
BackgroundInfluential
Research works printed but not linked: 3
- Analyzing Polarization in Social Media: Method and Application to Tweets on 21 Mass Shootings https://aclanthology.org/N19-1304/ (Demszky et al., NAACL 2019)
- Analyzing Polarization in Social Media: Method and Application to Tweets on 21 Mass Shootings (Demszky et al., NAACL 2019)
- ACL materials are Copyright © 1963–2026 ACL; other materials are copyrighted by their respective copyright holders. Materials prior to 2016 here are licensed under the Creative Commons Attribution-NonCommercial-ShareAlike 3.0 International License. Permission is granted to make copies for the purposes of teaching and research. Materials published in or after 2016 are licensed on a Creative Commons Attribution 4.0 International License.
Cited by
Sorted by citations
Can Large Language Models Transform Computational Social Science?
Ziems, C., Held, W., Shaikh, O., Chen, J., Zhang, Z., & Yang, D. (2024) · Computational Linguistics · doi:10.1162/coli_a_00502 · Cited by 585
“We evaluate on the Indian English dialect feature detection task of Demszky et al. (2019) because this is one of the only available datasets to be handlabeled by a domain expert.”
BackgroundMethodGenerative Adversarial Networks for face generation: A survey
Kammoun, A., Slama, R., Tabia, H., Ouni, T., & Abid, M. (2022) · ACM Computing Surveys · doi:10.1145/1122445.1122456 · Cited by 370
Stance detection on social media: State of the art and trends
Aldayel, A., & Magdy, W. (2021) · Information Processing & Management · doi:10.1016/j.ipm.2021.102597 · Cited by 290
“The work of [Demszky et al. 2019] analyzed the attitudes about 21 mass shooting event.”
BackgroundMethodResultFeng, S., Park, C. Y., Liu, Y., & Tsvetkov, Y. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2023.acl-long.656 · Cited by 149
Emotion and Reason in Political Language
Gennaro, G., & Ash, E. (2021) · The Economic Journal · doi:10.1093/ej/ueab104 · Cited by 134
Metadata
- Authors
- Demszky, D., Garg, N., Voigt, R., Zou, J., Shapiro, J., Gentzkow, M., & Jurafsky, D.
- Affiliations
- Stanford University (US)
- Brown University (US)
- Venue
- Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers)
- Published
- 2019
- Pages
- 2970-3005
- OpenAlex
- W2963834345
- Semantic Scholar
- 3475876c3f5e624587181744bc5acf4223aecd00
- Cited by
- 164
- References
- 52
- Citations by year
- 2026: 3 · 2025: 35 · 2024: 10 · 2023: 24 · 2022: 35 · 2021: 29 · 2020: 22 · 2019: 6
- FWCI
- 9.21
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) (publishedVersion, cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
- Physical Sciences › Computer Science › Artificial Intelligence › Hate Speech and Cyberbullying Detection
- Social Sciences › Communication › Social Media and Politics
- Keywords
- polarization, social media, tweets, mass shootings, sentiment analysis, political polarization, online discourse
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A second model labelled each claim on 2026-10-13 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review