Modeling Ideology and Predicting Policy Change with Social Media: Case of Same-Sex Marriage
The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
Social media has emerged as a prominent platform where people can express their feelings about social and political issues of our time. We study the many voices discussing an issue within a constituency and how they reflect ideology and may signal the outcome of important policy decisions. Focusing on the issue of same-sex marriage legalization, we examine almost 2 million public Twitter posts related to same-sex marriage in the U.S. states over the course of 4 years starting from 2011. Among other findings, we find evidence of moral culture wars between ideologies and show that constituencies that express higher levels of emotion and have fewer actively engaged participants often precede legalization efforts that fail. From our measures, we build statistical models to predict the outcome of potential policy changes, with our best model achieving 87% accuracy. We also achieve accuracies of 70%, comparable to public opinion surveys, many months before a policy decision. We discuss how these analyses can augment traditional political science techniques as well as assist activists and policy analysts in understanding discussions on important issues at a population scale.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Development and Psychometric Properties of LIWC2015
Pennebaker, J. W., Boyd, R. L., Jordan, K., & Blackburn, K. (2015) · University of Texas at Austin · doi:10.15781/t25p41 · Cited by 1,674
Extracting Policy Positions from Political Texts Using Words as Data
LAVER, M., BENOIT, K., & GARRY, J. (2003) · American Political Science Review · doi:10.1017/s0003055403000698 · Cited by 1,377 · cited 1×
“In terms of computational approaches to political science questions, much research focuses on classification of political positions from textual data such as speeches [21, 31].”
BackgroundPolitical Polarization on Twitter
Conover, M., Ratkiewicz, J., Francisco, M., Goncalves, B., Flammini, A., & Menczer, F. (2011) · Zenodo · doi:10.5281/zenodo.4589064 · Cited by 1,254
Personality in 100,000 Words: A large-scale analysis of personality and word use among bloggers
Yarkoni, T. (2010) · Journal of Research in Personality · doi:10.1016/j.jrp.2010.04.001 · Cited by 637 · cited 1×
“We use research that finds correlations between LIWC categories and personality traits [33] to build a measure for each trait.”
Method
Cited by
The Geography and Importance of Localness in Geotagged Social Media
Johnson, I. L., Sengupta, S., Schöning, J., & Hecht, B. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858122 · Cited by 67
“Indeed, researchers in HCI (e.g., [1,9,45,50]), the social sciences (e.g., [10,14,21,39,46,51]), and even the natural sciences (e.g., [38,44,49]) now regularly use social media VGI to better understand phenomena of interest ranging from social unrest and emergencies [6,24,43] to disease tracking…”
BackgroundThe psychology of job loss: using social media data to characterize and predict unemployment
Proserpio, D., Counts, S., & Jain, A. (2016) · Proceedings of the 8th ACM Conference on Web Science · doi:10.1145/2908131.2913008 · Cited by 23
Self-citationHow is "Public Policy" Used in HCI Scholarship?
Gairola, R., & Gray, C. M. (2025) · Proceedings of the Extended Abstracts of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706599.3719997 · Cited by 8
Paradoxes of Openness: Trans Experiences in Open Source Software
Frluckaj, H., Stevens, N., Howison, J., & Dabbish, L. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3687047 · Cited by 5
“Additionally, while many studies examine queer participation in social media [117], i.e. fear of being outed online [23, 115], open collaboration and peer production environments such as OSS have yet to be examined.”
Background
Metadata
- Authors
- Zhang, A. X., & Counts, S.
- Venue
- Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2015-04-18
- Pages
- 2603-2612
- OpenAlex
- W2134324301
- Cited by
- 30
- References
- 4
- FWCI
- 9.24
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Modeling Ideology and Predicting Policy Change with Social Media: Case of Same-Sex Marriage. https://app.cochat.ai/papers/10.1145/2702123.2702193
- The paper
- Zhang, A. X., & Counts, S. (2015). Modeling Ideology and Predicting Policy Change with Social Media: Case of Same-Sex Marriage. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. https://doi.org/10.1145/2702123.2702193
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.