The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Disproportionate Removals and Differing Content Moderation Experiences for Conservative, Transgender, and Black Social Media Users: Marginalization and Moderation Gray Areas
Abstract
Social media sites use content moderation to attempt to cultivate safe spaces with accurate information for their users. However, content moderation decisions may not be applied equally for all types of users, and may lead to disproportionate censorship related to people's genders, races, or political orientations. We conducted a mixed methods study involving qualitative and quantitative analysis of survey data to understand which types of social media users have content and accounts removed more frequently than others, what types of content and accounts are removed, and how content removed may differ between groups. We found that three groups of social media users in our dataset experienced content and account removals more often than others: political conservatives, transgender people, and Black people. However, the types of content removed from each group varied substantially. Conservative participants' removed content included content that was offensive or allegedly so, misinformation, Covid-related, adult, or hate speech. Transgender participants' content was often removed as adult despite following site guidelines, critical of a dominant group (e.g., men, white people), or specifically related to transgender or queer issues. Black participants' removed content was frequently related to racial justice or racism. More broadly, conservative participants' removals often involved harmful content removed according to site guidelines to create safe spaces with accurate information, while transgender and Black participants' removals often involved content related to expressing their marginalized identities that was removed despite following site policies or fell into content moderation gray areas. We discuss potential ways forward to make content moderation more equitable for marginalized social media users, such as embracing and designing specifically for content moderation gray areas.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Content moderation is not only applied to marginalized communities but also often targets their particular identity expressions, labelling diverging expressions as”
From Staring Back at the Surveillance Gaze: The Resistance of LGBTQ+ Users on Social Media (2026) · cites this paper as Haimson et al. 2021
In the citing paper
“This creates a regime of visibility that heightens the scrutiny of queer communities, which greatly impacts their possible evolution within counterpublic spaces operating outside of the cisheternormative system (Haimson et al. 2021;Mayworm, Albert, and Haimson 2024;Monea 2022).”
From Staring Back at the Surveillance Gaze: The Resistance of LGBTQ+ Users on Social Media (2026) · cites this paper as Haimson et al. 2021
In the citing paper
“These vague policies often affect queer and trans users, who experience extensive content removal even when respecting a platform's guidelines (Haimson et al. 2021;Mayworm, Albert, and Haimson 2024).”
From Staring Back at the Surveillance Gaze: The Resistance of LGBTQ+ Users on Social Media (2026) · cites this paper as Haimson et al. 2021
In the citing paper
“This reiterates the idea that surveillance through moderation targets queer users because of their identities (Haimson et al. 2021).”
From Staring Back at the Surveillance Gaze: The Resistance of LGBTQ+ Users on Social Media (2026) · cites this paper as Haimson et al. 2021
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Situated Knowledges: The Science Question in Feminism and the Privilege of Partial Perspective
Haraway, D. (1988) · Feminist Studies · doi:10.2307/3178066 · Cited by 18,364
Whose culture has capital? A critical race theory discussion of community cultural wealth
Yosso *, T. J. (2005) · Race Ethnicity and Education · doi:10.1080/1361332052000341006 · Cited by 8,663
The psychological implications of concealing a stigma: A cognitive-affective-behavioral model
Pachankis, J. E. (2007) · Psychological Bulletin · doi:10.1037/0033-2909.133.2.328 · Cited by 1,305
Massanari, A. (2017) · New Media & Society · doi:10.1177/1461444815608807 · Cited by 1,264
Theories of Reproduction and Resistance in the New Sociology of Education: A Critical Analysis
Giroux, H. (1983) · Harvard Educational Review · doi:10.17763/haer.53.3.a67x4u33g7682734 · Cited by 1,131
Chandrasekharan, E., Samory, M., Jhaver, S., Charvat, H., Bruckman, A., Lampe, C., Eisenstein, J., & Gilbert, E. (2018) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3274301 · Cited by 282 · cited 1×
“, Reddit, Discord) already employ diferent moderation approaches for content in specifc online communities [13], all sites should employ diferent moderation approaches for diferent online spaces depending on context and audience, especially considering online community contexts [122].”
BackgroundOnline Harassment and Content Moderation: The Case of Blocklists
Jhaver, S., Ghoshal, S., Bruckman, A., & Gilbert, E. (2018) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3185593 · Cited by 270
Social Media as Social Transition Machinery
Haimson, O. (2018) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3274332 · Cited by 175 · cited 1×
“Trans people rely on online spaces for community, fnding resources, and expressing changing identities [50, 104].”
BackgroundSelf-citationDo Platform Migrations Compromise Content Moderation? Evidence from r/The_Donald and r/Incels
Horta Ribeiro, M., Jhaver, S., Zannettou, S., Blackburn, J., Stringhini, G., De Cristofaro, E., & West, R. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3476057 · Cited by 124 · cited 1×
“Studies have found that while banning toxic communities from a mainstream platform may reduce elements like hate speech on that platform [12], conservative communities that were banned from mainstream platforms, such as r/The_Donald, may migrate to other platforms with more lax policies or set up their own dedicated s…”
BackgroundVaccaro, K., Sandvig, C., & Karahalios, K. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3415238 · Cited by 102 · cited 4×
“Such an approach would need to go far beyond current social media appeals processes, which are often insufcient [122].”
BackgroundInfluential
Research works printed but not linked: 67
- 10.1080/14680777.2020.1783805 · DOI
- 10.1080/14680777.2021.1928259 · DOI · Paper page
- Paul M. Barrett and J. Grant Sims. 2021. False Accusation: The Unfounded Claim that Social Media Companies Censor Conservatives. Technical Report. NYU Stern Center for Business and Human Rights. https://static1.squarespace.com/static/5b6df958f8370af3217d4178/t/6011e68dec2c7013d3caf3cb/1611785871154/NYU+False+Accusation+report_FINAL.pdf
- 10.1177/20563051211024977 · DOI
- Danielle Blunt and Ariel Wolf. 2020. Erased: The Impact of FOSTA-SESTA & the Removal of Backpage. Technical Report. Hacking//Hustling.
- 10.1215/23289252--8143407 · doi:10.1215/23289252--8143407
- Taina Bucher. 2018. If. .. Then: Algorithmic Power and Politics. Oxford University Press. Google-Books-ID: 2GdaDwAAQBAJ.
- 10.1145/3134666 · DOI · Paper page
- Alexander Cheves. 2018. The Dangerous Trend of LGBTQ Censorship on the Internet. (Dec. 2018). https://www.out.com/out-exclusives/2018/12/06/dangerous-trend-lgbtq-censorship-internet
- 10.1177/2056305120933301 · DOI
- Society (Aug. 2020). https://doi.org/10.1177/2056305120933301 Publisher: SAGE PublicationsSage UK: London England. · DOI
- Danielle Keats Citron. 2014. Hate Crimes in Cyberspace. Harvard University Press.
- Danielle Keats Citron and Helen Norton. 2011. Intermediaries and Hate Speech: Fostering Digital Citizenship for our Information Age. BUL Review (2011), 51.
- 10.1177/1461444814543163 · DOI · Paper page
- Gilles Deleuze and Felix Guattari. 1987. A Thousand Plateaus: Capitalism and Schizophrenia. U of Minnesota Press. Google-Books-ID: C948Tsr72woC.
- Dolores Delgado Bernal. 1997. Chicana school resistance and grassroots leadership: providing an alternative history of the 1968 East Los Angeles blowouts. Ph.D. Dissertation. University of California Los Angeles.
- Natasha Duarte, Emma Llansó, and Anna Loup. 2018. Mixed Messages? The Limits of Automated Social Media Content Analysis. In 2018 Conference on Fairness, Accountability, and Transparency. https://cdt.org/files/2017/12/FAT-conference-draft-2018.pdf
- Stefanie Duguay Jean Burgess and Nicolas Suzor. 2018. Queer women's experiences of patchwork platform governance on Tinder Instagram and Vine. 16. https://doi.org/10.1177/1354856518781530 · DOI · Paper page
- 10.1145/3313831.3376293 · DOI
- 10.1145/3392845 · DOI
- Electronic Frontier Foundation. 2019 a. EFF Project Shows How People Are Unfairly "TOSsed Out" By Platforms' Absurd Enforcement of Content Rules. https://www.eff.org/press/releases/eff-project-shows-how-people-are-unfairly-tossed-out-platforms-absurd-enforcement
- Paulo Freire. 1970. Education for critical consciousness. Continuum Publishing Company, New York, NY, USA.
- Paulo Freire. 1973. Pedagogy of the oppressed. The Seabury Press, New York, NY, USA.
- 10.1177/1461444820912540 · DOI
- Tarleton Gillespie. 2017. Governance of and by platforms. In The SAGE Handbook of Social Media. SAGE, New York, 30.
- Tarleton Gillespie. 2018. Custodians of the Internet: Platforms, Content Moderation, and the Hidden Decisions That Shape Social Media. Yale University Press, New Haven.
- James Grimmelmann. 2015. The Virtues of Moderation. Yale Journal of Law and Technology, Vol. 17 (2015), 42--109. https://heinonline.org/HOL/P?h=hein.journals/yjolt17&i=42
- 10.1145/2858036.2858136 · DOI
- 10.1145/3415195 · DOI
- 10.1080/14680777.2019.1678505 · DOI · Paper page
- 10.5210/fm.v21i6.6791 · DOI · Paper page
- Sandra G. Harding. 2004. The Feminist Standpoint Theory Reader: Intellectual and Political Controversies. Psychology Press. Google-Books-ID: qmSySHvIy5IC.
- 10.1080/09589236.2017.1411791 · DOI · Paper page
- Anna Lauren Hoffmann and Anne Jonas. 2017. Recasting Justice for Internet and Online Industry Research Ethics. In Internet Research Ethics for the Social Age: New Challenges, Cases, and Contexts, Michael Zimmer and Katharina Kinder-Kurlanda (Eds.). Peter Lang Publishing, 3--19.
- 10.1145/3359294 · DOI
- 10.1609/icwsm.v13i01.3229 · DOI
- 10.1609/aaai.v34i09.7117 · DOI
- Kate Klonick. 2020. The Facebook Oversight Board: Creating an Independent Institution to Adjudicate Online Free Expression. the yale law journal (2020), 82.
- Jessa Lingel. 2017. Digital Countercultures and the Struggle for Community 1 edition ed.). The MIT Press, Cambridge, MA.
- Natalie Martinez and Media Matters. 2019. Study: Facebook is still not censoring conservatives. Technical Report. https://www.mediamatters.org/facebook/study-facebook-still-not-censoring-conservatives
- Peter McLaren. 1994. Life in schools: an introduction to critical pedagogy in the foundations of education 2nd ed.). Longman, New York, NY, USA.
- 10.1145/3359231 · DOI
- 10.1177/1461444818773059 · DOI · Paper page
- 10.1177/1470412914546845 · doi:10.1177/1470412914546845
- Viviane Namaste. 2000. Invisible Lives: The Erasure of Transsexual and Transgendered People. University of Chicago Press. Google-Books-ID: Pq5jwRVbvY8C.
- 10.1145/3313831.3376392 · DOI · Paper page
- 10.1037/0033--2909.133.2.328 · doi:10.1037/0033--2909.133.2.328
- 10.1145/2858036.2858389 · DOI
- 10.1145/2957276.2957297 · DOI
- Delroy L. Paulhus. 1991. Measurement and Control of Response Bias. · DOI · Paper page
- 10.5210/fm.v23i3.8283 · DOI
- Salty. 2019. Exclusive: An Investigation into Algorithmic Bias in Content Policing on Instagram. https://www.saltyworld.net/algorithmicbiasreport-2/
- 10.1145/3274424 · DOI · Paper page
- 10.1177/1461444820913122 · DOI · Paper page
- 10.1177/1461444818821316 · DOI · Paper page
- Daniel Solórzano and Dolores Delgado Bernal. 2001. Critical race theory, transformational resistance and social justice: Chicana and Chicano students in an urban context. Urban Education (2001).
- 10.1177/1461444820904362 · DOI
- 10.1145/3338283 · DOI · Paper page
- 10.1177/20563051211024962 · DOI
- Anselm Strauss and Juliet M. Corbin. 1998. Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory. SAGE Publications. Google-Books-ID: tBcEjwEACAAJ.
- Nicolas P. Suzor. 2019 a. Lawless: The Secret Rules That Govern Our Digital Lives. Cambridge University Press. Google-Books-ID: EjGdDwAAQBAJ.
- Nicolas P Suzor. 2019 b. What Do We Mean When We Talk About Transparency? Toward Meaningful Transparency in Commercial Content Moderation. International Journal of Communication, Vol. 13 (2019), 1526--1543.
- 10.1177/1461444821996715 · DOI
- 10.1215/23289252--3334463 · doi:10.1215/23289252--3334463
- Jillian C. York. 2021. Silicon Values: The Future of Free Speech Under Surveillance Capitalism. Verso Books. Google-Books-ID: SNwfEAAAQBAJ.
- Savvas Zannettou. 2021. "I Won the Election!": An Empirical Analysis of Soft Moderation Interventions on Twitter. arXiv:2101.07183 [cs] (Jan. 2021). http://arxiv.org/abs/2101.07183 arXiv: 2101.07183. · arXiv
- 10.1145/3379337.3415858 · DOI
Cited by
Steen, E., Yurechko, K., & Klug, D. (2023) · Social Media + Society · doi:10.1177/20563051231194586 · Cited by 111
The Gradient of Generative AI Release: Methods and Considerations
Solaiman, I. (2023) · 2023 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3593013.3593981 · Cited by 90
SoK: Content Moderation in Social Media, from Guidelines to Enforcement, and Research to Practice
Singhal, M., Ling, C., Paudel, P., Thota, P., Kumarswamy, N., Stringhini, G., & Nilizadeh, S. (2023) · 2023 IEEE 8th European Symposium on Security and Privacy (EuroS&P) · doi:10.1109/eurosp57164.2023.00056 · Cited by 57
The Future of HCI-Policy Collaboration
Yang, Q., Wong, R. Y., Jackson, S., Junginger, S., Hagan, M. D., Gilbert, T., & Zimmerman, J. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642771 · Cited by 52
Whose Knowledge is Valued? Epistemic Injustice in CSCW Applications
Ajmani, L. H., Foriest, J. C., Taylor, J., Pittman, K., Gilbert, S., & DeVito, M. A. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3687062 · Cited by 30
Metadata
- Authors
- Haimson, O. L., Delmonaco, D., Nie, P., & Wegner, A.
- Affiliations
- University of Michigan, Ann Arbor, MI, USA
- Venue
- Proceedings of the ACM on Human-Computer Interaction
- Published
- 2021-10-13
- Volume
- 5
- Issue
- CSCW2
- Pages
- 1-35
- ISSN
- 2573-0142
- Cited by
- 253
- References
- 11
- Language
- en
- Funders
- National Science Foundation (1942125)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Disproportionate Removals and Differing Content Moderation Experiences for Conservative, Transgender, and Black Social Media Users: Marginalization and Moderation Gray Areas. https://app.cochat.ai/papers/10.1145/3479610
- The paper
- Haimson, O. L., Delmonaco, D., Nie, P., & Wegner, A. (2021). Disproportionate Removals and Differing Content Moderation Experiences for Conservative, Transgender, and Black Social Media Users: Marginalization and Moderation Gray Areas. Proceedings of the ACM on Human-Computer Interaction. https://doi.org/10.1145/3479610
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.