Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat
Cited by 253

The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.

Disproportionate Removals and Differing Content Moderation Experiences for Conservative, Transgender, and Black Social Media Users: Marginalization and Moderation Gray Areas

Haimson, Oliver L., Delmonaco, Daniel, Nie, Peipei, Wegner, Andrea · 2021 · Proceedings of the ACM on Human-Computer Interaction

Abstract

Social media sites use content moderation to attempt to cultivate safe spaces with accurate information for their users. However, content moderation decisions may not be applied equally for all types of users, and may lead to disproportionate censorship related to people's genders, races, or political orientations. We conducted a mixed methods study involving qualitative and quantitative analysis of survey data to understand which types of social media users have content and accounts removed more frequently than others, what types of content and accounts are removed, and how content removed may differ between groups. We found that three groups of social media users in our dataset experienced content and account removals more often than others: political conservatives, transgender people, and Black people. However, the types of content removed from each group varied substantially. Conservative participants' removed content included content that was offensive or allegedly so, misinformation, Covid-related, adult, or hate speech. Transgender participants' content was often removed as adult despite following site guidelines, critical of a dominant group (e.g., men, white people), or specifically related to transgender or queer issues. Black participants' removed content was frequently related to racial justice or racism. More broadly, conservative participants' removals often involved harmful content removed according to site guidelines to create safe spaces with accurate information, while transgender and Black participants' removals often involved content related to expressing their marginalized identities that was removed despite following site policies or fell into content moderation gray areas. We discuss potential ways forward to make content moderation more equitable for marginalized social media users, such as embracing and designing specifically for content moderation gray areas.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3479610

Cites

11 of 11 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 11 references

Research works printed but not linked: 67

  1. 10.1080/14680777.2020.1783805 · DOI
  2. 10.1080/14680777.2021.1928259 · DOI · Paper page
  3. Paul M. Barrett and J. Grant Sims. 2021. False Accusation: The Unfounded Claim that Social Media Companies Censor Conservatives. Technical Report. NYU Stern Center for Business and Human Rights. https://static1.squarespace.com/static/5b6df958f8370af3217d4178/t/6011e68dec2c7013d3caf3cb/1611785871154/NYU+False+Accusation+report_FINAL.pdf
  4. 10.1177/20563051211024977 · DOI
  5. Danielle Blunt and Ariel Wolf. 2020. Erased: The Impact of FOSTA-SESTA & the Removal of Backpage. Technical Report. Hacking//Hustling.
  6. 10.1215/23289252--8143407 · doi:10.1215/23289252--8143407
  7. Taina Bucher. 2018. If. .. Then: Algorithmic Power and Politics. Oxford University Press. Google-Books-ID: 2GdaDwAAQBAJ.
  8. 10.1145/3134666 · DOI · Paper page
  9. Alexander Cheves. 2018. The Dangerous Trend of LGBTQ Censorship on the Internet. (Dec. 2018). https://www.out.com/out-exclusives/2018/12/06/dangerous-trend-lgbtq-censorship-internet
  10. 10.1177/2056305120933301 · DOI
  11. Society (Aug. 2020). https://doi.org/10.1177/2056305120933301 Publisher: SAGE PublicationsSage UK: London England. · DOI
  12. Danielle Keats Citron. 2014. Hate Crimes in Cyberspace. Harvard University Press.
  13. Danielle Keats Citron and Helen Norton. 2011. Intermediaries and Hate Speech: Fostering Digital Citizenship for our Information Age. BUL Review (2011), 51.
  14. 10.1177/1461444814543163 · DOI · Paper page
  15. Gilles Deleuze and Felix Guattari. 1987. A Thousand Plateaus: Capitalism and Schizophrenia. U of Minnesota Press. Google-Books-ID: C948Tsr72woC.
  16. Dolores Delgado Bernal. 1997. Chicana school resistance and grassroots leadership: providing an alternative history of the 1968 East Los Angeles blowouts. Ph.D. Dissertation. University of California Los Angeles.
  17. Natasha Duarte, Emma Llansó, and Anna Loup. 2018. Mixed Messages? The Limits of Automated Social Media Content Analysis. In 2018 Conference on Fairness, Accountability, and Transparency. https://cdt.org/files/2017/12/FAT-conference-draft-2018.pdf
  18. Stefanie Duguay Jean Burgess and Nicolas Suzor. 2018. Queer women's experiences of patchwork platform governance on Tinder Instagram and Vine. 16. https://doi.org/10.1177/1354856518781530 · DOI · Paper page
  19. 10.1145/3313831.3376293 · DOI
  20. 10.1145/3392845 · DOI
  21. Electronic Frontier Foundation. 2019 a. EFF Project Shows How People Are Unfairly "TOSsed Out" By Platforms' Absurd Enforcement of Content Rules. https://www.eff.org/press/releases/eff-project-shows-how-people-are-unfairly-tossed-out-platforms-absurd-enforcement
  22. Paulo Freire. 1970. Education for critical consciousness. Continuum Publishing Company, New York, NY, USA.
  23. Paulo Freire. 1973. Pedagogy of the oppressed. The Seabury Press, New York, NY, USA.
  24. 10.1177/1461444820912540 · DOI
  25. Tarleton Gillespie. 2017. Governance of and by platforms. In The SAGE Handbook of Social Media. SAGE, New York, 30.
  26. Tarleton Gillespie. 2018. Custodians of the Internet: Platforms, Content Moderation, and the Hidden Decisions That Shape Social Media. Yale University Press, New Haven.
  27. James Grimmelmann. 2015. The Virtues of Moderation. Yale Journal of Law and Technology, Vol. 17 (2015), 42--109. https://heinonline.org/HOL/P?h=hein.journals/yjolt17&i=42
  28. 10.1145/2858036.2858136 · DOI
  29. 10.1145/3415195 · DOI
  30. 10.1080/14680777.2019.1678505 · DOI · Paper page
  31. 10.5210/fm.v21i6.6791 · DOI · Paper page
  32. Sandra G. Harding. 2004. The Feminist Standpoint Theory Reader: Intellectual and Political Controversies. Psychology Press. Google-Books-ID: qmSySHvIy5IC.
  33. 10.1080/09589236.2017.1411791 · DOI · Paper page
  34. Anna Lauren Hoffmann and Anne Jonas. 2017. Recasting Justice for Internet and Online Industry Research Ethics. In Internet Research Ethics for the Social Age: New Challenges, Cases, and Contexts, Michael Zimmer and Katharina Kinder-Kurlanda (Eds.). Peter Lang Publishing, 3--19.
  35. 10.1145/3359294 · DOI
  36. 10.1609/icwsm.v13i01.3229 · DOI
  37. 10.1609/aaai.v34i09.7117 · DOI
  38. Kate Klonick. 2020. The Facebook Oversight Board: Creating an Independent Institution to Adjudicate Online Free Expression. the yale law journal (2020), 82.
  39. Jessa Lingel. 2017. Digital Countercultures and the Struggle for Community 1 edition ed.). The MIT Press, Cambridge, MA.
  40. Natalie Martinez and Media Matters. 2019. Study: Facebook is still not censoring conservatives. Technical Report. https://www.mediamatters.org/facebook/study-facebook-still-not-censoring-conservatives
  41. Peter McLaren. 1994. Life in schools: an introduction to critical pedagogy in the foundations of education 2nd ed.). Longman, New York, NY, USA.
  42. 10.1145/3359231 · DOI
  43. 10.1177/1461444818773059 · DOI · Paper page
  44. 10.1177/1470412914546845 · doi:10.1177/1470412914546845
  45. Viviane Namaste. 2000. Invisible Lives: The Erasure of Transsexual and Transgendered People. University of Chicago Press. Google-Books-ID: Pq5jwRVbvY8C.
  46. 10.1145/3313831.3376392 · DOI · Paper page
  47. 10.1037/0033--2909.133.2.328 · doi:10.1037/0033--2909.133.2.328
  48. 10.1145/2858036.2858389 · DOI
  49. 10.1145/2957276.2957297 · DOI
  50. Delroy L. Paulhus. 1991. Measurement and Control of Response Bias. · DOI · Paper page
  51. 10.5210/fm.v23i3.8283 · DOI
  52. Salty. 2019. Exclusive: An Investigation into Algorithmic Bias in Content Policing on Instagram. https://www.saltyworld.net/algorithmicbiasreport-2/
  53. 10.1145/3274424 · DOI · Paper page
  54. 10.1177/1461444820913122 · DOI · Paper page
  55. 10.1177/1461444818821316 · DOI · Paper page
  56. Daniel Solórzano and Dolores Delgado Bernal. 2001. Critical race theory, transformational resistance and social justice: Chicana and Chicano students in an urban context. Urban Education (2001).
  57. 10.1177/1461444820904362 · DOI
  58. 10.1145/3338283 · DOI · Paper page
  59. 10.1177/20563051211024962 · DOI
  60. Anselm Strauss and Juliet M. Corbin. 1998. Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory. SAGE Publications. Google-Books-ID: tBcEjwEACAAJ.
  61. Nicolas P. Suzor. 2019 a. Lawless: The Secret Rules That Govern Our Digital Lives. Cambridge University Press. Google-Books-ID: EjGdDwAAQBAJ.
  62. Nicolas P Suzor. 2019 b. What Do We Mean When We Talk About Transparency? Toward Meaningful Transparency in Commercial Content Moderation. International Journal of Communication, Vol. 13 (2019), 1526--1543.
  63. 10.1177/1461444821996715 · DOI
  64. 10.1215/23289252--3334463 · doi:10.1215/23289252--3334463
  65. Jillian C. York. 2021. Silicon Values: The Future of Free Speech Under Surveillance Capitalism. Verso Books. Google-Books-ID: SNwfEAAAQBAJ.
  66. Savvas Zannettou. 2021. "I Won the Election!": An Empirical Analysis of Soft Moderation Interventions on Twitter. arXiv:2101.07183 [cs] (Jan. 2021). http://arxiv.org/abs/2101.07183 arXiv: 2101.07183. · arXiv
  67. 10.1145/3379337.3415858 · DOI

Cited by

See all 253

Metadata

Authors
Haimson, O. L., Delmonaco, D., Nie, P., & Wegner, A.
Affiliations
University of Michigan, Ann Arbor, MI, USA
Venue
Proceedings of the ACM on Human-Computer Interaction
Published
2021-10-13
Volume
5
Issue
CSCW2
Pages
1-35
ISSN
2573-0142
Cited by
253
References
11
Language
en
Funders
National Science Foundation (1942125)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Disproportionate Removals and Differing Content Moderation Experiences for Conservative, Transgender, and Black Social Media Users: Marginalization and Moderation Gray Areas. https://app.cochat.ai/papers/10.1145/3479610
The paper
Haimson, O. L., Delmonaco, D., Nie, P., & Wegner, A. (2021). Disproportionate Removals and Differing Content Moderation Experiences for Conservative, Transgender, and Black Social Media Users: Marginalization and Moderation Gray Areas. Proceedings of the ACM on Human-Computer Interaction. https://doi.org/10.1145/3479610

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.