Content Moderation Folk Theories and Perceptions of Platform Spirit among Marginalized Social Media Users
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
Social media users create folk theories to help explain how elements of social media operate. Marginalized social media users face disproportionate content moderation and removal on social media platforms. We conducted a qualitative interview study ( n = 24) to understand how marginalized social media users may create folk theories in response to content moderation and their perceptions of platforms’ spirit, and how these theories may relate to their marginalized identities. We found that marginalized social media users develop folk theories informed by their perceptions of platforms’ spirit to explain instances where their content was moderated in ways that violate their perceptions of how content moderation should work in practice. These folk theories typically address content being removed despite not violating community guidelines, along with bias against marginalized users embedded in guidelines. We provide implications for platforms, such as using marginalized users’ folk theories as tools to identify elements of platform moderation systems that function incorrectly and disproportionately impact marginalized users.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
Basics of Qualitative Research (3rd ed.): Techniques and Procedures for Developing Grounded Theory
Corbin, J., & Strauss, A. (2008) · SAGE · doi:10.4135/9781452230153 · Cited by 12,136
Gorwa, R., Binns, R., & Katzenbach, C. (2020) · Big Data & Society · doi:10.1177/2053951719897945 · Cited by 1,097 · cited 1×
“Content moderation can include human moderation [58] and algorithmic content moderation, defined by Gorwa as “systems that classify user-generated content based on either matching or prediction, leading to a decision and governance outcome” [35].”
BackgroundThe internet for empowerment of minority and marginalized users
Mehra, B., Merkel, C., & Bishop, A. P. (2004) · New Media & Society · doi:10.1177/146144804047513 · Cited by 411 · cited 1×
“…purposes unique to their communities and identities, including expressing frustration 1:2 S. Mayworm et al. with bigotry, finding information resources unique to their community, or seeking support, connections, and solidarity from other members of their community [37, 40, 49, 51, 54, 55, 66, 67].”
BackgroundFirst I "like" it, then I hide it: Folk Theories of Social Feeds
Eslami, M., Karahalios, K., Sandvig, C., Vaccaro, K., Rickman, A., Hamilton, K., & Kirlik, A. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858494 · Cited by 375
DeVito, M. A., Birnholtz, J., Hancock, J. T., French, M., & Liu, S. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173694 · Cited by 244 · cited 4×
“A users’ social media folk theories are rarely concrete either, but are “developed, tested, and re-evaluated” through their continued use of the social media platform [11, 13, 26].”
BackgroundMethodInfluentialSelf-citationMatias, J. N. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1813486116 · Cited by 208
Safe spaces in online places: social media and LGBTQ youth
Lucero, L. (2017) · Multicultural Education Review · doi:10.1080/2005615x.2017.1313482 · Cited by 195 · cited 1×
“…purposes unique to their communities and identities, including expressing frustration 1:2 S. Mayworm et al. with bigotry, finding information resources unique to their community, or seeking support, connections, and solidarity from other members of their community [37, 40, 49, 51, 54, 55, 66, 67].”
BackgroundMiller, R. A. (2017) · Journal of College Student Development · doi:10.1353/csd.2017.0040 · Cited by 141 · cited 1×
“…purposes unique to their communities and identities, including expressing frustration 1:2 S. Mayworm et al. with bigotry, finding information resources unique to their community, or seeking support, connections, and solidarity from other members of their community [37, 40, 49, 51, 54, 55, 66, 67].”
BackgroundVaccaro, K., Sandvig, C., & Karahalios, K. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3415238 · Cited by 102 · cited 1×
“Research on user perceptions of content moderation has shown that social media users often perceive content moderation as an inconsistent, frustrating, and unfair process [32, 62, 68, 72], which can result in user distrust and resentment of content moderation and of specific moderation tools [58].”
Background
Cited by
Mayworm, S., Albert, K., & Haimson, O. L. (2024) · The 2024 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3630106.3658907 · Cited by 21
Self-citationThach, H., Mayworm, S., Thomas, M., & Haimson, O. L. (2024) · The 2024 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3630106.3658909 · Cited by 14
Self-citationLameiro, F., Dunagan, L., Card, D., Gilbert, E., & Haimson, O. (2025) · Proceedings of the 2025 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3715275.3732095 · Cited by 6
Self-citation
Metadata
- Authors
- Mayworm, S., DeVito, M. A., Delmonaco, D., Thach, H., & Haimson, O. L.
- Venue
- ACM Transactions on Social Computing
- Published
- 2024-03-23
- Volume
- 7
- Issue
- 1-4
- Pages
- 1-27
- ISSN
- 2469-7818 (ISSN-L)
- 2469-7826
- OpenAlex
- W4389269265
- Cited by
- 37
- References
- 10
- FWCI
- 9.03
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.