Does Transparency in Moderation Really Matter?: User Behavior After Content Removal Explanations on Reddit
Open accessThe DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
When posts are removed on a social media platform, users may or may not receive an explanation. What kinds of explanations are provided? Do those explanations matter? Using a sample of 32 million Reddit posts, we characterize the removal explanations that are provided to Redditors, and link them to measures of subsequent user behaviors---including future post submissions and future post removals. Adopting a topic modeling approach, we show that removal explanations often provide information that educate users about the social norms of the community, thereby (theoretically) preparing them to become a productive member. We build regression models that show evidence of removal explanations playing a role in future user activity. Most importantly, we show that offering explanations for content moderation reduces the odds of future post removals. Additionally, explanations provided by human moderators did not have a significant advantage over explanations provided by bots for reducing future post removals. We propose design solutions that can promote the efficient use of explanation mechanisms, reflecting on how automated moderation tools can contribute to this space. Overall, our findings suggest that removal explanations may be under-utilized in moderation practices, and it is potentially worthwhile for community managers to invest time and resources into providing them.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
Gil de Zúñiga, H., Jung, N., & Valenzuela, S. (2012) · Journal of Computer-Mediated Communication · doi:10.1111/j.1083-6101.2012.01574.x · Cited by 1,821
Explaining collaborative filtering recommendations
Herlocker, J. L., Konstan, J. A., & Riedl, J. (2000) · Proceedings of the 2000 ACM conference on Computer supported cooperative work · doi:10.1145/358916.358995 · Cited by 1,731 · cited 1×
“Prior research on explanations span a number of different fields such as cognitive science, psychology and philosophy [25].”
BackgroundHow Much Information?: Effects of Transparency on Trust in an Algorithmic Interface
Kizilcec, R. F. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858402 · Cited by 615
What is a flag for? Social media reporting tools and the vocabulary of complaint
Crawford, K., & Gillespie, T. (2016) · New Media & Society · doi:10.1177/1461444814543163 · Cited by 496
You Can't Stay Here: The Efficacy of Reddit's 2015 Ban Examined Through Hate Speech
Chandrasekharan, E., Pavalanathan, U., Srinivasan, A., Glynn, A., Eisenstein, J., & Gilbert, E. (2017) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3134666 · Cited by 390
Explanations as Mechanisms for Supporting Algorithmic Transparency
Rader, E., Cotter, K., & Cho, J. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173677 · Cited by 388 · cited 1×
“Some HCI scholars have also raised questions about the limits and effectiveness of transparency based strategies in sociotechnical systems [14, 30, 33, 47].”
BackgroundTrust building with explanation interfaces
Pu, P., & Chen, L. (2006) · Proceedings of the 11th international conference on Intelligent user interfaces · doi:10.1145/1111449.1111475 · Cited by 300 · cited 1×
“The importance of explanations in providing system transparency and thereby increasing user acceptance has been demonstrated in many areas: e-commerce environments [46, 61], expert systems [34], medical decision support systems [2], and data exploration systems [7].”
BackgroundHuman-Machine Collaboration for Content Regulation: The Case of Reddit Automoderator
Jhaver, S., Birman, I., Gilbert, E., & Bruckman, A. (2019) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3338243 · Cited by 289
Self-citationChandrasekharan, E., Samory, M., Jhaver, S., Charvat, H., Bruckman, A., Lampe, C., Eisenstein, J., & Gilbert, E. (2018) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3274301 · Cited by 282
Self-citation
Research works printed but not linked: 44
- 10.1145/2675133.2675257 · DOI
- Sumit Asthana and Aaron Halfaker . 2018 . With Few Eyes , All Hoaxes Are Deep. Proc. ACM Hum.-Comput. Interact. , Vol. 2 , CSCW, Article 21 (Nov. 2018), bibinfonumpages 18 pages. https://doi.org/10 .1145/3274290 Sumit Asthana and Aaron Halfaker. 2018. With Few Eyes, All Hoaxes Are Deep. Proc. ACM Hum.-Comput. Interact. , Vol. 2, CSCW, Article 21 (Nov. 2018), bibinfonumpages18 pages. https://doi.org/10.1145/3274290 · DOI
- Albert Breton . 2007. The economics of transparency in politics . Ashgate Publishing, Ltd. Albert Breton. 2007. The economics of transparency in politics .Ashgate Publishing, Ltd.
- Giuseppe Carenini and Johanna Moore . 1998 . Multimedia explanations in IDEA decision support system . In Working Notes of the AAAI Spring Symposium on Interactive and Mixed-Initiative Decision Theoretic Systems . 16--22 . Giuseppe Carenini and Johanna Moore. 1998. Multimedia explanations in IDEA decision support system. In Working Notes of the AAAI Spring Symposium on Interactive and Mixed-Initiative Decision Theoretic Systems . 16--22.
- 10.1145/2858036.2858248 · DOI · Paper page
- 10.1016/j.telpol.2015.04.003 · DOI · Paper page
- 10.1145/2702123.2702556 · DOI · Paper page
- Archon Fung , Mary Graham , and David Weil . 2007. Full disclosure: The perils and promise of transparency . Cambridge University Press . Archon Fung, Mary Graham, and David Weil. 2007. Full disclosure: The perils and promise of transparency .Cambridge University Press.
- Society Vol. 1 1 (2015) 2056305115580479. Society Vol. 1 1 (2015) 2056305115580479.
- Tarleton Gillespie . 2017. Governance of and by platforms . Sage handbook of social media. London : Sage ( 2017 ). Tarleton Gillespie. 2017. Governance of and by platforms. Sage handbook of social media. London: Sage (2017).
- Tarleton Gillespie . 2018. Custodians of the Internet: Platforms, content moderation, and the hidden decisions that shape social media . Yale University Press . Tarleton Gillespie. 2018. Custodians of the Internet: Platforms, content moderation, and the hidden decisions that shape social media .Yale University Press.
- Robert Gorwa . 2019. What is platform governance? Information , Communication & Society ( 2019 ), 1--18. Robert Gorwa. 2019. What is platform governance? Information, Communication & Society (2019), 1--18.
- Nelson Granados and Alok Gupta . 2013. Transparency strategy: Competing with information in a digital world. MIS quarterly , Vol. 37 , 2 ( 2013 ). Nelson Granados and Alok Gupta. 2013. Transparency strategy: Competing with information in a digital world. MIS quarterly , Vol. 37, 2 (2013).
- James Grimmelmann . 2015 . The virtues of moderation . Yale JL & Tech. , Vol. 17 (2015), 42 . James Grimmelmann. 2015. The virtues of moderation. Yale JL & Tech. , Vol. 17 (2015), 42.
- Natali Helberger , Jo Pierson , and Thomas Poell . 2018. Governing online platforms: From contested to cooperative responsibility. The information society , Vol. 34 , 1 ( 2018 ), 1--14. Natali Helberger, Jo Pierson, and Thomas Poell. 2018. Governing online platforms: From contested to cooperative responsibility. The information society , Vol. 34, 1 (2018), 1--14.
- Shagun Jhaver , Darren Scott Appling , Eric Gilbert , and Amy Bruckman . 2018 a. “ Did You Suspect the Post Would be Removed?: User Reactions to Content Removals on Reddit . Proceedings of the ACM on Human-Computer Interaction , Vol. 2 , CSCW (2018), 33. Shagun Jhaver, Darren Scott Appling, Eric Gilbert, and Amy Bruckman. 2018a. “Did You Suspect the Post Would be Removed?: User Reactions to Content Removals on Reddit. Proceedings of the ACM on Human-Computer Interaction , Vol. 2, CSCW (2018), 33.
- 10.5210/fm.v23i2.8232 · DOI · Paper page
- 10.1145/3173574.3173995 · DOI · Paper page
- Sara Kiesler , Robert Kraut , and Paul Resnick . 2012. Regulating behavior in online communities . Building Successful Online Communities: Evidence-Based Social Design ( 2012 ). Sara Kiesler, Robert Kraut, and Paul Resnick. 2012. Regulating behavior in online communities . Building Successful Online Communities: Evidence-Based Social Design (2012).
- 10.1016/0004-3702(94)90053-1 · DOI
- 10.1145/1240624.1240815 · DOI
- 10.1145/985692.985761 · DOI · Paper page
- 10.1016/j.giq.2013.11.005 · DOI · Paper page
- David Laniado , Riccardo Tasso , Yana Volkovich , and Andreas Kaltenbrunner . 2011 . When the Wikipedians talk: Network and tree structure of Wikipedia discussion pages . In Fifth International AAAI Conference on Weblogs and Social Media . David Laniado, Riccardo Tasso, Yana Volkovich, and Andreas Kaltenbrunner. 2011. When the Wikipedians talk: Network and tree structure of Wikipedia discussion pages. In Fifth International AAAI Conference on Weblogs and Social Media .
- 10.1145/3025453.3025830 · DOI · Paper page
- 10.1609/icwsm.v13i01.3237 · DOI · Paper page
- 10.1145/2441776.2441871 · DOI · Paper page
- 10.5555/1857999.1858011 · doi:10.5555/1857999.1858011
- David B Nieborg and Thomas Poell . 2018. The platformization of cultural production: Theorizing the contingent cultural commodity. new media & society , Vol. 20 , 11 ( 2018 ), 4275--4292. David B Nieborg and Thomas Poell. 2018. The platformization of cultural production: Theorizing the contingent cultural commodity. new media & society , Vol. 20, 11 (2018), 4275--4292.
- 10.1080/10627260802153421 · DOI · Paper page
- Sarah Roberts . 2016. Commercial Content Moderation: Digital Laborers' Dirty Work . Media Studies Publications ( jan 2016 ). https://ir.lib.uwo.ca/commpub/12 Sarah Roberts. 2016. Commercial Content Moderation: Digital Laborers' Dirty Work . Media Studies Publications (jan 2016). https://ir.lib.uwo.ca/commpub/12
- Jodi Schneider , John G Breslin , and Alexandre Passant . 2010. A content analysis: How Wikipedia talk pages are used. Web Science ( 2010 ). Jodi Schneider, John G Breslin, and Alexandre Passant. 2010. A content analysis: How Wikipedia talk pages are used. Web Science (2010).
- Mark Scott and Mike Isaac . 2016. Facebook restores iconic Vietnam War photo it censored for nudity. The New York Times ( 2016 ). Mark Scott and Mike Isaac. 2016. Facebook restores iconic Vietnam War photo it censored for nudity. The New York Times (2016).
- 10.1145/2998181.2998277 · DOI · Paper page
- 10.1177/1461444818821316 · DOI · Paper page
- 10.1145/3173574.3174169 · DOI
- Nicolas Suzor. 2018. Digital constitutionalism: Using the rule of law to evaluate the legitimacy of governance by platforms. Social Media Nicolas Suzor. 2018. Digital constitutionalism: Using the rule of law to evaluate the legitimacy of governance by platforms. Social Media · DOI · Paper page
- Society Vol. 4 3 (2018) 2056305118787812. Society Vol. 4 3 (2018) 2056305118787812.
- 10.1177/1748048518757142 · DOI · Paper page
- Nicolas P Suzor , Sarah Myers West , Andrew Quodling , and Jillian York . 2019 . What Do We Mean When We Talk About Transparency? Toward Meaningful Transparency in Commercial Content Moderation . International Journal of Communication , Vol. 13 (2019), 18 . Nicolas P Suzor, Sarah Myers West, Andrew Quodling, and Jillian York. 2019. What Do We Mean When We Talk About Transparency? Toward Meaningful Transparency in Commercial Content Moderation. International Journal of Communication , Vol. 13 (2019), 18.
- 10.1145/1553374.1553515 · DOI · Paper page
- 10.2753/MIS0742-1222230410 · DOI · Paper page
- 10.1145/2675133.2675241 · DOI · Paper page
- Sarah Myers West . 2018. Censored , suspended, shadowbanned: User interpretations of content moderation on social media platforms . New Media & Society ( 2018 ). Sarah Myers West. 2018. Censored, suspended, shadowbanned: User interpretations of content moderation on social media platforms. New Media & Society (2018).
Cited by
Baumgartner, J., Zannettou, S., Keegan, B., Squire, M., & Blackburn, J. (2020) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v14i1.7347 · Cited by 881
Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance
Bansal, G., Wu, T., Zhou, J., Fok, R., Nushi, B., Kamar, E., Ribeiro, M. T., & Weld, D. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445717 · Cited by 757
“ations. 2 BACKGROUND AND RELATED WORK AI explanations are useful in many scenarios: communicating model predictions [17, 30, 33, 56], teaching humans tasks like translation [48] or content moderation [28], augmenting human analysis procedure [28] or creativity [14], legal imperatives [51, 64], and others. An assumptio…”
BackgroundDoes the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance
Bansal, G., Wu, T., Zhou, J., Fok, R., Nushi, B., Kamar, E., Ribeiro, M. T., & Weld, D. S. (2020) · arXiv · doi:10.48550/arxiv.2006.14779 · Cited by 754
Human-Machine Collaboration for Content Regulation: The Case of Reddit Automoderator
Jhaver, S., Birman, I., Gilbert, E., & Bruckman, A. (2019) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3338243 · Cited by 289
Self-citationZhou, J., Zhang, Y., Luo, Q., Parker, A. G., & De Choudhury, M. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581318 · Cited by 288
A Case for Humans-in-the-Loop: Decisions in the Presence of Erroneous Algorithmic Scores
De-Arteaga, M., Fogliato, R., & Chouldechova, A. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376638 · Cited by 221
Evaluating the Effectiveness of Deplatforming as a Moderation Strategy on Twitter
Jhaver, S., Boylston, C., Yang, D., & Bruckman, A. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3479525 · Cited by 169
Self-citationQuarantined! Examining the Effects of a Community-Wide Moderation Intervention on Reddit
Chandrasekharan, E., Jhaver, S., Bruckman, A., & Gilbert, E. (2022) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3490499 · Cited by 129
Self-citationMa, R., & Kou, Y. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3479573 · Cited by 102
“Upon Reddit’s API, this package allowed us to filter out all historical threads having specific keywords in either content, user comments, or titles.”
BackgroundInfluentialContestability For Content Moderation
Vaccaro, K., Xiao, Z., Hamilton, K., & Karahalios, K. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3476059 · Cited by 77
SolutionChat: Real-time Moderator Support for Chat-based Structured Discussion
Lee, S.-C., Song, J., Ko, E.-Y., Park, S., Kim, J., & Kim, J. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376609 · Cited by 49
“For content moderation, algorithms are increasingly used to fully automate the moderation process [21] or collaborate with humans [20].”
MethodAllison, K. R., Patterson, P., Guilbert, D., Noke, M., & Husson, O. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3449169 · Cited by 34
“[158, 161, 165, 166]), although it remains relatively unclear how these practices shape the psychosocial benefits experienced by community members [125].”
BackgroundWhose Knowledge is Valued? Epistemic Injustice in CSCW Applications
Ajmani, L. H., Foriest, J. C., Taylor, J., Pittman, K., Gilbert, S., & DeVito, M. A. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3687062 · Cited by 30
Content moderation by LLM: from accuracy to legitimacy
Huang, T. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11328-1 · Cited by 24
“In addition, reading explanations of moderation decisions is an educational opportunity for users to learn and internalize the community norms [59].”
Background"Taking Care of a Fruit Tree": Nurturing as a Layer of Concern in Online Community Moderation
Yu, B., Seering, J., Spiel, K., & Watts, L. (2020) · Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3334480.3383009 · Cited by 22
Thach, H., Mayworm, S., Thomas, M., & Haimson, O. L. (2024) · The 2024 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3630106.3658909 · Cited by 14
“Community-based moderation tasks vary by platform but involve regulating user behaviors, enforcing community guidelines, and removing harmful content [8, 32, 41, 49, 54].”
Background
Metadata
- Authors
- Jhaver, S., Bruckman, A., & Gilbert, E.
- Venue
- Proceedings of the ACM on Human-Computer Interaction
- Published
- 2019-11-07
- Volume
- 3
- Issue
- CSCW
- Pages
- 1-27
- ISSN
- 2573-0142 (ISSN-L)
- OpenAlex
- W2989364584
- Cited by
- 203
- References
- 16
- FWCI
- 8.40
- Type
- journal article
- Language
- en
- Open access
- bronze
- Funders
- National Science Foundation (IIS-1553376)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.