CoChat

Does Transparency in Moderation Really Matter?: User Behavior After Content Removal Explanations on Reddit

Open access
Jhaver, Shagun, Bruckman, Amy, Gilbert, Eric · 2019 · Proceedings of the ACM on Human-Computer Interaction
Cited by 203

The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.

Abstract

When posts are removed on a social media platform, users may or may not receive an explanation. What kinds of explanations are provided? Do those explanations matter? Using a sample of 32 million Reddit posts, we characterize the removal explanations that are provided to Redditors, and link them to measures of subsequent user behaviors---including future post submissions and future post removals. Adopting a topic modeling approach, we show that removal explanations often provide information that educate users about the social norms of the community, thereby (theoretically) preparing them to become a productive member. We build regression models that show evidence of removal explanations playing a role in future user activity. Most importantly, we show that offering explanations for content moderation reduces the odds of future post removals. Additionally, explanations provided by human moderators did not have a significant advantage over explanations provided by bots for reducing future post removals. We propose design solutions that can promote the efficient use of explanation mechanisms, reflecting on how automated moderation tools can contribute to this space. Overall, our findings suggest that removal explanations may be under-utilized in moderation practices, and it is potentially worthwhile for community managers to invest time and resources into providing them.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3359252

Cites

16 of 16 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 16 references

Research works printed but not linked: 44

  1. 10.1145/2675133.2675257 · DOI
  2. Sumit Asthana and Aaron Halfaker . 2018 . With Few Eyes , All Hoaxes Are Deep. Proc. ACM Hum.-Comput. Interact. , Vol. 2 , CSCW, Article 21 (Nov. 2018), bibinfonumpages 18 pages. https://doi.org/10 .1145/3274290 Sumit Asthana and Aaron Halfaker. 2018. With Few Eyes, All Hoaxes Are Deep. Proc. ACM Hum.-Comput. Interact. , Vol. 2, CSCW, Article 21 (Nov. 2018), bibinfonumpages18 pages. https://doi.org/10.1145/3274290 · DOI
  3. Albert Breton . 2007. The economics of transparency in politics . Ashgate Publishing, Ltd. Albert Breton. 2007. The economics of transparency in politics .Ashgate Publishing, Ltd.
  4. Giuseppe Carenini and Johanna Moore . 1998 . Multimedia explanations in IDEA decision support system . In Working Notes of the AAAI Spring Symposium on Interactive and Mixed-Initiative Decision Theoretic Systems . 16--22 . Giuseppe Carenini and Johanna Moore. 1998. Multimedia explanations in IDEA decision support system. In Working Notes of the AAAI Spring Symposium on Interactive and Mixed-Initiative Decision Theoretic Systems . 16--22.
  5. 10.1145/2858036.2858248 · DOI · Paper page
  6. 10.1016/j.telpol.2015.04.003 · DOI · Paper page
  7. 10.1145/2702123.2702556 · DOI · Paper page
  8. Archon Fung , Mary Graham , and David Weil . 2007. Full disclosure: The perils and promise of transparency . Cambridge University Press . Archon Fung, Mary Graham, and David Weil. 2007. Full disclosure: The perils and promise of transparency .Cambridge University Press.
  9. Society Vol. 1 1 (2015) 2056305115580479. Society Vol. 1 1 (2015) 2056305115580479.
  10. Tarleton Gillespie . 2017. Governance of and by platforms . Sage handbook of social media. London : Sage ( 2017 ). Tarleton Gillespie. 2017. Governance of and by platforms. Sage handbook of social media. London: Sage (2017).
  11. Tarleton Gillespie . 2018. Custodians of the Internet: Platforms, content moderation, and the hidden decisions that shape social media . Yale University Press . Tarleton Gillespie. 2018. Custodians of the Internet: Platforms, content moderation, and the hidden decisions that shape social media .Yale University Press.
  12. Robert Gorwa . 2019. What is platform governance? Information , Communication & Society ( 2019 ), 1--18. Robert Gorwa. 2019. What is platform governance? Information, Communication & Society (2019), 1--18.
  13. Nelson Granados and Alok Gupta . 2013. Transparency strategy: Competing with information in a digital world. MIS quarterly , Vol. 37 , 2 ( 2013 ). Nelson Granados and Alok Gupta. 2013. Transparency strategy: Competing with information in a digital world. MIS quarterly , Vol. 37, 2 (2013).
  14. James Grimmelmann . 2015 . The virtues of moderation . Yale JL & Tech. , Vol. 17 (2015), 42 . James Grimmelmann. 2015. The virtues of moderation. Yale JL & Tech. , Vol. 17 (2015), 42.
  15. Natali Helberger , Jo Pierson , and Thomas Poell . 2018. Governing online platforms: From contested to cooperative responsibility. The information society , Vol. 34 , 1 ( 2018 ), 1--14. Natali Helberger, Jo Pierson, and Thomas Poell. 2018. Governing online platforms: From contested to cooperative responsibility. The information society , Vol. 34, 1 (2018), 1--14.
  16. Shagun Jhaver , Darren Scott Appling , Eric Gilbert , and Amy Bruckman . 2018 a. “ Did You Suspect the Post Would be Removed?: User Reactions to Content Removals on Reddit . Proceedings of the ACM on Human-Computer Interaction , Vol. 2 , CSCW (2018), 33. Shagun Jhaver, Darren Scott Appling, Eric Gilbert, and Amy Bruckman. 2018a. “Did You Suspect the Post Would be Removed?: User Reactions to Content Removals on Reddit. Proceedings of the ACM on Human-Computer Interaction , Vol. 2, CSCW (2018), 33.
  17. 10.5210/fm.v23i2.8232 · DOI · Paper page
  18. 10.1145/3173574.3173995 · DOI · Paper page
  19. Sara Kiesler , Robert Kraut , and Paul Resnick . 2012. Regulating behavior in online communities . Building Successful Online Communities: Evidence-Based Social Design ( 2012 ). Sara Kiesler, Robert Kraut, and Paul Resnick. 2012. Regulating behavior in online communities . Building Successful Online Communities: Evidence-Based Social Design (2012).
  20. 10.1016/0004-3702(94)90053-1 · DOI
  21. 10.1145/1240624.1240815 · DOI
  22. 10.1145/985692.985761 · DOI · Paper page
  23. 10.1016/j.giq.2013.11.005 · DOI · Paper page
  24. David Laniado , Riccardo Tasso , Yana Volkovich , and Andreas Kaltenbrunner . 2011 . When the Wikipedians talk: Network and tree structure of Wikipedia discussion pages . In Fifth International AAAI Conference on Weblogs and Social Media . David Laniado, Riccardo Tasso, Yana Volkovich, and Andreas Kaltenbrunner. 2011. When the Wikipedians talk: Network and tree structure of Wikipedia discussion pages. In Fifth International AAAI Conference on Weblogs and Social Media .
  25. 10.1145/3025453.3025830 · DOI · Paper page
  26. 10.1609/icwsm.v13i01.3237 · DOI · Paper page
  27. 10.1145/2441776.2441871 · DOI · Paper page
  28. 10.5555/1857999.1858011 · doi:10.5555/1857999.1858011
  29. David B Nieborg and Thomas Poell . 2018. The platformization of cultural production: Theorizing the contingent cultural commodity. new media & society , Vol. 20 , 11 ( 2018 ), 4275--4292. David B Nieborg and Thomas Poell. 2018. The platformization of cultural production: Theorizing the contingent cultural commodity. new media & society , Vol. 20, 11 (2018), 4275--4292.
  30. 10.1080/10627260802153421 · DOI · Paper page
  31. Sarah Roberts . 2016. Commercial Content Moderation: Digital Laborers' Dirty Work . Media Studies Publications ( jan 2016 ). https://ir.lib.uwo.ca/commpub/12 Sarah Roberts. 2016. Commercial Content Moderation: Digital Laborers' Dirty Work . Media Studies Publications (jan 2016). https://ir.lib.uwo.ca/commpub/12
  32. Jodi Schneider , John G Breslin , and Alexandre Passant . 2010. A content analysis: How Wikipedia talk pages are used. Web Science ( 2010 ). Jodi Schneider, John G Breslin, and Alexandre Passant. 2010. A content analysis: How Wikipedia talk pages are used. Web Science (2010).
  33. Mark Scott and Mike Isaac . 2016. Facebook restores iconic Vietnam War photo it censored for nudity. The New York Times ( 2016 ). Mark Scott and Mike Isaac. 2016. Facebook restores iconic Vietnam War photo it censored for nudity. The New York Times (2016).
  34. 10.1145/2998181.2998277 · DOI · Paper page
  35. 10.1177/1461444818821316 · DOI · Paper page
  36. 10.1145/3173574.3174169 · DOI
  37. Nicolas Suzor. 2018. Digital constitutionalism: Using the rule of law to evaluate the legitimacy of governance by platforms. Social Media Nicolas Suzor. 2018. Digital constitutionalism: Using the rule of law to evaluate the legitimacy of governance by platforms. Social Media · DOI · Paper page
  38. Society Vol. 4 3 (2018) 2056305118787812. Society Vol. 4 3 (2018) 2056305118787812.
  39. 10.1177/1748048518757142 · DOI · Paper page
  40. Nicolas P Suzor , Sarah Myers West , Andrew Quodling , and Jillian York . 2019 . What Do We Mean When We Talk About Transparency? Toward Meaningful Transparency in Commercial Content Moderation . International Journal of Communication , Vol. 13 (2019), 18 . Nicolas P Suzor, Sarah Myers West, Andrew Quodling, and Jillian York. 2019. What Do We Mean When We Talk About Transparency? Toward Meaningful Transparency in Commercial Content Moderation. International Journal of Communication , Vol. 13 (2019), 18.
  41. 10.1145/1553374.1553515 · DOI · Paper page
  42. 10.2753/MIS0742-1222230410 · DOI · Paper page
  43. 10.1145/2675133.2675241 · DOI · Paper page
  44. Sarah Myers West . 2018. Censored , suspended, shadowbanned: User interpretations of content moderation on social media platforms . New Media & Society ( 2018 ). Sarah Myers West. 2018. Censored, suspended, shadowbanned: User interpretations of content moderation on social media platforms. New Media & Society (2018).

Cited by

See all 203

Metadata

Authors
Jhaver, S., Bruckman, A., & Gilbert, E.
Venue
Proceedings of the ACM on Human-Computer Interaction
Published
2019-11-07
Volume
3
Issue
CSCW
Pages
1-27
ISSN
2573-0142 (ISSN-L)
OpenAlex
W2989364584
Cited by
203
References
16
FWCI
8.40
Type
journal article
Language
en
Open access
bronze
Funders
National Science Foundation (IIS-1553376)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Does Transparency in Moderation Really Matter?: User Behavior After Content Removal Explanations on Reddit. https://app.cochat.ai/papers/10.1145/3359252
The paper
Jhaver, S., Bruckman, A., & Gilbert, E. (2019). Does Transparency in Moderation Really Matter?: User Behavior After Content Removal Explanations on Reddit. Proceedings of the ACM on Human-Computer Interaction. https://doi.org/10.1145/3359252

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.