Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat
Cited by 203

The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.

Does Transparency in Moderation Really Matter?: User Behavior After Content Removal Explanations on Reddit

Open access
Jhaver, Shagun, Bruckman, Amy, Gilbert, Eric · 2019 · Proceedings of the ACM on Human-Computer Interaction

Abstract

When posts are removed on a social media platform, users may or may not receive an explanation. What kinds of explanations are provided? Do those explanations matter? Using a sample of 32 million Reddit posts, we characterize the removal explanations that are provided to Redditors, and link them to measures of subsequent user behaviors---including future post submissions and future post removals. Adopting a topic modeling approach, we show that removal explanations often provide information that educate users about the social norms of the community, thereby (theoretically) preparing them to become a productive member. We build regression models that show evidence of removal explanations playing a role in future user activity. Most importantly, we show that offering explanations for content moderation reduces the odds of future post removals. Additionally, explanations provided by human moderators did not have a significant advantage over explanations provided by bots for reducing future post removals. We propose design solutions that can promote the efficient use of explanation mechanisms, reflecting on how automated moderation tools can contribute to this space. Overall, our findings suggest that removal explanations may be under-utilized in moderation practices, and it is potentially worthwhile for community managers to invest time and resources into providing them.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3359252

Cites

11 of 11 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 49

  1. 10.1145/2675133.2675257 · DOI
  2. Sumit Asthana and Aaron Halfaker . 2018 . With Few Eyes , All Hoaxes Are Deep. Proc. ACM Hum.-Comput. Interact. , Vol. 2 , CSCW, Article 21 (Nov. 2018), bibinfonumpages 18 pages. https://doi.org/10 .1145/3274290 Sumit Asthana and Aaron Halfaker. 2018. With Few Eyes, All Hoaxes Are Deep. Proc. ACM Hum.-Comput. Interact. , Vol. 2, CSCW, Article 21 (Nov. 2018), bibinfonumpages18 pages. https://doi.org/10.1145/3274290 · DOI
  3. 10.5555/944919.944937 · doi:10.5555/944919.944937
  4. Albert Breton . 2007. The economics of transparency in politics . Ashgate Publishing, Ltd. Albert Breton. 2007. The economics of transparency in politics .Ashgate Publishing, Ltd.
  5. Giuseppe Carenini and Johanna Moore . 1998 . Multimedia explanations in IDEA decision support system . In Working Notes of the AAAI Spring Symposium on Interactive and Mixed-Initiative Decision Theoretic Systems . 16--22 . Giuseppe Carenini and Johanna Moore. 1998. Multimedia explanations in IDEA decision support system. In Working Notes of the AAAI Spring Symposium on Interactive and Mixed-Initiative Decision Theoretic Systems . 16--22.
  6. 10.1145/2858036.2858248 · DOI
  7. 10.1145/3134666 · DOI · Paper page
  8. 10.1177/1461444814543163 · DOI · Paper page
  9. 10.1016/j.telpol.2015.04.003 · DOI · Paper page
  10. 10.1145/2702123.2702556 · DOI · Paper page
  11. Archon Fung , Mary Graham , and David Weil . 2007. Full disclosure: The perils and promise of transparency . Cambridge University Press . Archon Fung, Mary Graham, and David Weil. 2007. Full disclosure: The perils and promise of transparency .Cambridge University Press.
  12. 10.1111/j.1083-6101.2012.01574.x · DOI · Paper page
  13. Society Vol. 1 1 (2015) 2056305115580479. Society Vol. 1 1 (2015) 2056305115580479.
  14. Tarleton Gillespie . 2017. Governance of and by platforms . Sage handbook of social media. London : Sage ( 2017 ). Tarleton Gillespie. 2017. Governance of and by platforms. Sage handbook of social media. London: Sage (2017).
  15. Tarleton Gillespie . 2018. Custodians of the Internet: Platforms, content moderation, and the hidden decisions that shape social media . Yale University Press . Tarleton Gillespie. 2018. Custodians of the Internet: Platforms, content moderation, and the hidden decisions that shape social media .Yale University Press.
  16. Robert Gorwa . 2019. What is platform governance? Information , Communication & Society ( 2019 ), 1--18. Robert Gorwa. 2019. What is platform governance? Information, Communication & Society (2019), 1--18.
  17. Nelson Granados and Alok Gupta . 2013. Transparency strategy: Competing with information in a digital world. MIS quarterly , Vol. 37 , 2 ( 2013 ). Nelson Granados and Alok Gupta. 2013. Transparency strategy: Competing with information in a digital world. MIS quarterly , Vol. 37, 2 (2013).
  18. James Grimmelmann . 2015 . The virtues of moderation . Yale JL & Tech. , Vol. 17 (2015), 42 . James Grimmelmann. 2015. The virtues of moderation. Yale JL & Tech. , Vol. 17 (2015), 42.
  19. Natali Helberger , Jo Pierson , and Thomas Poell . 2018. Governing online platforms: From contested to cooperative responsibility. The information society , Vol. 34 , 1 ( 2018 ), 1--14. Natali Helberger, Jo Pierson, and Thomas Poell. 2018. Governing online platforms: From contested to cooperative responsibility. The information society , Vol. 34, 1 (2018), 1--14.
  20. Shagun Jhaver , Darren Scott Appling , Eric Gilbert , and Amy Bruckman . 2018 a. “ Did You Suspect the Post Would be Removed?: User Reactions to Content Removals on Reddit . Proceedings of the ACM on Human-Computer Interaction , Vol. 2 , CSCW (2018), 33. Shagun Jhaver, Darren Scott Appling, Eric Gilbert, and Amy Bruckman. 2018a. “Did You Suspect the Post Would be Removed?: User Reactions to Content Removals on Reddit. Proceedings of the ACM on Human-Computer Interaction , Vol. 2, CSCW (2018), 33.
  21. 10.1145/3338243 · DOI · Paper page
  22. 10.5210/fm.v23i2.8232 · DOI
  23. 10.1145/3173574.3173995 · DOI
  24. Sara Kiesler , Robert Kraut , and Paul Resnick . 2012. Regulating behavior in online communities . Building Successful Online Communities: Evidence-Based Social Design ( 2012 ). Sara Kiesler, Robert Kraut, and Paul Resnick. 2012. Regulating behavior in online communities . Building Successful Online Communities: Evidence-Based Social Design (2012).
  25. 10.1016/0004-3702(94)90053-1 · DOI
  26. 10.1145/1240624.1240815 · DOI
  27. 10.1145/985692.985761 · DOI · Paper page
  28. 10.1016/j.giq.2013.11.005 · DOI · Paper page
  29. David Laniado , Riccardo Tasso , Yana Volkovich , and Andreas Kaltenbrunner . 2011 . When the Wikipedians talk: Network and tree structure of Wikipedia discussion pages . In Fifth International AAAI Conference on Weblogs and Social Media . David Laniado, Riccardo Tasso, Yana Volkovich, and Andreas Kaltenbrunner. 2011. When the Wikipedians talk: Network and tree structure of Wikipedia discussion pages. In Fifth International AAAI Conference on Weblogs and Social Media .
  30. 10.1145/3025453.3025830 · DOI
  31. 10.1609/icwsm.v13i01.3237 · DOI · Paper page
  32. 10.1145/2441776.2441871 · DOI
  33. 10.5555/1857999.1858011 · doi:10.5555/1857999.1858011
  34. David B Nieborg and Thomas Poell . 2018. The platformization of cultural production: Theorizing the contingent cultural commodity. new media & society , Vol. 20 , 11 ( 2018 ), 4275--4292. David B Nieborg and Thomas Poell. 2018. The platformization of cultural production: Theorizing the contingent cultural commodity. new media & society , Vol. 20, 11 (2018), 4275--4292.
  35. 10.1080/10627260802153421 · DOI · Paper page
  36. Sarah Roberts . 2016. Commercial Content Moderation: Digital Laborers' Dirty Work . Media Studies Publications ( jan 2016 ). https://ir.lib.uwo.ca/commpub/12 Sarah Roberts. 2016. Commercial Content Moderation: Digital Laborers' Dirty Work . Media Studies Publications (jan 2016). https://ir.lib.uwo.ca/commpub/12
  37. Jodi Schneider , John G Breslin , and Alexandre Passant . 2010. A content analysis: How Wikipedia talk pages are used. Web Science ( 2010 ). Jodi Schneider, John G Breslin, and Alexandre Passant. 2010. A content analysis: How Wikipedia talk pages are used. Web Science (2010).
  38. Mark Scott and Mike Isaac . 2016. Facebook restores iconic Vietnam War photo it censored for nudity. The New York Times ( 2016 ). Mark Scott and Mike Isaac. 2016. Facebook restores iconic Vietnam War photo it censored for nudity. The New York Times (2016).
  39. 10.1145/2998181.2998277 · DOI · Paper page
  40. 10.1177/1461444818821316 · DOI · Paper page
  41. 10.1145/3173574.3174169 · DOI
  42. Nicolas Suzor. 2018. Digital constitutionalism: Using the rule of law to evaluate the legitimacy of governance by platforms. Social Media Nicolas Suzor. 2018. Digital constitutionalism: Using the rule of law to evaluate the legitimacy of governance by platforms. Social Media · DOI · Paper page
  43. Society Vol. 4 3 (2018) 2056305118787812. Society Vol. 4 3 (2018) 2056305118787812.
  44. 10.1177/1748048518757142 · DOI
  45. Nicolas P Suzor , Sarah Myers West , Andrew Quodling , and Jillian York . 2019 . What Do We Mean When We Talk About Transparency? Toward Meaningful Transparency in Commercial Content Moderation . International Journal of Communication , Vol. 13 (2019), 18 . Nicolas P Suzor, Sarah Myers West, Andrew Quodling, and Jillian York. 2019. What Do We Mean When We Talk About Transparency? Toward Meaningful Transparency in Commercial Content Moderation. International Journal of Communication , Vol. 13 (2019), 18.
  46. 10.1145/1553374.1553515 · DOI · Paper page
  47. 10.2753/MIS0742-1222230410 · DOI · Paper page
  48. 10.1145/2675133.2675241 · DOI
  49. Sarah Myers West . 2018. Censored , suspended, shadowbanned: User interpretations of content moderation on social media platforms . New Media & Society ( 2018 ). Sarah Myers West. 2018. Censored, suspended, shadowbanned: User interpretations of content moderation on social media platforms. New Media & Society (2018).

Cited by

See all 203

Metadata

Authors
Jhaver, S., Bruckman, A., & Gilbert, E.
Venue
Proceedings of the ACM on Human-Computer Interaction
Published
2019-11-07
Volume
3
Issue
CSCW
Pages
1-27
ISSN
2573-0142 (ISSN-L)
OpenAlex
W2989364584
Cited by
203
References
11
FWCI
8.40
Type
journal article
Language
en
Open access
bronze
Funders
National Science Foundation (IIS-1553376)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.