The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Does Transparency in Moderation Really Matter?: User Behavior After Content Removal Explanations on Reddit
Open accessAbstract
When posts are removed on a social media platform, users may or may not receive an explanation. What kinds of explanations are provided? Do those explanations matter? Using a sample of 32 million Reddit posts, we characterize the removal explanations that are provided to Redditors, and link them to measures of subsequent user behaviors---including future post submissions and future post removals. Adopting a topic modeling approach, we show that removal explanations often provide information that educate users about the social norms of the community, thereby (theoretically) preparing them to become a productive member. We build regression models that show evidence of removal explanations playing a role in future user activity. Most importantly, we show that offering explanations for content moderation reduces the odds of future post removals. Additionally, explanations provided by human moderators did not have a significant advantage over explanations provided by bots for reducing future post removals. We propose design solutions that can promote the efficient use of explanation mechanisms, reflecting on how automated moderation tools can contribute to this space. Overall, our findings suggest that removal explanations may be under-utilized in moderation practices, and it is potentially worthwhile for community managers to invest time and resources into providing them.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Explaining collaborative filtering recommendations
Herlocker, J. L., Konstan, J. A., & Riedl, J. (2000) · Proceedings of the 2000 ACM conference on Computer supported cooperative work · doi:10.1145/358916.358995 · Cited by 1,731
How Much Information?: Effects of Transparency on Trust in an Algorithmic Interface
Kizilcec, R. F. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858402 · Cited by 615
Explanations as Mechanisms for Supporting Algorithmic Transparency
Rader, E., Cotter, K., & Cho, J. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173677 · Cited by 388 · cited 1×
“Some HCI scholars have also raised questions about the limits and effectiveness of transparency based strategies in sociotechnical systems [14, 30, 33, 47].”
BackgroundTrust building with explanation interfaces
Pu, P., & Chen, L. (2006) · Proceedings of the 11th international conference on Intelligent user interfaces · doi:10.1145/1111449.1111475 · Cited by 300 · cited 1×
“The importance of explanations in providing system transparency and thereby increasing user acceptance has been demonstrated in many areas: e-commerce environments [46, 61], expert systems [34], medical decision support systems [2], and data exploration systems [7].”
BackgroundChandrasekharan, E., Samory, M., Jhaver, S., Charvat, H., Bruckman, A., Lampe, C., Eisenstein, J., & Gilbert, E. (2018) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3274301 · Cited by 282
Self-citationOnline Harassment and Content Moderation: The Case of Blocklists
Jhaver, S., Ghoshal, S., Bruckman, A., & Gilbert, E. (2018) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3185593 · Cited by 270
Self-citationThe work of sustaining order in wikipedia: the banning of a vandal
Geiger, R. S., & Ribes, D. (2010) · Proceedings of the 2010 ACM conference on Computer supported cooperative work · doi:10.1145/1718918.1718941 · Cited by 245
Value-Sensitive Algorithm Design: Method, Case Study, and Lessons
Zhu, H., Yu, B., Halfaker, A., & Terveen, L. (2018) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3274463 · Cited by 220
User attitudes towards algorithmic opacity and transparency in online reviewing platforms
Eslami, M., Vaccaro, K., Lee, M. K., Elazari Bar On, A., Gilbert, E., & Karahalios, K. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300724 · Cited by 184
Gillespie, T. (2015) · Social Media + Society · doi:10.1177/2056305115580479 · Cited by 148
Individual Prognosis of Diabetes Long-term Risks: A CBR Approach
Palaudàries, A., Plaza, E., & Armengol, E. (2001) · Methods of Information in Medicine · doi:10.1055/s-0038-1634463 · Cited by 45
Research works printed but not linked: 49
- 10.1145/2675133.2675257 · DOI
- Sumit Asthana and Aaron Halfaker . 2018 . With Few Eyes , All Hoaxes Are Deep. Proc. ACM Hum.-Comput. Interact. , Vol. 2 , CSCW, Article 21 (Nov. 2018), bibinfonumpages 18 pages. https://doi.org/10 .1145/3274290 Sumit Asthana and Aaron Halfaker. 2018. With Few Eyes, All Hoaxes Are Deep. Proc. ACM Hum.-Comput. Interact. , Vol. 2, CSCW, Article 21 (Nov. 2018), bibinfonumpages18 pages. https://doi.org/10.1145/3274290 · DOI
- 10.5555/944919.944937 · doi:10.5555/944919.944937
- Albert Breton . 2007. The economics of transparency in politics . Ashgate Publishing, Ltd. Albert Breton. 2007. The economics of transparency in politics .Ashgate Publishing, Ltd.
- Giuseppe Carenini and Johanna Moore . 1998 . Multimedia explanations in IDEA decision support system . In Working Notes of the AAAI Spring Symposium on Interactive and Mixed-Initiative Decision Theoretic Systems . 16--22 . Giuseppe Carenini and Johanna Moore. 1998. Multimedia explanations in IDEA decision support system. In Working Notes of the AAAI Spring Symposium on Interactive and Mixed-Initiative Decision Theoretic Systems . 16--22.
- 10.1145/2858036.2858248 · DOI
- 10.1145/3134666 · DOI · Paper page
- 10.1177/1461444814543163 · DOI · Paper page
- 10.1016/j.telpol.2015.04.003 · DOI · Paper page
- 10.1145/2702123.2702556 · DOI · Paper page
- Archon Fung , Mary Graham , and David Weil . 2007. Full disclosure: The perils and promise of transparency . Cambridge University Press . Archon Fung, Mary Graham, and David Weil. 2007. Full disclosure: The perils and promise of transparency .Cambridge University Press.
- 10.1111/j.1083-6101.2012.01574.x · DOI · Paper page
- Society Vol. 1 1 (2015) 2056305115580479. Society Vol. 1 1 (2015) 2056305115580479.
- Tarleton Gillespie . 2017. Governance of and by platforms . Sage handbook of social media. London : Sage ( 2017 ). Tarleton Gillespie. 2017. Governance of and by platforms. Sage handbook of social media. London: Sage (2017).
- Tarleton Gillespie . 2018. Custodians of the Internet: Platforms, content moderation, and the hidden decisions that shape social media . Yale University Press . Tarleton Gillespie. 2018. Custodians of the Internet: Platforms, content moderation, and the hidden decisions that shape social media .Yale University Press.
- Robert Gorwa . 2019. What is platform governance? Information , Communication & Society ( 2019 ), 1--18. Robert Gorwa. 2019. What is platform governance? Information, Communication & Society (2019), 1--18.
- Nelson Granados and Alok Gupta . 2013. Transparency strategy: Competing with information in a digital world. MIS quarterly , Vol. 37 , 2 ( 2013 ). Nelson Granados and Alok Gupta. 2013. Transparency strategy: Competing with information in a digital world. MIS quarterly , Vol. 37, 2 (2013).
- James Grimmelmann . 2015 . The virtues of moderation . Yale JL & Tech. , Vol. 17 (2015), 42 . James Grimmelmann. 2015. The virtues of moderation. Yale JL & Tech. , Vol. 17 (2015), 42.
- Natali Helberger , Jo Pierson , and Thomas Poell . 2018. Governing online platforms: From contested to cooperative responsibility. The information society , Vol. 34 , 1 ( 2018 ), 1--14. Natali Helberger, Jo Pierson, and Thomas Poell. 2018. Governing online platforms: From contested to cooperative responsibility. The information society , Vol. 34, 1 (2018), 1--14.
- Shagun Jhaver , Darren Scott Appling , Eric Gilbert , and Amy Bruckman . 2018 a. “ Did You Suspect the Post Would be Removed?: User Reactions to Content Removals on Reddit . Proceedings of the ACM on Human-Computer Interaction , Vol. 2 , CSCW (2018), 33. Shagun Jhaver, Darren Scott Appling, Eric Gilbert, and Amy Bruckman. 2018a. “Did You Suspect the Post Would be Removed?: User Reactions to Content Removals on Reddit. Proceedings of the ACM on Human-Computer Interaction , Vol. 2, CSCW (2018), 33.
- 10.1145/3338243 · DOI · Paper page
- 10.5210/fm.v23i2.8232 · DOI
- 10.1145/3173574.3173995 · DOI
- Sara Kiesler , Robert Kraut , and Paul Resnick . 2012. Regulating behavior in online communities . Building Successful Online Communities: Evidence-Based Social Design ( 2012 ). Sara Kiesler, Robert Kraut, and Paul Resnick. 2012. Regulating behavior in online communities . Building Successful Online Communities: Evidence-Based Social Design (2012).
- 10.1016/0004-3702(94)90053-1 · DOI
- 10.1145/1240624.1240815 · DOI
- 10.1145/985692.985761 · DOI · Paper page
- 10.1016/j.giq.2013.11.005 · DOI · Paper page
- David Laniado , Riccardo Tasso , Yana Volkovich , and Andreas Kaltenbrunner . 2011 . When the Wikipedians talk: Network and tree structure of Wikipedia discussion pages . In Fifth International AAAI Conference on Weblogs and Social Media . David Laniado, Riccardo Tasso, Yana Volkovich, and Andreas Kaltenbrunner. 2011. When the Wikipedians talk: Network and tree structure of Wikipedia discussion pages. In Fifth International AAAI Conference on Weblogs and Social Media .
- 10.1145/3025453.3025830 · DOI
- 10.1609/icwsm.v13i01.3237 · DOI · Paper page
- 10.1145/2441776.2441871 · DOI
- 10.5555/1857999.1858011 · doi:10.5555/1857999.1858011
- David B Nieborg and Thomas Poell . 2018. The platformization of cultural production: Theorizing the contingent cultural commodity. new media & society , Vol. 20 , 11 ( 2018 ), 4275--4292. David B Nieborg and Thomas Poell. 2018. The platformization of cultural production: Theorizing the contingent cultural commodity. new media & society , Vol. 20, 11 (2018), 4275--4292.
- 10.1080/10627260802153421 · DOI · Paper page
- Sarah Roberts . 2016. Commercial Content Moderation: Digital Laborers' Dirty Work . Media Studies Publications ( jan 2016 ). https://ir.lib.uwo.ca/commpub/12 Sarah Roberts. 2016. Commercial Content Moderation: Digital Laborers' Dirty Work . Media Studies Publications (jan 2016). https://ir.lib.uwo.ca/commpub/12
- Jodi Schneider , John G Breslin , and Alexandre Passant . 2010. A content analysis: How Wikipedia talk pages are used. Web Science ( 2010 ). Jodi Schneider, John G Breslin, and Alexandre Passant. 2010. A content analysis: How Wikipedia talk pages are used. Web Science (2010).
- Mark Scott and Mike Isaac . 2016. Facebook restores iconic Vietnam War photo it censored for nudity. The New York Times ( 2016 ). Mark Scott and Mike Isaac. 2016. Facebook restores iconic Vietnam War photo it censored for nudity. The New York Times (2016).
- 10.1145/2998181.2998277 · DOI · Paper page
- 10.1177/1461444818821316 · DOI · Paper page
- 10.1145/3173574.3174169 · DOI
- Nicolas Suzor. 2018. Digital constitutionalism: Using the rule of law to evaluate the legitimacy of governance by platforms. Social Media Nicolas Suzor. 2018. Digital constitutionalism: Using the rule of law to evaluate the legitimacy of governance by platforms. Social Media · DOI · Paper page
- Society Vol. 4 3 (2018) 2056305118787812. Society Vol. 4 3 (2018) 2056305118787812.
- 10.1177/1748048518757142 · DOI
- Nicolas P Suzor , Sarah Myers West , Andrew Quodling , and Jillian York . 2019 . What Do We Mean When We Talk About Transparency? Toward Meaningful Transparency in Commercial Content Moderation . International Journal of Communication , Vol. 13 (2019), 18 . Nicolas P Suzor, Sarah Myers West, Andrew Quodling, and Jillian York. 2019. What Do We Mean When We Talk About Transparency? Toward Meaningful Transparency in Commercial Content Moderation. International Journal of Communication , Vol. 13 (2019), 18.
- 10.1145/1553374.1553515 · DOI · Paper page
- 10.2753/MIS0742-1222230410 · DOI · Paper page
- 10.1145/2675133.2675241 · DOI
- Sarah Myers West . 2018. Censored , suspended, shadowbanned: User interpretations of content moderation on social media platforms . New Media & Society ( 2018 ). Sarah Myers West. 2018. Censored, suspended, shadowbanned: User interpretations of content moderation on social media platforms. New Media & Society (2018).
Cited by
Baumgartner, J., Zannettou, S., Keegan, B., Squire, M., & Blackburn, J. (2020) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v14i1.7347 · Cited by 881
Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance
Bansal, G., Wu, T., Zhou, J., Fok, R., Nushi, B., Kamar, E., Ribeiro, M. T., & Weld, D. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445717 · Cited by 757
“ations. 2 BACKGROUND AND RELATED WORK AI explanations are useful in many scenarios: communicating model predictions [17, 30, 33, 56], teaching humans tasks like translation [48] or content moderation [28], augmenting human analysis procedure [28] or creativity [14], legal imperatives [51, 64], and others. An assumptio…”
BackgroundDoes the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance
Bansal, G., Wu, T., Zhou, J., Fok, R., Nushi, B., Kamar, E., Ribeiro, M. T., & Weld, D. S. (2020) · arXiv · doi:10.48550/arxiv.2006.14779 · Cited by 754
Human-Machine Collaboration for Content Regulation: The Case of Reddit Automoderator
Jhaver, S., Birman, I., Gilbert, E., & Bruckman, A. (2019) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3338243 · Cited by 289
Self-citationZhou, J., Zhang, Y., Luo, Q., Parker, A. G., & De Choudhury, M. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581318 · Cited by 288
Metadata
- Authors
- Jhaver, S., Bruckman, A., & Gilbert, E.
- Venue
- Proceedings of the ACM on Human-Computer Interaction
- Published
- 2019-11-07
- Volume
- 3
- Issue
- CSCW
- Pages
- 1-27
- ISSN
- 2573-0142 (ISSN-L)
- OpenAlex
- W2989364584
- Cited by
- 203
- References
- 11
- FWCI
- 8.40
- Type
- journal article
- Language
- en
- Open access
- bronze
- Funders
- National Science Foundation (IIS-1553376)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.