CoChat

Designing Word Filter Tools for Creator-led Comment Moderation

Open access
Jhaver, Shagun, Chen, Quan Ze, Knauss, Detlef, Zhang, Amy X. · 2022 · CHI Conference on Human Factors in Computing Systems
Cited by 69

The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.

Abstract

Online social platforms centered around content creators often allow comments on content, where creators can then moderate the comments they receive. As creators can face overwhelming numbers of comments, with some of them harassing or hateful, platforms typically provide tools such as word filters for creators to automate aspects of moderation. From needfinding interviews with 19 creators about how they use existing tools, we found that they struggled with writing good filters as well as organizing and revising their filters, due to the difficulty of determining what the filters actually catch. To address these issues, we present FilterBuddy, a system that supports creators in authoring new filters or building from pre-made ones, as well as organizing their filters and visualizing what comments are captured by them over time. We conducted an early-stage evaluation of FilterBuddy with YouTube creators, finding that participants see FilterBuddy not just as a moderation tool, but also a means to organize their comments to better understand their audiences.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3491102.3517505

Cites

32 of 32 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 32 references

Research works printed but not linked: 86

  1. Crystal Abidin . 2015 . Communicative Intimacies: Influencers and Percieved Interconnectedness. (2015). Crystal Abidin. 2015. Communicative Intimacies: Influencers and Percieved Interconnectedness. (2015).
  2. 10.1080/09589236.2017.1288611 · DOI · Paper page
  3. Lindsay Blackwell , Tianying Chen , Sarita Schoenebeck , and Cliff Lampe . 2018 . When Online Harassment is Perceived as Justified . In Twelfth International AAAI Conference on Web and Social Media. Lindsay Blackwell, Tianying Chen, Sarita Schoenebeck, and Cliff Lampe. 2018. When Online Harassment is Perceived as Justified. In Twelfth International AAAI Conference on Web and Social Media.
  4. Jean Burgess and Joshua Green . 2018. YouTube: Online video and participatory culture . John Wiley & Sons . Jean Burgess and Joshua Green. 2018. YouTube: Online video and participatory culture. John Wiley & Sons.
  5. 10.1145/3311957.3359478 · DOI
  6. Robyn Caplan and Tarleton Gillespie . 2020. Tiered governance and demonetization: The shifting terms of labor and compensation in the platform economy. Social Media+ Society 6, 2 ( 2020 ), 2056305120936636. Robyn Caplan and Tarleton Gillespie. 2020. Tiered governance and demonetization: The shifting terms of labor and compensation in the platform economy. Social Media+ Society 6, 2 (2020), 2056305120936636.
  7. Caitlin Ring Carlson , Luc Cousineau , and Caitlin Ring Carlson . 2020 . Are You Sure You Want to View This Community? Exploring the Ethics of Reddit’s Quarantine Practice . Journal of Media Ethics 00 , 00 (2020), 1 – 12 . https://doi.org/10.1080/23736992.2020.1819285 Caitlin Ring Carlson, Luc Cousineau, and Caitlin Ring Carlson. 2020. Are You Sure You Want to View This Community? Exploring the Ethics of Reddit’s Quarantine Practice. Journal of Media Ethics 00, 00 (2020), 1–12. https://doi.org/10.1080/23736992.2020.1819285 · DOI
  8. 10.1145/2858036.2858516 · DOI · Paper page
  9. 10.1145/3025453.3026018 · DOI · Paper page
  10. Kathy Charmaz. 2006. Constructing grounded theory: a practical guide through qualitative analysis. https://doi.org/10.1016/j.lisr.2007.11.003 arXiv:arXiv:1011.1669v3 Kathy Charmaz. 2006. Constructing grounded theory: a practical guide through qualitative analysis. https://doi.org/10.1016/j.lisr.2007.11.003 arXiv:arXiv:1011.1669v3 · arXiv · doi:10.1016/j.lisr.2007.11.003
  11. Clement Chau . 2010. YouTube as a participatory culture. New directions for youth development 2010 , 128 (2010), 65–74. Clement Chau. 2010. YouTube as a participatory culture. New directions for youth development 2010, 128 (2010), 65–74.
  12. A Chen. 2019. How YouTubers plan to take on YouTube for better working conditions. MIT Technology Review(2019). A Chen. 2019. How YouTubers plan to take on YouTube for better working conditions. MIT Technology Review(2019).
  13. 10.1177/1329878X17709098 · DOI · Paper page
  14. 10.1177/1354856518781530 · DOI · Paper page
  15. 10.1177/1461444816688457 · DOI · Paper page
  16. Jad Esber Boaz Sender Ethan Zuckerman Crystal Lee Nana Nwachukwu Oumou Ly Peter Suber Primavera De Filippi Sahar Massachi Samuel Klein 2021. A meta-proposal for Twitter’s bluesky project. Available at SSRN 3816729(2021). Jad Esber Boaz Sender Ethan Zuckerman Crystal Lee Nana Nwachukwu Oumou Ly Peter Suber Primavera De Filippi Sahar Massachi Samuel Klein 2021. A meta-proposal for Twitter’s bluesky project. Available at SSRN 3816729(2021). · DOI
  17. 10.1145/3001896 · DOI · Paper page
  18. Julia R. Fernandez and Jeremy Birnholtz. 2019. ”I Don’t Want Them to Not Know”: Investigating Decisions to Disclose Transgender Identity on Dating Platforms . Proc. ACM Hum.-Comput. Interact. 3, CSCW, Article 226 (nov 2019 ), 21 pages. https://doi.org/10.1145/3359328 Julia R. Fernandez and Jeremy Birnholtz. 2019. ”I Don’t Want Them to Not Know”: Investigating Decisions to Disclose Transgender Identity on Dating Platforms. Proc. ACM Hum.-Comput. Interact. 3, CSCW, Article 226 (nov 2019), 21 pages. https://doi.org/10.1145/3359328 · DOI · Paper page
  19. Jessica L. Feuston and Jed R. Brubaker. 2021. Putting Tools in Their Place: The Role of Time and Perspective in Human-AI Collaboration for Qualitative Analysis . Proc. ACM Hum.-Comput. Interact. 5, CSCW2, Article 469 (oct 2021 ), 25 pages. https://doi.org/10.1145/3479856 Jessica L. Feuston and Jed R. Brubaker. 2021. Putting Tools in Their Place: The Role of Time and Perspective in Human-AI Collaboration for Qualitative Analysis. Proc. ACM Hum.-Comput. Interact. 5, CSCW2, Article 469 (oct 2021), 25 pages. https://doi.org/10.1145/3479856 · DOI · Paper page
  20. 10.1007/s10606-020-09386-w · DOI
  21. 10.1177/1461444818776611 · DOI · Paper page
  22. Tarleton Gillespie . 2018. Custodians of the Internet: Platforms, content moderation, and the hidden decisions that shape social media . Yale University Press . Tarleton Gillespie. 2018. Custodians of the Internet: Platforms, content moderation, and the hidden decisions that shape social media. Yale University Press.
  23. Mary L Gray and Siddharth Suri . 2019. Ghost work: How to stop Silicon Valley from building a new global underclass . Eamon Dolan Books . Mary L Gray and Siddharth Suri. 2019. Ghost work: How to stop Silicon Valley from building a new global underclass. Eamon Dolan Books.
  24. 10.5555/3013642.3013648 · doi:10.5555/3013642.3013648
  25. 10.1145/3479610 · DOI · Paper page
  26. Ivan Hare and James Weinstein . 2009. Extreme Speech and Democracy . Oxford University Press , USA. Ivan Hare and James Weinstein. 2009. Extreme Speech and Democracy. Oxford University Press, USA.
  27. Susan Herring , Kirk Job-Sluder , Rebecca Scheckler , and Sasha Barab . 2002. Searching for safety online: Managing ” trolling” in a feminist forum. The information society 18, 5 ( 2002 ), 371–384. Susan Herring, Kirk Job-Sluder, Rebecca Scheckler, and Sasha Barab. 2002. Searching for safety online: Managing” trolling” in a feminist forum. The information society 18, 5 (2002), 371–384.
  28. Jane Im , Sonali Tandon , Eshwar Chandrasekharan , Taylor Denby , and Eric Gilbert . 2020. Synthesized Social Signals: Computationally-Derived Social Signals from Account Histories . Association for Computing Machinery , New York, NY, USA , 1–12. https://doi.org/10.1145/3313831.3376383 Jane Im, Sonali Tandon, Eshwar Chandrasekharan, Taylor Denby, and Eric Gilbert. 2020. Synthesized Social Signals: Computationally-Derived Social Signals from Account Histories. Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3313831.3376383 · DOI · Paper page
  29. Jelani Ince , Fabio Rojas , and Clayton A Davis . 2017. The social media response to Black Lives Matter: How Twitter users interact with Black Lives Matter through hashtag use. Ethnic and racial studies 40, 11 ( 2017 ), 1814–1830. Jelani Ince, Fabio Rojas, and Clayton A Davis. 2017. The social media response to Black Lives Matter: How Twitter users interact with Black Lives Matter through hashtag use. Ethnic and racial studies 40, 11 (2017), 1814–1830.
  30. 10.1145/3359294 · DOI · Paper page
  31. Shagun Jhaver , Amy Bruckman , and Eric Gilbert . 2019 . Does Transparency in Moderation Really Matter? User Behavior After Content Removal Explanations on Reddit . Proc. ACM Hum.-Comput. Interact. 3, CSCW, Article 150 (nov 2019), 27 pages. https://doi.org/10.1145/3359252 Shagun Jhaver, Amy Bruckman, and Eric Gilbert. 2019. Does Transparency in Moderation Really Matter? User Behavior After Content Removal Explanations on Reddit. Proc. ACM Hum.-Comput. Interact. 3, CSCW, Article 150 (nov 2019), 27 pages. https://doi.org/10.1145/3359252 · DOI · Paper page
  32. Shagun Jhaver , Larry Chan , and Amy Bruckman . 2018. The View from the Other Side: The Border Between Controversial Speech and Harassment on Kotaku in Action. First Monday 23, 2 ( 2018 ). http://firstmonday.org/ojs/index.php/fm/article/view/8232 Shagun Jhaver, Larry Chan, and Amy Bruckman. 2018. The View from the Other Side: The Border Between Controversial Speech and Harassment on Kotaku in Action. First Monday 23, 2 (2018). http://firstmonday.org/ojs/index.php/fm/article/view/8232
  33. Shagun Jhaver Seth Frey and Amy Zhang. 2022. Decentralizing Platform Power: A Design Space of Multi-level Governance in Online Social Platforms. arXiv preprint arXiv:2108.12529(2022). Shagun Jhaver Seth Frey and Amy Zhang. 2022. Decentralizing Platform Power: A Design Space of Multi-level Governance in Online Social Platforms. arXiv preprint arXiv:2108.12529(2022). · arXiv
  34. 10.1145/3359157 · DOI · Paper page
  35. David Kaye. 2019. Speech police: The global struggle to govern the Internet. Columbia Global Reports. David Kaye. 2019. Speech police: The global struggle to govern the Internet. Columbia Global Reports. · DOI
  36. Moira Kenney . 2001. Mapping gay LA: The intersection of place and politics . Temple University Press . Moira Kenney. 2001. Mapping gay LA: The intersection of place and politics. Temple University Press.
  37. 10.1145/3311957.3359470 · DOI
  38. 10.1145/3411764.3445279 · DOI
  39. Patricia G Lange . 2007. Commenting on comments: Investigating responses to antagonism on YouTube . In Society for Applied anthropology conference, Vol. 31. 163–190. Patricia G Lange. 2007. Commenting on comments: Investigating responses to antagonism on YouTube. In Society for Applied anthropology conference, Vol. 31. 163–190.
  40. Clayton Lewis . 1982. Using the ” thinking-aloud” method in cognitive interface design. IBM TJ Watson Research Center Yorktown Heights , NY. Clayton Lewis. 1982. Using the” thinking-aloud” method in cognitive interface design. IBM TJ Watson Research Center Yorktown Heights, NY.
  41. 10.1177/0002764221989781 · DOI
  42. 10.1145/3359166 · DOI
  43. Brian Lubars and Chenhao Tan . 2019. Ask not what AI can do, but what AI should do: Towards a framework of task delegability. Advances in Neural Information Processing Systems 32 ( 2019 ). Brian Lubars and Chenhao Tan. 2019. Ask not what AI can do, but what AI should do: Towards a framework of task delegability. Advances in Neural Information Processing Systems 32 (2019).
  44. 10.1016/j.adolescence.2011.06.007 · DOI · Paper page
  45. 10.1145/3359297 · DOI · Paper page
  46. 10.1145/3173574.3174160 · DOI · Paper page
  47. 10.1145/3411764.3445320 · DOI
  48. Alice Marwick . 2015. You may know me from YouTube. A companion to celebrity 333 ( 2015 ). Alice Marwick. 2015. You may know me from YouTube. A companion to celebrity 333 (2015).
  49. 10.1145/2858036.2858391 · DOI · Paper page
  50. Nathan J. Matias . 2016 . The Civic Labor of Online Moderators. In Internet Politics and Policy conference ( Oxford, United Kingdom). Oxford, United Kingdom. Nathan J. Matias. 2016. The Civic Labor of Online Moderators. In Internet Politics and Policy conference (Oxford, United Kingdom). Oxford, United Kingdom.
  51. Sharan B Merriam . 2002. Introduction to Qualitative Research. Qualitative research in practice: Examples for discussion and analysis 1 ( 2002 ). Sharan B Merriam. 2002. Introduction to Qualitative Research. Qualitative research in practice: Examples for discussion and analysis 1 (2002).
  52. Casey Newton . 2019 . The trauma floor: The secret lives of Facebook moderators in America . The Verge 25 (2019), 2019 . Casey Newton. 2019. The trauma floor: The secret lives of Facebook moderators in America. The Verge 25(2019), 2019.
  53. Valentin Niebler. 2020. ‘YouTubers unite’: collective action by YouTube content creators. Valentin Niebler. 2020. ‘YouTubers unite’: collective action by YouTube content creators. · DOI
  54. Safiya Umoja Noble . 2018. Algorithms of oppression . New York University Press . Safiya Umoja Noble. 2018. Algorithms of oppression. New York University Press.
  55. 10.1145/3272973.3274057 · DOI
  56. Katherine Ognyanova. 2019. In Putin’s Russia information has you: Media control and internet censorship in the Russian Federation. In Censorship surveillance and privacy: Concepts methodologies tools and applications. IGI Global 1769–1786. Katherine Ognyanova. 2019. In Putin’s Russia information has you: Media control and internet censorship in the Russian Federation. In Censorship surveillance and privacy: Concepts methodologies tools and applications. IGI Global 1769–1786. · DOI
  57. 10.1145/2858036.2858389 · DOI · Paper page
  58. Simon Parkin . 2018 . The YouTube stars heading for burnout:“The most fun job imaginable became deeply bleak .”. The Guardian 8 (2018), 2018 . Simon Parkin. 2018. The YouTube stars heading for burnout:“The most fun job imaginable became deeply bleak.”. The Guardian 8(2018), 2018.
  59. 10.1145/2957276.2957297 · DOI · Paper page
  60. 10.1145/3025453.3025854 · DOI
  61. 10.1371/journal.pone.0178534 · DOI · Paper page
  62. 10.2307/j.ctt1fq9wdp · DOI
  63. 10.1177/1354856517736983 · DOI · Paper page
  64. Elissa M Redmiles , Jessica Bodford , and Lindsay Blackwell . 2019 . “ I just want to feel safe”: A Diary Study of Safety Perceptions on Social Media . In Proceedings of the International AAAI Conference on Web and Social Media, Vol. 13 . 405–416. Elissa M Redmiles, Jessica Bodford, and Lindsay Blackwell. 2019. “I just want to feel safe”: A Diary Study of Safety Perceptions on Social Media. In Proceedings of the International AAAI Conference on Web and Social Media, Vol. 13. 405–416.
  65. Kathryn E Ringland , Christine T Wolf , Lynn Dombrowski , and Gillian R Hayes . 2015 . Making” Safe” Community-Centered Practices in a Virtual World Dedicated to Children with Autism . In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing. 1788–1800 . Kathryn E Ringland, Christine T Wolf, Lynn Dombrowski, and Gillian R Hayes. 2015. Making” Safe” Community-Centered Practices in a Virtual World Dedicated to Children with Autism. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing. 1788–1800.
  66. Sarah T Roberts . 2019. Behind the Screen: Content Moderation in the Shadows of Social Media . Yale University Press . Sarah T Roberts. 2019. Behind the Screen: Content Moderation in the Shadows of Social Media. Yale University Press.
  67. J Ben Schafer , Dan Frankowski , Jon Herlocker , and Shilad Sen . 2007. Collaborative filtering recommender systems . In The adaptive web . Springer , 291–324. J Ben Schafer, Dan Frankowski, Jon Herlocker, and Shilad Sen. 2007. Collaborative filtering recommender systems. In The adaptive web. Springer, 291–324.
  68. 10.1145/3274424 · DOI · Paper page
  69. 10.1145/3449090 · DOI
  70. 10.1145/2998181.2998277 · DOI · Paper page
  71. 10.1177/1461444818821316 · DOI · Paper page
  72. Scott Simon and Emma Bowman . 2019. Propaganda , hate speech, violence: The working lives of Facebook’s content moderators. NPR Technology ( 2019 ). Scott Simon and Emma Bowman. 2019. Propaganda, hate speech, violence: The working lives of Facebook’s content moderators. NPR Technology (2019).
  73. Peter K Smith , Jess Mahdavi , Manuel Carvalho , and Neil Tippett . 2006. An investigation into cyberbullying, its forms, awareness and impact, and the relationship between age and gender in cyberbullying. Research Brief No. RBX03-06 . London : DfES( 2006 ). Peter K Smith, Jess Mahdavi, Manuel Carvalho, and Neil Tippett. 2006. An investigation into cyberbullying, its forms, awareness and impact, and the relationship between age and gender in cyberbullying. Research Brief No. RBX03-06. London: DfES(2006).
  74. Nicolas P Suzor , Sarah Myers West , Andrew Quodling , and Jillian York . 2019 . What Do We Mean When We Talk About Transparency? Toward Meaningful Transparency in Commercial Content Moderation . International Journal of Communication 13 (2019), 18 . Nicolas P Suzor, Sarah Myers West, Andrew Quodling, and Jillian York. 2019. What Do We Mean When We Talk About Transparency? Toward Meaningful Transparency in Commercial Content Moderation. International Journal of Communication 13 (2019), 18.
  75. 10.1145/3392828 · DOI · Paper page
  76. 10.1007/s10676-019-09516-z · DOI
  77. Jirassaya Uttarapong Jie Cai and Donghee Yvette Wohn. 2021. Harassment Experiences of Women and LGBTQ Live Streamers and How They Handled Negativity. (2021) 7–19. https://doi.org/10.1145/3452918.3458794 Jirassaya Uttarapong Jie Cai and Donghee Yvette Wohn. 2021. Harassment Experiences of Women and LGBTQ Live Streamers and How They Handled Negativity. (2021) 7–19. https://doi.org/10.1145/3452918.3458794 · DOI
  78. Maarten W Van Someren , Yvonne F Barnard , and Jacobijn AC Sandberg . 1994. The think aloud method: a practical approach to modelling cognitive . London : AcademicPress 11( 1994 ). Maarten W Van Someren, Yvonne F Barnard, and Jacobijn AC Sandberg. 1994. The think aloud method: a practical approach to modelling cognitive. London: AcademicPress 11(1994).
  79. 10.1145/2998181.2998337 · DOI · Paper page
  80. Jeremy Waldron . 2012. The harm in hate speech . Harvard University Press . Jeremy Waldron. 2012. The harm in hate speech. Harvard University Press.
  81. Jeremy Waldron . 2017 . The conditions of legitimacy: A response to James Weinstein . Const. Comment. 32 (2017), 697 . Jeremy Waldron. 2017. The conditions of legitimacy: A response to James Weinstein. Const. Comment. 32(2017), 697.
  82. James Weinstein . 2017 . Hate speech bans, democracy, and political legitimacy . Const. Comment. 32 (2017), 527 . James Weinstein. 2017. Hate speech bans, democracy, and political legitimacy. Const. Comment. 32(2017), 527.
  83. Sarah Myers West . 2018. Censored , suspended, shadowbanned: User interpretations of content moderation on social media platforms . New Media & Society( 2018 ). Sarah Myers West. 2018. Censored, suspended, shadowbanned: User interpretations of content moderation on social media platforms. New Media & Society(2018).
  84. Stephanie N Williams and Annette V Clarke . 2019. How the Desensitization of Police Violence , Stereotyped Language, and Racial Bias Impact Black Communities. Psychology and Cognitive Sciences–Open Journal 5, 2 ( 2019 ). Stephanie N Williams and Annette V Clarke. 2019. How the Desensitization of Police Violence, Stereotyped Language, and Racial Bias Impact Black Communities. Psychology and Cognitive Sciences–Open Journal 5, 2 (2019).
  85. Donghee Yvette Wohn and Guo Freeman . 2020 . Audience Management Practices of Live Streamers on Twitch. In ACM International Conference on Interactive Media Experiences (Cornella , Barcelona, Spain) (IMX ’20). Association for Computing Machinery, New York, NY, USA, 106–116. https://doi.org/10.1145/3391614.3393653 Donghee Yvette Wohn and Guo Freeman. 2020. Audience Management Practices of Live Streamers on Twitch. In ACM International Conference on Interactive Media Experiences (Cornella, Barcelona, Spain) (IMX ’20). Association for Computing Machinery, New York, NY, USA, 106–116. https://doi.org/10.1145/3391614.3393653 · DOI
  86. 10.5555/3061053.3061172 · doi:10.5555/3061053.3061172

Cited by

See all 69

Metadata

Authors
Jhaver, S., Chen, Q. Z., Knauss, D., & Zhang, A. X.
Venue
CHI Conference on Human Factors in Computing Systems
Publisher
ACM
Published
2022-04-29
Pages
1-21
OpenAlex
W4220881245
Cited by
69
References
32
FWCI
8.99
Type
conference paper
Language
en
Open access
green

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Designing Word Filter Tools for Creator-led Comment Moderation. https://app.cochat.ai/papers/10.1145/3491102.3517505
The paper
Jhaver, S., Chen, Q. Z., Knauss, D., & Zhang, A. X. (2022). Designing Word Filter Tools for Creator-led Comment Moderation. CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3491102.3517505

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.