Cited by 111

The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.

You Can (Not) Say What You Want: Using Algospeak to Contest and Evade Algorithmic Content Moderation on TikTok

Steen, Ella, Yurechko, Kathryn, Klug, Daniel·2023·Social Media + Society

Abstract

Social media users have long been aware of opaque content moderation systems and how they shape platform environments. On TikTok, creators increasingly utilize algospeak to circumvent unjust content restriction, meaning, they change or invent words to prevent TikTok’s content moderation algorithm from banning their video (e.g., “le$bean” for “lesbian”). We interviewed 19 TikTok creators about their motivations and practices of using algospeak in relation to their experience with TikTok’s content moderation. Participants largely anticipated how TikTok’s algorithm would read their videos, and used algospeak to evade unjustified content moderation while simultaneously ensuring target audiences can still find their videos. We identify non-contextuality, randomness, inaccuracy, and bias against marginalized communities as major issues regarding freedom of expression, equality of subjects, and support for communities of interest. Using algospeak, we argue for a need to improve contextually informed content moderation to valorize marginalized and tabooed audiovisual content on social media.

Overview

Integrity signals

Registry

Crossref · 10.1177/20563051231194586

Cites

2 of 2 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • The rationale for content moderation decisions is poorly communicated, and LGBTQ+ users have to rely on their own knowledge.

    “Overall, in a context in which the rationale for content moderation decisions is poorly communicated (Steen, Yurechko, and Klug 2023), LGBTQ+ users have to rely on their own knowledge.”

    From Staring Back at the Surveillance Gaze: The Resistance of LGBTQ+ Users on Social Media (2026) · cites this paper as Steen, Yurechko, and Klug 2023

Citations

Cites

Flagged first, then by citations

Research works printed but not linked: 91

  1. Androutsopoulos J. (2006). Introduction: Sociolinguistics and computer-mediated communication. Journal of Sociolinguistics, 10(4), 419–438. https://doi.org/10.1111/j.1467-9841.2006.00286.x · DOI
  2. Are C. (2022). The shadowban cycle: An autoethnography of pole dancing, nudity and censorship on Instagram. Feminist Media Studies, 22, 2002–2019. https://doi.org/10.1080/14680777.2021.1928259 · DOI
  3. Baron N. S, 2003, The Stanford handbook for language engineers, 59
  4. Barta K., Andalibi N. (2021). Constructing authenticity on TikTok: Social norms and social support on the “fun” platform. Proceedings of the ACM on Human-Computer Interaction, 5(CSCW2), 1–29. https://doi.org/10.1145/3479574 · DOI
  5. Benaquisto L. (2008). Codes and coding. In Given L. M. (Ed.), The SAGE encyclopedia of qualitative research methods (pp. 85–88). Sage. https://doi.org/10.4135/9781412963909.n48 · DOI
  6. Ben-David A., 2016, International Journal of Communication, 10
  7. 10.18653/v1/D19-5508 · DOI
  8. Bhat P., Klein O. (2020). Covert hate speech: White nationalists and dog whistle communication on twitter. In Twitter, the public sphere, and the chaos of online deliberation (pp. 151–172). Palgrave Macmillan. https://doi.org/10.1007/978-3-030-41421-4_7 · DOI
  9. Blashki K., Nichol S. (2005). Game geek’s goss: Linguistic creativity in young males within an online university forum. Australian Journal of Emerging Technologies and Society, 3(2), 71–80. https://hdl.handle.net/10536/DRO/DU:30003258
  10. Brooke S. J. (2022, April). Nice guys, virgins, and incels: Gender in remixing and sharing memes at hackathons. In CHI conference on human factors in computing systems (pp. 1–14). Association for Computing Machinery. https://doi.org/10.1145/3491102.3517627 · DOI
  11. 10.1080/1369118X.2016.1154086 · DOI
  12. 10.4135/9781473984066.n14 · DOI · Paper page
  13. Burns-Stanning K, 2020, The 11th debating communities and networks conference, 27, 1
  14. 10.1177/0049124113500475 · DOI · Paper page
  15. Cervi L., Tejedor S., Lladó C. M. (2021). TikTok and the new language of political communication. Cultura, Lenguaje y Representación, 26, 267–287. https://doi.org/10.6035/clr.5817 · DOI
  16. Chancellor S., Pater J. A., Clear T., Gilbert E., De Choudhury M. (2016, February). #thyghgapp: Instagram content moderation and lexical variation in pro-eating disorder communities. In Proceedings of the 19th ACM conference on computer-supported cooperative work & social computing (pp. 1201–1213). Association for Computing Machinery. https://doi.org/10.1145/2818048.2819963 · DOI
  17. 10.1145/3490499 · DOI · Paper page
  18. Chang J., Danescu-Niculescu-Mizil C. (2019, May). Trajectories of blocked community members: Redemption, recidivism and departure. In The world wide web conference (pp. 184–195). Association for Computing Machinery. https://doi.org/10.1145/3308558.3313638 · DOI
  19. Cho W. I., Kim S. (2021, November). Google-trickers, Yaminjeongeum, and Leetspeak: An empirical taxonomy for intentionally noisy user-generated text. In Proceedings of the seventh workshop on noisy user-generated text (W-NUT 2021) (pp. 56–61). Association for Computational Linguistics. https://doi.org/10.18653/v1/2021.wnut-1.7 · DOI
  20. Cotter K. (2022). Practical knowledge of algorithms: The case of BreadTube. New Media & Society. 14614448221081802. https://doi.org/10.1177/14614448221081802 · DOI
  21. Crawford K., Gillespie T. (2016). What is a flag for? Social media reporting tools and the vocabulary of complaint. New Media & Society, 18(3), 410–428. http://doi.org/10.1177/1461444814543163 · DOI · Paper page
  22. Crystal D. (2001). Language and the internet. Cambridge University Press. https://doi.org/10.1017/CBO9781139164771 · DOI
  23. 10.4324/9780203830901 · DOI
  24. Darvin R. (2022). Design, resistance and the performance of identity on TikTok. Discourse, Context & Media, 46, Article 100591. https://doi.org/10.1016/j.dcm.2022.100591 · DOI
  25. DeVito M. A., Gergle D., Birnholtz J. (2017, May). “Algorithms ruin everything.” # RIPTwitter, folk theories, and resistance to algorithmic change in social media. In Proceedings of the 2017 CHI conference on human factors in computing systems (pp. 3163–3174). Association for Computing Machinery. https://doi.org/10.1145/3025453.3025659 · DOI · Paper page
  26. Drouin M., Davis C. (2009). R u txting? Is the use of text speak hurting your literacy? Journal of Literacy Research, 41(1), 46–67. https://doi.org/10.1080/10862960802695131 · DOI
  27. Duffy B. E., Meisner C. (2023). Platform governance at the margins: Social media creators’ experiences with algorithmic (in) visibility. Media, Culture & Society, 45(2), 285–304. https://doi.org/10.1177/01634437221111923 · DOI
  28. Eriksson Krutrök M. (2021). Algorithmic closeness in mourning: Vernaculars of the hashtag #grief on TikTok. Social Media+ Society, 7(3), 20563051211042396. https://doi.org/10.1177/20563051211042396 · DOI
  29. Flick U., 2008, An introduction to qualitative research
  30. Freed D., Palmer J., Minchala D., Levy K., Ristenpart T., Dell N. (2018, April). “A stalker’s paradise.” How intimate partner abusers exploit technology. In Proceedings of the 2018 CHI conference on human factors in computing systems (pp. 1–13). Association for Computing Machinery. https://doi.org/10.1145/3173574.3174241 · DOI
  31. Gerrard Y. (2018). Beyond the hashtag: Circumventing content moderation on social media. New Media & Society, 20(12), 4492–4511. https://doi.org/10.1177/1461444818776611 · DOI
  32. Gillespie T, 2018, Custodians of the internet: Platforms, content moderation, and the hidden decisions that shape social media
  33. Gillespie T. (2020). Content moderation, AI, and the question of scale. Big Data & Society, 7(2), 2053951720943234. https://doi.org/10.1177/2053951720943234 · DOI
  34. Gillespie T. (2022). Do not recommend? Reduction as a form of content moderation. Social Media+ Society, 8(3), 20563051221117552. https://doi.org/10.1177/20563051221117552 · DOI
  35. Gorwa R., Binns R., Katzenbach C. (2020). Algorithmic content moderation: Technical and political challenges in the automation of platform governance. Big Data & Society, 7(1), 2053951719897945. https://doi.org/10.1177/2053951719897945 · DOI · Paper page
  36. Grandinetti J. (2021). Examining embedded apparatuses of AI in Facebook and TikTok. Ai & Society, 1–14. https://doi.org/10.1007/s00146-021-01270-5 · DOI
  37. Grieve J., Montgomery C., Nini A., Murakami A., Guo D. (2019). Mapping lexical dialect variation in British English using Twitter. Frontiers in Artificial Intelligence, 2, Article 11. https://doi.org/10.3389/frai.2019.00011 · DOI
  38. Grimmelmann J, 2015, Yale JL & Tech, 17, 42
  39. Haimson O. L., Delmonaco D., Nie P., Wegner A. (2021). Disproportionate removals and differing content moderation experiences for conservative, transgender, and black social media users: Marginalization and moderation gray areas. Proceedings of the ACM on Human-Computer Interaction, 5(CSCW2), 1–35. https://doi.org/10.1145/3479610 · DOI
  40. Herring S. C., Androutsopoulos J. (2015). Computer-mediated discourse 2.0. In Tannen D., Hamilton H. E., Schiffrin D. (Eds.), The handbook of discourse analysis (Vol. 2, pp. 127–151). Wiley. https://doi.org/10.1002/9781118584194.ch6 · DOI
  41. 10.1016/B978-0-08-097086-8.64108-9 · DOI
  42. Ilbury C. (2020). “Sassy queens”: Stylistic orthographic variation in Twitter and the enregisterment of AAVE. Journal of Sociolinguistics, 24(2), 245–264. https://doi.org/10.1111/josl.12366 · DOI
  43. 10.4324/9780203357255-24 · DOI
  44. Jhaver S., Appling D. S., Gilbert E., Bruckman A. (2019). “Did you suspect the post would be removed?” Understanding user reactions to content removals on Reddit. Proceedings of the ACM on Human-Computer Interaction, 3(CSCW), 1–33. https://doi.org/10.1145/3359294 · DOI
  45. 10.1145/3479525 · DOI · Paper page
  46. Jiang J. A., Fiesler C., Brubaker J. R. (2018). The perfect one: Understanding communication practices and challenges with animated GIFs. Proceedings of the ACM on Human-Computer Interaction, 2(CSCW), 1–20. https://doi.org/10.1145/3274349 · DOI
  47. Juneja P., Rama Subramanian D., Mitra T. (2020). Through the looking glass: Study of transparency in Reddit’s moderation practices. Proceedings of the ACM on Human-Computer Interaction, 4(GROUP), 1–35. https://doi.org/10.1145/3375197 · DOI
  48. 10.1145/3476046 · DOI
  49. Kim J., Wohn D. Y., Cha M. (2022). Understanding and identifying the use of emotes in toxic chat on Twitch. Online Social Networks and Media, 27, Article 100180. https://doi.org/10.1016/j.osnem.2021.100180 · DOI
  50. Kim S., Weber I., Wei L., Oh A. (2014, September). Sociolinguistic analysis of Twitter in multilingual societies. In Proceedings of the 25th ACM conference on hypertext and social media (pp. 243–248). Association for Computing Machinery. https://doi.org/10.1145/2631775.2631824 · DOI
  51. Klug D. (2020). “It took me almost 30 minutes to practice this”: Performance and production practices in dance challenge videos on TikTok. ArXiv Preprint: arXiv:2008.13040. https://doi.org/10.33767/osf.io/j8u9v · DOI
  52. Klug D., Qin Y., Evans M., Kaufman G. (2021, June). Trick and please. A mixed-method study on user assumptions about the TikTok algorithm. In 13th ACM web science conference 2021 (pp. 84–92). Association for Computing Machinery. https://doi.org/10.1145/3447535.3462512 · DOI
  53. Le Compte D., Klug D. (2021, October). “It’s viral!”: A study of the behaviors, practices, and motivations of TikTok users and social activism. In Companion publication of the 2021 conference on computer supported cooperative work and social computing (pp. 108–111). Association for Computing Machinery. https://doi.org/10.1145/3462204.3481741 · DOI
  54. Lee C. (2014). Language choice and self-presentation in social media: The case of university students in Hong Kong. In Seargeant P., Tagg C. (Eds.), The language of social media (pp. 91–111). Palgrave Macmillan. https://doi.org/10.1057/9781137029317_5 · DOI
  55. Le Merrer E., Morgan B., Trédan G. (2021, May). Setting the record straighter on shadow banning. In IEEE INFOCOM 2021-IEEE conference on computer communications (pp. 1–10). IEEE. https://doi.org/10.1109/INFOCOM42981.2021.9488792 · DOI
  56. Liao T., Tyson O. (2021). “Crystal is creepy, but cool”: Mapping folk theories and responses to automated personality recognition algorithms. Social Media+ Society, 7(2), 20563051211010170. https://doi.org/10.1177/20563051211010170 · DOI
  57. 10.1177/0163443719855301 · DOI
  58. Longhurst R., 2003, Key Methods in Geography, 3, 143
  59. Maity S., Chaudhary A., Kumar S., Mukherjee A., Sarda C., Patil A., Mondal A. (2016, February). Wassup? lol: Characterizing out-of-vocabulary words in Twitter. In Proceedings of the 19th ACM conference on computer supported cooperative work and social computing companion (pp. 341–344). Association for Computing Machinery. https://doi.org/10.1145/2818052.2869110 · DOI
  60. McCulloch G, 2020, Because internet: Understanding the new rules of language
  61. McDonald N., Schoenebeck S., Forte A. (2019). Reliability and inter-rater reliability in qualitative research: Norms and guidelines for CSCW and HCI practice. Proceedings of the ACM on Human-Computer Interaction, 3(CSCW), 1–23. https://doi.org/10.1145/3359174 · DOI · Paper page
  62. 10.1177/1461444818773059 · DOI
  63. Nascimento G., Carvalho F., Cunha A. M. D., Viana C. R., Guedes G. P. (2019, October). Hate speech detection using Brazilian imageboards. In Proceedings of the 25th Brazillian symposium on multimedia and the web (pp. 325–328). Association for Computing Machinery. https://doi.org/10.1145/3323503.3360619 · DOI
  64. Oeldorf-Hirsch A., Neubaum G. (2021). What do we know about algorithmic literacy? The status quo and a research agenda for a growing field. https://doi.org/10.1177/14614448231182662 · DOI
  65. 10.1037/0096-1523.34.1.237 · DOI
  66. Pilipets E., Paasonen S. (2022). Nipples, memes, and algorithmic failure: NSFW critique of Tumblr censorship. New Media & Society, 24(6), 1459–1480. https://doi.org/10.1177/1461444820979280 · DOI
  67. Punske J., Butler E. (2019). Do me a syntax: Doggo memes, language games and the internal structure of English. Ampersand, 6, Article 100052. https://doi.org/10.1016/j.amper.2019.100052 · DOI
  68. 10.4324/9781003196457-15 · DOI
  69. Rho E. H. R., Mark G., Mazmanian M. (2018). Fostering civil discourse online: Linguistic behavior in comments of #MeToo articles across political perspectives. Proceedings of the ACM on Human-Computer Interaction, 2(CSCW), 1–28. https://doi.org/10.1145/3274416 · DOI
  70. Robertson A., Magdy W., Goldwater S. (2021). Black or White but never neutral: How readers perceive identity from yellow or skin-toned emoji. Proceedings of the ACM on Human-Computer Interaction, 5(CSCW2), 1–23. https://doi.org/10.1145/3476091 · DOI
  71. 10.4135/9781446282243.n20 · DOI
  72. Saha K., Kim S. C., Reddy M. D., Carter A. J., Sharma E., Haimson O. L., De Choudhury M. (2019). The language of LGBTQ+ minority stress experiences on social media. Proceedings of the ACM on Human-Computer Interaction, 3(CSCW), 1–22. https://doi.org/10.1145/3361108 · DOI
  73. 10.1177/01634437221077174 · DOI
  74. 10.1057/9781137029317 · DOI
  75. Seering J. (2020). Reconsidering community self-moderation: The role of research in supporting community-based models for online content moderation. Proceedings of the ACM on Human-Computer Interaction, 4, Article 107. https://doi.org/10.1145/3415178 · DOI
  76. 10.18653/v1/E17-1116 · DOI
  77. Simpson E., Hamann A., Semaan B. (2022). How to tame “your” algorithm: LGBTQ+ users’ domestication of TikTok. Proceedings of the ACM on Human-Computer Interaction, 6(GROUP), 1–27. https://doi.org/10.1145/3492841 · DOI
  78. Simpson E., Semaan B. (2021). For you, or for “you”? Everyday LGBTQ+ encounters with TikTok. Proceedings of the ACM on Human-Computer Interaction, 4(CSCW3), 1–34. https://doi.org/10.1145/3432951 · DOI · Paper page
  79. Srinivasan K. B., Danescu-Niculescu-Mizil C., Lee L., Tan C. (2019). Content removal as a moderation strategy: Compliance and other outcomes in the changemyview community. Proceedings of the ACM on Human-Computer Interaction, 3(CSCW), 1–21. https://doi.org/10.1145/3359265 · DOI
  80. Stewart I., Chancellor S., De Choudhury M., Eisenstein J. (2017, December). #anorexia, #anarexia, #anarexyia: Characterizing online community practices with orthographic variation. In 2017 IEEE international conference on Big Data (Big Data) (pp. 4353–4361). IEEE. https://doi.org/10.1109/BigData.2017.8258465 · DOI
  81. Suzor N. P., 2019, International Journal of Communication, 13, 18
  82. Tatman R, 2015, Working Papers of the Linguistics Circle, 25, 97
  83. Taylor S. H., Choi M. (2022). An initial conceptualization of algorithm responsiveness: Comparing perceptions of algorithms across social media platforms. Social Media+ Society, 8(4), 20563051221144322. https://doi.org/10.1177/20563051221144322 · DOI
  84. Thach H., Mayworm S., Delmonaco D., Haimson O. (2022). (In)visible moderation: A digital ethnography of marginalized users and content moderation on Twitch and Reddit. New Media & Society. 14614448221109804. https://doi.org/10.1177/14614448221109804 · DOI
  85. Tian H., Ma X., Bardzell J., Patil S. (2022). Non-literal communication in Chinese internet spaces: A case study of fishing. Proceedings of the ACM on Human-Computer Interaction, 6(CSCW1), 1–32. https://doi.org/10.1145/3512951 · DOI
  86. Turner K. H., Abrams S. S., Katíc E., Donovan M. J. (2014). Demystifying digitalk: The what and why of the language teens use in digital writing. Journal of Literacy Research, 46(2), 157–193. https://doi.org/10.1177/1086296X14534061 · DOI
  87. Vaccaro K., Sandvig C., Karahalios K. (2020). “At the end of the day Facebook does what itwants.” How users experience contesting algorithmic content moderation. Proceedings of the ACM on Human-Computer Interaction, 4(CSCW2), 1–22. https://doi.org/10.1145/3415238 · DOI · Paper page
  88. Vázquez-Herrero J., Negreira-Rey M. C., López-García X. (2022). Let’s dance the news! How the news media are adapting to the logic of TikTok. Journalism, 23(8), 1717–1735. https://doi.org/10.1177/1464884920969092 · DOI
  89. Wang J., Komlodi A. (2018, March). Switching languages in online searching: A qualitative study of web users’ code-switching search behaviors. In Proceedings of the 2018 conference on human information interaction & retrieval (pp. 201–210). Association for Computing Machinery. https://doi.org/10.1145/3176349.3176396 · DOI
  90. 10.1002/poi3.287 · DOI
  91. Zhu J., Jurgens D. (2021). The structure of online social networks modulates the rate of lexical change. ArXiv Preprint: arxiv: 210405010. https://doi.org/10.48550/arXiv.2104.05010 · DOI

Cited by

Sorted by citations

Metadata

Authors
Steen, E., Yurechko, K., & Klug, D.
Affiliations
  • Gordon College, USA
  • Washington and Lee University, USA
  • Carnegie Mellon University, USA
Venue
Social Media + Society
Published
2023-07
Volume
9
Issue
3
ISSN
2056-3051
Cited by
111
References
2
Language
en

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review