Human-Machine Collaboration for Content Regulation: The Case of Reddit Automoderator
Open accessThe DOI matches its Crossref record; 94 of the 94 references it cites were found in a registry or an index.
Abstract
What one may say on the internet is increasingly controlled by a mix of automated programs, and decisions made by paid and volunteer human moderators. On the popular social media site Reddit, moderators heavily rely on a configurable, automated program called “Automoderator” (or “Automod”). How do moderators use Automod? What advantages and challenges does the use of Automod present? We participated as Reddit moderators for over a year, and conducted interviews with 16 moderators to understand the use of Automod in the context of the sociotechnical system of Reddit. Our findings suggest a need for audit tools to help tune the performance of automated mechanisms, a repository for sharing tools, and improving the division of labor between human and machine decision making. We offer insights that are relevant to multiple stakeholders—creators of platforms, designers of automated regulation systems, scholars of platform governance, and content moderators.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Notably, the task for humans to create conditional delegation rules share some similarity with what many social media moderators are already doing by writing manual automation rules to deal with the massive amount of comments (Fig. 1(C)).”
From Human-AI Collaboration via Conditional Delegation: A Case Study of Content Moderation (2022) · cites this paper as [44]
The cited source says what the claim attributes to it.
In the citing paper
“For example, moderators on Reddit use a tool called AutoModerator, with which they manually customize a rule-based system to automatically identify comments for deleting or reporting for further review [18,44].”
From Human-AI Collaboration via Conditional Delegation: A Case Study of Content Moderation (2022) · cites this paper as [44]
The cited source says what the claim attributes to it.
In the citing paper
“However, there exists a need for audit tools to monitor the performance of the keyword rules.”
From Human-AI Collaboration via Conditional Delegation: A Case Study of Content Moderation (2022) · cites this paper as [44]
In the citing paper
“They also highlight the fact that AutoModerator fundamentally changes the work of moderators and may introduce additional unnecessary work.”
From Human-AI Collaboration via Conditional Delegation: A Case Study of Content Moderation (2022) · cites this paper as [44]
In the citing paper
“Through interviews with 16 moderators, Jhaver et al. [44] found that AutoModerator improves the efciency of moderation.”
From Human-AI Collaboration via Conditional Delegation: A Case Study of Content Moderation (2022) · cites this paper as [44]
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1990) · Cited by 24,217
Qualitative evaluation and research methods
Ellis, D. (1990) · International Journal of Information Management · doi:10.1016/0268-4012(90)90041-p · Cited by 17,943
Basics of Qualitative Research
Ozanne, J. L., Strauss, A., & Corbin, J. (1992) · Journal of Marketing Research · doi:10.1177/002224379202900312 · Cited by 17,866
Basics of Qualitative Research
Ozanne, J. L., Strauss, A., & Corbin, J. (1992) · Journal of Marketing Research · doi:10.2307/3172751 · Cited by 17,850
The Managed Heart: Commercialization of Human Feeling
Tropman, J. E., & Hochschild, A. R. (1984) · Journal of Policy Analysis and Management · doi:10.2307/3324333 · Cited by 8,746
An Introduction to Qualitative Research
Flick, U. (2023) · SAGE Publications Ltd eBooks · doi:10.4135/9781036231712 · Cited by 8,198
Introduction to Qualitative Research Methods: A Guidebook and Resource
Taylor, S. J., & Bogdan, R. (2015) · Cited by 2,935
The New Governors: The People, Rules, and Processes Governing Online Speech
Klonick, K. (2018) · St. John's University School of Law (St. John's University) · Cited by 1,211
The Intellectual Challenge of CSCW: The Gap Between Social Requirements and Technical Feasibility
Ackerman, M. S. (2000) · Human–Computer Interaction · doi:10.1207/s15327051hci1523_5 · Cited by 892
Programming Techniques: Regular expression search algorithm
Thompson, K. (1968) · Communications of the ACM · doi:10.1145/363347.363387 · Cited by 854
Research works printed but not linked: 7
- Kathy Charmaz. 2006. Coding in grounded theory practice. Constructing Grounded Theory (2006), 42-70. Sage Pub- lications Ltd, Thousand Oaks, CA.
- Susan C. Herring. 2000. Gender differences in CMC: Findings and implications. Computer Professionals for Social Responsibility Journal 18, 1 (2000), 1-9.
- Ling Jiang and Eui-Hong Han. 2019. ModBot: Automatic comments moderation. In Proceedings of the Computation+ Journalism Symposium.
- Victor Kaptelinin. 1996. Activity theory: Implications for human-computer interaction. Context and Consciousness: Activity Theory and Human-Computer Interaction 1 (1996), 103-116. · doi:10.5555/223826.223831
- Nathan J. Matias. 2016. The civic labor of online moderators. In Internet Politics and Policy conference. Oxford, United Kingdom.
- M. Pilar Opazo. 2010. Revitalizing the concept of sociotechnical systems in social studies of technology. (2010). Available at https://www.semanticscholar.org/paper/Revitalizing-the-Concept-of-Sociotechnical-Systems-Opazo/ 78460b4bdcbe004ccd469f4bda1f7d98017954de.
- Vanessa L. Wilburn. 1994. Gender and Anonymity in Computer-Mediated Communication: Participation, Flaming, Deindividuation. Ph.D. Dissertation. University of Florida.
Cited by
Items 101–200 of 420
AI and the future of digital public squares
Goldberg, B., Acosta-Navas, D., Bakker, M. A., Beacock, I., Botvinick, M., Buch, P. K., DiResta, R., Donthi, N., Fast, N. J., Iyer, R., et al. (2026) · Collective Intelligence · doi:10.1177/26339137261459441 · Cited by 32
Warner, M., Strohmayer, A., Higgs, M., & Coventry, L. (2025) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2025.103468 · Cited by 31
Filtering Discomforting Recommendations with Large Language Models
Liu, J., Shao, Y., Zhang, P., Li, D., Gu, H., Chen, C., Du, L., Lu, T., & Gu, N. (2025) · International World Wide Web Conference (WWW) · doi:10.1145/3696410.3714850 · Cited by 32
Detecting Community Sensitive Norm Violations in Online Conversations
Park, C. Y., Mendelsohn, J., Radhakrishnan, K., Jain, K., Kanakagiri, T., Jurgens, D., & Tsvetkov, Y. (2021) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2021.findings-emnlp.288 · Cited by 31
Vision Skills Needed to Answer Visual Questions
Zeng, X., Wang, Y., Chiu, T.-Y., Bhattacharya, N., & Gurari, D. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3415220 · Cited by 31
Reuber, A. R., & Fischer, E. M. (2021) · International Small Business Journal Researching Entrepreneurship · doi:10.1177/02662426211050509 · Cited by 31
DOSA: Dravidian Code-Mixed Offensive Span Identification Dataset
Ravikiran, M., & Annamalai, S. (2021) · Cited by 30
On the challenges of using black-box APIs for toxicity evaluation in research
Pozzobon, L., Ermis, B., Lewis, P., & Hooker, S. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.472 · Cited by 29
Lambert, C., Rajagopal, A., & Chandrasekharan, E. (2022) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v16i1.19314 · Cited by 29
Salehi, N., Pakzad, R., Lajevardi, N., & Asad, M. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3579526 · Cited by 29
Content Moderation on Social Media: Does It Matter Who and Why Moderates Hate Speech?
Wang, S., & Kim, K. J. (2023) · Cyberpsychology Behavior and Social Networking · doi:10.1089/cyber.2022.0158 · Cited by 29
Lerman, K., Chu, Bickham, C., Luceri, L., & Ferrara, E. (2025) · EPJ Data Science · doi:10.1140/epjds/s13688-025-00575-5 · Cited by 28
Chen, C., Qu, W. D., Su, S., Feng, Y., & Li, T. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.114689 · Cited by 28
The Design Space for Online Restorative Justice Tools: A Case Study with ApoloBot
Doan, B. N. (., & Seering, J. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713598 · Cited by 26
Effects of Algorithmic Flagging on Fairness: Quasi-experimental Evidence from Wikipedia
TeBlunthuis, N., Hill, B. M., & Halfaker, A. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3449130 · Cited by 26
Frey, S., Zhong, Q., Bulat, B., Weisman, W. D., Liu, C., Fujimoto, S., Wang, H., & Schweik, C. M. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555191 · Cited by 26
"Nip it in the Bud": Moderation Strategies in Open Source Software Projects and the Role of Bots
Hsieh, J., Kim, J., Dabbish, L., & Zhu, H. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3610092 · Cited by 26
Carefully Unmaking the “Marginalized User”: A Diffractive Analysis of a Gay Online Community
Taylor, J., Deng, W. H., Holstein, K., Fox, S., & Zhu, H. (2024) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3673229 · Cited by 26
Wang, L., Yurechko, K., Dani, P., Chen, Q. Z., & Zhang, A. X. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713691 · Cited by 25
AURA: Amplifying Understanding, Resilience, and Awareness for Responsible AI Content Work
Zhang, A. Q., Amores, J., Shen, H., Czerwinski, M. P., Gray, M. L., & Suh, J. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3710931 · Cited by 24
Online Content Moderation: Does Justice Need a Human Face?
Katsaros, M., Kim, J., & Tyler, T. R. (2023) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2023.2210879 · Cited by 24
Day, M. (2025) · Journal of University Teaching and Learning Practice · doi:10.53761/90p10x24 · Cited by 24
Cao, Y. T., Domingo, L.-F., Gilbert, S., Mazurek, M. L., Shilton, K., & Daumé, H. (2024) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2024.emnlp-main.209 · Cited by 24
Haime, Z., Kennedy, L., Grace, L., & Biddle, L. (2025) · Digital Society · doi:10.1007/s44206-025-00166-x · Cited by 23
Namespotting: Username toxicity and actual toxic behavior on Reddit
Urbaniak, R., Tempska, P., Dowgiałło, M., Ptaszynski, M. E., Fortuna, M., Marcińczuk, M., Piesiewicz, J., Leliwa, G., Soliwoda, K., Dziublewska, I., et al. (2022) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107371 · Cited by 23
Song, J. Y., Lee, S., Lee, J., Kim, M., & Kim, J. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581057 · Cited by 23
Kou, Y., Ma, R., Zhang, Z., Zhou, Y., & Gui, X. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642675 · Cited by 23
Can Language Model Moderators Improve the Health of Online Discourse?
Cho, H. J., Liu, S., Shi, T., Jain, D., Rizk, B., Huang, Y., Lu, Z., Wen, N., Gratch, J. S., Ferrara, E., et al. (2024) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2024.naacl-long.415 · Cited by 23
Advances in Technical Documentation Processes improving Organizational Knowledge Transfer
ThankGod, O. O., Obiuto, N. C., & Mary, U.-O. U. (2020) · Journal of Frontiers in Multidisciplinary Research · doi:10.54660/.ijfmr.2020.1.2.173-181 · Cited by 23
The Practice of Online Peer Counseling and the Potential for AI-Powered Support Tools
Wang, T., Bruckman, A. S., & Yang, D. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3711089 · Cited by 22
Self-citationMoMoE: Mixture of Moderation Experts Framework for AI-Assisted Online Governance
Goyal, A., Zhan, X., Chen, Y., Saha, K., & Chandrasekharan, E. (2025) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2025.emnlp-main.638 · Cited by 22
Volunteer Work: Mapping the Future of Moderation Research
Kiene, C., Grandprey-Shores, K., Chandrasekharan, E., Jhaver, S., Jiang, J. A., Dym, B., Seering, J., Gilbert, S., Lo, K., Wohn, D. Y., et al. (2019) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/3311957.3359443 · Cited by 22
Self-citationApp store governance: Implications, limitations, and regulatory responses
Cowls, J., Morley, J., & Floridi, L. (2022) · Telecommunications Policy · doi:10.1016/j.telpol.2022.102460 · Cited by 22
Governable Spaces: Democratic Design for Online Life
Schneider, N. (2024) · University of California Press eBooks · doi:10.1525/luminos.181 · Cited by 22
Case Law Grounding: Using Precedents to Align Decision-Making for Humans and AI
Chen, Q. Z., & Zhang, A. X. (2025) · ACM Collective Intelligence Conference (CI) · doi:10.1145/3715928.3737487 · Cited by 22
Stevens, H., Acic, I., & Taylor, L. D. (2021) · Cyberpsychology Behavior and Social Networking · doi:10.1089/cyber.2021.0075 · Cited by 22
Can bots help create knowledge? The effects of bot intervention in open collaboration
Kang, S., Liu, X., Kim, Y., & Yoon, V. (2021) · Decision Support Systems · doi:10.1016/j.dss.2021.113601 · Cited by 21
Nguyen, A., Rai, A., & Maruping, L. M. (2024) · Journal of Management Information Systems · doi:10.1080/07421222.2024.2340831 · Cited by 21
Wang, L., & Zhu, H. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533147 · Cited by 20
Chillbot: Content Moderation in the Backchannel
Seering, J., Khadka, M., Haghighi, N., Yang, T., Xi, Z., & Bernstein, M. S. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3686941 · Cited by 20
The unappreciated role of intent in algorithmic moderation of abusive content on social media
Wang, X., Koneru, S., Venkit, P. N., Frischmann, B. M., & Rajtmajer, S. M. (2025) · Harvard Kennedy School Misinformation Review · doi:10.37016/mr-2020-180 · Cited by 20
Reporting the Community Beat: Practices for Moderating Online Discussion at a News Website
McInnis, B. J., Ajmani, L., Sun, L., Hou, Y., Zeng, Z., & Dow, S. P. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3476074 · Cited by 20
Contextualized counterspeech generated by Generative AI may backfirePreprint
Bär, D., Maarouf, A., & Feuerriegel, S. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2411.14986 · Cited by 20
Let Community Rules Be Reflected in Online Content ModerationPreprint
Xin, W., Wang, K., Fu, Z., & Zhou, L. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2408.12035 · Cited by 20
Post Guidance for Online Communities
Ribeiro, M. H., West, R., Lewis, R., & Kairam, S. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3711046 · Cited by 19
Harmonizing the Cacophony with MIC: An Affordance-aware Framework for Platform Moderation
Bajpai, T., Asher, D., Goswami, A., & Chandrasekharan, E. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555110 · Cited by 19
Kirasur, N., & Jhaver, S. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757518 · Cited by 18
Self-citationAutomatic content moderation on social media
Karabulut, D., Ozcinar, C., & Anbarjafari, G. (2022) · Multimedia Tools and Applications · doi:10.1007/s11042-022-11968-3 · Cited by 18
Smith, C. E., Alam, I., Tan, C., Keegan, B., & Blanchard, A. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555563 · Cited by 18
Alt‐health influencers and the threat of social media deplatforming
Zimdars, M. (2024) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.24870 · Cited by 18
Bezabih, A. M., Nourriz, S., Snider, A.-M., Rauenzahn, R., Handzo, G. F., & Smith, C. E. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757492 · Cited by 18
Conceptualizing Visual Analytic Interventions for Content Moderation
Vaidya, S., Cai, J., Basu, S., Naderi, A., Wohn, D. Y., & Dasgupta, A. (2021) · Visualization · doi:10.1109/vis49827.2021.9623288 · Cited by 18
Epstein, D. A., Liu, F., Monroy‐Hernández, A., & Wang, D. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555557 · Cited by 18
Lambretta: Learning to Rank for Twitter Soft Moderation
Paudel, P., Blackburn, J., Cristofaro, E. D., Zannettou, S., & Stringhini, G. (2023) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp46215.2023.10179392 · Cited by 18
Guo, H., He, J., Ma, J., Na, H., Wang, Z., Zhang, H., Chen, Q., Wang, W., Shi, Z., Shen, T., et al. (2025) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2025.emnlp-industry.172 · Cited by 17
App Store Governance: The Implications and Limitations of Duopolistic Dominance
Cowls, J., & Morley, J. (2022) · Digital ethics lab yearbook · doi:10.1007/978-3-031-09846-8_6 · Cited by 17
Zhang, A. Q., Montague, K. E., & Jhaver, S. (2026) · ACM Transactions on Social Computing · doi:10.1145/3862615 · Cited by 17
Self-citationPika: Empowering Non-Programmers to Author Executable Governance Policies in Online Communities
Wang, L., Vincent, N., Rukanskaitė, J., & Zhang, A. X. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642012 · Cited by 17
Seeing Like an AI: How LLMs Apply (and Misapply) Wikipedia Neutrality Norms
Ashkinaze, J., Guan, R., Kurek, L., Adar, E., Budak, C., & Gilbert, E. (2026) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v20i1.42630 · Cited by 17
Self-citationShadowbanning: An Opaque Form of Content Moderation
Risius, M., & Blasiak, K. M. (2024) · Business & Information Systems Engineering · doi:10.1007/s12599-024-00905-3 · Cited by 17
Ma, R., & Kou, Y. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3579477 · Cited by 17
The Effects of Machine-powered Platform Governance: An Empirical Study of Content Moderation
He, Q., Hong, Y., & Raghu, T. S. (2021) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2022.724 · Cited by 16
Chilling Tales: Understanding the Impact of Copyright Takedowns on Transformative Content Creators
Fiesler, C. L., Paup, J., & Zacher, C. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3610095 · Cited by 16
AppealMod: Inducing Friction to Reduce Moderator Workload of Handling User Appeals
Atreja, S., Im, J., Resnick, P., & Hemphill, L. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3637296 · Cited by 16
Hou, Y., Xu, X., & Pan, B. (2024) · Information Sciences · doi:10.1016/j.ins.2024.121511 · Cited by 16
Ensuring safety in digital spaces: Detecting code-mixed hate speech in social media posts
Roy, P. K., & Kumar, A. (2025) · Data & Knowledge Engineering · doi:10.1016/j.datak.2025.102409 · Cited by 16
Choi, F., Lambert, C., Koshy, V., Pratipati, S., Do, T., & Chandrasekharan, E. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713521 · Cited by 16
Vitiugin, F., Senarath, Y., & Purohit, H. (2021) · ACM Web Science Conference (WebSci) · doi:10.1145/3447535.3462495 · Cited by 16
Decentralized social networks and the future of free speech online
Huang, T. (2024) · Computer Law & Security Review · doi:10.1016/j.clsr.2024.106059 · Cited by 15
“This has already been used by the sub-Reddit moderators but the lack of a central repository of tools still limits the effectiveness of the coordination ([79], 12 – 13).”
MethodDing, X., Carik, B., Gunturi, U. S., Reyna, V. F., & Rho, E. H. R. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642117 · Cited by 15
Ma, R., Zhang, Z., Gui, X., & Kou, Y. (2024) · Designing Interactive Systems Conference · doi:10.1145/3643834.3661565 · Cited by 15
Opportunities, tensions, and challenges in computational approaches to addressing online harassment
Huang, E. J., Sarma, A., Hwang, S., Chandrasekharan, E., & Chancellor, S. (2024) · Designing Interactive Systems Conference · doi:10.1145/3643834.3661623 · Cited by 16
Safeguarding Decentralized Social Media: LLM Agents for Automating Community Rule Compliance
Cava, L. L., & Tagarelli, A. (2025) · Online Social Networks and Media · doi:10.1016/j.osnem.2025.100319 · Cited by 15
Kintsugi-Inspired Design: Communicatively Reconstructing Identities Online After Trauma
Randazzo, C., & Ammari, T. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757507 · Cited by 15
Venire: A Machine Learning-Guided Panel Review System for Community Content Moderation
Koshy, V., Choi, F., Chiang, Y.-S., Sundaram, H., Chandrasekharan, E., & Karahalios, K. G. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757699 · Cited by 15
An Empirical Analysis of Human-Bot Interaction on Reddit
Ma, M.-C., & Lalor, J. P. (2020) · Workshop on Noisy User-generated Text (W-NUT) · doi:10.18653/v1/2020.wnut-1.14 · Cited by 14
Examining science communication on Reddit: From an “Assembled” to a “Disassembling” approach
Edwards, M. L., & Ziegler, C. (2022) · Public Understanding of Science · doi:10.1177/09636625211057231 · Cited by 14
Adopting Third-party Bots for Managing Online Communities
Hwang, S., Kiene, C., Ong, S., & Shaw, A. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3653707 · Cited by 13
LLM-C3MOD: A Human-LLM Collaborative System for Cross-Cultural Hate Speech Moderation
Park, J., Jeong, S., Song, S., Lee, Y., & Oh, A. (2025) · Workshop on Cross-Cultural Considerations in NLP (C3NLP) · doi:10.18653/v1/2025.c3nlp-1.7 · Cited by 13
Lloyd, T., Nguyen, T., Levy, K. E. C., & Naaman, M. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791889 · Cited by 13
Needling Through the Threads: A Visualization Tool for Navigating Threaded Online Discussions
Liu, Y., Choi, F., & Chandrasekharan, E. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790365 · Cited by 13
Liao, Z., Zhao, H., Kulkarni, A., Chattrath, S., & Zhang, A. X. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757460 · Cited by 13
Spennemann, D. H. R. (2022) · Social Sciences · doi:10.3390/socsci11020031 · Cited by 13
Post Approvals in Online Communities
Ribeiro, M. H., Cheng, J., & West, R. (2022) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v16i1.19296 · Cited by 14
"How Do You Quantify How Racist Something Is?": Color-Blind Moderation in Decentralized Governance
Wu, Q., & Semaan, B. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3610030 · Cited by 13
Paakki, H., Vepsäläinen, H., Salovaara, A., & Zafar, B. (2023) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3635143 · Cited by 13
Bans vs. Warning Labels: Examining Bystanders’ Support for Community-wide Moderation Interventions
Jhaver, S. (2025) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3715116 · Cited by 12
Self-citationAmmari, T., Ahn, E., Lakhankar, A., & Lee, J. Y. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3710985 · Cited by 12
Haime, Z., & Biddle, L. (2025) · JMIR Human Factors · doi:10.2196/69817 · Cited by 12
Large Language Models for Automatic Detection of Sensitive Topics
Wen, R., Crowe, S., Gupta, K., Li, X., Billinghurst, M., Hoermann, S., Allan, D. D., Nassani, A., & Piumsomboon, T. (2024) · Australian Conference on Human-Computer Interaction (OzCHI) · doi:10.1145/3726986.3727014 · Cited by 12
Exploring Horizontally Flipped Interaction in Virtual Reality for Improving Spatial Ability
Bozgeyikli, L. “., Bozgeyikli, E., Schnell, C., & Clark, J. (2023) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2023.3320241 · Cited by 12
Analyzing Hate Speech with Incel-Hunters’ Critiques
Sang, Y., & Stanton, J. M. (2020) · International Conference on Social Media and Society (SMSociety) · doi:10.1145/3400806.3400808 · Cited by 12
Rare, but Valuable: Understanding Data-centered Talk in News Website Comment Sections
McInnis, B. J., Sun, L., Shin, J.-W., & Dow, S. P. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3415245 · Cited by 12
Problematic Advertising and its Disparate Exposure on FacebookPreprint
Ali, M., Goetzen, A., Mislove, A. E., Redmiles, E. M., & Sapieżyński, P. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2306.06052 · Cited by 13
Evolving Hate Speech Online: An Adaptive Framework for Detection and MitigationPreprint
Ali, S., Blackburn, J., & Stringhini, G. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2502.10921 · Cited by 12
Finding Place in a Design Space: Challenges for Supporting Community Design Efforts at Scale
MacNeil, S., Ding, Z., Boone, A., Grubbs, A. B., & Dow, S. P. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3449246 · Cited by 11
“To address information overload in forums, research has focused on developing technologies and affordances for forums to help people get oriented, including collaborative tagging [52], thread recommendation [83], recursive summarization [130, 134], and moderation carried out by humans [14, 43, 57] or machines [70].”
MethodLiao, J., Ye, Y., Filieri, R., Du, P., & Jiang, Y. (2024) · Psychology and Marketing · doi:10.1002/mar.22065 · Cited by 11
Dealing with Deepfakes: Reddit, Online Content Moderation, and Situational Crime Prevention
Kikerpill, K., Siibak, A., & Valli, S. (2021) · Studies in media and communications · doi:10.1108/s2050-206020210000020008 · Cited by 11
CPL-NoViD: Context-Aware Prompt-Based Learning for Norm Violation Detection in Online Communities
He, Z., May, J., & Lerman, K. (2024) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v18i1.31335 · Cited by 11
Automatically Labeling Low Quality Content on Wikipedia By Leveraging Patterns in Editing Behaviors
Asthana, S., Thommel, S. T., Halfaker, A., & Banović, N. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3479503 · Cited by 11
Metadata
- Authors
- Jhaver, S., Birman, I., Gilbert, E., & Bruckman, A.
- Affiliations
- Georgia Institute of Technology (US)
- University of Michigan, Ann Arbor, MI
- Venue
- ACM Transactions on Computer-Human Interaction
- Published
- 2019-07-19
- Volume
- 26
- Issue
- 5
- Pages
- 1-35
- ISSN
- 1073-0516 (ISSN-L)
- 1557-7325
- OpenAlex
- W2964034671
- Cited by
- 289
- References
- 92
- Citations by year
- 2026: 36 · 2025: 56 · 2024: 42 · 2023: 41 · 2022: 43 · 2021: 44 · 2020: 22 · 2019: 5
- FWCI
- 49.82
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- ACM Transactions on Computer-Human Interaction (publishedVersion, other-oa)
- Funders
- National Science Foundation (IIS-1553376)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Hate Speech and Cyberbullying Detection
- Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
- Keywords
- human-machine collaboration, content moderation, automated content moderation, Reddit, AutoMod, social media governance, platform governance, socio-technical systems, audit tool, division of labor, human moderators, tool sharing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.