Digital Juries: A Civics-Oriented Approach to Platform Governance
The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
As concerns have grown regarding harmful content spread on social media, platform mechanisms for content moderation have become increasingly significant. However, many existing platform governance structures lack formal processes for democratic participation by users of the platform. Drawing inspiration from constitutional jury trials in many legal systems, this paper proposes digital juries as a civics-oriented approach for adjudicating content moderation cases. Building on existing theoretical models of jury decision-making, we outline a 5-stage model characterizing the space of design considerations in a digital jury process. We implement two examples of jury designs involving blind-voting and deliberation. From users who participate in our jury implementations, we gather informed judgments of the democratic legitimacy of a jury process for content moderation. We find that digital juries are perceived as more procedurally just than existing common platform moderation practices, but also find disagreement over whether jury decisions should be enforced or used as recommendations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An Experimental Application of the DELPHI Method to the Use of Experts
Dalkey, N., & Helmer, O. (1963) · Management Science · doi:10.1287/mnsc.9.3.458 · Cited by 6,061
Emotion shapes the diffusion of moralized content in social networks
Brady, W. J., Wills, J. A., Jost, J. T., Tucker, J. A., & Van Bavel, J. J. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1618923114 · Cited by 1,580 · cited 1×
“The scale and ease by which content spreads on platforms have raised new alarm about online speech that incites violence [4, 88], radicalizes public discourse [95, 12], and even impacts elections [9].”
BackgroundThe law of group polarization.
Sunstein, C. R. (2002) · Journal of Political Philosophy · doi:10.1111/1467-9760.00148 · Cited by 1,371
What is Procedural Justice?: Criteria Used by Citizens to Assess the Fairness of Legal Procedures
Tyler, T. R. (1988) · Law & Society Review · doi:10.2307/3053563 · Cited by 912 · cited 2×
“We structure survey questions of each condition’s democratic legitimacy from participants using variants of Tyler’s procedural justice framework [89, 69] (e.”
BackgroundMethodWhat is a flag for? Social media reporting tools and the vocabulary of complaint
Crawford, K., & Gillespie, T. (2016) · New Media & Society · doi:10.1177/1461444814543163 · Cited by 496
Effects of four computer-mediated communications channels on trust development
Bos, N., Olson, J., Gergle, D., Olson, G., & Wright, Z. (2002) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/503376.503401 · Cited by 489 · cited 1×
“Media richness (synchronicity, bandwidth, fidelity): Media Richness Theory suggests that richer communication media (such as in-person, video conferencing, or synchronous text-based conversations) are more effective for communicating [26] and facilitating trust [10] than leaner media, such as asynchronous email.”
BackgroundYou Can't Stay Here: The Efficacy of Reddit's 2015 Ban Examined Through Hate Speech
Chandrasekharan, E., Pavalanathan, U., Srinivasan, A., Glynn, A., Eisenstein, J., & Gilbert, E. (2017) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3134666 · Cited by 390
Building Successful Online Communities: Evidence-Based Social Design
Kraut, R. E., Resnick, P., Kiesler, S., Burke, M., Chen, Y., Kittur, N., Konstan, J., Ren, Y., & Riedl, J. (2012) · doi:10.7551/mitpress/8472.001.0001 · Cited by 327
Decentralization in wikipedia governance.
Forte, A., Larco, V., & Bruckman, A. (2009) · Journal of Management Information Systems · doi:10.2753/mis0742-1222260103 · Cited by 300 · cited 1×
“Much research has focused on Wikipedia’s decentralized structure, including the many locally governed, self-contained WikiProjects [37] and emphasis on open deliberation to bestow responsibilities [14] and resolve disputes [53].”
BackgroundChandrasekharan, E., Samory, M., Jhaver, S., Charvat, H., Bruckman, A., Lampe, C., Eisenstein, J., & Gilbert, E. (2018) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3274301 · Cited by 282
Cited by
The Participatory Turn in AI Design: Theoretical Foundations and the Current State of Practice
Delgado, F., Yang, S., Madaio, M., & Yang, Q. (2023) · Equity and Access in Algorithms, Mechanisms, and Optimization · doi:10.1145/3617694.3623261 · Cited by 256
Contestability For Content Moderation
Vaccaro, K., Xiao, Z., Hamilton, K., & Karahalios, K. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3476059 · Cited by 77
Code of Conduct Conversations in Open Source Software Projects on Github
Li, R., Pandurangan, P., Frluckaj, H., & Dabbish, L. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3449093 · Cited by 50
Ma, S., Chen, Q., Wang, X., Zheng, C., Peng, Z., Yin, M., & Ma, X. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713423 · Cited by 48
“Recent studies on online deliberation have showcased its ability to enhance the accuracy of crowd-working tasks [24, 34], improve perceptions of procedural justice [40], and facilitate consensus-building among participants [80, 111, 126, 137].”
Exploring the Use of Personalized AI for Identifying Misinformation on Social Media
Jahanbakhsh, F., Katsis, Y., Wang, D., Popa, L., & Muller, M. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581219 · Cited by 42
“…to personalized moderators has been explored by prior work in the context of modifying news head-lines perceived as misleading or inaccurate, subjective moderation in chat, email harassment, allowing or removing content, or developing policies for platform governance [24, 34, 37, 53, 55, 62, 99].”
BackgroundWhose Knowledge is Valued? Epistemic Injustice in CSCW Applications
Ajmani, L. H., Foriest, J. C., Taylor, J., Pittman, K., Gilbert, S., & DeVito, M. A. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3687062 · Cited by 30
Kuo, T.-S., Chen, Q. Z., Zhang, A. X., Hsieh, J., Zhu, H., & Holstein, K. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713865 · Cited by 12
Self-citationFinding Place in a Design Space: Challenges for Supporting Community Design Efforts at Scale
MacNeil, S., Ding, Z., Boone, A., Grubbs, A. B., & Dow, S. P. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3449246 · Cited by 11
“Recent work on digital juries shown that people prefer decisions based on deliberation compared to voting alone [44].”
Background
Metadata
- Authors
- Fan, J., & Zhang, A. X.
- Venue
- Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2020-04-21
- Pages
- 1-14
- OpenAlex
- W3031586727
- Cited by
- 89
- References
- 16
- FWCI
- 99.33
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.