PolicyKit: Building Governance in Online Communities
Open accessThe DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
The software behind online community platforms encodes a governance model that represents a strikingly narrow set of governance possibilities focused on moderators and administrators. When online communities desire other forms of government, such as ones that take many members? opinions into account or that distribute power in non-trivial ways, communities must resort to laborious manual effort. In this paper, we present PolicyKit, a software infrastructure that empowers online community members to concisely author a wide range of governance procedures and automatically carry out those procedures on their home platforms. We draw on political science theory to encode community governance into policies, or short imperative functions that specify a procedure for determining whether a user-initiated action can execute. Actions that can be governed by policies encompass everyday activities such as posting or moderating a message, but actions can also encompass changes to the policies themselves, enabling the evolution of governance over time. We demonstrate the expressivity of PolicyKit through implementations of governance models such as a random jury deliberation, a multi-stage caucus, a reputation system, and a promotion procedure inspired by Wikipedia's Request for Adminship (RfA) process.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Groupware and social dynamics: eight challenges for developers
Grudin, J. (1994) · Communications of the ACM · doi:10.1145/175222.175230 · Cited by 1,228
The Emergence of Governance in an Open Source Community
O'Mahony, S., & Ferraro, F. (2007) · Academy of Management Journal · doi:10.5465/amj.2007.27169153 · Cited by 909
Decentralization in wikipedia governance.
Forte, A., Larco, V., & Bruckman, A. (2009) · Journal of Management Information Systems · doi:10.2753/mis0742-1222260103 · Cited by 300 · cited 1×
“n to English Wikipedia, another community with a more democratic model. Like other peer production communities such as GNU/Linux, a core tenet of Wikipedia is its openness in permitting contributions [17]. However, conflicts arise, and over time, Wikipedia has grown a number of processes involving petitions and votes t…”
BackgroundRaymond, E. S. (1998) · First Monday · doi:10.5210/fm.v3i10.621 · Cited by 290 · cited 1×
“tition the platform in a form of collective action [7,50] or leave for another platform [16, 28]. While the threat of such actions can blunt centralized power, resulting in “benevolent dictatorships” [62], the lack of structured ways to enact change can itself mask power [19]. While unable to alter platform software d…”
Human-Machine Collaboration for Content Regulation: The Case of Reddit Automoderator
Jhaver, S., Birman, I., Gilbert, E., & Bruckman, A. (2019) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3338243 · Cited by 289
Online Harassment and Content Moderation: The Case of Blocklists
Jhaver, S., Ghoshal, S., Bruckman, A., & Gilbert, E. (2018) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3185593 · Cited by 270 · cited 1×
“r and manage. Additional tools exist that help mods create better policies [8,52] but still are focused on the role of mods. Finally, some tools exist that are aimed at regular members of a community [23,32,46], but these are primarily only used to enact policies for an individual as opposed to a group. While all of t…”
BackgroundThe work of sustaining order in wikipedia: the banning of a vandal
Geiger, R. S., & Ribes, D. (2010) · Proceedings of the 2010 ACM conference on Computer supported cooperative work · doi:10.1145/1718918.1718941 · Cited by 245 · cited 1×
“include Reddit’s AutoModerator tool for mods to author rules for their subreddit [30], or the wide variety of bots on Wikipedia that perform administrative tasks such as tagging, archiving, and fixing [24,71]. In many cases, these automation tools are not, or do not start out, embedded in a platform but grow separately…”
MethodButler, B., Joyce, E., & Pike, J. (2008) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1357054.1357227 · Cited by 235
Laboratories of Oligarchy? How the Iron Law Extends to Peer Production
Shaw, A., & Hill, B. M. (2014) · Journal of Communication · doi:10.1111/jcom.12082 · Cited by 211
Matias, J. N. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1813486116 · Cited by 208
Research works printed but not linked: 52
- 10.1145/3313831.3376691 · DOI
- John Perry Barlow. 1996. A Declaration of the Independence of Cyberspace. (1996). https://projects.eff.org/ barlow/Declaration-Final.html John Perry Barlow. 1996. A Declaration of the Independence of Cyberspace. (1996). https://projects.eff.org/ barlow/Declaration-Final.html · DOI · Paper page
- 10.1145/1099203.1099205 · DOI · Paper page
- 10.1145/1460563.1460571 · DOI · Paper page
- 10.1145/2858036.2858516 · DOI
- Noam Cohen . 2007 . A contributor to Wikipedia has his fictional side . New York Times 5 (2007), 5 . Noam Cohen. 2007. A contributor to Wikipedia has his fictional side. New York Times 5 (2007), 5.
- 10.7208/chicago/9780226924564.001.0001 · doi:10.7208/chicago/9780226924564.001.0001
- Julian Dibbell. 1994. A rape in cyberspace or how an evil clown a Haitian trickster spirit two wizards and a cast of dozens turned a database into a society. Ann. Surv. Am. L. (1994) 471. Julian Dibbell. 1994. A rape in cyberspace or how an evil clown a Haitian trickster spirit two wizards and a cast of dozens turned a database into a society. Ann. Surv. Am. L. (1994) 471. · DOI · Paper page
- 10.1145/3313831.3376293 · DOI · Paper page
- 10.1145/1753326.1753502 · DOI · Paper page
- Cynthia Farina , Hoi Kong , Cheryl Blake , Mary Newhart , and Nik Luka . 2013 . Democratic deliberation in the wild: The McGill online design studio and the RegulationRoom project . Fordham Urb. LJ 41 (2013), 1527 . Cynthia Farina, Hoi Kong, Cheryl Blake, Mary Newhart, and Nik Luka. 2013. Democratic deliberation in the wild: The McGill online design studio and the RegulationRoom project. Fordham Urb. LJ 41 (2013), 1527.
- 10.1080/17530350.2011.563069 · DOI · Paper page
- Jo Freeman . 1972. The tyranny of structurelessness. Berkeley Journal of Sociology ( 1972 ), 151--164. Jo Freeman. 1972. The tyranny of structurelessness. Berkeley Journal of Sociology (1972), 151--164.
- Seth Frey , PM Krafft , and Brian C Keegan . 2019 . " This Place Does What It Was Built For" Designing Digital Institutions for Participatory Change . Proceedings of the ACM on Human-Computer Interaction 3, CSCW (2019), 1--31. Seth Frey, PM Krafft, and Brian C Keegan. 2019. " This Place Does What It Was Built For" Designing Digital Institutions for Participatory Change. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (2019), 1--31.
- 10.1371/journal.pone.0216335 · DOI · Paper page
- 10.1080/1369118X.2013.873069 · DOI · Paper page
- Tarleton Gillespie . 2018. Custodians of the Internet: Platforms, content moderation, and the hidden decisions that shape social media . Yale University Press . Tarleton Gillespie. 2018. Custodians of the Internet: Platforms, content moderation, and the hidden decisions that shape social media. Yale University Press.
- Albert O Hirschman . 1970. Exit , voice, and loyalty: Responses to decline in firms, organizations, and states . Vol. 25 . Harvard university press . Albert O Hirschman. 1970. Exit, voice, and loyalty: Responses to decline in firms, organizations, and states. Vol. 25. Harvard university press.
- 10.1145/3274343 · DOI
- 10.1145/3359252 · DOI · Paper page
- Google Jigsaw . 2017. Perspective API. ( 2017 ). Retrieved May 5, 2020 from https://www.perspectiveapi.com Google Jigsaw. 2017. Perspective API. (2017). Retrieved May 5, 2020 from https://www.perspectiveapi.com
- 10.1080/01972243.2017.1414092 · DOI
- Charles Kiene Andrés Monroy-Hernández and Benjamin Mako Hill. 2016. Surviving an eternal september: How an online community managed a surge of newcomers. In CHI. ACM 1152--1156. Charles Kiene Andrés Monroy-Hernández and Benjamin Mako Hill. 2016. Surviving an eternal september: How an online community managed a surge of newcomers. In CHI. ACM 1152--1156. · DOI · Paper page
- Larry Kiser and Elinor Ostrom . 1982. The three worlds of political action. Strategies of political inquiry . Berverly Hilly : Sage ( 1982 ). Larry Kiser and Elinor Ostrom. 1982. The three worlds of political action. Strategies of political inquiry. Berverly Hilly: Sage (1982).
- Mark Klein . 2011. How to harvest collective wisdom on complex problems: An introduction to the mit deliberatorium . Center for Collective Intelligence working paper ( 2011 ). Mark Klein. 2011. How to harvest collective wisdom on complex problems: An introduction to the mit deliberatorium. Center for Collective Intelligence working paper (2011).
- Piotr Konieczny . 2009. Governance , organization, and democracy on the Internet: The iron law and the evolution of Wikipedia . In Sociological Forum , Vol. 24 . Wiley Online Library , 162--192. Piotr Konieczny. 2009. Governance, organization, and democracy on the Internet: The iron law and the evolution of Wikipedia. In Sociological Forum, Vol. 24. Wiley Online Library, 162--192.
- Piotr Konieczny . 2018. Volunteer retention, burnout and dropout in online voluntary organizations: stress, conflict and retirement of Wikipedians. Research in Social Movements, Conflicts and Change ( Volume 42 ) . Emerald Publishing Limited ( 2018 ), 199--219. Piotr Konieczny. 2018. Volunteer retention, burnout and dropout in online voluntary organizations: stress, conflict and retirement of Wikipedians. Research in Social Movements, Conflicts and Change (Volume 42). Emerald Publishing Limited (2018), 199--219.
- 10.1145/3134697 · DOI
- Robert E Kraut and Paul Resnick . 2012. Building successful online communities: Evidence-based social design . Mit Press . Robert E Kraut and Paul Resnick. 2012. Building successful online communities: Evidence-based social design. Mit Press.
- 10.1145/2145204.2145249 · DOI · Paper page
- 10.1145/2207676.2208621 · DOI
- 10.1145/985692.985761 · DOI · Paper page
- 10.1145/3173574.3174160 · DOI · Paper page
- Danaja Maldeniya Ceren Budak Lionel Robert and Daniel Romero. 2020. Herding a Deluge of Good Samaritans: How GitHub Projects Respond to Increased Attention. http://dx.doi.org/10.1145/3366423.3380272 10.1145/3366423.3380272 · DOI
- Danaja Maldeniya Ceren Budak Lionel Robert and Daniel Romero. 2020. Herding a Deluge of Good Samaritans: How GitHub Projects Respond to Increased Attention. http://dx.doi.org/10.1145/3366423.3380272 · DOI
- Thomas W Malone and Mark Klein . 2007 . Harnessing collective intelligence to address global climate change. Innovations: Technology, Governance , Globalization 2 , 3 (2007), 15 -- 26 . Thomas W Malone and Mark Klein. 2007. Harnessing collective intelligence to address global climate change. Innovations: Technology, Governance, Globalization 2, 3 (2007), 15--26.
- 10.1145/1978942.1979366 · DOI · Paper page
- 10.1145/2858036.2858391 · DOI
- 10.1145/3173574.3173583 · DOI
- 10.1111/j.1541-0072.2010.00401.x · DOI · Paper page
- Michael D McGinnis and Elinor Ostrom . 2014. Social-ecological system framework: initial changes and continuing challenges . Ecology and Society 19, 2 ( 2014 ). Michael D McGinnis and Elinor Ostrom. 2014. Social-ecological system framework: initial changes and continuing challenges. Ecology and Society 19, 2 (2014).
- Jennifer L Mnookin . 1996 . Virtual (ly) law: The emergence of law in LambdaMoo: Mnookin . Journal of computer-mediated communication 2 , 1 (1996), JCMC214. Jennifer L Mnookin. 1996. Virtual (ly) law: The emergence of law in LambdaMoo: Mnookin. Journal of computer-mediated communication 2, 1 (1996), JCMC214.
- 10.1145/344949.344959 · DOI · Paper page
- Beth Simone Noveck . 2009. Wiki government: How technology can make government better, democracy stronger, and citizens more powerful . Brookings Institution Press . Beth Simone Noveck. 2009. Wiki government: How technology can make government better, democracy stronger, and citizens more powerful. Brookings Institution Press.
- Elinor Ostrom. 1990. Governing the commons-The evolution of institutions for collective actions. Political economy of institutions and decisions. Elinor Ostrom. 1990. Governing the commons-The evolution of institutions for collective actions. Political economy of institutions and decisions. · DOI · Paper page
- Sam Ransbotham and Gerald C Kane . 2011. Membership turnover and collaboration success in online communities: Explaining rises and falls from grace in Wikipedia. Mis Quarterly ( 2011 ), 613--627. Sam Ransbotham and Gerald C Kane. 2011. Membership turnover and collaboration success in online communities: Explaining rises and falls from grace in Wikipedia. Mis Quarterly (2011), 613--627.
- Sarah T Roberts . 2019. Behind the screen: Content moderation in the shadows of social media . Yale University Press . Sarah T Roberts. 2019. Behind the screen: Content moderation in the shadows of social media. Yale University Press.
- 10.1145/2702123.2702508 · DOI · Paper page
- Sarita Schoenebeck , Oliver L Haimson , and Lisa Nakamura . 2020. Drawing from justice theories to support targets of online harassment. new media & society ( 2020 ), 1461444820913122. Sarita Schoenebeck, Oliver L Haimson, and Lisa Nakamura. 2020. Drawing from justice theories to support targets of online harassment. new media & society (2020), 1461444820913122.
- 10.1145/2675133.2675215 · DOI · Paper page
- 10.1145/2998181.2998235 · DOI · Paper page
- 10.1145/3359317 · DOI
Cited by
Yes: Affirmative Consent as a Theoretical Framework for Understanding and Imagining Social Platforms
Im, J., Dimond, J., Berton, M., Lee, U., Mustelier, K., Ackerman, M. S., & Gilbert, E. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445778 · Cited by 119
Exploring the Use of Personalized AI for Identifying Misinformation on Social Media
Jahanbakhsh, F., Katsis, Y., Wang, D., Popa, L., & Muller, M. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581219 · Cited by 42
Effective voice: Beyond exit and affect in online communities
Frey, S., & Schneider, N. (2023) · New Media & Society · doi:10.1177/14614448211044025 · Cited by 18
“More dedicated tooling could further facilitate effective voice not just within community rule-sets but over those rule-sets as well (Schneider et al., 2021; Zhang et al., 2020), which in turn may increase the sustainability and adaptability of a community (Frey et al., 2019).”
BackgroundKuo, T.-S., Chen, Q. Z., Zhang, A. X., Hsieh, J., Zhu, H., & Holstein, K. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713865 · Cited by 12
Self-citationBaillargeon, P., Yoon, J., & Zhang, A. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3711106 · Cited by 8
Self-citation
Metadata
- Authors
- Zhang, A. X., Hugh, G., & Bernstein, M. S.
- Venue
- Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology
- Publisher
- ACM
- Published
- 2020-10-20
- Pages
- 365-378
- OpenAlex
- W3047791797
- Cited by
- 60
- References
- 15
- FWCI
- 14.81
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: PolicyKit: Building Governance in Online Communities. https://app.cochat.ai/papers/10.1145/3379337.3415858
- The paper
- Zhang, A. X., Hugh, G., & Bernstein, M. S. (2020). PolicyKit: Building Governance in Online Communities. Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology. https://doi.org/10.1145/3379337.3415858
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.