Beyond opening up the black box: Investigating the role of algorithmic systems in Wikipedian organizational culture
Open accessThe DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
Scholars and practitioners across domains are increasingly concerned with algorithmic transparency and opacity, interrogating the values and assumptions embedded in automated, black-boxed systems, particularly in user-generated content platforms. I report from an ethnography of infrastructure in Wikipedia to discuss an often understudied aspect of this topic: the local, contextual, learned expertise involved in participating in a highly automated social–technical environment. Today, the organizational culture of Wikipedia is deeply intertwined with various data-driven algorithmic systems, which Wikipedians rely on to help manage and govern the “anyone can edit” encyclopedia at a massive scale. These bots, scripts, tools, plugins, and dashboards make Wikipedia more efficient for those who know how to work with them, but like all organizational culture, newcomers must learn them if they want to fully participate. I illustrate how cultural and organizational expertise is enacted around algorithmic agents by discussing two autoethnographic vignettes, which relate my personal experience as a veteran in Wikipedia. I present thick descriptions of how governance and gatekeeping practices are articulated through and in alignment with these automated infrastructures. Over the past 15 years, Wikipedian veterans and administrators have made specific decisions to support administrative and editorial workflows with automation in particular ways and not others. I use these cases of Wikipedia’s bot-supported bureaucracy to discuss several issues in the fields of critical algorithms studies; critical data studies; and fairness, accountability, and transparency in machine learning—most principally arguing that scholarship and practice must go beyond trying to “open up the black box” of such systems and also examine sociocultural processes like newcomer socialization.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Austin, J. L. (1975) · doi:10.1093/acprof:oso/9780198245537.001.0001 · Cited by 21,496
Economy and Society: An Outline of Interpretive Sociology
Weber, M. (2002) · Readings in Economic Sociology · doi:10.1002/9780470755679.ch3 · Cited by 6,867
The Black Box Society: The Secret Algorithms That Control Money and Information
Pasquale, F. (2015) · doi:10.4159/harvard.9780674736061 · Cited by 3,796
How the machine “thinks”: Understanding opacity in machine learning algorithms
Burrell, J. (2016) · Big Data & Society · doi:10.1177/2053951715622512 · Cited by 3,196 · cited 4×
“My argument extends Burrell’s (2016) discussion of three different forms of opacity in machine learning: intentional secrecy (proprietary source code), technical literacy (such as learning to read code), and opacities inherent in machine learning (such as issues of interpretability). To these forms, I add another: the…”
BackgroundInfluential10 Sociomateriality: Challenging the Separation of Technology, Work and Organization
Orlikowski, W. J., & Scott, S. V. (2008) · Academy of Management Annals · doi:10.5465/19416520802211644 · Cited by 2,571
Layers of Silence, Arenas of Voice: The Ecology of Visible and Invisible Work
Star, S. L., & Strauss, A. (1999) · Computer Supported Cooperative Work (CSCW) · doi:10.1023/a:1008651105359 · Cited by 1,500 · cited 1×
“…efficiency of certain tasks, but also as a way for people to advance particular notions about Wikipedia’s organizational structure and culture, as scholars of IT in organizations have argued in different kinds of workplaces (Orlikowski and Scott, 2008; Star and Strauss, 1999; Zammuto et al., 2007).”
BackgroundThe Black Box Society: The Secret Algorithms That Control Money and Information
(2016) · Contemporary Sociology: A Journal of Reviews · doi:10.1177/0094306116641409c · Cited by 1,334
Gillespie, T. (2014) · Media Technologies · doi:10.7551/mitpress/9042.003.0013 · Cited by 1,016
Algorithms as culture: Some tactics for the ethnography of algorithmic systems
Seaver, N. (2017) · Big Data & Society · doi:10.1177/2053951717738104 · Cited by 1,010
What is a flag for? Social media reporting tools and the vocabulary of complaint
Crawford, K., & Gillespie, T. (2016) · New Media & Society · doi:10.1177/1461444814543163 · Cited by 496
Cited by
Algorithms at Work: The New Contested Terrain of Control
Kellogg, K. C., Valentine, M. A., & Christin, A. (2020) · Academy of Management Annals · doi:10.5465/annals.2018.0174 · Cited by 2,732
Digital inequalities in the age of artificial intelligence and big data
Lutz, C. (2019) · Human Behavior and Emerging Technologies · doi:10.1002/hbe2.140 · Cited by 411
To be or not to be algorithm aware: a question of a new digital divide?
Gran, A.-B., Booth, P., & Bucher, T. (2021) · Information, Communication & Society · doi:10.1080/1369118x.2020.1736124 · Cited by 410
“…qualitative or exploratory nature, focusing on thick descriptions of speci fi c sites of algorithmic production, maintenance and decision-making (Geiger, 2017; Mackenzie, 2015), case studies, for example of algorithmic governance (Introna, 2016; Lenglet, 2011), or more theoreti-cally-oriented…”
BackgroundSocial Media, Echo Chambers, and Political Polarization
Barberá, P. (2020) · Social Media and Democracy · doi:10.1017/9781108890960.004 · Cited by 373
Social Media and Democracy: The State of the Field, Prospects for Reform
(2020) · Cambridge University Press eBooks · doi:10.1017/9781108890960 · Cited by 295
Metadata
- Authors
- Geiger, R. S.
- Venue
- Big Data & Society
- Publisher
- SAGE Publications
- Published
- 2017-09-26
- Volume
- 4
- Issue
- 2
- Pages
- 205395171773073
- ISSN
- 2053-9517 (ISSN-L)
- OpenAlex
- W2758861434
- Cited by
- 88
- References
- 12
- FWCI
- 28.11
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Beyond opening up the black box: Investigating the role of algorithmic systems in Wikipedian organizational culture. https://app.cochat.ai/papers/10.1177/2053951717730735
- The paper
- Geiger, R. S. (2017). Beyond opening up the black box: Investigating the role of algorithmic systems in Wikipedian organizational culture. Big Data & Society. https://doi.org/10.1177/2053951717730735
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.