Seeing without knowing: Limitations of the transparency ideal and its application to algorithmic accountability
The DOI matches its Crossref record; 85 of the 86 references it cites were found in a registry or an index.
Abstract
Models for understanding and holding systems accountable have long rested upon ideals and logics of transparency. Being able to see a system is sometimes equated with being able to know how it works and govern it—a pattern that recurs in recent work about transparency and computational systems. But can “black boxes’ ever be opened, and if so, would that ever be sufficient? In this article, we critically interrogate the ideal of transparency, trace some of its roots in scientific and sociotechnical epistemological cultures, and present 10 limitations to its application. We specifically focus on the inadequacy of transparency for understanding and governing algorithmic systems and sketch an alternative typology of algorithmic accountability grounded in constructive engagements with the limitations of transparency ideals.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Transparency has its limitations and is often viewed as inadequate and limited ( Ananny and Crawford 2018 ).”
From Legal and human rights issues of AI: Gaps, challenges and vulnerabilities (2020) · cites this paper as Ananny and Crawford 2018
In the citing paper
“Meaningful accountability thus requires a view of the whole socio-technical process [2,43,66,75], from commissioning of the system; through design of the model, selection of training data, and training and testing procedures; to making individual decisions; and on to the effects of those decisions and any subsequent investigations.”
From Reviewable Automated Decision-Making: A Framework for Accountable Algorithmic Systems (2021) · cites this paper as [2]
In the citing paper
“Moreover, by focusing on models and holding individuals themselves responsible for understanding how they work, broader technical and organisational processes and other systemic issues are obscured, and attention is diverted from other (perhaps more relevant) factors [2,26].”
From Reviewable Automated Decision-Making: A Framework for Accountable Algorithmic Systems (2021) · cites this paper as [2]
In the citing paper
“Moreover, transparency can be harmful [2].”
From Reviewable Automated Decision-Making: A Framework for Accountable Algorithmic Systems (2021) · cites this paper as [2]
In the citing paper
“and even contextually appropriate information is always open to subjective interpretation and contestation [2].”
From Reviewable Automated Decision-Making: A Framework for Accountable Algorithmic Systems (2021) · cites this paper as [2]
30 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Dewey, J. (1986) · The Educational Forum · doi:10.1080/00131728609335764 · Cited by 13,432
The System of Professions: An Essay on the Division of Expert Labor
Abbott, A. (1988) · doi:10.7208/chicago/9780226189666.001.0001 · Cited by 7,733
(1980) · Medical Entomology and Zoology · Cited by 7,534
Katuna, A., Dewey, J., Schneider, F., Dickerman, W., Stephan, A. S., Sorenson, H., & Hart, J. K. (1938) · American Sociological Review · doi:10.2307/2084758 · Cited by 6,905
The System of Professions: An Essay on the Division of Expert Labor.
Tolbert, P. S., & Abbott, A. (1990) · Administrative Science Quarterly · doi:10.2307/2393403 · Cited by 5,617
The Black Box Society: The Secret Algorithms That Control Money and Information
Pasquale, F. (2015) · doi:10.4159/harvard.9780674736061 · Cited by 3,796
Bateson, G. (2000) · University of Chicago Press eBooks · doi:10.7208/chicago/9780226924601.001.0001 · Cited by 3,401
How the machine “thinks”: Understanding opacity in machine learning algorithms
Burrell, J. (2016) · Big Data & Society · doi:10.1177/2053951715622512 · Cited by 3,196 · cited 1×
“Sometimes, the details of a system will be not only protected by corporate secrecy or indecipherable to those without technical skills, but inscrutable even to its creators because of the scale and speed of its design (Burrell, 2016; Crain, 2018).”
BackgroundGoodwin, C. (1994) · American Anthropologist · doi:10.1525/aa.1994.96.3.02a00100 · Cited by 3,117
Mindstorms: Children, Computers, and Powerful Ideas
Malraison, P. J., & Papert, S. (1981) · The Two-Year College Mathematics Journal · doi:10.2307/3027082 · Cited by 1,824
Turner, F. (2006) · University of Chicago Press eBooks · doi:10.7208/chicago/9780226817439.001.0001 · Cited by 1,818 · cited 1×
“…the performance of “open” technological cultures has many chapters, including the growth of early virtual communities from counter-culture roots (Turner, 2006), the pursuit of radical transparency by open source programming collectives (Kelty, 2008), and Wikipedia editing communities (Tkacz,…”
BackgroundAn Engine, Not a Camera: How Financial Models Shape Markets
Mackenzie, D. A. (2006) · Cited by 1,395
The Black Box Society: The Secret Algorithms That Control Money and Information
(2016) · Contemporary Sociology: A Journal of Reviews · doi:10.1177/0094306116641409c · Cited by 1,334
Dark Matters: On the Surveillance of Blackness
Browne, S. (2015) · doi:10.1215/9780822375302 · Cited by 1,135
Gillespie, T. (2014) · Media Technologies · doi:10.7551/mitpress/9042.003.0013 · Cited by 1,016 · cited 1×
“…in historical contexts, but they are also changing amid a new set of online cultures, digital infrastructures, and networked institutions defining the conditions under which systems can be seen and understood—conditions of visibility governed in part through algorithmic systems (Gillespie, 2014).”
BackgroundAn Engine, Not a Camera: How Financial Models Shape Markets
Marquis, C. (2007) · Contemporary Sociology: A Journal of Reviews · doi:10.1177/009430610703600326 · Cited by 933
The uncertain relationship between transparency and accountability
Fox, J. (2007) · Development in Practice · doi:10.1080/09614520701469955 · Cited by 859 · cited 5×
“…answer for their actions) versus “ hard ” accountability (in which transparency brings the power to sanction and demand compensation for harms) (Fox, 2007); •• Transparency “ upwards ” (“the hierarchical superior/principal can observe the conduct, behavior, and/or ‘results’ of the hierarchical…”
BackgroundInfluentialObjectivity and the Escape from Perspective
Daston, L. (1992) · Social Studies of Science · doi:10.1177/030631292022004002 · Cited by 787 · cited 2×
“Several historians point to early Enlightenment practices around scientific evidence and social engineering as sites where transparency first emerged in a modern form (Crary, 1990; Daston, 1992; Daston and Galison, 2007; Hood, 2006).”
BackgroundTwo Bits: The Cultural Significance of Free Software
Kelty, C. M. (2008) · doi:10.2307/j.ctv1198vx9 · Cited by 774
Proceedings of the British Academy, 1937
(1939) · Notes and Queries · doi:10.1093/nq/176.25.449 · Cited by 764
Accountability in algorithmic decision making
Diakopoulos, N. (2016) · Communications of the ACM · doi:10.1145/2844110 · Cited by 763
Schnackenberg, A. K., & Tomlinson, E. C. (2016) · Journal of Management · doi:10.1177/0149206314525202 · Cited by 762
Two Bits: The Cultural Significance of Free Software
(2008) · Choice Reviews Online · doi:10.5860/choice.46-2158 · Cited by 709 · cited 1×
“…of early virtual communities from counter-culture roots (Turner, 2006), the pursuit of radical transparency by open source programming collectives (Kelty, 2008), and Wikipedia editing communities (Tkacz, 2015), the activism of “hacker” movements premised on enacting libertarian self-realization…”
BackgroundAutomated Experiments on Ad Privacy Settings: A Tale of Opacity, Choice, and Discrimination
Datta, A., Tschantz, M. C., & Datta, A. (2015) · Proceedings on Privacy Enhancing Technologies · doi:10.1515/popets-2015-0007 · Cited by 676 · cited 5×
“The researchers conclude that even Google’s own transparency tools are problematically opaque and unhelpful.”
BackgroundInfluentialDoubt is their product: how industry's assault on science threatens your health
(2009) · Choice Reviews Online · doi:10.5860/choice.46-2701 · Cited by 653
Striphas, T. (2015) · European Journal of Cultural Studies · doi:10.1177/1367549415577392 · Cited by 647 · cited 1×
“…2016: 1)—but also as relationships without social articulation (Eslami et al., 2015), elite structuring masked as emergent sociality (Mackenzie, 2015; Striphas, 2015), automated media circulation (Hallinan and Striphas, 2014; Napoli, 2014), optimized labor (Kushner, 2013) and financial markets…”
BackgroundThe emotion machine: commonsense thinking, artificial intelligence, and the future of the human mind
(2007) · Choice Reviews Online · doi:10.5860/choice.44-5688 · Cited by 635 · cited 1×
“And if accountability requires seeing a system well enough to understand it—and if Minsky (2007: 6) is right that if “you ‘understand’ something in only one way, then you scarcely understand it at all”—then using transparency for accountability begs the question of what, exactly, is being held to…”
BackgroundEslami, M., Rickman, A., Vaccaro, K., Aleyasen, A., Vuong, A., Karahalios, K., Hamilton, K., & Sandvig, C. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702556 · Cited by 627 · cited 1×
“…of people, things, processes, documents and resources” (Neyland and Möllers, 2016: 1)—but also as relationships without social articulation (Eslami et al., 2015), elite structuring masked as emergent sociality (Mackenzie, 2015; Striphas, 2015), automated media circulation (Hallinan and…”
BackgroundRethinking the Black Public Sphere: An Alternative Vocabulary for Multiple Public Spheres
Squires, C. R. (2002) · Communication Theory · doi:10.1111/j.1468-2885.2002.tb00278.x · Cited by 560 · cited 2×
“Hidden transcripts—like those that organized the underground railroad during US slavery (Bratich, 2016: 180)—“guard against unwanted publicity of the group’s true opinions, ideas, and tactics for survival” (Squires, 2002: 458).”
BackgroundRecommended for you: The Netflix Prize and the production of algorithmic culture
Hallinan, B., & Striphas, T. (2016) · New Media & Society · doi:10.1177/1461444814538646 · Cited by 528 · cited 1×
“, 2015), elite structuring masked as emergent sociality (Mackenzie, 2015; Striphas, 2015), automated media circulation (Hallinan and Striphas, 2014; Napoli, 2014), optimized labor (Kushner, 2013) and financial markets (Arnoldi, 2015), bracketed research methods (Driscoll and Walker, 2014), and rationalized expertise (…”
BackgroundScience on Stage: Expert Advice as Public Drama
Hilgartner, S. (2000) · Stanford University Press eBooks · doi:10.1515/9781503618220 · Cited by 478
Coding Freedom: The Ethics and Aesthetics of Hacking
Coleman, E. G. (2013) · Princeton University Press eBooks · doi:10.1515/9781400845293 · Cited by 456
(2015) · Project Muse (Johns Hopkins University) · Cited by 451
Heald, D. (2006) · Transparency: The Key to Better Governance? · doi:10.5871/bacad/9780197263839.003.0002 · Cited by 449 · cited 7×
“…that define the conditions of visibility) (Heald, 2006: 29–32); •• Transparency in retrospect (an organization’s “periodic” or “ex post account of stewardship and management”) versus real-time (in which “the accountability window is always open and surveillance is continuous”) (Heald, 2006: 32–33).”
BackgroundInfluentialCoding freedom: the ethics and aesthetics of hacking
(2013) · Choice Reviews Online · doi:10.5860/choice.50-6221 · Cited by 427 · cited 1×
“…2008), and Wikipedia editing communities (Tkacz, 2015), the activism of “hacker” movements premised on enacting libertarian self-realization through open coding ethics (Coleman, 2013), and the emerging intersection of software hacking movements with open government initiatives (Schrock, 2016).”
BackgroundSoftware visualization : programming as a multimedia experience
Stasko, J., Domingue, J., Brown, M. H., & Price, B. A. (1998) · Cited by 416
Automated Media: An Institutional Theory Perspective on Algorithmic Media Production and Consumption
Napoli, P. M. (2014) · Communication Theory · doi:10.1111/comt.12039 · Cited by 403 · cited 2×
“…al., 2015), elite structuring masked as emergent sociality (Mackenzie, 2015; Striphas, 2015), automated media circulation (Hallinan and Striphas, 2014; Napoli, 2014), optimized labor (Kushner, 2013) and financial markets (Arnoldi, 2015), bracketed research methods (Driscoll and Walker, 2014), and…”
BackgroundToward an Ethics of Algorithms: Convening, Observation, Probability, and Timeliness
Ananny, M. (2016) · Science, Technology, & Human Values · doi:10.1177/0162243915606523 · Cited by 395
Self-citationBall, C. (2009) · Public Integrity · doi:10.2753/pin1099-9922110400 · Cited by 376 · cited 1×
“…transparency: as a “public value embraced by society to counter corruption,” as a synonym for “open decision-making by governments and nonprofits,” and as a “complex tool of good governance”—all designed to create systems for “accountabil-ity, efficiency, and effectiveness” (Ball, 2009: 293).”
BackgroundOrganizational Transparency: Conceptualizations, Conditions, and Consequences
Albu, O. B., & Flyverbom, M. (2019) · Business & Society · doi:10.1177/0007650316659851 · Cited by 361 · cited 2×
“Although transparency is often thought to engender trust of organizations and systems, there is little conceptually rich empirical work confirming this (Albu and Flyverbom, 2016).”
BackgroundCrary, J. (1988) · October · doi:10.2307/779041 · Cited by 352 · cited 1×
“Several historians point to early Enlightenment practices around scientific evidence and social engineering as sites where transparency first emerged in a modern form (Crary, 1990; Daston, 1992; Daston and Galison, 2007; Hood, 2006).”
BackgroundTowards a sociology of computational and algorithmic journalism
Anderson, C. (2013) · New Media & Society · doi:10.1177/1461444812465137 · Cited by 341 · cited 1×
“…(Mackenzie, 2015; Striphas, 2015), automated media circulation (Hallinan and Striphas, 2014; Napoli, 2014), optimized labor (Kushner, 2013) and financial markets (Arnoldi, 2015), bracketed research methods (Driscoll and Walker, 2014), and rationalized expertise (Anderson, 2013; Levy, 2015).”
BackgroundTransparency in Historical Perspective
Hood, C. (2006) · Transparency: The Key to Better Governance? · doi:10.5871/bacad/9780197263839.003.0001 · Cited by 336 · cited 4×
“Hood (2006) first sees transparency as an empirical ideal appearing in the epistemological foundations of “many eighteenth-century ideas about social science, that the social world should be made knowable by methods analogous to those used in the natural sciences” (p. 8).”
BackgroundInfluentialBeyond Black Boxes: Bringing Transparency and Aesthetics Back to Scientific Investigation
Resnick, M., Berg, R., & Eisenberg, M. (2000) · Journal of the Learning Sciences · doi:10.1207/s15327809jls0901_3 · Cited by 336 · cited 2×
“Rather, it means dynamically interacting with them in order to understand how they behave in relation to their environments (Resnick et al., 2000).”
BackgroundFull Disclosure: The Perils and Promise of Transparency
Cook, B. J. (2007) · Perspectives on Politics · doi:10.1017/s153759270707243x · Cited by 324 · cited 1×
“And professions like medicine, law, advertising, and journalism all made self-regulatory moves to shore up their ethical codes, creating policies on transparency and accountability before the government did it for them (Birchall, 2011; Fung et al., 2008; Schudson, 2015).”
BackgroundCan an Algorithm be Agonistic? Ten Scenes from Life in Calculated Publics
Crawford, K. (2016) · Science, Technology, & Human Values · doi:10.1177/0162243915589635 · Cited by 314 · cited 2×
“Knowledge is produced in domains of conflicting interpretations and complex social interactions and disputes (Crawford, 2016; DiSalvo, 2012).”
BackgroundSelf-citationThe politics of transparency and the calibration of knowledge in the digital age
Hansen, H. K., & Flyverbom, M. (2015) · Organization · doi:10.1177/1350508414522315 · Cited by 273 · cited 1×
“Such “disclosure devices” (Hansen and Flyverbom, 2015: 872) are neither exclusively human nor entirely computational, but networks of human and non-human agents that create “particular visibilities and possibilities for observation.””
BackgroundThe Notebooks of Leonardo da Vinci
Conover, J. H., & Taylor, P. (1962) · Art Education · doi:10.2307/3186793 · Cited by 273
Introduction to ‘Secrecy and Transparency’: The Politics of Opacity and Openness
Birchall, C. (2011) · Theory, Culture & Society · doi:10.1177/0263276411427744 · Cited by 266
The production of prediction: What does machine learning want?
Mackenzie, A. (2015) · European Journal of Cultural Studies · doi:10.1177/1367549415577384 · Cited by 259 · cited 1×
“…and Möllers, 2016: 1)—but also as relationships without social articulation (Eslami et al., 2015), elite structuring masked as emergent sociality (Mackenzie, 2015; Striphas, 2015), automated media circulation (Hallinan and Striphas, 2014; Napoli, 2014), optimized labor (Kushner, 2013) and…”
BackgroundTurner, F. (2013) · University of Chicago Press eBooks · doi:10.7208/chicago/9780226064147.001.0001 · Cited by 259
The limits of transparency: Data brokers and commodification
Crain, M. (2018) · New Media & Society · doi:10.1177/1461444816657096 · Cited by 237 · cited 3×
“Sometimes, the details of a system will be not only protected by corporate secrecy or indecipherable to those without technical skills, but inscrutable even to its creators because of the scale and speed of its design (Burrell, 2016; Crain, 2018).”
BackgroundDiSalvo, C. (2012) · The MIT Press eBooks · doi:10.7551/mitpress/8732.001.0001 · Cited by 237
Peering into Transparency: Challenging Ideals, Proxies, and Organizational Practices
Christensen, L. T., & Cheney, G. (2015) · Communication Theory · doi:10.1111/comt.12052 · Cited by 234 · cited 2×
“…autonomy-through-openness assumes that “information is easily discernible and legible; that audiences are competent, involved, and able to comprehend” the information made visible (Christensen and Cheney, 2015: 74)—and that they act to create the potential futures openness suggests are possible.”
BackgroundDiSalvo, C. F. (2012) · Cited by 224
Doubt Is Their Product: How Industry’s Assault on Science Threatens Your Health
Gilbert, S. G. (2009) · Environmental Health Perspectives · doi:10.1289/ehp.117-a218a · Cited by 214 · cited 2×
“…2016) and scientific norms of data sharing to advance their own aims—as drug and tobacco companies do when they “institutionalize uncertainty” (Michaels, 2008: 176) by using public information to continuously manufacture alternate explanations of their product’s effects, going so far as to…”
BackgroundCivic hacking as data activism and advocacy: A history from publicity to open government data
Schrock, A. R. (2016) · New Media & Society · doi:10.1177/1461444816629469 · Cited by 174 · cited 1×
“…2008), and Wikipedia editing communities (Tkacz, 2015), the activism of “hacker” movements premised on enacting libertarian self-realization through open coding ethics (Coleman, 2013), and the emerging intersection of software hacking movements with open government initiatives (Schrock, 2016).”
BackgroundKindergarten Grammars: Designing with Froebel's Building Gifts
Stiny, G. (1980) · Environment and Planning B: Planning and Design · doi:10.1068/b070409 · Cited by 172 · cited 1×
“In Froebel’s “kindergarten method” of learning, he gave children physical objects designed to teach children how complex patterns emerged from their constituents (Stiny, 1980).”
BackgroundThe Contexts of Control: Information, Power, and Truck-Driving Work
Levy, K. E. C. (2015) · The Information Society · doi:10.1080/01972243.2015.998105 · Cited by 171 · cited 1×
“…(Mackenzie, 2015; Striphas, 2015), automated media circulation (Hallinan and Striphas, 2014; Napoli, 2014), optimized labor (Kushner, 2013) and financial markets (Arnoldi, 2015), bracketed research methods (Driscoll and Walker, 2014), and rationalized expertise (Anderson, 2013; Levy, 2015).”
BackgroundIntroduction: Sociological orientations to representational practice in science
Lynch, M., & Woolgar, S. (1988) · Human Studies · doi:10.1007/bf00177300 · Cited by 167
WikiLeaks: Inside Julian Assange's War on Secrecy
Leigh, D. S., & Harding, L. (2011) · Cited by 155
James, W. (2020) · Routledge eBooks · doi:10.4324/9781315161921-23 · Cited by 147
Transparency: Mediation and the Management of Visibilities
Flyverbom, M. (2016) · International journal of communication · Cited by 143
Wikipedia and the Politics of Openness
Tkacz, N. (2014) · University of Chicago Press eBooks · doi:10.7208/chicago/9780226192444.001.0001 · Cited by 133
The Rise of the Right to Know: Politics and the Culture of Transparency, 1945-1975
Schudson, M. (2015) · Harvard University Press eBooks · doi:10.4159/9780674915787 · Cited by 129 · cited 5×
“And professions like medicine, law, advertising, and journalism all made self-regulatory moves to shore up their ethical codes, creating policies on transparency and accountability before the government did it for them (Birchall, 2011; Fung et al., 2008; Schudson, 2015).”
BackgroundInfluentialBirchall, C. (2014) · Cultural Studies ↔ Critical Methodologies · doi:10.1177/1532708613517442 · Cited by 123 · cited 1×
“Indeed, “radical transparency” (Birchall, 2014) can harm the formation of enclave public spheres in which marginalized groups hide “counterhegemonic ideas and strategies in order to survive or avoid sanctions, while internally producing lively debate and planning” (Squires, 2002: 448).”
BackgroundAlgorithmic IF … THEN rules and the conditions and consequences of power
Neyland, D., & Möllers, N. (2017) · Information, Communication & Society · doi:10.1080/1369118x.2016.1156141 · Cited by 108 · cited 1×
“The power of these systems lies in the “careful plaiting of relatively unstable associations of people, things, processes, documents and resources” (Neyland and Möllers, 2016: 1)—but also as relationships without social articulation (Eslami et al., 2015), elite structuring masked as emergent…”
BackgroundInternational Journal of Communication Systems
(2006) · International Journal of Communication Systems · doi:10.1002/(issn)1099-1131 · Cited by 99
Defending a Paradigm by Patrolling a Boundary
Coddington, M. (2012) · Journalism & Mass Communication Quarterly · doi:10.1177/1077699012447918 · Cited by 87 · cited 2×
“…revelation of the entire Afghan War Logs database (Leigh and Harding, 2011)—acquiescing to some redaction only at the demand of journalistic partners (Coddington, 2012)—to Edward Snowden’s refusal to publicly reveal the entire database of National Security Agency (NSA) and Government…”
BackgroundWikipedia and the politics of openness
(2015) · Choice Reviews Online · doi:10.5860/choice.190605 · Cited by 86
Chalk: Materials and Concepts in Mathematics Research
Barany, M. J., & MacKenzie, D. A. (2014) · The MIT Press eBooks · doi:10.7551/mitpress/9780262525381.003.0006 · Cited by 86 · cited 1×
“, 2014: 1), mathematicians (Barany and MacKenzie, 2014), neuroscientists (De Rijcke and Beaulieu, 2014), computational biologists”
BackgroundComputer Algorithms, Market Manipulation and the Institutionalization of High Frequency Trading
Arnoldi, J. (2016) · Theory, Culture & Society · doi:10.1177/0263276414566642 · Cited by 85 · cited 1×
“…(Mackenzie, 2015; Striphas, 2015), automated media circulation (Hallinan and Striphas, 2014; Napoli, 2014), optimized labor (Kushner, 2013) and financial markets (Arnoldi, 2015), bracketed research methods (Driscoll and Walker, 2014), and rationalized expertise (Anderson, 2013; Levy, 2015).”
BackgroundHeemsbergen, L. J. (2016) · International journal of communication · Cited by 80
Misak, C. J. (2007) · doi:10.1093/oso/9780199279975.001.0001 · Cited by 79
When open data is a Trojan Horse: The weaponization of transparency in science and governance
Levy, K. E., & Johns, D. M. (2016) · Big Data & Society · doi:10.1177/2053951715621568 · Cited by 75 · cited 1×
“…techniques” of science policy advisors practicing openness to establish authority as experts—or co-opted by special interests using open data (Levy and Johns, 2016) and scientific norms of data sharing to advance their own aims—as drug and tobacco companies do when they “institutionalize…”
BackgroundThe freelance translation machine: Algorithmic culture and the invisible industry
Kushner, S. (2013) · New Media & Society · doi:10.1177/1461444812469597 · Cited by 73 · cited 2×
“…as emergent sociality (Mackenzie, 2015; Striphas, 2015), automated media circulation (Hallinan and Striphas, 2014; Napoli, 2014), optimized labor (Kushner, 2013) and financial markets (Arnoldi, 2015), bracketed research methods (Driscoll and Walker, 2014), and rationalized expertise (Anderson,…”
BackgroundMedia freedom and accountability
(1990) · Choice Reviews Online · doi:10.5860/choice.28-0095 · Cited by 43
Networked Neuroscience: Brain Scans and Visual Knowing at the Intersection of Atlases and Databases
de Rijcke, S., & Beaulieu, A. (2014) · The MIT Press eBooks · doi:10.7551/mitpress/9780262525381.003.0007 · Cited by 37
Drawing as: Distinctions and Disambiguation in Digital Images of Mars
Vertesi, J. (2014) · The MIT Press eBooks · doi:10.7551/mitpress/9780262525381.003.0002 · Cited by 33
Secrecy and Transparency: An Interview with Samuel Weber
Phillips, J. W. P. (2011) · Theory Culture & Society · doi:10.1177/0263276411428339 · Cited by 28 · cited 1×
“It includes an affective dimension, tied up with a fear of secrets, the feeling that seeing something may lead to control over it, and liberal democracy’s promise that openness ultimately creates security (Phillips, 2011).”
BackgroundWard, S. C. (1996) · Rowman & Littlefield Publishers eBooks · doi:10.5771/9781461641865 · Cited by 23 · cited 3×
“As Ward (1996) describes, any understanding of “society” is the “outcome of the settlement of controversies,” not a disconnected entity that gives truth to issues (p. 103).”
InfluentialIntroduction: Representation in Scientific Practice Revisited
Coopmans, C., Vertesi, J., Lynch, M., & Woolgar, S. (2014) · The MIT Press eBooks · doi:10.7551/mitpress/9780262525381.003.0001 · Cited by 22
Toward a New Ontology of Scientific Vision
Carusi, A., & Hoel, A. S. (2014) · The MIT Press eBooks · doi:10.7551/mitpress/9780262525381.003.0010 · Cited by 15
Towards a new Ontology of Scientific Vision
Carusi, A., & Hoel, A. S. (2014) · Research at the University of Copenhagen (University of Copenhagen) · Cited by 5
Occult(ing) Transparency: An Epilogue
Bratich, J. Z. (2016) · Cited by 1
Research works printed but not linked: 14
- Bacon M, 2012, Pragmatism
- Bratich J, 2016, International Journal of Communication Systems, 10, 178
- Brill J (2015) Scalable approaches to transparency and accountability in decisionmaking algorithms: remarks at the NYU conference on algorithms and accountability. Federal Trade Commission, 28 February. Available at: https://www.ftc.gov/system/files/documents/public_statements/629681/150228nyualgorithms.pdf
- Brown MH, 1998, Software Visualization Programming as a Multimedia Experience, 35
- Crain W, 2000, Theories and Development: Concepts and Applications
- Daston L, 2007, Objectivity
- Flyverbom M, 2016, International Journal of Communication Systems, 10, 110
- 10.7551/mitpress/9780262525374.003.0009 · doi:10.7551/mitpress/9780262525374.003.0009 · Paper page
- Greenwald G, 2014, No Place to Hide
- Heemsbergen L, 2016, International Journal of Communication Systems, 10, 138
- James W, 1997, Pragmatism: A Reader, 93
- 10.1215/9780822389002 · DOI · Paper page
- Lynch M, 1988, Human Studies, 11, 99
- Stohl C, 2016, International Journal of Communication Systems, 10, 123
Cited by
van Dijck, J., Poell, T., & de Waal, M. (2018) · doi:10.1093/oso/9780190889760.001.0001 · Cited by 2,951
Human trust in artificial intelligence: Review of empirical research
Glikson, E., & Woolley, A. W. (2020) · Academy of Management Annals · doi:10.5465/annals.2018.0057 · Cited by 2,921
“The complexity of AI algorithms rarely allows for full transparency about the basis of its decisions and the trade-offs it makes (Ananny & Crawford, 2018).”
BackgroundAlgorithms at Work: The New Contested Terrain of Control
Kellogg, K. C., Valentine, M. A., & Christin, A. (2020) · Academy of Management Annals · doi:10.5465/annals.2018.0174 · Cited by 2,732
“…that can best engage in algorithmic framing, the issues that are most amenable to discussion, the ways that different stakeholders can work across boundaries to mobilize for collective action, and how algorithmic technologies might facilitate such mobilization (Ananny & Crawford, 2018).”
BackgroundGorwa, R., Binns, R., & Katzenbach, C. (2020) · Big Data & Society · doi:10.1177/2053951719897945 · Cited by 1,097
“This is not to say that transparency is any sort of panacea, either in general or when it comes to algorithmic systems (Ananny and Crawford, 2018; Gorwa and Garton Ash, 2019), but minimum standards of decisional transparency are essential to allow both ordinary users and critical experts to…”
BackgroundCelik, I. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107468 · Cited by 1,012
Metadata
- Authors
- Ananny, M., & Crawford, K.
- Affiliations
- University of Southern California (US)
- Microsoft Research New York City (United States) (US)
- Corresponding author
- Ananny, Mike
- Venue
- New Media & Society
- Publisher
- SAGE Publications
- Published
- 2016-12-13
- Volume
- 20
- Issue
- 3
- Pages
- 973-989
- ISSN
- 1461-4448 (ISSN-L)
- 1461-7315
- OpenAlex
- W2575439561
- Semantic Scholar
- 55c9cbd66236546591d04e9ed23e95455c78703b
- Cited by
- 1,836
- References
- 86
- Citations by year
- 2026: 445 · 2025: 277 · 2024: 168 · 2023: 219 · 2022: 175 · 2021: 182 · 2020: 158 · 2019: 137 · 2018: 66 · 2017: 8 · 2016: 1
- FWCI
- 172.68
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- New Media & Society (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Social Sciences › Law › Digitalization, Law, and Regulation
- Keywords
- algorithmic accountability, black box, algorithmic governance, computational systems
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.