Deep Learning Meets Deep Democracy: Deliberative Governance and Responsible Innovation in Artificial Intelligence
Open accessThe DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Abstract
Responsible innovation in artificial intelligence (AI) calls for public deliberation: well-informed “deep democratic” debate that involves actors from the public, private, and civil society sectors in joint efforts to critically address the goals and means of AI. Adopting such an approach constitutes a challenge, however, due to the opacity of AI and strong knowledge boundaries between experts and citizens. This undermines trust in AI and undercuts key conditions for deliberation. We approach this challenge as a problem of situating the knowledge of actors from the AI industry within a deliberative system. We develop a new framework of responsibilities for AI innovation as well as a deliberative governance approach for enacting these responsibilities. In elucidating this approach, we show how actors from the AI industry can most effectively engage with experts and nonexperts in different social venues to facilitate well-informed judgments on opaque AI systems and thus effectuate their democratic governance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Rudin, C. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0048-x · Cited by 10,561 · cited 1×
“While issues of expert opacity can be addressed at least in part through efforts aimed at replacing black-box models with interpretable ones (Rudin, 2019), these solutions do not address important tensions related to expert and civic engagement in deliberation.”
BackgroundThe global landscape of AI ethics guidelines
Jobin, A., Ienca, M., & Vayena, E. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0088-2 · Cited by 6,220
Explanation in artificial intelligence: Insights from the social sciences
Miller, T. (2019) · Artificial Intelligence · doi:10.1016/j.artint.2018.07.007 · Cited by 5,302
Floridi, L., Cowls, J., Beltrametti, M., Chatila, R., Chazerand, P., Dignum, V., Luetge, C., Madelin, R., Pagallo, U., Rossi, F., et al. (2018) · Minds and Machines · doi:10.1007/s11023-018-9482-5 · Cited by 4,774 · cited 7×
“As such, AI mini-publics are key long-term agents of traceability (Mittelstadt et al., 2016) and explicability (Floridi et al., 2018).”
BackgroundMethodInfluentialDwivedi, Y. K., Hughes, L., Ismagilova, E., Aarts, G., Coombs, C., Crick, T., Duan, Y., Dwivedi, R., Edwards, J., Eirug, A., et al. (2021) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2019.08.002 · Cited by 4,611 · cited 1×
“Toward outsiders, meanwhile, the focus should be on why explanations, that is, on providing reasons to end users as to why a particular course of action was taken (Dwivedi et al., 2019; Rahwan, 2018).”
BackgroundThe ethics of algorithms: Mapping the debate
Mittelstadt, B. D., Allo, P., Taddeo, M., Wachter, S., & Floridi, L. (2016) · Big Data & Society · doi:10.1177/2053951716679679 · Cited by 4,567 · cited 17×
“This canmake it difficult even for AI developers themselves to forecast or reconstruct how data inputs are handled within such systems, how decisions are made, and how these decisions impact domains of application in the long term (Mittelstadt et al., 2016).”
BackgroundMethodInfluentialThe Black Box Society: The Secret Algorithms That Control Money and Information
Pasquale, F. (2015) · doi:10.4159/harvard.9780674736061 · Cited by 3,796
How the machine “thinks”: Understanding opacity in machine learning algorithms
Burrell, J. (2016) · Big Data & Society · doi:10.1177/2053951715622512 · Cited by 3,196 · cited 7×
“The literature on responsible AI has identified and continues to discuss, however, the unique role of epistemic challenges ensuing from the poor “ traceability ” (Mittelstadt et al., 2016) and “ explicability ” (Floridi et al., 2018) of “ opaque ” (Burrell, 2016) AI systems.”
BackgroundInfluentialDeveloping a framework for responsible innovation
Stilgoe, J., Owen, R., & Macnaghten, P. (2013) · Research Policy · doi:10.1016/j.respol.2013.05.008 · Cited by 3,184
Algorithms at Work: The New Contested Terrain of Control
Kellogg, K. C., Valentine, M. A., & Christin, A. (2020) · Academy of Management Annals · doi:10.5465/annals.2018.0174 · Cited by 2,732
Model Cards for Model Reporting
Mitchell, M., Wu, S., Zaldivar, A., Barnes, P., Vasserman, L., Hutchinson, B., Spitzer, E., Raji, I. D., & Gebru, T. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287596 · Cited by 2,681
Varieties of Participation in Complex Governance
Fung, A. (2006) · Public Administration Review · doi:10.1111/j.1540-6210.2006.00667.x · Cited by 2,464 · cited 2×
“The mode of engagement here is “technical expertise” (Fung, 2006), and actors from the AI industry should have an active and structured role in such expert deliberations.”
BackgroundOpen source software and the “private-collective” innovation model: Issues for organization science
Hippel, E. V., & Krogh, G. V. (2003) · Organization Science · doi:10.1287/orsc.14.2.209.14992 · Cited by 2,145 · cited 1×
“…section “ Enacting Responsible AI Governance ” ), open participation and deliberation by AI industry actors can obviously create problems of agency, for instance, in cases when the disclosure and sharing of information lead to disproportionate advantages for competitors (Hippel & Van Krogh, 2003).”
European Union Regulations on Algorithmic Decision Making and a “Right to Explanation”
Goodman, B., & Flaxman, S. (2017) · AI Magazine · doi:10.1609/aimag.v38i3.2741 · Cited by 2,131 · cited 2×
“For example, such consideration would involve balancing conflicting pressures between harnessing the potential for accuracy of AI systems (including their power to do good) against the need for these systems to be accountable (Goodman & Flaxman, 2017).”
BackgroundThe Ethics of AI Ethics: An Evaluation of Guidelines
Hagendorff, T. (2020) · Minds and Machines · doi:10.1007/s11023-020-09517-8 · Cited by 1,911 · cited 2×
“In its current version, moreover, the framework appears to replicate a central omission in AI ethics guidelines concerning the role of governance: as shown by a recent study of twenty-two guidelines (Hagendorff, 2020), questions of governance are rarely addressed in codes and principles for ethical AI.”
BackgroundThe Ethics of AI Ethics -- An Evaluation of Guidelines
Hagendorff, T. (2019) · arXiv · doi:10.48550/arxiv.1903.03425 · Cited by 1,907 · cited 2×
“In its current version, moreover, the framework appears to replicate a central omission in AI ethics guidelines concerning the role of governance: as shown by a recent study of twenty-two guidelines (Hagendorff, 2020), questions of governance are rarely addressed in codes and principles for ethical AI.”
BackgroundAnanny, M., & Crawford, K. (2018) · New Media & Society · doi:10.1177/1461444816676645 · Cited by 1,836 · cited 5×
“…the functionality of an AI, ensuring its competitiveness, or protecting the privacy of user data (Ananny & Crawford, 2018; Glenn & Monteith, 2014; Leese, 2014; Stark & Fins, 2013) but also the motives of avoiding accountability and evading regulations (Ananny & Crawford, 2018; Martin, 2019).”
BackgroundInfluentialStirling, A. (2008) · Science, Technology, & Human Values · doi:10.1177/0162243907311265 · Cited by 1,567
The Oxford Handbook of Deliberative Democracy
(2018) · doi:10.1093/oxfordhb/9780198747369.001.0001 · Cited by 1,428
Morley, J., Floridi, L., Kinsey, L., & Elhalal, A. (2020) · Science and Engineering Ethics · doi:10.1007/s11948-019-00165-5 · Cited by 882 · cited 8×
“This pipeline is a useful reference point in that various ethical challenges and related translational tools for ethical AI can be better understood by plotting them across this pipeline and addressing their implications in relation to these different stages (Morley et al., 2020).”
BackgroundInfluentialEthical Implications and Accountability of Algorithms
Martin, K. (2019) · Journal of Business Ethics · doi:10.1007/s10551-018-3921-3 · Cited by 757
Artificial Intelligence and the ‘Good Society’: the US, EU, and UK approach
Cath, C., Wachter, S., Mittelstadt, B., Taddeo, M., & Floridi, L. (2017) · Science and Engineering Ethics · doi:10.1007/s11948-017-9901-7 · Cited by 733
Measuring Political Deliberation: A Discourse Quality Index
Steenbergen, M. R., Bächtiger, A., Spörndli, M., & Steiner, J. (2003) · Comparative European Politics · doi:10.1057/palgrave.cep.6110002 · Cited by 719
There is a blind spot in AI research
Crawford, K., & Calo, R. (2016) · Nature · doi:10.1038/538311a · Cited by 580
Society-in-the-loop: programming the algorithmic social contract
Rahwan, I. (2018) · Ethics and Information Technology · doi:10.1007/s10676-017-9430-8 · Cited by 553
Translating Principles into Practices of Digital Ethics: Five Risks of Being Unethical
Floridi, L. (2019) · Philosophy & Technology · doi:10.1007/s13347-019-00354-x · Cited by 524 · cited 3×
“Consider, for instance, the recent criticism that the AI industry utilizes soft governance merely for purposes of “ ethics washing ” and for delaying regulation (Butcher & Beridze, 2019; Floridi, 2019b).”
BackgroundVeale, M., & Binns, R. (2017) · Big Data & Society · doi:10.1177/2053951717743530 · Cited by 512
Veale, M., & Binns, R. (2017) · doi:10.31235/osf.io/ustxg · Cited by 512
Zarsky, T. (2016) · Science, Technology, & Human Values · doi:10.1177/0162243915605575 · Cited by 422
The ethics of algorithms: key problems and solutions
Tsamados, A., Aggarwal, N., Cowls, J., Morley, J., Roberts, H., Taddeo, M., & Floridi, L. (2022) · AI & SOCIETY · doi:10.1007/s00146-021-01154-8 · Cited by 384
Organizational Transparency: Conceptualizations, Conditions, and Consequences
Albu, O. B., & Flyverbom, M. (2019) · Business & Society · doi:10.1177/0007650316659851 · Cited by 361
Will Democracy Survive Big Data and Artificial Intelligence?
Helbing, D., Frey, B. S., Gigerenzer, G., Hafen, E., Hagner, M., Hofstetter, Y., van den Hoven, J., Zicari, R. V., & Zwitter, A. (2019) · Towards Digital Enlightenment · doi:10.1007/978-3-319-90869-4_7 · Cited by 355
Transparent to whom? No algorithmic accountability without a critical audience
Kemper, J., & Kolkman, D. (2019) · Information, Communication & Society · doi:10.1080/1369118x.2018.1477967 · Cited by 260 · cited 2×
“…efforts do not take place in a social vacuum but in specific cultural and organizational settings (Felzmann, Villaronga, Lutz, & Tamò-Larrieux, 2019; Kemper & Kolkman, 2019; Miller, 2019), meaning they are performative and may have unintended consequences and downsides (Albu & Flyverbom, 2019).”
BackgroundFloridi, L. (2016) · SSRN Electronic Journal · doi:10.2139/ssrn.3835211 · Cited by 227
Artificial Intelligence Policy: A Primer and Roadmap
Calo, R. (2018) · University of Bologna Law Review · doi:10.6092/issn.2531-6133/8670 · Cited by 197
Democratizing Algorithmic Fairness
Wong, P.-H. (2020) · Philosophy & Technology · doi:10.1007/s13347-019-00355-w · Cited by 182
Buhmann, A., Paßmann, J., & Fieseler, C. (2020) · Journal of Business Ethics · doi:10.1007/s10551-019-04226-4 · Cited by 167 · cited 5×
“Third, by emphasizing the role of organizational learning (Scherer & Palazzo, 2010), the PCSR approach takes account of the dynamic nature of AI and the related potential for corporate routines, goals, and governance structures to be revised and shifted over time, either to achieve competitive (first-mover) advantages…”
BackgroundInfluentialSelf-citationAlgorithmic realism: expanding the boundaries of algorithmic thought
Green, B., & Viljoen, S. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372840 · Cited by 161
Social choice ethics in artificial intelligence
Baum, S. D. (2020) · AI & SOCIETY · doi:10.1007/s00146-017-0760-1 · Cited by 158 · cited 1×
“, 2014) and the appropriateness of extant social evaluation of these impacts (Baum, 2020; Buhmann et al., 2020).”
BackgroundJUSTIFIED BELIEF IN A DIGITAL AGE: ON THE EPISTEMIC IMPLICATIONS OF SECRET INTERNET TECHNOLOGIES
Miller, B., & Record, I. (2013) · Episteme · doi:10.1017/epi.2013.11 · Cited by 153
AI Ethics in the Public, Private, and NGO Sectors: A Review of a Global Document Collection
Schiff, D., Borenstein, J., Biddle, J., & Laas, K. (2021) · IEEE Transactions on Technology and Society · doi:10.1109/tts.2021.3052127 · Cited by 149 · cited 4×
“Attempts to address this problem have led to a surge in the issuance of guidelines for “ ethical AI ” over the past five years, authored by governments, nongovern-mental organizations, and corporations (Schiff, Borenstein, Biddle, & Laas, 2021).”
BackgroundInfluentialTheory Assessment and Agenda Setting in Political CSR: A Critical Theory Perspective
Scherer, A. G. (2018) · International Journal of Management Reviews · doi:10.1111/ijmr.12137 · Cited by 149 · cited 7×
“Indeed, our arguments can extend recent work from the PCSR literature on governing innovation more generally (Scherer & Voegtlin, 2020; Voegtlin & Scherer, 2017).”
BackgroundInfluentialThe Debate on the Moral Responsibilities of Online Service Providers
Taddeo, M., & Floridi, L. (2016) · Science and Engineering Ethics · doi:10.1007/s11948-015-9734-1 · Cited by 141 · cited 1×
“Although this macro – micro connection is currently explored in relation to data ethics more broadly (Taddeo & Floridi, 2016; Tsamados et al., 2021), it has rarely been examined with a business ethics focus in mind (Häußermann & Lütge, 2021).”
Background
Cited by
Camilleri, M. A. (2024) · Expert Systems · doi:10.1111/exsy.13406 · Cited by 331
Looking through a policy window with tinted glasses: Setting the agenda for U.S. AI policy
Schiff, D. S. (2023) · Review of Policy Research · doi:10.1111/ropr.12535 · Cited by 55
Scherer, A. G., Neesham, C., Schoeneborn, D., & Scholz, M. (2023) · Business Ethics Quarterly · doi:10.1017/beq.2023.7 · Cited by 24
Avoid diluting democracy by algorithms
Sætra, H. S., Borgebund, H., & Coeckelbergh, M. (2022) · Nature Machine Intelligence · doi:10.1038/s42256-022-00537-w · Cited by 22
Metadata
- Authors
- Buhmann, A., & Fieseler, C.
- Venue
- Business Ethics Quarterly
- Publisher
- Cambridge University Press (CUP)
- Published
- 2022-01-24
- Volume
- 33
- Issue
- 1
- Pages
- 146-179
- ISSN
- 1052-150X (ISSN-L)
- 2153-3326
- OpenAlex
- W4206945061
- Cited by
- 131
- References
- 43
- FWCI
- 27.58
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.