Explaining the Principles to Practices Gap in AI
The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Abstract
As artificial intelligence (AI) permeates across social and economic life, its ethical and governance implications have come to the forefront. Active debates surround AI's role in labor displacement, autonomous vehicles, military, misinformation, healthcare, education, and more. As societies collectively grapple with these challenges, new opportunities for AI to proactively contribute to social good (AI4SG) and equity (AI4Eq) have also been proposed [1], [2], such as Microsoft's AI for Earth program. These efforts highlight the potential of AI to address global challenges and help achieve targets like the United Nation's sustainable development goals (SDGs) [3]. Yet, whether AI efforts are directed explicitly at social good and equity or not, there are many barriers that stand between aspirations to be responsible and the translation of these aspirations into concrete practicalities.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)
Adadi, A., & Berrada, M. (2018) · IEEE Access · doi:10.1109/access.2018.2870052 · Cited by 6,294
Knowledge management: An organizational capabilities perspective
Gold, A. H., Malhotra, A., & Segars, A. H. (2001) · Journal of Management Information Systems · doi:10.1080/07421222.2001.11045669 · Cited by 6,233
Fair prediction with disparate impact: a study of bias in recidivism prediction instruments
Chouldechova, A. (2017) · Big Data · doi:10.1089/big.2016.0047 · Cited by 2,159 · cited 1×
“…today might identify a normative principle like “fairness,” specified in a corporate responsible AI policy, pick a plausible fairness metric to instantiate it (noting there are ineliminable tradeoffs between different metrics [27]), apply it, and communicate these decisions transparently [28].”
BackgroundThe Ethics of AI Ethics: An Evaluation of Guidelines
Hagendorff, T. (2020) · Minds and Machines · doi:10.1007/s11023-020-09517-8 · Cited by 1,911 · cited 1×
“For example, Hagendorff [14] argues that when companies are driven by an economic logic, “engineers and developers are neither systematically educated about ethical issues, nor are they empowered, for example by organizational structures, to raise ethical concerns.””
BackgroundThe Ethics of AI Ethics -- An Evaluation of Guidelines
Hagendorff, T. (2019) · arXiv · doi:10.48550/arxiv.1903.03425 · Cited by 1,907 · cited 1×
“For example, Hagendorff [14] argues that when companies are driven by an economic logic, “engineers and developers are neither systematically educated about ethical issues, nor are they empowered, for example by organizational structures, to raise ethical concerns.””
BackgroundPrinciples alone cannot guarantee ethical AI
Mittelstadt, B. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0114-4 · Cited by 1,886 · cited 2×
“According to Mittelstadt [11], “norms and requirements can rarely be logically deduced… without accounting for specific elements of the technology, application, context of use, or relevant local norms.””
BackgroundFairness and Abstraction in Sociotechnical Systems
Selbst, A. D., Boyd, D., Friedler, S. A., Venkatasubramanian, S., & Vertesi, J. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287598 · Cited by 1,631 · cited 1×
“Yet approaching social issues like bias and fairness too narrowly leads to what Selbst et al. (2018) call category or abstraction errors [29].”
BackgroundMan is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings
Bolukbasi, T., Chang, K.-W., Zou, J., Saligrama, V., & Kalai, A. (2016) · arXiv · doi:10.48550/arxiv.1607.06520 · Cited by 1,615 · cited 1×
“Some such methods are relatively narrower in scope, such as those surrounding explainable AI [41], bias [42], or procurement (e.g., the AI-RFX Procurement Framework).”
BackgroundBellamy, R. K. E., Dey, K., Hind, M., Hoffman, S. C., Houde, S., Kannan, K., Lohia, P., Martino, J., Mehta, S., Mojsilovic, A., et al. (2018) · arXiv · doi:10.48550/arxiv.1810.01943 · Cited by 1,581
AI Fairness 360: An extensible toolkit for detecting and mitigating algorithmic bias
Bellamy, R. K. E., Dey, K., Hind, M., Hoffman, S. C., Houde, S., Kannan, K., Lohia, P., Martino, J., Mehta, S., Mojsilović, A., et al. (2019) · IBM Journal of Research and Development · doi:10.1147/jrd.2019.2942287 · Cited by 884
Morley, J., Floridi, L., Kinsey, L., & Elhalal, A. (2020) · Science and Engineering Ethics · doi:10.1007/s11948-019-00165-5 · Cited by 882 · cited 2×
“Among the most comprehensive work assessing the principles-to-practices gap is the 2019 review by Morley et al. [40], which systematically explores existing responsible AI tools and methodologies mapped against seven components of the AI development lifecycle: 1) business and use-case development;…”
BackgroundFairness in Machine Learning: Lessons from Political Philosophy
Binns, R. (2017) · arXiv · doi:10.48550/arxiv.1712.03586 · Cited by 676
A Survey of Value Sensitive Design Methods
Friedman, B., Hendry, D. G., & Borning, A. (2017) · Foundations and Trends® in Human–Computer Interaction · doi:10.1561/1100000015 · Cited by 389 · cited 1×
“Still more relevant methods and approaches proposed for responsible AI also come from outside of the AI domain and include privacy-by-design [45], value-sensitive design [46], the Responsible Research and Innovation (RRI) approach [47], and numerous others.”
Greene, D., Hoffmann, A. L., & Stark, L. (2019) · Proceedings of the Annual Hawaii International Conference on System Sciences · doi:10.24251/hicss.2019.258 · Cited by 386 · cited 1×
“For example, Greene et al. [12] argue that companies attempt to shift responsibility onto designers and experts to minimize scrutiny of business decisions.”
Background‘Nuts and Bolts and People’ Gender Troubled Engineering Identities
Faulkner, W. (2015) · Philosophy of Engineering and Technology · doi:10.1007/978-3-319-16172-3_2 · Cited by 383 · cited 1×
“Engineers and computer scientists may see their responsibility as focused on the quality and safety of a particular product rather than on larger -scale social issues and maybe unaware of this wider universe of implications [33].”
BackgroundTackling climate change with machine learning
Rolnick, D., Donti, P. L., Kaack, L. H., Kochanski, K., Lacoste, A., Sankaran, K., Ross, A. S., Milojevic-Dupont, N., Jaques, N., Waldman-Brown, A., et al. (2023) · ACM Computing Surveys · doi:10.1145/3485128 · Cited by 336
Toward Trustworthy AI Development: Mechanisms for Supporting Verifiable Claims
Brundage, M., Avin, S., Wang, J., Belfield, H., Krueger, G., Hadfield, G., Khlaaf, H., Yang, J., Toner, H., Fong, R., et al. (2020) · arXiv · doi:10.48550/arxiv.2004.07213 · Cited by 306 · cited 3×
“Structural elements include software and engineering development processes [37], their integration with larger business development cycles, and organizational incentives and hierarchy.”
BackgroundInfluentialFrom ethics washing to ethics bashing: a view on tech ethics from within moral philosophy
Bietti, E. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372860 · Cited by 261 · cited 1×
“While some of these deeper criticisms may be true in part or for some organizations, we think a more multifaceted and charitable interpretation [15], [16] is both appropriate and likely to be beneficial toward seeking positive change.”
BackgroundValues Levers: Building Ethics into Design
Shilton, K. (2013) · Science, Technology, & Human Values · doi:10.1177/0162243912436985 · Cited by 240
Distributed Morality in an Information Society
Floridi, L. (2013) · Science and Engineering Ethics · doi:10.1007/s11948-012-9413-4 · Cited by 201 · cited 1×
“The result is the “many hands” problem, where responsibility for managing AI is distributed and muddled [34].”
BackgroundA machine learning approach to map tropical selective logging
Hethcoat, M. G., Edwards, D. P., Carreiras, J. M. B., Bryant, R. G., França, F. M., & Quegan, S. (2019) · Remote Sensing of Environment · doi:10.1016/j.rse.2018.11.044 · Cited by 91
Designing AI for Social Good: Seven Essential Factors
Cowls, J., King, T., Taddeo, M., & Floridi, L. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3388669 · Cited by 83
IEEE 7010: A New Standard for Assessing the Well-being Implications of Artificial Intelligence
Schiff, D., Ayesh, A., Musikanski, L., & Havens, J. C. (2020) · 2020 IEEE International Conference on Systems, Man, and Cybernetics (SMC) · doi:10.1109/smc42975.2020.9283454 · Cited by 62 · cited 2×
“2 We focus on the recently published IEEE 7010 standard as an exemplar [44], [53] created specifically to assess AI’s impacts on human well-being.”
BackgroundSelf-citationMapping Selective Logging in Mixed Deciduous Forest
Lippitt, C. D., Rogan, J., Li, Z., Eastman, J. R., & Jones, T. G. (2008) · Photogrammetric Engineering & Remote Sensing · doi:10.14358/pers.74.10.1201 · Cited by 56 · cited 1×
“Lastly, in the monitoring stage of restoration projects, AI can be used to identify where deforestation may have been conducted illegally [65], [66], as well as assess risks due to fire, disease, insects, or other causes [67].”
BackgroundAdvancing impact assessment for intelligent systems
Calvo, R. A., Peters, D., & Cave, S. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-0151-z · Cited by 39 · cited 1×
“Impact assessments are one promising strategy toward achieving many of these criteria [49].”
BackgroundImproving Social Responsibility of Artificial Intelligence by Using ISO 26000
Zhao, W.-W. (2018) · IOP Conference Series: Materials Science and Engineering · doi:10.1088/1757-899x/428/1/012049 · Cited by 23
Cited by
Responsible Artificial Intelligence Governance: A Review and Research Framework
Papagiannidis, E., Mikalef, P., & Conboy, K. (2025) · The Journal of Strategic Information Systems · doi:10.1016/j.jsis.2024.101885 · Cited by 565
AI governance: themes, knowledge gaps and future agendas
Birkstedt, T., Minkkinen, M., Tandon, A., & Mäntymäki, M. (2023) · Internet Research · doi:10.1108/intr-01-2022-0042 · Cited by 309
Kong, S.-C., Cheung, W. M.-Y., & Zhang, G. (2022) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2022.100223 · Cited by 135
Artificial intelligence and clinical anatomical education: Promises and perils
Lazarus, M. D., Truong, M., Douglas, P., & Selwyn, N. (2024) · Anatomical Sciences Education · doi:10.1002/ase.2221 · Cited by 116
“The mismatch between the skill development and AIEd capacity is often due to what Schiff et al. (2021) refer to as a disciplinary divide between the engineers and computer scientists designing and developing AI tools, and the population making up the tools' end users (e.g., future healthcare…”
BackgroundLooking through a policy window with tinted glasses: Setting the agenda for U.S. AI policy
Schiff, D. S. (2023) · Review of Policy Research · doi:10.1111/ropr.12535 · Cited by 55
Self-citation
Metadata
- Authors
- Schiff, D., Rakova, B., Ayesh, A., Fanti, A., & Lennon, M.
- Venue
- IEEE Technology and Society Magazine
- Published
- 2021-06
- Volume
- 40
- Issue
- 2
- Pages
- 81-94
- ISSN
- 0278-0097 (ISSN-L)
- 1937-416X
- OpenAlex
- W3169309147
- Cited by
- 91
- References
- 26
- FWCI
- 12.67
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.