The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Artificial intelligence ethics has a black box problem
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Bélisle-Pipon et al. [ 7 ] reviewed 47 major AI ethics guidelines from private and public stakeholders.Their findings show that only 38% reported any kind of stakeholder engagement in their processes; only 9% reported any engagement with citizens at large.”
From Positioning Paradata: A Conceptual Frame for AI Processual Documentation in Archives and Recordkeeping Contexts (2023) · cites this paper as [7]
In the citing paper
“guidelines developed based on stakeholder engagement were widely applicable across different contexts [ 7 ].”
From Positioning Paradata: A Conceptual Frame for AI Processual Documentation in Archives and Recordkeeping Contexts (2023) · cites this paper as [7]
Citations
Cites
The global landscape of AI ethics guidelines
Jobin, A., Ienca, M., & Vayena, E. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0088-2 · Cited by 6,220
Floridi, L., Cowls, J., Beltrametti, M., Chatila, R., Chazerand, P., Dignum, V., Luetge, C., Madelin, R., Pagallo, U., Rossi, F., et al. (2018) · Minds and Machines · doi:10.1007/s11023-018-9482-5 · Cited by 4,774 · cited 1×
“…to recommending a set of guidelines for types of actors with a particular role to play in the development, regulation or use of AI (i.e., normative guidance); and to stating general principles to ensure that AI benefits and is not harmful to humanity (Floridi et al. 2018; Greene et al. 2019).”
BackgroundThe Black Box Society: The Secret Algorithms That Control Money and Information
Pasquale, F. (2015) · doi:10.4159/harvard.9780674736061 · Cited by 3,796
The Ethics of AI Ethics: An Evaluation of Guidelines
Hagendorff, T. (2020) · Minds and Machines · doi:10.1007/s11023-020-09517-8 · Cited by 1,911 · cited 7×
“As such, Jobin et al. (2019), the Berkman Klein Center for Internet and Society (BKC) (Fjeld et al. 2020), Ryan and Stahl (2020), Zeng et al. (2018), and Hagendorff (2020) have paved the way for the mapping of the main axiological land‑ marks at the heart of these normative declarations.”
BackgroundMethodInfluentialThe Ethics of AI Ethics -- An Evaluation of Guidelines
Hagendorff, T. (2019) · arXiv · doi:10.48550/arxiv.1903.03425 · Cited by 1,907 · cited 7×
“As such, Jobin et al. (2019), the Berkman Klein Center for Internet and Society (BKC) (Fjeld et al. 2020), Ryan and Stahl (2020), Zeng et al. (2018), and Hagendorff (2020) have paved the way for the mapping of the main axiological land‑ marks at the heart of these normative declarations.”
BackgroundMethodInfluentialPrinciples alone cannot guarantee ethical AI
Mittelstadt, B. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0114-4 · Cited by 1,886 · cited 4×
“(Mittelstadt 2019a).”
BackgroundInfluentialMorley, J., Floridi, L., Kinsey, L., & Elhalal, A. (2020) · Science and Engineering Ethics · doi:10.1007/s11948-019-00165-5 · Cited by 882 · cited 2×
“…2020; Estrada 2020; Mittelstadt 2019b; Hagerty and Rubinov 2019; LaGrandeur 2020; Lauer 2020; Sloane 2018), as well as the contextual applicabil‑ ity in some areas of these ethical guidelines (Ryan and Stahl 2020; Morley et al. 2020; Hickok 2020; Floridi 2019; ÓhÉigeartaigh et al. 2020).”
BackgroundHow AI can be a force for good
Taddeo, M., & Floridi, L. (2018) · Science · doi:10.1126/science.aat5991 · Cited by 760
The Atlas of AI: Power, Politics, and the Planetary Costs of Artificial Intelligence
CRAWFORD, K. (2021) · doi:10.2307/j.ctv1ghv45t · Cited by 742
Emerging challenges in AI and the need for AI ethics education
Borenstein, J., & Howard, A. (2021) · AI and Ethics · doi:10.1007/s43681-020-00002-7 · Cited by 626
Translating Principles into Practices of Digital Ethics: Five Risks of Being Unethical
Floridi, L. (2019) · Philosophy & Technology · doi:10.1007/s13347-019-00354-x · Cited by 524 · cited 1×
“…2020; Estrada 2020; Mittelstadt 2019b; Hagerty and Rubinov 2019; LaGrandeur 2020; Lauer 2020; Sloane 2018), as well as the contextual applicabil‑ ity in some areas of these ethical guidelines (Ryan and Stahl 2020; Morley et al. 2020; Hickok 2020; Floridi 2019; ÓhÉigeartaigh et al. 2020).”
BackgroundThe Role and Limits of Principles in AI Ethics: Towards a Focus on Tensions
Whittlestone, J., Nyrup, R., Alexandrova, A., & Cave, S. (2019) · Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3306618.3314289 · Cited by 399 · cited 1×
“In addition to addressing the ten‑ sions between ethical principles (Whittlestone et al. 2019), a further step will be to explore the potential axiological conflicts between stakeholders’ perspectives, especially when those of citizens contrast with industry and regulators (Gagnon et al. 2020).”
BackgroundIncorporating Ethics into Artificial Intelligence
Etzioni, A., & Etzioni, O. (2017) · The Journal of Ethics · doi:10.1007/s10892-017-9252-2 · Cited by 388
Geis, J. R., Brady, A. P., Wu, C. C., Spencer, J., Ranschaert, E., Jaremko, J. L., Langer, S. G., Borondy Kitts, A., Birch, J., Shields, W. F., et al. (2019) · Radiology · doi:10.1148/radiol.2019191586 · Cited by 388
Greene, D., Hoffmann, A. L., & Stark, L. (2019) · Proceedings of the Annual Hawaii International Conference on System Sciences · doi:10.24251/hicss.2019.258 · Cited by 386
de Fine Licht, K., & de Fine Licht, J. (2020) · AI & SOCIETY · doi:10.1007/s00146-020-00960-w · Cited by 334 · cited 1×
“And this can be very problematic because it risks alienating the popu‑ lation towards AI’s benefits due to a lack of social accept‑ ability and mistrust of AI actors (Rees et al. 2020; Fine and Fine 2020).”
BackgroundStahl, B. C. (2021) · SpringerBriefs in Research and Innovation Governance · doi:10.1007/978-3-030-69978-9 · Cited by 317
Ryan, M., & Stahl, B. C. (2021) · Journal of Information, Communication and Ethics in Society · doi:10.1108/jices-12-2019-0138 · Cited by 310 · cited 3×
“As such, Jobin et al. (2019), the Berkman Klein Center for Internet and Society (BKC) (Fjeld et al. 2020), Ryan and Stahl (2020), Zeng et al. (2018), and Hagendorff (2020) have paved the way for the mapping of the main axiological land‑ marks at the heart of these normative declarations.”
BackgroundTowards a Code of Ethics for Artificial Intelligence
Boddington, P. (2017) · Artificial Intelligence: Foundations, Theory, and Algorithms · doi:10.1007/978-3-319-60648-4 · Cited by 294
Cave, S., & Dihal, K. (2020) · Philosophy & Technology · doi:10.1007/s13347-020-00415-6 · Cited by 279
Can corporate codes of ethics influence behavior?
Cleek, M. A., & Leonard, S. L. (1998) · Journal of Business Ethics · doi:10.1023/a:1017969921581 · Cited by 258
Beyond the promise: implementing ethical AI
Eitel-Porter, R. (2021) · AI and Ethics · doi:10.1007/s43681-020-00011-6 · Cited by 245 · cited 1×
“According to Eitel‑Porter (2020), “companies [should] arrive at a final set of principles that suit their unique circumstances and their brand values”.”
BackgroundArtificial Intelligence and the Future of Humans
Ovidius University of Constanta, D. O. T., & Ciocan, T.-C. (2023) · DIALOGO · doi:10.51917/dialogo.2023.10.1.15 · Cited by 243
Overcoming Barriers to Cross-cultural Cooperation in AI Ethics and Governance
ÓhÉigeartaigh, S. S., Whittlestone, J., Liu, Y., Zeng, Y., & Liu, Z. (2020) · Philosophy & Technology · doi:10.1007/s13347-020-00402-x · Cited by 188
Alami, H., Lehoux, P., Denis, J., Motulsky, A., Petitgand, C., Savoldelli, M., Rouquet, R., Gagnon, M., Roy, D. A., & Fortin, J. (2020) · Journal of Health Organization and Management · doi:10.1108/jhom-03-2020-0074 · Cited by 178
Lessons learned from AI ethics principles for future actions
Hickok, M. (2021) · AI and Ethics · doi:10.1007/s43681-020-00008-1 · Cited by 168 · cited 1×
“…2020; Estrada 2020; Mittelstadt 2019b; Hagerty and Rubinov 2019; LaGrandeur 2020; Lauer 2020; Sloane 2018), as well as the contextual applicabil‑ ity in some areas of these ethical guidelines (Ryan and Stahl 2020; Morley et al. 2020; Hickok 2020; Floridi 2019; ÓhÉigeartaigh et al. 2020).”
BackgroundThe Cambridge handbook of artificial intelligence
(2015) · Choice Reviews Online · doi:10.5860/choice.187061 · Cited by 147
Norman, W. (2011) · Journal of Business Ethics · doi:10.1007/s10551-011-1193-2 · Cited by 143
Public engagement and AI: A values analysis of national strategies
Wilson, C. (2022) · Government Information Quarterly · doi:10.1016/j.giq.2021.101652 · Cited by 140 · cited 1×
“…the interests of private sector actors who currently dominate public debates on AI and society […], and to mitigate the risk that AI processes will be “captured” by actors who do not pursue the public good” (Wilson 2021), and are promoted by international organisms, such as the OECD and UNESCO.”
BackgroundYou cannot have AI ethics without ethics
Lauer, D. (2020) · AI and Ethics · doi:10.1007/s43681-020-00013-4 · Cited by 105
What Makes Artificial Intelligence Exceptional in Health Technology Assessment?
Bélisle‐Pipon, J., Couture, V., Roy, M., Ganache, I., Goetghebeur, M. M., & Cohen, I. G. (2021) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2021.736697 · Cited by 93
Self-citationArtificial Intelligence, Governance and Ethics: Global PerspectivesPreprint
Daly, A., Hagendorff, T., Li, H., Mann, M., Marda, V., Wagner, B., Wang, W., & Witteborn, S. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3414805 · Cited by 91
Harmonizing Artificial Intelligence for Social Good
Berberich, N., Nishida, T., & Suzuki, S. (2020) · Philosophy & Technology · doi:10.1007/s13347-020-00421-8 · Cited by 83
How safe is our reliance on AI, and should we regulate it?
LaGrandeur, K. (2020) · AI and Ethics · doi:10.1007/s43681-020-00010-7 · Cited by 83
AI Ethics – Too Principled to Fail?
Mittelstadt, B. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3391293 · Cited by 82 · cited 4×
“(Mittelstadt 2019a).”
BackgroundInfluentialArtificial agents, good care, and modernity
Coeckelbergh, M. (2015) · Metamedicine · doi:10.1007/s11017-015-9331-y · Cited by 77
Bezuidenhout, L. M., & Ratti, E. (2020) · AI & Society · doi:10.1007/s00146-020-01112-w · Cited by 68
What is science for? The Lighthill report on artificial intelligence reinterpreted
AGAR, J. (2020) · The British Journal for the History of Science · doi:10.1017/s0007087420000230 · Cited by 54 · cited 2×
“…authors predict that AI will impact many, if not all, spheres of human life (e.g., work, health, leisure) and are concerned about the dominant role of a limited number of organizations in a position of power who are deciding how this technology will be developed and used (Crawford 2021; Agar 2020).”
BackgroundA Survey of the General Public’s Views on the Ethics of Using AI in Education
Latham, A., & Goltz, N. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-23204-7_17 · Cited by 49
Arnold, D., & Oakley, J. L. (2013) · Journal of Health Politics Policy and Law · doi:10.1215/03616878-2079496 · Cited by 37
The ethical dimension of human–artificial intelligence collaboration
Boni, M. (2021) · European View · doi:10.1177/17816858211059249 · Cited by 34
Defining ethical standards for the application of digital tools to population health research
Samuel, G. N., & Derrick, G. (2019) · Bulletin of the World Health Organization · doi:10.2471/blt.19.237370 · Cited by 33
The Ethics of Artificial Intelligence
Rees, C. (2020) · IFIP advances in information and communication technology · doi:10.1007/978-3-030-64246-4_5 · Cited by 32
Fiske, A., Tigard, D. W., Müller, R., Haddadin, S., Buyx, A., & McLennan, S. (2020) · The American Journal of Bioethics · doi:10.1080/15265161.2020.1820101 · Cited by 22
Exclusivity and paternalism in the public governance of explainable AI
Keller, P., & Drake, A. (2020) · Computer Law and Security Review · doi:10.1016/j.clsr.2020.105490 · Cited by 21
New Patterns of Power and Profit
Clemons, E. K. (2018) · Springer eBooks · doi:10.1007/978-3-030-00443-9 · Cited by 13
Quelle éthique pour la finance ?
Lacroix, A., & Marchildon, A. (2013) · Presses de l'Université du Québec eBooks · doi:10.1353/book28194 · Cited by 11
Häußler, H. (2021) · Libri · doi:10.1515/libri-2021-0095 · Cited by 10
Boisvert, Y. (2008) · Santé Publique · doi:10.3917/spub.084.0313 · Cited by 8
“Engage Patients in Your Research,” They Say
Bélisle‐Pipon, J., Grande, C. D., & Rouleau, G. (2019) · Narrative Inquiry in Bioethics · doi:10.1353/nib.2019.0007 · Cited by 5
Self-citationResponsible Use of Artificial Intelligence: Perspective of a Global IT Management Consultancy
Gutiw, D., Sorg, J. M., & Rodriguez, G. C. (2024) · Advances in business information systems and analytics book series · doi:10.4018/979-8-3693-2643-5.ch010 · Cited by 3
Research works printed but not linked: 10
- Crawford K, Dobbe R, Dryer T et al (2019) AI now 2019 report. New York University, New York
- Estrada D (2020) Ideal theory in AI ethics. http://arxiv.org/abs/201102279
- Fjeld J, Hilligoss H, Achten N et al (2020) Principled artificial intelligence: a map of ethical and rights-based approaches. Berkman Klein Center for Internet and Society, Cambridge
- Gagnon M-A (2020) Ghost management as a central feature of accumulation in corporate capitalism: the case of the global pharmaceutical sector. In: Benquet M, Bourgeron T (eds) Accumulating capital today: contemporary strategies of profit and dispossessive policies, 1st edn. Routledge, pp 163–177
- Goldsmith J, Burton E (2017) Why Teaching Ethics to AI Practitioners is Important. Proc AAAI Conf Artif Intell. https://doi.org/10.5555/3297863.3297908 · doi:10.5555/3297863.3297908
- Gordon K, Miyake M (1999) Deciphering codes of corporate conduct: a review of their contents. Organisation for Economic Co-operation and Development, Paris
- Government of Canada (2020) Responsible use of artificial intelligence. Canada, Ottawa
- Hagerty A, Rubinov I (2019) Global AI ethics: a review of the social impacts and ethical implications of artificial intelligence. http://arxiv.org/abs/190707892
- Sloane M, Moss E, Awomolo O, Forlano L (2020) Participation is not a design fix for machine learning. http://arxiv.org/abs/200702423
- Zeng Y, Lu E, Huangfu C (2018) Linking artificial intelligence principles. arXiv. https://arxiv.org/abs/1812.04814v1 · arXiv
Cited by
Khawaja, Z., & Bélisle-Pipon, J.-C. (2023) · Frontiers in Digital Health · doi:10.3389/fdgth.2023.1278186 · Cited by 214
Self-citationSaeidnia, H. R., Hashemi Fotami, S. G., Lund, B., & Ghiasi, N. (2024) · Social Sciences · doi:10.3390/socsci13070381 · Cited by 169
Amann, J., Vayena, E., Ormond, K. E., Frey, D., Madai, V. I., & Blasimme, A. (2023) · PLoS ONE · doi:10.1371/journal.pone.0279088 · Cited by 119
Specific challenges posed by artificial intelligence in research ethics
Bouhouita-Guermech, S., Gogognon, P., & Bélisle‐Pipon, J. (2023) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2023.1149082 · Cited by 153
“Considering the multidisciplinary aspect of AI, different experts are called to provide their knowledge and expertise on the matter (Bélisle-Pipon et al., 2022).”
BackgroundSelf-citationChow, J. C. L., & Li, K. (2024) · JMIR Bioinformatics and Biotechnology · doi:10.2196/64406 · Cited by 75
Metadata
- Authors
- Bélisle-Pipon, J.-C., Monteferrante, E., Roy, M.-C., & Couture, V.
- Affiliations
- McGill University (CA)
- Université de Montréal (CA)
- Université Laval (CA)
- Venue
- AI & SOCIETY
- Published
- 2022-01-05
- Volume
- 38
- Issue
- 4
- Pages
- 1507-1522
- ISSN
- 0951-5666 (ISSN-L)
- 1435-5655
- OpenAlex
- W4206760316
- Semantic Scholar
- 7e86fad5eca4ae4b5709c6b6c856fff2d5693998
- Cited by
- 85
- References
- 50
- Citations by year
- 2026: 16 · 2025: 28 · 2024: 25 · 2023: 15 · 2022: 1
- FWCI
- 19.99
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- AI & Society (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Law › Digitalization, Law, and Regulation
- Social Sciences › Business, Management and Accounting › Organizational Behavior and Human Resource Management › Ethics in Business and Education
- Keywords
- AI ethics, moral norms, stakeholder engagement, citizen participation, transparency, black box problem, public trust, private sector, AI regulation, normative development
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.