AI Certification: Advancing Ethical Practice by Reducing Information Asymmetries
Open accessThe DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Abstract
As artificial intelligence (AI) systems are increasingly deployed, principles for ethical AI are also proliferating. Certification offers a method to both incentivize the adoption of these principles and substantiate that they have been implemented in practice. This article draws from management literature on certification and reviews current AI certification programs and proposals. Successful programs rely on both emerging technical methods and specific design considerations. In order to avoid two common failures of certification, program designs should ensure that the symbol of the certification is substantially implemented in practice and that the program achieves its stated goals. The review indicates that the field currently focuses on self-certification and third-party certification of systems, individuals, and organizations—to the exclusion of process management certifications. Additionally, this article considers prospects for future AI certification programs. Ongoing changes in AI technology suggest that AI certification regimes should be designed to emphasize governance criteria of enduring value, such as ethics training for AI developers, and to adjust technical criteria as the technology changes. Overall, certification can play a valuable mix in the portfolio of AI governance tools.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The global landscape of AI ethics guidelines
Jobin, A., Ienca, M., & Vayena, E. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0088-2 · Cited by 6,220 · cited 1×
“The growing societal implications of AI have prompted extensive attention to the ethics principles that should guide AI development and use [1, 2] and, more recently, some attention to how organizations can translate these principles into practice [3, 4, 5].”
BackgroundEnergy and Policy Considerations for Deep Learning in NLP
Strubell, E., Ganesh, A., & McCallum, A. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1355 · Cited by 3,684 · cited 1×
“For example, AI systems meeting certain performance standards may require additional computing power, which inadvertently harms the environment via increased energy consumption [51].”
Model Cards for Model Reporting
Mitchell, M., Wu, S., Zaldivar, A., Barnes, P., Vasserman, L., Hutchinson, B., Spitzer, E., Raji, I. D., & Gebru, T. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287596 · Cited by 2,681 · cited 1×
“The most mature area may be documentation for AI system training data and model characteristics [33, 34, 35], which can help verify certification criteria associated with both credence and Potemkin attributes.”
Raji, I. D., Smart, A., White, R. N., Mitchell, M., Gebru, T., Hutchinson, B., Smith-Loud, J., Theron, D., & Barnes, P. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372873 · Cited by 2,245 · cited 3×
“These ethics principles are used as a “North Star” guide in today’s certification programs ([36] p.35) and will likely remain relevant as the technology matures.”
From smoke and mirrors to walking the talk: Decoupling in the contemporary world
Bromley, P., & Powell, W. W. (2012) · Academy of Management Annals · doi:10.5465/19416520.2012.684462 · Cited by 1,656 · cited 2×
“Attributes of products and services that cannot be identified by outside actors at all; they require insider information to be identified Whether an AI system was developed according to ethics principles, its security, the extensiveness of testing it underwent its object [18, 19, 20].”
The Brussels Effect: How the European Union Rules the World
Bradford, A. (2020) · doi:10.1093/oso/9780190088583.001.0001 · Cited by 1,349
A world of standards but not a standard world: Toward a sociology of standards and standardization
Timmermans, S., & Epstein, S. (2010) · Annual Review of Sociology · doi:10.1146/annurev.soc.012809.102629 · Cited by 1,226
SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems
Wang, A., Pruksachatkun, Y., Nangia, N., Singh, A., Michael, J., Hill, F., Levy, O., & Bowman, S. R. (2019) · arXiv · doi:10.48550/arxiv.1905.00537 · Cited by 1,051
Fjeld, J., Achten, N., Hilligoss, H., Nagy, A., & Srikumar, M. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3518482 · Cited by 998 · cited 1×
“The growing societal implications of AI have prompted extensive attention to the ethics principles that should guide AI development and use [1, 2] and, more recently, some attention to how organizations can translate these principles into practice [3, 4, 5].”
Beyond accuracy: behavioral testing of NLP models with CheckList
Ribeiro, M. T., Wu, T., Guestrin, C., & Singh, S. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.442 · Cited by 890
Cited by
Trust in AI: progress, challenges, and future directions
Afroogh, S., Akbari, A., Malone, E., Kargar, M., & Alambeigi, H. (2024) · Humanities and Social Sciences Communications · doi:10.1057/s41599-024-04044-8 · Cited by 507
Auditing large language models: a three-layered approach
Mökander, J., Schuett, J., Kirk, H. R., & Floridi, L. (2024) · AI and Ethics · doi:10.1007/s43681-023-00289-2 · Cited by 289
Self-citationFrontier AI Regulation: Managing Emerging Risks to Public Safety
Anderljung, M., Barnhart, J., Korinek, A., Leung, J., O'Keefe, C., Whittlestone, J., Avin, S., Brundage, M., Bullock, J., Cass-Beggs, D., et al. (2023) · arXiv · doi:10.48550/arxiv.2307.03718 · Cited by 77
Self-citationProduct liability for defective AI
Buiten, M. C. (2024) · European Journal of Law and Economics · doi:10.1007/s10657-024-09794-z · Cited by 41
Johnson, N., Silva, E., Leon, H., Eslami, M., Schwanke, B., Dotan, R., & Heidari, H. (2025) · Proceedings of the 2025 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3715275.3732049 · Cited by 12
Metadata
- Authors
- Cihon, P., Kleinaltenkamp, M. J., Schuett, J., & Baum, S. D.
- Venue
- IEEE Transactions on Technology and Society
- Published
- 2021-12
- Volume
- 2
- Issue
- 4
- Pages
- 200-209
- ISSN
- 2637-6415 (ISSN-L)
- OpenAlex
- W3160920566
- Cited by
- 66
- References
- 22
- FWCI
- 11.43
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: AI Certification: Advancing Ethical Practice by Reducing Information Asymmetries. https://app.cochat.ai/papers/10.1109/tts.2021.3077595
- The paper
- Cihon, P., Kleinaltenkamp, M. J., Schuett, J., & Baum, S. D. (2021). AI Certification: Advancing Ethical Practice by Reducing Information Asymmetries. IEEE Transactions on Technology and Society. https://doi.org/10.1109/tts.2021.3077595
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.