Certification systems for machine learning: Lessons from sustainability
Open accessThe DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Abstract
Concerns around machine learning’s societal impacts have led to proposals to certify some systems. While prominent governance efforts to date center around networking standards bodies such as the Institute of Electrical and Electronics Engineers (IEEE), we argue that machine learning certification should build on structures from the sustainability domain. Policy challenges of machine learning and sustainability share significant structural similarities, including difficult to observe credence properties, such as data collection characteristics or carbon emissions from model training, and value chain concerns, including core‐periphery inequalities, networks of labor, and fragmented and modular value creation. While networking‐style standards typically draw their adoption and enforcement from functional needs to conform to enable network participation, machine learning, despite its digital nature, does not benefit from this dynamic. We therefore apply research on certification systems in sustainability, particularly of commodities, to generate lessons across both areas, informing emerging proposals such as the EU’s AI Act.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Picard, R. W. (1997) · MIT Press · doi:10.7551/mitpress/1140.001.0001 · Cited by 7,382
The governance of global value chains
Gereffi, G., Humphrey, J., & Sturgeon, T. (2005) · Review of International Political Economy · doi:10.1080/09692290500049805 · Cited by 7,233 · cited 1×
“Here, we draw upon several of the characteristics of value chains highlighted in the research literature (see generally Geref fi et al .”
On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜
Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445922 · Cited by 6,988 · cited 1×
“Impacts on human rights through processes of data collection or labeling (Roberts 2019), or impact on emissions from large model training (Bender et al .”
Free competition and the optimal amount of fraud
Darby, M. R., & Karni, E. (1973) · The Journal of Law and Economics · doi:10.1086/466756 · Cited by 3,947 · cited 1×
“To understand what is omitted, we now introduce some concepts relating to the qualities of products from the governance of value chains and commodities (Darby and Karni 1973; McCluskey and Loureiro 2005).”
Big other: Surveillance Capitalism and the Prospects of an Information Civilization
Zuboff, S. (2015) · Journal of Information Technology · doi:10.1057/jit.2015.5 · Cited by 3,205 · cited 1×
“Even when individuals are unaware of these activities, populations are set up as the sources of these extractive activities by the design of the infrastructure and business models that surround them (Zuboff 2015).”
Barocas, S., & Selbst, A. D. (2014) · doi:10.2139/ssrn.2477899 · Cited by 3,048 · cited 2×
“This service might output prima facie discriminatory results (Barocas & Selbst 2016), be insecure to cybersecurity attacks (Huang et al .”
BackgroundAwad, E., Dsouza, S., Kim, R., Schulz, J., Henrich, J., Shariff, A., Bonnefon, J.-F., & Rahwan, I. (2018) · Nature · doi:10.1038/s41586-018-0637-6 · Cited by 1,859 · cited 1×
“See further Awad et al .”
Huang, L., Joseph, A. D., Nelson, B., Rubinstein, B. I. P., & Tygar, J. D. (2011) · Proceedings of the 4th ACM workshop on Security and artificial intelligence · doi:10.1145/2046684.2046692 · Cited by 1,194 · cited 1×
“This service might output prima facie discriminatory results (Barocas & Selbst 2016), be insecure to cybersecurity attacks (Huang et al .”
King, A. A., Lenox, M. J., & Terlaak, A. (2005) · Academy of Management Journal · doi:10.5465/amj.2005.19573111 · Cited by 875 · cited 1×
“2004; King & Lenox 2000; King, Lenox, and Terlaak 2005; Lenox 2007; Lenox 2006).”
Ethical and Scientific Implications of the Globalization of Clinical Research
Glickman, S. W., McHutchison, J. G., Peterson, E. D., Cairns, C. B., Harrington, R. A., Califf, R. M., & Schulman, K. A. (2009) · New England Journal of Medicine · doi:10.1056/nejmsb0803929 · Cited by 710
Cited by
Bilderback, S. (2024) · European Journal of Training and Development · doi:10.1108/ejtd-01-2023-0005 · Cited by 138
Demystifying the Draft EU Artificial Intelligence Act
Veale, M., & Zuiderveen Borgesius, F. (2021) · doi:10.31235/osf.io/38p5f · Cited by 91
Self-citationVigoda-Gadot, E., & Mizrahi, S. (2024) · Technology in Society · doi:10.1016/j.techsoc.2024.102530 · Cited by 59
“Studies suggest that this process of digital governance transformation is related to a complex set of variables, some not necessarily related to technology (e.g., the nature of the target population, the proxies used for technology assimilation; [41]).”
BackgroundBayamlıoğlu, E. (2022) · Regulation & Governance · doi:10.1111/rego.12391 · Cited by 44
Law and the Emerging Political Economy of Algorithmic Audits
Terzis, P., Veale, M., & Gaumann, N. (2024) · The 2024 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3630106.3658970 · Cited by 39
Self-citation
Metadata
- Authors
- Matus, K. J. M., & Veale, M.
- Venue
- Regulation & Governance
- Publisher
- Wiley
- Published
- 2021-06-09
- Volume
- 16
- Issue
- 1
- Pages
- 177-196
- ISSN
- 1748-5983 (ISSN-L)
- 1748-5991
- OpenAlex
- W3167266398
- Cited by
- 43
- References
- 26
- FWCI
- 9.27
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Certification systems for machine learning: Lessons from sustainability. https://app.cochat.ai/papers/10.1111/rego.12417
- The paper
- Matus, K. J. M., & Veale, M. (2022). Certification systems for machine learning: Lessons from sustainability. Regulation & Governance. https://doi.org/10.1111/rego.12417
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.