Certification systems for machine learning: Lessons from sustainability
Open accessThe DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Abstract
Concerns around machine learning’s societal impacts have led to proposals to certify some systems. While prominent governance efforts to date center around networking standards bodies such as the Institute of Electrical and Electronics Engineers (IEEE), we argue that machine learning certification should build on structures from the sustainability domain. Policy challenges of machine learning and sustainability share significant structural similarities, including difficult to observe credence properties, such as data collection characteristics or carbon emissions from model training, and value chain concerns, including core‐periphery inequalities, networks of labor, and fragmented and modular value creation. While networking‐style standards typically draw their adoption and enforcement from functional needs to conform to enable network participation, machine learning, despite its digital nature, does not benefit from this dynamic. We therefore apply research on certification systems in sustainability, particularly of commodities, to generate lessons across both areas, informing emerging proposals such as the EU’s AI Act.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Picard, R. W. (1997) · MIT Press · doi:10.7551/mitpress/1140.001.0001 · Cited by 7,382
The governance of global value chains
Gereffi, G., Humphrey, J., & Sturgeon, T. (2005) · Review of International Political Economy · doi:10.1080/09692290500049805 · Cited by 7,233 · cited 1×
“Here, we draw upon several of the characteristics of value chains highlighted in the research literature (see generally Geref fi et al .”
On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜
Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445922 · Cited by 6,988 · cited 1×
“Impacts on human rights through processes of data collection or labeling (Roberts 2019), or impact on emissions from large model training (Bender et al .”
Free competition and the optimal amount of fraud
Darby, M. R., & Karni, E. (1973) · The Journal of Law and Economics · doi:10.1086/466756 · Cited by 3,947 · cited 1×
“To understand what is omitted, we now introduce some concepts relating to the qualities of products from the governance of value chains and commodities (Darby and Karni 1973; McCluskey and Loureiro 2005).”
Big other: Surveillance Capitalism and the Prospects of an Information Civilization
Zuboff, S. (2015) · Journal of Information Technology · doi:10.1057/jit.2015.5 · Cited by 3,205 · cited 1×
“Even when individuals are unaware of these activities, populations are set up as the sources of these extractive activities by the design of the infrastructure and business models that surround them (Zuboff 2015).”
Barocas, S., & Selbst, A. D. (2014) · doi:10.2139/ssrn.2477899 · Cited by 3,048 · cited 2×
“This service might output prima facie discriminatory results (Barocas & Selbst 2016), be insecure to cybersecurity attacks (Huang et al .”
BackgroundAwad, E., Dsouza, S., Kim, R., Schulz, J., Henrich, J., Shariff, A., Bonnefon, J.-F., & Rahwan, I. (2018) · Nature · doi:10.1038/s41586-018-0637-6 · Cited by 1,859 · cited 1×
“See further Awad et al .”
Huang, L., Joseph, A. D., Nelson, B., Rubinstein, B. I. P., & Tygar, J. D. (2011) · Proceedings of the 4th ACM workshop on Security and artificial intelligence · doi:10.1145/2046684.2046692 · Cited by 1,194 · cited 1×
“This service might output prima facie discriminatory results (Barocas & Selbst 2016), be insecure to cybersecurity attacks (Huang et al .”
King, A. A., Lenox, M. J., & Terlaak, A. (2005) · Academy of Management Journal · doi:10.5465/amj.2005.19573111 · Cited by 875 · cited 1×
“2004; King & Lenox 2000; King, Lenox, and Terlaak 2005; Lenox 2007; Lenox 2006).”
Ethical and Scientific Implications of the Globalization of Clinical Research
Glickman, S. W., McHutchison, J. G., Peterson, E. D., Cairns, C. B., Harrington, R. A., Califf, R. M., & Schulman, K. A. (2009) · New England Journal of Medicine · doi:10.1056/nejmsb0803929 · Cited by 710
Fairness in Machine Learning: Lessons from Political Philosophy
Binns, R. (2017) · arXiv · doi:10.48550/arxiv.1712.03586 · Cited by 676
Lum, K., & Isaac, W. (2016) · Significance · doi:10.1111/j.1740-9713.2016.00960.x · Cited by 611
Edwards, L., & Veale, M. (2017) · doi:10.31228/osf.io/97upg · Cited by 524
Self-citationVeale, M., & Binns, R. (2017) · Big Data & Society · doi:10.1177/2053951717743530 · Cited by 512
Self-citationVeale, M., & Binns, R. (2017) · doi:10.31235/osf.io/ustxg · Cited by 512
Self-citationVeale, M., Van Kleek, M., & Binns, R. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174014 · Cited by 490 · cited 1×
“2018), or engender organizational pressures to transfer it to new and unsuitable contexts (Veale et al .”
Self-citationBehind the Screen: Content Moderation in the Shadows of Social Media
ROBERTS, S. T. (2019) · Yale University Press · doi:10.2307/j.ctvhrcz0v · Cited by 339
Algorithms that remember: model inversion attacks and data protection law
Veale, M., Binns, R., & Edwards, L. (2018) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2018.0083 · Cited by 278
Self-citationFrom ethics washing to ethics bashing: a view on tech ethics from within moral philosophy
Bietti, E. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372860 · Cited by 261 · cited 1×
“2018) – some of which have been branded as “ ethics-washing ” (see generally Bietti 2020).”
Transparency in nonstate certification: consequences for accountability and legitimacy
Auld, G., & Gulbrandsen, L. H. (2010) · Global Environmental Politics · doi:10.1162/glep_a_00016 · Cited by 253 · cited 1×
“…have faced criticisms when they get this balance “ wrong ” – for example when they are critiqued for being overly (or insuf fi ciently) representative of industry interests, at the expense of producer, environment, or civil society groups (Cashore 2002; Auld & Gulbrandsen 2010; Bennett 2017).”
Slave to the Algorithm? Why a Right to Explanationn is Probably Not the Remedy You are Looking for
Edwards, L., & Veale, M. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.2972855 · Cited by 244
Self-citationEnvironment, Self‐Regulation, and the Chemical Industry: Assessing Responsible Care*
GUNNINGHAM, N. (1995) · Law & Policy · doi:10.1111/j.1467-9930.1995.tb00139.x · Cited by 170 · cited 1×
“Even so, it has never really escaped its reputation as being a weak attempt by industry to avoid more serious regulatory efforts (Gunningham 1995; Gunningham et al .”
Decision Provenance: Harnessing Data Flow for Accountable Systems
Singh, J., Cobbe, J., & Norval, C. (2019) · IEEE Access · doi:10.1109/access.2018.2887201 · Cited by 110
Mol, A., & Oosterveer, P. (2015) · Sustainability · doi:10.3390/su70912258 · Cited by 109
Discrimination and Privacy in the Information Society: Data Mining and Profiling in Large Databases
(2013) · Studies in Applied Philosophy, Epistemology and Rational Ethics · doi:10.1007/978-3-642-30487-3 · Cited by 100
Gürses, S., & van Hoboken, J. (2018) · The Cambridge Handbook of Consumer Privacy · doi:10.1017/9781316831960.032 · Cited by 70
Cited by
Bilderback, S. (2024) · European Journal of Training and Development · doi:10.1108/ejtd-01-2023-0005 · Cited by 138
Demystifying the Draft EU Artificial Intelligence Act
Veale, M., & Zuiderveen Borgesius, F. (2021) · doi:10.31235/osf.io/38p5f · Cited by 91
Self-citationVigoda-Gadot, E., & Mizrahi, S. (2024) · Technology in Society · doi:10.1016/j.techsoc.2024.102530 · Cited by 59
“Studies suggest that this process of digital governance transformation is related to a complex set of variables, some not necessarily related to technology (e.g., the nature of the target population, the proxies used for technology assimilation; [41]).”
BackgroundBayamlıoğlu, E. (2022) · Regulation & Governance · doi:10.1111/rego.12391 · Cited by 44
Law and the Emerging Political Economy of Algorithmic Audits
Terzis, P., Veale, M., & Gaumann, N. (2024) · The 2024 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3630106.3658970 · Cited by 39
Self-citation
Metadata
- Authors
- Matus, K. J. M., & Veale, M.
- Venue
- Regulation & Governance
- Publisher
- Wiley
- Published
- 2021-06-09
- Volume
- 16
- Issue
- 1
- Pages
- 177-196
- ISSN
- 1748-5983 (ISSN-L)
- 1748-5991
- OpenAlex
- W3167266398
- Cited by
- 43
- References
- 26
- FWCI
- 9.27
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.