Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 105 of the 110 references it cites were found in a registry or an index.

The Flaws of Policies Requiring Human Oversight of Government Algorithms

Open access
Green, Ben · 2021 · Computer law & security review

Abstract

As algorithms become an influential component of government decision-making around the world, policymakers have debated how governments can attain the benefits of algorithms while preventing the harms of algorithms. One mechanism that has become a centerpiece of global efforts to regulate government algorithms is to require human oversight of algorithmic decisions. Despite the widespread turn to human oversight, these policies rest on an uninterrogated assumption: that people are able to effectively oversee algorithmic decision-making. In this article, I survey 41 policies that prescribe human oversight of government algorithms and find that they suffer from two significant flaws. First, evidence suggests that people are unable to perform the desired oversight functions. Second, as a result of the first flaw, human oversight policies legitimize government uses of faulty and controversial algorithms without addressing the fundamental issues with these tools. Thus, rather than protect against the potential harms of algorithmic decision-making in government, human oversight policies provide a false sense of security in adopting algorithms and enable vendors and agencies to shirk accountability for algorithmic harms. In light of these flaws, I propose a shift from human oversight to institutional oversight as the central mechanism for regulating government algorithms. This institutional approach operates in two stages. First, agencies must justify that it is appropriate to incorporate an algorithm into decision-making and that any proposed forms of human oversight are supported by empirical evidence. Second, these justifications must receive democratic public review and approval before the agency can adopt the algorithm.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.2139/ssrn.3921216

Cites

105 of 105 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 110 references

Research works printed but not linked: 46

  1. A Albright, 2019, If you give a judge a risk score: Evidence from Kentucky bail decisions
  2. Arnold Ventures, 2016, Article 29 Data Protection Working Party. Guidelines on Automated Individual Decision-Making and Profiling for the Purposes of Regulation, Public Safety Assessment FAQs, 101
  3. Belgian Federal, 2018, Loi Relative � la Protection des Personnes Physiques � L'�gard des Traitements de Donn�es � Caract�re Personnel (Law on the Protection of Natural Persons with regard to the Processing of Personal Data)
  4. S Brown, 2020, Data Accountability and Transparency Act
  5. Bundestag, 2019, Federal Data Protection Act (BDSG)
  6. California Legislature, 2021, AB-13 Public Contracts: Automated Decision Systems
  7. E T Campbell, 2019, Riverwise-Surveillance.pdf?file=1 . CBS News. Police Departments Adopting Facial Recognition Tech Amid Allegations of Wrongful Arrests, Detroiters Want to be Seen, not Watched. Riverwise, 2021
  8. R N Charette, 2018, Michigan's MiDAS unemployment system: Algorithm alchemy created lead, not gold, IEEE Spectrum
  9. Cambridge City, 2018, Surveillance technology ordinance
  10. B Cowgill, 2018, The Impact of Algorithms on Judicial Discretion: Evidence from Regression Discontinuities
  11. R Crootof, 2006, Cummings ML. Automation and accountability in decision support system interface design, Temple Int. Compar. Law J, 30, 23
  12. B J Dietvorst, 2015, Uitvoeringswet Algemene Verordening Gegevensbescherming (Implementation Act General Data Protection Regulation), J. Exp. Psychol, 144, 114
  13. 2021, Proposal for a Regulation Laying Down Harmonised Rules on Artificial Intelligence, Artificial Intelligence Act
  14. 2021, Civil Society Calls for AI red lines in the European Union's Artificial Intelligence Proposal
  15. 2021, EU's New Artificial Intelligence Law Risks Enabling Orwellian Surveillance States
  16. 2016, Council of the European Union. General data protection regulation, Off. J. Eur. Union
  17. 2021, Ban Facial Recognition
  18. French Parliament, 2018, French Data Protection Act
  19. W Hartzog, 2018, Facial recognition is the perfect tool for oppression
  20. J Henley, 2020, Welfare surveillance system violates human rights, Dutch court rules
  21. K Hill, 2018, How one state managed to actually write rules on facial recognition, Houses of the Oireachtas
  22. 2017, Not in it for Justice": How California's Pretrial Detention and Bail System Unfairly Punishes Poor People
  23. Hungarian Parliament, 2018, Data Protection Act
  24. N Ibarra, 2020, Bans predictive policing technology, Govern. Technol
  25. E Kelly, 2021, EU lawmaker vows to tighten use of biometric tracking tech in Europe
  26. Kingdom Of Bahrain, 2018, Personal Data Protection Law
  27. J Koebler, 2020, Detroit police chief: facial recognition software misidentifies 96% of the time
  28. T Metzinger, 2019, Ethics washing made in Europe, Der Tagesspiegel
  29. L Miller, 2020, LAPD will end controversial program that aimed to predict where crimes would occur, Los Angeles Times
  30. 2017, An Act to Modernize Legislative Provisions as Regards the Protection of Personal Information, Bill, 64
  31. Inc Northpointe, 2015, Office of the Privacy Commissioner of Canada. A Regulatory Framework for AI: Recommendations for PIPEDA Reform
  32. F Pasquale, 2020, New Laws of Robotics: Defending Human Expertise in the Age of AI
  33. Argentina Republic, 2013, Ley De Protecci�n De Los Datos Personales (Personal Data Protection Law)
  34. R Richardson, 2019, Confronting Black Boxes: A Shadow Report of the New York City Automated Decision System Task Force. AI Now Institute
  35. R Richardson, 2019, Dirty data, bad predictions: How civil rights violations impact police data, predictive policing systems, and justice, New York University Law Rev, 94, 15
  36. D Scharfenberg, 2018, Computers can solve your problem. You may not like the answer
  37. Slovenian Parliament, Zakon o varstvu Osebnih Podatkov na Podro ?ju Obravnavanja Kaznivih Dejanj (Personal Data Protection Act in the Field of Dealing with Criminal Offenses)
  38. L Solum, 2009, Legal theory lexicon: Rules, standards, and principles
  39. 2018, Statistics New Zealand. Algorithm Assessment Report
  40. M I Stein, 2020, New Orleans City Council bans facial recognition, predictive policing and other surveillance tech
  41. D Steinhart, 2006, Juvenile detention risk assessment: A practice guide for juvenile detention reform
  42. 2018, Stop LAPD Spying Coalition. Before the Bullet Hits the Body: Dismantling Predictive Policing in Los Angeles
  43. L Suchman, 1999, Data-Protection-and-Privacy-Act-2019.pdf. UK Information Commissioner's Office. Guidance on the AI Auditing Framework, American Behavioral Scientist, 43, 392
  44. Washington State, 2020, Concerning the Use of Facial Recognition Services
  45. 2018, Electronic Case Reference Manual
  46. D Zipper, 2021, The deadly myth that human error causes most car crashes

Cited by

See all 427

Metadata

Authors
Green, B.
Affiliations
University of Michigan (US)
Corresponding author
Green, Ben
Venue
Computer law & security review
Publisher
Elsevier BV
Published
2021
Volume
45
Pages
105681-105681
ISSN
2212-473X (ISSN-L)
OpenAlex
W3200421165
Cited by
259
References
110
Citations by year
2026: 108 · 2025: 56 · 2024: 43 · 2023: 28 · 2022: 24
FWCI
43.80
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Computer law & security review (publishedVersion, cc-by)
  • SSRN Electronic Journal (acceptedVersion)
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
  • Social Sciences › Law › Digitalization, Law, and Regulation
  • Social Sciences › Political Science and International Relations › E-Government and Public Services
Keywords
human oversight, algorithmic decision-making, algorithmic regulation, institutional oversight, accountability, algorithmic harms, public trust in government, algorithmic governance

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: The Flaws of Policies Requiring Human Oversight of Government Algorithms. https://app.cochat.ai/papers/10.2139/ssrn.3921216
The paper
Green, B. (2021). The Flaws of Policies Requiring Human Oversight of Government Algorithms. Computer law & security review. https://doi.org/10.2139/ssrn.3921216

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.