The DOI matches its Crossref record; 105 of the 110 references it cites were found in a registry or an index.
The Flaws of Policies Requiring Human Oversight of Government Algorithms
Open accessAbstract
As algorithms become an influential component of government decision-making around the world, policymakers have debated how governments can attain the benefits of algorithms while preventing the harms of algorithms. One mechanism that has become a centerpiece of global efforts to regulate government algorithms is to require human oversight of algorithmic decisions. Despite the widespread turn to human oversight, these policies rest on an uninterrogated assumption: that people are able to effectively oversee algorithmic decision-making. In this article, I survey 41 policies that prescribe human oversight of government algorithms and find that they suffer from two significant flaws. First, evidence suggests that people are unable to perform the desired oversight functions. Second, as a result of the first flaw, human oversight policies legitimize government uses of faulty and controversial algorithms without addressing the fundamental issues with these tools. Thus, rather than protect against the potential harms of algorithmic decision-making in government, human oversight policies provide a false sense of security in adopting algorithms and enable vendors and agencies to shirk accountability for algorithmic harms. In light of these flaws, I propose a shift from human oversight to institutional oversight as the central mechanism for regulating government algorithms. This institutional approach operates in two stages. First, agencies must justify that it is appropriate to incorporate an algorithm into decision-making and that any proposed forms of human oversight are supported by empirical evidence. Second, these justifications must receive democratic public review and approval before the agency can adopt the algorithm.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Blaming individual users of the technology will not help to develop safety improvements as this approach overlooks the important systemic issues and shifts responsibility from chiefs and vendors, which Green points out in relation to human oversight and algorithms (2022).”
From Just accountability structures – a way to promote the safe use of automated decision-making in the public sector (2024) · cites this paper as Green 2022
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Street-Level Bureaucracy: Dilemmas of the Individual in Public Services
Lipsky, M. (1981) · Michigan Law Review · doi:10.2307/1288305 · Cited by 8,981
The global landscape of AI ethics guidelines
Jobin, A., Ienca, M., & Vayena, E. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0088-2 · Cited by 6,220
Normal Accidents: Living with High Risk Technologies
Grimes, A. J., & Perrow, C. (1985) · Academy of Management Review · doi:10.5465/amr.1985.4278477 · Cited by 4,962
Bureaucracy: what government agencies do and why they do it
(1990) · Choice Reviews Online · doi:10.5860/choice.27-4796 · Cited by 3,795
(2018) · Cited by 3,510
Automating Inequality: How High-Tech Tools Profile, Police, and Punish the Poor
Lebovits, H. (2019) · Public Integrity · doi:10.1080/10999922.2018.1511671 · Cited by 3,279
Algorithm aversion: People erroneously avoid algorithms after seeing them err.
Dietvorst, B. J., Simmons, J. P., & Massey, C. (2015) · Journal of Experimental Psychology: General · doi:10.1037/xge0000033 · Cited by 3,232
Normal Accidents: Living with High-Risk Technologies
Cummings, L. L., & Perrow, C. (1984) · Administrative Science Quarterly · doi:10.2307/2392945 · Cited by 2,861
Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems
(2017) · doi:10.1145/3025453 · Cited by 2,207
Bainbridge, L. (1983) · Automatica · doi:10.1016/0005-1098(83)90046-8 · Cited by 2,205
Research works printed but not linked: 46
- A Albright, 2019, If you give a judge a risk score: Evidence from Kentucky bail decisions
- Arnold Ventures, 2016, Article 29 Data Protection Working Party. Guidelines on Automated Individual Decision-Making and Profiling for the Purposes of Regulation, Public Safety Assessment FAQs, 101
- Belgian Federal, 2018, Loi Relative � la Protection des Personnes Physiques � L'�gard des Traitements de Donn�es � Caract�re Personnel (Law on the Protection of Natural Persons with regard to the Processing of Personal Data)
- S Brown, 2020, Data Accountability and Transparency Act
- Bundestag, 2019, Federal Data Protection Act (BDSG)
- California Legislature, 2021, AB-13 Public Contracts: Automated Decision Systems
- E T Campbell, 2019, Riverwise-Surveillance.pdf?file=1 . CBS News. Police Departments Adopting Facial Recognition Tech Amid Allegations of Wrongful Arrests, Detroiters Want to be Seen, not Watched. Riverwise, 2021
- R N Charette, 2018, Michigan's MiDAS unemployment system: Algorithm alchemy created lead, not gold, IEEE Spectrum
- Cambridge City, 2018, Surveillance technology ordinance
- B Cowgill, 2018, The Impact of Algorithms on Judicial Discretion: Evidence from Regression Discontinuities
- R Crootof, 2006, Cummings ML. Automation and accountability in decision support system interface design, Temple Int. Compar. Law J, 30, 23
- B J Dietvorst, 2015, Uitvoeringswet Algemene Verordening Gegevensbescherming (Implementation Act General Data Protection Regulation), J. Exp. Psychol, 144, 114
- 2021, Proposal for a Regulation Laying Down Harmonised Rules on Artificial Intelligence, Artificial Intelligence Act
- 2021, Civil Society Calls for AI red lines in the European Union's Artificial Intelligence Proposal
- 2021, EU's New Artificial Intelligence Law Risks Enabling Orwellian Surveillance States
- 2016, Council of the European Union. General data protection regulation, Off. J. Eur. Union
- 2021, Ban Facial Recognition
- French Parliament, 2018, French Data Protection Act
- W Hartzog, 2018, Facial recognition is the perfect tool for oppression
- J Henley, 2020, Welfare surveillance system violates human rights, Dutch court rules
- K Hill, 2018, How one state managed to actually write rules on facial recognition, Houses of the Oireachtas
- 2017, Not in it for Justice": How California's Pretrial Detention and Bail System Unfairly Punishes Poor People
- Hungarian Parliament, 2018, Data Protection Act
- N Ibarra, 2020, Bans predictive policing technology, Govern. Technol
- E Kelly, 2021, EU lawmaker vows to tighten use of biometric tracking tech in Europe
- Kingdom Of Bahrain, 2018, Personal Data Protection Law
- J Koebler, 2020, Detroit police chief: facial recognition software misidentifies 96% of the time
- T Metzinger, 2019, Ethics washing made in Europe, Der Tagesspiegel
- L Miller, 2020, LAPD will end controversial program that aimed to predict where crimes would occur, Los Angeles Times
- 2017, An Act to Modernize Legislative Provisions as Regards the Protection of Personal Information, Bill, 64
- Inc Northpointe, 2015, Office of the Privacy Commissioner of Canada. A Regulatory Framework for AI: Recommendations for PIPEDA Reform
- F Pasquale, 2020, New Laws of Robotics: Defending Human Expertise in the Age of AI
- Argentina Republic, 2013, Ley De Protecci�n De Los Datos Personales (Personal Data Protection Law)
- R Richardson, 2019, Confronting Black Boxes: A Shadow Report of the New York City Automated Decision System Task Force. AI Now Institute
- R Richardson, 2019, Dirty data, bad predictions: How civil rights violations impact police data, predictive policing systems, and justice, New York University Law Rev, 94, 15
- D Scharfenberg, 2018, Computers can solve your problem. You may not like the answer
- Slovenian Parliament, Zakon o varstvu Osebnih Podatkov na Podro ?ju Obravnavanja Kaznivih Dejanj (Personal Data Protection Act in the Field of Dealing with Criminal Offenses)
- L Solum, 2009, Legal theory lexicon: Rules, standards, and principles
- 2018, Statistics New Zealand. Algorithm Assessment Report
- M I Stein, 2020, New Orleans City Council bans facial recognition, predictive policing and other surveillance tech
- D Steinhart, 2006, Juvenile detention risk assessment: A practice guide for juvenile detention reform
- 2018, Stop LAPD Spying Coalition. Before the Bullet Hits the Body: Dismantling Predictive Policing in Los Angeles
- L Suchman, 1999, Data-Protection-and-Privacy-Act-2019.pdf. UK Information Commissioner's Office. Guidance on the AI Auditing Framework, American Behavioral Scientist, 43, 392
- Washington State, 2020, Concerning the Use of Facial Recognition Services
- 2018, Electronic Case Reference Manual
- D Zipper, 2021, The deadly myth that human error causes most car crashes
Cited by
Towards a standard for identifying and managing bias in artificial intelligence
Schwartz, R., Vassilev, A., Greene, K., Perine, L., Burt, A., & Hall, P. (2022) · doi:10.6028/nist.sp.1270 · Cited by 548
Laux, J., Wachter, S., & Mittelstadt, B. (2024) · Regulation & Governance · doi:10.1111/rego.12512 · Cited by 365
OECD (2025) · OECD eBooks · doi:10.1787/795de142-en · Cited by 320
Is human oversight to AI systems still possible?
Holzinger, A., Zatloukal, K., & Müller, H. (2024) · New Biotechnology · doi:10.1016/j.nbt.2024.12.003 · Cited by 179
“How knowledge workers think generative AI will (not) transform their industries,”
Woodruff, A., Shelby, R., Kelley, P. G., Rousso-Schindler, S., Smith-Loud, J., & Wilcox, L. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642700 · Cited by 105
Metadata
- Authors
- Green, B.
- Affiliations
- University of Michigan (US)
- Corresponding author
- Green, Ben
- ORCID
- Green, Ben
- Venue
- Computer law & security review
- Publisher
- Elsevier BV
- Published
- 2021
- Volume
- 45
- Pages
- 105681-105681
- ISSN
- 2212-473X (ISSN-L)
- OpenAlex
- W3200421165
- Cited by
- 259
- References
- 110
- Citations by year
- 2026: 108 · 2025: 56 · 2024: 43 · 2023: 28 · 2022: 24
- FWCI
- 43.80
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Computer law & security review (publishedVersion, cc-by)
- SSRN Electronic Journal (acceptedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Law › Digitalization, Law, and Regulation
- Social Sciences › Political Science and International Relations › E-Government and Public Services
- Keywords
- human oversight, algorithmic decision-making, algorithmic regulation, institutional oversight, accountability, algorithmic harms, public trust in government, algorithmic governance
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The Flaws of Policies Requiring Human Oversight of Government Algorithms. https://app.cochat.ai/papers/10.2139/ssrn.3921216
- The paper
- Green, B. (2021). The Flaws of Policies Requiring Human Oversight of Government Algorithms. Computer law & security review. https://doi.org/10.2139/ssrn.3921216
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.