The Flaws of Policies Requiring Human Oversight of Government Algorithms
Open accessThe DOI matches its Crossref record; 105 of the 110 references it cites were found in a registry or an index.
Abstract
As algorithms become an influential component of government decision-making around the world, policymakers have debated how governments can attain the benefits of algorithms while preventing the harms of algorithms. One mechanism that has become a centerpiece of global efforts to regulate government algorithms is to require human oversight of algorithmic decisions. Despite the widespread turn to human oversight, these policies rest on an uninterrogated assumption: that people are able to effectively oversee algorithmic decision-making. In this article, I survey 41 policies that prescribe human oversight of government algorithms and find that they suffer from two significant flaws. First, evidence suggests that people are unable to perform the desired oversight functions. Second, as a result of the first flaw, human oversight policies legitimize government uses of faulty and controversial algorithms without addressing the fundamental issues with these tools. Thus, rather than protect against the potential harms of algorithmic decision-making in government, human oversight policies provide a false sense of security in adopting algorithms and enable vendors and agencies to shirk accountability for algorithmic harms. In light of these flaws, I propose a shift from human oversight to institutional oversight as the central mechanism for regulating government algorithms. This institutional approach operates in two stages. First, agencies must justify that it is appropriate to incorporate an algorithm into decision-making and that any proposed forms of human oversight are supported by empirical evidence. Second, these justifications must receive democratic public review and approval before the agency can adopt the algorithm.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Blaming individual users of the technology will not help to develop safety improvements as this approach overlooks the important systemic issues and shifts responsibility from chiefs and vendors, which Green points out in relation to human oversight and algorithms (2022).”
From Just accountability structures – a way to promote the safe use of automated decision-making in the public sector (2024) · cites this paper as Green 2022
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Street-Level Bureaucracy: Dilemmas of the Individual in Public Services
Lipsky, M. (1981) · Michigan Law Review · doi:10.2307/1288305 · Cited by 8,981
The global landscape of AI ethics guidelines
Jobin, A., Ienca, M., & Vayena, E. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0088-2 · Cited by 6,220
Normal Accidents: Living with High Risk Technologies
Grimes, A. J., & Perrow, C. (1985) · Academy of Management Review · doi:10.5465/amr.1985.4278477 · Cited by 4,963
Bureaucracy: what government agencies do and why they do it
(1990) · Choice Reviews Online · doi:10.5860/choice.27-4796 · Cited by 3,795
(2018) · Cited by 3,510
Automating Inequality: How High-Tech Tools Profile, Police, and Punish the Poor
Lebovits, H. (2019) · Public Integrity · doi:10.1080/10999922.2018.1511671 · Cited by 3,279
Algorithm aversion: People erroneously avoid algorithms after seeing them err.
Dietvorst, B. J., Simmons, J. P., & Massey, C. (2015) · Journal of Experimental Psychology: General · doi:10.1037/xge0000033 · Cited by 3,232
Normal Accidents: Living with High-Risk Technologies
Cummings, L. L., & Perrow, C. (1984) · Administrative Science Quarterly · doi:10.2307/2392945 · Cited by 2,861
Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems
(2017) · doi:10.1145/3025453 · Cited by 2,207
Bainbridge, L. (1983) · Automatica · doi:10.1016/0005-1098(83)90046-8 · Cited by 2,205
Research works printed but not linked: 37
- Albright A. If you give a judge a risk score: Evidence from Kentucky bail decisions; 2019 https: //thelittledataset.com/about _ files/albright _ judge _ score.pdf.
- Belgian Federal Parliament. Loi Relative à la Protection des Personnes Physiques à L'égard des Traitements de Données à Caractère Personnel (Law on the Protection of Natural Persons with regard to the Processing of Personal Data); 2018 https:// www.ejustice.just.fgov.be/eli/loi/2018/07/30/2018040581/justel .
- Bundestag, 2019, Federal Data Protection Act (BDSG)
- California Legislature, 2021, AB-13 Public Contracts: Automated Decision Systems
- Campbell ET, editor. Detroiters Want to be Seen, not Watched. Riverwise; 2019 https://detroitcommunitytech.org/system/tdf/ librarypdfs/2019-2206 _ Riverwise-Surveillance.pdf?file=1 . CBS News. Police Departments Adopting Facial Recognition Tech Amid Allegations of Wrongful Arrests; 2021 60 Minutes https://www.cbsnews.com/news/ facial-recognition-60-minutes-2021-05-16/ .
- Charette RN. Michigan's MiDAS unemployment system: Algorithm alchemy created lead, not gold. IEEE Spectrum 2018 https://spectrum.ieee.org/riskfactor/computing/software/ michigans-midas-unemployment-system-algorithm- alchemy-that-created-lead-not-gold .
- Cambridge City, 2018, Surveillance technology ordinance
- Cummings ML. Automation and accountability in decision support system interface design. J. Technol. Stud. 2006;32(1):23-31 https://scholar.lib.vt.edu/ejournals/JOTS/v32/ v32n1/pdf/cummings.pdf.
- 2021, Proposal for a Regulation Laying Down Harmonised Rules on Artificial Intelligence, Artificial Intelligence Act
- 2021, Civil Society Calls for AI red lines in the European Union's Artificial Intelligence Proposal
- 2021, EU's New Artificial Intelligence Law Risks Enabling Orwellian Surveillance States
- National Congress of Brazil. General Data Protection Law; 2019 https://iapp.org/media/pdf/resource _ center/ Brazilian _ General _ Data _ Protection _ Law.pdf. New Jersey Courts. One Year Criminal Justice Reform Report to the Governor and the Legislature; 2017 https: //www.njcourts.gov/courts/assets/criminal/2017cjrannual.pdf.
- 2021, Ban Facial Recognition
- French Parliament, 2018, French Data Protection Act
- K Hill, 2018, How one state managed to actually write rules on facial recognition, Houses of the Oireachtas
- Houses of the Oireachtas. (2018). Data Protection Act 2018. https://data.oireachtas.ie/ie/oireachtas/act/2018/7/eng/ enacted/a0718.pdf Human Rights Watch. "Not in it for Justice": How California's Pretrial Detention and Bail System Unfairly Punishes Poor People; 2017 https://www.hrw.org/report/2017/04/11/not-it-justice/ how-californias-pretrial-detention-and-bail-system-unfairly . Hungarian Parliament. Data Protection Act; 2018 https://www.parlament.hu/irom41/00623/00623.pdf.
- Ibarra N. Santa Cruz, Calif., Bans predictive policing technology. Govern. Technol. 2020 https://www.govtech.com/public-safety/ santa-cruz-calif-bans-predictive-policing-technology.html . Indiana Supreme Court. Malenchik v. State; 2010 928
- Kelly E. EU lawmaker vows to tighten use of biometric tracking tech in Europe. Sifted 2021 https://sifted.eu/articles/eu-facial-recognition-tech/ .
- Kingdom of Bahrain. Personal Data Protection Law; 2018 https://bahrainbusinesslaws.com/laws/ Personal-Data-Protection-Law .
- Koebler J. Detroit police chief: facial recognition software misidentifies 96% of the time. Vice 2020 https://www.vice.com/en/article/dyzykz/ detroit-police-chief-facial-recognition-software-misidentifies -96-of-the-time .
- Metzinger T. Ethics washing made in Europe. Der Tagesspiegel 2019 https://www.tagesspiegel.de/politik/ eu-guidelines-ethics-washing-made-in-europe/24195496. html .
- L Miller, 2020, LAPD will end controversial program that aimed to predict where crimes would occur, Los Angeles Times
- 2017, An Act to Modernize Legislative Provisions as Regards the Protection of Personal Information, Bill, 64
- Northpointe, Inc.. Practitioner's Guide to COMPAS Core; 2015 http://www.northpointeinc.com/downloads/compas/ Practitioners-Guide-COMPAS-Core-_ 031915.pdf. Office of the Privacy Commissioner of Canada. A Regulatory Framework for AI: Recommendations for PIPEDA Reform; 2020 https://www.priv.gc.ca/en/about-the-opc/what-we-do/ consultations/completed-consultations/consultation-ai/ reg-fw _ 202011/ .
- Pasquale F . New Laws of Robotics: Defending Human Expertise in the Age of AI. Belknap Press; 2020 .
- Argentina Republic, 2013, Ley De Protecci�n De Los Datos Personales (Personal Data Protection Law)
- Richardson R, editor. Confronting Black Boxes: A Shadow Report of the New York City Automated Decision System Task Force. AI Now Institute; 2019 https://ainowinstitute.org/ads-shadowreport-2019.pdf.
- Richardson R, Schultz JM, Crawford K. Dirty data, bad predictions: How civil rights violations impact police data, predictive policing systems, and justice. New York University Law Rev. 2019;94:15-55 https://www.nyulawreview.org/online-features/ dirty-data-bad-predictions-how-civil-rights-violations-impact- police-data-predictive-policing-systems-and-justice/ .
- Scharfenberg D. Computers can solve your problem. You may not like the answer. Boston Globe 2018 https://apps.bostonglobe. com/ideas/graphics/2018/09/equity-machine/ .
- J Skeem, 2016, Impact of risk assessment on judges' fairness in sentencing relatively poor defendants, Central Bond Court Report, 44, 51
- Slovenian Parliament. Zakon o varstvu Osebnih Podatkov na Podro čju Obravnavanja Kaznivih Dejanj (Personal Data Protection Act in the Field of Dealing with Criminal Offenses); 2020 http://www.pisrs.si/Pis.web/pregledPredpisa?id=ZAKO8157 .
- Solum L. Legal theory lexicon: Rules, standards, and principles. Legal Theory Blog 2009 https://lsolum.typepad.com/legaltheory/2009/09/ legal-theory-lexicon-rules-standards-and-principles.html .
- 2018, Statistics New Zealand. Algorithm Assessment Report
- Stein MI. New Orleans City Council bans facial recognition, predictive policing and other surveillance tech. Lens 2020 https://thelensnola.org/2020/12/18/new-orleans-city- council-approves-ban-on-facial-recognition-predictive- policing-and-other-surveillance-tech/ .
- Steinhart D. Juvenile detention risk assessment: A practice guide for juvenile detention reform. Annie E. Casey Found. 2006 https://www.aecf.org/m/resourceimg/ aecf-juveniledetentionriskassessment1-2006.pdf.
- Stop LAPD Spying Coalition. Before the Bullet Hits the Body: Dismantling Predictive Policing in Los Angeles; 2018 https://stoplapdspying.org/wp-content/uploads/2018/05/ Before-the-Bullet-Hits-the-Body-May-8-2018.pdf.
- Author Information Ben Green is a Postdoctoral Scholar in the Michigan Society of Fellows and an Assistant Professor in the Gerald R. Ford School of Public Policy. He holds a PhD in Applied Mathematics, with a secondary field in Science, Technology, and Society, from Har- vard University. His book, The Smart Enough City: Putting Tech- nology in Its Place to Reclaim Our Urban Future , was published in 2019 by MIT Press. Ben is also an Affiliate at the Berkman Klein Center for Internet & Society at Harvard and a Fellow at the Center for Democracy & Technology.
Cited by
Towards a standard for identifying and managing bias in artificial intelligence
Schwartz, R., Vassilev, A., Greene, K., Perine, L., Burt, A., & Hall, P. (2022) · doi:10.6028/nist.sp.1270 · Cited by 548
Laux, J., Wachter, S., & Mittelstadt, B. (2024) · Regulation & Governance · doi:10.1111/rego.12512 · Cited by 365
OECD (2025) · OECD eBooks · doi:10.1787/795de142-en · Cited by 324
Is human oversight to AI systems still possible?
Holzinger, A., Zatloukal, K., & Müller, H. (2024) · New Biotechnology · doi:10.1016/j.nbt.2024.12.003 · Cited by 179
“How knowledge workers think generative AI will (not) transform their industries,”
Woodruff, A., Shelby, R., Kelley, P. G., Rousso-Schindler, S., Smith-Loud, J., & Wilcox, L. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642700 · Cited by 105
Laux, J., Wachter, S., & Mittelstadt, B. (2024) · Computer Law & Security Review · doi:10.1016/j.clsr.2024.105957 · Cited by 110
Berman, A., Licht, K. D. F., & Carlsson, V. (2024) · Technology in Society · doi:10.1016/j.techsoc.2024.102471 · Cited by 172
Laux, J. (2024) · AI & SOCIETY · doi:10.1007/s00146-023-01777-z · Cited by 127
How do we assess the trustworthiness of AI? Introducing the trustworthiness assessment model (TrAM)
Schlicker, N., Baum, K., Uhde, A., Sterz, S., Hirsch, M. C., & Langer, M. (2025) · Computers in Human Behavior · doi:10.1016/j.chb.2025.108671 · Cited by 76
How Child Welfare Workers Reduce Racial Disparities in Algorithmic Decisions
Cheng, H.-F., Stapleton, L., Kawakami, A., Sivaraman, V., Cheng, Y., Qing, D., Perer, A., Holstein, K., Wu, Z. S., & Zhu, H. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501831 · Cited by 85
Bell, A., Solano-Kamaiko, I., Nov, O., & Stoyanovich, J. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533090 · Cited by 103
Stapleton, L., Lee, M. H., Qing, D., Wright, M., Chouldechova, A., Holstein, K., Wu, Z. S., & Zhu, H. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533177 · Cited by 76
Langer, M., Baum, K. L., & Schlicker, N. (2024) · Minds and Machines · doi:10.1007/s11023-024-09701-0 · Cited by 115
On the Quest for Effectiveness in Human Oversight: Interdisciplinary Perspectives
Sterz, S., Baum, K., Biewer, S., Hermanns, H., Lauber-Rönsberg, A., Meinel, P., & Langer, M. (2024) · The 2024 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3630106.3659051 · Cited by 91
Chan, A., Ezell, C., Kaufmann, M., Wei, K., Hammond, L., Bradley, H., Bluemke, E., Rajkumar, N., Krueger, D., Kolt, N., et al. (2024) · The 2024 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3630106.3658948 · Cited by 84
Wang, A., Kapoor, S., Barocas, S., & Narayanan, A. (2024) · ACM Journal on Responsible Computing · doi:10.1145/3636509 · Cited by 57
Prabhudesai, S., Yang, L., Asthana, S., Huan, X., Liao, Q. V., & Banovic, N. (2023) · Proceedings of the 28th International Conference on Intelligent User Interfaces · doi:10.1145/3581641.3584033 · Cited by 82
The impact of AI errors in a human-in-the-loop process
Agudo, U., Liberal, K. G., Arrese, M., & Matute, H. (2024) · Cognitive Research: Principles and Implications · doi:10.1186/s41235-023-00529-3 · Cited by 66
Detection of Digital Law Issues and Implication for Good Governance Policy in Indonesia
Marwan, A., Contreras-Garduno, D. O., & Bonfigli, F. (2022) · BESTUUR · doi:10.20961/bestuur.v10i1.59143 · Cited by 81
Automation bias in public administration – an interdisciplinary perspective from law and psychology
Ruschemeier, H., & Hondrich, L. J. (2024) · Government Information Quarterly · doi:10.1016/j.giq.2024.101953 · Cited by 59
Spatola, N. (2024) · Computers in Human Behavior Artificial Humans · doi:10.1016/j.chbah.2024.100099 · Cited by 77
Balakrishnan, M., Ferreira, K., & Tong, J. D. (2025) · Management Science · doi:10.1287/mnsc.2022.03850 · Cited by 88
Kawakami, A., Coston, A., Zhu, H., Heidari, H., & Holstein, K. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642849 · Cited by 54
Inherent Limitations of AI Fairness
Buyl, M., & Bie, T. D. (2024) · Communications of the ACM · doi:10.1145/3624700 · Cited by 73
Designing meaningful human oversight in AI
Zhu, L., Lu, Q., Ding, M., Lee, S. U., & Wang, C. (2026) · AI and Ethics · doi:10.1007/s43681-026-01147-7 · Cited by 68
Eisbach, S., Langer, M., & Hertel, G. (2023) · Computers in Human Behavior: Artificial Humans · doi:10.1016/j.chbah.2023.100015 · Cited by 46
Reimagining the machine learning life cycle to improve educational outcomes of students
Liu, L. T., Wang, S., Britton, T., & Abebe, R. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2204781120 · Cited by 70
Karusala, N., Upadhyay, S., Veeraraghavan, R., & Gajos, K. Z. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3641898 · Cited by 61
Cordella, A., & Gualdi, F. (2024) · Government Information Quarterly · doi:10.1016/j.giq.2024.101982 · Cited by 51
The Devil is in the Details: Interrogating Values Embedded in the Allegheny Family Screening Tool
Gerchick, M., Jegede, T., Shah, T., Gutierrez, A., Beiers, S., Shemtov, N., Xu, K., Samant, A., & Horowitz, A. (2023) · 2023 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3593013.3594081 · Cited by 34
Regulating Government AI and the Challenge of Sociotechnical Design
Engstrom, D. F., & Haim, A. (2023) · Annual Review of Law and Social Science · doi:10.1146/annurev-lawsocsci-120522-091626 · Cited by 48
The Algorithmic State Architecture (ASA): An Integrated Framework for AI-Enabled GovernmentPreprint
Engin, Z., Crowcroft, J., Hand, D. J., & Treleaven, P. C. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2503.08725 · Cited by 50
Decuypere, A., & de Vijver, A. V. (2025) · Government Information Quarterly · doi:10.1016/j.giq.2024.102002 · Cited by 40
Predictable artificial intelligence
Zhou, L., Casares, P. A. M., Martínez‐Plumed, F., Burden, J., Burnell, R., Cheke, L. G., Ferri, C. S., Marcoci, A., Mehrbakhsh, B., Moros-Daval, Y., et al. (2026) · Artificial Intelligence · doi:10.1016/j.artint.2026.104491 · Cited by 41
Differential Fairness: An Intersectional Framework for Fair AI
Islam, R., Keya, K. N., Pan, S., Sarwate, A. D., & Foulds, J. R. (2023) · Entropy · doi:10.3390/e25040660 · Cited by 45
Towards a Better Understanding of Evaluating Trustworthiness in AI Systems
Kemmerzell, N., Schreiner, A., Khalid, H., Schalk, M., & Bordoli, L. (2025) · ACM Computing Surveys · doi:10.1145/3721976 · Cited by 45
Wang, C., Yin, Y., & Hu, H. (2026) · Technology in Society · doi:10.1016/j.techsoc.2026.103264 · Cited by 44
Artificial Intelligence and Privacy
Solove, D. J. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4713111 · Cited by 33
Mapping the landscape of ethical considerations in explainable AI research
Nannini, L., Manerba, M. M., & Beretta, I. (2024) · Ethics and Information Technology · doi:10.1007/s10676-024-09773-7 · Cited by 38
Trust in hybrid human‐automated decision‐support
Kares, F., König, C. J., Uth, R., Protzel, C., & Langer, M. (2023) · International Journal of Selection and Assessment · doi:10.1111/ijsa.12423 · Cited by 31
Digital government inclusion: Exploring strategies for inclusive government automation
Peeters, R., Miller, S. M., & Schuilenburg, M. B. (2025) · Government Information Quarterly · doi:10.1016/j.giq.2025.102028 · Cited by 34
The application of AI in digital HRM – an experiment on human decision-making in personnel selection
Malin, C. D., Fleiß, J., Seeber, I., Kubicek, B., Kupfer, C., & Thalmann, S. (2024) · Business Process Management Journal · doi:10.1108/bpmj-11-2023-0884 · Cited by 45
Learning When to Advise Human Decision Makers
Noti, G., & Chen, Y. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/339 · Cited by 43
Germundsson, N., & Stranz, H. (2023) · International Journal of Social Welfare · doi:10.1111/ijsw.12633 · Cited by 27
Faas, C., Uth, R., Sterz, S., Langer, M., & Feit, A. M. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3812265 · Cited by 27
Rule of law in the AI era: addressing accountability, and the digital divide
Kouroutakis, A. E. (2024) · Discover Artificial Intelligence · doi:10.1007/s44163-024-00191-8 · Cited by 28
Chandimali, N., Bae, J., Hwang, J. Y., Bak, S. G., Cheong, S. H., & Lee, S. J. (2025) · Journal of Food Protection · doi:10.1016/j.jfp.2025.100547 · Cited by 29
Human–machine collaboration for enhanced decision-making in governance
Rooy, D. V. (2024) · Data & Policy · doi:10.1017/dap.2024.72 · Cited by 29
Zharova, A. (2023) · Journal of Digital Technologies and Law · doi:10.21202/jdtl.2023.42 · Cited by 30
Dhanorkar, S., Passi, S., & Vorvoreanu, M. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3812402 · Cited by 33
Yacoby, Y., Green, B., Griffin, C. L., Jr., & Doshi‐Velez, F. (2022) · Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · doi:10.1609/hcomp.v10i1.22001 · Cited by 33
Self-citationOn the Complexities of Testing for Compliance with Human Oversight Requirements in AI Regulation
Langer, M., Lazar, V., & Baum, K. L. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-07132-3_11 · Cited by 27
Who is controlling whom? Reframing “meaningful human control” of AI systems in security
Christen, M., Burri, T., Kandul, S., & Vörös, P. (2023) · Ethics and Information Technology · doi:10.1007/s10676-023-09686-x · Cited by 26
AI and Human Oversight: A Risk-Based Framework for AlignmentPreprint
Kandikatla, L., & Radeljić, B. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2510.09090 · Cited by 27
Singh, A. P., & Szajnfarber, Z. (2025) · Systems Engineering · doi:10.1002/sys.70024 · Cited by 25
Mitigating Societal Cognitive Overload in the Age of AI: Challenges and DirectionsPreprint
Lahlou, S. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2504.19990 · Cited by 29
Hirvonen, H. (2024) · AI & SOCIETY · doi:10.1007/s00146-023-01731-z · Cited by 19
A Human-Centric Perspective on Model Monitoring
Shergadwala, M., Lakkaraju, H., & Kenthapadi, K. (2022) · Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · doi:10.1609/hcomp.v10i1.21997 · Cited by 30
A comparative user study of human predictions in algorithm-supported recidivism risk assessment
Portela, M., Castillo, C., Tolan, S., Karimi-Haghighi, M., & Pueyo, A. A. (2024) · Artificial Intelligence and Law · doi:10.1007/s10506-024-09393-y · Cited by 23
Menke, W., Gomes, R. C., & Xavier, F. (2024) · Global Public Policy and Governance · doi:10.1007/s43508-024-00098-1 · Cited by 22
Automating Justice: An Ethical Responsibility of Computational Bioethics
Rahimzadeh, V. N., Lawson, J., Baek, J., & Dove, E. S. (2022) · The American Journal of Bioethics · doi:10.1080/15265161.2022.2075051 · Cited by 18
Mishler, A., & Dalmasso, N. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2202.05049 · Cited by 22
Human oversight of artificial intelligence: An operations management perspective
Salgado-Criado, J. (2025) · Journal of Industrial Engineering and Management · doi:10.3926/jiem.8567 · Cited by 16
Artificial intelligence and judicial decision-making: Evaluating the role of AI in debiasing
Lopes, G. (2024) · TATuP - Zeitschrift für Technikfolgenabschätzung in Theorie und Praxis · doi:10.14512/tatup.33.1.28 · Cited by 28
Fanfani, M., Palesi, L. A. I., & Nesi, P. (2026) · Big Data and Cognitive Computing · doi:10.3390/bdcc10060186 · Cited by 19
Sztandar‐Sztanderska, K., & Zieleńska, M. (2022) · Sozialer Fortschritt · doi:10.3790/sfo.71.6-7.465 · Cited by 19
Lane, L. (2023) · Internet Policy Review · doi:10.14763/2023.1.1697 · Cited by 20
Decoding the algorithmic operations of Australia's National Disability Insurance Scheme
van Toorn, G., & Carney, T. (2024) · Australian Journal of Social Issues · doi:10.1002/ajs4.342 · Cited by 16
Better together? Human oversight as means to achieve fairness in the European AI Act governance
Correa, A., Garsia, S., & Elbi, A. (2025) · Cambridge Forum on AI Law and Governance · doi:10.1017/cfl.2025.10010 · Cited by 17
Transforming Leadership: The Role of Artificial Intelligence in Modern Organizational Management
Ali, Q., & Mahmood, M. A. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3693-8960-7.ch009 · Cited by 14
Magakwe, J. (2025) · IntechOpen eBooks · doi:10.5772/intechopen.114901 · Cited by 13
Ma, Z., Mei, Y., Bruderlein, C., Gajos, K. Z., & Pan, W. (2025) · Annual Symposium on Human-Computer Interaction for Work (CHIWORK) · doi:10.1145/3729176.3729194 · Cited by 28
How context matters: Human oversight of automated decision-making systems in welfare administration
Sztandar‐Sztanderska, K. (2025) · Journal of European Social Policy · doi:10.1177/09589287251358069 · Cited by 13
Identifying Algorithmic Decision Subjects' Needs for Meaningful Contestability
Yurrita, M., Verma, H., Balayn, A., Alfrink, K., Gadiraju, U., & Bozzon, A. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757415 · Cited by 13
Faas, C., Kerstan, S., Uth, R., Langer, M., & Feit, A. M. (2026) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3742413.3789100 · Cited by 14
Jacobs-Basadien, M., & Pather, S. (2026) · Universal Access in the Information Society · doi:10.1007/s10209-026-01340-9 · Cited by 11
Barragán, D., Howard, J. J., Rabbitt, L. R., & Sirotin, Y. B. (2022) · PLoS ONE · doi:10.1371/journal.pone.0277625 · Cited by 11
Dietrich, F. (2024) · AI and Ethics · doi:10.1007/s43681-024-00610-7 · Cited by 18
Antar, A. D., Molaei, S., Chen, Y.-Y., Lee, M. L., & Banović, N. (2024) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3654777.3676323 · Cited by 11
Passi, S., Dhanorkar, S., & Vorvoreanu, M. (2025) · Springer eBooks · doi:10.1007/978-981-95-3658-0_98 · Cited by 15
Rohlfing, K. J., Främling, K., Lim, B., Alpsancar, S., & Thommes, K. (2026) · Springer eBooks · doi:10.1007/978-981-96-5290-7 · Cited by 10
Kynatun, M. (2025) · American Journal of Advanced Technology and Engineering Solutions · doi:10.63125/kzcdyz73 · Cited by 15
Human Discernment of Algorithmic Errors: A Case Study in Child WelfarePreprint
Fogliato, R., De‐Arteaga, M., & Chouldechova, A. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.4050125 · Cited by 10
Misabstraction in Sociotechnical Systems
de Troya, Í. M. D. R., Kernahan, J., Doorn, N., Dignum, V., & Dobbe, R. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732122 · Cited by 15
Transparency, Compliance, And Contestability When Code Is(n’t) Law
Hicks, A. (2022) · New Security Paradigms Workshop · doi:10.1145/3584318.3584854 · Cited by 12
Ruvalcaba-Gómez, E. A., & Benítez, V. H. G. (2025) · Review of Policy Research · doi:10.1111/ropr.70057 · Cited by 10
Haitsma, L. M. (2023) · Recht der Werkelijkheid · doi:10.5553/rdw/138064242023044002004 · Cited by 11
Code-ifying the Law: How Disciplinary Divides Afflict the Development of Legal Software
Escher, N., Bilik, J., Banović, N., & Green, B. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3686937 · Cited by 14
Self-citationDiversity and technology—Challenges for the next decade in personnel selection
Langer, M., Roulin, N., & Oostrom, J. K. (2023) · International Journal of Selection and Assessment · doi:10.1111/ijsa.12439 · Cited by 8
Law + TechnologyPreprint
Schrepel, T. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4115666 · Cited by 10
Don't Kill the Baby: The Case for AI in ArbitrationPreprint
Mei, Y., & Broyde, M. J. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4936638 · Cited by 10
Gules‐Guctas, E. (2026) · Public Administration Review · doi:10.1111/puar.70043 · Cited by 7
Haitsma, L., & Brink, B. (2025) · Digital Government: Research and Practice · doi:10.1145/3716173 · Cited by 7
Creating Digital Health Technology for Gender Equity: a Capabilities Approach
Jacobs, N. (2025) · Public Health Ethics · doi:10.1093/phe/phaf012 · Cited by 7
MacKay, M., Kukan, A., & McWhirter, J. E. (2025) · Digital Health · doi:10.1177/20552076251393302 · Cited by 9
Kim, E. (2026) · Policy & Internet · doi:10.1002/poi3.70029 · Cited by 7
Intermediation: Algorithmic Prioritization in Practice in Homeless Services
Tracey, P., & Garcia, P. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3686951 · Cited by 10
Haitsma, L. M. (2023) · Frontiers in Political Science · doi:10.3389/fpos.2023.1232601 · Cited by 8
Ouyang, B., Yan, Z., Jiang, Y., Deng, C., Chen, Y., & Wu, L. (2024) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi13110394 · Cited by 7
Ethics: Why Software Engineers Can’t Afford to Look Away
Johnson, B., & Menzies, T. (2023) · IEEE Software · doi:10.1109/ms.2023.3319768 · Cited by 7
Metadata
- Authors
- Green, B.
- Affiliations
- University of Michigan (US)
- Corresponding author
- Green, Ben
- ORCID
- Green, Ben
- Venue
- Computer law & security review
- Publisher
- Elsevier BV
- Published
- 2021
- Volume
- 45
- Pages
- 105681-105681
- ISSN
- 2212-473X (ISSN-L)
- OpenAlex
- W3200421165
- Cited by
- 259
- References
- 110
- Citations by year
- 2026: 108 · 2025: 56 · 2024: 43 · 2023: 28 · 2022: 24
- FWCI
- 43.80
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Computer law & security review (publishedVersion, cc-by)
- SSRN Electronic Journal (acceptedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Law › Digitalization, Law, and Regulation
- Social Sciences › Political Science and International Relations › E-Government and Public Services
- Keywords
- human oversight, algorithmic decision-making, algorithmic regulation, institutional oversight, accountability, algorithmic harms, public trust in government, algorithmic governance
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.