The Administrative State and Artificial Intelligence: Toward an Internal Law of Administrative Algorithms
Open accessThe DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Abstract
The administrative state is gradually embracing artificial intelligence (AI) algorithms. The advent of the so-called automated state has raised concerns over accountability, transparency, and fairness and engendered proposals for legal regulation. Yet the notion that algorithms are not merely technical instruments but encode social behavior embedded in a bureaucratic context has largely been missing from the discourse. This article identifies algorithmic as sociotechnical systems embedded in an organizational context, which can function as bureaucratic governance instruments. It argues that external legal institutions, whether legislative endeavors or judicial review, lack the capacity, insight, and perspective to achieve meaningful accountability in reviewing the administrative use of AI algorithms. The article suggests moving beyond seeing algorithms as a distinct phenomenon to regulate, to a more holistic view of the bureaucratic challenge, which entails confronting inconsistencies, inaccuracies, and administrative culture, and taking account of institutional design. By doing so, it follows in the footsteps of scholars of internal administrative law, comprising of the complex set of rules, guidelines, and procedures of the bureaucracy, and highlighting internal governance as means of improving outcomes and ensuring accountability. It also discusses the points of contention and outlines the doctrinal questions of administrative law that are likely to occupy judges and lawyers when dealing with internal governance with AI in the government. Concurrently, this article uncovers the internal law of administrative algorithms, which is emerging from a set of informal documents developed in the Federal government. The article reviews this corpus and distills the main tenets of responsible and trustworthy AI that will guide how administrative agencies design and implement their AI systems in the foreseeable future, and imbue general principles with actionable goals.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Procedural fairness fails where human review exists only in name or where time pressures and institutional incentives encourage acceptance of system outputs without scrutiny (Haim, 2023; Cobbe and Singh, 2021).”
From Judicial review of algorithmic administrative systems legality evidence and remedies in the smart city state (2026) · cites this paper as Haim, 2023
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Existing administrative procedures often fail to account for the cumulative effects of data errors, model design, and threshold settings that shape automated outcomes (Ng et al., 2020; Haim, 2023).”
From Judicial review of algorithmic administrative systems legality evidence and remedies in the smart city state (2026) · cites this paper as Haim, 2023
The cited source says what the claim attributes to it.
In the citing paper
“Work on the rule of law in algorithmic administration connects this to legality concerns, since system outputs can carry the force of administrative authority even when the internal basis for a decision is difficult to explain in legal terms (Civitarese Matteucci, 2021; Haim, 2023).”
From Judicial review of algorithmic administrative systems legality evidence and remedies in the smart city state (2026) · cites this paper as Haim, 2023
The cited source says what the claim attributes to it.
In the citing paper
“Judicial review traditionally focuses on the legality of decisions as issued, yet algorithmic administration requires attention to upstream choices that shape outcomes before any individual case arises (Oswald, 2018; Haim, 2023).”
From Judicial review of algorithmic administrative systems legality evidence and remedies in the smart city state (2026) · cites this paper as Haim, 2023
The cited source says what the claim attributes to it.
In the citing paper
“Administrative effectiveness and rights protection are not mutually exclusive within public law, provided that systems are designed and governed with review in mind (Sheehy and Ng, 2024; Haim, 2023).”
From Judicial review of algorithmic administrative systems legality evidence and remedies in the smart city state (2026) · cites this paper as Haim, 2023
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Barocas, S., & Selbst, A. D. (2014) · doi:10.2139/ssrn.2477899 · Cited by 3,048
Artificial Intelligence and Management: The Automation–Augmentation Paradox
Raisch, S., & Krakowski, S. (2021) · Academy of Management Review · doi:10.5465/amr.2018.0072 · Cited by 2,755
The Intuitive Appeal of Explainable Machines
Selbst, A. D., & Barocas, S. (2018) · doi:10.2139/ssrn.3126971 · Cited by 392
Goal Displacement: Assessing the Motivation for Organizational Cheating
Bohte, J., & Meier, K. J. (2000) · Public Administration Review · doi:10.1111/0033-3352.00075 · Cited by 306
Code and Other Laws of Cyberspace
Shuler, J. A. (2001) · Government Information Quarterly · doi:10.1016/s0740-624x(00)00068-x · Cited by 259
Risk Assessment in Criminal Sentencing
Monahan, J., & Skeem, J. L. (2016) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-021815-092945 · Cited by 256
Outsider Oversight: Designing a Third Party Audit Ecosystem for AI Governance
Raji, I. D., Xu, P., Honigsberg, C., & Ho, D. (2022) · Proceedings of the 2022 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3514094.3534181 · Cited by 209
Algorithmic Impact Assessments and Accountability: The Co-construction of Impacts
Metcalf, J., Moss, E., Watkins, E. A., Singh, R., & Elish, M. C. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445935 · Cited by 195
Raji, I. D., Smart, A., White, R. N., Mitchell, M., Gebru, T., Hutchinson, B., Smith-Loud, J., Theron, D., & Barnes, P. (2020) · arXiv · doi:10.48550/arxiv.2001.00973 · Cited by 179
Cuccaro-Alamin, S., Foust, R., Vaithianathan, R., & Putnam-Hornstein, E. (2017) · Children and Youth Services Review · doi:10.1016/j.childyouth.2017.06.027 · Cited by 145
Artificial intelligence, bureaucratic form, and discretion in public service
Bullock, J., Young, M. M., & Wang, Y.-F. (2020) · Information Polity · doi:10.3233/ip-200223 · Cited by 139
Agency Coordination in Shared Regulatory SpacePreprint
Freeman, J., & Rossi, J. (2011) · SSRN Electronic Journal · doi:10.2139/ssrn.1778363 · Cited by 100
Algorithmic Fairness and Vertical Equity: Income Fairness with IRS Tax Audit Models
Black, E., Elzayn, H., Chouldechova, A., Goldin, J. S., & Ho, D. E. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533204 · Cited by 77
Green, B., & Chen, Y. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3479562 · Cited by 69
(2021) · SSRN Electronic Journal · Cited by 64
Trust in Public Policy Algorithms
Kennedy, R., Waggoner, P., & Ward, M. (2018) · The Journal of Politics · doi:10.1086/716283 · Cited by 60
The Algorithmic Automation Problem: Prediction, Triage, and Human Effort
Raghu, M., Blumer, K., Corrado, G., Kleinberg, J., Obermeyer, Z., & Mullainathan, S. (2019) · arXiv · doi:10.48550/arxiv.1903.12220 · Cited by 58
Too Many Things to Do: How to Deal with the Dysfunctions of Multiple-Goal AgenciesPreprint
Biber, E. (2008) · SSRN Electronic Journal · doi:10.2139/ssrn.1090313 · Cited by 53
A Century of Excellence in Measurements, Standards, and Technology
Lide, D. R. (2002) · Measurement Science and Technology · doi:10.1088/0957-0233/13/10/707 · Cited by 51
Adjudicatory Independence and the Values of Procedural Due Process
Redish, M. H., & Marshall, L. C. (1986) · The Yale Law Journal · doi:10.2307/796487 · Cited by 50
Strategy and Accountability: Structural Reform Litigation and Public Management
Bertelli, A. M. (2004) · Public Administration Review · doi:10.1111/j.1540-6210.2004.00344.x · Cited by 32
Lubbers, J. S., & Ray, G. K. (2015) · bepress Legal Repository · Cited by 18
Engel, C., & Grgić-Hlača, N. (2021) · Journal of Legal Analysis · doi:10.1093/jla/laab001 · Cited by 16
Outsider Oversight: Designing a Third Party Audit Ecosystem for AI GovernancePreprint
Raji, I. D., Xu, P., Honigsberg, C., et al. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2206.04737 · Cited by 12
Trust in Public Policy AlgorithmsPreprint
Kennedy, R., Waggoner, P., & Ward, M. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3339475 · Cited by 11
The Management Side of Due Process in the Service-Based Welfare State
Sabel, C. F., & Simon, W. H. (2017) · Cambridge University Press eBooks · doi:10.1017/9781316671641.003 · Cited by 9
Designing Regulation Across Organizations: Assessing the Functions and Dimensions of Governance
Camacho, A. E., & Glicksman, R. L. (2021) · Regulation & Governance · doi:10.1111/rego.12420 · Cited by 9
Structural Reform Litigation: Remedial Bargaining and Bureaucratic DriftPreprint
Bertelli, A. M., & Feldmann, S. E. (2005) · SSRN Electronic Journal · doi:10.2139/ssrn.839426 · Cited by 2
Research works printed but not linked: 79
- Engstrom Et, under the Quick Disability Determination program, and using clustering for micro-specialization
- 2019, For example, assisting screening of hotline calls in Child Protection Services, ALLEGHENY METHODOLOGICAL REPORT
- Gail S Ennis, 2019, The Social Security Administration's Use of Insight Software to Identify Potential Anomalies in Hearing Decisions
- J Steven, 2022, Responding to Mass, Computer-generated and Malatributed Comments, 74 ADMIN, L. REV, 95
- See Generally, supra note 2; Coglianese and Ben Dor, supra note 2. 45 Such as prior art search at the USPTO. ENGSTROM ET AL, 48
- 2021, For example, for medical analysis in the Department of Veteran Affairs, See VA ARTIFICIAL INTELLIGENCE (AI) STRATEGY, US DEPARTMENT OF VETERANS AFFAIRS
- 2018, For a skeptical voice documenting some of these use-cases, see VIRGINIA EUBANKS, AUTOMATING INEQALITY: HOW HIGH-TECH TOOLS PROFILE, POLICE, AND PUNISH THE POOR
- 2020, In the Netherlands, a government was ousted due to a scandal that arose under similar circumstances, where an automated system wrongly accused dozens of thousands of families of fraud in child support benefits, Welfare surveillance system violates human rights, Dutch court rules, 22
- Sandra G Mayson, 2019, Bias In, Bias Out, 128 YALE LAW JOURNAL 2218
- Rashida Richardson, 2019, Bad Predictions: How Civil Rights Violations Impact Police Data, Predictive Policing Systems, and Justice, L. REV
- 1990, The field of science and technology studies (STS) has long advocated the notion that technology is not a foreign object but rather part of a wider social and political context, Technology is Society Made Durable
- Rebecca Crootof, 2023, Humans in the Loop, 76 VANDERBILT L. REV
- Christian Leibig, 2022, Combining the strengths of radiologists and AI for breast cancer screening: a retrospective analysis, 4 THE LANCET DIGITAL HEALTH e
- Avi Gesser, 2022, When Humans and Machines Disagree -The Myth of "AI Errors" and Unlocking the Promise of AI Through Optimal Decision Making -Debevoise Data Blog, 16
- Sherman Ho, supra note 16; Ho, supra note 119; HO, MARCUS, AND RAY, supra note 11. 118 Ho and Sherman, 16, 254
- Marcus Ho, AI can help agencies shift from a purely ex-post model of quality review and toward continuous assessment. Relatedly, Insight reflects the potential for AI to promote continuous learning for actors across the system
- 2002, See Levin, supra note 153
- Alexander Nabavi-Noori, 2022, Agency Control and Internally Binding Norms, 131 YALE L, J
- RECOMMENDATION 2017-5: AGENCY GUIDANCE THROUGH POLICY STATEMENTS
- For the importance of transparency with algorithms for the purposes of public legitimacy. See Amit Haim & Dvir Yogev, Perceived Algorithmic Legitimacy in the Administrative State
- Ari Waldman, 2022, Governing algorithmic decisions: The role of decision importance and governance on perceived legitimacy of algorithmic decisions, 9 BIG DATA & SOCIETY 20539517221100450
- Engstrom, Algorithmic Accountability, supra note 21, 846. 176 Engstrom and Haim
- Thomas W Merrill, 1954, See Magill, supra note 125 at 873-882, L. REV, 569
- For example, through good guidance practices
- 1980, SSA ALJ alleged invasion of statutory right to decisional independence upon receipt of "mandatory, unlawful instructions regarding every detail of their judicial role
- 1953, Federal Trial Examiners Conference, 345 US, 128
- U S C � � 554, 2016, 557. algorithm, that is calibration, false negative equity, and false positive equity. This means there cannot be a fully fair algorithms according to mathematically definable notions of fairness, Sendhil Mullainathan & Manish Raghavan, Inherent Trade-Offs in the Fair Determination of Risk Scores, 556
- See Ben Green, 2022, The flaws of policies requiring human oversight of government algorithms, 45 COMPUTER LAW & SECURITY REVIEW
- Lilian Edwards, 2022, Regulating AI in Europe: four problems and four solutions
- Engstrom and Ho started laying out the foundations of administrative law for algorithms. see Engstrom and Ho
- 2020, 216 Engstrom and Haim, supra note 8. See also EXAMINING THE BLACK BOX
- Andrew Tutt, 2017, An FDA for Algorithms, 69 ADMIN, L. REV, 83
- 2021, Itay Ravid & Amit Haim, Progressive Algorithms, 12 UC IRVINE L. REV, 527
- E T Dillon, 2018, ALGORITHMIC IMPACT ASSESSMENTS: A PRACTICAL FRAMEWORK FOR PUBLIC AGENCY ACCOUNTABILITY
- 2016, There is a blind spot in AI research, NATURE, 538
- Min Kyung, WeBuildAI: Participatory Framework for Algorithmic Governance, 3 PROC
- Justin B Matthew M Young, 2019, Artificial Discretion as a Tool of Governance: A Framework for Understanding the Impact of Artificial Intelligence on Public Administration, PERSPECTIVES ON PUBLIC MANAGEMENT AND GOVERNANCE gvz, AI & SOC, 29
- A L Reisman, supra note 63; JOSHI, supra note 4 at, 21
- Engstrom and Haim call this the "snapshot" and "bookend" problems. See Engstrom and Haim
- Robert A Wilson ;, 2017, supra note 12; MASHAW, supra note 12, Varieties of Bureaucratic Justice: Building on Mashaw's Typology
- Paul Verkuil, 2017, Meeting the Mashaw Test for Consistency in Administrative Decision-Making, in ADMINISTRATIVE LAW FROM THE INSIDE OUT 239
- Edelman, supra note 12; DiMaggio and Powell
- For an early antecedent see R. Shep Melnick, Administrative Law and Bureaucratic Reality
- L Rev ; Christopher, 1992, Put differently, federal agencies regulate us in many meaningful, and sometimes frightening, ways that either evade judicial review entirely or are at least substantially insulated from such review, Nicholas R Parrillo, Federal Agency Guidance and the Power to Bind: An Empirical Study of Agencies and Industries, 36, 1624
- 2019, Article 22 of the GDPR restricts fully automated decisions on data subjects. For exploration of this and other aspects see Margot E Kaminski, The Right to Explanation, Explained, 34 BERKELEY TECH, L. J
- 2019, For example, the New York City special task force on automated decision-making spent arduous efforts in coming up with a definition that will include all relevant automated and algorithmic systems, but will preclude banal instances such as use of spreadsheets like Excel, New York City Automated Decision Systems Task Force Report, 26
- Green, 2018, ALGORITMIC DECISION SYSTEMS
- Id, at 1917-1927; Ho and Xiang, supra note 56
- Heckler V Chaney, 1985, Engstrom, supra note 2; Solow-Niederman, supra note 21, 470
- Kate Crawford, 2019, Crawford and Schultz, supra note 53. 279 Engstrom and Haim, supra note 8; Glaze et al., supra note 11
- 2020, Executive Order 13960: Promoting the Use of Trustworthy Artificial Intelligence in the Federal Government, 85 FED, 78
- Id, 283 Agency inventories of AI use cases
- Executive Order 13960, supra note 289
- Russel T Vought, 2020, Guidance for Regulation of Artificial Intelligence Applications, 12
- 2018, ARTIFICIAL INTELLIGENCE: EMERGING OPPORTUNITIES, CHALLENGES, AND IMPLICATIONS
- BLUEPRINT FOR AN AI BILL OF RIGHTS: MAKING AUTOMATED SYSTEMS WORK FOR THE AMERICAN PEOPLE
- 2023, The Department of Education has begun a process of developing policies focused on effective, safe, and fair AI applications for education, Department of Veteran Affairs VA ARTIFICIAL INTELLIGENCE (AI) STRATEGY, supra note 45. The Department of Energy DOE AI Risk Management Playbook (AIRMP), ENERGY.GOV
- Ai (tai) Trustworthy, 2021, The Playbook specifically incorporates principles from EO13960 and the OMB Memo
- Safe And Effective Systems 2. Algorithmic Discrimination Protections 3. Data Privacy
- Notice And Explanation 5. Human Alternatives, Consideration, And Fallback OMB Memo 1. Public Trust 2. Public Participation 3. Scientific Integrity and Information Quality, Risk Assessment and Management, 4
- Interagency Coordination GAO Framework 1. Governance: Promote accountability by establishing processes to manage, operate, and oversee implementation 292 Id, Fairness and Nondiscrimination 8. Disclosure and Transparency 9. Safety and Security 10
- A I Doe, Risk Management Playbook (AIRMP), supra note 193
- Id, 317 Engstrom and Haim, supra note 8
- 2023, See supra note 69 at 93. In fact, the consistency of algorithms is also problematized with more advanced methods, where algorithmic outputs are sampled from a large probability distribution and may differ from query to query, The Role of Temperature in Large Language Model Response Generation
- Leibig, supra note 85; Raisch and Krakowski, supra note 85
- Gao Report, supra note 23; VA ARTIFICIAL INTELLIGENCE (AI) STRATEGY, supra note 45; NAIAC REPORT, supra note
- Schultz Crawford, Based in part on Engstrom and Haim, 325
- Id, at 61. This is reminiscent of protracted battles between the Social Security Administration and the ALJ union over decisional independence
- Raso, 2020, supra note 30; Raso, supra note 104; Rik Peeters, The agency of algorithms: Understanding humanalgorithm interaction in administrative decision-making, IP, 25
- Ames, supra note 16 at 61-62. This is common in situations where subordinates evaluate their superiors
- Hausman, supra note 140; Hausman, supra note 15
- Methodological and Informational Transparency
- Id, 65; Bednar, supra note
- Engstrom, supra note 3; Engstrom and Haim, supra note 8
- Cary Coglianese, 2019, Public Availability of Agency Guidance Documents
- Christie See, 2022, A recent whitepaper from researchers at Stanford University found the level of transparency of federal agencies regarding AI to be partial and lacking, Implementation Challenges to Three Pillars of America's AI Strategy
- Metzger has argued similarly regarding agency decision-making more generally, 22, 1366
- 2023, Artificial Intelligence (AI) at National Science Foundation
- John C Jeffries, 2007, Structural Reform Revisited, 95 CAL. L. REV. 1387
Cited by
Amin, M. R. M., Asbi, A., Sivakumaran, V. M., Kim, J., & Septiarini, E. (2025) · Social Sciences & Humanities Open · doi:10.1016/j.ssaho.2025.102048 · Cited by 44
Ameen, K. S., Towfiq, T. A., Mousa, K. M., & Pooyanmehr, M. (2026) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2026.1802986 · Cited by 4
“Administrative effectiveness and rights protection are not mutually exclusive within public law, provided that systems are designed and governed with review in mind (Sheehy and Ng, 2024; Haim, 2023).”
InfluentialHaryanto, M. F. P., & Sekti, B. A. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-9164-9.ch011
Metadata
- Authors
- Haim, A.
- Affiliations
- Max Planck Society (DE)
- Corresponding author
- Haim, Amit
- ORCID
- Haim, Amit
- Venue
- SSRN Electronic Journal
- Publisher
- Elsevier BV
- Published
- 2023
- ISSN
- 1556-5068 (ISSN-L)
- OpenAlex
- W4385322751
- Cited by
- 3
- References
- 24
- Citations by year
- 2026: 2 · 2025: 1
- Type
- posted content
- Language
- en
- Open access
- green
- doi.org
- Locations
- SSRN Electronic Journal (acceptedVersion)
- eScholarship (California Digital Library) (submittedVersion)
- eYLS (Yale Law School) (submittedVersion)
- Topics
- Social Sciences › Law › Administrative Law and Governance
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Law › Digitalization, Law, and Regulation
- Keywords
- artificial intelligence in government, internal governance, bureaucratic governance, accountability, transparency, fairness, administrative agencies, institutional design, administrative culture
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.