The DOI matches its Crossref record; 76 of the 76 references it cites were found in a registry or an index.
Street-Level Algorithms: A Theory at the Gaps Between Policy and Decisions
Abstract
Errors and biases are earning algorithms increasingly malignant reputations in society. A central challenge is that algorithms must bridge the gap between high-level policy and on-the-ground decisions, making inferences in novel situations where the policy or training data do not readily apply. In this paper, we draw on the theory of street-level bureaucracies, how human bureaucrats such as police and judges interpret policy to make on-the-ground decisions. We present by analogy a theory of street-level algorithms, the algorithms that bridge the gaps between policy and decisions about people in a socio-technical system. We argue that unlike street-level bureaucrats, who reflexively refine their decision criteria as they reason through a novel situation, street-level algorithms at best refine their criteria only after the decision is made. This loop-and-a-half delay results in illogical decisions when handling new or extenuating circumstances. This theory suggests designs for street-level algorithms that draw on historical design patterns for street-level bureaucracies, including mechanisms for self-policing and recourse in the case of error.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Moreover, regardless of the type of outcome, street-level bureaucrats in the public sector must still exercise discretion and contextualize the algorithmic results for each case and act within the constraints posed by bureaucratic processes as explained by the ADMAPS framework [2,62,91].”
From A Framework of High-Stakes Algorithmic Decision-Making for the Public Sector Developed through a Case Study of Child-Welfare (2021) · cites this paper as [2]
In the citing paper
“machine-learning techniques in ADM for making administrative decisions cannot work in a rule of law situation because machine-learning is actually based on predictions, where a new decision is made on the basis of a data pool of previous decisions”
From Administrative due process when using automated decision-making in public administration: some notes from a Finnish perspective (2021) · cites this paper as Alkhatib and Bernstein 2019
In the citing paper
“more training data does not eliminate errors that lead to incorrect decision, because there will always be new real cases that do not conform to the patterns extracted from training data”
From Administrative due process when using automated decision-making in public administration: some notes from a Finnish perspective (2021) · cites this paper as Alkhatib and Bernstein 2019
In the citing paper
“machine-learning is actually based on predictions, where a new decision is made on the basis of a data pool of previous decisions”
From Administrative due process when using automated decision-making in public administration: some notes from a Finnish perspective (2021) · cites this paper as Alkhatib and Bernstein 2019
In the citing paper
“Alkhatib and Bernstein describe 'street-level algorithms' as systems operating in the gaps between general policy and concrete decisions, where technical classifications may acquire practical authority without being formally recognized as exercises of discretion (Alkhatib and Bernstein, 2019).”
From Human-centric AI governance in the European Union. Accountability, fundamental rights, and institutional resilience in public administration (2026) · cites this paper as Alkhatib and Bernstein, 2019
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The ethics of algorithms: Mapping the debate
Mittelstadt, B. D., Allo, P., Taddeo, M., Wachter, S., & Floridi, L. (2016) · Big Data & Society · doi:10.1177/2053951716679679 · Cited by 4,567 · cited 2×
“[51] Brent Daniel Mittelstadt, Patrick Allo, Mariarosaria Taddeo, Sandra”
BackgroundBureaucracy: what government agencies do and why they do it
(1990) · Choice Reviews Online · doi:10.5860/choice.27-4796 · Cited by 3,795
(2018) · Cited by 3,510
Automating Inequality: How High-Tech Tools Profile, Police, and Punish the Poor
Lebovits, H. (2019) · Public Integrity · doi:10.1080/10999922.2018.1511671 · Cited by 3,279 · cited 1×
“This area in particular needs further study: the fault lines are here to stay, and we need to reflect on this shifting of discretion from the bureaucrat to the engineer [18].”
BackgroundThe Color of Law: A Forgotten History of How Our Government Segregated America
Pattillo, M. (2018) · Contemporary Sociology: A Journal of Reviews · doi:10.1177/0094306118792220ll · Cited by 2,247
Street-Level Bureaucracy: The Dilemmas of the Individual in Public Service
Lipsky, M. (1980) · Project Muse (Johns Hopkins University) · Cited by 2,135
Street Corner Society: The Social Structure of an Italian Slum
Meyer, C. H. Z., & Whyte, W. F. (1946) · Journal of Criminal Law and Criminology (1931-1951) · doi:10.2307/1138191 · Cited by 1,838
Çömlekçi, M. F. (2019) · Kırklareli University Institutional Repository (Kırklareli University) · Cited by 1,607
Flexibility Versus Efficiency? A Case Study of Model Changeovers in the Toyota Production System
Adler, P. S., Goldoftas, B., & Levine, D. I. (1999) · Organization Science · doi:10.1287/orsc.10.1.43 · Cited by 1,560
(2018) · Cited by 1,167
Research works printed but not linked: 7
- 10.5555/2908698.2908699 · doi:10.5555/2908698.2908699
- 10.5555/3208509 · doi:10.5555/3208509
- B.M. Jewell. 1921. The problem of piece work. Number nos. 1--16 in The Problem of Piece Work. Bronson Canode Print. Co. https: //books.google.com/books?id=NN5NAQAAIAAJ
- Eugene C Kim. 2007. YouTube: Testing the safe harbors of digital copyright law. S. Cal. Interdisc. LJ 17 (2007), 139.
- Michael Lipsky. 1969. Toward a theory of street-level bureaucracy. Institute for Research on Poverty, University of Wisconsin.
- Michael Winerip. 2012. Facing a robo-grader? Just keep obfuscating mellifluously. New York Times 22 (2012).
- Johanna Wright. 2018. Restricted Mode: How it works and what we can do better. https://youtube-creators.googleblog.com/2017/03/ restricted-mode-how-it-works-and-what.html
Cited by
The Principles and Limits of Algorithm-in-the-Loop Decision Making
Green, B., & Chen, Y. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359152 · Cited by 392
“Notably, although algorithms often make more accurate predictions than people do, their inability to reason re ex-ively and adapt to novel or marginal circumstances makes them poorly suited to achieving many principles of responsible and ethical decision making [2].”
BackgroundInfluentialThe Invisible Cage: Workers’ Reactivity to Opaque Algorithmic Evaluations
Rahman, H. A. (2021) · Administrative Science Quarterly · doi:10.1177/00018392211010118 · Cited by 375
“Second, and relatedly, this study highlights that algorithms lack reflexivity despite the speed and scale at which they operate; they simply carry out their programmed instructions regardless of the situation (Alkhatib and Bernstein, 2019).”
BackgroundOn the apparent conflict between individual and group fairness
Binns, R. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372864 · Cited by 312
“In contexts in which public administration and private decision-making are being automated or augmented with algorithms, the need for occasional individualised consideration is one of the reasons for keeping a human-in-the-loop, or ‘screen-level bureaucrat’ on hand [1, 8, 12, 48].”
BackgroundThe flaws of policies requiring human oversight of government algorithms
Green, B. (2022) · Computer Law & Security Review · doi:10.1016/j.clsr.2022.105681 · Cited by 263
The Flaws of Policies Requiring Human Oversight of Government Algorithms
Green, B. (2021) · doi:10.2139/ssrn.3921216 · Cited by 259
Metadata
- Authors
- Alkhatib, A., & Bernstein, M.
- Affiliations
- Stanford University (US)
- Venue
- Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2019-05-02
- Pages
- 1-13
- OpenAlex
- W2942399136
- Cited by
- 188
- References
- 75
- Citations by year
- 2026: 21 · 2025: 26 · 2024: 24 · 2023: 16 · 2022: 43 · 2021: 30 · 2020: 23 · 2019: 5
- FWCI
- 26.34
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- Funders
- Stanford Cyber Initiative
- National Science Foundation (IIS-1351131)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Law › Artificial Intelligence in Law
- Social Sciences › Political Science and International Relations › E-Government and Public Services
- Keywords
- street-level bureaucracy, algorithmic decision-making, algorithmic bias, algorithmic errors, policy implementation, socio-technical systems, novel situations
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Street-Level Algorithms: A Theory at the Gaps Between Policy and Decisions. https://app.cochat.ai/papers/10.1145/3290605.3300760
- The paper
- Alkhatib, A., & Bernstein, M. (2019). Street-Level Algorithms: A Theory at the Gaps Between Policy and Decisions. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3290605.3300760
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.