Algorithms and Decision-Making in the Public Sector
Open accessThe DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Abstract
This article surveys the use of algorithmic systems to support decision-making in the public sector. Governments adopt, procure, and use algorithmic systems to support their functions within several contexts—including criminal justice, education, and benefits provision—with important consequences for accountability, privacy, social inequity, and public participation in decision-making. We explore the social implications of municipal algorithmic systems across a variety of stages, including problem formulation, technology acquisition, deployment, and evaluation. We highlight several open questions that require further empirical research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Street-Level Bureaucracy: Dilemmas of the Individual in Public Services
Lipsky, M. (1981) · Michigan Law Review · doi:10.2307/1288305 · Cited by 8,981
Dissecting racial bias in an algorithm used to manage the health of populations
Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019) · Science · doi:10.1126/science.aax2342 · Cited by 7,137 · cited 1×
“…young people who cost less now but may cost and suffer more over the long term—and prioritizing high cost may yield inequitable results if women, immigrants, and minorities tend to be lower cost, including for reasons unrelated to their level of need (Harkinson 2016, Obermeyer et al. 2019).”
BackgroundLipton, Z. C. (2018) · Queue · doi:10.1145/3236386.3241340 · Cited by 5,427
Statistical Modeling: The Two Cultures (with comments and a rejoinder by the author)
Breiman, L. (2001) · Statistical Science · doi:10.1214/ss/1009213726 · Cited by 4,340
The Black Box Society: The Secret Algorithms That Control Money and Information
Pasquale, F. (2015) · doi:10.4159/harvard.9780674736061 · Cited by 3,796
A survey on concept drift adaptation
Gama, J., Žliobaitė, I., Bifet, A., Pechenizkiy, M., & Bouchachia, A. (2014) · ACM Computing Surveys · doi:10.1145/2523813 · Cited by 3,735
How the machine “thinks”: Understanding opacity in machine learning algorithms
Burrell, J. (2016) · Big Data & Society · doi:10.1177/2053951715622512 · Cited by 3,196 · cited 2×
“The tool uses data from seven county agencies to predict which homeless people are likely to become “high-cost public service user[s] in the next year (Early 2016, Toros & Flaming 2018, p. 119).”
BackgroundMethodBarocas, S., & Selbst, A. D. (2014) · doi:10.2139/ssrn.2477899 · Cited by 3,048 · cited 1×
“Although predictive accuracy is a primary concern here, there has been much recent discussion of how to navigate the potential discriminatory impact of using certain features (even when they contribute to accuracy) and how to then respond to and mitigate these issues (Barocas & Selbst 2016).”
BackgroundAlgorithms at Work: The New Contested Terrain of Control
Kellogg, K. C., Valentine, M. A., & Christin, A. (2020) · Academy of Management Annals · doi:10.5465/annals.2018.0174 · Cited by 2,732
“Clinical versus Actuarial Judgment.”
Dawes, R. M., Faust, D., & Meehl, P. E. (1989) · Science · doi:10.1126/science.2648573 · Cited by 2,298 · cited 1×
“…are reflected in the push for evidence-based policy and decision-making (Engstrom et al. 2020, Stevenson 2018) and in the growth of actuarial practices that rely on statistical prediction rather than on clinical judgment developed through experience and training (Dawes et al. 1989, Simon 1988).”
Cited by
Kawakami, A., Sivaraman, V., Cheng, H.-F., Stapleton, L., Cheng, Y., Qing, D., Perer, A., Wu, Z. S., Zhu, H., & Holstein, K. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517439 · Cited by 143
“At the same time, AI-based judgments are themselves likely to be imperfect and biased, even if in different ways than humans [15, 32, 39, 64].”
BackgroundResultInfluentialKawakami, A., Coston, A., Zhu, H., Heidari, H., & Holstein, K. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642849 · Cited by 54
“…semi-structured interviews with public sector agency workers (agency leaders, AI practitioners, frontline workers) and community advocates to understand the questions they believed were critical to discuss yet currently overlooked before deciding to move forward with a public sector AI proposal.”
BackgroundFrom Public E-Procurement 3.0 to E-Procurement 4.0; A Critical Literature Review
Mavidis, A., & Folinas, D. (2022) · Sustainability · doi:10.3390/su141811252 · Cited by 45
Ghosting the Machine: Judicial Resistance to a Recidivism Risk Assessment Instrument
Pruss, D. (2023) · 2023 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3593013.3593999 · Cited by 31
Kawakami, A., Coston, A., Heidari, H., Holstein, K., & Zhu, H. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3686989 · Cited by 24
Metadata
- Authors
- Levy, K., Chasalow, K. E., & Riley, S.
- Venue
- Annual Review of Law and Social Science
- Publisher
- Annual Reviews
- Published
- 2021-10-13
- Volume
- 17
- Issue
- 1
- Pages
- 309-334
- ISSN
- 1550-3585 (ISSN-L)
- 1550-3631
- OpenAlex
- W3172101419
- Cited by
- 108
- References
- 49
- FWCI
- 3.06
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Algorithms and Decision-Making in the Public Sector. https://app.cochat.ai/papers/10.1146/annurev-lawsocsci-041221-023808
- The paper
- Levy, K., Chasalow, K. E., & Riley, S. (2021). Algorithms and Decision-Making in the Public Sector. Annual Review of Law and Social Science. https://doi.org/10.1146/annurev-lawsocsci-041221-023808
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.