Street-Level Algorithms and AI in Bureaucratic Decision-Making: A Caseworker Perspective
The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Abstract
Studies of algorithmic decision-making in Computer-Supported Cooperative Work (CSCW) and related fields of research increasingly recognize an analogy between AI and bureaucracies. We elaborate this link with an empirical study of AI in the context of decision-making in a street-level bureaucracy: job placement. The study examines caseworkers' perspectives on the use of AI, and contributes to an understanding of bureaucratic decision-making, with implications for integrating AI in caseworker systems. We report findings from a participatory workshop on AI with 35 caseworkers from different types of public services, followed up by interviews with five caseworkers specializing in job placement. The paper contributes an understanding of caseworkers' collaboration around documentation as a key aspect of bureaucratic decision-making practices. The collaborative aspects of casework are important to show because they are subject to process descriptions making case documentation prone for an individually focused AI with consequences for the future of how casework develops as a practice. Examining the collaborative aspects of caseworkers' documentation practices in the context of AI and (potentially) automation, our data show that caseworkers perceive AI as valuable when it can support their work towards management, (strengthen their cause, if a case requires extra resources), and towards unemployed individuals (strengthen their cause in relation to the individual's case when deciding on, and assigning a specific job placement program). We end by discussing steps to support cooperative aspects in AI decision-support systems that are increasingly implemented into the bureaucratic context of public services.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Bureaucracy: what government agencies do and why they do it
(1990) · Choice Reviews Online · doi:10.5860/choice.27-4796 · Cited by 3,795
Automating Inequality: How High-Tech Tools Profile, Police, and Punish the Poor
Lebovits, H. (2019) · Public Integrity · doi:10.1080/10999922.2018.1511671 · Cited by 3,279
Olson, G. M., & Olson, J. S. (2000) · Human–Computer Interaction · doi:10.1207/s15327051hci1523_4 · Cited by 1,983 · cited 2×
“Systems design fails to fully account for the continuous negotiation that takes place within a community of professionals, particularly if we do not articulate the need for establishing common ground [43] and how it can be maintained when emerging technologies shift work conditions [39].”
BackgroundLee, M. K. (2018) · Big Data & Society · doi:10.1177/2053951718756684 · Cited by 1,338
Algorithms as culture: Some tactics for the ethnography of algorithmic systems
Seaver, N. (2017) · Big Data & Society · doi:10.1177/2053951717738104 · Cited by 1,010
Bovens, M., & Zouridis, S. (2002) · Public Administration Review · doi:10.1111/0033-3352.00168 · Cited by 964
When the State Meets the Street: Public Service and Moral Agency
Zacka, B. (2017) · Harvard University Press eBooks · doi:10.4159/9780674981423 · Cited by 789
Cai, C. J., Winter, S., Steiner, D., Wilcox, L., & Terry, M. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359206 · Cited by 594
Close encounters of the digital kind: A research agenda for the digitalization of public services
Lindgren, I., Madsen, C. Ø., Hofmann, S., & Melin, U. (2019) · Government Information Quarterly · doi:10.1016/j.giq.2019.03.002 · Cited by 517
Veale, M., Van Kleek, M., & Binns, R. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174014 · Cited by 490 · cited 1×
“Scholars have called for more research on what it means to bring a CSCW perspective to the root of algorithmic research [52].”
BackgroundStreet-Level Bureaucracy and E-Government
Buffat, A. (2015) · Public Management Review · doi:10.1080/14719037.2013.771699 · Cited by 394
Artificial Intelligence, Discretion, and Bureaucracy
Bullock, J. B. (2019) · The American Review of Public Administration · doi:10.1177/0275074019856123 · Cited by 346 · cited 2×
“Therefore, it is important to be aware that complying with the process of assembling and documenting an individual’s case involves many stakeholders, not just a single caseworker. systems) [9, 10, 12, 28, 35].”
BackgroundMethodThe ethnographer and the algorithm: beyond the black box
Christin, A. (2020) · Theory and Society · doi:10.1007/s11186-020-09411-3 · Cited by 327
Wang, D., Churchill, E., Maes, P., Fan, X., Shneiderman, B., Shi, Y., & Wang, Q. (2020) · Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3334480.3381069 · Cited by 271
Digital discretion: A systematic literature review of ICT and street-level discretion
Busch, P. A., & Henriksen, H. Z. (2018) · Information Polity · doi:10.3233/ip-170050 · Cited by 267
Randall, D., Harper, R., & Rouncefield, M. (2007) · Computer Supported Cooperative Work · doi:10.1007/978-1-84628-768-8 · Cited by 254
Algorithmic Profiling of Job Seekers in Austria: How Austerity Politics Are Made Effective
Allhutter, D., Cech, F., Fischer, F., Grill, G., & Mager, A. (2020) · Frontiers in Big Data · doi:10.3389/fdata.2020.00005 · Cited by 199
Street-Level Algorithms: A Theory at the Gaps Between Policy and Decisions
Alkhatib, A., & Bernstein, M. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300760 · Cited by 188 · cited 5×
“Recent studies of algorithmic decision-making now draw an analogy between bureaucracy and AI [1, 46].”
BackgroundInfluentialTechnology on the margins: AI and global migration management from a human rights perspective
Molnar, P. (2019) · Cambridge International Law Journal · doi:10.4337/cilj.2019.02.07 · Cited by 139
Process descriptions as organisational accounting devices: the dual use of workflow technologies
Dourish, P. (2001) · Proceedings of the 2001 International ACM SIGGROUP Conference on Supporting Group Work - GROUP '01 · doi:10.1145/500286.500297 · Cited by 121
Digitalization, Street‐Level Bureaucracy and Welfare Users' Experiences
Hansen, H., Lundberg, K., & Syltevik, L. J. (2018) · Social Policy and Administration · doi:10.1111/spol.12283 · Cited by 118
A Human-Centered Review of Algorithms used within the U.S. Child Welfare System
Saxena, D., Badillo-Urquiola, K., Wisniewski, P. J., & Guha, S. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376229 · Cited by 116
"The Computer Says No!" -- A Case Study on Automated Decision-Making in Public Authorities
Wihlborg, E., Larsson, H., & Hedstrom, K. (2016) · 2016 49th Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.2016.364 · Cited by 106
Fieldwork for Design: Theory and Practice (Computer Supported Cooperative Work)
Randall, D. W., Harper, R. H. R., & Rouncefield, M. (2007) · Springer eBooks · Cited by 103
Shifting Concepts of Value: Designing Algorithmic Decision-Support Systems for Public Services
Holten Møller, N., Shklovski, I., & Hildebrandt, T. T. (2020) · Proceedings of the 11th Nordic Conference on Human-Computer Interaction: Shaping Experiences, Shaping Society · doi:10.1145/3419249.3420149 · Cited by 97
Self-citationLe Dantec, C. A., & Edwards, W. K. (2008) · Proceedings of the 2008 ACM conference on Computer supported cooperative work · doi:10.1145/1460563.1460656 · Cited by 85
Looking at ourselves: an examination of the social organisation of two research laboratories
Harper, R. H. R. (1992) · Conference on Computer Supported Cooperative Work · doi:10.1145/143457.143542 · Cited by 73
Shared values/conflicting logics: working around e-government systems
Voida, A., Dombrowski, L. S., Hayes, G. R., & Mazmanian, M. (2014) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2556971 · Cited by 68
Jansson, G., & Erlingsson, G. Ó. (2014) · Journal of Information Technology & Politics · doi:10.1080/19331681.2014.908155 · Cited by 66 · cited 1×
“Therefore, it is important to be aware that complying with the process of assembling and documenting an individual’s case involves many stakeholders, not just a single caseworker. systems) [9, 10, 12, 28, 35].”
BackgroundThe Role of Discretion in the Age of Automation
Petersen, A. C. M., Christensen, L. R., & Hildebrandt, T. T. (2020) · Computer Supported Cooperative Work (CSCW) · doi:10.1007/s10606-020-09371-3 · Cited by 61
Self-citationLe Dantec, C. A., & Edwards, W. K. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753345 · Cited by 58 · cited 1×
“or the policymakers and regulatory bodies, leading to unresolvable conflicts and the creation of parallel systems [17, 18, 53].”
BackgroundE-government intermediaries and the challenges of access and trust
Dombrowski, L. S., Hayes, G. R., Mazmanian, M., & Voida, A. (2014) · ACM Transactions on Computer-Human Interaction · doi:10.1145/2559985 · Cited by 57
Locating systems at work: implications for the development of active badge applications
Harper, R. H. R., Lamming, M. G., & Newman, W. M. (1992) · Interacting with Computers · doi:10.1016/0953-5438(92)90022-8 · Cited by 53
"We Would Never Write That Down": Classifications of Unemployed and Data Challenges for AI
Petersen, A. C. M., Christensen, L. R., Harper, R., & Hildebrandt, T. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3449176 · Cited by 37 · cited 2×
“In doing this, they are similarly making a decision on how AI should support them in their work [45].”
BackgroundMethodSelf-citationHolten Møller, N. L., Fitzpatrick, G., & Le Dantec, C. A. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3361125 · Cited by 36
Self-citationBureaucracy as a Lens for Analyzing and Designing Algorithmic Systems
Pääkkönen, J., Nelimarkka, M., Haapoja, J., & Lampinen, A. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376780 · Cited by 35 · cited 4×
“build on this work, relying on two of the cases (crowd work and the justice system) while adding another case documented by Eubanks [23] on automated housing allocation for homeless people [46].”
BackgroundMethodInfluentialIn Search for the Perfect Pathway: Supporting Knowledge Work of Welfare Workers
Boulus-Rødje, N. (2018) · Computer Supported Cooperative Work (CSCW) · doi:10.1007/s10606-018-9318-0 · Cited by 34
Borchorst, N. G., & Bødker, S. (2011) · Springer eBooks · doi:10.1007/978-0-85729-913-0_10 · Cited by 30
Burke, A. (2019) · Big Data & Society · doi:10.1177/2053951719858743 · Cited by 28
Designing digital media for teen-aged apprentices: a participatory approach
Katterfeldt, E.-S., Zeising, A., & Schelhowe, H. (2012) · ACM International Conference on Interaction Design and Children (IDC) · doi:10.1145/2307096.2307124 · Cited by 25
When the System Does Not Fit: Coping Strategies of Employment Consultants
Dolata, M., Schenk, B., Fuhrer, J., Marti, A., & Schwabe, G. (2020) · Computer Supported Cooperative Work (CSCW) · doi:10.1007/s10606-020-09377-x · Cited by 22
Infrastructuring participatory development in information technology
Angeli, A. D., Bordin, S., & Menéndez-Blanco, M. (2014) · doi:10.1145/2661435.2661448 · Cited by 21
The future of clerical work is precarious
Møller, N. H. (2018) · interactions · doi:10.1145/3231028 · Cited by 20
Self-citationA Worker-Driven Common Information Space: Interventions into a Digital Future
Møller, N. H., Eriksen, M. G., & Bossen, C. (2020) · Computer Supported Cooperative Work (CSCW) · doi:10.1007/s10606-020-09379-9 · Cited by 19
Self-citationAlgorithmic long-term unemployment risk assessment in use: Counselors’ perceptions and use practices
Zejnilović, L., Lavado, S., Martínez de Rituerto de Troya, Í., Sim, S., & Bell, A. (2020) · Global Perspectives · doi:10.1525/gp.2020.12908 · Cited by 18 · cited 2×
“This is a concrete example of how AI is implemented to support decision-making in job placement [38, 44], which is also being adopted in countries such as Austria [2] and Portugal [60].”
BackgroundDalton, J. (2018) · Apress eBooks · doi:10.1007/978-1-4842-4206-3_27 · Cited by 17
Boulus-Rødje, N. (2019) · Nordic Journal of Working Life Studies · doi:10.18291/njwls.v9i2.114800 · Cited by 16
Justesen, L., & Plesner, U. (2018) · Tidsskrift for Arbejdsliv · doi:10.7146/tfa.v20i3.110811 · Cited by 9
When the State Meets the Street: Public Service and Moral Agency
Broughton, C. (2019) · Contemporary Sociology A Journal of Reviews · doi:10.1177/0094306119828696rr · Cited by 6
Research works printed but not linked: 12
- 10.5555/1241958.1241962 · doi:10.5555/1241958.1241962
- 10.1093/socpro · doi:10.1093/socpro
- Paul Dourish. 2019. User Experince as Legitimacy Trap. ACM Interactions. 2019 ACM 1072--5520/19/11
- Human Rights Watch. 2020. Automated Hardship - How the Tech-Driven Overhaul of the UK's Social Security System Worsens Poverty. September 2020. ISBN: 978-1-623138615
- Michael Lipsky. Street-Level Bureaucracy, 30th Ann. Ed. Dilemmas of the Individual in Public Service. 2010. Russel Sage Foundation.
- Michael Lispky. 1980. Toward a Theory of Street-level Bureaucracy. New York: Russell Sage.
- Henrik Palmer Olsen, Jacob Livingston Slosser, Thomas Hildebrandt and Cornelius Wiesener. 2019. What's in the Box? The Legal Requirement of Explanability in Computationally Aided Decision-Making in Public Administration. iCourts - The Danish National Research Foundation's Centre of Excellence for International Courts
- Judith S. Olson and Wendy A. Kellogg. 2014. Ways of Knowing in HCI. Springer.
- W. Richard Schott and Gerald F. Davis. 2007. Organizations and Organizing -- Rational, Natural, and Open Systems Perspective. Person International Edition.
- Lucy Suchman, Jeanet Blomberg, Juliane E. Orr and Randall Trigg. 1999. Reconstructing Technologies in Social Practice. The American Behavioral Scientist; Nov/Dec 1999; 42, 3; ABI/INFORM Global pg. 392. Sage Publications.
- Max Weber. 2012. Makt og Byråkrati -- Essay om politikk og klasse, samfunnsforskning og verdier. Gyldendal Akademisk. 3rd edition (first published in 1971).
- 10.1093/ppmgov · doi:10.1093/ppmgov
Cited by
The Participatory Turn in AI Design: Theoretical Foundations and the Current State of Practice
Delgado, F., Yang, S., Madaio, M., & Yang, Q. (2023) · Equity and Access in Algorithms, Mechanisms, and Optimization · doi:10.1145/3617694.3623261 · Cited by 256
“[8] Asbjørn Ammitzbøll Flügge, Thomas Hildebrandt, and Naja Holten Møller.”
BackgroundKawakami, A., Sivaraman, V., Cheng, H.-F., Stapleton, L., Cheng, Y., Qing, D., Perer, A., Wu, Z. S., Zhu, H., & Holstein, K. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517439 · Cited by 143
“, [3, 26, 52]) regarding the need for a broader re-consideration of how ADS should be designed, evaluated, and integrated into public sector contexts.”
BackgroundSeven HCI Grand Challenges Revisited: Five-Year Progress
Stephanidis, C., Salvendy, G., Antona, M., Duffy, V. G., Gao, Q., Karwowski, W., Konomi, S., Nah, F. F., Ntoa, S., Rau, P. P., et al. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2450411 · Cited by 69
“…conditions is crucial, the failure of sufficient context-ualization can lead to users’ resorting to workarounds, unsatis-factory or unacceptable decision-making outcomes, and a reluctance to adopt new systems (Ammitzbøll Fl € ugge et al., 2021; N. L. Holten Møller et al., 2019; Liao et al., 2022).”
Isbanner, S., O’Shaughnessy, P., Steel, D., Wilcock, S., & Carter, S. (2022) · Journal of Medical Internet Research · doi:10.2196/37611 · Cited by 45
Saxena, D., & Guha, S. (2022) · ACM Journal on Responsible Computing · doi:10.1145/3616473 · Cited by 77
Metadata
- Authors
- Ammitzbøll Flügge, A., Hildebrandt, T., & Møller, N. H.
- Affiliations
- University of Copenhagen, Copenhagen, Denmark
- University of Copenhagen (DK)
- Venue
- Proceedings of the ACM on Human-Computer Interaction
- Published
- 2021-04-13
- Volume
- 5
- Issue
- CSCW1
- Pages
- 1-23
- ISSN
- 2573-0142 (ISSN-L)
- OpenAlex
- W3157264954
- Cited by
- 83
- References
- 45
- Citations by year
- 2026: 15 · 2025: 13 · 2024: 20 · 2023: 11 · 2022: 20 · 2021: 4
- FWCI
- 4.02
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Proceedings of the ACM on Human-Computer Interaction (publishedVersion)
- Funders
- EcoKnow (7050- 00034A)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Political Science and International Relations › E-Government and Public Services
- Social Sciences › Business, Management and Accounting › Management Information Systems › Information Systems Theories and Implementation
- Keywords
- street-level bureaucracy, algorithmic decision-making, artificial intelligence in public services, job placement, caseworkers, case documentation, AI decision support, automation, unemployed people, public services, computer-supported cooperative work
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.