Algorithmic transparency and bureaucratic discretion: The case of SALER early warning system
Open accessThe DOI matches its Crossref record; 42 of the 43 references it cites were found in a registry or an index.
Abstract
The governance of public sector organizations has been challenged by the growing adoption and use of Artificial Intelligence (AI) systems and algorithms. Algorithmic transparency, conceptualized here using the dimensions of accessibility and explainability, fosters the appraisal of algorithms’ footprint in decisions of public agencies, and should include impacts on civil servants’ work. However, although discretion will not disappear, AI innovations might have a negative impact on how public employees support their decisions. This article is intended to answer the following research questions: RQ1. To what extent algorithms affect discretionary power of civil servants to make decisions?RQ2. How algorithmic transparency can impact discretionary power of civil servants? To do so, we analyze SALER, a case based on a set of algorithms focused on the prevention of irregularities in the Valencian regional administration (GVA), Spain, using a qualitative methodology supported on semi-structured interviews and documentary analysis. Among the results of the study, our empirical work suggests the existence of a series of factors that might be linked to the positive impacts of algorithms on the work and discretionary power of civil servants. Also, we identify different pathways for achieving algorithmic transparency, such as the involvement of civil servants in active development, or auditing processes being recognized by law, among others.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Public managers must decide on the acceptable error rates against the risk of marginalisation of vulnerable communities”
From AI adoption and diffusion in public administration: A systematic literature review and future research agenda (2023) · cites this paper as Criado, Valero, & Villodre, 2020
Citations
Cites
How Many Interviews Are Enough?: An Experiment with Data Saturation and Variability
Guest, G., Bunce, A., & Johnson, L. (2006) · Field Methods · doi:10.1177/1525822x05279903 · Cited by 20,808
Building Theories from Case Study Research
Eisenhardt, K. M. (1989) · The Academy of Management Review · doi:10.2307/258557 · Cited by 17,455
How the machine “thinks”: Understanding opacity in machine learning algorithms
Burrell, J. (2016) · Big Data & Society · doi:10.1177/2053951715622512 · Cited by 3,196 · cited 1×
“Burrell (2016) insists on the complexity of AI systems (i.e. machine learning) making it difficult to decode the learning capabilities of algorithms or to explain “ how an algorithm rendered a certain outcome in an individual case ” (Grimmelikhuijsen, 2019: 8).”
Bounded rationality and organizational learning
Simon, H. A. (1991) · Organization Science · doi:10.1287/orsc.2.1.125 · Cited by 3,028
Bounded Rationality and Organizational Learning
Simon, H. A. (1999) · Reflections: The SoL Journal · doi:10.1162/152417399570142 · Cited by 2,021
The algorithmic imaginary: exploring the ordinary affects of Facebook algorithms
Bucher, T. (2017) · Information, Communication & Society · doi:10.1080/1369118x.2016.1154086 · Cited by 1,327
What can machine learning do? Workforce implications
Brynjolfsson, E., & Mitchell, T. (2017) · Science · doi:10.1126/science.aap8062 · Cited by 1,131
Bovens, M., & Zouridis, S. (2002) · Public Administration Review · doi:10.1111/0033-3352.00168 · Cited by 964
Sun, T. Q., & Medaglia, R. (2019) · Government Information Quarterly · doi:10.1016/j.giq.2018.09.008 · Cited by 948
Working and organizing in the age of the learning algorithm
Faraj, S., Pachidi, S., & Sayegh, K. (2018) · Information and Organization · doi:10.1016/j.infoandorg.2018.02.005 · Cited by 929 · cited 2×
“…decisions as SALER system become more widespread and its functions more comprehensive, influencing the knowledge acquisition process and approach of public managers (Faraj et al., 2018), and even changing the nature of their relationship with work tools and organizational tasks (Vogl et al., 2020).”
Ethical Implications and Accountability of Algorithms
Martin, K. (2019) · Journal of Business Ethics · doi:10.1007/s10551-018-3921-3 · Cited by 757
Governing artificial intelligence: ethical, legal and technical opportunities and challenges
Cath, C. (2018) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2018.0080 · Cited by 745
Lepri, B., Oliver, N., Letouzé, E., Pentland, A., & Vinck, P. (2018) · Philosophy & Technology · doi:10.1007/s13347-017-0279-x · Cited by 709 · cited 1×
“Making the information available and observable by external users is essential to assure the accessibility of government processes (Lepri et al., 2018).”
Grimmelikhuijsen, S. G., & Meijer, A. J. (2014) · Journal of Public Administration Research and Theory · doi:10.1093/jopart/mus048 · Cited by 678 · cited 1×
“Here, Grimmelikhuijsen (2019) or Grimmelikhuijsen and Meijer (2014) argue that, in the first case (accessibility), transparency is accomplished by the availability of information in different dimensions of the policy process or managerial functions of public agencies.”
Policy Implementation, Street-level Bureaucracy, and the Importance of Discretion
Tummers, L., & Bekkers, V. (2014) · Public Management Review · doi:10.1080/14719037.2013.841978 · Cited by 535
Algorithmic Transparency in the News Media
Diakopoulos, N., & Koliska, M. (2017) · Digital Journalism · doi:10.1080/21670811.2016.1208053 · Cited by 515 · cited 1×
“…be stated clear, visible and comprehensible in order to prevent information manipulation, power-asymmetry and discrimination (Lepri et al., 2017; Diakopoulos & Koliska, 2016) Using two dimensions of algorithmic transparency (Grimmelikhuijsen, 2019): a) accessibility , that is, the source code…”
What Happens When Evaluation Goes Online? Exploring Apparatuses of Valuation in the Travel Sector
Orlikowski, W. J., & Scott, S. V. (2014) · Organization Science · doi:10.1287/orsc.2013.0877 · Cited by 439
Predictive policing: Review of benefits and drawbacks
Meijer, A., & Wessels, M. (2019) · International Journal of Public Administration · doi:10.1080/01900692.2019.1575664 · Cited by 383
Street-Level Bureaucracy and the Analysis of Urban Reform
Lipsky, M. (1971) · Urban Affairs Quarterly · doi:10.1177/107808747100600401 · Cited by 378
Algorithmic governance: Developing a research agenda through the power of collective intelligence
Danaher, J., Hogan, M. J., Noone, C., Kennedy, R., Behan, A., De Paor, A., Felzmann, H., Haklay, M., Khoo, S.-M., Morison, J., et al. (2017) · Big Data & Society · doi:10.1177/2053951717726554 · Cited by 369
The challenges and limits of big data algorithms in technocratic governance
Janssen, M., & Kuk, G. (2016) · Government Information Quarterly · doi:10.1016/j.giq.2016.08.011 · Cited by 363
Algorithms, Governance, and Governmentality: On Governing Academic Writing
Introna, L. D. (2016) · Science, Technology, & Human Values · doi:10.1177/0162243915587360 · Cited by 339 · cited 2×
“In the case of the Spanish legislation, there is no specific legal obligation in this regard despite the fact that the regulatory framework is certainly recent (2015).”
Criado, J. I., & Gil-Garcia, J. R. (2019) · International Journal of Public Sector Management · doi:10.1108/ijpsm-07-2019-0178 · Cited by 339
Self-citationApplying Information Technology to Organization Design
Simon, H. A. (1973) · Public Administration Review · doi:10.2307/974804 · Cited by 337
Big data and AI - A transformational shift for government: So, what next for research?
Pencheva, I., Esteve, M., & Mikhaylov, S. J. (2020) · Public Policy and Administration · doi:10.1177/0952076718780537 · Cited by 272 · cited 1×
“Besides, it is likely that these service areas may be improved by AI and algorithms regarding the different stages of the policy-cycle process (Pencheva et al., 2020; Valle-Cruz et al., 2020).”
Young, M. M., Bullock, J. B., & Lecy, J. D. (2019) · Perspectives on Public Management and Governance · doi:10.1093/ppmgov/gvz014 · Cited by 255
Valle-Cruz, D., Criado, J. I., Sandoval-Almazán, R., & Ruvalcaba-Gomez, E. A. (2020) · Government Information Quarterly · doi:10.1016/j.giq.2020.101509 · Cited by 241
Self-citationMargetts, H., & Dorobantu, C. (2019) · Nature · doi:10.1038/d41586-019-01099-5 · Cited by 238
Understanding the promises and premises of online health platforms
Van Dijck, J., & Poell, T. (2016) · Big Data & Society · doi:10.1177/2053951716654173 · Cited by 227
Public administration challenges in the world of AI and bots
Agarwal, P. K. (2018) · Public Administration Review · doi:10.1111/puar.12979 · Cited by 208
E-participation: A Strategic Framework
Wirtz, B. W., Daiser, P., & Binkowska, B. (2016) · International Journal of Public Administration · doi:10.1080/01900692.2016.1242620 · Cited by 178
van der Voort, H. G., Klievink, A. J., Arnaboldi, M., & Meijer, A. J. (2019) · Government Information Quarterly · doi:10.1016/j.giq.2018.10.011 · Cited by 142
Automated Decision Making Comes of Age
Davenport, T. H., & Harris, J. G. (2005) · MIT Sloan Management Review · Cited by 121
Artificial Intelligence and Administrative Discretion: Implications for Public Administration
Barth, T. J., & Arnold, E. (1999) · The American Review of Public Administration · doi:10.1177/02750749922064463 · Cited by 100
Geiger, R. S. (2017) · Big Data & Society · doi:10.1177/2053951717730735 · Cited by 88
Torrijos, J. V. (2019) · Revista Catalana de Dret Públic · doi:10.2436/rcdp.i58.2019.3307 · Cited by 71
Opening the government’s black boxes: freedom of information and algorithmic accountability
Fink, K. (2018) · Information, Communication & Society · doi:10.1080/1369118x.2017.1330418 · Cited by 61
Mayors and Corruption in Spain: Same Rules, Different Outcomes
Parrado, S., Dahlström, C., & Lapuente, V. (2018) · South European Society & Politics · doi:10.1080/13608746.2018.1528692 · Cited by 16
Public Managers' Perceptions about Open Government
Ruvalcaba-Gómez, E. A., Criado, J. I., & Gil-García, J. R. (2017) · Conference on Digital Government Research · doi:10.1145/3085228.3085248 · Cited by 15
Self-citationCox, R. W. (1990) · International Journal of Public Administration · doi:10.1080/01900699008524663 · Cited by 7
Inteligencia artificial desde el diseño. Retos y estrategias para el cumplimiento normativo
Martínez, R. M. (2019) · DOAJ (DOAJ: Directory of Open Access Journals) · doi:10.2436/rcdp.i58.2019.3317 · Cited by 4
Dossier sobre l'Administració a l'era digital
Rico, C. I. V. (2019) · RECERCAT (Consorci de Serveis Universitaris de Catalunya) · doi:10.2436/rcdp.i58.2019.3328 · Cited by 3
Research works printed but not linked: 3
- Capdeferro, 2020, La inteligencia artificial del sector público: desarrollo y regulación de la actuación administrativa inteligente en la cuarta revolución industrial, IDP, Revista de Internet, Derecho y Política, 30, 1
- Cerrillo, 2019, How to open the black box of public administration? Transparency and accountability in the use of algorithms, Revista Catalana de Dret Públic, 58, 13
- Villoria, M., Jiménez, F., & Revuelta, A. (2014) ‘Corruption Perception and Collective Action’. In Mendilow, J., & Peleg, I. (2014). Corruption in the Contemporary World. London: Lexington Books, pp. 197-222.
Cited by
Madan, R., & Ashok, M. (2023) · Government Information Quarterly · doi:10.1016/j.giq.2022.101774 · Cited by 468
“…environment • Correlational knowledge versus contextual human knowledge (Ahn & Chen, 2020; Andrews, 2018; Casares, 2018; Coglianese & Lehr, 2017; Criado et al., 2020; Fatima et al., 2021; Harrison & Luna-Reyes, 2022; Henman, 2019; H ¨ ochtl et al., 2016; Janssen, Brous, et al., 2020;…”
Exploring artificial intelligence adoption in public organizations: a comparative case study
Neumann, O., Guirguis, K., & Steiner, R. (2024) · Public Management Review · doi:10.1080/14719037.2022.2048685 · Cited by 451
“As such, our study heeds the calls for ‘research focusing on the wide variety of aspects involved in the phenomenon of AI adoption in the public sector’ (Sun and Medaglia 2019, 379) and for a ‘distinctive approach to AI in the public sector’ (Criado et al. 2020).”
BackgroundEnhancing public service delivery efficiency: Exploring the impact of AI
Kulal, A., Rahiman, H. U., Suvarna, H., Abhishek, N., & Dinesh, S. (2024) · Journal of Open Innovation Technology Market and Complexity · doi:10.1016/j.joitmc.2024.100329 · Cited by 205
van Noordt, C., & Tangi, L. (2023) · Government Information Quarterly · doi:10.1016/j.giq.2023.101860 · Cited by 219
Adoption of artificial intelligence: a TOP framework-based checklist for digital leaders
Tursunbayeva, A., & Chalutz-Ben Gal, H. (2024) · Business Horizons · doi:10.1016/j.bushor.2024.04.006 · Cited by 102
Metadata
- Authors
- Criado, J. I., Valero, J., & Villodre, J.
- Affiliations
- Universidad Autónoma de Madrid (ES)
- Universidad de Murcia (ES)
- Corresponding author
- Criado, J. Ignacio
- Venue
- Information Polity
- Publisher
- SAGE Publications
- Published
- 2020-12-04
- Volume
- 25
- Issue
- 4
- Pages
- 449-470
- ISSN
- 1570-1255 (ISSN-L)
- 1875-8754
- OpenAlex
- W3110851951
- Cited by
- 47
- References
- 43
- Citations by year
- 2026: 7 · 2025: 3 · 2024: 12 · 2023: 11 · 2022: 10 · 2021: 4
- FWCI
- 8.52
- Type
- journal article
- Language
- en
- Open access
- green
- hdl.handle.net
- Licence
- cc-by-nc-nd
- Locations
- Information Polity (publishedVersion)
- Hispana (submittedVersion, cc-by-nc-nd)
- Biblos-e Archivo (Universidad Autónoma de Madrid) (submittedVersion, public-domain)
- RIO (Universidad Pablo de Olavide) (submittedVersion, cc-by-nc-nd)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Political Science and International Relations › E-Government and Public Services
- Social Sciences › Law › Administrative Law and Governance
- Keywords
- algorithmic transparency, administrative discretion, Salers, early warning systems, artificial intelligence in public administration, public sector employees, algorithmic governance, explainability, algorithmic auditing, public sector decision-making
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.