Addressing discrimination in algorithmic profiling: Examining risk governance in Dutch public social security agencies
Open accessThe DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Abstract
In the social security sector, both in the Netherlands and abroad, the irresponsible use of algorithmic profiling technologies to combat misallocation of social security benefits has contributed to instances of discrimination. While a developing legal framework—made up of fundamental rights, the GDPR, and the recently adopted AI Act—requires risks of discrimination to be identified and mitigated, it offers limited guidance on how to implement these obligations. Social security agencies seeking to address the systemic risk of discrimination in algorithmic profiling are frustrated by the associated sociotechnical complexity, scientific uncertainty, and socio-legal ambiguity. This study examines how two Dutch social security agencies address discrimination risks in algorithmic profiling, using van Asselt and Renn's principles of systemic risk governance—communication and inclusion, integration, and reflection—as a theoretical framework. Through case studies involving document analysis and interviews, the research explores how these agencies address discrimination risks. This study highlights the importance of socially robust risk governance structures that encompass both simpler rule-based selection systems and trained algorithmic systems, that include scientific and client perspectives, and draw on the experiences of other agencies.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
A Survey on Bias and Fairness in Machine Learning
Mehrabi, N., Morstatter, F., Saxena, N., Lerman, K., & Galstyan, A. (2022) · ACM Computing Surveys · doi:10.1145/3457607 · Cited by 5,812 · cited 1×
“…predictive criteria, biases in the manual review of selected cases, insuf fi cient monitoring and evaluation mechanisms, and opacity toward external parties including citizens (Amnesty International, 2021; Constantaras et al. 2023; DDPA, 2024; Haitsma, 2023; Mehrabi et al., 2021; SyRI , 2020).”
Klinke, A., & Renn, O. (2002) · Risk Analysis · doi:10.1111/1539-6924.00274 · Cited by 668
The European Union Agency for Fundamental Rights
Dimitrakopoulos, I. N. (2015) · Research and policy in ethnic relations · doi:10.1332/policypress/9781447314899.003.0006 · Cited by 544
Coping with Complexity, Uncertainty and Ambiguity in Risk Governance: A Synthesis
Renn, O., Klinke, A., & van Asselt, M. (2011) · AMBIO · doi:10.1007/s13280-010-0134-0 · Cited by 508 · cited 4×
“These principles aim to promote social learning and co-production of knowledge among parties, thereby fostering legit-imacy and trust, and socially robust risk governance solutions based on collective input (Renn, 2015: 14; Renn and Klinke, 2016: 254; Renn et al., 2011: 246).”
Influentialvan Asselt, M. B. A., & Renn, O. (2011) · Journal of Risk Research · doi:10.1080/13669877.2011.553730 · Cited by 420
Why fairness cannot be automated: Bridging the gap between EU non-discrimination law and AI
Wachter, S., Mittelstadt, B., & Russell, C. (2021) · Computer Law & Security Review · doi:10.1016/j.clsr.2021.105567 · Cited by 336
Emerging models of data governance in the age of datafication
Micheli, M., Ponti, M., Craglia, M., & Berti Suman, A. (2020) · Big Data & Society · doi:10.1177/2053951720948087 · Cited by 332 · cited 1×
“…and climate risk, urban planning, supply chain risk, disaster management, public health, and, more recently, data governance (Ahlqvist et al., 2020; Taebi et al., 2020; Di Guilio, 2023; Hanssen et al., 2018; McHugh et al., 2021; Micheli et al., 2020; Renn, 2015; Renn and Klinke, 2016).”
Strengthening legal protection against discrimination by algorithms and artificial intelligence
Zuiderveen Borgesius, F. J. (2020) · The International Journal of Human Rights · doi:10.1080/13642987.2020.1743976 · Cited by 267
Adaptive and integrative governance on risk and uncertainty
Klinke, A., & Renn, O. (2012) · Journal of Risk Research · doi:10.1080/13669877.2011.636838 · Cited by 217 · cited 2×
“Uncertainty refers to when there is limited scienti fi c knowledge on how to assess and manage risks and potential negative outcomes (Klinke and Renn, 2012: 276).”
The lifecycle of algorithmic decision-making systems: Organizational choices and ethical challenges
Marabelli, M., Newell, S., & Handunge, V. R. (2021) · The Journal of Strategic Information Systems · doi:10.1016/j.jsis.2021.101683 · Cited by 170 · cited 2×
“However, interdisciplinary research into the causality of these discriminatory outcomes is still in its infancy (Algorithm Audit, 2024a; Dankloff et al., 2024; Haitsma 2023; Marabelli et al., 2021).”
Research works printed but not linked: 7
- Al Khatib OA Lokin MHAF Meeuwse ACM et al. (2024) De A is van algoritme: hoe de Awb op dit vlak te versterken. Nederlands Tijdschrift voor Bestuursrecht 2024/426.
- Constantaras E, Geiger G, Braun JC, et al. (2023) Inside the suspicion machine. WIRED, 6 March 2023.
- Haitsma L, Tollenaar A (2024) Regie op de toepassing van algoritmes in het sociaal domein. In: Munneke SAJ, Tolsma HD, Winter HB (eds) Regie, regie, regie: Over maatschappelijke problemen en de terugkeer van de sturende overheid. The Hague: Boom Juridisch, pp. 99–115.
- Human Rights College (2025) Toetsingskader risicoprofilering. Human Rights College.
- Pelgrim C (2025) Staatscommissie noemt discriminatie door overheid ‘structureel’ en hekelt uitspraken kabinet. NRC, 20 January 2025.
- Rensen F (2024) ‘Bij zo’n beetje elke tegel die we lichten, ontdekken we discriminerende algoritmen bij de overheid’, zegt de Autoriteit Persoonsgegevens. De Volkskrant, 2 July 2024.
- Tilburg University (2021) non-discrimination by design. Tilburg University.
Cited by
Coercive risk and the lottery default
Veluwenkamp, H. (2026) · Synthese · doi:10.1007/s11229-026-05622-w
“Using targeted selection can obstruct the kind of learning that would be needed to justify its continued use (see also Haitsma, 2025).”
Ruiz-Jaimes, M. Á., Toledo, Y., Ruiz-Martínez, V. J., Santana, E. C. V., Morales, T. H. V., Valle, J. E. M., Castillo, A. I. D., & Martínez-Ocampo, J. J. (2026) · IGI Global eBooks · doi:10.4018/979-8-3373-8592-1.ch008
Welfare Systems, Data, and Analysis: Digital Transformation and Social Challenge
Lokeshwari, D. V. (2026) · IGI Global eBooks · doi:10.4018/979-8-3373-8423-8.ch001
Schepers, T. G. J., Bex, F., Kempeneer, S., & Meijer, A. J. (2026) · Data & Policy · doi:10.1017/dap.2026.10095
“This can mean focusing on more human oversight or algorithmic systems with a human-in-the-loop, or on increased explainability that enables users to understand algorithmic decisions (Arrieta et al., 2020; Benedikt et al., 2020; Meijer et al., 2021; Haitsma, 2025).”
Metadata
- Authors
- Haitsma, L. M.
- Affiliations
- University of Groningen (NL)
- Corresponding author
- Haitsma, Lucas M
- ORCID
- Haitsma, Lucas M
- Venue
- European Journal of Social Security
- Publisher
- SAGE Publications
- Published
- 2025-06
- Volume
- 27
- Issue
- 2
- Pages
- 191-212
- ISSN
- 1388-2627 (ISSN-L)
- 2399-2948
- OpenAlex
- W4411667015
- Cited by
- 4
- References
- 46
- Citations by year
- 2026: 4
- FWCI
- 4.18
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0/ (unspecified)
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- European Journal of Social Security (publishedVersion, cc-by)
- University of Groningen research database (University of Groningen / Centre for Information Technology) (submittedVersion, cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Law › Digitalization, Law, and Regulation
- Social Sciences › Business, Management and Accounting › Industrial relations › Legal and Labor Studies
- Keywords
- algorithmic profiling, discrimination, risk governance, social security agency, social security benefits, systemic risk, EU AI Act, GDPR, fundamental rights
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Addressing discrimination in algorithmic profiling: Examining risk governance in Dutch public social security agencies. https://app.cochat.ai/papers/10.1177/13882627251351093
- The paper
- Haitsma, L. M. (2025). Addressing discrimination in algorithmic profiling: Examining risk governance in Dutch public social security agencies. European Journal of Social Security. https://doi.org/10.1177/13882627251351093
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.