A sociotechnical view of algorithmic fairness
Open accessThe DOI matches its Crossref record; 68 of the 68 references it cites were found in a registry or an index.
Abstract
Algorithmic fairness (AF) has been framed as a newly emerging technology that mitigates systemic discrimination in automated decision‐making, providing opportunities to improve fairness in information systems (IS). However, based on a state‐of‐the‐art literature review, we argue that fairness is an inherently social concept and that technologies for AF should therefore be approached through a sociotechnical lens. We advance the discourse on AF as a sociotechnical phenomenon. Our research objective is to embed AF in the sociotechnical view of IS. Specifically, we elaborate on why outcomes of a system that uses algorithmic means to assure fairness depend on mutual influences between technical and social structures. This perspective can generate new insights that integrate knowledge from both technical fields and social studies. Further, it spurs new directions for IS debates. We contribute as follows: First, we problematize fundamental assumptions in the current discourse on AF based on a systematic analysis of 310 articles. Second, we respond to these assumptions by theorizing AF as a sociotechnical construct. Third, we propose directions for IS researchers to enhance their impacts by pursuing a unique understanding of sociotechnical AF. We call for and undertake a holistic approach to AF. A sociotechnical perspective on AF can yield holistic solutions to systemic biases and discrimination.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Dissecting racial bias in an algorithm used to manage the health of populations
Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019) · Science · doi:10.1126/science.aax2342 · Cited by 7,137 · cited 1×
“A widely used algorithm for selecting healthcare system entry was found to discriminate against racial minorities, thereby affecting thousands of people (Obermeyer et al., 2019).”
MethodTowards an understanding of inequity
Adams, J. S. (1963) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0040968 · Cited by 5,146 · cited 1×
“Finally, psychology sees fairness as a perception of an individual comparing themselves to other individuals whom they consider to be relational partners (ie, as somehow similar to them) (Adams, 1963).”
BackgroundDwork, C., Hardt, M., Pitassi, T., Reingold, O., & Zemel, R. (2012) · Proceedings of the 3rd Innovations in Theoretical Computer Science Conference · doi:10.1145/2090236.2090255 · Cited by 3,501
Barocas, S., & Selbst, A. D. (2014) · doi:10.2139/ssrn.2477899 · Cited by 3,048
Equality of Opportunity in Supervised Learning
Hardt, M., Price, E., & Srebro, N. (2016) · arXiv · doi:10.48550/arxiv.1610.02413 · Cited by 2,536 · cited 1×
“Other group-level notions of fairness rely on prediction errors (Hardt & Price, 2016; Kleinberg, Mullainathan, & Raghavan, 2017; Zafar, Valera, Rodriguez, Gummadi, & Weller, 2017), whereby the confusion matrix from Figure 1 is considered.”
BackgroundMitchell, M. (2009) · doi:10.1093/oso/9780195124415.001.0001 · Cited by 2,310
Fair prediction with disparate impact: a study of bias in recidivism prediction instruments
Chouldechova, A. (2017) · Big Data · doi:10.1089/big.2016.0047 · Cited by 2,159 · cited 1×
“As can be seen in the different notions, there is no universal operationalization of fairness; further, it is mathematically impossible to fulfil all the different notions of fairness at once (Chouldechova, 2017; Kleinberg et al., 2017).”
BackgroundThe Ethics of AI Ethics -- An Evaluation of Guidelines
Hagendorff, T. (2019) · arXiv · doi:10.48550/arxiv.1903.03425 · Cited by 1,907
Where the Action Is: The Foundations of Embodied Interaction
Dourish, P. (2001) · The MIT Press eBooks · doi:10.7551/mitpress/7221.001.0001 · Cited by 1,866
Fairness and Abstraction in Sociotechnical Systems
Selbst, A. D., Boyd, D., Friedler, S. A., Venkatasubramanian, S., & Vertesi, J. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287598 · Cited by 1,631
Cited by
Feuerriegel, S., Hartmann, J., Janiesch, C., & Zschech, P. (2024) · Business & Information Systems Engineering · doi:10.1007/s12599-023-00834-7 · Cited by 2,267
“Addressing bias and thus fairness in AI receives increasing attention in the academic literature (DeArteaga et al., 2022; Dolata et al., 2022; Ferrara, 2023; Feuerriegel et al., 2020; Schramowski et al., 2022; von Zahn et al., 2022), but remains an open and ongoing research question.”
Self-citationDigital governance: A conceptual framework and research agenda
Hanisch, M., Goldsby, C. M., Fabian, N. E., & Oehmichen, J. (2023) · Journal of Business Research · doi:10.1016/j.jbusres.2023.113777 · Cited by 267
AI Knowledge: Improving AI Delegation through Human Enablement
Pinski, M., Adam, M., & Benlian, A. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580794 · Cited by 62
“In addition to human preference, researchers further agree that human-AI collaboration must match ethical standards [31].”
BackgroundMobilising new frontiers in digital transformation research: A problematization review
Ashrafi, A., Constantinides, P., Mehandjiev, N., & Thatcher, J. B. (2025) · Information Systems Journal · doi:10.1111/isj.12531 · Cited by 33
“Problematization reviews, on the other hand, center on the critical examination of the underlying theoretical and conceptual foundations in a specific domain of study (Dolata et al., 2022).”
A multi-perspective framework for research on (sustainable) autonomous systems
Beck, R., Dibbern, J., & Wiener, M. (2022) · Business & Information Systems Engineering · doi:10.1007/s12599-022-00752-0 · Cited by 23
“Here, critical ethical questions arise (Tang et al. 2020), including questions of fairness regarding the decision rules according to which AS act (Dolata et al. 2021); for instance, how a driverless car should react to unforeseen circumstances affecting humans (Kirkpatrick 2015).”
Background
Metadata
- Authors
- Dolata, M., Feuerriegel, S., & Schwabe, G.
- Venue
- Information Systems Journal
- Publisher
- Wiley
- Published
- 2021-10-07
- Volume
- 32
- Issue
- 4
- Pages
- 754-818
- ISSN
- 1350-1917 (ISSN-L)
- 1365-2575
- OpenAlex
- W3203106571
- Cited by
- 160
- References
- 68
- FWCI
- 25.64
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A sociotechnical view of algorithmic fairness. https://app.cochat.ai/papers/10.1111/isj.12370
- The paper
- Dolata, M., Feuerriegel, S., & Schwabe, G. (2022). A sociotechnical view of algorithmic fairness. Information Systems Journal. https://doi.org/10.1111/isj.12370
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.