Data Agency Theory: A Precise Theory of Justice for AI Applications
The DOI matches its Crossref record; 51 of the 54 references it cites were found in a registry or an index, and 3 are not checked yet.
Abstract
Data collection methods for AI applications have been heavily scrutinized by researchers, policymakers, and the general public. In this paper, we propose data agency theory (DAT), a precise theory of justice to evaluate and improve current consent procedures used in AI applications. We argue that data agency is systematically defined by consent policies. Therefore, data agency is a matter of justice. DAT claims data agency ought to be afforded in a way that minimizes the oppression of data contributors by data collectors. We then apply DAT to two salient consent procedures in AI applications: Reddit’s Terms of Service agreement and the United States’s IRB protocols. Through these cases, we demonstrate how our theory helps evaluate justice and generate ideas for improvement. Finally, we discuss the implications of using justice as an evaluation metric, comparing consent procedures, and adopting DAT in future research.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Researchers also proposed data agency theory [4], a precise theory of justice to evaluate and improve current consent procedures used in AI applications.”
From Exploring Collaboration Patterns and Strategies in Human-AI Co-creation through the Lens of Agency: A Scoping Review of the Top-tier HCI Literature (2025) · cites this paper as [4]
Citations
Cites
Dilemmas in a general theory of planning
Rittel, H. W. J., & Webber, M. M. (1973) · Policy Sciences · doi:10.1007/bf01405730 · Cited by 16,338 · cited 1×
“Therefore, having well-defined, agreed-upon definitions is a necessary step in iterating on solutions and achieving progressive improvement [72].”
BackgroundA Survey on Bias and Fairness in Machine Learning
Mehrabi, N., Morstatter, F., Saxena, N., Lerman, K., & Galstyan, A. (2022) · ACM Computing Surveys · doi:10.1145/3457607 · Cited by 5,812 · cited 2×
“Justice has been invoked both as a property of a model–“algorithms should be just" [23, 40, 52]–and as a pre-existing value in systems where AI is utilized–such as the criminal justice system [80, 91].”
BackgroundI tweet honestly, I tweet passionately: Twitter users, context collapse, and the imagined audience
Marwick, A. E., & boyd, D. (2011) · New Media & Society · doi:10.1177/1461444810365313 · Cited by 4,612 · cited 2×
“People post content with an imagined audience of their peers or other users, not data collectors [51].”
BackgroundJustice as Fairness: A Restatement
Metz, T. (2002) · The Philosophical Review · doi:10.1215/00318108-111-4-618 · Cited by 3,570
Justice and the Politics of Difference
Young, I. M. (2020) · The New Social Theory Reader · doi:10.4324/9781003060963-43 · Cited by 2,770
The Intellectual Challenge of CSCW: The Gap Between Social Requirements and Technical Feasibility
Ackerman, M. S. (2000) · Human–Computer Interaction · doi:10.1207/s15327051hci1523_5 · Cited by 892 · cited 1×
“Previous work has noted that consent is a sociotechnical gap in online spaces [2, 38, 76].”
BackgroundWhat is data justice? The case for connecting digital rights and freedoms globally
Taylor, L. (2017) · Big Data & Society · doi:10.1177/2053951717736335 · Cited by 802 · cited 3×
“Prior work supports the position that data rights are individual rights [82].”
BackgroundRothman, E. F., Exner, D., & Baughman, A. L. (2011) · Trauma, Violence, & Abuse · doi:10.1177/1524838010390707 · Cited by 564
Studying Reddit: A Systematic Overview of Disciplines, Approaches, Methods, and Ethics
Proferes, N., Jones, N., Gilbert, S., Fiesler, C., & Zimmer, M. (2021) · Social Media + Society · doi:10.1177/20563051211019004 · Cited by 537 · cited 2×
“Our work builds off of consent design by suggesting a meta-theoretical framework to evaluate and compare prevalent consent procedures, such as heavily scrutinized Terms of Service agreements [26, 49, 64, 79].”
BackgroundMethod
Research works printed but not linked: 29
- Imanol Arrieta-Ibarra, Leonard Goff, Diego Jiménez-Hernández, Jaron Lanier, and E Glen Weyl. 2018. Should we treat data as labor? Moving beyond “free”. AEA Pap. Proc. 108 (May 2018), 38–42.
- Jenae Barnes. 2023. Twitter Ends Its Free API: Here’s Who Will Be Affected. Forbes Magazine (Feb. 2023).
- Olav W Bertelsen and Susanne Bødker. 2003. Activity theory. HCI models, theories, and frameworks: Toward a multidisciplinary science (2003), 291–324.
- Stevie Chancellor. 2023. Toward Practices for Human-Centered Machine Learning. Commun. ACM 66, 3 (Feb. 2023), 78–85.
- Stevie Chancellor, Eric P S Baumer, and Munmun De Choudhury. 2019. Who is the “human” in human-centered Machine Learning. Proc. ACM Hum. Comput. Interact. 3, CSCW (Nov. 2019), 1–32.
- Stevie Chancellor and Munmun De Choudhury. 2020. Methods in predictive techniques for mental health status on social media: a critical review. NPJ Digit Med 3 (March 2020), 43.
- H F Cheng, L Stapleton, A Kawakami, and others. 2022. How child welfare workers reduce racial disparities in algorithmic decisions. Proceedings of the (2022).
- Maddy Coy, Liz Kelly, Fiona Vera-Gray, Maria Garner, and Ava Kanyeredzi. 2016. From ‘no means no’ to ‘an enthusiastic yes’: Changing the Discourse on Sexual Consent Through Sex and Relationships Education. In Global Perspectives and Key Debates in Sex and Relationships Education: Addressing Issues of Gender, Sexuality, Plurality and Power. Palgrave Macmillan UK, London, 84–99.
- Bronwyn Davies. 1991. THE CONCEPT OF AGENCY: A Feminist Poststructuralist Analysis. Social Analysis: The International Journal of Social and Cultural Practice30 (1991), 42–53.
- Yrjö Engeström and Others. 1999. Activity theory and individual and social transformation. Perspectives on activity theory 19, 38 (1999), 19–30.
- Casey Fiesler and Nicholas Proferes. 2018. “Participant” Perceptions of Twitter Research Ethics. Social Media + Society 4, 1 (Jan. 2018), 2056305118763366.
- Robert Folger, Russell Cropanzano, and Barry Goldman. 2013. What is the relationship between justice and morality? In Handbook of organizational justice. Psychology Press, 215–245.
- Rana Foroohar. 2018. Year in a Word: Techlash. Financial Times (Dec. 2018).
- Jaclyn Friedman and Jessica Valenti. 2019. Yes Means Yes!: Visions of Female Sexual Power and a World without Rape. Basic Books.
- Gail E Henderson. 2011. Is informed consent broken?Am. J. Med. Sci. 342, 4 (Oct. 2011), 267–272.
- Xiaoyun Huang and Jessica Vitak. 2022. “Finsta gets all my bad pictures”: Instagram Users’ Self-Presentation Across Finsta and Rinsta Accounts. Proc. ACM Hum.-Comput. Interact. 6, CSCW1 (April 2022), 1–25.
- Matthew Le Bui and Safiya Umoja Noble. 2020. We’re Missing a Moral Framework of Justice in Artificial Intelligence: On the Limits, Failings, and Ethics of Fairness. (July 2020).
- Alexandra S Levine. 2022. Suicide Hotline Left Ethics Board Out Of The Loop About Data-Sharing With For-Profit Spinoff. Forbes Magazine (Feb. 2022).
- K Livingston. 2015. The queer art & rhetoric of consent: Theories practices pedagogies. https://www.semanticscholar.org › paper › The-queer-art-...https://www.semanticscholar.org › paper › The-queer-art-... (2015).
- Juniper L Lovato, Antoine Allard, Randall Harp, Jeremiah Onaolapo, and Laurent Hébert-Dufresne. 2022. Limits of Individual Consent and Models of Distributed Consent in Online Social Networks. In 2022 ACM Conference on Fairness, Accountability, and Transparency (Seoul, Republic of Korea) (FAccT ’22). Association for Computing Machinery, New York, NY, USA, 2251–2262.
- Rawls. 2004. A theory of justice. Ethics (2004).
- Arie Rip and Jan-Peter Voβ. 2019. Umbrella terms as mediators in the governance of emerging science and technology. Nanotechnology and Its Governance (2019), 10–33.
- Annalisa Sannino. 2015. The principle of double stimulation: A path to volitional action. Learning, Culture and Social Interaction 6 (Sept. 2015), 1–15.
- Bryan A Sisk, Jessica Mozersky, Alison L Antes, and James M DuBois. 2020. The “Ought-Is” Problem: An Implementation Science Framework for Translating Ethical Norms Into Practice. Am. J. Bioeth. 20, 4 (May 2020), 62–70.
- Linda J Skitka, Christopher W Bauman, and Elizabeth Mullen. 2008. Morality and justice: An expanded theoretical perspective and empirical review. In Justice. Vol. 25. Emerald Group Publishing Limited, 1–27.
- K Sun, A H Mhaidli, S Watel, C A Brooks, and others. 2019. It’s my data! Tensions among stakeholders of a learning analytics dashboard. Proceedings of the 2019 (2019).
- Harry Surden. 2019. Artificial Intelligence and Law: An Overview. (June 2019).
- United States. National Commission for the Protection of Human Subjects of Biomedical and Behavioral Research. 1979. The Belmont Report: Ethical Principles and Guidelines for the Protection of Human Subjects of Research. Department of Health, Education, and Welfare, National Commission for the Protection of Human Subjects of Biomedical and Behavioral Research.
- Hal R Varian. 1975. Distributive Justice, Welfare Economics, and the Theory of Fairness. Philos. Public Aff. 4, 3 (1975), 223–247.
Cited by
Zhang, S., Wang, H., & Yi, X. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757594 · Cited by 36
“Researchers also proposed data agency theory [4], a precise theory of justice to evaluate and improve current consent procedures used in AI applications.”
Whose Knowledge is Valued? Epistemic Injustice in CSCW Applications
Ajmani, L. H., Foriest, J. C., Taylor, J., Pittman, K., Gilbert, S., & DeVito, M. A. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3687062 · Cited by 30
“The negative space of justice (i.e., injustice) is the systemic dehumanization of members of society, particularly through an infringement on basic rights [4, 133].”
Self-citationMoving Towards Epistemic Autonomy: A Paradigm Shift for Centering Participant Knowledge
Ajmani, L., Bhatt, T., & DeVito, M. A. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714252 · Cited by 29
“The drive to quantify and the related drive to force all knowledge through the lens of positivism are both engines of the very epistemic injustice we must fight.”
Self-citationSecondary Stakeholders in AI: Fighting for, Brokering, and Navigating Agency
Ajmani, L., Abdelkadir, N. A., & Chancellor, S. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732071 · Cited by 18
Self-citationNavigating the Future of Data-Driven Systems: Children’s perspectives on data and agency
Babai, N., Durall, E., Iivari, N., & Kinnula, M. (2025) · ACM International Conference on Interaction Design and Children (IDC) · doi:10.1145/3713043.3728844 · Cited by 11
“We consider that the concept of data agency [5, 59, 115] offers promising avenues to explore children’s critical engagements with the data and algorithms under-pinning these technologies.”
Metadata
- Authors
- Ajmani, L., Stapleton, L., Houtti, M., & Chancellor, S.
- Affiliations
- University of Minnesota (US)
- Venue
- The 2024 ACM Conference on Fairness Accountability and Transparency
- Publisher
- ACM
- Published
- 2024-06-03
- Pages
- 631-641
- OpenAlex
- W4399365211
- Semantic Scholar
- dfee52a5bc996f7257f463285681b4be8bb81449
- Cited by
- 11
- References
- 49
- Citations by year
- 2026: 6 · 2025: 4 · 2024: 1
- FWCI
- 5.02
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM Conference on Fairness, Accountability, and Transparency (FAccT) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Law › Digitalization, Law, and Regulation
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Ethics in Clinical Research
- Keywords
- data agency, justice, artificial intelligence applications, data consent, data collection, data collectors, oppression, informed consent, evaluation metrics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Data Agency Theory: A Precise Theory of Justice for AI Applications. https://app.cochat.ai/papers/10.1145/3630106.3658930
- The paper
- Ajmani, L., Stapleton, L., Houtti, M., & Chancellor, S. (2024). Data Agency Theory: A Precise Theory of Justice for AI Applications. The 2024 ACM Conference on Fairness Accountability and Transparency. https://doi.org/10.1145/3630106.3658930
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.