Deliberating with AI: Improving Decision-Making for the Future through Participatory AI Design and Stakeholder Deliberation
The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Abstract
Research exploring how to support decision-making has often used machine learning to automate or assist human decisions. We take an alternative approach for improving decision-making, using machine learning to help stakeholders surface ways to improve and make fairer decision-making processes. We created "Deliberating with AI", a web tool that enables people to create and evaluate ML models in order to examine strengths and shortcomings of past decision-making and deliberate on how to improve future decisions. We apply this tool to a context of people selection, having stakeholders---decision makers (faculty) and decision subjects (students)---use the tool to improve graduate school admission decisions. Through our case study, we demonstrate how the stakeholders used the web tool to create ML models that they used as boundary objects to deliberate over organization decision-making practices. We share insights from our study to inform future research on stakeholder-centered participatory AI design and technology for organizational decision-making.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“First, this task is widely used in AI-assisted decision-making research [23, 34, 135, 138], with real-world universities employing AI algorithms for decision consistency and workload reduction [99, 129].”
From Towards Human-AI Deliberation: Design and Evaluation of LLM-Empowered Deliberative AI for AI-Assisted Decision-Making (2025) · cites this paper as [135]
In the citing paper
“Second, graduate admission often involves deliberation among committee members [135], making it ideal for studying the effects of our proposed Human-AI Deliberation .”
From Towards Human-AI Deliberation: Design and Evaluation of LLM-Empowered Deliberative AI for AI-Assisted Decision-Making (2025) · cites this paper as [135]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Survey on Bias and Fairness in Machine Learning
Mehrabi, N., Morstatter, F., Saxena, N., Lerman, K., & Galstyan, A. (2019) · arXiv · doi:10.48550/arxiv.1908.09635 · Cited by 5,812
A Survey on Bias and Fairness in Machine Learning
Mehrabi, N., Morstatter, F., Saxena, N., Lerman, K., & Galstyan, A. (2022) · ACM Computing Surveys · doi:10.1145/3457607 · Cited by 5,812
Bertrand, M., & Mullainathan, S. (2004) · American Economic Review · doi:10.1257/0002828042002561 · Cited by 4,504
Artificial intelligence and the future of work: Human-AI symbiosis in organizational decision making
Jarrahi, M. H. (2018) · Business Horizons · doi:10.1016/j.bushor.2018.03.007 · Cited by 2,772 · cited 2×
“These efforts include understanding how to design fair ML models [26, 54, 74, 100], algorithmic auditing to uncover harms [12, 84, 105], participatory and community-centered approaches for AI design [50, 62, 85, 91], and constructing complementary relationships between AI and humans at the time of decision-making [47,…”
BackgroundGebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., Daumé, H., & Crawford, K. (2018) · arXiv · doi:10.48550/arxiv.1803.09010 · Cited by 2,474
Gebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., III, H. D., & Crawford, K. (2021) · Communications of the ACM · doi:10.1145/3458723 · Cited by 2,469 · cited 1×
“…and practitioners when creating fair AI systems in order to inform techniques that can help them [44, 69] such as AI fairness checklists [70], provenance for datasets [37, 46], visualizations of model behaviors [103], and toolkits for detecting and mitigating against ML unfairness [8, 10, 89].”
BackgroundRaji, I. D., Smart, A., White, R. N., Mitchell, M., Gebru, T., Hutchinson, B., Smith-Loud, J., Theron, D., & Barnes, P. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372873 · Cited by 2,245
Bellamy, R. K. E., Dey, K., Hind, M., Hoffman, S. C., Houde, S., Kannan, K., Lohia, P., Martino, J., Mehta, S., Mojsilovic, A., et al. (2018) · arXiv · doi:10.48550/arxiv.1810.01943 · Cited by 1,581
Human Decisions and Machine Predictions
Kleinberg, J., Lakkaraju, H., Leskovec, J., Ludwig, J., & Mullainathan, S. (2018) · The Quarterly Journal of Economics · doi:10.1093/qje/qjx032 · Cited by 1,040
AI Fairness 360: An extensible toolkit for detecting and mitigating algorithmic bias
Bellamy, R. K. E., Dey, K., Hind, M., Hoffman, S. C., Houde, S., Kannan, K., Lohia, P., Martino, J., Mehta, S., Mojsilović, A., et al. (2019) · IBM Journal of Research and Development · doi:10.1147/jrd.2019.2942287 · Cited by 884 · cited 1×
“…and practitioners when creating fair AI systems in order to inform techniques that can help them [44, 69] such as AI fairness checklists [70], provenance for datasets [37, 46], visualizations of model behaviors [103], and toolkits for detecting and mitigating against ML unfairness [8, 10, 89].”
Background
Research works printed but not linked: 67
- 10.1109/ICCIDS.2019.8862140 · DOI · Paper page
- Julia Angwin, Jeff Larson, Surya Mattu, and Lauren Kirchner. 2016. Machine bias: There's software used across the country to predict future criminals. And it's biased against blacks. ProPublica, Vol. 23 (2016), 77--91.
- Cecilia Aragon, Shion Guha, Marina Kogan, Michael Muller, and Gina Neff. 2022. Human-Centered Data Science: An Introduction. MIT Press.
- 10.1093/qje/qjy012 · DOI · Paper page
- 10.1038/s41598-020-73246-2 · DOI
- 10.1080/00221546.2018.1442633 · DOI
- 10.1145/1978942.1979275 · DOI · Paper page
- Sarah Bird, Miro Dud'ik, Richard Edgar, Brandon Horn, Roman Lutz, Vanessa Milan, Mehrnoosh Sameki, Hanna Wallach, and Kathleen Walker. 2020. Fairlearn: A toolkit for assessing and improving fairness in AI. Microsoft, Tech. Rep. MSR-TR-2020--32 (2020).
- Joy Buolamwini and Timnit Gebru. 2018. Gender shades: Intersectional accuracy disparities in commercial gender classification. In Conference on fairness, accountability and transparency. PMLR, 77--91.
- Stephanie Burkhalter, John Gastil, and Todd Kelshaw. 2002. A conceptual definition and theoretical model of public deliberation in small face-to-face groups. Communication theory, Vol. 12, 4 (2002), 398--422.
- 10.1145/3411763.3443435 · DOI · Paper page
- 10.1016/j.ijhcs.2021.102607 · DOI
- 10.1145/3411764.3445308 · DOI · Paper page
- Bo Cowgill and Catherine Tucker. 2017. Algorithmic bias: A counterfactual perspective. NSF Trustworthy Algorithms (2017).
- Robyn M Dawes, David Faust, and Paul E Meehl. 1989. Clinical versus actuarial judgment. Science, Vol. 243, 4899 (1989), 1668--1674.
- Maria De-Arteaga, Alexandra Chouldechova, and Artur Dubrawski. 2022. Doubting AI Predictions: Influence-Driven Second Opinion Recommendation. arXiv preprint arXiv:2205.00072 (2022). · arXiv
- Fernando Delgado, Stephen Yang, Michael Madaio, and Qian Yang. 2021. Stakeholder Participation in AI: Beyond" Add Diverse Stakeholders and Stir". arXiv preprint arXiv:2111.01122 (2021). · arXiv
- 10.1075/idj.23.1.03dig · DOI · Paper page
- Catherine D'ignazio and Lauren F Klein. 2020. Data feminism. MIT press.
- 10.1609/hcomp.v4i1.13270 · DOI · Paper page
- Selen A Ercan, Carolyn M Hendriks, and John S Dryzek. 2019. Public deliberation in an era of communicative plenty. Policy & politics, Vol. 47, 1 (2019), 19--36.
- 10.1145/3313831.3376293 · DOI · Paper page
- 10.1145/358916.359001 · DOI · Paper page
- James S Fishkin. 2002. Deliberative democracy. The Blackwell guide to social and political philosophy (2002), 221--238.
- Archon Fung. 2007. Minipublics: Deliberative designs and their consequences. In Deliberation, participation and democracy. Springer, 159--183.
- Claudia Goldin and Cecilia Rouse. 2000. Orchestrating impartiality: The impact of" blind" auditions on female musicians. American economic review, Vol. 90, 4 (2000), 715--741.
- 10.1111/j.0032-3217.2003.00450.x · DOI · Paper page
- Nina Grgi?-Hlavc a, Muhammad Bilal Zafar, Krishna P Gummadi, and Adrian Weller. 2018. Beyond distributive fairness in algorithmic decision making: Feature selection for procedurally fair learning. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 32.
- William M Grove, David H Zald, Boyd S Lebow, Beth E Snitz, and Chad Nelson. 2000. Clinical versus mechanical prediction: a meta-analysis. Psychological assessment, Vol. 12, 1 (2000), 19.
- 10.1145/3359318 · DOI · Paper page
- 10.18608/jla.2019.62.3 · DOI · Paper page
- 10.1145/3290605.3300291 · DOI
- 10.1145/985921.986201 · DOI
- Julia D Kent and Maureen Terese McCarthy. 2016. Holistic review in graduate admissions. Council of Graduate Schools (2016).
- Margaret Kramer. 2019. A timeline of key Supreme Court cases on affirmative action. New York Times, Vol. 30 (2019).
- 10.1145/2145204.2145249 · DOI · Paper page
- 10.1145/2675133.2675147 · DOI · Paper page
- 10.1145/3359284 · DOI · Paper page
- 10.1145/2750858.2807552 · DOI · Paper page
- Min Kyung Lee, Daniel Kusbit, Anson Kahng, Ji Tae Kim, Xinran Yuan, Allissa Chan, Daniel See, Ritesh Noothigattu, Siheon Lee, Alexandros Psomas, et al. 2019b. WeBuildAI: Participatory framework for algorithmic governance. Proceedings of the ACM on Human-Computer Interaction, Vol. 3, CSCW (2019), 1--35.
- 10.1145/2030112.2030166 · DOI · Paper page
- Caitlin Lustig, Artie Konrad, and Jed R Brubaker. 2022. Designing for the Bittersweet: Improving Sensitive Experiences with Recommender Systems. In CHI Conference on Human Factors in Computing Systems. 1--18.
- David Madras, Toniann Pitassi, and Richard Zemel. 2017. Predict responsibly: improving fairness and accuracy by learning to defer. arXiv preprint arXiv:1711.06664 (2017). · arXiv
- Laura Matrajt, Julia Eaton, Tiffany Leung, and Elizabeth R Brown. 2021. Vaccine optimization for COVID-19: Who to vaccinate first? Science Advances, Vol. 7, 6 (2021), eabf1374.
- Ronald A Metoyer, Tya S Chuanromanee, Gina M Girgis, Qiyu Zhi, and Eleanor C Kinyon. 2020. Supporting Storytelling With Evidence in Holistic Review Processes: A Participatory Design Approach. Proceedings of the ACM on Human-Computer Interaction, Vol. 4, CSCW1 (2020), 1--24.
- 10.1145/3397481.3450658 · DOI · Paper page
- Amy Hawn Nelson, Della Jenkins, Sharon Zanti, Matthew F Katz, Emily Berkowitz, TC Burnett, and Dennis P Culhane. 2020. A toolkit for centering racial equity throughout data integration. Actionable Intelligence for Social Policy, University of Pennsylvania.
- Michael Quinn Patton. 1990. Qualitative evaluation and research methods. SAGE Publications, inc.
- Julie R Posselt. 2016. Inside graduate admissions: Merit, diversity, and faculty gatekeeping. Harvard University Press.
- 10.1145/3359178 · DOI · Paper page
- 10.1145/3274423 · DOI · Paper page
- Donald A Schön. 2017. The reflective practitioner: How professionals think in action. Routledge.
- 10.1145/3442188.3445971 · DOI · Paper page
- 10.1145/3415224 · DOI · Paper page
- 10.1145/3531146.3533110 · DOI · Paper page
- Susan Leigh Star. 1989. The structure of ill-structured solutions: Boundary objects and heterogeneous distributed problem solving. In Distributed artificial intelligence. Elsevier, 37--54.
- Poorna Talkad Sukumar and Ronald Metoyer. 2018. A visualization approach to addressing reviewer bias in holistic college admissions. In Cognitive Biases in Visualizations. Springer, 161--175.
- Poorna Talkad Sukumar, Ronald Metoyer, and Shuai He. 2018. Making a pecan pie: Understanding and supporting the holistic review process in admissions. Proceedings of the ACM on Human-Computer Interaction, Vol. 2, CSCW (2018), 1--22.
- Halil Toros and Daniel Flaming. 2018. Prioritizing homeless assistance using predictive algorithms: an evidence-based approach. Cityscape, Vol. 20, 1 (2018), 117--146.
- Grutter v Bollinger. 2014. 539 US 306 (2003). Legal Information Institute, Cornell University Law School. https://www. law. cornell. edu/supct/html/02--241. ZO. html (2014).
- 10.1145/3359130 · DOI · Paper page
- 10.25300/MISQ/2021/16559 · DOI · Paper page
- 10.1609/aimag.v35i1.2504 · DOI · Paper page
- James Wexler, Mahima Pushkarna, Tolga Bolukbasi, Martin Wattenberg, Fernanda Viégas, and Jimbo Wilson. 2019. The what-if tool: Interactive probing of machine learning models. IEEE transactions on visualization and computer graphics, Vol. 26, 1 (2019), 56--65.
- Sarah Williams, Erica Deahl, Laurie Rubel, and Vivian Lim. 2014. City Digits: Local Lotto: Developing youth data literacy by investigating the lottery. Journal of Digital Media Literacy (2014).
- Zining Ye, Xinran Yuan, Shaurya Gaur, Aaron Halfaker, Jodi Forlizzi, and Haiyi Zhu. 2021. Wikipedia ORES Explorer: Visualizing Trade-offs For Designing Applications With Machine Learning API. In Designing Interactive Systems Conference 2021. 1554--1565.
- 10.1145/3357236.3395528 · DOI · Paper page
Cited by
Yildirim, N., Richardson, H., Wetscherek, M. T., Bajwa, J., Jacob, J., Pinnock, M. A., Harris, S., Coelho De Castro, D., Bannur, S., Hyland, S., et al. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642013 · Cited by 82
Ma, S., Chen, Q., Wang, X., Zheng, C., Peng, Z., Yin, M., & Ma, X. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713423 · Cited by 48
Kawakami, A., Coston, A., Heidari, H., Holstein, K., & Zhu, H. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3686989 · Cited by 24
Stakeholder Involvement for Responsible AI Development: A Process Framework
Kallina, E., & Singh, J. (2024) · Proceedings of the 4th ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization · doi:10.1145/3689904.3694698 · Cited by 23
From Fitting Participation to Forging Relationships: The Art of Participatory ML
Cooper, N., & Zafiroglu, A. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642775 · Cited by 17
Isaifan, R. J., & Hasna, M. O. (2025) · Quality in Higher Education · doi:10.1080/13538322.2025.2576326 · Cited by 12
“It’s Just a Wild, Wild West”: Harnessing Public Procurement as an AI Governance Mechanism
Hudig, A. I., Kallina, E., & Singh, J. (2026) · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791968 · Cited by 3
Perceptions of the Fairness Impacts of Multiplicity in Machine Learning
Meyer, A. P., Kim, Y.-S., D'Antoni, L., & Albarghouthi, A. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713524 · Cited by 1
PEAs in PODs: Co-Production of Community Based Public Engagement for Data and AI Research
Crockett, K., Colyer, E., Coulman, L., Nunn, C., & Linn, S. (2024) · 2024 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10650039
Metadata
- Authors
- Zhang, A., Walker, O., Nguyen, K., Dai, J., Chen, A., & Lee, M. K.
- Affiliations
- The University of Texas at Austin, Austin, TX, USA
- Venue
- Proceedings of the ACM on Human-Computer Interaction
- Published
- 2023-04-14
- Volume
- 7
- Issue
- CSCW1
- Pages
- 1-32
- ISSN
- 2573-0142
- Cited by
- 72
- References
- 40
- Language
- en
- Funders
- NSF (1952085, 1939606, 2125858)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.