The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
AI-Moderated Decision-Making: Capturing and Balancing Anchoring Bias in Sequential Decision Tasks
Abstract
Decision-making involves biases from past experiences, which are difficult to perceive and eliminate. We investigate a specific type of anchoring bias, in which decision-makers are anchored by their own recent decisions, e.g. a college admission officer sequentially reviewing students. We propose an algorithm that identifies existing anchored decisions, reduces sequential dependencies to previous decisions, and mitigates decision inaccuracies post-hoc with 2% increased agreement to ground-truth on a large-scale college admission decision data set. A crowd-sourced study validates this algorithm on product preferences (5% increased agreement). To avoid biased decisions ex-ante, we propose a procedure that presents instances in an order that reduces anchoring bias in real-time. Tested in another crowd-sourced study, it reduces bias and increases agreement to ground-truth by 7%. Our work reinforces individuals with similar characteristics to be treated similarly, independent of when they were reviewed in the decision-making process.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“First, this task is widely used in AI-assisted decision-making research [23, 34, 135, 138], with real-world universities employing AI algorithms for decision consistency and workload reduction [99, 129].”
From Towards Human-AI Deliberation: Design and Evaluation of LLM-Empowered Deliberative AI for AI-Assisted Decision-Making (2025) · cites this paper as [34]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Dwork, C., Hardt, M., Pitassi, T., Reingold, O., & Zemel, R. (2012) · Proceedings of the 3rd Innovations in Theoretical Computer Science Conference · doi:10.1145/2090236.2090255 · Cited by 3,501
Cai, C. J., Winter, S., Steiner, D., Wilcox, L., & Terry, M. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359206 · Cited by 594
Kaur, H., Nori, H., Jenkins, S., Caruana, R., Wallach, H., & Wortman Vaughan, J. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376219 · Cited by 564
Marketing AI recruitment: The next phase in job application and selection
van Esch, P., Black, J. S., & Ferolie, J. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2018.09.009 · Cited by 391
Human-Centered Explainable AI: Towards a Reflective Sociotechnical Approach
Ehsan, U., & Riedl, M. O. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-60117-1_33 · Cited by 274
Yang, Q., Zimmerman, J., Steinfeld, A., Carey, L., & Antaki, J. F. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858373 · Cited by 105
Levy, A., Agrawal, M., Satyanarayan, A., & Sontag, D. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445522 · Cited by 73 · cited 1×
“Those nudges are frequently used in decision-making [7, 16, 20, 33, 41, 43].”
BackgroundDesigning Information for Remediating Cognitive Biases in Decision-Making
Zhang, Y., Bellamy, R. K. E., & Kellogg, W. A. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702239 · Cited by 51
Evaluating the Interpretability of Generative Models by Interactive Reconstruction
Ross, A., Chen, N., Hang, E. Z., Glassman, E. L., & Doshi-Velez, F. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445296 · Cited by 40
Research works printed but not linked: 25
- Gediminas Adomavicius , Jesse Bockstedt , Shawn Curley , and Jingjing Zhang . 2011 . Recommender systems, consumer preferences, and anchoring effects . In RecSys 2011 Workshop on Human Decision Making in Recommender Systems. Citeseer, ACM , New York, NY, 35–42. Gediminas Adomavicius, Jesse Bockstedt, Shawn Curley, and Jingjing Zhang. 2011. Recommender systems, consumer preferences, and anchoring effects. In RecSys 2011 Workshop on Human Decision Making in Recommender Systems. Citeseer, ACM, New York, NY, 35–42.
- 10.1016/j.obhdp.2018.06.003 · DOI
- Richard A Block and David R Harper . 1991. Overconfidence in estimation: Testing the anchoring-and-adjustment hypothesis. Organizational behavior and human decision processes 49, 2 ( 1991 ), 188–207. Richard A Block and David R Harper. 1991. Overconfidence in estimation: Testing the anchoring-and-adjustment hypothesis. Organizational behavior and human decision processes 49, 2 (1991), 188–207.
- 10.1145/3290605.3300733 · DOI · Paper page
- 10.1145/2702123.2702139 · DOI
- Christopher G. Harris . 2020 . Mitigating Cognitive Biases in Machine Learning Algorithms for Decision Making. In Companion Proceedings of the Web Conference 2020. ACM, New York, NY, 775–781. Christopher G. Harris. 2020. Mitigating Cognitive Biases in Machine Learning Algorithms for Decision Making. In Companion Proceedings of the Web Conference 2020. ACM, New York, NY, 775–781.
- 10.1016/S0167-9236(00)00074-9 · DOI
- Jianrui Huang , Xianyou He , Xiaojin Ma , Yian Ren , Tingting Zhao , Xin Zeng , Han Li , and Yiheng Chen . 2018 . Sequential biases on subjective judgments: Evidence from face attractiveness and ringtone agreeableness judgment . Plos one 13 , 6 (2018), e0198723 . Jianrui Huang, Xianyou He, Xiaojin Ma, Yian Ren, Tingting Zhao, Xin Zeng, Han Li, and Yiheng Chen. 2018. Sequential biases on subjective judgments: Evidence from face attractiveness and ringtone agreeableness judgment. Plos one 13, 6 (2018), e0198723. · DOI
- 10.1214/aoms/1177699803 · DOI · Paper page
- 10.1037/0096-1523.3.1.92 · doi:10.1037/0096-1523.3.1.92 · Paper page
- 10.1080/10447318.2013.846790 · DOI
- Thomas C Leonard . 2008. Richard H. Thaler , Cass R. Sunstein , Nudge : Improving de cisions about health, wealth, and happiness. Thomas C Leonard. 2008. Richard H. Thaler, Cass R. Sunstein, Nudge: Improving decisions about health, wealth, and happiness.
- 10.1145/3313831.3376874 · DOI
- 10.1145/3411764.3445260 · DOI
- Volodymyr Mnih , Adria Puigdomenech Badia , Mehdi Mirza , Alex Graves , Timothy Lillicrap , Tim Harley , David Silver , and Koray Kavukcuoglu . 2016. Asynchronous methods for deep reinforcement learning ., 1928 –1937 pages. Volodymyr Mnih, Adria Puigdomenech Badia, Mehdi Mirza, Alex Graves, Timothy Lillicrap, Tim Harley, David Silver, and Koray Kavukcuoglu. 2016. Asynchronous methods for deep reinforcement learning., 1928–1937 pages.
- 10.1080/12460125.2019.1620573 · DOI
- Matteo Palmonari and Pasquale Minervini . 2020. Knowledge graph embeddings and explainable AI. Knowledge Graphs for Explainable Artificial Intelligence: Foundations, Applications and Challenges , IOS Press , Amsterdam 47, 1 ( 2020 ), 49–72. Matteo Palmonari and Pasquale Minervini. 2020. Knowledge graph embeddings and explainable AI. Knowledge Graphs for Explainable Artificial Intelligence: Foundations, Applications and Challenges, IOS Press, Amsterdam 47, 1 (2020), 49–72.
- 10.1145/2939672.2939778 · DOI · Paper page
- 10.1145/3313831.3376318 · DOI
- Linda J Skitka , Kathleen L Mosier , and Mark Burdick . 1999. Does automation bias decision-making?International Journal of Human-Computer Studies 51, 5 ( 1999 ), 991–1006. Linda J Skitka, Kathleen L Mosier, and Mark Burdick. 1999. Does automation bias decision-making?International Journal of Human-Computer Studies 51, 5 (1999), 991–1006.
- Tatsuji Takahashi , Masahiro Nakano , and Shuji Shinohara . 2010. Cognitive symmetry: Illogical but rational biases. Symmetry: culture and science 21, 1-3 ( 2010 ), 275–294. Tatsuji Takahashi, Masahiro Nakano, and Shuji Shinohara. 2010. Cognitive symmetry: Illogical but rational biases. Symmetry: culture and science 21, 1-3 (2010), 275–294.
- 10.1145/3274438 · DOI
- Amos Tversky and Daniel Kahneman . 1974. Judgment under uncertainty: Heuristics and biases. science 185, 4157 ( 1974 ), 1124–1131. Amos Tversky and Daniel Kahneman. 1974. Judgment under uncertainty: Heuristics and biases. science 185, 4157 (1974), 1124–1131.
- David W Vinson , Rick Dale , and Michael N Jones . 2019. Decision contamination in the wild: Sequential dependencies in online review ratings. Behavior research methods 51, 4 ( 2019 ), 1477–1484. David W Vinson, Rick Dale, and Michael N Jones. 2019. Decision contamination in the wild: Sequential dependencies in online review ratings. Behavior research methods 51, 4 (2019), 1477–1484.
- Rui Zhang , Nathan J McNeese , Guo Freeman , and Geoff Musick . 2021 . ” An Ideal Human” Expectations of AI Teammates in Human-AI Teaming . Proceedings of the ACM on Human-Computer Interaction 4, CSCW3(2021) , 1–25. Rui Zhang, Nathan J McNeese, Guo Freeman, and Geoff Musick. 2021. ” An Ideal Human” Expectations of AI Teammates in Human-AI Teaming. Proceedings of the ACM on Human-Computer Interaction 4, CSCW3(2021), 1–25.
Cited by
The impact of AI errors in a human-in-the-loop process
Agudo, U., Liberal, K. G., Arrese, M., & Matute, H. (2024) · Cognitive Research: Principles and Implications · doi:10.1186/s41235-023-00529-3 · Cited by 66
Ma, S., Chen, Q., Wang, X., Zheng, C., Peng, Z., Yin, M., & Ma, X. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713423 · Cited by 48
Bach, A. K. P., Nørgaard, T. M., Brok, J. C., & van Berkel, N. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581513 · Cited by 47
Salimzadeh, S., He, G., & Gadiraju, U. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3641905 · Cited by 41
“Such factors can be broadly classified into three primary categories: human-related factors [35, 95, 96], attributes of the AI systems [94, 98], and characteristics of the decision-making tasks [16, 56, 126].”
Backgroundde Jong, S., Paananen, V., Tag, B., & van Berkel, N. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3710946 · Cited by 32
Metadata
- Authors
- Echterhoff, J. M., Yarmand, M., & McAuley, J.
- Affiliations
- University of California San Diego, United States
- Computer Science and Engineering, University of California San Diego, United States
- Venue
- CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2022-04-27
- Pages
- 1-9
- Cited by
- 30
- References
- 9
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: AI-Moderated Decision-Making: Capturing and Balancing Anchoring Bias in Sequential Decision Tasks. https://app.cochat.ai/papers/10.1145/3491102.3517443
- The paper
- Echterhoff, J. M., Yarmand, M., & McAuley, J. (2022). AI-Moderated Decision-Making: Capturing and Balancing Anchoring Bias in Sequential Decision Tasks. CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3491102.3517443
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.