Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 30

The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.

AI-Moderated Decision-Making: Capturing and Balancing Anchoring Bias in Sequential Decision Tasks

Echterhoff, Jessica Maria, Yarmand, Matin, McAuley, Julian · 2022 · CHI Conference on Human Factors in Computing Systems

Abstract

Decision-making involves biases from past experiences, which are difficult to perceive and eliminate. We investigate a specific type of anchoring bias, in which decision-makers are anchored by their own recent decisions, e.g. a college admission officer sequentially reviewing students. We propose an algorithm that identifies existing anchored decisions, reduces sequential dependencies to previous decisions, and mitigates decision inaccuracies post-hoc with 2% increased agreement to ground-truth on a large-scale college admission decision data set. A crowd-sourced study validates this algorithm on product preferences (5% increased agreement). To avoid biased decisions ex-ante, we propose a procedure that presents instances in an order that reduces anchoring bias in real-time. Tested in another crowd-sourced study, it reduces bias and increases agreement to ground-truth by 7%. Our work reinforces individuals with similar characteristics to be treated similarly, independent of when they were reviewed in the decision-making process.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3491102.3517443

Cites

9 of 9 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 9 references

Research works printed but not linked: 25

  1. Gediminas Adomavicius , Jesse Bockstedt , Shawn Curley , and Jingjing Zhang . 2011 . Recommender systems, consumer preferences, and anchoring effects . In RecSys 2011 Workshop on Human Decision Making in Recommender Systems. Citeseer, ACM , New York, NY, 35–42. Gediminas Adomavicius, Jesse Bockstedt, Shawn Curley, and Jingjing Zhang. 2011. Recommender systems, consumer preferences, and anchoring effects. In RecSys 2011 Workshop on Human Decision Making in Recommender Systems. Citeseer, ACM, New York, NY, 35–42.
  2. 10.1016/j.obhdp.2018.06.003 · DOI
  3. Richard A Block and David R Harper . 1991. Overconfidence in estimation: Testing the anchoring-and-adjustment hypothesis. Organizational behavior and human decision processes 49, 2 ( 1991 ), 188–207. Richard A Block and David R Harper. 1991. Overconfidence in estimation: Testing the anchoring-and-adjustment hypothesis. Organizational behavior and human decision processes 49, 2 (1991), 188–207.
  4. 10.1145/3290605.3300733 · DOI · Paper page
  5. 10.1145/2702123.2702139 · DOI
  6. Christopher G. Harris . 2020 . Mitigating Cognitive Biases in Machine Learning Algorithms for Decision Making. In Companion Proceedings of the Web Conference 2020. ACM, New York, NY, 775–781. Christopher G. Harris. 2020. Mitigating Cognitive Biases in Machine Learning Algorithms for Decision Making. In Companion Proceedings of the Web Conference 2020. ACM, New York, NY, 775–781.
  7. 10.1016/S0167-9236(00)00074-9 · DOI
  8. Jianrui Huang , Xianyou He , Xiaojin Ma , Yian Ren , Tingting Zhao , Xin Zeng , Han Li , and Yiheng Chen . 2018 . Sequential biases on subjective judgments: Evidence from face attractiveness and ringtone agreeableness judgment . Plos one 13 , 6 (2018), e0198723 . Jianrui Huang, Xianyou He, Xiaojin Ma, Yian Ren, Tingting Zhao, Xin Zeng, Han Li, and Yiheng Chen. 2018. Sequential biases on subjective judgments: Evidence from face attractiveness and ringtone agreeableness judgment. Plos one 13, 6 (2018), e0198723. · DOI
  9. 10.1214/aoms/1177699803 · DOI · Paper page
  10. 10.1037/0096-1523.3.1.92 · doi:10.1037/0096-1523.3.1.92 · Paper page
  11. 10.1080/10447318.2013.846790 · DOI
  12. Thomas C Leonard . 2008. Richard H. Thaler , Cass R. Sunstein , Nudge : Improving de cisions about health, wealth, and happiness. Thomas C Leonard. 2008. Richard H. Thaler, Cass R. Sunstein, Nudge: Improving decisions about health, wealth, and happiness.
  13. 10.1145/3313831.3376874 · DOI
  14. 10.1145/3411764.3445260 · DOI
  15. Volodymyr Mnih , Adria Puigdomenech Badia , Mehdi Mirza , Alex Graves , Timothy Lillicrap , Tim Harley , David Silver , and Koray Kavukcuoglu . 2016. Asynchronous methods for deep reinforcement learning ., 1928 –1937 pages. Volodymyr Mnih, Adria Puigdomenech Badia, Mehdi Mirza, Alex Graves, Timothy Lillicrap, Tim Harley, David Silver, and Koray Kavukcuoglu. 2016. Asynchronous methods for deep reinforcement learning., 1928–1937 pages.
  16. 10.1080/12460125.2019.1620573 · DOI
  17. Matteo Palmonari and Pasquale Minervini . 2020. Knowledge graph embeddings and explainable AI. Knowledge Graphs for Explainable Artificial Intelligence: Foundations, Applications and Challenges , IOS Press , Amsterdam 47, 1 ( 2020 ), 49–72. Matteo Palmonari and Pasquale Minervini. 2020. Knowledge graph embeddings and explainable AI. Knowledge Graphs for Explainable Artificial Intelligence: Foundations, Applications and Challenges, IOS Press, Amsterdam 47, 1 (2020), 49–72.
  18. 10.1145/2939672.2939778 · DOI · Paper page
  19. 10.1145/3313831.3376318 · DOI
  20. Linda J Skitka , Kathleen L Mosier , and Mark Burdick . 1999. Does automation bias decision-making?International Journal of Human-Computer Studies 51, 5 ( 1999 ), 991–1006. Linda J Skitka, Kathleen L Mosier, and Mark Burdick. 1999. Does automation bias decision-making?International Journal of Human-Computer Studies 51, 5 (1999), 991–1006.
  21. Tatsuji Takahashi , Masahiro Nakano , and Shuji Shinohara . 2010. Cognitive symmetry: Illogical but rational biases. Symmetry: culture and science 21, 1-3 ( 2010 ), 275–294. Tatsuji Takahashi, Masahiro Nakano, and Shuji Shinohara. 2010. Cognitive symmetry: Illogical but rational biases. Symmetry: culture and science 21, 1-3 (2010), 275–294.
  22. 10.1145/3274438 · DOI
  23. Amos Tversky and Daniel Kahneman . 1974. Judgment under uncertainty: Heuristics and biases. science 185, 4157 ( 1974 ), 1124–1131. Amos Tversky and Daniel Kahneman. 1974. Judgment under uncertainty: Heuristics and biases. science 185, 4157 (1974), 1124–1131.
  24. David W Vinson , Rick Dale , and Michael N Jones . 2019. Decision contamination in the wild: Sequential dependencies in online review ratings. Behavior research methods 51, 4 ( 2019 ), 1477–1484. David W Vinson, Rick Dale, and Michael N Jones. 2019. Decision contamination in the wild: Sequential dependencies in online review ratings. Behavior research methods 51, 4 (2019), 1477–1484.
  25. Rui Zhang , Nathan J McNeese , Guo Freeman , and Geoff Musick . 2021 . ” An Ideal Human” Expectations of AI Teammates in Human-AI Teaming . Proceedings of the ACM on Human-Computer Interaction 4, CSCW3(2021) , 1–25. Rui Zhang, Nathan J McNeese, Guo Freeman, and Geoff Musick. 2021. ” An Ideal Human” Expectations of AI Teammates in Human-AI Teaming. Proceedings of the ACM on Human-Computer Interaction 4, CSCW3(2021), 1–25.

Cited by

See all 30

Metadata

Authors
Echterhoff, J. M., Yarmand, M., & McAuley, J.
Affiliations
  • University of California San Diego, United States
  • Computer Science and Engineering, University of California San Diego, United States
Venue
CHI Conference on Human Factors in Computing Systems
Publisher
ACM
Published
2022-04-27
Pages
1-9
Cited by
30
References
9

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: AI-Moderated Decision-Making: Capturing and Balancing Anchoring Bias in Sequential Decision Tasks. https://app.cochat.ai/papers/10.1145/3491102.3517443
The paper
Echterhoff, J. M., Yarmand, M., & McAuley, J. (2022). AI-Moderated Decision-Making: Capturing and Balancing Anchoring Bias in Sequential Decision Tasks. CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3491102.3517443

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.