Mitigating the Attraction Effect with Visualizations
Open accessThe DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
Human decisions are prone to biases, and this is no less true for decisions made within data visualizations. Bias mitigation strategies often focus on the person, by educating people about their biases, typically with little success. We focus instead on the system, presenting the first evidence that altering the design of an interactive visualization tool can mitigate a strong bias - the attraction effect. Participants viewed 2D scatterplots where choices between superior alternatives were affected by the placement of other suboptimal points. We found that highlighting the superior alternatives weakened the bias, but did not eliminate it. We then tested an interactive approach where participants completely removed locally dominated points from the view, inspired by the elimination by aspects strategy in the decision-making literature. This approach strongly decreased the bias, leading to a counterintuitive suggestion: tools that allow removing inappropriately salient or distracting data from a view may help lead users to make more rational decisions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Confirmation Bias: A Ubiquitous Phenomenon in Many Guises
Nickerson, R. S. (1998) · Review of General Psychology · doi:10.1037/1089-2680.2.2.175 · Cited by 7,267
Rational choice and the structure of the environment.
Simon, H. A. (1956) · Psychological Review · doi:10.1037/h0042769 · Cited by 5,919 · cited 3×
“One of the oldest non-compensatory strategies is the “satisficing” (SAT) [80], in which the decision maker first assigns thresholds, evaluates the alternatives by order of appearance, and chooses the first that satisfies these thresholds.”
BackgroundInfluentialA perspective on judgment and choice: mapping bounded rationality.
Kahneman, D. (2003) · American Psychologist · doi:10.1037/0003-066x.58.9.697 · Cited by 5,540
Payne, J. W., Bettman, J. R., & Johnson, E. J. (1993) · doi:10.1017/cbo9781139173933 · Cited by 3,487
Elimination by aspects: A theory of choice
Tversky, A. (1972) · Psychological Review · doi:10.1037/h0032955 · Cited by 3,365 · cited 3×
“Because people prefer non-compensatory strategies, we therefore chose to test one taken from the decision making literature, ELIMINATION BY ASPECTS (EBA) [86].”
BackgroundMethod“Clinical versus Actuarial Judgment.”
Dawes, R. M., Faust, D., & Meehl, P. E. (1989) · Science · doi:10.1126/science.2648573 · Cited by 2,298
Homo Heuristicus: Why Biased Minds Make Better Inferences
Gigerenzer, G., & Brighton, H. (2009) · Topics in Cognitive Science · doi:10.1111/j.1756-8765.2008.01006.x · Cited by 1,801
Fitts' Law as a Research and Design Tool in Human-Computer Interaction
MacKenzie, I. S. (1992) · Human–Computer Interaction · doi:10.1207/s15327051hci0701_3 · Cited by 1,637 · cited 1×
“In these cases users may have tried to reduce the distance between two consecutive decoys in order to decrease the cumulative selection time [57].”
BackgroundThe group as a polarizer of attitudes.
Moscovici, S., & Zavalloni, M. (1969) · Journal of Personality and Social Psychology · doi:10.1037/h0027568 · Cited by 1,038 · cited 1×
“In other cases of members forming judgments during a group discussion, individual biases can be amplified within the final decision [74], Group interactions often trigger other cognitive biases where individuals shape judgments to be favorable to the group [10, 29], and group decisions are often biased towards conform…”
BackgroundCosts and benefits of judgment errors: Implications for debiasing.
Arkes, H. R. (1991) · Psychological Bulletin · doi:10.1037/0033-2909.110.3.486 · Cited by 764
Mussweiler, T., Strack, F., & Pfeiffer, T. (2000) · Personality and Social Psychology Bulletin · doi:10.1177/01461672002611010 · Cited by 556 · cited 1×
“In “consider the opposite” decision makers are asked to consider evidence for alternatives in order to widen their sample of evidence, allowing to reduce biases such as overconfidence, hindsight or anchoring [3,64].”
BackgroundA solution to the single-question crowd wisdom problem
Prelec, D., Seung, H. S., & McCoy, J. (2017) · Nature · doi:10.1038/nature21054 · Cited by 314
Automation Bias in Intelligent Time Critical Decision Support Systems
Cummings, M. (2004) · AIAA 1st Intelligent Systems Technical Conference · doi:10.2514/6.2004-6313 · Cited by 269 · cited 2×
“They can also incorporate normative algorithms into the decision making process that would be difficult or impossible for human decision makers to compute [20].”
BackgroundError Bars Considered Harmful: Exploring Alternate Encodings for Mean and Error
Correll, M., & Gleicher, M. (2014) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2014.2346298 · Cited by 258 · cited 1×
“Improving performance in these domains can be difficult [17], even for animated displays [45].”
BackgroundAutomation bias in intelligent time critical decision support systems
Cummings, M. L. (2017) · Decision Making in Aviation · doi:10.4324/9781315095080-17 · Cited by 233
A longitudinal study of the effects of undergraduate training on reasoning.
Lehman, D. R., & Nisbett, R. E. (1990) · Developmental Psychology · doi:10.1037/0012-1649.26.6.952 · Cited by 211
When debiasing backfires: Accessible content and accessibility experiences in debiasing hindsight.
Sanna, L. J., Schwarz, N., & Stocker, S. L. (2002) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.28.3.497 · Cited by 195
Hullman, J., Resnick, P., & Adar, E. (2015) · PLOS ONE · doi:10.1371/journal.pone.0142444 · Cited by 194 · cited 1×
“Improving performance in these domains can be difficult [17], even for animated displays [45].”
BackgroundDisfluency disrupts the confirmation bias
Hernandez, I., & Preston, J. L. (2013) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2012.08.010 · Cited by 152 · cited 4×
“Slowing people down is also possible by presenting information in a disfluent format, which can reduce confirmation bias [40].”
BackgroundInfluentialBoy, J., Pandey, A. V., Emerson, J., Satterthwaite, M., Nov, O., & Bertini, E. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025512 · Cited by 104 · cited 2×
“[8] tested whether anthropomorphized icons would decrease an impulse to dehumanize statistical data about suffering populations [47].”
BackgroundThe Attraction Effect in Information Visualization
Dimara, E., Bezerianos, A., & Dragicevic, P. (2017) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2016.2598594 · Cited by 89
Self-citationThe Anchoring Effect in Decision-Making with Visual Analytics
Cho, I., Wesslen, R., Karduni, A., Santhanam, S., Shaikh, S., & Dou, W. (2017) · 2017 IEEE Conference on Visual Analytics Science and Technology (VAST) · doi:10.1109/vast.2017.8585665 · Cited by 88 · cited 1×
“Some studies focused explicitly on cognitive bias detection, demonstrating the existence of well known cognitive biases, such as anchoring effects or shifts in decision criteria [14,87,97], the attraction effect [22], or overconfidence effects [2], but do not test designs for mitigating these biases.”
BackgroundThe illusion of predictability: How regression statistics mislead experts
Soyer, E., & Hogarth, R. M. (2012) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2012.02.002 · Cited by 84 · cited 1×
“Other studies find that alternative visualization designs [2,36,68], or the use of visualizations instead of text [84] can improve probability estimations.”
Background
Cited by
Ethical Dimensions of Visualization Research
Correll, M. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300418 · Cited by 150
A Critical Reflection on Visualization Research: Where Do Decision Making Tasks Hide?
Dimara, E., & Stasko, J. (2022) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2021.3114813 · Cited by 60
Self-citation
Metadata
- Authors
- Dimara, E., Bailly, G., Bezerianos, A., & Franconeri, S.
- Venue
- IEEE Transactions on Visualization and Computer Graphics
- Published
- 2019-01
- Volume
- 25
- Issue
- 1
- Pages
- 850-860
- ISSN
- 1077-2626 (ISSN-L)
- 1941-0506
- 2160-9306
- OpenAlex
- W2888349491
- Cited by
- 61
- References
- 23
- FWCI
- 3.36
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.