Visualizing Uncertainty and Alternatives in Event Sequence Predictions
The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
Data analysts apply machine learning and statistical methods to timestamped event sequences to tackle various problems but face unique challenges when interpreting the results. Especially in event sequence prediction, it is difficult to convey uncertainty and possible alternative paths or outcomes. In this work, informed by interviews with five machine learning practitioners, we iteratively designed a novel visualization for exploring event sequence predictions of multiple records where users are able to review the most probable predictions and possible alternatives alongside uncertainty information. Through a controlled study with 18 participants, we found that users are more confident in making decisions when alternative predictions are displayed and they consider the alternatives more when deciding between two options with similar top predictions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Kuhn, M., & Johnson, K. (2013) · doi:10.1007/978-1-4614-6849-3 · Cited by 6,788
Prospect Theory: An Analysis of Decision Under Risk
Kahneman, D., & Tversky, A. (2013) · World Scientific Handbook in Financial Economics Series · doi:10.1142/9789814417358_0006 · Cited by 3,091
A domain‐specific risk‐attitude scale: measuring risk perceptions and risk behaviors
Weber, E. U., Blais, A., & Betz, N. E. (2002) · Journal of Behavioral Decision Making · doi:10.1002/bdm.414 · Cited by 2,936
In Pursuit of Error: A Survey of Uncertainty Visualization Evaluation
Hullman, J., Qiao, X., Correll, M., Kale, A., & Kay, M. (2019) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2018.2864889 · Cited by 187 · cited 2×
“Guided by the taxonomy of evaluating uncertainty visualizations [27], we designed a full-factorial, within-subject study to test our hypotheses by comparing two uncertainty visualization designs: Vunc (Fig.”
MethodGoyal, N., & Fussell, S. R. (2017) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3130917 · Cited by 46
Investigating User Confidence for Uncertainty Presentation in Predictive Decision Making
Arshad, S. Z., Zhou, J., Bridon, C., Chen, F., & Wang, Y. (2015) · Proceedings of the Annual Meeting of the Australian Special Interest Group for Computer Human Interaction · doi:10.1145/2838739.2838753 · Cited by 30
Cited by
Investigating Explainability of Generative AI for Code through Scenario-based Design
Sun, J., Liao, Q. V., Muller, M., Agarwal, M., Houde, S., Talamadupula, K., & Weisz, J. D. (2022) · 27th International Conference on Intelligent User Interfaces · doi:10.1145/3490099.3511119 · Cited by 219
“We built upon this work, as well as other work that explores XAI or transparency features [10, 21, 31], to select and adapt features that could apply to the context of GenAI for code.”
MethodLai, V., Chen, C., Smith-Renner, A., Liao, Q. V., & Tan, C. (2023) · 2023 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3593013.3594087 · Cited by 204
“Subjective metrics of understanding typically ask participants to directly rate their understanding of the AI [5, 12, 15, 18, 23, 75, 91, 105, 108], or some variations of it such as confidence in understanding [57], ease of understanding [46, 83], or confidence in simulation [2, 80].”
BackgroundMethodInfluentialPrabhudesai, S., Yang, L., Asthana, S., Huan, X., Liao, Q. V., & Banovic, N. (2023) · Proceedings of the 28th International Conference on Intelligent User Interfaces · doi:10.1145/3581641.3584033 · Cited by 82
“Unlike existing quantitative ML-assisted decision-making studies [36, 51, 69, 73, 108] that focused on the quantitative measures of decisions outcomes (e.g., in our case that would be how much money Alex saved or lost based on the participant’s recommendation), we focused on studying how the…”
BackgroundMethodA Critical Reflection on Visualization Research: Where Do Decision Making Tasks Hide?
Dimara, E., & Stasko, J. (2022) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2021.3114813 · Cited by 60
A Missing Piece in the Puzzle: Considering the Role of Task Complexity in Human-AI Decision Making
Salimzadeh, S., He, G., & Gadiraju, U. (2023) · Proceedings of the 31st ACM Conference on User Modeling, Adaptation and Personalization · doi:10.1145/3565472.3592959 · Cited by 42
“…are sometimes simplified for lay people to complete, some knowledge and familiarity, such as AI literacy [24], numeracy, and statistics background [41], may still be required to accomplish tasks, which may not be feasible to expect from all crowd workers — expert recruitment on-demand remains a…”
Background
Metadata
- Authors
- Guo, S., Du, F., Malik, S., Koh, E., Kim, S., Liu, Z., Kim, D., Zha, H., & Cao, N.
- Venue
- Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2019-05-02
- Pages
- 1-12
- OpenAlex
- W2941320055
- Cited by
- 56
- References
- 6
- FWCI
- 2.02
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Visualizing Uncertainty and Alternatives in Event Sequence Predictions. https://app.cochat.ai/papers/10.1145/3290605.3300803
- The paper
- Guo, S., Du, F., Malik, S., Koh, E., Kim, S., Liu, Z., Kim, D., Zha, H., & Cao, N. (2019). Visualizing Uncertainty and Alternatives in Event Sequence Predictions. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3290605.3300803
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.