In Pursuit of Error: A Survey of Uncertainty Visualization Evaluation
Abstract
Understanding and accounting for uncertainty is critical to effectively reasoning about visualized data. However, evaluating the impact of an uncertainty visualization is complex due to the difficulties that people have interpreting uncertainty and the challenge of defining correct behavior with uncertainty information. Currently, evaluators of uncertainty visualization must rely on general purpose visualization evaluation frameworks which can be ill-equipped to provide guidance with the unique difficulties of assessing judgments under uncertainty. To help evaluators navigate these complexities, we present a taxonomy for characterizing decisions made in designing an evaluation of an uncertainty visualization. Our taxonomy differentiates six levels of decisions that comprise an uncertainty visualization evaluation: the behavioral targets of the study, expected effects from an uncertainty visualization, evaluation goals, measures, elicitation techniques, and analysis approaches. Applying our taxonomy to 86 user studies of uncertainty visualizations, we find that existing evaluation practice, particularly in visualization research, focuses on Performance and Satisfaction-based measures that assume more predictable and statistically-driven judgment behavior than is suggested by research on human judgment and decision making. We reflect on common themes in evaluation practice concerning the interpretation and semantics of uncertainty, the use of confidence reporting, and a bias to…
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Hullman et al. review methods for evaluating the success of uncertainty visualization.
“Hullman et al. [55] review methods for evaluating the success of uncertainty visualization.”
From Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty (2021) · cites this paper as [55]
Cites
Prospect Theory: An Analysis of Decision under Risk
Kahneman, D., & Tversky, A. (1979) · Econometrica · doi:10.2307/1914185 · Cited by 48,524 · see citing works
Prospect theory: An analysis of decision under risk
Kahneman, D. J., & Tversky, A. (1988) · Cambridge University Press eBooks · doi:10.1017/cbo9780511609220.014 · Cited by 32,720 · see citing works
Judgment under Uncertainty: Heuristics and Biases
Tversky, A., & Kahneman, D. (1975) · Utility, Probability, and Human Decision Making · doi:10.1007/978-94-010-1834-0_8 · Cited by 22,650 · see citing works
(2011) · Cited by 14,317 · see citing works
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505 · see citing works
Availability: A heuristic for judging frequency and probability
Tversky, A., & Kahneman, D. (1973) · Cognitive Psychology · doi:10.1016/0010-0285(73)90033-9 · Cited by 9,984 · cited 1× · see citing works
“Historically, such biases have been attributed to heuristics, the use of simple judgments as a proxy for difficult judgments [49, 90, 91, 92].”
BackgroundJudgment under Uncertainty: Heuristics and Biases
(1982) · doi:10.1017/cbo9780511809477 · Cited by 8,240 · see citing works
“Risk, Ambiguity, and the Savage Axioms.”
Ellsberg, D. (1961) · The Quarterly Journal of Economics · doi:10.2307/1884324 · Cited by 7,891 · see citing works
Anderson, N. H. (2001) · Psychology Press eBooks · doi:10.4324/9781410600004-24 · Cited by 6,939 · see citing works
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · see citing works
Allais, M. (1953) · Econometrica · doi:10.2307/1907921 · Cited by 4,054 · see citing works
Simple Heuristics That Make Us Smart
Gigerenzer, G., & Todd, P. M. (1999) · Cited by 3,564 · see citing works
Belief in the law of small numbers.
Tversky, A., & Kahneman, D. (1971) · Psychological Bulletin · doi:10.1037/h0031322 · Cited by 3,246 · see citing works
Guidelines for evaluating and expressing the uncertainty of NIST measurement results
Taylor, B. N. (1994) · National Institute of Standards and Technology, NIST Technical Note 1297 · doi:10.6028/nist.tn.1297 · Cited by 2,833 · see citing works
Ambiguity and Choice in Organizations.
Perrow, C. B., March, J. G., & Olsen, J. P. (1977) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2064777 · Cited by 2,712 · see citing works
Guidelines for evaluating and expressing the uncertainty of NIST measurement results
Taylor, B. N., & Kuyatt, C. E. (2018) · doi:10.6028/nist.tn.1297-1993 · Cited by 2,582 · see citing works
How to improve Bayesian reasoning without instruction: Frequency formats.
Gigerenzer, G., & Hoffrage, U. (1995) · Psychological Review · doi:10.1037/0033-295x.102.4.684 · Cited by 2,128 · see citing works
Lindley, D. V., & Savage, L. J. (1973) · The Mathematical Gazette · doi:10.2307/3615588 · Cited by 1,973 · see citing works
Uncertain Judgements: Eliciting Experts' Probabilities
O'Hagan, A., Buck, C. E., Daneshkhah, A., Eiser, J. R., Garthwaite, P. H., Jenkinson, D. J., Oakley, J. E., & Rakow, T. (2006) · doi:10.1002/0470033312 · Cited by 1,550 · see citing works
Ambiguity and Choice in Organizations
Axelsson, R., March, J. G., & Olsen, J. P. (1977) · Scandinavian Journal of Economics · doi:10.2307/3439574 · Cited by 1,331 · see citing works
Davis, D. D., & Holt, C. A. (1993) · Princeton University Press eBooks · doi:10.1515/9780691233376 · Cited by 992 · see citing works
A Nested Model for Visualization Design and Validation
Munzner, T. (2009) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2009.111 · Cited by 882 · see citing works
Coping with Uncertainty: A Naturalistic Decision-Making Analysis
Lipshitz, R., & Strauss, O. (1997) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.1997.2679 · Cited by 878 · see citing works
Empirical Studies in Information Visualization: Seven Scenarios
Lam, H., Bertini, E., Isenberg, P., Catherine Plaisant, B., & Carpendale, S. (2011) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2011.279 · Cited by 625 · see citing works
Approaches to uncertainty visualization
Pang, A., Wittenbrink, C. M., & Lodha, S. K. (1997) · The Visual Computer · doi:10.1007/s003710050111 · Cited by 548 · see citing works
Visualizing Geospatial Information Uncertainty: What We Know and What We Need to Know
MacEachren, A. M., Robinson, A. C., Hopper, S., Gardner, S., Murray, R., GAHEGAN, M. N., & Hetzler, E. (2005) · Cartography and Geographic Information Science · doi:10.1559/1523040054738936 · Cited by 546 · see citing works
Strategies for evaluating information visualization tools
Shneiderman, B., & Catherine Plaisant, B. (2006) · doi:10.1145/1168149.1168158 · Cited by 399 · see citing works
Researchers Misunderstand Confidence Intervals and Standard Error Bars.
Belia, S., Fidler, F., Williams, J., & Cumming, G. (2005) · Psychological Methods · doi:10.1037/1082-989x.10.4.389 · Cited by 390 · see citing works
Visualizing Uncertain Information
MacEachren, A. M. (1992) · Cartographic Perspectives · doi:10.14714/cp13.1000 · Cited by 375 · see citing works
A Systematic Review on the Practice of Evaluating Visualization
Tobias Isenberg, A., Isenberg, P., Jian, C., Sedlmair, M., & Möller, T. B. (2013) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2013.126 · Cited by 324 · see citing works
A Next Step: Visualizing Errors and Uncertainty
Johnson, C. R., & Sanderson, A. R. (2003) · IEEE Computer Graphics and Applications · doi:10.1109/mcg.2003.1231171 · Cited by 276 · see citing works
Error Bars Considered Harmful: Exploring Alternate Encodings for Mean and Error
Correll, M., & Gleicher, M. (2014) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2014.2346298 · Cited by 258 · see citing works
Self-citationSignatures of a Statistical Computation in the Human Sense of Confidence
Sanders, J. I., Hangya, B., & Kepecs, A. (2016) · Neuron · doi:10.1016/j.neuron.2016.03.025 · Cited by 253 · see citing works
Kay, M., Kola, T., Hullman, J. R., & Munson, S. A. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858558 · Cited by 239 · see citing works
Self-citationOverview and State-of-the-Art of Uncertainty Visualization
Bonneau, G., Hege, H., Johnson, C. R., Oliveira, M. M., Potter, K. C., Rheingans, P. L., & Schultz, T. (2014) · Mathematics and visualization · doi:10.1007/978-1-4471-6497-5_1 · Cited by 211 · see citing works
Hullman, J., Resnick, P., & Adar, E. (2015) · PLOS ONE · doi:10.1371/journal.pone.0142444 · Cited by 194 · see citing works
Self-citationPaese, P. W., & Sniezek, J. (1991) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(91)90008-h · Cited by 188 · see citing works
Decision making under ignorance: Arguing with yourself
Hogarth, R. M., & Kunreuther, H. C. (1995) · Journal of Risk and Uncertainty · doi:10.1007/bf01211526 · Cited by 186 · see citing works
Uncertainty forecasts improve weather-related decisions and attenuate the effects of forecast error.
Joslyn, S. L., & LeClerc, J. E. (2011) · Journal of Experimental Psychology Applied · doi:10.1037/a0025185 · Cited by 186 · see citing works
From Quantification to Visualization: A Taxonomy of Uncertainty Visualization Approaches
Potter, K. C., Rosen, P., & Johnson, C. R. (2012) · IFIP International Federation for Information Processing/IFIP · doi:10.1007/978-3-642-32677-6_15 · Cited by 186 · see citing works
A typology for visualizing uncertainty
Thomson, J., Hetzler, E. G., MacEachren, A. M., GAHEGAN, M. N., & Misha Pavel, C. (2005) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.587254 · Cited by 180 · see citing works
Kinkeldey, C., MacEachren, A. M., & Schiewe, J. (2014) · The Cartographic Journal · doi:10.1179/1743277414y.0000000099 · Cited by 179 · see citing works
Uncertainty Displays Using Quantile Dotplots or CDFs Improve Transit Decision-Making
Fernandes, M., Walls, L., Munson, S., Hullman, J., & Kay, M. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173718 · Cited by 175 · see citing works
Self-citationGraphical Communication of Uncertain Quantities to Nontechnical People
Ibrekk, H., & Morgan, M. G. (1987) · Risk Analysis · doi:10.1111/j.1539-6924.1987.tb00488.x · Cited by 159 · see citing works
Uncertainty Visualization in Medical Volume Rendering Using Probabilistic Animation
Lundström, C. F., Ljung, P., Persson, A., & Ynnerman, A. (2007) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2007.70518 · Cited by 137 · see citing works
Theoretical analysis of uncertainty visualizations
Zuk, T., & Carpendale, S. (2006) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.643631 · Cited by 131 · see citing works
A User Study to Compare Four Uncertainty Visualization Methods for 1D and 2D Datasets
Sanyal, J., Zhang, S., Bhattacharya, G., Amburn, P., & Moorhead, R. J., II (2009) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2009.114 · Cited by 128 · see citing works
Testing Popular Visualization Techniques for Representing Model Uncertainty
Aerts, J. C. J. H., Clarke, K., & Keuper, A. D. (2003) · Cartography and Geographic Information Science · doi:10.1559/152304003100011180 · Cited by 128 · see citing works
The Visualization of Uncertain Data: Methods and Problems.
Griethe, H., & Schumann, H. (2006) · SimVis · Cited by 127 · see citing works
Guidelines for the Display of Attribute Certainty
Leitner, M., & Buttenfield, B. P. (2000) · Cartography and Geographic Information Science · doi:10.1559/152304000783548037 · Cited by 124 · see citing works
Hypothetical Outcome Plots Help Untrained Observers Judge Trends in Ambiguous Data
Kale, A., Nguyen, F., Kay, M., & Hullman, J. (2019) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2018.2864909 · Cited by 122 · see citing works
Self-citationDynamic display of spatial data-reliability: Does it benefit the map user?
Evans, B. J. (1997) · Computers & Geosciences · doi:10.1016/s0098-3004(97)00011-3 · Cited by 120 · see citing works
Revealing Uncertainty for Information Visualization
Skeels, M. M., Lee, B., Smith, G., & Robertson, G. G. (2009) · Information Visualization · doi:10.1057/ivs.2009.1 · Cited by 120 · see citing works
Lay understanding of probability distributions
Goldstein, D. G., & Rothschild, D. M. (2014) · Judgment and Decision Making · doi:10.1017/s1930297500004940 · Cited by 116 · see citing works
Grounded evaluation of information visualizations
Isenberg, P., Zuk, T., Collins, C. M., & Carpendale, S. (2008) · doi:10.1145/1377966.1377974 · Cited by 113 · see citing works
Evaluating Sketchiness as a Visual Variable for the Depiction of Qualitative Uncertainty
Boukhelifa, N., Bezerianos, A., Tobias Isenberg, A., & Fekete, J. (2012) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2012.220 · Cited by 111 · see citing works
Decisions With Uncertainty: The Glass Half Full
Joslyn, S., & LeClerc, J. (2013) · Current Directions in Psychological Science · doi:10.1177/0963721413481473 · Cited by 109 · see citing works
Bar graphs depicting averages are perceptually misinterpreted: The within-the-bar bias
Newman, G. E., & Scholl, B. J. (2012) · Psychonomic Bulletin & Review · doi:10.3758/s13423-012-0247-5 · Cited by 101 · see citing works
Kinkeldey, C., MacEachren, A. M., Riveiro, M., & Schiewe, J. (2015) · Cartography and Geographic Information Science · doi:10.1080/15230406.2015.1089792 · Cited by 95 · see citing works
Value-Suppressing Uncertainty Palettes
Correll, M., Moritz, D., & Heer, J. (2018) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174216 · Cited by 92 · see citing works
Self-citationEvaluating the impact of visualization of wildfire hazard upon decision-making under uncertainty
Cheong, L., Bleisch, S., Kealy, A., Tolhurst, K. G., Wilkening, T. S., & Duckham, M. (2016) · International Journal of Geographical Information Systems · doi:10.1080/13658816.2015.1131829 · Cited by 92 · see citing works
Uncertainty Forecasts Improve Decision Making Among Nonexperts
Nadav-Greenberg, L., & Joslyn, S. L. (2009) · Journal of Cognitive Engineering and Decision Making · doi:10.1518/155534309x474460 · Cited by 87 · see citing works
Relation between belief and performance in perceptual decision making
Drugowitsch, J., Moreno-Bote, R., & Pouget, A. (2014) · PLoS ONE · doi:10.1371/journal.pone.0096511 · Cited by 72 · see citing works
Displaying Uncertainty: Investigating the Effects of Display Format and Specificity
Bisantz, A. M., Marsiglio, S. S., & Munch, J. (2005) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872005775570916 · Cited by 66 · see citing works
Visual Encodings of Temporal Uncertainty: A Comparative User Study
Gschwandtner, T., Bögl, M., Federico, P., & Miksch, S. (2015) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2015.2467752 · Cited by 65 · see citing works
Communicating Local Climate Risks Online Through an Interactive Data Visualization
Herring, J., VanDyke, M. S., Cummins, R. G., & Melton, F. (2016) · Environmental Communication · doi:10.1080/17524032.2016.1176946 · Cited by 59 · see citing works
Navigating the Landscape of Data Literacy: It IS Complex.
Mandinach, E. B., & Gummer, E. S. (2012) · Cited by 59 · see citing works
The effects of experience and task difficulty on accuracy and confidence assessments of auditors
Chung, J. O. Y., & Monroe, G. S. (2000) · Accounting and Finance · doi:10.1111/1467-629x.00040 · Cited by 58 · see citing works
The Perception of Visual UncertaintyRepresentation by Non-Experts
Tak, S., Toet, A., & van Erp, J. B. F. (2014) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2013.247 · Cited by 57 · see citing works
Hullman, J., Kay, M., Kim, Y.-S., & Shrestha, S. (2018) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2017.2743898 · Cited by 55 · see citing works
Self-citationThe Effect of Probabilistic Information on Threshold Forecasts
Joslyn, S. L., Pak, K., Jones, D. A., Pyles, J. A., & Hunt, E. B. (2007) · Weather and Forecasting · doi:10.1175/waf1020.1 · Cited by 54 · see citing works
The disutility of the hard-easy effect in choice confidence
Merkle, E. C. (2009) · Psychonomic Bulletin & Review · doi:10.3758/pbr.16.1.204 · Cited by 46 · see citing works
Visualizing Large-Scale Uncertainty in Astrophysical Data
Li, H., Fu, C., Li, Y., & Hanson, A. J. (2007) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2007.70530 · Cited by 42 · see citing works
The influence of different graphical displays on nonexpert decision making under uncertainty.
Padilla, L., Hansen, G., Ruginski, I. T., Kramer, H., Thompson, W. B., & Creem-Regehr, S. H. (2014) · Journal of Experimental Psychology Applied · doi:10.1037/xap0000037 · Cited by 39 · see citing works
Dong, X., & Hayes, C. C. (2012) · Journal of Cognitive Engineering and Decision Making · doi:10.1177/1555343411432338 · Cited by 36 · see citing works
Evaluating the Perception of Uncertainty in Alternative Visualization Strategies
Blenkinsop, S., Fisher, P. F., Bastin, L., & Wood, J. (2000) · Cartographica The International Journal for Geographic Information and Geovisualization · doi:10.3138/3645-4v22-0m23-3t52 · Cited by 36 · see citing works
Boukhelifa, N., & Duke, D. J. (2009) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/1520340.1520616 · Cited by 36 · see citing works
Visualizing Data Certainty: A Case Study Using Graduated Circle Maps
Edwards, L. D., & Nelson, E. S. (2001) · Cartographic Perspectives · doi:10.14714/cp38.793 · Cited by 32 · see citing works
Why Evaluating Uncertainty Visualization is Error Prone
Hullman, J. R. (2016) · doi:10.1145/2993901.2993919 · Cited by 30 · see citing works
Self-citationKreuzmair, C., Siegrist, M., & Keller, C. (2016) · Risk Analysis · doi:10.1111/risa.12531 · Cited by 27 · see citing works
Hansen, C., Zidowitz, S., Ritter, F., Lange, C., Oldhafer, K. J., & Hahn, H. K. (2012) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-012-0790-6 · Cited by 20 · see citing works
Increasing Users' Confidence in Uncertain Data by Aggregating Data from Multiple Sources
Greis, M., Avci, E., Schmidt, A., & Machulla, T. (2017) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025998 · Cited by 19 · see citing works
Computation and visualization of uncertainty in surgical navigation
Simpson, A. L., Ma, B., Vasarhelyi, E. M., Borschneck, D. P., Ellis, R. E., & Stewart, A. J. (2013) · International Journal of Medical Robotics and Computer Assisted Surgery · doi:10.1002/rcs.1541 · Cited by 14 · see citing works
End-User Development for Interactive Data Analytics: Uncertainty, Correlation and User Confidence
Zhou, J. J., Arshad, S. Z., Wang, X., Li, Z., Feng, D. D., & Chen, F. (2017) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2017.2723402 · Cited by 13 · see citing works
Rößing, C., Reker, A., Gabb, M., Dietmayer, K., & Lensch, H. P. A. (2013) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2013.6629529 · Cited by 10 · see citing works
Daradkeh, M. K. (2015) · International Conference on Engineering & MIS (ICEMIS) · doi:10.1145/2832987.2833050 · Cited by 10 · see citing works
Glymour, C. (2016) · Springer eBooks · doi:10.1007/978-3-319-20451-2_8 · Cited by 9 · see citing works
Uncertainty Visualization for Mobile and Wearable Devices Based Activity Recognition Systems
Dong, M., Chen, L., Wang, L., Jiang, X., & Chen, G. (2016) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2016.1224527 · Cited by 7 · see citing works
Paese, P. W. (1993) · The Journal of Psychology · doi:10.1080/00223980.1993.9915580 · Cited by 1 · see citing works
Ensemble-space visualization improves perception of 3D state of molecular dynamics simulation
Huff, I. J., Weigle, C., & Banks, D. C. (2008) · Symposium on Applied Perception in Graphics and Visualization (APGV) · doi:10.1145/1394281.1394312 · Cited by 1 · see citing works
Flagged first, then by citations
3 of the 93 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty
Bhatt, U., Antorán, J., Zhang, Y., Liao, Q. V., Sattigeri, P., Fogliato, R., Melançon, G., Krishnan, R., Stanley, J., Tickoo, O., et al. (2021) · Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3461702.3462571 · Cited by 225 · see citing works
Effective Use of Likert Scales in Visualization Evaluations: A Systematic Review
South, L., Saffo, D., Vitek, O., Dunne, C., & Borkin, M. A. (2022) · Computer Graphics Forum · doi:10.1111/cgf.14521 · Cited by 242 · see citing works
Lee, C., Yang, T., Inchoco, G. D., Jones, G. M., & Satyanarayan, A. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445211 · Cited by 192 · see citing works
Why Authors Don't Visualize Uncertainty
Hullman, J. R. (2019) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2019.2934287 · Cited by 177 · see citing works
Self-citationEthical Dimensions of Visualization Research
Correll, M. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300418 · Cited by 150 · see citing works
Self-citationPadilla, L., Kay, M., & Hullman, J. R. (2021) · Wiley StatsRef: Statistics Reference Online · doi:10.1002/9781118445112.stat08296 · Cited by 87 · see citing works
Self-citationThe Unmet Data Visualization Needs of Decision Makers Within Organizations
Dimara, E., Zhang, H., Tory, M. K., & Franconeri, S. (2021) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2021.3074023 · Cited by 75 · see citing works
Recent advances and challenges in uncertainty visualization: a survey
Kamal, A., Dhakal, P., Javaid, A. Y., Devabhaktuni, V., Kaur, D., Zaientz, J. D., & Marinier, R. (2021) · Journal of Visualization · doi:10.1007/s12650-021-00755-1 · Cited by 71 · see citing works
A Critical Reflection on Visualization Research: Where Do Decision Making Tasks Hide?
Dimara, E., & Stasko, J. (2022) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2021.3114813 · Cited by 60 · see citing works
Visualizing Uncertainty and Alternatives in Event Sequence Predictions
Guo, S., Du, F., Malik, S., Koh, E., Kim, S., Liu, Z., Kim, Y., Hongyuan Zha, B., & Cao, N. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300803 · Cited by 56 · see citing works
Evaluating language models for mathematics through interactions
Collins, K. M., Jiang, A. Q., Frieder, S., Wong, L., Zilka, M., Bhatt, U., Lukasiewicz, T., Wu, Y.-H., Tenenbaum, J., Hart, W., et al. (2023) · Proceedings of the National Academy of Sciences of the United States of America · doi:10.1073/pnas.2318124121 · Cited by 130 · see citing works
Uncertainty Visualization: Concepts, Methods, and Applications in Biological Data Visualization
Weiskopf, D. (2022) · Frontiers in Bioinformatics · doi:10.3389/fbinf.2022.793819 · Cited by 50 · see citing works
Xie, X., Du, F., & Wu, Y. (2020) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2020.3028957 · Cited by 48 · see citing works
Visualizing Privacy-Utility Trade-Offs in Differentially Private Data Releases
Nanayakkara, P., Bater, J., He, X. Q., Hullman, J. R., & Rogers, J. (2022) · Proceedings on Privacy Enhancing Technologies · doi:10.2478/popets-2022-0058 · Cited by 52 · see citing works
Self-citationDesigning for Interactive Exploratory Data Analysis Requires Theories of Graphical Inference
Hullman, J. R., & Gelman, A. (2021) · Harvard Data Science Review · doi:10.1162/99608f92.3ab8a587 · Cited by 50 · see citing works
Self-citationData Hunches: Incorporating Personal Knowledge into Visualizations
Lin, H., Akbaba, D., Meyer, M., & Lex, A. (2022) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2022.3209451 · Cited by 50 · see citing works
Data Comics for Reporting Controlled User Studies in Human-Computer Interaction
Wang, Z., Ritchie, J., Zhou, J., Chevalier, F., & Bach, B. (2020) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2020.3030433 · Cited by 42 · see citing works
Visualizing Uncertainty for Non-Expert End Users: The Challenge of the Deterministic Construal Error
Joslyn, S. L., & Savelli, S. (2021) · Frontiers in Computer Science · doi:10.3389/fcomp.2020.590232 · Cited by 41 · see citing works
Communicating health information with visual displays
Woloshin, S., Yang, Y., & Fischhoff, B. (2023) · Nature Medicine · doi:10.1038/s41591-023-02328-1 · Cited by 38 · see citing works
Karduni, A., Markant, D. B., Wesslen, R. S., & Wenwen Dou, A. (2020) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2020.3029412 · Cited by 37 · see citing works
Helske, J., Helske, S., Cooper, M., Ynnerman, A., & Besancon, L. (2021) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2021.3073466 · Cited by 38 · see citing works
Uncertainty‐aware Visualization in Medical Imaging ‐ A Survey
Gillmann, C., Saur, D., Wischgoll, T., & Scheuermann, G. (2021) · Computer Graphics Forum · doi:10.1111/cgf.14333 · Cited by 38 · see citing works
Castro, S. C., Quinan, P. S., Hosseinpour, H., & Padilla, L. (2021) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2021.3114803 · Cited by 37 · see citing works
Mannino, M., & Abouzied, A. (2019) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3332165.3347866 · Cited by 35 · see citing works
Interactive Cleaning for Progressive Visualization through Composite Questions
Luo, Y., Chai, C., Qin, X., Tang, N., & Li, G. (2020) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde48307.2020.00069 · Cited by 36 · see citing works
Effects of Uncertainty Visualization on Map-Based Decision Making Under Time Pressure
Korporaal, M., Ruginski, I. T., & Fabrikant, S. (2020) · Frontiers of Computer Science · doi:10.3389/fcomp.2020.00032 · Cited by 33 · see citing works
Improving Visualization Design for Effective Multi-Objective Decision Making
Dy, B., Ibrahim, N., Poorthuis, A., & Joyce, S. C. (2021) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2021.3065126 · Cited by 31 · see citing works
Information, incentives, and goals in election forecasts
Gelman, A., Hullman, J. R., Wlezien, C. B., & Morris, G. E. (2020) · Judgment and Decision Making · doi:10.1017/s1930297500007981 · Cited by 30 · see citing works
Self-citationEveryday Uncertainty: How Blind People Use GenAI Tools for Information Access
Tang, X., Abdolrahmani, A., Gergle, D., & Piper, A. M. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713433 · Cited by 30 · see citing works
Visual‐Interactive Preprocessing of Multivariate Time Series Data
Bernard, J., Hutter, M., Reinemuth, H., Pfeifer, H., Bors, C., & Kohlhammer, J. (2019) · Computer Graphics Forum · doi:10.1111/cgf.13698 · Cited by 29 · see citing works
Vagueness visualization in building models across different design stages
Abualdenien, J., & Borrmann, A. (2020) · Advanced Engineering Informatics · doi:10.1016/j.aei.2020.101107 · Cited by 29 · see citing works
Robot-Assisted Decision-Making: Unveiling the Role of Uncertainty Visualisation and Embodiment
Schömbs, S., Pareek, S., Gonçalves, J., & Johal, W. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642911 · Cited by 28 · see citing works
Bowler, R. D., Bach, B., & Pschetz, L. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3502107 · Cited by 27 · see citing works
Effective uncertainty visualization for aftershock forecast maps
Schneider, M., McDowell, M., Guttorp, P. M., Steel, E. A., & Fleischhut, N. (2022) · Natural hazards and earth system sciences · doi:10.5194/nhess-22-1499-2022 · Cited by 27 · see citing works
Uncertainty-Aware Seasonal-Trend Decomposition Based on Loess
Krake, T., Klötzl, D., Hägele, D., & Weiskopf, D. (2024) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2024.3364388 · Cited by 26 · see citing works
Accounting for uncertainty during a pandemic
Zelner, J., Riou, J., Etzioni, R., & Gelman, A. (2020) · Patterns · doi:10.1016/j.patter.2021.100310 · Cited by 37 · see citing works
Uncertainty Visualization of 2D Morse Complex Ensembles Using Statistical Summary Maps
Athawale, T. M., Maljovec, D., Yan, L., Johnson, C. R., Pascucci, V., & Wang, B. (2020) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2020.3022359 · Cited by 26 · see citing works
Uncertainty VisualizationPreprint
Padilla, L., Kay, M., & Hullman, J. R. (2020) · doi:10.31234/osf.io/ebd6r · Cited by 28 · see citing works
Self-citationMethodological Considerations for Furthering the Understanding of Constraints in Applied Sports
Browne, P. R., Sweeting, A. J., Woods, C. T., & Robertson, S. J. (2021) · Sports Medicine - Open · doi:10.1186/s40798-021-00313-x · Cited by 28 · see citing works
Communicating Uncertainty in Digital Humanities Visualization Research
Panagiotidou, G., Lamqaddam, H., Poblome, J., Brosens, K., Verbert, K., & Moere, A. V. (2022) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2022.3209436 · Cited by 24 · see citing works
Uncertainty Visualisation: An Interactive Visual Survey
Jena, A., Engelke, U., Dwyer, T., Raiamanickam, V., & Paris, C. (2020) · IEEE Pacific Visualization Symposium · doi:10.1109/pacificvis48177.2020.1014 · Cited by 33 · see citing works
Evaluating the Impact of Uncertainty Visualization on Model Reliance
Zhao, J. L., Wang, Y., Mancenido, M. V., Chiou, E. K., & Maciejewski, R. (2023) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2023.3251950 · Cited by 26 · see citing works
Runge, M. C., Shea, K., Howerton, E., Yan, K.-T., Hochheiser, H., Rosenstrom, E. T., Probert, W., Borchering, R., Marathe, M., Lewis, B., et al. (2024) · Epidemics · doi:10.1016/j.epidem.2024.100775 · Cited by 13 · see citing works
The illusion of data validity: Why numbers about people are likely wrong
Jansen, B. J. J., Salminen, J. O., Jung, S., & Almerekhi, H. (2022) · Data and Information Management · doi:10.1016/j.dim.2022.100020 · Cited by 25 · see citing works
Beyond Trust Building — Calibrating Trust in Visual Analytics
Han, W., & Schulz, H. (2020) · IEEE Workshop on TRust and EXpertise in Visual Analytics (TREX) · doi:10.1109/trex51495.2020.00006 · Cited by 19 · see citing works
A uncertainty visual analytics approach for bus travel time
Zhao, W., Wang, G., Wang, Z., Liu, L., Wei, X., & Ya, W. (2022) · Visual Informatics · doi:10.1016/j.visinf.2022.06.002 · Cited by 19 · see citing works
Communicating Uncertainty and Risk in Air Quality Maps
Preston, A., & Ma, K. (2022) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2022.3171443 · Cited by 18 · see citing works
Data visualisation for decision making under deep uncertainty: current challenges and opportunities
Hadjimichael, A., Schlumberger, J., & Haasnoot, M. (2024) · Environmental Research Letters · doi:10.1088/1748-9326/ad858b · Cited by 17 · see citing works
Markant, D. B., Rogha, M., Karduni, A., Wesslen, R. S., & Wenwen Dou, A. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581330 · Cited by 16 · see citing works
Data visualization and domain knowledge: Insights through focus groups of researchers in Spain
Vázquez‐Ingelmo, A., García‐Holgado, A., Verdugo-Castro, S., Therón, R., & García‐Peñalvo, F. J. (2024) · Computers in Human Behavior · doi:10.1016/j.chb.2024.108162 · Cited by 20 · see citing works
Implicit Error, Uncertainty and Confidence in Visualization: An Archaeological Case Study
Panagiotidou, G., Vandam, R., Poblome, J., & Moere, A. V. (2021) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2021.3088339 · Cited by 16 · see citing works
Designing for Ambiguity: Visual Analytics in Avalanche Forecasting
Nowak, S., Bartram, L., & Haegeli, P. (2020) · Visualization · doi:10.1109/vis47514.2020.00023 · Cited by 15 · see citing works
Kerns, S. H., & Wilmer, J. B. (2021) · Journal of Vision · doi:10.1167/jov.21.12.17 · Cited by 16 · see citing works
Uncertainty visualization: Fundamentals and recent developments
Hägele, D., Schulz, C., Beschle, C. A., Booth, H., Butt, M., Barth, A., Deußen, O., & Weiskopf, D. (2022) · it - Information Technology · doi:10.1515/itit-2022-0033 · Cited by 15 · see citing works
Exploring the role of conscientiousness on visualization-supported decision-making
Alves, T., Delgado, T., Henriques‐Calado, J., Gonçalves, D. J. V., & Gama, S. P. (2023) · Computers & Graphics · doi:10.1016/j.cag.2023.01.010 · Cited by 15 · see citing works
Kaur, H., Conrad, M. R., Rule, D., Lampe, C. A. C., & Gilbert, É. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3637354 · Cited by 15 · see citing works
Evaluating the impact of visualization of risk upon emergency route-planning
Cheong, L., Kinkeldey, C., Burfurd, I., Bleisch, S., & Duckham, M. (2019) · International Journal of Geographical Information Systems · doi:10.1080/13658816.2019.1701677 · Cited by 15 · see citing works
Bayesian Methods for Interaction and Design
Williamson, J., Oulasvirta, A., Kristensson, P. O., & Banović, N. (2022) · Cambridge University Press eBooks · doi:10.1017/9781108874830 · Cited by 14 · see citing works
Subjective Probability Correction for Uncertainty Representations
Yang, F., Hedayati, M., & Kay, M. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580998 · Cited by 12 · see citing works
Self-citationComparing the Effectiveness of Visualizations of Different Data Distributions
Rodrigues, A. M. B., Barbosa, G. D. J., Lopes, H., & Barbosa, S. D. J. (2019) · SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI) · doi:10.1109/sibgrapi.2019.00020 · Cited by 14 · see citing works
Improving the Use of Hydrologic Probabilistic and Deterministic Information in Decision-Making
Carr, R., Semmens, K., Montz, B., & Maxfield, K. (2021) · Bulletin of The American Meteorological Society - (BAMS) · doi:10.1175/bams-d-21-0019.1 · Cited by 8 · see citing works
Leffrang, D., & Muller, O. (2021) · IEEE Workshop on TRust and EXpertise in Visual Analytics (TREX) · doi:10.1109/trex53765.2021.00009 · Cited by 14 · see citing works
Xexakis, G., & Trutnevyte, E. (2021) · Global Environmental Change · doi:10.1016/j.gloenvcha.2021.102324 · Cited by 15 · see citing works
Insights and Opportunities for HCI Research into Hurricane Risk Communication
Soden, R., Chilton, L. B., Miles, S. B., Bicksler, R., Villanueva, K. R., & Bica, M. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3502101 · Cited by 13 · see citing works
Milliways: Taming Multiverses through Principled Evaluation of Data Analysis Paths
Sarma, A., Hwang, K., Hullman, J. R., & Kay, M. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642375 · Cited by 13 · see citing works
Self-citationSondag, M., Meulemans, W., Schulz, C., Verbeek, K., Weiskopf, D., & Speckmann, B. (2020) · IEEE Pacific Visualization Symposium · doi:10.1109/pacificvis48177.2020.7614 · Cited by 13 · see citing works
Uncertainty-aware visual analytics: scope, opportunities, and challenges
Maack, R. G. C., Scheuermann, G., Hagen, H., Peñaloza, J. T. H., & Gillmann, C. (2022) · The Visual Computer · doi:10.1007/s00371-022-02733-6 · Cited by 13 · see citing works
Nguyen, F., Qiao, X., Heer, J., & Hullman, J. R. (2020) · Computer Graphics Forum · doi:10.1111/cgf.13902 · Cited by 13 · see citing works
Self-citationWesslen, R., Karduni, A., Markant, D., & Dou, W. (2021) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2021.3114692 · Cited by 15 · see citing works
Uncertainty-Aware Multidimensional Scaling
Hägele, D., Krake, T., & Weiskopf, D. (2022) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2022.3209420 · Cited by 13 · see citing works
Mehdiyev, N., Majlatow, M., & Fettke, P. (2024) · Communications in computer and information science · doi:10.1007/978-3-031-63800-8_21 · Cited by 12 · see citing works
Challenges in Evaluating Interactive Visual Machine Learning Systems
Boukhelifa, N., Bezerianos, A., Chang, R., Collins, C., Drucker, S. M., Endert, A., Hullman, J. R., North, C. L., & Sedlmair, M. (2020) · IEEE Computer Graphics and Applications · doi:10.1109/mcg.2020.3017064 · Cited by 12 · see citing works
Self-citationAlmahmoud, J., DeLine, R. A., & Drucker, S. M. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3463934 · Cited by 11 · see citing works
Studying Early Decision Making with Progressive Bar Charts
Patil, A., Richer, G., Jermaine, C., Moritz, D., & Fekete, J. (2022) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2022.3209426 · Cited by 11 · see citing works
Position Paper: Are We Making Progress In Visualization Research?
Correll, M. (2022) · IEEE Evaluation and Beyond - Methodological Approaches for Visualization (BELIV) · doi:10.1109/beliv57783.2022.00005 · Cited by 11 · see citing works
Self-citationDavidson, T. J., Wall, E., & Mace, J. (2023) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2023.3241596 · Cited by 11 · see citing works
In Dice We Trust: Uncertainty Displays for Maintaining Trust in Election Forecasts Over Time
Yang, F., Mortenson, C. R., Nisbet, E. C., Diakopoulos, N. A., & Kay, M. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642371 · Cited by 19 · see citing works
Self-citationNumerical and Visual Representations of Uncertainty Lead to Different Patterns of Decision Making
Matzen, L. E., Howell, B. C., Trumbo, M., & Divis, K. (2023) · IEEE Computer Graphics and Applications · doi:10.1109/mcg.2023.3299875 · Cited by 10 · see citing works
An empirical study of counterfactual visualization to support visual causal inference
Wang, A. Z., Borland, D., & Gotz, D. (2024) · Information Visualization · doi:10.1177/14738716241229437 · Cited by 11 · see citing works
Using AI Uncertainty Quantification to Improve Human Decision-MakingPreprint
Marusich, L. R., Bakdash, J. Z., Zhou, Y., & Kantarcıoğlu, M. (2023) · doi:10.31234/osf.io/6syfv · Cited by 13 · see citing works
Fitzgerald, K. G., & Tipton, E. (2023) · Journal of Research on Educational Effectiveness · doi:10.1080/19345747.2023.2209082 · Cited by 11 · see citing works
An Analysis of the Interplay and Mutual Benefits of Grounded Theory and Visualization
Diehl, A., Abdul‐Rahman, A., Bach, B., El‐Assady, M., Kraus, M., Laramee, R. S., Keim, D. A., & Chen, M. (2024) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2024.3452985 · Cited by 9 · see citing works
Odds and Insights: Decision Quality in Exploratory Data Analysis Under Uncertainty
Sarma, A., Pu, X., Cui, Y., Correll, M., Brown, E. T., & Kay, M. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3641995 · Cited by 9 · see citing works
Self-citationWhat Do We Actually Learn from Evaluations in the “Heroic Era” of Visualization? : Position Paper
Correll, M. (2020) · doi:10.1109/beliv51497.2020.00013 · Cited by 8 · see citing works
Self-citationŞalap‐Ayça, S., Jankowski, P. L., Clarke, K., & Nara, A. (2021) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2021.105181 · Cited by 8 · see citing works
Rare, but Valuable: Understanding Data-centered Talk in News Website Comment Sections
McInnis, B., Sun, L., Shin, J., & Dow, S. W. (2020) · Proc. ACM Hum. Comput. Interact. · doi:10.1145/3415245 · Cited by 10 · see citing works
Schmidt, S., Rolff, T., Voigt, H., Offe, M., & Steinicke, F. (2024) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3654777.3676454 · Cited by 8 · see citing works
Macgilchrist, F., & Jarke, J. (2025) · Discourse Studies in the Cultural Politics of Education · doi:10.1080/01596306.2025.2467365 · Cited by 7 · see citing works
Holstein, J., Böcking, L., Spitzer, P., Kühl, N., Vössing, M., & Satzger, G. (2025) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3762813 · Cited by 8 · see citing works
Complex model calibration through emulation, a worked example for a stochastic epidemic model
Dunne, M., Mohammadi, H., Challenor, P., Borgo, R., Porphyre, T., Vernon, I., Fırat, E. E., Turkay, Ç., Torsney-Weir, T., Goldstein, M., et al. (2022) · Epidemics · doi:10.1016/j.epidem.2022.100574 · Cited by 7 · see citing works
The Rational Agent Benchmark for Data Visualization
Wu, Y., Guo, Z., Mamakos, M., Hartline, J. D., & Hullman, J. R. (2023) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2023.3326513 · Cited by 8 · see citing works
Self-citationWilmer, J. B., & Kerns, S. H. (2022) · doi:10.31219/osf.io/av5ey · Cited by 7 · see citing works
Communicating Consequences: Visual Narratives, Abstraction, and Polysemy in Rural Bangladesh
Sultana, S., Ahmed, S. I., & Rzeszotarski, J. M. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581149 · Cited by 6 · see citing works
Schäfer, U., Sipos, L., & Müller-Birn, C. (2025) · Proc. ACM Hum. Comput. Interact. · doi:10.1145/3757451 · Cited by 11 · see citing works
Evaluating the Utility of Conformal Prediction Sets for AI-Advised Image Labeling
Zhang, D., Chatzimparmpas, A., Kamali, N., & Hullman, J. R. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642446 · Cited by 6 · see citing works
Self-citationFrom Delays to Densities: Exploring Data Uncertainty through Speech, Text, and Visualization
Stokes, C., Sanker, C., Cogley, B., & Setlur, V. (2024) · Computer Graphics Forum · doi:10.1111/cgf.15100 · Cited by 6 · see citing works
Unmasking Dunning-Kruger Effect in Visual Reasoning & Judgment
Chen, M., Liu, Y., & Wall, E. (2024) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2024.3456326 · Cited by 6 · see citing works
Leffrang, D., & Müller, O. (2024) · Journal of Forecasting · doi:10.1002/for.3222 · Cited by 5 · see citing works
Sun, X., Nakashima, M., Nguyen, C. T., Chen, P., Tang, W. H. W., Kwon, D. H., & Chen, D. J. (2025) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaf095 · Cited by 5 · see citing works
Heltne, A., Frans, N., Hummelen, B., Falkum, E., Germans Selvik, S., & Paap, M. C. S. (2023) · Scandinavian Journal of Psychology · doi:10.1111/sjop.12918 · Cited by 5 · see citing works
- Authors
- Hullman, J., Qiao, X., Correll, M., Kale, A., & Kay, M.
- Affiliations
- Northwestern University (US)
- Tableau Software (United States) (US)
- University of Washington (US)
- University of Michigan (US)
- Venue
- IEEE Transactions on Visualization and Computer Graphics
- Published
- 2019-01
- Volume
- 25
- Issue
- 1
- Pages
- 903-913
- ISSN
- 1077-2626 (ISSN-L)
- 1941-0506
- 2160-9306
- OpenAlex
- W2891628559
- Cited by
- 187
- References
- 93
- Citations by year
- 2026: 18 · 2025: 20 · 2024: 32 · 2023: 22 · 2022: 23 · 2021: 37 · 2020: 23 · 2019: 11 · 2018: 1
- FWCI
- 9.01
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Visualization and Computer Graphics (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Data Visualization and Analytics
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Computer Graphics and Visualization Techniques
- Keywords
- uncertainty visualization, visualization evaluation, evaluation taxonomy, decision quality, performance indicators, user satisfaction, elicitation methods, evaluation goals
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review