The DOI matches its Crossref record; 90 of the 93 references it cites were found in a registry or an index.
In Pursuit of Error: A Survey of Uncertainty Visualization Evaluation
Abstract
Understanding and accounting for uncertainty is critical to effectively reasoning about visualized data. However, evaluating the impact of an uncertainty visualization is complex due to the difficulties that people have interpreting uncertainty and the challenge of defining correct behavior with uncertainty information. Currently, evaluators of uncertainty visualization must rely on general purpose visualization evaluation frameworks which can be ill-equipped to provide guidance with the unique difficulties of assessing judgments under uncertainty. To help evaluators navigate these complexities, we present a taxonomy for characterizing decisions made in designing an evaluation of an uncertainty visualization. Our taxonomy differentiates six levels of decisions that comprise an uncertainty visualization evaluation: the behavioral targets of the study, expected effects from an uncertainty visualization, evaluation goals, measures, elicitation techniques, and analysis approaches. Applying our taxonomy to 86 user studies of uncertainty visualizations, we find that existing evaluation practice, particularly in visualization research, focuses on Performance and Satisfaction-based measures that assume more predictable and statistically-driven judgment behavior than is suggested by research on human judgment and decision making. We reflect on common themes in evaluation practice concerning the interpretation and semantics of uncertainty, the use of confidence reporting, and a bias to…
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Hullman et al. [55] review methods for evaluating the success of uncertainty visualization.”
From Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty (2021) · cites this paper as [55]
Citations
Cites
Prospect Theory: An Analysis of Decision under Risk
Kahneman, D., & Tversky, A. (1979) · Econometrica · doi:10.2307/1914185 · Cited by 48,524
Prospect theory: An analysis of decision under risk
Kahneman, D. J., & Tversky, A. (1988) · Cambridge University Press eBooks · doi:10.1017/cbo9780511609220.014 · Cited by 32,720
Judgment under Uncertainty: Heuristics and Biases
Tversky, A., & Kahneman, D. (1975) · Utility, Probability, and Human Decision Making · doi:10.1007/978-94-010-1834-0_8 · Cited by 22,650
(2011) · Cited by 14,317
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Availability: A heuristic for judging frequency and probability
Tversky, A., & Kahneman, D. (1973) · Cognitive Psychology · doi:10.1016/0010-0285(73)90033-9 · Cited by 9,984 · cited 1×
“Historically, such biases have been attributed to heuristics, the use of simple judgments as a proxy for difficult judgments [49, 90, 91, 92].”
BackgroundJudgment under Uncertainty: Heuristics and Biases
(1982) · doi:10.1017/cbo9780511809477 · Cited by 8,240
“Risk, Ambiguity, and the Savage Axioms.”
Ellsberg, D. (1961) · The Quarterly Journal of Economics · doi:10.2307/1884324 · Cited by 7,891
Anderson, N. H. (2001) · Psychology Press eBooks · doi:10.4324/9781410600004-24 · Cited by 6,939
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702
Allais, M. (1953) · Econometrica · doi:10.2307/1907921 · Cited by 4,054
Simple Heuristics That Make Us Smart
Gigerenzer, G., & Todd, P. M. (1999) · Cited by 3,563
Belief in the law of small numbers.
Tversky, A., & Kahneman, D. (1971) · Psychological Bulletin · doi:10.1037/h0031322 · Cited by 3,246
Guidelines for evaluating and expressing the uncertainty of NIST measurement results
Taylor, B. N. (1994) · National Institute of Standards and Technology, NIST Technical Note 1297 · doi:10.6028/nist.tn.1297 · Cited by 2,833
Ambiguity and Choice in Organizations.
Perrow, C. B., March, J. G., & Olsen, J. P. (1977) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2064777 · Cited by 2,714
Guidelines for evaluating and expressing the uncertainty of NIST measurement results
Taylor, B. N., & Kuyatt, C. E. (2018) · doi:10.6028/nist.tn.1297-1993 · Cited by 2,582
How to improve Bayesian reasoning without instruction: Frequency formats.
Gigerenzer, G., & Hoffrage, U. (1995) · Psychological Review · doi:10.1037/0033-295x.102.4.684 · Cited by 2,190
Lindley, D. V., & Savage, L. J. (1973) · The Mathematical Gazette · doi:10.2307/3615588 · Cited by 1,973
Uncertain Judgements: Eliciting Experts' Probabilities
O'Hagan, A., Buck, C. E., Daneshkhah, A., Eiser, J. R., Garthwaite, P. H., Jenkinson, D. J., Oakley, J. E., & Rakow, T. (2006) · doi:10.1002/0470033312 · Cited by 1,550
Ambiguity and Choice in Organizations
Axelsson, R., March, J. G., & Olsen, J. P. (1977) · Scandinavian Journal of Economics · doi:10.2307/3439574 · Cited by 1,331
Davis, D. D., & Holt, C. A. (1993) · Princeton University Press eBooks · doi:10.1515/9780691233376 · Cited by 992
Coping with Uncertainty: A Naturalistic Decision-Making Analysis
Lipshitz, R., & Strauss, O. (1997) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.1997.2679 · Cited by 922
A Nested Model for Visualization Design and Validation
Munzner, T. (2009) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2009.111 · Cited by 882
Empirical Studies in Information Visualization: Seven Scenarios
Lam, H., Bertini, E., Isenberg, P., Catherine Plaisant, B., & Carpendale, S. (2011) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2011.279 · Cited by 625
Approaches to uncertainty visualization
Pang, A., Wittenbrink, C. M., & Lodha, S. K. (1997) · The Visual Computer · doi:10.1007/s003710050111 · Cited by 548
Visualizing Geospatial Information Uncertainty: What We Know and What We Need to Know
MacEachren, A. M., Robinson, A. C., Hopper, S., Gardner, S., Murray, R., GAHEGAN, M. N., & Hetzler, E. (2005) · Cartography and Geographic Information Science · doi:10.1559/1523040054738936 · Cited by 546
Strategies for evaluating information visualization tools
Shneiderman, B., & Catherine Plaisant, B. (2006) · doi:10.1145/1168149.1168158 · Cited by 399
Researchers Misunderstand Confidence Intervals and Standard Error Bars.
Belia, S., Fidler, F., Williams, J., & Cumming, G. (2005) · Psychological Methods · doi:10.1037/1082-989x.10.4.389 · Cited by 390
Visualizing Uncertain Information
MacEachren, A. M. (1992) · Cartographic Perspectives · doi:10.14714/cp13.1000 · Cited by 375
A Systematic Review on the Practice of Evaluating Visualization
Tobias Isenberg, A., Isenberg, P., Jian, C., Sedlmair, M., & Möller, T. B. (2013) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2013.126 · Cited by 324
A Next Step: Visualizing Errors and Uncertainty
Johnson, C. R., & Sanderson, A. R. (2003) · IEEE Computer Graphics and Applications · doi:10.1109/mcg.2003.1231171 · Cited by 276
Error Bars Considered Harmful: Exploring Alternate Encodings for Mean and Error
Correll, M., & Gleicher, M. (2014) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2014.2346298 · Cited by 258
Self-citationSignatures of a Statistical Computation in the Human Sense of Confidence
Sanders, J. I., Hangya, B., & Kepecs, A. (2016) · Neuron · doi:10.1016/j.neuron.2016.03.025 · Cited by 253
Kay, M., Kola, T., Hullman, J. R., & Munson, S. A. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858558 · Cited by 239
Self-citationOverview and State-of-the-Art of Uncertainty Visualization
Bonneau, G., Hege, H., Johnson, C. R., Oliveira, M. M., Potter, K. C., Rheingans, P. L., & Schultz, T. (2014) · Mathematics and visualization · doi:10.1007/978-1-4471-6497-5_1 · Cited by 211
Hullman, J., Resnick, P., & Adar, E. (2015) · PLOS ONE · doi:10.1371/journal.pone.0142444 · Cited by 194
Self-citationPaese, P. W., & Sniezek, J. (1991) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(91)90008-h · Cited by 188
Uncertainty forecasts improve weather-related decisions and attenuate the effects of forecast error.
Joslyn, S. L., & LeClerc, J. E. (2011) · Journal of Experimental Psychology Applied · doi:10.1037/a0025185 · Cited by 186
From Quantification to Visualization: A Taxonomy of Uncertainty Visualization Approaches
Potter, K. C., Rosen, P., & Johnson, C. R. (2012) · IFIP International Federation for Information Processing/IFIP · doi:10.1007/978-3-642-32677-6_15 · Cited by 186
Decision making under ignorance: Arguing with yourself
Hogarth, R. M., & Kunreuther, H. C. (1995) · Journal of Risk and Uncertainty · doi:10.1007/bf01211526 · Cited by 185
A typology for visualizing uncertainty
Thomson, J., Hetzler, E. G., MacEachren, A. M., GAHEGAN, M. N., & Misha Pavel, C. (2005) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.587254 · Cited by 180
Kinkeldey, C., MacEachren, A. M., & Schiewe, J. (2014) · The Cartographic Journal · doi:10.1179/1743277414y.0000000099 · Cited by 179
Uncertainty Displays Using Quantile Dotplots or CDFs Improve Transit Decision-Making
Fernandes, M., Walls, L., Munson, S., Hullman, J., & Kay, M. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173718 · Cited by 175
Self-citationGraphical Communication of Uncertain Quantities to Nontechnical People
Ibrekk, H., & Morgan, M. G. (1987) · Risk Analysis · doi:10.1111/j.1539-6924.1987.tb00488.x · Cited by 159
Uncertainty Visualization in Medical Volume Rendering Using Probabilistic Animation
Lundström, C. F., Ljung, P., Persson, A., & Ynnerman, A. (2007) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2007.70518 · Cited by 137
Theoretical analysis of uncertainty visualizations
Zuk, T., & Carpendale, S. (2006) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.643631 · Cited by 131
A User Study to Compare Four Uncertainty Visualization Methods for 1D and 2D Datasets
Sanyal, J., Zhang, S., Bhattacharya, G., Amburn, P., & Moorhead, R. J., II (2009) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2009.114 · Cited by 128
Testing Popular Visualization Techniques for Representing Model Uncertainty
Aerts, J. C. J. H., Clarke, K., & Keuper, A. D. (2003) · Cartography and Geographic Information Science · doi:10.1559/152304003100011180 · Cited by 128
The Visualization of Uncertain Data: Methods and Problems.
Griethe, H., & Schumann, H. (2006) · SimVis · Cited by 127
Guidelines for the Display of Attribute Certainty
Leitner, M., & Buttenfield, B. P. (2000) · Cartography and Geographic Information Science · doi:10.1559/152304000783548037 · Cited by 124
Hypothetical Outcome Plots Help Untrained Observers Judge Trends in Ambiguous Data
Kale, A., Nguyen, F., Kay, M., & Hullman, J. (2019) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2018.2864909 · Cited by 122
Self-citationDynamic display of spatial data-reliability: Does it benefit the map user?
Evans, B. J. (1997) · Computers & Geosciences · doi:10.1016/s0098-3004(97)00011-3 · Cited by 120
Lay understanding of probability distributions
Goldstein, D. G., & Rothschild, D. M. (2014) · Judgment and Decision Making · doi:10.1017/s1930297500004940 · Cited by 120
Revealing Uncertainty for Information Visualization
Skeels, M. M., Lee, B., Smith, G., & Robertson, G. G. (2009) · Information Visualization · doi:10.1057/ivs.2009.1 · Cited by 120
Grounded evaluation of information visualizations
Isenberg, P., Zuk, T., Collins, C. M., & Carpendale, S. (2008) · doi:10.1145/1377966.1377974 · Cited by 113
Evaluating Sketchiness as a Visual Variable for the Depiction of Qualitative Uncertainty
Boukhelifa, N., Bezerianos, A., Tobias Isenberg, A., & Fekete, J. (2012) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2012.220 · Cited by 111
Decisions With Uncertainty: The Glass Half Full
Joslyn, S., & LeClerc, J. (2013) · Current Directions in Psychological Science · doi:10.1177/0963721413481473 · Cited by 109
Bar graphs depicting averages are perceptually misinterpreted: The within-the-bar bias
Newman, G. E., & Scholl, B. J. (2012) · Psychonomic Bulletin & Review · doi:10.3758/s13423-012-0247-5 · Cited by 101
Kinkeldey, C., MacEachren, A. M., Riveiro, M., & Schiewe, J. (2015) · Cartography and Geographic Information Science · doi:10.1080/15230406.2015.1089792 · Cited by 95
Value-Suppressing Uncertainty Palettes
Correll, M., Moritz, D., & Heer, J. (2018) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174216 · Cited by 92
Self-citationEvaluating the impact of visualization of wildfire hazard upon decision-making under uncertainty
Cheong, L., Bleisch, S., Kealy, A., Tolhurst, K. G., Wilkening, T. S., & Duckham, M. (2016) · International Journal of Geographical Information Systems · doi:10.1080/13658816.2015.1131829 · Cited by 92
Uncertainty Forecasts Improve Decision Making Among Nonexperts
Nadav-Greenberg, L., & Joslyn, S. L. (2009) · Journal of Cognitive Engineering and Decision Making · doi:10.1518/155534309x474460 · Cited by 87
Relation between belief and performance in perceptual decision making
Drugowitsch, J., Moreno-Bote, R., & Pouget, A. (2014) · PLoS ONE · doi:10.1371/journal.pone.0096511 · Cited by 72
Displaying Uncertainty: Investigating the Effects of Display Format and Specificity
Bisantz, A. M., Marsiglio, S. S., & Munch, J. (2005) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872005775570916 · Cited by 66
Communicating Local Climate Risks Online Through an Interactive Data Visualization
Herring, J., VanDyke, M. S., Cummins, R. G., & Melton, F. (2016) · Environmental Communication · doi:10.1080/17524032.2016.1176946 · Cited by 66
Visual Encodings of Temporal Uncertainty: A Comparative User Study
Gschwandtner, T., Bögl, M., Federico, P., & Miksch, S. (2015) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2015.2467752 · Cited by 65
Navigating the Landscape of Data Literacy: It IS Complex.
Mandinach, E. B., & Gummer, E. S. (2012) · Cited by 59
The effects of experience and task difficulty on accuracy and confidence assessments of auditors
Chung, J. O. Y., & Monroe, G. S. (2000) · Accounting and Finance · doi:10.1111/1467-629x.00040 · Cited by 58
The Perception of Visual UncertaintyRepresentation by Non-Experts
Tak, S., Toet, A., & van Erp, J. B. F. (2014) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2013.247 · Cited by 57
Hullman, J., Kay, M., Kim, Y.-S., & Shrestha, S. (2018) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2017.2743898 · Cited by 55
Self-citationThe Effect of Probabilistic Information on Threshold Forecasts
Joslyn, S. L., Pak, K., Jones, D. A., Pyles, J. A., & Hunt, E. B. (2007) · Weather and Forecasting · doi:10.1175/waf1020.1 · Cited by 54
The disutility of the hard-easy effect in choice confidence
Merkle, E. C. (2009) · Psychonomic Bulletin & Review · doi:10.3758/pbr.16.1.204 · Cited by 46
Visualizing Large-Scale Uncertainty in Astrophysical Data
Li, H., Fu, C., Li, Y., & Hanson, A. J. (2007) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2007.70530 · Cited by 42
The influence of different graphical displays on nonexpert decision making under uncertainty.
Padilla, L., Hansen, G., Ruginski, I. T., Kramer, H., Thompson, W. B., & Creem-Regehr, S. H. (2014) · Journal of Experimental Psychology Applied · doi:10.1037/xap0000037 · Cited by 39
Dong, X., & Hayes, C. C. (2012) · Journal of Cognitive Engineering and Decision Making · doi:10.1177/1555343411432338 · Cited by 36
Evaluating the Perception of Uncertainty in Alternative Visualization Strategies
Blenkinsop, S., Fisher, P. F., Bastin, L., & Wood, J. (2000) · Cartographica The International Journal for Geographic Information and Geovisualization · doi:10.3138/3645-4v22-0m23-3t52 · Cited by 36
Boukhelifa, N., & Duke, D. J. (2009) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/1520340.1520616 · Cited by 36
Visualizing Data Certainty: A Case Study Using Graduated Circle Maps
Edwards, L. D., & Nelson, E. S. (2001) · Cartographic Perspectives · doi:10.14714/cp38.793 · Cited by 32
Why Evaluating Uncertainty Visualization is Error Prone
Hullman, J. R. (2016) · doi:10.1145/2993901.2993919 · Cited by 30
Self-citationKreuzmair, C., Siegrist, M., & Keller, C. (2016) · Risk Analysis · doi:10.1111/risa.12531 · Cited by 27
Hansen, C., Zidowitz, S., Ritter, F., Lange, C., Oldhafer, K. J., & Hahn, H. K. (2012) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-012-0790-6 · Cited by 20
Increasing Users' Confidence in Uncertain Data by Aggregating Data from Multiple Sources
Greis, M., Avci, E., Schmidt, A., & Machulla, T. (2017) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025998 · Cited by 19
End-User Development for Interactive Data Analytics: Uncertainty, Correlation and User Confidence
Zhou, J. J., Arshad, S. Z., Wang, X., Li, Z., Feng, D. D., & Chen, F. (2017) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2017.2723402 · Cited by 14
Computation and visualization of uncertainty in surgical navigation
Simpson, A. L., Ma, B., Vasarhelyi, E. M., Borschneck, D. P., Ellis, R. E., & Stewart, A. J. (2013) · International Journal of Medical Robotics and Computer Assisted Surgery · doi:10.1002/rcs.1541 · Cited by 14
Rößing, C., Reker, A., Gabb, M., Dietmayer, K., & Lensch, H. P. A. (2013) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2013.6629529 · Cited by 10
Daradkeh, M. K. (2015) · International Conference on Engineering & MIS (ICEMIS) · doi:10.1145/2832987.2833050 · Cited by 10
Glymour, C. (2016) · Springer eBooks · doi:10.1007/978-3-319-20451-2_8 · Cited by 9
Uncertainty Visualization for Mobile and Wearable Devices Based Activity Recognition Systems
Dong, M., Chen, L., Wang, L., Jiang, X., & Chen, G. (2016) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2016.1224527 · Cited by 7
Paese, P. W. (1993) · The Journal of Psychology · doi:10.1080/00223980.1993.9915580 · Cited by 1
Ensemble-space visualization improves perception of 3D state of molecular dynamics simulation
Huff, I. J., Weigle, C., & Banks, D. C. (2008) · Symposium on Applied Perception in Graphics and Visualization (APGV) · doi:10.1145/1394281.1394312 · Cited by 1
Research works printed but not linked: 9
- 2006, Completing the forecast Characterizing and communicating uncertainty for better decisions using weather and climate forecasts
- potter, 0, Uncertainty visualization and data references
- quinan, 2015, Towards ecological validity in evaluating uncertainty, Proceedings of Workshop on Visualization for Decision Making Under Uncertainty (VIS'15)
- harrower, 2003, Representing uncertainty Does it help people make better decisions
- hastie, 1982, Concepts in judgment and decision research-anderson bf deane dh hammond kr mcclelland gh shanteau jc
- 10.3758/s13423-012-0247-5 · DOI · Paper page
- 1997, Guide to the Expression of Uncertainty in Measurement
- deitrick, 2012, Evaluating implicit visualization of uncertainty for public policy decision, Proceedings AutoCarto
- 2017, Edelman 2017 edelman trust barometer
Cited by
Sorted by citations
Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty
Bhatt, U., Antorán, J., Zhang, Y., Liao, Q. V., Sattigeri, P., Fogliato, R., Melançon, G., Krishnan, R., Stanley, J., Tickoo, O., et al. (2021) · Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3461702.3462571 · Cited by 300
Effective Use of Likert Scales in Visualization Evaluations: A Systematic Review
South, L., Saffo, D., Vitek, O., Dunne, C., & Borkin, M. A. (2022) · Computer Graphics Forum · doi:10.1111/cgf.14521 · Cited by 242
Lee, C., Yang, T., Inchoco, G. D., Jones, G. M., & Satyanarayan, A. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445211 · Cited by 214
Why Authors Don't Visualize Uncertainty
Hullman, J. R. (2019) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2019.2934287 · Cited by 195
Self-citationEthical Dimensions of Visualization Research
Correll, M. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300418 · Cited by 150
Self-citation
Metadata
- Authors
- Hullman, J., Qiao, X., Correll, M., Kale, A., & Kay, M.
- Affiliations
- Northwestern University (US)
- Tableau Software (United States) (US)
- University of Washington (US)
- University of Michigan (US)
- Venue
- IEEE Transactions on Visualization and Computer Graphics
- Published
- 2019-01
- Volume
- 25
- Issue
- 1
- Pages
- 903-913
- ISSN
- 1077-2626 (ISSN-L)
- 1941-0506
- 2160-9306
- OpenAlex
- W2891628559
- Cited by
- 187
- References
- 93
- Citations by year
- 2026: 18 · 2025: 20 · 2024: 32 · 2023: 22 · 2022: 23 · 2021: 37 · 2020: 23 · 2019: 11
- FWCI
- 9.01
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Visualization and Computer Graphics (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Data Visualization and Analytics
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Computer Graphics and Visualization Techniques
- Keywords
- uncertainty visualization, visualization evaluation, evaluation taxonomy, decision quality, performance indicators, user satisfaction, elicitation methods, evaluation goals
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
