Explaining the Gap: Visualizing One's Predictions Improves Recall and Comprehension of Data
The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
Information visualizations use interactivity to enable user-driven querying of visualized data. However, users' interactions with their internal representations, including their expectations about data, are also critical for a visualization to support learning. We present multiple graphically-based techniques for eliciting and incorporating a user's prior knowledge about data into visualization interaction. We use controlled experiments to evaluate how graphically eliciting forms of prior knowledge and presenting feedback on the gap between prior knowledge and the observed data impacts a user's ability to recall and understand the data. We find that participants who are prompted to reflect on their prior knowledge by predicting and self-explaining data outperform a control group in recall and comprehension. These effects persist when participants have moderate or little prior knowledge on the datasets. We discuss how the effects differ based on text versus visual presentations of data. We characterize the design space of graphical prediction and feedback techniques and describe design recommendations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The psychology of curiosity: A review and reinterpretation.
Loewenstein, G. (1994) · Psychological Bulletin · doi:10.1037/0033-2909.116.1.75 · Cited by 2,738 · cited 3×
“Prompting people to guess is thought to be one way to arouse curiosity by making this gap explicit [34].”
BackgroundConfirmation, disconfirmation, and information in hypothesis testing
Klayman, J., & Ha, Y.-W. (1987) · Psychological Review · doi:10.1037/0033-295x.94.2.211 · Cited by 2,094 · cited 1×
“Awareness of the gap results in an increasing desire to seek knowledge to fill this gap [34], and inspires people to explore more information [29], including in crowdsourcing contexts [32].”
BackgroundCognitive Theory of Multimedia Learning
Mayer, R. E. (2014) · The Cambridge Handbook of Multimedia Learning · doi:10.1017/cbo9781139547369.005 · Cited by 1,976
Self‐Explanations: How Students Study and Use Examples in Learning to Solve Problems
Chi, M. T. H., Bassok, M., Lewis, M. W., Reimann, P., & Glaser, R. (1989) · Cognitive Science · doi:10.1207/s15516709cog1302_1 · Cited by 1,714
Cognitive Theory of Multimedia Learning
Mayer, R. E. (2005) · The Cambridge Handbook of Multimedia Learning · doi:10.1017/cbo9780511816819.004 · Cited by 1,602
Cosmides, L. (1996) · Cognition · doi:10.1016/0010-0277(95)00664-8 · Cited by 1,293 · cited 1×
“Other studies suggest that externalizing one’s internal representations leads to better understanding of visualized information [15, 24, 37, 46].”
BackgroundAleven, V. A. W. M. M., & Koedinger, K. R. (2002) · Cognitive Science · doi:10.1207/s15516709cog2602_1 · Cited by 895
Eliciting Self‐Explanations Improves Understanding
Chi, M. T. H., De Leeuw, N., Chiu, M., & Lavancher, C. (1994) · Cognitive Science · doi:10.1207/s15516709cog1803_3 · Cited by 757
Bielaczyc, K., Pirolli, P. L., & Brown, A. L. (1995) · Cognition and Instruction · doi:10.1207/s1532690xci1302_3 · Cited by 422 · cited 2×
“While students who spontaneously generate self-explanations perform better [11, 18, 39, 40, 41], most learners tend not to naturally self-explain [5, 43].”
BackgroundThe Roles of Mental Animations and External Animations in Understanding Mechanical Systems
Hegarty, M., Kriz, S., & Cate, C. (2003) · Cognition and Instruction · doi:10.1207/s1532690xci2104_1 · Cited by 404 · cited 3×
“Similarly, Hegarty et al. [23] found that viewers who initially engaged in mental animation of a set of static views, then used an external animated visualization, understood the content better than those who used only the animated visualization.”
BackgroundResult
Cited by
Manipulating and Measuring Model Interpretability
Poursabzi-Sangdeh, F., Goldstein, D. G., Hofman, J. M., Vaughan, J. W., & Wallach, H. (2018) · arXiv · doi:10.48550/arxiv.1802.07810 · Cited by 711
Manipulating and Measuring Model Interpretability
Poursabzi-Sangdeh, F., Goldstein, D. G., Hofman, J. M., Wortman Vaughan, J. W., & Wallach, H. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445315 · Cited by 728
“Indeed, this idea is supported by recent research, which found that eliciting predictions and presenting feedback is beneficial for people’s memory and comprehension of data points [52].”
ResultHuman factors in model interpretability: Industry practices, challenges, and needs
Hong, S. R., Hullman, J., & Bertini, E. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3392878 · Cited by 219
“Our identification of unaddressed technological needs among practitioners is intended to help researchers direct their attention to unaddressed, yet prevalent, challenges in industry.”
Self-citationA Bayesian Cognition Approach to Improve Data Visualization
Kim, Y.-S., Walls, L. A., Krafft, P., & Hullman, J. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300912 · Cited by 76
“show that asking visualization users to “draw” their predictions in an interactive visualization prior to seeing the observed data can help them remember data 30% better [29, 30], perhaps by increasing their ability to compare the observed data to their expectations.”
BackgroundInfluentialSelf-citationKim, Y.-S., Reinecke, K., & Hullman, J. (2018) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2017.2745240 · Cited by 60
“This expectation is supported by recent work that indicates that asking a viewer to predict the data in a visualization then showing their prediction against the data can result in improved recall [24].”
BackgroundMethodInfluentialSelf-citation
Metadata
- Authors
- Kim, Y.-S., Reinecke, K., & Hullman, J.
- Venue
- Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2017-05-02
- Pages
- 1375-1386
- OpenAlex
- W2611586694
- Cited by
- 105
- References
- 13
- FWCI
- 2.91
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Explaining the Gap: Visualizing One's Predictions Improves Recall and Comprehension of Data. https://app.cochat.ai/papers/10.1145/3025453.3025592
- The paper
- Kim, Y.-S., Reinecke, K., & Hullman, J. (2017). Explaining the Gap: Visualizing One's Predictions Improves Recall and Comprehension of Data. Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3025453.3025592
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.