Understanding and characterizing insights: how do people gain insights using information visualization?
The DOI matches its Crossref record; 32 of the 36 references it cites were found in a registry or an index.
Abstract
Even though "providing insight" has been considered one of the main purposes of information visualization (InfoVis), we feel that insight is still a not-well-understood concept in this context. Inspired by research in sensemaking, we realized the importance of the procedural aspects in understanding insight. Thus, rather than asking "What is insight?" we instead focus on "How do people gain insights?" In an effort to better understand and characterize insight, we reviewed previous literature in InfoVis, seeking other researchers' comments and views on this concept. We found that: 1) Insights are often regarded as end results of using InfoVis and the procedures to gain insight have been largely veiled; 2) Four largely distinctive processes of gaining insight (Provide Overview, Adjust, Detect Pattern, and Match Mental Model) have been discussed in the InfoVis literature; and 3) These different processes provide some hints to understand the procedures in which insight can be gained from InfoVis. We hope that our findings help researchers and practitioners evaluate InfoVis systems and technologies in a more insight-oriented way.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Gioia, D. A., Mehra, A., & Weick, K. E. (1996) · The Academy of Management Review · doi:10.2307/259169 · Cited by 15,614 · cited 2×
“Weick [32], an organizational theorist, emphasized this notion of creation by providing a very clear distinction between interpretation and sensemaking.”
BackgroundWallace, A. F. C., & Garfinkel, H. (1968) · American Sociological Review · doi:10.2307/2092245 · Cited by 12,445
The eyes have it: a task by data type taxonomy for information visualizations
Shneiderman, B. (2002) · Proceedings 1996 IEEE Symposium on Visual Languages · doi:10.1109/vl.1996.545307 · Cited by 4,535 · cited 1×
“(Shneiderman, [26], p.336) “The display conveys the look of a 3-”
BackgroundReadings in Information Visualization: Using Vision to Think
Card, S. K., Mackinlay, J. D., & Shneiderman, B. (1999) · Cited by 3,935
(2013) · Information Visualization · doi:10.1016/b978-0-12-381464-7.00018-1 · Cited by 3,742
Why a Diagram is (Sometimes) Worth Ten Thousand Words
Larkin, J. H., & Simon, H. A. (1987) · Cognitive Science · doi:10.1016/s0364-0213(87)80026-5 · Cited by 3,733 · cited 3×
“(Card et al, [4], p. 16 discussing [13]) “Diagrams helped in three ways: (1) by grouping together information that is used together, large amounts of search are avoided.”
BackgroundUser Centered System Design: New Perspectives on Human-Computer Interaction
Anderson, N. S., Norman, D. A., & Draper, S. W. (1988) · The American Journal of Psychology · doi:10.2307/1422802 · Cited by 1,840
Making Sense of Sensemaking 1: Alternative Perspectives
Klein, G., Moon, B., & Hoffman, R. R. (2006) · IEEE Intelligent Systems · doi:10.1109/mis.2006.75 · Cited by 818 · cited 1×
“Sensemaking simply can be defined as “making sense of things” or, drawing from Klein et al. (p.71) [11], more comprehensively described as “a motivated, continuous effort to understand connections (which can be among people, places, and events) in order to anticipate their trajectories and act…”
BackgroundSimple tools for understanding risks: from innumeracy to insight
Gigerenzer, G., & Edwards, A. (2003) · BMJ · doi:10.1136/bmj.327.7417.741 · Cited by 763 · cited 1×
“(Gigerenzer & Edwards, [9], p. 744) “Some cognitive inferences done symbolically can be recoded into inferences done with simple perceptual operations.””
BackgroundThe cost structure of sensemaking
Russell, D. M., Stefik, M. J., Pirolli, P., & Card, S. K. (1993) · Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '93 · doi:10.1145/169059.169209 · Cited by 726 · cited 1×
“Russell et al. [22] describe the sensemaking procedure using Learning Loop Complex theory, which consists of 1) search for representations (generation loop), 2) instantiate representations (data coverage loop), 3) shift representations.”
MethodMaking Sense of Sensemaking 2: A Macrocognitive Model
Klein, Moon, & Hoffman (2006) · IEEE Intelligent Systems · doi:10.1109/mis.2006.100 · Cited by 569 · cited 1×
“These characteristics are well summarized by the Data/Frame Theory of sensemaking of Klein et al. [12].”
BackgroundToward measuring visualization insight
North, C. (2006) · IEEE Computer Graphics and Applications · doi:10.1109/mcg.2006.70 · Cited by 456 · cited 2×
“North acknowledges that defining insight is challenging, although he does provide an insightful characterization of insight [16].”
BackgroundCasual Information Visualization: Depictions of Data in Everyday Life
Pousman, Z., Stasko, J., & Mateas, M. (2007) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2007.70541 · Cited by 421 · cited 1×
“Furthermore, it appears that different kinds of insights exist [19], and researchers are still seeking ways to help make their InfoVis technologies promote greater insight.”
BackgroundSelf-citationShneiderman, B., & Plaisant, C. (2006) · Proceedings of the 2006 AVI workshop on BEyond time and errors: novel evaluation methods for information visualization · doi:10.1145/1168149.1168158 · Cited by 398 · cited 1×
“We anticipate that even more InfoVis evaluation studies will use insight-based evaluation or longitudinal case study techniques in the future (e.g., [21,27]).”
BackgroundA Taxonomy of Clutter Reduction for Information Visualisation
Ellis, G., & Dix, A. (2007) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2007.70535 · Cited by 375 · cited 1×
“Consequently, researchers have sought to reduce clutters in various ways [6].”
BackgroundInformation Visualization: Design for Interaction
Spence, R. (2006) · Cited by 346
An Insight-Based Methodology for Evaluating Bioinformatics Visualizations
Saraiya, P., North, C., & Duca, K. (2005) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2005.53 · Cited by 343 · cited 1×
“The recent growth of visual analytics [29] and the emergence of insight-based evaluation [23,24] elevated the level of interest in insight as a proper evaluation measure of InfoVis.”
BackgroundInformation Visualization: Design for Interaction
Spence, R. (2006) · Cited by 292
Proceedings 1999 IEEE Symposium on Information Visualization (InfoVis'99)
(1999) · Proceedings 1999 IEEE Symposium on Information Visualization (InfoVis'99) · doi:10.1109/infvis.1999.801829 · Cited by 186
An Insight-Based Longitudinal Study of Visual Analytics
Saraiya, P., North, C. L., Lam, V., & Duca, K. (2006) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2006.85 · Cited by 170 · cited 1×
“The recent growth of visual analytics [29] and the emergence of insight-based evaluation [23,24] elevated the level of interest in insight as a proper evaluation measure of InfoVis.”
BackgroundResnikoff, H. L. (1989) · Springer eBooks · doi:10.1007/978-1-4612-3474-6 · Cited by 168
Promoting Insight-Based Evaluation of Visualizations: From Contest to Benchmark Repository
Plaisant, C., Fekete, J.-D., & Grinstein, G. (2008) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2007.70412 · Cited by 145
Baby Names, Visualization, and Social Data Analysis
Wattenberg, M. (2006) · Proceedings of the 2005 IEEE Symposium on Information Visualization (INFOVIS'05) · doi:10.1109/infovis.2005.7 · Cited by 122
Czarniawska, B. (1997) · Scandinavian Journal of Management · doi:10.1016/s0956-5221(97)86666-3 · Cited by 114
Case study: visualizing sets of evolutionary trees
Amenta, N., & Klingner, J. (2003) · IEEE Symposium on Information Visualization, 2002. INFOVIS 2002. · doi:10.1109/infvis.2002.1173150 · Cited by 83 · cited 1×
“(Amenta and Klingner, [2], p. 71) “The TreeMap of the stock market allows monitoring and exploration of many equities.””
BackgroundVisualization's new tack: making sense of information
Gershon, N. D., & Eick, S. G. (1995) · IEEE Spectrum · doi:10.1109/6.469330 · Cited by 61 · cited 1×
“(Gershon and Eick, [8], p. 39) “Simple representations of risk can help professionals and patients move from innumeracy to insight and make consultations more time efficient.””
BackgroundBenefits of information visualization systems for administrative data analysts
González, V. M., & Kobsa, A. (2004) · IEEE Conference on Information Visualization (IV) · doi:10.1109/iv.2003.1217999 · Cited by 27 · cited 3×
“(González and Kobsa, [10], p. 331)”
BackgroundInfluentialMethods for the evaluation of an interactive InfoVis tool supporting exploratory reasoning processes
Rester, M., & Pohl, M. (2006) · doi:10.1145/1168149.1168156 · Cited by 12
Graphic data display for cardiovascular system
Agutter, J. A., Syroid, N., Drews, F. A., Westenskow, D. R., Bermudez, J., & Strayer, D. L. (2005) · IEEE Symposium on Information Visualization · doi:10.1109/infvis.2001.963295 · Cited by 9 · cited 1×
“(Agutter et al, [1], p. 165) “We present three new visual metaphors to help track activity within the VC market and help uncover trends or strategies that can help VC firms make more effective investment decisions.””
BackgroundGraphic Data Display for Cardiovascular System Case Study
Agutter, J. A., Syroid, N., Drews, F. A., Westenskow, D. R., Ancochea, J., & Strayer, D. L. (2001) · IEEE Symposium on Information Visualization · doi:10.1109/infovis.2001.10000 · Cited by 6
Insight-Based Studies for Pathway and Microarray Visualization Tools
Saraiya, P. B. (2006) · VTechWorks (Virginia Tech) · Cited by 4
Demystifying venture capital investing
Chuah, M. C. (2003) · IEEE Symposium on Information Visualization · doi:10.1109/infvis.2002.1173162 · Cited by 3 · cited 1×
“( Chuah, [5], p.161)”
Research works printed but not linked: 11
- 10.5555/772072.772109 · doi:10.5555/772072.772109
- 10.5555/300679 · doi:10.5555/300679
- 10.5555/857191.857747 · doi:10.5555/857191.857747
- 10.1111/j.1551-6708.1987.tb00863.x · DOI · Paper page
- Norman, D. 1993. Things That Make Us Smart. Addison-Wesley, Reading, MA.
- Pirolli, P. and Card, S. 2005. The sensemaking process and leverage points for analyst technology as identified through cognitive task analysis. In Proceedings of International Conference on Intelligence, McLean, VA, USA, 2--4 May 2005 2005.
- 10.5555/60571 · doi:10.5555/60571
- 10.5555/832277.834354 · doi:10.5555/832277.834354
- 10.5555/1196684 · doi:10.5555/1196684
- Thomas J. J. and Cook K. A. 2005. Illuminating the Path IEEE Los Alamitos CA USA.
- 10.5555/329554 · doi:10.5555/329554
Cited by
Knowledge Generation Model for Visual Analytics
Sacha, D., Stoffel, A., Stoffel, F., Kwon, B. C., Ellis, G., & Keim, D. A. (2014) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2014.2346481 · Cited by 387
“[43] go one step further and also consider the processes that involve insights.”
BackgroundApproaches to visualising Linked Data: A survey
Dadzie, A.-S., & Rowe, M. (2011) · Semantic Web · doi:10.3233/sw-2011-0037 · Cited by 220
“…familiar metaphor for navigation through unfamiliar geographical spaces, removes the technical barrier to LD consumption, enabling the (lay-)user to make use of experience in the real world to navigate the Web of Data ([74] explains the power in adopting metaphors in real life for visual analysis).”
BackgroundBörner, K., Maltese, A., Balliet, R. N., & Heimlich, J. (2016) · Information Visualization · doi:10.1177/1473871615594652 · Cited by 203
A conceptual framework linking learning design with learning analytics
Bakharia, A., Corrin, L., de Barba, P., Kennedy, G., Gašević, D., Mulder, R., Williams, D., Dawson, S., & Lockyer, L. (2016) · Proceedings of the Sixth International Conference on Learning Analytics & Knowledge - LAK '16 · doi:10.1145/2883851.2883944 · Cited by 164
“Yi, et al. [24], define pattern detection as a “means to find specific distributions, trends, frequencies, outliers, or structure in the dataset” and go on to say that by using pattern detection, “people may not only find what they have been looking for but also discover new knowledge that they did not…”
BackgroundAccessible Visualization via Natural Language Descriptions: A Four-Level Model of Semantic Content
Lundgard, A., & Satyanarayan, A. (2022) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2021.3114770 · Cited by 155
Metadata
- Authors
- Yi, J. S., Kang, Y.-A., Stasko, J. T., & Jacko, J. A.
- Affiliations
- Georgia Institute of Technology (US)
- GVU Center Georgia Institute of Technology, NW Atlanta, GA
- University of Minnesota (US)
- Venue
- Proceedings of the 2008 Workshop on BEyond time and errors: novel evaLuation methods for Information Visualization
- Publisher
- ACM
- Published
- 2008-04-05
- Pages
- 1-6
- OpenAlex
- W2063534350
- Cited by
- 175
- References
- 36
- Citations by year
- 2026: 4 · 2025: 7 · 2024: 4 · 2023: 9 · 2022: 9 · 2021: 8 · 2020: 12 · 2019: 13 · 2018: 12 · 2017: 13 · 2016: 10 · 2015: 21 · 2014: 10 · 2013: 11 · 2012: 7
- FWCI
- 6.67
- Type
- conference paper
- Language
- en
- Open access
- closed
- Funders
- National Science Foundation
- U.S. Department of Homeland Security
- Topics
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Data Visualization and Analytics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Computer Graphics and Visualization Techniques
- Keywords
- insight, information visualization, sensemaking, mental models, pattern detection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.