Understanding and characterizing insights: how do people gain insights using information visualization?
The DOI matches its Crossref record; 32 of the 36 references it cites were found in a registry or an index.
Abstract
Even though "providing insight" has been considered one of the main purposes of information visualization (InfoVis), we feel that insight is still a not-well-understood concept in this context. Inspired by research in sensemaking, we realized the importance of the procedural aspects in understanding insight. Thus, rather than asking "What is insight?" we instead focus on "How do people gain insights?" In an effort to better understand and characterize insight, we reviewed previous literature in InfoVis, seeking other researchers' comments and views on this concept. We found that: 1) Insights are often regarded as end results of using InfoVis and the procedures to gain insight have been largely veiled; 2) Four largely distinctive processes of gaining insight (Provide Overview, Adjust, Detect Pattern, and Match Mental Model) have been discussed in the InfoVis literature; and 3) These different processes provide some hints to understand the procedures in which insight can be gained from InfoVis. We hope that our findings help researchers and practitioners evaluate InfoVis systems and technologies in a more insight-oriented way.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Gioia, D. A., Mehra, A., & Weick, K. E. (1996) · The Academy of Management Review · doi:10.2307/259169 · Cited by 15,614 · cited 2×
“Weick [32], an organizational theorist, emphasized this notion of creation by providing a very clear distinction between interpretation and sensemaking.”
BackgroundWallace, A. F. C., & Garfinkel, H. (1968) · American Sociological Review · doi:10.2307/2092245 · Cited by 12,445
The eyes have it: a task by data type taxonomy for information visualizations
Shneiderman, B. (2002) · Proceedings 1996 IEEE Symposium on Visual Languages · doi:10.1109/vl.1996.545307 · Cited by 4,535 · cited 1×
“(Shneiderman, [26], p.336) “The display conveys the look of a 3-”
BackgroundReadings in Information Visualization: Using Vision to Think
Card, S. K., Mackinlay, J. D., & Shneiderman, B. (1999) · Cited by 3,935
(2013) · Information Visualization · doi:10.1016/b978-0-12-381464-7.00018-1 · Cited by 3,742
Why a Diagram is (Sometimes) Worth Ten Thousand Words
Larkin, J. H., & Simon, H. A. (1987) · Cognitive Science · doi:10.1016/s0364-0213(87)80026-5 · Cited by 3,733 · cited 3×
“(Card et al, [4], p. 16 discussing [13]) “Diagrams helped in three ways: (1) by grouping together information that is used together, large amounts of search are avoided.”
BackgroundUser Centered System Design: New Perspectives on Human-Computer Interaction
Anderson, N. S., Norman, D. A., & Draper, S. W. (1988) · The American Journal of Psychology · doi:10.2307/1422802 · Cited by 1,840
Making Sense of Sensemaking 1: Alternative Perspectives
Klein, G., Moon, B., & Hoffman, R. R. (2006) · IEEE Intelligent Systems · doi:10.1109/mis.2006.75 · Cited by 818 · cited 1×
“Sensemaking simply can be defined as “making sense of things” or, drawing from Klein et al. (p.71) [11], more comprehensively described as “a motivated, continuous effort to understand connections (which can be among people, places, and events) in order to anticipate their trajectories and act…”
BackgroundSimple tools for understanding risks: from innumeracy to insight
Gigerenzer, G., & Edwards, A. (2003) · BMJ · doi:10.1136/bmj.327.7417.741 · Cited by 763 · cited 1×
“(Gigerenzer & Edwards, [9], p. 744) “Some cognitive inferences done symbolically can be recoded into inferences done with simple perceptual operations.””
BackgroundThe cost structure of sensemaking
Russell, D. M., Stefik, M. J., Pirolli, P., & Card, S. K. (1993) · Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '93 · doi:10.1145/169059.169209 · Cited by 726 · cited 1×
“Russell et al. [22] describe the sensemaking procedure using Learning Loop Complex theory, which consists of 1) search for representations (generation loop), 2) instantiate representations (data coverage loop), 3) shift representations.”
Method
Research works printed but not linked: 11
- 10.5555/772072.772109 · doi:10.5555/772072.772109
- 10.5555/300679 · doi:10.5555/300679
- 10.5555/857191.857747 · doi:10.5555/857191.857747
- 10.1111/j.1551-6708.1987.tb00863.x · DOI · Paper page
- Norman, D. 1993. Things That Make Us Smart. Addison-Wesley, Reading, MA.
- Pirolli, P. and Card, S. 2005. The sensemaking process and leverage points for analyst technology as identified through cognitive task analysis. In Proceedings of International Conference on Intelligence, McLean, VA, USA, 2--4 May 2005 2005.
- 10.5555/60571 · doi:10.5555/60571
- 10.5555/832277.834354 · doi:10.5555/832277.834354
- 10.5555/1196684 · doi:10.5555/1196684
- Thomas J. J. and Cook K. A. 2005. Illuminating the Path IEEE Los Alamitos CA USA.
- 10.5555/329554 · doi:10.5555/329554
Cited by
Knowledge Generation Model for Visual Analytics
Sacha, D., Stoffel, A., Stoffel, F., Kwon, B. C., Ellis, G., & Keim, D. A. (2014) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2014.2346481 · Cited by 387
“[43] go one step further and also consider the processes that involve insights.”
BackgroundApproaches to visualising Linked Data: A survey
Dadzie, A.-S., & Rowe, M. (2011) · Semantic Web · doi:10.3233/sw-2011-0037 · Cited by 220
“…familiar metaphor for navigation through unfamiliar geographical spaces, removes the technical barrier to LD consumption, enabling the (lay-)user to make use of experience in the real world to navigate the Web of Data ([74] explains the power in adopting metaphors in real life for visual analysis).”
BackgroundBörner, K., Maltese, A., Balliet, R. N., & Heimlich, J. (2016) · Information Visualization · doi:10.1177/1473871615594652 · Cited by 203
A conceptual framework linking learning design with learning analytics
Bakharia, A., Corrin, L., de Barba, P., Kennedy, G., Gašević, D., Mulder, R., Williams, D., Dawson, S., & Lockyer, L. (2016) · Proceedings of the Sixth International Conference on Learning Analytics & Knowledge - LAK '16 · doi:10.1145/2883851.2883944 · Cited by 164
“Yi, et al. [24], define pattern detection as a “means to find specific distributions, trends, frequencies, outliers, or structure in the dataset” and go on to say that by using pattern detection, “people may not only find what they have been looking for but also discover new knowledge that they did not…”
BackgroundAccessible Visualization via Natural Language Descriptions: A Four-Level Model of Semantic Content
Lundgard, A., & Satyanarayan, A. (2022) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2021.3114770 · Cited by 155
Distributed Cognition as a Theoretical Framework for Information Visualization
Liu, Z., Nersessian, N. J., & Stasko, J. (2008) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2008.121 · Cited by 192
“In trying to understand how effectively our designs support this claim, InfoVis researchers are beginning to ask what insight is, how to measure insight and how insight is generated [25, 38].”
BackgroundSelf-citationDefining Insight for Visual Analytics
Chang, R., Ziemkiewicz, C., Green, T. M., & Ribarsky, W. (2009) · IEEE Computer Graphics and Applications · doi:10.1109/mcg.2009.22 · Cited by 146
“The idea that visualization should lead to insight seems logical, but researchers in the community have been slow to build on the concept because it is difficult to define what insight is [7, 8, 9, 11].”
BackgroundCharacterizing Visualization Insights from Quantified Selfers' Personal Data Presentations
Choe, E. K., Lee, B., & schraefel, M. C. (2015) · IEEE Computer Graphics and Applications · doi:10.1109/mcg.2015.51 · Cited by 124
Designing in Context: Reaching Beyond Usability in Learning Analytics Dashboard Design
Ahn, J., Campos, F., Hays, M., & Digiacomo, D. (2019) · Journal of Learning Analytics · doi:10.18608/jla.2019.62.5 · Cited by 108
“Yi, Kang, Stasko and Jacko (2008) argue that the basic building block of sensemaking is the generation of insights, which can be fostered not only through well-designed digital interfaces but also by promoting user's engagement with the data and reducing undesired cognitive load.”
BackgroundA Cognitive Interpretation of Data Analysis
Grolemund, G., & Wickham, H. (2014) · International Statistical Review · doi:10.1111/insr.12028 · Cited by 108
“…den Bosch, 2009); organizational studies (Weick, 1995; Weick et al., 2005); computer science (Attfield and Blandford, 2009; Russell et al., 1993); knowledge management (Dervin, 1998); intelligence analysis (Pirolli and Card, 2005); InfoVis (Yi et al., 2008); and Visual Analytics (Wu et al., 2010).”
BackgroundCollaboVR: A Reconfigurable Framework for Creative Collaboration in Virtual Reality
He, Z., Du, R.-F., & Perlin, K. (2020) · International Symposium on Mixed and Augmented Reality · doi:10.1109/ismar50242.2020.00082 · Cited by 93
“Given that sensemaking involves data analysis [89], different designs of 2D displays and digital tabletop are frequently discussed.”
BackgroundEvaluating the Effect of Style in Information Visualization
Vande Moere, A., Tomitsch, M., Wimmer, C., Christoph, B., & Grechenig, T. (2012) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2012.221 · Cited by 92
“Although a commonly accepted definition of insight has yet to emerge in the community, some early classifications [4, 5] and insight-acquiring processes [33] have already been proposed.”
BackgroundGuo, H., Gomez, S. R., Ziemkiewicz, C., & Laidlaw, D. H. (2015) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2015.2467613 · Cited by 126
“summarized four high-level processes through which users gain insights when using a visualization system [33], supporting the view that interaction Abstract actions Application-specific actions Individual actions Patterns Uttered insights Video segments ! Interaction log visualization ! Transition Matrices”
Trust, but Verify: Optimistic Visualizations of Approximate Queries for Exploring Big Data
Moritz, D., Fisher, D., Ding, B., & Wang, C. (2017) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025456 · Cited by 110
“An insight can bring in external context and the results of a number of queries; an example might be “the biggest airlines have trouble with congestion near the holidays, while smaller airlines do not” [43, 28].”
BackgroundBoyandin, I., Bertini, E., & Lalanne, D. (2012) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2012.03093.x · Cited by 93
VA2: A Visual Analytics Approach for Evaluating Visual Analytics Applications
Blascheck, T., John, M., Kurzhals, K., Koch, S., & Ertl, T. (2015) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2015.2467871 · Cited by 106
Value-driven evaluation of visualizations
Stasko, J. (2014) · Workshop on Beyond Time and Errors · doi:10.1145/2669557.2669579 · Cited by 95
“It is a by-product of exploration, not a task-driven result of analysis [38].”
BackgroundSelf-citationAn Exploratory Study of Data Sketching for Visual Representation
Walny, J., Huron, S., & Carpendale, S. (2015) · Computer Graphics Forum · doi:10.1111/cgf.12635 · Cited by 88
Kim, S.-H., Dong, Z., Xian, H., Upatising, B., & Yi, J. S. (2012) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2012.215 · Cited by 84
Self-citationMartínez‐Maldonado, R. (2019) · International Journal of Computer-Supported Collaborative Learning · doi:10.1007/s11412-019-09308-z · Cited by 83
Wallace, J. R., Scott, S. D., & MacGregor, C. G. (2013) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2466458 · Cited by 74
“This model closely resembles the one proposed by Yi et al. [39], where cluster and record would both be considered aspects of the adjust steps.”
MethodInfluentialLuo, W. P., & MacEachren, A. M. (2014) · Journal of Spatial Information Science · doi:10.5311/josis.2014.8.139 · Cited by 72
Toward effective insight management in visual analytics systems
Chen, Y., Yang, J., & Ribarsky, W. (2009) · IEEE Pacific Visualization Symposium · doi:10.1109/pacificvis.2009.4906837 · Cited by 74
“[33] argued that insights are more likely a by-product of exploration without an initial destination.”
BackgroundTelling Stories with Data Visualization
Rodríguez, M. T., Nunes, S., & Devezas, T. (2015) · doi:10.1145/2804565.2804567 · Cited by 69
““Providing insight” is considered to be the main objective of using information visualization and the by-product of an ongoing exploration with the visualization [7], and is important to understand what this process consists of.”
BackgroundDefining and applying knowledge conversion processes to a visual analytics system
Wang, X., Jeong, D. H., Dou, W., Lee, S.-W., Ribarsky, W., & Chang, R. (2009) · Computers & Graphics · doi:10.1016/j.cag.2009.06.004 · Cited by 59
You can't always sketch what you want: Understanding Sensemaking in Visual Query Systems
Lee, D. J., Lee, J., Siddiqui, T., Kim, J., Karahalios, K. G., & Parameswaran, A. (2019) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2019.2934666 · Cited by 62
“Cognitive measures such as insight time [22], [23] have been developed to capture how well users perform on a task against existing baselines.”
BackgroundCommunicative Visualizations as a Learning Problem
Adar, E., & Lee-Robbins, E. (2020) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2020.3030375 · Cited by 64
Towards interactive, intelligent, and integrated multimedia analytics
Zahálka, J., & Worring, M. (2014) · IEEE Conference on Visual Analytics Science and Technology (VAST) · doi:10.1109/vast.2014.7042476 · Cited by 57
“Insight is maybe the most used term for abstract knowledge gain, appearing both in information visualization [62][95] and visual analytics [40][41][78].”
BackgroundFan, D., Fay Siu, A., Rao, H., Kim, G. S.-H., Vazquez, X., Greco, L., O'Modhrain, S., & Follmer, S. (2023) · ACM Transactions on Accessible Computing · doi:10.1145/3557899 · Cited by 46
“Initial codes were framed as processes that lead to data insights (overview, adjust, detect pattern, match mental model) [129].”
BackgroundGetting the Message?: A Study of Explanation Interfaces for Microblog Data Analysis
Schaffer, J., Giridhar, P., Jones, D., Höllerer, T., Abdelzaher, T., & O'Donovan, J. (2015) · Proceedings of the 20th International Conference on Intelligent User Interfaces · doi:10.1145/2678025.2701406 · Cited by 39
“The visual analytics community has begun to favor openended protocols over benchmark tasks for the evaluation of interactive interfaces [7][17][28].”
The User Puzzle—Explaining the Interaction with Visual Analytics Systems
Pohl, M., Smuc, M., & Mayr, E. (2012) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2012.273 · Cited by 49
“[64] also discuss that there is no common definition of the concept of insight in information visualization and visual analytics.”
BackgroundSiu, A. F., Fan, D., Kim, G. S.-H., Rao, H. V., Vazquez, X., O'Modhrain, S., & Follmer, S. (2021) · Proceedings of the 18th International Web for All Conference · doi:10.1145/3430263.3452432 · Cited by 37
“processes that lead to data insights (overview, adjust, detect pattern, match mental model) [101].”
BackgroundMaking Sense of Sensemaking: Understanding How K–12 Teachers and Coaches React to Visual Analytics
Campos, F., Ahn, J., DiGiacomo, D. K., Nguyen, H., & Hays, M. (2021) · Journal of Learning Analytics · doi:10.18608/jla.2021.7113 · Cited by 47
Towards a Taxonomy for Evaluating User Engagement in Information Visualization
Mahyar, N., Kim, S.-H., & Kwon, B. C. (2015) · Cited by 37
Bridging the Gap of Domain and Visualization Experts with a Liaison
Simon, S., Mittelstädt, S., Keim, D. A., & Sedlmair, M. (2015) · Eurographics · doi:10.2312/eurovisshort.20151137 · Cited by 36
Group vs Individual: Impact of TOUCH and TILT Cross-Device Interactions on Mixed-Focus Collaboration
Homaeian, L., Goyal, N., Wallace, J. R., & Scott, S. D. (2018) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173647 · Cited by 34
“[41] propose an insight-based evaluation model that consists of four activities performed during sensemaking, (1) overview, (2) ad-”
BackgroundFrom Visualization to Visually Enabled Reasoning
Meyer, J., Thomas, J., Diehl, S., Fisher, B., & Keim, D. A. (2010) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/dfu.sciviz.2010.227 · Cited by 49
“point out [32], although a few definitions of insight exist, no commonly accepted definition has emerged in the community.”
BackgroundUsing data to stimulate creative thinking in the design of new products and services
Dove, G., & Jones, S. (2014) · Designing Interactive Systems Conference · doi:10.1145/2598510.2598564 · Cited by 39
“The remaining three were concerned with the extent to which the visualizations supported insight seeking during the second workshop activity, and were derived from work describing how users gain insight from information visualization by Yi et al [46] and North [28].”
Data Portraits and Intermediary Topics: Encouraging Exploration of Politically Diverse Profiles
Graells-Garrido, E., Lalmas, M., & Baeza-Yates, R. A. (2016) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/2856767.2856776 · Cited by 38
“Yi et al. [67] identify four cognitive processes that lead to insights gained through visualization: provide overview , adjust , detect pattern , and match mental model .”
Background"What Happened Here!?" A Taxonomy for User Interaction with Spatio-Temporal Game Data Visualization
Kleinman, E., Preetham, N., Teng, Z., Bryant, A., & El‐Nasr, M. S. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3474687 · Cited by 30
“…into three categories: Data Interaction (consisting of “study positioning to construct context", “study movement to infer decisions", and “seek details to support sense-making"), Sense Making (consisting of “leverage domain knowledge to fill gaps", “form a hypothesis of context and behavior that…”
BackgroundInfluentialTriangulating user behavior using eye movement, interaction, and think aloud data
Blascheck, T., John, M., Koch, S., Bruder, L., & Ertl, T. (2016) · ACM Symposium on Eye Tracking Research and Applications (ETRA) · doi:10.1145/2857491.2857523 · Cited by 33
Freitas, C. M. D. S., Pimenta, M. S., & Scapin, D. L. (2014) · Handbook of Human Centric Visualization · doi:10.1007/978-1-4614-7485-2_12 · Cited by 28
What Do We Mean When We Say “Insight”? A Formal Synthesis of Existing Theory
Battle, L., & Ottley, A. (2023) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2023.3326698 · Cited by 34
“Specific to insights, several taxonomies target common insight generation processes to predict insight scope, rigor, and complexity [8], [29], [32].”
BackgroundInfluentialThe Case for Visual Analytics of Arsenic Concentrations in Foods
Johnson, M. O., Cohly, H., Isokpehi, R. D., & Awofolu, O. R. (2010) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph7051970 · Cited by 28
Evaluating the relationship between user interaction and financial visual analysis
Jeong, D. H., Dou, W., Lipford, H. R., Stukes, F., Chang, R., & Ribarsky, W. (2008) · IEEE Conference on Visual Analytics Science and Technology (VAST) · doi:10.1109/vast.2008.4677360 · Cited by 28
“More recently, Yi et al. performed extensive literature review and created a categorization of how people gain insight through information visualization [15].”
BackgroundInsight Beyond Numbers: The Impact of Qualitative Factors on Visual Data Analysis
Karer, B., Hagen, H., & Lehmann, D. J. (2020) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2020.3030376 · Cited by 29
Narrative Visualization: Sharing Insights into Complex Data
Dove, G., & Jones, S. (2012) · City Research Online (City University London) · Cited by 53
Selected Human Factors Issues in Information Visualization
Robertson, G. G., Czerwinski, M. P., Fisher, D., & Lee, B. (2009) · Reviews of Human Factors and Ergonomics · doi:10.1518/155723409x448017 · Cited by 34
An Exploratory Study on Visual Exploration of Model Simulations by Multiple Types of Experts
Boukhelifa, N., Bezerianos, A., Trelea, I.-C., Perrot, N., & Lutton, É. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300874 · Cited by 28
“[58] describe four key processes of how people reach insight: provide overview, adjust, detect pattern, and match mental model.”
BackgroundRyu, H., Berry, A. B. L., Lim, C. Y., Hartzler, A. L., Hirsch, T., Trejo, J. I., Bermet, Z. A., Crawford-Gallagher, B., Tran, V., Ferguson, D. M., et al. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580908 · Cited by 31
“[85] on the insight gaining process, specifically “providing overview” and “adjusting”.”
BackgroundInfluentialThe Impact of a Narrative Design Strategy for Information Visualization on a Public Display
Claes, S., & Moere, A. V. (2017) · Designing Interactive Systems Conference · doi:10.1145/3064663.3064684 · Cited by 23
Becheru, A., Calota, A., & Popescu, E. (2018) · Smart Learning Environments · doi:10.1186/s40561-018-0063-0 · Cited by 24
“Indeed, as mentioned in the introduction, visualization methods should be easily correlated with humans’ mental map (insight gaining process P4 (Yi et al., 2008)), thus reducing the comprehension effort.”
InfluentialImage or Information? Examining the Nature and Impact of Visualization Perceptual Classification
Arunkumar, A., Padilla, L., Bae, G., & Bryan, C. (2023) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2023.3326919 · Cited by 24
Interactive visualization for research contextualization in international business
Schotter, A. P. J., Buchel, O., & Vashchilko, T. (2017) · Journal of World Business · doi:10.1016/j.jwb.2017.01.006 · Cited by 23
Gibson, A., & Martínez‐Maldonado, R. (2017) · Australian Conference on Computer-Human Interaction (OzCHI) · doi:10.1145/3152771.3156171 · Cited by 22
Visualizing differential principal turnover
Davis, B. W., & Anderson, E. (2020) · Journal of Educational Administration · doi:10.1108/jea-03-2020-0054 · Cited by 22
What Exactly is an Insight? A Literature Review
Battle, L., & Ottley, A. (2023) · Visualization · doi:10.1109/vis54172.2023.00027 · Cited by 23
“Cited By [9, 53] [19, 30, 56, 55] [25, 19, 52, 5, 26]”
BackgroundInfluentialWireless sensor network security visualization
Karapistoli, E., & Economides, A. A. (2012) · International Congress on Ultra Modern Telecommunications and Control Systems and Workshops (ICUMT) · doi:10.1109/icumt.2012.6459781 · Cited by 18
A Full-Scale Security Visualization Effectiveness Measurement and Presentation Approach
Garae, J., Ko, R. K. L., & Apperley, M. D. (2018) · IEEE International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom) · doi:10.1109/trustcom/bigdatase.2018.00095 · Cited by 18
“‘Insight’ [40] is defined as gaining accurate and deep”
BackgroundMethodVisualizing risks in cancer communication: A systematic review of computer-supported visual aids
Stellamanns, J., Ruetters, D., Dahal, K. P., Schillmöller, Z., & Hübner, J. (2017) · Patient Education and Counseling · doi:10.1016/j.pec.2017.02.003 · Cited by 23
Understanding node-link and matrix visualizations of networks: A large-scale online experiment
Ren, D., Marusich, L. R., O’Donovan, J., Bakdash, J. Z., Schaffer, J., Cassenti, D. N., Kase, S. E., Roy, H., Lin, W.-Y., & Höllerer, T. (2019) · Network Science · doi:10.1017/nws.2019.6 · Cited by 18
A Visual Information Processing Model to Characterize Interactive Visualization Environments
Jun, E., Landry, S. J., & Salvendy, G. (2011) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2011.540491 · Cited by 19
“By altering and changing views of the data, users can gain insight (North, 2006; Saraiya et al., 2006; Yi et al., 2008), pose new questions, and continue exploring the data set.”
BackgroundCharacterizing the Quality of Insight by Interactions: A Case Study
He, C., Micallef, L., He, L., Gopalacharyulu, P. V., Aittokallio, T. A., & Jacucci, G. (2020) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2020.2977634 · Cited by 17
“[70] identified four categories of insight gaining processes through an extensive literature review: providing an overview, adjusting the level of abstraction and/or the range of selection, detecting patterns, and matching the user’s mental model of the data.”
BackgroundWhat are Data Insights to Professional Visualization Users?
Law, P.-M., Endert, A., & Stasko, J. (2020) · Visualization · doi:10.1109/vis47514.2020.00043 · Cited by 17
“[39] believed that insights can be “sources or stimuli of other insights” (e.”
BackgroundSelf-citationMeng, Y., Zhang, H., Liu, M., & Liu, S. (2015) · IEEE Pacific Visualization Symposium · doi:10.1109/pacificvis.2015.7156379 · Cited by 17
Co-Insights framework for collaborative decision support and tacit knowledge transfer
Zhong, H., Ozsoy, E., & Nof, S. Y. (2015) · Expert Systems with Applications · doi:10.1016/j.eswa.2015.09.036 · Cited by 18
Cartography & geovisual analytics in personal contexts: designing for the data creator
Nelson, J. K. (2023) · International Journal of Cartography · doi:10.1080/23729333.2023.2189431 · Cited by 15
“Despite research e ff orts focused on characterizing, de fi ning, and measuring insight (e.g. Chang et al., 2009; North, 2006; Yi et al., 2008), the concept remains poorly understood in personal contexts (Choe & Lee, 2015).”
BackgroundA Visualization Approach for Reducing the Perceived Complexity of COBIT 5
Bartens, Y., Haes, S. D., Eggert, L., Heilig, L., Maes, K., Schulte, F., & Voß, S. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-06701-8_34 · Cited by 15
“We address insight generation through the adaption of certain design principles [9], which are outlined in Table 1.”
MethodLearning Objectives, Insights, and Assessments: How Specification Formats Impact Design
Lee-Robbins, E., He, S., & Adar, E. (2021) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2021.3114811 · Cited by 14
Evaluating visual and statistical exploration of scientific literature networks
Gove, R., Dunne, C., Shneiderman, B., Klavans, J. L., & Dorr, B. J. (2011) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vlhcc.2011.6070403 · Cited by 18
Exploring information visualization
Pohl, M., Wiltner, S., & Miksch, S. (2010) · doi:10.1145/2110192.2110195 · Cited by 14
“Unluckily, there is still no clear-cut and commonly accepted definition of the term "insight" [40].”
BackgroundHartt, C. M. (2013) · Saint Mary's University Institutional Repository (Saint Mary's University) · Cited by 23
Struggles and Strategies in Understanding Information Visualizations
Rezaie, M., Tory, M. K., & Carpendale, S. (2024) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2024.3388560 · Cited by 14
“Therefore, extensive research has been carried out on the definition of insight [54], its characterization [15, 32, 46, 65], quality of insight [54], how people gain insight [65] and factors that affect insight generation [30, 51].”
BackgroundOdds and Insights: Decision Quality in Exploratory Data Analysis Under Uncertainty
Sarma, A., Pu, X., Cui, Y., Correll, M., Brown, E. T., & Kay, M. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3641995 · Cited by 16
“Visualisation researchers have long argued that the primary objec-tive of visualisation is to help users gain insight and make data-driven decisions [9, 12, 14, 16, 51, 76].”
BackgroundOliver, J. L., Brereton, M. F., Watson, D. M., & Roe, P. (2018) · Australian Conference on Computer-Human Interaction (OzCHI) · doi:10.1145/3292147.3292171 · Cited by 13
“…2) adjusting the abstraction level and/or the range of a dataset to view, 3) detecting patterns in the dataset, such as specific distributions, trends, outliers, or structure, and 4) matching the mental model based on real-world knowledge to patterns identified in a visualisation of data [47].”
BackgroundAre We Closing the Loop Yet? Gaps in the Generalizability of VIS4ML Research
Subramonyam, H., & Hullman, J. R. (2023) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2023.3326591 · Cited by 16
“Hence, most of these evaluations inherit the ambiguity of what makes an insight meaningful or important, which is frequently discussed in visualization research [57, 90].”
BackgroundPadilla, S., Methven, T. S., Robb, D. A., & Chantler, M. J. (2017) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025977 · Cited by 12
Once Upon a Time in a Land Far Away: Guidelines for Spatio-Temporal Narrative Visualization
Rodrigues, S., Figueiras, A., & Alexandre, I. A. R. (2019) · International Conference on Information Visualisation (IV) · doi:10.1109/iv.2019.00017 · Cited by 15
“Providing insights on the data is the primary purpose of information visualization [1, 6, 22] and an aspect that should not be neglected.”
BackgroundInfluentialOpen Biomedical Ontology-based Medline exploration
Xuan, W., Dai, M., Mirel, B., Song, J. Y., Athey, B. D., Watson, S. J., & Meng, F. (2009) · BMC Bioinformatics · doi:10.1186/1471-2105-10-s5-s6 · Cited by 12
"The Data Says Otherwise" — Towards Automated Fact-checking and Communication of Data Claims
Fu, Y., Guo, S., Hoffswell, J., Bursztyn, V. S., Rossi, R. A., & Stasko, J. (2024) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3654777.3676359 · Cited by 16
“Researchers have developed frameworks and taxonomies to encapsulate the diversity and characteristics of such ‘data facts/insights’ [6, 20, 57, 69, 104].”
Self-citationMirel, B., Eichinger, F. H., Keller, B. J., & Kretzler, M. (2011) · Journal of Biomedical Discovery and Collaboration · doi:10.5210/disco.v6i0.3410 · Cited by 11
“In both fields, more research is needed at a concrete, application level in terms of support that can adequately “connect user objectives with the [tool] interaction techniques that help accomplish them” (6, 1225).”
BackgroundThe mining and application of diverse cultural perspectives in user-generated content
Gergle, D., & Hecht, B. J. (2013) · Cited by 11
eSTIMe: Towards an All-in-One Geovisualization Environment for Daily Mobility Analysis
Menin, A., Chardonnel, S., Davoine, P., & Nedel, L. (2019) · SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI) · doi:10.1109/sibgrapi.2019.00014 · Cited by 12
Information Visualization for Diabetes Management
Zhang, Y., Parker, A. G., & Dunne, C. (2020) · International Conference on Pervasive Computing Technologies for Healthcare · doi:10.1145/3421937.3421957 · Cited by 11
“Information visualization techniques have been commonly used to help make sense of diabetes data, including for identifying trends, patterns, and unusual occurrences [31].”
MethodTowards an instrument for measuring sensemaking and an assessment of its theoretical features
Alsufiani, K. D., Attfield, S., & Zhang, L. (2017) · Electronic workshops in computing · doi:10.14236/ewic/hci2017.86 · Cited by 10
“When attempting to gain insight into a subject, among other different procedures, sensemaking is considered a key process that people perform(Yi et al., 2008).”
BackgroundPromoting Insight: A Case Study of How to Incorporate Interaction in Existing Data Visualizations
Alexandre, I. (2016) · 2016 20th International Conference Information Visualisation (IV) · doi:10.1109/iv.2016.15 · Cited by 9
Narrative Scaffolding: A Narrative-First Framework for Data-Driven Sensemaking
Huang, O., Fatir, M., Luo, T., Suh, S., Subramonyam, H., & Nobre, C. (2026) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3742413.3789062 · Cited by 13
Embedded Merge & Split: Visual Adjustment of Data Grouping
Sarvghad, A., Saket, B., Endert, A., & Weibel, N. (2018) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2018.2865075 · Cited by 10
“When exploring data, users may need to adjust the default data groupings created by the tool according to their evolving needs and interests [48].”
BackgroundMethodVisualizing host traffic through graphs
Glatz, E. (2010) · IEEE Symposium on Visualization for Cyber Security (VIZSEC) · doi:10.1145/1850795.1850802 · Cited by 11
MediaViz: An Interactive Visualization Platform for Online Media Studies
Devezas, T., Nunes, S., & Rodríguez, M. T. (2015) · doi:10.1145/2808469.2808474 · Cited by 11
“By leveraging the process of gaining insight through the detection of patterns in a visual representation of the data to decrease the gap between the data and the user’s mental model of it [3], we developed a set of visualization tools which consume and display the news archive data, allowing it to be interrogated and…”
MethodUsing data visualization in creativity workshops
Dove, G., Jones, S., Dykes, J. A., Brown, A., & Duffy, A. (2013) · Creativity and Cognition · doi:10.1145/2466627.2466665 · Cited by 9
“This was derived in part from the Creativity Support Index [3] and in part from discussion of insight in the visualization literature [12,18].”
MethodSKYGLYPHS: REFLECTIONS on the DESIGN of a DELIGHTFUL VISUALIZATION
Aseniero, B. A., Fitzmaurice, G. W., Carpendale, S., & Matejka, J. (2022) · IEEE VIS Arts Program (VISAP) · doi:10.1109/visap57411.2022.00021 · Cited by 10
“Design Goals We distilled several design goals from the Infovis and Human–Computer Interaction (HCI) literature to ensure that, overall, our datavis is engaging—an important factor in helping people gain insight [30].”
MethodScholar Plot: Design and Evaluation of an Information Interface for Faculty Research Performance
Majeti, D., Akleman, E., Ahmed, M. E., Petersen, A. M., Uzzi, B., & Pavlidis, I. T. (2020) · Frontiers in Research Metrics and Analytics · doi:10.3389/frma.2019.00006 · Cited by 8
“In general, visualization has been used to help people understand complex datasets, supporting actionable insights (Yi et al., 2008).”
BackgroundTowards an Understanding of How Players Make Meaning from Post-Play Process Visualizations
Kleinman, E., Villareale, J., Shergadwala, M., Teng, Z., Bryant, A., Zhu, J., & El‐Nasr, M. S. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20212-4_4 · Cited by 7
Arunkumar, A., Padilla, L., & Bryan, C. (2024) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2024.3456344 · Cited by 7
“Application-based evaluation often centers on users’ exploration efforts [16,31], with some consideration of user’s goals, aesthetic preferences, data familiarity, and other relevant display parameters [83].”
Using Information Visualization to Support Creativity in Service Design Workshops
Dove, G., & Jones, S. (2014) · City Research Online (City University London) · Cited by 7
Interactive SNMP traffic analysis through information visualization
Barbosa, P. T., & Granville, L. Z. (2010) · IEEE/IFIP Network Operations and Management Symposium (NOMS) · doi:10.1109/noms.2010.5488438 · Cited by 7
“Gaining insight about data has been considered one of the main purposes of information visualization [9].”
BackgroundShih, Y.-A., Chang, B., & Chin, J. Y. (2020) · Journal of Computers in Education · doi:10.1007/s40692-020-00160-x · Cited by 7
“The social phenomenon of homophily is expressed as the correlation between personal attribute values and general sociocultural factors (Gehlbach et al. 2016; Yi et al. 2008).”
BackgroundHan, Q., John, M., Koch, S., Assenov, I., & Ertl, T. (2018) · Big Data Visual and Immersive Analytics · doi:10.1109/bdva.2018.8533897 · Cited by 8
“The proposed approaches support users in different stages of the insight generation process [1], for example, by providing”
MethodHeart Garden: Visualizing Heart Rate Data Using the Metaphor of a Garden
Rook, C., Panda, S., Sice, P. V., Fenwick, A., Hodgson, D., Sice, M. D., Heckels, D., & Elvin, G. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2504201 · Cited by 8
“Given its usefulness, visualization of heart rate data is important for translating complex physiological information into actionable insights (Yi et al., 2008).”
Metadata
- Authors
- Yi, J. S., Kang, Y.-A., Stasko, J. T., & Jacko, J. A.
- Affiliations
- Georgia Institute of Technology (US)
- GVU Center Georgia Institute of Technology, NW Atlanta, GA
- University of Minnesota (US)
- Venue
- Proceedings of the 2008 Workshop on BEyond time and errors: novel evaLuation methods for Information Visualization
- Publisher
- ACM
- Published
- 2008-04-05
- Pages
- 1-6
- OpenAlex
- W2063534350
- Cited by
- 175
- References
- 36
- Citations by year
- 2026: 4 · 2025: 7 · 2024: 4 · 2023: 9 · 2022: 9 · 2021: 8 · 2020: 12 · 2019: 13 · 2018: 12 · 2017: 13 · 2016: 10 · 2015: 21 · 2014: 10 · 2013: 11 · 2012: 7
- FWCI
- 6.67
- Type
- conference paper
- Language
- en
- Open access
- closed
- Funders
- National Science Foundation
- U.S. Department of Homeland Security
- Topics
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Data Visualization and Analytics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Computer Graphics and Visualization Techniques
- Keywords
- insight, information visualization, sensemaking, mental models, pattern detection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.