The DOI matches its Crossref record; 77 of the 77 references it cites were found in a registry or an index.
Mental Models, Visual Reasoning and Interaction in Information Visualization: A Top-down Perspective
Abstract
Although previous research has suggested that examining the interplay between internal and external representations can benefit our understanding of the role of information visualization (InfoVis) in human cognitive activities, there has been little work detailing the nature of internal representations, the relationship between internal and external representations and how interaction is related to these representations. In this paper, we identify and illustrate a specific kind of internal representation, mental models, and outline the high-level relationships between mental models and external visualizations. We present a top-down perspective of reasoning as model construction and simulation, and discuss the role of visualization in model based reasoning. From this perspective, interaction can be understood as active modeling for three primary purposes: external anchoring, information foraging, and cognitive offloading. Finally we discuss the implications of our approach for design, evaluation and theory development.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Ecological Approach to Visual Perception
Bornstein, M. H., & Gibson, J. J. (1980) · The Journal of Aesthetics and Art Criticism · doi:10.2307/429816 · Cited by 22,935
Vygotsky, L. S. (1964) · Bulletin of the Orton Society · doi:10.1007/bf02928399 · Cited by 20,704
Lakoff, G., & Johnson, M. (2003) · University of Chicago Press eBooks · doi:10.7208/chicago/9780226470993.001.0001 · Cited by 20,632
The Ecological Approach to Visual Perception: Classic Edition
Gibson, J. J. (2014) · doi:10.4324/9781315740218 · Cited by 12,132
The eyes have it: a task by data type taxonomy for information visualizations
Shneiderman, B. (2002) · Proceedings 1996 IEEE Symposium on Visual Languages · doi:10.1109/vl.1996.545307 · Cited by 4,535
Mental Models: Towards a Cognitive Science of Language, Inference, and Consciousness
Ford, M., & Johnson-Laird, P. N. (1985) · Language · doi:10.2307/414498 · Cited by 4,419
Protocol Analysis: Verbal Reports as Data
Venkatesan, M., Ericsson, K. A., & Simon, H. A. (1986) · Journal of Marketing Research · doi:10.2307/3151491 · Cited by 4,347
Readings in Information Visualization: Using Vision to Think
Card, S. K., Mackinlay, J. D., & Shneiderman, B. (1999) · Cited by 3,935
Why a Diagram is (Sometimes) Worth Ten Thousand Words
Larkin, J. H., & Simon, H. A. (1987) · Cognitive Science · doi:10.1016/s0364-0213(87)80026-5 · Cited by 3,733
Protocol Analysis: Verbal Reports as Data
Ericsson, K. A., & Simon, H. A. (1993) · doi:10.7551/mitpress/5657.001.0001 · Cited by 3,537
Vygotsky and the Social Formation of Mind
Kozulin, A., & Wertsch, J. V. (1987) · The American Journal of Psychology · doi:10.2307/1422646 · Cited by 3,341
The Ecological Approach To Visual Perception
Gibson, J. J. (2013) · Psychology Press eBooks · doi:10.4324/9780203767764 · Cited by 2,564
Noë, A. (2005) · Medical Entomology and Zoology · Cited by 1,876
Craik, K. J. W. (1943) · Cited by 1,845
Illuminating the Path: The Research and Development Agenda for Visual Analytics
Thomas, J. J., & Cook, K. A. (2005) · Cited by 1,770
Some observations on mental models
Norman, D. A. (1983) · Medical Entomology and Zoology · Cited by 1,549
Brooks, R. A. (2018) · The Artificial Life Route to Artificial Intelligence · doi:10.4324/9781351001885-2 · Cited by 1,548
What the Mind’s Eye Tells the Mind’s Brain: A Critique of Mental Imagery
Pylyshyn, Z. W. (1973) · Images, Perception, and Knowledge · doi:10.1007/978-94-010-1193-8_1 · Cited by 1,342
Direct Manipulation Interfaces
Hutchins, E. L., Hollan, J. D., & Norman, D. A. (1985) · Human–Computer Interaction · doi:10.1207/s15327051hci0104_2 · Cited by 1,307
On looking into the black box: Prospects and limits in the search for mental models.
Rouse, W. B., & Morris, N. M. (1986) · Psychological Bulletin · doi:10.1037/0033-2909.100.3.349 · Cited by 1,218
What the mind's eye tells the mind's brain: A critique of mental imagery.
Pylyshyn, Z. W. (1973) · Psychological Bulletin · doi:10.1037/h0034650 · Cited by 1,191
Deictic codes for the embodiment of cognition
Ballard, D. H., Hayhoe, M. M., Pook, P. K., & Rao, R. P. N. (1997) · Behavioral and Brain Sciences · doi:10.1017/s0140525x97001611 · Cited by 1,082
(1984) · Medical Entomology and Zoology · Cited by 1,076
External cognition: how do graphical representations work?
Scaife, M., & Rogers, Y. (1996) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.1996.0048 · Cited by 1,066
Toward a Deeper Understanding of the Role of Interaction in Information Visualization
Yi, J. S., Kang, Y. A., Stasko, J., & Jacko, J. A. (2007) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2007.70515 · Cited by 1,031
Self-citationLogie, R. H. (2014) · doi:10.4324/9781315804743 · Cited by 933
Kosslyn, S. M., Thompson, W. L., & Ganis, G. (2006) · doi:10.1093/acprof:oso/9780195179088.001.0001 · Cited by 909
Culture in mind: cognition, culture, and the problem of meaning
(1996) · Choice Reviews Online · doi:10.5860/choice.34-1628 · Cited by 909
Visual Explanations: Images and Quantities, Evidence and Narrative
Tufte, E. R., McKay, S. R., Christian, W., & Matey, J. R. (1998) · Computers in Physics · doi:10.1063/1.168637 · Cited by 897
(1995) · Choice Reviews Online · doi:10.5860/choice.33-0596 · Cited by 862
Material anchors for conceptual blends
Hutchins, E. (2005) · Journal of Pragmatics · doi:10.1016/j.pragma.2004.06.008 · Cited by 844
Culture In Mind: Cognition, Culture, and the Problem of Meaning
Shore, B. (1996) · doi:10.1093/oso/9780195095975.001.0001 · Cited by 801
Engineering and the mind's eye
(1993) · Choice Reviews Online · doi:10.5860/choice.30-3293 · Cited by 771
Anthropology and Psychology: Towards an Epidemiology of Representations
Sperber, D. (1985) · Man · doi:10.2307/2802222 · Cited by 736
Wilkinson, L. (2010) · WIREs Computational Statistics · doi:10.1002/wics.118 · Cited by 712
Nersessian, N. J. (2008) · The MIT Press eBooks · doi:10.7551/mitpress/7967.001.0001 · Cited by 684
Proceedings of the 31st Annual Conference of the Cognitive Science Society.
Tamariz, M. (2009) · Cited by 642
Cognitive maps, cognitive collages, and spatial mental models
Tversky, B. (1993) · Lecture Notes in Computer Science · doi:10.1007/3-540-57207-4_2 · Cited by 635
Polaris: a system for query, analysis, and visualization of multidimensional relational databases
Stolte, C., Tang, D., & Hanrahan, P. (2002) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/2945.981851 · Cited by 629
Spivey, M. (2006) · doi:10.1093/acprof:oso/9780195170788.001.0001 · Cited by 599
Toward measuring visualization insight
North, C. (2006) · IEEE Computer Graphics and Applications · doi:10.1109/mcg.2006.70 · Cited by 456
Shneiderman, B., & Plaisant, C. (2006) · Proceedings of the 2006 AVI workshop on BEyond time and errors: novel evaluation methods for information visualization · doi:10.1145/1168149.1168158 · Cited by 398
The role of a mental model in learning to operate a device
Kieras, D. E., & Bovair, S. (1984) · Cognitive Science · doi:10.1207/s15516709cog0803_3 · Cited by 340
(2007) · doi:10.4324/9780203810088-13 · Cited by 329
North, C., & Shneiderman, B. (2000) · Proceedings of the working conference on Advanced visual interfaces · doi:10.1145/345513.345282 · Cited by 309
Information Visualization: Design for Interaction
Spence, R. (2006) · Cited by 292
Pike, W. A., Stasko, J., Chang, R., & O'Connell, T. A. (2009) · Information Visualization · doi:10.1057/ivs.2009.22 · Cited by 242
Self-citationInformation visualization: design for interaction
Pignataro, J. (2008) · Information Visualization · doi:10.1145/1466620.1466626 · Cited by 240
Characterizing Users' Visual Analytic Activity for Insight Provenance
Gotz, D., & Zhou, M. X. (2009) · Information Visualization · doi:10.1057/ivs.2008.31 · Cited by 233
Model-Based Reasoning: Science, Technology, Values
Magnani, L., & Nersessian, N. J. (2012) · doi:10.1007/978-1-4615-0605-8 · Cited by 211
Notebooks of the Mind: Explorations of Thinking
Murray, D. M., & John-Steiner, V. P. (1987) · College Composition and Communication · doi:10.2307/357724 · Cited by 203
Visual imagery can impede reasoning
Knauff, M., & Johnson-Laird, P. N. (2002) · Memory & Cognition · doi:10.3758/bf03194937 · Cited by 200
Snap-together visualization: can users construct and operate coordinated visualizations?
NORTH, C., & SHNEIDERMAN, B. (2000) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.2000.0418 · Cited by 182
Polaris: a system for query, analysis and visualization of multi-dimensional relational databases
Stolte, C., & Hanrahan, P. (2002) · IEEE Symposium on Information Visualization 2000. INFOVIS 2000. Proceedings · doi:10.1109/infvis.2000.885086 · Cited by 161
On looking into the Black Box: Prospects and Limits in the Search for Mental Models
Rouse, W. B., & Morris, N. M. (1985) · doi:10.21236/ada159080 · Cited by 159
The Shaping of Information by Visual Metaphors
Ziemkiewicz, C., & Kosara, R. (2008) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2008.171 · Cited by 156
Distributed Cognition as a Theoretical Framework for Information Visualization
Liu, Z., Nersessian, N. J., & Stasko, J. (2008) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2008.121 · Cited by 154
Self-citationHow Important Is the “Mental Map”? – An Empirical Investigation of a Dynamic Graph Layout Algorithm
Purchase, H. C., Hoggan, E. E., & Görg, C. (2007) · Springer eBooks · doi:10.1007/978-3-540-70904-6_19 · Cited by 144
Temporal Summaries: Supporting Temporal Categorical Searching, Aggregation and Comparison
Wang, T. D., Catherine Plaisant, B., Shneiderman, B., Spring, N. T., Roseman, D., Marchand, G., Mukherjee, V., & Smith, M. (2009) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2009.187 · Cited by 140
Some Observations on Mental Models
Norman, D. A. (2014) · Psychology Press eBooks · doi:10.4324/9781315802725-5 · Cited by 139
A Framework of Interaction Costs in Information Visualization
Lam, H. (2008) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2008.109 · Cited by 133
Characterizing interactive externalizations
Tweedie, L. A. (1997) · doi:10.1145/258549.258803 · Cited by 125
Perceptual Organization in User-Generated Graph Layouts
van Ham, F., & Rogowitz, B. E. (2008) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2008.155 · Cited by 105
Exploring the role of individual differences in information visualization
Conati, C., & Maclaren, H. (2008) · Working Conference on Advanced Visual Interfaces (AVI) · doi:10.1145/1385569.1385602 · Cited by 101
A Comparison of User-Generated and Automatic Graph Layouts
Dwyer, T., Lee, B., Fisher, D., et al. (2009) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2009.109 · Cited by 99
Diagrams in the Mind and in the World: Relations between Internal and External Visualizations
Hegarty, M. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-25931-2_1 · Cited by 95
Imagery, Visualization, and Thinking
Johnson-Laird, P. N. (1998) · Elsevier eBooks · doi:10.1016/b978-012301160-2/50016-2 · Cited by 94
Vygotsky and the Social Formation of Mind
Wertsch, J. V. (1988) · doi:10.2307/j.ctv26071b0 · Cited by 92
Starting simple: adding value to static visualisation through simple interaction
Dix, A. J., & Ellis, G. P. (1998) · Working Conference on Advanced Visual Interfaces (AVI) · doi:10.1145/948496.948514 · Cited by 91
An empirical comparison of three commercial information visualization systems
Kobsa, A. (2001) · IEEE Symposium on Information Visualization · doi:10.1109/infvis.2001.963289 · Cited by 87
Mandler, J. M. (2014) · Psychology Press eBooks · doi:10.4324/9781315802459 · Cited by 84
Beyond Models and Metaphors: Visual Formalisms in User Interface Design
Nardi, B. A., & Zarmer, C. L. (1993) · Journal of Visual Languages & Computing · doi:10.1006/jvlc.1993.1002 · Cited by 78
Trafton, J. G., Trickett, S. B., & Mintz, F. E. (2005) · Foundations of Science · doi:10.1007/s10699-005-3007-4 · Cited by 77
Engineering and the Mind's Eye
Kranakis, E. F., & Ferguson, E. S. (1994) · Technology and Culture · doi:10.2307/3106309 · Cited by 75
Users' Mental Models: The Very Ideas
Payne, S. J. (2003) · Elsevier eBooks · doi:10.1016/b978-155860808-5/50006-x · Cited by 73
Projection, Problem Space and Anchoring
Kirsh, D. (2009) · PhilPapers (PhilPapers Foundation) · Cited by 44
Visual Imagery, Mental Models, and Reasoning
Gottschling, V. (2006) · Advances in psychology · doi:10.1016/s0166-4115(06)80037-3 · Cited by 14
Cited by
A Multi-Level Typology of Abstract Visualization Tasks
Brehmer, M., & Munzner, T. (2013) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2013.124 · Cited by 747
Visualization Rhetoric: Framing Effects in Narrative Visualization
Hullman, J., & Diakopoulos, N. (2011) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2011.255 · Cited by 505
The Effects of Interactive Latency on Exploratory Visual Analysis
Liu, Z., & Heer, J. (2014) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2014.2346452 · Cited by 326
Self-citationReactive Vega: A Streaming Dataflow Architecture for Declarative Interactive Visualization
Satyanarayan, A., Russell, R., Hoffswell, J., & Heer, J. (2016) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2015.2467091 · Cited by 274
The Role of Uncertainty, Awareness, and Trust in Visual Analytics
Sacha, D., Senaratne, H., Kwon, B. C., Ellis, G., & Keim, D. A. (2016) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2015.2467591 · Cited by 267
Metadata
- Authors
- Liu, Z., & Stasko, J. T.
- Venue
- IEEE Transactions on Visualization and Computer Graphics
- Published
- 2010-11
- Volume
- 16
- Issue
- 6
- Pages
- 999-1008
- ISSN
- 1077-2626 (ISSN-L)
- OpenAlex
- W2129815685
- Cited by
- 255
- References
- 77
- FWCI
- 14.74
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.