The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
The Effects of Interactive Latency on Exploratory Visual Analysis
Abstract
To support effective exploration, it is often stated that interactive visualizations should provide rapid response times. However, the effects of interactive latency on the process and outcomes of exploratory visual analysis have not been systematically studied. We present an experiment measuring user behavior and knowledge discovery with interactive visualizations under varying latency conditions. We observe that an additional delay of 500 ms incurs significant costs, decreasing user activity and data set coverage. Analyzing verbal data from think-aloud protocols, we find that increased latency reduces the rate at which users make observations, draw generalizations and generate hypotheses. Moreover, we note interaction effects in which initial exposure to higher latencies leads to subsequently reduced performance in a low-latency setting. Overall, increased latency causes users to shift exploration strategy, in turn affecting performance. We discuss how these results can inform the design of interactive analysis tools.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2011) · Cited by 14,317
Random effects structure for confirmatory hypothesis testing: Keep it maximal
Barr, D. J., Levy, R., Scheepers, C., & Tily, H. J. (2013) · Journal of Memory and Language · doi:10.1016/j.jml.2012.11.001 · Cited by 10,328 · cited 6×
“As no single subject experienced all combinations of factors, repeated measures ANOVA is subject to sampling bias and higher chances of type I error [32] .”
BackgroundInfluentialLinear Mixed-Effects Models using 'Eigen' and S4
Bates, D. M., Maechler, M., Bolker, B. M., & Walker, S. C. (2015) · Cited by 5,924
Resilient distributed datasets: a fault-tolerant abstraction for in-memory cluster computing
Zaharia, M., Chowdhury, M., Das, T., Dave, A., Ma, J. H., McCauley, M., Franklin, M. J. M., Shenker, S. J., & Stoica, I. G. (2012) · UC Berkeley · Cited by 4,891
(2010) · Cited by 4,411
The Psychology of Human-Computer Interaction
Card, S. K., Moran, T. P., & Newell, A. (2018) · CRC Press eBooks · doi:10.1201/9780203736166 · Cited by 4,103
Readings in Information Visualization: Using Vision to Think
Card, S. K., Mackinlay, J. D., & Shneiderman, B. (1999) · Cited by 3,935
Friendship and mobility: user movement in location-based social networks
Cho, E., Myers, S. A., & Leskovec, J. (2011) · Proceedings of the 17th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2020408.2020579 · Cited by 2,903
The language-as-fixed-effect fallacy: A critique of language statistics in psychological research
Clark, H. H. (1973) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(73)80014-3 · Cited by 2,222
The psychology of human-computer interaction
Rogers, Y. (1984) · Applied Ergonomics · doi:10.1016/0003-6870(84)90205-9 · Cited by 1,970
Quantifying Qualitative Analyses of Verbal Data: A Practical Guide
Chi, M. T. H. (1997) · Journal of the Learning Sciences · doi:10.1207/s15327809jls0603_1 · Cited by 1,764
Strangers to ourselves: discovering the adaptive unconscious
(2003) · Choice Reviews Online · doi:10.5860/choice.40-3712 · Cited by 1,645
Michotte, A. (2017) · Routledge eBooks · doi:10.4324/9781315519050 · Cited by 1,307
Deictic codes for the embodiment of cognition
Ballard, D. H., Hayhoe, M. M., Pook, P. K., & Rao, R. P. N. (1997) · Behavioral and Brain Sciences · doi:10.1017/s0140525x97001611 · Cited by 1,082
Hellerstein, J. M., Haas, P. J., & Wang, H. J. (1997) · Proceedings - ACM-SIGMOD International Conference on Management of Data · doi:10.1145/253260.253291 · Cited by 902
Vinkhuyzen, R. E., Verschure, P. F. M. J., & Newell, A. (1994) · The American Journal of Psychology · doi:10.2307/1422886 · Cited by 831
Memory Representations in Natural Tasks
Ballard, D. H., Hayhoe, M. M., & Pelz, J. B. (1995) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1995.7.1.66 · Cited by 817 · cited 1×
“For example, when the cost of acquiring a piece of information is increased from an eye movement to a head movement in a block-copying task, subjects change strategy and rely more on working memory [3].”
BackgroundBlinkDB: queries with bounded errors and bounded response times on very large data
Agarwal, S., Mozafari, B., Panda, A., Milner, H., Madden, S., & Stoica, I. (2013) · Proceedings of the 8th ACM European Conference on Computer Systems · doi:10.1145/2465351.2465355 · Cited by 694
Krueger, C., & Tian, L. (2004) · Biological Research For Nursing · doi:10.1177/1099800404267682 · Cited by 561 · cited 6×
“As no single subject experienced all combinations of factors, repeated measures ANOVA is subject to sampling bias and higher chances of type I error [32] .”
BackgroundInfluentialInteractive dynamics for visual analysis
Heer, J., & Shneiderman, B. (2012) · Communications of the ACM · doi:10.1145/2133806.2133821 · Cited by 474
Self-citationLinear models and linear mixed effects models in R with linguistic applications
Winter, B. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1308.5499 · Cited by 460
An Insight-Based Methodology for Evaluating Bioinformatics Visualizations
Saraiya, P., North, C., & Duca, K. (2005) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2005.53 · Cited by 343
imMens: Real‐time Visual Querying of Big Data
Liu, Z., Jiang, B., & Heer, J. (2013) · Computer Graphics Forum · doi:10.1111/cgf.12129 · Cited by 308
Self-citationHeer, J., & Shneiderman, B. (2012) · Queue · doi:10.1145/2133416.2146416 · Cited by 269
Self-citationGray, W. D., & Boehm-Davis, D. A. (2000) · Journal of Experimental Psychology: Applied · doi:10.1037//1076-898x.6.4.322 · Cited by 268
Voyagers and voyeurs: supporting asynchronous collaborative information visualization
Heer, J., Viégas, F. B., & Wattenberg, M. (2007) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1240624.1240781 · Cited by 261
Self-citationMental Models, Visual Reasoning and Interaction in Information Visualization: A Top-down Perspective
Liu, Z., & Stasko, J. T. (2010) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2010.177 · Cited by 255
Self-citationProfiler: integrated statistical analysis and visualization for data quality assessment
Kandel, S., Parikh, R., Paepcke, A., Hellerstein, J. M., & Heer, J. (2012) · Proceedings of the International Working Conference on Advanced Visual Interfaces · doi:10.1145/2254556.2254659 · Cited by 220
Self-citationDesigning for low-latency direct-touch input
Ng, A., Lepinski, J., Wigdor, D., Sanders, S., & Dietz, P. (2012) · Proceedings of the 25th annual ACM symposium on User interface software and technology · doi:10.1145/2380116.2380174 · Cited by 197
The efficacy of human post-editing for language translation
Green, S., Heer, J., & Manning, C. D. (2013) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2470718 · Cited by 186
Self-citationTrust me, i'm partially right: incremental visualization lets analysts explore large datasets faster
Fisher, D., Popov, I., Drucker, S., & schraefel, M. C. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208294 · Cited by 183
Approximate Power for Repeated-Measures ANOVA Lacking Sphericity
Muller, K. E., & Barton, C. N. (1989) · Journal of the American Statistical Association · doi:10.2307/2289941 · Cited by 177
Approximate Power for Repeated-Measures ANOVA Lacking Sphericity
Muller, K. E., & Barton, C. N. (1989) · Journal of the American Statistical Association · doi:10.1080/01621459.1989.10478802 · Cited by 176
How fast is fast enough?: a study of the effects of latency in direct-touch pointing tasks
Jota, R., Ng, A., Dietz, P., & Wigdor, D. (2013) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2481317 · Cited by 163
The Effects of Operator Implementation Cost on Planfulness of Problem Solving and Learning
O'Hara, K. P., & Payne, S. J. (1998) · Cognitive Psychology · doi:10.1006/cogp.1997.0676 · Cited by 155 · cited 4×
“O'Hara and Payne's experiments arguably involve conditions that span multiple time scales in Table 1.”
BackgroundInfluentialAn Insight-Based Longitudinal Study of Visual Analytics
Saraiya, P., North, C. L., Lam, V., & Duca, K. (2006) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2006.85 · Cited by 146
Planning and the user interface: the effects of lockout time and error recovery cost
O'Hara, K. P., & Payne, S. J. (1999) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.1998.0234 · Cited by 93
Trafton, J. G., Trickett, S. B., & Mintz, F. E. (2005) · Foundations of Science · doi:10.1007/s10699-005-3007-4 · Cited by 87
Cited by
HiGlass: web-based visual exploration and analysis of genome interaction maps
Kerpedjiev, P., Abdennur, N., Lekschas, F., McCallum, C., Dinkla, K., Strobelt, H., Luber, J. M., Ouellette, S. B., Azhir, A., Kumar, N., et al. (2018) · Genome Biology · doi:10.1186/s13059-018-1486-1 · Cited by 2,453
Approximated and User Steerable tSNE for Progressive Visual Analytics
Pezzotti, N., Lelieveldt, B. P. F., Maaten, L. V. D., Hollt, T., Eisemann, E., & Vilanova, A. (2017) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2016.2570755 · Cited by 308
Metadata
- Authors
- Liu, Z., & Heer, J.
- Venue
- IEEE Transactions on Visualization and Computer Graphics
- Published
- 2014-12-31
- Volume
- 20
- Issue
- 12
- Pages
- 2122-2131
- ISSN
- 1077-2626 (ISSN-L)
- OpenAlex
- W2002544066
- Cited by
- 326
- References
- 38
- FWCI
- 21.66
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.