The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
LineUp: Visual Analysis of Multi-Attribute Rankings
Open accessAbstract
Rankings are a popular and universal approach to structuring otherwise unorganized collections of items by computing a rank for each item based on the value of one or more of its attributes. This allows us, for example, to prioritize tasks or to evaluate the performance of products relative to each other. While the visualization of a ranking itself is straightforward, its interpretation is not, because the rank of an item represents only a summary of a potentially complicated relationship between its attributes and those of the other items. It is also common that alternative rankings exist which need to be compared and analyzed to gain insight into how multiple heterogeneous attributes affect the rankings. Advanced visual exploration tools are needed to make this process efficient. In this paper we present a comprehensive analysis of requirements for the visualization of multi-attribute rankings. Based on these considerations, we propose LineUp--a novel and scalable visualization technique that uses bar charts. This interactive technique supports the ranking of items based on multiple heterogeneous attributes with different scales and semantics. It enables users to interactively combine attributes and flexibly refine parameters to explore the effect of changes in the attribute combination. This process can be employed to derive actionable insights as to which attributes of an item need to be modified in order for its rank to change. Additionally, through integration of slope graphs, LineUp can also be used to compare multiple alternative rankings on the same set of items, for example, over time or across different attribute combinations. We evaluate the effectiveness of the proposed multi-attribute visualization technique in a qualitative study. The study shows that users are able to successfully solve complex ranking tasks in a short period of time.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The visual display of quantitative information
(1985) · General Pharmacology: The Vascular System · doi:10.1016/0306-3623(85)90230-7 · Cited by 5,070
NASA-Task Load Index (NASA-TLX); 20 Years Later
Hart, S. G. (2006) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120605000909 · Cited by 4,297 · cited 1×
“After each task, participants had to fill out the standardized NASA-TLX questionnaire for workload assessment [8].”
MethodKemp, C. D., & Tufte, E. R. (1992) · Biometrics · doi:10.2307/2532323 · Cited by 2,713
The Visual Display of Quantitative Information.
Fayers, P., & Tufte, E. R. (1990) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2983122 · Cited by 1,936
Cleveland, W. S., & McGill, R. (1984) · Journal of the American Statistical Association · doi:10.2307/2288400 · Cited by 1,796
Cleveland, W. S., & McGill, R. (1984) · Journal of the American Statistical Association · doi:10.1080/01621459.1984.10478080 · Cited by 1,788
Automating the design of graphical presentations of relational information
Mackinlay, J. (1986) · ACM Transactions on Graphics · doi:10.1145/22949.22950 · Cited by 1,610
Semiology of Graphics: Diagrams, Networks, Maps
Bertin, J., & Berg, W. J. (2010) · Cited by 1,555
The plane with parallel coordinates
Inselberg, A. (1985) · The Visual Computer · doi:10.1007/bf01898350 · Cited by 1,423
A Nested Model for Visualization Design and Validation
Munzner, T. (2009) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2009.111 · Cited by 880
The visual display of quantitative information
Azen, S. P. (1983) · Computational Statistics & Data Analysis · doi:10.1016/0167-9473(83)90110-x · Cited by 876
Rao, R., & Card, S. K. (1994) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/191666.191776 · Cited by 669
State of the Art: Coordinated & Multiple Views in Exploratory Visualization
Roberts, J. C. (2007) · Fifth International Conference on Coordinated and Multiple Views in Exploratory Visualization (CMV 2007) · doi:10.1109/cmv.2007.20 · Cited by 582
Scheffer, J. (2002) · Massey Research Online (Massey University) · Cited by 464
Animated Transitions in Statistical Data Graphics
Heer, J., & Robertson, G. (2007) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2007.70539 · Cited by 438
Interactive Data Visualization
Ward, M. O., Grinstein, G., & Keim, D. (2010) · A K Peters/CRC Press eBooks · doi:10.1201/9780429108433 · Cited by 333
Stacked Graphs – Geometry & Aesthetics
Byron, L., & Wattenberg, M. (2008) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2008.166 · Cited by 332
Interactive Data Visualization: Foundations, Techniques, and Applications
Ward, M. O., Grinstein, G., & Keim, D. (2010) · A K Peters/CRC Press eBooks · doi:10.1201/b10683 · Cited by 246
Stretching the rubber sheet: a metaphor for viewing large layouts on small screens
Sarkar, M., Snibbe, S. S., Tversky, O. J., & Reiss, S. P. (1993) · Proceedings of the 6th annual ACM symposium on User interface software and technology · doi:10.1145/168642.168650 · Cited by 226
A Rank-by-Feature Framework for Interactive Exploration of Multidimensional Data
Seo, J., & Shneiderman, B. (2005) · Information Visualization · doi:10.1057/palgrave.ivs.9500091 · Cited by 199
Plotting Likert and Other Rating Scales
Robbins, N. B., & Heiberger, R. M. (2011) · Cited by 155
Rao, R., & Card, S. K. (1994) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/259963.260391 · Cited by 118
RankExplorer: Visualization of Ranking Changes in Large Time Series Data
Shi, C., Cui, W., Liu, S., Xu, P., Chen, W., & Qu, H. (2012) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2012.253 · Cited by 81
Visualizing Incomplete and Partially Ranked Data
Kidwell, P., Lebanon, G., & Cleveland, W. S. (2008) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2008.181 · Cited by 54
Cited by
Visualizing high-dimensional data: advances in the past decade
Liu, S., Maljovec, D., Wang, B., Bremer, P.-T., & Pascucci, V. (2017) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2016.2640960 · Cited by 427
How do visual explanations foster end users' appropriate trust in machine learning?
Yang, F., Huang, Z., Scholtz, J., & Arendt, D. L. (2020) · Proceedings of the 25th International Conference on Intelligent User Interfaces · doi:10.1145/3377325.3377480 · Cited by 200
Illusion of Causality in Visualized Data
Xiong, C., Shapiro, J., Hullman, J., & Franconeri, S. (2020) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2019.2934399 · Cited by 71
A Critical Reflection on Visualization Research: Where Do Decision Making Tasks Hide?
Dimara, E., & Stasko, J. (2022) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2021.3114813 · Cited by 60
Metadata
- Authors
- Gratzl, S., Lex, A., Gehlenborg, N., Pfister, H., & Streit, M.
- Venue
- IEEE Transactions on Visualization and Computer Graphics
- Published
- 2013-12
- Volume
- 19
- Issue
- 12
- Pages
- 2277-2286
- ISSN
- 1077-2626 (ISSN-L)
- OpenAlex
- W2115556748
- Cited by
- 307
- References
- 24
- FWCI
- 21.19
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.