The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
Data visualization literacy: Definitions, conceptual frameworks, exercises, and assessments
Open accessAbstract
In the information age, the ability to read and construct data visualizations becomes as important as the ability to read and write text. However, while standard definitions and theoretical frameworks to teach and assess textual, mathematical, and visual literacy exist, current data visualization literacy (DVL) definitions and frameworks are not comprehensive enough to guide the design of DVL teaching and assessment. This paper introduces a data visualization literacy framework (DVL-FW) that was specifically developed to define, teach, and assess DVL. The holistic DVL-FW promotes both the reading and construction of data visualizations, a pairing analogous to that of both reading and writing in textual literacy and understanding and applying in mathematical literacy. Specifically, the DVL-FW defines a hierarchical typology of core concepts and details the process steps that are required to extract insights from data. Advancing the state of the art, the DVL-FW interlinks theoretical and procedural knowledge and showcases how both can be combined to design curricula and assessment measures for DVL. Earlier versions of the DVL-FW have been used to teach DVL to more than 8,500 residential and online students, and results from this effort have helped revise and validate the DVL-FW presented here.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2013) · Cited by 6,708
On the Theory of Scales of Measurement
Stevens, S. S. (1946) · Science · doi:10.1126/science.103.2684.677 · Cited by 4,761 · cited 1×
“Building on the work of Stevens (39), the DVL-FW distinguishes nominal, ordinal, interval, and ratio data based on the type of logical mathematical operations that are permissible (Fig.”
BackgroundThe eyes have it: a task by data type taxonomy for information visualizations
Shneiderman, B. (2002) · Proceedings 1996 IEEE Symposium on Visual Languages · doi:10.1109/vl.1996.545307 · Cited by 4,535
Bransford, J. D. (2000) · Medical Entomology and Zoology · Cited by 2,530
Cleveland, W. S., & McGill, R. (1984) · Journal of the American Statistical Association · doi:10.1080/01621459.1984.10478080 · Cited by 1,788
Visualization Analysis and Design
Munzner, T. (2014) · A K Peters/CRC Press eBooks · doi:10.1201/b17511 · Cited by 1,697
Automating the design of graphical presentations of relational information
Mackinlay, J. (1986) · ACM Transactions on Graphics · doi:10.1145/22949.22950 · Cited by 1,610
Semiology of Graphics: Diagrams, Networks, Maps
Bertin, J., & Berg, W. J. (2010) · Cited by 1,555
How numeracy influences risk comprehension and medical decision making.
Reyna, V. F., Nelson, W. L., Han, P. K., & Dieckmann, N. F. (2009) · Psychological Bulletin · doi:10.1037/a0017327 · Cited by 1,168
How Maps WorkRepresentation, Visualization, and Design
MacEachren, A. M. (1995) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 1,095
Visual images preserve metric spatial information: Evidence from studies of image scanning.
Kosslyn, S. M., Ball, T. M., & Reiser, B. J. (1978) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037//0096-1523.4.1.47 · Cited by 927
Vega-Lite: A Grammar of Interactive Graphics
Satyanarayan, A., Moritz, D., Wongsuphasawat, K., & Heer, J. (2017) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2016.2599030 · Cited by 883
Making Sense of Graphs: Critical Factors Influencing Comprehension and Instructional Implications
Friel, S. N., Curcio, F. R., & Bright, G. W. (2001) · Journal for Research in Mathematics Education · doi:10.2307/749671 · Cited by 819 · cited 2×
“Customization of exercises is possible and desirable, as there are at least four critical factors that affect the comprehension of graphs: purpose for usage, task characteristics, discipline characteristics, and reader characteristics (64).”
BackgroundCrowdsourcing graphical perception: using mechanical turk to assess visualization design
Heer, J., & Bostock, M. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753357 · Cited by 816
The Common Core State Standards in Mathematics
McCallum, W. (2015) · Selected Regular Lectures from the 12th International Congress on Mathematical Education · doi:10.1007/978-3-319-17187-6_31 · Cited by 770
A Multi-Level Typology of Abstract Visualization Tasks
Brehmer, M., & Munzner, T. (2013) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2013.124 · Cited by 747
How maps work: representation, visualization, and design
(1996) · Choice Reviews Online · doi:10.5860/choice.33-3446 · Cited by 702
Making Sense of Sensemaking 2: A Macrocognitive Model
Klein, Moon, & Hoffman (2006) · IEEE Intelligent Systems · doi:10.1109/mis.2006.100 · Cited by 569
Voyager: Exploratory Analysis via Faceted Browsing of Visualization Recommendations
Wongsuphasawat, K., Moritz, D., Anand, A., Mackinlay, J., Howe, B., & Heer, J. (2016) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2015.2467191 · Cited by 507
A theory of graph comprehension.
Pinker, S. A. (1990) · Cited by 477
Interactive dynamics for visual analysis
Heer, J., & Shneiderman, B. (2012) · Communications of the ACM · doi:10.1145/2133806.2133821 · Cited by 474
Wickham, H. (2010) · Journal of Computational and Graphical Statistics · doi:10.1198/jcgs.2009.07098 · Cited by 389
How People Learn II: Learners, Contexts, and Cultures
Illas Limson, S. L. (2025) · Academy of Management Learning & Education · doi:10.5465/amle.2022.0312 · Cited by 367
Interactive Data Visualization
Ward, M. O., Grinstein, G., & Keim, D. (2010) · A K Peters/CRC Press eBooks · doi:10.1201/9780429108433 · Cited by 333
How People Learn II: Learners, Contexts, and Cultures
Committee on How People Learn II: The Science and Practice of Learning, Board on Behavioral, C., Board on Science Education, Education, D. O. B. A. S. S. A., & National Academies of Sciences, E. (2018) · National Academies Press eBooks · doi:10.17226/24783 · Cited by 330
Artificial Intelligence and the Future of Testing
(2014) · Psychology Press eBooks · doi:10.4324/9781315808178 · Cited by 292
VLAT: Development of a Visualization Literacy Assessment Test
Lee, S., Kim, S.-H., & Kwon, B. C. (2017) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2016.2598920 · Cited by 290
A Principled Way of Assessing Visualization Literacy
Boy, J., Rensink, R. A., Bertini, E., & Fekete, J.-D. (2014) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2014.2346984 · Cited by 278
Information Graphics: A Comprehensive Illustrated Reference
Harris, R. L. (1996) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 270
How Information Visualization Novices Construct Visualizations
Grammel, L., Tory, M., & Storey, M. (2010) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2010.164 · Cited by 264
Visual Language: Global Communication for the 21st Century
Horn, R. E. (1998) · Cited by 253
Design and Update of a Classification System: The UCSD Map of Science
Börner, K., Klavans, R., Patek, M., Zoss, A. M., Biberstine, J. R., Light, R. P., Larivière, V., & Boyack, K. W. (2012) · PLoS ONE · doi:10.1371/journal.pone.0039464 · Cited by 246
Self-citationThe Many Faces of a Scatterplot
Cleveland, W. S., & McGill, R. (1984) · Journal of the American Statistical Association · doi:10.1080/01621459.1984.10477098 · Cited by 239
Börner, K., Maltese, A., Balliet, R. N., & Heimlich, J. (2016) · Information Visualization · doi:10.1177/1473871615594652 · Cited by 203
Self-citationRogers, Y., & Marshall, P. (2017) · Synthesis Lectures on Human-Centered Informatics · doi:10.1007/978-3-031-02220-3 · Cited by 193
Visual Literacy Standards in Higher Education: New Opportunities for Libraries and Student Learning
Hattwig, D., Bussert, K., Medaille, A., & Burgess, J. (2013) · portal: Libraries and the Academy · doi:10.1353/pla.2013.0008 · Cited by 180
Huron, S., Carpendale, S., Thudt, A., Tang, A., & Mauerer, M. (2014) · Proceedings of the 2014 conference on Designing interactive systems · doi:10.1145/2598510.2598566 · Cited by 179
Information graphics: A comprehensive illustrated reference
Wilson, R. D. (1998) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(19980401)49:4<383::aid-asi11>3.0.co;2-v · Cited by 171
Visualization Literacy at Elementary School
Alper, B., Riche, N. H., Chevalier, F., Boy, J., & Sezgin, M. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025877 · Cited by 163
Lee, S., Kim, S.-H., Hung, Y.-H., Lam, H., Kang, Y.-A., & Yi, J. S. (2016) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2015.2467195 · Cited by 161
A Nonmetric Variety of Linear Factor Analysis
Kruskal, J. B., & Shepard, R. N. (1974) · Psychometrika · doi:10.1007/bf02291465 · Cited by 156
The Grammar of Graphics (Statistics and Computing)
Wilkinson, L. (2005) · Springer eBooks · Cited by 143
Four types of ensemble coding in data visualizations
Szafir, D. A., Haroz, S., Gleicher, M. L., & Franconeri, S. (2016) · Journal of Vision · doi:10.1167/16.5.11 · Cited by 142
Constructing Visual Representations: Investigating the Use of Tangible Tokens
Huron, S., Jansen, Y., & Carpendale, S. (2014) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2014.2346292 · Cited by 141 · cited 2×
“(21) published a flow diagram showing common paths when constructing graphs; it features four main tasks—load data, build constructs, combine constructs, and correct—and several mental and physical subtasks.”
BackgroundInteractive Data Visualization: Foundations, Techniques, and Applications, Second Edition
Ward, M. O., Grinstein, G., & Keim, D. A. (2015) · A K Peters/CRC Press eBooks · doi:10.1201/b18379 · Cited by 141
Proceedings 1999 IEEE Symposium on Visual Languages
(1999) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vl.1999.795868 · Cited by 124
Data Visualization Literacy: Investigating Data Interpretation Along the Novice–Expert Continuum
Maltese, A. V., Harsh, J. A., & Svetina, D. (2015) · The journal of college science teaching · doi:10.2505/4/jcst15_045_01_84 · Cited by 112
Assessing Effects of Task and Data Distribution on the Effectiveness of Visual Encodings
Kim, Y.-H., & Heer, J. (2018) · Computer Graphics Forum · doi:10.1111/cgf.13409 · Cited by 98
Visual insights: a practical guide to making sense of data
Börner, K., Börner, K., Parts, T., & Polley, T. (2015) · Choice Reviews Online · doi:10.5860/choice.187405 · Cited by 79
Self-citationA Test of Graphicacy in Children
Wainer, H. (1980) · Applied Psychological Measurement · doi:10.1177/014662168000400305 · Cited by 59
Observations and Reflections on Visualization Literacy in Elementary School
Chevalier, F., Henry Riche, N., Alper, B., Plaisant, C., Boy, J., & Elmqvist, N. (2018) · IEEE Computer Graphics and Applications · doi:10.1109/mcg.2018.032421650 · Cited by 59
Attention allocation before antisaccades
Klapetek, A., Jonikaitis, D., & Deubel, H. (2016) · Journal of Vision · doi:10.1167/16.1.11 · Cited by 50
Data Visualization Literacy: Investigating Data Interpretation along the Novice-Expert Continuum
Maltese, A. V., Harsh, J. A., & Svetina, D. (2015) · The journal of college science teaching · Cited by 49
A Model of the Cognitive and Perceptual Processes in Graphical Display Comprehension
Shah, P. (1997) · Cited by 19
Network Visualization Literacy: Task, Context, and Layout
Zoss, A. M. (2018) · IUScholarWorks (Indiana University) · Cited by 2
Cited by
The concept and future prospects of soil health
Lehmann, J., Bossio, D. A., Kögel-Knabner, I., & Rillig, M. C. (2020) · Nature Reviews Earth & Environment · doi:10.1038/s43017-020-0080-8 · Cited by 1,791
The Science of Visual Data Communication: What Works
Franconeri, S. L., Padilla, L. M., Shah, P., Zacks, J. M., & Hullman, J. (2021) · Psychological Science in the Public Interest · doi:10.1177/15291006211051956 · Cited by 360
Accessible Visualization: Design Space, Opportunities, and Challenges
Kim, N. W., Joyner, S. C., Riegelhuth, A., & Kim, Y. (2021) · Computer Graphics Forum · doi:10.1111/cgf.14298 · Cited by 137
You’d Better Stop! Understanding Human Reliance on Machine Learning Models under Covariate Shift
Chiang, C.-W., & Yin, M. (2021) · 13th ACM Web Science Conference 2021 · doi:10.1145/3447535.3462487 · Cited by 53
“This might be partly caused by laypeople’s limited data visualization literacy [3].”
BackgroundChiang, C.-W., & Yin, M. (2022) · 27th International Conference on Intelligent User Interfaces · doi:10.1145/3490099.3511121 · Cited by 42
Metadata
- Authors
- Börner, K., Bueckle, A., & Ginda, M.
- Venue
- Proceedings of the National Academy of Sciences
- Published
- 2019-02-04
- Volume
- 116
- Issue
- 6
- Pages
- 1857-1864
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- OpenAlex
- W2913589238
- Cited by
- 316
- References
- 55
- FWCI
- 12.85
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.