A survey of visual analytics techniques for machine learning
Open accessThe DOI matches its Crossref record; 236 of the 236 references it cites were found in a registry or an index.
Abstract
Visual analytics for machine learning has recently evolved as one of the most exciting areas in the field of visualization. To better identify which research topics are promising and to learn how to apply relevant techniques in visual analytics, we systematically review 259 papers published in the last ten years together with representative works before 2010. We build a taxonomy, which includes three first-level categories: techniques before model building, techniques during modeling building, and techniques after model building. Each category is further characterized by representative analysis tasks, and each task is exemplified by a set of recent influential works. We also discuss and highlight research challenges and promising potential future research opportunities useful for visual analytics researchers.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Items 201–236 of 236
VIANA: Visual Interactive Annotation of Argumentation
Sperrle, F., Sevastjanova, R., Kehlbeck, R., & El‐Assady, M. (2019) · IEEE Conference on Visual Analytics Science and Technology (VAST) · doi:10.1109/vast47406.2019.8986917 · Cited by 28
Multi-Instance Learning from Supervised View
Zhou, Z. (2006) · Journal of Computer Science and Technology · doi:10.1007/s11390-006-0800-7 · Cited by 27
Improving Learning-from-Crowds through Expert Validation
Liu, M., Jiang, L., Liu, J., Wang, X., Zhu, J., & Liu, S. (2017) · Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/324 · Cited by 27
Self-citationHe, W., Lee, T., van Baar, J., Wittenburg, K. B., & Shen, H. (2020) · IEEE Pacific Visualization Symposium · doi:10.1109/pacificvis48177.2020.7127 · Cited by 27
Visual Analysis of Missing Values in Longitudinal Cohort Study Data
Alemzadeh, S., Niemann, U., Ittermann, T., Völzke, H., Schneider, D., Spiliopoulou, M., Bühler, K., & Preim, B. (2019) · Computer Graphics Forum · doi:10.1111/cgf.13662 · Cited by 26
Visual analysis and coding of data-rich user behavior
Blascheck, T., Beck, F., Baltes, S., Ertl, T., & Weiskopf, D. (2016) · IEEE Conference on Visual Analytics Science and Technology (VAST) · doi:10.1109/vast.2016.7883520 · Cited by 25
SocialBrands: Visual analysis of public perceptions of brands on social media
Liu, X., Xu, A., Gou, L., Liu, H., Akkiraju, R., & Shen, H. (2016) · IEEE Conference on Visual Analytics Science and Technology (VAST) · doi:10.1109/vast.2016.7883513 · Cited by 24
Urban Space Explorer: A Visual Analytics System for Urban Planning
Karduni, A., Cho, I., Wessel, G., Ribarsky, W., Sauda, É., & Wenwen Dou, A. (2017) · IEEE Computer Graphics and Applications · doi:10.1109/mcg.2017.3621223 · Cited by 24
Exploring Evolution of Dynamic Networks via Diachronic Node Embeddings
Xu, J., Tao, Y., Yan, Y., & Lin, H. B. (2018) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2018.2887230 · Cited by 24
Local Prediction Models for Spatiotemporal Volume Visualization
Tkachev, G., Frey, S., & Ertl, T. (2019) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2019.2961893 · Cited by 24
Visual Analytics for Exploring Local Impact of Air Traffic
Buchmüller, J., Janetzko, H., Andrienko, G., Andrienko, N. V., Fuchs, G., & Keim, D. A. (2015) · Computer Graphics Forum · doi:10.1111/cgf.12630 · Cited by 23
von Landesberger, T., Basgier, D., & Becker, M. (2015) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2015.2501813 · Cited by 23
WeSeer: Visual Analysis for Better Information Cascade Prediction of WeChat Articles
Li, Q., Wu, Z., Yi, L., Njotoprawiro, K. S., Qu, H., & Ma, X. (2018) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2018.2867776 · Cited by 23
TopicSifter: Interactive Search Space Reduction through Targeted Topic Modeling
Kim, H., Choi, D., Drake, B. L., Endert, A., & Park, H. (2019) · IEEE Conference on Visual Analytics Science and Technology · doi:10.1109/vast47406.2019.8986922 · Cited by 23
Visualization of Time‐Series Data in Parameter Space for Understanding Facial Dynamics
Tam, G. K. L., Fang, H., Aubrey, A. J., Grant, P. W., Rosin, P. L., Marshall, D., & Chen, M. (2011) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2011.01939.x · Cited by 21
Towards Easy Comparison of Local Businesses Using Online Reviews
Wang, Y., Haleem, H., Shi, C., Wu, Y., Zhao, X., Fu, S., & Qu, H. (2018) · Computer Graphics Forum · doi:10.1111/cgf.13401 · Cited by 21
A Visual Analytics Framework for Microblog Data Analysis at Multiple Scales of Aggregation
Zhang, J., Ahlbrand, B., Malik, A., Chae, J., Min, Z., Ko, S., & Ebert, D. S. (2016) · Computer Graphics Forum · doi:10.1111/cgf.12920 · Cited by 20
Blumenschein, M., Behrisch, M., Schmid, S., Butscher, S., Wahl, D. R., Villinger, K., Renner, B., Reiterer, H., & Keim, D. A. (2018) · IEEE Conference on Visual Analytics Science and Technology (VAST) · doi:10.1109/vast.2018.8802486 · Cited by 20
Bird's‐Eye ‐ Large‐Scale Visual Analytics of City Dynamics using Social Location Data
Krueger, R., Han, Q., Ivanov, N., Mahtal, S., Thom, D., Pfister, H., & Ertl, T. (2019) · Computer Graphics Forum · doi:10.1111/cgf.13713 · Cited by 20
Decision Exploration Lab: A Visual Analytics Solution for Decision Management
Broeksema, B., Baudel, T., Telea, A. C., & Crisafulli, P. (2013) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2013.146 · Cited by 19
Classifier‐Guided Visual Correction of Noisy Labels for Image Classification Tasks
Bäuerle, A., Heiko Neumann, B., & Ropinski, T. (2020) · OPen Access Repositorium der Universität Ulm (OPARU) (Ulm University) · doi:10.18725/oparu-43002 · Cited by 18
ConcaveCubes: Supporting Cluster‐based Geographical Visualization in Large Data Scale
Li, M., Choudhury, F. M., Bao, Z., Samet, H., & Sellis, T. (2018) · Computer Graphics Forum · doi:10.1111/cgf.13414 · Cited by 17
Zhang, C., Yang, J., Zhan, F. B., Gong, X., Brender, J. D., Langlois, P. H., Barlowe, S., & Zhao, Y. (2016) · IEEE Pacific Visualization Symposium · doi:10.1109/pacificvis.2016.7465261 · Cited by 16
Exploring Online Learners' Interactive Dynamics by Visually Analyzing Their Time‐anchored Comments
Sung, C., Huang, X., Shen, Y., et al. (2017) · Computer Graphics Forum · doi:10.1111/cgf.13280 · Cited by 16
Topic-Based Exploration and Embedded Visualizations for Research Idea Generation
Guo, H., & Laidlaw, D. H. (2018) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2018.2873011 · Cited by 16
Wang, J., Zhang, W., & Yang, H. (2020) · IEEE Pacific Visualization Symposium · doi:10.1109/pacificvis48177.2020.3542 · Cited by 16
FAIRVIS: Visual Analytics for Discovering Intersectional Bias in Machine Learning
Cabrera, Á. A., Epperson, W., Hohman, F., Kahng, M., Morgenstern, J., & Chau, D. H. (2019) · 2019 IEEE Conference on Visual Analytics Science and Technology (VAST) · doi:10.1109/vast47406.2019.8986948 · Cited by 14 · cited 3×
“Recently, the issue of model fairness has drawn growing attention [2, 32, 267].”
BackgroundLoVis: Local Pattern Visualization for Model Refinement
Zhao, K., Ward, M. O., Rundensteiner, E. A., & Higgins, H. N. (2014) · Computer Graphics Forum · doi:10.1111/cgf.12389 · Cited by 14
Segmentifier: Interactive Refinement of Clickstream Data
Dextras-Romagnino, K., & Munzner, T. (2019) · Computer Graphics Forum · doi:10.1111/cgf.13715 · Cited by 13
Image Flows Visualization for Inter-media Comparison
Itoh, M., Toyoda, M., Zhu, C. Z., Satoh, S., & Kitsuregawa, M. (2014) · IEEE Pacific Visualization Symposium · doi:10.1109/pacificvis.2014.49 · Cited by 11
Visualizing Deep Neural Networks for Text Analytics
Nie, S., Healey, C. G., Padia, K., Leeman-Munk, S., Benson, J. R., Caira, D., Sethi, S., & Devarajan, R. (2018) · IEEE Pacific Visualization Symposium · doi:10.1109/pacificvis.2018.00031 · Cited by 11
CMed: Crowd Analytics for Medical Imaging Data
Park, J. H., Nadeem, S., Boorboor, S., Marino, J., & Kaufman, A. E. (2019) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2019.2953026 · Cited by 11
Rationale Visualization for Safety and Security
Scheepens, R., Michels, S., van de Wetering, H., & van Wijk, J. J. (2015) · Computer Graphics Forum · doi:10.1111/cgf.12631 · Cited by 10
DIVA: Exploration and Validation of Hypothesized Drug‐Drug Interactions
Kakar, T., Qin, X., Rundensteiner, E. A., Harrison, L., Sahoo, S. K., & De, S. (2019) · Computer Graphics Forum · doi:10.1111/cgf.13674 · Cited by 10
Exploring controversy via sentiment divergences of aspects in reviews
Xu, J., Tao, Y., Lin, H. B., Zhu, R., & Yan, Y. (2017) · IEEE Pacific Visualization Symposium · doi:10.1109/pacificvis.2017.8031600 · Cited by 9
Topic Tomographies (TopTom): a visual approach to distill information from media streams
Gobbo, B., Balsamo, D., Mauri, M., Bajardi, P., Panisson, A., & Ciuccarelli, P. (2019) · Computer Graphics Forum · doi:10.1111/cgf.13714 · Cited by 5
Cited by
A survey of visual analytics for Explainable Artificial Intelligence methods
Alicioglu, G., & Sun, B. (2022) · Computers & Graphics · doi:10.1016/j.cag.2021.09.002 · Cited by 221
Extending the Nested Model for User-Centric XAI: A Design Study on GNN-based Drug Repurposing
Wang, Q., Huang, K., Chandak, P., Zitnik, M., & Gehlenborg, N. (2023) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2022.3209435 · Cited by 82
Naveed, Q. N., Alqahtani, H., Khan, R. U., Almakdi, S., Alshehri, M., & Abdul Rasheed, M. A. (2022) · Sensors · doi:10.3390/s22093333 · Cited by 45
“Yuan et al. [8] conducted a comprehensive review of 259 publications released in the last decades, as well as relevant performances before 2010, to better identify prospective research subjects and learn how to use relevant visual analytics approaches.”
BackgroundA survey of post-hoc xai methods from a visualization perspective: Challenges and opportunities
Bhati, D., Amiruzzaman, M., Zhao, Y., Guercio, A., & Le, T. (2025) · IEEE Access · doi:10.1109/access.2025.3581136 · Cited by 24
“Yuan et al. [29] surveyed papers before 2020 using three categories: techniques before model building, techniques during modeling building, and techniques after model building.”
Metadata
- Authors
- Yuan, J., Chen, C., Yang, W., Liu, M., Xia, J., & Liu, S.
- Venue
- Computational Visual Media
- Publisher
- Tsinghua University Press
- Published
- 2021-03
- Volume
- 7
- Issue
- 1
- Pages
- 3-36
- ISSN
- 2096-0433 (ISSN-L)
- 2096-0662
- OpenAlex
- W3108010663
- Cited by
- 258
- References
- 236
- FWCI
- 14.89
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.