The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
Towards Better Analysis of Deep Convolutional Neural Networks
Open accessAbstract
Deep convolutional neural networks (CNNs) have achieved breakthrough performance in many pattern recognition tasks such as image classification. However, the development of high-quality deep models typically relies on a substantial amount of trial-and-error, as there is still no clear understanding of when and why a deep model works. In this paper, we present a visual analytics approach for better understanding, diagnosing, and refining deep CNNs. We formulate a deep CNN as a directed acyclic graph. Based on this formulation, a hybrid visualization is developed to disclose the multiple facets of each neuron and the interactions between them. In particular, we introduce a hierarchical rectangle packing algorithm and a matrix reordering algorithm to show the derived features of a neuron cluster. We also propose a biclustering-based edge bundling method to reduce visual clutter caused by a large number of connections between neurons. We evaluated our method on a set of CNNs and the results are generally favorable.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,395
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
(2010) · Cited by 14,134
(2010) · International Conference on Machine Learning · Cited by 13,995
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001
Mean shift: a robust approach toward feature space analysis
Comaniciu, D., & Meer, P. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.1000236 · Cited by 11,305
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Fast Algorithms for Mining Association Rules in Large Databases
Agrawal, R., & Srikant, R. (1994) · Very Large Data Bases · Cited by 9,419
TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G. S., Davis, A., Dean, J., Devin, M., et al. (2016) · arXiv · doi:10.48550/arxiv.1603.04467 · Cited by 9,408
Learning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239
Large-Scale Video Classification with Convolutional Neural Networks
Karpathy, A., Toderici, G., Shetty, S., Leung, T., Sukthankar, R., & Fei-Fei, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.223 · Cited by 6,354
Fast algorithm for detecting community structure in networks
Newman, M. E. J. (2004) · Physical Review E · doi:10.1103/physreve.69.066133 · Cited by 5,406
Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps
Simonyan, K., Vedaldi, A., & Zisserman, A. (2013) · arXiv · doi:10.48550/arxiv.1312.6034 · Cited by 5,370
Learning Deep Architectures for AI
Bengio, Y. (2009) · now publishers, Inc. eBooks · doi:10.1561/9781601982957 · Cited by 4,941
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. J. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1408.5093 · Cited by 3,752
Understanding deep image representations by inverting them
Mahendran, A., & Vedaldi, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299155 · Cited by 1,827
Visualization Analysis and Design
Munzner, T. (2014) · A K Peters/CRC Press eBooks · doi:10.1201/b17511 · Cited by 1,697
Understanding Neural Networks Through Deep Visualization
Yosinski, J., Clune, J., Nguyen, A. M., Fuchs, T. J., & Lipson, H. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.06579 · Cited by 1,358
Adaptive deconvolutional networks for mid and high level feature learning
Zeiler, M. D., Taylor, G. W., & Fergus, R. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126474 · Cited by 1,217
Machine Learning: An Algorithmic Perspective
Marsland, S. (2009) · Cited by 1,182
Tree-Maps: A Space Filling Approach to the Visualization of Hierarchical Information Structures
Johnson, B., & Shneiderman, B. (1991) · Cited by 1,121
Efficient and Robust Feature Extraction by Maximum Margin Criterion
Li, H., Jiang, T., & Zhang, K. (2006) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2005.860852 · Cited by 841
Inverting Visual Representations with Convolutional Networks
Dosovitskiy, A., & Brox, T. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.522 · Cited by 603
Stochastic Gradient Learning in Neural Networks
Bottou, L. (1991) · Cited by 584
NodeTrix: a Hybrid Visualization of Social Networks
Henry, N., Fekete, J.-D., & McGuffin, M. J. (2007) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2007.70582 · Cited by 555
Force‐Directed Edge Bundling for Graph Visualization
Holten, D., & Van Wijk, J. J. (2009) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2009.01450.x · Cited by 522
Torch: a modular machine learning software library
Collobert, R., Samy Bengio, A., & Mariéthoz, J. (2002) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 435
Hierarchical Aggregation for Information Visualization: Overview, Techniques, and Design Guidelines
Elmqvist, N., & Fekete, J.-D. (2010) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2009.84 · Cited by 381
A survey on information visualization: recent advances and challenges
Liu, S., Cui, W., Wu, Y., & Liu, M. (2014) · The Visual Computer · doi:10.1007/s00371-013-0892-3 · Cited by 373
Self-citationTextFlow: Towards Better Understanding of Evolving Topics in Text
Cui, W., Liu, S., Tan, L., Shi, C., Song, Y., Gao, Z., Qu, H., & Tong, X. (2011) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2011.239 · Cited by 349
Self-citationGeometry-Based Edge Clustering for Graph Visualization
Cui, W., Zhou, H., Qu, H., Wong, P. C., & Li, X. (2008) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2008.135 · Cited by 283
Sun, G.-D., Wu, Y.-C., Liang, R.-H., & Liu, S.-X. (2013) · Journal of Computer Science and Technology · doi:10.1007/s11390-013-1383-8 · Cited by 197
Self-citationAn Interactive Node-Link Visualization of Convolutional Neural Networks
Harley, A. W. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-27857-5_77 · Cited by 150
On the depth of deep neural networks: a theoretical view
Sun, S., Chen, W., Wang, L., Liu, X., & Liu, T.-Y. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10243 · Cited by 147
An Information-theoretic Framework for Visualization
Mĭn, C., & Jäenicke, H. (2010) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2010.132 · Cited by 144
EvoRiver: Visual Analysis of Topic Coopetition on Social Media
Sun, G., Wu, Y., Liu, S., Peng, T., Zhu, J. J. H., & Liang, R. (2014) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2014.2346919 · Cited by 120
Self-citationegoSlider: Visual Analysis of Egocentric Network Evolution
Wu, Y., Pitipornvivat, N., Zhao, J., Yang, S., Huang, G., & Qu, H. (2015) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2015.2468151 · Cited by 110
Opening the Black Box - Data Driven Visualization of Neural Networks
Tzeng, F.-Y., & Ma, K. (2006) · Visualization · doi:10.1109/visual.2005.1532820 · Cited by 104
Opening the Black Box - Data Driven Visualization of Neural Network
Tzeng, F.-Y., & Ma, K. (2006) · doi:10.1109/vis.2005.73 · Cited by 91
Online Visual Analytics of Text Streams
Liu, S., Yin, J., Wang, X., Cui, W., Cao, K., & Pei, J. (2015) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2015.2509990 · Cited by 84
Self-citationAn Approach to Supporting Incremental Visual Data Classification
Paiva, J. G. S., Schwartz, W. R., Pedrini, H., & Minghim, R. (2014) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2014.2331979 · Cited by 80
An Uncertainty-Aware Approach for Exploratory Microblog Retrieval
Liu, M., Liu, S., Zhu, X., Liao, Q., Wei, F., & Pan, S. (2015) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2015.2467554 · Cited by 69
Self-citationThemeDelta: Dynamic Segmentations over Temporal Topic Models
Gad, S., Javed, W., Ghani, S., Elmqvist, N., Ewing, T., Hampton, K. N., & Ramakrishnan, N. (2015) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2014.2388208 · Cited by 63
Examining multiple potential models in end-user interactive concept learning
Amershi, S., Fogarty, J. A., Kapoor, A., & Tan, D. S. (2010) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753531 · Cited by 40
Chen, M., Walton, S., Berger, K., Thiyagalingam, J., Duffy, B., Fang, H., Holloway, C. J., & Trefethen, A. (2014) · Computer Graphics Forum · doi:10.1111/cgf.12380 · Cited by 26
Max-Margin Deep Generative ModelsPreprint
Li, C., Zhu, J., Shi, T., et al. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.06787 · Cited by 23
Self-citation
Research works printed but not linked: 8
- 10.1007/s10479-008-0463-6 · doi:10.1007/s10479-008-0463-6
- 10.1137/0110015 · doi:10.1137/0110015
- huang, 2012, Optimal rectangle packing: An absolute placement approach, J AIR, 46, 47
- 10.1109/TVCG.2015.2392771 · doi:10.1109/tvcg.2015.2392771
- 10.1109/TVCG.2015.2467813 · DOI
- 10.1109/TVCG.2014.2346433 · doi:10.1109/tvcg.2014.2346433
- erhan, 2009, Visualizing Higher-layer Features of Deep Networks
- bergstra, 2010, Theano a CPU and GPU math expression compiler
Cited by
Arrieta, A. B., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., García, S., Gil-López, S., Molina, D., Benjamins, R., et al. (2019) · arXiv · doi:10.48550/arxiv.1910.10045 · Cited by 11,321
Barredo Arrieta, A., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., Garcia, S., Gil-Lopez, S., Molina, D., Benjamins, R., et al. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.12.012 · Cited by 10,423
Opportunities and obstacles for deep learning in biology and medicine
Ching, T., Himmelstein, D. S., Beaulieu-Jones, B. K., Kalinin, A. A., Do, B. T., Way, G. P., Ferrero, E., Agapow, P.-M., Zietz, M., Hoffman, M. M., et al. (2018) · Journal of The Royal Society Interface · doi:10.1098/rsif.2017.0387 · Cited by 2,310
Ali, S., Abuhmed, T., El-Sappagh, S., Muhammad, K., Alonso-Moral, J. M., Confalonieri, R., Guidotti, R., Del Ser, J., Díaz-Rodríguez, N., & Herrera, F. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101805 · Cited by 1,762
Feng, D., Haase-Schutz, C., Rosenbaum, L., Hertlein, H., Glaser, C., Timm, F., Wiesbeck, W., & Dietmayer, K. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.2972974 · Cited by 1,425
Metadata
- Authors
- Liu, M., Shi, J., Li, Z., Li, C., Zhu, J., & Liu, S.
- Venue
- IEEE Transactions on Visualization and Computer Graphics
- Published
- 2017-01
- Volume
- 23
- Issue
- 1
- Pages
- 91-100
- ISSN
- 1077-2626 (ISSN-L)
- OpenAlex
- W2343061342
- Cited by
- 498
- References
- 55
- FWCI
- 31.26
- Type
- journal article
- Language
- en
- Open access
- green
- Funders
- National NSF of China (61672308, 61322308, 61332007)
- Microsoft Research (FY15-RES-OPP-112)
- National Basic Research Program (973 Program) of China (2013CB329403)
- Youth Top-notch Talent Support Program
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.