The DOI matches its DataCite record, with a small difference in title or year.
SVCCA: Singular Vector Canonical Correlation Analysis for Deep Learning Dynamics and Interpretability
Open accessAbstract
We propose a new technique, Singular Vector Canonical Correlation Analysis (SVCCA), a tool for quickly comparing two representations in a way that is both invariant to affine transform (allowing comparison between different layers and networks) and fast to compute (allowing more comparisons to be calculated than with previous methods). We deploy this tool to measure the intrinsic dimensionality of layers, showing in some cases needless over-parameterization; to probe learning dynamics throughout training, finding that networks converge to final representations from the bottom up; to show where class-specific information in networks is formed; and to suggest new training regimes that simultaneously save computation and overfit less. Code: https://github.com/google/svcca/
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Several other methods, such as t-distributed stochastic neighbor embedding (t-SNE) and correlation-based singular vector canonical correlation analysis (SVCCA) [48], play a significant role in directing towards the subspace of input for error-free predictions.”
From Interpreting Black-Box Models: A Review on Explainable Artificial Intelligence (2024) · cites this paper as [48]
Citations
Cites
Still being checked.
Cited by
Sorted by citations
Items 101–200 of 342
Adversarial training in communication constrained federated learningPreprint
Shah, D. P., Dube, P., Chakraborty, S., & Verma, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.01319 · Cited by 20
Reaching Data Confidentiality and Model Accountability on the CalTrain
Gu, Z., Jamjoom, H. T., Su, D., Huang, H., Zhang, J., Ma, T., Pendarakis, D. E., & Molloy, I. (2019) · International Conference on Dependable Systems & Networks/Proceedings · doi:10.1109/dsn.2019.00044 · Cited by 21
Individual differences among deep neural network modelsPreprint
Mehrer, J., Spoerer, C. J., Kriegeskorte, N., & Kietzmann, T. C. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.01.08.898288 · Cited by 22
Improving Speech Translation by Cross-Modal Multi-Grained Contrastive Learning
Zhang, H., Si, N., Chen, Y., Zhang, W., Yang, X., Qu, D., & Zhang, W.-Q. (2023) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2023.3244521 · Cited by 18
The Life Cycle of Knowledge in Big Language Models: A Survey
Cao, B., Lin, H., Han, X., & Sun, L. (2024) · Machine Intelligence Research · doi:10.1007/s11633-023-1416-x · Cited by 18
PipeTransformer: Automated Elastic Pipelining for Distributed Training of Large-scale Models
He, C., Shen, L., Soltanolkotabi, M., & Avestimehr, S. (2021) · International Conference on Machine Learning · Cited by 18
Selectivity considered harmful: evaluating the causal impact of class selectivity in DNNsPreprint
Leavitt, M. L., & Morcos, A. S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.01262 · Cited by 32
The Life Cycle of Knowledge in Big Language Models: A Survey
Cao, B., Lin, H., Han, X., & Sun, L. (2023) · arXiv · doi:10.48550/arxiv.2303.07616 · Cited by 18
Communication-Efficient Federated Learning With Gradual Layer Freezing
Malan, E., Peluso, V., Calimera, A., & Macii, E. (2022) · IEEE Embedded Systems Letters · doi:10.1109/les.2022.3190682 · Cited by 17
Object Detector Differences when Using Synthetic and Real Training Data
Ljungqvist, M. G., Nordander, O., Skans, M., Mildner, A., Liu, T., & Nugues, P. (2023) · SN Computer Science · doi:10.1007/s42979-023-01704-5 · Cited by 17
Characterizing the Shape of Activation Space in Deep Neural Networks
Gebhart, T., Schrater, P., & Hylton, A. (2019) · International Conference on Machine Learning and Applications · doi:10.1109/icmla.2019.00254 · Cited by 22
Research on Explainable Artificial Intelligence Techniques: An User Perspective
Morais, F. L. D., Cinalli, D., & García, A. C. B. (2021) · International Conference on Computer Supported Cooperative Work in Design (CSCWD) · doi:10.1109/cscwd49262.2021.9437820 · Cited by 16
Shaer, I., & Shami, A. A. (2023) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2023.3278937 · Cited by 16
CipherDAug: Ciphertext based Data Augmentation for Neural Machine Translation
Kambhatla, N., Born, L., & Sarkar, A. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.17 · Cited by 20
Rethinking Transfer Learning for Medical Image ClassificationPreprint
Peng, L., Liang, H., Luo, G., Li, T., & Sun, J. (2022) · medRxiv · doi:10.1101/2022.11.26.22282782 · Cited by 21
AiFed: An Adaptive and Integrated Mechanism for Asynchronous Federated Data Mining
You, L., Liu, S., Wang, T., Zuo, B.-R., Chang, Y., & Yuen, C. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2023.3332770 · Cited by 16
Rethinking ImageNet Pre-training for Computational Histopathology
Ray, I., Raipuria, G., & Singhal, N. (2022) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc48229.2022.9871687 · Cited by 15
Optimizing Mode Connectivity via Neuron AlignmentPreprint
Tatro, N. J., Chen, P., Das, P., Melnyk, I., Sattigeri, P., & Lai, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.02439 · Cited by 19
FedBFPT: An Efficient Federated Learning Framework for Bert Further Pre-training
Wang, X., Li, H., Chen, K., & Shou, L. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/483 · Cited by 14
Fedorov, A., Geenjaar, E., Wu, L., Sylvain, T., DeRamus, T. P., Luck, M. M., Misiura, M. B., Mittapalle, G., Hjelm, R. D., Plis, S., et al. (2023) · NeuroImage · doi:10.1016/j.neuroimage.2023.120485 · Cited by 17
Embracing Federated Learning: Enabling Weak Client Participation via Partial Model Training
Lee, S., Zhang, T., Prakash, S., Niu, Y., & Avestimehr, S. (2024) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2024.3392212 · Cited by 15
Is Pruning Compression?: Investigating Pruning Via Network Layer Similarity
Blakeney, C., Yan, Y., & Zong, Z. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093318 · Cited by 15
Interference and Generalization in Temporal Difference Learning
Bengio, E., Pineau, J., & Precup, D. (2020) · arXiv · doi:10.48550/arxiv.2003.06350 · Cited by 14
Similarity of Neural Networks with GradientsPreprint
Tang, S., Maddox, W. J., Dickens, C., Diethe, T., & Damianou, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.11498 · Cited by 14
An Interpretability Illusion for BERT
Bolukbasi, T., Pearce, A., Yuan, A., Coenen, A., Reif, E., Viégas, F., & Wattenberg, M. (2021) · arXiv · doi:10.48550/arxiv.2104.07143 · Cited by 113
Layer Pruning on Demand with Intermediate CTC
Lee, J., Kang, J., & Watanabe, S. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-1171 · Cited by 13
TX-Ray: Quantifying and Explaining Model-Knowledge Transfer in (Un-)Supervised NLPPreprint
Rethmeier, N., Saxena, V., & Augenstein, I. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.00982 · Cited by 17
Do Vision and Language Encoders Represent the World Similarly?
Maniparambil, M., Akshulakov, R., Dahou Djilali, Y. A., Seddik, M. E. A., Narayan, S., Mangalam, K., & O'Connor, N. E. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.01359 · Cited by 7
Understanding the Effects of Pre-Training for Object Detectors via Eigenspectrum
Shinya, Y., Simo‐Serra, E., & Suzuki, T. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00242 · Cited by 12
Self-Supervised Multimodal Domino: in Search of Biomarkers for Alzheimer’s Disease
Fedorov, A., Sylvain, T., Geenjaar, E., Luck, M. M., Wu, L., DeRamus, T. P., Kirilin, A., Bleklov, D., Calhoun, V. D., & Plis, S. (2021) · IEEE International Conference on Healthcare Informatics (ICHI) · doi:10.1109/ichi52183.2021.00017 · Cited by 12
Alleman, M., Mamou, J., Rio, M. A. D., Tang, H., Kim, Y., & Chung, S. (2021) · Workshop on Representation Learning for NLP (RepL4NLP) · doi:10.18653/v1/2021.repl4nlp-1.27 · Cited by 17
Let's Agree to Agree: Neural Networks Share Classification Order on Real DatasetsPreprint
Hacohen, G., Choshen, L., & Weinshall, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.10854 · Cited by 15
MURAL: Multimodal, Multitask Retrieval Across LanguagesPreprint
Jain, A., Guo, M., Srinivasan, K., Chen, T., Kudugunta, S., Jia, C., Yang, Y., & Baldridge, J. (2021) · arXiv.org · doi:10.48550/arxiv.2109.05125 · Cited by 65
Language Models Learn POS First
Saphra, N., & Lopez, A. (2018) · BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackboxNLP) · doi:10.18653/v1/w18-5438 · Cited by 11
Studying the Evolution of Neural Activation Patterns During Training of Feed-Forward ReLU Networks
Hartmann, D., Franzen, D., & Brodehl, S. (2021) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2021.642374 · Cited by 15
A Progressive and Cross-Domain Deep Transfer Learning Framework for Wrist Fracture Detection
Karam, C., Zini, J. E., Awad, M., Saade, C., Naffaa, L. N., & Amine, M. E. (2021) · Journal of Artificial Intelligence and Soft Computing Research · doi:10.2478/jaiscr-2022-0007 · Cited by 12
Classifying the classifier: dissecting the weight space of neural networksPreprint
Eilertsen, G., Jönsson, D., Ropinski, T., Unger, J., & Ynnerman, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.05688 · Cited by 11
Discovering Language-neutral Sub-networks in Multilingual Language Models
Foroutan, N., Banaei, M., Lebret, R., Bosselut, A., & Aberer, K. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.513 · Cited by 19
Few-Shot Omnidirectional Human Motion Recognition Using Monostatic Radar System
Yang, Y., Li, J., Li, B., Lang, Y., & Zhai, W. (2023) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2023.3328079 · Cited by 10
Spiking generative adversarial network with attention scoring decoding
Feng, L., Zhao, D., & Zeng, Y. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.106423 · Cited by 10
Disentangling Neuron Representations with Concept Vectors
O'Mahony, L., Andrearczyk, V., Müller, H., & Graziani, M. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00390 · Cited by 14
Interpreting Deep Neural Networks through Prototype Factorization
Das, S., Xu, P., Dai, Z., Endert, A., & Ren, L. (2020) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw51313.2020.00068 · Cited by 11
Taqwa, M. R. A., & Rahim, H. F. (2022) · Journal of Physics Conference Series · doi:10.1088/1742-6596/2309/1/012060 · Cited by 10
Shared Representational Geometry Across Neural NetworksPreprint
Lu, Q., Chen, P.-H., Pillow, J. W., Ramadge, P. J., Norman, K. A., & Hasson, U. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.11684 · Cited by 10
A Study of Gradient Variance in Deep LearningPreprint
Faghri, F., Duvenaud, D., Fleet, D. J., & Ba, J. L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.04532 · Cited by 34
Ps and Qs: Quantization-Aware Pruning for Efficient Low Latency Neural Network Inference.
Hawks, B., Duarte, J. M., Fraser, N. J., Pappalardo, A., Tran, N. V., & Umuroglu, Y. (2021) · eScholarship (California Digital Library) · Cited by 9
Towards AI-Enabled Hardware Security: Challenges and Opportunities
Sayadi, H., Aliasgari, M., Aydın, F., Potluri, S., Aysu, A., Edmonds, J., & Tehranipoor, F. (2022) · IEEE International On-Line Testing Symposium (IOLTS) · doi:10.1109/iolts56730.2022.9897507 · Cited by 10
Selective Super-Resolution for Scene Text Images
Nakao, R., Iwana, B. K., & Uchida, S. (2019) · IAPR International Conference on Document Analysis and Recognition (ICDAR) · doi:10.1109/icdar.2019.00071 · Cited by 9
Huang, L., Ma, Z., Yu, L., Zhou, H., & Tian, Y. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i1.25073 · Cited by 10
Improving Zero-Shot Translation by Disentangling Positional InformationPreprint
Liu, D., Niehues, J., Cross, J., Guzmán, F., & Li, X. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.15127 · Cited by 9
Williams, A. H. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.10.23.619871 · Cited by 9
Enhancing Android malware detection via knowledge distillation on homogenized function call graphs
Wang, Z., Zhang, K., Yang, S., He, D., & Chan, S. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113687 · Cited by 8
Communication Efficient Heterogeneous Federated Learning based on Model Similarity
Li, Z., Ohtsuki, T. O., & Gui, G. (2023) · IEEE Wireless Communications and Networking Conference · doi:10.1109/wcnc55385.2023.10118862 · Cited by 8
Wang, Z., Duan, Q., Xu, Y., & Zhang, L. (2024) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2024.103116 · Cited by 8
Neural networks trained with SGD learn distributions of increasing complexity*
Refinetti, M., Ingrosso, A., & Goldt, S. (2025) · Journal of Statistical Mechanics Theory and Experiment · doi:10.1088/1742-5468/ad8bb8 · Cited by 19
Analyzing and Controlling Inter-Head Diversity in Multi-Head Attention
Yun, H., Kang, T., & Jung, K. (2021) · Applied Sciences · doi:10.3390/app11041548 · Cited by 7
Investigating Multilingual NMT Representations at ScalePreprint
Kudugunta, S., Bapna, A., Caswell, I. R., Arivazhagan, N., & Fırat, O. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.02197 · Cited by 25
Hierarchical nucleation in deep neural networksPreprint
Doimo, D., Glielmo, A., Ansuini, A., & Laio, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.03506 · Cited by 12
Way, G. P., Zietz, M., Rubinetti, V., Himmelstein, D. S., & Greene, C. S. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/573782 · Cited by 7
Dufumier, B., Gori, P., Battaglia, I., Victor, J., Grigis, A., & Duchesnay, É. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.01132 · Cited by 22
Experimental Observations of the Topology of Convolutional Neural Network Activations
Purvine, E., Brown, D., Jefferson, B. A., Joslyn, C., Praggastis, B., Rathore, A., Shapiro, M. R., Wang, B., & Zhou, Y. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i8.26134 · Cited by 12
DSNet: Dynamic Stitchable Neural Network for Hyperspectral Image Classification
Feng, S., Zhao, Z., Xi, B., Zhao, C., Li, W., Tao, R., & Li, Y. (2025) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2025.3589364 · Cited by 11
PURSUhInT: In Search of Informative Hint Points Based on Layer Clustering for Knowledge Distillation
Keser, R. K., Ayanzadeh, A., Aghdam, O. A., Kilcioglu, C., Töreyın, B. U., & Üre, N. K. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.119040 · Cited by 7
Insights on Neural Representations for End-to-End Speech Recognition
Ollerenshaw, A., Jalal, M. A., & Hain, T. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-1516 · Cited by 7
An Investigation of Structures Responsible for Gender Bias in BERT and DistilBERT
Leteno, T., Gourru, A., Laclau, C., & Gravier, C. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-30047-9_20 · Cited by 9
Embedding Recycling for Language Models
Saad-Falcon, J., Singh, A., Soldaini, L., D’Arcy, M., Cohan, A., & Downey, D. (2023) · Findings of the Association for Computational Linguistics: EACL · doi:10.18653/v1/2023.findings-eacl.145 · Cited by 10
Towards Understanding Attention-Based Speech Recognition Models
Qin, C.-X., & Qu, D. (2020) · IEEE Access · doi:10.1109/access.2020.2970758 · Cited by 7
Walking the Tightrope: An Investigation of the Convolutional Autoencoder BottleneckPreprint
Manakov, I., Rohm, M., & Tresp, V. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.07460 · Cited by 7
Audio feature enhancement based on quaternion filtering and deep hashing
Jin, X., Sun, B., & Li, D. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128727 · Cited by 6
Topological Regularization for Representation Learning via Persistent Homology
Chen, M., Wang, D., Shi, F., & Zhang, Y. (2023) · Mathematics · doi:10.3390/math11041008 · Cited by 7
Toward Sampling for Deep Learning Model Diagnosis
Mehta, P., Portillo, S. K. N., Bałazińska, M., & Connolly, A. J. (2020) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde48307.2020.00201 · Cited by 6
AMITE: A Novel Polynomial Expansion for Analyzing Neural Network Nonlinearities
Sanchirico, M. J., Jiao, X., & Nataraj, C. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3130904 · Cited by 5
ImageNet Pre-training Also Transfers Non-robustness
Zhang, J., Sang, J., Yi, Q., Yang, Y., Dong, H., & Yu, J. F. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i3.25452 · Cited by 8
Does Transliteration Help Multilingual Language Modeling?
Moosa, I. M., Akhter, M. E., & Habib, A. B. (2023) · Findings of the Association for Computational Linguistics: EACL · doi:10.18653/v1/2023.findings-eacl.50 · Cited by 11
Deep Neural Networks Architectures from the Perspective of Manifold Learning
Magai, G. (2023) · International Conference on Pattern Recognition and Artificial Intelligence (PRAI) · doi:10.1109/prai59366.2023.10331992 · Cited by 7
On the Similarity between Hidden Layers of Pruned and Unpruned Convolutional Neural Networks
Ansuini, A., Medvet, E., Pellegrino, F. A., & Zullich, M. (2020) · International Conference on Pattern Recognition Applications and Methods · doi:10.5220/0008960300520059 · Cited by 7
Feature Space Saturation during Training
Richter, M. L., Shenk, J. C., Byttner, W., Wiedenroth, A., & Huss, M. (2021) · British Machine Vision Conference (BMVC) · doi:10.5244/c.35.28 · Cited by 6
Palla, G., & Ferrero, E. (2020) · iScience · doi:10.1016/j.isci.2020.101451 · Cited by 8
Optimal anticipatory control as a theory of motor preparation: a thalamo-cortical circuit modelPreprint
Kao, T.-C., Sadabadi, M. S., & Hennequin, G. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.02.02.931246 · Cited by 5
Transferred Discrepancy: Quantifying the Difference Between RepresentationsPreprint
Feng, Y., Zhai, R., He, D., Wang, L., & Dong, B. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.12446 · Cited by 12
Quantifying Differences in Neural Population Activity With Shape MetricsPreprint
Barbosa, J., Nejatbakhsh, A., Duong, L., Harvey, S. E., Brincat, S. L., Siegel, M., Miller, E. K., & Williams, A. H. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.01.10.632411 · Cited by 9
Training Acceleration Method Based on Parameter Freezing
Tang, H., Chen, J., Zhang, W., & Guo, Z. M. (2024) · Electronics · doi:10.3390/electronics13112140 · Cited by 6
Information Bottleneck Theory Based Exploration of Cascade Learning
Du, X., Farrahi, K., & Niranjan, M. (2021) · Entropy · doi:10.3390/e23101360 · Cited by 6
Using Multi-Resolution Data to Accelerate Neural Network Training in Scientific Applications
Wang, K., Lee, S., Balewski, J. T., Sim, A., Nugent, P., Agrawal, A., Choudhary, A., Wu, K. J., & Liao, W. (2022) · IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid) · doi:10.1109/ccgrid54584.2022.00050 · Cited by 5
What Affects Learned Equivariance in Deep Image Recognition Models?
Bruintjes, R.-J., Motyka, T., & van Gemert, J. C. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00512 · Cited by 9
Few-shot learning for inference in medical imaging with subspace feature representations
Liu, J., Fan, K., Cai, X., & Niranjan, M. (2024) · PLoS ONE · doi:10.1371/journal.pone.0309368 · Cited by 9
Paisarnsrisomsuk, S., Ruiz, C., & Álvarez, S. A. (2021) · SN Computer Science · doi:10.1007/s42979-021-00697-3 · Cited by 5
Dinh, T. A., Liu, D., & Niehues, J. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746815 · Cited by 5
Feature structure distillation with Centered Kernel Alignment in BERT transferring
Jung, H.-J., Kim, D., Na, S., & Kim, K. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.120980 · Cited by 5
On Geometric Structure of Activation Spaces in Neural NetworksPreprint
Jia, Y., Wang, H., Shao, S., Long, H., Zhou, Y., & Wang, X. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.01399 · Cited by 7
Exploring the Interchangeability of CNN Embedding SpacesPreprint
McNeely-White, D. G., Sattelberg, B., Blanchard, N., & Beveridge, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.02323 · Cited by 7
Does Continual Learning = Catastrophic Forgetting?Preprint
Thai, A., Stojanov, S., Rehg, I., & Rehg, J. M. (2021) · arXiv (Cornell University) · Cited by 5
Grounding Representation Similarity with Statistical TestingPreprint
Ding, F., Denain, J.-S., & Steinhardt, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.01661 · Cited by 22
Graph-Based Similarity of Deep Neural Networks
Chen, Z., Lu, Y., Hu, J., Xuan, Q., Wang, Z., & Yang, X. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128722 · Cited by 17
Explainable Self-Supervised Dynamic Neuroimaging Using Time Reversal
Iqbal, Z., Rahman, M. M., Mahmood, U., Zia, Q., Fu, Z., Calhoun, V. D., & Plis, S. (2025) · Brain Sciences · doi:10.3390/brainsci15010060 · Cited by 4
Coarse-to-fine fusion for language grounding in 3D navigation
Nguyen, T. T., Vo, A. H., Choi, S.-M., & Kim, Y.-G. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.110785 · Cited by 4
Basis scaling and double pruning for efficient inference in network-based transfer learning
Wong, K. C. L., Kashyap, S., & Moradi, M. (2023) · Pattern Recognition Letters · doi:10.1016/j.patrec.2023.11.026 · Cited by 4
Viewing Knowledge Transfer in Multilingual Machine Translation Through a Representational Lens
Stap, D., Niculae, V., & Monz, C. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.998 · Cited by 6
Advancing Security in AI Systems: A Novel Approach to Detecting Backdoors in Deep Neural Networks
Hossain, K. M., & Oates, T. (2024) · International Conference on Communications · doi:10.1109/icc51166.2024.10622312 · Cited by 4
Lee, M. (2024) · Fractal and Fractional · doi:10.3390/fractalfract8100552 · Cited by 5
Metadata
- Authors
- Raghu, M., Gilmer, J., Yosinski, J., & Sohl-Dickstein, J.
- Affiliations
- Google (United States) (US)
- Uber AI (United States) (US)
- ORCID
- Gilmer, Justin
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2017
- Volume
- 30
- Pages
- 6076-6085
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1706.05806
- OpenAlex
- W2767204723
- Cited by
- 335
- References
- 0
- Citations by year
- 2026: 4 · 2025: 13 · 2024: 33 · 2023: 55 · 2022: 40 · 2021: 77 · 2020: 65 · 2019: 41 · 2018: 7
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- neural information processing systems
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- Keywords
- representation comparison, affine invariance, overparameterization, learning dynamics, training dynamics, interpretability, training protocols, overfitting
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review