PreprintCited by 974Advanced Neural Network ApplicationsStochastic Gradient Optimization TechniquesNeural Networks and Applications

The DOI matches its DataCite record; 51 of the 53 references it cites were found in a registry or an index.

Compressing Neural Networks with the Hashing Trick

Open access

Chen, Wenlin, Wilson, James T., Tyree, Stephen, Weinberger, Kilian Q., Chen, Yixin·2015·arXiv

DOI 10.48550/arxiv.1504.04788arXiv 1504.04788

Open this paper in CoChat — free account Open PDF

Abstract

As deep nets are increasingly used in applications suited for mobile devices, a fundamental dilemma becomes apparent: the trend in deep learning is to grow models to absorb ever-increasing data set sizes; however mobile devices are designed with very little memory and cannot store such large models. We present a novel network architecture, HashedNets, that exploits inherent redundancy in neural networks to achieve drastic reductions in model sizes. HashedNets uses a low-cost hash function to randomly group connection weights into hash buckets, and all connections within the same hash bucket share a single parameter value. These parameters are tuned to adjust to the HashedNets weight sharing architecture with standard backprop during training. Our hashing procedure introduces no additional memory overhead, and we demonstrate on several benchmark data sets that HashedNets shrink the storage requirements of neural networks substantially while mostly preserving generalization performance.

Integrity signals

Registry

DataCite · 10.48550/arxiv.1504.04788

Cites

51 of 51 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Untitled work
(2014) · Cited by 33,419
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Neural networks for pattern recognition
Bishop, C. (1994) · Choice Reviews Online · doi:10.5860/choice.31-5500 · Cited by 18,537
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
Distilling the Knowledge in a Neural Network
Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204
Untitled work
(2010) · International Conference on Machine Learning · Cited by 13,995
Term-Weighting Approaches in Automatic Text Retrieval
Salton, G., & Buckley, C. (1988) · Information Processing & Management · doi:10.1016/0306-4573(88)90021-0 · Cited by 11,421
Deep neural networks for acoustic modeling in speech recognition: the shared views of four research groups
Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260

Show all 53 references

Sorted by citations

Items 601–700 of 973

Dynamic Runtime Feature Map PruningPreprint
Liang, T., Wang, L., Shi, S., & Glossner, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.09922 · Cited by 6
Understanding Sparse JL for Feature HashingPreprint
Jagadeesan, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.03605 · Cited by 6
Getting deep recommenders fit: Bloom embeddings for sparse binary input/output networksPreprint
Serrà, J., & Karatzoglou, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.03993 · Cited by 6
Meta Feature Modulator for Long-tailed RecognitionPreprint
Wang, R., Hu, K., Zhu, Y., Shu, J., Zhao, Q., & Meng, D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.03428 · Cited by 10
Transform Quantization for CNN Compression
Young, S. I., Wang, Z., Taubman, D., & Girod, B. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3084839 · Cited by 86
Merging Neurons for Structure Compression of Deep Networks
Zhong, G., Yao, H., & Zhou, H. (2018) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2018.8545107 · Cited by 5
Resource-Aware Optimization of DNNs for Embedded Applications
Frickenstein, A., Unger, C., & Stechele, W. (2019) · Canadian Conference on Computer and Robot Vision · doi:10.1109/crv.2019.00011 · Cited by 4
QPR: Quantizing PageRank with Coherent Shared Memory Accelerators
Mughrabi, A. T., Ibrahim, M. M. A., & Byrd, G. T. (2021) · IEEE International Parallel and Distributed Processing Symposium (IPDPS) · doi:10.1109/ipdps49936.2021.00105 · Cited by 5
Approximations in Deep Learning
Dupuis, E., Filip, S.-I., Sentieys, O., Novo, D., O’Connor, I., & Bosio, A. (2022) · Springer eBooks · doi:10.1007/978-3-030-94705-7_15 · Cited by 7
Edge artificial intelligence camera network: an efficient object detection and tracking framework
Chen, Y., Wang, C., & Lou, S. (2022) · Journal of Electronic Imaging · doi:10.1117/1.jei.31.3.033030 · Cited by 5
Self-citation
Discover the Effective Strategy for Face Recognition Model Compression by Improved Knowledge Distillation
Wang, M., Liu, R., Abe, N., Uchida, H., Matsunami, T., & Yamada, S. (2018) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2018.8451808 · Cited by 5
Segmentation of Fetal Adipose Tissue Using Efficient CNNs for Portable Ultrasound
Vaze, S., & Namburete, A. I. L. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-00807-9_6 · Cited by 5
Multi-Layer Pruning Framework for Compressing Single Shot MultiBox Detector
Singh, P. P., Manikandan, R., Matiyali, N., & Namboodiri, V. P. (2019) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2019.00145 · Cited by 5
Hardware–Software Approximations for Deep Neural Networks
Hanif, M. A., Javed, M. U., Hafiz, R., Rehman, S., & Shafique, M. (2018) · Springer eBooks · doi:10.1007/978-3-319-99322-5_13 · Cited by 5
Space Efficient Quantization for Deep Convolutional Neural Networks
Zhao, D., Fan, L., Sharif, K., Xia, G., & Wang, Y. (2019) · Journal of Computer Science and Technology · doi:10.1007/s11390-019-1912-1 · Cited by 5
iSparse: Output Informed Sparsification of Neural Network
Garg, Y., & Candan, K. S. (2020) · International Conference on Multimedia Retrieval · doi:10.1145/3372278.3390688 · Cited by 5
NFP: A No Fine-tuning Pruning Approach for Convolutional Neural Network Compression
Liu, R., Cao, J., Li, P., Sun, W., Zhang, Y., & Wang, Y. (2020) · International Conference on Artificial Intelligence and Big Data (ICAIBD) · doi:10.1109/icaibd49809.2020.9137429 · Cited by 5
Real-time Implementation of RMNv2 Classifier in NXP Bluebox 2.0 and NXP i.MX RT1060
Ayi, M., & El‐Sharkawy, M. (2020) · doi:10.1109/mic50194.2020.9209615 · Cited by 5
Multi-branch sharing network for real-time 3D brain tumor segmentation
Li, J., Zheng, J., Ding, M., & Yu, H. (2021) · Journal of Real-Time Image Processing · doi:10.1007/s11554-020-01049-9 · Cited by 5
Attn-HybridNet: Improving Discriminability of Hybrid Features With Attention Fusion
Verma, S., Wang, C., Zhu, L., & Liu, W. (2021) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2021.3060176 · Cited by 5
Improving Model Capacity of Quantized Networks with Conditional Computation
Pham, P., & Chung, J. (2021) · Electronics · doi:10.3390/electronics10080886 · Cited by 5
CLAIRE: Enabling Continual Learning for Real-time Autonomous Driving with a Dual-head Architecture
Zhang, H., & Mueller, F. (2022) · IEEE International Symposium on Real-Time Distributed Computing (ISORC) · doi:10.1109/isorc52572.2022.9812816 · Cited by 5
Learning with Scalability and Compactness
Chen, W. (2016) · Open Scholarship Institutional Repository (Washington University in St. Louis) · doi:10.7936/k7th8jz2 · Cited by 4
Self-citation
Distribution-Aware Binarization of Neural Networks for Sketch Recognition
Prabhu, A., Batchu, V., Munagala, S. A., Gajawada, R., & Namboodiri, A. (2018) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2018.00096 · Cited by 5
Deep Model Compression and Inference Speedup of Sum-Product Networks on Tensor Trains
Ko, C.-Y., Chen, C., He, Z., Zhang, Y., Batselier, K., & Wong, N. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2928379 · Cited by 5
Hardware Acceleration of Sparse Oblique Decision Trees for Edge Computing
Teodorovic, P., & STRUHARIK, R. J. R. (2019) · Elektronika ir Elektrotechnika · doi:10.5755/j01.eie.25.5.24351 · Cited by 6
On pruned, quantized and compact CNN architectures for vision applications
Gadosey, P. K., Li, Y., & Yamak, P. T. (2019) · International Conference on Artificial Intelligence, Information Processing and Cloud Computing (AIIPCC) · doi:10.1145/3371425.3371481 · Cited by 5
Effects of Gradient Optimizer on Model Pruning
Zhang, Y., Zhu, B. B., Ma, Q., & Wang, H. (2020) · IOP Conference Series Materials Science and Engineering · doi:10.1088/1757-899x/711/1/012095 · Cited by 5
Binarizing Weights Wisely for Edge Intelligence: Guide for Partial Binarization of Deconvolution-Based Generators
Liu, J., Zhang, J., Ding, Y., Xu, X., Jiang, M., & Shi, Y. (2020) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2020.2983370 · Cited by 5
Dynamic Programming Assisted Quantization Approaches for Compressing Normal and Robust DNN Models
Yang, D., Yu, W., Mu, H., & Yao, G. (2021) · Asia and South Pacific Design Automation Conference (ASP-DAC) · doi:10.1145/3394885.3431538 · Cited by 5
Bridging the Gap Between Neural Networks and Neuromorphic Hardware with A Neural Network CompilerPreprint
Ji, Y., Zhang, Y., Chen, W., & Xie, Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.00746 · Cited by 5
Self-citation
Compact and fast machine learning accelerator for IoT devices
Huang, H. (2018) · doi:10.32657/10356/73823 · Cited by 5
Learning Student Networks via Feature EmbeddingPreprint
Chen, H., Wang, Y., Xu, C., Xu, C., & Tao, D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.06597 · Cited by 5
MobiVSR: A Visual Speech Recognition Solution for Mobile DevicesPreprint
Shrivastava, N., Saxena, A., Kumar, Y., Shah, R. R., Mahata, D., & Stent, A. J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.03968 · Cited by 5
DAFL: Data-Free Learning of Student NetworksPreprint
Chen, H., Wang, Y., Xu, C., Yang, Z., Liu, C., Shi, B., Xu, C., Xu, C., & Tian, Q. C. (2019) · arXiv (Cornell University) · Cited by 5
A Mean Field Theory of Quantized Deep Networks: The Quantization-Depth Trade-OffPreprint
Blumenfeld, Y., Gilboa, D., & Soudry, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.00771 · Cited by 5
How Not to Give a FLOP: Combining Regularization and Pruning for Efficient InferencePreprint
Vu, T., Wen, E., & Nehoran, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.13593 · Cited by 5
CNN Acceleration by Low-rank Approximation with Quantized FactorsPreprint
Kozyrskiy, N., & Phan, A. H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.08878 · Cited by 5
Machine Learning Agricultural Application Based on the Secure Edge Computing Platform
Wu, F., Xu, Z., Liu, H., & Zhu, Z. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-62223-7_18 · Cited by 4
Variance reduction in feature hashing using MLE and control variate method
Verma, B. D., Pratap, R., & Thakur, M. (2022) · Machine Learning · doi:10.1007/s10994-022-06166-z · Cited by 4
Cluster-Based Structural Redundancy Identification for Neural Network Compression
Wu, T., Song, C., Zeng, P., & Xia, C. (2022) · Entropy · doi:10.3390/e25010009 · Cited by 4
NetPrune: A sparklines visualization for network pruning
Pommé, L.-E., Bourqui, R., Giot, R., Vallet, J., & Auber, D. (2023) · Visual Informatics · doi:10.1016/j.visinf.2023.04.001 · Cited by 7
Phase-field Models for Lightweight Graph Convolutional Networks
Sahbi, H. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00489 · Cited by 4
SNPF: Sensitiveness-Based Network Pruning Framework for Efficient Edge Computing
Lu, Y., Guan, Z., Zhao, W., Gong, M., Wang, W., & Sheng, K. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3314820 · Cited by 4
Research on compression pruning methods based on deep learning
Cai, M., Su, Y., Wang, B., & Zhang, T. (2023) · Journal of Physics Conference Series · doi:10.1088/1742-6596/2580/1/012060 · Cited by 4
Compressed neural networks for reduced order modeling
Zhu, Y., Sun, Q., Xiao, D., Yao, J., & Mao, X. (2024) · Physics of Fluids · doi:10.1063/5.0194598 · Cited by 4
Design and Implementation of a Self-Supervised Algorithm for Vein Structural Patterns Analysis Using Advanced Unsupervised Techniques
Rastogi, S., Duttagupta, S. P., & Guha, A. (2024) · Machine Learning and Knowledge Extraction · doi:10.3390/make6020056 · Cited by 4
SAAF: Self-Adaptive Attention Factor-Based Taylor-Pruning on Convolutional Neural Networks
Lu, Y., Gong, M., Feng, K., Liu, J., Guan, Z., & Li, H. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3439435 · Cited by 4
Towards thinner convolutional neural networks through gradually global pruning
Wang, Z., Zhu, C., Xia, Z., Guo, Q., & Liu, Y. (2017) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2017.8297021 · Cited by 4
The Mating Rituals of Deep Neural Networks: Learning Compact Feature Representations Through Sexual Evolutionary Synthesis
Chung, A. G., Shafiee, M. J., Fieguth, P., & Wong, A. M. (2017) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2017.147 · Cited by 4
Refine or Represent: Residual Networks with Explicit Channel-wise Configuration
Shen, Y., & Gao, J. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/372 · Cited by 4
Sensitivity-Oriented Layer-Wise Acceleration and Compression for Convolutional Neural Network
Zhou, W., Niu, Y., & Zhang, G. (2019) · IEEE Access · doi:10.1109/access.2019.2905138 · Cited by 4
Computationally Efficient Learning of Quality Controlled Word Embeddings for Natural Language Processing
Alawad, M., & Tourassi, G. D. (2019) · IEEE Computer Society Annual Symposium on VLSI · doi:10.1109/isvlsi.2019.00033 · Cited by 4
A Sparse Connected Long Short-Term Memory With Sharing Weight for Time Series Prediction
Xiong, L., Ling, X., Huang, X., Tang, H., Yuan, W., & Huang, W. (2020) · IEEE Access · doi:10.1109/access.2020.2984796 · Cited by 4
Lightweight Convolutional Neural Network-Based Method for Crane Safety Inspection
Jiang, W., Liu, T., Chen, Y., Chen, Q., Zhang, X., & Gui, G. (2020) · International Conference on Dependable Systems and Their Applications (DSA) · doi:10.1109/dsa51864.2020.00058 · Cited by 4
Self-citation
Mask-Net: A Hardware-efficient Object Detection Network with Masked Region Proposals
Chen, H., & Hao, C. (2022) · IEEE International Conference on Application-specific Systems, Architectures and Processors (ASAP) · doi:10.1109/asap54787.2022.00030 · Cited by 5
MSNet: Multi-Resolution Synergistic Networks for Adaptive Inference
Hang, R., Qian, X., & Liu, Q. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3218891 · Cited by 4
Filling the Gap: Fault-Tolerant Updates of On-Satellite Neural Networks Using Vector Quantization
Kondrateva, O., Dietzel, S., Schambach, M., Otterbach, J., & Scheuermann, B. (2023) · IFIP Networking Conference (IFIP Networking) · doi:10.23919/ifipnetworking57963.2023.10186407 · Cited by 4
A densely connected LDCT image denoising network based on dual-edge extraction and multi-scale attention under compound loss
Li-na, J., He, X., Aimin, H., Beibei, J., & Zhiguo, G. (2023) · Journal of X-Ray Science and Technology · doi:10.3233/xst-230132 · Cited by 4
PRANC: Pseudo RAndom Networks for Compacting deep models
Nooralinejad, P., Abbasi, A., Koohpayegani, S. A., Pourahmadi, K., Khan, R. M. S., Kolouri, S., & Pirsiavash, H. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01561 · Cited by 4
Asymmetric Ternary Networks
Ding, J., Wu, J., & Wu, H. (2017) · IEEE International Conference on Tools with Artificial Intelligence (ICTAI) · doi:10.1109/ictai.2017.00021 · Cited by 4
NumPyCNNAndroid: A Library for Straightforward Implementation of Convolutional Neural Networks for Android Devices
Gad, A. F. (2019) · International Conference on Innovative Trends in Computer Engineering (ITCE) · doi:10.1109/itce.2019.8646653 · Cited by 4
Thread: Towards fine-grained precision reconfiguration in variable-precision neural network accelerator
Zhang, S., Wang, Y., Chen, X., Han, Y., Wang, Y., & Li, X. (2019) · IEICE Electronics Express · doi:10.1587/elex.16.20190145 · Cited by 4
Pulse-Net: Dynamic Compression of Convolutional Neural Networks
Browne, B., Giering, G., & Prestwich, P. (2019) · IEEE World Forum on Internet of Things (WF-IoT) · doi:10.1109/wf-iot.2019.8767300 · Cited by 4
Group Pruning Using a Bounded- $$\ell _p$$ ℓ p Norm for Group Gating and Regularization
Mummadi, C. K., Genewein, T., Zhang, D., Brox, T., & Fischer, V. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-33676-9_10 · Cited by 4
Adversarial Deep Mutual Learning
Lai, X., & Qu, Y. (2019) · IEEE International Conference on Unmanned Systems and Artificial Intelligence (ICUSAI) · doi:10.1109/icusai47366.2019.9124828 · Cited by 4
Synchronous Weight Quantization-Compression for Low-Bit Quantized Neural Network
Jiao, Y., Li, S., Huo, X., & Li, Y. K. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9533393 · Cited by 4
Cuckoo Feature Hashing: Dynamic Weight Sharing for Sparse Analytics
Gao, J., Ooi, B. C., Shen, Y., & Lee, W.-C. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/295 · Cited by 4
D y VED eep
Ganapathy, S., Venkataramani, S., Sriraman, G., Ravindran, B., & Raghunathan, A. (2020) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3372882 · Cited by 8
C3-Flow
Sotoudeh, M., & Baghsorkhi, S. S. (2019) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1145/3316781.3317786 · Cited by 4
The Effect of Gradient Noise on the Energy Landscape of Deep NetworksPreprint
Chaudhari, P., & Soatto, S. (2015) · arXiv (Cornell University) · Cited by 4
When Lempel-Ziv-Welch Meets Machine Learning: A Case Study of Accelerating Machine Learning using Coding.Preprint
Li, F., Chen, L., Kumar, A., Naughton, J. F., Patel, J. M., & Wu, X. (2017) · arXiv (Cornell University) · Cited by 4
PydMobileNet: Improved Version of MobileNets with Pyramid Depthwise Separable ConvolutionPreprint
Hoang, V.-T., & Jo, K.-H. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.07083 · Cited by 4
Model Compression by Entropy Penalized ReparameterizationPreprint
Oktay, D., Ballé, J., Singh, S., & Shrivastava, A. (2019) · arXiv (Cornell University) · Cited by 4
PIMBALL: Binary Neural Networks in Spintronic MemoryPreprint
Resch, S., Khatamifard, S. K., Chowdhury, Z. I., Zabihi, M., Zhao, Z., Wang, J., Sapatnekar, S. S., & Karpuzcu, U. R. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.03989 · Cited by 4
Understanding and Training Deep Diagonal Circulant Neural NetworksPreprint
Araujo, A., Négrevergne, B., Chevaleyre, Y., & Atif, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.10255 · Cited by 7
Self-Supervised GAN CompressionPreprint
Yu, C., & Pool, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.01491 · Cited by 6
Dependency Aware Filter PruningPreprint
Zhao, K., Zhang, X., Han, Q., & Cheng, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.02634 · Cited by 4
Anchor & Transform: Learning Sparse Embeddings for Large VocabulariesPreprint
Liang, P. P., Zaheer, M., Wang, Y., & Ahmed, A. A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.08197 · Cited by 8
Backpropagating through Fréchet Inception DistancePreprint
Mathiasen, A., & Hvilshøj, F. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.14075 · Cited by 24
Epitopological Sparse Ultra-Deep Learning: A Brain-Network Topological Theory Carves Communities in Sparse and Percolated Hyperbolic ANNsPreprint
Zhang, Y., Zhao, J., Wu, W., Muscoloni, A., & Cannistraci, C. V. (2023) · Preprints.org · doi:10.20944/preprints202207.0139.v2 · Cited by 4
Efficient Early Warning System in Identifying Enset Bacterial Wilt Disease using Transfer Learning
Fulle, B. A., Ma, C., Shi, X., Zhu, W., Yemataw, Z., & Assefa, E. (2023) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn54540.2023.10191617 · Cited by 3
EC-DNN: A new method for parallel training of deep neural networks
Sun, S., & Liu, X. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.01.072 · Cited by 3
A MOEA/D approach to exploit the crucial structure of convolution kernels
Zhang, Q., Li, B., & Zhang, F. (2018) · International Conference on Advanced Computational Intelligence (ICACI) · doi:10.1109/icaci.2018.8377535 · Cited by 3
SqueezeGAN: Image to Image Translation With Minimum Parameters
Kelkar, S., Rastogi, C., Gupta, S., & Pillai, G. N. (2018) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2018.8489587 · Cited by 3
Cross-layer CNN Approximations for Hardware Implementation
Ali, K. M. A., Alouani, I., Cadi, A. A. E., Ouarnoughi, H., & Niar, S. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-44534-8_12 · Cited by 3
CountSketches, Feature Hashing and the Median of Three
Larsen, K. G., Pagh, R., & Tětek, J. (2021) · Research at the University of Copenhagen (University of Copenhagen) · doi:10.48550/arxiv.2102.02193 · Cited by 3
COPS: Controlled Pruning Before Training Starts
Wimmer, P., Jens, M., & Condurache, A. P. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9533582 · Cited by 5
Clustered Network Adaptation Methodology for the Resource Constrained Platform
Verma, P., Sasmal, P., Pal, C., Channappayya, S. S., & Acharyya, A. (2022) · IEEE Interregional NEWCAS Conference (NEWCAS) · doi:10.1109/newcas52662.2022.9842117 · Cited by 3
Training a Lightweight CNN Model for Fine-Grained Sewer Pipe Cracks Classification Based on Knowledge Distillation
Ma, B., Zuo, X., Shen, J., Shu, X., Huang, S., & Li, Y. (2022) · International Conference on Pattern Recognition and Artificial Intelligence (PRAI) · doi:10.1109/prai55851.2022.9904106 · Cited by 3
Compact and Optimal Deep Learning with Recurrent Parameter Generators
Wang, J., Chen, Y., Yu, S. X., Cheung, B., & LeCun, Y. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00389 · Cited by 7
Self-citation
A Pruning Method Based on the Dissimilarity of Angle Among Channels and Filters
Yao, J., Li, P., Kang, X., & Wang, Y. (2022) · IEEE International Conference on Tools with Artificial Intelligence (ICTAI) · doi:10.1109/ictai56018.2022.00084 · Cited by 3
Deep Learning: Principles and Training Algorithms
Aggarwal, C. C. (2023) · Springer eBooks · doi:10.1007/978-3-031-29642-0_4 · Cited by 3
Towards efficient filter pruning via adaptive automatic structure search
Xu, X., Chen, J., Li, Z., Su, H., & Xie, L. (2024) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2024.108398 · Cited by 3
VarKFaceNet: An Efficient Variable Depthwise Convolution Kernels Neural Network for Lightweight Face Recognition
Ma, Q., Zhang, P., & Cui, M. (2024) · IEEE Access · doi:10.1109/access.2024.3447018 · Cited by 3
Human Intelligent-Things Interaction Application Using 6G and Deep Edge Learning
Kedwan, F., & Rahman, M. A. (2024) · Journal on internet of things · doi:10.32604/jiot.2024.052325 · Cited by 3
Universal and Succinct Source Coding of Deep Neural Networks
Basu, S., & Varshney, L. R. (2022) · IEEE Journal on Selected Areas in Information Theory · doi:10.1109/jsait.2023.3261819 · Cited by 3
A Highly Efficient Training-Aware Convolutional Neural Network Compression Paradigm
Liu, C., & Lu, H. (2020) · IEEE International Conference on Multimedia & Expo Workshops (ICMEW) · doi:10.1109/icmew46912.2020.9105960 · Cited by 3
Efficient use of recent progresses for Real-time Semantic segmentation
Elhoufi, S., & Majda, A. (2020) · Machine Vision and Applications · doi:10.1007/s00138-020-01095-0 · Cited by 3
Parameter-Efficient Deep Neural Networks With Bilinear Projections
Yu, L., Gao, Y., Zhou, J. W., & Zhang, J. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3016688 · Cited by 3

Authors: Chen, W., Wilson, J. T., Tyree, S., Weinberger, K. Q., & Chen, Y.
Affiliations: Washington University in St. Louis (US)
ORCID: Chen, Wenlin
Weinberger, Kilian Q.
Chen, Yixin
Venue: arXiv
Publisher: arXiv
Published: 2015
ISSN: 2331-8422 (ISSN-L)
DOI: 10.48550/arxiv.1504.04788
arXiv: 1504.04788
OpenAlex: W2172166488
Cited by: 974
References: 53
Citations by year: 2026: 2 · 2025: 9 · 2024: 29 · 2023: 59 · 2022: 69 · 2021: 118 · 2020: 167 · 2019: 159 · 2018: 184 · 2017: 114 · 2016: 44 · 2015: 19
Type: posted content
Language: en
Open access: green
arxiv.org
Licence: arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations: arXiv (Cornell University) (submittedVersion)
arXiv (Cornell University)
Topics: Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
Keywords: neural network compression, parameter sharing, model size reduction, memory-efficient deep learning, mobile devices, parameter redundancy, hash functions

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Compressing Neural Networks with the Hashing Trick

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks