PreprintCited by 974Advanced Neural Network ApplicationsStochastic Gradient Optimization TechniquesNeural Networks and Applications

The DOI matches its DataCite record; 51 of the 53 references it cites were found in a registry or an index.

Compressing Neural Networks with the Hashing Trick

Open access

Chen, Wenlin, Wilson, James T., Tyree, Stephen, Weinberger, Kilian Q., Chen, Yixin·2015·arXiv

DOI 10.48550/arxiv.1504.04788arXiv 1504.04788

Open this paper in CoChat — free account Open PDF

Abstract

As deep nets are increasingly used in applications suited for mobile devices, a fundamental dilemma becomes apparent: the trend in deep learning is to grow models to absorb ever-increasing data set sizes; however mobile devices are designed with very little memory and cannot store such large models. We present a novel network architecture, HashedNets, that exploits inherent redundancy in neural networks to achieve drastic reductions in model sizes. HashedNets uses a low-cost hash function to randomly group connection weights into hash buckets, and all connections within the same hash bucket share a single parameter value. These parameters are tuned to adjust to the HashedNets weight sharing architecture with standard backprop during training. Our hashing procedure introduces no additional memory overhead, and we demonstrate on several benchmark data sets that HashedNets shrink the storage requirements of neural networks substantially while mostly preserving generalization performance.

Integrity signals

Registry

DataCite · 10.48550/arxiv.1504.04788

Cites

51 of 51 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Untitled work
(2014) · Cited by 33,419
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Neural networks for pattern recognition
Bishop, C. (1994) · Choice Reviews Online · doi:10.5860/choice.31-5500 · Cited by 18,537
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
Distilling the Knowledge in a Neural Network
Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204
Untitled work
(2010) · International Conference on Machine Learning · Cited by 13,995
Term-Weighting Approaches in Automatic Text Retrieval
Salton, G., & Buckley, C. (1988) · Information Processing & Management · doi:10.1016/0306-4573(88)90021-0 · Cited by 11,421
Deep neural networks for acoustic modeling in speech recognition: the shared views of four research groups
Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260

Show all 53 references

Sorted by citations

Items 501–600 of 973

DLIRIR : Deep learning based improved Reverse Image Retrieval
Singh, D., Mathew, J., Agarwal, M., & Govind, M. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.106833 · Cited by 12
MCMC: Multi-Constrained Model Compression via One-Stage Envelope Reinforcement Learning
Li, S., Chen, J., Liu, S., Zhu, C., Tian, G., & Liu, Y. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3353763 · Cited by 9
Micro and Macro Breast Histology Image Analysis by Partial Network Re-use
Vu, Q. D., To, M. N. N., Kim, E., & Kwak, J. T. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-93000-8_102 · Cited by 9
Training Compact Deep Learning Models for Video Classification Using Circulant Matrices
Araujo, A., Négrevergne, B., Chevaleyre, Y., & Jamal Atif, C. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-11018-5_25 · Cited by 9
Play and Prune: Adaptive Filter Pruning for Deep Model Compression
Singh, P. P., Verma, V. K., Rai, P., & Namboodiri, V. P. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/480 · Cited by 14
Energy-Efficient Convolutional Neural Networks via Recurrent Data Reuse
Mocerino, L., Tenace, V., & Calimera, A. (2019) · Design, Automation, and Test in Europe · doi:10.23919/date.2019.8714880 · Cited by 10
A Convolutional Neural Network Pruning Method Based On Attention Mechanism
Wang, X. J., Yao, W., & Fu, H. (2019) · Proceedings/Proceedings of the ... International Conference on Software Engineering and Knowledge Engineering · doi:10.18293/seke2019-147 · Cited by 9
MONGOOSE: A Learnable LSH Framework for Efficient Neural Network Training
Chen, B., Liu, Z., Peng, B., Xu, Z., Li, J. L., Dao, T., Song, Z., Shrivastava, A., & Ré, C. (2021) · International Conference on Learning Representations · Cited by 10
An Efficient Binary Convolutional Neural Network With Numerous Skip Connections for Fog Computing
Wu, L., Lin, X., Chen, Z., Huang, J., Liu, H., & Yang, Y. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3052105 · Cited by 9
Joint sparse neural network compression via multi-application multi-objective optimization
Chen, J., Xu, Y., Sun, W., & Huang, L. (2021) · Applied Intelligence · doi:10.1007/s10489-021-02243-3 · Cited by 9
A Unified Federated DNNs Framework for Heterogeneous Mobile Devices
Li, X., Li, Y., Li, S., Zhou, Y., Chen, C., & Zheng, Z. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3088867 · Cited by 9
Model-Distributed Inference in Multi-Source Edge Networks
Li, P., Seferoğlu, H., & Koyuncu, E. (2023) · IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW) · doi:10.1109/icasspw59220.2023.10193154 · Cited by 10
Facial Soft Biometrics Detection on Low Power Devices
Vasileiadis, M., Stavropoulos, G., & Tzovaras, D. K. (2019) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2019.00285 · Cited by 9
Learning Student Networks with Few Data
Kong, S., Guo, T., You, S., & Xu, C. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.5874 · Cited by 9
Depthwise Multiception Convolution for Reducing Network Parameters without Sacrificing Accuracy
Bao, G., Graeber, M. B., & Wang, X. (2020) · International Conference on Control, Automation, Robotics and Vision (ICARCV) · doi:10.1109/icarcv50220.2020.9305369 · Cited by 9
Automated training of location-specific edge models for traffic counting
Leroux, S., Li, B., & Simoens, P. (2022) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2022.107763 · Cited by 9
Trivializing The Energy Landscape Of Deep Networks.Preprint
Chaudhari, P., & Soatto, S. (2015) · arXiv (Cornell University) · Cited by 12
SEP-Nets: Small and Effective Pattern NetworksPreprint
Li, Z., Wang, X., Lv, X., & Yang, T. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.03912 · Cited by 9
A Survey of Pruning Methods for Efficient Person Re-identification Across DomainsPreprint
Masson, H., Bhuiyan, A., Nguyen-Meidine, L. T., Javan, M., Siva, P., Ayed, I. B., & Granger, É. (2019) · arXiv (Cornell University) · Cited by 9
Super Resolution Using Segmentation-Prior Self-Attention Generative Adversarial NetworkPreprint
Zhang, Y., Zheng, Z., & Hu, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.03489 · Cited by 10
Online ensemble model compression for nonstationary data stream learning
Soares, R. G. F., & Minku, L. L. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.107151 · Cited by 8
DeltaFrame-BP: An Algorithm Using Frame Difference for Deep Convolutional Neural Networks Training and Inference on Video Data
Han, B., & Roy, K. (2018) · IEEE Transactions on Multi-Scale Computing Systems · doi:10.1109/tmscs.2018.2865303 · Cited by 8
PTEENet: Post-Trained Early-Exit Neural Networks Augmentation for Inference Cost Optimization
Lahiany, A., & Aperstein, Y. (2022) · IEEE Access · doi:10.1109/access.2022.3187002 · Cited by 8
Filter Pruning via Attention Consistency on Feature Maps
Yang, H., Liang, Y., Liu, W., & Meng, F. (2023) · Applied Sciences · doi:10.3390/app13031964 · Cited by 8
LDCNet: A Lightweight Multiscale Convolutional Neural Network Using Local Dense Connectivity for Image Recognition
Wang, J., Zhang, W., Fu, J., Song, K., Meng, Q., Zhu, L., & Jin, Y. (2023) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2023.3311171 · Cited by 9
Compressing deep convolutional neural networks in visual emotion recognition
Rassadin, A. G., & Savchenkov, A. V. (2017) · International Conference on Information Technology and Nanotechnology (ITNT) · doi:10.18287/1613-0073-2017-1901-207-213 · Cited by 8
CompactNet: High Accuracy Deep Neural Network Optimized for On-Chip Implementation
Goel, A., Liu, Z., & Blanton, R. D. (2018) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata.2018.8622329 · Cited by 7
EncoDeep
Samragh, M., Javaheripi, M., & Koushanfar, F. (2020) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3391901 · Cited by 8
HBUCNNA: Hybrid Binary-Unary Convolutional Neural Network Accelerator
Faraji, S. R., Abillama, P., Singh, G., & Bazargan, K. (2020) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas45731.2020.9180836 · Cited by 8
Data Agnostic Filter Gating For Efficient Deep Networks
Xu, H., Su, X. Q., You, S., Huang, T., Wang, F., Qian, C., Zhang, C., Xu, C., Wang, D., & Sowmya, A. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746346 · Cited by 8
Extreme Model Compression for On-device Natural Language Understanding
Sathyendra, K. M., Choudhary, S., & Nicolich-Henkin, L. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-industry.15 · Cited by 8
Model Pruning Techniques for Boosting the Inference Efficiency on Embedded Systems
Zhang, Z. (2021) · 2021 2nd International Conference on Computing and Data Science (CDS) · doi:10.1109/cds52072.2021.00027 · Cited by 8
Elastic Significant Bit Quantization and Acceleration for Deep Neural Networks
Gong, C., Lu, Y., Xie, K., Jin, Z., Li, T., & Wang, Y. (2021) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2021.3129615 · Cited by 8
On-Site Colonoscopy Autodiagnosis Using Smart Internet of Medical Things
Chen, J., Song, X., Huang, Z., Li, J., Wang, Z., Luo, C., & Yu, F. R. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3116699 · Cited by 8
Random Sharing Parameters in the Global Region of Convolutional Neural Network
Dai, D., Zhuang, Z., Wei, J., Xia, S., Li, Y., & Zhu, H. (2021) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2021.3136494 · Cited by 8
Pedestrian detection based on multi-convolutional features by feature maps pruning
Rui, T., Zou, J., Zhou, Y., Fang, H., & Gao, Q. (2017) · Multimedia Tools and Applications · doi:10.1007/s11042-017-4837-0 · Cited by 8
Towards Compact and Fast Neural Machine Translation Using a Combined Method
Zhang, X., Chen, W., Wang, F., Xu, S., & Xu, B. (2017) · Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1154 · Cited by 8
Self-citation
Rotation Invariant Local Binary Convolution Neural Networks
Zhang, X., Xie, Y., Chen, J., Wu, L., Ye, Q., & Liu, L. (2018) · IEEE Access · doi:10.1109/access.2018.2818887 · Cited by 9
A-MnasNet: Augmented MnasNet for Computer Vision
Shah, P., & El‐Sharkawy, M. (2020) · IEEE International Midwest Symposium on Circuits and Systems (MWSCAS) · doi:10.1109/mwscas48704.2020.9184619 · Cited by 8
Compressed Superposition of Neural Networks for Deep Learning in Edge Computing
Zeman, M., Osipov, E., & Bosnić, Z. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9533602 · Cited by 8
BitNet: Bit-Regularized Deep Neural NetworksPreprint
Raghavan, A., Amer, M., Chai, S. M., & Taylor, G. W. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.04788 · Cited by 11
Minimal Random Code Learning: Getting Bits Back from Compressed Model ParametersPreprint
Havasi, M., Peharz, R., & Hernández-Lobato, J. M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.00440 · Cited by 19
LCNN: Lookup-based Convolutional Neural NetworkPreprint
Bagherinezhad, H., Rastegari, M., & Farhadi, A. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.06473 · Cited by 18
Depth separation for reduced deep networks in nonlinear model reduction: Distilling shock waves in nonlinear hyperbolic problemsPreprint
Rim, D., Venturi, L., Bruna, J., & Peherstorfer, B. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.13977 · Cited by 8
A Locally Distributed Mobile Computing Framework for DNN based Android Applications
Zhang, J., Chen, S., Liu, B., Ma, Y., & Chen, X. (2018) · Proceedings of the Tenth Asia-Pacific Symposium on Internetware · doi:10.1145/3275219.3275236 · Cited by 7
Interleaver design for deep neural networks
Dey, S., Beerei, P. A., & Chugg, K. M. (2017) · Asilomar Conference on Signals, Systems and Computers (ACSSC) · doi:10.1109/acssc.2017.8335713 · Cited by 7
A Lightweight Identification Method for Complex Power Industry Tasks Based on Knowledge Distillation and Network Pruning
Wang, W., Zhou, X., Jiang, C., Zhu, H., Yu, H., & Wang, S. (2023) · Processes · doi:10.3390/pr11092780 · Cited by 7
A Lightweight Patch-Level Change Detection Network Based on Multilayer Feature Compression and Sensitivity-Guided Network Pruning
Xue, L., Wang, X., Wang, Z., Li, G., Song, H., & Song, Z. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3398820 · Cited by 8
Enhancing Split Computing and Early Exit Applications through Predefined Sparsity
Capogrosso, L., Fraccaroli, E., Petrozziello, G., Setti, F., Chakraborty, S., Fummi, F., & Cristani, M. (2024) · Forum on specification and Design Languages · doi:10.1109/fdl63219.2024.10673767 · Cited by 7
Dependable Deep Computation Model for Feature Learning on Big Data in Cyber-Physical Systems
Zhang, Q., Yang, L. T., Chen, Z., & Li, P. (2018) · ACM Transactions on Cyber-Physical Systems · doi:10.1145/3110218 · Cited by 7
West: Word Encoded Sequence Transducers
Variani, E., Suresh, A. T., & Weintraub, M. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8683694 · Cited by 7
Efficient Deep Learning in Network Compression and Acceleration
Ge, S. (2018) · IntechOpen eBooks · doi:10.5772/intechopen.79562 · Cited by 8
Shallow SqueezeNext: An Efficient & Shallow DNN
Duggal, J. K., & El‐Sharkawy, M. (2019) · IEEE International Conference on Vehicular Electronics and Safety (ICVES) · doi:10.1109/icves.2019.8906416 · Cited by 7
Full-Stack Application of Skin Cancer Diagnosis Based on CNN Model
Huo, Y. (2021) · International Conference on Computer Science, Electronic Information Engineering and Intelligent Control Technology (CEI) · doi:10.1109/cei52496.2021.9574583 · Cited by 7
Deep asymmetric hashing with dual semantic regression and class structure quantization
Lu, J., Wang, H., Zhou, J., Yan, M., & Wen, J. (2022) · Information Sciences · doi:10.1016/j.ins.2021.12.112 · Cited by 7
Intelligent Vehicle Collision Warning System Based on a Deep Learning Approach
Lai, Y.-K., Huang, Y.-H., & Schumann, T. (2018) · IEEE International Conference on Consumer Electronics - Taiwan (ICCE-Taiwan) · doi:10.1109/icce-china.2018.8448556 · Cited by 7
Merging Similar Neurons for Deep Networks Compression
Zhong, G., Liu, W., Yao, H., Li, T., Sun, J., & Liu, X. (2020) · Cognitive Computation · doi:10.1007/s12559-019-09703-6 · Cited by 8
A Framework for Distributed Deep Neural Network Training with Heterogeneous Computing Platforms
Gu, B., Kong, J., Munir, A., & Kim, Y. G. (2019) · IEEE International Conference on Parallel and Distributed Systems (ICPADS) · doi:10.1109/icpads47876.2019.00068 · Cited by 7
Magnitude and Uncertainty Pruning Criterion for Neural Networks
Ko, V., Oehmcke, S., & Gieseke, F. C. (2019) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata47090.2019.9005692 · Cited by 7
Approximation Computing Techniques to Accelerate CNN Based Image Processing Applications – A Survey in Hardware/Software Perspective
Manikandan, N. (2020) · International Journal of Advanced Trends in Computer Science and Engineering · doi:10.30534/ijatcse/2020/202932020 · Cited by 7
Weight-Dependent Gates for Differentiable Neural Network Pruning
Li, Y., Wu, W., Liu, Z., Zhang, C., Zhang, X., Yao, H., & Yin, B. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-68238-5_3 · Cited by 7
Efficient and Scalable Object Localization in 3D on Mobile Device
Gupta, N., & Khan, N. (2022) · Journal of Imaging · doi:10.3390/jimaging8070188 · Cited by 7
BHNN: A memory-efficient accelerator for compressing deep neural networks with blocked hashing techniques
Zhu, J., Qian, Z., & Tsui, C.-Y. (2017) · Asia and South Pacific Design Automation Conference (ASP-DAC) · doi:10.1109/aspdac.2017.7858404 · Cited by 6
Simplifying Deep Neural Networks for FPGA-Like Neuromorphic Systems
Chung, J., Shin, T., & Yang, J.-S. (2018) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2018.2877016 · Cited by 7
Interpolating Convolutional Neural Networks Using Batch Normalization
Data, G. W. P., Ngu, K., Murray, D. W., & Prisacariu, V. A. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01261-8_35 · Cited by 7
Optimizing Deep Learning Inference on Embedded Systems Through Adaptive Model Selection
Marco, V. S., Taylor, B., Wang, Z., & Elkhatib, Y. (2020) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3371154 · Cited by 81
Model Compression with Generative Adversarial NetworksPreprint
Liu, R., Fusi, N., & Mackey, L. W. (2018) · arXiv (Cornell University) · Cited by 9
Text classification with word embedding regularization and soft similarity measurePreprint
Novotný, V. S., Ayetiran, E. F., Štefánik, M., & Sojka, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.05019 · Cited by 7
Shapley Value as Principled Metric for Structured Network PruningPreprint
Ancona, M., Öztireli, C., & Groß, M. H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.01795 · Cited by 18
ES-ENAS: Combining Evolution Strategies with Neural Architecture Search at No Extra Cost for Reinforcement Learning.Preprint
Song, X., Choromański, K., Parker-Holder, J., Tang, Y., Peng, D., Jain, D., Gao, W., Pacchiano, A., Sarlós, T., & Yang, Y. (2021) · arXiv (Cornell University) · Cited by 7
On Hiding Neural Networks Inside Neural NetworksPreprint
Guo, C., Wu, R., & Weinberger, K. Q. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.10078 · Cited by 29
Self-citation
Deep discovery of facial motions using a shallow embedding layer
Ghasemi, A., Baktashmotlagh, M., Denman, S., Sridharan, S., Tien, D. N., & Fookes, C. (2017) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2017.8296545 · Cited by 5
A Hybrid Face Identification System using a Compressed CNN in a Big Data Environment for Embedded Devices
Meddad, M., Moujahdi, C., Mikram, M., & Rziza, M. (2020) · International Journal of Computing and Digital Systems · doi:10.12785/ijcds/090416 · Cited by 5
Palleon: A Runtime System for Efficient Video Processing toward Dynamic Class Skew
Feng, B., Wang, Y., Li, G., Xie, Y., & Ding, Y. (2021) · Rare & Special e-Zone (The Hong Kong University of Science and Technology) · Cited by 6
Pruning CNNs for LiDAR-based Perception in Resource Constrained Environments
Vemparala, M. R., Singh, A., Mzid, A., Fasfous, N., Frickenstein, A., Mirus, F., Voegel, H.-J., Nagaraja, N. S., & Stechele, W. (2021) · IEEE Intelligent Vehicles Symposium Workshops (IV Workshops) · doi:10.1109/ivworkshops54471.2021.9669256 · Cited by 7
Determining Top Fully Connected Layer’s Hidden Neuron Count for Transfer Learning, Using Knowledge Distillation: a Case Study on Chest X-Ray Classification of Pneumonia and COVID-19
Ghosh, R. (2021) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-021-00518-2 · Cited by 7
AlignQ: Alignment Quantization with ADMM-based Correlation Preservation
Chen, T., Yang, D.-N., & Chen⋆, M.-S. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01221 · Cited by 7
Reconstructed SqueezeNext with C-CBAM for offline handwritten Chinese character recognition
Wu, R., Zhou, F., Li, N., Liu, X., & Wang, R. (2023) · PeerJ Computer Science · doi:10.7717/peerj-cs.1529 · Cited by 6
Adaptively Hashing 3DLUTs for Lightweight Real-time Image Enhancement
Zhang, F., Zhang, L., Zhang, T., & Wang, D. (2023) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme55011.2023.00471 · Cited by 6
Early-Exit Meets Model-Distributed Inference at Edge Networks
Colocrese, M., Koyuncu, E., & Seferoğlu, H. (2024) · IEEE International Symposium on Local and Metropolitan Area Networks (LANMAN) · doi:10.1109/lanman61958.2024.10621887 · Cited by 7
Adaptive neuron apoptosis for accelerating deep learning on large scale systems
Siegel, C., Daily, J. A., & Vishnu, A. (2016) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata.2016.7840668 · Cited by 9
Survey of progress in deep neural networks for resource-constrained applications
Stuart, M., & Manic, M. (2017) · Annual Conference of the IEEE Industrial Electronics Society (IECON) · doi:10.1109/iecon.2017.8217271 · Cited by 6
Compressing YOLO Network by Compressive Sensing
Wu, Y., Meng, Z.-Y., Shivakumara, P., & Lü, T. (2017) · Asian Conference on Pattern Recognition · doi:10.1109/acpr.2017.11 · Cited by 6
Tensor-Train Fuzzy Deep Computation Model for Citywide Traffic Flow Prediction
Chen, W., An, J., Li, R., & Xie, G. (2019) · IEEE Access · doi:10.1109/access.2019.2920430 · Cited by 6
Self-citation
ENAS oriented layer adaptive data scheduling strategy for resource limited hardware
Li, C., Fan, X., Geng, Y., Yang, Z., Wang, D., & Zhang, M. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.11.005 · Cited by 6
Binary Convolutional Neural Network with High Accuracy and Compression Rate
Liu, S., & Zhu, H. (2019) · International Conference on Algorithms, Computing and Artificial Intelligence (ACAI) · doi:10.1145/3377713.3377721 · Cited by 6
Fast Fréchet Inception Distance
Mathiasen, A., & Hvilshøj, F. (2020) · Cited by 7
TiQSA: Workload Minimization in Convolutional Neural Networks Using Tile Quantization and Symmetry Approximation
Sabir, D., Hanif, M. A., Hassan, A., Rehman, S. U., & Shafique, M. (2021) · IEEE Access · doi:10.1109/access.2021.3069906 · Cited by 6
Sum-Rate-Distortion Function for Indirect Multiterminal Source Coding in Federated Learning
Zhang, N., Tao, M., & Wang, J. (2021) · IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit45174.2021.9518074 · Cited by 7
Tricking the Hashing Trick: A Tight Lower Bound on the Robustness of CountSketch to Adaptive Inputs
Cohen, E., Nelson, J., Sarlós, T., & Stemmer, U. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i6.25882 · Cited by 6
Balanced and Deterministic Weight-Sharing Helps Network Performance
Chang, O., & Lipson, H. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01424-7_5 · Cited by 6
Object Detection Implementation and Optimization on Embedded GPU System
Yin, X., Chen, L., Zhang, X., & Gao, Z. (2018) · IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB) · doi:10.1109/bmsb.2018.8436848 · Cited by 6
HBUNN - Hybrid Binary-Unary Neural Network: Realizing a Complete CNN on an FPGA
Faraji, S. A., Singh, G., & Bazargan, K. (2019) · IEEE International Conference on Computer Design: VLSI in Computers and Processors (ICCD) · doi:10.1109/iccd46524.2019.00027 · Cited by 6
A Convolutional Result Sharing Approach for Binarized Neural Network Inference
Chang, Y., Lin, C.-C., Lin, Y.-T., Chen, Y., & Wang, C.-Y. (2020) · Design, Automation, and Test in Europe · doi:10.23919/date48585.2020.9116221 · Cited by 6
Self-citation
Rethinking Numerical Representations for Deep Neural NetworksPreprint
Hill, P., Zamirai, B., Lu, S., Chao, Y.-W., Laurenzano, M. A., Samadi, M., Papaefthymiou, M. C., Mahlke, S. A., Wenisch, T. F., Deng, J., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.02513 · Cited by 11
Recursive Binary Neural Network Learning Model with 2.28b/Weight Storage RequirementPreprint
Guan, T., Zeng, X., & Seok, M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.05306 · Cited by 6
Quantization and training of object detection networks with low-precision weights and activations
Yang, B., Liu, J., Zhou, L., Wang, Y., & Chen, J. (2018) · Journal of Electronic Imaging · doi:10.1117/1.jei.27.1.013020 · Cited by 6
Adaptive Selection of Deep Learning Models on Embedded SystemsPreprint
Taylor, B., Marco, V. S., Wolff, W., Elkhatib, Y., & Wang, Z. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.04252 · Cited by 6
Structured Pruning for Efficient ConvNets via Incremental RegularizationPreprint
Wang, H., Zhang, Q., Wang, Y., & Hu, H. R. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.08390 · Cited by 6
Harmonic Networks: Integrating Spectral Information into CNNsPreprint
Uličný, M., Krylov, V. A., & Dahyot, R. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.03205 · Cited by 9

Authors: Chen, W., Wilson, J. T., Tyree, S., Weinberger, K. Q., & Chen, Y.
Affiliations: Washington University in St. Louis (US)
ORCID: Chen, Wenlin
Weinberger, Kilian Q.
Chen, Yixin
Venue: arXiv
Publisher: arXiv
Published: 2015
ISSN: 2331-8422 (ISSN-L)
DOI: 10.48550/arxiv.1504.04788
arXiv: 1504.04788
OpenAlex: W2172166488
Cited by: 974
References: 53
Citations by year: 2026: 2 · 2025: 9 · 2024: 29 · 2023: 59 · 2022: 69 · 2021: 118 · 2020: 167 · 2019: 159 · 2018: 184 · 2017: 114 · 2016: 44 · 2015: 19
Type: posted content
Language: en
Open access: green
arxiv.org
Licence: arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations: arXiv (Cornell University) (submittedVersion)
arXiv (Cornell University)
Topics: Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
Keywords: neural network compression, parameter sharing, model size reduction, memory-efficient deep learning, mobile devices, parameter redundancy, hash functions

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Compressing Neural Networks with the Hashing Trick

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks