Learning Sparse Neural Networks through $L_0$ Regularization

Adam: A Method for Stochastic Optimization

Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946

Gradient-based learning applied to document recognition

Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805

Regression shrinkage and selection via the lasso

Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482

Estimating the Dimension of a Model

Schwarz, G. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344136 · Cited by 47,033

Auto-Encoding Variational Bayes

Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067

Information Theory and an Extension of the Maximum Likelihood Principle

Akaike, H. (1998) · Springer series in statistics · doi:10.1007/978-1-4612-1694-0_15 · Cited by 18,636

Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning

Williams, R. J. (1992) · Machine Learning · doi:10.1007/bf00992696 · Cited by 8,608

Wide Residual Networks

Zagoruyko, S., & Komodakis, N. (2016) · Procedings of the British Machine Vision Conference 2016 · doi:10.5244/c.30.87 · Cited by 7,244

Deep Residual Learning for Image Recognition

He, K., Zhang, X., Ren, S., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1512.03385 · Cited by 4,196

Stochastic Backpropagation and Approximate Inference in Deep Generative ModelsPreprint

Rezende, D. J., Mohamed, S., & Wierstra, D. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1401.4082 · Cited by 3,921

Sparse Teachers Can Be Dense with Knowledge

Yang, Y., Zhang, C., & Song, D. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.258 · Cited by 6

Adaptive Pruning of Neural Language Models for Mobile DevicesPreprint

Tang, R., & Lin, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.10282 · Cited by 5

Artificial neural networks condensation: A strategy to facilitate adaption of machine learning in medical settings by reducing computational burdenPreprint

Liu, D., Sepulveda, N. A., & Zheng, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.09659 · Cited by 5

Non-Differentiable Supervised Learning with Evolution Strategies and Hybrid MethodsPreprint

Lenc, K., Elsen, E., Schaul, T., & Simonyan, K. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.03139 · Cited by 14

Variable Selection with Rigorous Uncertainty Quantification using Deep Bayesian Neural Networks: Posterior Concentration and Bernstein-von Mises PhenomenonPreprint

Liu, J. Z. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.01189 · Cited by 4

Computation on Sparse Neural Networks: an Inspiration for Future HardwarePreprint

Sun, F., Qin, M., Zhang, T., Liu, L., Chen, Y.-K., & Xie, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.11946 · Cited by 4

Do We Need Fully Connected Output Layers in Convolutional Networks?Preprint

Qian, Z., Hayes, T. L., Kafle, K., & Kanan, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.13587 · Cited by 4

A Deeper Look at the Layerwise Sparsity of Magnitude-based Pruning.Preprint

Lee, J., Park, S., Mo, S., Ahn, S. S., & Shin, J. (2020) · arXiv (Cornell University) · Cited by 4

SparseDNN: Fast Sparse Deep Learning Inference on CPUsPreprint

Wang, Z. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.07948 · Cited by 19

Truncation: A New Approach to Neural Network Reduction

Nevzorov, A. A., Владимирович, П. С., & Stankevich, D. A. (2021) · Neural Processing Letters · doi:10.1007/s11063-021-10638-z · Cited by 3

A predictive maintenance system for wireless sensor networks: a machine learning approach

Almazaideh, M., & Levendovszky, J. (2022) · Indonesian Journal of Electrical Engineering and Computer Science · doi:10.11591/ijeecs.v25.i2.pp1047-1058 · Cited by 4

Train Flat, Then Compress: Sharpness-Aware Minimization Learns More Compressible Models

Na, C., Mehta, S. V., & Strubell, E. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.361 · Cited by 14

Long-Range Language Modeling with Selective Cache

Huang, X., & Hollenstein, N. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.321 · Cited by 5

A Review of Neural Network Lightweighting Techniques

Gong, Z., Zhang, H., Yang, H., Liu, F., & Luo, F. (2024) · Innovation & Technology Advances · doi:10.61187/ita.v1i2.36 · Cited by 17

Probabilistic Connection Importance Inference and Lossless Compression of Deep Neural Networks

Xing, X., Sha, L., Hong, P., Shang, Z., & Liu, J. S. (2020) · International Conference on Learning Representations · Cited by 3

Exploring the Effect of ℓ0/ℓ2 Regularization in Neural Network Pruning using the LC Toolkit

Idelbayev, Y., & Carreira-Perpiñán, M. Á. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746605 · Cited by 4

Rethinking Large-scale Pre-ranking System

Song, J., Huang, R., Wang, X., Huang, W., Yu, Q., Chen, M., Yao, Y., Fan, C., Peng, C., Lin, Z., et al. (2022) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3511808.3557683 · Cited by 4

Aggressively prunable MAM²-based Deep Neural Oracle for ECG acquisition by Compressed Sensing

Bich, P., Prono, L., Mangia, M., Pareschi, F., Rovatti, R., & Setti, G. (2022) · IEEE Biomedical Circuits and Systems Conference (BioCAS) · doi:10.1109/biocas54905.2022.9948676 · Cited by 4

CopGAT: Co-propagation Self-supervised Graph Attention Network

Zhang, B., Xu, M. Z., Chen, M., Chen, M., & Wang, C. (2022) · IEEE International Symposium on Parallel and Distributed Processing with Applications (ISPA) · doi:10.1109/ispa-bdcloud-socialcom-sustaincom57177.2022.00010 · Cited by 3

NASH: A Simple Unified Framework of Structured Pruning for Accelerating Encoder-Decoder Language Models

Ko, J., Park, S., Kim, Y., Ahn, S., Chang, D.-S., Ahn, E., & Yun, S.-Y. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.404 · Cited by 10

Adaptive Perception Control for Aerial Robots with Twin Delayed DDPG

Muvva, V. V. R. M. K. R., Joseph, K. T., Samal, K., Wolf, M., & Pitla, S. K. (2024) · Design, Automation, and Test in Europe · doi:10.23919/date58400.2024.10546708 · Cited by 3

AdaFSNet: Time Series Classification Based on Convolutional Network with a Adaptive and Effective Kernel Size Configuration

Wang, H., Peng, B., Zhang, J., & Cheng, X. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10650281 · Cited by 3

KnowGNN: a knowledge-aware and structure-sensitive model-level explainer for graph neural networks

Ma, Y., Liu, X., Guo, C., Jin, B., & Liu, H. (2024) · Applied Intelligence · doi:10.1007/s10489-024-06034-4 · Cited by 3

WAPS-Quant: Low-Bit Post-Training Quantization Using Weight-Activation Product Scaling

Choi, G., Lee, K., & Kwak, N. (2025) · IEEE Access · doi:10.1109/access.2025.3566307 · Cited by 3

On the stable recovery of deep structured linear networks under sparsity constraints

Malgouyres, F. (2020) · HAL · Cited by 3

Adaptive Feature Selection for End-to-End Speech Translation

Zhang, B., Titov, I., Haddow, B., & Sennrich, R. (2020) · Zurich Open Repository and Archive (University of Zurich) · doi:10.48550/arxiv.2010.08518 · Cited by 3

PSM-nets: Compressing Neural Networks with Product of Sparse Matrices

Giffon, L., Ayache, S., Kadri, H., Artières, T., & Sicre, R. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9533408 · Cited by 4

Analysis of the Influence Degree of Network Pruning on Fine-grained Image Processing Tasks

Xu, J., Diao, B., Cui, B., Li, C., Xu, Y., & Hong, H. (2021) · IEEE International Conference on Signal and Image Processing (ICSIP) · doi:10.1109/icsip52628.2021.9688612 · Cited by 3

Investigation and analysis of hyper and hypo neuron pruning to selectively update neurons during unsupervised adaptation

Mitra, V., & Franco, H. (2020) · Digital Signal Processing · doi:10.1016/j.dsp.2019.102655 · Cited by 3

LANA: Latency Aware Network Acceleration

Molchanov, P. A., Hall, J., Yin, H., Kautz, J., Fusi, N., & Vahdat, A. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19775-8_9 · Cited by 3

Constraints on Optimising Encoder-Only Transformers for Modelling Sign Language with Human Pose Estimation Keypoint Data

Woods, L. T., & Rana, Z. A. (2023) · Journal of Imaging · doi:10.3390/jimaging9110238 · Cited by 3

How do languages influence each other? Studying cross-lingual data sharing during LM fine-tuning

Choenni, R., Garrette, D., & Shutova, E. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.818 · Cited by 16

Pruning Convolutional Filters Using Batch Bridgeout

Khan, N. U., & Stavness, I. (2020) · IEEE Access · doi:10.1109/access.2020.3040256 · Cited by 3

Semi-Smooth Newton Algorithm for Non-Convex Penalized Linear RegressionPreprint

Shi, Y., Huang, J., Jiao, Y., & Yang, Q. (2018) · arXiv (Cornell University) · Cited by 3

INTERPRETABLE CONVOLUTIONAL FILTER PRUNINGPreprint

Qin, Z., Yu, F., Liu, C., Zhao, L., & Chen, X. (2018) · arXiv (Cornell University) · Cited by 3

Deep networks with probabilistic gates.Preprint

Herrmann, C., Bowen, R. S., & Zabih, R. (2018) · arXiv (Cornell University) · Cited by 3

Image Captioning with Sparse Recurrent Neural NetworkPreprint

Tan, J. H., Chan, C. S., & Chuah, J. H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.10797 · Cited by 3

A Sparse Deep Factorization Machine for Efficient CTR predictionPreprint

Deng, W., Pan, J., Zhou, T., Flores, A., & Lin, G. (2020) · arXiv (Cornell University) · Cited by 3

PFGDF: Pruning Filter via Gaussian Distribution Feature for Deep Neural Networks AccelerationPreprint

Xu, J., Diao, B., Cui, B., Yang, K., Li, C., & Xu, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.12963 · Cited by 3

MARS: Masked Automatic Ranks Selection in Tensor DecompositionsPreprint

Kodryan, M., Kropotov, D., & Vetrov, D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.10859 · Cited by 5

Principal Component Networks: Parameter Reduction Early in TrainingPreprint

Waleffe, R., & Rekatsinas, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.13347 · Cited by 3

Dirichlet Pruning for Neural Network CompressionPreprint

Adamczewski, K., & Park, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.05985 · Cited by 3

Local Disentanglement in Variational Auto-Encoders Using Jacobian $L_1$ RegularizationPreprint

Rhodes, T., & Lee, D. D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.02923 · Cited by 3

Deep Neural Compression Via Concurrent Pruning and Self-DistillationPreprint

Neill, J. O., Dutta, S., & Assem, H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.15014 · Cited by 5

Learning Compact Representations of Neural Networks using DiscriminAtive Masking (DAM)Preprint

Bu, J., Daw, A., Maruf, M., & Karpatne, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.00684 · Cited by 3

Using Machine Learning to Identify the Risk Factors of Pancreatic Cancer from the NIH PLCO DatasetPreprint

Dutta, A. (2023) · Preprints.org · doi:10.20944/preprints202308.1933.v1 · Cited by 3

Deciphering the Enigma: A Deep Dive into Understanding and Interpreting LLM OutputsPreprint

Wang, Y. (2023) · doi:10.36227/techrxiv.24085833 · Cited by 3

Learning Structured Sparsity for Efficient Nanopore DNA Basecalling Using Delayed Masking

Frensel, M., Al-Ars, Z., & Hofstee, H. P. (2024) · ACM International Conference on Bioinformatics, Computational Biology, and Health Informatics (ACM-BCB) · doi:10.1145/3698587.3701357 · Cited by 2

Neural Plasticity Networks

Li, Y., & Ji, S. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9534123 · Cited by 2

Batch Normalization Assisted Adversarial Pruning: Towards Lightweight, Sparse and Robust Models

Xiao, W., Zhu, Y. T., & Xia, S. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9534077 · Cited by 2

Analysing the Lottery Ticket Hypothesis on Face Recognition for Structured and Unstructured Pruning

Örenbaş, H., & Wang, M. (2021) · Innovations in Intelligent Systems and Applications Conference (ASYU) · doi:10.1109/asyu52992.2021.9599030 · Cited by 2

Using Structured Pruning to Find Winning Lottery Tickets

Azizi, K., Taheri, H., & Khooyooz, S. (2023) · International Computer Conference, Computer Society of Iran (CSICC) · doi:10.1109/csicc58665.2023.10105376 · Cited by 2

Pruning of Dendritic Neuron Model with Significance Constraints for Classification

Luo, X., Ye, L., Liu, X., Wen, X., & Zhang, Q. (2023) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn54540.2023.10192047 · Cited by 2

Low-Rank Updates of pre-trained Weights for Multi-Task Learning

Audibert, A. D., Amini, M.-R., Usevich, K., & Clausel, M. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.476 · Cited by 3

Legal-Tech Open Diaries: Lesson learned on how to develop and deploy light-weight models in the era of humongous Language Models

Maroudas, S., Legkas, S., Malakasiotis, P., & Chalkidis, I. (2022) · Natural Legal Language Processing Workshop (NLLP) · doi:10.18653/v1/2022.nllp-1.8 · Cited by 9

Neural Network Light Weighting Approach Using Multi-Metric Evaluation of Convolution Kernels

Wang, P., Ren, T., Liu, J., Meng, F., Liu, X., & Liu, W. (2023) · IEEE Access · doi:10.1109/access.2023.3305984 · Cited by 3

Surrogate Lagrangian Relaxation: A Path to Retrain-Free Deep Neural Network Pruning

Zhou, S., Bragin, M. A., Gurevin, D., Pepin, L., Miao, F., & Ding, C. (2023) · ACM Transactions on Design Automation of Electronic Systems · doi:10.1145/3624476 · Cited by 3

Improving Lightweight AdderNet via Distillation From ℓ2 to ℓ1-norm

Dong, M., Chen, X., Wang, Y., & Xu, C. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3318940 · Cited by 2

Compressing and Debiasing Vision-Language Pre-Trained Models for Visual Question Answering

Si, Q., Liu, Y., Lin, Z., Fu, P., Cao, Y., & Wang, W. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.34 · Cited by 2

VeriCompress: A Tool to Streamline the Synthesis of Verified Robust Compressed Neural Networks from Scratch

Kaur, S., Xiao, Y., & Salekin, A. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i21.30327 · Cited by 2

Accelerating Cutting-Plane Algorithms via Reinforcement Learning Surrogates

Mana, K., Acero, F., Mak, S., Zehtabi, P., Cashmore, M., Magazzeni, D., & Veloso, M. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i18.30067 · Cited by 1

Developability Approximation for Neural Implicits Through Rank Minimization

Selvaraju, P. (2024) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv62453.2024.00041 · Cited by 2

Efficient Deep Neural Network Compression for Environmental Sound Classification on Microcontroller Units

Chen, S., Na, M. E. N. G., LI, H., & Fang, W. W. (2024) · TURKISH JOURNAL OF ELECTRICAL ENGINEERING & COMPUTER SCIENCES · doi:10.55730/1300-0632.4084 · Cited by 2

Transparent sparse graph pathway network for analyzing the internal relationship of lung cancer

Jin, Z., Shi, Y., & Zhou, L. (2024) · Frontiers in Genetics · doi:10.3389/fgene.2024.1437174 · Cited by 2

An Attentive Pruning Method for Edge Computing

Gao, Y., Gong, H., Lü, W., Qing-hua, W., Chen, S., & Zhang, N. (2020) · International Conference on Machine Learning and Computing (ICMLC) · doi:10.1145/3383972.3384008 · Cited by 2

Overview of deep convolutional neural network pruning

Li, G., Liu, F., & Xia, Y. (2020) · International Conference on Image, Video Processing and Artificial Intelligence (IVPAI) · doi:10.1117/12.2580086 · Cited by 2

Probing Structured Pruning on Multilingual Pre-trained Models: Settings, Algorithms, and Efficiency

Li, Y., Luo, F., Xu, R., Huang, S., Huang, F., & Wang, L. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.130 · Cited by 2

Convergence of a Relaxed Variable Splitting Coarse Gradient Descent Method for Learning Sparse Weight Binarized Activation Neural Network

Dinh, T., & Xin, J. X. (2020) · Frontiers in Applied Mathematics and Statistics · doi:10.3389/fams.2020.00013 · Cited by 2

Adaptive Neural Connections for Sparsity Learning

Gain, A., Kaushik, P., & Siegelmann, H. T. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093542 · Cited by 2

Dynamic Thresholding for Learning Sparse Neural Networks

Jin-Woo, P., & Lee, J. (2020) · Frontiers in artificial intelligence and applications · doi:10.3233/faia200245 · Cited by 2

Rescaling CNN Through Learnable Repetition of Network Parameters

Chavan, A., Bamba, U., Tiwari, R., & Gupta, D. K. (2021) · Proceedings - International Conference on Image Processing · doi:10.1109/icip42928.2021.9506158 · Cited by 2

Pruning Deep Neural Networks with L_0-Constrained Optimization

Phan, D. T., Nguyen, L. M., Nguyen, N. H., & Kalagnanam, J. (2020) · Proceedings · doi:10.1109/icdm50108.2020.00152 · Cited by 2

Correlation Analysis between the Robustness of Sparse Neural Networks and their Random Hidden Structural Priors

Amor, M. B., Stier, J., & Granitzer, M. (2021) · Procedia Computer Science · doi:10.1016/j.procs.2021.09.182 · Cited by 3

Multilingual Speech Emotion Recognition with Multi-Gating Mechanism and Neural Architecture Search

Wang, Z., Qi, M., Lan, H., Zhang, X., Guo, K., & Gupta, A. (2023) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt54892.2023.10022557 · Cited by 3

Support recovery with Projected Stochastic Gates: Theory and application for linear models

Jana, S., Li, H., Yamada, Y., & Lindenbaum, O. (2023) · Signal Processing · doi:10.1016/j.sigpro.2023.109193 · Cited by 2

Learning Sparse Neural Networks via $$\ell _0$$ and T $$\ell _1$$ by a Relaxed Variable Splitting Method with Application to Multi-scale Curve Classification

Xue, F., & Xin, J. X. (2019) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-21803-4_80 · Cited by 2

A Discover of Class and Image Level Variance Between Different Pruning Methods on Convolutional Neural Networks

Gao, S. (2020) · IEEE International Conference on Smart Internet of Things (SmartIoT) · doi:10.1109/smartiot49966.2020.00034 · Cited by 2

Learning with Multiplicative Perturbations

Yang, X., & Ji, S. (2021) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr48806.2021.9412861 · Cited by 4

Model Channel Pruning Method Based on Squeeze-and-Excitation Mechanism and Upper Quartile Truncation

Ding, Z., Zhao, J., & Sun, J. (2021) · International Symposium on Computer Science and Intelligent Control (ISCSIC) · doi:10.1109/iscsic54682.2021.00031 · Cited by 2

Bayesian Sparsification of Gated Recurrent Neural NetworksPreprint

Lobacheva, E., Chirkova, N., & Vetrov, D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.05692 · Cited by 2

High-Dimensional Learning under Approximate Sparsity: A Unifying Framework for Nonsmooth Learning and Regularized Neural NetworksPreprint

Liu, H., & Yinyu Ye, Y. (2019) · arXiv (Cornell University) · Cited by 2

An end-to-end approach for speeding up neural network inferencePreprint

Herrmann, C., Bowen, R. S., & Zabih, R. (2018) · arXiv (Cornell University) · Cited by 3

Stochastic In-Face Frank-Wolfe Methods for Non-Convex Optimization and Sparse Neural Network TrainingPreprint

Grigas, P., Lobos, A., & Vermeersch, N. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.03580 · Cited by 2

Neuron ranking -- an informed way to condense convolutional neural networks architecturePreprint

Adamczewski, K., & Park, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.02519 · Cited by 2

Group Pruning using a Bounded-Lp norm for Group Gating and RegularizationPreprint

Mummadi, C. K., Genewein, T., Zhang, D., Brox, T., & Fischer, V. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.03463 · Cited by 3

Reinforcement Learning with Chromatic Networks for Compact Architecture SearchPreprint

Song, X., Choromański, K., Parker-Holder, J., Tang, Y., Gao, W., Pacchiano, A., Sarlós, T., Jain, D., & Yang, Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.06511 · Cited by 2

Neural gradients are lognormally distributed: understanding sparse and quantized training.Preprint

Chmiel, B., Ben-Uri, L., Shkolnik, M., Hoffer, E., Banner, R., & Soudry, D. (2020) · arXiv (Cornell University) · Cited by 2

Interpretable Neuroevolutionary Models for Learning Non-Differentiable Functions and Programs.Preprint

Costa, A. D. S., Dangovski, R., Kim, S., Goyal, P., Marin Soljacic, A., & Jacobson, J. M. (2020) · arXiv (Cornell University) · Cited by 2

A Math Approach with Brief Cases towards Reducing Computational and Time Complexity in the Industrial SystemsPreprint

Matviychuk, Y., Peráček, T., & Shakhovska, N. (2020) · Preprints.org · doi:10.20944/preprints202009.0687.v1 · Cited by 2

DiffPrune: Neural Network Pruning with Deterministic Approximate Binary Gates and $L_0$ RegularizationPreprint

Shulman, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.03653 · Cited by 3

BWCP: Probabilistic Learning-to-Prune Channels for ConvNets via Batch WhiteningPreprint

Shao, W., Yu, H., Zhang, Z., Xu, H., Li, Z., & Luo, P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.06423 · Cited by 3

$\ell_0$-based Sparse Canonical Correlation AnalysisPreprint

Lindenbaum, O., Salhov, M., Averbuch, A. Z., & Kluger, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.05620 · Cited by 2

Towards Structured Dynamic Sparse Pre-Training of BERTPreprint

Dietrich, A., Gressmann, F., Orr, D., Chelombiev, I., Justus, D., & Luschi, C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.06277 · Cited by 13

On the Effectiveness of Sparsification for Detecting the Deep Unknowns.Preprint

Sun, Y., & Li, Y. (2021) · arXiv (Cornell University) · Cited by 2

MIOSTONE: Modeling microbiome-trait associations with taxonomy-adaptive neural networksPreprint

Jiang, Y., Aton, M., Zhu, Q., & Lu, Y. Y. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.11.04.565596 · Cited by 2

Polyconvex Neural Network Models of ThermoelasticityPreprint

Fuhg, J. N., Jadoon, A. A., Weeger, O., Seidl, D. T., & Jones, R. E. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4847473 · Cited by 2

On Building Efficient and Robust Neural Network Designs

Yang, X., Yang, H., Zhang, J., Li, H. H., & Chen, Y. (2022) · Asilomar Conference on Signals, Systems and Computers (ACSSC) · doi:10.1109/ieeeconf56349.2022.10051891 · Cited by 1

A pruning-then-quantization model compression framework for facial emotion recognition

Sun, H., Shao, W., Li, T., Zhao, J., Xu, W., & Song, L. (2023) · Intelligent and Converged Networks · doi:10.23919/icn.2023.0020 · Cited by 1

Pruning neural networks by synchronously changing weight information

Tang, Z. C., Li, P., Xiao, J., & Nie, J. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10650879 · Cited by 1

Training Deep Models and Deriving Fisher Kernels: A Step Wise Approach

Azim, T., & Ahmed, S. (2018) · SpringerBriefs in computer science · doi:10.1007/978-3-319-98524-4_3 · Cited by 1

DiffPrune: Neural Network Pruning with Deterministic Approximate Binary Gates and $L_0$ RegularizationPreprint

Shulman, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.03653 · Cited by 3

Learning Sparse Neural Networks Through Mixture-Distributed Regularization

Huang, C.-T., Chen, J.-C., & Wu, J. (2020) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00355 · Cited by 7

Dep-$$L_0$$: Improving $$L_0$$-Based Network Sparsification via Dependency Modeling

Li, Y., & Ji, S. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-86523-8_11 · Cited by 1

Batch Gradient Training Method with Smoothing Group $$L_0$$ Regularization for Feedfoward Neural Networks

Zhang, Y., Wei, J., Xu, D., & Zhang, H. (2022) · Neural Processing Letters · doi:10.1007/s11063-022-10956-w · Cited by 6

Online gradient method with smoothing ℓ0 regularization for feedforward neural networks

Zhang, H., & Tang, Y. (2016) · Neurocomputing · doi:10.1016/j.neucom.2016.10.057 · Cited by 26