Low-rank matrix factorization for Deep Neural Network training with high-dimensional output targets

Deep neural networks for acoustic modeling in speech recognition: the shared views of four research groups

Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260

Convolutional networks for images, speech, and time series

LeCun, Y., & Bengio, Y. (1998) · HAL · doi:10.5555/303568.303704 · Cited by 4,646

Deep Neural Networks for Acoustic Modeling in Speech Recognition

Hinton, G. E., Deng, L., Yu, D., Dahl, G. E., Mohamed, A., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T. N., et al. (2012) · Cited by 1,839

Connectionist Speech Recognition: A Hybrid Approach

Bourlard, H. A., & Morgan, N. H. (1993) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 1,115

Deep convolutional neural networks for LVCSR

Sainath, T. N., Mohamed, A., Kingsbury, B. E. D., & Ramabhadran, B. (2013) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2013.6639347 · Cited by 1,083

Conversational speech transcription using context-dependent deep neural networks

Seide, F. T. B., Li, G., & Yu, D. (2011) · Interspeech (USB) · doi:10.21437/interspeech.2011-169 · Cited by 877

Feature engineering in Context-Dependent Deep Neural Networks for conversational speech transcription

Seide, F. T. B., Li, G., Xie, C., & Yu, D. (2011) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru.2011.6163899 · Cited by 648

Parallel stochastic gradient algorithms for large-scale matrix completion

Recht, B., & Ré, C. (2013) · Mathematical Programming Computation · doi:10.1007/s12532-013-0053-8 · Cited by 378

Introduction to Linear Algebra

DeFranza, J., & Gagliardi, D. (2008) · Cited by 378

Dimension Reduction and Coefficient Estimation in Multivariate Linear Regression

Yuan, M., Ekici, A., Lu, Z., & Monteiro, R. D. C. (2007) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.1467-9868.2007.00591.x · Cited by 310

Pruned and Structurally Sparse Neural Networks

Alford, S., Robinett, R. A., Milechin, L., & Kepner, J. (2018) · IEEE MIT Undergraduate Research Technology Conference (URTC) · doi:10.1109/urtc45901.2018.9244787 · Cited by 22

Towards Robust Compressed Convolutional Neural Networks

Wijayanto, A. W., Choong, J. J., Madhawa, K., & Murata, T. (2019) · IEEE International Conference on Big Data and Smart Computing (BigComp) · doi:10.1109/bigcomp.2019.8679132 · Cited by 24

Nonrecurrent Neural Structure for Long-Term Dependence

Zhang, S., Liu, C., Jiang, H., Wei, S., Dai, L.-R., & Hu, Y. (2017) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2017.2672398 · Cited by 85

A dimensionality reduction approach for convolutional neural networks

Meneghetti, L., Demo, N., & Rozza, G. (2023) · Applied Intelligence · doi:10.1007/s10489-023-04730-1 · Cited by 21

ABM-SpConv-SIMD: Accelerating Convolutional Neural Network Inference for Industrial IoT Applications on Edge Devices

Li, X., Gong, X., Wang, D., Zhang, J., Baker, T., Zhou, J. L., & Lu, T. (2022) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2022.3154412 · Cited by 21

Low Dimensional Trajectory Hypothesis is True: DNNs can be Trained in Tiny Subspaces

Li, T., Tan, L., Huang, Z., Tao, Q., Liu, Y., & Huang, X. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3178101 · Cited by 32

Localization and reduction of redundancy in CNN using L1-sparsity induction

Hssayni, E. H., Joudar, N., & Ettaouil, M. (2022) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-022-04025-2 · Cited by 21

TinyPower: Side-Channel Attacks with Tiny Neural Networks

Li, H., Ninan, M., Wang, B., & Emmert, J. M. (2024) · IEEE International Symposium on Hardware Oriented Security and Trust (HOST) · doi:10.1109/host55342.2024.10545382 · Cited by 20

Speaker adaptation using the i-vector technique for bottleneck features

Cardinal, P., Dehak, N., Zhang, Y., & Glass, J. R. (2015) · Interspeech (USB) · doi:10.21437/interspeech.2015-603 · Cited by 20

Compression of fully-connected layer in neural network by Kronecker product

Wu, J. (2016) · International Conference on Advanced Computational Intelligence (ICACI) · doi:10.1109/icaci.2016.7449822 · Cited by 22

Recommendation system in social networks with topical attention and probabilistic matrix factorization

Zhang, W., Fang-ai, L., Xu, D., & Jiang, L. (2019) · PLoS ONE · doi:10.1371/journal.pone.0223967 · Cited by 20

4-Bit Quantization of LSTM-Based Speech Recognition Models

Fasoli, A., Chen, C., Serrano, M. J., Sun, X. N., Wang, N., Venkataramani, S., Saon, G., Cui, X., Kingsbury, B. E. D., Zhang, W., et al. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-1962 · Cited by 20

Compressing Neural Networks: Towards Determining the Optimal Layer-wise DecompositionPreprint

Liebenwein, L., Maalouf, A., Oren, G., Feldman, D., & Rus, D. L. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.11442 · Cited by 20

Wise teachers train better DNN acoustic models

Price, R., Iso, K.-I., & Shinoda, K. (2016) · EURASIP Journal on Audio Speech and Music Processing · doi:10.1186/s13636-016-0088-7 · Cited by 21

On-Device Neural Language Model Based Word Prediction

Yu, S., Kulkarni, N. V., Lee, H., & Kim, J. (2018) · International Conference on Computational Linguistics · Cited by 19

Mixed Precision Low-Bit Quantization of Neural Network Language Models for Speech Recognition

Xu, J., Yu, J., Hu, S., Liu, X., & Meng, H. M. L. (2021) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2021.3129357 · Cited by 20

Single-shot pruning and quantization for hardware-friendly neural network acceleration

Jiang, B., Chen, J., & Liu, Y. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.106816 · Cited by 24

Training Behavior of Sparse Neural Network Topologies

Alford, S., Robinett, R. A., Milechin, L., & Kepner, J. (2019) · IEEE High Performance Extreme Computing Conference · doi:10.1109/hpec.2019.8916385 · Cited by 20

Increasing Deep Neural Network Acoustic Model Size for Large Vocabulary Continuous Speech RecognitionPreprint

Maas, A. L., Hannun, A., Lengerich, C. T., Qi, P., Jurafsky, D. S., & Ng, A. Y. (2014) · arXiv (Cornell University) · Cited by 20

Learning Recurrent Binary/Ternary WeightsPreprint

Ardakani, A., Ji, Z., Smithson, S. C., Meyer, B. H., & Gross, W. J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.11086 · Cited by 24

RFCSC: Communication efficient reinforcement federated learning with dynamic client selection and adaptive gradient compression

Pan, Z., Li, Y., Guan, Z., Liang, M., Li, A., Wang, J., & Kou, F. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128672 · Cited by 18

Compression of Deep Neural Networks based on quantized tensor decomposition to implement on reconfigurable hardware platforms

Nekooei, A., & Safari, S. (2022) · Neural Networks · doi:10.1016/j.neunet.2022.02.024 · Cited by 19

SegBlocks: Block-Based Dynamic Resolution Networks for Real-Time Segmentation

Verelst, T., & Tuytelaars, T. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3162528 · Cited by 21

Small-Footprint Deep Neural Networks with Highway Connections for Speech Recognition

Lu, L., & Renals, S. J. (2016) · Interspeech (USB) · doi:10.21437/interspeech.2016-39 · Cited by 17

The State of the Art in Implementing Machine Learning for Mobile Apps: A Survey

Dai, X., Spasić, ‪., Chapman, S., & Meyer, B. (2020) · IEEE SoutheastCon · doi:10.1109/southeastcon44009.2020.9249652 · Cited by 21

Speaker adaptation of hybrid NN/HMM model for speech recognition based on singular value decomposition

Xue, S., Jiang, H., & Dai, L.-R. (2014) · International Symposium on Chinese Spoken Language Processing (ISCSLP) · doi:10.1109/iscslp.2014.6936583 · Cited by 17

Sequence training of multiple deep neural networks for better performance and faster training speed

Zhou, P., Dai, L.-R., & Jiang, H. (2014) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2014.6854680 · Cited by 18

Entity representation for pairwise collaborative ranking using restricted Boltzmann machine

Hazrati, N., Shams, B., & Haratizadeh, S. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.09.013 · Cited by 17

Discriminative segmental cascades for feature-rich phone recognition

Tang, H., Wang, W., Gimpel, K., & Livescu, K. (2015) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru.2015.7404845 · Cited by 17

CircConv: A Structured Convolution with Low Complexity

Liao, S., & Yuan, B. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33014287 · Cited by 19

On the compression of neural networks using ℓ 0 -norm regularization and weight pruning

Oliveira, F. D. D. R., Batista, E. L. O., & Seara, R. (2023) · Neural Networks · doi:10.1016/j.neunet.2023.12.019 · Cited by 17

Neural Network Compression Based on Tensor Ring Decomposition

Xie, K., Liu, C., Wang, X., Li, X., Xie, G., Wen, J., & Li, K. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3383392 · Cited by 17

Variance regularization of RNNLM for speech recognition

Shi, Y., Zhang, W.-Q., Cai, M., & Liu, J. (2014) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2014.6854532 · Cited by 16

Context-Sensitive Recommender Systems

Aggarwal, C. C. (2016) · Springer eBooks · doi:10.1007/978-3-319-29659-3_8 · Cited by 16

Hybrid orthogonal projection and estimation (HOPE)

Zhang, S., Jiang, H., & Dai, L.-R. (2016) · Journal of Machine Learning Research · doi:10.5555/2946645.2946682 · Cited by 15

Small-Footprint Highway Deep Neural Networks for Speech Recognition

Lu, L., & Renals, S. J. (2017) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2017.2698723 · Cited by 15

Gabor filter based image representation for object classification

Rizvi, S. T. H., Cabodi, G., de Gusmão, P. P. B., & Francini, G. (2016) · International Conference on Control, Decision and Information Technologies (CoDIT) · doi:10.1109/codit.2016.7593635 · Cited by 15

Design and Analysis of a Neural Network Inference Engine Based on Adaptive Weight Compression

Ko, J. H., Kim, D.-H., Na, T., & Mukhopadhyay, S. (2018) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2018.2801228 · Cited by 15

Learning Compressed Transforms with Low Displacement Rank

Thomas, A., Gu, A., Dao, T., Atri Rudra, B., & Ré, C. (2018) · PubMed · doi:10.48550/arxiv.1810.02309 · Cited by 15

ProdSumNet: reducing model parameters in deep neural networks via product-of-sums matrix decompositionsPreprint

Wu, C. W. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.02209 · Cited by 27

A Day in the Life of ChatGPT as a researcher: Sustainable and Efficient Machine Learning - A Review of Sparsity Techniques and Future Research DirectionsPreprint

Srivastava, M. (2023) · doi:10.31219/osf.io/e9p3g · Cited by 18

A Survey for Sparse Regularization Based Compression Methods

Tang, A., Quan, P., Niu, L., & Shi, Y. (2022) · Annals of Data Science · doi:10.1007/s40745-022-00389-6 · Cited by 14

Deep matrix factorization models for estimation of missing data in a low-cost sensor network to measure air quality

Rivera-Muñoz, L. M., Giraldo-Forero, A. F., & Martinez-Vargas, J. D. (2022) · Ecological Informatics · doi:10.1016/j.ecoinf.2022.101775 · Cited by 14

Edge Intelligence with Distributed Processing of DNNs: A Survey

Tang, S., Cui, M., Qi, L., & Xu, X. (2022) · Computer Modeling in Engineering & Sciences · doi:10.32604/cmes.2023.023684 · Cited by 15

Adaptation of Deep Neural Network Acoustic Models for Robust Automatic Speech Recognition

Sim, K. C., Qian, Y., Mantena, G., Samarakoon, L., Kundu, S., & Tan, T. (2017) · Springer eBooks · doi:10.1007/978-3-319-64680-0_9 · Cited by 14

Comparison of the Effects of Mel Coefficients and Spectrogram Images via Deep Learning in Emotion Classification

Demircan, S., & Örnek, H. K. (2020) · Traitement du signal · doi:10.18280/ts.370107 · Cited by 15

A Multilayer Network-Based Approach to Represent, Explore and Handle Convolutional Neural Networks

Amelio, A., Bonifazi, G., Corradini, E., Domenico Ursino, A., & Virgili, L. (2022) · Cognitive Computation · doi:10.1007/s12559-022-10084-6 · Cited by 14

Selection and combination of hypotheses for dialectal speech recognition

Soto, V., Siohan, O., Elfeky, M. G., & Moreno, P. J. (2016) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2016.7472798 · Cited by 14

DARB: A Density-Adaptive Regular-Block Pruning for Deep Neural Networks

Ren, A., Zhang, T., Yuhao, W., Sheng, L., Dong, P., Chen, Y.-K., Xie, Y., & Wang, Y. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.6000 · Cited by 14

Addressing the New Item problem in video recommender systems by incorporation of visual features with restricted Boltzmann machines

Hazrati, N., & Elahi, M. (2020) · Expert Systems · doi:10.1111/exsy.12645 · Cited by 14

SBNN: Slimming binarized neural network

Wu, Q., Lu, X., Xue, S., Wang, C., Wu, X., & Fan, J. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.03.030 · Cited by 14

RCT: Resource Constrained Training for Edge AI

Huang, T., Luo, T., Yan, M., Zhou, J. T., & Goh, R. S. M. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3190451 · Cited by 14

Artificial Neural Networks and Machine Learning – ICANN 2021

Le, T., Bertolini, M., No\'e, F., & Clevert, D.-A. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-86365-4 · Cited by 13

Data Mining Based Marketing Decision Support System Using Hybrid Machine Learning Algorithm

Kumar, T. S. (2020) · Journal of Artificial Intelligence and Capsule Networks · doi:10.36548/jaicn.2020.3.006 · Cited by 19

AlphaTuning: Quantization-Aware Parameter-Efficient Adaptation of Large-Scale Pre-Trained Language Models

Kwon, S. J., Kim, J., Bae, J., Yoo, K. M., Kim, J.-H., Park, B., Kim, B., Ha, J.-W., Sung, N., & Lee, D. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.240 · Cited by 17

TreeConnect: A Sparse Alternative to Fully Connected Layers

Richter, O., & Wattenhofer, R. P. (2018) · IEEE International Conference on Tools with Artificial Intelligence (ICTAI) · doi:10.1109/ictai.2018.00143 · Cited by 12

Shift-based Primitives for Efficient Convolutional Neural NetworksPreprint

Zhong, H., Liu, X., He, Y., & Ma, Y. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.08458 · Cited by 13

Rethinking Full Connectivity in Recurrent Neural NetworksPreprint

Keirsbilck, M. V., Keller, A., & Yang, X.-D. (2019) · arXiv.org · doi:10.48550/arxiv.1905.12340 · Cited by 18

Deep Fried ConvnetsPreprint

Yang, Z., Moczulski, M., Denil, M., de Freitas, N., Smola, A. J., Song, L., & Wang, Z. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.7149 · Cited by 13

Pufferfish: Communication-efficient Models At No Extra CostPreprint

Wang, H., Agarwal, S., & Papailiopoulos, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.03936 · Cited by 17

FLOPs-efficient filter pruning via transfer scale for neural network acceleration

Guo, Z., Xiao, Y., Liao, W., Veelaert, P., & Philips, W. R. (2021) · Journal of Computational Science · doi:10.1016/j.jocs.2021.101459 · Cited by 12

Enabling Inference and Training of Deep Learning Models for AI Applications on IoT Edge Devices

Sharma, D., & Sarkar, S. (2022) · Internet of things · doi:10.1007/978-3-030-87059-1_10 · Cited by 17

Personalized Elastic Embedding Learning for On-Device Recommendation

Zheng, R., Qu, L., Chen, T., Zheng, K., Shi, Y., & Yin, H. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3361562 · Cited by 12

Denseflex: A Low Rank Factorization Methodology for Adaptable Dense Layers in DNNs

Kokhazadeh, M., Κεραμίδας, Γ., Kelefouras, V. I., & Stamoulis, I. (2024) · ACM International Conference on Computing Frontiers (CF) · doi:10.1145/3649153.3649183 · Cited by 12

Dynamically Hierarchy Revolution: DirNet for Compressing Recurrent Neural Network on Mobile Devices

Zhang, J., Wang, X., Li, D., & Wang, Y. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/429 · Cited by 12

Syllable-level Neural Language Model for Agglutinative Language

Yu, S., Kulkarni, N. V., Lee, H., & Kim, J. (2017) · Workshop on Subword and Character Level Models in NLP (SCLeM) · doi:10.18653/v1/w17-4113 · Cited by 13

Machine Learning in the development of Si-based anodes using Small-Angle X-ray Scattering for structural property analysis

Seitz, P., Scherdel, C., Reichenauer, G., & Schmitt, J. (2022) · Computational Materials Science · doi:10.1016/j.commatsci.2022.111984 · Cited by 12

A novel layerwise pruning method for model reduction of fully connected deep neural networks

Mauch, L., & Yang, B. (2017) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2017.7952583 · Cited by 11

Cross-Entropy Training of DNN Ensemble Acoustic Models for Low-Resource ASR

Sahraeian, R., & Compernolle, D. V. (2018) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2018.2851145 · Cited by 12

Subspace Network

Sun, M., Baytaş, İ. M., Zhan, L., Wang, Z., & Zhou, J. (2018) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3219819.3219966 · Cited by 12

The Synthesis of XNOR Recurrent Neural Networks with Stochastic Logic

Ardakani, A., Ji, Z., Ardakani, A., & Gross, W. J. (2019) · neural information processing systems · Cited by 11

LLaMA-LoRA Neural Prompt Engineering: A Deep Tuning Framework for Automatically Generating Chinese Text Logical Reasoning Thinking Chains

Chen, S., Wang, W., Chen, X., Lu, P., Yang, Z., & Du, Y. (2024) · Data Intelligence · doi:10.1162/dint_a_00251 · Cited by 14

A study of rank-constrained multilingual DNNS for low-resource ASR

Sahraeian, R., & Compernolle, D. V. (2016) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2016.7472713 · Cited by 11

Low-bit Quantization of Recurrent Neural Network Language Models Using Alternating Direction Methods of Multipliers

Xu, J., Xie, C., Hu, S., Yu, J., Liu, X., & Meng, H. M. L. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9053483 · Cited by 11

Time-Constrained Ensemble Sensing With Heterogeneous IoT Devices in Intelligent Transportation Systems

Feng, X., Luo, C., Wei, B. W., Zhang, J., Li, J., Wang, H. H., Xu, W., Chan, M. C., & Leung, V. C. M. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3170028 · Cited by 11

Hyperscale Hardware Optimized Neural Architecture Search

Li, S., Andersen, G., Chen, T., Cheng, L., Grady, J., Huang, D., Le, Q. V., Li, A., Li, X. S., Li, Y., et al. (2023) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/3582016.3582049 · Cited by 11

Compressing End-to-end ASR Networks by Tensor-Train Decomposition

Mori, T., Tjandra, A., Sakti, S., & Nakamura, S. (2018) · Interspeech (USB) · doi:10.21437/interspeech.2018-1543 · Cited by 11

Retraining-Based Iterative Weight Quantization for Deep Neural NetworksPreprint

Lee, D., & Kim, B. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.11233 · Cited by 13

Projected Minimal Gated Recurrent Unit for Speech Recognition

Feng, R., Jiang, W., Yu, N., Wu, Y., & Yan, J. (2020) · IEEE Access · doi:10.1109/access.2020.3041477 · Cited by 10

Bitwidth-Adaptive Quantization-Aware Neural Network Training: A Meta-Learning Approach

Youn, J., Song, J., Kim, H., & Bahk, S. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19775-8_13 · Cited by 10

A Comparative Analysis of Compression and Transfer Learning Techniques in DeepFake Detection Models

Karathanasis, A., Violos, J., & Kompatsiaris, I. Y. (2025) · Mathematics · doi:10.3390/math13050887 · Cited by 16

Lightweight Class Incremental Semantic Segmentation Without Catastrophic Forgetting

Cong, W. W., Cong, Y., & Ren, Y. (2025) · IEEE Transactions on Image Processing · doi:10.1109/tip.2025.3588065 · Cited by 11

A comparison of two optimization techniques for sequence discriminative training of deep neural networks

Saon, G., & Soltau, H. (2014) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2014.6854668 · Cited by 10

Top-N Recommendation System Using Explicit Feedback and Outer Product Based Residual CNN

Bhuvaneshwari, P., Rao, A. N., & Robinson, H. (2022) · Wireless Personal Communications · doi:10.1007/s11277-022-09984-5 · Cited by 10

LBARNet: Lightweight bilateral asymmetric residual network for real-time semantic segmentation

Hu, X., & Zhou, B. (2023) · Computers & Graphics · doi:10.1016/j.cag.2023.07.039 · Cited by 10

Compressing and Accelerating Neural Network for Facial Point Localization

Zeng, D., Zhao, F., Shen, W., & Ge, S. (2017) · Cognitive Computation · doi:10.1007/s12559-017-9506-0 · Cited by 10

MuffNet: Multi-Layer Feature Federation for Mobile Deep Learning

Chen, H., Lin, M., Sun, X., Qian, Q., Li, H., & Jin, R. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00356 · Cited by 10

COSINE: Compressive Network Embedding on Large-Scale Information Networks

Zhang, Z., Yang, C. H., Liu, Z., Sun, M., Fang, Z., Zhang, B., & Lin, L. (2020) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.3030539 · Cited by 10

Knowledge distillation: A novel approach for deep feature selection

Deepa, C., Shetty, A., & Narasimhadhan, A. V. (2022) · The Egyptian Journal of Remote Sensing and Space Science · doi:10.1016/j.ejrs.2022.12.006 · Cited by 10

Structured Convolution Matrices for Energy-efficient Deep learningPreprint

Appuswamy, R., Nayak, T. K., Arthur, J. V., Esser, S. K., Merolla, P. A., McKinstry, J. L., Melano, T., Flickner, M., & Modha, D. S. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.02407 · Cited by 13

Learning K-way D-dimensional Discrete Code For Compact Embedding RepresentationsPreprint

Chen, T., Min, M. R., & Sun, Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.03067 · Cited by 12

Latent Projection BNNs: Avoiding weight-space pathologies by learning latent representations of neural network weights.Preprint

Pradier, M. F., Pan, W., Yao, J., Ghosh, S., & Doshi‐Velez, F. (2018) · arXiv (Cornell University) · Cited by 10

Reducing Model Complexity in Neural Networks by Using Pyramid Training Approaches

Kivanç, Ş. G., Şen, B., Nar, F., & Ok, A. Ö. (2024) · Applied Sciences · doi:10.3390/app14135898 · Cited by 13

Unstructured Pruning and Low Rank Factorisation of Self-Supervised Pre-Trained Speech Models

Wang, H., & Zhang, W.-Q. (2024) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2024.3433616 · Cited by 10

Exploring the Intersection Between Neural Architecture Search and Continual Learning

Shahawy, M., Benkhelifa, E., & White, D. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3453973 · Cited by 11

User Relation Prediction Based on Matrix Factorization and Hybrid Particle Swarm Optimization

Shi, Z., Zuo, W., Chen, W., Yue, L., Han, J., & Feng, L. (2017) · International World Wide Web Conference (WWW) · doi:10.1145/3041021.3051151 · Cited by 9

LightFormer: Light-weight Transformer Using SVD-based Weight Transfer and Parameter Sharing

Lv, X., Zhang, P., Li, S., Gan, G., & Sun, Y.-H. (2023) · Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2023.findings-acl.656 · Cited by 27

Raw Multichannel Processing Using Deep Neural Networks

Sainath, T. N., Weiss, R. J., Wilson, K., Narayanan, A., Bacchiani, M., Li, B., Variani, E., Izhak Shafran, J., Senior, A., Chin, K. K., et al. (2017) · Springer eBooks · doi:10.1007/978-3-319-64680-0_5 · Cited by 9

Efficient Deep Neural Networks for Edge Computing

Alnemari, M. H., & Bagherzadeh, N. (2019) · IEEE International Conference on Edge Computing and Communications (EDGE) · doi:10.1109/edge.2019.00014 · Cited by 10

Iterative Compression of End-to-End ASR Model Using AutoML

Mehrotra, A., Dudziak, Ł., Yeo, J., Lee, Y.-Y., Vipperla, R., Abdelfattah, M. S., Bhattacharya, S., Ishtiaq, S. S., Ramos, A. G. C. P., Lee, S.-J., et al. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-1894 · Cited by 11

Deep neural network based acoustic model parameter reduction using manifold regularized low rank matrix factorization

Chung, H., Kang, J. J., Park, K. Y., Lee, S. J., & Park, J. G. (2016) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt.2016.7846333 · Cited by 3

Parameter Reduction For Deep Neural Network Based Acoustic Models Using Sparsity Regularized Factorization Neurons

Chung, H., Chung, E., Park, J. G., & Jung, H. (2019) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2019.8852021 · Cited by 6

Multi-lingual speech recognition with low-rank multi-task deep neural networks

Mohan, A., & Rose, R. C. (2015) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2015.7178921 · Cited by 33

A study of rank-constrained multilingual DNNS for low-resource ASR

Sahraeian, R., & Compernolle, D. V. (2016) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2016.7472713 · Cited by 11

Low-Rank Representation For Enhanced Deep Neural Network Acoustic Models

Luyet, G. (2016) · Infoscience (Ecole Polytechnique Fédérale de Lausanne)