Wang, Zhongfeng

Hardware Accelerator for Multi-Head Attention and Position-Wise Feed-Forward in the Transformer

Lu, S., Wang, M., Liang, S., Lin, J., & Wang, Z. (2020) · 2020 IEEE 33rd International System-on-Chip Conference (SOCC)

Embedded Systems Design TechniquesAdvanced Neural Network Applications

Cited by 154

Efficient Precision-Adjustable Architecture for Softmax Function in Deep Learning

Zhu, D., Lu, S., Wang, M., Lin, J., & Wang, Z. (2020) · IEEE Transactions on Circuits and Systems II: Express Briefs

Numerical Methods and AlgorithmsAdvanced Neural Network Applications

Cited by 115

An Algorithm–Hardware Co-Optimized Framework for Accelerating N:M Sparse Transformers

Fang, C., Zhou, A., & Wang, Z. (2022) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems

Advanced Neural Network ApplicationsParallel Computing and Optimization Techniques

Cited by 94

An Efficient Hardware Accelerator for Sparse Transformer Neural Networks

Fang, C., Guo, S., Wu, W., Lin, J., Wang, Z., Hsu, M. K., & Liu, L. (2022) · 2022 IEEE International Symposium on Circuits and Systems (ISCAS)

Advanced Neural Network ApplicationsEmbedded Systems Design Techniques

Cited by 30

BEBERT: Efficient and robust binary ensemble BERT

Tian, J., Fang, C., Wang, H., & Wang, Z. (2023) · ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

Advanced Neural Network ApplicationsTopic Modeling

Cited by 18

Accelerating NLP Tasks on FPGA with Compressed BERT and a Hardware-Oriented Early Exit Method

Li, B., Lu, S., Xie, K., & Wang, Z. (2022) · 2022 IEEE Computer Society Annual Symposium on VLSI (ISVLSI)

Advanced Neural Network ApplicationsEmbedded Systems Design Techniques

Cited by 5