Fu, Daniel Y.

FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness

Dao, T., Fu, D. Y., Ermon, S., Rudra, A., & Ré, C. (2022) · arXiv

Parallel Computing and Optimization TechniquesAdvanced Neural Network Applications

Cited by 1,214

Hungry Hungry Hippos: Towards Language Modeling with State Space Models

Fu, D. Y., Dao, T., Saab, K. K., Thomas, A. W., Rudra, A., & Ré, C. (2022) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 123

Hyena Hierarchy: Towards Larger Convolutional Language Models

Poli, M., Massaroli, S., Nguyen, E., Fu, D. Y., Dao, T., Baccus, S., Bengio, Y., Ermon, S., & Ré, C. (2023) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 96

FlexGen: High-Throughput Generative Inference of Large Language Models with a Single GPU

Sheng, Y., Zheng, L., Yuan, B., Li, Z., Ryabinin, M., Fu, D. Y., Xie, Z., Chen, B., Barrett, C., Gonzalez, J. E., et al. (2023) · arXiv

Parallel Computing and Optimization TechniquesNatural Language Processing Techniques

Cited by 86

Hydragen: High-Throughput LLM Inference with Shared Prefixes

Juravsky, J., Brown, B., Ehrlich, R., Fu, D. Y., Ré, C., & Mirhoseini, A. (2024) · arXiv

Parallel Computing and Optimization TechniquesTopic Modeling

Cited by 2