Ryabinin, Max

FlexGen: High-Throughput Generative Inference of Large Language Models with a Single GPU

Sheng, Y., Zheng, L., Yuan, B., Li, Z., Ryabinin, M., Fu, D. Y., Xie, Z., Chen, B., Barrett, C., Gonzalez, J. E., et al. (2023) · arXiv

Parallel Computing and Optimization TechniquesNatural Language Processing Techniques

Cited by 86

Mind Your Format: Towards Consistent Evaluation of In-Context Learning Improvements

Voronov, A., Wolf, L., & Ryabinin, M. (2024) · Findings of the Association for Computational Linguistics ACL 2024

Topic ModelingDomain Adaptation and Few-Shot Learning

Cited by 77

Distributed Inference and Fine-tuning of Large Language Models Over The Internet

Borzunov, A., Ryabinin, M., Chumachenko, A., Baranchuk, D., Dettmers, T., Belkada, Y., Samygin, P., & Raffel, C. (2023) · arXiv

Topic ModelingPrivacy-Preserving Technologies in Data

Cited by 35

SWARM Parallelism: Training Large Models Can Be Surprisingly Communication-Efficient

Ryabinin, M., Dettmers, T., Diskin, M., & Borzunov, A. (2023) · arXiv

Parallel Computing and Optimization TechniquesStochastic Gradient Optimization Techniques

Cited by 8

Petals: Collaborative Inference and Fine-tuning of Large Models

Borzunov, A., Baranchuk, D., Dettmers, T., Ryabinin, M., Belkada, Y., Chumachenko, A., Samygin, P., & Raffel, C. (2022) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 6

Sequoia: Scalable and Robust Speculative Decoding

Chen, Z., May, A., Svirschevski, R., Huang, Y., Ryabinin, M., Jia, Z., & Chen, B. (2024) · Advances in Neural Information Processing Systems 37

Natural Language Processing TechniquesParallel Computing and Optimization Techniques

Cited by 5

INTELLECT-1 Technical Report

Jaghouar, S., Ong, J. M., Basra, M., Obeid, F., Straube, J., Keiblinger, M., Bakouch, E., Atkins, L., Panahi, M., Goddard, C., et al. (2024) · arXiv

Parallel Computing and Optimization TechniquesCloud Computing and Resource Management

Cited by 0