Micikevicius, Paulius

Mixed Precision Training

Micikevicius, P., Narang, S., Alben, J., Diamos, G., Elsen, E., Garcia, D., Ginsburg, B., Houston, M., Kuchaiev, O., Venkatesh, G., et al. (2017) · arXiv

Numerical Methods and AlgorithmsAdvanced Neural Network Applications

Cited by 1,179

Integer Quantization for Deep Learning Inference: Principles and Empirical Evaluation

Wu, H., Judd, P., Zhang, X., Isaev, M., & Micikevicius, P. (2020) · arXiv

Advanced Neural Network ApplicationsNumerical Methods and Algorithms

Cited by 246

MLPerf Training Benchmark

Mattson, P., Cheng, C., Coleman, C., Diamos, G., Micikevicius, P., Patterson, D., Tang, H., Wei, G.-Y., Bailis, P., Bittorf, V., et al. (2019) · arXiv

Parallel Computing and Optimization TechniquesCloud Computing and Resource Management

Cited by 206

MLPerf: An Industry Standard Benchmark Suite for Machine Learning Performance

Mattson, P., Reddi, V. J., Cheng, C., Coleman, C., Diamos, G., Kanter, D., Micikevicius, P., Patterson, D., Schmuelling, G., Tang, H., et al. (2020) · IEEE Micro

Parallel Computing and Optimization TechniquesAdvanced Neural Network Applications

Cited by 171

Accelerating Sparse Deep Neural Networks

Mishra, A., Latorre, J. A., Pool, J., Stosic, D., Stosic, D., Venkatesh, G., Yu, C., & Micikevicius, P. (2021) · arXiv

Parallel Computing and Optimization TechniquesAdvanced Neural Network Applications

Cited by 97

Microscaling Data Formats for Deep Learning

Rouhani, B. D., Zhao, R., More, A., Hall, M., Khodamoradi, A., Deng, S., Choudhary, D., Cornea, M., Dellinger, E., Denolf, K., et al. (2023) · arXiv

Numerical Methods and AlgorithmsAdvanced Neural Network Applications

Cited by 19

Nemotron-H: A Family of Accurate and Efficient Hybrid Mamba-Transformer Models

NVIDIA, :, Blakeman, A., Basant, A., Khattar, A., Renduchintala, A., Bercovich, A., Ficek, A., Bjorlin, A., Taghibakhshi, A., et al. (2025) · arXiv

Advanced Neural Network ApplicationsTopic Modeling

Cited by 0