Kuchaiev, Oleksii

Mixed Precision Training

Micikevicius, P., Narang, S., Alben, J., Diamos, G., Elsen, E., Garcia, D., Ginsburg, B., Houston, M., Kuchaiev, O., Venkatesh, G., et al. (2017) · arXiv

Numerical Methods and AlgorithmsAdvanced Neural Network Applications

Cited by 1,179

Geometric De-noising of Protein-Protein Interaction Networks

Kuchaiev, O., Rašajski, M., Higham, D. J., & Pržulj, N. (2009) · PLoS Computational Biology

Bioinformatics and Genomic NetworksComplex Network Analysis Techniques

Cited by 180

Factorization tricks for LSTM networks

Kuchaiev, O., & Ginsburg, B. (2017) · arXiv

Topic ModelingNeural Networks and Applications

Cited by 99

Nemotron-4 340B Technical Report

Nvidia, :, Adler, B., Agarwal, N., Aithal, A., Anh, D. H., Bhattacharya, P., Brundyn, A., Casper, J., Catanzaro, B., et al. (2024) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 66

Shall We Pretrain Autoregressive Language Models with Retrieval? A Comprehensive Study

Wang, B., Ping, W., Xu, P., McAfee, L., Liu, Z., Shoeybi, M., Dong, Y., Kuchaiev, O., Li, B., Xiao, C., et al. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing

Topic ModelingInformation Retrieval and Search Behavior

Cited by 21

Cross-Language Transfer Learning, Continuous Learning, and Domain Adaptation for End-to-End Automatic Speech Recognition

Huang, J., Kuchaiev, O., O'Neill, P., Lavrukhin, V., Li, J., Flores, A., Kucsko, G., & Ginsburg, B. (2020) · arXiv

Speech Recognition and SynthesisDomain Adaptation and Few-Shot Learning

Cited by 20

SteerLM: Attribute Conditioned SFT as an (User-Steerable) Alternative to RLHF

Dong, Y., Wang, Z., Sreedhar, M., Wu, X., & Kuchaiev, O. (2023) · Findings of the Association for Computational Linguistics: EMNLP 2023

Topic ModelingNatural Language Processing Techniques

Cited by 15

Nemotron-4 15B Technical Report

Parmar, J., Prabhumoye, S., Jennings, J., Patwary, M., Subramanian, S., Su, D., Zhu, C., Narayanan, D., Jhunjhunwala, A., Dattagupta, A., et al. (2024) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 9

HelpSteer2: Open-source dataset for training top-performing reward models

Wang, Z., Dong, Y., Delalleau, O., Zeng, J., Shen, G., Egert, D., Zhang, J. J., Sreedhar, M. N., & Kuchaiev, O. (2024) · arXiv

Reinforcement Learning in RoboticsTopic Modeling

Cited by 7

Llama-Nemotron: Efficient Reasoning Models

Bercovich, A., Levy, I., Golan, I., Dabbah, M., El-Yaniv, R., Puny, O., Galil, I., Moshe, Z., Ronen, T., Nabwani, N., et al. (2025) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 1

Nemotron-H: A Family of Accurate and Efficient Hybrid Mamba-Transformer Models

NVIDIA, :, Blakeman, A., Basant, A., Khattar, A., Renduchintala, A., Bercovich, A., Ficek, A., Bjorlin, A., Taghibakhshi, A., et al. (2025) · arXiv

Advanced Neural Network ApplicationsTopic Modeling

Cited by 0