Catanzaro, Bryan

Image Inpainting for Irregular Holes Using Partial Convolutions

Liu, G., Reda, F. A., Shih, K. J., Wang, T.-C., Tao, A., & Catanzaro, B. (2018) · Lecture Notes in Computer Science

Generative Adversarial Networks and Image SynthesisAdvanced Image Processing Techniques

Cited by 2,419

“Waveglow: a flow-based generative network for speech synthesis,”

Prenger, R., Valle, R., & Catanzaro, B. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

Speech Recognition and SynthesisSpeech and Audio Processing

Cited by 1,004

Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism

Shoeybi, M., Patwary, M., Puri, R., LeGresley, P., Casper, J., & Catanzaro, B. (2019) · arXiv

Topic ModelingParallel Computing and Optimization Techniques

Cited by 893

Efficient large-scale language model training on GPU clusters using megatron-LM

Narayanan, D., Shoeybi, M., Casper, J., LeGresley, P., Patwary, M., Korthikanti, V., Vainbrand, D., Kashinkunti, P., Bernauer, J., Catanzaro, B., et al. (2021) · Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis

Parallel Computing and Optimization TechniquesTopic Modeling

Cited by 639

Video-to-Video Synthesis

Wang, T.-C., Liu, M.-Y., Zhu, J.-Y., Liu, G., Tao, A., Kautz, J., & Catanzaro, B. (2018) · arXiv

Generative Adversarial Networks and Image SynthesisAdvanced Image Processing Techniques

Cited by 594

DiffWave: A Versatile Diffusion Model for Audio Synthesis

Kong, Z., Ping, W., Huang, J., Zhao, K., & Catanzaro, B. (2020) · arXiv

Speech Recognition and SynthesisMusic and Audio Processing

Cited by 569

Fast support vector machine training and classification on graphics processors

Catanzaro, B., Sundaram, N., & Keutzer, K. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08

Parallel Computing and Optimization TechniquesStochastic Gradient Optimization Techniques

Cited by 372

Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model

Smith, S., Patwary, M., Norick, B., LeGresley, P., Rajbhandari, S., Casper, J., Liu, Z., Prabhumoye, S., Zerveas, G., Korthikanti, V., et al. (2022) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 286

BigVGAN: A Universal Neural Vocoder with Large-Scale Training

Lee, S.-G., Ping, W., Ginsburg, B., Catanzaro, B., & Yoon, S. (2022) · arXiv

Speech Recognition and SynthesisSpeech and Audio Processing

Cited by 103

Factuality Enhanced Language Models for Open-Ended Text Generation

Lee, N., Ping, W., Xu, P., Patwary, M., Fung, P., Shoeybi, M., & Catanzaro, B. (2022) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 68

Nemotron-4 340B Technical Report

Nvidia, :, Adler, B., Agarwal, N., Aithal, A., Anh, D. H., Bhattacharya, P., Brundyn, A., Casper, J., Catanzaro, B., et al. (2024) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 66

RankRAG: Unifying Context Ranking with Retrieval-Augmented Generation in LLMs

Yu, Y., Ping, W., Liu, Z., Wang, B., You, J., Zhang, C., Shoeybi, M., & Catanzaro, B. (2024) · Advances in Neural Information Processing Systems 37

Topic ModelingInformation Retrieval and Search Behavior

Cited by 47

Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dialogue Abilities

Kong, Z., Goel, A., Badlani, R., Ping, W., Valle, R., & Catanzaro, B. (2024) · arXiv

Multimodal Machine Learning ApplicationsSpeech Recognition and Synthesis

Cited by 23

Large scale multi-actor generative dialog modeling,

Boyd, A., Puri, R., Shoeybi, M., Patwary, M., & Catanzaro, B. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics

Speech and dialogue systemsTopic Modeling

Cited by 22

Shall We Pretrain Autoregressive Language Models with Retrieval? A Comprehensive Study

Wang, B., Ping, W., Xu, P., McAfee, L., Liu, Z., Shoeybi, M., Dong, Y., Kuchaiev, O., Li, B., Xiao, C., et al. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing

Topic ModelingInformation Retrieval and Search Behavior

Cited by 21

Retrieval meets Long Context Large Language Models

Xu, P., Ping, W., Wu, X., McAfee, L., Zhu, C., Liu, Z., Subramanian, S., Bakhturina, E., Shoeybi, M., & Catanzaro, B. (2023) · arXiv

Topic ModelingInformation Retrieval and Search Behavior

Cited by 20

An Empirical Study of Mamba-based Language Models

Waleffe, R., Byeon, W., Riach, D., Norick, B., Korthikanti, V., Dao, T., Gu, A., Hatamizadeh, A., Singh, S., Narayanan, D., et al. (2024) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 19

NV-Embed: Improved Techniques for Training LLMs as Generalist Embedding Models

Lee, C., Roy, R., Xu, M., Raiman, J., Shoeybi, M., Catanzaro, B., & Ping, W. (2024) · arXiv

Topic ModelingInformation Retrieval and Search Behavior

Cited by 15

ODIN: Disentangled Reward Mitigates Hacking in RLHF

Chen, L., Zhu, C., Soselia, D., Chen, J., Zhou, T., Goldstein, T., Huang, H., Shoeybi, M., & Catanzaro, B. (2024) · arXiv

Reinforcement Learning in RoboticsTopic Modeling

Cited by 13

ChatQA 2: Bridging the Gap to Proprietary LLMs in Long Context and RAG Capabilities

Xu, P., Ping, W., Wu, X., Xu, C., Liu, Z., Shoeybi, M., & Catanzaro, B. (2024) · arXiv

Topic ModelingMultimodal Machine Learning Applications

Cited by 13

MEGATRON-CNTRL: Controllable Story Generation with External Knowledge Using Large-Scale Language Models

Xu, P., Patwary, M., Shoeybi, M., Puri, R., Fung, P., Anandkumar, A., & Catanzaro, B. (2020) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 12

Nemotron-4 15B Technical Report

Parmar, J., Prabhumoye, S., Jennings, J., Patwary, M., Subramanian, S., Su, D., Zhu, C., Narayanan, D., Jhunjhunwala, A., Dattagupta, A., et al. (2024) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 9

AceMath: Advancing Frontier Math Reasoning with Post-Training and Reward Modeling

Liu, Z., Chen, Y., Shoeybi, M., Catanzaro, B., & Ping, W. (2024) · arXiv

Topic ModelingMathematics, Computing, and Information Processing

Cited by 5

RAVEN: In-Context Learning with Retrieval Augmented Encoder-Decoder Language Models

Huang, J., Ping, W., Xu, P., Shoeybi, M., Chang, K. C.-C., & Catanzaro, B. (2023) · arXiv

Topic ModelingDomain Adaptation and Few-Shot Learning

Cited by 5