MelNet: a generative model for audio in the frequency domain

Deep Residual Learning for Image Recognition

He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · see citing works

Long Short-Term Memory

Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · see citing works

Adam: A Method for Stochastic Optimization

Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946 · see citing works

Auto-Encoding Variational Bayes

Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067 · see citing works

GAN（Generative Adversarial Nets）

淳司, 柴. (2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,268 · see citing works

WaveNet: a generative model for raw audio

Oord, A. V. D., Dieleman, S., Zen, H., Simonyan, K., Vinyals, O., Graves, A., Kalchbrenner, N., Senior, A., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1609.03499 · Cited by 4,911 · see citing works

Progressive Growing of GANs for Improved Quality, Stability, and Variation

Karras, T., Aila, T., Laine, S., & Lehtinen, J. (2017) · arXiv · doi:10.48550/arxiv.1710.10196 · Cited by 4,727 · see citing works

Pixel Recurrent Neural NetworksPreprint

van den Oord, A., Kalchbrenner, N., & Kavukcuoglu, K. (2016) · International Conference on Machine Learning · doi:10.48550/arxiv.1601.06759 · Cited by 3,111 · see citing works

Conditional Image Generation with PixelCNN DecodersPreprint

van den Oord, A., Kalchbrenner, N., Vinyals, O., Espeholt, L., Graves, A., & Kavukcuoglu, K. (2016) · Neural Information Processing Systems · doi:10.48550/arxiv.1606.05328 · Cited by 3,066 · see citing works

Generating Sequences With Recurrent Neural Networks

Graves, A. (2013) · arXiv · doi:10.48550/arxiv.1308.0850 · Cited by 2,894 · see citing works

Natural TTS Synthesis by Conditioning Wavenet on MEL Spectrogram Predictions

Shen, J., Pang, R., Weiss, R. J., Schuster, M., Jaitly, N., Yang, Z., Chen, Z., Zhang, Y., Wang, Y., Skerrv-Ryan, R., et al. (2018) · 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2018.8461368 · Cited by 2,791 · see citing works

Neural Discrete Representation Learning

Oord, A. V. D., Vinyals, O., & Kavukcuoglu, K. (2017) · arXiv · doi:10.48550/arxiv.1711.00937 · Cited by 2,729 · see citing works

VoxCeleb2: Deep Speaker Recognition

Chung, J. S., Nagrani, A., & Zisserman, A. (2018) · Interspeech 2018 · doi:10.21437/interspeech.2018-1929 · Cited by 2,256 · see citing works

Signal estimation from modified short-time Fourier transform

Griffin, D. W., & Lim, J. S. (1984) · IEEE Transactions on Acoustics Speech and Signal Processing · doi:10.1109/tassp.1984.1164317 · Cited by 2,085 · see citing works

Untitled work

(1994) · Aston Publications Explorer (Aston University) · Cited by 1,245 · see citing works

Image transformer

Parmar, N., Vaswani, A., Uszkoreit, J., Kaiser, Ł., Shazeer, N., Ku, A., & Tran, D. (2018) · arXiv · doi:10.48550/arxiv.1802.05751 · Cited by 1,085 · see citing works

Generating Long Sequences with Sparse Transformers

Child, R., Gray, S., Radford, A., & Sutskever, I. (2019) · arXiv · doi:10.48550/arxiv.1904.10509 · Cited by 1,063 · see citing works

“Waveglow: a flow-based generative network for speech synthesis,”

Prenger, R., Valle, R., & Catanzaro, B. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8683143 · Cited by 1,004 · see citing works

Efficient Neural Audio SynthesisPreprint

Kalchbrenner, N., Elsen, E., Simonyan, K., Noury, S., Casagrande, N., Lockhart, E., Stimberg, F., van den Oord, A., Dieleman, S., & Kavukcuoglu, K. (2018) · International Conference on Machine Learning · doi:10.48550/arxiv.1802.08435 · Cited by 948 · see citing works

Offline Arabic Handwriting Recognition with Multidimensional Recurrent Neural Networks

Graves, A. (2012) · Springer eBooks · doi:10.1007/978-1-4471-4072-6_12 · Cited by 685 · see citing works

Music Transformer: Generating Music with Long-Term StructurePreprint

Huang, C., Vaswani, A., Uszkoreit, J., Shazeer, N., Simon, I., Hawthorne, C., Dai, A. M., Hoffman, M., Dinculescu, M., & Eck, D. (2018) · International Conference on Learning Representations · doi:10.48550/arxiv.1809.04281 · Cited by 635 · see citing works

PixelCNN++: Improving the PixelCNN with Discretized Logistic Mixture Likelihood and Other Modifications

Salimans, T., Karpathy, A., Chen, X., & Kingma, D. P. (2017) · arXiv · doi:10.48550/arxiv.1701.05517 · Cited by 584 · see citing works

Deep Voice: Real-time Neural Text-to-SpeechPreprint

Arık, S. Ö., Chrzanowski, M., Coates, A., Diamos, G., Gibiansky, A., Kang, Y., Li, X., Miller, J. J., Ng, A. Y., Raiman, J., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.07825 · Cited by 483 · see citing works

SampleRNN: An Unconditional End-to-End Neural Audio Generation ModelPreprint

Mehri, S., Kumar, K., Gulrajani, I., Kumar, R., Jain, S., Sotelo, J., Courville, A. C., & Bengio, Y. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.07837 · Cited by 414 · see citing works

Parallel WaveNet: Fast High-Fidelity Speech SynthesisPreprint

van den Oord, A., Li, Y., Babuschkin, I., Simonyan, K., Vinyals, O., Kavukcuoglu, K., van den Driessche, G., Lockhart, E., Cobo, L. C., Stimberg, F., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.10433 · Cited by 384 · see citing works

ClariNet: Parallel Wave Generation in End-to-End Text-to-SpeechPreprint

Ping, W., Peng, K.-N., & Chen, J.-T. (2018) · International Conference on Learning Representations · doi:10.48550/arxiv.1807.07281 · Cited by 370 · see citing works

Music Transformer: Generating Music with Long-Term Structure

Huang, C.-Z. A., Vaswani, A., Uszkoreit, J., Shazeer, N., Simon, I., Hawthorne, C., Dai, A., Hoffman, M., Dinculescu, M., & Douglas Eck, C. (2019) · International Conference on Learning Representations · Cited by 330 · see citing works

PixelSNAIL: An Improved Autoregressive Generative ModelPreprint

Chen, X., Mishra, N., Rohaninejad, M., & Abbeel, P. (2017) · International Conference on Machine Learning · doi:10.48550/arxiv.1712.09763 · Cited by 319 · see citing works

Char2Wav: End-to-End Speech Synthesis

Sotelo, J., Mehri, S., Kumar, K., Santos, J. F., Kastner, K., Courville, A. C., & Bengio, Y. (2017) · International Conference on Learning Representations · Cited by 306 · see citing works

Multi-dimensional Recurrent Neural Networks

Graves, A., Fernández, S., & Schmidhuber, J. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-74690-4_56 · Cited by 303 · see citing works

Enabling Factorized Piano Music Modeling and Generation with the MAESTRO DatasetPreprint

Hawthorne, C., Stasyuk, A., Roberts, A., Simon, I., Huang, C.-Z. A., Dieleman, S., Elsen, E., Engel, J., & Douglas Eck, C. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.12247 · Cited by 301 · see citing works

GANSynth: Adversarial Neural Audio SynthesisPreprint

Engel, J., Agrawal, K. K., Chen, S., Gulrajani, I., Donahue, C., & Roberts, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.08710 · Cited by 291 · see citing works

TED-LIUM 3: Twice as Much Data and Corpus Repartition for Experiments on Speaker Adaptation

Hernandez, F., Nguyen, V., Ghannay, S., Tomashenko, N., & Estève, Y. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-99579-3_21 · Cited by 280 · see citing works

Grid Long Short-Term MemoryPreprint

Kalchbrenner, N., Danihelka, I., & Graves, A. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1507.01526 · Cited by 275 · see citing works

Pixel Recursive Super Resolution

Dahl, R., Norouzi, M., & Shlens, J. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.581 · Cited by 265 · see citing works

Parallel WaveNet: Fast High-Fidelity Speech SynthesisPreprint

van den Oord, A., Li, Y., Babuschkin, I., Simonyan, K., Vinyals, O., Kavukcuoglu, K., van den Driessche, G., Lockhart, E., Cobo, L. C., Stimberg, F., et al. (2017) · arXiv (Cornell University) · Cited by 262 · see citing works

ReNet: A Recurrent Neural Network Based Alternative to Convolutional NetworksPreprint

Visin, F., Kastner, K., Cho, K., Matteucci, M., Courville, A. C., & Bengio, Y. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1505.00393 · Cited by 258 · see citing works

Parallel Multiscale Autoregressive Density EstimationPreprint

Reed, S. E., van den Oord, A., Kalchbrenner, N., Colmenarejo, S. G., Wang, Z.-Y., Chen, Y., Belov, D., & de Freitas, N. (2017) · International Conference on Machine Learning · doi:10.48550/arxiv.1703.03664 · Cited by 223 · see citing works

Hierarchical Generative Modeling for Controllable Speech SynthesisPreprint

Hsu, W.-N., Zhang, Y., Weiss, R. J., Zen, H., Wu, Y., Wang, Y., Cao, Y. J., Ye, J., Chen, Z., Shen, J., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.07217 · Cited by 165 · see citing works

Generative Image Modeling Using Spatial LSTMsPreprint

Theis, L., & Bethge, M. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.03478 · Cited by 159 · see citing works

Expressive Speech Synthesis via Modeling Expressions with Variational Autoencoder

Akuzawa, K., Iwasawa, Y., & Matsuo, Y. (2018) · Interspeech (USB) · doi:10.21437/interspeech.2018-1113 · Cited by 143 · see citing works

Tacotron: Towards End-to-End Speech SynthesisPreprint

Wang, Y., Skerry-Ryan, R., Stanton, D., Wu, Y., Weiss, R. J., Jaitly, N., Yang, Z., Xiao, Y., Chen, Z., Samy Bengio, A., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.10135 · Cited by 123 · see citing works

Fast Spectrogram Inversion Using Multi-Head Convolutional Neural Networks

Arık, S. Ö., Jun, H., & Diamos, G. (2018) · IEEE Signal Processing Letters · doi:10.1109/lsp.2018.2880284 · Cited by 121 · see citing works

Sample Efficient Adaptive Text-to-SpeechPreprint

Chen, Y., Assael, Y., Shillingford, B., Budden, D. M., Reed, S., Zen, H., Wang, Q., Cobo, L. C., Trask, A., Laurie, B., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.10460 · Cited by 117 · see citing works

The challenge of realistic music generation: modelling raw audio at scalePreprint

Dieleman, S., van den Oord, A., & Simonyan, K. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.10474 · Cited by 115 · see citing works

Synthesizing Audio with Generative Adversarial Networks

Donahue, C., McAuley, J., & Puckette, M. (2018) · Cited by 103 · see citing works

Generating High Fidelity Images with Subscale Pixel Networks and Multidimensional UpscalingPreprint

Menick, J., & Kalchbrenner, N. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.01608 · Cited by 94 · see citing works

Adversarial Audio SynthesisPreprint

Donahue, C., McAuley, J., & Puckette, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.04208 · Cited by 89 · see citing works

Modeling Time-Frequency Patterns with LSTM vs. Convolutional Architectures for LVCSR Tasks

Sainath, T. N., & Li, B. (2016) · Interspeech (USB) · doi:10.21437/interspeech.2016-84 · Cited by 57 · see citing works

Exploring multidimensional lstms for large vocabulary ASR

Li, J., Mohamed, A., Zweig, G., & Gong, Y. (2016) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2016.7472617 · Cited by 55 · see citing works

Inversion of auditory spectrograms, traditional spectrograms, and other envelope representations

Decorsière, R. J. B., Søndergaard, P. L., MacDonald, E., & Dau, T. (2014) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2014.2367821 · Cited by 24 · see citing works

Expressive Speech Synthesis via Modeling Expressions with Variational AutoencoderPreprint

Akuzawa, K., Iwasawa, Y., & Matsuo, Y. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.02135 · Cited by 14 · see citing works

Conditioning Deep Generative Raw Audio Models for Structured Automatic MusicPreprint

Manzelli, R., Thakkar, V., Siahkamari, A., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.09905 · Cited by 8 · see citing works

VoxCeleb2: Deep Speaker Recognition

Chung, J. S., Nagrani, A., & Zisserman, A. (2018) · arXiv · doi:10.48550/arxiv.1806.05622

TED-LIUM 3: twice as much data and corpus repartition for experiments on speaker adaptation

Hernandez, F., Nguyen, V., Ghannay, S., Tomashenko, N., & Estève, Y. (2018) · arXiv · doi:10.48550/arxiv.1805.04699

Jukebox: A Generative Model for MusicPreprint

Dhariwal, P., Jun, H., Payne, C., Kim, J. W., Radford, A., & Sutskever, I. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.00341 · Cited by 602 · see citing works

WaveGrad: Estimating Gradients for Waveform GenerationPreprint

Chen, N., Zhang, Y., Zen, H., Weiss, R. J., Norouzi, M., & Chan, W. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.00713 · Cited by 410 · see citing works

A survey on neural speech synthesis

Tan, X., Qin, T., Soong, F., & Liu, T.-Y. (2021) · arXiv · doi:10.48550/arxiv.2106.15561 · Cited by 216 · see citing works

SuperNNova: an open-source framework for Bayesian, neural network-based supernova classification

Möller, A., & de Boissière, T. (2020) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stz3312 · Cited by 191 · see citing works

Deepfake generation and detection: Case study and challenges

Patel, Y., Tanwar, S., Gupta, R., Bhattacharya, P., Davidson, I. E., Nyameko, R., Aluvala, S., & Vimal, V. (2023) · IEEE Access · doi:10.1109/access.2023.3342107 · Cited by 186 · see citing works

High Fidelity Speech Synthesis with Adversarial NetworksPreprint

Bińkowski, M., Donahue, J., Dieleman, S., Clark, A., Elsen, E., Casagrande, N., Cobo, L. C., & Simonyan, K. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.11646 · Cited by 199 · see citing works

3‑D Inorganic Crystal Structure Generation and Property Prediction via Representation Learning

Court, C. J., Yildirim, B., Jain, A., & Cole, J. M. (2020) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.0c00464 · Cited by 127 · see citing works

End-to-End Adversarial Text-to-SpeechPreprint

Donahue, J., Dieleman, S., Binkowski, M., Elsen, E., & Simonyan, K. (2020) · International Conference on Learning Representations · doi:10.48550/arxiv.2006.03575 · Cited by 200 · see citing works

Audio deepfakes: A survey

Khanjani, Z., Watson, G., & Janeja, V. P. (2023) · Frontiers in Big Data · doi:10.3389/fdata.2022.1001063 · Cited by 121 · see citing works

Testing human ability to detect ‘deepfake’ images of human faces

Bray, S. D., Johnson, S. D., & Kleinberg, B. (2023) · Journal of Cybersecurity · doi:10.1093/cybsec/tyad011 · Cited by 96 · see citing works

Any-to-Many Voice Conversion With Location-Relative Sequence-to-Sequence Modeling

Liu, S., Cao, Y., Wang, D., Wu, X., Liu, X., & Meng, H. M. L. (2021) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2021.3076867 · Cited by 87 · see citing works

A Comprehensive Survey on Deep Music Generation: Multi-level Representations, Algorithms, Evaluations, and Future DirectionsPreprint

Ji, S., Luo, J., & Yang, X. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.06801 · Cited by 85 · see citing works

VQVC+: One-Shot Voice Conversion by Vector Quantization and U-Net Architecture

Wu, D.-Y., Chen, Y.-H., & Lee, H.-Y. (2020) · Interspeech 2020 · doi:10.21437/interspeech.2020-1443 · Cited by 88 · see citing works

Music Creation by Example

Frid, E., Gomes, C., & Jin, Z. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376514 · Cited by 58 · see citing works

GACELA: A Generative Adversarial Context Encoder for Long Audio Inpainting of Music

Marafioti, A., Majdak, P., Holighaus, N., & Perraudin, N. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.3037506 · Cited by 52 · see citing works

DrumGAN: Synthesis of Drum Sounds With Timbral Feature Conditioning Using Generative Adversarial NetworksPreprint

Nistal, J., Lattner, S., & Gaël Richard, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.12073 · Cited by 44 · see citing works

The Ethical Implications of Generative Audio Models: A Systematic Literature Review

Barnett, J. (2023) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3600211.3604686 · Cited by 47 · see citing works

Social Media through Voice

Zhang, L., Jiang, L., Washington, N. L., Liu, A. A., Shao, J., Fourney, A., Morris, M., & Findlater, L. (2021) · Proc. ACM Hum. Comput. Interact. · doi:10.1145/3449235 · Cited by 34 · see citing works

Revisiting Over-Smoothness in Text to Speech

Ren, Y., Tan, X., Qin, T., Zhao, Z., & Liu, T. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.564 · Cited by 39 · see citing works

Unsupervised Style and Content Separation by Minimizing Mutual Information for Speech Synthesis

Hu, T.-Y., Shrivastava, A., Tuzel, O., & Dhir, C. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9054591 · Cited by 35 · see citing works

Audio representations for deep learning in sound synthesis: A review

Natsiou, A., & O’Leary, S. (2021) · IEEE/ACS International Conference on Computer Systems and Applications (AICCSA) · doi:10.1109/aiccsa53542.2021.9686838 · Cited by 35 · see citing works

Unconditional Audio Generation with Generative Adversarial Networks and Cycle Regularization

Liu, J.-Y., Chen, Y.-H., Yeh, Y.-C., & Yang, Y. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-1137 · Cited by 33 · see citing works

Conditional Sound Generation Using Neural Discrete Time-Frequency Representation Learning

Liu, X., Iqbal, T., Zhao, J., Huang, Q., Plumbley, M. D., & Wang, W. (2021) · Machine learning for signal processing ... · doi:10.1109/mlsp52302.2021.9596430 · Cited by 32 · see citing works

Semi-Supervised Generative Modeling for Controllable Speech SynthesisPreprint

Habib, R., Mariooryad, S., Shannon, M., Battenberg, E., Skerry-Ryan, R., Stanton, D., Kao, D., & Bagby, T. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.01709 · Cited by 32 · see citing works

Controllable Data Generation by Deep Learning: A Review

Wang, S.-Y., Du, Y., Guo, X., Pan, B., Qin, Z. S., & Zhao, L. (2024) · ACM Computing Surveys · doi:10.1145/3648609 · Cited by 39 · see citing works

Music Generation Using Deep Learning and Generative AI: A Systematic Review

Mitra, R., & Zualkernan, I. A. (2025) · IEEE Access · doi:10.1109/access.2025.3531798 · Cited by 36 · see citing works

Speaker Conditional WaveRNN: Towards Universal Neural Vocoder for Unseen Speaker and Recording Conditions

Paul, D., Pantazis, Y., & Stylianou, Y. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-2786 · Cited by 30 · see citing works

A Convolutional Deep Markov Model for Unsupervised Speech Representation Learning

Khurana, S., Laurent, A., Hsu, W.-N., Chorowski, J., Łańcucki, A., Marxer, R., & Glass, J. R. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-3084 · Cited by 28 · see citing works

Seq-U-Net: A One-Dimensional Causal U-Net for Efficient Sequence Modelling

Stoller, D., Tian, M., Ewert, S., & Dixon, S. (2020) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/400 · Cited by 28 · see citing works

FoleyGAN: Visually Guided Generative Adversarial Network-Based Synchronous Sound Generation in Silent Videos

Ghose, S., & Prevost, J. J. (2022) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3177894 · Cited by 28 · see citing works

SYNT++: Utilizing Imperfect Synthetic Data to Improve Speech Recognition

Hu, T.-Y., Armandpour, M., Shrivastava, A., Chang, J.-H. R., Koppula, H. S., & Tuzel, O. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746217 · Cited by 28 · see citing works

High Quality Streaming Speech Synthesis with Low, Sentence-Length-Independent Latency

Ellinas, N., Vamvoukakis, G., Μαρκόπουλος, Κ., Chalamandaris, A., Maniati, G., Kakoulidis, P., Raptis, S., Sung, J. S., Park, H.-M., & Tsiakoulis, P. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-2464 · Cited by 26 · see citing works

Investigation of learning abilities on linguistic features in sequence-to-sequence text-to-speech synthesis

Yasuda, Y., Wang, X., & Yamagishi, J. (2020) · Computer Speech & Language · doi:10.1016/j.csl.2020.101183 · Cited by 23 · see citing works

Score and Lyrics-Free Singing Voice GenerationPreprint

Liu, J.-Y., Chen, Y.-H., Yeh, Y.-C., & Yang, Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.11747 · Cited by 23 · see citing works

ESeismic-GAN: A Generative Model for Seismic Events From Cotopaxi Volcano

Grijalva, F., Ramos, W., Pérez, N., Benítez, D. S., Lara-Cueva, R., & Ruiz, M. C. (2021) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2021.3095270 · Cited by 22 · see citing works

Review of end-to-end speech synthesis technology based on deep learningPreprint

Mu, Z., Yang, X., & Dong, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.09995 · Cited by 25 · see citing works

Controllable deep melody generation via hierarchical music structure representationPreprint

Dai, S., Jin, Z., Gomes, C., & Dannenberg, R. B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.00663 · Cited by 22 · see citing works

How Deep Are the Fakes? Focusing on Audio Deepfake: A SurveyPreprint

Khanjani, Z., Watson, G., & Janeja, V. P. (2021) · arXiv (Cornell University) · doi:10.13016/m2ivas-ogyu · Cited by 22 · see citing works

Phase Reconstruction Based On Recurrent Phase Unwrapping With Deep Neural Networks

Masuyama, Y., Yatabe, K., Koizumi, Y., Oikawa, Y., & Harada, N. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9053234 · Cited by 21 · see citing works

Adaptive Multi-Scale Detection of Acoustic Events

Ding, W., & He, L. J. (2019) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2019.2953350 · Cited by 20 · see citing works

Learnable MFCCs for Speaker Verification

Liu, X., Sahidullah, M., & Kinnunen, T. (2021) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas51556.2021.9401593 · Cited by 21 · see citing works

Multi-Instrumentalist Net: Unsupervised Generation of Music from Body MovementsPreprint

Su, K., Liu, X., & Shlizerman, E. (2020) · arXiv.org · doi:10.48550/arxiv.2012.03478 · Cited by 33 · see citing works

High Quality Audio Coding with Mdctnet

Davidson, G. A., Vinton, M. S., Ekstrand, P., Zhou, C., Villemoes, L. F., & Lu, L. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096056 · Cited by 13 · see citing works

Conditional image generation with One-Vs-All classifier

Xu, X., Li, Y., & Cao, Y. (2021) · Neurocomputing · doi:10.1016/j.neucom.2020.12.091 · Cited by 12 · see citing works

Time-Frequency Phase Retrieval for Audio—The Effect of Transform Parameters

Marafioti, A., Holighaus, N., & Majdak, P. (2021) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2021.3088581 · Cited by 12 · see citing works

Dual Learning Music Composition and Dance Choreography

Wu, S., Liu, Z., Lu, S., & Cheng, L. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3475180 · Cited by 11 · see citing works

GANStrument: Adversarial Instrument Sound Synthesis with Pitch-Invariant Instance Conditioning

Narita, G., Shimizu, J., & Akama, T. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10097250 · Cited by 11 · see citing works

Perceptual-Similarity-Aware Deep Speaker Representation Learning for Multi-Speaker Generative Modeling

Saito, Y., Takamichi, S., & Saruwatari, H. (2021) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2021.3059114 · Cited by 11 · see citing works

Learning audio representations via phase predictionPreprint

Quitry, F. D. C., Tagliasacchi, M., & Roblek, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.11910 · Cited by 10 · see citing works

Incremental Text to Speech for Neural Sequence-to-Sequence Models Using Reinforcement Learning

Mohan, D. S. R., Lenain, R., Foglianti, L., Teh, T. H., Staib, M., Torresquintero, A., & Gao, J. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-1822 · Cited by 9 · see citing works

Synthesis of respiratory signals using conditional generative adversarial networks from scalogram representation

Jayalakshmy, S., Lakshmipriya, B., & Sudha, G. F. (2021) · Elsevier eBooks · doi:10.1016/b978-0-12-823519-5.00024-5 · Cited by 9 · see citing works

Modeling of Rakugo Speech and Its Limitations: Toward Speech Synthesis That Entertains Audiences

Kato, S., Yasuda, Y., Wang, X., Cooper, E., Takaki, S., & Yamagishi, J. (2020) · IEEE Access · doi:10.1109/access.2020.3011975 · Cited by 9 · see citing works

CSTNet: Contrastive Speech Translation Network for Self-Supervised Speech Representation LearningPreprint

Khurana, S., Laurent, A., & Glass, J. R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.02814 · Cited by 9 · see citing works

FastS2S-VC: Streaming Non-Autoregressive Sequence-to-Sequence Voice ConversionPreprint

Kameoka, H., Tanaka, K., & Kaneko, T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.06900 · Cited by 8 · see citing works

Energy Consumption of Deep Generative Audio ModelsPreprint

Douwes, C., Esling, P., & Briot, J.-P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.02621 · Cited by 8 · see citing works

VMD-Informer-DCC for Photovoltaic Power Prediction

Wu, Y., Pan, X., & Yang, J. (2024) · IEICE Transactions on Communications · doi:10.23919/transcom.2023ebp3170 · Cited by 7 · see citing works

Fingerprint Spoof Generation Using Style Transfer

Wone, A., Manno, J. D., Charrier, C., & Rosenberger, C. (2025) · IEEE Transactions on Biometrics Behavior and Identity Science · doi:10.1109/tbiom.2025.3545308 · Cited by 7 · see citing works

Controllable speech synthesis by learning discrete phoneme-level prosodic representations

Ellinas, N., Christidou, M., Vioni, A., Sung, J. S., Chalamandaris, A., Tsiakoulis, P., & Mastorocostas, P. (2022) · Speech Communication · doi:10.1016/j.specom.2022.11.006 · Cited by 6 · see citing works

Speech-to-Singing Conversion Based on Boundary Equilibrium GAN

Wu, D.-Y., & Yang, Y. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-1984 · Cited by 6 · see citing works

Enabling an IoT System of Systems through Auto Sound Synthesis in Silent Video with DNN

Ghose, S., & Prevost, J. J. (2020) · International Conference on System of Systems Engineering · doi:10.1109/sose50414.2020.9130483 · Cited by 6 · see citing works

Prosodic Clustering for Phoneme-Level Prosody Control in End-to-End Speech Synthesis

Vioni, A., Christidou, M., Ellinas, N., Vamvoukakis, G., Kakoulidis, P., Kim, T., Sung, J. S., Park, H.-M., Chalamandaris, A., & Tsiakoulis, P. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9413604 · Cited by 6 · see citing works

Gamma Boltzmann Machine for Audio Modeling

Nakashika, T., & Yatabe, K. (2021) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2021.3095656 · Cited by 6 · see citing works

Comparing Representations for Audio Synthesis Using Generative Adversarial Networks

Nistal, J., Lattner, S., & Gaël Richard, A. (2020) · European Signal Processing Conference (EUSIPCO) · doi:10.23919/eusipco47968.2020.9287799 · Cited by 5 · see citing works

Comprehensive Performance Analysis of Object Detection Algorithms Across Diverse Sensor Modalities

Acharjee, S., Ganguly, S., Ali, A., & Frnda, J. (2025) · IEEE Sensors Reviews · doi:10.1109/sr.2025.3584745 · Cited by 5 · see citing works

A Neural Lip-Sync Framework for Synthesizing Photorealistic Virtual News Anchors

Zheng, R., Zhou, Z., Song, B., & Ji, C. (2021) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr48806.2021.9412187 · Cited by 7 · see citing works

Phase reconstruction based on recurrent phase unwrapping with deep neural networksPreprint

Masuyama, Y., Yatabe, K., Koizumi, Y., Oikawa, Y., & Harada, N. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.05832 · Cited by 5 · see citing works

WaveNODE: A Continuous Normalizing Flow for Speech SynthesisPreprint

Kim, H., Lee, H. S., Kang, W. H., Cheon, S. J., Choi, B. J., & Kim, N. S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.04598 · Cited by 5 · see citing works

MP3net: coherent, minute-long music generation from raw audio with a simple convolutional GANPreprint

van den Broek, K. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.04785 · Cited by 5 · see citing works

DarkGAN: Exploiting Knowledge Distillation for Comprehensible Audio Synthesis With GANsPreprint

Nistal, J., Lattner, S., & Gaël Richard, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.01216 · Cited by 5 · see citing works

A Survey on Audio Synthesis and Audio-Visual Multimodal ProcessingPreprint

Shi, Z. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.00443 · Cited by 10 · see citing works

Phase-Aware Transformations in Variational Autoencoders for Audio Effects

Cámara, M., & Blanco, J. L. (2022) · Journal of the Audio Engineering Society · doi:10.17743/jaes.2022.0042 · Cited by 4 · see citing works

CycleDRUMS: automatic drum arrangement for bass lines using CycleGAN

Barnabò, G., Trappolini, G., Lastilla, L., Campagnano, C., Fan, A., Petroni, F., & Silvestri, F. (2023) · Discover Artificial Intelligence · doi:10.1007/s44163-023-00047-7 · Cited by 4 · see citing works

Multi-speaker Chinese news broadcasting system based on improved Tacotron2

Zhao, W., Lian, Y., Chai, J., & Tu, Z. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-15279-z · Cited by 4 · see citing works

Synthesising Expressiveness in Peking Opera via Duration Informed Attention NetworkPreprint

Wu, Y., Li, S., Yu, C., Lu, H., Weng, C., Zhang, L., & Yu, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.12010 · Cited by 4 · see citing works

Generative Models for Security: Attacks, Defenses, and OpportunitiesPreprint

Bauer, L. A., & Bindschaedler, V. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.10139 · Cited by 10 · see citing works

A Benchmarking Initiative for Audio-Domain Music Generation Using the Freesound Loop DatasetPreprint

Hung, T. M., Chen, B., Yeh, Y.-T., & Yang, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.01576 · Cited by 4 · see citing works

TTSlow: Slow Down Text-to-Speech With Efficiency Robustness Evaluations

Gao, X., Chen, Y., Yue, X., Tsao, Y., & Chen, N. F. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3533357 · Cited by 3 · see citing works

Sound of Story: Multi-modal Storytelling with Audio

Bae, J., Jeong, S., Kang, S., Han, N., Lee, J.-Y., Kim, H., & Kim, T.-H. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.898 · Cited by 3 · see citing works

Mapping the Audio Landscape for Innovative Music Sample Generation

Limberg, C., & Zhang, Z. (2024) · International Conference on Multimedia Retrieval · doi:10.1145/3652583.3657586 · Cited by 2 · see citing works

FCH-TTS: Fast, Controllable and High-quality Non-Autoregressive Text-to-Speech Synthesis

Zhou, X. Y., Zhou, Z., & Shi, X. (2022) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn55064.2022.9892512 · Cited by 2 · see citing works

Unsupervised Style and Content Separation by Minimizing Mutual Information for Speech SynthesisPreprint

Hu, T.-Y., Shrivastava, A., Tuzel, O., & Dhir, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.06227 · Cited by 2 · see citing works

Gamma Boltzmann Machine for Simultaneously Modeling Linear- and Log-amplitude SpectraPreprint

Nakashika, T., & Yatabe, K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.13590 · Cited by 2 · see citing works

Generative Adversarial Networks in Human Emotion Synthesis: A Review

Hajarolasvadi, N., Ramírez, M. A., Beccaro, W., & Demirel, H. (2020) · IEEE Access · doi:10.1109/access.2020.3042328 · Cited by 34 · see citing works

MDCTNet: A Hybrid Approach to Neural Audio Coding

Villemoes, L. F., Vinton, M. S., Ekstrand, P., Lu, L., Davidson, G. A., & Zhou, C. (2024) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2024.3482721 · Cited by 1 · see citing works

A Study on the Production of Real-Time Algorithmic Composition System Using the VQ-VAE Algorithm of OpenAI Jukebox

Jeon, M.-J., & Kim, J. (2021) · Journal of Digital Contents Society · doi:10.9728/dcs.2021.22.3.375 · Cited by 1 · see citing works

Multi-Track Music Generation Network Based on a Hybrid Learning Module

Zhang, D., Hu, Z., Li, X., Tie, Y., & Qi, L. (2023) · IEEE International Conference on Multimedia and Expo workshops · doi:10.1109/icmew59549.2023.00062 · Cited by 1 · see citing works

Exploring the Impact of Speech AI: A Comparative Analysis of ML Models on Arabic Dataset

Mna, M. K. B., & Letaïfa, A. B. (2023) · International Conference on Communications and Networking (ComNet) · doi:10.1109/comnet60156.2023.10366659 · Cited by 1 · see citing works

Towards the implementation of an Attention-based Neural Machine Translation with artificial pronunciation for Nahuatl as a mobile application

García, S. K. B., Lucero, E. S., Méndez, B. E. P., Hernández, J. C. H., Huerta, E. B., & Cruz, J. F. R. (2020) · International Conference in Software Engineering Research and Innovation (CONISOFT) · doi:10.1109/conisoft50191.2020.00041 · Cited by 1 · see citing works

A sinusoidal signal reconstruction method for the inversion of the mel-spectrogram

Natsiou, A., & O’Leary, S. (2021) · IEEE International Symposium on Multimedia (ISM) · doi:10.1109/ism52913.2021.00048 · Cited by 1 · see citing works

Conditional Sound Generation Using Neural Discrete Time-Frequency Representation LearningPreprint

Liu, X., Iqbal, T., Zhao, J., Huang, Q., Plumbley, M. D., & Wang, W. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.09998 · Cited by 1 · see citing works

Guided-TTS:Text-to-Speech with Untranscribed SpeechPreprint

Kim, H., Kim, S., & Yoon, S. (2021) · arXiv (Cornell University) · Cited by 1 · see citing works

Individually amplified text-to-speech.Preprint

Schlittenlacher, J., & Baer, T. (2020) · arXiv (Cornell University)

AudioViewer : learning to visualize soundPreprint

Zhang, Y. (2021) · arXiv (Cornell University) · doi:10.14288/1.0395431

Text-to-speech for the hearing impairedPreprint

Schlittenlacher, J., & Baer, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.02174

Improving the Expressiveness of Neural Vocoding with Non-Affine Normalizing Flows

Gabryś, A., Jiao, Y., Klimkov, V., Korzekwa, D., & Barra-Chicote, R. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-1555

Multi-Scale Spectrogram Modelling for Neural Text-to-Speech

Abbas, A., Bollepalli, B., Moinet, A., Joly, A., Karanasou, P., Makarov, P., Slangens, S., Karlapati, S., & Thomas Drugman, A. (2021) · ISCA Speech Synthesis Workshop (SSW) · doi:10.21437/ssw.2021-31

Musical Speech: A Transformer-based Composition ToolPreprint

d’Eon, J., Dumpala, S. H., Sastry, C. S., Oore, D., & Oore, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.01043

Research on the Methods of Speech Synthesis Technology

Hu, J., & Hamdulla, A. (2021) · IEEE International Conference on Pattern Recognition and Machine Learning (PRML) · doi:10.1109/prml52754.2021.9520718

Analyzing Emotional Speech and Text: A Special Focus on Bengali Language

Majumder, K., & Das, D. (2022) · Signals and communication technology · doi:10.1007/978-3-031-18444-4_15

Improving Variational Methods for Representation Learning and Generative Modelling of Speech

Braithwaite, D. T. (2023) · doi:10.26686/wgtn.23462480

SampleRNN: An Unconditional End-to-End Neural Audio Generation ModelPreprint

Mehri, S., Kumar, K., Gulrajani, I., Kumar, R., Jain, S., Sotelo, J., Courville, A. C., & Bengio, Y. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.07837 · Cited by 414 · see citing works

WaveNet: a generative model for raw audio

Oord, A. V. D., Dieleman, S., Zen, H., Simonyan, K., Vinyals, O., Graves, A., Kalchbrenner, N., Senior, A., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1609.03499 · Cited by 4,911 · see citing works

From Discrete Tokens to High-Fidelity Audio Using Multi-Band DiffusionPreprint

Roman, R. S., Adi, Y., Deleforge, A., Serizel, R., Synnaeve, G., & Défossez, A. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2308.02560 · Cited by 8 · see citing works

WaveGrad: Estimating Gradients for Waveform GenerationPreprint

Chen, N., Zhang, Y., Zen, H., Weiss, R. J., Norouzi, M., & Chan, W. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.00713 · Cited by 410 · see citing works

Catch-A-Waveform: Learning to Generate Audio from a Single Short ExamplePreprint

Greshler, G., Shaham, T. R., & Michaeli, T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.06426 · Cited by 15 · see citing works