PreprintCited by 2Music and Audio ProcessingSpeech Recognition and SynthesisGenerative Adversarial Networks and Image Synthesis

The DOI matches its DataCite record; the references it cites are not checked yet.

EVA-GAN: Enhanced Various Audio Generation via Scalable Generative Adversarial Networks

Open access

Abstract

The advent of Large Models marks a new era in machine learning, significantly outperforming smaller models by leveraging vast datasets to capture and synthesize complex patterns. Despite these advancements, the exploration into scaling, especially in the audio generation domain, remains limited, with previous efforts didn't extend into the high-fidelity (HiFi) 44.1kHz domain and suffering from both spectral discontinuities and blurriness in the high-frequency domain, alongside a lack of robustness against out-of-domain data. These limitations restrict the applicability of models to diverse use cases, including music and singing generation. Our work introduces Enhanced Various Audio Generation via Scalable Generative Adversarial Networks (EVA-GAN), yields significant improvements over previous state-of-the-art in spectral and high-frequency reconstruction and robustness in out-of-domain data performance, enabling the generation of HiFi audios by employing an extensive dataset of 36,000 hours of 44.1kHz audio, a context-aware module, a Human-In-The-Loop artifact measurement toolkit, and expands the model to approximately 200 million parameters. Demonstrations of our work are available at https://double-blind-eva-gan.cc.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2402.00892

Cites

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Recent research has continued to refine speech synthesis technologies, enabling synthesised speech to sound increasingly natural while improving synthesis speed.

    “In recent years, research [44,45,46,47,48,49,50,51] has continued to refine these technologies, enabling synthesised speech to sound increasingly natural while also improving synthesis speed.”

    From Audio Deepfake Detection: What Has Been Achieved and What Lies Ahead (2025) · cites this paper as [47]

    The Introduction and Conclusions describe advances in audio fidelity and realistic generation, and the Results report efficient inference. But Table 1 shows EVA-GAN took longer to infer than its HiFi-GAN baseline, so this paper does not establish improved synthesis speed alongside improved quality. (LLM, conf=0.84)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

The citation lists haven’t been fetched yet

Cited by 2

Research works printed but not linked: 6

  1. Liutkus, A., Stöter, F.-R., Rafii, Z., Kitamura, D., Rivet, B., Ito, N., Ono, N., and Fontecave, J. The 2016 signal separation evaluation campaign. In Tichavský, P., Babaie- Zadeh, M., Michel, O. J., and Thirion-Moreau, N. (eds.), Latent Variable Analysis and Signal Separation -12th International Conference, LVA/ICA 2015, Liberec, Czech Republic, August 25-28, 2015, Proceedings, pp. 323-332, Cham, 2017. Springer International Publishing.
  2. Rix, A., Beerends, J., Hollier, M., and Hekstra, A. Percep- tual evaluation of speech quality (pesq): A new method for speech quality assessment of telephone networks and codecs. volume 2, pp. 749-752 vol.2, 02 2001. ISBN 0-7803-7041-4. doi: 10.1109/ICASSP.2001.941023. · DOI
  3. Steinmetz, C. J. and Reiss, J. D. auraloss: Audio focused loss functions in PyTorch. In Digital Music Research Network One-day Workshop (DMRN+15), 2020.
  4. Xu, S., Zhao, W., and Guo, J. Refinegan: Universally generating waveform better than ground truth with highly accurate pitch and intensity responses. arXiv preprint arXiv:2111.00962, 2021. · arXiv
  5. Zhang, L., Li, R., Wang, S., Deng, L., Liu, J., Ren, Y., He, J., Huang, R., Zhu, J., Chen, X., and Zhao, Z. M4singer: A multi-style, multi-singer and musical score provided mandarin singing corpus. In Thirty-sixth Conference on Neural Information Processing Systems Datasets and Benchmarks Track, 2022.
  6. Zhao, Y., Wang, X., Juvela, L., and Yamagishi, J. Trans- ferring neural speech waveform synthesizers to musi- cal instrument sounds generation. In Proc. ICASSP, pp. 6269-6273, 2020. doi: 10.1109/ICASSP40776. 2020.9053047. URL https://ieeexplore.ieee. org/document/9053047/. · DOI

Metadata

Authors
Liao, S., Lan, S., & Zachariah, A. G.
Affiliations
Nvidia (United States) (US)
Venue
arXiv
Publisher
arXiv
Published
2024
ISSN
2331-8422 (ISSN-L)
OpenAlex
W4391555519
Cited by
2
References
0
Citations by year
2025: 2
Type
posted content
Language
en
Open access
Locations
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Topics
  • Physical Sciences › Computer Science › Signal Processing › Music and Audio Processing
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
Keywords
audio generation, generative adversarial networks, high-fidelity audio, spectral reconstruction, high-frequency reconstruction, out-of-domain robustness, human-in-the-loop evaluation, music generation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review