XTTS: a Massively Multilingual Zero-Shot Text-to-Speech Model
Open accessAbstract
Most Zero-shot Multi-speaker TTS (ZS-TTS) systems support only a single language. Although models like YourTTS, VALL-E X, Mega-TTS 2, and Voicebox explored Multilingual ZS-TTS they are limited to just a few high/medium resource languages, limiting the applications of these models in most of the low/medium resource languages. In this paper, we aim to alleviate this issue by proposing and making publicly available the XTTS system. Our method builds upon the Tortoise model and adds several novel modifications to enable multilingual training, improve voice cloning, and enable faster training and inference. XTTS was trained in 16 languages and achieved state-of-the-art (SOTA) results in most of them.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Attack A29 (pre-trained XTTS) was the best recognized attack by the non-SSL based detector, with a pooled min DCF of 0.075 and scores smaller than 0.1 in combination with eight of the 11 codecs.
“Overall, attack A29 (pre-trained XTTS [27]) was the best recognized attack with a pooled score of 0.075 and having scores smaller 0.1 in combination with eight of the 11 codecs.”
From Robust audio deepfake detection: exploring front-/back-end combinations and data augmentation strategies for the ASVspoof5 Challenge (2024) · cites this paper as [27]
Cites
Still being checked.
Cited by
Sorted by citations
Schäfer, K., Choi, J.-E., & Neu, M. (2024) · The Automatic Speaker Verification Spoofing Countermeasures Workshop (ASVspoof 2024) · doi:10.21437/asvspoof.2024-9 · Cited by 8 · see citing works
“Overall, attack A29 (pre-trained XTTS [27]) was the best recognized attack with a pooled score of 0.075 and having scores smaller 0.1 in combination with eight of the 11 codecs.”
InfluentialAV-Deepfake1M++: A Large-Scale Audio-Visual Deepfake Benchmark with Real-World Perturbations
Cai, Z., Kuckreja, K., Ghosh, S., Chuchra, A., Khan, M. H., Tariq, U., Gedeon, T., & Dhall, A. (2025) · Proceedings of the 33rd ACM International Conference on Multimedia · doi:10.1145/3746027.3761979 · Cited by 4 · see citing works
Detecting Voice Cloning and Text to Speech Audio in Real Time on Mobile Devices
Berchtold, W., Heeger, J., Bugert, S., & Steinebach, M. (2025) · Electronic Imaging · doi:10.2352/ei.2025.37.3.mobmu-310 · Cited by 1 · see citing works
Efficient Algorithms for Deepfake Audio Detection based on LCNN
Lim, D.-H., & Han, J.-K. (2024) · Journal of Broadcast Engineering · doi:10.5909/jbe.2024.29.5.713
Speaker Embedding Clusters Consistency-Based Evaluation Metric for Zero-Shot TTS Models
Sviridova, N., & Asano, N. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-29178-3_40
Mtabvuri, D., Donga, S., & Quarkume, A. Y. (2026) · International Conference on Information Technology for Social Good (GoodIT) · doi:10.1145/3794786.3830734
- Authors
- Casanova, E., Davis, K., Gölge, E., Göknar, G., Gulea, I., Hart, L., Aljafari, A., Meyer, J., Morais, R., Olayemi, S., & Weber, J.
- ORCID
- Casanova, Edresson
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2024
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2406.04904
- OpenAlex
- W4399511026
- Cited by
- 4
- References
- 0
- Citations by year
- 2026: 2 · 2025: 1 · 2024: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Fundação para a Ciência e a Tecnologia
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Phonetics and Phonology Research
- Keywords
- zero-shot text-to-speech, prosody, tortoises, voice cloning, low-resource languages
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
