TL;DR
Alania-2 is a 488M-parameter Turkish text-to-speech (TTS) system that achieves state-of-the-art intelligibility by prioritizing high-quality synthetic training data and robust text normalization over sheer model size. It delivers high-fidelity 48 kHz audio with a median first-audio latency of just 32 ms, featuring both instant voice cloning and fast-trained professional adapters.
What Problem Does This Paper Address?
Turkish is a "mid-resource" language for speech synthesis. While massive multilingual models exist, they are often optimized for English or Chinese, leaving Turkish with sub-par intelligibility.
The authors identify two primary hurdles:
- Linguistic Complexity: Turkish is an agglutinative language where numbers, dates, and foreign names take case suffixes that must agree with their pronunciation. Simple text-to-phoneme mapping often fails here.
- The "Size vs. Quality" Trade-off: There is a prevailing trend that "bigger is better" in TTS. The authors challenge this, seeking a model small enough for low-latency production (like telephone assistants) that doesn't sacrifice clarity.
Methods
Alania-2 utilizes the VoxCPM2 architecture, which consists of a language-model backbone that reads text and generates continuous audio latents via a diffusion transformer decoder. These latents are then turned into 48 kHz audio by a frozen Variational Autoencoder (VAE).
Key technical innovations include:
- Custom Text Normalizer: A rule-based engine that rewrites symbols and numbers into spoken words while handling complex Turkish vowel harmony for suffixes.
- Optimized Inference: By implementing batched VAE decoding and CUDA-graph prefilling, the team reduced single-stream latency from 74 ms to 32 ms.
- Two-Tiered Cloning:
- Instant: Uses "reference-only" conditioning (rather than continuation) to prevent word skipping.
- Professional: Employs rank-32 LoRA adapters trained in roughly two minutes to achieve high speaker similarity.
Datasets
The model was trained on a massive 18,195-hour corpus, though only 10% of this was "real" speech (filtered from YouTube/YODAS). The remaining 90% was synthetic speech generated by a larger teacher model and passed through rigorous quality filters.
The authors have released several resources to the community:
- Freya-TR-Eval: A public benchmark of 495 Turkish sentences.
- Captions & Text: A 2,398-hour caption set and a 1.44M-sentence domain text corpus.
- Synthetic Speech Set: 3,411 hours of 48 kHz audio.
Key Insights and Ideas
- Data Quality > Model Size: In a striking result, the authors trained "Antalia-2 Mini," a tiny 7.6M-parameter model, using the same data recipe. It matched the intelligibility of models 300 times its size. This suggests that for mid-resource languages, the bottleneck is often the training recipe, not the parameter count.
- Normalization is Critical: Without the text normalizer, the model failed to correctly synthesize 100% of test sentences containing digits. With it, success jumped to 89.5%.
- The "Continuation" Trap: Many zero-shot TTS models clone voices by "continuing" a prompt. The authors found this leads to instability (loops and skips) with longer references. Switching to "reference-only" mode (conditioning without transcribing the prompt) dropped word error rates from 21.9% to 1.7%.
- Synthetic Teacher-Student Training: Using a large, slow model to generate "perfect" training data for a smaller, faster model is a highly effective strategy for languages where high-quality studio recordings are scarce.
Key Results
- Intelligibility: On the Freya-TR-Eval benchmark, Alania-2 achieved a 1.44% Word Error Rate (WER), a massive improvement over their previous system's 5.99%.
- Throughput: The model can handle 12 concurrent requests per second on a single H200 GPU while staying ahead of real-time.
- Cloning Fidelity: Professional LoRA adapters significantly outperformed instant cloning in speaker similarity, with training taking less than 130 seconds on an A100.
Limitations and Future Work
- Naturalness Metrics: The authors relied on UTMOS22, which is trained on English speech, potentially missing nuances of Turkish prosody.
- Teacher Artifacts: Because 90% of the data is synthetic, Alania-2 occasionally inherits "robotic" high-frequency tones from its teacher model.
- Safety: While professional clones require a live verification phrase, instant clones currently lack a robust "liveness" check, posing a potential risk for misuse.
- Future Directions: The team plans to implement audio watermarking and conduct extensive subjective listening tests with native speakers.
Summary updated