F5-TTS
यह Soniqo पेज स्थानीय speech-swift / speech-core implementation में F5-TTS को दस्तावेज़ करता है। Hugging Face bundle links integration notes के बाद दिए गए हैं।
पहले आंतरिक पेज
Landing cards और docs menus पहले इसी पेज पर आते हैं; source model और bundle links यहीं उपलब्ध रहते हैं।
सारांश
| मॉडल | F5-TTS |
|---|---|
| भूमिका | Zero-shot voice cloning from a short reference plus transcript |
| Backend | MLX fp16 |
| Output | 24 kHz mono waveform |
| भाषाएँ | English and Mandarin, mixed EN/ZH supported |
| लाइसेंस | CC-BY-NC-4.0 weights; non-commercial bundle |
| स्थिति | Ready through speech speak --engine f5 and the F5TTS Swift product |
| Source | SWivid F5-TTS |
| Swift product | F5TTS |
| CLI / runtime | speech speak --engine f5 |
उपयोग
नीचे का snippet मौजूदा speech-swift API या command से मेल खाता है।
# Clone a voice from a ~10 s reference clip plus its transcript.
.build/release/speech speak "Hello from my cloned voice." \
--engine f5 \
--voice-sample reference.wav \
--f5-reference-text "Text spoken in the reference clip." \
-o cloned.wavमॉडल लिंक
implementation notes
- 16 flow steps are the default (RTF 0.57 on an M5 Pro, lower is faster); --f5-steps 32 for maximum fidelity, 12 runs at RTF 0.43 — ASR roundtrips are word-identical across all three.
- --f5-reference-text is required: cloning conditions on the reference transcript, and quality tracks how cleanly the reference clip ends on a sentence boundary.
- Mandarin runs through a bundled pinyin lexicon with tone sandhi baked in at export time (99.2% token-exact against the upstream rjieba/pypinyin frontend), so Swift needs no external tokenizer.
- Deterministic per --f5-seed; --f5-speed scales pacing, CFG strength and sway sampling are exposed as flags; about 0.8 GB peak RSS makes it the smallest cloning engine in the package.