Fish Audio S2 Pro

This first-party Soniqo page documents Fish Audio S2 Pro from the local speech-swift / speech-core implementation. Hugging Face bundles are linked below after the integration notes.

Internal Page First

Landing cards and docs menus now point here first; source model and bundle links remain available from this page.

At a Glance

Model	Fish Audio S2 Pro
Role	Experimental multilingual TTS with raw-reference cloning and style markers
Backend	MLX fp16
Output	44.1 kHz mono PCM
Languages	Multilingual
License	Research / non-commercial bundle; obtain Fish Audio license for commercial exposure
Status	Programmatic runtime; CLI integration is still pending
Source	Fish Audio S2 Pro
Swift product	`FishAudioTTS`
CLI / runtime	Programmatic runtime today; planned speech speak --engine fish-audio

Use

The snippet below mirrors the current speech-swift API or command exposed by the repo.

import FishAudioTTS

let model = try await FishAudioTTSModel.fromPretrained()
let pcm = try await model.generate(
    text: "आज मैं बहुत खुश हूँ। [excited]",
    referenceAudioURL: URL(fileURLWithPath: "reference.wav"),
    referenceText: "नमस्ते, यह संदर्भ आवाज है।"
)

Model Links

Implementation Notes

Download uses the newer explicit byte-weighted file manifest, so progress reflects real transferred bytes across the multi-GB shards.
Control markers include [pause], [emphasis], [laughing], [excited], [angry], [whisper], [screaming], [shouting], [surprised], and [sad].
The runtime generates 10 DAC codebook rows, then decodes generated or reference-conditioned codebooks through FishAudioCodec.
Current tests cover bundle loading, codebook generation, codec encode/decode, Hindi cloning, and ASR round-trip gates.