Voxtral Mini 3B 2507

Esta página da Soniqo documenta Voxtral Mini 3B 2507 conforme a implementação local em speech-swift / speech-core. Os links do Hugging Face ficam abaixo das notas de integração.

Página interna primeiro

Cards e menus apontam primeiro para cá; os links do modelo fonte e dos bundles continuam disponíveis nesta página.

Visão geral

Modelo	Voxtral Mini 3B 2507
Papel	High-accuracy multilingual offline speech-to-text
Backend	Native MLX on Apple Silicon
Saída	Plain-text transcription
Idiomas	English, French, German, Spanish, Italian, Portuguese, Dutch, and Hindi
Licença	Apache-2.0
Status	Published FP16, INT5, and INT8 bundles; INT5 is the default
Fonte	Mistral Voxtral Mini 3B 2507
Produto Swift	`VoxtralASR`
CLI / runtime	`speech transcribe --engine voxtral`

Uso

O trecho abaixo reflete a API ou comando atual exposto por speech-swift.

# INT5 is the default.
speech transcribe recording.wav --engine voxtral

# Select another published precision and pass a language hint.
speech transcribe recording.wav --engine voxtral --model int8 --language fr

Links do modelo

Notas de implementação

The audio frontend resamples mono Float32 PCM to 16 kHz and packs up to 30 seconds of audio per request.
INT5 is the default: on the validated English FLEURS run it used a 3.77 GiB bundle, 6,012 MiB physical footprint, and 0.0739 mean RTF.
The decoder projects only the final prompt state through the 131,072-token language-model head, reducing quantized-model RTF without changing transcripts.
MLX has no INT7 affine kernel; use INT8 as the supported higher-quality option.
This is a non-streaming engine. Benchmark results cover English read speech, not conversational or speaker-heavy audio.