Qwen3-ASR vs Whisper on Apple Silicon

Qwen3-ASR and Whisper are both strong local speech-recognition choices, but they optimize for different constraints. This comparison isolates the Qwen and Whisper rows from Soniqo's broader benchmark so accuracy, speed, memory, and implementation trade-offs are easier to evaluate.

Both engines are supported: speech-swift ships Qwen3-ASR through MLX and Whisper Large-v3 Turbo through native Core ML. WhisperKit appears below only as an external benchmark reference.

Quick answer

Across all rows, Qwen3-ASR 1.7B 5-bit has the lowest measured WER at 1.32%, while Qwen3-ASR 0.6B 5-bit has the lowest RTF at 0.014. In the matched 200-utterance Whisper comparison, native WhisperASR is faster: RTF 0.077 versus 0.084 and cached load 1.3 s versus 7.2 s. Accuracy is one word error apart (1.73% versus 1.71% WER), and peak RSS differs by only 18 MB (445 versus 427 MB).

Measured results

RTF is wall time divided by audio duration, so lower is faster. All rows use LibriSpeech test-clean and the same text normalizer; see the methodology caveat below for fixture sizes.

EngineQuant.WER%RTFPeak RSS
Qwen3-ASR 1.7B MLX5-bit1.320.0271.92 GB
Qwen3-ASR 1.7B MLX8-bit1.520.0332.7 GB
Qwen3-ASR 0.6B MLX5-bit1.740.0141.03 GB
Qwen3-ASR 0.6B MLX8-bit1.820.0151.3 GB
WhisperKit Large-v3 TurboFP161.710.084427 MB
WhisperASR native CoreMLFP161.730.077445 MB

Which one should you choose?

Methodology and limits

The benchmark uses LibriSpeech test-clean English read speech on an Apple M5 Pro with release builds. The 8-bit Qwen and Whisper rows use the first 200 utterances (about 30 minutes). The Qwen 5-bit rows use a 100-utterance subset of the same fixture, added when those variants landed.

These numbers compare these implementations on this fixture; they are not a universal multilingual ranking. Accent, noise, long-form segmentation, language mix, decoding settings, and hardware can change the result. WER is lower-is-better, and peak RSS is measured with each engine in a separate process.

Implementation guides and full data