LocalVQE v1.4-AEC
Diese Soniqo-Seite dokumentiert LocalVQE v1.4-AEC aus der lokalen speech-swift-Implementierung. Hugging-Face-Bundles sind nach den Integrationshinweisen verlinkt.
Zuerst interne Seite
Landing-Karten und Docs-Menüs führen zuerst hierher; Quellen- und Bundle-Links bleiben auf dieser Seite verfügbar.
Überblick
| Modell | LocalVQE v1.4-AEC |
|---|---|
| Rolle | Explicit-reference acoustic echo cancellation |
| Backend | Native C++ adaptive filter plus stateful Core ML residual mask |
| Ausgabe | 16 kHz mono Float32 clean-microphone PCM |
| Sprachen | Language-independent acoustic processing |
| Lizenz | Apache-2.0 code and weights |
| Status | Streaming and complete-clip speech-swift runtime |
| Quelle | LocalVQE |
| Swift-Produkt | SpeechEnhancement |
| CLI / Laufzeit | Programmatic LocalVQEEchoCanceller runtime |
Verwendung
Das folgende Snippet entspricht der aktuellen API oder dem aktuellen Befehl aus speech-swift.
import SpeechEnhancement
let aec = try await LocalVQEEchoCanceller.fromPretrained()
let cleanMicrophone = try aec.processFrame(
microphone: microphoneFrame,
reference: playbackReferenceFrame
)
Modelllinks
Implementierungsnotizen
- Microphone and playback reference are separate, synchronized inputs; a mixed system-audio transcript is not a valid reference.
- Streaming accepts exactly 256 mono samples per input at 16 kHz and adds one 16 ms spectral hop of algorithmic latency.
- Reset after dropped frames, device changes, capture restarts, or recording boundaries so stale filter and neural state cannot cross discontinuities.
- A silent reference preserves microphone-only speech; the runtime never falls back to subtracting a mix or muting the microphone.
- Do not blindly cascade this path with Apple Voice Processing I/O because two adaptive cancellers can distort near-end speech.