Qwen3 Audio and Vision Support Now Available in llama.cpp
2 min readNearly five months on, this remains current — because Qwen3-Omni-30B-A3B is still the only open-weights omni model there is. Qwen3.5, Qwen3.6 and Qwen3.8 are all text-only families; there is no Qwen3.5-Omni or Qwen3.8-Omni, whatever the SEO pages tell you.
Two corrections to how this reads today: llama.cpp gives you audio and vision input only — speech output (the Talker) is still unimplemented and only at the planning stage. And the GGUFs referenced below landed the day after this was written, not alongside it.
For the working commands, real file sizes, and the open bugs, see Running Qwen3-Omni With Audio and Vision in llama.cpp.
The llama.cpp project has successfully integrated support for Qwen3-Omni and Qwen3-ASR models, enabling both vision and audio input on consumer hardware. Pre-quantized GGUF versions of Qwen3-Omni 30B A3B (Thinking and Instruct variants) are now available, removing compilation barriers for end users.
Qwen3-Omni represents a significant multimodal capability leap—the model can process images, audio, and text simultaneously, competing with frontier proprietary systems. Having native llama.cpp support means users can run these models locally without complex dependency chains or custom builds. The availability of high-quality quantized versions further democratizes access.
This positions local practitioners to build sophisticated applications with vision, audio, and text reasoning entirely on-device. Real-world use cases span accessibility features, real-time video analysis, voice interaction, and privacy-preserving document processing—all now feasible without cloud infrastructure.
Source: r/LocalLLaMA · Relevance: 9/10