Tagged "llama-cpp-integration"

7 articles tagged llama-cpp-integration, 14 February 2026 to 23 April 2026. Newest first.

• Intel OpenVINO 2026.1 Integrates llama.cpp with Wildcat Lake and Arc Pro B70 23 April 2026

  Intel's latest OpenVINO release brings native llama.cpp integration with support for the new Wildcat Lake processors and Arc Pro B70 GPUs, significantly expanding local inference capabilities on Intel hardware.

• Speculative Decoding Achieves 29% Speed Boost for Gemma-4 31B 13 April 2026

  Benchmarks show speculative decoding with Gemma-4 E2B draft model delivers 29% average throughput improvement and 50% gains on code tasks. This practical optimization technique significantly accelerates local inference on consumer GPUs.

• Qwen3 Audio and Vision Support Now Available in llama.cpp 13 April 2026

  Qwen3-Omni and Qwen3-ASR models now run natively in llama.cpp with full audio and vision input support. This enables truly multimodal local inference with Alibaba's frontier-competitive model architecture.

• Intel Releases OpenVINO 2026.1 With Backend For Llama.cpp, New Hardware Support 9 April 2026

  Intel's latest OpenVINO release adds native llama.cpp backend support and expands hardware compatibility, enabling optimized local LLM inference across Intel CPUs and Arc GPUs.

• PaddleOCR-VL Now Integrated into llama.cpp for Multilingual OCR 20 February 2026

  PaddleOCR-VL, a 900M parameter multilingual OCR model, has been integrated into llama.cpp, providing open-source optical character recognition capabilities for local LLM workflows. This addition enables fully local document processing pipelines without cloud dependencies.

• Qwen 3.5-397B-A17B Now Available for Local Inference with Aggressive Quantisation 17 February 2026

  Alibaba's Qwen 3.5-397B mixture-of-experts model is now available on HuggingFace with multiple quantisation options, including a 113GB IQ2_XS variant that fits on consumer hardware. Early benchmarks show performance competitive with Gemini 3 Pro and GPT-5.2 on spatial reasoning tasks.

• GNOME's AI Assistant Newelle Adds llama.cpp Support and Command Execution 14 February 2026

  The open-source GNOME AI assistant Newelle now integrates directly with llama.cpp for local inference and includes new command execution capabilities for system automation.