Tagged "inference-acceleration"

5 articles tagged inference-acceleration, 3 April 2026 to 28 August 2026. Newest first.

• Ollama v0.33.1 Adds Qwen3.8-Flash-Next Support via MLX Backend 28 August 2026

  Ollama's latest release includes native Qwen3.8-Flash-Next support through its MLX backend, along with structured output capabilities and Metal GPU optimizations for macOS users.

• Google Releases Gemma 4 12B Model for Local Inference on 16GB Enterprise Laptops 5 June 2026

  Google has released Gemma 4 12B, a new model optimized for on-device deployment on enterprise laptops with 16GB of RAM. This release demonstrates Google's commitment to making capable open-source models accessible for local inference without requiring high-end hardware.

• Google Releases Gemma 4 Multi-Token Prediction Drafters To Accelerate AI Inference 8 May 2026

  Google has released new multi-token prediction drafters for Gemma 4, providing significant inference acceleration capabilities for local LLM deployment. This optimization technique enables faster token generation while maintaining output quality.

• ASUS Malaysia to Bring UGen300 USB AI Accelerator in Q2 for Portable On-Device AI Inferencing 13 April 2026

  ASUS is launching the UGen300 USB AI accelerator in Q2, enabling portable and efficient on-device AI inference. This hardware advancement addresses the growing need for edge AI computing without reliance on cloud infrastructure.

• NVIDIA Accelerates Gemma 4 for Local Agentic AI on RTX GPUs 3 April 2026

  NVIDIA provides day-one optimizations for Google's Gemma 4 models across its RTX GPU lineup, enabling accelerated local inference for agentic AI workflows on consumer and enterprise graphics cards.