Tagged "multimodal-inference"

9 articles tagged multimodal-inference, 3 March 2026 to 3 October 2026. Newest first.

• llama.cpp Adds Support for Decision Models 3 October 2026

  llama.cpp now supports Cloudflare's Clef decision models, expanding local inference capabilities to include multimodal decision-making tasks alongside traditional language generation.

• Ollama v0.35.1 Brings Clef Decision Model Support 3 October 2026

  Ollama 0.35.1 adds native support for Cloudflare's Clef and Clef Flash decision models through the /v1/systemone API, enabling multimodal local inference for decision-making workloads.

• Bringing Vision Capabilities to Local LLMs With Simple Python Implementation 4 September 2026

  Developer adds vision capabilities to a local LLM with a few hundred lines of Python, enabling practical multimodal inference on consumer hardware without cloud dependencies.

• Liquid AI Releases LFM2.5-VL-3B: Compact Vision-Language Model for Edge Inference 14 August 2026

  Liquid AI unveiled LFM2.5-VL-3B, a 3 billion parameter vision-language model designed for on-device deployment with capabilities for screen reading, object grounding, and tool calling without server dependencies.

• Muse Glimmer Now Available on Ollama – Meta's Open Multimodal Agent Model 11 August 2026

  Meta's Muse Glimmer, an open-source multimodal model optimized for local deployment, is now available across all Ollama platforms with state-of-the-art performance on Apple Silicon. The model powers coding agents and long-running personal assistants while maintaining full local inference control.

• Transcribe.cpp – ggml speech-to-text inference engine 1 July 2026

  A new GGML-based speech-to-text inference engine enabling local, on-device transcription without cloud dependencies. This tool extends the ggml ecosystem to multimodal local inference capabilities.

• Audio Processing Support Lands in llama.cpp with Gemma-4 13 April 2026

  llama.cpp now supports speech-to-text functionality with Gemma-4 E2A and E4A models, enabling local multimodal inference on consumer hardware. This expansion brings audio capabilities to the most widely-used local LLM inference engine.

• Real-time Multimodal AI on Apple Silicon: Gemma E2B Demo Shows Practical Edge Deployment 6 April 2026

  A working demonstration of real-time audio/video-to-voice inference using Gemma E2B on Apple M3 Pro hardware showcases the feasibility of running multimodal models locally on consumer devices.

• Qwen 3.5 0.8B Running in Browser with WebGPU via Transformers.js 3 March 2026

  A practical demonstration of running Qwen 3.5's smallest 0.8B multimodal model directly in the browser using WebGPU and Transformers.js, eliminating backend requirements for inference.