Local AI, 16 Nov – 22 Nov 2026

9 posts · All weeks

The release of llama.cpp 1.0.0, with a 55% speed boost on RTX 3090 via speculative decoding, dominated the week, alongside Ollama 0.40.17’s Vulkan GPU enhancements and vLLM 0.34.0’s extensible KV cache supporting Mistral Large 4.

Don’t miss the benchmark guide “Best Local AI Models for 24GB VRAM and 24GB Macs Tested and Benchmarked” and the “Efficient Frontier of LLM Inference” deep‑dive.

Tuesday, 17 November 2026

Llama.cpp hits 1.0.0 with a stable API, while Ollama 0.40.17 adds Vulkan GPU and mmap support.

Monday, 16 November 2026

llama.cpp v1.0 hits release, delivering 55% faster RTX 3090 inference via speculative decoding.