Tagged "model-compatibility"
9 articles tagged model-compatibility, 14 February 2026 to 24 September 2026. Newest first.
-
Llama.cpp v0.5.0: Backend Performance, Broader Model Support, and Robust Server Operations
The v0.5.0 release of llama.cpp brings significant improvements to backend performance, adds support for additional model architectures, and enhances the HTTP server for production deployment scenarios.
-
llama.cpp Adds CUDA Pool Operations Support
llama.cpp release b10589 introduces 1D pooling support for CUDA, expanding the inference runtime's capability to handle more complex model architectures on NVIDIA hardware.
-
Intel llm-scaler-vllm 1.4 Released With Updated Components and Arc Pro B70 Support
Intel releases version 1.4 of its llm-scaler-vllm toolkit with improved components and support for Arc Pro B70 GPUs, enabling optimized local LLM inference on Intel hardware.
-
Show HN: Willitrun – Check if Any ML Model Runs on Any Device (Benchmark-Backed)
Willitrun is a new tool that helps developers determine whether specific machine learning models can run on particular devices, backed by real benchmarking data to guide local deployment decisions.
-
Llama.cpp Merges Automatic Parser Generator to Mainline
After months of testing, llama.cpp has merged its new automatic parser generator solution into the main codebase, building on improved Jinja templating and native parsing infrastructure. This enhancement streamlines model deployment and reduces manual configuration overhead for local inference.
-
Critical: Qwen 3.5 Requires BF16 KV Cache, Not FP16 for Accurate Inference
Community member Daniel Han alerts users that Qwen 3.5 models require bfloat16 KV cache precision instead of the default float16, with perplexity measurements demonstrating the accuracy impact when using incorrect cache formats.
-
[Release] Ouro-2.6B-Thinking: ByteDance's Recurrent Model Now Runnable Locally
ByteDance's novel recurrent Universal Transformer architecture (Ouro-2.6B-Thinking) is now functional for local inference after fixes for transformers 4.55, enabling access to a unique thinking-focused model on consumer hardware.
-
AMD Announces Day 0 Support for Qwen 3.5 LLM on Instinct GPUs
AMD has enabled immediate support for the Qwen 3.5 model on its Instinct GPU lineup, providing optimized inference performance for local deployments on AMD hardware accelerators.
-
ByteDance Releases Seed2.0 LLM with Complex Real-World Task Improvements
ByteDance announces Seed2.0, an updated language model claiming breakthrough performance on complex real-world tasks, though local deployment details remain unclear.