Tagged "local-llm-serving"
5 articles tagged local-llm-serving, 26 February 2026 to 12 August 2026. Newest first.
-
vLLM v0.27.0 Brings Major Performance Improvements and New Model Support
vLLM v0.27.0 features 561 commits from 242 contributors including full-stack Kimi K3 support, new kernel optimizations, and DeepGEMM integration. This release significantly improves inference performance for local LLM serving.
-
Ollama Secures $65M Series B Funding to Grow its Open-source AI Platform
Ollama raises $65 million in Series B funding to accelerate development of its open-source local LLM platform, signaling strong investor confidence in the on-device AI deployment market.
-
LM Studio 0.4 Introduces Headless Deployment for Local LLM APIs
LM Studio 0.4 adds headless mode enabling local LLM serving without the GUI, expanding deployment flexibility for production and edge scenarios.
-
Intel LLM-Scaler vLLM 0.14.0 Released With Official Arc Pro B70 Support
A new vLLM release brings production-ready support for Intel's Arc Pro B70 GPU, enabling optimized batch inference and high-throughput local LLM serving on Intel discrete graphics.
-
LM Studio vs Ollama: Complete Comparison
A detailed comparison of two leading local LLM serving frameworks, examining their strengths, weaknesses, and suitability for different use cases. Helps practitioners choose the right tool for their deployment scenarios.