Tagged "ggml"

8 articles tagged ggml, 21 February 2026 to 24 September 2026. Newest first.

• Llama.cpp v0.5.0: Backend Performance, Broader Model Support, and Robust Server Operations 24 September 2026

  The v0.5.0 release of llama.cpp brings significant improvements to backend performance, adds support for additional model architectures, and enhances the HTTP server for production deployment scenarios.

• Per-Tensor Layout Maps for GGUF Quantization 14 September 2026

  A new quantization optimization technique for GGUF models that enables per-tensor layout customization, improving inference performance and memory efficiency across diverse hardware targets.

• llama.cpp 0.4.0: Qwen3.8-Flash-Next and On-Demand Tensor Reading 6 September 2026

  The latest llama.cpp release introduces support for Qwen3.8-Flash-Next models, on-demand tensor reading, per-slot server context limits, and sparse flash attention improvements.

• llama.cpp 0.4.0 Released with Sparse Flash Attention and RDMA Support 5 September 2026

  llama.cpp 0.4.0 introduces major performance improvements including sparse flash attention, RDMA support, Qwen3.8-Flash-Next support, on-demand tensor reading, and upgraded GGML 0.23.0, enabling more efficient local inference at scale.

• Transcribe.cpp – ggml speech-to-text inference engine 1 July 2026

  A new GGML-based speech-to-text inference engine enabling local, on-device transcription without cloud dependencies. This tool extends the ggml ecosystem to multimodal local inference capabilities.

• The Complete Stack for Local Autonomous Agents: From GGML to Orchestration 23 February 2026

  A comprehensive guide to building autonomous agent systems entirely on local hardware, covering quantisation with GGML through deployment orchestration. This resource addresses the full pipeline needed for production local agent deployment.

• GGML Joins Hugging Face: What This Means for Local Model Optimization 22 February 2026

  GGML, the foundational library for efficient local LLM inference, joins Hugging Face, promising deeper integration and optimization capabilities for edge deployment.

• Open-Source + AI: ggml Joins Hugging Face, llama.cpp Stays Open—Local AI's Long-Term Home 21 February 2026

  ggml, the foundational library powering llama.cpp and other local inference tools, joins Hugging Face while maintaining its open-source commitment, securing the future of the local LLM ecosystem.