Tagged "cpu-optimization"
7 articles tagged cpu-optimization, 14 March 2026 to 16 October 2026. Newest first.
-
llama.cpp Releases Performance Improvements: CPU Optimization and AVX2 Enhancements
Recent llama.cpp releases (b11688 and others) deliver CPU-level performance optimizations, including AVX2 tiled accumulator improvements. These optimizations make inference faster on standard CPU hardware, expanding local deployment viability.
-
llama.cpp's 4.26× Intel Gain Has a Narrow Catch
Recent optimizations in llama.cpp for Intel processors show significant inference speedups, though with important caveats about hardware requirements and real-world applicability. The community discusses the practical implications of these performance improvements for local deployment.
-
Developer Switches from LM Studio to llama.cpp, Reports No Performance Downgrade
A developer shares their experience migrating from LM Studio to llama.cpp for local LLM inference, finding the lighter-weight tool delivers comparable performance with better resource efficiency.
-
AI Agent Designs a RISC-V CPU Core from Scratch
An AI agent has successfully designed a complete RISC-V CPU core autonomously, demonstrating advanced reasoning capabilities and opening new possibilities for hardware optimization tailored to local LLM inference.
-
ASUS ExpertCenter PN55 Mini PC Combines AMD AI CPU and 55 TOPS NPU
ASUS launches a ruggedized industrial mini PC featuring AMD's latest AI-optimized CPU and a dedicated 55 TOPS NPU, purpose-built for on-device inference deployments in demanding environments.
-
I made Karpathy's Autoresearch work on CPU
A developer successfully optimized Karpathy's Autoresearch project to run on CPU-only systems, removing GPU dependency. This breakthrough makes advanced research automation accessible to users without GPU hardware.
-
Intel OpenVINO Backend Support Now Available in llama.cpp
Intel's team has contributed OpenVINO backend support to llama.cpp, enabling optimized local LLM inference on Intel CPUs and compatible hardware platforms.