Tagged "exllama"
5 articles tagged exllama, 15 March 2026 to 15 June 2026. Newest first.
-
Most People Use Ollama or llama.cpp for Local LLMs, but These Are the Tools I Switch to When It Gets Serious
An experienced practitioner compares advanced local LLM deployment tools beyond the popular Ollama and llama.cpp, highlighting specialized frameworks for production scenarios.
-
GPU Memory for LLM Inference (Part 1)
A detailed technical guide exploring GPU memory optimization strategies for running large language models efficiently during inference, critical knowledge for anyone deploying LLMs locally with limited VRAM.
-
GPUs vs. TPUs: Decoding the Powerhouses of AI
A comprehensive comparison of GPU and TPU architectures for AI workloads, examining trade-offs between general-purpose graphics processors and tensor-optimized units for local and edge LLM deployment scenarios.
-
Local AI Ecosystem Extends Far Beyond Ollama
A comprehensive look at the broader tooling and framework landscape for local LLM deployment, highlighting alternatives and complementary tools beyond Ollama for various deployment scenarios.
-
AMD Launches Agent System Optimized for Local AI Inference With Ryzen and Radeon
AMD announces a new integrated system designed specifically for local AI workloads, combining Ryzen CPUs with Radeon GPU acceleration for efficient inference.