Tagged "consumer-gpu-deployment"
3 articles tagged consumer-gpu-deployment, 13 March 2026 to 30 April 2026. Newest first.
-
How Much "Brain Damage" Can an LLM Tolerate?
Research explores LLM resilience to model degradation, weight pruning, and parameter corruption—critical insights for optimizing models for edge and resource-constrained deployments.
-
VRAM Optimization Technique Cuts Gemma 4 Memory Usage by 3x
A simple llama.cpp parameter adjustment (-np 1) significantly reduces Sliding Window Attention cache VRAM requirements for Gemma 4, enabling deployment on systems with limited GPU memory.
-
How to Install OpenClaw with Ollama (Step-by-Step Tutorial)
A comprehensive tutorial guides users through setting up OpenClaw with Ollama, providing practical instructions for local deployment of reasoning-focused LLM models.