Tagged "home-lab"
5 articles tagged home-lab, 11 February 2026 to 29 July 2026. Newest first.
-
Gemma 4's Quantized Models Finally Made Local AI Practical in Homelab
Google's Gemma 4 quantized models have reached a performance-to-resource ratio that makes local AI deployment genuinely practical for homelab enthusiasts. The breakthrough demonstrates how recent quantization advances are lowering barriers to self-hosted inference.
-
Converting a Home Server Into a Production AI Appliance
A practical case study documenting the software stack and architectural decisions that made a home server viable for running AI workloads at scale, providing actionable insights for self-hosted deployments.
-
Homelab Consolidation: Replacing 3 Models with Single 122B MoE Model on AMD Ryzen AI MAX+
A homelabber consolidated their inference setup from three separate models down to a single 122B mixture-of-experts model on consumer hardware (Ryzen AI MAX+ 395 with 128GB RAM), providing detailed benchmarks and practical insights on model consolidation strategy.
-
Complete Offline AI System: Voice Control and Smart Home via Local LLM and Radio Without Internet
A developer in Ukraine built a fully offline AI assistant using a Mac mini, local LLMs, and a $30 radio module, enabling smart home control and voice messaging without internet connectivity during power outages.
-
Community Member Builds 144GB VRAM Local LLM Powerhouse
A LocalLLaMA community member showcases a custom-built system with 6x RTX 3090 GPUs providing 144GB of VRAM, featuring modified drivers with P2P support for high-performance local LLM inference.