Tagged "geeky-gadgets"
4 articles tagged geeky-gadgets, 15 April 2026 to 18 July 2026. Newest first.
-
Host Private Local AI on NVIDIA DGX Spark Using Ollama and Open WebUI
A technical deep-dive on deploying private LLM infrastructure using NVIDIA's hardware with Ollama and Open WebUI for complete control and data privacy. Ideal for enterprises managing sensitive workloads.
-
Ollama Runs 32B Local AI Models on a $599 Mac via Quantization for Free
A breakthrough demonstration of running large 32-billion parameter models efficiently on consumer Mac hardware through quantization, proving that sophisticated local inference is now accessible on modest hardware.
-
Running a Local LLM on a 12-Year-Old Raspberry Pi: Practical Edge Inference
A practical guide demonstrates running local LLMs on ancient hardware like a 12-year-old Raspberry Pi, showcasing the efficiency improvements in modern inference frameworks.
-
Google's Gemma 4 Brings Game-Changing Performance to Local Laptop Inference
Google and NVIDIA collaborate to optimize Gemma 4 for on-device laptop deployment, enabling efficient local inference without cloud dependencies. This advancement demonstrates significant progress in making capable language models accessible for personal computing.