Tagged "multi-model-deployment"
3 articles tagged multi-model-deployment, 7 March 2026 to 2 May 2026. Newest first.
-
Local LLMs Work Best When You're Not Loyal to Just One
A new analysis reveals that leveraging multiple local models strategically outperforms single-model approaches for diverse inference workloads.
-
Custom GPU Multiplexer Achieves 0.3ms Model Switching on Legacy Hardware
A developer built a custom Linux kernel module that multiplexes six GPUs through a single PCIe slot, enabling model hot-swapping in under 0.3 milliseconds using repurposed Bitcoin mining hardware.
-
Show HN: Asterode – Multi-Model AI App with Memory and Power Features
A new multi-model AI application that combines several LLMs with advanced memory management and performance optimization features for local deployment.