Tagged "multi-model-inference"
5 articles tagged multi-model-inference, 6 March 2026 to 7 October 2026. Newest first.
-
GridCore: A GPU Scheduler for Running Multiple Local LLMs on One GPU
GridCore is a new scheduler that enables multiple local LLMs to share a single GPU efficiently. This tool addresses a critical constraint for local deployment: allowing developers to run multiple models simultaneously without requiring multiple GPUs.
-
Satcove – Query 5 AI Models Simultaneously and Get Structured Verdicts
Satcove enables querying multiple AI models in parallel and consolidating their outputs into a single structured verdict. This approach addresses reliability and consistency concerns when running inference with multiple local or cloud models for critical decision-making applications.
-
Powerful AI Search Engine Built on Single GeForce RTX 5090
An enthusiast successfully deployed a fully-featured AI search engine on a single GeForce RTX 5090 GPU, demonstrating the viability of complex local inference workloads on consumer hardware.
-
Show HN: Asterode – Multi-Model AI App with Memory and Power Features
A new multi-model AI application that combines several LLMs with advanced memory management and performance optimization features for local deployment.
-
llama-swap Emerges as Superior Alternative to Ollama and LM-Studio
Community members report that llama-swap provides significantly better model switching and multi-model serving compared to established tools like Ollama and LM-Studio. Early adopters highlight breakthrough improvements in model management workflows.