Tagged "fathom-journal"
4 articles tagged fathom-journal, 5 April 2026 to 11 May 2026. Newest first.
-
Deploying Frigate & Ollama On A Minisforum MS-A2 Server
A practical deployment guide demonstrates running Frigate video analytics and Ollama LLM inference simultaneously on compact, low-power edge hardware. This real-world example shows how to combine multiple AI workloads on resource-constrained devices.
-
LiteLLM Integrates with Ollama to Simplify Running 100+ Models Locally
LiteLLM now supports seamless integration with Ollama, enabling developers to run over 100 different LLMs locally without requiring code changes across different model implementations. This abstraction layer significantly reduces deployment complexity and standardizes the local inference workflow.
-
TurboQuant in Llama.cpp Achieves 6X Smaller KV Cache
A new implementation of TurboQuant in llama.cpp reduces KV cache size by 6x, significantly improving memory efficiency for local LLM inference. This breakthrough enables running larger models on resource-constrained devices.
-
Run AutoGEN with Ollama and LiteLLM in Simple Steps
A practical guide demonstrates how to integrate AutoGEN multi-agent systems with Ollama and LiteLLM for local LLM-powered agent frameworks. This tutorial bridges agent orchestration with local inference infrastructure.