Tagged "model-inference"
3 articles tagged model-inference, 21 February 2026 to 13 April 2026. Newest first.
-
Build a Sovereign Local AI Stack: Ollama and Open WebUI and Pgvector 2026
A comprehensive guide to building a complete local AI infrastructure using Ollama for model serving, Open WebUI for the interface, and Pgvector for vector database capabilities. This stack enables fully self-hosted AI applications without cloud dependencies.
-
Orca – Executable skills and capabilities for AI agent workflows
New framework for building modular executable skills and capabilities for AI agents, enabling local deployment of agent-based systems with composable components.
-
[Release] Ouro-2.6B-Thinking: ByteDance's Recurrent Model Now Runnable Locally
ByteDance's novel recurrent Universal Transformer architecture (Ouro-2.6B-Thinking) is now functional for local inference after fixes for transformers 4.55, enabling access to a unique thinking-focused model on consumer hardware.