Tagged "docker-deployment"
12 articles tagged docker-deployment, 28 February 2026 to 9 August 2026. Newest first.
-
llama.cpp Adds Tool Isolation Support via Docker
Recent llama.cpp releases introduce initial tool isolation capabilities through Docker integration, enabling safer execution of AI agent tools in local deployments. Multiple updates improve server infrastructure including working directory handling and improved tool sandboxing.
-
Self-Hosting LLMs Using Ollama and Docker
A practical tutorial on containerized LLM deployment using Ollama and Docker, providing reproducible, scalable infrastructure for running open-source models in self-hosted environments.
-
I Gave a Local LLM Access to My Docker Containers, and It Replaced My Monitoring Scripts
A practical case study demonstrating how local LLMs can be integrated with Docker infrastructure to automate monitoring and system administration tasks traditionally handled by custom scripts.
-
How to Self-Host LibreChat with Docker
A practical guide for deploying LibreChat, an open-source alternative to ChatGPT, using Docker containers. The tutorial provides step-by-step instructions for setting up a local conversational interface against locally-run language models.
-
Deploying Frigate & Ollama On A Minisforum MS-A2 Server
A practical deployment guide demonstrates running Frigate video analytics and Ollama LLM inference simultaneously on compact, low-power edge hardware. This real-world example shows how to combine multiple AI workloads on resource-constrained devices.
-
Building a Local AI Stack: Five Docker Containers to Replace ChatGPT Subscriptions
A practical guide demonstrating how to build a complete local AI infrastructure using five Docker containers, eliminating the need for expensive cloud AI subscriptions while maintaining productivity and feature parity.
-
Build Your Own Local AI Stack with 5 Docker Containers and Eliminate ChatGPT Subscriptions
A practical guide demonstrating how to construct a complete local LLM infrastructure using Docker containers, allowing full control and independence from commercial AI services. This approach provides cost savings and enhanced privacy for production deployments.
-
I Built a Local AI Stack With 5 Docker Containers, and Now I'll Never Pay for ChatGPT Again
Step-by-step guide for containerizing a complete local LLM infrastructure using Docker, eliminating cloud API dependencies while maintaining production-ready deployment patterns.
-
5 Useful Docker Containers for Agentic Developers
KDnuggets has compiled a guide to Docker containers that support local LLM deployment and agentic AI development. These containerized solutions simplify setup, reproducibility, and scaling of inference workloads.
-
Developer Builds Fully Local Multi-Agent System Using vLLM and Parallel Inference
A practical demonstration of running multiple AI agents entirely offline using vLLM for parallel inference orchestration. The setup coordinates 4 concurrent agents for collaborative coding without any cloud provider dependencies.
-
Qwen3.5-397B Achieves 282 tok/s on 4x RTX PRO 6000 Blackwell Through Custom CUTLASS Kernel
A developer achieved a 5x performance improvement on the massive Qwen3.5-397B model by building a custom CUTLASS kernel to fix SM120's broken MoE GEMM tiles, reaching 282 tokens/second on Blackwell GPUs. This breakthrough demonstrates significant optimization potential for running large models locally with multi-GPU setups.
-
5 Useful Docker Containers for Agentic Developers
KDnuggets highlights essential Docker container setups for developers building agentic AI systems, providing practical deployment patterns for local model inference.