Tagged "containerization"
14 articles tagged containerization, 27 February 2026 to 8 July 2026. Newest first.
-
Self-Hosting LLMs Using Ollama and Docker
A practical tutorial on containerized LLM deployment using Ollama and Docker, providing reproducible, scalable infrastructure for running open-source models in self-hosted environments.
-
code-on-incus: Isolated Machine Environments for AI Agents
A new tool that provisions isolated container environments with root access for each AI agent, enabling safer sandboxed execution of agent code on local infrastructure. This addresses a critical security concern for deploying autonomous AI systems locally.
-
Running AI Locally, Part 2: From VMware Context to Hands-On Tools
The second installment in a series covering practical approaches to running AI workloads locally, including virtualization context and hands-on tooling recommendations for self-hosted inference.
-
Why Your Docker Container Is 1.2GB When It Should Be 80MB
Practical guide to dramatically reducing Docker container sizes for AI applications, with techniques directly applicable to containerized local LLM deployments.
-
How to Self-Host LibreChat with Docker
A practical guide for deploying LibreChat, an open-source alternative to ChatGPT, using Docker containers. The tutorial provides step-by-step instructions for setting up a local conversational interface against locally-run language models.
-
Show HN: Minimal Linux Sandboxes to Manage AI-Generated Code with Ease
A new open-source tool for sandboxing and safely executing AI-generated code in minimal Linux environments, enabling secure local agent deployment.
-
Build Your Own Local AI Stack with 5 Docker Containers and Eliminate ChatGPT Subscriptions
A practical guide demonstrating how to construct a complete local LLM infrastructure using Docker containers, allowing full control and independence from commercial AI services. This approach provides cost savings and enhanced privacy for production deployments.
-
I Built a Local AI Stack with 5 Docker Containers, and Now I'll Never Pay for ChatGPT Again
A practical guide demonstrating how to assemble a complete local AI stack using five Docker containers, eliminating dependency on cloud API services. This showcases end-to-end self-hosted LLM infrastructure design.
-
We Built a Local Model Arena in 30 Minutes — Infrastructure Mattered More Than the App
HackerNoon shares insights from building a local model comparison platform, revealing that infrastructure decisions significantly impact performance and usability in local LLM deployments. The piece highlights practical deployment patterns for benchmarking multiple models efficiently.
-
GPU Passthrough to LXCs in Proxmox Simplifies Local Inference Infrastructure
System administrators discover that GPU passthrough to Linux containers in Proxmox offers simpler and more efficient deployment for local LLM inference compared to traditional virtual machines. This reduces operational complexity for self-hosted inference setups.
-
5 Useful Docker Containers for Agentic Developers
KDnuggets has compiled a guide to Docker containers that support local LLM deployment and agentic AI development. These containerized solutions simplify setup, reproducibility, and scaling of inference workloads.
-
GPU Passthrough to LXCs in Proxmox Simplifies Local Inference Infrastructure
GPU passthrough to LXC containers in Proxmox offers a simpler and more efficient alternative to virtual machines for local LLM deployment, improving resource utilization and reducing complexity.
-
5 Useful Docker Containers for Agentic Developers
KDnuggets highlights essential Docker container setups for developers building agentic AI systems, providing practical deployment patterns for local model inference.
-
5 Useful Docker Containers for Agentic Developers
A practical resource highlighting Docker containerization strategies specifically designed for developers building agentic AI systems, enabling easier local deployment and experimentation.