Tagged "kubernetes"
6 articles tagged kubernetes, 11 March 2026 to 29 July 2026. Newest first.
-
Triton Control: Open-Source Control Plane for Nvidia Triton on Kubernetes
A new open-source project providing a control plane for managing Nvidia Triton Inference Server deployments on Kubernetes, streamlining multi-model serving infrastructure.
-
Open-Weight AI on Kubernetes: Comparing vLLM and KubeAI for Local Deployment
A comprehensive guide examines vLLM and KubeAI as competing solutions for deploying open-weight models on Kubernetes clusters, helping teams choose the right inference framework for self-hosted LLM workloads.
-
Build Self-Scaling OCR Pipeline with Qwen 3.5 and Kubernetes
A production-ready course demonstrates deploying Qwen 3.5 for OCR workloads with Kubernetes auto-scaling, bridging the gap between local inference and distributed edge deployment.
-
Open-Source AI on OCI: Serving LLMs on Kubernetes with vLLM, Qdrant, and Terraform
Oracle publishes a comprehensive guide for deploying open-source LLMs on Kubernetes clusters using vLLM for inference optimization, Qdrant for vector search, and Terraform for infrastructure as code. This practical approach enables scalable self-hosted LLM deployments on enterprise infrastructure.
-
NVIDIA Dynamo Snapshot Accelerates AI Inference Startup on Kubernetes
NVIDIA AI has released Dynamo Snapshot, a CRIU-based fast startup system that dramatically reduces cold-start latency for AI inference workloads deployed on Kubernetes clusters.
-
A Kubernetes Operator That Orchestrates AI Coding Agents
A new Kubernetes operator enables orchestration of AI coding agents for planning, coding, review, and shipping—providing infrastructure for deploying multi-agent AI systems at scale in self-hosted environments.