Tagged "kubernetes-orchestration"

4 articles tagged kubernetes-orchestration, 6 June 2026 to 29 July 2026. Newest first.

• Triton Control: Open-Source Control Plane for Nvidia Triton on Kubernetes 29 July 2026

  A new open-source project providing a control plane for managing Nvidia Triton Inference Server deployments on Kubernetes, streamlining multi-model serving infrastructure.

• Build Self-Scaling OCR Pipeline with Qwen 3.5 and Kubernetes 26 July 2026

  A production-ready course demonstrates deploying Qwen 3.5 for OCR workloads with Kubernetes auto-scaling, bridging the gap between local inference and distributed edge deployment.

• Open-Source AI on OCI: Serving LLMs on Kubernetes with vLLM, Qdrant, and Terraform 16 July 2026

  Oracle publishes a comprehensive guide for deploying open-source LLMs on Kubernetes clusters using vLLM for inference optimization, Qdrant for vector search, and Terraform for infrastructure as code. This practical approach enables scalable self-hosted LLM deployments on enterprise infrastructure.

• NVIDIA Dynamo Snapshot Accelerates AI Inference Startup on Kubernetes 6 June 2026

  NVIDIA AI has released Dynamo Snapshot, a CRIU-based fast startup system that dramatically reduces cold-start latency for AI inference workloads deployed on Kubernetes clusters.