Tagged "vllm-inference"
7 articles tagged vllm-inference, 11 February 2026 to 22 May 2026. Newest first.
-
Deploying Hermes Agent for Free on AMD Developer Cloud with Open Models and vLLM
AMD and the open-source community demonstrate practical deployment of sophisticated agents using vLLM on AMD hardware, showcasing free compute access for local AI development.
-
DGX Spark Setup Guide: Running vLLM and PyTorch for Local LLM Inference Backend
A developer details their setup process for NVIDIA DGX Spark hardware running vLLM with Hugging Face models as a local API backend for education and analytics applications while maintaining privacy.
-
5 Useful Docker Containers for Agentic Developers
KDnuggets has compiled a guide to Docker containers that support local LLM deployment and agentic AI development. These containerized solutions simplify setup, reproducibility, and scaling of inference workloads.
-
Developer Builds Fully Local Multi-Agent System Using vLLM and Parallel Inference
A practical demonstration of running multiple AI agents entirely offline using vLLM for parallel inference orchestration. The setup coordinates 4 concurrent agents for collaborative coding without any cloud provider dependencies.
-
OpenClaw with vLLM Running for Free on AMD Developer Cloud
AMD launches free cloud access to run OpenClaw and vLLM inference workloads, providing developers with no-cost GPU resources for local LLM development.
-
Heaps Do Lie: Debugging a Memory Leak in vLLM
Mistral AI engineers share detailed technical insights into identifying and fixing a critical memory leak in vLLM inference engine.
-
Mistral AI Debugs Critical Memory Leak in vLLM Inference Engine
Mistral AI's engineering team shares their process for identifying and fixing a significant memory leak in vLLM that was affecting production deployments.