Tagged "rocm"
8 articles tagged rocm, 9 March 2026 to 3 September 2026. Newest first.
-
Lemonade 11.9 Local AI Server Released With AMD ROCm HRX Backend
Lemonade AI server reaches version 11.9 with new AMD ROCm HRX backend support, expanding local inference capabilities to AMD GPU hardware and providing an alternative to NVIDIA-focused deployment stacks.
-
AMD ROCm 10 Arrives With ROCm.AI GA: Hyperloom Agents and 3.3x Inference Lift
AMD's ROCm 10 platform introduces ROCm.AI general availability with claimed 3.3x inference performance improvements and new agent frameworks, expanding GPU options for local LLM deployment beyond NVIDIA.
-
Native vLLM and ROCm 7.15 Support for AMD RDNA2 GPUs on Windows
Community developers have released native vLLM integration with ROCm 7.15 for AMD Radeon RX 6000 series GPUs on Windows 11, enabling high-throughput inference at 26 Tflops FP16 on consumer AMD hardware.
-
AMD Adds Day 0 Qwen3.8 Support, Radeon AI PRO R9700 Hits 51.8 Tokens per Second
AMD's Radeon AI PRO GPUs now offer native support for Qwen3.8-27B with impressive throughput of 51.8 tokens per second, enabling practitioners to leverage RDNA architecture for efficient local LLM inference without NVIDIA dependency.
-
AMD's Lemonade SDK Advances macOS Support for Local AI Inference with ROCm 7.13
AMD promotes macOS to general availability status in its Lemonade SDK for AI, integrating ROCm 7.13 to enable GPU-accelerated local LLM inference on Apple Silicon and AMD-powered Macs.
-
ROCm 7.2.3 Delivers Performance Improvements Over 7.0.0 on AMD Radeon AI PRO
Phoronix benchmarks show measurable performance gains with ROCm 7.2.3 compared to version 7.0.0 on AMD's Radeon AI PRO R9700 GPU. The improvements highlight the importance of staying current with driver and runtime updates for optimal local inference performance.
-
ROCm Integration in Ubuntu 26.04 Advances Linux GPU Inference
Ubuntu 26.04 brings improved ROCm support, enhancing AMD GPU acceleration for local LLM inference on Linux systems. This integration simplifies GPU-accelerated deployment on AMD hardware.
-
Strix Halo (Ryzen AI Max+ 395) Achieves Strong Local Inference Performance with ROCm 7.2
New benchmarks on AMD's Strix Halo platform with ROCm 7.2 backend show practical inference speeds for the Qwen 3.5 model family, with recent llama.cpp optimisations delivering measurable performance gains.