Tagged "cuda"
6 articles tagged cuda, 12 March 2026 to 15 September 2026. Newest first.
-
llama.cpp b10977 advances CUDA Windows builds and platform support
The latest llama.cpp release bumps CUDA Windows x64 builds to version 13.4.1 and continues expanding cross-platform compatibility for the high-performance inference engine.
-
NVIDIA Local AI Optimization Delivers 1.9x Speedup on 24GB RTX GPUs
NVIDIA has announced performance optimizations for local AI inference on RTX GPUs with 24GB+ VRAM, achieving 1.9x speed improvements that rival cloud API latency and economics, making consumer hardware increasingly viable for production local LLM deployment.
-
AMD ROCm 10 Arrives With ROCm.AI GA: Hyperloom Agents and 3.3x Inference Lift
AMD's ROCm 10 platform introduces ROCm.AI general availability with claimed 3.3x inference performance improvements and new agent frameworks, expanding GPU options for local LLM deployment beyond NVIDIA.
-
llama.cpp Build b10301: CUDA Optimization and Compiler Warning Fixes
The latest llama.cpp release fixes CUDA compiler warnings for unused variables and functions, continuing the project's focus on production-grade optimization and cross-platform stability. Releases continue at a rapid pace with incremental improvements to inference performance and hardware support.
-
AMD's Lemonade SDK Adds NVIDIA CUDA Support for Cross-Platform Local AI
AMD expands the Lemonade SDK with CUDA support, enabling local AI developers to run models efficiently across both AMD and NVIDIA hardware. This cross-platform capability accelerates adoption.
-
Cutile.jl Brings Nvidia CUDA Tile-Based Programming to Julia
Cutile.jl enables tile-based CUDA programming in Julia, offering improved GPU utilization and performance optimization capabilities for compute-intensive workloads including LLM inference.