Tagged "cuda-optimization"
3 articles tagged cuda-optimization, 22 March 2026 to 11 November 2026. Newest first.
-
llama.cpp Adds FP8 Quantisation Support for CUDA
llama.cpp releases major update adding FP8 (8-bit floating point) quantisation support with CUDA optimization, reducing model memory footprint while maintaining inference quality.
-
llama.cpp Build b10301: CUDA Optimization and Compiler Warning Fixes
The latest llama.cpp release fixes CUDA compiler warnings for unused variables and functions, continuing the project's focus on production-grade optimization and cross-platform stability. Releases continue at a rapid pace with incremental improvements to inference performance and hardware support.
-
Nvidia Nemotron Cascade 2 30B Emerges as Powerful Alternative to Qwen Models
Nvidia's newest Nemotron Cascade 2 30B model offers a distinct non-Qwen architecture option for local deployment with competitive performance characteristics. Early community testing suggests this model deserves attention alongside the popular Qwen family.