Tagged "kernel-fusion"
3 articles tagged kernel-fusion, 17 February 2026 to 14 August 2026. Newest first.
-
Ollama 0.32.10: 7-8% Prefill Speed Gains on NVFP4 Models
Ollama 0.32.10 delivers significant prefill performance improvements for NVFP4 quantized models through kernel fusion optimizations, alongside updated default repeat penalty settings for improved speculative decoding.
-
llama.cpp Improves CUDA Performance with Kernel Fusion
Recent llama.cpp builds optimize CUDA kernel execution through operator fusion, combining rms_norm, multiplication, and rope operations into single kernels. This reduces memory bandwidth overhead and improves inference speed on NVIDIA GPUs.
-
Qwen3-Next 80B MoE Achieves 39 Tokens/Second on RTX 5070/5060 Ti Dual-GPU Setup
A community member has optimised Qwen3-Next 80B mixture-of-experts to run at 39 tokens/second on dual RTX 50-series GPUs with 32GB total VRAM, sharing previously undiscovered configuration solutions for consumer-grade hardware.