Tagged "rtx-3090"
3 articles tagged rtx-3090, 11 February 2026 to 15 November 2026. Newest first.
-
Llama.cpp v1.0 Achieves 55% Speed Improvement with Speculative Decoding on RTX 3090
Benchmarks show llama.cpp v1.0 delivers up to 55% faster inference using speculative decoding on NVIDIA RTX 3090 GPUs, demonstrating significant performance gains for consumer-grade local deployment.
-
Qwen3.8-Flash-Next Non-Uniform Quantization Runs on Dual RTX3090s
Qwen3.8-Flash-Next achieves efficient local deployment through non-uniform quantization (GSQ-RCO), enabling the model to run on two consumer-grade RTX3090 GPUs.
-
Community Member Builds 144GB VRAM Local LLM Powerhouse
A LocalLLaMA community member showcases a custom-built system with 6x RTX 3090 GPUs providing 144GB of VRAM, featuring modified drivers with P2P support for high-performance local LLM inference.