Tagged "gpu-performance"
4 articles tagged gpu-performance, 25 March 2026 to 29 May 2026. Newest first.
-
Real-time LLM Inference on Standard GPUs: 3k tokens/s per request
A breakthrough in LLM inference optimization achieves 3,000 tokens per second on standard GPUs, significantly improving real-time inference performance for local deployments.
-
Intel OpenVINO 2026.1 Integrates llama.cpp with Wildcat Lake and Arc Pro B70
Intel's latest OpenVINO release brings native llama.cpp integration with support for the new Wildcat Lake processors and Arc Pro B70 GPUs, significantly expanding local inference capabilities on Intel hardware.
-
Samsung Launches Galaxy Book6 Series in India with NVIDIA RTX 5070 Graphics and On-Device AI
Samsung's new Galaxy Book6 line features NVIDIA RTX 5070 graphics and dedicated on-device AI capabilities, representing advances in consumer hardware for local inference.
-
Llama.cpp Benchmark: RTX 5090 vs Enterprise Systems Compared
Comprehensive llama-bench benchmarks comparing RTX 5090 consumer GPU against DGX Spark and AMD AI395 in real-world local inference scenarios, with ROCm and Vulkan results included.