Tagged "performance-benchmarking"
12 articles tagged performance-benchmarking, 2 April 2026 to 21 September 2026. Newest first.
-
ROCmFix and InferBench: AMD Local-LLM Setup and Vulkan vs. HIP Benchmarking
Practical tools and benchmarks for AMD GPU-based local LLM inference, comparing Vulkan and HIP backend performance to optimize inference on AMD hardware.
-
Benchmarking Local LLM Servers: Llama.cpp, Llamafile, LM Studio, and Ollama
A practical benchmark comparison of four major local LLM serving frameworks, measuring performance across speed, memory usage, and ease of deployment on consumer hardware.
-
Benchmarking Qwen 3.8 27B on RTX 5090 and Beyond
Comprehensive performance benchmarking of Qwen 3.8 27B model on high-end consumer GPUs like the RTX 5090, providing practical insights for local deployment scenarios.
-
Homebench: Comprehensive Benchmarking Tool for Local LLMs
A new benchmarking tool specifically designed to measure speed, memory usage, and output quality of locally-running LLMs, helping practitioners optimize their deployments.
-
Benchmarking a Portable AI Workstation: Lenovo ThinkPad P16 Gen 3, Part 2
Detailed performance analysis of the Lenovo ThinkPad P16 Gen 3 as a portable AI workstation, providing real-world benchmarks for local LLM inference and training workflows.
-
AI/ML Benchmark Tool for Local LLM Inference and XGBoost Training
A new benchmarking tool has been released for measuring local LLM inference performance and XGBoost training across GPU and CPU hardware. This resource helps practitioners evaluate their on-device deployment setups and optimize inference performance.
-
Show HN: Find the best local LLM for your hardware, ranked by benchmarks
A new GitHub tool helps developers identify the optimal local LLM for their specific hardware constraints by ranking models across performance benchmarks. This addresses a key pain point in the local LLM ecosystem where choosing between dozens of models requires extensive manual testing.
-
Running Capable Local LLMs Without Expensive GPU Hardware
New approaches and hardware configurations demonstrate that effective local LLM deployment is achievable on consumer-grade and budget hardware, removing the high barrier to entry.
-
Linux Crushes Windows on llama.cpp Inference by Double Digits
New benchmarks reveal significant performance advantages for llama.cpp inference on Linux systems compared to Windows, with improvements reaching double-digit percentages across various model sizes.
-
Warp Decode vs. vLLM's Triton Kernel: Performance Crossover Analysis
A detailed technical comparison analyzing where Warp Decode and vLLM's Triton kernel each excel for local LLM inference, with implications for choosing the right decoding strategy for your hardware.
-
I Replaced My Local LLM With a Model Half Its Size and Got Better Results — and It Wasn't About the Parameters
A detailed account of how switching to a smaller, better-optimized model outperformed a larger predecessor on local hardware, challenging assumptions about model scaling and practical performance.
-
Qwen 3.6-Plus Released
Alibaba releases Qwen 3.6-Plus, a new model optimized for local deployment with improved performance characteristics for on-device inference.