Tagged "local-inference-performance"

4 articles tagged local-inference-performance, 9 March 2026 to 21 May 2026. Newest first.

• AMD's New Ryzen AI Max Pro 400 with 192GB LPDDR5X Memory 21 May 2026

  AMD reveals the Ryzen AI Max Pro 400 series processors featuring 192GB of LPDDR5X memory, significantly expanding on-device LLM deployment capabilities for enterprise and professional workloads.

• Offline Voice-to-Text and AI Keyboard App for Local Processing 16 May 2026

  Dictawiz, a new app featuring offline voice-to-text transcription and AI-powered keyboard functionality, demonstrates practical on-device LLM applications. The tool performs inference locally without requiring cloud connectivity or external API calls.

• Claude Code with a Local LLM Running Offline Is the Hybrid Setup I Didn't Know I Needed 7 May 2026

  A developer shares their experience combining Claude Code with a locally-running LLM for an optimal hybrid workflow. This practical guide demonstrates how to leverage both cloud AI capabilities and local inference for flexible, privacy-preserving development.

• Strix Halo (Ryzen AI Max+ 395) Achieves Strong Local Inference Performance with ROCm 7.2 9 March 2026

  New benchmarks on AMD's Strix Halo platform with ROCm 7.2 backend show practical inference speeds for the Qwen 3.5 model family, with recent llama.cpp optimisations delivering measurable performance gains.