Tagged "inference-infrastructure"
3 articles tagged inference-infrastructure, 24 July 2026 to 4 October 2026. Newest first.
-
Nvidia's DGX Spark Gets a 64GB Model at $4,999
NVIDIA announces a more affordable 64GB variant of its DGX Spark system, enabling accessible high-performance local AI development with support for memory pooling across multiple units.
-
AMD's MI355X Undercuts Nvidia's B300 on Cost to Run China's Kimi K3
AMD's MI355X GPU offers competitive pricing advantages over NVIDIA's B300 for running large language models, providing cost-conscious practitioners with viable alternatives for local inference hardware.
-
Hetzner Working on LLM Inference for Self-Hosted Deployments
Infrastructure provider Hetzner is developing LLM inference capabilities, expanding options for self-hosted and on-device model deployment. This move signals growing demand for accessible, cost-effective local inference solutions.