Tagged "modular"
5 articles tagged modular, 25 June 2026 to 18 October 2026. Newest first.
-
Modular's MAX Achieves 5.5x Performance Improvement Over vLLM on Kimi K2.5
Modular's MAX inference engine demonstrates significant performance gains, delivering 5.5x speedup compared to vLLM on Kimi K2.5, marking a major breakthrough in local LLM inference optimization.
-
Modular's MAX Framework Delivers 5.5x Speedup Over vLLM on Kimi Models
Modular's MAX inference framework achieves 5.5x performance improvement over vLLM when running Kimi K2.5 models, demonstrating significant optimisations for local LLM inference speed and efficiency.
-
Modular's MAX Inference Stack Achieves 5.5x Speedup on AMD Hardware
Modular's Dakkak reports MAX Inference delivering 5.5x faster performance on Kimi K2.5, with AMD's 30% hardware discount reshaping the economics of local model deployment.
-
You Can Now Run Max AI Models on Apple Silicon
Modular's Max platform now supports running AI models directly on Apple Silicon GPUs, expanding local deployment options for macOS users and M-series chip owners.
-
Qualcomm Acquires Modular AI in $3.9 Billion Deal to Accelerate On-Device AI
Qualcomm's acquisition of AI software startup Modular signals a major push to optimize LLM deployment on mobile and edge devices. The deal aims to enhance Qualcomm's compiler and runtime technology for efficient on-device inference.