Tagged "hardware-diversification"
9 articles tagged hardware-diversification, 20 February 2026 to 30 May 2026. Newest first.
-
Zoho-Backed Netrasemi Launches 12nm AI Chip, Mass Production Begins This Year
India's Netrasemi, backed by Zoho, is launching a 12nm AI processor with mass production starting in 2026, offering a homegrown option for local LLM inference with implications for edge deployment and hardware accessibility.
-
Kog AI – Building a Real-Time Inference Stack on AMD Instinct GPUs
A technical presentation on building production inference systems using AMD Instinct GPUs, expanding the hardware ecosystem for local LLM deployment beyond NVIDIA dominance. The talk covers real-time inference optimization techniques applicable to on-device deployments.
-
Intel Arc Pro B70 32GB Achieves 12 Tokens/Sec on Qwen 3.5-27B
Intel Arc Pro GPU hardware demonstrates strong performance running Qwen 3.5 27B quantized models with vLLM and llama.cpp, establishing alternative hardware viability for local deployment.
-
Lotte Innovate and DeepX Collaborate on Mass Production of Domestic AI Semiconductors
A strategic partnership between Lotte Innovate and DeepX aims to mass-produce AI semiconductors optimized for edge inference, positioning NPUs as alternatives to GPUs for local LLM deployment and reducing dependency on traditional GPU infrastructure.
-
Chinese Chipmakers Claim Nearly Half of Local Market as Nvidia's Lead Shrinks
Chinese semiconductor manufacturers are rapidly gaining market share in their domestic AI chip market, now commanding nearly 50% of the segment as Nvidia's dominance faces competitive pressure. This shift has significant implications for local LLM inference costs and accessibility in Asia.
-
This External GPU Enclosure Tries to Break Cloud Dependence for Local AI Inference
New external GPU enclosure hardware aims to democratize local AI inference by enabling retrofit GPU acceleration for standard PCs. The solution targets users looking to reduce cloud costs and latency for LLM workloads.
-
AMD Launches Copilot+ Desktop Chips to Compete in On-Device AI Market
AMD has entered the on-device AI competition with its first Copilot+ certified desktop processors, offering an alternative to Intel and Apple for local model inference. The chips target the growing market of Windows-based AI workstations and edge devices requiring native AI acceleration.
-
Intel Arc Pro B70 Workstation GPU Confirmed via vLLM AI Release Notes
Intel's Arc Pro B70 discrete GPU receives official support in vLLM release notes, expanding local LLM inference options for professional workstations. The BMG-G31 architecture targets professional AI computing workflows.
-
Free ASIC-Accelerated Llama 3.1 8B Inference at 16,000 Tokens/Second
Taalas, a fast inference hardware startup, has released a free chatbot interface and API endpoint running Llama 3.1 8B on custom ASICs, achieving 16,000 tokens/second throughput. This demonstrates the viability of specialized hardware for cost-effective local-style inference.