Tagged "npu"
21 articles tagged npu, 12 February 2026 to 27 July 2026. Newest first.
-
CPU vs GPU vs NPU: Which Semiconductor Does What?
A technical breakdown comparing CPUs, GPUs, and NPUs (Neural Processing Units) and their respective roles in AI inference. This educational piece helps practitioners understand hardware trade-offs when selecting platforms for local LLM deployment.
-
Bringing Up the RK3576 NPU on Mainline Linux: A Byte-Exact Single-Task Path
A detailed technical guide on enabling the RK3576 Neural Processing Unit on mainline Linux, opening new possibilities for efficient local LLM inference on edge devices with dedicated AI hardware acceleration.
-
WSL 3 Brings Near-Native GPU and NPU Passthrough for Local AI on Windows
Microsoft's WSL 3 at Build 2026 enables near-native GPU and NPU passthrough, making it significantly easier to run local LLMs on Windows with direct hardware acceleration. This development removes a major bottleneck for Windows-based local inference deployments.
-
Nota AI Partners with Mobilint to Accelerate On-Device AI on Domestic NPU Infrastructure
Nota AI has announced a strategic partnership with Mobilint focused on optimizing on-device AI deployment using Neural Processing Units (NPUs). This collaboration aims to commercialize AI optimization technology for domestic NPU infrastructure.
-
Lotte Innovate and DeepX Collaborate on Mass Production of Domestic AI Semiconductors
A strategic partnership between Lotte Innovate and DeepX aims to mass-produce AI semiconductors optimized for edge inference, positioning NPUs as alternatives to GPUs for local LLM deployment and reducing dependency on traditional GPU infrastructure.
-
Lemonade 10.0.1 Improves Setup Process For Using AMD Ryzen AI NPUs On Linux
Lemonade 10.0.1 update significantly improves the developer experience for leveraging AMD Ryzen AI NPUs on Linux systems. This enhancement makes hardware-accelerated local inference more accessible to Linux users with AMD processors.
-
Korea to Deploy Domestic AI Chips in Smart Cities as NPU Trials Scale Up
South Korea is scaling trials of domestically-developed AI chips optimized for neural processing in smart city infrastructure, marking a significant shift toward regional edge computing independence.
-
ASUS ExpertCenter PN55 Mini PC Combines AMD AI CPU and 55 TOPS NPU
ASUS launches a ruggedized industrial mini PC featuring AMD's latest AI-optimized CPU and a dedicated 55 TOPS NPU, purpose-built for on-device inference deployments in demanding environments.
-
Dell Pro Max 16 Plus Launches With Enterprise-Grade Discrete NPU for On-Device AI
Dell's new Pro Max 16 Plus laptop features a dedicated Neural Processing Unit (NPU) designed for efficient on-device AI inference. The hardware advancement enables faster, more power-efficient local LLM deployment on enterprise devices.
-
AMD Declares 'AI on the PC Has Crossed an Important Line' – Agent Computers as Next Breakthrough
AMD signals that on-device AI inference has reached a critical inflection point, positioning local agent computing as the next major evolution in personal computing. This reflects industry momentum toward reducing cloud dependence for AI workloads.
-
Lemonade v10 Brings Linux NPU Support and Multi-Modal Capabilities
Lemonade v10 adds Linux support for NPU inference alongside expanded multi-modal capabilities, enabling efficient local LLM deployment on AMD NPUs across more platforms.
-
Qualcomm Snapdragon Wear Elite: 2B Parameter NPU for Personal AI Wearables
Qualcomm unveils Snapdragon Wear Elite with a dedicated 2 billion-parameter NPU designed for AI inference on smartwatches and wearables. The platform enables always-on personal AI assistants with 30% improved battery efficiency.
-
AMD Ryzen AI 400 Series Desktop Processors Launch with Integrated 60 TOPS NPU
AMD unveils Ryzen AI 400 series desktop processors featuring up to 12 cores and an integrated Radeon 890M GPU with a 60 TOPS NPU. These processors enable local LLM inference on standard desktop machines with Copilot+ support.
-
AMD Expands Ryzen AI 400 Series Portfolio for Consumer and Enterprise AI PC Options
AMD announced an expanded lineup of Ryzen AI 400 Series processors, bringing more hardware options for local AI inference across consumer laptops and business workstations. The expansion increases accessibility of dedicated NPU hardware for on-device LLM deployment.
-
Snapdragon 8 Elite Gen 5 for Galaxy Official: 5 Key Improvements that Push the Boundaries
Details on the latest Snapdragon processor generation bringing performance improvements specifically relevant to on-device AI inference and local model execution on mobile devices.
-
How AI is Redefining Price and Performance in Modern Laptops
Modern laptops are increasingly optimized for local AI inference through improved hardware accelerators, specialized chips, and software frameworks. This shift is creating more capable platforms for running quantized language models without cloud dependency.
-
Google Open-Sources NPU IP, Synaptics Implements It for Hardware Acceleration
Google has open-sourced its Neural Processing Unit IP architecture, with Synaptics already implementing it, potentially enabling more efficient hardware accelerators for local LLM inference across edge devices.
-
Asus ExpertBook B3 G2 with 50 TOPS AI Sets New Enterprise Standard
Asus announces the ExpertBook B3 G2, an enterprise laptop featuring 50 TOPS of AI compute, establishing new performance benchmarks for business-class local inference devices.
-
AI PCs Explained: 7 Critical Truths About NPUs and Privacy
A deep dive into NPU-equipped AI PCs and the privacy implications of on-device inference, clarifying misconceptions about local AI processing capabilities.
-
At India AI Impact Summit, Intel Showcases AI PCs and Cost-Efficient Frugal AI
Intel demonstrates efficient AI computing strategies and NPU-based AI PCs optimized for resource-constrained environments at the India AI Impact Summit.
-
Running Mistral-7B on Intel NPU Achieves 12.6 Tokens/Second
A developer created a tool to run LLMs on Intel NPUs, achieving 12.6 tokens/second with Mistral-7B while using zero CPU/GPU resources, though integrated GPU still performs better at 23.38 tokens/second.