Tagged "onnx-runtime"
3 articles tagged onnx-runtime, 22 May 2026 to 10 September 2026. Newest first.
-
UNIST Develops On-Device AI That Cuts Model Storage 2,400-Fold
Researchers at UNIST have developed a breakthrough technique for on-device AI that reduces model storage requirements by 2,400 times, enabling deployment of capable models on severely resource-constrained edge devices.
-
CPU vs GPU vs NPU: Which Semiconductor Does What?
A technical breakdown comparing CPUs, GPUs, and NPUs (Neural Processing Units) and their respective roles in AI inference. This educational piece helps practitioners understand hardware trade-offs when selecting platforms for local LLM deployment.
-
Show HN: Interactive and Stylized AI Chat Chrome Extension
A new Chrome extension demonstrates interactive and stylized AI chat capabilities, showing how local or edge-deployed inference can be integrated directly into browser workflows for improved user experience. This project highlights practical implementations of on-device AI for end users.