Tagged "edge-inference-optimization"
5 articles tagged edge-inference-optimization, 20 February 2026 to 13 May 2026. Newest first.
-
BT Explainer: Google's Gemma 4 Could Put Powerful AI on Your Phone and Laptop
Google's latest Gemma model is designed specifically for on-device inference, enabling capable language models to run directly on consumer phones and laptops without cloud connectivity.
-
Show HN: We built an OCR server that can process 270 dense images/s on a 5090
A high-performance OCR inference server achieving 270 dense images per second on a single GPU, demonstrating practical edge inference optimization techniques.
-
DMax: New Parallel Decoding Paradigm for Diffusion Language Models
National University of Singapore researchers present DMax, a novel approach enabling aggressive parallel decoding in diffusion language models through progressive self-refinement, potentially revolutionizing inference speed.
-
Snapdragon Wear Elite Unveiled at MWC 2026, Advancing Wearable AI Inference
Qualcomm's Snapdragon Wear Elite processor brings enhanced AI capabilities to wearable devices. The new chip enables lightweight model deployment on smartwatches and fitness trackers.
-
Mirai Secures $10M to Optimize On-Device AI Amid Cloud Cost Surge
Mirai, founded by creators of Reface and Prisma, raises $10M Series A funding to advance on-device AI inference optimization, addressing the market shift toward edge computing and away from cloud-dependent models.