Tagged "browser-based-inference"
7 articles tagged browser-based-inference, 3 March 2026 to 24 July 2026. Newest first.
-
Mozilla Firefox 153 ESR Adds On-Device AI Capabilities for Enterprise Deployment
Mozilla's latest Firefox ESR release introduces native on-device AI features designed for enterprise environments, enabling local inference directly within the browser without external API dependencies. This represents a significant step toward mainstream browser-based local LLM integration.
-
Chrome Is Hiding a Free Local AI Chatbot on Your Computer
Google Chrome now includes a built-in local AI chatbot that runs directly on your machine without requiring cloud connectivity. This represents a significant shift toward edge inference in mainstream browsers.
-
Microsoft Expands On-Device AI Models in Edge Browser with New APIs for Local Inference
Microsoft is expanding on-device AI capabilities in Edge with new models and developer APIs, enabling local LLM inference directly in the browser. The initiative includes model uninstall controls and broader hardware support across Windows devices.
-
Show HN: seed – Self-Modifying Webpage with On-Device LLM
A novel project demonstrating an LLM running entirely in-browser with the webpage code stored in the URL itself, enabling true on-device inference without external dependencies.
-
Liquid AI's LFM2-24B Achieves 50 Tokens/Second in Web Browser via WebGPU
Liquid AI has demonstrated their LFM2-24B mixture-of-experts model running at 50 tokens/second in a web browser on M4 Max hardware using WebGPU. The 8B variant achieves over 100 tokens/second, showcasing practical edge inference in browser environments.
-
Show HN: Voice-tracked teleprompter using on-device ASR in the browser
A new browser-based tool that combines on-device automatic speech recognition with teleprompter functionality, enabling voice-tracked presentations without server dependencies. The system processes audio locally in the browser.
-
Qwen 3.5 0.8B Running in Browser with WebGPU via Transformers.js
A practical demonstration of running Qwen 3.5's smallest 0.8B multimodal model directly in the browser using WebGPU and Transformers.js, eliminating backend requirements for inference.