Tagged "browser-inference"
21 articles tagged browser-inference, 3 March 2026 to 11 October 2026. Newest first.
-
Jeyzma: In-Browser LLM Inference with Go and TinyGo
Jeyzma enables local LLM inference directly in web browsers using Go/TinyGo and llama.cpp integration, combining accessibility with privacy-preserving edge inference.
-
Show HN: Single-File GGUF Inference
A browser-based GGUF inference solution enables running quantized models directly in WebAssembly, allowing local LLM inference without any backend server or installation required.
-
Hugging Face Releases 200+ WebGPU Kernels for Local AI Inference
Hugging Face launches a comprehensive collection of WebGPU kernels enabling efficient local AI inference directly in browsers and on-device. This represents a major step toward browser-native LLM deployment without server backends.
-
Running LLMs in the Browser: WebGPU and Local Inference
Guide to running language models directly in web browsers using WebGPU, enabling client-side inference without server dependencies or data transmission.
-
Chrome and Edge Now Require 20GB Free Space for AI Models
Google Chrome and Microsoft Edge are implementing 20GB minimum free storage requirements to support local AI model execution within the browser.
-
Chrome's On-Device AI Model Requires 20GB Storage Space
Google's integrated on-device AI in Chrome requires substantial storage allocation, raising important considerations about local inference feasibility and hardware requirements for browser-based model deployment. Users can disable or control this feature.
-
Chrome and Edge Browsers Quietly Deploy Up to 20GB AI Models on Windows 11
Microsoft Edge and Google Chrome are automatically downloading multi-gigabyte AI models to local storage for on-device inference capabilities, raising awareness about browser-integrated LLM deployment patterns and storage management.
-
Google Chrome Reveals Storage Requirements for Integrated Local AI Models
Google discloses how much free disk space Chrome requires to install and run local AI models, indicating the browser is moving toward on-device model deployment for inference.
-
This Open-Source Extension Lets You Rewrite Your X Algorithm Using a Local LLM, and It Healed My Timeline
An innovative open-source browser extension enables users to control their X (formerly Twitter) feed using locally-running language models instead of corporate algorithms. This demonstrates practical consumer applications for on-device AI.
-
Google's LiteRT.js Enables On-Device AI Inference in Web Browsers
Google releases LiteRT.js, a JavaScript framework enabling efficient AI model inference directly in web browsers without server calls. This advancement brings on-device LLM capabilities to edge environments, reducing latency and improving privacy for web-based applications.
-
Chrome Downloads 4GB AI Model: Implications for Local On-Device AI
Google Chrome's automatic download of a 4GB AI model raises important questions about on-device inference, user consent, and the shift toward local LLM deployment in mainstream browsers.
-
Microsoft Expands On-Device AI Models in Edge Browser with New APIs for Local Inference
Microsoft is expanding on-device AI capabilities in Edge with new models and developer APIs, enabling local LLM inference directly in the browser. The initiative includes model uninstall controls and broader hardware support across Windows devices.
-
Chrome Quietly Downloads 4GB AI Model Without User Permission
Google Chrome has begun automatically downloading a 4GB AI model for on-device inference capabilities. This unexpected behavior raises important questions about local model deployment, storage, and user control in mainstream browsers.
-
Show HN: seed – Self-Modifying Webpage with On-Device LLM
A novel project demonstrating an LLM running entirely in-browser with the webpage code stored in the URL itself, enabling true on-device inference without external dependencies.
-
Chrome Automatically Downloads 4GB AI Model for Local Processing
Google Chrome now automatically downloads a 4GB on-device AI model to support native AI features, with implications for local inference standards and user privacy. Users can disable the automatic download if preferred.
-
NordVPN Adds On-Device AI Voice Detector to Chrome Extension to Identify Synthetic Audio
NordVPN integrates a local AI model into its Chrome extension to detect synthetic audio, demonstrating practical applications of on-device inference for security and media verification.
-
Show HN: Turn Photos Into Wordle Puzzles with AI That Runs 100% in Your Browser
A practical demonstration of running computer vision and generative AI models entirely in-browser without server-side processing, showcasing the feasibility of edge AI inference for consumer applications.
-
NVIDIA Nemotron 3 Nano 4B Enables On-Device Inference Directly in Web Browsers via WebGPU
NVIDIA's 4B Nemotron 3 Nano model now runs efficiently in web browsers using WebGPU, achieving 75 tokens per second on consumer hardware and democratizing edge AI inference without local installation.
-
Show HN: Voice-tracked teleprompter using on-device ASR in the browser
A new browser-based tool that combines on-device automatic speech recognition with teleprompter functionality, enabling voice-tracked presentations without server dependencies. The system processes audio locally in the browser.
-
Show HN: TLDR – Free Chrome Extension for AI-Powered Article Summarization
A new Chrome extension uses AI to generate two-second summaries of any article. The project demonstrates feasibility of running inference efficiently enough for real-time browser integration.
-
Qwen 3.5 0.8B Running in Browser with WebGPU via Transformers.js
A practical demonstration of running Qwen 3.5's smallest 0.8B multimodal model directly in the browser using WebGPU and Transformers.js, eliminating backend requirements for inference.