Tagged "browser-ai"
18 articles tagged browser-ai, 14 February 2026 to 3 September 2026. Newest first.
-
Show HN: Single-File GGUF Inference
A browser-based GGUF inference solution enables running quantized models directly in WebAssembly, allowing local LLM inference without any backend server or installation required.
-
Hugging Face Releases 200+ WebGPU Kernels for Local AI Inference
Hugging Face launches a comprehensive collection of WebGPU kernels enabling efficient local AI inference directly in browsers and on-device. This represents a major step toward browser-native LLM deployment without server backends.
-
Running LLMs in the Browser: WebGPU and Local Inference
Guide to running language models directly in web browsers using WebGPU, enabling client-side inference without server dependencies or data transmission.
-
Squeezes – A Private, Local-First Bulk Image Compressor Running In-Browser
A new in-browser image compression tool demonstrates the viability of running complex computational tasks entirely locally without server dependencies, using client-side processing for batch image optimization.
-
Microsoft Expands On-Device AI Models in Edge Browser with New APIs for Local Inference
Microsoft is expanding on-device AI capabilities in Edge with new models and developer APIs, enabling local LLM inference directly in the browser. The initiative includes model uninstall controls and broader hardware support across Windows devices.
-
Chrome Silently Downloads 4GB AI Model for Local Inference Without User Consent
Google Chrome is automatically downloading a 4GB AI model to enable on-device inference capabilities, raising important questions about local storage, bandwidth usage, and user transparency in mainstream browser-based LLM deployment.
-
Google Chrome Raises Privacy Questions with 4GB AI Model Download
A new report questions whether Google Chrome is downloading a large AI model without explicit user consent. The privacy implications raise important considerations for users deploying and understanding on-device AI systems.
-
Show HN: Interactive and Stylized AI Chat Chrome Extension
A new Chrome extension demonstrates interactive and stylized AI chat capabilities, showing how local or edge-deployed inference can be integrated directly into browser workflows for improved user experience. This project highlights practical implementations of on-device AI for end users.
-
Chrome Automatically Downloads 4GB AI Model for Local Processing
Google Chrome now automatically downloads a 4GB on-device AI model to support native AI features, with implications for local inference standards and user privacy. Users can disable the automatic download if preferred.
-
Bonsai 1.7B in the Browser: A 290MB 1-bit LLM on WebGPU
Bonsai, a 1.7B parameter model quantized to 1-bit, now runs directly in web browsers via WebGPU at just 290MB. This breakthrough demonstrates extreme quantization techniques making capable language models viable for edge inference without server infrastructure.
-
Show HN: Turn Photos Into Wordle Puzzles with AI That Runs 100% in Your Browser
A practical demonstration of running computer vision and generative AI models entirely in-browser without server-side processing, showcasing the feasibility of edge AI inference for consumer applications.
-
Liquid AI's LFM2-24B Achieves 50 Tokens/Second in Web Browser via WebGPU
Liquid AI has demonstrated their LFM2-24B mixture-of-experts model running at 50 tokens/second in a web browser on M4 Max hardware using WebGPU. The 8B variant achieves over 100 tokens/second, showcasing practical edge inference in browser environments.
-
NVIDIA Nemotron 3 Nano 4B Enables On-Device Inference Directly in Web Browsers via WebGPU
NVIDIA's 4B Nemotron 3 Nano model now runs efficiently in web browsers using WebGPU, achieving 75 tokens per second on consumer hardware and democratizing edge AI inference without local installation.
-
Browser-Based Transcription Tools
Browser-based transcription solutions leverage local inference to enable audio processing entirely within the user's device, eliminating cloud dependency for speech-to-text tasks. This trend reflects growing adoption of WebAssembly and on-device AI models for privacy-preserving audio applications.
-
Qwen 3.5-4B Generates Fully Functional OS in Single Prompt
A user demonstrates Qwen 3.5-4B generating a complete web-based operating system with games, text editor, audio player, and file browser in a single inference pass, showcasing impressive code generation capability.
-
Qwen 3.5 Small Models Released: 0.8B to 9B Parameters Optimized for On-Device Inference
Alibaba's Qwen team released a new family of small multimodal models (0.8B, 2B, 4B, 9B) designed specifically for on-device and edge deployment, with demonstrated improvements across the generational progression from Qwen 2.5 to 3.5.
-
Qwen 3.5 0.8B Running in Browser with WebGPU via Transformers.js
A practical demonstration of running Qwen 3.5's smallest 0.8B multimodal model directly in the browser using WebGPU and Transformers.js, eliminating backend requirements for inference.
-
GPT-OSS 20B Now Runs 100% Locally in Browser via WebGPU
GPT-OSS 20B can now run entirely in web browsers using WebGPU acceleration through Transformers.js v4 and ONNX Runtime Web, enabling client-side AI without server dependencies.