Tagged "webgpu"
11 articles tagged webgpu, 14 February 2026 to 2 September 2026. Newest first.
-
Hugging Face Releases 200+ WebGPU Kernels for Local AI Inference
Hugging Face launches a comprehensive collection of WebGPU kernels enabling efficient local AI inference directly in browsers and on-device. This represents a major step toward browser-native LLM deployment without server backends.
-
Running LLMs in the Browser: WebGPU and Local Inference
Guide to running language models directly in web browsers using WebGPU, enabling client-side inference without server dependencies or data transmission.
-
Chrome Silently Downloads 4GB AI Model for Local Inference Without User Consent
Google Chrome is automatically downloading a 4GB AI model to enable on-device inference capabilities, raising important questions about local storage, bandwidth usage, and user transparency in mainstream browser-based LLM deployment.
-
Bonsai 1.7B in the Browser: A 290MB 1-bit LLM on WebGPU
Bonsai, a 1.7B parameter model quantized to 1-bit, now runs directly in web browsers via WebGPU at just 290MB. This breakthrough demonstrates extreme quantization techniques making capable language models viable for edge inference without server infrastructure.
-
Show HN: Turn Photos Into Wordle Puzzles with AI That Runs 100% in Your Browser
A practical demonstration of running computer vision and generative AI models entirely in-browser without server-side processing, showcasing the feasibility of edge AI inference for consumer applications.
-
Liquid AI's LFM2-24B Achieves 50 Tokens/Second in Web Browser via WebGPU
Liquid AI has demonstrated their LFM2-24B mixture-of-experts model running at 50 tokens/second in a web browser on M4 Max hardware using WebGPU. The 8B variant achieves over 100 tokens/second, showcasing practical edge inference in browser environments.
-
NVIDIA Nemotron 3 Nano 4B Enables On-Device Inference Directly in Web Browsers via WebGPU
NVIDIA's 4B Nemotron 3 Nano model now runs efficiently in web browsers using WebGPU, achieving 75 tokens per second on consumer hardware and democratizing edge AI inference without local installation.
-
Qwen 3.5-4B Generates Fully Functional OS in Single Prompt
A user demonstrates Qwen 3.5-4B generating a complete web-based operating system with games, text editor, audio player, and file browser in a single inference pass, showcasing impressive code generation capability.
-
Qwen 3.5 Small Models Released: 0.8B to 9B Parameters Optimized for On-Device Inference
Alibaba's Qwen team released a new family of small multimodal models (0.8B, 2B, 4B, 9B) designed specifically for on-device and edge deployment, with demonstrated improvements across the generational progression from Qwen 2.5 to 3.5.
-
Qwen 3.5 0.8B Running in Browser with WebGPU via Transformers.js
A practical demonstration of running Qwen 3.5's smallest 0.8B multimodal model directly in the browser using WebGPU and Transformers.js, eliminating backend requirements for inference.
-
GPT-OSS 20B Now Runs 100% Locally in Browser via WebGPU
GPT-OSS 20B can now run entirely in web browsers using WebGPU acceleration through Transformers.js v4 and ONNX Runtime Web, enabling client-side AI without server dependencies.