Tagged "client-side-inference"

5 articles tagged client-side-inference, 14 February 2026 to 1 September 2026. Newest first.

• Running LLMs in the Browser: WebGPU and Local Inference 1 September 2026

  Guide to running language models directly in web browsers using WebGPU, enabling client-side inference without server dependencies or data transmission.

• This Open-Source Extension Lets You Rewrite Your X Algorithm Using a Local LLM, and It Healed My Timeline 20 July 2026

  An innovative open-source browser extension enables users to control their X (formerly Twitter) feed using locally-running language models instead of corporate algorithms. This demonstrates practical consumer applications for on-device AI.

• Show HN: Interactive and Stylized AI Chat Chrome Extension 22 May 2026

  A new Chrome extension demonstrates interactive and stylized AI chat capabilities, showing how local or edge-deployed inference can be integrated directly into browser workflows for improved user experience. This project highlights practical implementations of on-device AI for end users.

• Qwen 3.5 0.8B Running in Browser with WebGPU via Transformers.js 3 March 2026

  A practical demonstration of running Qwen 3.5's smallest 0.8B multimodal model directly in the browser using WebGPU and Transformers.js, eliminating backend requirements for inference.

• GPT-OSS 20B Now Runs 100% Locally in Browser via WebGPU 14 February 2026

  GPT-OSS 20B can now run entirely in web browsers using WebGPU acceleration through Transformers.js v4 and ONNX Runtime Web, enabling client-side AI without server dependencies.