Tagged "1-bit-quantization"

4 articles tagged 1-bit-quantization, 1 April 2026 to 16 April 2026. Newest first.

• Bonsai 1.7B in the Browser: A 290MB 1-bit LLM on WebGPU 16 April 2026

  Bonsai, a 1.7B parameter model quantized to 1-bit, now runs directly in web browsers via WebGPU at just 290MB. This breakthrough demonstrates extreme quantization techniques making capable language models viable for edge inference without server infrastructure.

• Researchers Achieve 1-Bit Quantization of OLMo-3 7B Using Distillation 13 April 2026

  A novel approach using quantization-aware distillation successfully compressed OLMo-3 7B Instruct to 1-bit precision, enabling ultra-efficient inference on severely resource-constrained devices.

• Bonsai 1-Bit Models Deliver Exceptional Local Inference Performance 2 April 2026

  PrismML's Bonsai 1-bit quantization achieves 14x size reduction while maintaining quality, enabling previously impossible deployments on resource-constrained local hardware.

• PrismML Announces 1-Bit Bonsai: First Commercially Viable 1-Bit LLMs 1 April 2026

  PrismML has released Bonsai-8B, a groundbreaking 1-bit quantised model that fits in just 1.15GB of memory while maintaining competitive performance with Llama 3 8B. This represents a major breakthrough in memory-efficient local LLM deployment, enabling edge inference on severely resource-constrained devices.