Tagged "turboquant"

5 articles tagged turboquant, 29 March 2026 to 19 September 2026. Newest first.

• 4-Bit Rotational Quantization: -45% RAM, <1% Recall Drop vs. TurboQuant 19 September 2026

  Weaviate presents a 4-bit rotational quantization technique achieving 45% RAM reduction with less than 1% recall degradation, advancing the state of memory-efficient inference.

• 4-Bit Rotational Quantization: -45% RAM, <1% Recall Drop vs. TurboQuant 18 September 2026

  Weaviate introduces a new quantization technique achieving 45% RAM reduction with negligible accuracy loss, advancing memory-efficient local model deployment.

• Mixed Precision Quantization on MLX with TurboQuant Implementation 4 April 2026

  MLX framework now supports mixed precision quantization through TurboQuant, enabling more efficient model compression for Apple Silicon devices. This advancement allows developers to achieve better quality-to-size trade-offs when deploying LLMs locally.

• TurboQuant Enables Qwen 3.5-27B on 16GB Consumer GPUs 2 April 2026

  Advanced quantization technique TurboQuant achieves near-Q4_0 quality at 10% smaller size, allowing high-performance models to fit on consumer-grade graphics cards.

• Google's TurboQuant Shows Memory Constraints Remain Critical for Local LLM Inference 29 March 2026

  Insights from KAIST researchers involved in Google's TurboQuant quantisation work highlight how memory demands continue to be the fundamental bottleneck limiting local LLM deployment at scale.