Tagged "turboquant"

3 articles tagged turboquant, 29 March 2026 to 4 April 2026. Newest first.

• Mixed Precision Quantization on MLX with TurboQuant Implementation 4 April 2026

  MLX framework now supports mixed precision quantization through TurboQuant, enabling more efficient model compression for Apple Silicon devices. This advancement allows developers to achieve better quality-to-size trade-offs when deploying LLMs locally.

• TurboQuant Enables Qwen 3.5-27B on 16GB Consumer GPUs 2 April 2026

  Advanced quantization technique TurboQuant achieves near-Q4_0 quality at 10% smaller size, allowing high-performance models to fit on consumer-grade graphics cards.

• Google's TurboQuant Shows Memory Constraints Remain Critical for Local LLM Inference 29 March 2026

  Insights from KAIST researchers involved in Google's TurboQuant quantisation work highlight how memory demands continue to be the fundamental bottleneck limiting local LLM deployment at scale.