Tagged "compression"
5 articles tagged compression, 25 March 2026 to 18 July 2026. Newest first.
-
Apple in Early Talks With PrismML on AI Compression Tech
Apple explores advanced model compression technology that could enable faster, more efficient on-device AI inference while preserving model quality. Implications for future iPhone and Mac deployments.
-
Apple Explores Running Larger AI Models on iPhone with On-Device Compression
Apple is developing techniques to run significantly larger language models directly on iPhones, including a 27-billion-parameter model for the first time. The company is exploring advanced compression technologies like PrismML to enable this capability.
-
Compressor V2: Three Compression Layers for 50% LLM Agent Cost Cut
A new compression technique achieves 50% cost reduction for LLM agents through three layered compression approaches. This breakthrough is particularly relevant for resource-constrained local deployments seeking to optimize inference efficiency.
-
Unweight: Lossless MLP Weight Compression for LLM Inference
Cloudflare Research presents a new lossless weight compression technique for MLP layers in language models, enabling faster inference and reduced memory footprint without quality degradation. A breakthrough for memory-constrained local deployments.
-
Google TurboQuant: Extreme Compression for Local LLM Deployment
Google Research releases TurboQuant, a new quantisation technique enabling extreme model compression for efficient local and edge inference. Early implementations are already being integrated into frameworks like MLX Studio.