Tagged "inference-cost-reduction"
5 articles tagged inference-cost-reduction, 13 February 2026 to 1 June 2026. Newest first.
-
Netflix Wiz Creates App to Slash AI Bills, Then Open Sources It
Netflix engineer Wiz has developed and open-sourced a tool designed to significantly reduce AI inference costs, making it highly relevant for self-hosted LLM deployments seeking cost optimization.
-
Externalization in LLM Agents: Unified Review of Memory and Harness Engineering
A comprehensive research paper reviewing memory externalization and harness engineering patterns for LLM agents, examining how to optimize agent performance through external memory systems.
-
Building PyTorch-Native Support for IBM Spyre Accelerator
IBM Research announces new PyTorch-native support for the IBM Spyre accelerator, enabling better integration of custom hardware with popular deep learning frameworks. This development simplifies local LLM deployment on specialized accelerators.
-
NVIDIA's Dynamic Memory Sparsification Cuts LLM Inference Costs by 8x
NVIDIA introduces Dynamic Memory Sparsification technique that reduces LLM reasoning costs by 8x through intelligent KV cache management without accuracy loss.
-
MiniMax M2.5: 230B Parameter MoE Model Coming to HuggingFace
MiniMax officially confirms open-source release of M2.5, a 230B parameter MoE model with only 10B active parameters, showing impressive SWE-Bench performance at 80.2%.