Tagged "memory-constrained-inference"
3 articles tagged memory-constrained-inference, 21 February 2026 to 15 April 2026. Newest first.
-
SigMap – Shrink AI Coding Context 97% with Auto-Scaling Token Budget
SigMap introduces an auto-scaling token budget system that reduces AI coding context by 97%, enabling more efficient local model inference for code generation and analysis tasks. This performance optimization is critical for running models on memory-constrained devices.
-
Nummi – AI Companion with Memory and Daily Guidance
Nummi launches as a downloadable AI companion application featuring persistent memory and personalized guidance, showcasing how local LLM deployment enables continuous, context-aware interactions without relying on cloud infrastructure.
-
Strix Halo Performance Benchmarks: Minimax M2.5, Step 3.5 Flash, Qwen3 Coder
New benchmarks show how recent compact models (Minimax M2.5, Step 3.5 Flash, Qwen3 Coder Next) perform on Strix Halo processors, providing practical guidance for developers choosing models for memory-constrained edge deployments.