Tagged "memory-constraints"
3 articles tagged memory-constraints, 29 March 2026 to 21 August 2026. Newest first.
-
llama.cpp b10549: Tensor Parallelism Support for LFM2/LFM2MOE Models
Latest llama.cpp release enables tensor split for LFM2 and LFM2MOE models, expanding multi-GPU inference capabilities for local deployment.
-
Apple Unveils AFM 3 Core Advanced with 20 Billion Parameters for On-Device AI
Apple introduced the AFM 3 Core Advanced architecture at WWDC26, featuring a 20 billion parameter model optimized for on-device inference. This represents a significant milestone in local LLM deployment on consumer hardware with architectural innovations to overcome memory constraints.
-
Google's TurboQuant Shows Memory Constraints Remain Critical for Local LLM Inference
Insights from KAIST researchers involved in Google's TurboQuant quantisation work highlight how memory demands continue to be the fundamental bottleneck limiting local LLM deployment at scale.