Tagged "model-scaling"

14 articles tagged model-scaling, 12 February 2026 to 19 May 2026. Newest first.

• I Stopped Trying to Replace My Cloud LLMs, and Local Models Finally Made Sense 19 May 2026

  A practitioner shares insights on when and why local LLMs become practical replacements for cloud APIs, moving beyond the hype to focus on real-world use cases and total cost of ownership. The piece highlights recent improvements in inference speed and model quality that have shifted the economics.

• Google's Gemma 4 Could Put Powerful AI on Your Phone and Laptop 27 April 2026

  Google prepares Gemma 4 with optimizations targeting local deployment on consumer phones and laptops, continuing the trend of shifting powerful models from cloud to edge devices.

• I Replaced My Local LLM With a Model Half Its Size and Got Better Results — and It Wasn't About the Parameters 9 April 2026

  A detailed account of how switching to a smaller, better-optimized model outperformed a larger predecessor on local hardware, challenging assumptions about model scaling and practical performance.

• Gemma 4 31B Achieves Exceptional Performance on Local Hardware 6 April 2026

  Google's new Gemma 4 31B model is delivering frontier-level performance at a fraction of the cost, outperforming much larger models like GPT-5.2 and Claude Opus on benchmark leaderboards while remaining viable for local deployment.

• Qwen 3.5 397B emerges as top-performing local coding model 21 March 2026

  Users report that Qwen 3.5 397B significantly outperforms competing local models including GPT-OSS 120B and Nemotron 120B for code generation tasks, despite slower inference speeds.

• Mamba 3: State Space Model Architecture Optimized for Inference 18 March 2026

  Mamba 3 introduces a state space model architecture specifically optimized for efficient inference performance, offering a potential alternative to traditional transformer-based architectures for local deployment.

• Sarvam Open-Sources 30B and 105B Reasoning Models 11 March 2026

  Indian AI startup Sarvam has released open-source reasoning models in 30B and 105B parameter sizes, providing locally-deployable alternatives for reasoning tasks without reliance on proprietary APIs.

• Sarvam Open-Sources 30B and 105B Reasoning Models 9 March 2026

  Indian AI lab Sarvam has released open-source reasoning models in 30B and 105B parameter sizes, providing alternatives to proprietary reasoning systems. These models are optimized for local deployment and logical inference tasks.

• Running Local AI Models on Mac Studio 128GB: 4B, 20B & 120B Tested 2 March 2026

  A comprehensive benchmark test evaluated performance of local LLM inference on Mac Studio with 128GB memory, testing models ranging from 4B to 120B parameters. Results provide practical guidance for practitioners evaluating local deployment on Apple's high-end hardware.

• Qwen 3.5-27B Demonstrates Exceptional Performance with Thoughtful Prompt Engineering 28 February 2026

  Users report that Qwen 3.5-27B significantly exceeds expected performance for its size when paired with effective prompting strategies, suggesting prompt engineering can bridge the capability gap between model sizes.

• Krasis: Hybrid CPU/GPU MoE Runtime Achieves 3,324 Tokens/Second Prefill on RTX 5080 28 February 2026

  New open-source runtime optimises mixture-of-experts models by splitting prefill to GPU and decode to CPU, enabling larger MoE models to run on single consumer GPUs with dramatic throughput improvements.

• GLM-5 Technical Report: DSA Innovation Reduces Training and Inference Costs 18 February 2026

  Alibaba releases GLM-5 technical report detailing key innovations including DSA adoption that significantly reduces training and inference costs while maintaining long-context fidelity.

• Context Management Identified as Real Bottleneck in AI-Assisted Coding 14 February 2026

  Discussion highlights how context window limitations and management, rather than model capabilities, represent the primary challenge for local AI coding assistants.

• GLM-5 Released: 744B Parameter MoE Model Targeting Complex Tasks 12 February 2026

  Zhipu AI releases GLM-5, a massive 744B parameter MoE model with 32B active parameters, designed for complex systems engineering and long-horizon agentic tasks with significant performance improvements over GLM-4.5.