Tagged "small-language-models"
13 articles tagged small-language-models, 11 February 2026 to 6 September 2026. Newest first.
-
llama.cpp 0.4.0: Qwen3.8-Flash-Next and On-Demand Tensor Reading
The latest llama.cpp release introduces support for Qwen3.8-Flash-Next models, on-demand tensor reading, per-slot server context limits, and sparse flash attention improvements.
-
NVIDIA Research: Small Language Models Are the Future of Agentic AI
NVIDIA Research argues that small language models are more suitable and economical than LLMs for many agentic tasks, with on-device and real-time inference among the motivating scenarios.
-
Leveraging Local Small Language Models for Project-Specific Deployment
A comprehensive guide on effectively deploying and customizing smaller language models for local inference in specific applications, balancing capability with resource constraints.
-
Claude Code Cut System Prompt by 80%: Implications for Small Local Models
Anthropic's dramatic 80% system prompt reduction in Claude Code raises questions about prompt efficiency for smaller, resource-constrained models deployed locally.
-
Code Mode Can Help Smaller LLM Models
A technique enabling smaller language models to improve performance through code-based reasoning and structured outputs, relevant for resource-constrained local deployments.
-
OpenBMB Runs Local Agents with MiniCPM5-1B – Efficient LLM for Edge Deployment
OpenBMB demonstrates local agent execution using MiniCPM5-1B, an extremely efficient model optimized for on-device inference and agentic workflows.
-
I Put a Local LLM on My Phone and Stopped Needing Cloud AI for Most Tasks
Practical demonstrations show that modern optimized language models can run efficiently on smartphones, eliminating cloud API dependency for many everyday AI tasks. Mobile local inference offers privacy, offline availability, and reduced latency for real-world applications.
-
Apple Research Shows Self-Distillation Significantly Improves Local Code Generation
A new Apple research paper demonstrates that embarrassingly simple self-distillation techniques can meaningfully improve code generation quality in smaller language models, with implications for on-device coding assistants.
-
Ultra-Compact 28M Parameter Models Show Promise for Specialized Domain Tasks
Experimental work with tiny 28M parameter models fine-tuned on specific domains (like business email) reveals viable pathways for training task-specific models that run on extremely resource-constrained devices.
-
Qwen 3.5 Ultra-Compact Models Enable On-Device AI from Watches to Gaming
The latest Qwen 3.5 lineup, including the 0.8B variant, demonstrates that state-of-the-art small language models can now run on severely constrained devices while maintaining impressive capabilities, from vision tasks to game-playing agents.
-
Fine-Tuned Qwen SLMs (0.6–8B) Demonstrate Competitive Performance Against Frontier LLMs on Specialized Tasks
A systematic benchmarking study shows that properly fine-tuned Qwen3 small language models can match or exceed the performance of frontier LLMs like GPT-5 and Claude on narrowly-scoped tasks, validating the viability of local model specialization strategies.
-
Alibaba's Qwen 3.5 Small Model Runs Directly on iPhone 17
Alibaba releases Qwen 3.5, a lightweight AI model optimized for on-device inference on Apple's iPhone 17. This breakthrough demonstrates practical edge deployment of capable language models on consumer mobile hardware.
-
Nanbeige4.1-3B: A Small General Model that Reasons, Aligns, and Acts
Nanbeige LLM Lab releases a new open-source 3B parameter model designed to achieve strong reasoning, preference alignment, and agentic behavior in a compact form factor ideal for local deployment.