Tagged "unsloth"
13 articles tagged unsloth, 28 February 2026 to 16 August 2026. Newest first.
-
Unsloth Releases Qwen 3.8 27B GGUF Quantised Weights
Unsloth has published optimised GGUF format weights for Qwen 3.8 27B, enabling efficient local deployment with pre-quantised models that balance quality and memory footprint for consumer hardware.
-
Unsloth's Custom Kernels Make LLM Fine-Tuning Viable on Consumer GPUs
Unsloth releases optimized custom kernels that dramatically reduce memory overhead and training time for LLM fine-tuning on consumer-grade GPUs, making local model adaptation more accessible.
-
Unsloth Completes Comprehensive MiniMax M2.7 GGUF Quantization Suite
Unsloth has finished quantizing MiniMax M2.7 across the full range of GGUF quantization levels from 1-bit to BF16, providing practitioners with optimized variants for every hardware configuration from edge devices to high-end systems.
-
MiniMax M2.7 Released: New Model Available for Local Deployment
MiniMax has released the M2.7 model, generating significant interest in the LocalLLaMA community with rapid quantization support from Unsloth and other contributors. However, the model comes with restrictive licensing that prohibits commercial use without prior written permission.
-
Critical Unsloth Gemma-4 Chat Template Updates for Tool Calling
Unsloth has released updated Gemma-4 quantizations with corrected chat templates and reasoning budget fixes from Google, requiring users to redownload for proper tool calling functionality.
-
Gemma 4 GGUF Models Updated with Critical Quantization Fixes
Unsloth has released updated Gemma 4 GGUF quantizations addressing kv-cache issues and other inference problems. New versions are available for both 26B and 31B model sizes.
-
Gemma 4 26B MoE Emerges as Optimal All-Around Local Model for Consumer Hardware
Community testing reveals Gemma 4 26B MoE (Mixture of Experts) is well-suited for local deployment on consumer machines, with particular strength in coding tasks and memory efficiency. The model achieves impressive performance while remaining manageable on 16GB VRAM systems.
-
Google Gemma 4 Released with GGUF Quantizations
Google has released Gemma 4 with multiple model sizes (26B, 31B variants) already quantized in GGUF format by Unsloth, enabling immediate local deployment on consumer hardware.
-
Unsloth Studio Beta Ships 50+ New Features for Local Model Training and Inference
The Unsloth Studio project released substantial updates including pre-compiled llama.cpp and mamba_ssm binaries, expanding capabilities for local model fine-tuning and inference workflows. The rapid feature velocity demonstrates active development in the local LLM toolkit ecosystem.
-
Unsloth Studio: Open-Source Web UI for Training and Running LLMs Locally
Unsloth has launched Unsloth Studio (Beta), an Apache-licensed open-source web UI that unifies local LLM training and inference in a single interface, positioning itself as a potential alternative to LMStudio for GGUF ecosystem users.
-
Qwen 3.5 Family Benchmark Comparison Shows Strong Performance Across Smaller Models
New benchmarks reveal that Qwen 3.5's 27B, 35B, and 122B variants retain most of the flagship model's performance, while smaller 2B and 0.8B models show steeper degradation on long-context and agent tasks.
-
Switch Qwen 3.5 Thinking Mode On/Off Without Model Reload Using setParamsByID
Unsloth and Qwen community members have discovered how to toggle thinking vs. instruct mode on Qwen 3.5 without reloading the model, enabling dynamic workflow switching and reducing inference latency.
-
Unsloth Dynamic 2.0 GGUFs
Unsloth releases Dynamic 2.0 GGUF format models, advancing quantized model optimization for local inference with improved efficiency and compatibility across edge devices.