Tagged "model-configuration"
3 articles tagged model-configuration, 25 February 2026 to 29 May 2026. Newest first.
-
Tweaking Local Language Model Settings with Ollama
A practical guide to optimizing Ollama configurations for various hardware setups and use cases, helping practitioners maximize inference performance on local systems.
-
Qwen3.5 122B Achieves 25 tok/s on 72GB VRAM Setup
Users report exceptional performance running Qwen3.5 122B across three 3090s with 72GB total VRAM, reaching 25 tokens/second with full GPU loading. The model demonstrates strong inference speed and practical viability for enthusiasts with mid-range hardware stacks.
-
Qwen3.5 Thinking Mode Can Be Disabled for Production Inference Optimization
Users can now disable Qwen3.5's thinking capability via llama.cpp configuration, enabling optimized inference parameters for instruct mode deployments without the reasoning overhead.