Tagged "token-management"
5 articles tagged token-management, 20 February 2026 to 30 August 2026. Newest first.
-
Controlling Reasoning Token Budgets in llama.cpp
Cap how many tokens a reasoning model spends thinking — with server flags, undocumented per-request fields, and a mid-stream interrupt. Includes what it costs you in throughput.
-
Gemini CLI – Open-Source AI Agent for Terminal Integration
Google released an open-source CLI tool that brings Gemini AI capabilities into terminal environments, enabling developers to integrate AI reasoning directly into command-line workflows and scripting. This provides another option for local-first AI integration in development pipelines.
-
Practical Fix for Qwen 3.5 Overthinking in llama.cpp
Community members share techniques to mitigate Qwen 3.5's verbose internal reasoning loops, offering practical optimization strategies for controlling model behavior in local inference environments.
-
Llama.cpp Adds True Reasoning Budget Support
Llama.cpp has implemented full support for reasoning budgets, allowing users to control and optimize inference costs for reasoning models. This feature moves beyond previous stub implementations to provide real control over thinking token allocation.
-
Show HN: Forked – A Local Time-Travel Debugger for OpenClaw Agents
Forked introduces time-travel debugging capabilities for local LLM-based agents, enabling developers to inspect and replay agent execution states for better debugging and optimization.