Tagged "manual"

4 articles tagged manual, 31 August 2026 to 1 September 2026. Newest first.

• FreeToken: Edge-Native MoE Serving with CPU-GPU Co-Execution 1 September 2026

  FreeToken is an open-source engine for running 290B+ Mixture-of-Experts models locally on consumer hardware through bandwidth-adaptive CPU-GPU co-execution, with elastic memory management, expert caching, and support for DeepSeek, Qwen and GLM models across NVIDIA RTX 30/40/50 series.

• NVIDIA Research: Small Language Models Are the Future of Agentic AI 31 August 2026

  NVIDIA Research argues that small language models are more suitable and economical than LLMs for many agentic tasks, with on-device and real-time inference among the motivating scenarios.

• Gemma 4 MoE for Agentic Coding: Testing Open-Weight Models on AMD APU Hardware 31 August 2026

  Alex Ewerlof runs Gemma 4 26B MoE for coding on an AMD Ryzen 7 PRO 250 APU with 64GB of RAM, and reports that tooling closes much of the gap to proprietary models — at the cost of cold starts and slower inference.

• DeepSeek Harness: Open-Source Agent Framework with Plugin-Based Architecture 31 August 2026

  DeepSeek AI has published an open-source agent harness (dsh) built on a plugin architecture, run locally via a web UI. It is a developer preview, with compatibility-breaking changes expected.