Tagged "rust"
11 articles tagged rust, 18 February 2026 to 29 June 2026. Newest first.
-
LLM-Free, Layout-Aware PDF Chunker in Pure Rust
A new PDF chunking utility written in Rust that preserves document structure without requiring LLM inference, improving RAG pipeline efficiency for local deployments.
-
Local Semantic Search Engine in Rust, No External DB
LocalMind brings a lightweight semantic search implementation written in Rust that operates without external database dependencies, ideal for self-contained local search applications.
-
Bun's Experimental Rust Rewrite Achieves 99.8% Test Compatibility on Linux
Bun's Rust-based rewrite demonstrates significant progress in runtime performance and compatibility, relevant to local LLM inference infrastructure and deployment environments.
-
Sorting 1M u64 KV-Pairs in 20ms on i9-13980HX Using Branchless Rust Implementation
A deep dive into extreme performance optimisation for in-memory operations using branchless Rust code, achieving sub-20ms throughput for million-element datasets. Directly applicable to KV-cache and token management in local LLM inference.
-
Velr: Embedded Property-Graph Database for Local LLM Applications
Velr introduces an embedded property-graph database built in Rust on top of SQLite, enabling local LLM systems to maintain structured knowledge graphs without external dependencies.
-
Rust Project Perspectives on AI
The Rust project team discusses how AI intersects with systems programming and language design, with implications for building efficient local LLM infrastructure.
-
Glyph – A Local-First Markdown Notes App for macOS Built With Rust
A new native macOS notes application emphasizing local-first data storage and built with Rust for performance. Demonstrates practical integration patterns for embedding lightweight LLM features into productivity tools.
-
SynthesisOS – A Local-First, Agentic Desktop Layer Built in Rust
A new open-source desktop environment written in Rust that enables local-first, agentic AI capabilities without cloud dependencies. This represents a significant step toward truly autonomous, on-device AI agents for everyday computing tasks.
-
24 Simultaneous Claude Code Agents on Local Hardware
A Rust-based orchestration system demonstrating the ability to run 24 concurrent Claude Code agents on local hardware using tokio. This breakthrough shows the feasibility of deploying multi-agent systems for production workloads without cloud services.
-
Aegis.rs: Open Source Rust-Based LLM Security Proxy Released
Aegis.rs is the first open-source Rust-based LLM security proxy, providing input/output validation and security guardrails for local LLM deployments. This tool addresses critical security concerns when exposing local models to applications.
-
Cloudflare Releases Agents SDK v0.5.0 with Rust-Powered Infire Engine for Edge Inference
Cloudflare has upgraded its Agents SDK to v0.5.0, featuring a new Rust-based Infire engine that delivers optimized edge inference performance with improved latency and throughput.