Tagged "on-device-llm"
5 articles tagged on-device-llm, 25 February 2026 to 31 May 2026. Newest first.
-
Show HN: seed – Self-Modifying Webpage with On-Device LLM
A novel project demonstrating an LLM running entirely in-browser with the webpage code stored in the URL itself, enabling true on-device inference without external dependencies.
-
BibCrit – LLM Grounded in ETCBC Corpus Data for Biblical Textual Criticism
A specialised local LLM model fine-tuned on the ETCBC corpus for biblical textual analysis, demonstrating how domain-specific models can be deployed locally for expert applications. Exemplifies niche use cases for on-device inference.
-
Running an Open-Weight LLM Locally on an Apple Watch
A developer demonstrates successfully running an open-weight LLM directly on Apple Watch hardware, pushing the boundaries of edge inference on ultra-constrained devices.
-
The Emerging Role of SRAM-Centric Chips in AI Inference
Hardware architectures optimized around SRAM are reshaping AI inference capabilities for edge and local deployments. This emerging trend addresses critical bottlenecks in memory bandwidth and latency for on-device LLM execution.
-
New Era of On-Device AI Driven by High-Speed UFS 5.0 Storage
UFS 5.0 storage technology is enabling faster on-device AI inference by dramatically improving data throughput on mobile and edge devices. This hardware advancement removes I/O bottlenecks that previously limited local LLM deployment on consumer hardware.