Tagged "inference-pipeline"
3 articles tagged inference-pipeline, 5 May 2026 to 23 September 2026. Newest first.
-
Transformers Library Now Runs llama.cpp Quantized Models
Hugging Face's Transformers library now supports inference with llama.cpp quantized models, significantly expanding compatibility for local LLM deployment. This integration makes it easier for practitioners to leverage highly optimized quantizations in standard Python workflows.
-
LM Studio 0.4 Introduces Headless Deployment for Local LLM APIs
LM Studio 0.4 adds headless mode enabling local LLM serving without the GUI, expanding deployment flexibility for production and edge scenarios.
-
Show HN: Memex, Claude Memory via Local RAG with MCP and Offline Embeddings
Memex enables persistent memory for Claude through local retrieval-augmented generation using offline embeddings and Model Context Protocol, eliminating cloud dependency for context management.