Tagged "production"
17 articles tagged production, 26 February 2026 to 7 August 2026. Newest first.
-
Ask HN: What Observability Stack Are You Using for AI Agents in Production?
A Hacker News discussion surfacing critical operational challenges: how do teams monitor and debug AI agents running in production? This conversation captures the current state of observability tooling for local and self-hosted agents.
-
Ask HN: What are you using for LLM inference in production?
Community discussion revealing current production setups for local LLM inference, including frameworks, hardware choices, and real-world deployment patterns from practitioners.
-
Enprompta: Prompt Registry, LLM Evals, and Observability for Production AI Apps
A new platform providing prompt management, evaluation frameworks, and observability tools designed specifically for production LLM applications, enabling better governance and monitoring of local deployments.
-
What Every AI Builder Learns the Hard Way
A video compilation of hard-won lessons from experienced AI practitioners deploying models in production, covering practical challenges and solutions.
-
Beyond Setup: Production Practices for Local LLM Deployment
A practical guide exploring what comes after initial local LLM setup, covering production considerations like monitoring, optimization, and operational best practices for sustained on-device inference.
-
SynapseKit: A New Production Framework for Deploying LLMs
Engineers have released SynapseKit, a production-focused LLM framework addressing real-world challenges in deploying language models at scale. The framework aims to solve gaps identified in existing deployment solutions.
-
Self-Hosted LLMs in Production: Real-World Limits and Practical Lessons
Deep dive into the operational challenges and workarounds for deploying LLMs in production environments, drawing on practical experience with self-hosted systems.
-
Developer Replaced GPT-4 with a Local SLM and CI/CD Pipeline Stability Improved
A Towards Data Science article documents a successful case study where replacing cloud-based GPT-4 calls with local small language models improved CI/CD pipeline reliability and reduced operational costs. This practical demonstration proves the value of local deployment for production systems.
-
The AI-Ready Product Data Framework for B2B Commerce
A framework for structuring product data to enable efficient local and edge-based AI processing in B2B commerce applications.
-
OpenClaw at 250K GitHub Stars: Community Explores Practical Limitations Beyond News Digests
After deploying OpenClaw across 1,000+ isolated VMs, infrastructure operators share findings that despite massive adoption, the most reliable use case remains automated news digests, prompting discussion about real-world limitations.
-
Ollama's Limitations for Production Local LLM Deployments
A critical analysis reveals that while Ollama excels as an easy entry point for local LLMs, it faces significant challenges when scaled to production environments. Industry practitioners highlight the gap between getting started and running stable, long-term inference workloads.
-
Ollama is Still the Easiest Way to Start Local LLMs, But It's the Worst Way to Keep Running Them
XDA explores Ollama's strengths as an onboarding tool while highlighting critical limitations for production deployment, including resource management and scalability issues that practitioners need to address.
-
RAG Deployment Lessons from Regulated Industries
Practical insights from deploying RAG-powered local AI assistants in highly regulated sectors including construction, aged care, and mining operations.
-
Building a Production AI Receptionist: Practical Local LLM Deployment Case Study
A detailed walkthrough of deploying a custom AI receptionist system for a real business, demonstrating practical considerations for productionizing local language models in service scenarios.
-
Show HN: Detect When an LLM Silently Changes Behavior for the Same Prompt
A new tool enables monitoring and detecting when LLMs silently alter their responses for identical prompts, addressing a critical reliability concern for production deployments.
-
Nota AI to Showcase End-to-End On-Device AI Optimization at Embedded World 2026
Nota AI will demonstrate complete on-device AI solutions from edge optimization to industrial deployment at Embedded World 2026. The showcase highlights production-ready approaches for deploying optimized AI across constrained hardware environments.
-
The Complete Developer's Guide to Running LLMs Locally: From Ollama to Production
A comprehensive guide covering the full lifecycle of deploying LLMs locally, from initial setup with Ollama to production-ready deployments. Essential resource for developers transitioning from cloud-based APIs to self-hosted inference.