Tagged "offline-inference"
- Tiny microphone on my balcony to listen for any birds passing by
- Local LLMs Offer Unique Advantages That Cloud AI Services Cannot Match
- Maker Builds Offline Jetson-Powered Chatbot Suitcase
- HP's On-Device AI Needs More If It Is Going to Compete With Copilot
- Sarvam Edge: Indian-Built AI Models Run Offline on Phones and Laptops Without Internet
- Pocket LLM v1.5.0 Brings Multimodal AI to Android with No Cloud Required
- Show HN: I Can't Write Python. It Works Anyway – Local LLM Automation
- Noi Enables Running ChatGPT and Claude Side-by-Side on Your Desktop
- AIYO Wisper: Local Voice-to-Text for macOS Using WhisperKit
- AI PC Market Projected to Reach $235B by 2032, Driven by On-Device Computing Adoption
- Google AI Edge Gallery Showcases Offline Inference with Gemma 4
- Google's Gemma 4 Brings Powerful On-Device AI to Android and iOS
- TurboQuant KV Cache Compression Achieves 22.8% Faster Decoding at 32K Context