Tagged "arm-optimization"
6 articles tagged arm-optimization, 14 February 2026 to 1 June 2026. Newest first.
-
Qualcomm Reveals Snapdragon C with Advanced On-Device AI Engine
Qualcomm announces Snapdragon C processor featuring a 6nm process, optimised core configuration, and dedicated on-device AI accelerator. The chip targets mobile and edge devices for local AI inference.
-
Running AI Models Locally on M4 Processors with 24GB Memory
A technical guide explores deploying language models on Apple M4 devices with 24GB unified memory, demonstrating Apple Silicon's capabilities for local inference. The approach leverages frameworks optimized for ARM architecture and unified memory access.
-
Building a Raspberry Pi-Based Local LLM Server for Remote Access
A developer successfully deployed a local LLM server on a Raspberry Pi with remote access capabilities, demonstrating viable edge inference on minimal hardware.
-
Building a Remote-Accessible Local LLM Server on Raspberry Pi
A practical guide demonstrating how to deploy and access a local LLM server running on a Raspberry Pi from anywhere, combining edge deployment with convenient remote access.
-
Running a 1.7B Parameters LLM on an Apple Watch
A developer successfully deployed a 1.7 billion parameter language model on an Apple Watch, demonstrating extreme edge inference capabilities on ultra-constrained wearable hardware.
-
Scaling llama.cpp On Neoverse N2: Solving Cross-NUMA Performance Issues
Deep dive into optimizing llama.cpp performance on ARM Neoverse N2 processors, addressing critical NUMA topology challenges for better local inference scaling.