Tagged "algorithmic-optimization"
3 articles tagged algorithmic-optimization, 9 April 2026 to 20 April 2026. Newest first.
-
llama.cpp Merges Speculative Checkpointing for Major Inference Speed Boost
llama.cpp integrates speculative checkpointing techniques to significantly accelerate local AI inference performance, enabling faster token generation on consumer hardware.
-
DFlash Speculative Decoding Achieves 3.3x Speedup on Apple Silicon
A native MLX implementation of DFlash speculative decoding reaches 85 tokens/second on Qwen 3.5-9B running on Apple M5 Max, delivering a 3.3x performance boost through parallel draft token generation and single-pass verification.
-
Speculative Decoding Made My Local LLM Actually Usable
A practitioner shares how implementing speculative decoding techniques dramatically improved inference speed on local LLM deployments, making previously unusable models practical for daily use.