Tagged "tensor-parallelism"
3 articles tagged tensor-parallelism, 28 June 2026 to 21 August 2026. Newest first.
-
llama.cpp b10549: Tensor Parallelism Support for LFM2/LFM2MOE Models
Latest llama.cpp release enables tensor split for LFM2 and LFM2MOE models, expanding multi-GPU inference capabilities for local deployment.
-
K3 Model Achieves 20 Tokens/Second on 80x RTX 5090 Cluster
Benchmark results show K3 model inference achieving 20 tokens per second across an 80-GPU RTX 5090 setup, providing insights into scaling strategies for high-throughput local deployments.
-
A Guide on How to Run Nemotron 3 Super 120B Thinking on 2 Nvidia DGX Spark
Practical deployment guide for running NVIDIA's large reasoning model (120B parameters) on a two-node DGX Spark cluster with distributed inference techniques.