< cd ../gallery
[DevTools]
GLM-5.2-NVFP4-KV-4x-DGX-Spark-300kctx-42tok-s by tonyd2wild
GLM-5.2 744B with a true 4-bit NVFP4 KV cache on 4x DGX Spark: 42 tok/s peak, 317K-token KV pool (+58.6% vs fp8), needle-verified at 250K depth, serving 316K context. Maintained by tonyd2wild on GitHub, where it has earned 12 stars from the community.
@tonyd2wild
maintainer
★ 12 stars
# install
pip install glm-5.2-nvfp4-kv-4x-dgx-spark-300kctx-42tok-smore vLLM repos
DevTools
GLM-5.2 (744B/40B MoE) on a 4× DGX Spark / GB10 (sm_121) cluster: portable Triton sparse-MLA kernels, a data-free expert prune, MTP draft, and a one-script bootstrap. Maintained by CosmicRaisins on GitHub, where it has earned 36 stars from the community.
2mo ago
DevTools
DGX Spark research and tests - containers, benchmarks, and investigation notes for running models on GB10 (SM 12.1). Maintained by Sggin1 on GitHub, where it has earned 18 stars from the community.
4mo ago
DevTools
GLM-5.2 on 4x DGX Spark with adaptive MTP K2/K4/K5, FULL CUDA graphs, DCP2, 520K context, and a downloadable ARM64 runtime image. Maintained by 0xdfi on GitHub, where it has earned 11 stars from the community.
8w ago
