< cd ../gallery
[DevTools]

GLM-5.2-NVFP4-KV-4x-DGX-Spark-300kctx-42tok-s

GLM-5.2 744B with a true 4-bit NVFP4 KV cache on 4x DGX Spark: 42 tok/s peak, 317K-token KV pool (+58.6% vs fp8), needle-verified at 250K depth, serving 316K context
tonyd2wild
@tonyd2wild
maintainer
★ 12 stars
github
glm-5-2-nvfp4-kv-4x-dgx-spark-300kctx-42tok-s — preview
GLM-5.2-NVFP4-KV-4x-DGX-Spark-300kctx-42tok-s repository preview
# README
GLM-5.2 744B with a true 4-bit NVFP4 KV cache on 4x DGX Spark: 42 tok/s peak, 317K-token KV pool (+58.6% vs fp8), needle-verified at 250K depth, serving 316K context. Maintained by tonyd2wild on GitHub, where it has earned 12 stars from the community.
It's actively developed around dgx-spark, gb10, glm, and is a solid reference for anyone building with these tools.
# tags
# install
npm install GLM-5.2-NVFP4-KV-4x-DGX-Spark-300kctx-42tok-s
languages
last commit6w ago
licenseApache-2.0
more vLLM repos

Ask MadeWithWhat

AI answers may contain mistakes — please double-check important details.