< cd ../gallery

[AI & ML]

glm-5.2-sm120 by 0xSero

GLM-5.2-NVFP4-REAP-469B serving on SM120 (4× RTX PRO 6000 Blackwell) — one-command vLLM launch recipe, 250K context, DeepSeek Sparse Attention + MTP speculative decode. Maintained by 0xSero on GitHub, where it has earned 152 stars from the community.

maintainer

★ 152 stars

9 forks

2 watchers

# install

pip install glm-5.2-sm120

# tags

Shell Blackwell Glm Llm Inference Moe

languages

last commit4mo ago

license—

more vLLM repos

Optimized vLLM setup for Qwen3.6-27B-FP8 on dual RTX PRO 6000 Blackwell (192 GB GDDR7, no NVLink); config, benchmark sweep results, and custom chat template with thinking mode off by default. Maintained by theogravity on GitHub, where it has earned 18 stars from the community.

@theogravity5mo ago

NVFP4 inference on Blackwell GeForce (RTX 5090/5080/5070 Ti/RTX PRO 6000) — SM120 patches for vLLM + FlashInfer + CUTLASS. 175 tok/s on Qwen3.6-35B MoE. Maintained by lna-lab on GitHub, where it has earned 22 stars from the community.

@lna-lab5mo ago

DFlash vLLM for DGX Spark — Plug & Play Block-Diffusion Speculative Decoding. Maintained by AEON-7 on GitHub, where it has earned 54 stars from the community.