< cd ../gallery
Reproducible recipe: serve abliterated Gemma-4-12B (gemma4_unified) at 50-118 tok/s on no-NVLink Blackwell (SM120) via vLLM nightly + ModelOpt FP8/NVFP4 + MTP spec-decode. Maintained by lna-lab on GitHub, where it has earned 15 stars from the community.
@lna-lab
maintainer
★ 15 stars
# install
pip install gemma4-12b-vllm-sm120more vLLM repos
DevTools
Lna-Lab production pipeline: GGUF -> modelopt-format NVFP4 + working MTP head for vLLM on RTX PRO 6000 Blackwell (SM120). Stages 2 (NVFP4) and 3 (MTP graft) are Lna-Lab originals; stage 1 (GGUF->bf16) reuses li-yifei/gguf-to-nvfp4. Maintained by lna-lab on GitHub, where it has earned 10 stars from the community.
5mo ago
DevTools
Automated Triton w8a8 block FP8 kernel tuning tool for vLLM. Auto-detects model architecture, supports Qwen3-Coder-30B-A3B-Instruct-FP8/DeepSeek-V3/custom models, multi-GPU parallel tuning, and generates optimized kernel configs for quantization. Maintained by massif-01 on GitHub, where it has earned 13 stars from the community.
5mo ago
DevTools
GLM-5.2 (744B/40B MoE) on a 4× DGX Spark / GB10 (sm_121) cluster: portable Triton sparse-MLA kernels, a data-free expert prune, MTP draft, and a one-script bootstrap. Maintained by CosmicRaisins on GitHub, where it has earned 36 stars from the community.
2mo ago