< cd ../gallery
[DevTools]
gemma4-12b-vllm-sm120
Reproducible recipe: serve abliterated Gemma-4-12B (gemma4_unified) at 50-118 tok/s on no-NVLink Blackwell (SM120) via vLLM nightly + ModelOpt FP8/NVFP4 + MTP spec-decode.
@lna-lab
maintainer
★ 15 stars
# README
Reproducible recipe: serve abliterated Gemma-4-12B (gemma4_unified) at 50-118 tok/s on no-NVLink Blackwell (SM120) via vLLM nightly + ModelOpt FP8/NVFP4 + MTP spec-decode. Maintained by lna-lab on GitHub, where it has earned 15 stars from the community.
It's actively developed around abliterated, blackwell, fp8, and is a solid reference for anyone building with these tools.
# tags
# install
npm install gemma4-12b-vllm-sm120more vLLM repos
