< cd ../gallery
[AI & ML]
dual-rtx-6000-blackwell-qwen3.6-27b-fp8 by theogravity
Optimized vLLM setup for Qwen3.6-27B-FP8 on dual RTX PRO 6000 Blackwell (192 GB GDDR7, no NVLink); config, benchmark sweep results, and custom chat template with thinking mode off by default. Maintained by theogravity on GitHub, where it has earned 18 stars from the community.
@theogravity
maintainer
★ 18 stars
# install
more vLLM repos
AI & ML
GLM-5.2-NVFP4-REAP-469B serving on SM120 (4× RTX PRO 6000 Blackwell) — one-command vLLM launch recipe, 250K context, DeepSeek Sparse Attention + MTP speculative decode. Maintained by 0xSero on GitHub, where it has earned 152 stars from the community.
4mo ago
AI & ML
Serve Poolside Laguna S 2.1 (NVFP4) on the NVIDIA DGX Spark (GB10) without hanging your box. Working stack, crash-safe configs, benchmarks, and the exact gotchas. Maintained by sudoingX on GitHub, where it has earned 18 stars from the community.
3mo ago
AI & ML
Benchmarks and notes for running modern LLMs with vLLM on 8x Tesla V100-32GB in 2026. Maintained by KumphanartDansiri on GitHub, where it has earned 10 stars from the community.
3mo ago
