< cd ../gallery
One-click Qwen3.6-27B inference on Windows. 158 tok/s on RTX 5090, 72 tok/s on RTX 3090. Native, no WSL, no Docker, no telemetry. Maintained by devnen on GitHub, where it has earned 227 stars from the community.
# install
pip install qwen3.6-windows-servermore vLLM repos
AI & ML
Patched native-Windows build of vLLM. Three Windows-specific fixes (CPU-relay for Gloo, Qwen3 reasoning parser, wildcard model name) on top of SystemPanic 0.19.0. Engine for devnen/qwen3.6-windows-server. Maintained by devnen on GitHub, where it has earned 25 stars from the community.
5mo ago
AI & ML
SNDR Core Engine (Genesis) — vLLM runtime patch-overlay for Qwen3.6 + Gemma4 on consumer NVIDIA (Ampere sm_86, 2× A5000/3090). Qwen3.6-35B-A3B FP8 ~240 tok/s, 27B-int4 hybrid GDN+Mamba, Gemma4 26B/31B AWQ, 256K ctx. 321 patches: TurboQuant k8v4 KV, MTP/DFlash spec-decode, FULL cudagraph, hybrid GDN. vLLM pin dev424 + Control Center GUI. Maintained by Sandermage on GitHub, where it has earned 131 stars from the community.
2mo ago
AI & ML
Local LLM speed measurements from a 4x RTX 3090 rig, with exact launch commands and per-run provenance. Maintained by alesha-pro on GitHub, where it has earned 13 stars from the community.
2mo ago