< cd ../gallery
[AI & ML]
vllm-windows by devnen
Patched native-Windows build of vLLM. Three Windows-specific fixes (CPU-relay for Gloo, Qwen3 reasoning parser, wildcard model name) on top of SystemPanic 0.19.0. Engine for devnen/qwen3.6-windows-server. Maintained by devnen on GitHub, where it has earned 25 stars from the community.
# install
pip install vllm-windowsmore vLLM repos
AI & ML
One-click Qwen3.6-27B inference on Windows. 158 tok/s on RTX 5090, 72 tok/s on RTX 3090. Native, no WSL, no Docker, no telemetry. Maintained by devnen on GitHub, where it has earned 227 stars from the community.
5mo ago
AI & ML
A "standard library" of Triton kernels. Maintained by stackav-oss on GitHub, where it has earned 26 stars from the community.
1y ago
AI & ML
Benchmarks and notes for running modern LLMs with vLLM on 8x Tesla V100-32GB in 2026. Maintained by KumphanartDansiri on GitHub, where it has earned 10 stars from the community.
3mo ago
