< cd ../gallery
[AI & ML]
vllm-windows-build
Native Windows vLLM 0.24.0: Python 3.13, CUDA 12.8, PyTorch 2.11 cu128, RTX 30/40/50 wheel, hardened portable installer with legacy PowerShell support, Qwen3-VL/FlashAttention fixes, Rust frontend/tool parser, OpenAI server fixes, and 10 KV-cache compression dtypes.
@aivrar
maintainer
★ 28 stars
# README
Native Windows vLLM 0.24.0: Python 3.13, CUDA 12.8, PyTorch 2.11 cu128, RTX 30/40/50 wheel, hardened portable installer with legacy PowerShell support, Qwen3-VL/FlashAttention fixes, Rust frontend/tool parser, OpenAI server fixes, and 10 KV-cache compression dtypes. Maintained by aivrar on GitHub, where it has earned 28 stars from the community.
It's actively developed around awq, cuda, flash-attention, and is a solid reference for anyone building with these tools.
# tags
# install
npm install vllm-windows-buildmore vLLM repos
