< cd ../gallery
NVFP4 inference on Blackwell GeForce (RTX 5090/5080/5070 Ti/RTX PRO 6000) — SM120 patches for vLLM + FlashInfer + CUTLASS. 175 tok/s on Qwen3.6-35B MoE. Maintained by lna-lab on GitHub, where it has earned 22 stars from the community.
# install
pip install blackwell-geforce-nvfp4-gemmmore vLLM repos
AI & ML
A Scheduler for Batched LLM Inference. Maintained by iPieter on GitHub, where it has earned 19 stars from the community.
1y ago
AI & ML
Open recipes, engine patches, and benchmark harnesses for LLM inference on Intel Arc Pro B60/B70 (Battlemage, Xe2). MoE 35B at 126 t/s decode / 7.5K t/s prefill single-stream — vLLM XPU MTP unlocked. Maintained by SergiioB on GitHub, where it has earned 16 stars from the community.
8w ago
AI & ML
DFlash vLLM for DGX Spark — Plug & Play Block-Diffusion Speculative Decoding. Maintained by AEON-7 on GitHub, where it has earned 54 stars from the community.
3mo ago