< cd ../gallery
Open recipes, engine patches, and benchmark harnesses for LLM inference on Intel Arc Pro B60/B70 (Battlemage, Xe2). MoE 35B at 126 t/s decode / 7.5K t/s prefill single-stream — vLLM XPU MTP unlocked. Maintained by SergiioB on GitHub, where it has earned 16 stars from the community.
@SergiioB
maintainer
★ 16 stars
# install
pip install intel-arc-pro-b70-inference-cookbookmore vLLM repos
AI & ML
nano-vllmmoeSpeculative Decoding. Maintained by banfeb on GitHub, where it has earned 11 stars from the community.
4mo ago
AI & ML
A Scheduler for Batched LLM Inference. Maintained by iPieter on GitHub, where it has earned 19 stars from the community.
1y ago
AI & ML
NVFP4 inference on Blackwell GeForce (RTX 5090/5080/5070 Ti/RTX PRO 6000) — SM120 patches for vLLM + FlashInfer + CUTLASS. 175 tok/s on Qwen3.6-35B MoE. Maintained by lna-lab on GitHub, where it has earned 22 stars from the community.
5mo ago
