< cd ../gallery
[AI & ML]
gfx906-fa-vllm by nick413-bit
FlashAttention-style custom attention backend for vLLM on AMD MI50/MI60/Radeon VII (gfx906). Downstream fork of mixa3607/ML-gfx906 with replacement HIP kernels and a vllm.general_plugins entry point. Maintained by nick413-bit on GitHub, where it has earned 14 stars from the community.
# install
pip install gfx906-fa-vllmmore vLLM repos
AI & ML
MinerU AMD vLLM + hybrid-auto-engine ！ AMD/ROCm 。 MinerU 3.x ROCm 7.x + PyTorch 2.11.0 + vLLM ， NVIDIA 。. Maintained by buptanswer on GitHub, where it has earned 11 stars from the community.
4mo ago
AI & ML
[ICPP'25] TD-Pipe: Temporally-Disaggregated Pipeline Parallelism Architecture for High-Throughput LLM Inference. Maintained by MLSysU on GitHub, where it has earned 52 stars from the community.
9mo ago
AI & ML
A high-throughput LLM serving engine with non-uniform KV cache compression, built on vLLM. Maintained by aiha-lab on GitHub, where it has earned 13 stars from the community.
8w ago
