< cd ../gallery
[DevTools]
localaiservers by joe2gaan
Open-source local AI server configs, GFX906 runtime maintenance, reproducible benchmarks, and QC methods for affordable AI research infrastructure. Maintained by joe2gaan on GitHub, where it has earned 12 stars from the community.
@joe2gaan
maintainer
★ 12 stars
# install
pip install localaiserversmore vLLM repos
DevTools
vLLM tool parser for Qwen2.5-Coder models using <tools> tag format. Maintained by hanXen on GitHub, where it has earned 12 stars from the community.
5mo ago
DevTools
GLM-5.2 on 4x DGX Spark with adaptive MTP K2/K4/K5, FULL CUDA graphs, DCP2, 520K context, and a downloadable ARM64 runtime image. Maintained by 0xdfi on GitHub, where it has earned 11 stars from the community.
8w ago
DevTools
Automated Triton w8a8 block FP8 kernel tuning tool for vLLM. Auto-detects model architecture, supports Qwen3-Coder-30B-A3B-Instruct-FP8/DeepSeek-V3/custom models, multi-GPU parallel tuning, and generates optimized kernel configs for quantization. Maintained by massif-01 on GitHub, where it has earned 13 stars from the community.
5mo ago
