InferenceBench by aisa-group

DeepSeek-V3, R1 671B on 8xH100 Throughput Benchmarks. Maintained by dzhsurf on GitHub, where it has earned 22 stars from the community.

Serve Llama 3.3 70B (with AWQ quantization) using vLLM and deploy it on BentoCloud. Maintained by kingabzpro on GitHub, where it has earned 31 stars from the community.

Open-source local AI server configs, GFX906 runtime maintenance, reproducible benchmarks, and QC methods for affordable AI research infrastructure. Maintained by joe2gaan on GitHub, where it has earned 12 stars from the community.