< cd ../gallery
[AI & ML]
llm-bench-rig
Dual-engine (llama.cpp + vLLM) LLM benchmarking pipeline for GGUF & safetensors on NVIDIA GPUs — speed, quality, live dashboard, publishable cards.
@notwitcheer
maintainer
★ 23 stars
# README
Dual-engine (llama.cpp + vLLM) LLM benchmarking pipeline for GGUF & safetensors on NVIDIA GPUs — speed, quality, live dashboard, publishable cards. Maintained by notwitcheer on GitHub, where it has earned 23 stars from the community.
It's actively developed around benchmarking, cuda, fastapi, and is a solid reference for anyone building with these tools.
# tags
# install
npm install llm-bench-rigmore vLLM repos
