< cd ../gallery
[AI & ML]
llm-bench-rig by notwitcheer
Dual-engine (llama.cpp + vLLM) LLM benchmarking pipeline for GGUF & safetensors on NVIDIA GPUs — speed, quality, live dashboard, publishable cards. Maintained by notwitcheer on GitHub, where it has earned 26 stars from the community.
# install
pip install llm-bench-rigmore vLLM repos
AI & ML
Unified KV-cache compression for LLM inference: 12 Python-native methods, Debian-tested isolated add-ons, Godzilla KVarN/TriAttention, exact Godzilla/Gigatoken profiles, CUDA weight sharing, and multi-GPU planning. Maintained by aivrar on GitHub, where it has earned 25 stars from the community.
2mo ago
AI & ML
A "standard library" of Triton kernels. Maintained by stackav-oss on GitHub, where it has earned 26 stars from the community.
1y ago
AI & ML
Community registry of LLM serving-path traps that produce confidently wrong measurements: templates, tool parsers, reasoning fields, quant kernel paths, CUDA toolchains, KV allocation, eval harnesses, versioning. Symptom-first, with the check that catches each. Maintained by Blackwellboy on GitHub, where it has earned 64 stars from the community.
2mo ago
