< cd ../gallery
[AI & ML]
model-serving-minefield by Blackwellboy
Community registry of LLM serving-path traps that produce confidently wrong measurements: templates, tool parsers, reasoning fields, quant kernel paths, CUDA toolchains, KV allocation, eval harnesses, versioning. Symptom-first, with the check that catches each. Maintained by Blackwellboy on GitHub, where it has earned 64 stars from the community.
@Blackwellboy
maintainer
★ 64 stars
# install
pip install model-serving-minefieldmore vLLM repos
AI & ML
Dual-engine (llama.cpp + vLLM) LLM benchmarking pipeline for GGUF & safetensors on NVIDIA GPUs — speed, quality, live dashboard, publishable cards. Maintained by notwitcheer on GitHub, where it has earned 26 stars from the community.
8w ago
AI & ML
Local LLM speed measurements from a 4x RTX 3090 rig, with exact launch commands and per-run provenance. Maintained by alesha-pro on GitHub, where it has earned 13 stars from the community.
2mo ago
AI & ML
llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deployment, such as UI, RESTful API, auto-scaling, computing resource management, monitoring, and more. Maintained by OpenCSGs on GitHub, where it has earned 95 stars from the community.
2y ago
