< cd ../gallery
An intelligent tuner for vLLM that automatically monitors GPU metrics, uses Bayesian optimization to tune parameters. Maintained by jranaraki on GitHub, where it has earned 66 stars from the community.
# install
pip install vllm-tunermore vLLM repos
Dashboards
Two-node DGX Spark/ASUS GX10 DeepSeek V4 Flash DSpark NVFP4 port for vLLM 0.25, with live dashboard and reproducible deployment. Maintained by Anemll on GitHub, where it has earned 36 stars from the community.
2mo ago
Dashboards
Real-time hardware and LLM inference monitoring — GPU, CPU, memory, and vLLM metrics streamed to a dashboard. Maintained by niklasfrick on GitHub, where it has earned 86 stars from the community.
2mo ago
AI & ML
Official implementation for Text Generation Beyond Discrete Token Sampling. Maintained by EvanZhuang on GitHub, where it has earned 26 stars from the community.
1y ago