< cd ../gallery
nvtop for vLLM — an interactive terminal dashboard for vLLM serving performance (concurrency, throughput, cache & KV memory, latency, spec-decode, GPU). Maintained by bryanvine on GitHub, where it has earned 10 stars from the community.
@bryanvine
maintainer
★ 10 stars
# install
pip install vllmstatlatest versions
v0.9.1↗more vLLM repos
DevTools
Run and manage both vLLM and llama.cpp model servers from one terminal UI + CLI — shared Docker Compose profiles, live tok/s, and cross-backend port/GPU conflict checks. NVIDIA + Linux. Maintained by Changroro on GitHub, where it has earned 22 stars from the community.
2mo ago
DevTools
vLLM tool parser for Qwen2.5-Coder models using <tools> tag format. Maintained by hanXen on GitHub, where it has earned 12 stars from the community.
5mo ago
DevTools
A command-line interface tool for serving LLM using vLLM. Maintained by Chen-zexi on GitHub, where it has earned 507 stars from the community.
8mo ago
