< cd ../gallery
[DevTools]
vllmstat
nvtop for vLLM — an interactive terminal dashboard for vLLM serving performance (concurrency, throughput, cache & KV memory, latency, spec-decode, GPU)
@bryanvine
maintainer
★ 10 stars
# README
nvtop for vLLM — an interactive terminal dashboard for vLLM serving performance (concurrency, throughput, cache & KV memory, latency, spec-decode, GPU). Maintained by bryanvine on GitHub, where it has earned 10 stars from the community.
It's actively developed around gpu, llm, monitoring, and is a solid reference for anyone building with these tools.
# tags
# install
npm install vllmstatlatest versions
v0.9.1↗more vLLM repos