< cd ../gallery
[DevTools]

vllmstat

nvtop for vLLM — an interactive terminal dashboard for vLLM serving performance (concurrency, throughput, cache & KV memory, latency, spec-decode, GPU)
bryanvine
@bryanvine
maintainer
★ 10 stars
github
vllmstat — preview
vllmstat repository preview
# README
nvtop for vLLM — an interactive terminal dashboard for vLLM serving performance (concurrency, throughput, cache & KV memory, latency, spec-decode, GPU). Maintained by bryanvine on GitHub, where it has earned 10 stars from the community.
It's actively developed around gpu, llm, monitoring, and is a solid reference for anyone building with these tools.
# tags
# install
npm install vllmstat
languages
Python100%
last commit2mo ago
licenseApache-2.0
latest versions
v0.9.1
more vLLM repos

Ask MadeWithWhat

AI answers may contain mistakes — please double-check important details.