llmtop by InfraWhisperer

Policy-driven seamless lazy loading. Maintained by cloudpilot-ai on GitHub, where it has earned 29 stars from the community.

Run and manage both vLLM and llama.cpp model servers from one terminal UI + CLI — shared Docker Compose profiles, live tok/s, and cross-backend port/GPU conflict checks. NVIDIA + Linux. Maintained by Changroro on GitHub, where it has earned 22 stars from the community.

nvtop for vLLM — an interactive terminal dashboard for vLLM serving performance (concurrency, throughput, cache & KV memory, latency, spec-decode, GPU). Maintained by bryanvine on GitHub, where it has earned 10 stars from the community.