vllm-qwen2.5-coder-tool-parser by hanXen

nvtop for vLLM — an interactive terminal dashboard for vLLM serving performance (concurrency, throughput, cache & KV memory, latency, spec-decode, GPU). Maintained by bryanvine on GitHub, where it has earned 10 stars from the community.

Running Large Language Model easily. Maintained by janelu9 on GitHub, where it has earned 14 stars from the community.

A command-line interface tool for serving LLM using vLLM. Maintained by Chen-zexi on GitHub, where it has earned 507 stars from the community.