profile by jungledesh

htop for your LLM inference cluster. Maintained by InfraWhisperer on GitHub, where it has earned 17 stars from the community.

Run and manage both vLLM and llama.cpp model servers from one terminal UI + CLI — shared Docker Compose profiles, live tok/s, and cross-backend port/GPU conflict checks. NVIDIA + Linux. Maintained by Changroro on GitHub, where it has earned 22 stars from the community.

vllm. Maintained by gameofdimension on GitHub, where it has earned 31 stars from the community.