< cd ../gallery
[DevTools]
llmux by Changroro
Run and manage both vLLM and llama.cpp model servers from one terminal UI + CLI — shared Docker Compose profiles, live tok/s, and cross-backend port/GPU conflict checks. NVIDIA + Linux. Maintained by Changroro on GitHub, where it has earned 22 stars from the community.
@Changroro
maintainer
★ 22 stars
# install
pip install llmuxmore vLLM repos
DevTools
Professional CLI toolkit for Modal GPU workflows, Docker Compose deployments, Python runtimes, model serving, and account/billing management. Maintained by PuxHocDL on GitHub, where it has earned 11 stars from the community.
3mo ago
DevTools
nvtop for vLLM — an interactive terminal dashboard for vLLM serving performance (concurrency, throughput, cache & KV memory, latency, spec-decode, GPU). Maintained by bryanvine on GitHub, where it has earned 10 stars from the community.
3mo ago
DevTools
Local diagnostic CLI for NVIDIA DGX Spark (GB10). Detects power caps, UMA pressure, thermal risk, CUDA 13/SM_121 wheel mismatches, Docker issues, and validates vLLM/Ollama/llama.cpp/SGLang recipes. Maintained by joeynyc on GitHub, where it has earned 101 stars from the community.
3mo ago
