< cd ../gallery
[DevTools]
llmux
Run and manage both vLLM and llama.cpp model servers from one terminal UI + CLI — shared Docker Compose profiles, live tok/s, and cross-backend port/GPU conflict checks. NVIDIA + Linux.
@Changroro
maintainer
★ 22 stars
# README
Run and manage both vLLM and llama.cpp model servers from one terminal UI + CLI — shared Docker Compose profiles, live tok/s, and cross-backend port/GPU conflict checks. NVIDIA + Linux. Maintained by Changroro on GitHub, where it has earned 22 stars from the community.
It's actively developed around cli, docker-compose, gguf, and is a solid reference for anyone building with these tools.
# tags
# install
npm install llmuxmore vLLM repos
