< cd ../gallery
[AI & ML]
llamactl
Unified management and routing for llama.cpp, MLX and vLLM models with web dashboard.
@lordmathis
maintainer
★ 139 stars
# README
Unified management and routing for llama.cpp, MLX and vLLM models with web dashboard. Maintained by lordmathis on GitHub, where it has earned 139 stars from the community.
It's actively developed around llama-cpp, llama-server, llamacpp, and is a solid reference for anyone building with these tools.
# tags
# install
npm install llamactlmore vLLM repos