< cd ../gallery
[AI & ML]

llamactl

Unified management and routing for llama.cpp, MLX and vLLM models with web dashboard.
lordmathis
@lordmathis
maintainer
★ 139 stars
go to website ↗github
llamactl — preview
llamactl repository preview
# README
Unified management and routing for llama.cpp, MLX and vLLM models with web dashboard. Maintained by lordmathis on GitHub, where it has earned 139 stars from the community.
It's actively developed around llama-cpp, llama-server, llamacpp, and is a solid reference for anyone building with these tools.
# tags
# install
npm install llamactl
languages
Go57%
CSS1%
last commit5w ago
licenseMIT
more vLLM repos

Ask MadeWithWhat

AI answers may contain mistakes — please double-check important details.